2024-05-14T14:50:43.699 INFO:root:teuthology version: 0.0.1.dev271+g1ae7ad8 2024-05-14T14:50:43.699 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_vshankar@teuthology --verbose --description fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/postgres}} --name vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi --archive /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878 -- /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878/orig.config.yaml 2024-05-14T14:50:43.763 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-14T14:50:43.863 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878 branch: wip-vshankar-testing-20240509.053109-debug description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/postgres}} email: vshankar@redhat.com first_in_suite: false job_id: '7705878' kernel: flavor: default kdb: true sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing-20240509.053109-debug ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 standby_replay: true conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: e2b755a64f0d72176b57299d02e880cf0620d780 subvols: create: 2 subvol_options: --namespace-isolated ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 0 mountpoint: /tmp/cephfs check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: e2b755a64f0d72176b57299d02e880cf0620d780 kclient: client.0: mntopts: - context=system_u:object_r:postgresql_db_t:s0 mount_subvol_num: 1 mountpoint: /tmp/cephfs selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing-20240509.053109-debug sha1: e2b755a64f0d72176b57299d02e880cf0620d780 owner: scheduled_vshankar@teuthology priority: 120 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 6285 sha1: e2b755a64f0d72176b57299d02e880cf0620d780 sleep_before_teardown: 0 subset: 548/1024 suite: fs suite_branch: wip-vshankar-testing-20240509.053109-debug suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: e2b755a64f0d72176b57299d02e880cf0620d780 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi069.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFVTSATEondWaJSdgRY6kdk/ZTBWkk+ubUoyzp8T6nUPAAS9/lGJdNr6YpYY7QuWronnz1zShCj5icDrCXtKXx0= smithi092.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ6Nsr7eyxaj3OkHGBYHr8Z9HbsE2Cp2JkecWp4xZsntz3z1EQLl9H4IIlOihXD9cKGcoTslcQne5cF7XVkte3M= smithi203.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUF+A+T1wRajnKCWp0bJUM9x42LNW5q7GoSE9gbZwpLoAIMEVwT1EafiPSLSdBsbVU9KtpgFwcNj4YxV+tDndI= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - exec: client.0: - sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/ - sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres - sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data - sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?" - sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local - sudo restorecon -R -v /tmp/cephfs/postgres - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf - sudo -u postgres -- postgresql-setup --initdb - sudo ls -lZaR /tmp/cephfs/postgres/ - sudo systemctl start postgresql - sudo -u postgres -- pgbench -s 32 -i - sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900 - sudo systemctl stop postgresql - sudo ls -lZaR /tmp/cephfs/postgres/ teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 1ae7ad82388e92a475afff437d49054826c019a1 timestamp: 2024-05-14_07:04:04 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-05-14T14:50:43.863 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa; will attempt to use it 2024-05-14T14:50:43.863 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks 2024-05-14T14:50:43.864 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-14T14:50:43.865 INFO:teuthology.task.internal:Checking packages... 2024-05-14T14:50:43.887 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'e2b755a64f0d72176b57299d02e880cf0620d780' 2024-05-14T14:50:43.887 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-14T14:50:43.887 INFO:teuthology.packaging:ref: None 2024-05-14T14:50:43.888 INFO:teuthology.packaging:tag: None 2024-05-14T14:50:43.888 INFO:teuthology.packaging:branch: wip-vshankar-testing-20240509.053109-debug 2024-05-14T14:50:43.888 INFO:teuthology.packaging:sha1: e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T14:50:43.888 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing-20240509.053109-debug 2024-05-14T14:50:44.106 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3588.ge2b755a6 2024-05-14T14:50:44.108 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-14T14:50:44.114 INFO:teuthology.task.internal:no buildpackages task found 2024-05-14T14:50:44.114 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-14T14:50:44.135 INFO:teuthology.task.internal:Saving configuration 2024-05-14T14:50:44.158 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-14T14:50:44.164 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T14:50:44.189 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 14:45:26.170040', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFVTSATEondWaJSdgRY6kdk/ZTBWkk+ubUoyzp8T6nUPAAS9/lGJdNr6YpYY7QuWronnz1zShCj5icDrCXtKXx0='} 2024-05-14T14:50:44.211 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 14:45:26.172007', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ6Nsr7eyxaj3OkHGBYHr8Z9HbsE2Cp2JkecWp4xZsntz3z1EQLl9H4IIlOihXD9cKGcoTslcQne5cF7XVkte3M='} 2024-05-14T14:50:44.234 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 14:45:26.173776', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUF+A+T1wRajnKCWp0bJUM9x42LNW5q7GoSE9gbZwpLoAIMEVwT1EafiPSLSdBsbVU9KtpgFwcNj4YxV+tDndI='} 2024-05-14T14:50:44.235 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-14T14:50:44.241 INFO:teuthology.task.internal:roles: ubuntu@smithi069.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-05-14T14:50:44.241 INFO:teuthology.task.internal:roles: ubuntu@smithi092.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-05-14T14:50:44.241 INFO:teuthology.task.internal:roles: ubuntu@smithi203.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-05-14T14:50:44.241 INFO:teuthology.run_tasks:Running task console_log... 2024-05-14T14:50:44.342 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb00cd460d0>, signals=[15]) 2024-05-14T14:50:44.342 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-14T14:50:44.348 INFO:teuthology.task.internal:Opening connections... 2024-05-14T14:50:44.348 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi069.front.sepia.ceph.com 2024-05-14T14:50:44.350 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:50:44.430 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi092.front.sepia.ceph.com 2024-05-14T14:50:44.431 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:50:44.508 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi203.front.sepia.ceph.com 2024-05-14T14:50:44.508 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:50:44.580 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-14T14:50:44.587 DEBUG:teuthology.orchestra.run.smithi069:> uname -m 2024-05-14T14:50:44.605 INFO:teuthology.orchestra.run.smithi069.stdout:x86_64 2024-05-14T14:50:44.605 DEBUG:teuthology.orchestra.run.smithi069:> cat /etc/os-release 2024-05-14T14:50:44.662 INFO:teuthology.orchestra.run.smithi069.stdout:NAME="CentOS Stream" 2024-05-14T14:50:44.662 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION="9" 2024-05-14T14:50:44.662 INFO:teuthology.orchestra.run.smithi069.stdout:ID="centos" 2024-05-14T14:50:44.662 INFO:teuthology.orchestra.run.smithi069.stdout:ID_LIKE="rhel fedora" 2024-05-14T14:50:44.662 INFO:teuthology.orchestra.run.smithi069.stdout:VERSION_ID="9" 2024-05-14T14:50:44.662 INFO:teuthology.orchestra.run.smithi069.stdout:PLATFORM_ID="platform:el9" 2024-05-14T14:50:44.662 INFO:teuthology.orchestra.run.smithi069.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-14T14:50:44.662 INFO:teuthology.orchestra.run.smithi069.stdout:ANSI_COLOR="0;31" 2024-05-14T14:50:44.662 INFO:teuthology.orchestra.run.smithi069.stdout:LOGO="fedora-logo-icon" 2024-05-14T14:50:44.663 INFO:teuthology.orchestra.run.smithi069.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-14T14:50:44.663 INFO:teuthology.orchestra.run.smithi069.stdout:HOME_URL="https://centos.org/" 2024-05-14T14:50:44.663 INFO:teuthology.orchestra.run.smithi069.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-14T14:50:44.663 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-14T14:50:44.663 INFO:teuthology.orchestra.run.smithi069.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-14T14:50:44.663 INFO:teuthology.lock.ops:Updating smithi069.front.sepia.ceph.com on lock server 2024-05-14T14:50:44.688 DEBUG:teuthology.orchestra.run.smithi092:> uname -m 2024-05-14T14:50:44.705 INFO:teuthology.orchestra.run.smithi092.stdout:x86_64 2024-05-14T14:50:44.705 DEBUG:teuthology.orchestra.run.smithi092:> cat /etc/os-release 2024-05-14T14:50:44.762 INFO:teuthology.orchestra.run.smithi092.stdout:NAME="CentOS Stream" 2024-05-14T14:50:44.762 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION="9" 2024-05-14T14:50:44.762 INFO:teuthology.orchestra.run.smithi092.stdout:ID="centos" 2024-05-14T14:50:44.762 INFO:teuthology.orchestra.run.smithi092.stdout:ID_LIKE="rhel fedora" 2024-05-14T14:50:44.762 INFO:teuthology.orchestra.run.smithi092.stdout:VERSION_ID="9" 2024-05-14T14:50:44.762 INFO:teuthology.orchestra.run.smithi092.stdout:PLATFORM_ID="platform:el9" 2024-05-14T14:50:44.762 INFO:teuthology.orchestra.run.smithi092.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-14T14:50:44.762 INFO:teuthology.orchestra.run.smithi092.stdout:ANSI_COLOR="0;31" 2024-05-14T14:50:44.763 INFO:teuthology.orchestra.run.smithi092.stdout:LOGO="fedora-logo-icon" 2024-05-14T14:50:44.763 INFO:teuthology.orchestra.run.smithi092.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-14T14:50:44.763 INFO:teuthology.orchestra.run.smithi092.stdout:HOME_URL="https://centos.org/" 2024-05-14T14:50:44.763 INFO:teuthology.orchestra.run.smithi092.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-14T14:50:44.763 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-14T14:50:44.763 INFO:teuthology.orchestra.run.smithi092.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-14T14:50:44.763 INFO:teuthology.lock.ops:Updating smithi092.front.sepia.ceph.com on lock server 2024-05-14T14:50:44.788 DEBUG:teuthology.orchestra.run.smithi203:> uname -m 2024-05-14T14:50:44.805 INFO:teuthology.orchestra.run.smithi203.stdout:x86_64 2024-05-14T14:50:44.805 DEBUG:teuthology.orchestra.run.smithi203:> cat /etc/os-release 2024-05-14T14:50:44.862 INFO:teuthology.orchestra.run.smithi203.stdout:NAME="CentOS Stream" 2024-05-14T14:50:44.862 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION="9" 2024-05-14T14:50:44.863 INFO:teuthology.orchestra.run.smithi203.stdout:ID="centos" 2024-05-14T14:50:44.863 INFO:teuthology.orchestra.run.smithi203.stdout:ID_LIKE="rhel fedora" 2024-05-14T14:50:44.863 INFO:teuthology.orchestra.run.smithi203.stdout:VERSION_ID="9" 2024-05-14T14:50:44.863 INFO:teuthology.orchestra.run.smithi203.stdout:PLATFORM_ID="platform:el9" 2024-05-14T14:50:44.863 INFO:teuthology.orchestra.run.smithi203.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-14T14:50:44.863 INFO:teuthology.orchestra.run.smithi203.stdout:ANSI_COLOR="0;31" 2024-05-14T14:50:44.863 INFO:teuthology.orchestra.run.smithi203.stdout:LOGO="fedora-logo-icon" 2024-05-14T14:50:44.863 INFO:teuthology.orchestra.run.smithi203.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-14T14:50:44.863 INFO:teuthology.orchestra.run.smithi203.stdout:HOME_URL="https://centos.org/" 2024-05-14T14:50:44.863 INFO:teuthology.orchestra.run.smithi203.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-14T14:50:44.863 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-14T14:50:44.863 INFO:teuthology.orchestra.run.smithi203.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-14T14:50:44.864 INFO:teuthology.lock.ops:Updating smithi203.front.sepia.ceph.com on lock server 2024-05-14T14:50:44.888 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-14T14:50:44.898 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-14T14:50:44.904 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-14T14:50:44.904 DEBUG:teuthology.orchestra.run.smithi069:> test '!' -e /home/ubuntu/cephtest 2024-05-14T14:50:44.906 DEBUG:teuthology.orchestra.run.smithi092:> test '!' -e /home/ubuntu/cephtest 2024-05-14T14:50:44.909 DEBUG:teuthology.orchestra.run.smithi203:> test '!' -e /home/ubuntu/cephtest 2024-05-14T14:50:44.924 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-14T14:50:44.930 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-14T14:50:44.930 DEBUG:teuthology.orchestra.run.smithi069:> test -z $(ls -A /var/lib/ceph) 2024-05-14T14:50:44.963 DEBUG:teuthology.orchestra.run.smithi092:> test -z $(ls -A /var/lib/ceph) 2024-05-14T14:50:44.965 DEBUG:teuthology.orchestra.run.smithi203:> test -z $(ls -A /var/lib/ceph) 2024-05-14T14:50:45.073 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-14T14:50:45.145 INFO:teuthology.run_tasks:Running task kernel... 2024-05-14T14:50:45.158 INFO:teuthology.task.kernel:normalize config orig: {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'} 2024-05-14T14:50:45.159 INFO:teuthology.task.kernel:config {'mon.a': {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'}, 'mon.b': {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'}, 'mon.c': {'flavor': 'default', 'kdb': True, 'sha1': 'fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e'}}, timeout 300 2024-05-14T14:50:45.159 DEBUG:teuthology.orchestra.run.smithi069:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T14:50:45.159 DEBUG:teuthology.orchestra.run.smithi092:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T14:50:45.160 DEBUG:teuthology.orchestra.run.smithi203:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-14T14:50:45.175 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T14:50:45.176 DEBUG:teuthology.task.kernel:sha1 for mon.b is fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T14:50:45.176 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e"... 2024-05-14T14:50:45.176 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-05-14T14:50:45.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T14:50:45.177 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T14:50:45.178 DEBUG:teuthology.task.kernel:sha1 for mon.c is fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T14:50:45.178 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e"... 2024-05-14T14:50:45.178 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-05-14T14:50:45.178 DEBUG:teuthology.task.kernel:sha1 for mon.a is fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T14:50:45.178 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e"... 2024-05-14T14:50:45.179 DEBUG:teuthology.orchestra.run.smithi069:> uname -r 2024-05-14T14:50:45.232 INFO:teuthology.orchestra.run.smithi092.stdout:5.14.0-437.el9.x86_64 2024-05-14T14:50:45.232 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T14:50:45.233 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-14T14:50:45.233 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T14:50:45.237 INFO:teuthology.orchestra.run.smithi069.stdout:5.14.0-437.el9.x86_64 2024-05-14T14:50:45.237 INFO:teuthology.orchestra.run.smithi203.stdout:5.14.0-437.el9.x86_64 2024-05-14T14:50:45.237 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T14:50:45.238 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-14T14:50:45.238 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T14:50:45.239 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-437.el9.x86_64 vs fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T14:50:45.239 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2024-05-14T14:50:45.239 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T14:50:45.394 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum upgrade -y linux-firmware 2024-05-14T14:50:45.410 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum upgrade -y linux-firmware 2024-05-14T14:50:45.453 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum upgrade -y linux-firmware 2024-05-14T14:50:47.690 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-05-14T14:50:47.740 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - BaseOS 12 MB/s | 8.1 MB 00:00 2024-05-14T14:50:49.442 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 29 MB/s | 19 MB 00:00 2024-05-14T14:50:49.685 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.1 MB 00:02 2024-05-14T14:50:50.108 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - AppStream 15 MB/s | 19 MB 00:01 2024-05-14T14:50:51.986 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 16 MB/s | 19 MB 00:01 2024-05-14T14:50:53.909 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.2 MB 00:00 2024-05-14T14:50:54.226 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.2 MB 00:00 2024-05-14T14:50:55.527 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 16 kB 00:00 2024-05-14T14:50:55.842 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - Extras packages 58 kB/s | 16 kB 00:00 2024-05-14T14:50:56.294 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 8.8 MB/s | 6.2 MB 00:00 2024-05-14T14:50:57.314 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-14T14:50:57.602 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-14T14:50:57.778 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 16 kB 00:00 2024-05-14T14:50:58.563 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 33 MB/s | 21 MB 00:00 2024-05-14T14:51:02.553 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 20 kB/s | 1.7 kB 00:00 2024-05-14T14:51:02.802 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-14T14:51:03.654 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-05-14T14:51:04.684 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-05-14T14:51:04.685 INFO:teuthology.orchestra.run.smithi203.stdout:Nothing to do. 2024-05-14T14:51:04.686 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-05-14T14:51:04.804 INFO:teuthology.task.kernel:Downloading kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.c... 2024-05-14T14:51:04.804 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T14:51:04.895 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-05-14T14:51:04.896 INFO:teuthology.orchestra.run.smithi069.stdout:Nothing to do. 2024-05-14T14:51:04.896 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-05-14T14:51:04.999 INFO:teuthology.task.kernel:Downloading kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.a... 2024-05-14T14:51:04.999 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T14:51:05.023 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ 2024-05-14T14:51:05.024 DEBUG:teuthology.orchestra.run.smithi203:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-14T14:51:05.026 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi203.front.sepia.ceph.com to complete... 2024-05-14T14:51:05.222 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ 2024-05-14T14:51:05.222 DEBUG:teuthology.orchestra.run.smithi069:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-14T14:51:05.224 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi069.front.sepia.ceph.com to complete... 2024-05-14T14:51:05.749 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-05-14T14:51:05.749 INFO:teuthology.orchestra.run.smithi092.stdout:Nothing to do. 2024-05-14T14:51:05.749 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-05-14T14:51:05.849 INFO:teuthology.task.kernel:Downloading kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.b... 2024-05-14T14:51:05.850 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e 2024-05-14T14:51:06.069 INFO:teuthology.task.kernel:fetching, builder baseurl is https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ 2024-05-14T14:51:06.069 DEBUG:teuthology.orchestra.run.smithi092:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/ --input-file=- 2024-05-14T14:51:06.071 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi092.front.sepia.ceph.com to complete... 2024-05-14T14:51:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14 14:51:26 URL:https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm [357387737/357387737] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-14T14:51:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:FINISHED --2024-05-14 14:51:26-- 2024-05-14T14:51:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:Total wall clock time: 22s 2024-05-14T14:51:26.846 INFO:teuthology.orchestra.run.smithi069.stderr:Downloaded: 1 files, 341M in 21s (16.1 MB/s) 2024-05-14T14:51:26.849 INFO:teuthology.task.kernel:Installing kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.a... 2024-05-14T14:51:26.849 DEBUG:teuthology.orchestra.run.smithi069:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-14T14:51:28.927 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying... ######################################## 2024-05-14T14:51:29.048 INFO:teuthology.orchestra.run.smithi069.stdout:Preparing... ######################################## 2024-05-14T14:51:29.151 INFO:teuthology.orchestra.run.smithi069.stdout:Updating / installing... 2024-05-14T14:51:37.077 INFO:teuthology.orchestra.run.smithi069.stdout:kernel-6.9.0_rc3_gfb9a6a44107e-1 ######################################## 2024-05-14T14:51:37.263 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14 14:51:37 URL:https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm [357387737/357387737] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-14T14:51:37.263 INFO:teuthology.orchestra.run.smithi203.stderr:FINISHED --2024-05-14 14:51:37-- 2024-05-14T14:51:37.263 INFO:teuthology.orchestra.run.smithi203.stderr:Total wall clock time: 32s 2024-05-14T14:51:37.263 INFO:teuthology.orchestra.run.smithi203.stderr:Downloaded: 1 files, 341M in 32s (10.7 MB/s) 2024-05-14T14:51:37.268 INFO:teuthology.task.kernel:Installing kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.c... 2024-05-14T14:51:37.268 DEBUG:teuthology.orchestra.run.smithi203:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-14T14:51:40.613 INFO:teuthology.orchestra.run.smithi203.stdout:Verifying... ######################################## 2024-05-14T14:51:40.847 INFO:teuthology.orchestra.run.smithi203.stdout:Preparing... ######################################## 2024-05-14T14:51:40.958 INFO:teuthology.orchestra.run.smithi203.stdout:Updating / installing... 2024-05-14T14:51:42.985 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14 14:51:43 URL:https://2.chacra.ceph.com/r/kernel/testing/fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e/centos/9/flavors/default/x86_64/kernel-6.9.0_rc3_gfb9a6a44107e-1.x86_64.rpm [357387737/357387737] -> "/tmp/kernel.x86_64.rpm" [1] 2024-05-14T14:51:42.985 INFO:teuthology.orchestra.run.smithi092.stderr:FINISHED --2024-05-14 14:51:43-- 2024-05-14T14:51:42.985 INFO:teuthology.orchestra.run.smithi092.stderr:Total wall clock time: 37s 2024-05-14T14:51:42.985 INFO:teuthology.orchestra.run.smithi092.stderr:Downloaded: 1 files, 341M in 37s (9.33 MB/s) 2024-05-14T14:51:43.020 INFO:teuthology.task.kernel:Installing kernel fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e on mon.b... 2024-05-14T14:51:43.020 DEBUG:teuthology.orchestra.run.smithi092:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2024-05-14T14:51:45.879 INFO:teuthology.orchestra.run.smithi092.stdout:Verifying... ######################################## 2024-05-14T14:51:46.133 INFO:teuthology.orchestra.run.smithi092.stdout:Preparing... ######################################## 2024-05-14T14:51:46.246 INFO:teuthology.orchestra.run.smithi092.stdout:Updating / installing... 2024-05-14T14:51:48.854 INFO:teuthology.orchestra.run.smithi203.stdout:kernel-6.9.0_rc3_gfb9a6a44107e-1 ######################################## 2024-05-14T14:51:54.185 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-6.9.0_rc3_gfb9a6a44107e-1 ######################################## 2024-05-14T14:52:15.595 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi069.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-14T14:52:15.595 DEBUG:teuthology.orchestra.run.smithi069:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-14T14:52:15.679 INFO:teuthology.orchestra.run.smithi069.stdout:/boot/System.map-6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:15.679 INFO:teuthology.orchestra.run.smithi069.stdout:/boot/config-6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:15.679 INFO:teuthology.orchestra.run.smithi069.stdout:/boot/vmlinuz-6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:15.679 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/System.map 2024-05-14T14:52:15.679 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/config 2024-05-14T14:52:15.679 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel 2024-05-14T14:52:15.680 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch 2024-05-14T14:52:15.680 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86 2024-05-14T14:52:15.680 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto 2024-05-14T14:52:15.680 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-14T14:52:15.680 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-14T14:52:15.680 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-14T14:52:15.680 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-14T14:52:15.680 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-14T14:52:15.680 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-14T14:52:15.680 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-14T14:52:15.680 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-14T14:52:15.681 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-14T14:52:15.681 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-14T14:52:15.681 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-14T14:52:15.681 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-14T14:52:15.681 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-14T14:52:15.681 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-14T14:52:15.681 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-14T14:52:15.681 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-14T14:52:15.681 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-14T14:52:15.681 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-14T14:52:15.681 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-14T14:52:15.681 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-14T14:52:15.681 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel 2024-05-14T14:52:15.681 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu 2024-05-14T14:52:15.681 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce 2024-05-14T14:52:15.682 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-14T14:52:15.682 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm 2024-05-14T14:52:15.682 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-14T14:52:15.682 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-14T14:52:15.682 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm.ko 2024-05-14T14:52:15.682 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto 2024-05-14T14:52:15.682 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ansi_cprng.ko 2024-05-14T14:52:15.682 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/anubis.ko 2024-05-14T14:52:15.682 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/arc4.ko 2024-05-14T14:52:15.682 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx 2024-05-14T14:52:15.682 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_memcpy.ko 2024-05-14T14:52:15.682 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_pq.ko 2024-05-14T14:52:15.682 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-14T14:52:15.682 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_tx.ko 2024-05-14T14:52:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_xor.ko 2024-05-14T14:52:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/raid6test.ko 2024-05-14T14:52:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authenc.ko 2024-05-14T14:52:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authencesn.ko 2024-05-14T14:52:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blake2b_generic.ko 2024-05-14T14:52:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_common.ko 2024-05-14T14:52:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_generic.ko 2024-05-14T14:52:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/camellia_generic.ko 2024-05-14T14:52:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast5_generic.ko 2024-05-14T14:52:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast6_generic.ko 2024-05-14T14:52:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast_common.ko 2024-05-14T14:52:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ccm.ko 2024-05-14T14:52:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cmac.ko 2024-05-14T14:52:15.683 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crc32_generic.ko 2024-05-14T14:52:15.684 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_engine.ko 2024-05-14T14:52:15.684 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_user.ko 2024-05-14T14:52:15.684 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cts.ko 2024-05-14T14:52:15.684 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/des_generic.ko 2024-05-14T14:52:15.684 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/dh_generic.ko 2024-05-14T14:52:15.684 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/echainiv.ko 2024-05-14T14:52:15.684 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/essiv.ko 2024-05-14T14:52:15.684 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/fcrypt.ko 2024-05-14T14:52:15.684 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/khazad.ko 2024-05-14T14:52:15.684 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4.ko 2024-05-14T14:52:15.684 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4hc.ko 2024-05-14T14:52:15.684 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/md4.ko 2024-05-14T14:52:15.684 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/michael_mic.ko 2024-05-14T14:52:15.684 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcbc.ko 2024-05-14T14:52:15.685 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcrypt.ko 2024-05-14T14:52:15.685 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/rmd160.ko 2024-05-14T14:52:15.685 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/seed.ko 2024-05-14T14:52:15.685 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/serpent_generic.ko 2024-05-14T14:52:15.685 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tcrypt.ko 2024-05-14T14:52:15.685 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tea.ko 2024-05-14T14:52:15.685 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_common.ko 2024-05-14T14:52:15.685 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_generic.ko 2024-05-14T14:52:15.685 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/vmac.ko 2024-05-14T14:52:15.685 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/wp512.ko 2024-05-14T14:52:15.685 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xcbc.ko 2024-05-14T14:52:15.685 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xor.ko 2024-05-14T14:52:15.685 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xxhash_generic.ko 2024-05-14T14:52:15.686 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers 2024-05-14T14:52:15.686 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi 2024-05-14T14:52:15.686 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-14T14:52:15.686 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_pad.ko 2024-05-14T14:52:15.686 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/ec_sys.ko 2024-05-14T14:52:15.686 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/platform_profile.ko 2024-05-14T14:52:15.686 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbs.ko 2024-05-14T14:52:15.686 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbshc.ko 2024-05-14T14:52:15.686 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/video.ko 2024-05-14T14:52:15.686 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata 2024-05-14T14:52:15.686 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/acard-ahci.ko 2024-05-14T14:52:15.686 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ahci_platform.ko 2024-05-14T14:52:15.686 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ata_generic.ko 2024-05-14T14:52:15.686 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/libahci_platform.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_acpi.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ali.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_amd.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_artop.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atiixp.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atp867x.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd640.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd64x.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cypress.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_efar.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt366.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt37x.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it8213.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it821x.ko 2024-05-14T14:52:15.687 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_jmicron.ko 2024-05-14T14:52:15.688 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_marvell.ko 2024-05-14T14:52:15.688 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_mpiix.ko 2024-05-14T14:52:15.688 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_netcell.ko 2024-05-14T14:52:15.688 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ninja32.ko 2024-05-14T14:52:15.688 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87410.ko 2024-05-14T14:52:15.688 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87415.ko 2024-05-14T14:52:15.688 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_oldpiix.ko 2024-05-14T14:52:15.688 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_opti.ko 2024-05-14T14:52:15.688 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_optidma.ko 2024-05-14T14:52:15.688 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pcmcia.ko 2024-05-14T14:52:15.688 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-14T14:52:15.688 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-14T14:52:15.688 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_piccolo.ko 2024-05-14T14:52:15.688 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_rdc.ko 2024-05-14T14:52:15.688 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sch.ko 2024-05-14T14:52:15.689 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_serverworks.ko 2024-05-14T14:52:15.689 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sil680.ko 2024-05-14T14:52:15.689 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sis.ko 2024-05-14T14:52:15.689 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sl82c105.ko 2024-05-14T14:52:15.689 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_triflex.ko 2024-05-14T14:52:15.689 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_via.ko 2024-05-14T14:52:15.689 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pdc_adma.ko 2024-05-14T14:52:15.689 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_inic162x.ko 2024-05-14T14:52:15.689 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_mv.ko 2024-05-14T14:52:15.689 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_nv.ko 2024-05-14T14:52:15.689 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_promise.ko 2024-05-14T14:52:15.689 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_qstor.ko 2024-05-14T14:52:15.689 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil.ko 2024-05-14T14:52:15.689 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil24.ko 2024-05-14T14:52:15.689 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sis.ko 2024-05-14T14:52:15.689 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_svw.ko 2024-05-14T14:52:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sx4.ko 2024-05-14T14:52:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_uli.ko 2024-05-14T14:52:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_via.ko 2024-05-14T14:52:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_vsc.ko 2024-05-14T14:52:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay 2024-05-14T14:52:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay/ks0108.ko 2024-05-14T14:52:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base 2024-05-14T14:52:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap 2024-05-14T14:52:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-14T14:52:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-14T14:52:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma 2024-05-14T14:52:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma/bcma.ko 2024-05-14T14:52:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block 2024-05-14T14:52:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe 2024-05-14T14:52:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe/aoe.ko 2024-05-14T14:52:15.690 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/brd.ko 2024-05-14T14:52:15.691 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd 2024-05-14T14:52:15.691 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd/drbd.ko 2024-05-14T14:52:15.691 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/floppy.ko 2024-05-14T14:52:15.691 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/loop.ko 2024-05-14T14:52:15.691 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx 2024-05-14T14:52:15.691 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-14T14:52:15.691 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/nbd.ko 2024-05-14T14:52:15.691 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk 2024-05-14T14:52:15.691 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk/null_blk.ko 2024-05-14T14:52:15.691 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/pktcdvd.ko 2024-05-14T14:52:15.691 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/rbd.ko 2024-05-14T14:52:15.691 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/virtio_blk.ko 2024-05-14T14:52:15.691 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback 2024-05-14T14:52:15.691 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-14T14:52:15.691 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkfront.ko 2024-05-14T14:52:15.691 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram 2024-05-14T14:52:15.692 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram/zram.ko 2024-05-14T14:52:15.692 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char 2024-05-14T14:52:15.692 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hangcheck-timer.ko 2024-05-14T14:52:15.692 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random 2024-05-14T14:52:15.692 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-14T14:52:15.692 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-14T14:52:15.692 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-14T14:52:15.692 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/via-rng.ko 2024-05-14T14:52:15.692 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-14T14:52:15.692 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi 2024-05-14T14:52:15.692 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-14T14:52:15.692 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-14T14:52:15.692 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-14T14:52:15.692 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-14T14:52:15.692 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-14T14:52:15.692 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-14T14:52:15.693 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/lp.ko 2024-05-14T14:52:15.693 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave 2024-05-14T14:52:15.693 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave/mwave.ko 2024-05-14T14:52:15.693 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ppdev.ko 2024-05-14T14:52:15.693 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tlclk.ko 2024-05-14T14:52:15.693 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm 2024-05-14T14:52:15.693 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm.ko 2024-05-14T14:52:15.693 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-14T14:52:15.693 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-14T14:52:15.693 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-14T14:52:15.693 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-14T14:52:15.693 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-14T14:52:15.693 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/uv_mmtimer.ko 2024-05-14T14:52:15.694 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/virtio_console.ko 2024-05-14T14:52:15.694 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq 2024-05-14T14:52:15.694 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-14T14:52:15.694 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-14T14:52:15.694 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-14T14:52:15.694 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-14T14:52:15.694 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-14T14:52:15.694 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-14T14:52:15.694 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto 2024-05-14T14:52:15.694 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp 2024-05-14T14:52:15.694 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-14T14:52:15.694 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp.ko 2024-05-14T14:52:15.694 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel 2024-05-14T14:52:15.694 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat 2024-05-14T14:52:15.694 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common 2024-05-14T14:52:15.694 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-14T14:52:15.695 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-14T14:52:15.695 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-14T14:52:15.695 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-aes.ko 2024-05-14T14:52:15.695 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-sha.ko 2024-05-14T14:52:15.695 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio 2024-05-14T14:52:15.695 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-14T14:52:15.695 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca 2024-05-14T14:52:15.695 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca/dca.ko 2024-05-14T14:52:15.695 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq 2024-05-14T14:52:15.695 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-14T14:52:15.695 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma 2024-05-14T14:52:15.695 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw 2024-05-14T14:52:15.695 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-14T14:52:15.695 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat 2024-05-14T14:52:15.696 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-14T14:52:15.696 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac 2024-05-14T14:52:15.696 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/amd64_edac.ko 2024-05-14T14:52:15.696 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/e752x_edac.ko 2024-05-14T14:52:15.696 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/edac_mce_amd.ko 2024-05-14T14:52:15.696 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3000_edac.ko 2024-05-14T14:52:15.696 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3200_edac.ko 2024-05-14T14:52:15.696 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5100_edac.ko 2024-05-14T14:52:15.696 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5400_edac.ko 2024-05-14T14:52:15.696 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7300_edac.ko 2024-05-14T14:52:15.696 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7core_edac.ko 2024-05-14T14:52:15.696 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i82975x_edac.ko 2024-05-14T14:52:15.696 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/ie31200_edac.ko 2024-05-14T14:52:15.696 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/sb_edac.ko 2024-05-14T14:52:15.696 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/x38_edac.ko 2024-05-14T14:52:15.697 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware 2024-05-14T14:52:15.697 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/edd.ko 2024-05-14T14:52:15.697 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-14T14:52:15.697 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio 2024-05-14T14:52:15.697 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-ich.ko 2024-05-14T14:52:15.697 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-14T14:52:15.697 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid 2024-05-14T14:52:15.697 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-appleir.ko 2024-05-14T14:52:15.697 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-aureal.ko 2024-05-14T14:52:15.697 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-axff.ko 2024-05-14T14:52:15.697 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-dr.ko 2024-05-14T14:52:15.697 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elecom.ko 2024-05-14T14:52:15.697 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elo.ko 2024-05-14T14:52:15.697 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-emsff.ko 2024-05-14T14:52:15.698 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gaff.ko 2024-05-14T14:52:15.698 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gt683r.ko 2024-05-14T14:52:15.698 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gyration.ko 2024-05-14T14:52:15.698 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-14T14:52:15.698 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-14T14:52:15.698 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtekff.ko 2024-05-14T14:52:15.698 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-hyperv.ko 2024-05-14T14:52:15.698 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-icade.ko 2024-05-14T14:52:15.698 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-keytouch.ko 2024-05-14T14:52:15.698 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-kye.ko 2024-05-14T14:52:15.698 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lcpower.ko 2024-05-14T14:52:15.698 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-led.ko 2024-05-14T14:52:15.698 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lenovo.ko 2024-05-14T14:52:15.699 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-14T14:52:15.699 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-14T14:52:15.699 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-multitouch.ko 2024-05-14T14:52:15.699 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-ortek.ko 2024-05-14T14:52:15.699 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-penmount.ko 2024-05-14T14:52:15.699 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-petalynx.ko 2024-05-14T14:52:15.699 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-picolcd.ko 2024-05-14T14:52:15.699 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-pl.ko 2024-05-14T14:52:15.699 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-plantronics.ko 2024-05-14T14:52:15.699 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-primax.ko 2024-05-14T14:52:15.699 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-rmi.ko 2024-05-14T14:52:15.699 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-14T14:52:15.699 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-common.ko 2024-05-14T14:52:15.700 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-14T14:52:15.700 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-14T14:52:15.700 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-14T14:52:15.700 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-14T14:52:15.700 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-14T14:52:15.700 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-14T14:52:15.700 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-14T14:52:15.700 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-14T14:52:15.700 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-14T14:52:15.700 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat.ko 2024-05-14T14:52:15.700 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-saitek.ko 2024-05-14T14:52:15.700 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-samsung.ko 2024-05-14T14:52:15.700 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-14T14:52:15.700 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sjoy.ko 2024-05-14T14:52:15.701 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sony.ko 2024-05-14T14:52:15.701 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-speedlink.ko 2024-05-14T14:52:15.701 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-steelseries.ko 2024-05-14T14:52:15.701 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sunplus.ko 2024-05-14T14:52:15.701 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-14T14:52:15.701 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tivo.ko 2024-05-14T14:52:15.701 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tmff.ko 2024-05-14T14:52:15.701 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-topseed.ko 2024-05-14T14:52:15.701 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-twinhan.ko 2024-05-14T14:52:15.701 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-uclogic.ko 2024-05-14T14:52:15.701 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-waltop.ko 2024-05-14T14:52:15.701 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-wiimote.ko 2024-05-14T14:52:15.701 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-xinmo.ko 2024-05-14T14:52:15.701 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zpff.ko 2024-05-14T14:52:15.701 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zydacron.ko 2024-05-14T14:52:15.701 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/uhid.ko 2024-05-14T14:52:15.702 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/wacom.ko 2024-05-14T14:52:15.702 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv 2024-05-14T14:52:15.702 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_balloon.ko 2024-05-14T14:52:15.702 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_utils.ko 2024-05-14T14:52:15.702 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_vmbus.ko 2024-05-14T14:52:15.702 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon 2024-05-14T14:52:15.702 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru.ko 2024-05-14T14:52:15.702 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru3.ko 2024-05-14T14:52:15.702 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-14T14:52:15.702 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7414.ko 2024-05-14T14:52:15.702 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7418.ko 2024-05-14T14:52:15.702 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adc128d818.ko 2024-05-14T14:52:15.702 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1025.ko 2024-05-14T14:52:15.702 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1026.ko 2024-05-14T14:52:15.702 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1029.ko 2024-05-14T14:52:15.703 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1031.ko 2024-05-14T14:52:15.703 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm9240.ko 2024-05-14T14:52:15.703 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ads7828.ko 2024-05-14T14:52:15.703 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7410.ko 2024-05-14T14:52:15.703 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7411.ko 2024-05-14T14:52:15.703 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7462.ko 2024-05-14T14:52:15.703 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7470.ko 2024-05-14T14:52:15.703 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7475.ko 2024-05-14T14:52:15.703 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7x10.ko 2024-05-14T14:52:15.703 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/amc6821.ko 2024-05-14T14:52:15.703 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/applesmc.ko 2024-05-14T14:52:15.704 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asb100.ko 2024-05-14T14:52:15.704 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asc7621.ko 2024-05-14T14:52:15.704 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-14T14:52:15.704 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/atxp1.ko 2024-05-14T14:52:15.704 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/coretemp.ko 2024-05-14T14:52:15.704 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-14T14:52:15.704 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dme1737.ko 2024-05-14T14:52:15.704 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds1621.ko 2024-05-14T14:52:15.704 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds620.ko 2024-05-14T14:52:15.704 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc1403.ko 2024-05-14T14:52:15.704 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc6w201.ko 2024-05-14T14:52:15.704 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71805f.ko 2024-05-14T14:52:15.704 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71882fg.ko 2024-05-14T14:52:15.705 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f75375s.ko 2024-05-14T14:52:15.705 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fam15h_power.ko 2024-05-14T14:52:15.705 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fschmd.ko 2024-05-14T14:52:15.705 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g760a.ko 2024-05-14T14:52:15.705 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g762.ko 2024-05-14T14:52:15.705 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl518sm.ko 2024-05-14T14:52:15.705 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl520sm.ko 2024-05-14T14:52:15.705 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-14T14:52:15.705 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5500_temp.ko 2024-05-14T14:52:15.705 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5k_amb.ko 2024-05-14T14:52:15.705 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmaem.ko 2024-05-14T14:52:15.705 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmpex.ko 2024-05-14T14:52:15.705 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina209.ko 2024-05-14T14:52:15.705 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina2xx.ko 2024-05-14T14:52:15.705 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/it87.ko 2024-05-14T14:52:15.706 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k10temp.ko 2024-05-14T14:52:15.706 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k8temp.ko 2024-05-14T14:52:15.706 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lineage-pem.ko 2024-05-14T14:52:15.706 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm63.ko 2024-05-14T14:52:15.706 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm73.ko 2024-05-14T14:52:15.706 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm75.ko 2024-05-14T14:52:15.706 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm77.ko 2024-05-14T14:52:15.706 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm78.ko 2024-05-14T14:52:15.706 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm80.ko 2024-05-14T14:52:15.706 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm83.ko 2024-05-14T14:52:15.706 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm85.ko 2024-05-14T14:52:15.706 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm87.ko 2024-05-14T14:52:15.706 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm90.ko 2024-05-14T14:52:15.706 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm92.ko 2024-05-14T14:52:15.706 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm93.ko 2024-05-14T14:52:15.707 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95234.ko 2024-05-14T14:52:15.707 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95241.ko 2024-05-14T14:52:15.707 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95245.ko 2024-05-14T14:52:15.707 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc2945.ko 2024-05-14T14:52:15.707 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4151.ko 2024-05-14T14:52:15.707 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4215.ko 2024-05-14T14:52:15.707 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4222.ko 2024-05-14T14:52:15.707 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4245.ko 2024-05-14T14:52:15.707 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4260.ko 2024-05-14T14:52:15.707 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4261.ko 2024-05-14T14:52:15.707 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max16065.ko 2024-05-14T14:52:15.707 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1619.ko 2024-05-14T14:52:15.707 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1668.ko 2024-05-14T14:52:15.707 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max197.ko 2024-05-14T14:52:15.708 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6639.ko 2024-05-14T14:52:15.708 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6650.ko 2024-05-14T14:52:15.708 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6697.ko 2024-05-14T14:52:15.708 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/mcp3021.ko 2024-05-14T14:52:15.708 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6683.ko 2024-05-14T14:52:15.708 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775-core.ko 2024-05-14T14:52:15.708 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775.ko 2024-05-14T14:52:15.708 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct7802.ko 2024-05-14T14:52:15.708 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87360.ko 2024-05-14T14:52:15.708 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87427.ko 2024-05-14T14:52:15.708 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pcf8591.ko 2024-05-14T14:52:15.708 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus 2024-05-14T14:52:15.708 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-14T14:52:15.708 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-14T14:52:15.708 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-14T14:52:15.708 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-14T14:52:15.709 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-14T14:52:15.709 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-14T14:52:15.709 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-14T14:52:15.709 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-14T14:52:15.709 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-14T14:52:15.709 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-14T14:52:15.709 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-14T14:52:15.709 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-14T14:52:15.709 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/powr1220.ko 2024-05-14T14:52:15.709 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5627.ko 2024-05-14T14:52:15.709 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5636.ko 2024-05-14T14:52:15.709 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-14T14:52:15.709 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht15.ko 2024-05-14T14:52:15.709 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht21.ko 2024-05-14T14:52:15.709 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/shtc1.ko 2024-05-14T14:52:15.709 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sis5595.ko 2024-05-14T14:52:15.710 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47b397.ko 2024-05-14T14:52:15.710 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m1.ko 2024-05-14T14:52:15.710 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m192.ko 2024-05-14T14:52:15.710 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/thmc50.ko 2024-05-14T14:52:15.710 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp102.ko 2024-05-14T14:52:15.710 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp103.ko 2024-05-14T14:52:15.710 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp401.ko 2024-05-14T14:52:15.710 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp421.ko 2024-05-14T14:52:15.710 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via-cputemp.ko 2024-05-14T14:52:15.710 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via686a.ko 2024-05-14T14:52:15.710 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt1211.ko 2024-05-14T14:52:15.710 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt8231.ko 2024-05-14T14:52:15.710 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627ehf.ko 2024-05-14T14:52:15.710 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627hf.ko 2024-05-14T14:52:15.710 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83781d.ko 2024-05-14T14:52:15.710 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83791d.ko 2024-05-14T14:52:15.711 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83792d.ko 2024-05-14T14:52:15.711 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83793.ko 2024-05-14T14:52:15.711 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83795.ko 2024-05-14T14:52:15.711 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l785ts.ko 2024-05-14T14:52:15.711 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l786ng.ko 2024-05-14T14:52:15.711 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c 2024-05-14T14:52:15.711 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos 2024-05-14T14:52:15.711 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-14T14:52:15.711 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-14T14:52:15.711 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses 2024-05-14T14:52:15.711 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-14T14:52:15.711 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-14T14:52:15.711 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-14T14:52:15.711 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-14T14:52:15.711 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-14T14:52:15.711 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-14T14:52:15.712 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-14T14:52:15.712 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-14T14:52:15.712 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-14T14:52:15.712 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-14T14:52:15.712 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-14T14:52:15.712 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-14T14:52:15.712 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-14T14:52:15.712 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-14T14:52:15.712 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-14T14:52:15.712 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-14T14:52:15.712 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-14T14:52:15.712 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-14T14:52:15.712 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-14T14:52:15.712 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-14T14:52:15.712 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-14T14:52:15.713 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-14T14:52:15.713 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-14T14:52:15.713 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-dev.ko 2024-05-14T14:52:15.713 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-mux.ko 2024-05-14T14:52:15.713 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-14T14:52:15.713 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-smbus.ko 2024-05-14T14:52:15.713 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-stub.ko 2024-05-14T14:52:15.713 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband 2024-05-14T14:52:15.713 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core 2024-05-14T14:52:15.713 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-14T14:52:15.713 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_core.ko 2024-05-14T14:52:15.713 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-14T14:52:15.713 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-14T14:52:15.713 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-14T14:52:15.713 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-14T14:52:15.714 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-14T14:52:15.714 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw 2024-05-14T14:52:15.714 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4 2024-05-14T14:52:15.714 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-14T14:52:15.714 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4 2024-05-14T14:52:15.714 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-14T14:52:15.714 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5 2024-05-14T14:52:15.714 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-14T14:52:15.714 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca 2024-05-14T14:52:15.714 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-14T14:52:15.714 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp 2024-05-14T14:52:15.714 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib 2024-05-14T14:52:15.714 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-14T14:52:15.714 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser 2024-05-14T14:52:15.714 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-14T14:52:15.715 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert 2024-05-14T14:52:15.715 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-14T14:52:15.715 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp 2024-05-14T14:52:15.715 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-14T14:52:15.715 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt 2024-05-14T14:52:15.715 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-14T14:52:15.715 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input 2024-05-14T14:52:15.715 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport 2024-05-14T14:52:15.715 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-14T14:52:15.715 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-14T14:52:15.715 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/gameport.ko 2024-05-14T14:52:15.715 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/joydev.ko 2024-05-14T14:52:15.715 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard 2024-05-14T14:52:15.715 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-14T14:52:15.716 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse 2024-05-14T14:52:15.716 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/appletouch.ko 2024-05-14T14:52:15.716 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/bcm5974.ko 2024-05-14T14:52:15.716 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/cyapatp.ko 2024-05-14T14:52:15.716 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-14T14:52:15.716 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/sermouse.ko 2024-05-14T14:52:15.716 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-14T14:52:15.716 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-14T14:52:15.716 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-14T14:52:15.716 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4 2024-05-14T14:52:15.716 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-14T14:52:15.716 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio 2024-05-14T14:52:15.716 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/altera_ps2.ko 2024-05-14T14:52:15.716 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/arc_ps2.ko 2024-05-14T14:52:15.716 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-14T14:52:15.716 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/serio_raw.ko 2024-05-14T14:52:15.717 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/sparse-keymap.ko 2024-05-14T14:52:15.717 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds 2024-05-14T14:52:15.717 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-blinkm.ko 2024-05-14T14:52:15.717 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lm3530.ko 2024-05-14T14:52:15.717 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lp3944.ko 2024-05-14T14:52:15.717 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-ss4200.ko 2024-05-14T14:52:15.717 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger 2024-05-14T14:52:15.717 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-14T14:52:15.717 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-14T14:52:15.717 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-14T14:52:15.717 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-14T14:52:15.717 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-14T14:52:15.717 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-14T14:52:15.717 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-14T14:52:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-14T14:52:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-14T14:52:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md 2024-05-14T14:52:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache 2024-05-14T14:52:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache/bcache.ko 2024-05-14T14:52:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-bio-prison.ko 2024-05-14T14:52:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache-smq.ko 2024-05-14T14:52:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache.ko 2024-05-14T14:52:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-crypt.ko 2024-05-14T14:52:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-delay.ko 2024-05-14T14:52:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-flakey.ko 2024-05-14T14:52:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-log-userspace.ko 2024-05-14T14:52:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-multipath.ko 2024-05-14T14:52:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-queue-length.ko 2024-05-14T14:52:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-raid.ko 2024-05-14T14:52:15.718 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-round-robin.ko 2024-05-14T14:52:15.719 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-service-time.ko 2024-05-14T14:52:15.719 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-switch.ko 2024-05-14T14:52:15.719 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-thin-pool.ko 2024-05-14T14:52:15.719 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-verity.ko 2024-05-14T14:52:15.719 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data 2024-05-14T14:52:15.719 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-14T14:52:15.719 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid0.ko 2024-05-14T14:52:15.719 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid1.ko 2024-05-14T14:52:15.719 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid10.ko 2024-05-14T14:52:15.719 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid456.ko 2024-05-14T14:52:15.719 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message 2024-05-14T14:52:15.719 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion 2024-05-14T14:52:15.719 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptbase.ko 2024-05-14T14:52:15.720 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptctl.ko 2024-05-14T14:52:15.720 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptfc.ko 2024-05-14T14:52:15.720 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptlan.ko 2024-05-14T14:52:15.720 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptsas.ko 2024-05-14T14:52:15.720 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptscsih.ko 2024-05-14T14:52:15.720 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptspi.ko 2024-05-14T14:52:15.720 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd 2024-05-14T14:52:15.720 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_ich.ko 2024-05-14T14:52:15.720 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_sch.ko 2024-05-14T14:52:15.720 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/mfd-core.ko 2024-05-14T14:52:15.720 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/sm501.ko 2024-05-14T14:52:15.720 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/viperboard.ko 2024-05-14T14:52:15.720 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/vx855.ko 2024-05-14T14:52:15.720 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/wl1273-core.ko 2024-05-14T14:52:15.720 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc 2024-05-14T14:52:15.721 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl 2024-05-14T14:52:15.721 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-14T14:52:15.721 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds9802als.ko 2024-05-14T14:52:15.721 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds990x.ko 2024-05-14T14:52:15.721 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/bh1770glc.ko 2024-05-14T14:52:15.721 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710 2024-05-14T14:52:15.721 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710/cb710.ko 2024-05-14T14:52:15.721 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom 2024-05-14T14:52:15.721 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/at24.ko 2024-05-14T14:52:15.721 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-14T14:52:15.721 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/max6875.ko 2024-05-14T14:52:15.721 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/enclosure.ko 2024-05-14T14:52:15.721 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/hpilo.ko 2024-05-14T14:52:15.721 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29003.ko 2024-05-14T14:52:15.721 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29020.ko 2024-05-14T14:52:15.721 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d 2024-05-14T14:52:15.722 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-14T14:52:15.722 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-14T14:52:15.722 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei 2024-05-14T14:52:15.722 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-me.ko 2024-05-14T14:52:15.722 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-txe.ko 2024-05-14T14:52:15.722 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei.ko 2024-05-14T14:52:15.722 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru 2024-05-14T14:52:15.722 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-14T14:52:15.722 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp 2024-05-14T14:52:15.722 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-14T14:52:15.722 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-14T14:52:15.722 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-14T14:52:15.722 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_7xx1.ko 2024-05-14T14:52:15.722 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_core.ko 2024-05-14T14:52:15.722 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tsl2550.ko 2024-05-14T14:52:15.723 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_balloon.ko 2024-05-14T14:52:15.723 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci 2024-05-14T14:52:15.723 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-14T14:52:15.723 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net 2024-05-14T14:52:15.723 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding 2024-05-14T14:52:15.723 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding/bonding.ko 2024-05-14T14:52:15.723 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa 2024-05-14T14:52:15.723 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53 2024-05-14T14:52:15.723 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-14T14:52:15.723 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-14T14:52:15.723 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-14T14:52:15.723 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx 2024-05-14T14:52:15.723 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-14T14:52:15.723 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dummy.ko 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/eql.ko 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-14T14:52:15.724 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon 2024-05-14T14:52:15.725 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-14T14:52:15.725 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera 2024-05-14T14:52:15.725 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-14T14:52:15.725 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd 2024-05-14T14:52:15.725 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-14T14:52:15.725 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-14T14:52:15.725 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-14T14:52:15.725 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros 2024-05-14T14:52:15.725 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx 2024-05-14T14:52:15.725 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-14T14:52:15.725 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-14T14:52:15.725 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-14T14:52:15.726 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-14T14:52:15.726 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-14T14:52:15.726 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx 2024-05-14T14:52:15.726 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-14T14:52:15.726 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-14T14:52:15.726 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom 2024-05-14T14:52:15.726 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-14T14:52:15.726 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-14T14:52:15.726 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-14T14:52:15.726 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-14T14:52:15.726 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-14T14:52:15.726 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet 2024-05-14T14:52:15.726 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-14T14:52:15.726 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-14T14:52:15.726 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade 2024-05-14T14:52:15.727 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna 2024-05-14T14:52:15.727 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-14T14:52:15.727 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio 2024-05-14T14:52:15.727 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-14T14:52:15.727 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-14T14:52:15.727 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-14T14:52:15.727 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-14T14:52:15.727 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-14T14:52:15.727 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-14T14:52:15.727 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-14T14:52:15.727 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-14T14:52:15.727 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-14T14:52:15.727 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-14T14:52:15.728 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco 2024-05-14T14:52:15.728 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic 2024-05-14T14:52:15.728 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-14T14:52:15.728 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec 2024-05-14T14:52:15.728 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip 2024-05-14T14:52:15.728 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-14T14:52:15.728 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-14T14:52:15.728 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-14T14:52:15.728 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-14T14:52:15.728 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-14T14:52:15.728 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-14T14:52:15.728 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink 2024-05-14T14:52:15.728 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-14T14:52:15.728 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-14T14:52:15.729 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dnet.ko 2024-05-14T14:52:15.729 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex 2024-05-14T14:52:15.729 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet 2024-05-14T14:52:15.729 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-14T14:52:15.729 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ethoc.ko 2024-05-14T14:52:15.729 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/fealnx.ko 2024-05-14T14:52:15.729 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel 2024-05-14T14:52:15.729 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-14T14:52:15.729 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000 2024-05-14T14:52:15.729 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-14T14:52:15.729 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e 2024-05-14T14:52:15.729 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-14T14:52:15.729 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k 2024-05-14T14:52:15.729 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-14T14:52:15.729 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e 2024-05-14T14:52:15.730 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-14T14:52:15.730 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf 2024-05-14T14:52:15.730 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-14T14:52:15.730 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb 2024-05-14T14:52:15.730 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-14T14:52:15.730 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf 2024-05-14T14:52:15.730 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-14T14:52:15.730 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-14T14:52:15.730 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-14T14:52:15.730 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-14T14:52:15.730 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-14T14:52:15.730 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/jme.ko 2024-05-14T14:52:15.730 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell 2024-05-14T14:52:15.730 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-14T14:52:15.731 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-14T14:52:15.731 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-14T14:52:15.731 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox 2024-05-14T14:52:15.731 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-14T14:52:15.731 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-14T14:52:15.731 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-14T14:52:15.731 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-14T14:52:15.731 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-14T14:52:15.731 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-14T14:52:15.731 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel 2024-05-14T14:52:15.731 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-14T14:52:15.731 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom 2024-05-14T14:52:15.731 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-14T14:52:15.731 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-14T14:52:15.732 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi 2024-05-14T14:52:15.732 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-14T14:52:15.732 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-14T14:52:15.732 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion 2024-05-14T14:52:15.732 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-14T14:52:15.732 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia 2024-05-14T14:52:15.732 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-14T14:52:15.732 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines 2024-05-14T14:52:15.732 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-14T14:52:15.732 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-14T14:52:15.732 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic 2024-05-14T14:52:15.732 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-14T14:52:15.732 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-14T14:52:15.732 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-14T14:52:15.732 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-14T14:52:15.733 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-14T14:52:15.733 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc 2024-05-14T14:52:15.733 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-14T14:52:15.733 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek 2024-05-14T14:52:15.733 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-14T14:52:15.733 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-14T14:52:15.733 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-14T14:52:15.733 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-14T14:52:15.733 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker 2024-05-14T14:52:15.733 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-14T14:52:15.733 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc 2024-05-14T14:52:15.733 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-14T14:52:15.733 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan 2024-05-14T14:52:15.733 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-14T14:52:15.733 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis 2024-05-14T14:52:15.734 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-14T14:52:15.734 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-14T14:52:15.734 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc 2024-05-14T14:52:15.734 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-14T14:52:15.734 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-14T14:52:15.734 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-14T14:52:15.734 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-14T14:52:15.734 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro 2024-05-14T14:52:15.734 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-14T14:52:15.734 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-14T14:52:15.734 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-14T14:52:15.734 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun 2024-05-14T14:52:15.734 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/geneve.ko 2024-05-14T14:52:15.735 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv 2024-05-14T14:52:15.736 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-14T14:52:15.736 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154 2024-05-14T14:52:15.736 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-14T14:52:15.736 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ifb.ko 2024-05-14T14:52:15.736 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan 2024-05-14T14:52:15.736 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-14T14:52:15.736 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvlan.ko 2024-05-14T14:52:15.736 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvtap.ko 2024-05-14T14:52:15.736 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio 2024-05-14T14:52:15.736 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio.ko 2024-05-14T14:52:15.736 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-14T14:52:15.736 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-14T14:52:15.736 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-14T14:52:15.736 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mii.ko 2024-05-14T14:52:15.736 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/net_failover.ko 2024-05-14T14:52:15.736 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/netconsole.ko 2024-05-14T14:52:15.737 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/nlmon.ko 2024-05-14T14:52:15.737 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs 2024-05-14T14:52:15.737 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-14T14:52:15.737 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-14T14:52:15.737 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy 2024-05-14T14:52:15.737 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/amd.ko 2024-05-14T14:52:15.737 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-14T14:52:15.737 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-14T14:52:15.737 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-14T14:52:15.737 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm87xx.ko 2024-05-14T14:52:15.737 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/broadcom.ko 2024-05-14T14:52:15.737 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/cicada.ko 2024-05-14T14:52:15.737 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/davicom.ko 2024-05-14T14:52:15.737 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/dp83640.ko 2024-05-14T14:52:15.737 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/et1011c.ko 2024-05-14T14:52:15.737 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/icplus.ko 2024-05-14T14:52:15.738 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/lxt.ko 2024-05-14T14:52:15.738 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/marvell.ko 2024-05-14T14:52:15.738 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/micrel.ko 2024-05-14T14:52:15.738 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/national.ko 2024-05-14T14:52:15.738 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/phylink.ko 2024-05-14T14:52:15.738 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/qsemi.ko 2024-05-14T14:52:15.738 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/realtek.ko 2024-05-14T14:52:15.738 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/smsc.ko 2024-05-14T14:52:15.738 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/ste10Xp.ko 2024-05-14T14:52:15.738 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/vitesse.ko 2024-05-14T14:52:15.738 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp 2024-05-14T14:52:15.738 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-14T14:52:15.738 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_async.ko 2024-05-14T14:52:15.738 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-14T14:52:15.739 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-14T14:52:15.739 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-14T14:52:15.739 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-14T14:52:15.739 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppoe.ko 2024-05-14T14:52:15.739 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppox.ko 2024-05-14T14:52:15.739 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pptp.ko 2024-05-14T14:52:15.739 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip 2024-05-14T14:52:15.739 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slhc.ko 2024-05-14T14:52:15.739 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slip.ko 2024-05-14T14:52:15.739 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/sungem_phy.ko 2024-05-14T14:52:15.739 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tap.ko 2024-05-14T14:52:15.739 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team 2024-05-14T14:52:15.739 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team.ko 2024-05-14T14:52:15.739 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-14T14:52:15.739 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-14T14:52:15.739 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_random.ko 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tun.ko 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/veth.ko 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/virtio_net.ko 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan/vxlan.ko 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netfront.ko 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb/ntb.ko 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host 2024-05-14T14:52:15.740 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme-core.ko 2024-05-14T14:52:15.741 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme.ko 2024-05-14T14:52:15.741 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport 2024-05-14T14:52:15.741 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport.ko 2024-05-14T14:52:15.741 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_cs.ko 2024-05-14T14:52:15.741 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_pc.ko 2024-05-14T14:52:15.741 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_serial.ko 2024-05-14T14:52:15.741 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci 2024-05-14T14:52:15.741 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug 2024-05-14T14:52:15.741 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-14T14:52:15.741 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie 2024-05-14T14:52:15.741 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-14T14:52:15.741 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/xen-pcifront.ko 2024-05-14T14:52:15.741 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia 2024-05-14T14:52:15.741 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/i82092.ko 2024-05-14T14:52:15.741 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/pd6729.ko 2024-05-14T14:52:15.742 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-14T14:52:15.742 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl 2024-05-14T14:52:15.742 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel 2024-05-14T14:52:15.742 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-14T14:52:15.742 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform 2024-05-14T14:52:15.742 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86 2024-05-14T14:52:15.742 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-14T14:52:15.742 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acerhdf.ko 2024-05-14T14:52:15.742 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-14T14:52:15.742 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-14T14:52:15.742 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-14T14:52:15.742 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-14T14:52:15.742 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-14T14:52:15.742 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/hdaps.ko 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel_ips.ko 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-14T14:52:15.743 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi.ko 2024-05-14T14:52:15.744 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap 2024-05-14T14:52:15.744 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-14T14:52:15.744 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-14T14:52:15.744 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps 2024-05-14T14:52:15.744 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients 2024-05-14T14:52:15.744 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-14T14:52:15.744 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-14T14:52:15.744 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps_parport.ko 2024-05-14T14:52:15.744 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/pps_core.ko 2024-05-14T14:52:15.744 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp 2024-05-14T14:52:15.744 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp.ko 2024-05-14T14:52:15.744 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp_kvm.ko 2024-05-14T14:52:15.744 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras 2024-05-14T14:52:15.744 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd 2024-05-14T14:52:15.744 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl 2024-05-14T14:52:15.744 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/fmpm.ko 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-em3027.ko 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-14T14:52:15.745 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-max6900.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-x1205.ko 2024-05-14T14:52:15.746 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi 2024-05-14T14:52:15.747 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-9xxx.ko 2024-05-14T14:52:15.747 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-sas.ko 2024-05-14T14:52:15.747 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-xxxx.ko 2024-05-14T14:52:15.747 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/BusLogic.ko 2024-05-14T14:52:15.747 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/a100u2w.ko 2024-05-14T14:52:15.747 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid 2024-05-14T14:52:15.747 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-14T14:52:15.747 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/advansys.ko 2024-05-14T14:52:15.747 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx 2024-05-14T14:52:15.747 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-14T14:52:15.747 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-14T14:52:15.747 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/am53c974.ko 2024-05-14T14:52:15.748 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr 2024-05-14T14:52:15.748 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-14T14:52:15.748 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/atp870u.ko 2024-05-14T14:52:15.748 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi 2024-05-14T14:52:15.748 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-14T14:52:15.748 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa 2024-05-14T14:52:15.748 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa/bfa.ko 2024-05-14T14:52:15.748 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc 2024-05-14T14:52:15.748 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-14T14:52:15.748 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i 2024-05-14T14:52:15.748 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-14T14:52:15.748 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ch.ko 2024-05-14T14:52:15.748 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor 2024-05-14T14:52:15.748 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-14T14:52:15.748 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi 2024-05-14T14:52:15.748 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-14T14:52:15.749 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-14T14:52:15.749 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-14T14:52:15.749 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-14T14:52:15.749 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-14T14:52:15.749 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dc395x.ko 2024-05-14T14:52:15.749 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler 2024-05-14T14:52:15.749 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-14T14:52:15.749 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-14T14:52:15.749 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-14T14:52:15.749 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-14T14:52:15.749 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dmx3191d.ko 2024-05-14T14:52:15.749 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r 2024-05-14T14:52:15.749 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-14T14:52:15.749 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esp_scsi.ko 2024-05-14T14:52:15.749 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe 2024-05-14T14:52:15.749 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-14T14:52:15.750 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-14T14:52:15.750 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic 2024-05-14T14:52:15.750 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic/fnic.ko 2024-05-14T14:52:15.750 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hpsa.ko 2024-05-14T14:52:15.750 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hptiop.ko 2024-05-14T14:52:15.750 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hv_storvsc.ko 2024-05-14T14:52:15.750 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/initio.ko 2024-05-14T14:52:15.750 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ipr.ko 2024-05-14T14:52:15.750 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ips.ko 2024-05-14T14:52:15.750 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci 2024-05-14T14:52:15.750 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci/isci.ko 2024-05-14T14:52:15.750 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-14T14:52:15.750 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-14T14:52:15.750 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc 2024-05-14T14:52:15.750 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc/libfc.ko 2024-05-14T14:52:15.750 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi.ko 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas/libsas.ko 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid.ko 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvumi.ko 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001 2024-05-14T14:52:15.751 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-14T14:52:15.752 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pmcraid.ko 2024-05-14T14:52:15.752 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla1280.ko 2024-05-14T14:52:15.752 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx 2024-05-14T14:52:15.752 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-14T14:52:15.752 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-14T14:52:15.752 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx 2024-05-14T14:52:15.752 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-14T14:52:15.752 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/raid_class.ko 2024-05-14T14:52:15.752 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_debug.ko 2024-05-14T14:52:15.752 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-14T14:52:15.752 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-14T14:52:15.752 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-14T14:52:15.752 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-14T14:52:15.752 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-14T14:52:15.752 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ses.ko 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/st.ko 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/stex.ko 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/virtio_scsi.ko 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/wd719x.ko 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb/ssb.ko 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_file.ko 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_iblock.ko 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_mod.ko 2024-05-14T14:52:15.753 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_pscsi.ko 2024-05-14T14:52:15.754 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_user.ko 2024-05-14T14:52:15.754 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc 2024-05-14T14:52:15.754 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-14T14:52:15.754 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal 2024-05-14T14:52:15.754 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel 2024-05-14T14:52:15.754 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal 2024-05-14T14:52:15.754 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-14T14:52:15.754 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-14T14:52:15.754 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-14T14:52:15.754 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-14T14:52:15.754 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-14T14:52:15.754 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-14T14:52:15.754 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-14T14:52:15.754 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-14T14:52:15.754 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-14T14:52:15.754 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-14T14:52:15.755 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-14T14:52:15.755 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-14T14:52:15.755 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-14T14:52:15.755 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-14T14:52:15.755 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-14T14:52:15.755 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-14T14:52:15.755 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-14T14:52:15.755 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-14T14:52:15.755 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty 2024-05-14T14:52:15.755 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless 2024-05-14T14:52:15.755 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-14T14:52:15.755 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_gsm.ko 2024-05-14T14:52:15.755 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_hdlc.ko 2024-05-14T14:52:15.755 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/nozomi.ko 2024-05-14T14:52:15.755 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial 2024-05-14T14:52:15.756 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250 2024-05-14T14:52:15.756 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-14T14:52:15.756 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/arc_uart.ko 2024-05-14T14:52:15.756 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm 2024-05-14T14:52:15.756 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-14T14:52:15.756 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs 2024-05-14T14:52:15.756 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core 2024-05-14T14:52:15.756 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-14T14:52:15.756 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host 2024-05-14T14:52:15.756 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-14T14:52:15.756 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio 2024-05-14T14:52:15.756 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio.ko 2024-05-14T14:52:15.756 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_aec.ko 2024-05-14T14:52:15.756 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_cif.ko 2024-05-14T14:52:15.756 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_pci_generic.ko 2024-05-14T14:52:15.756 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_sercos3.ko 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-acm.ko 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usblp.ko 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usbtmc.ko 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/mdc800.ko 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/microtek.ko 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/adutux.ko 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/appledisplay.ko 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi26.ko 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi62.ko 2024-05-14T14:52:15.757 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ezusb.ko 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/idmouse.ko 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/iowarrior.ko 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ldusb.ko 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/legousbtower.ko 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usb3503.ko 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usblcd.ko 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/uss720.ko 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/yurex.ko 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy/phy-generic.ko 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial 2024-05-14T14:52:15.758 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/aircable.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ark3116.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ch341.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cp210x.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cyberjack.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/empeg.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_ti.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipaq.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipw.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ir-usb.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-14T14:52:15.759 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mct_u232.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7720.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7840.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/navman.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/omninet.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/opticon.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/option.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/oti6858.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/pl2303.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcaux.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcserial.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/quatech2.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/safe_serial.ko 2024-05-14T14:52:15.760 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/sierra.ko 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ssu100.ko 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/symbolserial.ko 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_debug.ko 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/visor.ko 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/whiteheat.ko 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/uas.ko 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-14T14:52:15.761 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-14T14:52:15.762 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-14T14:52:15.762 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-14T14:52:15.762 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-karma.ko 2024-05-14T14:52:15.762 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-14T14:52:15.762 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-14T14:52:15.762 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-14T14:52:15.762 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-14T14:52:15.763 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-14T14:52:15.763 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/usb-storage.ko 2024-05-14T14:52:15.763 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip 2024-05-14T14:52:15.763 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-14T14:52:15.763 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-14T14:52:15.763 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-14T14:52:15.764 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio 2024-05-14T14:52:15.764 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci 2024-05-14T14:52:15.764 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-14T14:52:15.764 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-14T14:52:15.764 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio.ko 2024-05-14T14:52:15.764 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-14T14:52:15.764 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost 2024-05-14T14:52:15.765 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost.ko 2024-05-14T14:52:15.765 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-14T14:52:15.765 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_net.ko 2024-05-14T14:52:15.765 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_scsi.ko 2024-05-14T14:52:15.765 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video 2024-05-14T14:52:15.765 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight 2024-05-14T14:52:15.766 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/apple_bl.ko 2024-05-14T14:52:15.766 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/lcd.ko 2024-05-14T14:52:15.766 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-14T14:52:15.766 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio 2024-05-14T14:52:15.766 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio.ko 2024-05-14T14:52:15.766 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_balloon.ko 2024-05-14T14:52:15.767 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_mmio.ko 2024-05-14T14:52:15.767 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci.ko 2024-05-14T14:52:15.767 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-14T14:52:15.767 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-14T14:52:15.767 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_ring.ko 2024-05-14T14:52:15.767 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1 2024-05-14T14:52:15.767 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters 2024-05-14T14:52:15.768 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2482.ko 2024-05-14T14:52:15.768 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2490.ko 2024-05-14T14:52:15.768 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves 2024-05-14T14:52:15.768 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-14T14:52:15.768 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-14T14:52:15.768 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-14T14:52:15.769 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-14T14:52:15.769 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-14T14:52:15.769 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-14T14:52:15.769 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-14T14:52:15.769 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-14T14:52:15.769 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-14T14:52:15.770 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-14T14:52:15.770 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-14T14:52:15.770 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/wire.ko 2024-05-14T14:52:15.770 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog 2024-05-14T14:52:15.770 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-14T14:52:15.770 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-14T14:52:15.770 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-14T14:52:15.771 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/hpwdt.ko 2024-05-14T14:52:15.771 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/i6300esb.ko 2024-05-14T14:52:15.771 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-14T14:52:15.771 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-14T14:52:15.771 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ib700wdt.ko 2024-05-14T14:52:15.771 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ibmasr.ko 2024-05-14T14:52:15.772 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-14T14:52:15.772 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-14T14:52:15.772 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it87_wdt.ko 2024-05-14T14:52:15.772 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/machzwd.ko 2024-05-14T14:52:15.772 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/nv_tco.ko 2024-05-14T14:52:15.772 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-14T14:52:15.772 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-14T14:52:15.772 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-14T14:52:15.772 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-14T14:52:15.772 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/softdog.ko 2024-05-14T14:52:15.772 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/via_wdt.ko 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/wdt_pci.ko 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/xen_wdt.ko 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-evtchn.ko 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntalloc.ko 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntdev.ko 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-privcmd.ko 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-14T14:52:15.773 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs 2024-05-14T14:52:15.774 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p 2024-05-14T14:52:15.774 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p/9p.ko 2024-05-14T14:52:15.774 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs 2024-05-14T14:52:15.774 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs/affs.ko 2024-05-14T14:52:15.774 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs 2024-05-14T14:52:15.774 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs/befs.ko 2024-05-14T14:52:15.774 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/binfmt_misc.ko 2024-05-14T14:52:15.774 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs 2024-05-14T14:52:15.774 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs/btrfs.ko 2024-05-14T14:52:15.774 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles 2024-05-14T14:52:15.774 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles/cachefiles.ko 2024-05-14T14:52:15.774 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph 2024-05-14T14:52:15.774 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph/ceph.ko 2024-05-14T14:52:15.774 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda 2024-05-14T14:52:15.774 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda/coda.ko 2024-05-14T14:52:15.774 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs/cramfs.ko 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm/dlm.ko 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs/f2fs.ko 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/fat.ko 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/msdos.ko 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/vfat.ko 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/cuse.ko 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/fuse.ko 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2/gfs2.ko 2024-05-14T14:52:15.775 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs 2024-05-14T14:52:15.776 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs/hfs.ko 2024-05-14T14:52:15.776 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus 2024-05-14T14:52:15.776 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus/hfsplus.ko 2024-05-14T14:52:15.776 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs 2024-05-14T14:52:15.776 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs/isofs.ko 2024-05-14T14:52:15.776 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs 2024-05-14T14:52:15.776 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs/jfs.ko 2024-05-14T14:52:15.776 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd 2024-05-14T14:52:15.776 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd/lockd.ko 2024-05-14T14:52:15.776 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix 2024-05-14T14:52:15.776 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix/minix.ko 2024-05-14T14:52:15.776 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs 2024-05-14T14:52:15.776 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs/netfs.ko 2024-05-14T14:52:15.776 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs 2024-05-14T14:52:15.776 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout 2024-05-14T14:52:15.777 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-14T14:52:15.777 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout 2024-05-14T14:52:15.777 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-14T14:52:15.777 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout 2024-05-14T14:52:15.777 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-14T14:52:15.777 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfs.ko 2024-05-14T14:52:15.777 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv3.ko 2024-05-14T14:52:15.777 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv4.ko 2024-05-14T14:52:15.777 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common 2024-05-14T14:52:15.777 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/grace.ko 2024-05-14T14:52:15.777 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/nfs_acl.ko 2024-05-14T14:52:15.777 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd 2024-05-14T14:52:15.777 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd/nfsd.ko 2024-05-14T14:52:15.777 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2 2024-05-14T14:52:15.777 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2/nilfs2.ko 2024-05-14T14:52:15.777 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls 2024-05-14T14:52:15.778 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-celtic.ko 2024-05-14T14:52:15.778 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-centeuro.ko 2024-05-14T14:52:15.778 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-croatian.ko 2024-05-14T14:52:15.778 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-cyrillic.ko 2024-05-14T14:52:15.778 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-gaelic.ko 2024-05-14T14:52:15.778 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-greek.ko 2024-05-14T14:52:15.778 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-iceland.ko 2024-05-14T14:52:15.778 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-inuit.ko 2024-05-14T14:52:15.778 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-roman.ko 2024-05-14T14:52:15.778 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-romanian.ko 2024-05-14T14:52:15.778 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-turkish.ko 2024-05-14T14:52:15.778 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1250.ko 2024-05-14T14:52:15.778 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1251.ko 2024-05-14T14:52:15.778 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1255.ko 2024-05-14T14:52:15.778 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp737.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp775.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp850.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp852.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp855.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp857.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp860.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp861.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp862.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp863.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp864.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp865.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp866.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp869.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp874.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp932.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp936.ko 2024-05-14T14:52:15.779 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp949.ko 2024-05-14T14:52:15.780 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp950.ko 2024-05-14T14:52:15.780 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_euc-jp.ko 2024-05-14T14:52:15.780 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-1.ko 2024-05-14T14:52:15.780 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-13.ko 2024-05-14T14:52:15.780 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-14.ko 2024-05-14T14:52:15.780 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-15.ko 2024-05-14T14:52:15.780 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-2.ko 2024-05-14T14:52:15.780 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-3.ko 2024-05-14T14:52:15.780 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-4.ko 2024-05-14T14:52:15.780 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-5.ko 2024-05-14T14:52:15.780 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-6.ko 2024-05-14T14:52:15.780 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-7.ko 2024-05-14T14:52:15.780 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-9.ko 2024-05-14T14:52:15.781 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-r.ko 2024-05-14T14:52:15.781 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-ru.ko 2024-05-14T14:52:15.781 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-u.ko 2024-05-14T14:52:15.781 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-14T14:52:15.781 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_utf8.ko 2024-05-14T14:52:15.781 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2 2024-05-14T14:52:15.781 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster 2024-05-14T14:52:15.781 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-14T14:52:15.781 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm 2024-05-14T14:52:15.781 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-14T14:52:15.781 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs 2024-05-14T14:52:15.781 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-14T14:52:15.781 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2.ko 2024-05-14T14:52:15.781 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-14T14:52:15.781 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-14T14:52:15.782 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-14T14:52:15.782 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs 2024-05-14T14:52:15.782 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs/overlay.ko 2024-05-14T14:52:15.782 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore 2024-05-14T14:52:15.782 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore/ramoops.ko 2024-05-14T14:52:15.782 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs 2024-05-14T14:52:15.782 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs/reiserfs.ko 2024-05-14T14:52:15.782 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs 2024-05-14T14:52:15.782 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs/romfs.ko 2024-05-14T14:52:15.782 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb 2024-05-14T14:52:15.782 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client 2024-05-14T14:52:15.782 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client/cifs.ko 2024-05-14T14:52:15.782 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common 2024-05-14T14:52:15.782 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_arc4.ko 2024-05-14T14:52:15.782 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_md4.ko 2024-05-14T14:52:15.782 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs 2024-05-14T14:52:15.783 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs/squashfs.ko 2024-05-14T14:52:15.783 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv 2024-05-14T14:52:15.783 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv/sysv.ko 2024-05-14T14:52:15.783 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf 2024-05-14T14:52:15.783 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf/udf.ko 2024-05-14T14:52:15.783 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs 2024-05-14T14:52:15.783 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs/ufs.ko 2024-05-14T14:52:15.783 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs 2024-05-14T14:52:15.783 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs/xfs.ko 2024-05-14T14:52:15.783 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel 2024-05-14T14:52:15.783 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu 2024-05-14T14:52:15.783 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu/rcutorture.ko 2024-05-14T14:52:15.783 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/torture.ko 2024-05-14T14:52:15.783 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace 2024-05-14T14:52:15.783 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-14T14:52:15.784 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib 2024-05-14T14:52:15.784 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/asn1_encoder.ko 2024-05-14T14:52:15.784 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc-itu-t.ko 2024-05-14T14:52:15.784 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc8.ko 2024-05-14T14:52:15.784 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto 2024-05-14T14:52:15.784 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libarc4.ko 2024-05-14T14:52:15.784 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libdes.ko 2024-05-14T14:52:15.784 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/libcrc32c.ko 2024-05-14T14:52:15.784 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lru_cache.ko 2024-05-14T14:52:15.784 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4 2024-05-14T14:52:15.784 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4_compress.ko 2024-05-14T14:52:15.784 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4hc_compress.ko 2024-05-14T14:52:15.784 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math 2024-05-14T14:52:15.784 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math/cordic.ko 2024-05-14T14:52:15.784 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6 2024-05-14T14:52:15.784 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6/raid6_pq.ko 2024-05-14T14:52:15.785 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon 2024-05-14T14:52:15.785 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-14T14:52:15.785 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_bm.ko 2024-05-14T14:52:15.785 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_fsm.ko 2024-05-14T14:52:15.785 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_kmp.ko 2024-05-14T14:52:15.785 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd 2024-05-14T14:52:15.785 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd/zstd_compress.ko 2024-05-14T14:52:15.785 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm 2024-05-14T14:52:15.785 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm/hwpoison-inject.ko 2024-05-14T14:52:15.785 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net 2024-05-14T14:52:15.785 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan 2024-05-14T14:52:15.785 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/6lowpan.ko 2024-05-14T14:52:15.785 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_dest.ko 2024-05-14T14:52:15.785 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_fragment.ko 2024-05-14T14:52:15.785 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_hop.ko 2024-05-14T14:52:15.786 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-14T14:52:15.786 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_mobility.ko 2024-05-14T14:52:15.786 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_routing.ko 2024-05-14T14:52:15.786 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_udp.ko 2024-05-14T14:52:15.786 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802 2024-05-14T14:52:15.786 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/garp.ko 2024-05-14T14:52:15.786 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/mrp.ko 2024-05-14T14:52:15.786 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/p8022.ko 2024-05-14T14:52:15.786 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/psnap.ko 2024-05-14T14:52:15.786 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/stp.ko 2024-05-14T14:52:15.786 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q 2024-05-14T14:52:15.786 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q/8021q.ko 2024-05-14T14:52:15.786 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p 2024-05-14T14:52:15.786 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet.ko 2024-05-14T14:52:15.786 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_fd.ko 2024-05-14T14:52:15.786 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_rdma.ko 2024-05-14T14:52:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_virtio.ko 2024-05-14T14:52:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv 2024-05-14T14:52:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv/batman-adv.ko 2024-05-14T14:52:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge 2024-05-14T14:52:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/br_netfilter.ko 2024-05-14T14:52:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/bridge.ko 2024-05-14T14:52:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter 2024-05-14T14:52:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-14T14:52:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-14T14:52:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-14T14:52:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-14T14:52:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-14T14:52:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-14T14:52:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-14T14:52:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-14T14:52:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtables.ko 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph 2024-05-14T14:52:15.788 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph/libceph.ko 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/failover.ko 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/pktgen.ko 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp.ko 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_diag.ko 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv4.ko 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv6.ko 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver/dns_resolver.ko 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/dsa_core.ko 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_brcm.ko 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_dsa.ko 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_none.ko 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_trailer.ko 2024-05-14T14:52:15.789 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154.ko 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ah4.ko 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/esp4.ko 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/fou.ko 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/gre.ko 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/inet_diag.ko 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_gre.ko 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_tunnel.ko 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_vti.ko 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipcomp.ko 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipip.ko 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter 2024-05-14T14:52:15.790 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-14T14:52:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-14T14:52:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-14T14:52:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-14T14:52:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-14T14:52:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-14T14:52:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-14T14:52:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-14T14:52:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-14T14:52:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-14T14:52:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-14T14:52:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-14T14:52:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-14T14:52:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-14T14:52:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-14T14:52:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-14T14:52:15.791 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_bic.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_dctcp.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_diag.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_highspeed.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_htcp.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_hybla.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_illinois.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_lp.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_scalable.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_vegas.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_veno.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_westwood.ko 2024-05-14T14:52:15.792 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_yeah.ko 2024-05-14T14:52:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tunnel4.ko 2024-05-14T14:52:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_diag.ko 2024-05-14T14:52:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_tunnel.ko 2024-05-14T14:52:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-14T14:52:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6 2024-05-14T14:52:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ah6.ko 2024-05-14T14:52:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/esp6.ko 2024-05-14T14:52:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/fou6.ko 2024-05-14T14:52:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_tunnel.ko 2024-05-14T14:52:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-14T14:52:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_vti.ko 2024-05-14T14:52:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ipcomp6.ko 2024-05-14T14:52:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter 2024-05-14T14:52:15.793 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-14T14:52:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-14T14:52:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-14T14:52:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-14T14:52:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-14T14:52:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-14T14:52:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-14T14:52:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-14T14:52:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-14T14:52:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-14T14:52:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-14T14:52:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-14T14:52:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-14T14:52:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-14T14:52:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-14T14:52:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-14T14:52:15.794 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-14T14:52:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-14T14:52:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-14T14:52:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-14T14:52:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-14T14:52:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-14T14:52:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-14T14:52:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-14T14:52:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/sit.ko 2024-05-14T14:52:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/tunnel6.ko 2024-05-14T14:52:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-14T14:52:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key 2024-05-14T14:52:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key/af_key.ko 2024-05-14T14:52:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp 2024-05-14T14:52:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_core.ko 2024-05-14T14:52:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-14T14:52:15.795 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_eth.ko 2024-05-14T14:52:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip.ko 2024-05-14T14:52:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip6.ko 2024-05-14T14:52:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_netlink.ko 2024-05-14T14:52:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ppp.ko 2024-05-14T14:52:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc 2024-05-14T14:52:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc/llc.ko 2024-05-14T14:52:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154 2024-05-14T14:52:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154/mac802154.ko 2024-05-14T14:52:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls 2024-05-14T14:52:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls/mpls_gso.ko 2024-05-14T14:52:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter 2024-05-14T14:52:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset 2024-05-14T14:52:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set.ko 2024-05-14T14:52:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-14T14:52:15.796 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-14T14:52:15.797 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-14T14:52:15.798 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-14T14:52:15.798 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-14T14:52:15.798 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-14T14:52:15.798 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-14T14:52:15.798 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-14T14:52:15.798 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-14T14:52:15.798 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-14T14:52:15.798 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-14T14:52:15.798 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-14T14:52:15.798 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-14T14:52:15.798 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-14T14:52:15.798 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conncount.ko 2024-05-14T14:52:15.798 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack.ko 2024-05-14T14:52:15.798 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-14T14:52:15.798 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-14T14:52:15.798 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-14T14:52:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-14T14:52:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-14T14:52:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-14T14:52:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-14T14:52:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-14T14:52:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-14T14:52:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-14T14:52:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-14T14:52:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-14T14:52:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-14T14:52:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table.ko 2024-05-14T14:52:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-14T14:52:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_log_syslog.ko 2024-05-14T14:52:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat.ko 2024-05-14T14:52:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-14T14:52:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-14T14:52:15.800 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_irc.ko 2024-05-14T14:52:15.800 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_sip.ko 2024-05-14T14:52:15.800 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-14T14:52:15.800 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-14T14:52:15.800 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_tables.ko 2024-05-14T14:52:15.800 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink.ko 2024-05-14T14:52:15.800 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-14T14:52:15.800 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_log.ko 2024-05-14T14:52:15.800 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-14T14:52:15.800 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-14T14:52:15.800 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_chain_nat.ko 2024-05-14T14:52:15.800 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_compat.ko 2024-05-14T14:52:15.800 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_ct.ko 2024-05-14T14:52:15.800 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-14T14:52:15.800 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fib.ko 2024-05-14T14:52:15.800 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_hash.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_limit.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_log.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_masq.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_nat.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_numgen.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_queue.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_quota.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_redir.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject_inet.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_socket.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_tunnel.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_AUDIT.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-14T14:52:15.801 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-14T14:52:15.802 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CT.ko 2024-05-14T14:52:15.802 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_DSCP.ko 2024-05-14T14:52:15.802 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HL.ko 2024-05-14T14:52:15.802 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HMARK.ko 2024-05-14T14:52:15.802 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-14T14:52:15.802 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LED.ko 2024-05-14T14:52:15.802 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LOG.ko 2024-05-14T14:52:15.802 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-14T14:52:15.802 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NETMAP.ko 2024-05-14T14:52:15.802 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFLOG.ko 2024-05-14T14:52:15.802 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-14T14:52:15.802 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_RATEEST.ko 2024-05-14T14:52:15.802 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-14T14:52:15.802 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_SECMARK.ko 2024-05-14T14:52:15.802 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-14T14:52:15.802 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-14T14:52:15.803 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TEE.ko 2024-05-14T14:52:15.803 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TPROXY.ko 2024-05-14T14:52:15.803 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TRACE.ko 2024-05-14T14:52:15.803 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_addrtype.ko 2024-05-14T14:52:15.803 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_bpf.ko 2024-05-14T14:52:15.803 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cgroup.ko 2024-05-14T14:52:15.803 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cluster.ko 2024-05-14T14:52:15.803 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_comment.ko 2024-05-14T14:52:15.803 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connbytes.ko 2024-05-14T14:52:15.803 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlabel.ko 2024-05-14T14:52:15.803 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlimit.ko 2024-05-14T14:52:15.803 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connmark.ko 2024-05-14T14:52:15.803 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_conntrack.ko 2024-05-14T14:52:15.803 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cpu.ko 2024-05-14T14:52:15.804 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dccp.ko 2024-05-14T14:52:15.804 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_devgroup.ko 2024-05-14T14:52:15.804 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dscp.ko 2024-05-14T14:52:15.804 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ecn.ko 2024-05-14T14:52:15.804 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_esp.ko 2024-05-14T14:52:15.804 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hashlimit.ko 2024-05-14T14:52:15.804 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_helper.ko 2024-05-14T14:52:15.804 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hl.ko 2024-05-14T14:52:15.804 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipcomp.ko 2024-05-14T14:52:15.804 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_iprange.ko 2024-05-14T14:52:15.804 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipvs.ko 2024-05-14T14:52:15.804 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_l2tp.ko 2024-05-14T14:52:15.804 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_length.ko 2024-05-14T14:52:15.804 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_limit.ko 2024-05-14T14:52:15.804 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mac.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mark.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_multiport.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nat.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nfacct.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_osf.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_owner.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_physdev.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_pkttype.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_policy.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_quota.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_rateest.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_realm.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_recent.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_sctp.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_set.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_socket.ko 2024-05-14T14:52:15.805 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_state.ko 2024-05-14T14:52:15.806 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_statistic.ko 2024-05-14T14:52:15.806 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_string.ko 2024-05-14T14:52:15.806 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_tcpmss.ko 2024-05-14T14:52:15.806 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_time.ko 2024-05-14T14:52:15.806 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_u32.ko 2024-05-14T14:52:15.806 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink 2024-05-14T14:52:15.806 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink/netlink_diag.ko 2024-05-14T14:52:15.806 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh 2024-05-14T14:52:15.806 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh/nsh.ko 2024-05-14T14:52:15.806 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch 2024-05-14T14:52:15.806 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/openvswitch.ko 2024-05-14T14:52:15.806 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-geneve.ko 2024-05-14T14:52:15.806 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-gre.ko 2024-05-14T14:52:15.806 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-vxlan.ko 2024-05-14T14:52:15.806 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet 2024-05-14T14:52:15.806 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet/af_packet_diag.ko 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds.ko 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_rdma.ko 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_tcp.ko 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_csum.ko 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_gact.ko 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_mirred.ko 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_nat.ko 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_pedit.ko 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_police.ko 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_simple.ko 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_skbedit.ko 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_vlan.ko 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_basic.ko 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_bpf.ko 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_flow.ko 2024-05-14T14:52:15.807 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_fw.ko 2024-05-14T14:52:15.808 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_route.ko 2024-05-14T14:52:15.808 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_u32.ko 2024-05-14T14:52:15.808 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_cmp.ko 2024-05-14T14:52:15.808 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_ipset.ko 2024-05-14T14:52:15.808 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_meta.ko 2024-05-14T14:52:15.808 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_nbyte.ko 2024-05-14T14:52:15.808 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_text.ko 2024-05-14T14:52:15.808 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_u32.ko 2024-05-14T14:52:15.808 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_choke.ko 2024-05-14T14:52:15.808 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_codel.ko 2024-05-14T14:52:15.808 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_drr.ko 2024-05-14T14:52:15.808 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_fq.ko 2024-05-14T14:52:15.808 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_gred.ko 2024-05-14T14:52:15.808 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hfsc.ko 2024-05-14T14:52:15.808 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hhf.ko 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_htb.ko 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_ingress.ko 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio.ko 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio_lib.ko 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_multiq.ko 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_netem.ko 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_pie.ko 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_plug.ko 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_prio.ko 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_qfq.ko 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_red.ko 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfb.ko 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfq.ko 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_tbf.ko 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_teql.ko 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp 2024-05-14T14:52:15.809 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp.ko 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp_diag.ko 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/sunrpc.ko 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc.ko 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc_diag.ko 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix/unix_diag.ko 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-14T14:52:15.810 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock.ko 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys/trusted.ko 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias.bin 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.alias.bin 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.bin 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.modinfo 2024-05-14T14:52:15.811 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep 2024-05-14T14:52:15.812 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep.bin 2024-05-14T14:52:15.812 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.devname 2024-05-14T14:52:15.812 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.order 2024-05-14T14:52:15.812 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.softdep 2024-05-14T14:52:15.812 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols 2024-05-14T14:52:15.812 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols.bin 2024-05-14T14:52:15.812 INFO:teuthology.orchestra.run.smithi069.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T14:52:15.815 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:15.816 DEBUG:teuthology.orchestra.run.smithi069:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-14T14:52:15.838 INFO:teuthology.orchestra.run.smithi069.stdout:postinstall scriptlet (using /bin/sh): 2024-05-14T14:52:15.838 INFO:teuthology.orchestra.run.smithi069.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T14:52:15.838 INFO:teuthology.orchestra.run.smithi069.stdout: /usr/bin/kernel-install add 6.9.0-rc3-gfb9a6a44107e /lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T14:52:15.838 INFO:teuthology.orchestra.run.smithi069.stdout:fi 2024-05-14T14:52:15.838 INFO:teuthology.orchestra.run.smithi069.stdout:for file in vmlinuz System.map config; do 2024-05-14T14:52:15.838 INFO:teuthology.orchestra.run.smithi069.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e"; then 2024-05-14T14:52:15.839 INFO:teuthology.orchestra.run.smithi069.stdout: cp "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T14:52:15.839 INFO:teuthology.orchestra.run.smithi069.stdout: fi 2024-05-14T14:52:15.839 INFO:teuthology.orchestra.run.smithi069.stdout:done 2024-05-14T14:52:15.839 INFO:teuthology.orchestra.run.smithi069.stdout:if [ -d "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" ] && \ 2024-05-14T14:52:15.839 INFO:teuthology.orchestra.run.smithi069.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" >/dev/null 2>&1; then 2024-05-14T14:52:15.839 INFO:teuthology.orchestra.run.smithi069.stdout: rm -rf "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T14:52:15.839 INFO:teuthology.orchestra.run.smithi069.stdout: cp -r "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T14:52:15.839 INFO:teuthology.orchestra.run.smithi069.stdout:fi 2024-05-14T14:52:15.839 INFO:teuthology.orchestra.run.smithi069.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep" ]; then 2024-05-14T14:52:15.839 INFO:teuthology.orchestra.run.smithi069.stdout: /usr/sbin/depmod 6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:15.839 INFO:teuthology.orchestra.run.smithi069.stdout:fi 2024-05-14T14:52:15.839 INFO:teuthology.orchestra.run.smithi069.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-14T14:52:15.839 INFO:teuthology.orchestra.run.smithi069.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T14:52:15.839 INFO:teuthology.orchestra.run.smithi069.stdout:kernel-install remove 6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:15.839 INFO:teuthology.orchestra.run.smithi069.stdout:fi 2024-05-14T14:52:15.840 DEBUG:teuthology.orchestra.run.smithi069:> sudo rpm -qi grub2-tools 2024-05-14T14:52:15.912 INFO:teuthology.orchestra.run.smithi069.stdout:Name : grub2-tools 2024-05-14T14:52:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:Epoch : 1 2024-05-14T14:52:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:Version : 2.06 2024-05-14T14:52:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:Release : 68.el9 2024-05-14T14:52:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:Architecture: x86_64 2024-05-14T14:52:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-14T14:52:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:Group : Unspecified 2024-05-14T14:52:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:Size : 8264254 2024-05-14T14:52:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:License : GPLv3+ 2024-05-14T14:52:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-14T14:52:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-14T14:52:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-14T14:52:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-14T14:52:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:Packager : builder@centos.org 2024-05-14T14:52:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:Vendor : CentOS 2024-05-14T14:52:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-14T14:52:15.913 INFO:teuthology.orchestra.run.smithi069.stdout:Summary : Support tools for GRUB. 2024-05-14T14:52:15.914 INFO:teuthology.orchestra.run.smithi069.stdout:Description : 2024-05-14T14:52:15.914 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T14:52:15.914 INFO:teuthology.orchestra.run.smithi069.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-14T14:52:15.914 INFO:teuthology.orchestra.run.smithi069.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-14T14:52:15.914 INFO:teuthology.orchestra.run.smithi069.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-14T14:52:15.914 INFO:teuthology.orchestra.run.smithi069.stdout:hardware devices. 2024-05-14T14:52:15.914 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T14:52:15.914 INFO:teuthology.orchestra.run.smithi069.stdout:This subpackage provides tools for support of all platforms. 2024-05-14T14:52:15.915 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-14T14:52:15.915 INFO:teuthology.task.kernel:Updating grub on smithi069 to boot 6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:15.915 DEBUG:teuthology.orchestra.run.smithi069:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-14T14:52:16.466 INFO:teuthology.orchestra.run.smithi069.stderr:Generating grub configuration file ... 2024-05-14T14:52:17.973 INFO:teuthology.orchestra.run.smithi069.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-14T14:52:18.003 INFO:teuthology.orchestra.run.smithi069.stderr:done 2024-05-14T14:52:18.006 DEBUG:teuthology.orchestra.run.smithi069:> mktemp 2024-05-14T14:52:18.020 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/tmp.pddSktSjPY 2024-05-14T14:52:18.021 DEBUG:teuthology.orchestra.run.smithi069:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.pddSktSjPY 2024-05-14T14:52:18.092 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0666 /tmp/tmp.pddSktSjPY 2024-05-14T14:52:18.233 DEBUG:teuthology.orchestra.remote:smithi069:/tmp/tmp.pddSktSjPY is 6KB 2024-05-14T14:52:18.283 DEBUG:teuthology.orchestra.run.smithi069:> rm -fr /tmp/tmp.pddSktSjPY 2024-05-14T14:52:18.297 DEBUG:teuthology.orchestra.run.smithi069:> sudo /bin/ls /boot/loader/entries || true 2024-05-14T14:52:18.358 INFO:teuthology.orchestra.run.smithi069.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-14T14:52:18.358 INFO:teuthology.orchestra.run.smithi069.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-14T14:52:18.358 INFO:teuthology.orchestra.run.smithi069.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-14T14:52:18.358 INFO:teuthology.orchestra.run.smithi069.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e.conf 2024-05-14T14:52:18.359 DEBUG:teuthology.orchestra.run.smithi069:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:18.536 DEBUG:teuthology.orchestra.run.smithi069:> sudo shutdown -r now 2024-05-14T14:52:27.307 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi203.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-14T14:52:27.308 DEBUG:teuthology.orchestra.run.smithi203:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-14T14:52:27.424 INFO:teuthology.orchestra.run.smithi203.stdout:/boot/System.map-6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:27.424 INFO:teuthology.orchestra.run.smithi203.stdout:/boot/config-6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:27.424 INFO:teuthology.orchestra.run.smithi203.stdout:/boot/vmlinuz-6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:27.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/System.map 2024-05-14T14:52:27.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/config 2024-05-14T14:52:27.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel 2024-05-14T14:52:27.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch 2024-05-14T14:52:27.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86 2024-05-14T14:52:27.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto 2024-05-14T14:52:27.424 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-14T14:52:27.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-14T14:52:27.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-14T14:52:27.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-14T14:52:27.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-14T14:52:27.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-14T14:52:27.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-14T14:52:27.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-14T14:52:27.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-14T14:52:27.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-14T14:52:27.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-14T14:52:27.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-14T14:52:27.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-14T14:52:27.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-14T14:52:27.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-14T14:52:27.425 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-14T14:52:27.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-14T14:52:27.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-14T14:52:27.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-14T14:52:27.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-14T14:52:27.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel 2024-05-14T14:52:27.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu 2024-05-14T14:52:27.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce 2024-05-14T14:52:27.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-14T14:52:27.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm 2024-05-14T14:52:27.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-14T14:52:27.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-14T14:52:27.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm.ko 2024-05-14T14:52:27.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto 2024-05-14T14:52:27.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ansi_cprng.ko 2024-05-14T14:52:27.426 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/anubis.ko 2024-05-14T14:52:27.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/arc4.ko 2024-05-14T14:52:27.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx 2024-05-14T14:52:27.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_memcpy.ko 2024-05-14T14:52:27.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_pq.ko 2024-05-14T14:52:27.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-14T14:52:27.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_tx.ko 2024-05-14T14:52:27.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_xor.ko 2024-05-14T14:52:27.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/raid6test.ko 2024-05-14T14:52:27.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authenc.ko 2024-05-14T14:52:27.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authencesn.ko 2024-05-14T14:52:27.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blake2b_generic.ko 2024-05-14T14:52:27.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_common.ko 2024-05-14T14:52:27.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_generic.ko 2024-05-14T14:52:27.427 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/camellia_generic.ko 2024-05-14T14:52:27.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast5_generic.ko 2024-05-14T14:52:27.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast6_generic.ko 2024-05-14T14:52:27.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast_common.ko 2024-05-14T14:52:27.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ccm.ko 2024-05-14T14:52:27.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cmac.ko 2024-05-14T14:52:27.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crc32_generic.ko 2024-05-14T14:52:27.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_engine.ko 2024-05-14T14:52:27.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_user.ko 2024-05-14T14:52:27.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cts.ko 2024-05-14T14:52:27.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/des_generic.ko 2024-05-14T14:52:27.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/dh_generic.ko 2024-05-14T14:52:27.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/echainiv.ko 2024-05-14T14:52:27.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/essiv.ko 2024-05-14T14:52:27.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/fcrypt.ko 2024-05-14T14:52:27.428 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/khazad.ko 2024-05-14T14:52:27.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4.ko 2024-05-14T14:52:27.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4hc.ko 2024-05-14T14:52:27.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/md4.ko 2024-05-14T14:52:27.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/michael_mic.ko 2024-05-14T14:52:27.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcbc.ko 2024-05-14T14:52:27.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcrypt.ko 2024-05-14T14:52:27.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/rmd160.ko 2024-05-14T14:52:27.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/seed.ko 2024-05-14T14:52:27.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/serpent_generic.ko 2024-05-14T14:52:27.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tcrypt.ko 2024-05-14T14:52:27.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tea.ko 2024-05-14T14:52:27.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_common.ko 2024-05-14T14:52:27.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_generic.ko 2024-05-14T14:52:27.429 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/vmac.ko 2024-05-14T14:52:27.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/wp512.ko 2024-05-14T14:52:27.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xcbc.ko 2024-05-14T14:52:27.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xor.ko 2024-05-14T14:52:27.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xxhash_generic.ko 2024-05-14T14:52:27.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers 2024-05-14T14:52:27.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi 2024-05-14T14:52:27.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-14T14:52:27.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_pad.ko 2024-05-14T14:52:27.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/ec_sys.ko 2024-05-14T14:52:27.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/platform_profile.ko 2024-05-14T14:52:27.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbs.ko 2024-05-14T14:52:27.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbshc.ko 2024-05-14T14:52:27.430 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/video.ko 2024-05-14T14:52:27.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata 2024-05-14T14:52:27.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/acard-ahci.ko 2024-05-14T14:52:27.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ahci_platform.ko 2024-05-14T14:52:27.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ata_generic.ko 2024-05-14T14:52:27.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/libahci_platform.ko 2024-05-14T14:52:27.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_acpi.ko 2024-05-14T14:52:27.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ali.ko 2024-05-14T14:52:27.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_amd.ko 2024-05-14T14:52:27.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_artop.ko 2024-05-14T14:52:27.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atiixp.ko 2024-05-14T14:52:27.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atp867x.ko 2024-05-14T14:52:27.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd640.ko 2024-05-14T14:52:27.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd64x.ko 2024-05-14T14:52:27.431 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cypress.ko 2024-05-14T14:52:27.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_efar.ko 2024-05-14T14:52:27.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt366.ko 2024-05-14T14:52:27.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt37x.ko 2024-05-14T14:52:27.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-14T14:52:27.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-14T14:52:27.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it8213.ko 2024-05-14T14:52:27.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it821x.ko 2024-05-14T14:52:27.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_jmicron.ko 2024-05-14T14:52:27.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_marvell.ko 2024-05-14T14:52:27.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_mpiix.ko 2024-05-14T14:52:27.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_netcell.ko 2024-05-14T14:52:27.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ninja32.ko 2024-05-14T14:52:27.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87410.ko 2024-05-14T14:52:27.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87415.ko 2024-05-14T14:52:27.432 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_oldpiix.ko 2024-05-14T14:52:27.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_opti.ko 2024-05-14T14:52:27.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_optidma.ko 2024-05-14T14:52:27.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pcmcia.ko 2024-05-14T14:52:27.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-14T14:52:27.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-14T14:52:27.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_piccolo.ko 2024-05-14T14:52:27.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_rdc.ko 2024-05-14T14:52:27.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sch.ko 2024-05-14T14:52:27.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_serverworks.ko 2024-05-14T14:52:27.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sil680.ko 2024-05-14T14:52:27.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sis.ko 2024-05-14T14:52:27.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sl82c105.ko 2024-05-14T14:52:27.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_triflex.ko 2024-05-14T14:52:27.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_via.ko 2024-05-14T14:52:27.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pdc_adma.ko 2024-05-14T14:52:27.433 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_inic162x.ko 2024-05-14T14:52:27.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_mv.ko 2024-05-14T14:52:27.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_nv.ko 2024-05-14T14:52:27.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_promise.ko 2024-05-14T14:52:27.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_qstor.ko 2024-05-14T14:52:27.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil.ko 2024-05-14T14:52:27.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil24.ko 2024-05-14T14:52:27.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sis.ko 2024-05-14T14:52:27.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_svw.ko 2024-05-14T14:52:27.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sx4.ko 2024-05-14T14:52:27.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_uli.ko 2024-05-14T14:52:27.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_via.ko 2024-05-14T14:52:27.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_vsc.ko 2024-05-14T14:52:27.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay 2024-05-14T14:52:27.434 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay/ks0108.ko 2024-05-14T14:52:27.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base 2024-05-14T14:52:27.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap 2024-05-14T14:52:27.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-14T14:52:27.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-14T14:52:27.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma 2024-05-14T14:52:27.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma/bcma.ko 2024-05-14T14:52:27.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block 2024-05-14T14:52:27.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe 2024-05-14T14:52:27.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe/aoe.ko 2024-05-14T14:52:27.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/brd.ko 2024-05-14T14:52:27.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd 2024-05-14T14:52:27.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd/drbd.ko 2024-05-14T14:52:27.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/floppy.ko 2024-05-14T14:52:27.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/loop.ko 2024-05-14T14:52:27.435 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx 2024-05-14T14:52:27.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-14T14:52:27.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/nbd.ko 2024-05-14T14:52:27.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk 2024-05-14T14:52:27.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk/null_blk.ko 2024-05-14T14:52:27.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/pktcdvd.ko 2024-05-14T14:52:27.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/rbd.ko 2024-05-14T14:52:27.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/virtio_blk.ko 2024-05-14T14:52:27.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback 2024-05-14T14:52:27.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-14T14:52:27.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkfront.ko 2024-05-14T14:52:27.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram 2024-05-14T14:52:27.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram/zram.ko 2024-05-14T14:52:27.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char 2024-05-14T14:52:27.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hangcheck-timer.ko 2024-05-14T14:52:27.436 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random 2024-05-14T14:52:27.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-14T14:52:27.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-14T14:52:27.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-14T14:52:27.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/via-rng.ko 2024-05-14T14:52:27.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-14T14:52:27.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi 2024-05-14T14:52:27.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-14T14:52:27.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-14T14:52:27.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-14T14:52:27.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-14T14:52:27.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-14T14:52:27.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-14T14:52:27.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/lp.ko 2024-05-14T14:52:27.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave 2024-05-14T14:52:27.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave/mwave.ko 2024-05-14T14:52:27.437 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ppdev.ko 2024-05-14T14:52:27.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tlclk.ko 2024-05-14T14:52:27.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm 2024-05-14T14:52:27.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm.ko 2024-05-14T14:52:27.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-14T14:52:27.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-14T14:52:27.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-14T14:52:27.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-14T14:52:27.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-14T14:52:27.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/uv_mmtimer.ko 2024-05-14T14:52:27.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/virtio_console.ko 2024-05-14T14:52:27.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq 2024-05-14T14:52:27.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-14T14:52:27.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-14T14:52:27.438 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-14T14:52:27.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-14T14:52:27.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-14T14:52:27.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-14T14:52:27.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto 2024-05-14T14:52:27.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp 2024-05-14T14:52:27.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-14T14:52:27.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp.ko 2024-05-14T14:52:27.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel 2024-05-14T14:52:27.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat 2024-05-14T14:52:27.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common 2024-05-14T14:52:27.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-14T14:52:27.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-14T14:52:27.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-14T14:52:27.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-aes.ko 2024-05-14T14:52:27.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-sha.ko 2024-05-14T14:52:27.439 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio 2024-05-14T14:52:27.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-14T14:52:27.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca 2024-05-14T14:52:27.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca/dca.ko 2024-05-14T14:52:27.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq 2024-05-14T14:52:27.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-14T14:52:27.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma 2024-05-14T14:52:27.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw 2024-05-14T14:52:27.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-14T14:52:27.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat 2024-05-14T14:52:27.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-14T14:52:27.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac 2024-05-14T14:52:27.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/amd64_edac.ko 2024-05-14T14:52:27.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/e752x_edac.ko 2024-05-14T14:52:27.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/edac_mce_amd.ko 2024-05-14T14:52:27.440 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3000_edac.ko 2024-05-14T14:52:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3200_edac.ko 2024-05-14T14:52:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5100_edac.ko 2024-05-14T14:52:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5400_edac.ko 2024-05-14T14:52:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7300_edac.ko 2024-05-14T14:52:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7core_edac.ko 2024-05-14T14:52:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i82975x_edac.ko 2024-05-14T14:52:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/ie31200_edac.ko 2024-05-14T14:52:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/sb_edac.ko 2024-05-14T14:52:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/x38_edac.ko 2024-05-14T14:52:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware 2024-05-14T14:52:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/edd.ko 2024-05-14T14:52:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-14T14:52:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio 2024-05-14T14:52:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-ich.ko 2024-05-14T14:52:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-14T14:52:27.441 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid 2024-05-14T14:52:27.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-appleir.ko 2024-05-14T14:52:27.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-aureal.ko 2024-05-14T14:52:27.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-axff.ko 2024-05-14T14:52:27.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-dr.ko 2024-05-14T14:52:27.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elecom.ko 2024-05-14T14:52:27.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elo.ko 2024-05-14T14:52:27.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-emsff.ko 2024-05-14T14:52:27.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gaff.ko 2024-05-14T14:52:27.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gt683r.ko 2024-05-14T14:52:27.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gyration.ko 2024-05-14T14:52:27.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-14T14:52:27.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-14T14:52:27.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtekff.ko 2024-05-14T14:52:27.442 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-hyperv.ko 2024-05-14T14:52:27.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-icade.ko 2024-05-14T14:52:27.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-keytouch.ko 2024-05-14T14:52:27.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-kye.ko 2024-05-14T14:52:27.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lcpower.ko 2024-05-14T14:52:27.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-led.ko 2024-05-14T14:52:27.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lenovo.ko 2024-05-14T14:52:27.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-14T14:52:27.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-14T14:52:27.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-multitouch.ko 2024-05-14T14:52:27.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-ortek.ko 2024-05-14T14:52:27.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-penmount.ko 2024-05-14T14:52:27.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-petalynx.ko 2024-05-14T14:52:27.443 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-picolcd.ko 2024-05-14T14:52:27.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-pl.ko 2024-05-14T14:52:27.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-plantronics.ko 2024-05-14T14:52:27.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-primax.ko 2024-05-14T14:52:27.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-rmi.ko 2024-05-14T14:52:27.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-14T14:52:27.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-common.ko 2024-05-14T14:52:27.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-14T14:52:27.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-14T14:52:27.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-14T14:52:27.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-14T14:52:27.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-14T14:52:27.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-14T14:52:27.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-14T14:52:27.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-14T14:52:27.444 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-14T14:52:27.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat.ko 2024-05-14T14:52:27.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-saitek.ko 2024-05-14T14:52:27.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-samsung.ko 2024-05-14T14:52:27.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-14T14:52:27.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sjoy.ko 2024-05-14T14:52:27.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sony.ko 2024-05-14T14:52:27.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-speedlink.ko 2024-05-14T14:52:27.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-steelseries.ko 2024-05-14T14:52:27.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sunplus.ko 2024-05-14T14:52:27.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-14T14:52:27.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tivo.ko 2024-05-14T14:52:27.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tmff.ko 2024-05-14T14:52:27.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-topseed.ko 2024-05-14T14:52:27.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-twinhan.ko 2024-05-14T14:52:27.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-uclogic.ko 2024-05-14T14:52:27.445 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-waltop.ko 2024-05-14T14:52:27.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-wiimote.ko 2024-05-14T14:52:27.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-xinmo.ko 2024-05-14T14:52:27.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zpff.ko 2024-05-14T14:52:27.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zydacron.ko 2024-05-14T14:52:27.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/uhid.ko 2024-05-14T14:52:27.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/wacom.ko 2024-05-14T14:52:27.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv 2024-05-14T14:52:27.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_balloon.ko 2024-05-14T14:52:27.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_utils.ko 2024-05-14T14:52:27.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_vmbus.ko 2024-05-14T14:52:27.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon 2024-05-14T14:52:27.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru.ko 2024-05-14T14:52:27.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru3.ko 2024-05-14T14:52:27.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-14T14:52:27.446 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7414.ko 2024-05-14T14:52:27.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7418.ko 2024-05-14T14:52:27.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adc128d818.ko 2024-05-14T14:52:27.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1025.ko 2024-05-14T14:52:27.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1026.ko 2024-05-14T14:52:27.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1029.ko 2024-05-14T14:52:27.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1031.ko 2024-05-14T14:52:27.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm9240.ko 2024-05-14T14:52:27.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ads7828.ko 2024-05-14T14:52:27.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7410.ko 2024-05-14T14:52:27.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7411.ko 2024-05-14T14:52:27.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7462.ko 2024-05-14T14:52:27.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7470.ko 2024-05-14T14:52:27.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7475.ko 2024-05-14T14:52:27.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7x10.ko 2024-05-14T14:52:27.447 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/amc6821.ko 2024-05-14T14:52:27.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/applesmc.ko 2024-05-14T14:52:27.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asb100.ko 2024-05-14T14:52:27.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asc7621.ko 2024-05-14T14:52:27.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-14T14:52:27.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/atxp1.ko 2024-05-14T14:52:27.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/coretemp.ko 2024-05-14T14:52:27.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-14T14:52:27.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dme1737.ko 2024-05-14T14:52:27.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds1621.ko 2024-05-14T14:52:27.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds620.ko 2024-05-14T14:52:27.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc1403.ko 2024-05-14T14:52:27.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc6w201.ko 2024-05-14T14:52:27.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71805f.ko 2024-05-14T14:52:27.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71882fg.ko 2024-05-14T14:52:27.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f75375s.ko 2024-05-14T14:52:27.448 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fam15h_power.ko 2024-05-14T14:52:27.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fschmd.ko 2024-05-14T14:52:27.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g760a.ko 2024-05-14T14:52:27.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g762.ko 2024-05-14T14:52:27.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl518sm.ko 2024-05-14T14:52:27.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl520sm.ko 2024-05-14T14:52:27.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-14T14:52:27.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5500_temp.ko 2024-05-14T14:52:27.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5k_amb.ko 2024-05-14T14:52:27.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmaem.ko 2024-05-14T14:52:27.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmpex.ko 2024-05-14T14:52:27.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina209.ko 2024-05-14T14:52:27.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina2xx.ko 2024-05-14T14:52:27.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/it87.ko 2024-05-14T14:52:27.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k10temp.ko 2024-05-14T14:52:27.449 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k8temp.ko 2024-05-14T14:52:27.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lineage-pem.ko 2024-05-14T14:52:27.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm63.ko 2024-05-14T14:52:27.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm73.ko 2024-05-14T14:52:27.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm75.ko 2024-05-14T14:52:27.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm77.ko 2024-05-14T14:52:27.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm78.ko 2024-05-14T14:52:27.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm80.ko 2024-05-14T14:52:27.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm83.ko 2024-05-14T14:52:27.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm85.ko 2024-05-14T14:52:27.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm87.ko 2024-05-14T14:52:27.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm90.ko 2024-05-14T14:52:27.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm92.ko 2024-05-14T14:52:27.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm93.ko 2024-05-14T14:52:27.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95234.ko 2024-05-14T14:52:27.450 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95241.ko 2024-05-14T14:52:27.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95245.ko 2024-05-14T14:52:27.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc2945.ko 2024-05-14T14:52:27.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4151.ko 2024-05-14T14:52:27.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4215.ko 2024-05-14T14:52:27.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4222.ko 2024-05-14T14:52:27.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4245.ko 2024-05-14T14:52:27.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4260.ko 2024-05-14T14:52:27.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4261.ko 2024-05-14T14:52:27.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max16065.ko 2024-05-14T14:52:27.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1619.ko 2024-05-14T14:52:27.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1668.ko 2024-05-14T14:52:27.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max197.ko 2024-05-14T14:52:27.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6639.ko 2024-05-14T14:52:27.451 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6650.ko 2024-05-14T14:52:27.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6697.ko 2024-05-14T14:52:27.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/mcp3021.ko 2024-05-14T14:52:27.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6683.ko 2024-05-14T14:52:27.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775-core.ko 2024-05-14T14:52:27.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775.ko 2024-05-14T14:52:27.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct7802.ko 2024-05-14T14:52:27.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87360.ko 2024-05-14T14:52:27.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87427.ko 2024-05-14T14:52:27.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pcf8591.ko 2024-05-14T14:52:27.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus 2024-05-14T14:52:27.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-14T14:52:27.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-14T14:52:27.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-14T14:52:27.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-14T14:52:27.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-14T14:52:27.452 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-14T14:52:27.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-14T14:52:27.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-14T14:52:27.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-14T14:52:27.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-14T14:52:27.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-14T14:52:27.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-14T14:52:27.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/powr1220.ko 2024-05-14T14:52:27.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5627.ko 2024-05-14T14:52:27.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5636.ko 2024-05-14T14:52:27.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-14T14:52:27.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht15.ko 2024-05-14T14:52:27.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht21.ko 2024-05-14T14:52:27.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/shtc1.ko 2024-05-14T14:52:27.453 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sis5595.ko 2024-05-14T14:52:27.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47b397.ko 2024-05-14T14:52:27.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m1.ko 2024-05-14T14:52:27.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m192.ko 2024-05-14T14:52:27.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/thmc50.ko 2024-05-14T14:52:27.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp102.ko 2024-05-14T14:52:27.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp103.ko 2024-05-14T14:52:27.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp401.ko 2024-05-14T14:52:27.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp421.ko 2024-05-14T14:52:27.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via-cputemp.ko 2024-05-14T14:52:27.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via686a.ko 2024-05-14T14:52:27.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt1211.ko 2024-05-14T14:52:27.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt8231.ko 2024-05-14T14:52:27.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627ehf.ko 2024-05-14T14:52:27.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627hf.ko 2024-05-14T14:52:27.454 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83781d.ko 2024-05-14T14:52:27.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83791d.ko 2024-05-14T14:52:27.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83792d.ko 2024-05-14T14:52:27.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83793.ko 2024-05-14T14:52:27.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83795.ko 2024-05-14T14:52:27.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l785ts.ko 2024-05-14T14:52:27.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l786ng.ko 2024-05-14T14:52:27.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c 2024-05-14T14:52:27.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos 2024-05-14T14:52:27.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-14T14:52:27.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-14T14:52:27.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses 2024-05-14T14:52:27.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-14T14:52:27.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-14T14:52:27.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-14T14:52:27.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-14T14:52:27.455 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-14T14:52:27.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-14T14:52:27.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-14T14:52:27.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-14T14:52:27.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-14T14:52:27.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-14T14:52:27.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-14T14:52:27.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-14T14:52:27.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-14T14:52:27.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-14T14:52:27.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-14T14:52:27.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-14T14:52:27.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-14T14:52:27.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-14T14:52:27.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-14T14:52:27.456 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-14T14:52:27.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-14T14:52:27.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-14T14:52:27.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-14T14:52:27.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-dev.ko 2024-05-14T14:52:27.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-mux.ko 2024-05-14T14:52:27.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-14T14:52:27.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-smbus.ko 2024-05-14T14:52:27.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-stub.ko 2024-05-14T14:52:27.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband 2024-05-14T14:52:27.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core 2024-05-14T14:52:27.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-14T14:52:27.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_core.ko 2024-05-14T14:52:27.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-14T14:52:27.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-14T14:52:27.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-14T14:52:27.457 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-14T14:52:27.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-14T14:52:27.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw 2024-05-14T14:52:27.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4 2024-05-14T14:52:27.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-14T14:52:27.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4 2024-05-14T14:52:27.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-14T14:52:27.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5 2024-05-14T14:52:27.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-14T14:52:27.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca 2024-05-14T14:52:27.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-14T14:52:27.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp 2024-05-14T14:52:27.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib 2024-05-14T14:52:27.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-14T14:52:27.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser 2024-05-14T14:52:27.458 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-14T14:52:27.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert 2024-05-14T14:52:27.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-14T14:52:27.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp 2024-05-14T14:52:27.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-14T14:52:27.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt 2024-05-14T14:52:27.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-14T14:52:27.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input 2024-05-14T14:52:27.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport 2024-05-14T14:52:27.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-14T14:52:27.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-14T14:52:27.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/gameport.ko 2024-05-14T14:52:27.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/joydev.ko 2024-05-14T14:52:27.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard 2024-05-14T14:52:27.459 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-14T14:52:27.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse 2024-05-14T14:52:27.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/appletouch.ko 2024-05-14T14:52:27.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/bcm5974.ko 2024-05-14T14:52:27.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/cyapatp.ko 2024-05-14T14:52:27.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-14T14:52:27.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/sermouse.ko 2024-05-14T14:52:27.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-14T14:52:27.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-14T14:52:27.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-14T14:52:27.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4 2024-05-14T14:52:27.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-14T14:52:27.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio 2024-05-14T14:52:27.460 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/altera_ps2.ko 2024-05-14T14:52:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/arc_ps2.ko 2024-05-14T14:52:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-14T14:52:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/serio_raw.ko 2024-05-14T14:52:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/sparse-keymap.ko 2024-05-14T14:52:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds 2024-05-14T14:52:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-blinkm.ko 2024-05-14T14:52:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lm3530.ko 2024-05-14T14:52:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lp3944.ko 2024-05-14T14:52:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-ss4200.ko 2024-05-14T14:52:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger 2024-05-14T14:52:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-14T14:52:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-14T14:52:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-14T14:52:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-14T14:52:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-14T14:52:27.461 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-14T14:52:27.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-14T14:52:27.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-14T14:52:27.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-14T14:52:27.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md 2024-05-14T14:52:27.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache 2024-05-14T14:52:27.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache/bcache.ko 2024-05-14T14:52:27.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-bio-prison.ko 2024-05-14T14:52:27.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache-smq.ko 2024-05-14T14:52:27.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache.ko 2024-05-14T14:52:27.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-crypt.ko 2024-05-14T14:52:27.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-delay.ko 2024-05-14T14:52:27.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-flakey.ko 2024-05-14T14:52:27.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-log-userspace.ko 2024-05-14T14:52:27.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-multipath.ko 2024-05-14T14:52:27.462 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-queue-length.ko 2024-05-14T14:52:27.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-raid.ko 2024-05-14T14:52:27.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-round-robin.ko 2024-05-14T14:52:27.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-service-time.ko 2024-05-14T14:52:27.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-switch.ko 2024-05-14T14:52:27.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-thin-pool.ko 2024-05-14T14:52:27.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-verity.ko 2024-05-14T14:52:27.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data 2024-05-14T14:52:27.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-14T14:52:27.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid0.ko 2024-05-14T14:52:27.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid1.ko 2024-05-14T14:52:27.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid10.ko 2024-05-14T14:52:27.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid456.ko 2024-05-14T14:52:27.463 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message 2024-05-14T14:52:27.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion 2024-05-14T14:52:27.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptbase.ko 2024-05-14T14:52:27.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptctl.ko 2024-05-14T14:52:27.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptfc.ko 2024-05-14T14:52:27.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptlan.ko 2024-05-14T14:52:27.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptsas.ko 2024-05-14T14:52:27.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptscsih.ko 2024-05-14T14:52:27.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptspi.ko 2024-05-14T14:52:27.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd 2024-05-14T14:52:27.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_ich.ko 2024-05-14T14:52:27.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_sch.ko 2024-05-14T14:52:27.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/mfd-core.ko 2024-05-14T14:52:27.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/sm501.ko 2024-05-14T14:52:27.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/viperboard.ko 2024-05-14T14:52:27.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/vx855.ko 2024-05-14T14:52:27.464 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/wl1273-core.ko 2024-05-14T14:52:27.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc 2024-05-14T14:52:27.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl 2024-05-14T14:52:27.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-14T14:52:27.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds9802als.ko 2024-05-14T14:52:27.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds990x.ko 2024-05-14T14:52:27.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/bh1770glc.ko 2024-05-14T14:52:27.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710 2024-05-14T14:52:27.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710/cb710.ko 2024-05-14T14:52:27.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom 2024-05-14T14:52:27.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/at24.ko 2024-05-14T14:52:27.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-14T14:52:27.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/max6875.ko 2024-05-14T14:52:27.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/enclosure.ko 2024-05-14T14:52:27.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/hpilo.ko 2024-05-14T14:52:27.465 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29003.ko 2024-05-14T14:52:27.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29020.ko 2024-05-14T14:52:27.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d 2024-05-14T14:52:27.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-14T14:52:27.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-14T14:52:27.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei 2024-05-14T14:52:27.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-me.ko 2024-05-14T14:52:27.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-txe.ko 2024-05-14T14:52:27.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei.ko 2024-05-14T14:52:27.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru 2024-05-14T14:52:27.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-14T14:52:27.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp 2024-05-14T14:52:27.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-14T14:52:27.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-14T14:52:27.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-14T14:52:27.466 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_7xx1.ko 2024-05-14T14:52:27.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_core.ko 2024-05-14T14:52:27.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tsl2550.ko 2024-05-14T14:52:27.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_balloon.ko 2024-05-14T14:52:27.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci 2024-05-14T14:52:27.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-14T14:52:27.467 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net 2024-05-14T14:52:27.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding 2024-05-14T14:52:27.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding/bonding.ko 2024-05-14T14:52:27.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa 2024-05-14T14:52:27.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53 2024-05-14T14:52:27.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-14T14:52:27.468 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-14T14:52:27.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-14T14:52:27.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx 2024-05-14T14:52:27.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-14T14:52:27.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dummy.ko 2024-05-14T14:52:27.469 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/eql.ko 2024-05-14T14:52:27.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet 2024-05-14T14:52:27.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com 2024-05-14T14:52:27.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-14T14:52:27.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-14T14:52:27.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-14T14:52:27.470 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-14T14:52:27.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390 2024-05-14T14:52:27.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-14T14:52:27.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-14T14:52:27.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-14T14:52:27.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-14T14:52:27.471 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec 2024-05-14T14:52:27.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-14T14:52:27.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere 2024-05-14T14:52:27.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-14T14:52:27.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon 2024-05-14T14:52:27.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-14T14:52:27.472 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera 2024-05-14T14:52:27.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-14T14:52:27.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd 2024-05-14T14:52:27.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-14T14:52:27.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-14T14:52:27.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-14T14:52:27.473 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros 2024-05-14T14:52:27.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx 2024-05-14T14:52:27.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-14T14:52:27.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-14T14:52:27.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-14T14:52:27.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-14T14:52:27.474 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-14T14:52:27.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx 2024-05-14T14:52:27.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-14T14:52:27.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-14T14:52:27.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom 2024-05-14T14:52:27.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-14T14:52:27.475 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-14T14:52:27.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-14T14:52:27.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-14T14:52:27.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-14T14:52:27.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet 2024-05-14T14:52:27.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-14T14:52:27.476 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-14T14:52:27.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade 2024-05-14T14:52:27.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna 2024-05-14T14:52:27.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-14T14:52:27.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio 2024-05-14T14:52:27.477 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-14T14:52:27.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-14T14:52:27.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-14T14:52:27.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-14T14:52:27.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-14T14:52:27.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-14T14:52:27.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-14T14:52:27.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-14T14:52:27.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-14T14:52:27.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-14T14:52:27.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco 2024-05-14T14:52:27.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic 2024-05-14T14:52:27.478 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-14T14:52:27.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec 2024-05-14T14:52:27.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip 2024-05-14T14:52:27.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-14T14:52:27.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-14T14:52:27.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-14T14:52:27.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-14T14:52:27.479 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-14T14:52:27.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-14T14:52:27.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink 2024-05-14T14:52:27.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-14T14:52:27.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-14T14:52:27.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dnet.ko 2024-05-14T14:52:27.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex 2024-05-14T14:52:27.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet 2024-05-14T14:52:27.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-14T14:52:27.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ethoc.ko 2024-05-14T14:52:27.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/fealnx.ko 2024-05-14T14:52:27.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel 2024-05-14T14:52:27.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-14T14:52:27.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000 2024-05-14T14:52:27.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-14T14:52:27.480 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e 2024-05-14T14:52:27.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-14T14:52:27.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k 2024-05-14T14:52:27.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-14T14:52:27.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e 2024-05-14T14:52:27.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-14T14:52:27.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf 2024-05-14T14:52:27.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-14T14:52:27.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb 2024-05-14T14:52:27.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-14T14:52:27.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf 2024-05-14T14:52:27.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-14T14:52:27.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-14T14:52:27.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-14T14:52:27.481 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-14T14:52:27.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-14T14:52:27.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/jme.ko 2024-05-14T14:52:27.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell 2024-05-14T14:52:27.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-14T14:52:27.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-14T14:52:27.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-14T14:52:27.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox 2024-05-14T14:52:27.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-14T14:52:27.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-14T14:52:27.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-14T14:52:27.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-14T14:52:27.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-14T14:52:27.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-14T14:52:27.482 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel 2024-05-14T14:52:27.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-14T14:52:27.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom 2024-05-14T14:52:27.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-14T14:52:27.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-14T14:52:27.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi 2024-05-14T14:52:27.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-14T14:52:27.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-14T14:52:27.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion 2024-05-14T14:52:27.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-14T14:52:27.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia 2024-05-14T14:52:27.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-14T14:52:27.483 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines 2024-05-14T14:52:27.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-14T14:52:27.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-14T14:52:27.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic 2024-05-14T14:52:27.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-14T14:52:27.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-14T14:52:27.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-14T14:52:27.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-14T14:52:27.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-14T14:52:27.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc 2024-05-14T14:52:27.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-14T14:52:27.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek 2024-05-14T14:52:27.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-14T14:52:27.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-14T14:52:27.484 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-14T14:52:27.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-14T14:52:27.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker 2024-05-14T14:52:27.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-14T14:52:27.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc 2024-05-14T14:52:27.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-14T14:52:27.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan 2024-05-14T14:52:27.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-14T14:52:27.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis 2024-05-14T14:52:27.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-14T14:52:27.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-14T14:52:27.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc 2024-05-14T14:52:27.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-14T14:52:27.485 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-14T14:52:27.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-14T14:52:27.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-14T14:52:27.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro 2024-05-14T14:52:27.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-14T14:52:27.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-14T14:52:27.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-14T14:52:27.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun 2024-05-14T14:52:27.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-14T14:52:27.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-14T14:52:27.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-14T14:52:27.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-14T14:52:27.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti 2024-05-14T14:52:27.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-14T14:52:27.486 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti 2024-05-14T14:52:27.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-14T14:52:27.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via 2024-05-14T14:52:27.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-14T14:52:27.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-14T14:52:27.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet 2024-05-14T14:52:27.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-14T14:52:27.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-14T14:52:27.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom 2024-05-14T14:52:27.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-14T14:52:27.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/geneve.ko 2024-05-14T14:52:27.487 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv 2024-05-14T14:52:27.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-14T14:52:27.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154 2024-05-14T14:52:27.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-14T14:52:27.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ifb.ko 2024-05-14T14:52:27.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan 2024-05-14T14:52:27.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-14T14:52:27.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvlan.ko 2024-05-14T14:52:27.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvtap.ko 2024-05-14T14:52:27.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio 2024-05-14T14:52:27.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio.ko 2024-05-14T14:52:27.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-14T14:52:27.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-14T14:52:27.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-14T14:52:27.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mii.ko 2024-05-14T14:52:27.488 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/net_failover.ko 2024-05-14T14:52:27.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/netconsole.ko 2024-05-14T14:52:27.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/nlmon.ko 2024-05-14T14:52:27.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs 2024-05-14T14:52:27.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-14T14:52:27.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-14T14:52:27.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy 2024-05-14T14:52:27.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/amd.ko 2024-05-14T14:52:27.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-14T14:52:27.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-14T14:52:27.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-14T14:52:27.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm87xx.ko 2024-05-14T14:52:27.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/broadcom.ko 2024-05-14T14:52:27.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/cicada.ko 2024-05-14T14:52:27.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/davicom.ko 2024-05-14T14:52:27.489 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/dp83640.ko 2024-05-14T14:52:27.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/et1011c.ko 2024-05-14T14:52:27.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/icplus.ko 2024-05-14T14:52:27.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/lxt.ko 2024-05-14T14:52:27.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/marvell.ko 2024-05-14T14:52:27.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/micrel.ko 2024-05-14T14:52:27.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/national.ko 2024-05-14T14:52:27.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/phylink.ko 2024-05-14T14:52:27.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/qsemi.ko 2024-05-14T14:52:27.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/realtek.ko 2024-05-14T14:52:27.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/smsc.ko 2024-05-14T14:52:27.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/ste10Xp.ko 2024-05-14T14:52:27.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/vitesse.ko 2024-05-14T14:52:27.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp 2024-05-14T14:52:27.490 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-14T14:52:27.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_async.ko 2024-05-14T14:52:27.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-14T14:52:27.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-14T14:52:27.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-14T14:52:27.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-14T14:52:27.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppoe.ko 2024-05-14T14:52:27.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppox.ko 2024-05-14T14:52:27.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pptp.ko 2024-05-14T14:52:27.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip 2024-05-14T14:52:27.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slhc.ko 2024-05-14T14:52:27.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slip.ko 2024-05-14T14:52:27.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/sungem_phy.ko 2024-05-14T14:52:27.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tap.ko 2024-05-14T14:52:27.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team 2024-05-14T14:52:27.491 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team.ko 2024-05-14T14:52:27.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-14T14:52:27.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-14T14:52:27.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-14T14:52:27.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_random.ko 2024-05-14T14:52:27.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-14T14:52:27.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tun.ko 2024-05-14T14:52:27.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/veth.ko 2024-05-14T14:52:27.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/virtio_net.ko 2024-05-14T14:52:27.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3 2024-05-14T14:52:27.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-14T14:52:27.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan 2024-05-14T14:52:27.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan/vxlan.ko 2024-05-14T14:52:27.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback 2024-05-14T14:52:27.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-14T14:52:27.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netfront.ko 2024-05-14T14:52:27.492 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb 2024-05-14T14:52:27.493 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb/ntb.ko 2024-05-14T14:52:27.493 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme 2024-05-14T14:52:27.493 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host 2024-05-14T14:52:27.493 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme-core.ko 2024-05-14T14:52:27.493 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme.ko 2024-05-14T14:52:27.493 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport 2024-05-14T14:52:27.493 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport.ko 2024-05-14T14:52:27.493 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_cs.ko 2024-05-14T14:52:27.493 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_pc.ko 2024-05-14T14:52:27.493 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_serial.ko 2024-05-14T14:52:27.493 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci 2024-05-14T14:52:27.493 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug 2024-05-14T14:52:27.494 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-14T14:52:27.494 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie 2024-05-14T14:52:27.494 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-14T14:52:27.494 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/xen-pcifront.ko 2024-05-14T14:52:27.494 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia 2024-05-14T14:52:27.494 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/i82092.ko 2024-05-14T14:52:27.494 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/pd6729.ko 2024-05-14T14:52:27.494 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-14T14:52:27.494 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl 2024-05-14T14:52:27.494 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel 2024-05-14T14:52:27.494 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-14T14:52:27.494 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform 2024-05-14T14:52:27.495 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86 2024-05-14T14:52:27.495 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-14T14:52:27.495 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acerhdf.ko 2024-05-14T14:52:27.495 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-14T14:52:27.495 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-14T14:52:27.495 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-14T14:52:27.495 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-14T14:52:27.495 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-14T14:52:27.495 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-14T14:52:27.495 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-14T14:52:27.495 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-14T14:52:27.495 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-14T14:52:27.495 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/hdaps.ko 2024-05-14T14:52:27.495 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel 2024-05-14T14:52:27.495 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-14T14:52:27.496 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel_ips.ko 2024-05-14T14:52:27.496 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-14T14:52:27.496 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-14T14:52:27.496 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-14T14:52:27.496 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-14T14:52:27.496 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-14T14:52:27.496 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-14T14:52:27.496 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-14T14:52:27.496 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-14T14:52:27.496 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-14T14:52:27.496 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi.ko 2024-05-14T14:52:27.496 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap 2024-05-14T14:52:27.496 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-14T14:52:27.496 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-14T14:52:27.496 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps 2024-05-14T14:52:27.497 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients 2024-05-14T14:52:27.497 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-14T14:52:27.497 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-14T14:52:27.497 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps_parport.ko 2024-05-14T14:52:27.497 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/pps_core.ko 2024-05-14T14:52:27.497 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp 2024-05-14T14:52:27.497 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp.ko 2024-05-14T14:52:27.497 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp_kvm.ko 2024-05-14T14:52:27.497 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras 2024-05-14T14:52:27.497 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd 2024-05-14T14:52:27.497 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl 2024-05-14T14:52:27.497 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-14T14:52:27.497 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/fmpm.ko 2024-05-14T14:52:27.498 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc 2024-05-14T14:52:27.498 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-14T14:52:27.498 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-14T14:52:27.498 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-14T14:52:27.498 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-14T14:52:27.498 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-14T14:52:27.498 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-14T14:52:27.498 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-14T14:52:27.498 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-14T14:52:27.498 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-14T14:52:27.498 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-14T14:52:27.498 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-em3027.ko 2024-05-14T14:52:27.498 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-14T14:52:27.498 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-14T14:52:27.499 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-14T14:52:27.499 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-14T14:52:27.499 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-14T14:52:27.499 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-14T14:52:27.499 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-max6900.ko 2024-05-14T14:52:27.499 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-14T14:52:27.499 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-14T14:52:27.499 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-14T14:52:27.499 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-14T14:52:27.499 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-14T14:52:27.499 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-14T14:52:27.499 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-14T14:52:27.499 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-14T14:52:27.499 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-14T14:52:27.499 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-14T14:52:27.500 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-14T14:52:27.500 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-14T14:52:27.500 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-x1205.ko 2024-05-14T14:52:27.500 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi 2024-05-14T14:52:27.500 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-9xxx.ko 2024-05-14T14:52:27.500 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-sas.ko 2024-05-14T14:52:27.500 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-xxxx.ko 2024-05-14T14:52:27.500 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/BusLogic.ko 2024-05-14T14:52:27.500 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/a100u2w.ko 2024-05-14T14:52:27.500 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid 2024-05-14T14:52:27.500 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-14T14:52:27.500 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/advansys.ko 2024-05-14T14:52:27.500 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx 2024-05-14T14:52:27.500 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-14T14:52:27.500 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-14T14:52:27.500 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/am53c974.ko 2024-05-14T14:52:27.501 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr 2024-05-14T14:52:27.501 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-14T14:52:27.501 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/atp870u.ko 2024-05-14T14:52:27.501 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi 2024-05-14T14:52:27.501 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-14T14:52:27.501 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa 2024-05-14T14:52:27.501 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa/bfa.ko 2024-05-14T14:52:27.501 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc 2024-05-14T14:52:27.501 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-14T14:52:27.501 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i 2024-05-14T14:52:27.501 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-14T14:52:27.501 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ch.ko 2024-05-14T14:52:27.502 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor 2024-05-14T14:52:27.502 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-14T14:52:27.502 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi 2024-05-14T14:52:27.502 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-14T14:52:27.502 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-14T14:52:27.502 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-14T14:52:27.502 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-14T14:52:27.502 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-14T14:52:27.502 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dc395x.ko 2024-05-14T14:52:27.502 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler 2024-05-14T14:52:27.502 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-14T14:52:27.502 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-14T14:52:27.502 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-14T14:52:27.502 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-14T14:52:27.503 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dmx3191d.ko 2024-05-14T14:52:27.503 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r 2024-05-14T14:52:27.503 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-14T14:52:27.503 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esp_scsi.ko 2024-05-14T14:52:27.503 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe 2024-05-14T14:52:27.503 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-14T14:52:27.503 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-14T14:52:27.503 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic 2024-05-14T14:52:27.503 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic/fnic.ko 2024-05-14T14:52:27.503 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hpsa.ko 2024-05-14T14:52:27.503 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hptiop.ko 2024-05-14T14:52:27.503 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hv_storvsc.ko 2024-05-14T14:52:27.503 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/initio.ko 2024-05-14T14:52:27.503 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ipr.ko 2024-05-14T14:52:27.503 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ips.ko 2024-05-14T14:52:27.504 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci 2024-05-14T14:52:27.504 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci/isci.ko 2024-05-14T14:52:27.504 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-14T14:52:27.504 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-14T14:52:27.504 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc 2024-05-14T14:52:27.504 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc/libfc.ko 2024-05-14T14:52:27.504 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi.ko 2024-05-14T14:52:27.504 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-14T14:52:27.504 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas 2024-05-14T14:52:27.504 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas/libsas.ko 2024-05-14T14:52:27.504 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc 2024-05-14T14:52:27.504 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-14T14:52:27.504 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid 2024-05-14T14:52:27.505 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid.ko 2024-05-14T14:52:27.505 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-14T14:52:27.505 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-14T14:52:27.505 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-14T14:52:27.505 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas 2024-05-14T14:52:27.505 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-14T14:52:27.505 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas 2024-05-14T14:52:27.505 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-14T14:52:27.505 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvumi.ko 2024-05-14T14:52:27.505 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001 2024-05-14T14:52:27.505 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-14T14:52:27.505 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pmcraid.ko 2024-05-14T14:52:27.505 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla1280.ko 2024-05-14T14:52:27.506 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx 2024-05-14T14:52:27.506 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-14T14:52:27.506 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-14T14:52:27.506 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx 2024-05-14T14:52:27.506 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-14T14:52:27.506 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/raid_class.ko 2024-05-14T14:52:27.506 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_debug.ko 2024-05-14T14:52:27.506 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-14T14:52:27.506 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-14T14:52:27.506 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-14T14:52:27.506 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-14T14:52:27.506 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-14T14:52:27.506 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ses.ko 2024-05-14T14:52:27.507 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/st.ko 2024-05-14T14:52:27.507 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/stex.ko 2024-05-14T14:52:27.507 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2 2024-05-14T14:52:27.507 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-14T14:52:27.507 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/virtio_scsi.ko 2024-05-14T14:52:27.507 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-14T14:52:27.507 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/wd719x.ko 2024-05-14T14:52:27.507 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb 2024-05-14T14:52:27.507 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb/ssb.ko 2024-05-14T14:52:27.507 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target 2024-05-14T14:52:27.507 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi 2024-05-14T14:52:27.507 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-14T14:52:27.507 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback 2024-05-14T14:52:27.507 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-14T14:52:27.507 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_file.ko 2024-05-14T14:52:27.508 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_iblock.ko 2024-05-14T14:52:27.508 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_mod.ko 2024-05-14T14:52:27.508 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_pscsi.ko 2024-05-14T14:52:27.508 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_user.ko 2024-05-14T14:52:27.508 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc 2024-05-14T14:52:27.508 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-14T14:52:27.508 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal 2024-05-14T14:52:27.508 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel 2024-05-14T14:52:27.508 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal 2024-05-14T14:52:27.508 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-14T14:52:27.508 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-14T14:52:27.508 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-14T14:52:27.508 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-14T14:52:27.509 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-14T14:52:27.509 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-14T14:52:27.509 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-14T14:52:27.509 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-14T14:52:27.509 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-14T14:52:27.509 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-14T14:52:27.509 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-14T14:52:27.509 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-14T14:52:27.509 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-14T14:52:27.509 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-14T14:52:27.509 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-14T14:52:27.509 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-14T14:52:27.509 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-14T14:52:27.509 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-14T14:52:27.509 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty 2024-05-14T14:52:27.510 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless 2024-05-14T14:52:27.510 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-14T14:52:27.510 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_gsm.ko 2024-05-14T14:52:27.510 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_hdlc.ko 2024-05-14T14:52:27.510 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/nozomi.ko 2024-05-14T14:52:27.510 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial 2024-05-14T14:52:27.510 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250 2024-05-14T14:52:27.510 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-14T14:52:27.510 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/arc_uart.ko 2024-05-14T14:52:27.510 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm 2024-05-14T14:52:27.510 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-14T14:52:27.510 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs 2024-05-14T14:52:27.510 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core 2024-05-14T14:52:27.511 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-14T14:52:27.511 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host 2024-05-14T14:52:27.511 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-14T14:52:27.511 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio 2024-05-14T14:52:27.511 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio.ko 2024-05-14T14:52:27.511 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_aec.ko 2024-05-14T14:52:27.511 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_cif.ko 2024-05-14T14:52:27.511 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_pci_generic.ko 2024-05-14T14:52:27.511 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_sercos3.ko 2024-05-14T14:52:27.511 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb 2024-05-14T14:52:27.511 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class 2024-05-14T14:52:27.511 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-acm.ko 2024-05-14T14:52:27.511 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-14T14:52:27.511 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usblp.ko 2024-05-14T14:52:27.511 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usbtmc.ko 2024-05-14T14:52:27.512 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host 2024-05-14T14:52:27.512 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-14T14:52:27.512 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image 2024-05-14T14:52:27.512 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/mdc800.ko 2024-05-14T14:52:27.512 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/microtek.ko 2024-05-14T14:52:27.512 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc 2024-05-14T14:52:27.512 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/adutux.ko 2024-05-14T14:52:27.512 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/appledisplay.ko 2024-05-14T14:52:27.512 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi26.ko 2024-05-14T14:52:27.512 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi62.ko 2024-05-14T14:52:27.512 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ezusb.ko 2024-05-14T14:52:27.512 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/idmouse.ko 2024-05-14T14:52:27.512 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/iowarrior.ko 2024-05-14T14:52:27.512 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-14T14:52:27.513 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ldusb.ko 2024-05-14T14:52:27.513 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/legousbtower.ko 2024-05-14T14:52:27.513 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga 2024-05-14T14:52:27.513 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-14T14:52:27.513 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-14T14:52:27.513 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usb3503.ko 2024-05-14T14:52:27.513 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usblcd.ko 2024-05-14T14:52:27.513 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-14T14:52:27.513 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/uss720.ko 2024-05-14T14:52:27.513 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/yurex.ko 2024-05-14T14:52:27.513 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy 2024-05-14T14:52:27.513 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy/phy-generic.ko 2024-05-14T14:52:27.513 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial 2024-05-14T14:52:27.513 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/aircable.ko 2024-05-14T14:52:27.514 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ark3116.ko 2024-05-14T14:52:27.514 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-14T14:52:27.514 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ch341.ko 2024-05-14T14:52:27.514 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cp210x.ko 2024-05-14T14:52:27.514 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cyberjack.ko 2024-05-14T14:52:27.514 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-14T14:52:27.514 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-14T14:52:27.514 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/empeg.ko 2024-05-14T14:52:27.514 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-14T14:52:27.514 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-14T14:52:27.514 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-14T14:52:27.514 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_ti.ko 2024-05-14T14:52:27.514 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipaq.ko 2024-05-14T14:52:27.515 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipw.ko 2024-05-14T14:52:27.515 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ir-usb.ko 2024-05-14T14:52:27.515 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-14T14:52:27.515 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan.ko 2024-05-14T14:52:27.515 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-14T14:52:27.515 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-14T14:52:27.515 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-14T14:52:27.515 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mct_u232.ko 2024-05-14T14:52:27.515 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7720.ko 2024-05-14T14:52:27.515 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7840.ko 2024-05-14T14:52:27.515 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/navman.ko 2024-05-14T14:52:27.515 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/omninet.ko 2024-05-14T14:52:27.515 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/opticon.ko 2024-05-14T14:52:27.516 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/option.ko 2024-05-14T14:52:27.516 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/oti6858.ko 2024-05-14T14:52:27.516 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/pl2303.ko 2024-05-14T14:52:27.516 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcaux.ko 2024-05-14T14:52:27.516 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcserial.ko 2024-05-14T14:52:27.516 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/quatech2.ko 2024-05-14T14:52:27.516 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/safe_serial.ko 2024-05-14T14:52:27.516 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/sierra.ko 2024-05-14T14:52:27.516 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-14T14:52:27.516 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ssu100.ko 2024-05-14T14:52:27.516 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/symbolserial.ko 2024-05-14T14:52:27.517 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-14T14:52:27.517 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-14T14:52:27.517 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_debug.ko 2024-05-14T14:52:27.517 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-14T14:52:27.517 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/visor.ko 2024-05-14T14:52:27.517 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/whiteheat.ko 2024-05-14T14:52:27.517 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-14T14:52:27.517 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage 2024-05-14T14:52:27.517 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/uas.ko 2024-05-14T14:52:27.517 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-14T14:52:27.517 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-14T14:52:27.517 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-14T14:52:27.518 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-14T14:52:27.518 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-14T14:52:27.518 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-14T14:52:27.518 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-14T14:52:27.518 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-karma.ko 2024-05-14T14:52:27.518 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-14T14:52:27.518 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-14T14:52:27.518 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-14T14:52:27.518 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-14T14:52:27.518 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-14T14:52:27.518 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/usb-storage.ko 2024-05-14T14:52:27.518 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip 2024-05-14T14:52:27.518 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-14T14:52:27.519 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-14T14:52:27.519 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-14T14:52:27.519 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio 2024-05-14T14:52:27.519 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci 2024-05-14T14:52:27.519 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-14T14:52:27.519 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-14T14:52:27.519 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio.ko 2024-05-14T14:52:27.519 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-14T14:52:27.519 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost 2024-05-14T14:52:27.519 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost.ko 2024-05-14T14:52:27.519 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-14T14:52:27.519 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_net.ko 2024-05-14T14:52:27.519 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_scsi.ko 2024-05-14T14:52:27.519 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video 2024-05-14T14:52:27.520 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight 2024-05-14T14:52:27.520 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/apple_bl.ko 2024-05-14T14:52:27.520 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/lcd.ko 2024-05-14T14:52:27.520 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-14T14:52:27.520 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio 2024-05-14T14:52:27.520 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio.ko 2024-05-14T14:52:27.520 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_balloon.ko 2024-05-14T14:52:27.520 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_mmio.ko 2024-05-14T14:52:27.520 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci.ko 2024-05-14T14:52:27.520 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-14T14:52:27.520 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-14T14:52:27.520 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_ring.ko 2024-05-14T14:52:27.520 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1 2024-05-14T14:52:27.520 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters 2024-05-14T14:52:27.521 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2482.ko 2024-05-14T14:52:27.521 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2490.ko 2024-05-14T14:52:27.521 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves 2024-05-14T14:52:27.521 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-14T14:52:27.521 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-14T14:52:27.521 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-14T14:52:27.521 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-14T14:52:27.521 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-14T14:52:27.521 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-14T14:52:27.521 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-14T14:52:27.521 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-14T14:52:27.521 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-14T14:52:27.521 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-14T14:52:27.521 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-14T14:52:27.521 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/wire.ko 2024-05-14T14:52:27.522 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog 2024-05-14T14:52:27.522 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-14T14:52:27.522 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-14T14:52:27.522 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-14T14:52:27.522 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/hpwdt.ko 2024-05-14T14:52:27.522 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/i6300esb.ko 2024-05-14T14:52:27.522 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-14T14:52:27.522 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-14T14:52:27.522 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ib700wdt.ko 2024-05-14T14:52:27.522 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ibmasr.ko 2024-05-14T14:52:27.522 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-14T14:52:27.522 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-14T14:52:27.523 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it87_wdt.ko 2024-05-14T14:52:27.523 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/machzwd.ko 2024-05-14T14:52:27.523 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/nv_tco.ko 2024-05-14T14:52:27.523 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-14T14:52:27.523 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-14T14:52:27.523 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-14T14:52:27.523 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-14T14:52:27.523 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/softdog.ko 2024-05-14T14:52:27.523 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-14T14:52:27.523 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/via_wdt.ko 2024-05-14T14:52:27.523 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-14T14:52:27.523 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-14T14:52:27.523 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-14T14:52:27.523 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/wdt_pci.ko 2024-05-14T14:52:27.523 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/xen_wdt.ko 2024-05-14T14:52:27.524 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen 2024-05-14T14:52:27.524 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-14T14:52:27.524 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-evtchn.ko 2024-05-14T14:52:27.524 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntalloc.ko 2024-05-14T14:52:27.524 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntdev.ko 2024-05-14T14:52:27.524 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback 2024-05-14T14:52:27.524 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-14T14:52:27.524 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-privcmd.ko 2024-05-14T14:52:27.524 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs 2024-05-14T14:52:27.524 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-14T14:52:27.524 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs 2024-05-14T14:52:27.524 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p 2024-05-14T14:52:27.524 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p/9p.ko 2024-05-14T14:52:27.524 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs 2024-05-14T14:52:27.524 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs/affs.ko 2024-05-14T14:52:27.524 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs 2024-05-14T14:52:27.525 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs/befs.ko 2024-05-14T14:52:27.525 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/binfmt_misc.ko 2024-05-14T14:52:27.525 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs 2024-05-14T14:52:27.525 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs/btrfs.ko 2024-05-14T14:52:27.525 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles 2024-05-14T14:52:27.525 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles/cachefiles.ko 2024-05-14T14:52:27.525 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph 2024-05-14T14:52:27.525 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph/ceph.ko 2024-05-14T14:52:27.525 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda 2024-05-14T14:52:27.525 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda/coda.ko 2024-05-14T14:52:27.525 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs 2024-05-14T14:52:27.525 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs/cramfs.ko 2024-05-14T14:52:27.525 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm 2024-05-14T14:52:27.525 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm/dlm.ko 2024-05-14T14:52:27.525 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs 2024-05-14T14:52:27.526 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-14T14:52:27.526 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs 2024-05-14T14:52:27.526 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs/f2fs.ko 2024-05-14T14:52:27.526 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat 2024-05-14T14:52:27.526 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/fat.ko 2024-05-14T14:52:27.526 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/msdos.ko 2024-05-14T14:52:27.526 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/vfat.ko 2024-05-14T14:52:27.526 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse 2024-05-14T14:52:27.526 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/cuse.ko 2024-05-14T14:52:27.526 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/fuse.ko 2024-05-14T14:52:27.526 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2 2024-05-14T14:52:27.526 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2/gfs2.ko 2024-05-14T14:52:27.526 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs 2024-05-14T14:52:27.526 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs/hfs.ko 2024-05-14T14:52:27.527 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus 2024-05-14T14:52:27.527 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus/hfsplus.ko 2024-05-14T14:52:27.527 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs 2024-05-14T14:52:27.527 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs/isofs.ko 2024-05-14T14:52:27.527 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs 2024-05-14T14:52:27.527 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs/jfs.ko 2024-05-14T14:52:27.527 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd 2024-05-14T14:52:27.527 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd/lockd.ko 2024-05-14T14:52:27.527 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix 2024-05-14T14:52:27.527 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix/minix.ko 2024-05-14T14:52:27.527 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs 2024-05-14T14:52:27.527 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs/netfs.ko 2024-05-14T14:52:27.527 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs 2024-05-14T14:52:27.527 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout 2024-05-14T14:52:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-14T14:52:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout 2024-05-14T14:52:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-14T14:52:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout 2024-05-14T14:52:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-14T14:52:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfs.ko 2024-05-14T14:52:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv3.ko 2024-05-14T14:52:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv4.ko 2024-05-14T14:52:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common 2024-05-14T14:52:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/grace.ko 2024-05-14T14:52:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/nfs_acl.ko 2024-05-14T14:52:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd 2024-05-14T14:52:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd/nfsd.ko 2024-05-14T14:52:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2 2024-05-14T14:52:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2/nilfs2.ko 2024-05-14T14:52:27.528 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls 2024-05-14T14:52:27.529 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-celtic.ko 2024-05-14T14:52:27.529 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-centeuro.ko 2024-05-14T14:52:27.529 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-croatian.ko 2024-05-14T14:52:27.529 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-cyrillic.ko 2024-05-14T14:52:27.529 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-gaelic.ko 2024-05-14T14:52:27.529 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-greek.ko 2024-05-14T14:52:27.529 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-iceland.ko 2024-05-14T14:52:27.529 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-inuit.ko 2024-05-14T14:52:27.529 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-roman.ko 2024-05-14T14:52:27.529 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-romanian.ko 2024-05-14T14:52:27.529 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-turkish.ko 2024-05-14T14:52:27.529 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1250.ko 2024-05-14T14:52:27.529 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1251.ko 2024-05-14T14:52:27.530 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1255.ko 2024-05-14T14:52:27.530 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp737.ko 2024-05-14T14:52:27.530 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp775.ko 2024-05-14T14:52:27.530 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp850.ko 2024-05-14T14:52:27.530 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp852.ko 2024-05-14T14:52:27.530 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp855.ko 2024-05-14T14:52:27.530 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp857.ko 2024-05-14T14:52:27.530 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp860.ko 2024-05-14T14:52:27.530 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp861.ko 2024-05-14T14:52:27.530 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp862.ko 2024-05-14T14:52:27.530 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp863.ko 2024-05-14T14:52:27.530 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp864.ko 2024-05-14T14:52:27.531 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp865.ko 2024-05-14T14:52:27.531 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp866.ko 2024-05-14T14:52:27.531 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp869.ko 2024-05-14T14:52:27.531 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp874.ko 2024-05-14T14:52:27.531 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp932.ko 2024-05-14T14:52:27.531 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp936.ko 2024-05-14T14:52:27.531 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp949.ko 2024-05-14T14:52:27.531 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp950.ko 2024-05-14T14:52:27.531 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_euc-jp.ko 2024-05-14T14:52:27.531 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-1.ko 2024-05-14T14:52:27.531 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-13.ko 2024-05-14T14:52:27.531 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-14.ko 2024-05-14T14:52:27.531 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-15.ko 2024-05-14T14:52:27.531 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-2.ko 2024-05-14T14:52:27.531 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-3.ko 2024-05-14T14:52:27.532 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-4.ko 2024-05-14T14:52:27.532 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-5.ko 2024-05-14T14:52:27.532 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-6.ko 2024-05-14T14:52:27.532 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-7.ko 2024-05-14T14:52:27.532 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-9.ko 2024-05-14T14:52:27.532 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-r.ko 2024-05-14T14:52:27.532 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-ru.ko 2024-05-14T14:52:27.532 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-u.ko 2024-05-14T14:52:27.532 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-14T14:52:27.532 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_utf8.ko 2024-05-14T14:52:27.532 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2 2024-05-14T14:52:27.532 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster 2024-05-14T14:52:27.532 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-14T14:52:27.532 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm 2024-05-14T14:52:27.532 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-14T14:52:27.533 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs 2024-05-14T14:52:27.533 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-14T14:52:27.533 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2.ko 2024-05-14T14:52:27.533 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-14T14:52:27.533 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-14T14:52:27.533 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-14T14:52:27.533 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs 2024-05-14T14:52:27.533 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs/overlay.ko 2024-05-14T14:52:27.533 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore 2024-05-14T14:52:27.533 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore/ramoops.ko 2024-05-14T14:52:27.533 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs 2024-05-14T14:52:27.533 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs/reiserfs.ko 2024-05-14T14:52:27.533 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs 2024-05-14T14:52:27.533 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs/romfs.ko 2024-05-14T14:52:27.534 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb 2024-05-14T14:52:27.534 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client 2024-05-14T14:52:27.534 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client/cifs.ko 2024-05-14T14:52:27.534 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common 2024-05-14T14:52:27.534 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_arc4.ko 2024-05-14T14:52:27.534 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_md4.ko 2024-05-14T14:52:27.534 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs 2024-05-14T14:52:27.534 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs/squashfs.ko 2024-05-14T14:52:27.534 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv 2024-05-14T14:52:27.534 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv/sysv.ko 2024-05-14T14:52:27.534 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf 2024-05-14T14:52:27.534 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf/udf.ko 2024-05-14T14:52:27.534 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs 2024-05-14T14:52:27.535 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs/ufs.ko 2024-05-14T14:52:27.535 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs 2024-05-14T14:52:27.535 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs/xfs.ko 2024-05-14T14:52:27.535 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel 2024-05-14T14:52:27.535 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu 2024-05-14T14:52:27.535 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu/rcutorture.ko 2024-05-14T14:52:27.535 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/torture.ko 2024-05-14T14:52:27.535 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace 2024-05-14T14:52:27.535 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-14T14:52:27.535 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib 2024-05-14T14:52:27.535 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/asn1_encoder.ko 2024-05-14T14:52:27.535 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc-itu-t.ko 2024-05-14T14:52:27.535 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc8.ko 2024-05-14T14:52:27.535 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto 2024-05-14T14:52:27.535 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libarc4.ko 2024-05-14T14:52:27.536 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libdes.ko 2024-05-14T14:52:27.536 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/libcrc32c.ko 2024-05-14T14:52:27.536 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lru_cache.ko 2024-05-14T14:52:27.536 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4 2024-05-14T14:52:27.536 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4_compress.ko 2024-05-14T14:52:27.536 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4hc_compress.ko 2024-05-14T14:52:27.536 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math 2024-05-14T14:52:27.536 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math/cordic.ko 2024-05-14T14:52:27.536 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6 2024-05-14T14:52:27.536 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6/raid6_pq.ko 2024-05-14T14:52:27.536 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon 2024-05-14T14:52:27.536 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-14T14:52:27.536 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_bm.ko 2024-05-14T14:52:27.536 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_fsm.ko 2024-05-14T14:52:27.536 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_kmp.ko 2024-05-14T14:52:27.537 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd 2024-05-14T14:52:27.537 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd/zstd_compress.ko 2024-05-14T14:52:27.537 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm 2024-05-14T14:52:27.537 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm/hwpoison-inject.ko 2024-05-14T14:52:27.537 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net 2024-05-14T14:52:27.537 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan 2024-05-14T14:52:27.537 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/6lowpan.ko 2024-05-14T14:52:27.537 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_dest.ko 2024-05-14T14:52:27.537 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_fragment.ko 2024-05-14T14:52:27.537 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_hop.ko 2024-05-14T14:52:27.537 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-14T14:52:27.537 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_mobility.ko 2024-05-14T14:52:27.537 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_routing.ko 2024-05-14T14:52:27.537 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_udp.ko 2024-05-14T14:52:27.537 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802 2024-05-14T14:52:27.538 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/garp.ko 2024-05-14T14:52:27.538 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/mrp.ko 2024-05-14T14:52:27.538 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/p8022.ko 2024-05-14T14:52:27.538 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/psnap.ko 2024-05-14T14:52:27.538 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/stp.ko 2024-05-14T14:52:27.538 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q 2024-05-14T14:52:27.538 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q/8021q.ko 2024-05-14T14:52:27.538 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p 2024-05-14T14:52:27.538 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet.ko 2024-05-14T14:52:27.538 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_fd.ko 2024-05-14T14:52:27.538 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_rdma.ko 2024-05-14T14:52:27.538 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_virtio.ko 2024-05-14T14:52:27.538 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv 2024-05-14T14:52:27.538 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv/batman-adv.ko 2024-05-14T14:52:27.539 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge 2024-05-14T14:52:27.539 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/br_netfilter.ko 2024-05-14T14:52:27.539 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/bridge.ko 2024-05-14T14:52:27.539 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter 2024-05-14T14:52:27.539 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-14T14:52:27.539 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-14T14:52:27.539 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-14T14:52:27.539 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-14T14:52:27.539 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-14T14:52:27.539 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-14T14:52:27.539 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-14T14:52:27.539 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-14T14:52:27.539 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-14T14:52:27.539 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-14T14:52:27.539 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-14T14:52:27.540 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-14T14:52:27.540 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-14T14:52:27.540 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-14T14:52:27.540 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-14T14:52:27.540 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-14T14:52:27.540 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-14T14:52:27.540 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-14T14:52:27.540 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-14T14:52:27.540 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-14T14:52:27.540 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtables.ko 2024-05-14T14:52:27.540 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-14T14:52:27.540 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-14T14:52:27.540 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-14T14:52:27.540 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph 2024-05-14T14:52:27.541 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph/libceph.ko 2024-05-14T14:52:27.541 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core 2024-05-14T14:52:27.541 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/failover.ko 2024-05-14T14:52:27.541 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/pktgen.ko 2024-05-14T14:52:27.541 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp 2024-05-14T14:52:27.541 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp.ko 2024-05-14T14:52:27.541 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_diag.ko 2024-05-14T14:52:27.541 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv4.ko 2024-05-14T14:52:27.541 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv6.ko 2024-05-14T14:52:27.541 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver 2024-05-14T14:52:27.541 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver/dns_resolver.ko 2024-05-14T14:52:27.541 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa 2024-05-14T14:52:27.541 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/dsa_core.ko 2024-05-14T14:52:27.541 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_brcm.ko 2024-05-14T14:52:27.541 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_dsa.ko 2024-05-14T14:52:27.541 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_none.ko 2024-05-14T14:52:27.542 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_trailer.ko 2024-05-14T14:52:27.542 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154 2024-05-14T14:52:27.542 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan 2024-05-14T14:52:27.542 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-14T14:52:27.542 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154.ko 2024-05-14T14:52:27.542 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-14T14:52:27.542 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4 2024-05-14T14:52:27.542 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ah4.ko 2024-05-14T14:52:27.542 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/esp4.ko 2024-05-14T14:52:27.542 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/fou.ko 2024-05-14T14:52:27.542 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/gre.ko 2024-05-14T14:52:27.542 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/inet_diag.ko 2024-05-14T14:52:27.542 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_gre.ko 2024-05-14T14:52:27.542 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_tunnel.ko 2024-05-14T14:52:27.543 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_vti.ko 2024-05-14T14:52:27.543 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipcomp.ko 2024-05-14T14:52:27.543 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipip.ko 2024-05-14T14:52:27.543 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter 2024-05-14T14:52:27.543 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-14T14:52:27.543 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-14T14:52:27.543 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-14T14:52:27.543 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-14T14:52:27.543 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-14T14:52:27.543 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-14T14:52:27.543 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-14T14:52:27.543 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-14T14:52:27.543 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-14T14:52:27.543 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-14T14:52:27.543 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-14T14:52:27.544 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-14T14:52:27.544 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-14T14:52:27.544 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-14T14:52:27.544 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-14T14:52:27.544 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-14T14:52:27.544 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-14T14:52:27.544 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-14T14:52:27.544 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-14T14:52:27.544 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-14T14:52:27.544 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-14T14:52:27.544 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_bic.ko 2024-05-14T14:52:27.544 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_dctcp.ko 2024-05-14T14:52:27.544 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_diag.ko 2024-05-14T14:52:27.544 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_highspeed.ko 2024-05-14T14:52:27.544 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_htcp.ko 2024-05-14T14:52:27.545 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_hybla.ko 2024-05-14T14:52:27.545 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_illinois.ko 2024-05-14T14:52:27.545 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_lp.ko 2024-05-14T14:52:27.545 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_scalable.ko 2024-05-14T14:52:27.545 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_vegas.ko 2024-05-14T14:52:27.545 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_veno.ko 2024-05-14T14:52:27.545 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_westwood.ko 2024-05-14T14:52:27.545 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_yeah.ko 2024-05-14T14:52:27.545 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tunnel4.ko 2024-05-14T14:52:27.545 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_diag.ko 2024-05-14T14:52:27.545 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_tunnel.ko 2024-05-14T14:52:27.545 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-14T14:52:27.545 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6 2024-05-14T14:52:27.545 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ah6.ko 2024-05-14T14:52:27.545 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/esp6.ko 2024-05-14T14:52:27.546 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/fou6.ko 2024-05-14T14:52:27.546 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_tunnel.ko 2024-05-14T14:52:27.546 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-14T14:52:27.546 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_vti.ko 2024-05-14T14:52:27.546 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ipcomp6.ko 2024-05-14T14:52:27.546 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter 2024-05-14T14:52:27.546 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-14T14:52:27.546 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-14T14:52:27.546 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-14T14:52:27.546 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-14T14:52:27.546 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-14T14:52:27.546 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-14T14:52:27.546 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-14T14:52:27.547 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-14T14:52:27.547 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-14T14:52:27.547 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-14T14:52:27.547 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-14T14:52:27.547 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-14T14:52:27.547 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-14T14:52:27.547 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-14T14:52:27.547 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-14T14:52:27.547 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-14T14:52:27.547 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-14T14:52:27.547 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-14T14:52:27.547 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-14T14:52:27.547 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-14T14:52:27.547 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-14T14:52:27.547 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-14T14:52:27.547 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-14T14:52:27.548 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-14T14:52:27.548 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/sit.ko 2024-05-14T14:52:27.548 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/tunnel6.ko 2024-05-14T14:52:27.548 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-14T14:52:27.548 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key 2024-05-14T14:52:27.548 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key/af_key.ko 2024-05-14T14:52:27.548 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp 2024-05-14T14:52:27.548 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_core.ko 2024-05-14T14:52:27.548 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-14T14:52:27.548 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_eth.ko 2024-05-14T14:52:27.548 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip.ko 2024-05-14T14:52:27.548 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip6.ko 2024-05-14T14:52:27.548 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_netlink.ko 2024-05-14T14:52:27.548 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ppp.ko 2024-05-14T14:52:27.549 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc 2024-05-14T14:52:27.549 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc/llc.ko 2024-05-14T14:52:27.549 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154 2024-05-14T14:52:27.549 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154/mac802154.ko 2024-05-14T14:52:27.549 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls 2024-05-14T14:52:27.549 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls/mpls_gso.ko 2024-05-14T14:52:27.549 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter 2024-05-14T14:52:27.549 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset 2024-05-14T14:52:27.549 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set.ko 2024-05-14T14:52:27.549 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-14T14:52:27.549 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-14T14:52:27.549 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-14T14:52:27.549 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-14T14:52:27.549 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-14T14:52:27.549 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-14T14:52:27.550 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-14T14:52:27.550 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-14T14:52:27.550 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-14T14:52:27.550 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-14T14:52:27.550 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-14T14:52:27.550 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-14T14:52:27.550 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-14T14:52:27.550 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-14T14:52:27.550 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-14T14:52:27.550 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs 2024-05-14T14:52:27.550 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-14T14:52:27.550 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-14T14:52:27.550 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-14T14:52:27.550 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-14T14:52:27.551 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-14T14:52:27.551 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-14T14:52:27.551 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-14T14:52:27.551 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-14T14:52:27.551 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-14T14:52:27.551 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-14T14:52:27.551 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-14T14:52:27.551 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-14T14:52:27.551 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-14T14:52:27.551 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-14T14:52:27.551 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conncount.ko 2024-05-14T14:52:27.551 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack.ko 2024-05-14T14:52:27.551 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-14T14:52:27.551 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-14T14:52:27.551 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-14T14:52:27.552 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-14T14:52:27.552 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-14T14:52:27.552 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-14T14:52:27.552 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-14T14:52:27.552 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-14T14:52:27.552 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-14T14:52:27.552 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-14T14:52:27.552 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-14T14:52:27.552 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-14T14:52:27.552 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-14T14:52:27.552 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table.ko 2024-05-14T14:52:27.552 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-14T14:52:27.552 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_log_syslog.ko 2024-05-14T14:52:27.552 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat.ko 2024-05-14T14:52:27.552 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-14T14:52:27.552 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-14T14:52:27.553 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_irc.ko 2024-05-14T14:52:27.553 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_sip.ko 2024-05-14T14:52:27.553 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-14T14:52:27.553 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-14T14:52:27.553 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_tables.ko 2024-05-14T14:52:27.553 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink.ko 2024-05-14T14:52:27.553 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-14T14:52:27.553 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_log.ko 2024-05-14T14:52:27.553 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-14T14:52:27.553 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-14T14:52:27.553 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_chain_nat.ko 2024-05-14T14:52:27.553 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_compat.ko 2024-05-14T14:52:27.553 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_ct.ko 2024-05-14T14:52:27.553 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-14T14:52:27.554 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fib.ko 2024-05-14T14:52:27.554 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-14T14:52:27.554 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_hash.ko 2024-05-14T14:52:27.554 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_limit.ko 2024-05-14T14:52:27.554 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_log.ko 2024-05-14T14:52:27.554 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_masq.ko 2024-05-14T14:52:27.554 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_nat.ko 2024-05-14T14:52:27.554 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_numgen.ko 2024-05-14T14:52:27.554 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_queue.ko 2024-05-14T14:52:27.554 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_quota.ko 2024-05-14T14:52:27.554 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_redir.ko 2024-05-14T14:52:27.554 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject.ko 2024-05-14T14:52:27.554 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject_inet.ko 2024-05-14T14:52:27.555 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_socket.ko 2024-05-14T14:52:27.555 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_tunnel.ko 2024-05-14T14:52:27.555 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_AUDIT.ko 2024-05-14T14:52:27.555 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-14T14:52:27.555 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-14T14:52:27.555 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-14T14:52:27.555 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CT.ko 2024-05-14T14:52:27.555 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_DSCP.ko 2024-05-14T14:52:27.555 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HL.ko 2024-05-14T14:52:27.555 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HMARK.ko 2024-05-14T14:52:27.555 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-14T14:52:27.555 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LED.ko 2024-05-14T14:52:27.555 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LOG.ko 2024-05-14T14:52:27.555 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-14T14:52:27.555 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NETMAP.ko 2024-05-14T14:52:27.556 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFLOG.ko 2024-05-14T14:52:27.556 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-14T14:52:27.556 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_RATEEST.ko 2024-05-14T14:52:27.556 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-14T14:52:27.556 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_SECMARK.ko 2024-05-14T14:52:27.556 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-14T14:52:27.556 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-14T14:52:27.556 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TEE.ko 2024-05-14T14:52:27.556 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TPROXY.ko 2024-05-14T14:52:27.556 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TRACE.ko 2024-05-14T14:52:27.556 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_addrtype.ko 2024-05-14T14:52:27.556 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_bpf.ko 2024-05-14T14:52:27.556 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cgroup.ko 2024-05-14T14:52:27.556 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cluster.ko 2024-05-14T14:52:27.556 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_comment.ko 2024-05-14T14:52:27.557 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connbytes.ko 2024-05-14T14:52:27.557 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlabel.ko 2024-05-14T14:52:27.557 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlimit.ko 2024-05-14T14:52:27.557 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connmark.ko 2024-05-14T14:52:27.557 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_conntrack.ko 2024-05-14T14:52:27.557 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cpu.ko 2024-05-14T14:52:27.557 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dccp.ko 2024-05-14T14:52:27.557 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_devgroup.ko 2024-05-14T14:52:27.557 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dscp.ko 2024-05-14T14:52:27.557 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ecn.ko 2024-05-14T14:52:27.557 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_esp.ko 2024-05-14T14:52:27.557 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hashlimit.ko 2024-05-14T14:52:27.557 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_helper.ko 2024-05-14T14:52:27.557 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hl.ko 2024-05-14T14:52:27.557 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipcomp.ko 2024-05-14T14:52:27.557 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_iprange.ko 2024-05-14T14:52:27.558 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipvs.ko 2024-05-14T14:52:27.558 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_l2tp.ko 2024-05-14T14:52:27.558 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_length.ko 2024-05-14T14:52:27.558 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_limit.ko 2024-05-14T14:52:27.558 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mac.ko 2024-05-14T14:52:27.558 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mark.ko 2024-05-14T14:52:27.558 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_multiport.ko 2024-05-14T14:52:27.558 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nat.ko 2024-05-14T14:52:27.558 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nfacct.ko 2024-05-14T14:52:27.558 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_osf.ko 2024-05-14T14:52:27.558 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_owner.ko 2024-05-14T14:52:27.558 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_physdev.ko 2024-05-14T14:52:27.558 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_pkttype.ko 2024-05-14T14:52:27.558 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_policy.ko 2024-05-14T14:52:27.559 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_quota.ko 2024-05-14T14:52:27.559 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_rateest.ko 2024-05-14T14:52:27.559 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_realm.ko 2024-05-14T14:52:27.559 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_recent.ko 2024-05-14T14:52:27.559 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_sctp.ko 2024-05-14T14:52:27.559 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_set.ko 2024-05-14T14:52:27.559 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_socket.ko 2024-05-14T14:52:27.559 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_state.ko 2024-05-14T14:52:27.559 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_statistic.ko 2024-05-14T14:52:27.559 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_string.ko 2024-05-14T14:52:27.559 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_tcpmss.ko 2024-05-14T14:52:27.559 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_time.ko 2024-05-14T14:52:27.559 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_u32.ko 2024-05-14T14:52:27.559 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink 2024-05-14T14:52:27.559 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink/netlink_diag.ko 2024-05-14T14:52:27.559 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh 2024-05-14T14:52:27.560 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh/nsh.ko 2024-05-14T14:52:27.560 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch 2024-05-14T14:52:27.560 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/openvswitch.ko 2024-05-14T14:52:27.560 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-geneve.ko 2024-05-14T14:52:27.560 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-gre.ko 2024-05-14T14:52:27.560 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-vxlan.ko 2024-05-14T14:52:27.560 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet 2024-05-14T14:52:27.560 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet/af_packet_diag.ko 2024-05-14T14:52:27.560 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds 2024-05-14T14:52:27.560 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds.ko 2024-05-14T14:52:27.561 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_rdma.ko 2024-05-14T14:52:27.561 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_tcp.ko 2024-05-14T14:52:27.561 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched 2024-05-14T14:52:27.561 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_csum.ko 2024-05-14T14:52:27.561 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_gact.ko 2024-05-14T14:52:27.561 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_mirred.ko 2024-05-14T14:52:27.561 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_nat.ko 2024-05-14T14:52:27.561 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_pedit.ko 2024-05-14T14:52:27.561 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_police.ko 2024-05-14T14:52:27.561 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_simple.ko 2024-05-14T14:52:27.561 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_skbedit.ko 2024-05-14T14:52:27.561 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_vlan.ko 2024-05-14T14:52:27.561 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_basic.ko 2024-05-14T14:52:27.561 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_bpf.ko 2024-05-14T14:52:27.561 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_flow.ko 2024-05-14T14:52:27.561 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_fw.ko 2024-05-14T14:52:27.562 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_route.ko 2024-05-14T14:52:27.562 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_u32.ko 2024-05-14T14:52:27.562 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_cmp.ko 2024-05-14T14:52:27.562 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_ipset.ko 2024-05-14T14:52:27.562 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_meta.ko 2024-05-14T14:52:27.562 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_nbyte.ko 2024-05-14T14:52:27.562 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_text.ko 2024-05-14T14:52:27.562 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_u32.ko 2024-05-14T14:52:27.562 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_choke.ko 2024-05-14T14:52:27.562 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_codel.ko 2024-05-14T14:52:27.562 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_drr.ko 2024-05-14T14:52:27.562 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_fq.ko 2024-05-14T14:52:27.562 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_gred.ko 2024-05-14T14:52:27.563 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hfsc.ko 2024-05-14T14:52:27.563 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hhf.ko 2024-05-14T14:52:27.563 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_htb.ko 2024-05-14T14:52:27.563 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_ingress.ko 2024-05-14T14:52:27.563 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio.ko 2024-05-14T14:52:27.563 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio_lib.ko 2024-05-14T14:52:27.563 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_multiq.ko 2024-05-14T14:52:27.563 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_netem.ko 2024-05-14T14:52:27.563 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_pie.ko 2024-05-14T14:52:27.563 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_plug.ko 2024-05-14T14:52:27.563 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_prio.ko 2024-05-14T14:52:27.563 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_qfq.ko 2024-05-14T14:52:27.563 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_red.ko 2024-05-14T14:52:27.563 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfb.ko 2024-05-14T14:52:27.564 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfq.ko 2024-05-14T14:52:27.564 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_tbf.ko 2024-05-14T14:52:27.564 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_teql.ko 2024-05-14T14:52:27.564 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp 2024-05-14T14:52:27.564 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp.ko 2024-05-14T14:52:27.564 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp_diag.ko 2024-05-14T14:52:27.564 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc 2024-05-14T14:52:27.564 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss 2024-05-14T14:52:27.564 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-14T14:52:27.564 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-14T14:52:27.564 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/sunrpc.ko 2024-05-14T14:52:27.564 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma 2024-05-14T14:52:27.564 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-14T14:52:27.564 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc 2024-05-14T14:52:27.564 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc.ko 2024-05-14T14:52:27.564 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc_diag.ko 2024-05-14T14:52:27.565 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix 2024-05-14T14:52:27.565 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix/unix_diag.ko 2024-05-14T14:52:27.565 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock 2024-05-14T14:52:27.565 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-14T14:52:27.565 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-14T14:52:27.565 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock.ko 2024-05-14T14:52:27.565 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-14T14:52:27.565 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-14T14:52:27.565 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm 2024-05-14T14:52:27.565 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-14T14:52:27.565 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security 2024-05-14T14:52:27.565 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys 2024-05-14T14:52:27.565 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys 2024-05-14T14:52:27.565 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-14T14:52:27.565 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys 2024-05-14T14:52:27.566 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys/trusted.ko 2024-05-14T14:52:27.566 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias 2024-05-14T14:52:27.566 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias.bin 2024-05-14T14:52:27.566 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin 2024-05-14T14:52:27.566 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.alias.bin 2024-05-14T14:52:27.566 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.bin 2024-05-14T14:52:27.566 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.modinfo 2024-05-14T14:52:27.566 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep 2024-05-14T14:52:27.566 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep.bin 2024-05-14T14:52:27.566 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.devname 2024-05-14T14:52:27.566 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.order 2024-05-14T14:52:27.566 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.softdep 2024-05-14T14:52:27.566 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols 2024-05-14T14:52:27.566 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols.bin 2024-05-14T14:52:27.566 INFO:teuthology.orchestra.run.smithi203.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T14:52:27.570 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:27.570 DEBUG:teuthology.orchestra.run.smithi203:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-14T14:52:27.592 INFO:teuthology.orchestra.run.smithi203.stdout:postinstall scriptlet (using /bin/sh): 2024-05-14T14:52:27.592 INFO:teuthology.orchestra.run.smithi203.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T14:52:27.592 INFO:teuthology.orchestra.run.smithi203.stdout: /usr/bin/kernel-install add 6.9.0-rc3-gfb9a6a44107e /lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T14:52:27.592 INFO:teuthology.orchestra.run.smithi203.stdout:fi 2024-05-14T14:52:27.592 INFO:teuthology.orchestra.run.smithi203.stdout:for file in vmlinuz System.map config; do 2024-05-14T14:52:27.592 INFO:teuthology.orchestra.run.smithi203.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e"; then 2024-05-14T14:52:27.592 INFO:teuthology.orchestra.run.smithi203.stdout: cp "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T14:52:27.592 INFO:teuthology.orchestra.run.smithi203.stdout: fi 2024-05-14T14:52:27.592 INFO:teuthology.orchestra.run.smithi203.stdout:done 2024-05-14T14:52:27.592 INFO:teuthology.orchestra.run.smithi203.stdout:if [ -d "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" ] && \ 2024-05-14T14:52:27.593 INFO:teuthology.orchestra.run.smithi203.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" >/dev/null 2>&1; then 2024-05-14T14:52:27.593 INFO:teuthology.orchestra.run.smithi203.stdout: rm -rf "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T14:52:27.593 INFO:teuthology.orchestra.run.smithi203.stdout: cp -r "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T14:52:27.593 INFO:teuthology.orchestra.run.smithi203.stdout:fi 2024-05-14T14:52:27.593 INFO:teuthology.orchestra.run.smithi203.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep" ]; then 2024-05-14T14:52:27.593 INFO:teuthology.orchestra.run.smithi203.stdout: /usr/sbin/depmod 6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:27.593 INFO:teuthology.orchestra.run.smithi203.stdout:fi 2024-05-14T14:52:27.593 INFO:teuthology.orchestra.run.smithi203.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-14T14:52:27.593 INFO:teuthology.orchestra.run.smithi203.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T14:52:27.593 INFO:teuthology.orchestra.run.smithi203.stdout:kernel-install remove 6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:27.593 INFO:teuthology.orchestra.run.smithi203.stdout:fi 2024-05-14T14:52:27.594 DEBUG:teuthology.orchestra.run.smithi203:> sudo rpm -qi grub2-tools 2024-05-14T14:52:27.664 INFO:teuthology.orchestra.run.smithi203.stdout:Name : grub2-tools 2024-05-14T14:52:27.665 INFO:teuthology.orchestra.run.smithi203.stdout:Epoch : 1 2024-05-14T14:52:27.665 INFO:teuthology.orchestra.run.smithi203.stdout:Version : 2.06 2024-05-14T14:52:27.665 INFO:teuthology.orchestra.run.smithi203.stdout:Release : 68.el9 2024-05-14T14:52:27.665 INFO:teuthology.orchestra.run.smithi203.stdout:Architecture: x86_64 2024-05-14T14:52:27.665 INFO:teuthology.orchestra.run.smithi203.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-14T14:52:27.665 INFO:teuthology.orchestra.run.smithi203.stdout:Group : Unspecified 2024-05-14T14:52:27.665 INFO:teuthology.orchestra.run.smithi203.stdout:Size : 8264254 2024-05-14T14:52:27.665 INFO:teuthology.orchestra.run.smithi203.stdout:License : GPLv3+ 2024-05-14T14:52:27.665 INFO:teuthology.orchestra.run.smithi203.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-14T14:52:27.665 INFO:teuthology.orchestra.run.smithi203.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-14T14:52:27.665 INFO:teuthology.orchestra.run.smithi203.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-14T14:52:27.665 INFO:teuthology.orchestra.run.smithi203.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-14T14:52:27.665 INFO:teuthology.orchestra.run.smithi203.stdout:Packager : builder@centos.org 2024-05-14T14:52:27.665 INFO:teuthology.orchestra.run.smithi203.stdout:Vendor : CentOS 2024-05-14T14:52:27.665 INFO:teuthology.orchestra.run.smithi203.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-14T14:52:27.666 INFO:teuthology.orchestra.run.smithi203.stdout:Summary : Support tools for GRUB. 2024-05-14T14:52:27.666 INFO:teuthology.orchestra.run.smithi203.stdout:Description : 2024-05-14T14:52:27.666 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T14:52:27.666 INFO:teuthology.orchestra.run.smithi203.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-14T14:52:27.666 INFO:teuthology.orchestra.run.smithi203.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-14T14:52:27.666 INFO:teuthology.orchestra.run.smithi203.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-14T14:52:27.666 INFO:teuthology.orchestra.run.smithi203.stdout:hardware devices. 2024-05-14T14:52:27.666 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T14:52:27.666 INFO:teuthology.orchestra.run.smithi203.stdout:This subpackage provides tools for support of all platforms. 2024-05-14T14:52:27.667 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-14T14:52:27.667 INFO:teuthology.task.kernel:Updating grub on smithi203 to boot 6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:27.667 DEBUG:teuthology.orchestra.run.smithi203:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-14T14:52:28.241 INFO:teuthology.orchestra.run.smithi203.stderr:Generating grub configuration file ... 2024-05-14T14:52:29.616 INFO:teuthology.orchestra.run.smithi203.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-14T14:52:29.647 INFO:teuthology.orchestra.run.smithi203.stderr:done 2024-05-14T14:52:29.649 DEBUG:teuthology.orchestra.run.smithi203:> mktemp 2024-05-14T14:52:29.664 INFO:teuthology.orchestra.run.smithi203.stdout:/tmp/tmp.U6tafchBPJ 2024-05-14T14:52:29.664 DEBUG:teuthology.orchestra.run.smithi203:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.U6tafchBPJ 2024-05-14T14:52:29.730 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 0666 /tmp/tmp.U6tafchBPJ 2024-05-14T14:52:29.867 DEBUG:teuthology.orchestra.remote:smithi203:/tmp/tmp.U6tafchBPJ is 6KB 2024-05-14T14:52:29.915 DEBUG:teuthology.orchestra.run.smithi203:> rm -fr /tmp/tmp.U6tafchBPJ 2024-05-14T14:52:29.929 DEBUG:teuthology.orchestra.run.smithi203:> sudo /bin/ls /boot/loader/entries || true 2024-05-14T14:52:29.991 INFO:teuthology.orchestra.run.smithi203.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-14T14:52:29.992 INFO:teuthology.orchestra.run.smithi203.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-14T14:52:29.992 INFO:teuthology.orchestra.run.smithi203.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-14T14:52:29.992 INFO:teuthology.orchestra.run.smithi203.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e.conf 2024-05-14T14:52:29.993 DEBUG:teuthology.orchestra.run.smithi203:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:30.150 DEBUG:teuthology.orchestra.run.smithi203:> sudo shutdown -r now 2024-05-14T14:52:31.446 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi092.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2024-05-14T14:52:31.447 DEBUG:teuthology.orchestra.run.smithi092:> rpm -qlp /tmp/kernel.x86_64.rpm 2024-05-14T14:52:31.535 INFO:teuthology.orchestra.run.smithi092.stdout:/boot/System.map-6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:31.535 INFO:teuthology.orchestra.run.smithi092.stdout:/boot/config-6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:31.535 INFO:teuthology.orchestra.run.smithi092.stdout:/boot/vmlinuz-6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:31.536 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/System.map 2024-05-14T14:52:31.536 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/config 2024-05-14T14:52:31.536 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel 2024-05-14T14:52:31.536 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch 2024-05-14T14:52:31.536 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86 2024-05-14T14:52:31.536 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto 2024-05-14T14:52:31.536 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/blowfish-x86_64.ko 2024-05-14T14:52:31.536 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2024-05-14T14:52:31.536 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2024-05-14T14:52:31.536 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/camellia-x86_64.ko 2024-05-14T14:52:31.536 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2024-05-14T14:52:31.536 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2024-05-14T14:52:31.536 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32-pclmul.ko 2024-05-14T14:52:31.537 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crc32c-intel.ko 2024-05-14T14:52:31.537 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2024-05-14T14:52:31.537 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2024-05-14T14:52:31.537 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2024-05-14T14:52:31.537 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2024-05-14T14:52:31.537 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-avx2.ko 2024-05-14T14:52:31.537 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2024-05-14T14:52:31.537 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha1-ssse3.ko 2024-05-14T14:52:31.537 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha256-ssse3.ko 2024-05-14T14:52:31.537 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/sha512-ssse3.ko 2024-05-14T14:52:31.537 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2024-05-14T14:52:31.537 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2024-05-14T14:52:31.537 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/crypto/twofish-x86_64.ko 2024-05-14T14:52:31.537 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel 2024-05-14T14:52:31.537 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu 2024-05-14T14:52:31.538 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce 2024-05-14T14:52:31.538 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2024-05-14T14:52:31.538 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm 2024-05-14T14:52:31.538 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-amd.ko 2024-05-14T14:52:31.538 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm-intel.ko 2024-05-14T14:52:31.538 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/arch/x86/kvm/kvm.ko 2024-05-14T14:52:31.538 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto 2024-05-14T14:52:31.538 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ansi_cprng.ko 2024-05-14T14:52:31.538 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/anubis.ko 2024-05-14T14:52:31.538 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/arc4.ko 2024-05-14T14:52:31.538 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx 2024-05-14T14:52:31.538 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_memcpy.ko 2024-05-14T14:52:31.538 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_pq.ko 2024-05-14T14:52:31.539 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_raid6_recov.ko 2024-05-14T14:52:31.539 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_tx.ko 2024-05-14T14:52:31.539 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/async_xor.ko 2024-05-14T14:52:31.539 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/async_tx/raid6test.ko 2024-05-14T14:52:31.539 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authenc.ko 2024-05-14T14:52:31.539 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/authencesn.ko 2024-05-14T14:52:31.539 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blake2b_generic.ko 2024-05-14T14:52:31.539 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_common.ko 2024-05-14T14:52:31.539 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/blowfish_generic.ko 2024-05-14T14:52:31.539 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/camellia_generic.ko 2024-05-14T14:52:31.539 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast5_generic.ko 2024-05-14T14:52:31.539 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast6_generic.ko 2024-05-14T14:52:31.539 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cast_common.ko 2024-05-14T14:52:31.539 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/ccm.ko 2024-05-14T14:52:31.539 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cmac.ko 2024-05-14T14:52:31.539 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crc32_generic.ko 2024-05-14T14:52:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_engine.ko 2024-05-14T14:52:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/crypto_user.ko 2024-05-14T14:52:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/cts.ko 2024-05-14T14:52:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/des_generic.ko 2024-05-14T14:52:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/dh_generic.ko 2024-05-14T14:52:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/echainiv.ko 2024-05-14T14:52:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/essiv.ko 2024-05-14T14:52:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/fcrypt.ko 2024-05-14T14:52:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/khazad.ko 2024-05-14T14:52:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4.ko 2024-05-14T14:52:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/lz4hc.ko 2024-05-14T14:52:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/md4.ko 2024-05-14T14:52:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/michael_mic.ko 2024-05-14T14:52:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcbc.ko 2024-05-14T14:52:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/pcrypt.ko 2024-05-14T14:52:31.540 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/rmd160.ko 2024-05-14T14:52:31.541 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/seed.ko 2024-05-14T14:52:31.541 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/serpent_generic.ko 2024-05-14T14:52:31.541 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tcrypt.ko 2024-05-14T14:52:31.541 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/tea.ko 2024-05-14T14:52:31.541 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_common.ko 2024-05-14T14:52:31.541 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/twofish_generic.ko 2024-05-14T14:52:31.541 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/vmac.ko 2024-05-14T14:52:31.541 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/wp512.ko 2024-05-14T14:52:31.541 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xcbc.ko 2024-05-14T14:52:31.541 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xor.ko 2024-05-14T14:52:31.541 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/crypto/xxhash_generic.ko 2024-05-14T14:52:31.541 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers 2024-05-14T14:52:31.541 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi 2024-05-14T14:52:31.541 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_ipmi.ko 2024-05-14T14:52:31.542 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/acpi_pad.ko 2024-05-14T14:52:31.542 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/ec_sys.ko 2024-05-14T14:52:31.542 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/platform_profile.ko 2024-05-14T14:52:31.542 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbs.ko 2024-05-14T14:52:31.542 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/sbshc.ko 2024-05-14T14:52:31.542 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/acpi/video.ko 2024-05-14T14:52:31.542 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata 2024-05-14T14:52:31.542 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/acard-ahci.ko 2024-05-14T14:52:31.542 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ahci_platform.ko 2024-05-14T14:52:31.542 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/ata_generic.ko 2024-05-14T14:52:31.542 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/libahci_platform.ko 2024-05-14T14:52:31.542 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_acpi.ko 2024-05-14T14:52:31.542 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ali.ko 2024-05-14T14:52:31.542 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_amd.ko 2024-05-14T14:52:31.543 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_artop.ko 2024-05-14T14:52:31.543 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atiixp.ko 2024-05-14T14:52:31.543 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_atp867x.ko 2024-05-14T14:52:31.543 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd640.ko 2024-05-14T14:52:31.543 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cmd64x.ko 2024-05-14T14:52:31.543 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_cypress.ko 2024-05-14T14:52:31.543 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_efar.ko 2024-05-14T14:52:31.543 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt366.ko 2024-05-14T14:52:31.543 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt37x.ko 2024-05-14T14:52:31.543 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x2n.ko 2024-05-14T14:52:31.543 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_hpt3x3.ko 2024-05-14T14:52:31.543 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it8213.ko 2024-05-14T14:52:31.543 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_it821x.ko 2024-05-14T14:52:31.543 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_jmicron.ko 2024-05-14T14:52:31.543 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_marvell.ko 2024-05-14T14:52:31.543 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_mpiix.ko 2024-05-14T14:52:31.544 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_netcell.ko 2024-05-14T14:52:31.544 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ninja32.ko 2024-05-14T14:52:31.544 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87410.ko 2024-05-14T14:52:31.544 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_ns87415.ko 2024-05-14T14:52:31.544 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_oldpiix.ko 2024-05-14T14:52:31.544 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_opti.ko 2024-05-14T14:52:31.544 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_optidma.ko 2024-05-14T14:52:31.544 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pcmcia.ko 2024-05-14T14:52:31.544 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc2027x.ko 2024-05-14T14:52:31.544 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_pdc202xx_old.ko 2024-05-14T14:52:31.544 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_piccolo.ko 2024-05-14T14:52:31.544 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_rdc.ko 2024-05-14T14:52:31.544 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sch.ko 2024-05-14T14:52:31.544 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_serverworks.ko 2024-05-14T14:52:31.544 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sil680.ko 2024-05-14T14:52:31.544 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sis.ko 2024-05-14T14:52:31.545 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_sl82c105.ko 2024-05-14T14:52:31.545 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_triflex.ko 2024-05-14T14:52:31.545 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pata_via.ko 2024-05-14T14:52:31.545 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/pdc_adma.ko 2024-05-14T14:52:31.545 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_inic162x.ko 2024-05-14T14:52:31.545 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_mv.ko 2024-05-14T14:52:31.545 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_nv.ko 2024-05-14T14:52:31.545 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_promise.ko 2024-05-14T14:52:31.545 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_qstor.ko 2024-05-14T14:52:31.545 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil.ko 2024-05-14T14:52:31.545 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sil24.ko 2024-05-14T14:52:31.545 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sis.ko 2024-05-14T14:52:31.545 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_svw.ko 2024-05-14T14:52:31.545 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_sx4.ko 2024-05-14T14:52:31.545 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_uli.ko 2024-05-14T14:52:31.545 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_via.ko 2024-05-14T14:52:31.546 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ata/sata_vsc.ko 2024-05-14T14:52:31.546 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay 2024-05-14T14:52:31.546 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/auxdisplay/ks0108.ko 2024-05-14T14:52:31.546 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base 2024-05-14T14:52:31.546 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap 2024-05-14T14:52:31.546 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-i2c.ko 2024-05-14T14:52:31.546 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/base/regmap/regmap-mmio.ko 2024-05-14T14:52:31.546 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma 2024-05-14T14:52:31.546 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/bcma/bcma.ko 2024-05-14T14:52:31.546 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block 2024-05-14T14:52:31.546 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe 2024-05-14T14:52:31.546 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/aoe/aoe.ko 2024-05-14T14:52:31.546 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/brd.ko 2024-05-14T14:52:31.546 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd 2024-05-14T14:52:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/drbd/drbd.ko 2024-05-14T14:52:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/floppy.ko 2024-05-14T14:52:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/loop.ko 2024-05-14T14:52:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx 2024-05-14T14:52:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/mtip32xx/mtip32xx.ko 2024-05-14T14:52:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/nbd.ko 2024-05-14T14:52:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk 2024-05-14T14:52:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/null_blk/null_blk.ko 2024-05-14T14:52:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/pktcdvd.ko 2024-05-14T14:52:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/rbd.ko 2024-05-14T14:52:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/virtio_blk.ko 2024-05-14T14:52:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback 2024-05-14T14:52:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkback/xen-blkback.ko 2024-05-14T14:52:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/xen-blkfront.ko 2024-05-14T14:52:31.547 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram 2024-05-14T14:52:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/block/zram/zram.ko 2024-05-14T14:52:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char 2024-05-14T14:52:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hangcheck-timer.ko 2024-05-14T14:52:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random 2024-05-14T14:52:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/amd-rng.ko 2024-05-14T14:52:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/intel-rng.ko 2024-05-14T14:52:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/timeriomem-rng.ko 2024-05-14T14:52:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/via-rng.ko 2024-05-14T14:52:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/hw_random/virtio-rng.ko 2024-05-14T14:52:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi 2024-05-14T14:52:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_devintf.ko 2024-05-14T14:52:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2024-05-14T14:52:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2024-05-14T14:52:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_si.ko 2024-05-14T14:52:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_ssif.ko 2024-05-14T14:52:31.548 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2024-05-14T14:52:31.549 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/lp.ko 2024-05-14T14:52:31.549 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave 2024-05-14T14:52:31.549 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/mwave/mwave.ko 2024-05-14T14:52:31.549 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/ppdev.ko 2024-05-14T14:52:31.549 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tlclk.ko 2024-05-14T14:52:31.549 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm 2024-05-14T14:52:31.549 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm.ko 2024-05-14T14:52:31.549 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_atmel.ko 2024-05-14T14:52:31.549 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_infineon.ko 2024-05-14T14:52:31.549 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_nsc.ko 2024-05-14T14:52:31.549 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis.ko 2024-05-14T14:52:31.549 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/tpm/tpm_tis_core.ko 2024-05-14T14:52:31.549 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/uv_mmtimer.ko 2024-05-14T14:52:31.549 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/char/virtio_console.ko 2024-05-14T14:52:31.549 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq 2024-05-14T14:52:31.549 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/acpi-cpufreq.ko 2024-05-14T14:52:31.550 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2024-05-14T14:52:31.550 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/p4-clockmod.ko 2024-05-14T14:52:31.550 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/pcc-cpufreq.ko 2024-05-14T14:52:31.550 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/powernow-k8.ko 2024-05-14T14:52:31.550 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/cpufreq/speedstep-lib.ko 2024-05-14T14:52:31.550 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto 2024-05-14T14:52:31.550 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp 2024-05-14T14:52:31.550 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp-crypto.ko 2024-05-14T14:52:31.550 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/ccp/ccp.ko 2024-05-14T14:52:31.550 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel 2024-05-14T14:52:31.550 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat 2024-05-14T14:52:31.550 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common 2024-05-14T14:52:31.550 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2024-05-14T14:52:31.550 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2024-05-14T14:52:31.550 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2024-05-14T14:52:31.551 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-aes.ko 2024-05-14T14:52:31.551 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/padlock-sha.ko 2024-05-14T14:52:31.551 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio 2024-05-14T14:52:31.551 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/crypto/virtio/virtio_crypto.ko 2024-05-14T14:52:31.551 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca 2024-05-14T14:52:31.551 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dca/dca.ko 2024-05-14T14:52:31.551 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq 2024-05-14T14:52:31.551 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/devfreq/governor_simpleondemand.ko 2024-05-14T14:52:31.551 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma 2024-05-14T14:52:31.551 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw 2024-05-14T14:52:31.551 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/dw/dw_dmac.ko 2024-05-14T14:52:31.551 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat 2024-05-14T14:52:31.551 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/dma/ioat/ioatdma.ko 2024-05-14T14:52:31.551 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac 2024-05-14T14:52:31.551 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/amd64_edac.ko 2024-05-14T14:52:31.552 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/e752x_edac.ko 2024-05-14T14:52:31.552 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/edac_mce_amd.ko 2024-05-14T14:52:31.552 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3000_edac.ko 2024-05-14T14:52:31.552 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i3200_edac.ko 2024-05-14T14:52:31.552 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5100_edac.ko 2024-05-14T14:52:31.552 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i5400_edac.ko 2024-05-14T14:52:31.552 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7300_edac.ko 2024-05-14T14:52:31.552 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i7core_edac.ko 2024-05-14T14:52:31.552 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/i82975x_edac.ko 2024-05-14T14:52:31.552 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/ie31200_edac.ko 2024-05-14T14:52:31.552 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/sb_edac.ko 2024-05-14T14:52:31.552 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/edac/x38_edac.ko 2024-05-14T14:52:31.552 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware 2024-05-14T14:52:31.552 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/edd.ko 2024-05-14T14:52:31.552 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/firmware/iscsi_ibft.ko 2024-05-14T14:52:31.553 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio 2024-05-14T14:52:31.553 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-ich.ko 2024-05-14T14:52:31.553 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/gpio/gpio-viperboard.ko 2024-05-14T14:52:31.553 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid 2024-05-14T14:52:31.553 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-appleir.ko 2024-05-14T14:52:31.553 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-aureal.ko 2024-05-14T14:52:31.553 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-axff.ko 2024-05-14T14:52:31.553 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-dr.ko 2024-05-14T14:52:31.553 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elecom.ko 2024-05-14T14:52:31.553 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-elo.ko 2024-05-14T14:52:31.553 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-emsff.ko 2024-05-14T14:52:31.553 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gaff.ko 2024-05-14T14:52:31.553 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gt683r.ko 2024-05-14T14:52:31.553 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-gyration.ko 2024-05-14T14:52:31.553 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-kbd.ko 2024-05-14T14:52:31.553 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtek-mouse.ko 2024-05-14T14:52:31.554 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-holtekff.ko 2024-05-14T14:52:31.554 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-hyperv.ko 2024-05-14T14:52:31.554 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-icade.ko 2024-05-14T14:52:31.554 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-keytouch.ko 2024-05-14T14:52:31.554 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-kye.ko 2024-05-14T14:52:31.554 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lcpower.ko 2024-05-14T14:52:31.554 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-led.ko 2024-05-14T14:52:31.554 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-lenovo.ko 2024-05-14T14:52:31.554 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-dj.ko 2024-05-14T14:52:31.554 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-logitech-hidpp.ko 2024-05-14T14:52:31.554 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-multitouch.ko 2024-05-14T14:52:31.554 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-ortek.ko 2024-05-14T14:52:31.554 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-penmount.ko 2024-05-14T14:52:31.554 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-petalynx.ko 2024-05-14T14:52:31.555 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-picolcd.ko 2024-05-14T14:52:31.555 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-pl.ko 2024-05-14T14:52:31.555 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-plantronics.ko 2024-05-14T14:52:31.555 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-primax.ko 2024-05-14T14:52:31.555 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-rmi.ko 2024-05-14T14:52:31.555 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-arvo.ko 2024-05-14T14:52:31.555 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-common.ko 2024-05-14T14:52:31.555 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-isku.ko 2024-05-14T14:52:31.555 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kone.ko 2024-05-14T14:52:31.555 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-koneplus.ko 2024-05-14T14:52:31.555 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-konepure.ko 2024-05-14T14:52:31.555 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-kovaplus.ko 2024-05-14T14:52:31.555 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-lua.ko 2024-05-14T14:52:31.555 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-pyra.ko 2024-05-14T14:52:31.555 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-ryos.ko 2024-05-14T14:52:31.555 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat-savu.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-roccat.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-saitek.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-samsung.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sensor-hub.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sjoy.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sony.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-speedlink.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-steelseries.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-sunplus.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-thrustmaster.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tivo.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-tmff.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-topseed.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-twinhan.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-uclogic.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-waltop.ko 2024-05-14T14:52:31.556 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-wiimote.ko 2024-05-14T14:52:31.557 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-xinmo.ko 2024-05-14T14:52:31.557 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zpff.ko 2024-05-14T14:52:31.557 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/hid-zydacron.ko 2024-05-14T14:52:31.557 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/uhid.ko 2024-05-14T14:52:31.557 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hid/wacom.ko 2024-05-14T14:52:31.557 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv 2024-05-14T14:52:31.557 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_balloon.ko 2024-05-14T14:52:31.557 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_utils.ko 2024-05-14T14:52:31.557 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hv/hv_vmbus.ko 2024-05-14T14:52:31.557 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon 2024-05-14T14:52:31.557 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru.ko 2024-05-14T14:52:31.557 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/abituguru3.ko 2024-05-14T14:52:31.557 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/acpi_power_meter.ko 2024-05-14T14:52:31.557 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7414.ko 2024-05-14T14:52:31.557 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ad7418.ko 2024-05-14T14:52:31.557 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adc128d818.ko 2024-05-14T14:52:31.558 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1025.ko 2024-05-14T14:52:31.558 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1026.ko 2024-05-14T14:52:31.558 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1029.ko 2024-05-14T14:52:31.558 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm1031.ko 2024-05-14T14:52:31.558 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adm9240.ko 2024-05-14T14:52:31.558 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ads7828.ko 2024-05-14T14:52:31.558 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7410.ko 2024-05-14T14:52:31.558 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7411.ko 2024-05-14T14:52:31.558 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7462.ko 2024-05-14T14:52:31.558 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7470.ko 2024-05-14T14:52:31.558 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7475.ko 2024-05-14T14:52:31.558 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/adt7x10.ko 2024-05-14T14:52:31.558 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/amc6821.ko 2024-05-14T14:52:31.558 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/applesmc.ko 2024-05-14T14:52:31.558 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asb100.ko 2024-05-14T14:52:31.559 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asc7621.ko 2024-05-14T14:52:31.559 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/asus_atk0110.ko 2024-05-14T14:52:31.559 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/atxp1.ko 2024-05-14T14:52:31.559 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/coretemp.ko 2024-05-14T14:52:31.559 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dell-smm-hwmon.ko 2024-05-14T14:52:31.559 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/dme1737.ko 2024-05-14T14:52:31.559 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds1621.ko 2024-05-14T14:52:31.559 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ds620.ko 2024-05-14T14:52:31.559 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc1403.ko 2024-05-14T14:52:31.559 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/emc6w201.ko 2024-05-14T14:52:31.559 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71805f.ko 2024-05-14T14:52:31.559 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f71882fg.ko 2024-05-14T14:52:31.559 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/f75375s.ko 2024-05-14T14:52:31.559 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fam15h_power.ko 2024-05-14T14:52:31.559 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/fschmd.ko 2024-05-14T14:52:31.560 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g760a.ko 2024-05-14T14:52:31.560 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/g762.ko 2024-05-14T14:52:31.560 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl518sm.ko 2024-05-14T14:52:31.560 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/gl520sm.ko 2024-05-14T14:52:31.560 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/hwmon-vid.ko 2024-05-14T14:52:31.560 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5500_temp.ko 2024-05-14T14:52:31.560 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/i5k_amb.ko 2024-05-14T14:52:31.560 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmaem.ko 2024-05-14T14:52:31.560 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ibmpex.ko 2024-05-14T14:52:31.560 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina209.ko 2024-05-14T14:52:31.560 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ina2xx.ko 2024-05-14T14:52:31.560 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/it87.ko 2024-05-14T14:52:31.560 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k10temp.ko 2024-05-14T14:52:31.560 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/k8temp.ko 2024-05-14T14:52:31.560 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lineage-pem.ko 2024-05-14T14:52:31.561 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm63.ko 2024-05-14T14:52:31.561 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm73.ko 2024-05-14T14:52:31.561 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm75.ko 2024-05-14T14:52:31.561 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm77.ko 2024-05-14T14:52:31.561 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm78.ko 2024-05-14T14:52:31.561 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm80.ko 2024-05-14T14:52:31.561 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm83.ko 2024-05-14T14:52:31.561 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm85.ko 2024-05-14T14:52:31.561 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm87.ko 2024-05-14T14:52:31.561 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm90.ko 2024-05-14T14:52:31.561 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm92.ko 2024-05-14T14:52:31.561 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm93.ko 2024-05-14T14:52:31.561 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95234.ko 2024-05-14T14:52:31.561 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95241.ko 2024-05-14T14:52:31.562 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/lm95245.ko 2024-05-14T14:52:31.562 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc2945.ko 2024-05-14T14:52:31.562 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4151.ko 2024-05-14T14:52:31.562 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4215.ko 2024-05-14T14:52:31.562 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4222.ko 2024-05-14T14:52:31.562 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4245.ko 2024-05-14T14:52:31.562 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4260.ko 2024-05-14T14:52:31.562 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/ltc4261.ko 2024-05-14T14:52:31.562 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max16065.ko 2024-05-14T14:52:31.562 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1619.ko 2024-05-14T14:52:31.562 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max1668.ko 2024-05-14T14:52:31.562 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max197.ko 2024-05-14T14:52:31.562 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6639.ko 2024-05-14T14:52:31.563 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6650.ko 2024-05-14T14:52:31.563 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/max6697.ko 2024-05-14T14:52:31.563 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/mcp3021.ko 2024-05-14T14:52:31.563 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6683.ko 2024-05-14T14:52:31.563 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775-core.ko 2024-05-14T14:52:31.563 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct6775.ko 2024-05-14T14:52:31.563 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/nct7802.ko 2024-05-14T14:52:31.563 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87360.ko 2024-05-14T14:52:31.563 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pc87427.ko 2024-05-14T14:52:31.563 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pcf8591.ko 2024-05-14T14:52:31.563 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus 2024-05-14T14:52:31.563 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/adm1275.ko 2024-05-14T14:52:31.563 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/lm25066.ko 2024-05-14T14:52:31.563 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ltc2978.ko 2024-05-14T14:52:31.564 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max16064.ko 2024-05-14T14:52:31.564 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max34440.ko 2024-05-14T14:52:31.564 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/max8688.ko 2024-05-14T14:52:31.564 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus.ko 2024-05-14T14:52:31.564 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2024-05-14T14:52:31.564 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/tps40422.ko 2024-05-14T14:52:31.564 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9000.ko 2024-05-14T14:52:31.564 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/ucd9200.ko 2024-05-14T14:52:31.564 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/pmbus/zl6100.ko 2024-05-14T14:52:31.564 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/powr1220.ko 2024-05-14T14:52:31.564 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5627.ko 2024-05-14T14:52:31.564 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch5636.ko 2024-05-14T14:52:31.564 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sch56xx-common.ko 2024-05-14T14:52:31.564 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht15.ko 2024-05-14T14:52:31.564 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sht21.ko 2024-05-14T14:52:31.565 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/shtc1.ko 2024-05-14T14:52:31.565 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/sis5595.ko 2024-05-14T14:52:31.565 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47b397.ko 2024-05-14T14:52:31.565 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m1.ko 2024-05-14T14:52:31.565 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/smsc47m192.ko 2024-05-14T14:52:31.565 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/thmc50.ko 2024-05-14T14:52:31.565 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp102.ko 2024-05-14T14:52:31.565 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp103.ko 2024-05-14T14:52:31.565 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp401.ko 2024-05-14T14:52:31.565 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/tmp421.ko 2024-05-14T14:52:31.565 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via-cputemp.ko 2024-05-14T14:52:31.565 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/via686a.ko 2024-05-14T14:52:31.565 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt1211.ko 2024-05-14T14:52:31.565 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/vt8231.ko 2024-05-14T14:52:31.565 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627ehf.ko 2024-05-14T14:52:31.565 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83627hf.ko 2024-05-14T14:52:31.566 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83781d.ko 2024-05-14T14:52:31.566 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83791d.ko 2024-05-14T14:52:31.566 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83792d.ko 2024-05-14T14:52:31.566 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83793.ko 2024-05-14T14:52:31.566 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83795.ko 2024-05-14T14:52:31.566 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l785ts.ko 2024-05-14T14:52:31.566 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/hwmon/w83l786ng.ko 2024-05-14T14:52:31.566 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c 2024-05-14T14:52:31.566 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos 2024-05-14T14:52:31.566 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2024-05-14T14:52:31.566 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2024-05-14T14:52:31.566 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses 2024-05-14T14:52:31.566 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2024-05-14T14:52:31.566 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd756.ko 2024-05-14T14:52:31.567 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-amd8111.ko 2024-05-14T14:52:31.567 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2024-05-14T14:52:31.567 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-core.ko 2024-05-14T14:52:31.567 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2024-05-14T14:52:31.567 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2024-05-14T14:52:31.567 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2024-05-14T14:52:31.567 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-i801.ko 2024-05-14T14:52:31.567 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-isch.ko 2024-05-14T14:52:31.567 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-ismt.ko 2024-05-14T14:52:31.567 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2024-05-14T14:52:31.567 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-nforce2.ko 2024-05-14T14:52:31.567 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-parport.ko 2024-05-14T14:52:31.567 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2024-05-14T14:52:31.567 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-piix4.ko 2024-05-14T14:52:31.568 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-scmi.ko 2024-05-14T14:52:31.568 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-simtec.ko 2024-05-14T14:52:31.568 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-sis96x.ko 2024-05-14T14:52:31.568 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2024-05-14T14:52:31.568 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-via.ko 2024-05-14T14:52:31.568 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viapro.ko 2024-05-14T14:52:31.568 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/busses/i2c-viperboard.ko 2024-05-14T14:52:31.568 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-dev.ko 2024-05-14T14:52:31.568 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-mux.ko 2024-05-14T14:52:31.568 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-slave-eeprom.ko 2024-05-14T14:52:31.568 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-smbus.ko 2024-05-14T14:52:31.568 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/i2c/i2c-stub.ko 2024-05-14T14:52:31.568 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband 2024-05-14T14:52:31.569 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core 2024-05-14T14:52:31.569 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_cm.ko 2024-05-14T14:52:31.569 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_core.ko 2024-05-14T14:52:31.569 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_umad.ko 2024-05-14T14:52:31.569 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/ib_uverbs.ko 2024-05-14T14:52:31.569 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/iw_cm.ko 2024-05-14T14:52:31.569 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_cm.ko 2024-05-14T14:52:31.569 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/core/rdma_ucm.ko 2024-05-14T14:52:31.569 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw 2024-05-14T14:52:31.569 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4 2024-05-14T14:52:31.569 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2024-05-14T14:52:31.569 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4 2024-05-14T14:52:31.569 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2024-05-14T14:52:31.569 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5 2024-05-14T14:52:31.570 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2024-05-14T14:52:31.570 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca 2024-05-14T14:52:31.570 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2024-05-14T14:52:31.570 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp 2024-05-14T14:52:31.570 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib 2024-05-14T14:52:31.570 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2024-05-14T14:52:31.570 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser 2024-05-14T14:52:31.570 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2024-05-14T14:52:31.570 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert 2024-05-14T14:52:31.570 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2024-05-14T14:52:31.570 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp 2024-05-14T14:52:31.570 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2024-05-14T14:52:31.570 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt 2024-05-14T14:52:31.571 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2024-05-14T14:52:31.571 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input 2024-05-14T14:52:31.571 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport 2024-05-14T14:52:31.571 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/emu10k1-gp.ko 2024-05-14T14:52:31.571 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/fm801-gp.ko 2024-05-14T14:52:31.571 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/gameport/gameport.ko 2024-05-14T14:52:31.571 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/joydev.ko 2024-05-14T14:52:31.571 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard 2024-05-14T14:52:31.571 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/keyboard/gpio_keys.ko 2024-05-14T14:52:31.571 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse 2024-05-14T14:52:31.571 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/appletouch.ko 2024-05-14T14:52:31.571 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/bcm5974.ko 2024-05-14T14:52:31.571 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/cyapatp.ko 2024-05-14T14:52:31.571 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/elan_i2c.ko 2024-05-14T14:52:31.571 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/sermouse.ko 2024-05-14T14:52:31.572 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_i2c.ko 2024-05-14T14:52:31.572 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/synaptics_usb.ko 2024-05-14T14:52:31.572 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/mouse/vsxxxaa.ko 2024-05-14T14:52:31.572 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4 2024-05-14T14:52:31.572 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/rmi4/rmi_core.ko 2024-05-14T14:52:31.572 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio 2024-05-14T14:52:31.572 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/altera_ps2.ko 2024-05-14T14:52:31.572 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/arc_ps2.ko 2024-05-14T14:52:31.572 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/hyperv-keyboard.ko 2024-05-14T14:52:31.572 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/serio/serio_raw.ko 2024-05-14T14:52:31.572 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/input/sparse-keymap.ko 2024-05-14T14:52:31.572 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds 2024-05-14T14:52:31.572 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-blinkm.ko 2024-05-14T14:52:31.572 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lm3530.ko 2024-05-14T14:52:31.572 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-lp3944.ko 2024-05-14T14:52:31.572 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/leds-ss4200.ko 2024-05-14T14:52:31.573 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger 2024-05-14T14:52:31.573 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-audio.ko 2024-05-14T14:52:31.573 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2024-05-14T14:52:31.573 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-camera.ko 2024-05-14T14:52:31.573 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2024-05-14T14:52:31.573 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-gpio.ko 2024-05-14T14:52:31.573 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2024-05-14T14:52:31.573 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2024-05-14T14:52:31.573 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-timer.ko 2024-05-14T14:52:31.573 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/leds/trigger/ledtrig-transient.ko 2024-05-14T14:52:31.573 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md 2024-05-14T14:52:31.573 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache 2024-05-14T14:52:31.573 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/bcache/bcache.ko 2024-05-14T14:52:31.573 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-bio-prison.ko 2024-05-14T14:52:31.573 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache-smq.ko 2024-05-14T14:52:31.573 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-cache.ko 2024-05-14T14:52:31.574 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-crypt.ko 2024-05-14T14:52:31.574 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-delay.ko 2024-05-14T14:52:31.574 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-flakey.ko 2024-05-14T14:52:31.574 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-log-userspace.ko 2024-05-14T14:52:31.574 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-multipath.ko 2024-05-14T14:52:31.574 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-queue-length.ko 2024-05-14T14:52:31.574 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-raid.ko 2024-05-14T14:52:31.574 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-round-robin.ko 2024-05-14T14:52:31.574 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-service-time.ko 2024-05-14T14:52:31.574 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-switch.ko 2024-05-14T14:52:31.574 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-thin-pool.ko 2024-05-14T14:52:31.574 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/dm-verity.ko 2024-05-14T14:52:31.574 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data 2024-05-14T14:52:31.574 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2024-05-14T14:52:31.574 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid0.ko 2024-05-14T14:52:31.575 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid1.ko 2024-05-14T14:52:31.575 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid10.ko 2024-05-14T14:52:31.575 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/md/raid456.ko 2024-05-14T14:52:31.575 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message 2024-05-14T14:52:31.575 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion 2024-05-14T14:52:31.575 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptbase.ko 2024-05-14T14:52:31.575 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptctl.ko 2024-05-14T14:52:31.575 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptfc.ko 2024-05-14T14:52:31.575 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptlan.ko 2024-05-14T14:52:31.575 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptsas.ko 2024-05-14T14:52:31.575 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptscsih.ko 2024-05-14T14:52:31.575 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/message/fusion/mptspi.ko 2024-05-14T14:52:31.575 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd 2024-05-14T14:52:31.575 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_ich.ko 2024-05-14T14:52:31.576 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/lpc_sch.ko 2024-05-14T14:52:31.576 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/mfd-core.ko 2024-05-14T14:52:31.576 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/sm501.ko 2024-05-14T14:52:31.576 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/viperboard.ko 2024-05-14T14:52:31.576 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/vx855.ko 2024-05-14T14:52:31.576 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/mfd/wl1273-core.ko 2024-05-14T14:52:31.576 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc 2024-05-14T14:52:31.576 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl 2024-05-14T14:52:31.576 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2024-05-14T14:52:31.576 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds9802als.ko 2024-05-14T14:52:31.576 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/apds990x.ko 2024-05-14T14:52:31.576 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/bh1770glc.ko 2024-05-14T14:52:31.576 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710 2024-05-14T14:52:31.576 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/cb710/cb710.ko 2024-05-14T14:52:31.576 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom 2024-05-14T14:52:31.577 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/at24.ko 2024-05-14T14:52:31.577 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2024-05-14T14:52:31.577 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/eeprom/max6875.ko 2024-05-14T14:52:31.577 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/enclosure.ko 2024-05-14T14:52:31.577 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/hpilo.ko 2024-05-14T14:52:31.577 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29003.ko 2024-05-14T14:52:31.577 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/isl29020.ko 2024-05-14T14:52:31.577 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d 2024-05-14T14:52:31.577 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2024-05-14T14:52:31.577 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2024-05-14T14:52:31.577 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei 2024-05-14T14:52:31.577 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-me.ko 2024-05-14T14:52:31.577 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei-txe.ko 2024-05-14T14:52:31.577 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/mei/mei.ko 2024-05-14T14:52:31.578 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru 2024-05-14T14:52:31.578 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-gru/gru.ko 2024-05-14T14:52:31.578 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp 2024-05-14T14:52:31.578 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xp.ko 2024-05-14T14:52:31.578 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpc.ko 2024-05-14T14:52:31.578 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/sgi-xp/xpnet.ko 2024-05-14T14:52:31.578 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_7xx1.ko 2024-05-14T14:52:31.578 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tifm_core.ko 2024-05-14T14:52:31.578 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/tsl2550.ko 2024-05-14T14:52:31.578 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_balloon.ko 2024-05-14T14:52:31.578 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci 2024-05-14T14:52:31.578 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2024-05-14T14:52:31.578 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net 2024-05-14T14:52:31.578 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding 2024-05-14T14:52:31.578 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/bonding/bonding.ko 2024-05-14T14:52:31.578 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa 2024-05-14T14:52:31.579 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53 2024-05-14T14:52:31.579 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/b53/b53_common.ko 2024-05-14T14:52:31.579 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/bcm-sf2.ko 2024-05-14T14:52:31.579 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6060.ko 2024-05-14T14:52:31.579 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx 2024-05-14T14:52:31.579 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2024-05-14T14:52:31.579 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/dummy.ko 2024-05-14T14:52:31.579 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/eql.ko 2024-05-14T14:52:31.579 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet 2024-05-14T14:52:31.579 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com 2024-05-14T14:52:31.579 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2024-05-14T14:52:31.579 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2024-05-14T14:52:31.579 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/3c59x.ko 2024-05-14T14:52:31.579 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/3com/typhoon.ko 2024-05-14T14:52:31.579 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390 2024-05-14T14:52:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/8390.ko 2024-05-14T14:52:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2024-05-14T14:52:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2024-05-14T14:52:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2024-05-14T14:52:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec 2024-05-14T14:52:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/adaptec/starfire.ko 2024-05-14T14:52:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere 2024-05-14T14:52:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/agere/et131x.ko 2024-05-14T14:52:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon 2024-05-14T14:52:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/alteon/acenic.ko 2024-05-14T14:52:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera 2024-05-14T14:52:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/altera/altera_tse.ko 2024-05-14T14:52:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd 2024-05-14T14:52:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/amd8111e.ko 2024-05-14T14:52:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2024-05-14T14:52:31.580 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/amd/pcnet32.ko 2024-05-14T14:52:31.581 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros 2024-05-14T14:52:31.581 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx 2024-05-14T14:52:31.581 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2024-05-14T14:52:31.581 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c 2024-05-14T14:52:31.581 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2024-05-14T14:52:31.581 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e 2024-05-14T14:52:31.581 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2024-05-14T14:52:31.581 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx 2024-05-14T14:52:31.581 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2024-05-14T14:52:31.581 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2024-05-14T14:52:31.581 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom 2024-05-14T14:52:31.581 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/b44.ko 2024-05-14T14:52:31.581 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2024-05-14T14:52:31.581 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x 2024-05-14T14:52:31.582 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2024-05-14T14:52:31.582 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/cnic.ko 2024-05-14T14:52:31.582 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet 2024-05-14T14:52:31.582 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2024-05-14T14:52:31.582 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/broadcom/tg3.ko 2024-05-14T14:52:31.582 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade 2024-05-14T14:52:31.582 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna 2024-05-14T14:52:31.582 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2024-05-14T14:52:31.582 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio 2024-05-14T14:52:31.582 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb 2024-05-14T14:52:31.582 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2024-05-14T14:52:31.582 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3 2024-05-14T14:52:31.582 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2024-05-14T14:52:31.582 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4 2024-05-14T14:52:31.582 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2024-05-14T14:52:31.583 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2024-05-14T14:52:31.583 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2024-05-14T14:52:31.583 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb 2024-05-14T14:52:31.583 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2024-05-14T14:52:31.583 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco 2024-05-14T14:52:31.583 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic 2024-05-14T14:52:31.583 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2024-05-14T14:52:31.583 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec 2024-05-14T14:52:31.583 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip 2024-05-14T14:52:31.583 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2024-05-14T14:52:31.583 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2024-05-14T14:52:31.583 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2024-05-14T14:52:31.583 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2024-05-14T14:52:31.583 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2024-05-14T14:52:31.583 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2024-05-14T14:52:31.584 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink 2024-05-14T14:52:31.584 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/dl2k.ko 2024-05-14T14:52:31.584 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dlink/sundance.ko 2024-05-14T14:52:31.584 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/dnet.ko 2024-05-14T14:52:31.584 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex 2024-05-14T14:52:31.584 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet 2024-05-14T14:52:31.584 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2024-05-14T14:52:31.584 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ethoc.ko 2024-05-14T14:52:31.584 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/fealnx.ko 2024-05-14T14:52:31.584 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel 2024-05-14T14:52:31.584 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e100.ko 2024-05-14T14:52:31.584 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000 2024-05-14T14:52:31.584 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2024-05-14T14:52:31.584 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e 2024-05-14T14:52:31.584 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2024-05-14T14:52:31.584 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igb/igb.ko 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/jme.ko 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2024-05-14T14:52:31.585 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/skge.ko 2024-05-14T14:52:31.586 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/marvell/sky2.ko 2024-05-14T14:52:31.586 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox 2024-05-14T14:52:31.586 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4 2024-05-14T14:52:31.586 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2024-05-14T14:52:31.586 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2024-05-14T14:52:31.586 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5 2024-05-14T14:52:31.586 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core 2024-05-14T14:52:31.586 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2024-05-14T14:52:31.586 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel 2024-05-14T14:52:31.586 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2024-05-14T14:52:31.586 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom 2024-05-14T14:52:31.586 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge 2024-05-14T14:52:31.586 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2024-05-14T14:52:31.586 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi 2024-05-14T14:52:31.586 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2024-05-14T14:52:31.586 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/neterion/s2io.ko 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rdc/r6040.ko 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek 2024-05-14T14:52:31.587 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139cp.ko 2024-05-14T14:52:31.588 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/8139too.ko 2024-05-14T14:52:31.588 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/atp.ko 2024-05-14T14:52:31.588 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/realtek/r8169.ko 2024-05-14T14:52:31.588 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker 2024-05-14T14:52:31.588 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/rocker/rocker.ko 2024-05-14T14:52:31.588 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc 2024-05-14T14:52:31.588 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sfc/sfc.ko 2024-05-14T14:52:31.588 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan 2024-05-14T14:52:31.588 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/silan/sc92031.ko 2024-05-14T14:52:31.588 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis 2024-05-14T14:52:31.588 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis190.ko 2024-05-14T14:52:31.588 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sis/sis900.ko 2024-05-14T14:52:31.588 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc 2024-05-14T14:52:31.588 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/epic100.ko 2024-05-14T14:52:31.588 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2024-05-14T14:52:31.588 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2024-05-14T14:52:31.589 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2024-05-14T14:52:31.589 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro 2024-05-14T14:52:31.589 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac 2024-05-14T14:52:31.589 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2024-05-14T14:52:31.589 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2024-05-14T14:52:31.589 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun 2024-05-14T14:52:31.589 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/cassini.ko 2024-05-14T14:52:31.589 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/niu.ko 2024-05-14T14:52:31.589 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sungem.ko 2024-05-14T14:52:31.589 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/sun/sunhme.ko 2024-05-14T14:52:31.589 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti 2024-05-14T14:52:31.589 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2024-05-14T14:52:31.589 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti 2024-05-14T14:52:31.589 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/ti/tlan.ko 2024-05-14T14:52:31.589 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via 2024-05-14T14:52:31.590 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-rhine.ko 2024-05-14T14:52:31.590 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/via/via-velocity.ko 2024-05-14T14:52:31.590 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet 2024-05-14T14:52:31.590 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5100.ko 2024-05-14T14:52:31.590 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/wiznet/w5300.ko 2024-05-14T14:52:31.590 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom 2024-05-14T14:52:31.590 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2024-05-14T14:52:31.590 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/geneve.ko 2024-05-14T14:52:31.590 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv 2024-05-14T14:52:31.590 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/hyperv/hv_netvsc.ko 2024-05-14T14:52:31.590 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154 2024-05-14T14:52:31.590 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ieee802154/fakelb.ko 2024-05-14T14:52:31.590 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ifb.ko 2024-05-14T14:52:31.590 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan 2024-05-14T14:52:31.590 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ipvlan/ipvlan.ko 2024-05-14T14:52:31.590 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvlan.ko 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/macvtap.ko 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio.ko 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-bitbang.ko 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mdio/mdio-regmap.ko 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/mii.ko 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/net_failover.ko 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/netconsole.ko 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/nlmon.ko 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs-lynx.ko 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/pcs/pcs_xpcs.ko 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/amd.ko 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-lib.ko 2024-05-14T14:52:31.591 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm-phy-ptp.ko 2024-05-14T14:52:31.592 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm7xxx.ko 2024-05-14T14:52:31.592 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/bcm87xx.ko 2024-05-14T14:52:31.592 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/broadcom.ko 2024-05-14T14:52:31.592 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/cicada.ko 2024-05-14T14:52:31.592 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/davicom.ko 2024-05-14T14:52:31.592 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/dp83640.ko 2024-05-14T14:52:31.592 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/et1011c.ko 2024-05-14T14:52:31.592 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/icplus.ko 2024-05-14T14:52:31.592 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/lxt.ko 2024-05-14T14:52:31.592 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/marvell.ko 2024-05-14T14:52:31.592 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/micrel.ko 2024-05-14T14:52:31.592 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/national.ko 2024-05-14T14:52:31.592 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/phylink.ko 2024-05-14T14:52:31.592 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/qsemi.ko 2024-05-14T14:52:31.592 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/realtek.ko 2024-05-14T14:52:31.592 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/smsc.ko 2024-05-14T14:52:31.593 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/ste10Xp.ko 2024-05-14T14:52:31.593 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/phy/vitesse.ko 2024-05-14T14:52:31.593 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp 2024-05-14T14:52:31.593 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/bsd_comp.ko 2024-05-14T14:52:31.593 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_async.ko 2024-05-14T14:52:31.593 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_deflate.ko 2024-05-14T14:52:31.593 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_generic.ko 2024-05-14T14:52:31.593 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_mppe.ko 2024-05-14T14:52:31.593 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/ppp_synctty.ko 2024-05-14T14:52:31.593 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppoe.ko 2024-05-14T14:52:31.593 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pppox.ko 2024-05-14T14:52:31.593 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/ppp/pptp.ko 2024-05-14T14:52:31.593 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip 2024-05-14T14:52:31.593 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slhc.ko 2024-05-14T14:52:31.593 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/slip/slip.ko 2024-05-14T14:52:31.593 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/sungem_phy.ko 2024-05-14T14:52:31.594 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tap.ko 2024-05-14T14:52:31.594 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team 2024-05-14T14:52:31.594 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team.ko 2024-05-14T14:52:31.594 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_activebackup.ko 2024-05-14T14:52:31.594 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_broadcast.ko 2024-05-14T14:52:31.594 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_loadbalance.ko 2024-05-14T14:52:31.594 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_random.ko 2024-05-14T14:52:31.594 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/team/team_mode_roundrobin.ko 2024-05-14T14:52:31.594 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/tun.ko 2024-05-14T14:52:31.594 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/veth.ko 2024-05-14T14:52:31.594 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/virtio_net.ko 2024-05-14T14:52:31.594 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3 2024-05-14T14:52:31.594 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vmxnet3/vmxnet3.ko 2024-05-14T14:52:31.594 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan 2024-05-14T14:52:31.594 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/vxlan/vxlan.ko 2024-05-14T14:52:31.595 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback 2024-05-14T14:52:31.595 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netback/xen-netback.ko 2024-05-14T14:52:31.595 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/net/xen-netfront.ko 2024-05-14T14:52:31.595 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb 2024-05-14T14:52:31.595 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ntb/ntb.ko 2024-05-14T14:52:31.595 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme 2024-05-14T14:52:31.595 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host 2024-05-14T14:52:31.595 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme-core.ko 2024-05-14T14:52:31.595 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/nvme/host/nvme.ko 2024-05-14T14:52:31.595 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport 2024-05-14T14:52:31.595 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport.ko 2024-05-14T14:52:31.595 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_cs.ko 2024-05-14T14:52:31.595 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_pc.ko 2024-05-14T14:52:31.595 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/parport/parport_serial.ko 2024-05-14T14:52:31.595 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci 2024-05-14T14:52:31.595 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/pcie/aer_inject.ko 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pci/xen-pcifront.ko 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/i82092.ko 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/pd6729.ko 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pcmcia/yenta_socket.ko 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acer-wmi.ko 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/acerhdf.ko 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/apple-gmux.ko 2024-05-14T14:52:31.596 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-laptop.ko 2024-05-14T14:52:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-nb-wmi.ko 2024-05-14T14:52:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/asus-wmi.ko 2024-05-14T14:52:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/classmate-laptop.ko 2024-05-14T14:52:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-laptop.ko 2024-05-14T14:52:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/eeepc-wmi.ko 2024-05-14T14:52:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-laptop.ko 2024-05-14T14:52:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/fujitsu-tablet.ko 2024-05-14T14:52:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/hdaps.ko 2024-05-14T14:52:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel 2024-05-14T14:52:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel/intel-rst.ko 2024-05-14T14:52:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/intel_ips.ko 2024-05-14T14:52:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/msi-wmi.ko 2024-05-14T14:52:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/mxm-wmi.ko 2024-05-14T14:52:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/panasonic-laptop.ko 2024-05-14T14:52:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-laptop.ko 2024-05-14T14:52:31.597 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/samsung-q10.ko 2024-05-14T14:52:31.598 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/topstar-laptop.ko 2024-05-14T14:52:31.598 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2024-05-14T14:52:31.598 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/toshiba_haps.ko 2024-05-14T14:52:31.598 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi-bmof.ko 2024-05-14T14:52:31.598 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/platform/x86/wmi.ko 2024-05-14T14:52:31.598 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap 2024-05-14T14:52:31.598 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_common.ko 2024-05-14T14:52:31.598 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/powercap/intel_rapl_msr.ko 2024-05-14T14:52:31.598 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps 2024-05-14T14:52:31.598 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients 2024-05-14T14:52:31.598 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-gpio.ko 2024-05-14T14:52:31.598 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps-ldisc.ko 2024-05-14T14:52:31.598 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/clients/pps_parport.ko 2024-05-14T14:52:31.598 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/pps/pps_core.ko 2024-05-14T14:52:31.598 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp 2024-05-14T14:52:31.599 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp.ko 2024-05-14T14:52:31.599 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ptp/ptp_kvm.ko 2024-05-14T14:52:31.599 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras 2024-05-14T14:52:31.599 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd 2024-05-14T14:52:31.599 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl 2024-05-14T14:52:31.599 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/atl/amd_atl.ko 2024-05-14T14:52:31.599 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ras/amd/fmpm.ko 2024-05-14T14:52:31.599 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc 2024-05-14T14:52:31.599 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-bq32k.ko 2024-05-14T14:52:31.599 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1286.ko 2024-05-14T14:52:31.599 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1307.ko 2024-05-14T14:52:31.599 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1374.ko 2024-05-14T14:52:31.599 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1511.ko 2024-05-14T14:52:31.599 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1553.ko 2024-05-14T14:52:31.599 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1672.ko 2024-05-14T14:52:31.599 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds1742.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds2404.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-ds3232.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-em3027.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-fm3130.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl12022.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-isl1208.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m41t80.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t35.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-m48t59.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-max6900.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-msm6242.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf2127.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf85063.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8523.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8563.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-pcf8583.ko 2024-05-14T14:52:31.600 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rp5c01.ko 2024-05-14T14:52:31.601 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rs5c372.ko 2024-05-14T14:52:31.601 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rv3029c2.ko 2024-05-14T14:52:31.601 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8025.ko 2024-05-14T14:52:31.601 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-rx8581.ko 2024-05-14T14:52:31.601 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-stk17ta8.ko 2024-05-14T14:52:31.601 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/rtc/rtc-x1205.ko 2024-05-14T14:52:31.601 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi 2024-05-14T14:52:31.601 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-9xxx.ko 2024-05-14T14:52:31.601 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-sas.ko 2024-05-14T14:52:31.601 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/3w-xxxx.ko 2024-05-14T14:52:31.601 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/BusLogic.ko 2024-05-14T14:52:31.601 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/a100u2w.ko 2024-05-14T14:52:31.601 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid 2024-05-14T14:52:31.602 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aacraid/aacraid.ko 2024-05-14T14:52:31.602 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/advansys.ko 2024-05-14T14:52:31.602 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx 2024-05-14T14:52:31.602 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2024-05-14T14:52:31.602 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2024-05-14T14:52:31.602 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/am53c974.ko 2024-05-14T14:52:31.602 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr 2024-05-14T14:52:31.602 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/arcmsr/arcmsr.ko 2024-05-14T14:52:31.602 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/atp870u.ko 2024-05-14T14:52:31.602 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi 2024-05-14T14:52:31.602 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2024-05-14T14:52:31.602 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa 2024-05-14T14:52:31.602 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bfa/bfa.ko 2024-05-14T14:52:31.602 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc 2024-05-14T14:52:31.602 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2024-05-14T14:52:31.603 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i 2024-05-14T14:52:31.603 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/bnx2i/bnx2i.ko 2024-05-14T14:52:31.603 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ch.ko 2024-05-14T14:52:31.603 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor 2024-05-14T14:52:31.603 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/csiostor/csiostor.ko 2024-05-14T14:52:31.603 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi 2024-05-14T14:52:31.603 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i 2024-05-14T14:52:31.603 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2024-05-14T14:52:31.603 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i 2024-05-14T14:52:31.603 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2024-05-14T14:52:31.603 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2024-05-14T14:52:31.603 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dc395x.ko 2024-05-14T14:52:31.603 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler 2024-05-14T14:52:31.603 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2024-05-14T14:52:31.603 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2024-05-14T14:52:31.604 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2024-05-14T14:52:31.604 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2024-05-14T14:52:31.604 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/dmx3191d.ko 2024-05-14T14:52:31.604 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r 2024-05-14T14:52:31.604 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esas2r/esas2r.ko 2024-05-14T14:52:31.604 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/esp_scsi.ko 2024-05-14T14:52:31.604 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe 2024-05-14T14:52:31.604 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/fcoe.ko 2024-05-14T14:52:31.604 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fcoe/libfcoe.ko 2024-05-14T14:52:31.604 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic 2024-05-14T14:52:31.604 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/fnic/fnic.ko 2024-05-14T14:52:31.604 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hpsa.ko 2024-05-14T14:52:31.604 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hptiop.ko 2024-05-14T14:52:31.604 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/hv_storvsc.ko 2024-05-14T14:52:31.605 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/initio.ko 2024-05-14T14:52:31.605 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ipr.ko 2024-05-14T14:52:31.605 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ips.ko 2024-05-14T14:52:31.605 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci 2024-05-14T14:52:31.605 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/isci/isci.ko 2024-05-14T14:52:31.605 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2024-05-14T14:52:31.605 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/iscsi_tcp.ko 2024-05-14T14:52:31.605 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc 2024-05-14T14:52:31.605 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libfc/libfc.ko 2024-05-14T14:52:31.605 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi.ko 2024-05-14T14:52:31.605 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libiscsi_tcp.ko 2024-05-14T14:52:31.605 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas 2024-05-14T14:52:31.605 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/libsas/libsas.ko 2024-05-14T14:52:31.605 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc 2024-05-14T14:52:31.605 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/lpfc/lpfc.ko 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid.ko 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvsas/mvsas.ko 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/mvumi.ko 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pm8001/pm80xx.ko 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/pmcraid.ko 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla1280.ko 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2024-05-14T14:52:31.606 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2024-05-14T14:52:31.607 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx 2024-05-14T14:52:31.607 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2024-05-14T14:52:31.607 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/raid_class.ko 2024-05-14T14:52:31.607 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_debug.ko 2024-05-14T14:52:31.607 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_fc.ko 2024-05-14T14:52:31.607 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_iscsi.ko 2024-05-14T14:52:31.607 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_sas.ko 2024-05-14T14:52:31.607 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_spi.ko 2024-05-14T14:52:31.607 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/scsi_transport_srp.ko 2024-05-14T14:52:31.607 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/ses.ko 2024-05-14T14:52:31.607 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/st.ko 2024-05-14T14:52:31.607 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/stex.ko 2024-05-14T14:52:31.607 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2 2024-05-14T14:52:31.607 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2024-05-14T14:52:31.607 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/virtio_scsi.ko 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/vmw_pvscsi.ko 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/scsi/wd719x.ko 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ssb/ssb.ko 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/loopback/tcm_loop.ko 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_file.ko 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_iblock.ko 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_mod.ko 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_pscsi.ko 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/target_core_user.ko 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/target/tcm_fc/tcm_fc.ko 2024-05-14T14:52:31.608 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal 2024-05-14T14:52:31.609 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel 2024-05-14T14:52:31.609 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal 2024-05-14T14:52:31.609 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2024-05-14T14:52:31.609 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2024-05-14T14:52:31.609 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2024-05-14T14:52:31.609 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2024-05-14T14:52:31.609 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2024-05-14T14:52:31.609 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2024-05-14T14:52:31.609 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2024-05-14T14:52:31.609 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2024-05-14T14:52:31.609 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2024-05-14T14:52:31.609 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2024-05-14T14:52:31.609 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_power_floor.ko 2024-05-14T14:52:31.609 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2024-05-14T14:52:31.610 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2024-05-14T14:52:31.610 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_hint.ko 2024-05-14T14:52:31.610 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_wt_req.ko 2024-05-14T14:52:31.610 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2024-05-14T14:52:31.610 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2024-05-14T14:52:31.610 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2024-05-14T14:52:31.610 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty 2024-05-14T14:52:31.610 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless 2024-05-14T14:52:31.610 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/ipwireless/ipwireless.ko 2024-05-14T14:52:31.610 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_gsm.ko 2024-05-14T14:52:31.610 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/n_hdlc.ko 2024-05-14T14:52:31.610 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/nozomi.ko 2024-05-14T14:52:31.610 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial 2024-05-14T14:52:31.610 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250 2024-05-14T14:52:31.610 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/8250/serial_cs.ko 2024-05-14T14:52:31.611 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/arc_uart.ko 2024-05-14T14:52:31.611 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm 2024-05-14T14:52:31.611 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/tty/serial/jsm/jsm.ko 2024-05-14T14:52:31.611 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs 2024-05-14T14:52:31.611 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core 2024-05-14T14:52:31.611 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/core/ufshcd-core.ko 2024-05-14T14:52:31.611 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host 2024-05-14T14:52:31.611 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/ufs/host/ufshcd-pci.ko 2024-05-14T14:52:31.611 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio 2024-05-14T14:52:31.611 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio.ko 2024-05-14T14:52:31.611 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_aec.ko 2024-05-14T14:52:31.611 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_cif.ko 2024-05-14T14:52:31.611 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_pci_generic.ko 2024-05-14T14:52:31.611 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/uio/uio_sercos3.ko 2024-05-14T14:52:31.611 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb 2024-05-14T14:52:31.612 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class 2024-05-14T14:52:31.612 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-acm.ko 2024-05-14T14:52:31.612 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/cdc-wdm.ko 2024-05-14T14:52:31.612 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usblp.ko 2024-05-14T14:52:31.612 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/class/usbtmc.ko 2024-05-14T14:52:31.612 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host 2024-05-14T14:52:31.612 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/host/sl811-hcd.ko 2024-05-14T14:52:31.612 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image 2024-05-14T14:52:31.612 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/mdc800.ko 2024-05-14T14:52:31.612 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/image/microtek.ko 2024-05-14T14:52:31.612 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc 2024-05-14T14:52:31.612 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/adutux.ko 2024-05-14T14:52:31.612 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/appledisplay.ko 2024-05-14T14:52:31.612 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi26.ko 2024-05-14T14:52:31.612 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/emi62.ko 2024-05-14T14:52:31.612 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ezusb.ko 2024-05-14T14:52:31.613 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/idmouse.ko 2024-05-14T14:52:31.613 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/iowarrior.ko 2024-05-14T14:52:31.613 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/isight_firmware.ko 2024-05-14T14:52:31.613 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/ldusb.ko 2024-05-14T14:52:31.613 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/legousbtower.ko 2024-05-14T14:52:31.613 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga 2024-05-14T14:52:31.613 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2024-05-14T14:52:31.613 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/trancevibrator.ko 2024-05-14T14:52:31.613 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usb3503.ko 2024-05-14T14:52:31.613 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usblcd.ko 2024-05-14T14:52:31.613 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/usbsevseg.ko 2024-05-14T14:52:31.613 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/uss720.ko 2024-05-14T14:52:31.613 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/misc/yurex.ko 2024-05-14T14:52:31.613 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy 2024-05-14T14:52:31.614 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/phy/phy-generic.ko 2024-05-14T14:52:31.614 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial 2024-05-14T14:52:31.614 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/aircable.ko 2024-05-14T14:52:31.614 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ark3116.ko 2024-05-14T14:52:31.614 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/belkin_sa.ko 2024-05-14T14:52:31.614 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ch341.ko 2024-05-14T14:52:31.614 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cp210x.ko 2024-05-14T14:52:31.614 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cyberjack.ko 2024-05-14T14:52:31.614 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/cypress_m8.ko 2024-05-14T14:52:31.614 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/digi_acceleport.ko 2024-05-14T14:52:31.614 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/empeg.ko 2024-05-14T14:52:31.614 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ftdi_sio.ko 2024-05-14T14:52:31.614 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/garmin_gps.ko 2024-05-14T14:52:31.614 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_edgeport.ko 2024-05-14T14:52:31.615 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/io_ti.ko 2024-05-14T14:52:31.615 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipaq.ko 2024-05-14T14:52:31.615 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ipw.ko 2024-05-14T14:52:31.615 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ir-usb.ko 2024-05-14T14:52:31.615 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/iuu_phoenix.ko 2024-05-14T14:52:31.615 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan.ko 2024-05-14T14:52:31.615 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/keyspan_pda.ko 2024-05-14T14:52:31.615 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kl5kusb105.ko 2024-05-14T14:52:31.615 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/kobil_sct.ko 2024-05-14T14:52:31.615 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mct_u232.ko 2024-05-14T14:52:31.615 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7720.ko 2024-05-14T14:52:31.615 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/mos7840.ko 2024-05-14T14:52:31.615 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/navman.ko 2024-05-14T14:52:31.615 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/omninet.ko 2024-05-14T14:52:31.616 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/opticon.ko 2024-05-14T14:52:31.616 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/option.ko 2024-05-14T14:52:31.616 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/oti6858.ko 2024-05-14T14:52:31.616 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/pl2303.ko 2024-05-14T14:52:31.616 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcaux.ko 2024-05-14T14:52:31.616 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/qcserial.ko 2024-05-14T14:52:31.616 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/quatech2.ko 2024-05-14T14:52:31.616 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/safe_serial.ko 2024-05-14T14:52:31.616 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/sierra.ko 2024-05-14T14:52:31.616 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/spcp8x5.ko 2024-05-14T14:52:31.616 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ssu100.ko 2024-05-14T14:52:31.616 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/symbolserial.ko 2024-05-14T14:52:31.616 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2024-05-14T14:52:31.616 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb-serial-simple.ko 2024-05-14T14:52:31.617 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_debug.ko 2024-05-14T14:52:31.617 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/usb_wwan.ko 2024-05-14T14:52:31.617 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/visor.ko 2024-05-14T14:52:31.617 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/whiteheat.ko 2024-05-14T14:52:31.617 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/serial/xsens_mt.ko 2024-05-14T14:52:31.617 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage 2024-05-14T14:52:31.617 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/uas.ko 2024-05-14T14:52:31.617 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-alauda.ko 2024-05-14T14:52:31.617 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-cypress.ko 2024-05-14T14:52:31.617 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-datafab.ko 2024-05-14T14:52:31.617 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-eneub6250.ko 2024-05-14T14:52:31.617 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-freecom.ko 2024-05-14T14:52:31.617 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-isd200.ko 2024-05-14T14:52:31.617 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-jumpshot.ko 2024-05-14T14:52:31.618 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-karma.ko 2024-05-14T14:52:31.618 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-onetouch.ko 2024-05-14T14:52:31.618 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-realtek.ko 2024-05-14T14:52:31.618 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr09.ko 2024-05-14T14:52:31.618 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-sddr55.ko 2024-05-14T14:52:31.618 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/ums-usbat.ko 2024-05-14T14:52:31.618 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/storage/usb-storage.ko 2024-05-14T14:52:31.618 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip 2024-05-14T14:52:31.618 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-core.ko 2024-05-14T14:52:31.618 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/usbip-host.ko 2024-05-14T14:52:31.618 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/usb/usbip/vhci-hcd.ko 2024-05-14T14:52:31.618 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio 2024-05-14T14:52:31.618 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci 2024-05-14T14:52:31.618 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci-core.ko 2024-05-14T14:52:31.619 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/pci/vfio-pci.ko 2024-05-14T14:52:31.619 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio.ko 2024-05-14T14:52:31.619 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vfio/vfio_iommu_type1.ko 2024-05-14T14:52:31.619 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost 2024-05-14T14:52:31.619 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost.ko 2024-05-14T14:52:31.619 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_iotlb.ko 2024-05-14T14:52:31.619 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_net.ko 2024-05-14T14:52:31.619 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/vhost/vhost_scsi.ko 2024-05-14T14:52:31.619 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video 2024-05-14T14:52:31.619 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight 2024-05-14T14:52:31.619 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/apple_bl.ko 2024-05-14T14:52:31.619 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/lcd.ko 2024-05-14T14:52:31.619 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/video/backlight/platform_lcd.ko 2024-05-14T14:52:31.619 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio 2024-05-14T14:52:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio.ko 2024-05-14T14:52:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_balloon.ko 2024-05-14T14:52:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_mmio.ko 2024-05-14T14:52:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci.ko 2024-05-14T14:52:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2024-05-14T14:52:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2024-05-14T14:52:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/virtio/virtio_ring.ko 2024-05-14T14:52:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1 2024-05-14T14:52:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters 2024-05-14T14:52:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2482.ko 2024-05-14T14:52:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/masters/ds2490.ko 2024-05-14T14:52:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves 2024-05-14T14:52:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2406.ko 2024-05-14T14:52:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2408.ko 2024-05-14T14:52:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2413.ko 2024-05-14T14:52:31.620 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2423.ko 2024-05-14T14:52:31.621 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2431.ko 2024-05-14T14:52:31.621 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2433.ko 2024-05-14T14:52:31.621 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2780.ko 2024-05-14T14:52:31.621 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds2781.ko 2024-05-14T14:52:31.621 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_ds28e04.ko 2024-05-14T14:52:31.621 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_smem.ko 2024-05-14T14:52:31.621 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/slaves/w1_therm.ko 2024-05-14T14:52:31.621 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/w1/wire.ko 2024-05-14T14:52:31.621 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog 2024-05-14T14:52:31.621 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim1535_wdt.ko 2024-05-14T14:52:31.621 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/alim7101_wdt.ko 2024-05-14T14:52:31.621 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/f71808e_wdt.ko 2024-05-14T14:52:31.621 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/hpwdt.ko 2024-05-14T14:52:31.621 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/i6300esb.ko 2024-05-14T14:52:31.621 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_vendor_support.ko 2024-05-14T14:52:31.622 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/iTCO_wdt.ko 2024-05-14T14:52:31.622 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ib700wdt.ko 2024-05-14T14:52:31.622 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ibmasr.ko 2024-05-14T14:52:31.622 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/ie6xx_wdt.ko 2024-05-14T14:52:31.622 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it8712f_wdt.ko 2024-05-14T14:52:31.622 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/it87_wdt.ko 2024-05-14T14:52:31.622 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/machzwd.ko 2024-05-14T14:52:31.622 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/nv_tco.ko 2024-05-14T14:52:31.622 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_pci.ko 2024-05-14T14:52:31.622 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/pcwd_usb.ko 2024-05-14T14:52:31.622 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2024-05-14T14:52:31.622 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sch311x_wdt.ko 2024-05-14T14:52:31.622 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/softdog.ko 2024-05-14T14:52:31.622 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/sp5100_tco.ko 2024-05-14T14:52:31.622 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/via_wdt.ko 2024-05-14T14:52:31.622 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83627hf_wdt.ko 2024-05-14T14:52:31.623 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83877f_wdt.ko 2024-05-14T14:52:31.623 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/w83977f_wdt.ko 2024-05-14T14:52:31.623 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/wdt_pci.ko 2024-05-14T14:52:31.623 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/watchdog/xen_wdt.ko 2024-05-14T14:52:31.623 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen 2024-05-14T14:52:31.623 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-acpi-processor.ko 2024-05-14T14:52:31.623 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-evtchn.ko 2024-05-14T14:52:31.623 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntalloc.ko 2024-05-14T14:52:31.623 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-gntdev.ko 2024-05-14T14:52:31.623 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback 2024-05-14T14:52:31.623 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2024-05-14T14:52:31.623 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xen-privcmd.ko 2024-05-14T14:52:31.623 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs 2024-05-14T14:52:31.623 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/drivers/xen/xenfs/xenfs.ko 2024-05-14T14:52:31.623 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs 2024-05-14T14:52:31.624 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p 2024-05-14T14:52:31.624 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/9p/9p.ko 2024-05-14T14:52:31.624 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs 2024-05-14T14:52:31.624 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/affs/affs.ko 2024-05-14T14:52:31.624 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs 2024-05-14T14:52:31.624 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/befs/befs.ko 2024-05-14T14:52:31.624 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/binfmt_misc.ko 2024-05-14T14:52:31.624 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs 2024-05-14T14:52:31.624 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/btrfs/btrfs.ko 2024-05-14T14:52:31.624 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles 2024-05-14T14:52:31.624 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cachefiles/cachefiles.ko 2024-05-14T14:52:31.624 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph 2024-05-14T14:52:31.624 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ceph/ceph.ko 2024-05-14T14:52:31.624 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda 2024-05-14T14:52:31.624 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/coda/coda.ko 2024-05-14T14:52:31.624 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs 2024-05-14T14:52:31.625 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/cramfs/cramfs.ko 2024-05-14T14:52:31.625 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm 2024-05-14T14:52:31.625 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/dlm/dlm.ko 2024-05-14T14:52:31.625 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs 2024-05-14T14:52:31.625 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ecryptfs/ecryptfs.ko 2024-05-14T14:52:31.625 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs 2024-05-14T14:52:31.625 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/f2fs/f2fs.ko 2024-05-14T14:52:31.625 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat 2024-05-14T14:52:31.625 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/fat.ko 2024-05-14T14:52:31.625 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/msdos.ko 2024-05-14T14:52:31.625 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fat/vfat.ko 2024-05-14T14:52:31.625 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse 2024-05-14T14:52:31.625 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/cuse.ko 2024-05-14T14:52:31.625 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/fuse/fuse.ko 2024-05-14T14:52:31.625 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2 2024-05-14T14:52:31.625 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/gfs2/gfs2.ko 2024-05-14T14:52:31.626 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs 2024-05-14T14:52:31.626 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfs/hfs.ko 2024-05-14T14:52:31.626 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus 2024-05-14T14:52:31.626 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/hfsplus/hfsplus.ko 2024-05-14T14:52:31.626 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs 2024-05-14T14:52:31.626 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/isofs/isofs.ko 2024-05-14T14:52:31.626 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs 2024-05-14T14:52:31.626 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/jfs/jfs.ko 2024-05-14T14:52:31.626 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd 2024-05-14T14:52:31.626 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/lockd/lockd.ko 2024-05-14T14:52:31.626 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix 2024-05-14T14:52:31.626 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/minix/minix.ko 2024-05-14T14:52:31.626 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs 2024-05-14T14:52:31.626 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/netfs/netfs.ko 2024-05-14T14:52:31.626 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs 2024-05-14T14:52:31.626 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout 2024-05-14T14:52:31.627 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2024-05-14T14:52:31.627 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout 2024-05-14T14:52:31.627 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2024-05-14T14:52:31.627 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout 2024-05-14T14:52:31.627 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2024-05-14T14:52:31.627 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfs.ko 2024-05-14T14:52:31.627 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv3.ko 2024-05-14T14:52:31.627 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs/nfsv4.ko 2024-05-14T14:52:31.627 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common 2024-05-14T14:52:31.627 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/grace.ko 2024-05-14T14:52:31.627 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfs_common/nfs_acl.ko 2024-05-14T14:52:31.627 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd 2024-05-14T14:52:31.627 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nfsd/nfsd.ko 2024-05-14T14:52:31.627 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2 2024-05-14T14:52:31.627 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nilfs2/nilfs2.ko 2024-05-14T14:52:31.627 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls 2024-05-14T14:52:31.628 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-celtic.ko 2024-05-14T14:52:31.628 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-centeuro.ko 2024-05-14T14:52:31.628 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-croatian.ko 2024-05-14T14:52:31.628 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-cyrillic.ko 2024-05-14T14:52:31.628 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-gaelic.ko 2024-05-14T14:52:31.628 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-greek.ko 2024-05-14T14:52:31.628 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-iceland.ko 2024-05-14T14:52:31.628 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-inuit.ko 2024-05-14T14:52:31.628 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-roman.ko 2024-05-14T14:52:31.628 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-romanian.ko 2024-05-14T14:52:31.628 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/mac-turkish.ko 2024-05-14T14:52:31.628 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1250.ko 2024-05-14T14:52:31.628 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1251.ko 2024-05-14T14:52:31.628 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp1255.ko 2024-05-14T14:52:31.629 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp737.ko 2024-05-14T14:52:31.629 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp775.ko 2024-05-14T14:52:31.629 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp850.ko 2024-05-14T14:52:31.629 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp852.ko 2024-05-14T14:52:31.629 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp855.ko 2024-05-14T14:52:31.629 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp857.ko 2024-05-14T14:52:31.629 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp860.ko 2024-05-14T14:52:31.629 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp861.ko 2024-05-14T14:52:31.629 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp862.ko 2024-05-14T14:52:31.629 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp863.ko 2024-05-14T14:52:31.629 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp864.ko 2024-05-14T14:52:31.629 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp865.ko 2024-05-14T14:52:31.629 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp866.ko 2024-05-14T14:52:31.629 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp869.ko 2024-05-14T14:52:31.630 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp874.ko 2024-05-14T14:52:31.630 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp932.ko 2024-05-14T14:52:31.630 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp936.ko 2024-05-14T14:52:31.630 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp949.ko 2024-05-14T14:52:31.630 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_cp950.ko 2024-05-14T14:52:31.630 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_euc-jp.ko 2024-05-14T14:52:31.630 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-1.ko 2024-05-14T14:52:31.630 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-13.ko 2024-05-14T14:52:31.630 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-14.ko 2024-05-14T14:52:31.630 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-15.ko 2024-05-14T14:52:31.630 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-2.ko 2024-05-14T14:52:31.630 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-3.ko 2024-05-14T14:52:31.630 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-4.ko 2024-05-14T14:52:31.631 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-5.ko 2024-05-14T14:52:31.631 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-6.ko 2024-05-14T14:52:31.631 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-7.ko 2024-05-14T14:52:31.631 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_iso8859-9.ko 2024-05-14T14:52:31.631 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-r.ko 2024-05-14T14:52:31.631 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-ru.ko 2024-05-14T14:52:31.631 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_koi8-u.ko 2024-05-14T14:52:31.631 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_ucs2_utils.ko 2024-05-14T14:52:31.631 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/nls/nls_utf8.ko 2024-05-14T14:52:31.631 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2 2024-05-14T14:52:31.631 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster 2024-05-14T14:52:31.631 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2024-05-14T14:52:31.631 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm 2024-05-14T14:52:31.631 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2024-05-14T14:52:31.631 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs 2024-05-14T14:52:31.631 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2024-05-14T14:52:31.632 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2.ko 2024-05-14T14:52:31.632 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2024-05-14T14:52:31.632 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stack_user.ko 2024-05-14T14:52:31.632 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ocfs2/ocfs2_stackglue.ko 2024-05-14T14:52:31.632 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs 2024-05-14T14:52:31.632 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/overlayfs/overlay.ko 2024-05-14T14:52:31.632 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore 2024-05-14T14:52:31.632 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/pstore/ramoops.ko 2024-05-14T14:52:31.632 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs 2024-05-14T14:52:31.632 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/reiserfs/reiserfs.ko 2024-05-14T14:52:31.632 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs 2024-05-14T14:52:31.632 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/romfs/romfs.ko 2024-05-14T14:52:31.632 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb 2024-05-14T14:52:31.632 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client 2024-05-14T14:52:31.632 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/client/cifs.ko 2024-05-14T14:52:31.632 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_arc4.ko 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/smb/common/cifs_md4.ko 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/squashfs/squashfs.ko 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/sysv/sysv.ko 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/udf/udf.ko 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/ufs/ufs.ko 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/fs/xfs/xfs.ko 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/rcu/rcutorture.ko 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/torture.ko 2024-05-14T14:52:31.633 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace 2024-05-14T14:52:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/kernel/trace/ring_buffer_benchmark.ko 2024-05-14T14:52:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib 2024-05-14T14:52:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/asn1_encoder.ko 2024-05-14T14:52:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc-itu-t.ko 2024-05-14T14:52:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crc8.ko 2024-05-14T14:52:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto 2024-05-14T14:52:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libarc4.ko 2024-05-14T14:52:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/crypto/libdes.ko 2024-05-14T14:52:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/libcrc32c.ko 2024-05-14T14:52:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lru_cache.ko 2024-05-14T14:52:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4 2024-05-14T14:52:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4_compress.ko 2024-05-14T14:52:31.634 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/lz4/lz4hc_compress.ko 2024-05-14T14:52:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math 2024-05-14T14:52:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/math/cordic.ko 2024-05-14T14:52:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6 2024-05-14T14:52:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/raid6/raid6_pq.ko 2024-05-14T14:52:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon 2024-05-14T14:52:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/reed_solomon/reed_solomon.ko 2024-05-14T14:52:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_bm.ko 2024-05-14T14:52:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_fsm.ko 2024-05-14T14:52:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/ts_kmp.ko 2024-05-14T14:52:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd 2024-05-14T14:52:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/lib/zstd/zstd_compress.ko 2024-05-14T14:52:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm 2024-05-14T14:52:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/mm/hwpoison-inject.ko 2024-05-14T14:52:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net 2024-05-14T14:52:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan 2024-05-14T14:52:31.635 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/6lowpan.ko 2024-05-14T14:52:31.636 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_dest.ko 2024-05-14T14:52:31.636 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_fragment.ko 2024-05-14T14:52:31.636 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_hop.ko 2024-05-14T14:52:31.636 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_ipv6.ko 2024-05-14T14:52:31.636 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_mobility.ko 2024-05-14T14:52:31.636 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_routing.ko 2024-05-14T14:52:31.636 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/6lowpan/nhc_udp.ko 2024-05-14T14:52:31.636 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802 2024-05-14T14:52:31.636 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/garp.ko 2024-05-14T14:52:31.636 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/mrp.ko 2024-05-14T14:52:31.636 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/p8022.ko 2024-05-14T14:52:31.636 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/psnap.ko 2024-05-14T14:52:31.636 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/802/stp.ko 2024-05-14T14:52:31.636 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q 2024-05-14T14:52:31.636 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/8021q/8021q.ko 2024-05-14T14:52:31.636 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p 2024-05-14T14:52:31.637 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet.ko 2024-05-14T14:52:31.637 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_fd.ko 2024-05-14T14:52:31.637 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_rdma.ko 2024-05-14T14:52:31.637 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/9p/9pnet_virtio.ko 2024-05-14T14:52:31.637 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv 2024-05-14T14:52:31.637 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/batman-adv/batman-adv.ko 2024-05-14T14:52:31.637 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge 2024-05-14T14:52:31.637 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/br_netfilter.ko 2024-05-14T14:52:31.637 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/bridge.ko 2024-05-14T14:52:31.637 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter 2024-05-14T14:52:31.637 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_802_3.ko 2024-05-14T14:52:31.637 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_among.ko 2024-05-14T14:52:31.637 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arp.ko 2024-05-14T14:52:31.637 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_arpreply.ko 2024-05-14T14:52:31.637 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_dnat.ko 2024-05-14T14:52:31.638 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip.ko 2024-05-14T14:52:31.638 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_ip6.ko 2024-05-14T14:52:31.638 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_limit.ko 2024-05-14T14:52:31.638 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_log.ko 2024-05-14T14:52:31.638 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark.ko 2024-05-14T14:52:31.638 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_mark_m.ko 2024-05-14T14:52:31.638 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_nflog.ko 2024-05-14T14:52:31.638 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_pkttype.ko 2024-05-14T14:52:31.638 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_redirect.ko 2024-05-14T14:52:31.638 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_snat.ko 2024-05-14T14:52:31.638 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_stp.ko 2024-05-14T14:52:31.638 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebt_vlan.ko 2024-05-14T14:52:31.638 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_broute.ko 2024-05-14T14:52:31.638 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_filter.ko 2024-05-14T14:52:31.638 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtable_nat.ko 2024-05-14T14:52:31.639 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/ebtables.ko 2024-05-14T14:52:31.639 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2024-05-14T14:52:31.639 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2024-05-14T14:52:31.639 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2024-05-14T14:52:31.639 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph 2024-05-14T14:52:31.639 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ceph/libceph.ko 2024-05-14T14:52:31.639 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core 2024-05-14T14:52:31.639 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/failover.ko 2024-05-14T14:52:31.639 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/core/pktgen.ko 2024-05-14T14:52:31.639 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp 2024-05-14T14:52:31.639 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp.ko 2024-05-14T14:52:31.639 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_diag.ko 2024-05-14T14:52:31.639 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv4.ko 2024-05-14T14:52:31.639 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dccp/dccp_ipv6.ko 2024-05-14T14:52:31.639 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dns_resolver/dns_resolver.ko 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/dsa_core.ko 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_brcm.ko 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_dsa.ko 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_none.ko 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/dsa/tag_trailer.ko 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154.ko 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ieee802154/ieee802154_socket.ko 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ah4.ko 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/esp4.ko 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/fou.ko 2024-05-14T14:52:31.640 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/gre.ko 2024-05-14T14:52:31.641 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/inet_diag.ko 2024-05-14T14:52:31.641 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_gre.ko 2024-05-14T14:52:31.641 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_tunnel.ko 2024-05-14T14:52:31.641 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ip_vti.ko 2024-05-14T14:52:31.641 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipcomp.ko 2024-05-14T14:52:31.641 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/ipip.ko 2024-05-14T14:52:31.641 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter 2024-05-14T14:52:31.641 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arp_tables.ko 2024-05-14T14:52:31.641 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arpt_mangle.ko 2024-05-14T14:52:31.641 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/arptable_filter.ko 2024-05-14T14:52:31.641 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ECN.ko 2024-05-14T14:52:31.641 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2024-05-14T14:52:31.641 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_ah.ko 2024-05-14T14:52:31.641 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2024-05-14T14:52:31.642 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_mangle.ko 2024-05-14T14:52:31.642 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_nat.ko 2024-05-14T14:52:31.642 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_raw.ko 2024-05-14T14:52:31.642 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/iptable_security.ko 2024-05-14T14:52:31.642 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2024-05-14T14:52:31.642 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2024-05-14T14:52:31.642 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2024-05-14T14:52:31.642 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2024-05-14T14:52:31.642 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2024-05-14T14:52:31.642 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2024-05-14T14:52:31.642 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2024-05-14T14:52:31.642 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2024-05-14T14:52:31.642 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2024-05-14T14:52:31.642 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2024-05-14T14:52:31.643 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_bic.ko 2024-05-14T14:52:31.643 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_dctcp.ko 2024-05-14T14:52:31.643 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_diag.ko 2024-05-14T14:52:31.643 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_highspeed.ko 2024-05-14T14:52:31.643 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_htcp.ko 2024-05-14T14:52:31.643 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_hybla.ko 2024-05-14T14:52:31.643 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_illinois.ko 2024-05-14T14:52:31.643 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_lp.ko 2024-05-14T14:52:31.643 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_scalable.ko 2024-05-14T14:52:31.643 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_vegas.ko 2024-05-14T14:52:31.643 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_veno.ko 2024-05-14T14:52:31.643 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_westwood.ko 2024-05-14T14:52:31.643 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tcp_yeah.ko 2024-05-14T14:52:31.643 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/tunnel4.ko 2024-05-14T14:52:31.644 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_diag.ko 2024-05-14T14:52:31.644 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/udp_tunnel.ko 2024-05-14T14:52:31.644 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv4/xfrm4_tunnel.ko 2024-05-14T14:52:31.644 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6 2024-05-14T14:52:31.644 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ah6.ko 2024-05-14T14:52:31.644 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/esp6.ko 2024-05-14T14:52:31.644 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/fou6.ko 2024-05-14T14:52:31.644 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_tunnel.ko 2024-05-14T14:52:31.644 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_udp_tunnel.ko 2024-05-14T14:52:31.644 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ip6_vti.ko 2024-05-14T14:52:31.644 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/ipcomp6.ko 2024-05-14T14:52:31.644 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter 2024-05-14T14:52:31.644 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6_tables.ko 2024-05-14T14:52:31.644 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2024-05-14T14:52:31.644 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2024-05-14T14:52:31.644 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ah.ko 2024-05-14T14:52:31.645 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2024-05-14T14:52:31.645 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_frag.ko 2024-05-14T14:52:31.645 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2024-05-14T14:52:31.645 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2024-05-14T14:52:31.645 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_mh.ko 2024-05-14T14:52:31.645 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2024-05-14T14:52:31.645 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6t_rt.ko 2024-05-14T14:52:31.645 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_filter.ko 2024-05-14T14:52:31.645 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2024-05-14T14:52:31.645 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_nat.ko 2024-05-14T14:52:31.645 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_raw.ko 2024-05-14T14:52:31.645 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/ip6table_security.ko 2024-05-14T14:52:31.645 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2024-05-14T14:52:31.645 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2024-05-14T14:52:31.646 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2024-05-14T14:52:31.646 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2024-05-14T14:52:31.646 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2024-05-14T14:52:31.646 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2024-05-14T14:52:31.646 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2024-05-14T14:52:31.646 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2024-05-14T14:52:31.646 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/sit.ko 2024-05-14T14:52:31.646 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/tunnel6.ko 2024-05-14T14:52:31.646 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/ipv6/xfrm6_tunnel.ko 2024-05-14T14:52:31.646 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key 2024-05-14T14:52:31.646 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/key/af_key.ko 2024-05-14T14:52:31.646 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp 2024-05-14T14:52:31.646 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_core.ko 2024-05-14T14:52:31.646 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_debugfs.ko 2024-05-14T14:52:31.646 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_eth.ko 2024-05-14T14:52:31.647 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip.ko 2024-05-14T14:52:31.647 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ip6.ko 2024-05-14T14:52:31.647 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_netlink.ko 2024-05-14T14:52:31.647 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/l2tp/l2tp_ppp.ko 2024-05-14T14:52:31.647 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc 2024-05-14T14:52:31.647 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/llc/llc.ko 2024-05-14T14:52:31.647 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154 2024-05-14T14:52:31.647 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mac802154/mac802154.ko 2024-05-14T14:52:31.647 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls 2024-05-14T14:52:31.647 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/mpls/mpls_gso.ko 2024-05-14T14:52:31.647 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter 2024-05-14T14:52:31.647 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset 2024-05-14T14:52:31.647 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set.ko 2024-05-14T14:52:31.647 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2024-05-14T14:52:31.647 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2024-05-14T14:52:31.648 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2024-05-14T14:52:31.648 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2024-05-14T14:52:31.648 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2024-05-14T14:52:31.648 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2024-05-14T14:52:31.648 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2024-05-14T14:52:31.648 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2024-05-14T14:52:31.648 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2024-05-14T14:52:31.648 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2024-05-14T14:52:31.648 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2024-05-14T14:52:31.648 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2024-05-14T14:52:31.648 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2024-05-14T14:52:31.648 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2024-05-14T14:52:31.648 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipset/ip_set_list_set.ko 2024-05-14T14:52:31.648 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs 2024-05-14T14:52:31.648 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs.ko 2024-05-14T14:52:31.649 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2024-05-14T14:52:31.649 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2024-05-14T14:52:31.649 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2024-05-14T14:52:31.649 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2024-05-14T14:52:31.649 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2024-05-14T14:52:31.649 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2024-05-14T14:52:31.649 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2024-05-14T14:52:31.649 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2024-05-14T14:52:31.649 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2024-05-14T14:52:31.649 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2024-05-14T14:52:31.649 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2024-05-14T14:52:31.649 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2024-05-14T14:52:31.649 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2024-05-14T14:52:31.649 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conncount.ko 2024-05-14T14:52:31.650 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack.ko 2024-05-14T14:52:31.650 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_amanda.ko 2024-05-14T14:52:31.650 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_broadcast.ko 2024-05-14T14:52:31.650 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_ftp.ko 2024-05-14T14:52:31.650 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_h323.ko 2024-05-14T14:52:31.650 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_irc.ko 2024-05-14T14:52:31.650 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2024-05-14T14:52:31.650 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_netlink.ko 2024-05-14T14:52:31.650 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_pptp.ko 2024-05-14T14:52:31.650 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sane.ko 2024-05-14T14:52:31.650 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_sip.ko 2024-05-14T14:52:31.650 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_snmp.ko 2024-05-14T14:52:31.650 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_conntrack_tftp.ko 2024-05-14T14:52:31.650 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_dup_netdev.ko 2024-05-14T14:52:31.651 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table.ko 2024-05-14T14:52:31.651 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_flow_table_inet.ko 2024-05-14T14:52:31.651 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_log_syslog.ko 2024-05-14T14:52:31.651 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat.ko 2024-05-14T14:52:31.651 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_amanda.ko 2024-05-14T14:52:31.651 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_ftp.ko 2024-05-14T14:52:31.651 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_irc.ko 2024-05-14T14:52:31.651 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_sip.ko 2024-05-14T14:52:31.651 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_nat_tftp.ko 2024-05-14T14:52:31.651 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_synproxy_core.ko 2024-05-14T14:52:31.651 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nf_tables.ko 2024-05-14T14:52:31.651 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink.ko 2024-05-14T14:52:31.651 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_acct.ko 2024-05-14T14:52:31.651 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_log.ko 2024-05-14T14:52:31.651 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_osf.ko 2024-05-14T14:52:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nfnetlink_queue.ko 2024-05-14T14:52:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_chain_nat.ko 2024-05-14T14:52:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_compat.ko 2024-05-14T14:52:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_ct.ko 2024-05-14T14:52:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_dup_netdev.ko 2024-05-14T14:52:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fib.ko 2024-05-14T14:52:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_fwd_netdev.ko 2024-05-14T14:52:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_hash.ko 2024-05-14T14:52:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_limit.ko 2024-05-14T14:52:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_log.ko 2024-05-14T14:52:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_masq.ko 2024-05-14T14:52:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_nat.ko 2024-05-14T14:52:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_numgen.ko 2024-05-14T14:52:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_queue.ko 2024-05-14T14:52:31.652 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_quota.ko 2024-05-14T14:52:31.653 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_redir.ko 2024-05-14T14:52:31.653 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject.ko 2024-05-14T14:52:31.653 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_reject_inet.ko 2024-05-14T14:52:31.653 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_socket.ko 2024-05-14T14:52:31.653 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/nft_tunnel.ko 2024-05-14T14:52:31.653 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_AUDIT.ko 2024-05-14T14:52:31.653 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CHECKSUM.ko 2024-05-14T14:52:31.653 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CLASSIFY.ko 2024-05-14T14:52:31.653 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CONNSECMARK.ko 2024-05-14T14:52:31.653 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_CT.ko 2024-05-14T14:52:31.653 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_DSCP.ko 2024-05-14T14:52:31.653 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HL.ko 2024-05-14T14:52:31.653 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_HMARK.ko 2024-05-14T14:52:31.653 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_IDLETIMER.ko 2024-05-14T14:52:31.654 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LED.ko 2024-05-14T14:52:31.654 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_LOG.ko 2024-05-14T14:52:31.654 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_MASQUERADE.ko 2024-05-14T14:52:31.654 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NETMAP.ko 2024-05-14T14:52:31.654 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFLOG.ko 2024-05-14T14:52:31.654 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_NFQUEUE.ko 2024-05-14T14:52:31.654 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_RATEEST.ko 2024-05-14T14:52:31.654 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_REDIRECT.ko 2024-05-14T14:52:31.654 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_SECMARK.ko 2024-05-14T14:52:31.654 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPMSS.ko 2024-05-14T14:52:31.654 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2024-05-14T14:52:31.654 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TEE.ko 2024-05-14T14:52:31.654 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TPROXY.ko 2024-05-14T14:52:31.655 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_TRACE.ko 2024-05-14T14:52:31.655 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_addrtype.ko 2024-05-14T14:52:31.655 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_bpf.ko 2024-05-14T14:52:31.655 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cgroup.ko 2024-05-14T14:52:31.655 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cluster.ko 2024-05-14T14:52:31.655 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_comment.ko 2024-05-14T14:52:31.655 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connbytes.ko 2024-05-14T14:52:31.655 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlabel.ko 2024-05-14T14:52:31.655 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connlimit.ko 2024-05-14T14:52:31.655 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_connmark.ko 2024-05-14T14:52:31.655 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_conntrack.ko 2024-05-14T14:52:31.655 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_cpu.ko 2024-05-14T14:52:31.655 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dccp.ko 2024-05-14T14:52:31.655 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_devgroup.ko 2024-05-14T14:52:31.655 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_dscp.ko 2024-05-14T14:52:31.656 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ecn.ko 2024-05-14T14:52:31.656 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_esp.ko 2024-05-14T14:52:31.656 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hashlimit.ko 2024-05-14T14:52:31.656 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_helper.ko 2024-05-14T14:52:31.656 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_hl.ko 2024-05-14T14:52:31.656 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipcomp.ko 2024-05-14T14:52:31.656 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_iprange.ko 2024-05-14T14:52:31.656 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_ipvs.ko 2024-05-14T14:52:31.656 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_l2tp.ko 2024-05-14T14:52:31.656 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_length.ko 2024-05-14T14:52:31.656 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_limit.ko 2024-05-14T14:52:31.656 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mac.ko 2024-05-14T14:52:31.656 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_mark.ko 2024-05-14T14:52:31.656 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_multiport.ko 2024-05-14T14:52:31.656 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nat.ko 2024-05-14T14:52:31.657 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_nfacct.ko 2024-05-14T14:52:31.657 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_osf.ko 2024-05-14T14:52:31.657 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_owner.ko 2024-05-14T14:52:31.657 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_physdev.ko 2024-05-14T14:52:31.657 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_pkttype.ko 2024-05-14T14:52:31.657 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_policy.ko 2024-05-14T14:52:31.657 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_quota.ko 2024-05-14T14:52:31.657 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_rateest.ko 2024-05-14T14:52:31.657 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_realm.ko 2024-05-14T14:52:31.657 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_recent.ko 2024-05-14T14:52:31.657 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_sctp.ko 2024-05-14T14:52:31.657 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_set.ko 2024-05-14T14:52:31.657 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_socket.ko 2024-05-14T14:52:31.657 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_state.ko 2024-05-14T14:52:31.657 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_statistic.ko 2024-05-14T14:52:31.658 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_string.ko 2024-05-14T14:52:31.658 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_tcpmss.ko 2024-05-14T14:52:31.658 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_time.ko 2024-05-14T14:52:31.658 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netfilter/xt_u32.ko 2024-05-14T14:52:31.658 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink 2024-05-14T14:52:31.658 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/netlink/netlink_diag.ko 2024-05-14T14:52:31.658 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh 2024-05-14T14:52:31.658 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/nsh/nsh.ko 2024-05-14T14:52:31.658 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch 2024-05-14T14:52:31.658 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/openvswitch.ko 2024-05-14T14:52:31.658 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-geneve.ko 2024-05-14T14:52:31.658 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-gre.ko 2024-05-14T14:52:31.658 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/openvswitch/vport-vxlan.ko 2024-05-14T14:52:31.658 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet 2024-05-14T14:52:31.659 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/packet/af_packet_diag.ko 2024-05-14T14:52:31.659 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds 2024-05-14T14:52:31.659 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds.ko 2024-05-14T14:52:31.659 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_rdma.ko 2024-05-14T14:52:31.659 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/rds/rds_tcp.ko 2024-05-14T14:52:31.659 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched 2024-05-14T14:52:31.659 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_csum.ko 2024-05-14T14:52:31.659 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_gact.ko 2024-05-14T14:52:31.659 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_mirred.ko 2024-05-14T14:52:31.659 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_nat.ko 2024-05-14T14:52:31.659 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_pedit.ko 2024-05-14T14:52:31.659 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_police.ko 2024-05-14T14:52:31.659 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_simple.ko 2024-05-14T14:52:31.659 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_skbedit.ko 2024-05-14T14:52:31.659 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/act_vlan.ko 2024-05-14T14:52:31.660 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_basic.ko 2024-05-14T14:52:31.660 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_bpf.ko 2024-05-14T14:52:31.660 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_flow.ko 2024-05-14T14:52:31.660 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_fw.ko 2024-05-14T14:52:31.660 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_route.ko 2024-05-14T14:52:31.660 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/cls_u32.ko 2024-05-14T14:52:31.660 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_cmp.ko 2024-05-14T14:52:31.660 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_ipset.ko 2024-05-14T14:52:31.660 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_meta.ko 2024-05-14T14:52:31.660 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_nbyte.ko 2024-05-14T14:52:31.660 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_text.ko 2024-05-14T14:52:31.660 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/em_u32.ko 2024-05-14T14:52:31.660 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_choke.ko 2024-05-14T14:52:31.660 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_codel.ko 2024-05-14T14:52:31.661 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_drr.ko 2024-05-14T14:52:31.661 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_fq.ko 2024-05-14T14:52:31.661 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_gred.ko 2024-05-14T14:52:31.661 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hfsc.ko 2024-05-14T14:52:31.661 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_hhf.ko 2024-05-14T14:52:31.661 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_htb.ko 2024-05-14T14:52:31.661 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_ingress.ko 2024-05-14T14:52:31.661 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio.ko 2024-05-14T14:52:31.661 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_mqprio_lib.ko 2024-05-14T14:52:31.661 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_multiq.ko 2024-05-14T14:52:31.661 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_netem.ko 2024-05-14T14:52:31.661 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_pie.ko 2024-05-14T14:52:31.661 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_plug.ko 2024-05-14T14:52:31.661 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_prio.ko 2024-05-14T14:52:31.661 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_qfq.ko 2024-05-14T14:52:31.661 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_red.ko 2024-05-14T14:52:31.662 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfb.ko 2024-05-14T14:52:31.662 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_sfq.ko 2024-05-14T14:52:31.662 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_tbf.ko 2024-05-14T14:52:31.662 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sched/sch_teql.ko 2024-05-14T14:52:31.662 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp 2024-05-14T14:52:31.662 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp.ko 2024-05-14T14:52:31.662 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sctp/sctp_diag.ko 2024-05-14T14:52:31.662 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc 2024-05-14T14:52:31.662 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss 2024-05-14T14:52:31.662 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2024-05-14T14:52:31.662 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2024-05-14T14:52:31.662 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/sunrpc.ko 2024-05-14T14:52:31.662 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma 2024-05-14T14:52:31.662 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2024-05-14T14:52:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc 2024-05-14T14:52:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc.ko 2024-05-14T14:52:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/tipc/tipc_diag.ko 2024-05-14T14:52:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix 2024-05-14T14:52:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/unix/unix_diag.ko 2024-05-14T14:52:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock 2024-05-14T14:52:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2024-05-14T14:52:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2024-05-14T14:52:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock.ko 2024-05-14T14:52:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_diag.ko 2024-05-14T14:52:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/vmw_vsock/vsock_loopback.ko 2024-05-14T14:52:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm 2024-05-14T14:52:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/net/xfrm/xfrm_ipcomp.ko 2024-05-14T14:52:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security 2024-05-14T14:52:31.663 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys 2024-05-14T14:52:31.664 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys 2024-05-14T14:52:31.664 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2024-05-14T14:52:31.664 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys 2024-05-14T14:52:31.664 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/kernel/security/keys/trusted-keys/trusted.ko 2024-05-14T14:52:31.664 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias 2024-05-14T14:52:31.664 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.alias.bin 2024-05-14T14:52:31.664 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin 2024-05-14T14:52:31.664 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.alias.bin 2024-05-14T14:52:31.664 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.bin 2024-05-14T14:52:31.664 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.builtin.modinfo 2024-05-14T14:52:31.664 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep 2024-05-14T14:52:31.664 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep.bin 2024-05-14T14:52:31.664 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.devname 2024-05-14T14:52:31.664 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.order 2024-05-14T14:52:31.664 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.softdep 2024-05-14T14:52:31.665 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols 2024-05-14T14:52:31.665 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.symbols.bin 2024-05-14T14:52:31.665 INFO:teuthology.orchestra.run.smithi092.stdout:/lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T14:52:31.668 DEBUG:teuthology.task.kernel:get_image_version: 6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:31.668 DEBUG:teuthology.orchestra.run.smithi092:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2024-05-14T14:52:31.690 INFO:teuthology.orchestra.run.smithi092.stdout:postinstall scriptlet (using /bin/sh): 2024-05-14T14:52:31.690 INFO:teuthology.orchestra.run.smithi092.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T14:52:31.690 INFO:teuthology.orchestra.run.smithi092.stdout: /usr/bin/kernel-install add 6.9.0-rc3-gfb9a6a44107e /lib/modules/6.9.0-rc3-gfb9a6a44107e/vmlinuz 2024-05-14T14:52:31.690 INFO:teuthology.orchestra.run.smithi092.stdout:fi 2024-05-14T14:52:31.690 INFO:teuthology.orchestra.run.smithi092.stdout:for file in vmlinuz System.map config; do 2024-05-14T14:52:31.690 INFO:teuthology.orchestra.run.smithi092.stdout: if ! cmp --silent "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e"; then 2024-05-14T14:52:31.690 INFO:teuthology.orchestra.run.smithi092.stdout: cp "/lib/modules/6.9.0-rc3-gfb9a6a44107e/${file}" "/boot/${file}-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T14:52:31.690 INFO:teuthology.orchestra.run.smithi092.stdout: fi 2024-05-14T14:52:31.690 INFO:teuthology.orchestra.run.smithi092.stdout:done 2024-05-14T14:52:31.690 INFO:teuthology.orchestra.run.smithi092.stdout:if [ -d "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" ] && \ 2024-05-14T14:52:31.690 INFO:teuthology.orchestra.run.smithi092.stdout: ! diff -rq "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" >/dev/null 2>&1; then 2024-05-14T14:52:31.690 INFO:teuthology.orchestra.run.smithi092.stdout: rm -rf "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T14:52:31.690 INFO:teuthology.orchestra.run.smithi092.stdout: cp -r "/lib/modules/6.9.0-rc3-gfb9a6a44107e/dtb" "/boot/dtb-6.9.0-rc3-gfb9a6a44107e" 2024-05-14T14:52:31.690 INFO:teuthology.orchestra.run.smithi092.stdout:fi 2024-05-14T14:52:31.691 INFO:teuthology.orchestra.run.smithi092.stdout:if [ ! -e "/lib/modules/6.9.0-rc3-gfb9a6a44107e/modules.dep" ]; then 2024-05-14T14:52:31.691 INFO:teuthology.orchestra.run.smithi092.stdout: /usr/sbin/depmod 6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:31.691 INFO:teuthology.orchestra.run.smithi092.stdout:fi 2024-05-14T14:52:31.691 INFO:teuthology.orchestra.run.smithi092.stdout:preuninstall scriptlet (using /bin/sh): 2024-05-14T14:52:31.691 INFO:teuthology.orchestra.run.smithi092.stdout:if [ -x /usr/bin/kernel-install ]; then 2024-05-14T14:52:31.691 INFO:teuthology.orchestra.run.smithi092.stdout:kernel-install remove 6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:31.691 INFO:teuthology.orchestra.run.smithi092.stdout:fi 2024-05-14T14:52:31.692 DEBUG:teuthology.orchestra.run.smithi092:> sudo rpm -qi grub2-tools 2024-05-14T14:52:31.765 INFO:teuthology.orchestra.run.smithi092.stdout:Name : grub2-tools 2024-05-14T14:52:31.765 INFO:teuthology.orchestra.run.smithi092.stdout:Epoch : 1 2024-05-14T14:52:31.765 INFO:teuthology.orchestra.run.smithi092.stdout:Version : 2.06 2024-05-14T14:52:31.765 INFO:teuthology.orchestra.run.smithi092.stdout:Release : 68.el9 2024-05-14T14:52:31.765 INFO:teuthology.orchestra.run.smithi092.stdout:Architecture: x86_64 2024-05-14T14:52:31.765 INFO:teuthology.orchestra.run.smithi092.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-14T14:52:31.765 INFO:teuthology.orchestra.run.smithi092.stdout:Group : Unspecified 2024-05-14T14:52:31.765 INFO:teuthology.orchestra.run.smithi092.stdout:Size : 8264254 2024-05-14T14:52:31.765 INFO:teuthology.orchestra.run.smithi092.stdout:License : GPLv3+ 2024-05-14T14:52:31.765 INFO:teuthology.orchestra.run.smithi092.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-14T14:52:31.765 INFO:teuthology.orchestra.run.smithi092.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-14T14:52:31.766 INFO:teuthology.orchestra.run.smithi092.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-14T14:52:31.766 INFO:teuthology.orchestra.run.smithi092.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-14T14:52:31.766 INFO:teuthology.orchestra.run.smithi092.stdout:Packager : builder@centos.org 2024-05-14T14:52:31.766 INFO:teuthology.orchestra.run.smithi092.stdout:Vendor : CentOS 2024-05-14T14:52:31.766 INFO:teuthology.orchestra.run.smithi092.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-14T14:52:31.766 INFO:teuthology.orchestra.run.smithi092.stdout:Summary : Support tools for GRUB. 2024-05-14T14:52:31.766 INFO:teuthology.orchestra.run.smithi092.stdout:Description : 2024-05-14T14:52:31.766 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T14:52:31.766 INFO:teuthology.orchestra.run.smithi092.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-14T14:52:31.766 INFO:teuthology.orchestra.run.smithi092.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-14T14:52:31.766 INFO:teuthology.orchestra.run.smithi092.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-14T14:52:31.766 INFO:teuthology.orchestra.run.smithi092.stdout:hardware devices. 2024-05-14T14:52:31.766 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T14:52:31.766 INFO:teuthology.orchestra.run.smithi092.stdout:This subpackage provides tools for support of all platforms. 2024-05-14T14:52:31.767 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-14T14:52:31.767 INFO:teuthology.task.kernel:Updating grub on smithi092 to boot 6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:31.767 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-14T14:52:32.318 INFO:teuthology.orchestra.run.smithi092.stderr:Generating grub configuration file ... 2024-05-14T14:52:33.773 INFO:teuthology.orchestra.run.smithi092.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-14T14:52:33.803 INFO:teuthology.orchestra.run.smithi092.stderr:done 2024-05-14T14:52:33.805 DEBUG:teuthology.orchestra.run.smithi092:> mktemp 2024-05-14T14:52:33.834 INFO:teuthology.orchestra.run.smithi092.stdout:/tmp/tmp.M3QHYsDRjJ 2024-05-14T14:52:33.834 DEBUG:teuthology.orchestra.run.smithi092:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.M3QHYsDRjJ 2024-05-14T14:52:33.901 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 0666 /tmp/tmp.M3QHYsDRjJ 2024-05-14T14:52:34.040 DEBUG:teuthology.orchestra.remote:smithi092:/tmp/tmp.M3QHYsDRjJ is 6KB 2024-05-14T14:52:34.063 DEBUG:teuthology.orchestra.run.smithi092:> rm -fr /tmp/tmp.M3QHYsDRjJ 2024-05-14T14:52:34.077 DEBUG:teuthology.orchestra.run.smithi092:> sudo /bin/ls /boot/loader/entries || true 2024-05-14T14:52:34.149 INFO:teuthology.orchestra.run.smithi092.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-14T14:52:34.149 INFO:teuthology.orchestra.run.smithi092.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-14T14:52:34.149 INFO:teuthology.orchestra.run.smithi092.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-14T14:52:34.149 INFO:teuthology.orchestra.run.smithi092.stdout:7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e.conf 2024-05-14T14:52:34.150 DEBUG:teuthology.orchestra.run.smithi092:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:52:34.314 DEBUG:teuthology.orchestra.run.smithi092:> sudo shutdown -r now 2024-05-14T14:52:48.543 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-14T14:52:48.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-05-14T14:52:48.544 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:53:00.164 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-05-14T14:53:00.164 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-05-14T14:53:00.165 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:53:04.320 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-14T14:53:04.320 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-05-14T14:53:04.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:53:06.974 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-05-14T14:53:15.984 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-05-14T14:53:15.985 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:53:18.494 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-05-14T14:53:19.038 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.69 2024-05-14T14:53:22.846 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-05-14T14:53:27.498 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-05-14T14:53:27.499 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:53:30.559 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.203 2024-05-14T14:53:31.040 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-05-14T14:53:31.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:53:31.848 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-05-14T14:53:31.849 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:53:34.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.92 2024-05-14T14:53:42.566 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-05-14T14:53:42.567 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:53:46.916 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-05-14T14:53:46.916 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:54:18.881 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-05-14T14:54:19.422 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-05-14T14:54:19.423 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "6.9.0-rc3-gfb9a6a44107e"... 2024-05-14T14:54:19.423 DEBUG:teuthology.orchestra.run.smithi092:> uname -r 2024-05-14T14:54:19.466 INFO:teuthology.orchestra.run.smithi092.stdout:6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:54:19.467 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-gfb9a6a44107e vs 6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:54:19.467 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-14T14:54:19.467 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-14T14:54:20.468 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-14T14:54:20.468 DEBUG:teuthology.orchestra.run.smithi092:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-14T14:54:20.614 INFO:teuthology.orchestra.run.smithi092.stdout:ttyS1 2024-05-14T14:54:20.659 DEBUG:teuthology.parallel:result is None 2024-05-14T14:54:31.043 DEBUG:teuthology.orchestra.remote:timed out 2024-05-14T14:54:42.569 DEBUG:teuthology.orchestra.remote:timed out 2024-05-14T14:54:46.044 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-05-14T14:54:46.045 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:54:46.487 DEBUG:teuthology.orchestra.run.smithi069:> true 2024-05-14T14:54:47.113 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-05-14T14:54:47.113 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "6.9.0-rc3-gfb9a6a44107e"... 2024-05-14T14:54:47.114 DEBUG:teuthology.orchestra.run.smithi069:> uname -r 2024-05-14T14:54:47.165 INFO:teuthology.orchestra.run.smithi069.stdout:6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:54:47.165 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-gfb9a6a44107e vs 6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:54:47.165 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-14T14:54:47.165 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-14T14:54:48.167 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-14T14:54:48.167 DEBUG:teuthology.orchestra.run.smithi069:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-14T14:54:48.313 INFO:teuthology.orchestra.run.smithi069.stdout:ttyS1 2024-05-14T14:54:48.376 DEBUG:teuthology.parallel:result is None 2024-05-14T14:54:57.570 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-05-14T14:54:57.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T14:54:57.975 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-05-14T14:54:58.633 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-05-14T14:54:58.634 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "6.9.0-rc3-gfb9a6a44107e"... 2024-05-14T14:54:58.634 DEBUG:teuthology.orchestra.run.smithi203:> uname -r 2024-05-14T14:54:58.687 INFO:teuthology.orchestra.run.smithi203.stdout:6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:54:58.687 DEBUG:teuthology.task.kernel:current kernel version is 6.9.0-rc3-gfb9a6a44107e vs 6.9.0-rc3-gfb9a6a44107e 2024-05-14T14:54:58.687 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-14T14:54:58.688 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-14T14:54:59.688 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-05-14T14:54:59.689 DEBUG:teuthology.orchestra.run.smithi203:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-14T14:54:59.830 INFO:teuthology.orchestra.run.smithi203.stdout:ttyS1 2024-05-14T14:54:59.900 DEBUG:teuthology.parallel:result is None 2024-05-14T14:54:59.901 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-14T14:54:59.912 INFO:teuthology.task.internal:Creating test directory... 2024-05-14T14:54:59.912 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T14:54:59.921 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T14:54:59.929 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-14T14:54:59.986 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-14T14:54:59.996 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-14T14:55:00.097 INFO:teuthology.task.internal:Creating archive directory... 2024-05-14T14:55:00.097 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T14:55:00.105 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T14:55:00.113 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-14T14:55:00.211 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-14T14:55:00.218 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-14T14:55:00.218 DEBUG:teuthology.orchestra.run.smithi069:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T14:55:00.225 DEBUG:teuthology.orchestra.run.smithi092:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T14:55:00.232 DEBUG:teuthology.orchestra.run.smithi203:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-14T14:55:00.307 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T14:55:00.320 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T14:55:00.325 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T14:55:00.337 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T14:55:00.352 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T14:55:00.355 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-14T14:55:00.359 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-14T14:55:00.365 INFO:teuthology.task.internal:Configuring sudo... 2024-05-14T14:55:00.366 DEBUG:teuthology.orchestra.run.smithi069:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T14:55:00.373 DEBUG:teuthology.orchestra.run.smithi092:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T14:55:00.378 DEBUG:teuthology.orchestra.run.smithi203:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-14T14:55:00.460 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-14T14:55:00.470 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-14T14:55:00.470 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T14:55:00.477 DEBUG:teuthology.orchestra.run.smithi092:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T14:55:00.484 DEBUG:teuthology.orchestra.run.smithi203:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-14T14:55:00.537 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T14:55:00.618 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T14:55:00.733 DEBUG:teuthology.orchestra.run.smithi069:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T14:55:00.819 DEBUG:teuthology.orchestra.run.smithi069:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T14:55:00.902 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T14:55:00.902 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T14:55:00.984 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T14:55:01.069 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T14:55:01.165 DEBUG:teuthology.orchestra.run.smithi092:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T14:55:01.247 DEBUG:teuthology.orchestra.run.smithi092:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T14:55:01.335 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-05-14T14:55:01.336 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T14:55:01.421 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T14:55:01.502 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-14T14:55:01.596 DEBUG:teuthology.orchestra.run.smithi203:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T14:55:01.680 DEBUG:teuthology.orchestra.run.smithi203:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-14T14:55:01.768 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-05-14T14:55:01.768 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-14T14:55:01.852 DEBUG:teuthology.orchestra.run.smithi069:> sudo service rsyslog restart 2024-05-14T14:55:01.859 DEBUG:teuthology.orchestra.run.smithi092:> sudo service rsyslog restart 2024-05-14T14:55:01.867 DEBUG:teuthology.orchestra.run.smithi203:> sudo service rsyslog restart 2024-05-14T14:55:01.972 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T14:55:01.988 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T14:55:01.994 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T14:55:02.498 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-14T14:55:02.508 INFO:teuthology.task.internal:Starting timer... 2024-05-14T14:55:02.508 INFO:teuthology.run_tasks:Running task pcp... 2024-05-14T14:55:02.519 INFO:teuthology.run_tasks:Running task selinux... 2024-05-14T14:55:02.528 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-05-14T14:55:02.528 DEBUG:teuthology.orchestra.run.smithi069:> sudo service auditd rotate 2024-05-14T14:55:02.676 INFO:teuthology.orchestra.run.smithi069.stdout:Rotating logs: 2024-05-14T14:55:02.681 DEBUG:teuthology.orchestra.run.smithi092:> sudo service auditd rotate 2024-05-14T14:55:02.823 INFO:teuthology.orchestra.run.smithi092.stdout:Rotating logs: 2024-05-14T14:55:02.828 DEBUG:teuthology.orchestra.run.smithi203:> sudo service auditd rotate 2024-05-14T14:55:02.979 INFO:teuthology.orchestra.run.smithi203.stdout:Rotating logs: 2024-05-14T14:55:02.984 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-14T14:55:02.984 DEBUG:teuthology.orchestra.run.smithi069:> /usr/sbin/getenforce 2024-05-14T14:55:03.039 INFO:teuthology.orchestra.run.smithi069.stdout:Permissive 2024-05-14T14:55:03.039 DEBUG:teuthology.orchestra.run.smithi092:> /usr/sbin/getenforce 2024-05-14T14:55:03.096 INFO:teuthology.orchestra.run.smithi092.stdout:Permissive 2024-05-14T14:55:03.097 DEBUG:teuthology.orchestra.run.smithi203:> /usr/sbin/getenforce 2024-05-14T14:55:03.147 INFO:teuthology.orchestra.run.smithi203.stdout:Permissive 2024-05-14T14:55:03.148 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi069.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi092.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi203.front.sepia.ceph.com': 'permissive'} 2024-05-14T14:55:03.148 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T14:55:03.228 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T14:55:03.229 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T14:55:03.303 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T14:55:03.303 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T14:55:03.383 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T14:55:03.383 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-14T14:55:03.383 DEBUG:teuthology.orchestra.run.smithi069:> sudo /usr/sbin/setenforce permissive 2024-05-14T14:55:03.459 DEBUG:teuthology.orchestra.run.smithi092:> sudo /usr/sbin/setenforce permissive 2024-05-14T14:55:03.524 DEBUG:teuthology.orchestra.run.smithi203:> sudo /usr/sbin/setenforce permissive 2024-05-14T14:55:03.597 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-14T14:55:03.608 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-14T14:55:03.626 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-14T14:55:03.628 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi069.front.sepia.ceph.com,smithi092.front.sepia.ceph.com,smithi203.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-14T15:01:12.050 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi069.front.sepia.ceph.com'), Remote(name='ubuntu@smithi092.front.sepia.ceph.com'), Remote(name='ubuntu@smithi203.front.sepia.ceph.com')] 2024-05-14T15:01:12.051 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-05-14T15:01:12.052 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi069.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T15:01:12.164 DEBUG:teuthology.orchestra.run.smithi069:> true 2024-05-14T15:01:12.319 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi069.front.sepia.ceph.com' 2024-05-14T15:01:12.319 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-05-14T15:01:12.320 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi092.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T15:01:12.433 DEBUG:teuthology.orchestra.run.smithi092:> true 2024-05-14T15:01:12.581 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi092.front.sepia.ceph.com' 2024-05-14T15:01:12.581 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-05-14T15:01:12.582 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi203.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-14T15:01:12.686 DEBUG:teuthology.orchestra.run.smithi203:> true 2024-05-14T15:01:12.837 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi203.front.sepia.ceph.com' 2024-05-14T15:01:12.837 INFO:teuthology.run_tasks:Running task clock... 2024-05-14T15:01:12.848 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-14T15:01:12.849 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T15:01:12.849 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T15:01:12.857 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T15:01:12.857 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T15:01:12.864 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-14T15:01:12.864 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T15:01:12.943 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-14T15:01:12.945 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-14T15:01:12.956 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-14T15:01:12.984 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-14T15:01:12.986 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-14T15:01:12.995 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-14T15:01:13.053 INFO:teuthology.orchestra.run.smithi092.stderr:sudo: ntpd: command not found 2024-05-14T15:01:13.062 INFO:teuthology.orchestra.run.smithi069.stderr:sudo: ntpd: command not found 2024-05-14T15:01:13.071 INFO:teuthology.orchestra.run.smithi203.stderr:sudo: ntpd: command not found 2024-05-14T15:01:13.080 INFO:teuthology.orchestra.run.smithi092.stdout:506 Cannot talk to daemon 2024-05-14T15:01:13.095 INFO:teuthology.orchestra.run.smithi069.stdout:506 Cannot talk to daemon 2024-05-14T15:01:13.102 INFO:teuthology.orchestra.run.smithi203.stdout:506 Cannot talk to daemon 2024-05-14T15:01:13.117 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-14T15:01:13.137 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-14T15:01:13.144 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-14T15:01:13.158 INFO:teuthology.orchestra.run.smithi092.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-14T15:01:13.178 INFO:teuthology.orchestra.run.smithi069.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-14T15:01:13.187 INFO:teuthology.orchestra.run.smithi203.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-14T15:01:13.292 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-05-14T15:01:13.302 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T15:01:13.302 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-05-14T15:01:13.302 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:01:13.302 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:01:13.302 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:01:13.302 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:01:13.312 INFO:teuthology.orchestra.run.smithi069.stderr:bash: line 1: ntpq: command not found 2024-05-14T15:01:13.320 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T15:01:13.320 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2024-05-14T15:01:13.320 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:01:13.320 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:01:13.320 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:01:13.320 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:01:13.323 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-05-14T15:01:13.332 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T15:01:13.333 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-05-14T15:01:13.333 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:01:13.333 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:01:13.333 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:01:13.333 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T15:01:13.334 INFO:teuthology.run_tasks:Running task install... 2024-05-14T15:01:13.344 DEBUG:teuthology.task.install:project ceph 2024-05-14T15:01:13.344 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'}} 2024-05-14T15:01:13.344 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780'} 2024-05-14T15:01:13.344 INFO:teuthology.task.install:Using flavor: default 2024-05-14T15:01:13.350 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-14T15:01:13.350 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-14T15:01:13.351 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'tag': None, 'wait_for_package': False} 2024-05-14T15:01:13.351 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T15:01:13.353 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'tag': None, 'wait_for_package': False} 2024-05-14T15:01:13.353 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T15:01:13.354 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'tag': None, 'wait_for_package': False} 2024-05-14T15:01:13.354 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T15:01:13.504 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/ 2024-05-14T15:01:13.504 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3588.ge2b755a6 2024-05-14T15:01:13.583 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/ 2024-05-14T15:01:13.583 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3588.ge2b755a6 2024-05-14T15:01:13.592 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/ 2024-05-14T15:01:13.593 INFO:teuthology.task.install.rpm:Package version is 19.0.0-3588.ge2b755a6 2024-05-14T15:01:13.616 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-14T15:01:13.616 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:01:13.616 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-14T15:01:13.693 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-14T15:01:13.694 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-05-14T15:01:13.694 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-14T15:01:13.703 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-05-14T15:01:13.703 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-05-14T15:01:13.703 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-05-14T15:01:13.713 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-14T15:01:13.714 DEBUG:teuthology.orchestra.run.smithi069:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b755a64f0d72176b57299d02e880cf0620d780/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-14T15:01:13.780 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-14T15:01:13.780 DEBUG:teuthology.orchestra.run.smithi092:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b755a64f0d72176b57299d02e880cf0620d780/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-14T15:01:13.793 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-05-14T15:01:13.793 DEBUG:teuthology.orchestra.run.smithi203:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/e2b755a64f0d72176b57299d02e880cf0620d780/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-05-14T15:01:13.843 DEBUG:teuthology.orchestra.run.smithi069:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-14T15:01:13.904 DEBUG:teuthology.orchestra.run.smithi092:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-14T15:01:13.922 DEBUG:teuthology.orchestra.run.smithi203:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-05-14T15:01:13.951 DEBUG:teuthology.orchestra.run.smithi069:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-14T15:01:14.015 DEBUG:teuthology.orchestra.run.smithi092:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-14T15:01:14.029 INFO:teuthology.orchestra.run.smithi069.stdout:check_obsoletes = 1 2024-05-14T15:01:14.033 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum clean all 2024-05-14T15:01:14.034 DEBUG:teuthology.orchestra.run.smithi203:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-05-14T15:01:14.089 INFO:teuthology.orchestra.run.smithi092.stdout:check_obsoletes = 1 2024-05-14T15:01:14.093 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum clean all 2024-05-14T15:01:14.114 INFO:teuthology.orchestra.run.smithi203.stdout:check_obsoletes = 1 2024-05-14T15:01:14.118 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum clean all 2024-05-14T15:01:14.365 INFO:teuthology.orchestra.run.smithi069.stdout:57 files removed 2024-05-14T15:01:14.403 DEBUG:teuthology.orchestra.run.smithi069:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-14T15:01:14.438 INFO:teuthology.orchestra.run.smithi092.stdout:57 files removed 2024-05-14T15:01:14.462 INFO:teuthology.orchestra.run.smithi203.stdout:57 files removed 2024-05-14T15:01:14.475 DEBUG:teuthology.orchestra.run.smithi092:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-14T15:01:14.505 DEBUG:teuthology.orchestra.run.smithi203:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-05-14T15:01:15.219 INFO:teuthology.orchestra.run.smithi069.stdout:ceph packages for x86_64 218 kB/s | 84 kB 00:00 2024-05-14T15:01:15.300 INFO:teuthology.orchestra.run.smithi092.stdout:ceph packages for x86_64 210 kB/s | 84 kB 00:00 2024-05-14T15:01:15.416 INFO:teuthology.orchestra.run.smithi203.stdout:ceph packages for x86_64 177 kB/s | 84 kB 00:00 2024-05-14T15:01:15.787 INFO:teuthology.orchestra.run.smithi069.stdout:ceph noarch packages 25 kB/s | 12 kB 00:00 2024-05-14T15:01:15.901 INFO:teuthology.orchestra.run.smithi092.stdout:ceph noarch packages 23 kB/s | 12 kB 00:00 2024-05-14T15:01:15.934 INFO:teuthology.orchestra.run.smithi203.stdout:ceph noarch packages 28 kB/s | 12 kB 00:00 2024-05-14T15:01:16.256 INFO:teuthology.orchestra.run.smithi069.stdout:ceph source packages 4.9 kB/s | 1.9 kB 00:00 2024-05-14T15:01:16.385 INFO:teuthology.orchestra.run.smithi092.stdout:ceph source packages 4.8 kB/s | 1.9 kB 00:00 2024-05-14T15:01:16.493 INFO:teuthology.orchestra.run.smithi203.stdout:ceph source packages 4.0 kB/s | 1.9 kB 00:00 2024-05-14T15:01:17.150 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.1 MB 00:00 2024-05-14T15:01:18.344 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.1 MB 00:02 2024-05-14T15:01:19.335 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - AppStream 20 MB/s | 19 MB 00:00 2024-05-14T15:01:20.395 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - AppStream 24 MB/s | 19 MB 00:00 2024-05-14T15:01:20.783 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - BaseOS 1.9 MB/s | 8.1 MB 00:04 2024-05-14T15:01:23.575 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - AppStream 12 MB/s | 19 MB 00:01 2024-05-14T15:01:24.771 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.2 MB 00:00 2024-05-14T15:01:25.702 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.2 MB 00:02 2024-05-14T15:01:26.680 INFO:teuthology.orchestra.run.smithi069.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 16 kB 00:00 2024-05-14T15:01:27.395 INFO:teuthology.orchestra.run.smithi203.stdout:CentOS Stream 9 - Extras packages 52 kB/s | 16 kB 00:00 2024-05-14T15:01:28.615 INFO:teuthology.orchestra.run.smithi069.stdout:Extra Packages for Enterprise Linux 12 MB/s | 21 MB 00:01 2024-05-14T15:01:29.826 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - CRB 2.6 MB/s | 6.2 MB 00:02 2024-05-14T15:01:34.740 INFO:teuthology.orchestra.run.smithi069.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-05-14T15:01:35.188 INFO:teuthology.orchestra.run.smithi203.stdout:Extra Packages for Enterprise Linux 2.8 MB/s | 21 MB 00:07 2024-05-14T15:01:35.468 INFO:teuthology.orchestra.run.smithi092.stdout:CentOS Stream 9 - Extras packages 3.8 kB/s | 16 kB 00:04 2024-05-14T15:01:37.336 INFO:teuthology.orchestra.run.smithi069.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T15:01:37.338 INFO:teuthology.orchestra.run.smithi069.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T15:01:37.359 INFO:teuthology.orchestra.run.smithi069.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-14T15:01:37.361 INFO:teuthology.orchestra.run.smithi069.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-14T15:01:37.362 INFO:teuthology.orchestra.run.smithi069.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T15:01:37.364 INFO:teuthology.orchestra.run.smithi069.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T15:01:37.366 INFO:teuthology.orchestra.run.smithi069.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T15:01:37.369 INFO:teuthology.orchestra.run.smithi069.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-14T15:01:37.371 INFO:teuthology.orchestra.run.smithi069.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T15:01:37.443 INFO:teuthology.orchestra.run.smithi069.stdout:Dependencies resolved. 2024-05-14T15:01:37.458 INFO:teuthology.orchestra.run.smithi069.stdout:======================================================================================= 2024-05-14T15:01:37.458 INFO:teuthology.orchestra.run.smithi069.stdout: Package Arch Version Repository Size 2024-05-14T15:01:37.458 INFO:teuthology.orchestra.run.smithi069.stdout:======================================================================================= 2024-05-14T15:01:37.458 INFO:teuthology.orchestra.run.smithi069.stdout:Installing: 2024-05-14T15:01:37.458 INFO:teuthology.orchestra.run.smithi069.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-14T15:01:37.458 INFO:teuthology.orchestra.run.smithi069.stdout: ceph x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.6 k 2024-05-14T15:01:37.458 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T15:01:37.458 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 863 k 2024-05-14T15:01:37.458 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 147 k 2024-05-14T15:01:37.459 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T15:01:37.459 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 142 k 2024-05-14T15:01:37.459 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 3.5 M 2024-05-14T15:01:37.459 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 7.4 M 2024-05-14T15:01:37.459 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 49 k 2024-05-14T15:01:37.459 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 10 M 2024-05-14T15:01:37.459 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 43 M 2024-05-14T15:01:37.459 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 273 k 2024-05-14T15:01:37.459 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 763 k 2024-05-14T15:01:37.459 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 224 k 2024-05-14T15:01:37.459 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-shell x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 27 k 2024-05-14T15:01:37.459 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-top noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 18 k 2024-05-14T15:01:37.460 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-14T15:01:37.460 INFO:teuthology.orchestra.run.smithi069.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-14T15:01:37.460 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-14T15:01:37.460 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 32 k 2024-05-14T15:01:37.460 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 756 k 2024-05-14T15:01:37.460 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 127 k 2024-05-14T15:01:37.460 INFO:teuthology.orchestra.run.smithi069.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-14T15:01:37.460 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-14T15:01:37.460 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-14T15:01:37.460 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-14T15:01:37.460 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-14T15:01:37.460 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-14T15:01:37.460 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 162 k 2024-05-14T15:01:37.460 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 321 k 2024-05-14T15:01:37.460 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 301 k 2024-05-14T15:01:37.461 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 100 k 2024-05-14T15:01:37.461 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 86 k 2024-05-14T15:01:37.461 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.0 M 2024-05-14T15:01:37.461 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 170 k 2024-05-14T15:01:37.461 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-14T15:01:37.461 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrading: 2024-05-14T15:01:37.461 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-14T15:01:37.461 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-14T15:01:37.461 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-14T15:01:37.461 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-14T15:01:37.461 INFO:teuthology.orchestra.run.smithi069.stdout: librados2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.3 M 2024-05-14T15:01:37.461 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.1 M 2024-05-14T15:01:37.461 INFO:teuthology.orchestra.run.smithi069.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-14T15:01:37.461 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-14T15:01:37.462 INFO:teuthology.orchestra.run.smithi069.stdout:Installing dependencies: 2024-05-14T15:01:37.462 INFO:teuthology.orchestra.run.smithi069.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-14T15:01:37.462 INFO:teuthology.orchestra.run.smithi069.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-14T15:01:37.462 INFO:teuthology.orchestra.run.smithi069.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-14T15:01:37.462 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 20 M 2024-05-14T15:01:37.462 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 34 k 2024-05-14T15:01:37.462 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 2.3 M 2024-05-14T15:01:37.462 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 274 k 2024-05-14T15:01:37.462 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 4.9 M 2024-05-14T15:01:37.462 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 18 M 2024-05-14T15:01:37.462 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 16 k 2024-05-14T15:01:37.462 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 25 k 2024-05-14T15:01:37.462 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-14T15:01:37.463 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-14T15:01:37.463 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-14T15:01:37.465 INFO:teuthology.orchestra.run.smithi069.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-14T15:01:37.465 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-14T15:01:37.465 INFO:teuthology.orchestra.run.smithi069.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-14T15:01:37.465 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-14T15:01:37.465 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-14T15:01:37.465 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 157 k 2024-05-14T15:01:37.465 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-14T15:01:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-14T15:01:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-14T15:01:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-14T15:01:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-14T15:01:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 497 k 2024-05-14T15:01:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-14T15:01:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.2 M 2024-05-14T15:01:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-14T15:01:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-14T15:01:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-14T15:01:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-14T15:01:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-14T15:01:37.466 INFO:teuthology.orchestra.run.smithi069.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-14T15:01:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-14T15:01:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-14T15:01:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-14T15:01:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-14T15:01:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-14T15:01:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-14T15:01:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-14T15:01:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-14T15:01:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-14T15:01:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-14T15:01:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-14T15:01:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 45 k 2024-05-14T15:01:37.467 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 135 k 2024-05-14T15:01:37.468 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-14T15:01:37.468 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-14T15:01:37.468 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-14T15:01:37.468 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-14T15:01:37.468 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-14T15:01:37.468 INFO:teuthology.orchestra.run.smithi069.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-14T15:01:37.468 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-14T15:01:37.468 INFO:teuthology.orchestra.run.smithi069.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-14T15:01:37.468 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-14T15:01:37.468 INFO:teuthology.orchestra.run.smithi069.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-14T15:01:37.468 INFO:teuthology.orchestra.run.smithi069.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-14T15:01:37.468 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-14T15:01:37.468 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-14T15:01:37.468 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-14T15:01:37.469 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-14T15:01:37.469 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-14T15:01:37.469 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-14T15:01:37.469 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-14T15:01:37.469 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-14T15:01:37.469 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-14T15:01:37.469 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-14T15:01:37.469 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-14T15:01:37.469 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-14T15:01:37.469 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-14T15:01:37.469 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-14T15:01:37.469 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-14T15:01:37.469 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-14T15:01:37.469 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-14T15:01:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-14T15:01:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-14T15:01:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-14T15:01:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-14T15:01:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-14T15:01:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-14T15:01:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-14T15:01:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-14T15:01:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-14T15:01:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-14T15:01:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-14T15:01:37.470 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-14T15:01:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-14T15:01:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-14T15:01:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-14T15:01:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-14T15:01:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-14T15:01:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-14T15:01:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-14T15:01:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-14T15:01:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-14T15:01:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-14T15:01:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-14T15:01:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-14T15:01:37.471 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-14T15:01:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-14T15:01:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-14T15:01:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-14T15:01:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-14T15:01:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-14T15:01:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-14T15:01:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-14T15:01:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-14T15:01:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-14T15:01:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-14T15:01:37.472 INFO:teuthology.orchestra.run.smithi069.stdout:Installing weak dependencies: 2024-05-14T15:01:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-14T15:01:37.472 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:01:37.473 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction Summary 2024-05-14T15:01:37.473 INFO:teuthology.orchestra.run.smithi069.stdout:======================================================================================= 2024-05-14T15:01:37.473 INFO:teuthology.orchestra.run.smithi069.stdout:Install 148 Packages 2024-05-14T15:01:37.473 INFO:teuthology.orchestra.run.smithi069.stdout:Upgrade 8 Packages 2024-05-14T15:01:37.473 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:01:37.473 INFO:teuthology.orchestra.run.smithi069.stdout:Total download size: 219 M 2024-05-14T15:01:37.473 INFO:teuthology.orchestra.run.smithi069.stdout:Downloading Packages: 2024-05-14T15:01:38.334 INFO:teuthology.orchestra.run.smithi092.stdout:Extra Packages for Enterprise Linux 7.9 MB/s | 21 MB 00:02 2024-05-14T15:01:40.741 INFO:teuthology.orchestra.run.smithi069.stdout:(1/156): ceph-19.0.0-3588.ge2b755a6.el9.x86_64. 26 kB/s | 6.6 kB 00:00 2024-05-14T15:01:40.958 INFO:teuthology.orchestra.run.smithi069.stdout:(2/156): ceph-fuse-19.0.0-3588.ge2b755a6.el9.x8 3.9 MB/s | 863 kB 00:00 2024-05-14T15:01:41.042 INFO:teuthology.orchestra.run.smithi069.stdout:(3/156): ceph-immutable-object-cache-19.0.0-358 1.7 MB/s | 147 kB 00:00 2024-05-14T15:01:41.350 INFO:teuthology.orchestra.run.smithi069.stdout:(4/156): ceph-base-19.0.0-3588.ge2b755a6.el9.x8 6.3 MB/s | 5.4 MB 00:00 2024-05-14T15:01:41.442 INFO:teuthology.orchestra.run.smithi069.stdout:(5/156): ceph-mds-19.0.0-3588.ge2b755a6.el9.x86 5.7 MB/s | 2.3 MB 00:00 2024-05-14T15:01:41.526 INFO:teuthology.orchestra.run.smithi069.stdout:(6/156): ceph-mgr-19.0.0-3588.ge2b755a6.el9.x86 8.6 MB/s | 1.5 MB 00:00 2024-05-14T15:01:41.538 INFO:teuthology.orchestra.run.smithi203.stdout:lab-extras 25 kB/s | 1.7 kB 00:00 2024-05-14T15:01:42.076 INFO:teuthology.orchestra.run.smithi069.stdout:(7/156): ceph-mon-19.0.0-3588.ge2b755a6.el9.x86 7.7 MB/s | 4.9 MB 00:00 2024-05-14T15:01:43.010 INFO:teuthology.orchestra.run.smithi069.stdout:(8/156): ceph-common-19.0.0-3588.ge2b755a6.el9. 7.8 MB/s | 20 MB 00:02 2024-05-14T15:01:43.068 INFO:teuthology.orchestra.run.smithi069.stdout:(9/156): ceph-selinux-19.0.0-3588.ge2b755a6.el9 441 kB/s | 25 kB 00:00 2024-05-14T15:01:43.327 INFO:teuthology.orchestra.run.smithi069.stdout:(10/156): ceph-osd-19.0.0-3588.ge2b755a6.el9.x8 9.9 MB/s | 18 MB 00:01 2024-05-14T15:01:43.485 INFO:teuthology.orchestra.run.smithi069.stdout:(11/156): ceph-radosgw-19.0.0-3588.ge2b755a6.el 7.2 MB/s | 10 MB 00:01 2024-05-14T15:01:43.519 INFO:teuthology.orchestra.run.smithi069.stdout:(12/156): cephfs-mirror-19.0.0-3588.ge2b755a6.e 1.1 MB/s | 224 kB 00:00 2024-05-14T15:01:43.552 INFO:teuthology.orchestra.run.smithi069.stdout:(13/156): cephfs-shell-19.0.0-3588.ge2b755a6.el 409 kB/s | 27 kB 00:00 2024-05-14T15:01:43.569 INFO:teuthology.orchestra.run.smithi069.stdout:(14/156): libcephfs-devel-19.0.0-3588.ge2b755a6 641 kB/s | 32 kB 00:00 2024-05-14T15:01:43.703 INFO:teuthology.orchestra.run.smithi069.stdout:(15/156): libcephfs2-19.0.0-3588.ge2b755a6.el9. 5.0 MB/s | 756 kB 00:00 2024-05-14T15:01:43.737 INFO:teuthology.orchestra.run.smithi069.stdout:(16/156): libcephsqlite-19.0.0-3588.ge2b755a6.e 948 kB/s | 157 kB 00:00 2024-05-14T15:01:43.770 INFO:teuthology.orchestra.run.smithi069.stdout:(17/156): librados-devel-19.0.0-3588.ge2b755a6. 1.9 MB/s | 127 kB 00:00 2024-05-14T15:01:43.862 INFO:teuthology.orchestra.run.smithi069.stdout:(18/156): libradosstriper1-19.0.0-3588.ge2b755a 3.9 MB/s | 497 kB 00:00 2024-05-14T15:01:43.988 INFO:teuthology.orchestra.run.smithi069.stdout:(19/156): python3-ceph-argparse-19.0.0-3588.ge2 363 kB/s | 45 kB 00:00 2024-05-14T15:01:44.088 INFO:teuthology.orchestra.run.smithi069.stdout:(20/156): python3-ceph-common-19.0.0-3588.ge2b7 1.3 MB/s | 135 kB 00:00 2024-05-14T15:01:44.107 INFO:teuthology.orchestra.run.smithi203.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T15:01:44.109 INFO:teuthology.orchestra.run.smithi203.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T15:01:44.129 INFO:teuthology.orchestra.run.smithi203.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-14T15:01:44.130 INFO:teuthology.orchestra.run.smithi203.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-14T15:01:44.131 INFO:teuthology.orchestra.run.smithi203.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T15:01:44.133 INFO:teuthology.orchestra.run.smithi203.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T15:01:44.135 INFO:teuthology.orchestra.run.smithi203.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T15:01:44.138 INFO:teuthology.orchestra.run.smithi203.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-14T15:01:44.140 INFO:teuthology.orchestra.run.smithi203.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T15:01:44.180 INFO:teuthology.orchestra.run.smithi069.stdout:(21/156): python3-cephfs-19.0.0-3588.ge2b755a6. 1.7 MB/s | 162 kB 00:00 2024-05-14T15:01:44.209 INFO:teuthology.orchestra.run.smithi203.stdout:Dependencies resolved. 2024-05-14T15:01:44.228 INFO:teuthology.orchestra.run.smithi203.stdout:======================================================================================= 2024-05-14T15:01:44.228 INFO:teuthology.orchestra.run.smithi203.stdout: Package Arch Version Repository Size 2024-05-14T15:01:44.228 INFO:teuthology.orchestra.run.smithi203.stdout:======================================================================================= 2024-05-14T15:01:44.228 INFO:teuthology.orchestra.run.smithi203.stdout:Installing: 2024-05-14T15:01:44.228 INFO:teuthology.orchestra.run.smithi203.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-14T15:01:44.228 INFO:teuthology.orchestra.run.smithi203.stdout: ceph x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.6 k 2024-05-14T15:01:44.228 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T15:01:44.228 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 863 k 2024-05-14T15:01:44.228 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 147 k 2024-05-14T15:01:44.228 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T15:01:44.229 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 142 k 2024-05-14T15:01:44.229 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 3.5 M 2024-05-14T15:01:44.229 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 7.4 M 2024-05-14T15:01:44.229 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 49 k 2024-05-14T15:01:44.229 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 10 M 2024-05-14T15:01:44.229 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 43 M 2024-05-14T15:01:44.229 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-volume noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 273 k 2024-05-14T15:01:44.229 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 763 k 2024-05-14T15:01:44.229 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 224 k 2024-05-14T15:01:44.229 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-shell x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 27 k 2024-05-14T15:01:44.229 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-top noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 18 k 2024-05-14T15:01:44.229 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-14T15:01:44.229 INFO:teuthology.orchestra.run.smithi203.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-14T15:01:44.229 INFO:teuthology.orchestra.run.smithi203.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-14T15:01:44.229 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 32 k 2024-05-14T15:01:44.230 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 756 k 2024-05-14T15:01:44.230 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 127 k 2024-05-14T15:01:44.230 INFO:teuthology.orchestra.run.smithi203.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-14T15:01:44.230 INFO:teuthology.orchestra.run.smithi203.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-14T15:01:44.230 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-14T15:01:44.230 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-14T15:01:44.230 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-14T15:01:44.230 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-14T15:01:44.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 162 k 2024-05-14T15:01:44.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 321 k 2024-05-14T15:01:44.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 301 k 2024-05-14T15:01:44.230 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 100 k 2024-05-14T15:01:44.230 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 86 k 2024-05-14T15:01:44.230 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.0 M 2024-05-14T15:01:44.231 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 170 k 2024-05-14T15:01:44.231 INFO:teuthology.orchestra.run.smithi203.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-14T15:01:44.231 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrading: 2024-05-14T15:01:44.231 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-14T15:01:44.231 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-14T15:01:44.231 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-14T15:01:44.231 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-14T15:01:44.231 INFO:teuthology.orchestra.run.smithi203.stdout: librados2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.3 M 2024-05-14T15:01:44.231 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.1 M 2024-05-14T15:01:44.231 INFO:teuthology.orchestra.run.smithi203.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-14T15:01:44.231 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-14T15:01:44.231 INFO:teuthology.orchestra.run.smithi203.stdout:Installing dependencies: 2024-05-14T15:01:44.231 INFO:teuthology.orchestra.run.smithi203.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-14T15:01:44.231 INFO:teuthology.orchestra.run.smithi203.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-14T15:01:44.231 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-14T15:01:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 20 M 2024-05-14T15:01:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 34 k 2024-05-14T15:01:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 2.3 M 2024-05-14T15:01:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 274 k 2024-05-14T15:01:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 4.9 M 2024-05-14T15:01:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 18 M 2024-05-14T15:01:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 16 k 2024-05-14T15:01:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 25 k 2024-05-14T15:01:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-14T15:01:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-14T15:01:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-14T15:01:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-14T15:01:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-14T15:01:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-14T15:01:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-14T15:01:44.232 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-14T15:01:44.233 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 157 k 2024-05-14T15:01:44.233 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-14T15:01:44.233 INFO:teuthology.orchestra.run.smithi203.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-14T15:01:44.233 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-14T15:01:44.233 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-14T15:01:44.233 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-14T15:01:44.233 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 497 k 2024-05-14T15:01:44.233 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-14T15:01:44.233 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.2 M 2024-05-14T15:01:44.233 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-14T15:01:44.233 INFO:teuthology.orchestra.run.smithi203.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-14T15:01:44.233 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-14T15:01:44.233 INFO:teuthology.orchestra.run.smithi203.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-14T15:01:44.233 INFO:teuthology.orchestra.run.smithi203.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-14T15:01:44.233 INFO:teuthology.orchestra.run.smithi203.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-14T15:01:44.234 INFO:teuthology.orchestra.run.smithi203.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-14T15:01:44.234 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-14T15:01:44.234 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-14T15:01:44.234 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-14T15:01:44.234 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-14T15:01:44.234 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-14T15:01:44.234 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-14T15:01:44.234 INFO:teuthology.orchestra.run.smithi203.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-14T15:01:44.234 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-14T15:01:44.234 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-14T15:01:44.234 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-14T15:01:44.235 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 45 k 2024-05-14T15:01:44.235 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 135 k 2024-05-14T15:01:44.235 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-14T15:01:44.235 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-14T15:01:44.235 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-14T15:01:44.235 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-14T15:01:44.235 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-14T15:01:44.235 INFO:teuthology.orchestra.run.smithi203.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-14T15:01:44.235 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-14T15:01:44.235 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-14T15:01:44.236 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-14T15:01:44.236 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-14T15:01:44.236 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-14T15:01:44.236 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-14T15:01:44.236 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-14T15:01:44.236 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-14T15:01:44.236 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-14T15:01:44.236 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-14T15:01:44.236 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-14T15:01:44.236 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-14T15:01:44.236 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-14T15:01:44.236 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-14T15:01:44.236 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-14T15:01:44.236 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-14T15:01:44.236 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-14T15:01:44.237 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-14T15:01:44.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-14T15:01:44.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-14T15:01:44.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-14T15:01:44.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-14T15:01:44.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-14T15:01:44.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-14T15:01:44.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-14T15:01:44.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-14T15:01:44.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-14T15:01:44.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-14T15:01:44.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-14T15:01:44.238 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-14T15:01:44.239 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-14T15:01:44.239 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-14T15:01:44.239 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-14T15:01:44.239 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-14T15:01:44.239 INFO:teuthology.orchestra.run.smithi203.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-14T15:01:44.239 INFO:teuthology.orchestra.run.smithi203.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-14T15:01:44.239 INFO:teuthology.orchestra.run.smithi203.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-14T15:01:44.239 INFO:teuthology.orchestra.run.smithi203.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-14T15:01:44.239 INFO:teuthology.orchestra.run.smithi203.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-14T15:01:44.239 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-14T15:01:44.239 INFO:teuthology.orchestra.run.smithi203.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-14T15:01:44.239 INFO:teuthology.orchestra.run.smithi203.stdout:Installing weak dependencies: 2024-05-14T15:01:44.239 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-14T15:01:44.239 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:01:44.239 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction Summary 2024-05-14T15:01:44.239 INFO:teuthology.orchestra.run.smithi203.stdout:======================================================================================= 2024-05-14T15:01:44.240 INFO:teuthology.orchestra.run.smithi203.stdout:Install 148 Packages 2024-05-14T15:01:44.240 INFO:teuthology.orchestra.run.smithi203.stdout:Upgrade 8 Packages 2024-05-14T15:01:44.240 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:01:44.240 INFO:teuthology.orchestra.run.smithi203.stdout:Total download size: 219 M 2024-05-14T15:01:44.240 INFO:teuthology.orchestra.run.smithi203.stdout:Downloading Packages: 2024-05-14T15:01:44.322 INFO:teuthology.orchestra.run.smithi069.stdout:(22/156): librgw2-19.0.0-3588.ge2b755a6.el9.x86 9.4 MB/s | 5.2 MB 00:00 2024-05-14T15:01:44.364 INFO:teuthology.orchestra.run.smithi069.stdout:(23/156): python3-rados-19.0.0-3588.ge2b755a6.e 1.7 MB/s | 321 kB 00:00 2024-05-14T15:01:44.406 INFO:teuthology.orchestra.run.smithi069.stdout:(24/156): python3-rbd-19.0.0-3588.ge2b755a6.el9 3.6 MB/s | 301 kB 00:00 2024-05-14T15:01:44.431 INFO:teuthology.orchestra.run.smithi069.stdout:(25/156): python3-rgw-19.0.0-3588.ge2b755a6.el9 1.5 MB/s | 100 kB 00:00 2024-05-14T15:01:44.452 INFO:teuthology.orchestra.run.smithi092.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-05-14T15:01:44.481 INFO:teuthology.orchestra.run.smithi069.stdout:(26/156): rbd-fuse-19.0.0-3588.ge2b755a6.el9.x8 1.1 MB/s | 86 kB 00:00 2024-05-14T15:01:44.590 INFO:teuthology.orchestra.run.smithi069.stdout:(27/156): rbd-nbd-19.0.0-3588.ge2b755a6.el9.x86 1.5 MB/s | 170 kB 00:00 2024-05-14T15:01:44.724 INFO:teuthology.orchestra.run.smithi069.stdout:(28/156): rbd-mirror-19.0.0-3588.ge2b755a6.el9. 10 MB/s | 3.0 MB 00:00 2024-05-14T15:01:44.740 INFO:teuthology.orchestra.run.smithi069.stdout:(29/156): ceph-grafana-dashboards-19.0.0-3588.g 229 kB/s | 34 kB 00:00 2024-05-14T15:01:44.802 INFO:teuthology.orchestra.run.smithi069.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3588.ge2b755a 1.9 MB/s | 142 kB 00:00 2024-05-14T15:01:45.225 INFO:teuthology.orchestra.run.smithi069.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3588.ge2b75 7.3 MB/s | 3.5 MB 00:00 2024-05-14T15:01:45.333 INFO:teuthology.orchestra.run.smithi069.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3588.ge2 2.5 MB/s | 274 kB 00:00 2024-05-14T15:01:45.407 INFO:teuthology.orchestra.run.smithi203.stdout:(1/156): ceph-19.0.0-3588.ge2b755a6.el9.x86_64. 8.2 kB/s | 6.6 kB 00:00 2024-05-14T15:01:45.425 INFO:teuthology.orchestra.run.smithi069.stdout:(33/156): ceph-mgr-rook-19.0.0-3588.ge2b755a6.e 544 kB/s | 49 kB 00:00 2024-05-14T15:01:45.509 INFO:teuthology.orchestra.run.smithi069.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3588.ge 200 kB/s | 16 kB 00:00 2024-05-14T15:01:45.634 INFO:teuthology.orchestra.run.smithi069.stdout:(35/156): ceph-volume-19.0.0-3588.ge2b755a6.el9 2.2 MB/s | 273 kB 00:00 2024-05-14T15:01:45.776 INFO:teuthology.orchestra.run.smithi069.stdout:(36/156): ceph-mgr-diskprediction-local-19.0.0- 7.6 MB/s | 7.4 MB 00:00 2024-05-14T15:01:45.826 INFO:teuthology.orchestra.run.smithi069.stdout:(37/156): cephadm-19.0.0-3588.ge2b755a6.el9.noa 3.9 MB/s | 763 kB 00:00 2024-05-14T15:01:45.852 INFO:teuthology.orchestra.run.smithi069.stdout:(38/156): cephfs-top-19.0.0-3588.ge2b755a6.el9. 245 kB/s | 18 kB 00:00 2024-05-14T15:01:46.010 INFO:teuthology.orchestra.run.smithi069.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 440 kB/s | 80 kB 00:00 2024-05-14T15:01:46.119 INFO:teuthology.orchestra.run.smithi069.stdout:(40/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.8 MB/s | 195 kB 00:00 2024-05-14T15:01:46.141 INFO:teuthology.orchestra.run.smithi203.stdout:(2/156): ceph-fuse-19.0.0-3588.ge2b755a6.el9.x8 1.2 MB/s | 863 kB 00:00 2024-05-14T15:01:46.161 INFO:teuthology.orchestra.run.smithi069.stdout:(41/156): libgfortran-11.4.1-3.el9.x86_64.rpm 2.6 MB/s | 803 kB 00:00 2024-05-14T15:01:46.241 INFO:teuthology.orchestra.run.smithi203.stdout:(3/156): ceph-immutable-object-cache-19.0.0-358 1.4 MB/s | 147 kB 00:00 2024-05-14T15:01:46.636 INFO:teuthology.orchestra.run.smithi069.stdout:(42/156): ceph-test-19.0.0-3588.ge2b755a6.el9.x 12 MB/s | 43 MB 00:03 2024-05-14T15:01:46.670 INFO:teuthology.orchestra.run.smithi069.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 460 kB/s | 253 kB 00:00 2024-05-14T15:01:46.733 INFO:teuthology.orchestra.run.smithi203.stdout:(4/156): ceph-base-19.0.0-3588.ge2b755a6.el9.x8 2.5 MB/s | 5.4 MB 00:02 2024-05-14T15:01:46.745 INFO:teuthology.orchestra.run.smithi069.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 2.1 MB/s | 1.2 MB 00:00 2024-05-14T15:01:46.770 INFO:teuthology.orchestra.run.smithi069.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.3 MB/s | 135 kB 00:00 2024-05-14T15:01:46.829 INFO:teuthology.orchestra.run.smithi069.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-05-14T15:01:46.854 INFO:teuthology.orchestra.run.smithi069.stdout:(47/156): python3-urllib3-1.26.5-5.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-05-14T15:01:46.879 INFO:teuthology.orchestra.run.smithi069.stdout:(48/156): python3-ply-3.11-14.el9.noarch.rpm 440 kB/s | 106 kB 00:00 2024-05-14T15:01:46.922 INFO:teuthology.orchestra.run.smithi069.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 7.3 MB/s | 689 kB 00:00 2024-05-14T15:01:46.933 INFO:teuthology.orchestra.run.smithi203.stdout:(5/156): ceph-mds-19.0.0-3588.ge2b755a6.el9.x86 3.3 MB/s | 2.3 MB 00:00 2024-05-14T15:01:46.972 INFO:teuthology.orchestra.run.smithi069.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 1.1 MB/s | 107 kB 00:00 2024-05-14T15:01:46.997 INFO:teuthology.orchestra.run.smithi069.stdout:(51/156): elfutils-libelf-devel-0.190-2.el9.x86 289 kB/s | 21 kB 00:00 2024-05-14T15:01:47.008 INFO:teuthology.orchestra.run.smithi203.stdout:(6/156): ceph-mgr-19.0.0-3588.ge2b755a6.el9.x86 5.5 MB/s | 1.5 MB 00:00 2024-05-14T15:01:47.041 INFO:teuthology.orchestra.run.smithi092.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T15:01:47.043 INFO:teuthology.orchestra.run.smithi092.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-05-14T15:01:47.047 INFO:teuthology.orchestra.run.smithi069.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 4.8 MB/s | 943 kB 00:00 2024-05-14T15:01:47.062 INFO:teuthology.orchestra.run.smithi092.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-05-14T15:01:47.064 INFO:teuthology.orchestra.run.smithi092.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-05-14T15:01:47.065 INFO:teuthology.orchestra.run.smithi092.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-05-14T15:01:47.066 INFO:teuthology.orchestra.run.smithi092.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-05-14T15:01:47.069 INFO:teuthology.orchestra.run.smithi092.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-05-14T15:01:47.072 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-05-14T15:01:47.072 INFO:teuthology.orchestra.run.smithi069.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 438 kB/s | 33 kB 00:00 2024-05-14T15:01:47.073 INFO:teuthology.orchestra.run.smithi092.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-05-14T15:01:47.131 INFO:teuthology.orchestra.run.smithi069.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 1.9 MB/s | 313 kB 00:00 2024-05-14T15:01:47.143 INFO:teuthology.orchestra.run.smithi092.stdout:Dependencies resolved. 2024-05-14T15:01:47.156 INFO:teuthology.orchestra.run.smithi069.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 219 kB/s | 18 kB 00:00 2024-05-14T15:01:47.164 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================= 2024-05-14T15:01:47.164 INFO:teuthology.orchestra.run.smithi092.stdout: Package Arch Version Repository Size 2024-05-14T15:01:47.164 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================= 2024-05-14T15:01:47.164 INFO:teuthology.orchestra.run.smithi092.stdout:Installing: 2024-05-14T15:01:47.164 INFO:teuthology.orchestra.run.smithi092.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-05-14T15:01:47.164 INFO:teuthology.orchestra.run.smithi092.stdout: ceph x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 6.6 k 2024-05-14T15:01:47.164 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.4 M 2024-05-14T15:01:47.164 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 863 k 2024-05-14T15:01:47.164 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 147 k 2024-05-14T15:01:47.165 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 1.5 M 2024-05-14T15:01:47.165 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 142 k 2024-05-14T15:01:47.165 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 3.5 M 2024-05-14T15:01:47.165 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 7.4 M 2024-05-14T15:01:47.165 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 49 k 2024-05-14T15:01:47.165 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 10 M 2024-05-14T15:01:47.165 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 43 M 2024-05-14T15:01:47.165 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 273 k 2024-05-14T15:01:47.165 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 763 k 2024-05-14T15:01:47.165 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 224 k 2024-05-14T15:01:47.165 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-shell x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 27 k 2024-05-14T15:01:47.165 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 18 k 2024-05-14T15:01:47.165 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-05-14T15:01:47.165 INFO:teuthology.orchestra.run.smithi092.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-05-14T15:01:47.165 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-05-14T15:01:47.165 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 32 k 2024-05-14T15:01:47.166 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 756 k 2024-05-14T15:01:47.166 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 127 k 2024-05-14T15:01:47.166 INFO:teuthology.orchestra.run.smithi092.stdout: libtool x86_64 2.4.6-45.el9 appstream 582 k 2024-05-14T15:01:47.166 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-05-14T15:01:47.166 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel x86_64 1:3.2.1-1.el9 appstream 4.4 M 2024-05-14T15:01:47.166 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-05-14T15:01:47.166 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-05-14T15:01:47.166 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-05-14T15:01:47.166 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 162 k 2024-05-14T15:01:47.166 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 321 k 2024-05-14T15:01:47.166 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 301 k 2024-05-14T15:01:47.166 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 100 k 2024-05-14T15:01:47.166 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 86 k 2024-05-14T15:01:47.166 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.0 M 2024-05-14T15:01:47.167 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 170 k 2024-05-14T15:01:47.167 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-05-14T15:01:47.167 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrading: 2024-05-14T15:01:47.167 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager x86_64 1:1.47.90-1.el9 baseos 2.3 M 2024-05-14T15:01:47.167 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-libnm x86_64 1:1.47.90-1.el9 baseos 1.8 M 2024-05-14T15:01:47.167 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-team x86_64 1:1.47.90-1.el9 baseos 41 k 2024-05-14T15:01:47.167 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-tui x86_64 1:1.47.90-1.el9 baseos 248 k 2024-05-14T15:01:47.167 INFO:teuthology.orchestra.run.smithi092.stdout: librados2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.3 M 2024-05-14T15:01:47.167 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 3.1 M 2024-05-14T15:01:47.167 INFO:teuthology.orchestra.run.smithi092.stdout: openssl x86_64 1:3.2.1-1.el9 baseos 1.3 M 2024-05-14T15:01:47.167 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-libs x86_64 1:3.2.1-1.el9 baseos 2.4 M 2024-05-14T15:01:47.167 INFO:teuthology.orchestra.run.smithi092.stdout:Installing dependencies: 2024-05-14T15:01:47.167 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-05-14T15:01:47.167 INFO:teuthology.orchestra.run.smithi092.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-05-14T15:01:47.167 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-05-14T15:01:47.167 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 20 M 2024-05-14T15:01:47.168 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 34 k 2024-05-14T15:01:47.168 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 2.3 M 2024-05-14T15:01:47.168 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 274 k 2024-05-14T15:01:47.168 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 4.9 M 2024-05-14T15:01:47.168 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 18 M 2024-05-14T15:01:47.168 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts noarch 2:19.0.0-3588.ge2b755a6.el9 ceph-noarch 16 k 2024-05-14T15:01:47.168 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 25 k 2024-05-14T15:01:47.168 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-05-14T15:01:47.168 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-05-14T15:01:47.168 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-05-14T15:01:47.168 INFO:teuthology.orchestra.run.smithi092.stdout: fuse x86_64 2.9.9-15.el9 baseos 80 k 2024-05-14T15:01:47.168 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-05-14T15:01:47.168 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-05-14T15:01:47.168 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-05-14T15:01:47.168 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-05-14T15:01:47.169 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 157 k 2024-05-14T15:01:47.169 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-05-14T15:01:47.169 INFO:teuthology.orchestra.run.smithi092.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-05-14T15:01:47.169 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-05-14T15:01:47.169 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-05-14T15:01:47.169 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-05-14T15:01:47.169 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 497 k 2024-05-14T15:01:47.169 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-05-14T15:01:47.169 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2 x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 5.2 M 2024-05-14T15:01:47.169 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-05-14T15:01:47.169 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-05-14T15:01:47.169 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-05-14T15:01:47.169 INFO:teuthology.orchestra.run.smithi092.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-05-14T15:01:47.169 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-05-14T15:01:47.169 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-05-14T15:01:47.170 INFO:teuthology.orchestra.run.smithi092.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-05-14T15:01:47.170 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-05-14T15:01:47.170 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-05-14T15:01:47.170 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-05-14T15:01:47.170 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-05-14T15:01:47.170 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-05-14T15:01:47.170 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-05-14T15:01:47.170 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-05-14T15:01:47.170 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-05-14T15:01:47.170 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-05-14T15:01:47.170 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-05-14T15:01:47.170 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 45 k 2024-05-14T15:01:47.170 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common x86_64 2:19.0.0-3588.ge2b755a6.el9 ceph 135 k 2024-05-14T15:01:47.171 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-05-14T15:01:47.171 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-05-14T15:01:47.171 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-05-14T15:01:47.171 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-05-14T15:01:47.171 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-05-14T15:01:47.171 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-05-14T15:01:47.171 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-05-14T15:01:47.171 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-05-14T15:01:47.171 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth noarch 1:2.29.0-1.el9 epel 206 k 2024-05-14T15:01:47.171 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-05-14T15:01:47.171 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-05-14T15:01:47.171 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-05-14T15:01:47.171 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-05-14T15:01:47.171 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-05-14T15:01:47.172 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-05-14T15:01:47.172 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-05-14T15:01:47.172 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-05-14T15:01:47.172 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-05-14T15:01:47.172 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-05-14T15:01:47.172 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-05-14T15:01:47.172 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-05-14T15:01:47.172 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-05-14T15:01:47.172 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-05-14T15:01:47.172 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-05-14T15:01:47.172 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-05-14T15:01:47.172 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-05-14T15:01:47.172 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-05-14T15:01:47.172 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-05-14T15:01:47.172 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-05-14T15:01:47.173 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-05-14T15:01:47.173 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-05-14T15:01:47.173 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-05-14T15:01:47.173 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-05-14T15:01:47.173 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-05-14T15:01:47.173 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-05-14T15:01:47.173 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-05-14T15:01:47.173 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-05-14T15:01:47.173 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-05-14T15:01:47.173 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-05-14T15:01:47.173 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-05-14T15:01:47.173 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-05-14T15:01:47.173 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-05-14T15:01:47.173 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-05-14T15:01:47.173 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-05-14T15:01:47.173 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-05-14T15:01:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-05-14T15:01:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-05-14T15:01:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-05-14T15:01:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-05-14T15:01:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3 noarch 1.26.5-5.el9 baseos 215 k 2024-05-14T15:01:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-05-14T15:01:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-05-14T15:01:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-05-14T15:01:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-05-14T15:01:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-05-14T15:01:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-05-14T15:01:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-05-14T15:01:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-05-14T15:01:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: socat x86_64 1.7.4.1-5.el9 appstream 305 k 2024-05-14T15:01:47.174 INFO:teuthology.orchestra.run.smithi092.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-05-14T15:01:47.175 INFO:teuthology.orchestra.run.smithi092.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-05-14T15:01:47.175 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-05-14T15:01:47.175 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-05-14T15:01:47.175 INFO:teuthology.orchestra.run.smithi092.stdout:Installing weak dependencies: 2024-05-14T15:01:47.175 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-05-14T15:01:47.175 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T15:01:47.175 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction Summary 2024-05-14T15:01:47.175 INFO:teuthology.orchestra.run.smithi092.stdout:======================================================================================= 2024-05-14T15:01:47.175 INFO:teuthology.orchestra.run.smithi092.stdout:Install 148 Packages 2024-05-14T15:01:47.175 INFO:teuthology.orchestra.run.smithi092.stdout:Upgrade 8 Packages 2024-05-14T15:01:47.175 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T15:01:47.176 INFO:teuthology.orchestra.run.smithi092.stdout:Total download size: 219 M 2024-05-14T15:01:47.176 INFO:teuthology.orchestra.run.smithi092.stdout:Downloading Packages: 2024-05-14T15:01:47.190 INFO:teuthology.orchestra.run.smithi069.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 193 kB/s | 11 kB 00:00 2024-05-14T15:01:47.224 INFO:teuthology.orchestra.run.smithi069.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.4 MB/s | 160 kB 00:00 2024-05-14T15:01:47.249 INFO:teuthology.orchestra.run.smithi069.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 780 kB/s | 45 kB 00:00 2024-05-14T15:01:47.316 INFO:teuthology.orchestra.run.smithi069.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 7.1 MB/s | 662 kB 00:00 2024-05-14T15:01:47.358 INFO:teuthology.orchestra.run.smithi069.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 5.3 MB/s | 582 kB 00:00 2024-05-14T15:01:47.383 INFO:teuthology.orchestra.run.smithi069.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 385 kB/s | 25 kB 00:00 2024-05-14T15:01:47.458 INFO:teuthology.orchestra.run.smithi069.stdout:(62/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 7.3 MB/s | 3.0 MB 00:00 2024-05-14T15:01:47.484 INFO:teuthology.orchestra.run.smithi069.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 380 kB/s | 47 kB 00:00 2024-05-14T15:01:47.517 INFO:teuthology.orchestra.run.smithi069.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.1 MB/s | 292 kB 00:00 2024-05-14T15:01:47.543 INFO:teuthology.orchestra.run.smithi069.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 609 kB/s | 35 kB 00:00 2024-05-14T15:01:47.606 INFO:teuthology.orchestra.run.smithi069.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.3 MB/s | 188 kB 00:00 2024-05-14T15:01:47.694 INFO:teuthology.orchestra.run.smithi203.stdout:(7/156): ceph-common-19.0.0-3588.ge2b755a6.el9. 6.3 MB/s | 20 MB 00:03 2024-05-14T15:01:47.768 INFO:teuthology.orchestra.run.smithi069.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 9.9 MB/s | 1.6 MB 00:00 2024-05-14T15:01:47.894 INFO:teuthology.orchestra.run.smithi069.stdout:(68/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-05-14T15:01:48.002 INFO:teuthology.orchestra.run.smithi069.stdout:(69/156): openblas-openmp-0.3.21-2.el9.x86_64.r 9.8 MB/s | 4.7 MB 00:00 2024-05-14T15:01:48.076 INFO:teuthology.orchestra.run.smithi203.stdout:(8/156): ceph-mon-19.0.0-3588.ge2b755a6.el9.x86 4.3 MB/s | 4.9 MB 00:01 2024-05-14T15:01:48.176 INFO:teuthology.orchestra.run.smithi069.stdout:(70/156): postgresql-contrib-13.14-1.el9.x86_64 2.2 MB/s | 911 kB 00:00 2024-05-14T15:01:48.184 INFO:teuthology.orchestra.run.smithi203.stdout:(9/156): ceph-selinux-19.0.0-3588.ge2b755a6.el9 234 kB/s | 25 kB 00:00 2024-05-14T15:01:48.211 INFO:teuthology.orchestra.run.smithi069.stdout:(71/156): postgresql-private-libs-13.14-1.el9.x 421 kB/s | 133 kB 00:00 2024-05-14T15:01:48.278 INFO:teuthology.orchestra.run.smithi069.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-05-14T15:01:48.320 INFO:teuthology.orchestra.run.smithi092.stdout:(1/156): ceph-19.0.0-3588.ge2b755a6.el9.x86_64. 14 kB/s | 6.6 kB 00:00 2024-05-14T15:01:48.336 INFO:teuthology.orchestra.run.smithi069.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 6.3 MB/s | 1.0 MB 00:00 2024-05-14T15:01:48.403 INFO:teuthology.orchestra.run.smithi069.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 3.6 MB/s | 244 kB 00:00 2024-05-14T15:01:48.503 INFO:teuthology.orchestra.run.smithi069.stdout:(75/156): postgresql-server-13.14-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-05-14T15:01:48.537 INFO:teuthology.orchestra.run.smithi069.stdout:(76/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.8 MB/s | 248 kB 00:00 2024-05-14T15:01:48.560 INFO:teuthology.orchestra.run.smithi203.stdout:(10/156): ceph-radosgw-19.0.0-3588.ge2b755a6.el 12 MB/s | 10 MB 00:00 2024-05-14T15:01:48.563 INFO:teuthology.orchestra.run.smithi069.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 439 kB/s | 26 kB 00:00 2024-05-14T15:01:48.605 INFO:teuthology.orchestra.run.smithi069.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 288 kB/s | 19 kB 00:00 2024-05-14T15:01:48.652 INFO:teuthology.orchestra.run.smithi203.stdout:(11/156): cephfs-mirror-19.0.0-3588.ge2b755a6.e 2.4 MB/s | 224 kB 00:00 2024-05-14T15:01:48.661 INFO:teuthology.orchestra.run.smithi069.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.7 MB/s | 172 kB 00:00 2024-05-14T15:01:48.689 INFO:teuthology.orchestra.run.smithi069.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 420 kB/s | 35 kB 00:00 2024-05-14T15:01:48.744 INFO:teuthology.orchestra.run.smithi203.stdout:(12/156): cephfs-shell-19.0.0-3588.ge2b755a6.el 297 kB/s | 27 kB 00:00 2024-05-14T15:01:48.754 INFO:teuthology.orchestra.run.smithi092.stdout:(2/156): ceph-fuse-19.0.0-3588.ge2b755a6.el9.x8 2.0 MB/s | 863 kB 00:00 2024-05-14T15:01:48.755 INFO:teuthology.orchestra.run.smithi069.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-05-14T15:01:48.837 INFO:teuthology.orchestra.run.smithi092.stdout:(3/156): ceph-immutable-object-cache-19.0.0-358 1.7 MB/s | 147 kB 00:00 2024-05-14T15:01:48.889 INFO:teuthology.orchestra.run.smithi069.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 9.8 MB/s | 6.0 MB 00:00 2024-05-14T15:01:48.923 INFO:teuthology.orchestra.run.smithi069.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 222 kB 00:00 2024-05-14T15:01:48.948 INFO:teuthology.orchestra.run.smithi069.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-14T15:01:48.982 INFO:teuthology.orchestra.run.smithi069.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 730 kB/s | 42 kB 00:00 2024-05-14T15:01:49.011 INFO:teuthology.orchestra.run.smithi203.stdout:(13/156): ceph-osd-19.0.0-3588.ge2b755a6.el9.x8 8.9 MB/s | 18 MB 00:02 2024-05-14T15:01:49.015 INFO:teuthology.orchestra.run.smithi069.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 269 kB 00:00 2024-05-14T15:01:49.036 INFO:teuthology.orchestra.run.smithi203.stdout:(14/156): libcephfs-devel-19.0.0-3588.ge2b755a6 109 kB/s | 32 kB 00:00 2024-05-14T15:01:49.049 INFO:teuthology.orchestra.run.smithi069.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.4 MB/s | 159 kB 00:00 2024-05-14T15:01:49.083 INFO:teuthology.orchestra.run.smithi069.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-05-14T15:01:49.103 INFO:teuthology.orchestra.run.smithi203.stdout:(15/156): libcephsqlite-19.0.0-3588.ge2b755a6.e 2.3 MB/s | 157 kB 00:00 2024-05-14T15:01:49.108 INFO:teuthology.orchestra.run.smithi069.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 875 kB/s | 51 kB 00:00 2024-05-14T15:01:49.112 INFO:teuthology.orchestra.run.smithi092.stdout:(4/156): ceph-mds-19.0.0-3588.ge2b755a6.el9.x86 8.2 MB/s | 2.3 MB 00:00 2024-05-14T15:01:49.167 INFO:teuthology.orchestra.run.smithi069.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 648 kB/s | 54 kB 00:00 2024-05-14T15:01:49.170 INFO:teuthology.orchestra.run.smithi203.stdout:(16/156): libcephfs2-19.0.0-3588.ge2b755a6.el9. 4.7 MB/s | 756 kB 00:00 2024-05-14T15:01:49.235 INFO:teuthology.orchestra.run.smithi203.stdout:(17/156): librados-devel-19.0.0-3588.ge2b755a6. 967 kB/s | 127 kB 00:00 2024-05-14T15:01:49.275 INFO:teuthology.orchestra.run.smithi069.stdout:(91/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.3 MB/s | 5.1 MB 00:00 2024-05-14T15:01:49.287 INFO:teuthology.orchestra.run.smithi203.stdout:(18/156): libradosstriper1-19.0.0-3588.ge2b755a 4.2 MB/s | 497 kB 00:00 2024-05-14T15:01:49.301 INFO:teuthology.orchestra.run.smithi069.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 314 kB/s | 42 kB 00:00 2024-05-14T15:01:49.334 INFO:teuthology.orchestra.run.smithi069.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 763 kB/s | 44 kB 00:00 2024-05-14T15:01:49.368 INFO:teuthology.orchestra.run.smithi069.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 221 kB 00:00 2024-05-14T15:01:49.388 INFO:teuthology.orchestra.run.smithi092.stdout:(5/156): ceph-mgr-19.0.0-3588.ge2b755a6.el9.x86 5.5 MB/s | 1.5 MB 00:00 2024-05-14T15:01:49.388 INFO:teuthology.orchestra.run.smithi203.stdout:(19/156): python3-ceph-argparse-19.0.0-3588.ge2 454 kB/s | 45 kB 00:00 2024-05-14T15:01:49.401 INFO:teuthology.orchestra.run.smithi069.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 543 kB/s | 36 kB 00:00 2024-05-14T15:01:49.435 INFO:teuthology.orchestra.run.smithi069.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 712 kB/s | 47 kB 00:00 2024-05-14T15:01:49.468 INFO:teuthology.orchestra.run.smithi069.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 4.5 MB/s | 305 kB 00:00 2024-05-14T15:01:49.494 INFO:teuthology.orchestra.run.smithi069.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 58 kB 00:00 2024-05-14T15:01:49.579 INFO:teuthology.orchestra.run.smithi069.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 860 kB/s | 94 kB 00:00 2024-05-14T15:01:49.667 INFO:teuthology.orchestra.run.smithi069.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 370 kB/s | 64 kB 00:00 2024-05-14T15:01:49.703 INFO:teuthology.orchestra.run.smithi069.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 362 kB/s | 45 kB 00:00 2024-05-14T15:01:49.787 INFO:teuthology.orchestra.run.smithi069.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 188 kB/s | 22 kB 00:00 2024-05-14T15:01:49.922 INFO:teuthology.orchestra.run.smithi203.stdout:(20/156): librgw2-19.0.0-3588.ge2b755a6.el9.x86 7.5 MB/s | 5.2 MB 00:00 2024-05-14T15:01:50.039 INFO:teuthology.orchestra.run.smithi203.stdout:(21/156): python3-cephfs-19.0.0-3588.ge2b755a6. 1.4 MB/s | 162 kB 00:00 2024-05-14T15:01:50.064 INFO:teuthology.orchestra.run.smithi203.stdout:(22/156): python3-ceph-common-19.0.0-3588.ge2b7 201 kB/s | 135 kB 00:00 2024-05-14T15:01:50.123 INFO:teuthology.orchestra.run.smithi203.stdout:(23/156): python3-rados-19.0.0-3588.ge2b755a6.e 3.8 MB/s | 321 kB 00:00 2024-05-14T15:01:50.173 INFO:teuthology.orchestra.run.smithi203.stdout:(24/156): python3-rbd-19.0.0-3588.ge2b755a6.el9 2.7 MB/s | 301 kB 00:00 2024-05-14T15:01:50.207 INFO:teuthology.orchestra.run.smithi203.stdout:(25/156): python3-rgw-19.0.0-3588.ge2b755a6.el9 1.2 MB/s | 100 kB 00:00 2024-05-14T15:01:50.240 INFO:teuthology.orchestra.run.smithi203.stdout:(26/156): rbd-fuse-19.0.0-3588.ge2b755a6.el9.x8 1.3 MB/s | 86 kB 00:00 2024-05-14T15:01:50.253 INFO:teuthology.orchestra.run.smithi092.stdout:(6/156): ceph-mon-19.0.0-3588.ge2b755a6.el9.x86 5.6 MB/s | 4.9 MB 00:00 2024-05-14T15:01:50.262 INFO:teuthology.orchestra.run.smithi069.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 14 MB/s | 16 MB 00:01 2024-05-14T15:01:50.313 INFO:teuthology.orchestra.run.smithi069.stdout:(104/156): protobuf-compiler-3.14.0-13.el9.x86_ 1.4 MB/s | 863 kB 00:00 2024-05-14T15:01:50.324 INFO:teuthology.orchestra.run.smithi203.stdout:(27/156): rbd-nbd-19.0.0-3588.ge2b755a6.el9.x86 2.0 MB/s | 170 kB 00:00 2024-05-14T15:01:50.458 INFO:teuthology.orchestra.run.smithi203.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3588.g 258 kB/s | 34 kB 00:00 2024-05-14T15:01:50.546 INFO:teuthology.orchestra.run.smithi069.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 723 kB/s | 548 kB 00:00 2024-05-14T15:01:50.589 INFO:teuthology.orchestra.run.smithi069.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 71 kB/s | 19 kB 00:00 2024-05-14T15:01:50.625 INFO:teuthology.orchestra.run.smithi203.stdout:(29/156): rbd-mirror-19.0.0-3588.ge2b755a6.el9. 7.3 MB/s | 3.0 MB 00:00 2024-05-14T15:01:50.658 INFO:teuthology.orchestra.run.smithi203.stdout:(30/156): ceph-mgr-cephadm-19.0.0-3588.ge2b755a 713 kB/s | 142 kB 00:00 2024-05-14T15:01:50.813 INFO:teuthology.orchestra.run.smithi069.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 562 kB/s | 309 kB 00:00 2024-05-14T15:01:50.830 INFO:teuthology.orchestra.run.smithi069.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 108 kB/s | 26 kB 00:00 2024-05-14T15:01:51.046 INFO:teuthology.orchestra.run.smithi092.stdout:(7/156): ceph-base-19.0.0-3588.ge2b755a6.el9.x8 1.7 MB/s | 5.4 MB 00:03 2024-05-14T15:01:51.147 INFO:teuthology.orchestra.run.smithi069.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 146 kB/s | 49 kB 00:00 2024-05-14T15:01:51.173 INFO:teuthology.orchestra.run.smithi069.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 197 kB/s | 67 kB 00:00 2024-05-14T15:01:51.451 INFO:teuthology.orchestra.run.smithi203.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3588.ge2b75 4.3 MB/s | 3.5 MB 00:00 2024-05-14T15:01:51.548 INFO:teuthology.orchestra.run.smithi069.stdout:(111/156): luarocks-3.9.2-1.el9.noarch.rpm 378 kB/s | 151 kB 00:00 2024-05-14T15:01:51.576 INFO:teuthology.orchestra.run.smithi203.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3588.ge2 2.2 MB/s | 274 kB 00:00 2024-05-14T15:01:51.651 INFO:teuthology.orchestra.run.smithi203.stdout:(33/156): ceph-mgr-rook-19.0.0-3588.ge2b755a6.e 666 kB/s | 49 kB 00:00 2024-05-14T15:01:51.718 INFO:teuthology.orchestra.run.smithi203.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3588.ge 251 kB/s | 16 kB 00:00 2024-05-14T15:01:51.810 INFO:teuthology.orchestra.run.smithi203.stdout:(35/156): ceph-volume-19.0.0-3588.ge2b755a6.el9 2.9 MB/s | 273 kB 00:00 2024-05-14T15:01:51.823 INFO:teuthology.orchestra.run.smithi069.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 1.3 MB/s | 839 kB 00:00 2024-05-14T15:01:51.915 INFO:teuthology.orchestra.run.smithi069.stdout:(113/156): libarrow-9.0.0-11.el9.x86_64.rpm 3.2 MB/s | 4.4 MB 00:01 2024-05-14T15:01:52.044 INFO:teuthology.orchestra.run.smithi203.stdout:(36/156): cephadm-19.0.0-3588.ge2b755a6.el9.noa 3.2 MB/s | 763 kB 00:00 2024-05-14T15:01:52.119 INFO:teuthology.orchestra.run.smithi203.stdout:(37/156): cephfs-top-19.0.0-3588.ge2b755a6.el9. 246 kB/s | 18 kB 00:00 2024-05-14T15:01:52.132 INFO:teuthology.orchestra.run.smithi069.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 940 kB/s | 548 kB 00:00 2024-05-14T15:01:52.165 INFO:teuthology.orchestra.run.smithi069.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 129 kB/s | 32 kB 00:00 2024-05-14T15:01:52.191 INFO:teuthology.orchestra.run.smithi069.stdout:(116/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 118 kB/s | 43 kB 00:00 2024-05-14T15:01:52.253 INFO:teuthology.orchestra.run.smithi203.stdout:(38/156): ceph-mgr-diskprediction-local-19.0.0- 4.6 MB/s | 7.4 MB 00:01 2024-05-14T15:01:52.392 INFO:teuthology.orchestra.run.smithi069.stdout:(117/156): python3-certifi-2021.10.8-2.el9.noar 58 kB/s | 15 kB 00:00 2024-05-14T15:01:52.600 INFO:teuthology.orchestra.run.smithi069.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 397 kB/s | 172 kB 00:00 2024-05-14T15:01:52.647 INFO:teuthology.orchestra.run.smithi092.stdout:(8/156): ceph-common-19.0.0-3588.ge2b755a6.el9. 4.1 MB/s | 20 MB 00:04 2024-05-14T15:01:52.713 INFO:teuthology.orchestra.run.smithi092.stdout:(9/156): ceph-selinux-19.0.0-3588.ge2b755a6.el9 386 kB/s | 25 kB 00:00 2024-05-14T15:01:52.733 INFO:teuthology.orchestra.run.smithi069.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 662 kB/s | 358 kB 00:00 2024-05-14T15:01:52.859 INFO:teuthology.orchestra.run.smithi069.stdout:(120/156): python3-colorama-0.4.4-12.el9.noarch 137 kB/s | 35 kB 00:00 2024-05-14T15:01:52.892 INFO:teuthology.orchestra.run.smithi069.stdout:(121/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 606 kB/s | 303 kB 00:00 2024-05-14T15:01:53.201 INFO:teuthology.orchestra.run.smithi069.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 441 kB/s | 206 kB 00:00 2024-05-14T15:01:53.203 INFO:teuthology.orchestra.run.smithi203.stdout:(39/156): ceph-test-19.0.0-3588.ge2b755a6.el9.x 8.6 MB/s | 43 MB 00:05 2024-05-14T15:01:53.237 INFO:teuthology.orchestra.run.smithi203.stdout:(40/156): fuse-2.9.9-15.el9.x86_64.rpm 72 kB/s | 80 kB 00:01 2024-05-14T15:01:53.293 INFO:teuthology.orchestra.run.smithi069.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 362 kB/s | 144 kB 00:00 2024-05-14T15:01:53.393 INFO:teuthology.orchestra.run.smithi069.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 56 kB/s | 11 kB 00:00 2024-05-14T15:01:53.489 INFO:teuthology.orchestra.run.smithi092.stdout:(10/156): ceph-radosgw-19.0.0-3588.ge2b755a6.el 4.1 MB/s | 10 MB 00:02 2024-05-14T15:01:53.593 INFO:teuthology.orchestra.run.smithi069.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 59 kB/s | 18 kB 00:00 2024-05-14T15:01:53.606 INFO:teuthology.orchestra.run.smithi092.stdout:(11/156): cephfs-mirror-19.0.0-3588.ge2b755a6.e 1.9 MB/s | 224 kB 00:00 2024-05-14T15:01:53.669 INFO:teuthology.orchestra.run.smithi069.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 84 kB/s | 23 kB 00:00 2024-05-14T15:01:53.680 INFO:teuthology.orchestra.run.smithi092.stdout:(12/156): cephfs-shell-19.0.0-3588.ge2b755a6.el 365 kB/s | 27 kB 00:00 2024-05-14T15:01:53.756 INFO:teuthology.orchestra.run.smithi092.stdout:(13/156): libcephfs-devel-19.0.0-3588.ge2b755a6 427 kB/s | 32 kB 00:00 2024-05-14T15:01:53.810 INFO:teuthology.orchestra.run.smithi069.stdout:(127/156): python3-grpcio-1.46.7-10.el9.x86_64. 2.1 MB/s | 2.0 MB 00:00 2024-05-14T15:01:53.871 INFO:teuthology.orchestra.run.smithi203.stdout:(41/156): libgfortran-11.4.1-3.el9.x86_64.rpm 497 kB/s | 803 kB 00:01 2024-05-14T15:01:53.886 INFO:teuthology.orchestra.run.smithi069.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 67 kB/s | 19 kB 00:00 2024-05-14T15:01:53.961 INFO:teuthology.orchestra.run.smithi069.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 67 kB/s | 20 kB 00:00 2024-05-14T15:01:53.964 INFO:teuthology.orchestra.run.smithi092.stdout:(14/156): libcephfs2-19.0.0-3588.ge2b755a6.el9. 3.6 MB/s | 756 kB 00:00 2024-05-14T15:01:54.129 INFO:teuthology.orchestra.run.smithi203.stdout:(42/156): libquadmath-11.4.1-3.el9.x86_64.rpm 211 kB/s | 195 kB 00:00 2024-05-14T15:01:54.220 INFO:teuthology.orchestra.run.smithi069.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 139 kB/s | 46 kB 00:00 2024-05-14T15:01:54.239 INFO:teuthology.orchestra.run.smithi203.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 253 kB/s | 253 kB 00:00 2024-05-14T15:01:54.240 INFO:teuthology.orchestra.run.smithi092.stdout:(15/156): ceph-osd-19.0.0-3588.ge2b755a6.el9.x8 4.5 MB/s | 18 MB 00:03 2024-05-14T15:01:54.273 INFO:teuthology.orchestra.run.smithi092.stdout:(16/156): libcephsqlite-19.0.0-3588.ge2b755a6.e 512 kB/s | 157 kB 00:00 2024-05-14T15:01:54.307 INFO:teuthology.orchestra.run.smithi092.stdout:(17/156): librados-devel-19.0.0-3588.ge2b755a6. 1.9 MB/s | 127 kB 00:00 2024-05-14T15:01:54.379 INFO:teuthology.orchestra.run.smithi069.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 189 kB/s | 79 kB 00:00 2024-05-14T15:01:54.434 INFO:teuthology.orchestra.run.smithi092.stdout:(18/156): libradosstriper1-19.0.0-3588.ge2b755a 3.1 MB/s | 497 kB 00:00 2024-05-14T15:01:54.504 INFO:teuthology.orchestra.run.smithi069.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 1.5 MB/s | 1.0 MB 00:00 2024-05-14T15:01:54.507 INFO:teuthology.orchestra.run.smithi092.stdout:(19/156): python3-ceph-argparse-19.0.0-3588.ge2 610 kB/s | 45 kB 00:00 2024-05-14T15:01:54.562 INFO:teuthology.orchestra.run.smithi069.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 169 kB/s | 58 kB 00:00 2024-05-14T15:01:54.583 INFO:teuthology.orchestra.run.smithi092.stdout:(20/156): python3-ceph-common-19.0.0-3588.ge2b7 1.8 MB/s | 135 kB 00:00 2024-05-14T15:01:54.666 INFO:teuthology.orchestra.run.smithi092.stdout:(21/156): python3-cephfs-19.0.0-3588.ge2b755a6. 1.9 MB/s | 162 kB 00:00 2024-05-14T15:01:54.783 INFO:teuthology.orchestra.run.smithi092.stdout:(22/156): python3-rados-19.0.0-3588.ge2b755a6.e 2.7 MB/s | 321 kB 00:00 2024-05-14T15:01:54.829 INFO:teuthology.orchestra.run.smithi069.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 50 kB/s | 16 kB 00:00 2024-05-14T15:01:54.930 INFO:teuthology.orchestra.run.smithi069.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 496 kB/s | 272 kB 00:00 2024-05-14T15:01:54.942 INFO:teuthology.orchestra.run.smithi092.stdout:(23/156): python3-rbd-19.0.0-3588.ge2b755a6.el9 1.9 MB/s | 301 kB 00:00 2024-05-14T15:01:54.971 INFO:teuthology.orchestra.run.smithi069.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 220 kB/s | 90 kB 00:00 2024-05-14T15:01:55.009 INFO:teuthology.orchestra.run.smithi092.stdout:(24/156): python3-rgw-19.0.0-3588.ge2b755a6.el9 1.5 MB/s | 100 kB 00:00 2024-05-14T15:01:55.014 INFO:teuthology.orchestra.run.smithi203.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 131 kB/s | 106 kB 00:00 2024-05-14T15:01:55.084 INFO:teuthology.orchestra.run.smithi092.stdout:(25/156): rbd-fuse-19.0.0-3588.ge2b755a6.el9.x8 1.1 MB/s | 86 kB 00:00 2024-05-14T15:01:55.105 INFO:teuthology.orchestra.run.smithi069.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 103 kB/s | 28 kB 00:00 2024-05-14T15:01:55.111 INFO:teuthology.orchestra.run.smithi203.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 1.0 MB/s | 1.2 MB 00:01 2024-05-14T15:01:55.148 INFO:teuthology.orchestra.run.smithi203.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 149 kB/s | 135 kB 00:00 2024-05-14T15:01:55.172 INFO:teuthology.orchestra.run.smithi069.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 127 kB/s | 31 kB 00:00 2024-05-14T15:01:55.276 INFO:teuthology.orchestra.run.smithi092.stdout:(26/156): librgw2-19.0.0-3588.ge2b755a6.el9.x86 5.3 MB/s | 5.2 MB 00:00 2024-05-14T15:01:55.343 INFO:teuthology.orchestra.run.smithi092.stdout:(27/156): rbd-nbd-19.0.0-3588.ge2b755a6.el9.x86 2.5 MB/s | 170 kB 00:00 2024-05-14T15:01:55.364 INFO:teuthology.orchestra.run.smithi069.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 481 kB/s | 188 kB 00:00 2024-05-14T15:01:55.414 INFO:teuthology.orchestra.run.smithi069.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 148 kB/s | 36 kB 00:00 2024-05-14T15:01:55.418 INFO:teuthology.orchestra.run.smithi092.stdout:(28/156): ceph-grafana-dashboards-19.0.0-3588.g 462 kB/s | 34 kB 00:00 2024-05-14T15:01:55.439 INFO:teuthology.orchestra.run.smithi069.stdout:(141/156): python3-rsa-4.9-2.el9.noarch.rpm 177 kB/s | 59 kB 00:00 2024-05-14T15:01:55.519 INFO:teuthology.orchestra.run.smithi092.stdout:(29/156): ceph-mgr-cephadm-19.0.0-3588.ge2b755a 1.4 MB/s | 142 kB 00:00 2024-05-14T15:01:55.523 INFO:teuthology.orchestra.run.smithi203.stdout:(47/156): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 689 kB 00:00 2024-05-14T15:01:55.748 INFO:teuthology.orchestra.run.smithi203.stdout:(48/156): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-05-14T15:01:55.756 INFO:teuthology.orchestra.run.smithi069.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 130 kB/s | 51 kB 00:00 2024-05-14T15:01:55.769 INFO:teuthology.orchestra.run.smithi092.stdout:(30/156): rbd-mirror-19.0.0-3588.ge2b755a6.el9. 4.5 MB/s | 3.0 MB 00:00 2024-05-14T15:01:55.832 INFO:teuthology.orchestra.run.smithi203.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.3 MB/s | 107 kB 00:00 2024-05-14T15:01:55.916 INFO:teuthology.orchestra.run.smithi203.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 259 kB/s | 21 kB 00:00 2024-05-14T15:01:55.923 INFO:teuthology.orchestra.run.smithi069.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 186 kB/s | 90 kB 00:00 2024-05-14T15:01:55.966 INFO:teuthology.orchestra.run.smithi203.stdout:(51/156): python3-requests-2.25.1-8.el9.noarch. 131 kB/s | 125 kB 00:00 2024-05-14T15:01:55.982 INFO:teuthology.orchestra.run.smithi069.stdout:(144/156): python3-webob-1.8.7-6.el9.noarch.rpm 405 kB/s | 230 kB 00:00 2024-05-14T15:01:56.008 INFO:teuthology.orchestra.run.smithi203.stdout:(52/156): flex-2.6.4-9.el9.x86_64.rpm 3.4 MB/s | 313 kB 00:00 2024-05-14T15:01:56.200 INFO:teuthology.orchestra.run.smithi203.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 140 kB/s | 33 kB 00:00 2024-05-14T15:01:56.234 INFO:teuthology.orchestra.run.smithi203.stdout:(54/156): python3-urllib3-1.26.5-5.el9.noarch.r 192 kB/s | 215 kB 00:01 2024-05-14T15:01:56.257 INFO:teuthology.orchestra.run.smithi069.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 60 kB/s | 20 kB 00:00 2024-05-14T15:01:56.284 INFO:teuthology.orchestra.run.smithi203.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 219 kB/s | 18 kB 00:00 2024-05-14T15:01:56.343 INFO:teuthology.orchestra.run.smithi203.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 11 kB 00:00 2024-05-14T15:01:56.386 INFO:teuthology.orchestra.run.smithi092.stdout:(31/156): ceph-mgr-dashboard-19.0.0-3588.ge2b75 4.1 MB/s | 3.5 MB 00:00 2024-05-14T15:01:56.418 INFO:teuthology.orchestra.run.smithi203.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.2 MB/s | 160 kB 00:00 2024-05-14T15:01:56.435 INFO:teuthology.orchestra.run.smithi203.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 495 kB/s | 45 kB 00:00 2024-05-14T15:01:56.503 INFO:teuthology.orchestra.run.smithi092.stdout:(32/156): ceph-mgr-modules-core-19.0.0-3588.ge2 2.3 MB/s | 274 kB 00:00 2024-05-14T15:01:56.558 INFO:teuthology.orchestra.run.smithi069.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 333 kB/s | 192 kB 00:00 2024-05-14T15:01:56.560 INFO:teuthology.orchestra.run.smithi203.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-05-14T15:01:56.578 INFO:teuthology.orchestra.run.smithi092.stdout:(33/156): ceph-mgr-rook-19.0.0-3588.ge2b755a6.e 666 kB/s | 49 kB 00:00 2024-05-14T15:01:56.602 INFO:teuthology.orchestra.run.smithi203.stdout:(60/156): libtool-2.4.6-45.el9.x86_64.rpm 3.4 MB/s | 582 kB 00:00 2024-05-14T15:01:56.628 INFO:teuthology.orchestra.run.smithi203.stdout:(61/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 381 kB/s | 25 kB 00:00 2024-05-14T15:01:56.654 INFO:teuthology.orchestra.run.smithi092.stdout:(34/156): ceph-prometheus-alerts-19.0.0-3588.ge 221 kB/s | 16 kB 00:00 2024-05-14T15:01:56.686 INFO:teuthology.orchestra.run.smithi203.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 572 kB/s | 47 kB 00:00 2024-05-14T15:01:56.720 INFO:teuthology.orchestra.run.smithi203.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-05-14T15:01:56.741 INFO:teuthology.orchestra.run.smithi069.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 434 kB/s | 427 kB 00:00 2024-05-14T15:01:56.770 INFO:teuthology.orchestra.run.smithi203.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-05-14T15:01:56.795 INFO:teuthology.orchestra.run.smithi092.stdout:(35/156): ceph-volume-19.0.0-3588.ge2b755a6.el9 1.9 MB/s | 273 kB 00:00 2024-05-14T15:01:56.796 INFO:teuthology.orchestra.run.smithi203.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 471 kB/s | 35 kB 00:00 2024-05-14T15:01:56.905 INFO:teuthology.orchestra.run.smithi203.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-05-14T15:01:56.933 INFO:teuthology.orchestra.run.smithi069.stdout:(148/156): librados2-19.0.0-3588.ge2b755a6.el9. 8.9 MB/s | 3.3 MB 00:00 2024-05-14T15:01:57.037 INFO:teuthology.orchestra.run.smithi092.stdout:(36/156): cephadm-19.0.0-3588.ge2b755a6.el9.noa 3.1 MB/s | 763 kB 00:00 2024-05-14T15:01:57.147 INFO:teuthology.orchestra.run.smithi203.stdout:(67/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-05-14T15:01:57.150 INFO:teuthology.orchestra.run.smithi069.stdout:(149/156): librbd1-19.0.0-3588.ge2b755a6.el9.x8 7.6 MB/s | 3.1 MB 00:00 2024-05-14T15:01:57.272 INFO:teuthology.orchestra.run.smithi203.stdout:(68/156): openblas-openmp-0.3.21-2.el9.x86_64.r 9.5 MB/s | 4.7 MB 00:00 2024-05-14T15:01:57.317 INFO:teuthology.orchestra.run.smithi069.stdout:(150/156): thrift-0.15.0-2.el9.x86_64.rpm 1.5 MB/s | 1.6 MB 00:01 2024-05-14T15:01:57.331 INFO:teuthology.orchestra.run.smithi203.stdout:(69/156): postgresql-13.14-1.el9.x86_64.rpm 3.7 MB/s | 1.6 MB 00:00 2024-05-14T15:01:57.364 INFO:teuthology.orchestra.run.smithi203.stdout:(70/156): postgresql-private-libs-13.14-1.el9.x 1.4 MB/s | 133 kB 00:00 2024-05-14T15:01:57.415 INFO:teuthology.orchestra.run.smithi203.stdout:(71/156): postgresql-contrib-13.14-1.el9.x86_64 3.3 MB/s | 911 kB 00:00 2024-05-14T15:01:57.442 INFO:teuthology.orchestra.run.smithi069.stdout:(151/156): NetworkManager-1.47.90-1.el9.x86_64. 4.5 MB/s | 2.3 MB 00:00 2024-05-14T15:01:57.490 INFO:teuthology.orchestra.run.smithi203.stdout:(72/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.2 MB/s | 87 kB 00:00 2024-05-14T15:01:57.501 INFO:teuthology.orchestra.run.smithi069.stdout:(152/156): NetworkManager-team-1.47.90-1.el9.x8 227 kB/s | 41 kB 00:00 2024-05-14T15:01:57.513 INFO:teuthology.orchestra.run.smithi092.stdout:(37/156): ceph-test-19.0.0-3588.ge2b755a6.el9.x 9.0 MB/s | 43 MB 00:04 2024-05-14T15:01:57.534 INFO:teuthology.orchestra.run.smithi069.stdout:(153/156): NetworkManager-tui-1.47.90-1.el9.x86 2.7 MB/s | 248 kB 00:00 2024-05-14T15:01:57.538 INFO:teuthology.orchestra.run.smithi092.stdout:(38/156): cephfs-top-19.0.0-3588.ge2b755a6.el9. 36 kB/s | 18 kB 00:00 2024-05-14T15:01:57.540 INFO:teuthology.orchestra.run.smithi203.stdout:(73/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.8 MB/s | 1.0 MB 00:00 2024-05-14T15:01:57.641 INFO:teuthology.orchestra.run.smithi203.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-05-14T15:01:57.647 INFO:teuthology.orchestra.run.smithi092.stdout:(39/156): fuse-2.9.9-15.el9.x86_64.rpm 607 kB/s | 80 kB 00:00 2024-05-14T15:01:57.766 INFO:teuthology.orchestra.run.smithi203.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 1.9 MB/s | 248 kB 00:00 2024-05-14T15:01:57.772 INFO:teuthology.orchestra.run.smithi092.stdout:(40/156): libgfortran-11.4.1-3.el9.x86_64.rpm 3.4 MB/s | 803 kB 00:00 2024-05-14T15:01:57.793 INFO:teuthology.orchestra.run.smithi069.stdout:(154/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 9.3 MB/s | 2.4 MB 00:00 2024-05-14T15:01:57.805 INFO:teuthology.orchestra.run.smithi092.stdout:(41/156): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-05-14T15:01:57.839 INFO:teuthology.orchestra.run.smithi092.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.7 MB/s | 253 kB 00:00 2024-05-14T15:01:57.850 INFO:teuthology.orchestra.run.smithi203.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 310 kB/s | 26 kB 00:00 2024-05-14T15:01:57.851 INFO:teuthology.orchestra.run.smithi069.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 3.9 MB/s | 1.3 MB 00:00 2024-05-14T15:01:57.889 INFO:teuthology.orchestra.run.smithi092.stdout:(43/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-05-14T15:01:57.908 INFO:teuthology.orchestra.run.smithi203.stdout:(77/156): python3-jsonpointer-2.0-4.el9.noarch. 333 kB/s | 19 kB 00:00 2024-05-14T15:01:57.918 INFO:teuthology.orchestra.run.smithi069.stdout:(156/156): NetworkManager-libnm-1.47.90-1.el9.x 2.4 MB/s | 1.8 MB 00:00 2024-05-14T15:01:57.924 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-05-14T15:01:57.925 INFO:teuthology.orchestra.run.smithi069.stdout:Total 11 MB/s | 219 MB 00:20 2024-05-14T15:01:57.948 INFO:teuthology.orchestra.run.smithi092.stdout:(44/156): python3-cryptography-36.0.1-4.el9.x86 8.7 MB/s | 1.2 MB 00:00 2024-05-14T15:01:58.059 INFO:teuthology.orchestra.run.smithi203.stdout:(78/156): python3-babel-2.9.1-2.el9.noarch.rpm 11 MB/s | 6.0 MB 00:00 2024-05-14T15:01:58.073 INFO:teuthology.orchestra.run.smithi092.stdout:(45/156): ceph-mgr-diskprediction-local-19.0.0- 3.2 MB/s | 7.4 MB 00:02 2024-05-14T15:01:58.092 INFO:teuthology.orchestra.run.smithi203.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 941 kB/s | 172 kB 00:00 2024-05-14T15:01:58.099 INFO:teuthology.orchestra.run.smithi092.stdout:(46/156): python3-pycparser-2.20-6.el9.noarch.r 650 kB/s | 135 kB 00:00 2024-05-14T15:01:58.118 INFO:teuthology.orchestra.run.smithi203.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 602 kB/s | 35 kB 00:00 2024-05-14T15:01:58.124 INFO:teuthology.orchestra.run.smithi092.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 715 kB/s | 125 kB 00:00 2024-05-14T15:01:58.185 INFO:teuthology.orchestra.run.smithi203.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.7 MB/s | 250 kB 00:00 2024-05-14T15:01:58.224 INFO:teuthology.orchestra.run.smithi092.stdout:(48/156): python3-urllib3-1.26.5-5.el9.noarch.r 1.4 MB/s | 215 kB 00:00 2024-05-14T15:01:58.260 INFO:teuthology.orchestra.run.smithi203.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-05-14T15:01:58.336 INFO:teuthology.orchestra.run.smithi203.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 1.0 MB/s | 77 kB 00:00 2024-05-14T15:01:58.416 INFO:teuthology.orchestra.run.smithi092.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 560 kB/s | 107 kB 00:00 2024-05-14T15:01:58.491 INFO:teuthology.orchestra.run.smithi092.stdout:(50/156): elfutils-libelf-devel-0.190-2.el9.x86 290 kB/s | 21 kB 00:00 2024-05-14T15:01:58.526 INFO:teuthology.orchestra.run.smithi092.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 1.6 MB/s | 689 kB 00:00 2024-05-14T15:01:58.544 INFO:teuthology.orchestra.run.smithi203.stdout:(84/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 11 MB/s | 5.1 MB 00:00 2024-05-14T15:01:58.562 INFO:teuthology.orchestra.run.smithi203.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 188 kB/s | 42 kB 00:00 2024-05-14T15:01:58.592 INFO:teuthology.orchestra.run.smithi092.stdout:(52/156): flexiblas-3.0.4-8.el9.x86_64.rpm 497 kB/s | 33 kB 00:00 2024-05-14T15:01:58.629 INFO:teuthology.orchestra.run.smithi203.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 3.2 MB/s | 269 kB 00:00 2024-05-14T15:01:58.662 INFO:teuthology.orchestra.run.smithi203.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.6 MB/s | 159 kB 00:00 2024-05-14T15:01:58.667 INFO:teuthology.orchestra.run.smithi092.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 1.7 MB/s | 313 kB 00:00 2024-05-14T15:01:58.718 INFO:teuthology.orchestra.run.smithi092.stdout:(54/156): bison-3.7.4-5.el9.x86_64.rpm 1.6 MB/s | 943 kB 00:00 2024-05-14T15:01:58.746 INFO:teuthology.orchestra.run.smithi203.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-05-14T15:01:58.759 INFO:teuthology.orchestra.run.smithi092.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 200 kB/s | 18 kB 00:00 2024-05-14T15:01:58.802 INFO:teuthology.orchestra.run.smithi092.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 134 kB/s | 11 kB 00:00 2024-05-14T15:01:58.846 INFO:teuthology.orchestra.run.smithi203.stdout:(89/156): python3-requests-oauthlib-1.3.0-12.el 537 kB/s | 54 kB 00:00 2024-05-14T15:01:58.902 INFO:teuthology.orchestra.run.smithi092.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 456 kB/s | 45 kB 00:00 2024-05-14T15:01:59.069 INFO:teuthology.orchestra.run.smithi092.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 520 kB/s | 160 kB 00:00 2024-05-14T15:01:59.080 INFO:teuthology.orchestra.run.smithi203.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 122 kB/s | 51 kB 00:00 2024-05-14T15:01:59.147 INFO:teuthology.orchestra.run.smithi203.stdout:(91/156): python3-toml-0.10.2-6.el9.noarch.rpm 633 kB/s | 42 kB 00:00 2024-05-14T15:01:59.311 INFO:teuthology.orchestra.run.smithi092.stdout:(59/156): librdkafka-1.6.1-102.el9.x86_64.rpm 1.6 MB/s | 662 kB 00:00 2024-05-14T15:01:59.339 INFO:teuthology.orchestra.run.smithi203.stdout:(92/156): postgresql-server-13.14-1.el9.x86_64. 2.9 MB/s | 5.8 MB 00:02 2024-05-14T15:01:59.369 INFO:teuthology.orchestra.run.smithi092.stdout:(60/156): libuuid-devel-2.37.4-18.el9.x86_64.rp 444 kB/s | 25 kB 00:00 2024-05-14T15:01:59.381 INFO:teuthology.orchestra.run.smithi203.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 190 kB/s | 44 kB 00:00 2024-05-14T15:01:59.428 INFO:teuthology.orchestra.run.smithi092.stdout:(61/156): libtool-2.4.6-45.el9.x86_64.rpm 1.6 MB/s | 582 kB 00:00 2024-05-14T15:01:59.453 INFO:teuthology.orchestra.run.smithi092.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 569 kB/s | 47 kB 00:00 2024-05-14T15:01:59.456 INFO:teuthology.orchestra.run.smithi203.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 1.9 MB/s | 221 kB 00:00 2024-05-14T15:01:59.482 INFO:teuthology.orchestra.run.smithi203.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 362 kB/s | 36 kB 00:00 2024-05-14T15:01:59.549 INFO:teuthology.orchestra.run.smithi203.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 724 kB/s | 47 kB 00:00 2024-05-14T15:01:59.553 INFO:teuthology.orchestra.run.smithi092.stdout:(63/156): lua-5.4.4-4.el9.x86_64.rpm 1.9 MB/s | 188 kB 00:00 2024-05-14T15:01:59.582 INFO:teuthology.orchestra.run.smithi203.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 3.0 MB/s | 305 kB 00:00 2024-05-14T15:01:59.587 INFO:teuthology.orchestra.run.smithi092.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-05-14T15:01:59.621 INFO:teuthology.orchestra.run.smithi092.stdout:(65/156): openblas-0.3.21-2.el9.x86_64.rpm 533 kB/s | 35 kB 00:00 2024-05-14T15:01:59.625 INFO:teuthology.orchestra.run.smithi203.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 772 kB/s | 58 kB 00:00 2024-05-14T15:01:59.658 INFO:teuthology.orchestra.run.smithi203.stdout:(99/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rpm 1.2 MB/s | 94 kB 00:00 2024-05-14T15:01:59.692 INFO:teuthology.orchestra.run.smithi203.stdout:(100/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 971 kB/s | 64 kB 00:00 2024-05-14T15:01:59.726 INFO:teuthology.orchestra.run.smithi203.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 678 kB/s | 45 kB 00:00 2024-05-14T15:01:59.880 INFO:teuthology.orchestra.run.smithi092.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 2.3 MB/s | 3.0 MB 00:01 2024-05-14T15:02:00.026 INFO:teuthology.orchestra.run.smithi203.stdout:(102/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 14 MB/s | 16 MB 00:01 2024-05-14T15:02:00.218 INFO:teuthology.orchestra.run.smithi203.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 42 kB/s | 22 kB 00:00 2024-05-14T15:02:00.288 INFO:teuthology.orchestra.run.smithi092.stdout:(67/156): postgresql-13.14-1.el9.x86_64.rpm 3.9 MB/s | 1.6 MB 00:00 2024-05-14T15:02:00.318 INFO:teuthology.orchestra.run.smithi203.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 1.8 MB/s | 548 kB 00:00 2024-05-14T15:02:00.368 INFO:teuthology.orchestra.run.smithi203.stdout:(105/156): grpc-data-1.46.7-10.el9.noarch.rpm 394 kB/s | 19 kB 00:00 2024-05-14T15:02:00.418 INFO:teuthology.orchestra.run.smithi203.stdout:(106/156): gperftools-libs-2.9.1-2.el9.x86_64.r 1.5 MB/s | 309 kB 00:00 2024-05-14T15:02:00.469 INFO:teuthology.orchestra.run.smithi203.stdout:(107/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 528 kB/s | 26 kB 00:00 2024-05-14T15:02:00.488 INFO:teuthology.orchestra.run.smithi092.stdout:(68/156): postgresql-contrib-13.14-1.el9.x86_64 4.5 MB/s | 911 kB 00:00 2024-05-14T15:02:00.547 INFO:teuthology.orchestra.run.smithi092.stdout:(69/156): postgresql-private-libs-13.14-1.el9.x 2.3 MB/s | 133 kB 00:00 2024-05-14T15:02:00.552 INFO:teuthology.orchestra.run.smithi203.stdout:(108/156): liboath-2.6.7-2.el9.x86_64.rpm 588 kB/s | 49 kB 00:00 2024-05-14T15:02:00.611 INFO:teuthology.orchestra.run.smithi203.stdout:(109/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.1 MB/s | 67 kB 00:00 2024-05-14T15:02:00.678 INFO:teuthology.orchestra.run.smithi203.stdout:(110/156): luarocks-3.9.2-1.el9.noarch.rpm 2.2 MB/s | 151 kB 00:00 2024-05-14T15:02:00.745 INFO:teuthology.orchestra.run.smithi203.stdout:(111/156): protobuf-compiler-3.14.0-13.el9.x86_ 847 kB/s | 863 kB 00:01 2024-05-14T15:02:00.856 INFO:teuthology.orchestra.run.smithi092.stdout:(70/156): openssl-devel-3.2.1-1.el9.x86_64.rpm 3.6 MB/s | 4.4 MB 00:01 2024-05-14T15:02:00.879 INFO:teuthology.orchestra.run.smithi203.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 4.1 MB/s | 839 kB 00:00 2024-05-14T15:02:00.929 INFO:teuthology.orchestra.run.smithi203.stdout:(113/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 874 kB/s | 43 kB 00:00 2024-05-14T15:02:00.933 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction check 2024-05-14T15:02:00.971 INFO:teuthology.orchestra.run.smithi203.stdout:(114/156): python3-cachetools-4.2.4-1.el9.noarc 782 kB/s | 32 kB 00:00 2024-05-14T15:02:01.014 INFO:teuthology.orchestra.run.smithi203.stdout:(115/156): python3-asyncssh-2.13.2-5.el9.noarch 2.0 MB/s | 548 kB 00:00 2024-05-14T15:02:01.039 INFO:teuthology.orchestra.run.smithi203.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 226 kB/s | 15 kB 00:00 2024-05-14T15:02:01.089 INFO:teuthology.orchestra.run.smithi092.stdout:(71/156): openblas-openmp-0.3.21-2.el9.x86_64.r 3.2 MB/s | 4.7 MB 00:01 2024-05-14T15:02:01.089 INFO:teuthology.orchestra.run.smithi203.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 2.3 MB/s | 172 kB 00:00 2024-05-14T15:02:01.139 INFO:teuthology.orchestra.run.smithi092.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 3.6 MB/s | 1.0 MB 00:00 2024-05-14T15:02:01.148 INFO:teuthology.orchestra.run.smithi203.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2024-05-14T15:02:01.164 INFO:teuthology.orchestra.run.smithi092.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.1 MB/s | 87 kB 00:00 2024-05-14T15:02:01.176 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction check succeeded. 2024-05-14T15:02:01.176 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction test 2024-05-14T15:02:01.198 INFO:teuthology.orchestra.run.smithi203.stdout:(119/156): python3-colorama-0.4.4-12.el9.noarch 717 kB/s | 35 kB 00:00 2024-05-14T15:02:01.240 INFO:teuthology.orchestra.run.smithi203.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.0 MB/s | 303 kB 00:00 2024-05-14T15:02:01.248 INFO:teuthology.orchestra.run.smithi092.stdout:(74/156): python3-devel-3.9.18-3.el9.x86_64.rpm 2.9 MB/s | 244 kB 00:00 2024-05-14T15:02:01.340 INFO:teuthology.orchestra.run.smithi092.stdout:(75/156): python3-jinja2-2.11.3-5.el9.noarch.rp 2.7 MB/s | 248 kB 00:00 2024-05-14T15:02:01.358 INFO:teuthology.orchestra.run.smithi203.stdout:(121/156): libarrow-9.0.0-11.el9.x86_64.rpm 4.5 MB/s | 4.4 MB 00:00 2024-05-14T15:02:01.391 INFO:teuthology.orchestra.run.smithi203.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 1.0 MB/s | 206 kB 00:00 2024-05-14T15:02:01.399 INFO:teuthology.orchestra.run.smithi092.stdout:(76/156): python3-jsonpatch-1.21-16.el9.noarch. 445 kB/s | 26 kB 00:00 2024-05-14T15:02:01.424 INFO:teuthology.orchestra.run.smithi203.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 2.1 MB/s | 144 kB 00:00 2024-05-14T15:02:01.450 INFO:teuthology.orchestra.run.smithi203.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 185 kB/s | 11 kB 00:00 2024-05-14T15:02:01.475 INFO:teuthology.orchestra.run.smithi203.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 356 kB/s | 18 kB 00:00 2024-05-14T15:02:01.501 INFO:teuthology.orchestra.run.smithi203.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 468 kB/s | 23 kB 00:00 2024-05-14T15:02:01.507 INFO:teuthology.orchestra.run.smithi092.stdout:(77/156): postgresql-server-13.14-1.el9.x86_64. 6.0 MB/s | 5.8 MB 00:00 2024-05-14T15:02:01.526 INFO:teuthology.orchestra.run.smithi203.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 392 kB/s | 19 kB 00:00 2024-05-14T15:02:01.532 INFO:teuthology.orchestra.run.smithi092.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 144 kB/s | 19 kB 00:00 2024-05-14T15:02:01.551 INFO:teuthology.orchestra.run.smithi203.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 397 kB/s | 20 kB 00:00 2024-05-14T15:02:01.575 INFO:teuthology.orchestra.run.smithi092.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.5 MB/s | 172 kB 00:00 2024-05-14T15:02:01.593 INFO:teuthology.orchestra.run.smithi203.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.1 MB/s | 46 kB 00:00 2024-05-14T15:02:01.600 INFO:teuthology.orchestra.run.smithi092.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 524 kB/s | 35 kB 00:00 2024-05-14T15:02:01.684 INFO:teuthology.orchestra.run.smithi092.stdout:(81/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 3.0 MB/s | 250 kB 00:00 2024-05-14T15:02:01.692 INFO:teuthology.orchestra.run.smithi203.stdout:(130/156): python3-grpcio-1.46.7-10.el9.x86_64. 4.5 MB/s | 2.0 MB 00:00 2024-05-14T15:02:01.719 INFO:teuthology.orchestra.run.smithi203.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 632 kB/s | 79 kB 00:00 2024-05-14T15:02:01.744 INFO:teuthology.orchestra.run.smithi203.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 1.1 MB/s | 58 kB 00:00 2024-05-14T15:02:01.775 INFO:teuthology.orchestra.run.smithi092.stdout:(82/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.4 MB/s | 222 kB 00:00 2024-05-14T15:02:01.786 INFO:teuthology.orchestra.run.smithi203.stdout:(133/156): python3-kubernetes-26.1.0-2.el9.noar 3.9 MB/s | 1.0 MB 00:00 2024-05-14T15:02:01.812 INFO:teuthology.orchestra.run.smithi203.stdout:(134/156): python3-portend-3.1.0-2.el9.noarch.r 248 kB/s | 16 kB 00:00 2024-05-14T15:02:01.834 INFO:teuthology.orchestra.run.smithi092.stdout:(83/156): python3-packaging-20.9-5.el9.noarch.r 1.3 MB/s | 77 kB 00:00 2024-05-14T15:02:01.837 INFO:teuthology.orchestra.run.smithi203.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.8 MB/s | 90 kB 00:00 2024-05-14T15:02:01.862 INFO:teuthology.orchestra.run.smithi203.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 570 kB/s | 28 kB 00:00 2024-05-14T15:02:01.888 INFO:teuthology.orchestra.run.smithi203.stdout:(137/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-05-14T15:02:01.913 INFO:teuthology.orchestra.run.smithi203.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 409 kB/s | 31 kB 00:00 2024-05-14T15:02:01.918 INFO:teuthology.orchestra.run.smithi092.stdout:(84/156): python3-prettytable-0.7.2-27.el9.noar 513 kB/s | 42 kB 00:00 2024-05-14T15:02:01.938 INFO:teuthology.orchestra.run.smithi203.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.2 MB/s | 59 kB 00:00 2024-05-14T15:02:01.964 INFO:teuthology.orchestra.run.smithi203.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 724 kB/s | 36 kB 00:00 2024-05-14T15:02:01.989 INFO:teuthology.orchestra.run.smithi203.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 1.5 MB/s | 188 kB 00:00 2024-05-14T15:02:02.010 INFO:teuthology.orchestra.run.smithi092.stdout:(85/156): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-05-14T15:02:02.014 INFO:teuthology.orchestra.run.smithi203.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 682 kB/s | 51 kB 00:00 2024-05-14T15:02:02.048 INFO:teuthology.orchestra.run.smithi203.stdout:(143/156): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-05-14T15:02:02.099 INFO:teuthology.orchestra.run.smithi203.stdout:(144/156): python3-websocket-client-1.2.3-2.el9 1.1 MB/s | 90 kB 00:00 2024-05-14T15:02:02.115 INFO:teuthology.orchestra.run.smithi203.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 302 kB/s | 20 kB 00:00 2024-05-14T15:02:02.118 INFO:teuthology.orchestra.run.smithi092.stdout:(86/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 9.4 MB/s | 5.1 MB 00:00 2024-05-14T15:02:02.144 INFO:teuthology.orchestra.run.smithi092.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.2 MB/s | 159 kB 00:00 2024-05-14T15:02:02.149 INFO:teuthology.orchestra.run.smithi203.stdout:(146/156): re2-20211101-3.el9.x86_64.rpm 3.8 MB/s | 192 kB 00:00 2024-05-14T15:02:02.186 INFO:teuthology.orchestra.run.smithi092.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 279 kB 00:00 2024-05-14T15:02:02.199 INFO:teuthology.orchestra.run.smithi203.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.3 MB/s | 427 kB 00:00 2024-05-14T15:02:02.211 INFO:teuthology.orchestra.run.smithi092.stdout:(89/156): python3-pytz-2021.1-5.el9.noarch.rpm 766 kB/s | 51 kB 00:00 2024-05-14T15:02:02.236 INFO:teuthology.orchestra.run.smithi092.stdout:(90/156): python3-requests-oauthlib-1.3.0-12.el 1.1 MB/s | 54 kB 00:00 2024-05-14T15:02:02.317 INFO:teuthology.orchestra.run.smithi203.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 7.9 MB/s | 1.6 MB 00:00 2024-05-14T15:02:02.345 INFO:teuthology.orchestra.run.smithi092.stdout:(91/156): python3-babel-2.9.1-2.el9.noarch.rpm 4.9 MB/s | 6.0 MB 00:01 2024-05-14T15:02:02.362 INFO:teuthology.orchestra.run.smithi092.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 334 kB/s | 42 kB 00:00 2024-05-14T15:02:02.396 INFO:teuthology.orchestra.run.smithi092.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 896 kB/s | 44 kB 00:00 2024-05-14T15:02:02.429 INFO:teuthology.orchestra.run.smithi092.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.3 MB/s | 221 kB 00:00 2024-05-14T15:02:02.454 INFO:teuthology.orchestra.run.smithi092.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 621 kB/s | 36 kB 00:00 2024-05-14T15:02:02.488 INFO:teuthology.orchestra.run.smithi092.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 822 kB/s | 47 kB 00:00 2024-05-14T15:02:02.547 INFO:teuthology.orchestra.run.smithi092.stdout:(97/156): socat-1.7.4.1-5.el9.x86_64.rpm 3.3 MB/s | 305 kB 00:00 2024-05-14T15:02:02.572 INFO:teuthology.orchestra.run.smithi092.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 699 kB/s | 58 kB 00:00 2024-05-14T15:02:02.631 INFO:teuthology.orchestra.run.smithi092.stdout:(99/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-05-14T15:02:02.664 INFO:teuthology.orchestra.run.smithi092.stdout:(100/156): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.0 MB/s | 94 kB 00:00 2024-05-14T15:02:02.667 INFO:teuthology.orchestra.run.smithi203.stdout:(149/156): librados2-19.0.0-3588.ge2b755a6.el9. 6.4 MB/s | 3.3 MB 00:00 2024-05-14T15:02:02.698 INFO:teuthology.orchestra.run.smithi092.stdout:(101/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 678 kB/s | 45 kB 00:00 2024-05-14T15:02:02.800 INFO:teuthology.orchestra.run.smithi203.stdout:(150/156): librbd1-19.0.0-3588.ge2b755a6.el9.x8 5.2 MB/s | 3.1 MB 00:00 2024-05-14T15:02:03.281 INFO:teuthology.orchestra.run.smithi092.stdout:(102/156): lua-devel-5.4.4-4.el9.x86_64.rpm 36 kB/s | 22 kB 00:00 2024-05-14T15:02:03.534 INFO:teuthology.orchestra.run.smithi203.stdout:(151/156): NetworkManager-1.47.90-1.el9.x86_64. 1.9 MB/s | 2.3 MB 00:01 2024-05-14T15:02:03.643 INFO:teuthology.orchestra.run.smithi203.stdout:(152/156): NetworkManager-team-1.47.90-1.el9.x8 49 kB/s | 41 kB 00:00 2024-05-14T15:02:03.748 INFO:teuthology.orchestra.run.smithi092.stdout:(103/156): protobuf-compiler-3.14.0-13.el9.x86_ 822 kB/s | 863 kB 00:01 2024-05-14T15:02:03.990 INFO:teuthology.orchestra.run.smithi092.stdout:(104/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 9.1 MB/s | 16 MB 00:01 2024-05-14T15:02:04.020 INFO:teuthology.orchestra.run.smithi069.stdout:Transaction test succeeded. 2024-05-14T15:02:04.021 INFO:teuthology.orchestra.run.smithi069.stdout:Running transaction 2024-05-14T15:02:04.035 INFO:teuthology.orchestra.run.smithi203.stdout:(153/156): NetworkManager-libnm-1.47.90-1.el9.x 1.3 MB/s | 1.8 MB 00:01 2024-05-14T15:02:04.174 INFO:teuthology.orchestra.run.smithi092.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 615 kB/s | 548 kB 00:00 2024-05-14T15:02:04.299 INFO:teuthology.orchestra.run.smithi092.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 63 kB/s | 19 kB 00:00 2024-05-14T15:02:04.441 INFO:teuthology.orchestra.run.smithi092.stdout:(107/156): gperftools-libs-2.9.1-2.el9.x86_64.r 447 kB/s | 309 kB 00:00 2024-05-14T15:02:04.460 INFO:teuthology.orchestra.run.smithi203.stdout:(154/156): NetworkManager-tui-1.47.90-1.el9.x86 268 kB/s | 248 kB 00:00 2024-05-14T15:02:04.466 INFO:teuthology.orchestra.run.smithi092.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 156 kB/s | 26 kB 00:00 2024-05-14T15:02:04.558 INFO:teuthology.orchestra.run.smithi092.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 418 kB/s | 49 kB 00:00 2024-05-14T15:02:04.810 INFO:teuthology.orchestra.run.smithi203.stdout:(155/156): openssl-3.2.1-1.el9.x86_64.rpm 1.2 MB/s | 1.3 MB 00:01 2024-05-14T15:02:04.950 INFO:teuthology.orchestra.run.smithi092.stdout:(110/156): libarrow-9.0.0-11.el9.x86_64.rpm 5.7 MB/s | 4.4 MB 00:00 2024-05-14T15:02:04.992 INFO:teuthology.orchestra.run.smithi092.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 128 kB/s | 67 kB 00:00 2024-05-14T15:02:05.017 INFO:teuthology.orchestra.run.smithi092.stdout:(112/156): luarocks-3.9.2-1.el9.noarch.rpm 330 kB/s | 151 kB 00:00 2024-05-14T15:02:05.159 INFO:teuthology.orchestra.run.smithi092.stdout:(113/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.9 MB/s | 839 kB 00:00 2024-05-14T15:02:05.184 INFO:teuthology.orchestra.run.smithi092.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 261 kB/s | 43 kB 00:00 2024-05-14T15:02:05.219 INFO:teuthology.orchestra.run.smithi203.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 2.0 MB/s | 2.4 MB 00:01 2024-05-14T15:02:05.226 INFO:teuthology.orchestra.run.smithi203.stdout:-------------------------------------------------------------------------------- 2024-05-14T15:02:05.226 INFO:teuthology.orchestra.run.smithi203.stdout:Total 10 MB/s | 219 MB 00:20 2024-05-14T15:02:05.260 INFO:teuthology.orchestra.run.smithi092.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 323 kB/s | 32 kB 00:00 2024-05-14T15:02:05.285 INFO:teuthology.orchestra.run.smithi092.stdout:(116/156): python3-certifi-2021.10.8-2.el9.noar 150 kB/s | 15 kB 00:00 2024-05-14T15:02:05.360 INFO:teuthology.orchestra.run.smithi092.stdout:(117/156): python3-asyncssh-2.13.2-5.el9.noarch 1.5 MB/s | 548 kB 00:00 2024-05-14T15:02:05.486 INFO:teuthology.orchestra.run.smithi092.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 764 kB/s | 172 kB 00:00 2024-05-14T15:02:05.686 INFO:teuthology.orchestra.run.smithi092.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 933 kB/s | 303 kB 00:00 2024-05-14T15:02:05.728 INFO:teuthology.orchestra.run.smithi092.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 811 kB/s | 358 kB 00:00 2024-05-14T15:02:05.753 INFO:teuthology.orchestra.run.smithi092.stdout:(121/156): python3-colorama-0.4.4-12.el9.noarch 132 kB/s | 35 kB 00:00 2024-05-14T15:02:05.812 INFO:teuthology.orchestra.run.smithi092.stdout:(122/156): python3-google-auth-2.29.0-1.el9.noa 1.6 MB/s | 206 kB 00:00 2024-05-14T15:02:06.071 INFO:teuthology.orchestra.run.smithi092.stdout:(123/156): python3-grpcio-tools-1.46.7-10.el9.x 456 kB/s | 144 kB 00:00 2024-05-14T15:02:06.096 INFO:teuthology.orchestra.run.smithi092.stdout:(124/156): python3-jaraco-8.2.1-3.el9.noarch.rp 38 kB/s | 11 kB 00:00 2024-05-14T15:02:06.163 INFO:teuthology.orchestra.run.smithi092.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 194 kB/s | 18 kB 00:00 2024-05-14T15:02:06.205 INFO:teuthology.orchestra.run.smithi092.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 214 kB/s | 23 kB 00:00 2024-05-14T15:02:06.264 INFO:teuthology.orchestra.run.smithi092.stdout:(127/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.8 MB/s | 2.0 MB 00:00 2024-05-14T15:02:06.289 INFO:teuthology.orchestra.run.smithi092.stdout:(128/156): python3-jaraco-functools-3.5.0-2.el9 155 kB/s | 19 kB 00:00 2024-05-14T15:02:06.314 INFO:teuthology.orchestra.run.smithi092.stdout:(129/156): python3-jaraco-text-3.2.0-6.el9.noar 182 kB/s | 20 kB 00:00 2024-05-14T15:02:06.406 INFO:teuthology.orchestra.run.smithi092.stdout:(130/156): python3-kubernetes-26.1.0-2.el9.noar 7.2 MB/s | 1.0 MB 00:00 2024-05-14T15:02:06.423 INFO:teuthology.orchestra.run.smithi092.stdout:(131/156): python3-logutils-0.3.5-21.el9.noarch 348 kB/s | 46 kB 00:00 2024-05-14T15:02:06.457 INFO:teuthology.orchestra.run.smithi092.stdout:(132/156): python3-more-itertools-8.12.0-2.el9. 556 kB/s | 79 kB 00:00 2024-05-14T15:02:06.498 INFO:teuthology.orchestra.run.smithi092.stdout:(133/156): python3-natsort-7.1.1-5.el9.noarch.r 632 kB/s | 58 kB 00:00 2024-05-14T15:02:06.824 INFO:teuthology.orchestra.run.smithi092.stdout:(134/156): python3-pecan-1.4.2-3.el9.noarch.rpm 681 kB/s | 272 kB 00:00 2024-05-14T15:02:06.849 INFO:teuthology.orchestra.run.smithi092.stdout:(135/156): python3-portend-3.1.0-2.el9.noarch.r 42 kB/s | 16 kB 00:00 2024-05-14T15:02:06.893 INFO:teuthology.orchestra.run.smithi092.stdout:(136/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 228 kB/s | 90 kB 00:00 2024-05-14T15:02:06.966 INFO:teuthology.orchestra.run.smithi092.stdout:(137/156): python3-pyperclip-1.8.2-2.el9.noarch 200 kB/s | 28 kB 00:00 2024-05-14T15:02:07.000 INFO:teuthology.orchestra.run.smithi092.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 205 kB/s | 31 kB 00:00 2024-05-14T15:02:07.317 INFO:teuthology.orchestra.run.smithi092.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 169 kB/s | 59 kB 00:00 2024-05-14T15:02:07.342 INFO:teuthology.orchestra.run.smithi092.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 105 kB/s | 36 kB 00:00 2024-05-14T15:02:07.367 INFO:teuthology.orchestra.run.smithi092.stdout:(141/156): python3-routes-2.5.1-5.el9.noarch.rp 398 kB/s | 188 kB 00:00 2024-05-14T15:02:07.409 INFO:teuthology.orchestra.run.smithi092.stdout:(142/156): python3-typing-extensions-4.4.0-2.el 558 kB/s | 51 kB 00:00 2024-05-14T15:02:07.476 INFO:teuthology.orchestra.run.smithi092.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 829 kB/s | 90 kB 00:00 2024-05-14T15:02:07.518 INFO:teuthology.orchestra.run.smithi092.stdout:(144/156): python3-webob-1.8.7-6.el9.noarch.rpm 1.3 MB/s | 230 kB 00:00 2024-05-14T15:02:07.552 INFO:teuthology.orchestra.run.smithi092.stdout:(145/156): python3-werkzeug-2.0.3-3.el9.1.noarc 2.9 MB/s | 427 kB 00:00 2024-05-14T15:02:07.644 INFO:teuthology.orchestra.run.smithi092.stdout:(146/156): python3-zc-lockfile-2.0-10.el9.noarc 120 kB/s | 20 kB 00:00 2024-05-14T15:02:07.694 INFO:teuthology.orchestra.run.smithi092.stdout:(147/156): re2-20211101-3.el9.x86_64.rpm 1.1 MB/s | 192 kB 00:00 2024-05-14T15:02:07.870 INFO:teuthology.orchestra.run.smithi092.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2024-05-14T15:02:08.112 INFO:teuthology.orchestra.run.smithi092.stdout:(149/156): NetworkManager-1.47.90-1.el9.x86_64. 9.6 MB/s | 2.3 MB 00:00 2024-05-14T15:02:08.214 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction check 2024-05-14T15:02:08.220 INFO:teuthology.orchestra.run.smithi092.stdout:(150/156): NetworkManager-libnm-1.47.90-1.el9.x 17 MB/s | 1.8 MB 00:00 2024-05-14T15:02:08.270 INFO:teuthology.orchestra.run.smithi092.stdout:(151/156): NetworkManager-team-1.47.90-1.el9.x8 846 kB/s | 41 kB 00:00 2024-05-14T15:02:08.329 INFO:teuthology.orchestra.run.smithi092.stdout:(152/156): NetworkManager-tui-1.47.90-1.el9.x86 4.2 MB/s | 248 kB 00:00 2024-05-14T15:02:08.446 INFO:teuthology.orchestra.run.smithi092.stdout:(153/156): librados2-19.0.0-3588.ge2b755a6.el9. 4.1 MB/s | 3.3 MB 00:00 2024-05-14T15:02:08.457 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction check succeeded. 2024-05-14T15:02:08.457 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction test 2024-05-14T15:02:08.505 INFO:teuthology.orchestra.run.smithi092.stdout:(154/156): openssl-3.2.1-1.el9.x86_64.rpm 7.7 MB/s | 1.3 MB 00:00 2024-05-14T15:02:08.821 INFO:teuthology.orchestra.run.smithi092.stdout:(155/156): librbd1-19.0.0-3588.ge2b755a6.el9.x8 2.7 MB/s | 3.1 MB 00:01 2024-05-14T15:02:09.205 INFO:teuthology.orchestra.run.smithi092.stdout:(156/156): openssl-libs-3.2.1-1.el9.x86_64.rpm 3.2 MB/s | 2.4 MB 00:00 2024-05-14T15:02:09.212 INFO:teuthology.orchestra.run.smithi092.stdout:-------------------------------------------------------------------------------- 2024-05-14T15:02:09.213 INFO:teuthology.orchestra.run.smithi092.stdout:Total 9.9 MB/s | 219 MB 00:22 2024-05-14T15:02:10.510 INFO:teuthology.orchestra.run.smithi069.stdout: Preparing : 1/1 2024-05-14T15:02:10.609 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-14T15:02:10.683 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-14T15:02:10.810 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-14T15:02:10.872 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-14T15:02:10.911 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-14T15:02:11.012 INFO:teuthology.orchestra.run.smithi203.stdout:Transaction test succeeded. 2024-05-14T15:02:11.012 INFO:teuthology.orchestra.run.smithi203.stdout:Running transaction 2024-05-14T15:02:11.015 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-14T15:02:11.461 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-14T15:02:11.567 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T15:02:11.762 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T15:02:11.793 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T15:02:11.920 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T15:02:11.998 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T15:02:12.179 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction check 2024-05-14T15:02:12.339 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-14T15:02:12.406 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-14T15:02:12.420 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction check succeeded. 2024-05-14T15:02:12.420 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction test 2024-05-14T15:02:12.430 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T15:02:12.563 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T15:02:12.590 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T15:02:12.692 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T15:02:12.724 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T15:02:12.779 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T15:02:13.030 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T15:02:13.252 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T15:02:13.464 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T15:02:13.543 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T15:02:13.688 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T15:02:13.809 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T15:02:14.101 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T15:02:14.297 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-14T15:02:14.330 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-14T15:02:14.383 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-14T15:02:14.487 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-14T15:02:14.544 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-14T15:02:14.608 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-14T15:02:14.665 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-14T15:02:14.704 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-14T15:02:14.822 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-14T15:02:14.894 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-14T15:02:14.940 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-14T15:02:14.996 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-14T15:02:15.101 INFO:teuthology.orchestra.run.smithi092.stdout:Transaction test succeeded. 2024-05-14T15:02:15.102 INFO:teuthology.orchestra.run.smithi092.stdout:Running transaction 2024-05-14T15:02:15.104 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-14T15:02:15.151 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 32/164 2024-05-14T15:02:15.200 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 33/164 2024-05-14T15:02:15.232 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 34/164 2024-05-14T15:02:15.349 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-14T15:02:15.402 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-14T15:02:15.503 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-14T15:02:15.679 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-14T15:02:15.755 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-14T15:02:16.432 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-14T15:02:16.536 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-14T15:02:16.581 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-14T15:02:16.634 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-14T15:02:16.676 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 44/164 2024-05-14T15:02:16.744 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-14T15:02:16.948 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-14T15:02:17.016 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-14T15:02:17.165 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-14T15:02:17.254 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-14T15:02:17.334 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-14T15:02:17.383 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-14T15:02:17.422 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-14T15:02:17.487 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-14T15:02:17.553 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-14T15:02:17.617 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-14T15:02:17.680 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-14T15:02:17.883 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-14T15:02:17.932 INFO:teuthology.orchestra.run.smithi203.stdout: Preparing : 1/1 2024-05-14T15:02:17.937 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-14T15:02:17.975 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-14T15:02:18.066 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-14T15:02:18.076 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-14T15:02:18.153 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-14T15:02:18.197 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-14T15:02:18.241 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-14T15:02:18.274 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-14T15:02:18.289 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-14T15:02:18.323 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-14T15:02:18.331 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-14T15:02:18.356 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-14T15:02:18.362 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-14T15:02:18.497 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-14T15:02:18.541 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-14T15:02:18.727 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-14T15:02:18.771 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-14T15:02:18.809 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-14T15:02:18.855 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-14T15:02:18.913 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-14T15:02:18.937 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-14T15:02:18.973 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-14T15:02:19.044 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T15:02:19.050 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-14T15:02:19.089 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-14T15:02:19.137 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-14T15:02:19.212 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-14T15:02:19.223 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T15:02:19.255 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T15:02:19.259 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-14T15:02:19.382 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T15:02:19.401 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-14T15:02:19.421 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T15:02:19.467 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-14T15:02:19.530 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-14T15:02:19.600 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-14T15:02:19.710 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-14T15:02:19.752 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-14T15:02:19.777 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-14T15:02:19.801 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T15:02:19.821 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-14T15:02:19.948 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T15:02:19.977 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T15:02:20.063 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T15:02:20.095 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T15:02:20.173 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T15:02:20.520 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T15:02:20.767 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-14T15:02:20.821 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-14T15:02:20.855 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-14T15:02:20.891 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T15:02:20.977 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-14T15:02:21.051 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T15:02:21.052 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-14T15:02:21.156 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T15:02:21.158 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-14T15:02:21.206 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-14T15:02:21.326 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T15:02:21.421 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T15:02:21.454 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-14T15:02:21.486 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-14T15:02:21.597 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-14T15:02:21.732 INFO:teuthology.orchestra.run.smithi092.stdout: Preparing : 1/1 2024-05-14T15:02:21.770 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T15:02:21.893 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : openssl-libs-1:3.2.1-1.el9.x86_64 1/164 2024-05-14T15:02:21.954 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-14T15:02:21.976 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-05-14T15:02:21.993 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-14T15:02:22.048 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-14T15:02:22.096 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-05-14T15:02:22.158 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-05-14T15:02:22.164 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-14T15:02:22.197 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-05-14T15:02:22.222 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-14T15:02:22.302 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-05-14T15:02:22.324 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-14T15:02:22.375 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-14T15:02:22.418 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-14T15:02:22.454 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-14T15:02:22.538 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-14T15:02:22.598 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-14T15:02:22.617 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-14T15:02:22.677 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-14T15:02:22.725 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-05-14T15:02:22.739 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-14T15:02:22.856 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-14T15:02:22.861 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T15:02:22.898 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 32/164 2024-05-14T15:02:22.958 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 33/164 2024-05-14T15:02:22.996 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 34/164 2024-05-14T15:02:23.049 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T15:02:23.079 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T15:02:23.140 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-14T15:02:23.199 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T15:02:23.211 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-14T15:02:23.236 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T15:02:23.319 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-14T15:02:23.492 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-14T15:02:23.534 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/164 2024-05-14T15:02:23.560 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-14T15:02:23.608 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-13.14-1.el9.x86_64 12/164 2024-05-14T15:02:23.658 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T15:02:23.824 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T15:02:23.851 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T15:02:23.936 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 14/164 2024-05-14T15:02:23.969 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T15:02:24.032 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-05-14T15:02:24.216 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-14T15:02:24.229 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-14T15:02:24.317 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-14T15:02:24.325 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T15:02:24.340 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-14T15:02:24.353 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-14T15:02:24.377 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-14T15:02:24.414 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-14T15:02:24.422 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-14T15:02:24.461 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 44/164 2024-05-14T15:02:24.520 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-14T15:02:24.633 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-05-14T15:02:24.769 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-14T15:02:24.810 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-14T15:02:24.825 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T15:02:24.831 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-14T15:02:24.877 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T15:02:24.913 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 17/164 2024-05-14T15:02:24.958 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-14T15:02:24.990 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T15:02:25.030 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/164 2024-05-14T15:02:25.035 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-14T15:02:25.077 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T15:02:25.088 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-14T15:02:25.122 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-14T15:02:25.164 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-14T15:02:25.177 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T15:02:25.203 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-14T15:02:25.268 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-14T15:02:25.312 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-14T15:02:25.393 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-14T15:02:25.460 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-14T15:02:25.498 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.47.90-1.el9.x86_64 18/164 2024-05-14T15:02:25.644 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-14T15:02:25.664 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-14T15:02:25.685 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T15:02:25.692 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : re2-1:20211101-3.el9.x86_64 19/164 2024-05-14T15:02:25.718 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-14T15:02:25.725 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-05-14T15:02:25.775 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T15:02:25.777 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : liboath-2.6.7-2.el9.x86_64 21/164 2024-05-14T15:02:25.780 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-14T15:02:25.803 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/164 2024-05-14T15:02:25.839 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-14T15:02:25.886 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 22/164 2024-05-14T15:02:25.929 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 23/164 2024-05-14T15:02:25.981 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-14T15:02:26.000 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 24/164 2024-05-14T15:02:26.022 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-14T15:02:26.050 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 25/164 2024-05-14T15:02:26.071 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-14T15:02:26.091 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-5.4.4-4.el9.x86_64 26/164 2024-05-14T15:02:26.104 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-14T15:02:26.162 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-14T15:02:26.208 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 27/164 2024-05-14T15:02:26.277 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 28/164 2024-05-14T15:02:26.317 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 29/164 2024-05-14T15:02:26.361 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-14T15:02:26.371 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 30/164 2024-05-14T15:02:26.480 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 31/164 2024-05-14T15:02:26.520 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 32/164 2024-05-14T15:02:26.540 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-14T15:02:26.571 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 33/164 2024-05-14T15:02:26.593 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-14T15:02:26.602 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 34/164 2024-05-14T15:02:26.633 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-14T15:02:26.678 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-14T15:02:26.717 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 35/164 2024-05-14T15:02:26.736 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-14T15:02:26.781 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : luarocks-3.9.2-1.el9.noarch 36/164 2024-05-14T15:02:26.788 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-14T15:02:26.830 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-14T15:02:26.876 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-14T15:02:26.882 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 37/164 2024-05-14T15:02:26.943 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-14T15:02:27.021 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-14T15:02:27.056 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 38/164 2024-05-14T15:02:27.075 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-14T15:02:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 39/164 2024-05-14T15:02:27.220 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-14T15:02:27.281 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-14T15:02:27.341 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-14T15:02:27.415 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-14T15:02:27.568 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-14T15:02:27.636 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-14T15:02:27.801 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rsa-4.9-2.el9.noarch 40/164 2024-05-14T15:02:27.906 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 41/164 2024-05-14T15:02:27.950 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 42/164 2024-05-14T15:02:27.995 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 43/164 2024-05-14T15:02:28.036 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 44/164 2024-05-14T15:02:28.110 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 45/164 2024-05-14T15:02:28.347 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 46/164 2024-05-14T15:02:28.415 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T15:02:28.427 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : openssl-1:3.2.1-1.el9.x86_64 47/164 2024-05-14T15:02:28.474 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T15:02:28.556 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 48/164 2024-05-14T15:02:28.588 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-14T15:02:28.629 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 49/164 2024-05-14T15:02:28.636 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-14T15:02:28.669 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-14T15:02:28.718 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 50/164 2024-05-14T15:02:28.761 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 51/164 2024-05-14T15:02:28.788 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-14T15:02:28.799 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 52/164 2024-05-14T15:02:28.856 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 53/164 2024-05-14T15:02:28.880 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-14T15:02:28.900 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 54/164 2024-05-14T15:02:28.960 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 55/164 2024-05-14T15:02:28.982 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-14T15:02:29.021 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 56/164 2024-05-14T15:02:29.029 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-14T15:02:29.151 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T15:02:29.192 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 57/164 2024-05-14T15:02:29.239 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 58/164 2024-05-14T15:02:29.266 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-14T15:02:29.276 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 59/164 2024-05-14T15:02:29.301 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-14T15:02:29.322 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 60/164 2024-05-14T15:02:29.375 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T15:02:29.407 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-14T15:02:29.445 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-05-14T15:02:29.486 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-google-auth-1:2.29.0-1.el9.noarch 62/164 2024-05-14T15:02:29.535 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-05-14T15:02:29.539 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T15:02:29.539 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-14T15:02:29.539 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-14T15:02:29.539 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:02:29.576 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 64/164 2024-05-14T15:02:29.578 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T15:02:29.609 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-05-14T15:02:29.831 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-05-14T15:02:30.016 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-05-14T15:02:30.058 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-05-14T15:02:30.097 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-05-14T15:02:30.144 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-05-14T15:02:30.201 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-05-14T15:02:30.234 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-14T15:02:30.252 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-05-14T15:02:30.294 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-05-14T15:02:30.340 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-05-14T15:02:30.373 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-14T15:02:30.416 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-05-14T15:02:30.494 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-05-14T15:02:30.538 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-05-14T15:02:30.680 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-05-14T15:02:30.742 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-05-14T15:02:30.789 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-05-14T15:02:30.860 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-05-14T15:02:31.006 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-packaging-20.9-5.el9.noarch 82/164 2024-05-14T15:02:31.077 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/164 2024-05-14T15:02:31.962 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-14T15:02:32.034 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/164 2024-05-14T15:02:32.058 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-14T15:02:32.093 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-14T15:02:32.094 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/164 2024-05-14T15:02:32.127 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/164 2024-05-14T15:02:32.128 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-14T15:02:32.252 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/164 2024-05-14T15:02:32.313 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 88/164 2024-05-14T15:02:32.412 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-05-14T15:02:32.462 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-05-14T15:02:32.513 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-14T15:02:32.553 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T15:02:32.675 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T15:02:32.697 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-0.3.21-2.el9.x86_64 91/164 2024-05-14T15:02:32.710 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/164 2024-05-14T15:02:32.734 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 92/164 2024-05-14T15:02:32.774 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-14T15:02:32.840 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-05-14T15:02:33.340 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-14T15:02:33.373 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T15:02:33.498 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T15:02:33.526 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/164 2024-05-14T15:02:33.688 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-05-14T15:02:33.838 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-05-14T15:02:35.435 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-05-14T15:02:35.533 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-05-14T15:02:35.569 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-05-14T15:02:35.604 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 99/164 2024-05-14T15:02:35.983 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-05-14T15:02:36.021 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T15:02:36.141 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 101/164 2024-05-14T15:02:36.177 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 102/164 2024-05-14T15:02:36.191 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T15:02:36.238 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T15:02:36.253 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-05-14T15:02:36.820 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-05-14T15:02:36.865 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T15:02:36.908 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T15:02:36.956 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 105/164 2024-05-14T15:02:36.967 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T15:02:36.984 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 106/164 2024-05-14T15:02:37.128 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T15:02:37.128 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-14T15:02:37.129 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-14T15:02:37.129 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:02:37.168 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T15:02:39.651 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T15:02:39.873 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T15:02:40.555 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 107/164 2024-05-14T15:02:40.601 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T15:02:40.790 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 108/164 2024-05-14T15:02:40.790 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-05-14T15:02:40.790 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-05-14T15:02:40.790 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T15:02:40.827 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T15:02:42.621 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T15:02:42.621 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /sys 2024-05-14T15:02:42.621 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /proc 2024-05-14T15:02:42.622 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /mnt 2024-05-14T15:02:42.622 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /var/tmp 2024-05-14T15:02:42.622 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /home 2024-05-14T15:02:42.622 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /root 2024-05-14T15:02:42.622 INFO:teuthology.orchestra.run.smithi069.stdout:skipping the directory /tmp 2024-05-14T15:02:42.622 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:02:42.835 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T15:02:42.882 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T15:02:42.883 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:42.883 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-14T15:02:42.883 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:02:44.562 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T15:02:44.648 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T15:02:44.648 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:44.648 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-14T15:02:44.648 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T15:02:44.648 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T15:02:44.648 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:02:44.895 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T15:02:44.961 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T15:02:44.962 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:44.962 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-14T15:02:44.962 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T15:02:44.962 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T15:02:44.962 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:02:45.471 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T15:02:45.540 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T15:02:45.540 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:45.540 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-14T15:02:45.540 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T15:02:45.540 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T15:02:45.540 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:02:45.673 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-14T15:02:45.734 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-14T15:02:45.808 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-14T15:02:46.075 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-14T15:02:46.142 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-14T15:02:46.229 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-14T15:02:46.335 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-14T15:02:46.520 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-14T15:02:46.580 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-14T15:02:46.625 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-14T15:02:46.657 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-14T15:02:47.342 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T15:02:47.392 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T15:02:47.447 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 126/164 2024-05-14T15:02:47.546 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 127/164 2024-05-14T15:02:47.578 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T15:02:48.885 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T15:02:48.939 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T15:02:50.036 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T15:02:50.072 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T15:02:50.226 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T15:02:50.274 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T15:02:50.275 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /sys 2024-05-14T15:02:50.275 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /proc 2024-05-14T15:02:50.275 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /mnt 2024-05-14T15:02:50.275 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /var/tmp 2024-05-14T15:02:50.275 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /home 2024-05-14T15:02:50.275 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /root 2024-05-14T15:02:50.275 INFO:teuthology.orchestra.run.smithi203.stdout:skipping the directory /tmp 2024-05-14T15:02:50.275 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:02:50.441 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 131/164 2024-05-14T15:02:50.474 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T15:02:50.507 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T15:02:50.541 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T15:02:50.541 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:50.541 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-14T15:02:50.541 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T15:02:50.542 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T15:02:50.542 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:02:50.556 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T15:02:50.556 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:50.556 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-14T15:02:50.556 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:02:50.600 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T15:02:50.637 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T15:02:50.750 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 134/164 2024-05-14T15:02:50.822 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 135/164 2024-05-14T15:02:51.834 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-14T15:02:51.869 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T15:02:51.937 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T15:02:51.937 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:51.937 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-14T15:02:51.937 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T15:02:51.937 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T15:02:51.937 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:02:51.986 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T15:02:52.056 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T15:02:52.056 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:52.056 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-14T15:02:52.056 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:02:52.128 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T15:02:52.227 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T15:02:52.228 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:52.228 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-14T15:02:52.228 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T15:02:52.228 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T15:02:52.228 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:02:52.364 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T15:02:52.443 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T15:02:52.443 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:52.443 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-14T15:02:52.444 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T15:02:52.444 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T15:02:52.444 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:02:52.621 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T15:02:52.700 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T15:02:52.700 INFO:teuthology.orchestra.run.smithi069.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:52.700 INFO:teuthology.orchestra.run.smithi069.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-14T15:02:52.700 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T15:02:52.701 INFO:teuthology.orchestra.run.smithi069.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T15:02:52.701 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:02:52.736 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T15:02:52.805 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T15:02:52.806 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:52.806 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-14T15:02:52.806 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T15:02:52.806 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T15:02:52.806 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:02:53.337 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T15:02:53.406 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T15:02:53.406 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:53.406 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-14T15:02:53.406 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T15:02:53.406 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T15:02:53.406 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:02:53.476 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 109/164 2024-05-14T15:02:53.476 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /sys 2024-05-14T15:02:53.476 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /proc 2024-05-14T15:02:53.477 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /mnt 2024-05-14T15:02:53.477 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /var/tmp 2024-05-14T15:02:53.477 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /home 2024-05-14T15:02:53.477 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /root 2024-05-14T15:02:53.477 INFO:teuthology.orchestra.run.smithi092.stdout:skipping the directory /tmp 2024-05-14T15:02:53.477 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T15:02:53.545 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-14T15:02:53.608 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-14T15:02:53.684 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-14T15:02:53.750 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T15:02:53.799 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 110/164 2024-05-14T15:02:53.799 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:53.799 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-05-14T15:02:53.800 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T15:02:53.920 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-14T15:02:53.983 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-14T15:02:54.067 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-14T15:02:54.168 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-14T15:02:54.341 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-14T15:02:54.397 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-14T15:02:54.441 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-14T15:02:54.482 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-14T15:02:55.048 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T15:02:55.094 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T15:02:55.145 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 126/164 2024-05-14T15:02:55.256 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 127/164 2024-05-14T15:02:55.285 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T15:02:55.521 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T15:02:55.600 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 111/164 2024-05-14T15:02:55.600 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:55.601 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-05-14T15:02:55.601 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T15:02:55.601 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-05-14T15:02:55.601 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T15:02:55.847 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T15:02:55.920 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 112/164 2024-05-14T15:02:55.921 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:55.921 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-05-14T15:02:55.921 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T15:02:55.921 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-05-14T15:02:55.921 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T15:02:56.448 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T15:02:56.517 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 113/164 2024-05-14T15:02:56.517 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:56.517 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-05-14T15:02:56.517 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T15:02:56.518 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-05-14T15:02:56.518 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T15:02:56.584 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T15:02:56.637 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T15:02:56.658 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-05-14T15:02:56.719 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-05-14T15:02:56.794 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-05-14T15:02:57.043 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-05-14T15:02:57.104 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-05-14T15:02:57.218 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-05-14T15:02:57.322 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-05-14T15:02:57.424 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/164 2024-05-14T15:02:57.485 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 142/164 2024-05-14T15:02:57.487 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-05-14T15:02:57.549 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 143/164 2024-05-14T15:02:57.550 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-05-14T15:02:57.594 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-05-14T15:02:57.605 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-14T15:02:57.626 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : fuse-2.9.9-15.el9.x86_64 124/164 2024-05-14T15:02:57.651 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-14T15:02:57.740 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T15:02:57.779 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T15:02:57.936 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T15:02:57.953 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 146/164 2024-05-14T15:02:58.017 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-14T15:02:58.046 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 148/164 2024-05-14T15:02:58.122 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-14T15:02:58.125 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 131/164 2024-05-14T15:02:58.157 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T15:02:58.181 INFO:teuthology.orchestra.run.smithi069.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-14T15:02:58.231 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T15:02:58.231 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:58.231 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-14T15:02:58.231 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T15:02:58.231 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T15:02:58.231 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:02:58.291 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T15:02:58.327 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T15:02:58.331 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T15:02:58.372 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 125/164 2024-05-14T15:02:58.428 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 126/164 2024-05-14T15:02:58.433 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 134/164 2024-05-14T15:02:58.503 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 135/164 2024-05-14T15:02:58.524 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 127/164 2024-05-14T15:02:58.557 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T15:02:59.126 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T15:02:59.178 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T15:02:59.234 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T15:02:59.540 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-14T15:02:59.569 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T15:02:59.642 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T15:02:59.642 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:59.642 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-14T15:02:59.642 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T15:02:59.643 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T15:02:59.643 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:02:59.703 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T15:02:59.789 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T15:02:59.789 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:59.789 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-14T15:02:59.789 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:02:59.811 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 128/164 2024-05-14T15:02:59.858 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T15:02:59.874 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T15:02:59.969 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T15:02:59.969 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:02:59.970 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-14T15:02:59.970 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T15:02:59.970 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T15:02:59.970 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:03:00.380 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T15:03:00.461 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T15:03:00.523 INFO:teuthology.orchestra.run.smithi203.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:03:00.524 INFO:teuthology.orchestra.run.smithi203.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-14T15:03:00.524 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T15:03:00.524 INFO:teuthology.orchestra.run.smithi203.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T15:03:00.524 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:03:00.577 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 152/164 2024-05-14T15:03:00.685 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-14T15:03:00.748 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-14T15:03:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-14T15:03:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-14T15:03:00.950 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 129/164 2024-05-14T15:03:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-14T15:03:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T15:03:00.975 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T15:03:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T15:03:01.130 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 130/164 2024-05-14T15:03:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-14T15:03:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T15:03:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T15:03:01.311 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 131/164 2024-05-14T15:03:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-14T15:03:01.365 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T15:03:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T15:03:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T15:03:01.461 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 132/164 2024-05-14T15:03:01.461 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:03:01.461 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-05-14T15:03:01.461 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T15:03:01.461 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-05-14T15:03:01.461 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T15:03:01.520 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T15:03:01.558 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 133/164 2024-05-14T15:03:01.678 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 134/164 2024-05-14T15:03:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T15:03:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T15:03:01.752 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 135/164 2024-05-14T15:03:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T15:03:01.973 INFO:teuthology.orchestra.run.smithi069.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T15:03:02.236 INFO:teuthology.orchestra.run.smithi069.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T15:03:02.237 INFO:teuthology.orchestra.run.smithi069.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-14T15:03:02.237 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:03:02.767 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libtool-2.4.6-45.el9.x86_64 136/164 2024-05-14T15:03:02.797 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T15:03:02.867 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 137/164 2024-05-14T15:03:02.867 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:03:02.867 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-05-14T15:03:02.867 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T15:03:02.867 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-05-14T15:03:02.867 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T15:03:02.915 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T15:03:02.980 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 138/164 2024-05-14T15:03:02.980 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:03:02.980 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-05-14T15:03:02.980 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T15:03:03.096 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T15:03:03.171 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 139/164 2024-05-14T15:03:03.171 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:03:03.171 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-05-14T15:03:03.171 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T15:03:03.171 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-05-14T15:03:03.171 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T15:03:03.562 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T15:03:03.630 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 140/164 2024-05-14T15:03:03.630 INFO:teuthology.orchestra.run.smithi092.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-05-14T15:03:03.630 INFO:teuthology.orchestra.run.smithi092.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-05-14T15:03:03.630 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T15:03:03.630 INFO:teuthology.orchestra.run.smithi092.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-05-14T15:03:03.630 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T15:03:05.256 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/164 2024-05-14T15:03:05.314 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 142/164 2024-05-14T15:03:05.376 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 143/164 2024-05-14T15:03:05.411 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-14T15:03:05.459 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-14T15:03:05.792 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 146/164 2024-05-14T15:03:05.878 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-14T15:03:05.913 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 148/164 2024-05-14T15:03:05.959 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-14T15:03:06.006 INFO:teuthology.orchestra.run.smithi203.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-14T15:03:06.897 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T15:03:06.945 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T15:03:07.001 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T15:03:07.982 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 1/164 2024-05-14T15:03:07.982 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2/164 2024-05-14T15:03:07.982 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 3/164 2024-05-14T15:03:07.982 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 4/164 2024-05-14T15:03:07.982 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 5/164 2024-05-14T15:03:07.982 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 6/164 2024-05-14T15:03:07.982 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 7/164 2024-05-14T15:03:07.982 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T15:03:07.982 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T15:03:07.982 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T15:03:07.983 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/164 2024-05-14T15:03:07.983 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 12/164 2024-05-14T15:03:07.983 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T15:03:07.983 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/164 2024-05-14T15:03:07.983 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 15/164 2024-05-14T15:03:07.983 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 16/164 2024-05-14T15:03:07.983 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 17/164 2024-05-14T15:03:07.983 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 18/164 2024-05-14T15:03:07.983 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 19/164 2024-05-14T15:03:07.983 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 20/164 2024-05-14T15:03:07.983 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 21/164 2024-05-14T15:03:07.983 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 22/164 2024-05-14T15:03:07.983 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 23/164 2024-05-14T15:03:07.983 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 24/164 2024-05-14T15:03:07.984 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 25/164 2024-05-14T15:03:07.984 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 26/164 2024-05-14T15:03:07.984 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 27/164 2024-05-14T15:03:07.984 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 28/164 2024-05-14T15:03:07.984 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 29/164 2024-05-14T15:03:07.995 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 30/164 2024-05-14T15:03:07.995 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 31/164 2024-05-14T15:03:07.995 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 32/164 2024-05-14T15:03:07.995 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 33/164 2024-05-14T15:03:07.995 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 34/164 2024-05-14T15:03:07.995 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 35/164 2024-05-14T15:03:07.995 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 36/164 2024-05-14T15:03:07.995 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 37/164 2024-05-14T15:03:07.996 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 38/164 2024-05-14T15:03:07.996 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 39/164 2024-05-14T15:03:07.996 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-14T15:03:07.996 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-14T15:03:07.996 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-14T15:03:07.996 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-14T15:03:07.996 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-14T15:03:07.996 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-14T15:03:07.996 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-14T15:03:07.996 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-14T15:03:07.996 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-14T15:03:07.996 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-14T15:03:07.996 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-14T15:03:07.996 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-14T15:03:07.997 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-14T15:03:07.997 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-14T15:03:07.997 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-14T15:03:07.997 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-14T15:03:07.997 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-14T15:03:07.997 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-14T15:03:07.997 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-14T15:03:07.997 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-14T15:03:07.997 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-14T15:03:07.997 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-14T15:03:07.997 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-14T15:03:07.997 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-14T15:03:07.997 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-14T15:03:07.997 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-14T15:03:07.998 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-14T15:03:07.998 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-14T15:03:07.998 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-14T15:03:07.998 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-14T15:03:07.998 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-14T15:03:07.998 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-14T15:03:07.998 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-14T15:03:07.998 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-14T15:03:07.998 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-14T15:03:07.998 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-14T15:03:07.998 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-14T15:03:07.998 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-14T15:03:07.998 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-14T15:03:07.999 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-14T15:03:07.999 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-14T15:03:07.999 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-14T15:03:07.999 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-14T15:03:07.999 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-14T15:03:07.999 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-14T15:03:07.999 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-14T15:03:07.999 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-14T15:03:07.999 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-14T15:03:07.999 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-14T15:03:07.999 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-14T15:03:07.999 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-14T15:03:07.999 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-14T15:03:07.999 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-14T15:03:08.000 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-14T15:03:08.000 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-14T15:03:08.000 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-14T15:03:08.000 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-14T15:03:08.000 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-14T15:03:08.000 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-14T15:03:08.000 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-14T15:03:08.000 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-14T15:03:08.000 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-14T15:03:08.000 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-14T15:03:08.000 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-14T15:03:08.000 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-14T15:03:08.001 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-14T15:03:08.001 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-14T15:03:08.001 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-14T15:03:08.001 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-14T15:03:08.001 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-14T15:03:08.001 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-14T15:03:08.001 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-14T15:03:08.002 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-14T15:03:08.002 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-14T15:03:08.002 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-14T15:03:08.002 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-14T15:03:08.002 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-14T15:03:08.002 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-14T15:03:08.002 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-14T15:03:08.002 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-14T15:03:08.002 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-14T15:03:08.002 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-14T15:03:08.002 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-14T15:03:08.002 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-14T15:03:08.002 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-14T15:03:08.002 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-14T15:03:08.003 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-14T15:03:08.003 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-14T15:03:08.003 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-14T15:03:08.003 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-14T15:03:08.003 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-14T15:03:08.003 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-14T15:03:08.003 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-14T15:03:08.003 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-14T15:03:08.003 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-14T15:03:08.003 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-14T15:03:08.003 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-14T15:03:08.003 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-14T15:03:08.003 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-14T15:03:08.003 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-14T15:03:08.004 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-14T15:03:08.004 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-14T15:03:08.004 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-14T15:03:08.004 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-14T15:03:08.004 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-14T15:03:08.004 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-14T15:03:08.004 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-14T15:03:08.004 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-14T15:03:08.004 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-14T15:03:08.004 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 149/164 2024-05-14T15:03:08.004 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-14T15:03:08.004 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 151/164 2024-05-14T15:03:08.004 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-14T15:03:08.004 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-14T15:03:08.004 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-14T15:03:08.005 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-14T15:03:08.005 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-14T15:03:08.005 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-14T15:03:08.005 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-14T15:03:08.005 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-14T15:03:08.005 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-14T15:03:08.005 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-14T15:03:08.005 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-14T15:03:08.005 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-14T15:03:08.331 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 141/164 2024-05-14T15:03:08.388 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 152/164 2024-05-14T15:03:08.389 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 142/164 2024-05-14T15:03:08.451 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 143/164 2024-05-14T15:03:08.487 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 144/164 2024-05-14T15:03:08.487 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-14T15:03:08.525 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 145/164 2024-05-14T15:03:08.560 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-14T15:03:08.735 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-14T15:03:08.772 INFO:teuthology.orchestra.run.smithi203.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-14T15:03:08.810 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-14T15:03:08.810 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T15:03:08.826 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 146/164 2024-05-14T15:03:08.883 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 147/164 2024-05-14T15:03:08.913 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 148/164 2024-05-14T15:03:08.937 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T15:03:08.988 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-team-1:1.47.90-1.el9.x86_64 149/164 2024-05-14T15:03:09.001 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-14T15:03:09.001 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T15:03:09.039 INFO:teuthology.orchestra.run.smithi092.stdout: Upgrading : NetworkManager-tui-1:1.47.90-1.el9.x86_64 150/164 2024-05-14T15:03:09.147 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T15:03:09.186 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-14T15:03:09.220 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T15:03:09.221 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T15:03:09.523 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T15:03:09.524 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T15:03:09.660 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T15:03:09.791 INFO:teuthology.orchestra.run.smithi203.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T15:03:09.924 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T15:03:09.977 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T15:03:10.032 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 151/164 2024-05-14T15:03:10.047 INFO:teuthology.orchestra.run.smithi203.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T15:03:10.047 INFO:teuthology.orchestra.run.smithi203.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-14T15:03:10.047 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:03:10.214 INFO:teuthology.orchestra.run.smithi069.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T15:03:10.214 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:03:10.214 INFO:teuthology.orchestra.run.smithi069.stdout:Upgraded: 2024-05-14T15:03:10.214 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-14T15:03:10.214 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-14T15:03:10.214 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-14T15:03:10.215 INFO:teuthology.orchestra.run.smithi069.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-14T15:03:10.215 INFO:teuthology.orchestra.run.smithi069.stdout: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.215 INFO:teuthology.orchestra.run.smithi069.stdout: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.215 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-14T15:03:10.215 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-14T15:03:10.215 INFO:teuthology.orchestra.run.smithi069.stdout:Installed: 2024-05-14T15:03:10.215 INFO:teuthology.orchestra.run.smithi069.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-14T15:03:10.215 INFO:teuthology.orchestra.run.smithi069.stdout: automake-1.16.2-8.el9.noarch 2024-05-14T15:03:10.215 INFO:teuthology.orchestra.run.smithi069.stdout: bison-3.7.4-5.el9.x86_64 2024-05-14T15:03:10.215 INFO:teuthology.orchestra.run.smithi069.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-14T15:03:10.215 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.215 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.215 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.216 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.216 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:10.216 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-immutable-object-cache-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.216 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.216 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.216 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:10.216 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:10.216 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:10.216 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:10.216 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:10.216 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.217 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.217 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:10.217 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.217 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.217 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.217 INFO:teuthology.orchestra.run.smithi069.stdout: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:10.217 INFO:teuthology.orchestra.run.smithi069.stdout: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:10.217 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.217 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.217 INFO:teuthology.orchestra.run.smithi069.stdout: cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:10.217 INFO:teuthology.orchestra.run.smithi069.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-14T15:03:10.217 INFO:teuthology.orchestra.run.smithi069.stdout: flex-2.6.4-9.el9.x86_64 2024-05-14T15:03:10.218 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-14T15:03:10.218 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-14T15:03:10.218 INFO:teuthology.orchestra.run.smithi069.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-14T15:03:10.218 INFO:teuthology.orchestra.run.smithi069.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-14T15:03:10.219 INFO:teuthology.orchestra.run.smithi069.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-14T15:03:10.219 INFO:teuthology.orchestra.run.smithi069.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-14T15:03:10.219 INFO:teuthology.orchestra.run.smithi069.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-14T15:03:10.219 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-14T15:03:10.219 INFO:teuthology.orchestra.run.smithi069.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-14T15:03:10.219 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.219 INFO:teuthology.orchestra.run.smithi069.stdout: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.219 INFO:teuthology.orchestra.run.smithi069.stdout: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.219 INFO:teuthology.orchestra.run.smithi069.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-14T15:03:10.219 INFO:teuthology.orchestra.run.smithi069.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-14T15:03:10.219 INFO:teuthology.orchestra.run.smithi069.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-14T15:03:10.219 INFO:teuthology.orchestra.run.smithi069.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-14T15:03:10.219 INFO:teuthology.orchestra.run.smithi069.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-14T15:03:10.220 INFO:teuthology.orchestra.run.smithi069.stdout: librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.220 INFO:teuthology.orchestra.run.smithi069.stdout: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.220 INFO:teuthology.orchestra.run.smithi069.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-14T15:03:10.220 INFO:teuthology.orchestra.run.smithi069.stdout: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.220 INFO:teuthology.orchestra.run.smithi069.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-14T15:03:10.220 INFO:teuthology.orchestra.run.smithi069.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-14T15:03:10.220 INFO:teuthology.orchestra.run.smithi069.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-14T15:03:10.220 INFO:teuthology.orchestra.run.smithi069.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-14T15:03:10.220 INFO:teuthology.orchestra.run.smithi069.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-14T15:03:10.220 INFO:teuthology.orchestra.run.smithi069.stdout: lua-5.4.4-4.el9.x86_64 2024-05-14T15:03:10.220 INFO:teuthology.orchestra.run.smithi069.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-14T15:03:10.220 INFO:teuthology.orchestra.run.smithi069.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-14T15:03:10.220 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-14T15:03:10.220 INFO:teuthology.orchestra.run.smithi069.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-14T15:03:10.220 INFO:teuthology.orchestra.run.smithi069.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-14T15:03:10.221 INFO:teuthology.orchestra.run.smithi069.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-14T15:03:10.221 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-13.14-1.el9.x86_64 2024-05-14T15:03:10.221 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-14T15:03:10.221 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-14T15:03:10.221 INFO:teuthology.orchestra.run.smithi069.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-14T15:03:10.221 INFO:teuthology.orchestra.run.smithi069.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-14T15:03:10.221 INFO:teuthology.orchestra.run.smithi069.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-14T15:03:10.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-14T15:03:10.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-14T15:03:10.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-14T15:03:10.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-14T15:03:10.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-14T15:03:10.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.221 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-14T15:03:10.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-14T15:03:10.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-14T15:03:10.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-14T15:03:10.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-14T15:03:10.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-14T15:03:10.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-14T15:03:10.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-14T15:03:10.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-14T15:03:10.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-14T15:03:10.222 INFO:teuthology.orchestra.run.smithi069.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-14T15:03:10.223 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-14T15:03:10.223 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-14T15:03:10.223 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-14T15:03:10.223 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-14T15:03:10.223 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-14T15:03:10.223 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-14T15:03:10.223 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-14T15:03:10.223 INFO:teuthology.orchestra.run.smithi069.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-14T15:03:10.223 INFO:teuthology.orchestra.run.smithi069.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-14T15:03:10.223 INFO:teuthology.orchestra.run.smithi069.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-14T15:03:10.223 INFO:teuthology.orchestra.run.smithi069.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-14T15:03:10.223 INFO:teuthology.orchestra.run.smithi069.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-14T15:03:10.223 INFO:teuthology.orchestra.run.smithi069.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-14T15:03:10.223 INFO:teuthology.orchestra.run.smithi069.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-14T15:03:10.224 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-14T15:03:10.224 INFO:teuthology.orchestra.run.smithi069.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-14T15:03:10.224 INFO:teuthology.orchestra.run.smithi069.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-14T15:03:10.224 INFO:teuthology.orchestra.run.smithi069.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-14T15:03:10.224 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-14T15:03:10.224 INFO:teuthology.orchestra.run.smithi069.stdout: python3-ply-3.11-14.el9.noarch 2024-05-14T15:03:10.224 INFO:teuthology.orchestra.run.smithi069.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-14T15:03:10.224 INFO:teuthology.orchestra.run.smithi069.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-14T15:03:10.224 INFO:teuthology.orchestra.run.smithi069.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-14T15:03:10.224 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-14T15:03:10.224 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-14T15:03:10.224 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-14T15:03:10.224 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-14T15:03:10.224 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-14T15:03:10.224 INFO:teuthology.orchestra.run.smithi069.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-14T15:03:10.224 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-14T15:03:10.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-14T15:03:10.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-14T15:03:10.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-14T15:03:10.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-14T15:03:10.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-14T15:03:10.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-14T15:03:10.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-14T15:03:10.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-14T15:03:10.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-14T15:03:10.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-14T15:03:10.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-14T15:03:10.225 INFO:teuthology.orchestra.run.smithi069.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-14T15:03:10.226 INFO:teuthology.orchestra.run.smithi069.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-14T15:03:10.226 INFO:teuthology.orchestra.run.smithi069.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-14T15:03:10.226 INFO:teuthology.orchestra.run.smithi069.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-14T15:03:10.226 INFO:teuthology.orchestra.run.smithi069.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-14T15:03:10.226 INFO:teuthology.orchestra.run.smithi069.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-14T15:03:10.226 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.226 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.226 INFO:teuthology.orchestra.run.smithi069.stdout: rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:10.226 INFO:teuthology.orchestra.run.smithi069.stdout: re2-1:20211101-3.el9.x86_64 2024-05-14T15:03:10.226 INFO:teuthology.orchestra.run.smithi069.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-14T15:03:10.226 INFO:teuthology.orchestra.run.smithi069.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-14T15:03:10.226 INFO:teuthology.orchestra.run.smithi069.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-14T15:03:10.226 INFO:teuthology.orchestra.run.smithi069.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-14T15:03:10.226 INFO:teuthology.orchestra.run.smithi069.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-14T15:03:10.227 INFO:teuthology.orchestra.run.smithi069.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-14T15:03:10.227 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:03:10.227 INFO:teuthology.orchestra.run.smithi069.stdout:Complete! 2024-05-14T15:03:10.842 DEBUG:teuthology.parallel:result is None 2024-05-14T15:03:11.373 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 152/164 2024-05-14T15:03:11.516 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : openssl-devel-1:3.2.1-1.el9.x86_64 153/164 2024-05-14T15:03:11.591 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-05-14T15:03:11.749 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-05-14T15:03:11.792 INFO:teuthology.orchestra.run.smithi092.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-05-14T15:03:11.830 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 157/164 2024-05-14T15:03:11.831 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T15:03:11.952 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/164 2024-05-14T15:03:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 159/164 2024-05-14T15:03:11.997 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T15:03:12.142 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-05-14T15:03:12.181 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 161/164 2024-05-14T15:03:12.215 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T15:03:12.215 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T15:03:12.536 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 162/164 2024-05-14T15:03:12.536 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T15:03:12.697 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 163/164 2024-05-14T15:03:12.827 INFO:teuthology.orchestra.run.smithi092.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T15:03:13.068 INFO:teuthology.orchestra.run.smithi092.stdout: Running scriptlet: openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T15:03:13.068 INFO:teuthology.orchestra.run.smithi092.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2024-05-14T15:03:13.069 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T15:03:16.282 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 1/164 2024-05-14T15:03:16.282 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2/164 2024-05-14T15:03:16.282 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 3/164 2024-05-14T15:03:16.282 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 4/164 2024-05-14T15:03:16.282 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 5/164 2024-05-14T15:03:16.283 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 6/164 2024-05-14T15:03:16.283 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 7/164 2024-05-14T15:03:16.283 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T15:03:16.283 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T15:03:16.283 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T15:03:16.283 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/164 2024-05-14T15:03:16.283 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 12/164 2024-05-14T15:03:16.283 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T15:03:16.283 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/164 2024-05-14T15:03:16.284 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 15/164 2024-05-14T15:03:16.284 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 16/164 2024-05-14T15:03:16.284 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 17/164 2024-05-14T15:03:16.284 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 18/164 2024-05-14T15:03:16.284 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 19/164 2024-05-14T15:03:16.284 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 20/164 2024-05-14T15:03:16.284 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 21/164 2024-05-14T15:03:16.284 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 22/164 2024-05-14T15:03:16.284 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 23/164 2024-05-14T15:03:16.285 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 24/164 2024-05-14T15:03:16.285 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 25/164 2024-05-14T15:03:16.285 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 26/164 2024-05-14T15:03:16.285 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 27/164 2024-05-14T15:03:16.300 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 28/164 2024-05-14T15:03:16.301 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 29/164 2024-05-14T15:03:16.301 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 30/164 2024-05-14T15:03:16.301 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 31/164 2024-05-14T15:03:16.301 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 32/164 2024-05-14T15:03:16.301 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 33/164 2024-05-14T15:03:16.301 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 34/164 2024-05-14T15:03:16.301 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 35/164 2024-05-14T15:03:16.301 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 36/164 2024-05-14T15:03:16.301 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 37/164 2024-05-14T15:03:16.301 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 38/164 2024-05-14T15:03:16.301 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 39/164 2024-05-14T15:03:16.301 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-14T15:03:16.302 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-14T15:03:16.302 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-14T15:03:16.302 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-14T15:03:16.302 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-14T15:03:16.302 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-14T15:03:16.302 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-14T15:03:16.302 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-14T15:03:16.302 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-14T15:03:16.302 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-14T15:03:16.302 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-14T15:03:16.302 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-14T15:03:16.302 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-14T15:03:16.302 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-14T15:03:16.303 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-14T15:03:16.303 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-14T15:03:16.303 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-14T15:03:16.303 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-14T15:03:16.303 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-14T15:03:16.303 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-14T15:03:16.303 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-14T15:03:16.303 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-14T15:03:16.303 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-14T15:03:16.303 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-14T15:03:16.303 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-14T15:03:16.303 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-14T15:03:16.303 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-14T15:03:16.303 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-14T15:03:16.304 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-14T15:03:16.304 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-14T15:03:16.304 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-14T15:03:16.304 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-14T15:03:16.304 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-14T15:03:16.304 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-14T15:03:16.304 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-14T15:03:16.304 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-14T15:03:16.304 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-14T15:03:16.304 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-14T15:03:16.304 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-14T15:03:16.304 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-14T15:03:16.304 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-14T15:03:16.305 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-14T15:03:16.305 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-14T15:03:16.305 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-14T15:03:16.305 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-14T15:03:16.305 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-14T15:03:16.305 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-14T15:03:16.305 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-14T15:03:16.305 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-14T15:03:16.305 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-14T15:03:16.306 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-14T15:03:16.306 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-14T15:03:16.306 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-14T15:03:16.306 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-14T15:03:16.306 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-14T15:03:16.306 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-14T15:03:16.306 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-14T15:03:16.306 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-14T15:03:16.306 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-14T15:03:16.306 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-14T15:03:16.306 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-14T15:03:16.306 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-14T15:03:16.307 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-14T15:03:16.307 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-14T15:03:16.307 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-14T15:03:16.307 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-14T15:03:16.307 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-14T15:03:16.307 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-14T15:03:16.307 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-14T15:03:16.307 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-14T15:03:16.307 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-14T15:03:16.307 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-14T15:03:16.307 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-14T15:03:16.307 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-14T15:03:16.307 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-14T15:03:16.307 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-14T15:03:16.308 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-14T15:03:16.308 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-14T15:03:16.308 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-14T15:03:16.308 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-14T15:03:16.308 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-14T15:03:16.308 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-14T15:03:16.308 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-14T15:03:16.308 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-14T15:03:16.308 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-14T15:03:16.308 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-14T15:03:16.308 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-14T15:03:16.308 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-14T15:03:16.308 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-14T15:03:16.308 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-14T15:03:16.309 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-14T15:03:16.309 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-14T15:03:16.309 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-14T15:03:16.309 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-14T15:03:16.309 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-14T15:03:16.309 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-14T15:03:16.309 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-14T15:03:16.309 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-14T15:03:16.309 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-14T15:03:16.309 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-14T15:03:16.309 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-14T15:03:16.309 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-14T15:03:16.309 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-14T15:03:16.309 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-14T15:03:16.309 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-14T15:03:16.310 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-14T15:03:16.310 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-14T15:03:16.310 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-14T15:03:16.310 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-14T15:03:16.310 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 149/164 2024-05-14T15:03:16.310 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-14T15:03:16.310 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 151/164 2024-05-14T15:03:16.310 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-14T15:03:16.310 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-14T15:03:16.310 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-14T15:03:16.310 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-14T15:03:16.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-14T15:03:16.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-14T15:03:16.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-14T15:03:16.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-14T15:03:16.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-14T15:03:16.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-14T15:03:16.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-14T15:03:16.311 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-14T15:03:18.561 INFO:teuthology.orchestra.run.smithi203.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T15:03:18.561 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:03:18.561 INFO:teuthology.orchestra.run.smithi203.stdout:Upgraded: 2024-05-14T15:03:18.562 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-14T15:03:18.562 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-14T15:03:18.562 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-14T15:03:18.562 INFO:teuthology.orchestra.run.smithi203.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-14T15:03:18.562 INFO:teuthology.orchestra.run.smithi203.stdout: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.562 INFO:teuthology.orchestra.run.smithi203.stdout: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.562 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-14T15:03:18.562 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-14T15:03:18.562 INFO:teuthology.orchestra.run.smithi203.stdout:Installed: 2024-05-14T15:03:18.562 INFO:teuthology.orchestra.run.smithi203.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-14T15:03:18.562 INFO:teuthology.orchestra.run.smithi203.stdout: automake-1.16.2-8.el9.noarch 2024-05-14T15:03:18.562 INFO:teuthology.orchestra.run.smithi203.stdout: bison-3.7.4-5.el9.x86_64 2024-05-14T15:03:18.562 INFO:teuthology.orchestra.run.smithi203.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-14T15:03:18.562 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.563 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.563 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.563 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.563 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:18.563 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-immutable-object-cache-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.563 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.563 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.563 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:18.563 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:18.563 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:18.563 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:18.563 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:18.563 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.564 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.564 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:18.564 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.564 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.564 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.564 INFO:teuthology.orchestra.run.smithi203.stdout: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:18.564 INFO:teuthology.orchestra.run.smithi203.stdout: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:18.564 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.564 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.564 INFO:teuthology.orchestra.run.smithi203.stdout: cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:18.564 INFO:teuthology.orchestra.run.smithi203.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-14T15:03:18.564 INFO:teuthology.orchestra.run.smithi203.stdout: flex-2.6.4-9.el9.x86_64 2024-05-14T15:03:18.564 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-14T15:03:18.565 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-14T15:03:18.565 INFO:teuthology.orchestra.run.smithi203.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-14T15:03:18.565 INFO:teuthology.orchestra.run.smithi203.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-14T15:03:18.565 INFO:teuthology.orchestra.run.smithi203.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-14T15:03:18.565 INFO:teuthology.orchestra.run.smithi203.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-14T15:03:18.565 INFO:teuthology.orchestra.run.smithi203.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-14T15:03:18.565 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-14T15:03:18.565 INFO:teuthology.orchestra.run.smithi203.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-14T15:03:18.565 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.565 INFO:teuthology.orchestra.run.smithi203.stdout: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.565 INFO:teuthology.orchestra.run.smithi203.stdout: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.565 INFO:teuthology.orchestra.run.smithi203.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-14T15:03:18.565 INFO:teuthology.orchestra.run.smithi203.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-14T15:03:18.565 INFO:teuthology.orchestra.run.smithi203.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-14T15:03:18.565 INFO:teuthology.orchestra.run.smithi203.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-14T15:03:18.566 INFO:teuthology.orchestra.run.smithi203.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-14T15:03:18.566 INFO:teuthology.orchestra.run.smithi203.stdout: librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.566 INFO:teuthology.orchestra.run.smithi203.stdout: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.566 INFO:teuthology.orchestra.run.smithi203.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-14T15:03:18.566 INFO:teuthology.orchestra.run.smithi203.stdout: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.566 INFO:teuthology.orchestra.run.smithi203.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-14T15:03:18.566 INFO:teuthology.orchestra.run.smithi203.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-14T15:03:18.566 INFO:teuthology.orchestra.run.smithi203.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-14T15:03:18.566 INFO:teuthology.orchestra.run.smithi203.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-14T15:03:18.566 INFO:teuthology.orchestra.run.smithi203.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-14T15:03:18.566 INFO:teuthology.orchestra.run.smithi203.stdout: lua-5.4.4-4.el9.x86_64 2024-05-14T15:03:18.566 INFO:teuthology.orchestra.run.smithi203.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-14T15:03:18.566 INFO:teuthology.orchestra.run.smithi203.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-14T15:03:18.567 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-14T15:03:18.567 INFO:teuthology.orchestra.run.smithi203.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-14T15:03:18.567 INFO:teuthology.orchestra.run.smithi203.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-14T15:03:18.567 INFO:teuthology.orchestra.run.smithi203.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-14T15:03:18.567 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-13.14-1.el9.x86_64 2024-05-14T15:03:18.567 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-14T15:03:18.567 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-14T15:03:18.567 INFO:teuthology.orchestra.run.smithi203.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-14T15:03:18.567 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-14T15:03:18.567 INFO:teuthology.orchestra.run.smithi203.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-14T15:03:18.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-14T15:03:18.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-14T15:03:18.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-14T15:03:18.567 INFO:teuthology.orchestra.run.smithi203.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-14T15:03:18.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-14T15:03:18.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-14T15:03:18.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-14T15:03:18.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-14T15:03:18.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-14T15:03:18.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-14T15:03:18.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-14T15:03:18.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-14T15:03:18.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-14T15:03:18.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-14T15:03:18.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-14T15:03:18.568 INFO:teuthology.orchestra.run.smithi203.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-14T15:03:18.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-14T15:03:18.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-14T15:03:18.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-14T15:03:18.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-14T15:03:18.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-14T15:03:18.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-14T15:03:18.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-14T15:03:18.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-14T15:03:18.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-14T15:03:18.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-14T15:03:18.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-14T15:03:18.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-14T15:03:18.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-14T15:03:18.569 INFO:teuthology.orchestra.run.smithi203.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-14T15:03:18.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-14T15:03:18.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-14T15:03:18.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-14T15:03:18.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-14T15:03:18.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-14T15:03:18.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-ply-3.11-14.el9.noarch 2024-05-14T15:03:18.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-14T15:03:18.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-14T15:03:18.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-14T15:03:18.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-14T15:03:18.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-14T15:03:18.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-14T15:03:18.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-14T15:03:18.570 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-14T15:03:18.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-14T15:03:18.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-14T15:03:18.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-14T15:03:18.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-14T15:03:18.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-14T15:03:18.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-14T15:03:18.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-14T15:03:18.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-14T15:03:18.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-14T15:03:18.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-14T15:03:18.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-14T15:03:18.571 INFO:teuthology.orchestra.run.smithi203.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-14T15:03:18.572 INFO:teuthology.orchestra.run.smithi203.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-14T15:03:18.572 INFO:teuthology.orchestra.run.smithi203.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-14T15:03:18.572 INFO:teuthology.orchestra.run.smithi203.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-14T15:03:18.572 INFO:teuthology.orchestra.run.smithi203.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-14T15:03:18.572 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-14T15:03:18.572 INFO:teuthology.orchestra.run.smithi203.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-14T15:03:18.572 INFO:teuthology.orchestra.run.smithi203.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-14T15:03:18.572 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.572 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.572 INFO:teuthology.orchestra.run.smithi203.stdout: rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:18.572 INFO:teuthology.orchestra.run.smithi203.stdout: re2-1:20211101-3.el9.x86_64 2024-05-14T15:03:18.572 INFO:teuthology.orchestra.run.smithi203.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-14T15:03:18.572 INFO:teuthology.orchestra.run.smithi203.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-14T15:03:18.572 INFO:teuthology.orchestra.run.smithi203.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-14T15:03:18.572 INFO:teuthology.orchestra.run.smithi203.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-14T15:03:18.573 INFO:teuthology.orchestra.run.smithi203.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-14T15:03:18.573 INFO:teuthology.orchestra.run.smithi203.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-14T15:03:18.573 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:03:18.573 INFO:teuthology.orchestra.run.smithi203.stdout:Complete! 2024-05-14T15:03:19.202 DEBUG:teuthology.parallel:result is None 2024-05-14T15:03:19.238 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 1/164 2024-05-14T15:03:19.238 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2/164 2024-05-14T15:03:19.238 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 3/164 2024-05-14T15:03:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 4/164 2024-05-14T15:03:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-3588.ge2b75 5/164 2024-05-14T15:03:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 6/164 2024-05-14T15:03:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 7/164 2024-05-14T15:03:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 8/164 2024-05-14T15:03:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 9/164 2024-05-14T15:03:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 10/164 2024-05-14T15:03:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 11/164 2024-05-14T15:03:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 12/164 2024-05-14T15:03:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 13/164 2024-05-14T15:03:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 14/164 2024-05-14T15:03:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_ 15/164 2024-05-14T15:03:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 16/164 2024-05-14T15:03:19.239 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 17/164 2024-05-14T15:03:19.240 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_6 18/164 2024-05-14T15:03:19.240 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86 19/164 2024-05-14T15:03:19.240 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 20/164 2024-05-14T15:03:19.240 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el 21/164 2024-05-14T15:03:19.240 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9. 22/164 2024-05-14T15:03:19.240 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_6 23/164 2024-05-14T15:03:19.240 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 24/164 2024-05-14T15:03:19.240 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 25/164 2024-05-14T15:03:19.240 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 26/164 2024-05-14T15:03:19.240 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 27/164 2024-05-14T15:03:19.240 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 28/164 2024-05-14T15:03:19.240 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 29/164 2024-05-14T15:03:19.240 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6. 30/164 2024-05-14T15:03:19.240 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noa 31/164 2024-05-14T15:03:19.241 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.n 32/164 2024-05-14T15:03:19.241 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b 33/164 2024-05-14T15:03:19.241 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el 34/164 2024-05-14T15:03:19.241 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 35/164 2024-05-14T15:03:19.241 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.e 36/164 2024-05-14T15:03:19.241 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 37/164 2024-05-14T15:03:19.241 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 38/164 2024-05-14T15:03:19.241 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 39/164 2024-05-14T15:03:19.241 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 40/164 2024-05-14T15:03:19.241 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/164 2024-05-14T15:03:19.241 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/164 2024-05-14T15:03:19.241 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-05-14T15:03:19.241 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-05-14T15:03:19.242 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-05-14T15:03:19.242 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-05-14T15:03:19.242 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-05-14T15:03:19.242 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 48/164 2024-05-14T15:03:19.242 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-05-14T15:03:19.242 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-05-14T15:03:19.242 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-05-14T15:03:19.242 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 52/164 2024-05-14T15:03:19.242 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-05-14T15:03:19.242 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-05-14T15:03:19.242 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-05-14T15:03:19.242 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-05-14T15:03:19.242 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-05-14T15:03:19.243 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-05-14T15:03:19.243 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-05-14T15:03:19.243 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-05-14T15:03:19.243 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 61/164 2024-05-14T15:03:19.243 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/164 2024-05-14T15:03:19.243 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-05-14T15:03:19.243 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-05-14T15:03:19.243 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-05-14T15:03:19.243 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/164 2024-05-14T15:03:19.243 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/164 2024-05-14T15:03:19.243 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-devel-1:3.2.1-1.el9.x86_64 68/164 2024-05-14T15:03:19.243 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/164 2024-05-14T15:03:19.243 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/164 2024-05-14T15:03:19.243 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/164 2024-05-14T15:03:19.244 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/164 2024-05-14T15:03:19.244 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-05-14T15:03:19.244 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-05-14T15:03:19.244 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-05-14T15:03:19.244 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 76/164 2024-05-14T15:03:19.244 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 77/164 2024-05-14T15:03:19.244 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 78/164 2024-05-14T15:03:19.244 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 79/164 2024-05-14T15:03:19.244 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 80/164 2024-05-14T15:03:19.244 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 81/164 2024-05-14T15:03:19.244 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 82/164 2024-05-14T15:03:19.244 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 83/164 2024-05-14T15:03:19.244 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 84/164 2024-05-14T15:03:19.245 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 85/164 2024-05-14T15:03:19.245 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 86/164 2024-05-14T15:03:19.245 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 87/164 2024-05-14T15:03:19.245 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 88/164 2024-05-14T15:03:19.245 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 89/164 2024-05-14T15:03:19.245 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 90/164 2024-05-14T15:03:19.245 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 91/164 2024-05-14T15:03:19.245 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 92/164 2024-05-14T15:03:19.245 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 93/164 2024-05-14T15:03:19.245 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 94/164 2024-05-14T15:03:19.245 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 95/164 2024-05-14T15:03:19.245 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 96/164 2024-05-14T15:03:19.245 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 97/164 2024-05-14T15:03:19.245 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 98/164 2024-05-14T15:03:19.245 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 99/164 2024-05-14T15:03:19.246 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 100/164 2024-05-14T15:03:19.246 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 101/164 2024-05-14T15:03:19.246 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 102/164 2024-05-14T15:03:19.246 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 103/164 2024-05-14T15:03:19.246 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 104/164 2024-05-14T15:03:19.246 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 105/164 2024-05-14T15:03:19.246 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 106/164 2024-05-14T15:03:19.246 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 107/164 2024-05-14T15:03:19.246 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 108/164 2024-05-14T15:03:19.247 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 109/164 2024-05-14T15:03:19.247 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 110/164 2024-05-14T15:03:19.247 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 111/164 2024-05-14T15:03:19.247 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 112/164 2024-05-14T15:03:19.247 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 113/164 2024-05-14T15:03:19.247 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 114/164 2024-05-14T15:03:19.247 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 115/164 2024-05-14T15:03:19.247 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 116/164 2024-05-14T15:03:19.248 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 117/164 2024-05-14T15:03:19.248 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 118/164 2024-05-14T15:03:19.248 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 119/164 2024-05-14T15:03:19.248 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 120/164 2024-05-14T15:03:19.248 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 121/164 2024-05-14T15:03:19.248 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-google-auth-1:2.29.0-1.el9.noarch 122/164 2024-05-14T15:03:19.248 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-05-14T15:03:19.248 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-05-14T15:03:19.248 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-05-14T15:03:19.248 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-05-14T15:03:19.248 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-05-14T15:03:19.248 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-05-14T15:03:19.249 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-05-14T15:03:19.249 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-05-14T15:03:19.249 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-05-14T15:03:19.249 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-05-14T15:03:19.249 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-05-14T15:03:19.249 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-05-14T15:03:19.249 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-05-14T15:03:19.249 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-05-14T15:03:19.249 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-05-14T15:03:19.249 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-05-14T15:03:19.249 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-05-14T15:03:19.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-05-14T15:03:19.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-05-14T15:03:19.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 142/164 2024-05-14T15:03:19.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/164 2024-05-14T15:03:19.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-05-14T15:03:19.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-05-14T15:03:19.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-05-14T15:03:19.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/164 2024-05-14T15:03:19.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-05-14T15:03:19.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 149/164 2024-05-14T15:03:19.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-05-14T15:03:19.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 151/164 2024-05-14T15:03:19.250 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-05-14T15:03:19.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-1:1.47.90-1.el9.x86_64 153/164 2024-05-14T15:03:19.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/164 2024-05-14T15:03:19.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-libnm-1:1.47.90-1.el9.x86_64 155/164 2024-05-14T15:03:19.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/164 2024-05-14T15:03:19.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-team-1:1.47.90-1.el9.x86_64 157/164 2024-05-14T15:03:19.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/164 2024-05-14T15:03:19.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-tui-1:1.47.90-1.el9.x86_64 159/164 2024-05-14T15:03:19.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/164 2024-05-14T15:03:19.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-1:3.2.1-1.el9.x86_64 161/164 2024-05-14T15:03:19.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 162/164 2024-05-14T15:03:19.251 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-libs-1:3.2.1-1.el9.x86_64 163/164 2024-05-14T15:03:21.400 INFO:teuthology.orchestra.run.smithi092.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 164/164 2024-05-14T15:03:21.400 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T15:03:21.401 INFO:teuthology.orchestra.run.smithi092.stdout:Upgraded: 2024-05-14T15:03:21.401 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-1:1.47.90-1.el9.x86_64 2024-05-14T15:03:21.401 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-libnm-1:1.47.90-1.el9.x86_64 2024-05-14T15:03:21.401 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-team-1:1.47.90-1.el9.x86_64 2024-05-14T15:03:21.401 INFO:teuthology.orchestra.run.smithi092.stdout: NetworkManager-tui-1:1.47.90-1.el9.x86_64 2024-05-14T15:03:21.401 INFO:teuthology.orchestra.run.smithi092.stdout: librados2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.401 INFO:teuthology.orchestra.run.smithi092.stdout: librbd1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.401 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-1:3.2.1-1.el9.x86_64 2024-05-14T15:03:21.401 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-libs-1:3.2.1-1.el9.x86_64 2024-05-14T15:03:21.401 INFO:teuthology.orchestra.run.smithi092.stdout:Installed: 2024-05-14T15:03:21.401 INFO:teuthology.orchestra.run.smithi092.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-05-14T15:03:21.401 INFO:teuthology.orchestra.run.smithi092.stdout: automake-1.16.2-8.el9.noarch 2024-05-14T15:03:21.401 INFO:teuthology.orchestra.run.smithi092.stdout: bison-3.7.4-5.el9.x86_64 2024-05-14T15:03:21.401 INFO:teuthology.orchestra.run.smithi092.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-05-14T15:03:21.402 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.402 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-base-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.402 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.402 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.402 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-grafana-dashboards-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:21.402 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-immutable-object-cache-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.402 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mds-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.402 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.402 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:21.402 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-dashboard-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:21.402 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-diskprediction-local-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:21.402 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-modules-core-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:21.402 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mgr-rook-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-mon-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-osd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-prometheus-alerts-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-radosgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-selinux-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-test-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: ceph-volume-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: cephadm-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-shell-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: cephfs-top-2:19.0.0-3588.ge2b755a6.el9.noarch 2024-05-14T15:03:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-05-14T15:03:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: flex-2.6.4-9.el9.x86_64 2024-05-14T15:03:21.403 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-05-14T15:03:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-05-14T15:03:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-05-14T15:03:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: fuse-2.9.9-15.el9.x86_64 2024-05-14T15:03:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-05-14T15:03:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: grpc-data-1.46.7-10.el9.noarch 2024-05-14T15:03:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-05-14T15:03:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-9.0.0-11.el9.x86_64 2024-05-14T15:03:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-05-14T15:03:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: libcephfs2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: libcephsqlite-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-05-14T15:03:21.404 INFO:teuthology.orchestra.run.smithi092.stdout: liboath-2.6.7-2.el9.x86_64 2024-05-14T15:03:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-05-14T15:03:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-05-14T15:03:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-05-14T15:03:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: librados-devel-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: libradosstriper1-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-05-14T15:03:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: librgw2-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: libtool-2.4.6-45.el9.x86_64 2024-05-14T15:03:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: libunwind-1.6.2-1.el9.x86_64 2024-05-14T15:03:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-05-14T15:03:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-05-14T15:03:21.405 INFO:teuthology.orchestra.run.smithi092.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-05-14T15:03:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: lua-5.4.4-4.el9.x86_64 2024-05-14T15:03:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-05-14T15:03:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: luarocks-3.9.2-1.el9.noarch 2024-05-14T15:03:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-0.3.21-2.el9.x86_64 2024-05-14T15:03:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-05-14T15:03:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: openssl-devel-1:3.2.1-1.el9.x86_64 2024-05-14T15:03:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-05-14T15:03:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-13.14-1.el9.x86_64 2024-05-14T15:03:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-05-14T15:03:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-05-14T15:03:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: postgresql-server-13.14-1.el9.x86_64 2024-05-14T15:03:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-3.14.0-13.el9.x86_64 2024-05-14T15:03:21.406 INFO:teuthology.orchestra.run.smithi092.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-05-14T15:03:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-05-14T15:03:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-05-14T15:03:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: python3-babel-2.9.1-2.el9.noarch 2024-05-14T15:03:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-05-14T15:03:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-05-14T15:03:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-argparse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ceph-common-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cephfs-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-05-14T15:03:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-05-14T15:03:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-05-14T15:03:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-05-14T15:03:21.407 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-05-14T15:03:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-05-14T15:03:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-05-14T15:03:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-05-14T15:03:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: python3-google-auth-1:2.29.0-1.el9.noarch 2024-05-14T15:03:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-05-14T15:03:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-05-14T15:03:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-05-14T15:03:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-05-14T15:03:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-05-14T15:03:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-05-14T15:03:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-05-14T15:03:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-05-14T15:03:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-05-14T15:03:21.408 INFO:teuthology.orchestra.run.smithi092.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-05-14T15:03:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-05-14T15:03:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-05-14T15:03:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: python3-mako-1.1.4-6.el9.noarch 2024-05-14T15:03:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-05-14T15:03:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-05-14T15:03:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-05-14T15:03:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-05-14T15:03:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-05-14T15:03:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-05-14T15:03:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: python3-packaging-20.9-5.el9.noarch 2024-05-14T15:03:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-05-14T15:03:21.409 INFO:teuthology.orchestra.run.smithi092.stdout: python3-ply-3.11-14.el9.noarch 2024-05-14T15:03:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: python3-portend-3.1.0-2.el9.noarch 2024-05-14T15:03:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-05-14T15:03:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-05-14T15:03:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-05-14T15:03:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-05-14T15:03:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-05-14T15:03:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pycparser-2.20-6.el9.noarch 2024-05-14T15:03:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-05-14T15:03:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: python3-pytz-2021.1-5.el9.noarch 2024-05-14T15:03:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rados-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.410 INFO:teuthology.orchestra.run.smithi092.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-05-14T15:03:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-2.25.1-8.el9.noarch 2024-05-14T15:03:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-05-14T15:03:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rgw-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: python3-routes-2.5.1-5.el9.noarch 2024-05-14T15:03:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: python3-rsa-4.9-2.el9.noarch 2024-05-14T15:03:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-05-14T15:03:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-05-14T15:03:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: python3-toml-0.10.2-6.el9.noarch 2024-05-14T15:03:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-05-14T15:03:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-05-14T15:03:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-05-14T15:03:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: python3-webob-1.8.7-6.el9.noarch 2024-05-14T15:03:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-05-14T15:03:21.411 INFO:teuthology.orchestra.run.smithi092.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-05-14T15:03:21.412 INFO:teuthology.orchestra.run.smithi092.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-05-14T15:03:21.412 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-24.02.0-1.el9.x86_64 2024-05-14T15:03:21.412 INFO:teuthology.orchestra.run.smithi092.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-05-14T15:03:21.412 INFO:teuthology.orchestra.run.smithi092.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-05-14T15:03:21.412 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-fuse-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.412 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-mirror-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.412 INFO:teuthology.orchestra.run.smithi092.stdout: rbd-nbd-2:19.0.0-3588.ge2b755a6.el9.x86_64 2024-05-14T15:03:21.412 INFO:teuthology.orchestra.run.smithi092.stdout: re2-1:20211101-3.el9.x86_64 2024-05-14T15:03:21.412 INFO:teuthology.orchestra.run.smithi092.stdout: socat-1.7.4.1-5.el9.x86_64 2024-05-14T15:03:21.412 INFO:teuthology.orchestra.run.smithi092.stdout: thrift-0.15.0-2.el9.x86_64 2024-05-14T15:03:21.412 INFO:teuthology.orchestra.run.smithi092.stdout: uuid-1.6.2-55.el9.x86_64 2024-05-14T15:03:21.412 INFO:teuthology.orchestra.run.smithi092.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-05-14T15:03:21.412 INFO:teuthology.orchestra.run.smithi092.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-05-14T15:03:21.413 INFO:teuthology.orchestra.run.smithi092.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-05-14T15:03:21.413 INFO:teuthology.orchestra.run.smithi092.stdout: 2024-05-14T15:03:21.413 INFO:teuthology.orchestra.run.smithi092.stdout:Complete! 2024-05-14T15:03:22.049 DEBUG:teuthology.parallel:result is None 2024-05-14T15:03:22.050 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T15:03:22.203 DEBUG:teuthology.orchestra.run.smithi069:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-14T15:03:22.274 INFO:teuthology.orchestra.run.smithi069.stdout:19.0.0-3588.ge2b755a6.el9 2024-05-14T15:03:22.275 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3588.ge2b755a6.el9 2024-05-14T15:03:22.275 INFO:teuthology.task.install:The correct ceph version 19.0.0-3588.ge2b755a6 is installed. 2024-05-14T15:03:22.277 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T15:03:22.492 DEBUG:teuthology.orchestra.run.smithi092:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-14T15:03:22.547 INFO:teuthology.orchestra.run.smithi092.stdout:19.0.0-3588.ge2b755a6.el9 2024-05-14T15:03:22.547 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3588.ge2b755a6.el9 2024-05-14T15:03:22.547 INFO:teuthology.task.install:The correct ceph version 19.0.0-3588.ge2b755a6 is installed. 2024-05-14T15:03:22.549 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T15:03:22.764 DEBUG:teuthology.orchestra.run.smithi203:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-05-14T15:03:22.834 INFO:teuthology.orchestra.run.smithi203.stdout:19.0.0-3588.ge2b755a6.el9 2024-05-14T15:03:22.835 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3588.ge2b755a6.el9 2024-05-14T15:03:22.835 INFO:teuthology.task.install:The correct ceph version 19.0.0-3588.ge2b755a6 is installed. 2024-05-14T15:03:22.836 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-14T15:03:22.837 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:03:22.837 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T15:03:22.924 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-05-14T15:03:22.924 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T15:03:22.990 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-05-14T15:03:22.990 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-14T15:03:23.081 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-14T15:03:23.081 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:03:23.081 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T15:03:23.164 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T15:03:23.241 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-05-14T15:03:23.241 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T15:03:23.307 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T15:03:23.412 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-05-14T15:03:23.412 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/daemon-helper 2024-05-14T15:03:23.503 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-14T15:03:23.632 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-14T15:03:23.633 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:03:23.633 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T15:03:23.721 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T15:03:23.849 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-05-14T15:03:23.850 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T15:03:23.918 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T15:03:24.018 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-05-14T15:03:24.018 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-14T15:03:24.109 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-14T15:03:24.239 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-14T15:03:24.239 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:03:24.239 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T15:03:24.326 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T15:03:24.408 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-05-14T15:03:24.408 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T15:03:24.471 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T15:03:24.571 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-05-14T15:03:24.571 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/usr/bin/stdin-killer 2024-05-14T15:03:24.658 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-14T15:03:24.742 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-14T15:03:24.846 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-05-14T15:03:24.846 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T15:03:24.847 INFO:tasks.cephadm:Cluster fsid is 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:03:24.847 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-14T15:03:24.847 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.69', 'mon.b': '172.21.15.92', 'mon.c': '172.21.15.203'} 2024-05-14T15:03:24.848 INFO:tasks.cephadm:First mon is mon.a on smithi069 2024-05-14T15:03:24.848 INFO:tasks.cephadm:First mgr is x 2024-05-14T15:03:24.848 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-14T15:03:24.848 DEBUG:teuthology.orchestra.run.smithi069:> sudo hostname $(hostname -s) 2024-05-14T15:03:24.938 DEBUG:teuthology.orchestra.run.smithi092:> sudo hostname $(hostname -s) 2024-05-14T15:03:25.018 DEBUG:teuthology.orchestra.run.smithi203:> sudo hostname $(hostname -s) 2024-05-14T15:03:25.110 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-05-14T15:03:25.110 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T15:03:25.255 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79237/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3588-ge2b755a6', 'node_name': '172.21.2.1+braggi01', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3588.ge2b755a6'}, 'url': 'https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-09 07:03:10.506903', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20240509.053109-debug', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}, {'status': 'ready', 'sha1': 'e2b755a64f0d72176b57299d02e880cf0620d780', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/79236/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.0.0-3588-ge2b755a6', 'node_name': '172.21.5.34+adami04', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.0.0-3588.ge2b755a6'}, 'url': 'https://3.chacra.ceph.com/r/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-05-09 06:43:33.316648', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'wip-vshankar-testing-20240509.053109-debug', 'chacra_url': 'https://3.chacra.ceph.com/repos/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-05-14T15:03:25.398 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref wip-vshankar-testing-20240509.053109-debug, sha1 e2b755a64f0d72176b57299d02e880cf0620d780 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T15:03:25.400 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/x86_64/flavors/default/cephadm 2024-05-14T15:03:25.400 DEBUG:teuthology.orchestra.run.smithi069:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-14T15:03:25.973 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-r--r--. 1 ubuntu ubuntu 782846 May 14 15:03 /home/ubuntu/cephtest/cephadm 2024-05-14T15:03:25.973 DEBUG:teuthology.orchestra.run.smithi092:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-14T15:03:26.774 INFO:teuthology.orchestra.run.smithi092.stdout:-rw-r--r--. 1 ubuntu ubuntu 782846 May 14 15:03 /home/ubuntu/cephtest/cephadm 2024-05-14T15:03:26.775 DEBUG:teuthology.orchestra.run.smithi203:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/wip-vshankar-testing-20240509.053109-debug/e2b755a64f0d72176b57299d02e880cf0620d780/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-14T15:03:27.321 INFO:teuthology.orchestra.run.smithi203.stdout:-rw-r--r--. 1 ubuntu ubuntu 782846 May 14 15:03 /home/ubuntu/cephtest/cephadm 2024-05-14T15:03:27.321 DEBUG:teuthology.orchestra.run.smithi069:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-14T15:03:27.382 DEBUG:teuthology.orchestra.run.smithi092:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-14T15:03:27.439 DEBUG:teuthology.orchestra.run.smithi203:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-14T15:03:27.516 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 on all hosts... 2024-05-14T15:03:27.517 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 pull 2024-05-14T15:03:27.524 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 pull 2024-05-14T15:03:27.531 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 pull 2024-05-14T15:03:28.695 INFO:teuthology.orchestra.run.smithi092.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780... 2024-05-14T15:03:28.857 INFO:teuthology.orchestra.run.smithi203.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780... 2024-05-14T15:03:28.904 INFO:teuthology.orchestra.run.smithi069.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780... 2024-05-14T15:04:14.379 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-05-14T15:04:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T15:04:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: "image_id": "bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345", 2024-05-14T15:04:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: "repo_digests": [ 2024-05-14T15:04:14.379 INFO:teuthology.orchestra.run.smithi092.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430" 2024-05-14T15:04:14.380 INFO:teuthology.orchestra.run.smithi092.stdout: ] 2024-05-14T15:04:14.380 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-05-14T15:04:15.155 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-05-14T15:04:15.155 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T15:04:15.155 INFO:teuthology.orchestra.run.smithi203.stdout: "image_id": "bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345", 2024-05-14T15:04:15.155 INFO:teuthology.orchestra.run.smithi203.stdout: "repo_digests": [ 2024-05-14T15:04:15.155 INFO:teuthology.orchestra.run.smithi203.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430" 2024-05-14T15:04:15.155 INFO:teuthology.orchestra.run.smithi203.stdout: ] 2024-05-14T15:04:15.155 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-05-14T15:04:17.483 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:04:17.483 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T15:04:17.484 INFO:teuthology.orchestra.run.smithi069.stdout: "image_id": "bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345", 2024-05-14T15:04:17.484 INFO:teuthology.orchestra.run.smithi069.stdout: "repo_digests": [ 2024-05-14T15:04:17.484 INFO:teuthology.orchestra.run.smithi069.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430" 2024-05-14T15:04:17.484 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-05-14T15:04:17.484 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:04:17.551 DEBUG:teuthology.orchestra.run.smithi069:> sudo mkdir -p /etc/ceph 2024-05-14T15:04:18.036 DEBUG:teuthology.orchestra.run.smithi092:> sudo mkdir -p /etc/ceph 2024-05-14T15:04:18.129 DEBUG:teuthology.orchestra.run.smithi203:> sudo mkdir -p /etc/ceph 2024-05-14T15:04:18.223 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 777 /etc/ceph 2024-05-14T15:04:18.308 DEBUG:teuthology.orchestra.run.smithi092:> sudo chmod 777 /etc/ceph 2024-05-14T15:04:18.395 DEBUG:teuthology.orchestra.run.smithi203:> sudo chmod 777 /etc/ceph 2024-05-14T15:04:18.477 INFO:tasks.cephadm:Writing seed config... 2024-05-14T15:04:18.478 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-05-14T15:04:18.478 INFO:tasks.cephadm: override: [client] debug client = 20 2024-05-14T15:04:18.478 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-05-14T15:04:18.479 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-05-14T15:04:18.479 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-05-14T15:04:18.479 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-05-14T15:04:18.479 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-05-14T15:04:18.479 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-05-14T15:04:18.479 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-05-14T15:04:18.479 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-05-14T15:04:18.479 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-05-14T15:04:18.479 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-05-14T15:04:18.479 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-05-14T15:04:18.479 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-05-14T15:04:18.479 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-05-14T15:04:18.479 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-05-14T15:04:18.479 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-05-14T15:04:18.479 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-05-14T15:04:18.480 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-05-14T15:04:18.480 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-05-14T15:04:18.480 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-05-14T15:04:18.480 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-05-14T15:04:18.480 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-05-14T15:04:18.480 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-14T15:04:18.480 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-14T15:04:18.480 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-14T15:04:18.480 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-14T15:04:18.480 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-14T15:04:18.480 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-05-14T15:04:18.480 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-05-14T15:04:18.480 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-05-14T15:04:18.480 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-05-14T15:04:18.480 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-05-14T15:04:18.481 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-05-14T15:04:18.481 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-14T15:04:18.481 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-14T15:04:18.481 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-05-14T15:04:18.481 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-05-14T15:04:18.481 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-05-14T15:04:18.481 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-05-14T15:04:18.481 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-05-14T15:04:18.481 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-05-14T15:04:18.481 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-05-14T15:04:18.481 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-05-14T15:04:18.481 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-05-14T15:04:18.482 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:04:18.482 DEBUG:teuthology.orchestra.run.smithi069:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-14T15:04:18.538 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 1cc2580e-1203-11ef-bc98-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-05-14T15:04:18.539 DEBUG:teuthology.orchestra.run.smithi069:mon.a> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mon.a.service 2024-05-14T15:04:18.587 DEBUG:teuthology.orchestra.run.smithi069:mgr.x> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mgr.x.service 2024-05-14T15:04:18.632 INFO:tasks.cephadm:Bootstrapping... 2024-05-14T15:04:18.632 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 -v bootstrap --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.69 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-14T15:04:18.900 INFO:teuthology.orchestra.run.smithi069.stdout:-------------------------------------------------------------------------------- 2024-05-14T15:04:18.900 INFO:teuthology.orchestra.run.smithi069.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780', '-v', 'bootstrap', '--fsid', '1cc2580e-1203-11ef-bc98-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.69', '--skip-admin-label'] 2024-05-14T15:04:18.900 INFO:teuthology.orchestra.run.smithi069.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-05-14T15:04:18.901 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying podman|docker is present... 2024-05-14T15:04:18.961 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stdout 5.0.2 2024-05-14T15:04:18.961 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying lvm2 is present... 2024-05-14T15:04:18.961 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying time synchronization is in place... 2024-05-14T15:04:18.974 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-14T15:04:18.974 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-14T15:04:18.993 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-14T15:04:18.993 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2024-05-14T15:04:19.016 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout enabled 2024-05-14T15:04:19.038 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout active 2024-05-14T15:04:19.038 INFO:teuthology.orchestra.run.smithi069.stdout:Unit chronyd.service is enabled and running 2024-05-14T15:04:19.038 INFO:teuthology.orchestra.run.smithi069.stdout:Repeating the final host check... 2024-05-14T15:04:19.095 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stdout 5.0.2 2024-05-14T15:04:19.095 INFO:teuthology.orchestra.run.smithi069.stdout:podman (/bin/podman) version 5.0.2 is present 2024-05-14T15:04:19.095 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl is present 2024-05-14T15:04:19.095 INFO:teuthology.orchestra.run.smithi069.stdout:lvcreate is present 2024-05-14T15:04:19.108 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-05-14T15:04:19.108 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-05-14T15:04:19.125 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-05-14T15:04:19.125 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2024-05-14T15:04:19.149 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout enabled 2024-05-14T15:04:19.171 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout active 2024-05-14T15:04:19.172 INFO:teuthology.orchestra.run.smithi069.stdout:Unit chronyd.service is enabled and running 2024-05-14T15:04:19.172 INFO:teuthology.orchestra.run.smithi069.stdout:Host looks OK 2024-05-14T15:04:19.172 INFO:teuthology.orchestra.run.smithi069.stdout:Cluster fsid: 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:04:19.172 INFO:teuthology.orchestra.run.smithi069.stdout:Acquiring lock 140231180644304 on /run/cephadm/1cc2580e-1203-11ef-bc98-c7b262605968.lock 2024-05-14T15:04:19.173 INFO:teuthology.orchestra.run.smithi069.stdout:Lock 140231180644304 acquired on /run/cephadm/1cc2580e-1203-11ef-bc98-c7b262605968.lock 2024-05-14T15:04:19.174 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying IP 172.21.15.69 port 3300 ... 2024-05-14T15:04:19.175 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying IP 172.21.15.69 port 6789 ... 2024-05-14T15:04:19.175 INFO:teuthology.orchestra.run.smithi069.stdout:Base mon IP(s) is [172.21.15.69:3300, 172.21.15.69:6789], mon addrv is [v2:172.21.15.69:3300,v1:172.21.15.69:6789] 2024-05-14T15:04:19.190 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.69 metric 100 2024-05-14T15:04:19.190 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.69 metric 100 2024-05-14T15:04:19.202 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-05-14T15:04:19.202 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-05-14T15:04:19.203 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1751sec hoplimit 64 pref medium 2024-05-14T15:04:19.214 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-14T15:04:19.214 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-05-14T15:04:19.214 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-14T15:04:19.214 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-05-14T15:04:19.214 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d737/64 scope link 2024-05-14T15:04:19.214 INFO:teuthology.orchestra.run.smithi069.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-05-14T15:04:19.217 INFO:teuthology.orchestra.run.smithi069.stdout:Mon IP `172.21.15.69` is in CIDR network `172.21.0.0/20` 2024-05-14T15:04:19.217 INFO:teuthology.orchestra.run.smithi069.stdout:Mon IP `172.21.15.69` is in CIDR network `172.21.0.0/20` 2024-05-14T15:04:19.217 INFO:teuthology.orchestra.run.smithi069.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-05-14T15:04:19.220 INFO:teuthology.orchestra.run.smithi069.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-14T15:04:19.222 INFO:teuthology.orchestra.run.smithi069.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780... 2024-05-14T15:04:19.829 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stdout bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 2024-05-14T15:04:19.829 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780... 2024-05-14T15:04:19.829 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Getting image source signatures 2024-05-14T15:04:19.830 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Copying blob sha256:bf5b95bd68251da39c6cd2eb96c6ba4138bb37a62bdc39287908b25e92047d7e 2024-05-14T15:04:19.830 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Copying blob sha256:d2511a189d36a438cd7259d98515a840197dc63bdcef8f78efcfd8f43785c919 2024-05-14T15:04:19.830 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Copying config sha256:bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 2024-05-14T15:04:19.830 INFO:teuthology.orchestra.run.smithi069.stdout:/bin/podman: stderr Writing manifest to image destination 2024-05-14T15:04:21.134 INFO:teuthology.orchestra.run.smithi069.stdout:ceph: stdout ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev) 2024-05-14T15:04:21.135 INFO:teuthology.orchestra.run.smithi069.stdout:Ceph version: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev) 2024-05-14T15:04:21.135 INFO:teuthology.orchestra.run.smithi069.stdout:Extracting ceph user uid/gid from container image... 2024-05-14T15:04:22.530 INFO:teuthology.orchestra.run.smithi069.stdout:stat: stdout 167 167 2024-05-14T15:04:22.530 INFO:teuthology.orchestra.run.smithi069.stdout:Creating initial keys... 2024-05-14T15:04:23.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph-authtool: stdout AQB3fUNm87KuBRAA+hcx7Zc72TATl7pX3aIEPQ== 2024-05-14T15:04:24.830 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph-authtool: stdout AQB4fUNmIX7hDhAA82abbW20/6grVlYE8VXi7A== 2024-05-14T15:04:26.030 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph-authtool: stdout AQB5fUNmLxr2FhAA5lJP31e+dQnkdo+9N2sucQ== 2024-05-14T15:04:26.031 INFO:teuthology.orchestra.run.smithi069.stdout:Creating initial monmap... 2024-05-14T15:04:28.381 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-14T15:04:28.381 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-05-14T15:04:28.381 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:04:28.381 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-14T15:04:28.381 INFO:teuthology.orchestra.run.smithi069.stdout:monmaptool for a [v2:172.21.15.69:3300,v1:172.21.15.69:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-14T15:04:28.381 INFO:teuthology.orchestra.run.smithi069.stdout:setting min_mon_release = quincy 2024-05-14T15:04:28.381 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: set fsid to 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:04:28.382 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-14T15:04:28.382 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:04:28.382 INFO:teuthology.orchestra.run.smithi069.stdout:Creating mon... 2024-05-14T15:04:29.636 INFO:teuthology.orchestra.run.smithi069.stdout:create mon.a on 2024-05-14T15:04:30.023 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-05-14T15:04:30.265 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-14T15:04:30.573 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-1cc2580e-1203-11ef-bc98-c7b262605968.target → /etc/systemd/system/ceph-1cc2580e-1203-11ef-bc98-c7b262605968.target. 2024-05-14T15:04:30.573 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-1cc2580e-1203-11ef-bc98-c7b262605968.target → /etc/systemd/system/ceph-1cc2580e-1203-11ef-bc98-c7b262605968.target. 2024-05-14T15:04:30.946 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mon.a 2024-05-14T15:04:30.946 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mon.a.service: Unit ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mon.a.service not loaded. 2024-05-14T15:04:31.257 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1cc2580e-1203-11ef-bc98-c7b262605968.target.wants/ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mon.a.service → /etc/systemd/system/ceph-1cc2580e-1203-11ef-bc98-c7b262605968@.service. 2024-05-14T15:04:31.963 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:31 smithi069 podman[30874]: 2024-05-14 15:04:31.906417747 +0000 UTC m=+0.371799158 container start 01a7b31a4a5a353b6baacdc5913411dfea48a8a74240017b99e3d92d46c0be77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-14T15:04:32.034 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-14T15:04:32.034 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout disabled 2024-05-14T15:04:32.051 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-14T15:04:32.051 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2024-05-14T15:04:32.051 INFO:teuthology.orchestra.run.smithi069.stdout:firewalld.service is not enabled 2024-05-14T15:04:32.051 INFO:teuthology.orchestra.run.smithi069.stdout:Not possible to enable service . firewalld.service is not available 2024-05-14T15:04:32.051 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mon to start... 2024-05-14T15:04:32.051 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mon... 2024-05-14T15:04:32.342 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:32 smithi069 bash[30874]: 01a7b31a4a5a353b6baacdc5913411dfea48a8a74240017b99e3d92d46c0be77 2024-05-14T15:04:32.343 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:32 smithi069 systemd[1]: Started Ceph mon.a for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:04:32.343 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:32 smithi069 ceph-mon[30893]: mkfs 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:04:32.343 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:32 smithi069 ceph-mon[30893]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-14T15:04:33.335 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:33 smithi069 ceph-mon[30893]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-14T15:04:33.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:33 smithi069 ceph-mon[30893]: monmap epoch 1 2024-05-14T15:04:33.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:33 smithi069 ceph-mon[30893]: fsid 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:04:33.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:33 smithi069 ceph-mon[30893]: last_changed 2024-05-14T15:04:26.570547+0000 2024-05-14T15:04:33.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:33 smithi069 ceph-mon[30893]: created 2024-05-14T15:04:26.570547+0000 2024-05-14T15:04:33.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:33 smithi069 ceph-mon[30893]: min_mon_release 19 (squid) 2024-05-14T15:04:33.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:33 smithi069 ceph-mon[30893]: election_strategy: 1 2024-05-14T15:04:33.336 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:33 smithi069 ceph-mon[30893]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-05-14T15:04:33.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:33 smithi069 ceph-mon[30893]: fsmap 2024-05-14T15:04:33.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:33 smithi069 ceph-mon[30893]: osdmap e1: 0 total, 0 up, 0 in 2024-05-14T15:04:33.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:33 smithi069 ceph-mon[30893]: mgrmap e1: no daemons active 2024-05-14T15:04:33.337 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:33 smithi069 ceph-mon[30893]: from='client.? 172.21.15.69:0/1368730916' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-14T15:04:33.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout cluster: 2024-05-14T15:04:33.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout id: 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:04:33.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-05-14T15:04:33.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-05-14T15:04:33.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout services: 2024-05-14T15:04:33.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.75458s) 2024-05-14T15:04:33.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-05-14T15:04:33.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-05-14T15:04:33.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-05-14T15:04:33.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout data: 2024-05-14T15:04:33.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-05-14T15:04:33.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-05-14T15:04:33.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-05-14T15:04:33.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout pgs: 2024-05-14T15:04:33.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-05-14T15:04:33.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.735+0000 7f34c8600700 1 Processor -- start 2024-05-14T15:04:33.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.735+0000 7f34c8600700 1 -- start start 2024-05-14T15:04:33.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.736+0000 7f34c8600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34c010bb40 0x7f34c010bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:33.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.736+0000 7f34c8600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f34c010c540 con 0x7f34c010bb40 2024-05-14T15:04:33.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.736+0000 7f34c5c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34c010bb40 0x7f34c010bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:33.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.736+0000 7f34c5c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34c010bb40 0x7f34c010bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53102/0 (socket says 172.21.15.69:53102) 2024-05-14T15:04:33.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.736+0000 7f34c5c00700 1 -- 172.21.15.69:0/1737368340 learned_addr learned my addr 172.21.15.69:0/1737368340 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:33.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.737+0000 7f34c5c00700 1 -- 172.21.15.69:0/1737368340 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c010cd10 con 0x7f34c010bb40 2024-05-14T15:04:33.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.737+0000 7f34c5c00700 1 --2- 172.21.15.69:0/1737368340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34c010bb40 0x7f34c010bf50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f34b40098a0 tx=0x7f34b4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535e086a377e4a66 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:33.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.738+0000 7f34bfe00700 1 -- 172.21.15.69:0/1737368340 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b4004160 con 0x7f34c010bb40 2024-05-14T15:04:33.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.738+0000 7f34bfe00700 1 -- 172.21.15.69:0/1737368340 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b4004300 con 0x7f34c010bb40 2024-05-14T15:04:33.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.738+0000 7f34bfe00700 1 -- 172.21.15.69:0/1737368340 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b40036a0 con 0x7f34c010bb40 2024-05-14T15:04:33.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.738+0000 7f34c8600700 1 -- 172.21.15.69:0/1737368340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34c010bb40 msgr2=0x7f34c010bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:33.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.738+0000 7f34c8600700 1 --2- 172.21.15.69:0/1737368340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34c010bb40 0x7f34c010bf50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f34b40098a0 tx=0x7f34b4009bb0 comp rx=0 tx=0).stop 2024-05-14T15:04:33.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.738+0000 7f34c8600700 1 -- 172.21.15.69:0/1737368340 shutdown_connections 2024-05-14T15:04:33.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.739+0000 7f34c8600700 1 --2- 172.21.15.69:0/1737368340 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34c010bb40 0x7f34c010bf50 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:33.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.739+0000 7f34c8600700 1 -- 172.21.15.69:0/1737368340 >> 172.21.15.69:0/1737368340 conn(0x7f34c0107480 msgr2=0x7f34c01098a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:33.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.739+0000 7f34c8600700 1 -- 172.21.15.69:0/1737368340 shutdown_connections 2024-05-14T15:04:33.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.739+0000 7f34c8600700 1 -- 172.21.15.69:0/1737368340 wait complete. 2024-05-14T15:04:33.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.740+0000 7f34c8600700 1 Processor -- start 2024-05-14T15:04:33.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.741+0000 7f34c8600700 1 -- start start 2024-05-14T15:04:33.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.741+0000 7f34c8600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34c010bb40 0x7f34c019f670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:33.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.741+0000 7f34c8600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f34c010d240 con 0x7f34c010bb40 2024-05-14T15:04:33.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.741+0000 7f34c5c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34c010bb40 0x7f34c019f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:33.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.742+0000 7f34c5c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34c010bb40 0x7f34c019f670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53104/0 (socket says 172.21.15.69:53104) 2024-05-14T15:04:33.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.742+0000 7f34c5c00700 1 -- 172.21.15.69:0/1368730916 learned_addr learned my addr 172.21.15.69:0/1368730916 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:33.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.742+0000 7f34c5c00700 1 -- 172.21.15.69:0/1368730916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34c019fbb0 con 0x7f34c010bb40 2024-05-14T15:04:33.680 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.742+0000 7f34c5c00700 1 --2- 172.21.15.69:0/1368730916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34c010bb40 0x7f34c019f670 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f34c010c7a0 tx=0x7f34b4004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:33.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.743+0000 7f34be000700 1 -- 172.21.15.69:0/1368730916 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b4003db0 con 0x7f34c010bb40 2024-05-14T15:04:33.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.743+0000 7f34be000700 1 -- 172.21.15.69:0/1368730916 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34b4011630 con 0x7f34c010bb40 2024-05-14T15:04:33.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.743+0000 7f34c8600700 1 -- 172.21.15.69:0/1368730916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34c019fe40 con 0x7f34c010bb40 2024-05-14T15:04:33.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.743+0000 7f34be000700 1 -- 172.21.15.69:0/1368730916 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34b4011930 con 0x7f34c010bb40 2024-05-14T15:04:33.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.743+0000 7f34c8600700 1 -- 172.21.15.69:0/1368730916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34c01a2a50 con 0x7f34c010bb40 2024-05-14T15:04:33.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.743+0000 7f34be000700 1 -- 172.21.15.69:0/1368730916 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f34b4024480 con 0x7f34c010bb40 2024-05-14T15:04:33.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.743+0000 7f34be000700 1 -- 172.21.15.69:0/1368730916 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f34b401ab80 con 0x7f34c010bb40 2024-05-14T15:04:33.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.744+0000 7f34c8600700 1 -- 172.21.15.69:0/1368730916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34c0064e20 con 0x7f34c010bb40 2024-05-14T15:04:33.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.748+0000 7f34be000700 1 -- 172.21.15.69:0/1368730916 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f34b4004260 con 0x7f34c010bb40 2024-05-14T15:04:33.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.826+0000 7f34c8600700 1 -- 172.21.15.69:0/1368730916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f34c002e860 con 0x7f34c010bb40 2024-05-14T15:04:33.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.827+0000 7f34be000700 1 -- 172.21.15.69:0/1368730916 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+316 (secure 0 0 0) 0x7f34b401ad80 con 0x7f34c010bb40 2024-05-14T15:04:33.681 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.828+0000 7f34c8600700 1 -- 172.21.15.69:0/1368730916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34c010bb40 msgr2=0x7f34c019f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:33.682 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.828+0000 7f34c8600700 1 --2- 172.21.15.69:0/1368730916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34c010bb40 0x7f34c019f670 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f34c010c7a0 tx=0x7f34b4004750 comp rx=0 tx=0).stop 2024-05-14T15:04:33.682 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.828+0000 7f34c8600700 1 -- 172.21.15.69:0/1368730916 shutdown_connections 2024-05-14T15:04:33.682 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.828+0000 7f34c8600700 1 --2- 172.21.15.69:0/1368730916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f34c010bb40 0x7f34c019f670 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:33.682 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.828+0000 7f34c8600700 1 -- 172.21.15.69:0/1368730916 >> 172.21.15.69:0/1368730916 conn(0x7f34c0107480 msgr2=0x7f34c0195cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:33.682 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.828+0000 7f34c8600700 1 -- 172.21.15.69:0/1368730916 shutdown_connections 2024-05-14T15:04:33.682 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:32.828+0000 7f34c8600700 1 -- 172.21.15.69:0/1368730916 wait complete. 2024-05-14T15:04:33.682 INFO:teuthology.orchestra.run.smithi069.stdout:mon is available 2024-05-14T15:04:33.682 INFO:teuthology.orchestra.run.smithi069.stdout:Assimilating anything we can from ceph.conf... 2024-05-14T15:04:34.712 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:34 smithi069 ceph-mon[30893]: from='client.? 172.21.15.69:0/2543240170' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-14T15:04:34.712 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:34 smithi069 ceph-mon[30893]: from='client.? 172.21.15.69:0/2543240170' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-14T15:04:35.109 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-05-14T15:04:35.109 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [global] 2024-05-14T15:04:35.109 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout fsid = 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:04:35.110 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-14T15:04:35.110 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.69:3300,v1:172.21.15.69:6789] 2024-05-14T15:04:35.110 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-14T15:04:35.110 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-14T15:04:35.110 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-14T15:04:35.110 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-14T15:04:35.110 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-05-14T15:04:35.110 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-14T15:04:35.110 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-14T15:04:35.110 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-05-14T15:04:35.110 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [osd] 2024-05-14T15:04:35.110 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-14T15:04:35.110 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-14T15:04:35.110 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-14T15:04:35.111 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-14T15:04:35.111 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-14T15:04:35.111 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.338+0000 7f7c39200700 1 Processor -- start 2024-05-14T15:04:35.111 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.338+0000 7f7c39200700 1 -- start start 2024-05-14T15:04:35.111 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.339+0000 7f7c39200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c3410bb60 0x7f7c3410bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:35.111 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.339+0000 7f7c39200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3410c560 con 0x7f7c3410bb60 2024-05-14T15:04:35.111 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.339+0000 7f7c31e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c3410bb60 0x7f7c3410bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:35.111 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.339+0000 7f7c31e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c3410bb60 0x7f7c3410bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60156/0 (socket says 172.21.15.69:60156) 2024-05-14T15:04:35.111 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.339+0000 7f7c31e00700 1 -- 172.21.15.69:0/2484269412 learned_addr learned my addr 172.21.15.69:0/2484269412 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:35.111 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.340+0000 7f7c31e00700 1 -- 172.21.15.69:0/2484269412 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c3410cd30 con 0x7f7c3410bb60 2024-05-14T15:04:35.111 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.340+0000 7f7c31e00700 1 --2- 172.21.15.69:0/2484269412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c3410bb60 0x7f7c3410bf70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7c240098a0 tx=0x7f7c24009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9576c40afad0709 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:35.111 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.341+0000 7f7c30a00700 1 -- 172.21.15.69:0/2484269412 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c24004160 con 0x7f7c3410bb60 2024-05-14T15:04:35.111 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.341+0000 7f7c30a00700 1 -- 172.21.15.69:0/2484269412 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c24004300 con 0x7f7c3410bb60 2024-05-14T15:04:35.111 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.341+0000 7f7c30a00700 1 -- 172.21.15.69:0/2484269412 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c240036a0 con 0x7f7c3410bb60 2024-05-14T15:04:35.111 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.342+0000 7f7c39200700 1 -- 172.21.15.69:0/2484269412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c3410bb60 msgr2=0x7f7c3410bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:35.112 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.342+0000 7f7c39200700 1 --2- 172.21.15.69:0/2484269412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c3410bb60 0x7f7c3410bf70 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f7c240098a0 tx=0x7f7c24009bb0 comp rx=0 tx=0).stop 2024-05-14T15:04:35.112 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.342+0000 7f7c39200700 1 -- 172.21.15.69:0/2484269412 shutdown_connections 2024-05-14T15:04:35.112 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.342+0000 7f7c39200700 1 --2- 172.21.15.69:0/2484269412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c3410bb60 0x7f7c3410bf70 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:35.112 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.342+0000 7f7c39200700 1 -- 172.21.15.69:0/2484269412 >> 172.21.15.69:0/2484269412 conn(0x7f7c3407f090 msgr2=0x7f7c34109d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:35.112 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.342+0000 7f7c39200700 1 -- 172.21.15.69:0/2484269412 shutdown_connections 2024-05-14T15:04:35.112 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.342+0000 7f7c39200700 1 -- 172.21.15.69:0/2484269412 wait complete. 2024-05-14T15:04:35.112 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.343+0000 7f7c39200700 1 Processor -- start 2024-05-14T15:04:35.112 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.343+0000 7f7c39200700 1 -- start start 2024-05-14T15:04:35.112 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.343+0000 7f7c39200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c3410bb60 0x7f7c3419f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:35.112 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.344+0000 7f7c39200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7c3410d260 con 0x7f7c3410bb60 2024-05-14T15:04:35.112 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.344+0000 7f7c31e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c3410bb60 0x7f7c3419f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:35.112 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.344+0000 7f7c31e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c3410bb60 0x7f7c3419f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60162/0 (socket says 172.21.15.69:60162) 2024-05-14T15:04:35.112 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.344+0000 7f7c31e00700 1 -- 172.21.15.69:0/2543240170 learned_addr learned my addr 172.21.15.69:0/2543240170 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:35.112 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.344+0000 7f7c31e00700 1 -- 172.21.15.69:0/2543240170 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c3419fc70 con 0x7f7c3410bb60 2024-05-14T15:04:35.113 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.345+0000 7f7c31e00700 1 --2- 172.21.15.69:0/2543240170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c3410bb60 0x7f7c3419f730 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7c24000c00 tx=0x7f7c24004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:35.113 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.345+0000 7f7c2aa00700 1 -- 172.21.15.69:0/2543240170 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c24003db0 con 0x7f7c3410bb60 2024-05-14T15:04:35.113 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.345+0000 7f7c2aa00700 1 -- 172.21.15.69:0/2543240170 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c24011630 con 0x7f7c3410bb60 2024-05-14T15:04:35.113 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.345+0000 7f7c39200700 1 -- 172.21.15.69:0/2543240170 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c3419ff00 con 0x7f7c3410bb60 2024-05-14T15:04:35.113 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.345+0000 7f7c2aa00700 1 -- 172.21.15.69:0/2543240170 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c24011950 con 0x7f7c3410bb60 2024-05-14T15:04:35.113 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.345+0000 7f7c39200700 1 -- 172.21.15.69:0/2543240170 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c341a2b10 con 0x7f7c3410bb60 2024-05-14T15:04:35.113 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.345+0000 7f7c2aa00700 1 -- 172.21.15.69:0/2543240170 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7c2401a460 con 0x7f7c3410bb60 2024-05-14T15:04:35.113 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.345+0000 7f7c2aa00700 1 -- 172.21.15.69:0/2543240170 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7c2401b780 con 0x7f7c3410bb60 2024-05-14T15:04:35.113 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.346+0000 7f7c39200700 1 -- 172.21.15.69:0/2543240170 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c341a0360 con 0x7f7c3410bb60 2024-05-14T15:04:35.113 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.349+0000 7f7c2aa00700 1 -- 172.21.15.69:0/2543240170 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7c2401b980 con 0x7f7c3410bb60 2024-05-14T15:04:35.113 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.427+0000 7f7c39200700 1 -- 172.21.15.69:0/2543240170 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f7c3402e800 con 0x7f7c3410bb60 2024-05-14T15:04:35.113 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.436+0000 7f7c2aa00700 1 -- 172.21.15.69:0/2543240170 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+465 (secure 0 0 0) 0x7f7c2401bb60 con 0x7f7c3410bb60 2024-05-14T15:04:35.113 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.438+0000 7f7c39200700 1 -- 172.21.15.69:0/2543240170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c3410bb60 msgr2=0x7f7c3419f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:35.113 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.438+0000 7f7c39200700 1 --2- 172.21.15.69:0/2543240170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c3410bb60 0x7f7c3419f730 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f7c24000c00 tx=0x7f7c24004750 comp rx=0 tx=0).stop 2024-05-14T15:04:35.114 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.438+0000 7f7c39200700 1 -- 172.21.15.69:0/2543240170 shutdown_connections 2024-05-14T15:04:35.114 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.438+0000 7f7c39200700 1 --2- 172.21.15.69:0/2543240170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7c3410bb60 0x7f7c3419f730 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:35.114 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.439+0000 7f7c39200700 1 -- 172.21.15.69:0/2543240170 >> 172.21.15.69:0/2543240170 conn(0x7f7c3407f090 msgr2=0x7f7c341936a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:35.114 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.439+0000 7f7c39200700 1 -- 172.21.15.69:0/2543240170 shutdown_connections 2024-05-14T15:04:35.114 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:34.439+0000 7f7c39200700 1 -- 172.21.15.69:0/2543240170 wait complete. 2024-05-14T15:04:35.114 INFO:teuthology.orchestra.run.smithi069.stdout:Generating new minimal ceph.conf... 2024-05-14T15:04:36.163 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:35 smithi069 ceph-mon[30893]: from='client.? 172.21.15.69:0/3971655704' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:04:36.507 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.748+0000 7f5423000700 1 Processor -- start 2024-05-14T15:04:36.507 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.748+0000 7f5423000700 1 -- start start 2024-05-14T15:04:36.508 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.749+0000 7f5423000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f541c10a410 0x7f541c10c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:36.508 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.749+0000 7f5423000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f541c07ce40 con 0x7f541c10a410 2024-05-14T15:04:36.508 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.749+0000 7f541be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f541c10a410 0x7f541c10c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:36.508 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.750+0000 7f541be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f541c10a410 0x7f541c10c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60164/0 (socket says 172.21.15.69:60164) 2024-05-14T15:04:36.508 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.750+0000 7f541be00700 1 -- 172.21.15.69:0/2385883077 learned_addr learned my addr 172.21.15.69:0/2385883077 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:36.508 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.750+0000 7f541be00700 1 -- 172.21.15.69:0/2385883077 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541c10cd70 con 0x7f541c10a410 2024-05-14T15:04:36.508 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.750+0000 7f541be00700 1 --2- 172.21.15.69:0/2385883077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f541c10a410 0x7f541c10c830 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f540c0098a0 tx=0x7f540c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44309af59559b802 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:36.508 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.751+0000 7f541aa00700 1 -- 172.21.15.69:0/2385883077 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f540c004160 con 0x7f541c10a410 2024-05-14T15:04:36.508 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.751+0000 7f541aa00700 1 -- 172.21.15.69:0/2385883077 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f540c004300 con 0x7f541c10a410 2024-05-14T15:04:36.508 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.751+0000 7f541aa00700 1 -- 172.21.15.69:0/2385883077 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f540c0119e0 con 0x7f541c10a410 2024-05-14T15:04:36.508 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.752+0000 7f5423000700 1 -- 172.21.15.69:0/2385883077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f541c10a410 msgr2=0x7f541c10c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:36.508 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.752+0000 7f5423000700 1 --2- 172.21.15.69:0/2385883077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f541c10a410 0x7f541c10c830 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f540c0098a0 tx=0x7f540c009bb0 comp rx=0 tx=0).stop 2024-05-14T15:04:36.508 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.752+0000 7f5423000700 1 -- 172.21.15.69:0/2385883077 shutdown_connections 2024-05-14T15:04:36.508 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.752+0000 7f5423000700 1 --2- 172.21.15.69:0/2385883077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f541c10a410 0x7f541c10c830 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:36.509 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.752+0000 7f5423000700 1 -- 172.21.15.69:0/2385883077 >> 172.21.15.69:0/2385883077 conn(0x7f541c103ed0 msgr2=0x7f541c106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:36.509 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.752+0000 7f5423000700 1 -- 172.21.15.69:0/2385883077 shutdown_connections 2024-05-14T15:04:36.509 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.752+0000 7f5423000700 1 -- 172.21.15.69:0/2385883077 wait complete. 2024-05-14T15:04:36.509 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.754+0000 7f5423000700 1 Processor -- start 2024-05-14T15:04:36.509 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.754+0000 7f5423000700 1 -- start start 2024-05-14T15:04:36.509 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.754+0000 7f5423000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f541c10a410 0x7f541c19dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:36.509 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.754+0000 7f5423000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f541c10dcd0 con 0x7f541c10a410 2024-05-14T15:04:36.509 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.755+0000 7f541be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f541c10a410 0x7f541c19dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:36.509 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.755+0000 7f541be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f541c10a410 0x7f541c19dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60176/0 (socket says 172.21.15.69:60176) 2024-05-14T15:04:36.509 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.755+0000 7f541be00700 1 -- 172.21.15.69:0/3971655704 learned_addr learned my addr 172.21.15.69:0/3971655704 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:36.509 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.755+0000 7f541be00700 1 -- 172.21.15.69:0/3971655704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f541c19e190 con 0x7f541c10a410 2024-05-14T15:04:36.509 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.755+0000 7f541be00700 1 --2- 172.21.15.69:0/3971655704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f541c10a410 0x7f541c19dc50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f540c0119b0 tx=0x7f540c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:36.509 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.756+0000 7f5418c00700 1 -- 172.21.15.69:0/3971655704 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f540c003af0 con 0x7f541c10a410 2024-05-14T15:04:36.509 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.756+0000 7f5418c00700 1 -- 172.21.15.69:0/3971655704 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f540c01a8a0 con 0x7f541c10a410 2024-05-14T15:04:36.510 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.756+0000 7f5423000700 1 -- 172.21.15.69:0/3971655704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f541c19e420 con 0x7f541c10a410 2024-05-14T15:04:36.510 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.756+0000 7f5418c00700 1 -- 172.21.15.69:0/3971655704 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f540c024830 con 0x7f541c10a410 2024-05-14T15:04:36.510 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.756+0000 7f5423000700 1 -- 172.21.15.69:0/3971655704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f541c1a1030 con 0x7f541c10a410 2024-05-14T15:04:36.510 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.756+0000 7f5418c00700 1 -- 172.21.15.69:0/3971655704 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f540c022020 con 0x7f541c10a410 2024-05-14T15:04:36.510 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.756+0000 7f5418c00700 1 -- 172.21.15.69:0/3971655704 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f540c02dde0 con 0x7f541c10a410 2024-05-14T15:04:36.510 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.757+0000 7f5423000700 1 -- 172.21.15.69:0/3971655704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f541c064e20 con 0x7f541c10a410 2024-05-14T15:04:36.510 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.760+0000 7f5418c00700 1 -- 172.21.15.69:0/3971655704 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f540c01aa50 con 0x7f541c10a410 2024-05-14T15:04:36.510 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.837+0000 7f5423000700 1 -- 172.21.15.69:0/3971655704 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f541c1a1200 con 0x7f541c10a410 2024-05-14T15:04:36.510 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.837+0000 7f5418c00700 1 -- 172.21.15.69:0/3971655704 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7f540c032030 con 0x7f541c10a410 2024-05-14T15:04:36.510 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.839+0000 7f5423000700 1 -- 172.21.15.69:0/3971655704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f541c10a410 msgr2=0x7f541c19dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:36.510 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.839+0000 7f5423000700 1 --2- 172.21.15.69:0/3971655704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f541c10a410 0x7f541c19dc50 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f540c0119b0 tx=0x7f540c011a90 comp rx=0 tx=0).stop 2024-05-14T15:04:36.510 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.839+0000 7f5423000700 1 -- 172.21.15.69:0/3971655704 shutdown_connections 2024-05-14T15:04:36.510 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.839+0000 7f5423000700 1 --2- 172.21.15.69:0/3971655704 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f541c10a410 0x7f541c19dc50 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:36.511 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.839+0000 7f5423000700 1 -- 172.21.15.69:0/3971655704 >> 172.21.15.69:0/3971655704 conn(0x7f541c103ed0 msgr2=0x7f541c104700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:36.511 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.839+0000 7f5423000700 1 -- 172.21.15.69:0/3971655704 shutdown_connections 2024-05-14T15:04:36.511 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:35.839+0000 7f5423000700 1 -- 172.21.15.69:0/3971655704 wait complete. 2024-05-14T15:04:36.511 INFO:teuthology.orchestra.run.smithi069.stdout:Restarting the monitor... 2024-05-14T15:04:36.915 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:36 smithi069 systemd[1]: Stopping Ceph mon.a for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:04:37.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:36 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a[30888]: 2024-05-14T15:04:36.962+0000 7f7fdfc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:04:37.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:36 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a[30888]: 2024-05-14T15:04:36.962+0000 7f7fdfc00700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-14T15:04:37.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:37 smithi069 podman[31138]: 2024-05-14 15:04:37.056397446 +0000 UTC m=+0.195783608 container died 01a7b31a4a5a353b6baacdc5913411dfea48a8a74240017b99e3d92d46c0be77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS) 2024-05-14T15:04:37.657 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:37 smithi069 podman[31138]: 2024-05-14 15:04:37.505841434 +0000 UTC m=+0.645227584 container cleanup 01a7b31a4a5a353b6baacdc5913411dfea48a8a74240017b99e3d92d46c0be77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T15:04:37.658 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:37 smithi069 bash[31138]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a 2024-05-14T15:04:37.962 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:37 smithi069 podman[31150]: 2024-05-14 15:04:37.71528816 +0000 UTC m=+0.640904826 container remove 01a7b31a4a5a353b6baacdc5913411dfea48a8a74240017b99e3d92d46c0be77 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:04:38.295 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:38 smithi069 systemd[1]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-14T15:04:38.295 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:38 smithi069 systemd[1]: Stopped Ceph mon.a for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:04:38.295 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:38 smithi069 systemd[1]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mon.a.service: Consumed 1.832s CPU time. 2024-05-14T15:04:38.295 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:38 smithi069 systemd[1]: Starting Ceph mon.a for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:04:38.672 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:38 smithi069 podman[31251]: 2024-05-14 15:04:38.35980748 +0000 UTC m=+0.037308042 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T15:04:38.925 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:38 smithi069 podman[31251]: 2024-05-14 15:04:38.682953066 +0000 UTC m=+0.360453647 container create bc76d6ff7912cff5c63b93fcdbae2a9d200b7c5bed48a449d8577ae9b14ab5bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-05-14T15:04:38.925 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:38 smithi069 podman[31251]: 2024-05-14 15:04:38.920777427 +0000 UTC m=+0.598278078 container init bc76d6ff7912cff5c63b93fcdbae2a9d200b7c5bed48a449d8577ae9b14ab5bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True) 2024-05-14T15:04:38.925 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:38 smithi069 podman[31251]: 2024-05-14 15:04:38.930564041 +0000 UTC m=+0.608064655 container start bc76d6ff7912cff5c63b93fcdbae2a9d200b7c5bed48a449d8577ae9b14ab5bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T15:04:39.064 INFO:teuthology.orchestra.run.smithi069.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-05-14T15:04:39.212 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: set uid:gid to 167:167 (ceph:ceph) 2024-05-14T15:04:39.212 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev), process ceph-mon, pid 2 2024-05-14T15:04:39.212 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: pidfile_write: ignore empty --pid-file 2024-05-14T15:04:39.212 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: load: jerasure load: lrc 2024-05-14T15:04:39.212 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: RocksDB version: 7.9.2 2024-05-14T15:04:39.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Git sha 0 2024-05-14T15:04:39.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Compile date 2024-05-09 05:50:40 2024-05-14T15:04:39.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: DB SUMMARY 2024-05-14T15:04:39.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: DB Session ID: IUGDSC9Y9TQPMKUF7LRN 2024-05-14T15:04:39.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: CURRENT file: CURRENT 2024-05-14T15:04:39.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: IDENTITY file: IDENTITY 2024-05-14T15:04:39.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-05-14T15:04:39.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-14T15:04:39.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 103990 ; 2024-05-14T15:04:39.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.error_if_exists: 0 2024-05-14T15:04:39.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.create_if_missing: 0 2024-05-14T15:04:39.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.paranoid_checks: 1 2024-05-14T15:04:39.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-14T15:04:39.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-14T15:04:39.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-14T15:04:39.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.env: 0x5650334df500 2024-05-14T15:04:39.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.fs: PosixFileSystem 2024-05-14T15:04:39.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.info_log: 0x565065304060 2024-05-14T15:04:39.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_file_opening_threads: 16 2024-05-14T15:04:39.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.statistics: (nil) 2024-05-14T15:04:39.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.use_fsync: 0 2024-05-14T15:04:39.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_log_file_size: 0 2024-05-14T15:04:39.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-14T15:04:39.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-14T15:04:39.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.keep_log_file_num: 1000 2024-05-14T15:04:39.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.recycle_log_file_num: 0 2024-05-14T15:04:39.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.allow_fallocate: 1 2024-05-14T15:04:39.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.allow_mmap_reads: 0 2024-05-14T15:04:39.214 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.allow_mmap_writes: 0 2024-05-14T15:04:39.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.use_direct_reads: 0 2024-05-14T15:04:39.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-14T15:04:39.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.create_missing_column_families: 0 2024-05-14T15:04:39.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.db_log_dir: 2024-05-14T15:04:39.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.wal_dir: 2024-05-14T15:04:39.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-14T15:04:39.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-14T15:04:39.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-14T15:04:39.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-14T15:04:39.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-14T15:04:39.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-14T15:04:39.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.advise_random_on_open: 1 2024-05-14T15:04:39.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.db_write_buffer_size: 0 2024-05-14T15:04:39.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.write_buffer_manager: 0x5650651ce8c0 2024-05-14T15:04:39.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-14T15:04:39.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-14T15:04:39.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-14T15:04:39.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.rate_limiter: (nil) 2024-05-14T15:04:39.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-14T15:04:39.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.wal_recovery_mode: 2 2024-05-14T15:04:39.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.enable_thread_tracking: 0 2024-05-14T15:04:39.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.enable_pipelined_write: 0 2024-05-14T15:04:39.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.unordered_write: 0 2024-05-14T15:04:39.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-14T15:04:39.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-14T15:04:39.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-14T15:04:39.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-14T15:04:39.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.row_cache: None 2024-05-14T15:04:39.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.wal_filter: None 2024-05-14T15:04:39.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-14T15:04:39.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.allow_ingest_behind: 0 2024-05-14T15:04:39.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.two_write_queues: 0 2024-05-14T15:04:39.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.manual_wal_flush: 0 2024-05-14T15:04:39.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.wal_compression: 0 2024-05-14T15:04:39.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.atomic_flush: 0 2024-05-14T15:04:39.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-14T15:04:39.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-14T15:04:39.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-14T15:04:39.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.log_readahead_size: 0 2024-05-14T15:04:39.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-14T15:04:39.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.best_efforts_recovery: 0 2024-05-14T15:04:39.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-14T15:04:39.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-14T15:04:39.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.allow_data_in_errors: 0 2024-05-14T15:04:39.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.db_host_id: __hostname__ 2024-05-14T15:04:39.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-14T15:04:39.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_background_jobs: 2 2024-05-14T15:04:39.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_background_compactions: -1 2024-05-14T15:04:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_subcompactions: 1 2024-05-14T15:04:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-14T15:04:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-14T15:04:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-14T15:04:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_total_wal_size: 0 2024-05-14T15:04:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-14T15:04:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-14T15:04:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-14T15:04:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-14T15:04:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_open_files: -1 2024-05-14T15:04:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.bytes_per_sync: 0 2024-05-14T15:04:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-14T15:04:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-14T15:04:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compaction_readahead_size: 0 2024-05-14T15:04:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_background_flushes: -1 2024-05-14T15:04:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Compression algorithms supported: 2024-05-14T15:04:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-14T15:04:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: kZSTD supported: 0 2024-05-14T15:04:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: kXpressCompression supported: 0 2024-05-14T15:04:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: kLZ4HCCompression supported: 1 2024-05-14T15:04:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: kZlibCompression supported: 1 2024-05-14T15:04:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: kSnappyCompression supported: 1 2024-05-14T15:04:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: kLZ4Compression supported: 1 2024-05-14T15:04:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: kBZip2Compression supported: 0 2024-05-14T15:04:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-14T15:04:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-14T15:04:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-05-14T15:04:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-14T15:04:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-14T15:04:39.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.merge_operator: 2024-05-14T15:04:39.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compaction_filter: None 2024-05-14T15:04:39.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compaction_filter_factory: None 2024-05-14T15:04:39.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.sst_partitioner_factory: None 2024-05-14T15:04:39.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-14T15:04:39.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-14T15:04:39.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x565065304220) 2024-05-14T15:04:39.221 INFO:journalctl@ceph.mon.a.smithi069.stdout: cache_index_and_filter_blocks: 1 2024-05-14T15:04:39.221 INFO:journalctl@ceph.mon.a.smithi069.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-14T15:04:39.221 INFO:journalctl@ceph.mon.a.smithi069.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-14T15:04:39.221 INFO:journalctl@ceph.mon.a.smithi069.stdout: pin_top_level_index_and_filter: 1 2024-05-14T15:04:39.221 INFO:journalctl@ceph.mon.a.smithi069.stdout: index_type: 0 2024-05-14T15:04:39.221 INFO:journalctl@ceph.mon.a.smithi069.stdout: data_block_index_type: 0 2024-05-14T15:04:39.221 INFO:journalctl@ceph.mon.a.smithi069.stdout: index_shortening: 1 2024-05-14T15:04:39.221 INFO:journalctl@ceph.mon.a.smithi069.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-14T15:04:39.222 INFO:journalctl@ceph.mon.a.smithi069.stdout: checksum: 4 2024-05-14T15:04:39.222 INFO:journalctl@ceph.mon.a.smithi069.stdout: no_block_cache: 0 2024-05-14T15:04:39.222 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_cache: 0x5650652011f0 2024-05-14T15:04:39.222 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_cache_name: BinnedLRUCache 2024-05-14T15:04:39.222 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_cache_options: 2024-05-14T15:04:39.222 INFO:journalctl@ceph.mon.a.smithi069.stdout: capacity : 536870912 2024-05-14T15:04:39.222 INFO:journalctl@ceph.mon.a.smithi069.stdout: num_shard_bits : 4 2024-05-14T15:04:39.222 INFO:journalctl@ceph.mon.a.smithi069.stdout: strict_capacity_limit : 0 2024-05-14T15:04:39.222 INFO:journalctl@ceph.mon.a.smithi069.stdout: high_pri_pool_ratio: 0.000 2024-05-14T15:04:39.222 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_cache_compressed: (nil) 2024-05-14T15:04:39.222 INFO:journalctl@ceph.mon.a.smithi069.stdout: persistent_cache: (nil) 2024-05-14T15:04:39.222 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_size: 4096 2024-05-14T15:04:39.222 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_size_deviation: 10 2024-05-14T15:04:39.222 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_restart_interval: 16 2024-05-14T15:04:39.223 INFO:journalctl@ceph.mon.a.smithi069.stdout: index_block_restart_interval: 1 2024-05-14T15:04:39.223 INFO:journalctl@ceph.mon.a.smithi069.stdout: metadata_block_size: 4096 2024-05-14T15:04:39.223 INFO:journalctl@ceph.mon.a.smithi069.stdout: partition_filters: 0 2024-05-14T15:04:39.223 INFO:journalctl@ceph.mon.a.smithi069.stdout: use_delta_encoding: 1 2024-05-14T15:04:39.223 INFO:journalctl@ceph.mon.a.smithi069.stdout: filter_policy: bloomfilter 2024-05-14T15:04:39.223 INFO:journalctl@ceph.mon.a.smithi069.stdout: whole_key_filtering: 1 2024-05-14T15:04:39.223 INFO:journalctl@ceph.mon.a.smithi069.stdout: verify_compression: 0 2024-05-14T15:04:39.223 INFO:journalctl@ceph.mon.a.smithi069.stdout: read_amp_bytes_per_bit: 0 2024-05-14T15:04:39.223 INFO:journalctl@ceph.mon.a.smithi069.stdout: format_version: 5 2024-05-14T15:04:39.223 INFO:journalctl@ceph.mon.a.smithi069.stdout: enable_index_compression: 1 2024-05-14T15:04:39.223 INFO:journalctl@ceph.mon.a.smithi069.stdout: block_align: 0 2024-05-14T15:04:39.223 INFO:journalctl@ceph.mon.a.smithi069.stdout: max_auto_readahead_size: 262144 2024-05-14T15:04:39.223 INFO:journalctl@ceph.mon.a.smithi069.stdout: prepopulate_block_cache: 0 2024-05-14T15:04:39.223 INFO:journalctl@ceph.mon.a.smithi069.stdout: initial_auto_readahead_size: 8192 2024-05-14T15:04:39.224 INFO:journalctl@ceph.mon.a.smithi069.stdout: num_file_reads_for_auto_readahead: 2 2024-05-14T15:04:39.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.write_buffer_size: 33554432 2024-05-14T15:04:39.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_write_buffer_number: 2 2024-05-14T15:04:39.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compression: NoCompression 2024-05-14T15:04:39.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.bottommost_compression: Disabled 2024-05-14T15:04:39.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.prefix_extractor: nullptr 2024-05-14T15:04:39.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-14T15:04:39.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.num_levels: 7 2024-05-14T15:04:39.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-14T15:04:39.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-14T15:04:39.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-14T15:04:39.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-14T15:04:39.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-14T15:04:39.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-14T15:04:39.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-14T15:04:39.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-14T15:04:39.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-14T15:04:39.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-14T15:04:39.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-14T15:04:39.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-14T15:04:39.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-14T15:04:39.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compression_opts.level: 32767 2024-05-14T15:04:39.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compression_opts.strategy: 0 2024-05-14T15:04:39.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-14T15:04:39.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-14T15:04:39.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-14T15:04:39.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-14T15:04:39.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compression_opts.enabled: false 2024-05-14T15:04:39.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-14T15:04:39.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-14T15:04:39.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-14T15:04:39.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-14T15:04:39.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.target_file_size_base: 67108864 2024-05-14T15:04:39.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-14T15:04:39.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-14T15:04:39.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-14T15:04:39.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-14T15:04:39.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-14T15:04:39.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-14T15:04:39.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-14T15:04:39.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-14T15:04:39.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-14T15:04:39.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-14T15:04:39.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-14T15:04:39.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-14T15:04:39.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-14T15:04:39.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-14T15:04:39.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.arena_block_size: 1048576 2024-05-14T15:04:39.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-14T15:04:39.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-14T15:04:39.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.disable_auto_compactions: 0 2024-05-14T15:04:39.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-14T15:04:39.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-14T15:04:39.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-14T15:04:39.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-14T15:04:39.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-14T15:04:39.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-14T15:04:39.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-14T15:04:39.229 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-14T15:04:39.229 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-14T15:04:39.229 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-14T15:04:39.229 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-14T15:04:39.229 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.inplace_update_support: 0 2024-05-14T15:04:39.229 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-14T15:04:39.229 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-14T15:04:39.229 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-14T15:04:39.229 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-14T15:04:39.229 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.bloom_locality: 0 2024-05-14T15:04:39.229 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.max_successive_merges: 0 2024-05-14T15:04:39.229 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-14T15:04:39.229 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.paranoid_file_checks: 0 2024-05-14T15:04:39.229 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.force_consistency_checks: 1 2024-05-14T15:04:39.229 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.report_bg_io_stats: 0 2024-05-14T15:04:39.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.ttl: 2592000 2024-05-14T15:04:39.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-14T15:04:39.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-14T15:04:39.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-14T15:04:39.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.enable_blob_files: false 2024-05-14T15:04:39.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.min_blob_size: 0 2024-05-14T15:04:39.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.blob_file_size: 268435456 2024-05-14T15:04:39.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-14T15:04:39.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-14T15:04:39.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-14T15:04:39.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-14T15:04:39.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-14T15:04:39.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.blob_file_starting_level: 0 2024-05-14T15:04:39.230 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-14T15:04:39.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-05-14T15:04:39.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-05-14T15:04:39.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 4ac80cb5-ce09-48e2-a16b-8c2faf0fdf72 2024-05-14T15:04:39.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715699079056351, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-05-14T15:04:39.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-05-14T15:04:39.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715699079058108, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 99225, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 322, "table_properties": {"data_size": 97171, "index_size": 310, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13895, "raw_average_key_size": 49, "raw_value_size": 89580, "raw_average_value_size": 318, "num_data_blocks": 12, "num_entries": 281, "num_filter_entries": 281, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715699079, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "4ac80cb5-ce09-48e2-a16b-8c2faf0fdf72", "db_session_id": "IUGDSC9Y9TQPMKUF7LRN", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-05-14T15:04:39.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715699079058252, "job": 1, "event": "recovery_finished"} 2024-05-14T15:04:39.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-05-14T15:04:39.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-14T15:04:39.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5650651e5c00 2024-05-14T15:04:39.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 bash[31251]: bc76d6ff7912cff5c63b93fcdbae2a9d200b7c5bed48a449d8577ae9b14ab5bc 2024-05-14T15:04:39.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: DB pointer 0x565069fd8000 2024-05-14T15:04:39.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-14T15:04:39.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-14T15:04:39.232 INFO:journalctl@ceph.mon.a.smithi069.stdout: ** DB Stats ** 2024-05-14T15:04:39.232 INFO:journalctl@ceph.mon.a.smithi069.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-14T15:04:39.232 INFO:journalctl@ceph.mon.a.smithi069.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-14T15:04:39.232 INFO:journalctl@ceph.mon.a.smithi069.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-14T15:04:39.232 INFO:journalctl@ceph.mon.a.smithi069.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-14T15:04:39.232 INFO:journalctl@ceph.mon.a.smithi069.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-14T15:04:39.232 INFO:journalctl@ceph.mon.a.smithi069.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-14T15:04:39.232 INFO:journalctl@ceph.mon.a.smithi069.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-14T15:04:39.232 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2024-05-14T15:04:39.232 INFO:journalctl@ceph.mon.a.smithi069.stdout: ** Compaction Stats [default] ** 2024-05-14T15:04:39.232 INFO:journalctl@ceph.mon.a.smithi069.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-14T15:04:39.232 INFO:journalctl@ceph.mon.a.smithi069.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-14T15:04:39.232 INFO:journalctl@ceph.mon.a.smithi069.stdout: L0 2/0 98.76 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T15:04:39.233 INFO:journalctl@ceph.mon.a.smithi069.stdout: Sum 2/0 98.76 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T15:04:39.233 INFO:journalctl@ceph.mon.a.smithi069.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 94.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T15:04:39.233 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2024-05-14T15:04:39.233 INFO:journalctl@ceph.mon.a.smithi069.stdout: ** Compaction Stats [default] ** 2024-05-14T15:04:39.233 INFO:journalctl@ceph.mon.a.smithi069.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-14T15:04:39.233 INFO:journalctl@ceph.mon.a.smithi069.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-14T15:04:39.233 INFO:journalctl@ceph.mon.a.smithi069.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 94.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T15:04:39.233 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2024-05-14T15:04:39.233 INFO:journalctl@ceph.mon.a.smithi069.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-14T15:04:39.233 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2024-05-14T15:04:39.233 INFO:journalctl@ceph.mon.a.smithi069.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-14T15:04:39.233 INFO:journalctl@ceph.mon.a.smithi069.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-14T15:04:39.233 INFO:journalctl@ceph.mon.a.smithi069.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-14T15:04:39.233 INFO:journalctl@ceph.mon.a.smithi069.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-14T15:04:39.234 INFO:journalctl@ceph.mon.a.smithi069.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-14T15:04:39.234 INFO:journalctl@ceph.mon.a.smithi069.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-14T15:04:39.234 INFO:journalctl@ceph.mon.a.smithi069.stdout: Cumulative compaction: 0.00 GB write, 14.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-14T15:04:39.234 INFO:journalctl@ceph.mon.a.smithi069.stdout: Interval compaction: 0.00 GB write, 14.68 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-14T15:04:39.234 INFO:journalctl@ceph.mon.a.smithi069.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-14T15:04:39.234 INFO:journalctl@ceph.mon.a.smithi069.stdout: Block cache BinnedLRUCache@0x5650652011f0#2 capacity: 512.00 MB usage: 1.41 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-05-14T15:04:39.234 INFO:journalctl@ceph.mon.a.smithi069.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,0.91 KB,0.000172853%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-05-14T15:04:39.234 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2024-05-14T15:04:39.234 INFO:journalctl@ceph.mon.a.smithi069.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-14T15:04:39.234 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: starting mon.a rank 0 at public addrs [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] at bind addrs [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:04:39.234 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: mon.a@-1(???) e1 preinit fsid 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:04:39.234 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: mon.a@-1(???).mds e1 new map 2024-05-14T15:04:39.234 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: mon.a@-1(???).mds e1 print_map 2024-05-14T15:04:39.234 INFO:journalctl@ceph.mon.a.smithi069.stdout: e1 2024-05-14T15:04:39.235 INFO:journalctl@ceph.mon.a.smithi069.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-14T15:04:39.235 INFO:journalctl@ceph.mon.a.smithi069.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-14T15:04:39.235 INFO:journalctl@ceph.mon.a.smithi069.stdout: legacy client fscid: -1 2024-05-14T15:04:39.235 INFO:journalctl@ceph.mon.a.smithi069.stdout: 2024-05-14T15:04:39.235 INFO:journalctl@ceph.mon.a.smithi069.stdout: No filesystems configured 2024-05-14T15:04:39.235 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-14T15:04:39.235 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T15:04:39.235 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T15:04:39.235 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T15:04:39.235 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-14T15:04:39.235 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 systemd[1]: Started Ceph mon.a for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:04:39.235 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-14T15:04:39.235 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: monmap epoch 1 2024-05-14T15:04:39.235 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: fsid 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:04:39.235 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: last_changed 2024-05-14T15:04:26.570547+0000 2024-05-14T15:04:39.236 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: created 2024-05-14T15:04:26.570547+0000 2024-05-14T15:04:39.236 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: min_mon_release 19 (squid) 2024-05-14T15:04:39.236 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: election_strategy: 1 2024-05-14T15:04:39.236 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-05-14T15:04:39.236 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: fsmap 2024-05-14T15:04:39.236 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: osdmap e1: 0 total, 0 up, 0 in 2024-05-14T15:04:39.236 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:39 smithi069 ceph-mon[31270]: mgrmap e1: no daemons active 2024-05-14T15:04:40.542 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.790+0000 7ff531a00700 1 Processor -- start 2024-05-14T15:04:40.543 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.790+0000 7ff531a00700 1 -- start start 2024-05-14T15:04:40.543 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.791+0000 7ff531a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff52c10bb40 0x7ff52c10bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:40.543 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.791+0000 7ff531a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c10c540 con 0x7ff52c10bb40 2024-05-14T15:04:40.543 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.792+0000 7ff52aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff52c10bb40 0x7ff52c10bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:40.543 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.792+0000 7ff52aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff52c10bb40 0x7ff52c10bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60188/0 (socket says 172.21.15.69:60188) 2024-05-14T15:04:40.543 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.792+0000 7ff52aa00700 1 -- 172.21.15.69:0/3720545058 learned_addr learned my addr 172.21.15.69:0/3720545058 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:40.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.792+0000 7ff52aa00700 1 -- 172.21.15.69:0/3720545058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52c10cd10 con 0x7ff52c10bb40 2024-05-14T15:04:40.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.793+0000 7ff52aa00700 1 --2- 172.21.15.69:0/3720545058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff52c10bb40 0x7ff52c10bf50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0098a0 tx=0x7ff51c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4258f4d9b3035e06 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:40.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.793+0000 7ff529600700 1 -- 172.21.15.69:0/3720545058 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff51c004160 con 0x7ff52c10bb40 2024-05-14T15:04:40.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.793+0000 7ff529600700 1 -- 172.21.15.69:0/3720545058 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ff51c004300 con 0x7ff52c10bb40 2024-05-14T15:04:40.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.793+0000 7ff529600700 1 -- 172.21.15.69:0/3720545058 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff51c0119e0 con 0x7ff52c10bb40 2024-05-14T15:04:40.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.794+0000 7ff531a00700 1 -- 172.21.15.69:0/3720545058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff52c10bb40 msgr2=0x7ff52c10bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:40.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.794+0000 7ff531a00700 1 --2- 172.21.15.69:0/3720545058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff52c10bb40 0x7ff52c10bf50 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0098a0 tx=0x7ff51c009bb0 comp rx=0 tx=0).stop 2024-05-14T15:04:40.548 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.794+0000 7ff531a00700 1 -- 172.21.15.69:0/3720545058 shutdown_connections 2024-05-14T15:04:40.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.794+0000 7ff531a00700 1 --2- 172.21.15.69:0/3720545058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff52c10bb40 0x7ff52c10bf50 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:40.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.794+0000 7ff531a00700 1 -- 172.21.15.69:0/3720545058 >> 172.21.15.69:0/3720545058 conn(0x7ff52c107480 msgr2=0x7ff52c1098a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:40.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.794+0000 7ff531a00700 1 -- 172.21.15.69:0/3720545058 shutdown_connections 2024-05-14T15:04:40.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.794+0000 7ff531a00700 1 -- 172.21.15.69:0/3720545058 wait complete. 2024-05-14T15:04:40.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.795+0000 7ff531a00700 1 Processor -- start 2024-05-14T15:04:40.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.795+0000 7ff531a00700 1 -- start start 2024-05-14T15:04:40.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.796+0000 7ff531a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff52c10bb40 0x7ff52c19fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:40.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.796+0000 7ff531a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff52c1100c0 con 0x7ff52c10bb40 2024-05-14T15:04:40.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.796+0000 7ff52aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff52c10bb40 0x7ff52c19fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:40.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.796+0000 7ff52aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff52c10bb40 0x7ff52c19fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60192/0 (socket says 172.21.15.69:60192) 2024-05-14T15:04:40.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.796+0000 7ff52aa00700 1 -- 172.21.15.69:0/3774410076 learned_addr learned my addr 172.21.15.69:0/3774410076 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:40.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.796+0000 7ff52aa00700 1 -- 172.21.15.69:0/3774410076 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff52c1a03e0 con 0x7ff52c10bb40 2024-05-14T15:04:40.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.797+0000 7ff52aa00700 1 --2- 172.21.15.69:0/3774410076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff52c10bb40 0x7ff52c19fea0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0119b0 tx=0x7ff51c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:40.549 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.797+0000 7ff523400700 1 -- 172.21.15.69:0/3774410076 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff51c003970 con 0x7ff52c10bb40 2024-05-14T15:04:40.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.797+0000 7ff531a00700 1 -- 172.21.15.69:0/3774410076 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff52c1a0670 con 0x7ff52c10bb40 2024-05-14T15:04:40.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.797+0000 7ff523400700 1 -- 172.21.15.69:0/3774410076 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ff51c003b10 con 0x7ff52c10bb40 2024-05-14T15:04:40.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.797+0000 7ff523400700 1 -- 172.21.15.69:0/3774410076 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff51c024610 con 0x7ff52c10bb40 2024-05-14T15:04:40.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.797+0000 7ff531a00700 1 -- 172.21.15.69:0/3774410076 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff52c1a3280 con 0x7ff52c10bb40 2024-05-14T15:04:40.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.798+0000 7ff523400700 1 -- 172.21.15.69:0/3774410076 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff51c024c60 con 0x7ff52c10bb40 2024-05-14T15:04:40.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.798+0000 7ff523400700 1 -- 172.21.15.69:0/3774410076 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ff51c019700 con 0x7ff52c10bb40 2024-05-14T15:04:40.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.799+0000 7ff531a00700 1 -- 172.21.15.69:0/3774410076 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff52c064e20 con 0x7ff52c10bb40 2024-05-14T15:04:40.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.803+0000 7ff523400700 1 -- 172.21.15.69:0/3774410076 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7ff51c01aae0 con 0x7ff52c10bb40 2024-05-14T15:04:40.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.878+0000 7ff531a00700 1 -- 172.21.15.69:0/3774410076 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7ff52c1a34a0 con 0x7ff52c10bb40 2024-05-14T15:04:40.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.882+0000 7ff523400700 1 -- 172.21.15.69:0/3774410076 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7ff51c01a430 con 0x7ff52c10bb40 2024-05-14T15:04:40.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.883+0000 7ff531a00700 1 -- 172.21.15.69:0/3774410076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff52c10bb40 msgr2=0x7ff52c19fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:40.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.883+0000 7ff531a00700 1 --2- 172.21.15.69:0/3774410076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff52c10bb40 0x7ff52c19fea0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0119b0 tx=0x7ff51c011a90 comp rx=0 tx=0).stop 2024-05-14T15:04:40.550 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.883+0000 7ff531a00700 1 -- 172.21.15.69:0/3774410076 shutdown_connections 2024-05-14T15:04:40.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.883+0000 7ff531a00700 1 --2- 172.21.15.69:0/3774410076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff52c10bb40 0x7ff52c19fea0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:40.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.883+0000 7ff531a00700 1 -- 172.21.15.69:0/3774410076 >> 172.21.15.69:0/3774410076 conn(0x7ff52c107480 msgr2=0x7ff52c108c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:40.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.884+0000 7ff531a00700 1 -- 172.21.15.69:0/3774410076 shutdown_connections 2024-05-14T15:04:40.551 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:39.884+0000 7ff531a00700 1 -- 172.21.15.69:0/3774410076 wait complete. 2024-05-14T15:04:40.551 INFO:teuthology.orchestra.run.smithi069.stdout:Wrote config to /etc/ceph/ceph.conf 2024-05-14T15:04:40.572 INFO:teuthology.orchestra.run.smithi069.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-14T15:04:40.572 INFO:teuthology.orchestra.run.smithi069.stdout:Creating mgr... 2024-05-14T15:04:40.573 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying port 0.0.0.0:9283 ... 2024-05-14T15:04:40.574 INFO:teuthology.orchestra.run.smithi069.stdout:Verifying port 0.0.0.0:8765 ... 2024-05-14T15:04:41.009 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mgr.x 2024-05-14T15:04:41.009 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Failed to reset failed state of unit ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mgr.x.service: Unit ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mgr.x.service not loaded. 2024-05-14T15:04:41.212 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:40 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3774410076' entity='client.admin' 2024-05-14T15:04:41.269 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-1cc2580e-1203-11ef-bc98-c7b262605968.target.wants/ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-1cc2580e-1203-11ef-bc98-c7b262605968@.service. 2024-05-14T15:04:41.678 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:41 smithi069 systemd[1]: Starting Ceph mgr.x for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:04:41.955 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:41 smithi069 podman[31485]: 2024-05-14 15:04:41.592689329 +0000 UTC m=+0.033904385 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 2024-05-14T15:04:41.955 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:41 smithi069 podman[31485]: 2024-05-14 15:04:41.694029144 +0000 UTC m=+0.135244225 container create fad87f236ca82ebf9dd0cdc11828619c29f9de8c1f2c448dd54dc36ed6dd2367 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-05-14T15:04:41.955 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:41 smithi069 podman[31485]: 2024-05-14 15:04:41.963989566 +0000 UTC m=+0.405204690 container init fad87f236ca82ebf9dd0cdc11828619c29f9de8c1f2c448dd54dc36ed6dd2367 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T15:04:42.074 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-14T15:04:42.074 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout disabled 2024-05-14T15:04:42.091 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-14T15:04:42.092 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2024-05-14T15:04:42.092 INFO:teuthology.orchestra.run.smithi069.stdout:firewalld.service is not enabled 2024-05-14T15:04:42.092 INFO:teuthology.orchestra.run.smithi069.stdout:Not possible to enable service . firewalld.service is not available 2024-05-14T15:04:42.110 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-14T15:04:42.110 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout disabled 2024-05-14T15:04:42.125 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-14T15:04:42.125 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2024-05-14T15:04:42.125 INFO:teuthology.orchestra.run.smithi069.stdout:firewalld.service is not enabled 2024-05-14T15:04:42.125 INFO:teuthology.orchestra.run.smithi069.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-05-14T15:04:42.125 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mgr to start... 2024-05-14T15:04:42.125 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mgr... 2024-05-14T15:04:42.212 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:41 smithi069 podman[31485]: 2024-05-14 15:04:41.975626947 +0000 UTC m=+0.416842045 container start fad87f236ca82ebf9dd0cdc11828619c29f9de8c1f2c448dd54dc36ed6dd2367 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-14T15:04:42.212 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:42 smithi069 bash[31485]: fad87f236ca82ebf9dd0cdc11828619c29f9de8c1f2c448dd54dc36ed6dd2367 2024-05-14T15:04:42.212 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:42 smithi069 systemd[1]: Started Ceph mgr.x for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:04:42.547 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:42 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:42.285+0000 7f1e381d6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T15:04:42.547 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:42 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:42.556+0000 7f1e381d6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:04:42.830 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:42 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:42.697+0000 7f1e381d6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T15:04:43.106 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:42 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/4166835811' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-14T15:04:43.462 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:43 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:43.116+0000 7f1e381d6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T15:04:43.463 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:43 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:43.231+0000 7f1e381d6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T15:04:43.643 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-05-14T15:04:43.665 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2024-05-14T15:04:43.665 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsid": "1cc2580e-1203-11ef-bc98-c7b262605968", 2024-05-14T15:04:43.665 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "health": { 2024-05-14T15:04:43.666 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-14T15:04:43.666 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-14T15:04:43.666 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-14T15:04:43.666 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:43.666 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-14T15:04:43.666 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-14T15:04:43.666 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 0 2024-05-14T15:04:43.667 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-05-14T15:04:43.667 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-14T15:04:43.667 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "a" 2024-05-14T15:04:43.667 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-05-14T15:04:43.667 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_age": 3, 2024-05-14T15:04:43.667 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-14T15:04:43.667 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T15:04:43.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-14T15:04:43.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-14T15:04:43.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:43.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-14T15:04:43.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T15:04:43.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-14T15:04:43.668 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-14T15:04:43.669 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-14T15:04:43.669 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-14T15:04:43.669 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-14T15:04:43.669 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-14T15:04:43.669 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:43.669 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-14T15:04:43.670 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-14T15:04:43.670 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-14T15:04:43.670 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-14T15:04:43.670 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-14T15:04:43.670 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-14T15:04:43.671 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-14T15:04:43.671 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-14T15:04:43.671 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-14T15:04:43.671 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:43.671 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-14T15:04:43.671 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T15:04:43.671 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-14T15:04:43.671 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-14T15:04:43.671 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:43.672 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-14T15:04:43.672 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-14T15:04:43.672 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-14T15:04:43.672 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-14T15:04:43.672 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-14T15:04:43.672 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-14T15:04:43.672 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "restful" 2024-05-14T15:04:43.673 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-05-14T15:04:43.673 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T15:04:43.673 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:43.673 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-14T15:04:43.673 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T15:04:43.673 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modified": "2024-05-14T15:04:32.075828+0000", 2024-05-14T15:04:43.673 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T15:04:43.673 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:43.673 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-14T15:04:43.674 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2024-05-14T15:04:43.674 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.840+0000 7f645ae00700 1 Processor -- start 2024-05-14T15:04:43.674 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.840+0000 7f645ae00700 1 -- start start 2024-05-14T15:04:43.674 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.840+0000 7f645ae00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645407edd0 0x7f645407d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:43.674 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.840+0000 7f645ae00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f645407d740 con 0x7f645407edd0 2024-05-14T15:04:43.674 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.841+0000 7f6459a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645407edd0 0x7f645407d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:43.674 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.841+0000 7f6459a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645407edd0 0x7f645407d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60898/0 (socket says 172.21.15.69:60898) 2024-05-14T15:04:43.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.841+0000 7f6459a00700 1 -- 172.21.15.69:0/3597298831 learned_addr learned my addr 172.21.15.69:0/3597298831 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:43.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.842+0000 7f6459a00700 1 -- 172.21.15.69:0/3597298831 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645407d8c0 con 0x7f645407edd0 2024-05-14T15:04:43.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.842+0000 7f6459a00700 1 --2- 172.21.15.69:0/3597298831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645407edd0 0x7f645407d200 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f64480098a0 tx=0x7f6448009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de2f856f0b081521 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:43.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.842+0000 7f6453e00700 1 -- 172.21.15.69:0/3597298831 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6448004160 con 0x7f645407edd0 2024-05-14T15:04:43.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.842+0000 7f6453e00700 1 -- 172.21.15.69:0/3597298831 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f6448004300 con 0x7f645407edd0 2024-05-14T15:04:43.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.842+0000 7f6453e00700 1 -- 172.21.15.69:0/3597298831 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64480119e0 con 0x7f645407edd0 2024-05-14T15:04:43.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.843+0000 7f645ae00700 1 -- 172.21.15.69:0/3597298831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645407edd0 msgr2=0x7f645407d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:43.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.843+0000 7f645ae00700 1 --2- 172.21.15.69:0/3597298831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645407edd0 0x7f645407d200 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f64480098a0 tx=0x7f6448009bb0 comp rx=0 tx=0).stop 2024-05-14T15:04:43.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.843+0000 7f645ae00700 1 -- 172.21.15.69:0/3597298831 shutdown_connections 2024-05-14T15:04:43.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.843+0000 7f645ae00700 1 --2- 172.21.15.69:0/3597298831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645407edd0 0x7f645407d200 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:43.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.843+0000 7f645ae00700 1 -- 172.21.15.69:0/3597298831 >> 172.21.15.69:0/3597298831 conn(0x7f6454104e60 msgr2=0x7f64541072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:43.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.844+0000 7f645ae00700 1 -- 172.21.15.69:0/3597298831 shutdown_connections 2024-05-14T15:04:43.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.844+0000 7f645ae00700 1 -- 172.21.15.69:0/3597298831 wait complete. 2024-05-14T15:04:43.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.845+0000 7f645ae00700 1 Processor -- start 2024-05-14T15:04:43.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.845+0000 7f645ae00700 1 -- start start 2024-05-14T15:04:43.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.845+0000 7f645ae00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645407edd0 0x7f645419fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:43.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.845+0000 7f645ae00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f645410fd20 con 0x7f645407edd0 2024-05-14T15:04:43.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.845+0000 7f6459a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645407edd0 0x7f645419fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:43.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.845+0000 7f6459a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645407edd0 0x7f645419fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60912/0 (socket says 172.21.15.69:60912) 2024-05-14T15:04:43.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.845+0000 7f6459a00700 1 -- 172.21.15.69:0/4166835811 learned_addr learned my addr 172.21.15.69:0/4166835811 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:43.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.846+0000 7f6459a00700 1 -- 172.21.15.69:0/4166835811 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64541a0200 con 0x7f645407edd0 2024-05-14T15:04:43.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.846+0000 7f6459a00700 1 --2- 172.21.15.69:0/4166835811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645407edd0 0x7f645419fcc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f64480119b0 tx=0x7f6448011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:43.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.846+0000 7f6452000700 1 -- 172.21.15.69:0/4166835811 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6448003af0 con 0x7f645407edd0 2024-05-14T15:04:43.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.847+0000 7f6452000700 1 -- 172.21.15.69:0/4166835811 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f644801a8a0 con 0x7f645407edd0 2024-05-14T15:04:43.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.847+0000 7f6452000700 1 -- 172.21.15.69:0/4166835811 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6448024830 con 0x7f645407edd0 2024-05-14T15:04:43.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.847+0000 7f645ae00700 1 -- 172.21.15.69:0/4166835811 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64541a0490 con 0x7f645407edd0 2024-05-14T15:04:43.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.847+0000 7f645ae00700 1 -- 172.21.15.69:0/4166835811 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64541a30a0 con 0x7f645407edd0 2024-05-14T15:04:43.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.847+0000 7f6452000700 1 -- 172.21.15.69:0/4166835811 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6448022020 con 0x7f645407edd0 2024-05-14T15:04:43.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.847+0000 7f6452000700 1 -- 172.21.15.69:0/4166835811 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f64480193c0 con 0x7f645407edd0 2024-05-14T15:04:43.682 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.848+0000 7f645ae00700 1 -- 172.21.15.69:0/4166835811 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6454064e20 con 0x7f645407edd0 2024-05-14T15:04:43.682 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.853+0000 7f6452000700 1 -- 172.21.15.69:0/4166835811 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6448042ec0 con 0x7f645407edd0 2024-05-14T15:04:43.682 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.932+0000 7f645ae00700 1 -- 172.21.15.69:0/4166835811 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f64541a32c0 con 0x7f645407edd0 2024-05-14T15:04:43.682 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.932+0000 7f6452000700 1 -- 172.21.15.69:0/4166835811 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f6448031020 con 0x7f645407edd0 2024-05-14T15:04:43.683 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.934+0000 7f645ae00700 1 -- 172.21.15.69:0/4166835811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645407edd0 msgr2=0x7f645419fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:43.683 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.934+0000 7f645ae00700 1 --2- 172.21.15.69:0/4166835811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645407edd0 0x7f645419fcc0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f64480119b0 tx=0x7f6448011a90 comp rx=0 tx=0).stop 2024-05-14T15:04:43.683 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.934+0000 7f645ae00700 1 -- 172.21.15.69:0/4166835811 shutdown_connections 2024-05-14T15:04:43.683 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.934+0000 7f645ae00700 1 --2- 172.21.15.69:0/4166835811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f645407edd0 0x7f645419fcc0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:43.683 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.934+0000 7f645ae00700 1 -- 172.21.15.69:0/4166835811 >> 172.21.15.69:0/4166835811 conn(0x7f6454104e60 msgr2=0x7f64541066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:43.683 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.934+0000 7f645ae00700 1 -- 172.21.15.69:0/4166835811 shutdown_connections 2024-05-14T15:04:43.683 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:42.934+0000 7f645ae00700 1 -- 172.21.15.69:0/4166835811 wait complete. 2024-05-14T15:04:43.683 INFO:teuthology.orchestra.run.smithi069.stdout:mgr not available, waiting (1/15)... 2024-05-14T15:04:45.213 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:44 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:44.838+0000 7f1e381d6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T15:04:45.213 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:45 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:45.067+0000 7f1e381d6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T15:04:45.650 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:45 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:45.281+0000 7f1e381d6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T15:04:45.651 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:45 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:45.660+0000 7f1e381d6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T15:04:45.962 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:45 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:45.786+0000 7f1e381d6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T15:04:46.298 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:46 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:46.046+0000 7f1e381d6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T15:04:46.299 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:46 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:46.308+0000 7f1e381d6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:04:46.712 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:46 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3355900271' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-14T15:04:47.135 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-05-14T15:04:47.135 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2024-05-14T15:04:47.135 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsid": "1cc2580e-1203-11ef-bc98-c7b262605968", 2024-05-14T15:04:47.135 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "health": { 2024-05-14T15:04:47.135 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-14T15:04:47.135 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-14T15:04:47.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-14T15:04:47.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:47.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-14T15:04:47.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-14T15:04:47.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 0 2024-05-14T15:04:47.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-05-14T15:04:47.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-14T15:04:47.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "a" 2024-05-14T15:04:47.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-05-14T15:04:47.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-05-14T15:04:47.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-14T15:04:47.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T15:04:47.136 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-14T15:04:47.137 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-14T15:04:47.137 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:47.137 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-14T15:04:47.137 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T15:04:47.137 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-14T15:04:47.137 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-14T15:04:47.137 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-14T15:04:47.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-14T15:04:47.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-14T15:04:47.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-14T15:04:47.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:47.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-14T15:04:47.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-14T15:04:47.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-14T15:04:47.145 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-14T15:04:47.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-14T15:04:47.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-14T15:04:47.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-14T15:04:47.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-14T15:04:47.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-14T15:04:47.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:47.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-14T15:04:47.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T15:04:47.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-14T15:04:47.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-14T15:04:47.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:47.146 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-14T15:04:47.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-14T15:04:47.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-14T15:04:47.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-14T15:04:47.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-14T15:04:47.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-14T15:04:47.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "restful" 2024-05-14T15:04:47.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-05-14T15:04:47.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T15:04:47.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:47.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-14T15:04:47.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T15:04:47.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modified": "2024-05-14T15:04:32.075828+0000", 2024-05-14T15:04:47.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T15:04:47.147 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:47.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-14T15:04:47.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2024-05-14T15:04:47.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.322+0000 7f66dda00700 1 Processor -- start 2024-05-14T15:04:47.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.323+0000 7f66dda00700 1 -- start start 2024-05-14T15:04:47.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.323+0000 7f66dda00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66d8109810 0x7f66d8109c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:47.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.323+0000 7f66dda00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f66d810a210 con 0x7f66d8109810 2024-05-14T15:04:47.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.323+0000 7f66d7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66d8109810 0x7f66d8109c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:47.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.323+0000 7f66d7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66d8109810 0x7f66d8109c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60928/0 (socket says 172.21.15.69:60928) 2024-05-14T15:04:47.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.323+0000 7f66d7e00700 1 -- 172.21.15.69:0/3878292522 learned_addr learned my addr 172.21.15.69:0/3878292522 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:47.148 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.324+0000 7f66d7e00700 1 -- 172.21.15.69:0/3878292522 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d810a990 con 0x7f66d8109810 2024-05-14T15:04:47.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.324+0000 7f66d7e00700 1 --2- 172.21.15.69:0/3878292522 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66d8109810 0x7f66d8109c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f66c80098a0 tx=0x7f66c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8802c10cbb4869 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:47.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.324+0000 7f66d6a00700 1 -- 172.21.15.69:0/3878292522 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66c8004160 con 0x7f66d8109810 2024-05-14T15:04:47.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.324+0000 7f66d6a00700 1 -- 172.21.15.69:0/3878292522 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f66c8004300 con 0x7f66d8109810 2024-05-14T15:04:47.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.324+0000 7f66d6a00700 1 -- 172.21.15.69:0/3878292522 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66c80119e0 con 0x7f66d8109810 2024-05-14T15:04:47.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.325+0000 7f66dda00700 1 -- 172.21.15.69:0/3878292522 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66d8109810 msgr2=0x7f66d8109c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:47.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.325+0000 7f66dda00700 1 --2- 172.21.15.69:0/3878292522 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66d8109810 0x7f66d8109c20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f66c80098a0 tx=0x7f66c8009bb0 comp rx=0 tx=0).stop 2024-05-14T15:04:47.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.325+0000 7f66dda00700 1 -- 172.21.15.69:0/3878292522 shutdown_connections 2024-05-14T15:04:47.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.325+0000 7f66dda00700 1 --2- 172.21.15.69:0/3878292522 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66d8109810 0x7f66d8109c20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:47.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.326+0000 7f66dda00700 1 -- 172.21.15.69:0/3878292522 >> 172.21.15.69:0/3878292522 conn(0x7f66d8104e90 msgr2=0x7f66d8107300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:47.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.326+0000 7f66dda00700 1 -- 172.21.15.69:0/3878292522 shutdown_connections 2024-05-14T15:04:47.149 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.326+0000 7f66dda00700 1 -- 172.21.15.69:0/3878292522 wait complete. 2024-05-14T15:04:47.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.327+0000 7f66dda00700 1 Processor -- start 2024-05-14T15:04:47.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.327+0000 7f66dda00700 1 -- start start 2024-05-14T15:04:47.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.327+0000 7f66dda00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66d8109810 0x7f66d819fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:47.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.327+0000 7f66dda00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f66d810dd40 con 0x7f66d8109810 2024-05-14T15:04:47.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.328+0000 7f66d7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66d8109810 0x7f66d819fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:47.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.328+0000 7f66d7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66d8109810 0x7f66d819fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60932/0 (socket says 172.21.15.69:60932) 2024-05-14T15:04:47.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.328+0000 7f66d7e00700 1 -- 172.21.15.69:0/3355900271 learned_addr learned my addr 172.21.15.69:0/3355900271 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:47.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.328+0000 7f66d7e00700 1 -- 172.21.15.69:0/3355900271 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d81a0270 con 0x7f66d8109810 2024-05-14T15:04:47.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.328+0000 7f66d7e00700 1 --2- 172.21.15.69:0/3355900271 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66d8109810 0x7f66d819fd30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f66c80119b0 tx=0x7f66c8011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:47.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.329+0000 7f66d4c00700 1 -- 172.21.15.69:0/3355900271 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66c8003970 con 0x7f66d8109810 2024-05-14T15:04:47.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.329+0000 7f66d4c00700 1 -- 172.21.15.69:0/3355900271 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f66c8003b10 con 0x7f66d8109810 2024-05-14T15:04:47.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.329+0000 7f66d4c00700 1 -- 172.21.15.69:0/3355900271 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66c8024610 con 0x7f66d8109810 2024-05-14T15:04:47.150 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.329+0000 7f66dda00700 1 -- 172.21.15.69:0/3355900271 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d81a0500 con 0x7f66d8109810 2024-05-14T15:04:47.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.329+0000 7f66dda00700 1 -- 172.21.15.69:0/3355900271 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d81a3100 con 0x7f66d8109810 2024-05-14T15:04:47.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.329+0000 7f66d4c00700 1 -- 172.21.15.69:0/3355900271 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f66c8024c60 con 0x7f66d8109810 2024-05-14T15:04:47.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.329+0000 7f66d4c00700 1 -- 172.21.15.69:0/3355900271 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f66c8019700 con 0x7f66d8109810 2024-05-14T15:04:47.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.330+0000 7f66dda00700 1 -- 172.21.15.69:0/3355900271 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66d8064e20 con 0x7f66d8109810 2024-05-14T15:04:47.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.333+0000 7f66d4c00700 1 -- 172.21.15.69:0/3355900271 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f66c801aae0 con 0x7f66d8109810 2024-05-14T15:04:47.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.413+0000 7f66dda00700 1 -- 172.21.15.69:0/3355900271 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f66d81a3700 con 0x7f66d8109810 2024-05-14T15:04:47.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.413+0000 7f66d4c00700 1 -- 172.21.15.69:0/3355900271 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f66c801a430 con 0x7f66d8109810 2024-05-14T15:04:47.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.415+0000 7f66dda00700 1 -- 172.21.15.69:0/3355900271 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66d8109810 msgr2=0x7f66d819fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:47.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.415+0000 7f66dda00700 1 --2- 172.21.15.69:0/3355900271 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66d8109810 0x7f66d819fd30 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f66c80119b0 tx=0x7f66c8011a90 comp rx=0 tx=0).stop 2024-05-14T15:04:47.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.415+0000 7f66dda00700 1 -- 172.21.15.69:0/3355900271 shutdown_connections 2024-05-14T15:04:47.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.415+0000 7f66dda00700 1 --2- 172.21.15.69:0/3355900271 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f66d8109810 0x7f66d819fd30 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:47.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.415+0000 7f66dda00700 1 -- 172.21.15.69:0/3355900271 >> 172.21.15.69:0/3355900271 conn(0x7f66d8104e90 msgr2=0x7f66d807d160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:47.151 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.416+0000 7f66dda00700 1 -- 172.21.15.69:0/3355900271 shutdown_connections 2024-05-14T15:04:47.152 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:46.416+0000 7f66dda00700 1 -- 172.21.15.69:0/3355900271 wait complete. 2024-05-14T15:04:47.152 INFO:teuthology.orchestra.run.smithi069.stdout:mgr not available, waiting (2/15)... 2024-05-14T15:04:47.427 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:47 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:47.143+0000 7f1e381d6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T15:04:47.427 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:47 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:47.436+0000 7f1e381d6200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T15:04:48.348 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:47 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:47.989+0000 7f1e381d6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T15:04:48.348 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:48 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:48.116+0000 7f1e381d6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T15:04:48.712 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:48 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:48.582+0000 7f1e381d6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T15:04:49.293 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:49 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:49.038+0000 7f1e381d6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T15:04:49.293 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:49 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:49.164+0000 7f1e381d6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T15:04:49.610 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:49 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:49.509+0000 7f1e381d6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T15:04:49.926 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:49 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:49.693+0000 7f1e381d6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T15:04:49.926 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:49 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:49.827+0000 7f1e381d6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T15:04:50.212 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:49 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2496819337' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-14T15:04:50.631 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:50 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:50.242+0000 7f1e381d6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T15:04:50.631 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:50 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:50.370+0000 7f1e381d6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T15:04:50.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-05-14T15:04:50.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2024-05-14T15:04:50.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsid": "1cc2580e-1203-11ef-bc98-c7b262605968", 2024-05-14T15:04:50.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "health": { 2024-05-14T15:04:50.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-14T15:04:50.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-14T15:04:50.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-14T15:04:50.639 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:50.640 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-14T15:04:50.640 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-14T15:04:50.640 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 0 2024-05-14T15:04:50.640 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-05-14T15:04:50.640 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-14T15:04:50.640 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "a" 2024-05-14T15:04:50.640 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-05-14T15:04:50.640 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_age": 10, 2024-05-14T15:04:50.640 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-14T15:04:50.640 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T15:04:50.640 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-14T15:04:50.640 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-14T15:04:50.640 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:50.641 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-14T15:04:50.641 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T15:04:50.641 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-14T15:04:50.641 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-14T15:04:50.649 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-14T15:04:50.650 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-14T15:04:50.650 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-14T15:04:50.650 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-14T15:04:50.650 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:50.650 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-14T15:04:50.650 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-14T15:04:50.650 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-14T15:04:50.650 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-14T15:04:50.650 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-14T15:04:50.650 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-14T15:04:50.650 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-14T15:04:50.650 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-14T15:04:50.650 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-14T15:04:50.651 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:50.651 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-14T15:04:50.651 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T15:04:50.651 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-14T15:04:50.651 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-14T15:04:50.651 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:50.651 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-14T15:04:50.651 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": false, 2024-05-14T15:04:50.651 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-14T15:04:50.651 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-14T15:04:50.651 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-14T15:04:50.651 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-14T15:04:50.651 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "restful" 2024-05-14T15:04:50.651 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-05-14T15:04:50.652 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T15:04:50.652 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:50.652 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-14T15:04:50.652 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T15:04:50.652 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modified": "2024-05-14T15:04:32.075828+0000", 2024-05-14T15:04:50.652 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T15:04:50.652 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:50.652 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-14T15:04:50.652 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2024-05-14T15:04:50.652 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.845+0000 7f637f000700 1 Processor -- start 2024-05-14T15:04:50.652 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.845+0000 7f637f000700 1 -- start start 2024-05-14T15:04:50.652 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.845+0000 7f637f000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637807f800 0x7f637807dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:50.652 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.845+0000 7f637f000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f637807e170 con 0x7f637807f800 2024-05-14T15:04:50.652 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.846+0000 7f6377e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637807f800 0x7f637807dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:50.653 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.846+0000 7f6377e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637807f800 0x7f637807dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60940/0 (socket says 172.21.15.69:60940) 2024-05-14T15:04:50.653 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.846+0000 7f6377e00700 1 -- 172.21.15.69:0/2750481223 learned_addr learned my addr 172.21.15.69:0/2750481223 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:50.653 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.846+0000 7f6377e00700 1 -- 172.21.15.69:0/2750481223 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637807e2f0 con 0x7f637807f800 2024-05-14T15:04:50.653 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.847+0000 7f6377e00700 1 --2- 172.21.15.69:0/2750481223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637807f800 0x7f637807dc30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f63680098a0 tx=0x7f6368009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f24da00d435af715 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:50.653 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.847+0000 7f6376a00700 1 -- 172.21.15.69:0/2750481223 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6368004160 con 0x7f637807f800 2024-05-14T15:04:50.653 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.847+0000 7f6376a00700 1 -- 172.21.15.69:0/2750481223 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f6368004300 con 0x7f637807f800 2024-05-14T15:04:50.653 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.847+0000 7f6376a00700 1 -- 172.21.15.69:0/2750481223 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f63680119e0 con 0x7f637807f800 2024-05-14T15:04:50.653 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.848+0000 7f637f000700 1 -- 172.21.15.69:0/2750481223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637807f800 msgr2=0x7f637807dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:50.653 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.848+0000 7f637f000700 1 --2- 172.21.15.69:0/2750481223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637807f800 0x7f637807dc30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f63680098a0 tx=0x7f6368009bb0 comp rx=0 tx=0).stop 2024-05-14T15:04:50.653 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.848+0000 7f637f000700 1 -- 172.21.15.69:0/2750481223 shutdown_connections 2024-05-14T15:04:50.653 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.848+0000 7f637f000700 1 --2- 172.21.15.69:0/2750481223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637807f800 0x7f637807dc30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:50.653 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.849+0000 7f637f000700 1 -- 172.21.15.69:0/2750481223 >> 172.21.15.69:0/2750481223 conn(0x7f6378105000 msgr2=0x7f6378107470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:50.653 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.849+0000 7f637f000700 1 -- 172.21.15.69:0/2750481223 shutdown_connections 2024-05-14T15:04:50.653 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.849+0000 7f637f000700 1 -- 172.21.15.69:0/2750481223 wait complete. 2024-05-14T15:04:50.653 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.850+0000 7f637f000700 1 Processor -- start 2024-05-14T15:04:50.654 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.850+0000 7f637f000700 1 -- start start 2024-05-14T15:04:50.654 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.850+0000 7f637f000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637807f800 0x7f637819fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:50.654 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.850+0000 7f637f000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f637810ff00 con 0x7f637807f800 2024-05-14T15:04:50.654 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.850+0000 7f6377e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637807f800 0x7f637819fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:50.654 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.851+0000 7f6377e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637807f800 0x7f637819fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60950/0 (socket says 172.21.15.69:60950) 2024-05-14T15:04:50.654 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.851+0000 7f6377e00700 1 -- 172.21.15.69:0/2496819337 learned_addr learned my addr 172.21.15.69:0/2496819337 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:50.654 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.851+0000 7f6377e00700 1 -- 172.21.15.69:0/2496819337 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63781a03a0 con 0x7f637807f800 2024-05-14T15:04:50.654 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.851+0000 7f6377e00700 1 --2- 172.21.15.69:0/2496819337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637807f800 0x7f637819fe60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f63680119b0 tx=0x7f6368011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:50.654 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.852+0000 7f6374c00700 1 -- 172.21.15.69:0/2496819337 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6368003af0 con 0x7f637807f800 2024-05-14T15:04:50.654 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.852+0000 7f6374c00700 1 -- 172.21.15.69:0/2496819337 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f636801a8a0 con 0x7f637807f800 2024-05-14T15:04:50.654 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.852+0000 7f637f000700 1 -- 172.21.15.69:0/2496819337 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63781a0630 con 0x7f637807f800 2024-05-14T15:04:50.654 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.852+0000 7f6374c00700 1 -- 172.21.15.69:0/2496819337 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6368024830 con 0x7f637807f800 2024-05-14T15:04:50.654 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.852+0000 7f637f000700 1 -- 172.21.15.69:0/2496819337 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63781a3240 con 0x7f637807f800 2024-05-14T15:04:50.654 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.853+0000 7f6374c00700 1 -- 172.21.15.69:0/2496819337 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6368022020 con 0x7f637807f800 2024-05-14T15:04:50.655 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.853+0000 7f6374c00700 1 -- 172.21.15.69:0/2496819337 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6368019590 con 0x7f637807f800 2024-05-14T15:04:50.655 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.853+0000 7f637f000700 1 -- 172.21.15.69:0/2496819337 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6378064e20 con 0x7f637807f800 2024-05-14T15:04:50.655 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.856+0000 7f6374c00700 1 -- 172.21.15.69:0/2496819337 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f636801aa50 con 0x7f637807f800 2024-05-14T15:04:50.655 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.936+0000 7f637f000700 1 -- 172.21.15.69:0/2496819337 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f63781a3410 con 0x7f637807f800 2024-05-14T15:04:50.655 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.937+0000 7f6374c00700 1 -- 172.21.15.69:0/2496819337 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1240 (secure 0 0 0) 0x7f6368032030 con 0x7f637807f800 2024-05-14T15:04:50.655 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.938+0000 7f637f000700 1 -- 172.21.15.69:0/2496819337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637807f800 msgr2=0x7f637819fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:50.655 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.938+0000 7f637f000700 1 --2- 172.21.15.69:0/2496819337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637807f800 0x7f637819fe60 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f63680119b0 tx=0x7f6368011a90 comp rx=0 tx=0).stop 2024-05-14T15:04:50.655 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.939+0000 7f637f000700 1 -- 172.21.15.69:0/2496819337 shutdown_connections 2024-05-14T15:04:50.655 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.939+0000 7f637f000700 1 --2- 172.21.15.69:0/2496819337 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f637807f800 0x7f637819fe60 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:50.655 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.939+0000 7f637f000700 1 -- 172.21.15.69:0/2496819337 >> 172.21.15.69:0/2496819337 conn(0x7f6378105000 msgr2=0x7f6378105800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:50.655 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.939+0000 7f637f000700 1 -- 172.21.15.69:0/2496819337 shutdown_connections 2024-05-14T15:04:50.655 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:49.939+0000 7f637f000700 1 -- 172.21.15.69:0/2496819337 wait complete. 2024-05-14T15:04:50.655 INFO:teuthology.orchestra.run.smithi069.stdout:mgr not available, waiting (3/15)... 2024-05-14T15:04:51.406 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:51 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:51.130+0000 7f1e381d6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T15:04:51.406 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:51 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:51.415+0000 7f1e381d6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T15:04:51.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:51 smithi069 ceph-mon[31270]: Activating manager daemon x 2024-05-14T15:04:51.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:51 smithi069 ceph-mon[31270]: mgrmap e2: x(active, starting, since 0.0135825s) 2024-05-14T15:04:51.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:51 smithi069 ceph-mon[31270]: from='mgr.14100 172.21.15.69:0/1681325650' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-14T15:04:51.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:51 smithi069 ceph-mon[31270]: from='mgr.14100 172.21.15.69:0/1681325650' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-14T15:04:51.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:51 smithi069 ceph-mon[31270]: from='mgr.14100 172.21.15.69:0/1681325650' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-14T15:04:51.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:51 smithi069 ceph-mon[31270]: from='mgr.14100 172.21.15.69:0/1681325650' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:04:51.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:51 smithi069 ceph-mon[31270]: from='mgr.14100 172.21.15.69:0/1681325650' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-14T15:04:51.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:51 smithi069 ceph-mon[31270]: Manager daemon x is now available 2024-05-14T15:04:51.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:51 smithi069 ceph-mon[31270]: from='mgr.14100 172.21.15.69:0/1681325650' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-14T15:04:51.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:51 smithi069 ceph-mon[31270]: from='mgr.14100 172.21.15.69:0/1681325650' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-14T15:04:51.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:51 smithi069 ceph-mon[31270]: from='mgr.14100 172.21.15.69:0/1681325650' entity='mgr.x' 2024-05-14T15:04:52.801 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:52 smithi069 ceph-mon[31270]: from='mgr.14100 172.21.15.69:0/1681325650' entity='mgr.x' 2024-05-14T15:04:52.801 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:52 smithi069 ceph-mon[31270]: from='mgr.14100 172.21.15.69:0/1681325650' entity='mgr.x' 2024-05-14T15:04:52.802 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:52 smithi069 ceph-mon[31270]: mgrmap e3: x(active, since 1.02453s) 2024-05-14T15:04:54.331 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-05-14T15:04:54.332 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2024-05-14T15:04:54.332 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsid": "1cc2580e-1203-11ef-bc98-c7b262605968", 2024-05-14T15:04:54.332 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "health": { 2024-05-14T15:04:54.332 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-05-14T15:04:54.332 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-05-14T15:04:54.332 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-05-14T15:04:54.332 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:54.332 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-05-14T15:04:54.332 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-05-14T15:04:54.332 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 0 2024-05-14T15:04:54.332 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-05-14T15:04:54.332 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-05-14T15:04:54.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "a" 2024-05-14T15:04:54.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-05-14T15:04:54.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "quorum_age": 14, 2024-05-14T15:04:54.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "monmap": { 2024-05-14T15:04:54.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T15:04:54.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-05-14T15:04:54.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-05-14T15:04:54.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:54.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-05-14T15:04:54.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T15:04:54.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-05-14T15:04:54.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-05-14T15:04:54.333 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-05-14T15:04:54.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-05-14T15:04:54.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-05-14T15:04:54.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-05-14T15:04:54.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:54.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-05-14T15:04:54.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-05-14T15:04:54.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-05-14T15:04:54.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-05-14T15:04:54.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-05-14T15:04:54.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-05-14T15:04:54.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-05-14T15:04:54.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-05-14T15:04:54.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-05-14T15:04:54.334 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:54.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-05-14T15:04:54.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T15:04:54.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-05-14T15:04:54.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-05-14T15:04:54.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:54.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-05-14T15:04:54.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-14T15:04:54.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-05-14T15:04:54.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modules": [ 2024-05-14T15:04:54.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "iostat", 2024-05-14T15:04:54.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "nfs", 2024-05-14T15:04:54.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "restful" 2024-05-14T15:04:54.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ], 2024-05-14T15:04:54.335 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T15:04:54.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:54.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-05-14T15:04:54.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-05-14T15:04:54.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "modified": "2024-05-14T15:04:32.075828+0000", 2024-05-14T15:04:54.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "services": {} 2024-05-14T15:04:54.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout }, 2024-05-14T15:04:54.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-05-14T15:04:54.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2024-05-14T15:04:54.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.328+0000 7f07b9800700 1 Processor -- start 2024-05-14T15:04:54.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.329+0000 7f07b9800700 1 -- start start 2024-05-14T15:04:54.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.329+0000 7f07b9800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b4080040 0x7f07b4080450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:54.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.329+0000 7f07b9800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f07b4080a60 con 0x7f07b4080040 2024-05-14T15:04:54.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.330+0000 7f07b2a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b4080040 0x7f07b4080450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:54.336 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.330+0000 7f07b2a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b4080040 0x7f07b4080450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56164/0 (socket says 172.21.15.69:56164) 2024-05-14T15:04:54.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.330+0000 7f07b2a00700 1 -- 172.21.15.69:0/3124496829 learned_addr learned my addr 172.21.15.69:0/3124496829 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:54.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.330+0000 7f07b2a00700 1 -- 172.21.15.69:0/3124496829 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b4081210 con 0x7f07b4080040 2024-05-14T15:04:54.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.330+0000 7f07b2a00700 1 --2- 172.21.15.69:0/3124496829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b4080040 0x7f07b4080450 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f07a40098a0 tx=0x7f07a4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bf3a270208d98e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:54.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.331+0000 7f07b1600700 1 -- 172.21.15.69:0/3124496829 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a4004160 con 0x7f07b4080040 2024-05-14T15:04:54.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.331+0000 7f07b1600700 1 -- 172.21.15.69:0/3124496829 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f07a4004300 con 0x7f07b4080040 2024-05-14T15:04:54.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.331+0000 7f07b1600700 1 -- 172.21.15.69:0/3124496829 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a40119e0 con 0x7f07b4080040 2024-05-14T15:04:54.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.332+0000 7f07b9800700 1 -- 172.21.15.69:0/3124496829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b4080040 msgr2=0x7f07b4080450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:54.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.332+0000 7f07b9800700 1 --2- 172.21.15.69:0/3124496829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b4080040 0x7f07b4080450 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f07a40098a0 tx=0x7f07a4009bb0 comp rx=0 tx=0).stop 2024-05-14T15:04:54.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.332+0000 7f07b9800700 1 -- 172.21.15.69:0/3124496829 shutdown_connections 2024-05-14T15:04:54.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.332+0000 7f07b9800700 1 --2- 172.21.15.69:0/3124496829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b4080040 0x7f07b4080450 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:54.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.332+0000 7f07b9800700 1 -- 172.21.15.69:0/3124496829 >> 172.21.15.69:0/3124496829 conn(0x7f07b407f050 msgr2=0x7f07b4109d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:54.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.332+0000 7f07b9800700 1 -- 172.21.15.69:0/3124496829 shutdown_connections 2024-05-14T15:04:54.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.332+0000 7f07b9800700 1 -- 172.21.15.69:0/3124496829 wait complete. 2024-05-14T15:04:54.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.333+0000 7f07b9800700 1 Processor -- start 2024-05-14T15:04:54.337 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.333+0000 7f07b9800700 1 -- start start 2024-05-14T15:04:54.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.333+0000 7f07b9800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b4080040 0x7f07b41a4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:54.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.333+0000 7f07b9800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f07b40825d0 con 0x7f07b4080040 2024-05-14T15:04:54.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.334+0000 7f07b2a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b4080040 0x7f07b41a4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:54.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.334+0000 7f07b2a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b4080040 0x7f07b41a4290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56180/0 (socket says 172.21.15.69:56180) 2024-05-14T15:04:54.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.334+0000 7f07b2a00700 1 -- 172.21.15.69:0/1374975178 learned_addr learned my addr 172.21.15.69:0/1374975178 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:54.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.334+0000 7f07b2a00700 1 -- 172.21.15.69:0/1374975178 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07b41a47d0 con 0x7f07b4080040 2024-05-14T15:04:54.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.334+0000 7f07b2a00700 1 --2- 172.21.15.69:0/1374975178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b4080040 0x7f07b41a4290 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f07a40116a0 tx=0x7f07a4011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:54.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.335+0000 7f07ab400700 1 -- 172.21.15.69:0/1374975178 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a40039f0 con 0x7f07b4080040 2024-05-14T15:04:54.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.335+0000 7f07ab400700 1 -- 172.21.15.69:0/1374975178 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f07a4003b90 con 0x7f07b4080040 2024-05-14T15:04:54.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.335+0000 7f07b9800700 1 -- 172.21.15.69:0/1374975178 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07b41a4a60 con 0x7f07b4080040 2024-05-14T15:04:54.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.335+0000 7f07ab400700 1 -- 172.21.15.69:0/1374975178 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07a401a600 con 0x7f07b4080040 2024-05-14T15:04:54.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.335+0000 7f07b9800700 1 -- 172.21.15.69:0/1374975178 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07b41a7670 con 0x7f07b4080040 2024-05-14T15:04:54.338 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.336+0000 7f07b9800700 1 -- 172.21.15.69:0/1374975178 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07b4064e20 con 0x7f07b4080040 2024-05-14T15:04:54.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.336+0000 7f07ab400700 1 -- 172.21.15.69:0/1374975178 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 3) ==== 50105+0+0 (secure 0 0 0) 0x7f07a4024430 con 0x7f07b4080040 2024-05-14T15:04:54.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.337+0000 7f07ab400700 1 --2- 172.21.15.69:0/1374975178 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f079803e3d0 0x7f07980408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:54.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.337+0000 7f07ab400700 1 -- 172.21.15.69:0/1374975178 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f07a4053940 con 0x7f07b4080040 2024-05-14T15:04:54.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.337+0000 7f07b2000700 1 --2- 172.21.15.69:0/1374975178 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f079803e3d0 0x7f07980408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:54.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.338+0000 7f07b2000700 1 --2- 172.21.15.69:0/1374975178 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f079803e3d0 0x7f07980408e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f07a0006fd0 tx=0x7f07a0006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:54.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.344+0000 7f07ab400700 1 -- 172.21.15.69:0/1374975178 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f07a4016dc0 con 0x7f07b4080040 2024-05-14T15:04:54.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.482+0000 7f07ab400700 1 -- 172.21.15.69:0/1374975178 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f07a4018a40 con 0x7f07b4080040 2024-05-14T15:04:54.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.663+0000 7f07b9800700 1 -- 172.21.15.69:0/1374975178 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f07b402e8f0 con 0x7f07b4080040 2024-05-14T15:04:54.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.664+0000 7f07ab400700 1 -- 172.21.15.69:0/1374975178 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1239 (secure 0 0 0) 0x7f07a40212e0 con 0x7f07b4080040 2024-05-14T15:04:54.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.667+0000 7f07b9800700 1 -- 172.21.15.69:0/1374975178 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f079803e3d0 msgr2=0x7f07980408e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:54.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.667+0000 7f07b9800700 1 --2- 172.21.15.69:0/1374975178 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f079803e3d0 0x7f07980408e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f07a0006fd0 tx=0x7f07a0006e40 comp rx=0 tx=0).stop 2024-05-14T15:04:54.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.667+0000 7f07b9800700 1 -- 172.21.15.69:0/1374975178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b4080040 msgr2=0x7f07b41a4290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:54.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.667+0000 7f07b9800700 1 --2- 172.21.15.69:0/1374975178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b4080040 0x7f07b41a4290 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f07a40116a0 tx=0x7f07a4011a60 comp rx=0 tx=0).stop 2024-05-14T15:04:54.339 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.668+0000 7f07b9800700 1 -- 172.21.15.69:0/1374975178 shutdown_connections 2024-05-14T15:04:54.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.668+0000 7f07b9800700 1 --2- 172.21.15.69:0/1374975178 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f079803e3d0 0x7f07980408e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:54.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.668+0000 7f07b9800700 1 --2- 172.21.15.69:0/1374975178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f07b4080040 0x7f07b41a4290 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:54.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.668+0000 7f07b9800700 1 -- 172.21.15.69:0/1374975178 >> 172.21.15.69:0/1374975178 conn(0x7f07b407f050 msgr2=0x7f07b410a220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:54.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.668+0000 7f07b9800700 1 -- 172.21.15.69:0/1374975178 shutdown_connections 2024-05-14T15:04:54.340 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:53.668+0000 7f07b9800700 1 -- 172.21.15.69:0/1374975178 wait complete. 2024-05-14T15:04:54.340 INFO:teuthology.orchestra.run.smithi069.stdout:mgr is available 2024-05-14T15:04:54.712 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:54 smithi069 ceph-mon[31270]: mgrmap e4: x(active, since 2s) 2024-05-14T15:04:54.712 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:54 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1374975178' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-14T15:04:55.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:55 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/4192849856' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-14T15:04:56.065 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-05-14T15:04:56.065 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [global] 2024-05-14T15:04:56.065 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout fsid = 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:04:56.066 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-05-14T15:04:56.066 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-05-14T15:04:56.066 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-05-14T15:04:56.066 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-05-14T15:04:56.066 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-05-14T15:04:56.066 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-05-14T15:04:56.066 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [mgr] 2024-05-14T15:04:56.066 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-05-14T15:04:56.066 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 2024-05-14T15:04:56.066 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout [osd] 2024-05-14T15:04:56.066 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-05-14T15:04:56.066 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-05-14T15:04:56.066 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-05-14T15:04:56.066 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-05-14T15:04:56.066 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-05-14T15:04:56.067 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.160+0000 7f57eee00700 1 Processor -- start 2024-05-14T15:04:56.067 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.161+0000 7f57eee00700 1 -- start start 2024-05-14T15:04:56.067 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.161+0000 7f57eee00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57e8109a10 0x7f57e8109e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:56.067 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.161+0000 7f57eee00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f57e810a410 con 0x7f57e8109a10 2024-05-14T15:04:56.067 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.161+0000 7f57e7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57e8109a10 0x7f57e8109e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:56.067 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.161+0000 7f57e7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57e8109a10 0x7f57e8109e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56190/0 (socket says 172.21.15.69:56190) 2024-05-14T15:04:56.067 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.161+0000 7f57e7e00700 1 -- 172.21.15.69:0/1421131780 learned_addr learned my addr 172.21.15.69:0/1421131780 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:56.067 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.162+0000 7f57e7e00700 1 -- 172.21.15.69:0/1421131780 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e810ab40 con 0x7f57e8109a10 2024-05-14T15:04:56.067 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.162+0000 7f57e7e00700 1 --2- 172.21.15.69:0/1421131780 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57e8109a10 0x7f57e8109e20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f57d80098a0 tx=0x7f57d8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96cdbd255f454392 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:56.067 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.162+0000 7f57e6a00700 1 -- 172.21.15.69:0/1421131780 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57d8004160 con 0x7f57e8109a10 2024-05-14T15:04:56.067 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.163+0000 7f57e6a00700 1 -- 172.21.15.69:0/1421131780 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f57d8004300 con 0x7f57e8109a10 2024-05-14T15:04:56.067 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.163+0000 7f57e6a00700 1 -- 172.21.15.69:0/1421131780 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57d80119e0 con 0x7f57e8109a10 2024-05-14T15:04:56.067 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.163+0000 7f57eee00700 1 -- 172.21.15.69:0/1421131780 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57e8109a10 msgr2=0x7f57e8109e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:56.067 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.163+0000 7f57eee00700 1 --2- 172.21.15.69:0/1421131780 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57e8109a10 0x7f57e8109e20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f57d80098a0 tx=0x7f57d8009bb0 comp rx=0 tx=0).stop 2024-05-14T15:04:56.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.163+0000 7f57eee00700 1 -- 172.21.15.69:0/1421131780 shutdown_connections 2024-05-14T15:04:56.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.163+0000 7f57eee00700 1 --2- 172.21.15.69:0/1421131780 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57e8109a10 0x7f57e8109e20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:56.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.163+0000 7f57eee00700 1 -- 172.21.15.69:0/1421131780 >> 172.21.15.69:0/1421131780 conn(0x7f57e8105070 msgr2=0x7f57e8107500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:56.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.164+0000 7f57eee00700 1 -- 172.21.15.69:0/1421131780 shutdown_connections 2024-05-14T15:04:56.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.164+0000 7f57eee00700 1 -- 172.21.15.69:0/1421131780 wait complete. 2024-05-14T15:04:56.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.165+0000 7f57eee00700 1 Processor -- start 2024-05-14T15:04:56.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.165+0000 7f57eee00700 1 -- start start 2024-05-14T15:04:56.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.165+0000 7f57eee00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57e8109a10 0x7f57e819fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:56.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.165+0000 7f57eee00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f57e810def0 con 0x7f57e8109a10 2024-05-14T15:04:56.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.165+0000 7f57e7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57e8109a10 0x7f57e819fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:56.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.165+0000 7f57e7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57e8109a10 0x7f57e819fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56196/0 (socket says 172.21.15.69:56196) 2024-05-14T15:04:56.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.166+0000 7f57e7e00700 1 -- 172.21.15.69:0/4192849856 learned_addr learned my addr 172.21.15.69:0/4192849856 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:56.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.166+0000 7f57e7e00700 1 -- 172.21.15.69:0/4192849856 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57e81a0410 con 0x7f57e8109a10 2024-05-14T15:04:56.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.166+0000 7f57e7e00700 1 --2- 172.21.15.69:0/4192849856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57e8109a10 0x7f57e819fed0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f57d80119b0 tx=0x7f57d8011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:56.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.166+0000 7f57e4c00700 1 -- 172.21.15.69:0/4192849856 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57d8003970 con 0x7f57e8109a10 2024-05-14T15:04:56.068 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.166+0000 7f57e4c00700 1 -- 172.21.15.69:0/4192849856 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f57d8003b10 con 0x7f57e8109a10 2024-05-14T15:04:56.069 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.167+0000 7f57eee00700 1 -- 172.21.15.69:0/4192849856 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57e81a06a0 con 0x7f57e8109a10 2024-05-14T15:04:56.069 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.167+0000 7f57e4c00700 1 -- 172.21.15.69:0/4192849856 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f57d8024610 con 0x7f57e8109a10 2024-05-14T15:04:56.069 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.167+0000 7f57eee00700 1 -- 172.21.15.69:0/4192849856 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57e81a32b0 con 0x7f57e8109a10 2024-05-14T15:04:56.069 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.168+0000 7f57e4c00700 1 -- 172.21.15.69:0/4192849856 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f57d801a430 con 0x7f57e8109a10 2024-05-14T15:04:56.069 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.168+0000 7f57eee00700 1 -- 172.21.15.69:0/4192849856 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57e8064e20 con 0x7f57e8109a10 2024-05-14T15:04:56.069 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.168+0000 7f57e4c00700 1 --2- 172.21.15.69:0/4192849856 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f57cc03e530 0x7f57cc040a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:56.069 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.169+0000 7f57e4c00700 1 -- 172.21.15.69:0/4192849856 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f57d80538b0 con 0x7f57e8109a10 2024-05-14T15:04:56.069 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.169+0000 7f57e7400700 1 --2- 172.21.15.69:0/4192849856 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f57cc03e530 0x7f57cc040a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:56.069 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.170+0000 7f57e7400700 1 --2- 172.21.15.69:0/4192849856 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f57cc03e530 0x7f57cc040a40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f57d4006fd0 tx=0x7f57d4006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:56.069 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.175+0000 7f57e4c00700 1 -- 172.21.15.69:0/4192849856 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f57d800b3e0 con 0x7f57e8109a10 2024-05-14T15:04:56.069 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.395+0000 7f57eee00700 1 -- 172.21.15.69:0/4192849856 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f57e81a3480 con 0x7f57e8109a10 2024-05-14T15:04:56.069 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.397+0000 7f57e4c00700 1 -- 172.21.15.69:0/4192849856 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+409 (secure 0 0 0) 0x7f57d802de10 con 0x7f57e8109a10 2024-05-14T15:04:56.069 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.400+0000 7f57eee00700 1 -- 172.21.15.69:0/4192849856 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f57cc03e530 msgr2=0x7f57cc040a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:56.069 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.400+0000 7f57eee00700 1 --2- 172.21.15.69:0/4192849856 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f57cc03e530 0x7f57cc040a40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f57d4006fd0 tx=0x7f57d4006e40 comp rx=0 tx=0).stop 2024-05-14T15:04:56.069 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.400+0000 7f57eee00700 1 -- 172.21.15.69:0/4192849856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57e8109a10 msgr2=0x7f57e819fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:56.070 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.400+0000 7f57eee00700 1 --2- 172.21.15.69:0/4192849856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57e8109a10 0x7f57e819fed0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f57d80119b0 tx=0x7f57d8011a90 comp rx=0 tx=0).stop 2024-05-14T15:04:56.070 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.400+0000 7f57eee00700 1 -- 172.21.15.69:0/4192849856 shutdown_connections 2024-05-14T15:04:56.070 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.400+0000 7f57eee00700 1 --2- 172.21.15.69:0/4192849856 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f57cc03e530 0x7f57cc040a40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:56.070 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.400+0000 7f57eee00700 1 --2- 172.21.15.69:0/4192849856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57e8109a10 0x7f57e819fed0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:56.070 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.400+0000 7f57eee00700 1 -- 172.21.15.69:0/4192849856 >> 172.21.15.69:0/4192849856 conn(0x7f57e8105070 msgr2=0x7f57e807da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:56.070 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.401+0000 7f57eee00700 1 -- 172.21.15.69:0/4192849856 shutdown_connections 2024-05-14T15:04:56.070 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:55.401+0000 7f57eee00700 1 -- 172.21.15.69:0/4192849856 wait complete. 2024-05-14T15:04:56.070 INFO:teuthology.orchestra.run.smithi069.stdout:Enabling cephadm module... 2024-05-14T15:04:57.273 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:57 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2923142257' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-14T15:04:57.689 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: ignoring --setuser ceph since I am not root 2024-05-14T15:04:57.689 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: ignoring --setgroup ceph since I am not root 2024-05-14T15:04:57.689 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:57.453+0000 7f58ad4df200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T15:04:57.689 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:57.698+0000 7f58ad4df200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:04:57.791 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.738+0000 7f0797600700 1 Processor -- start 2024-05-14T15:04:57.797 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.738+0000 7f0797600700 1 -- start start 2024-05-14T15:04:57.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.738+0000 7f0797600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f079010a500 0x7f079010c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:57.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.738+0000 7f0797600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f079007d7c0 con 0x7f079010a500 2024-05-14T15:04:57.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.739+0000 7f0794c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f079010a500 0x7f079010c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:57.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.739+0000 7f0794c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f079010a500 0x7f079010c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56206/0 (socket says 172.21.15.69:56206) 2024-05-14T15:04:57.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.739+0000 7f0794c00700 1 -- 172.21.15.69:0/560545187 learned_addr learned my addr 172.21.15.69:0/560545187 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:57.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.740+0000 7f0794c00700 1 -- 172.21.15.69:0/560545187 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f079010ce60 con 0x7f079010a500 2024-05-14T15:04:57.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.740+0000 7f0794c00700 1 --2- 172.21.15.69:0/560545187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f079010a500 0x7f079010c920 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f07840098a0 tx=0x7f0784009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e329ea6b1d163f14 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:57.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.740+0000 7f078f400700 1 -- 172.21.15.69:0/560545187 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0784004160 con 0x7f079010a500 2024-05-14T15:04:57.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.740+0000 7f078f400700 1 -- 172.21.15.69:0/560545187 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0784004300 con 0x7f079010a500 2024-05-14T15:04:57.798 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.740+0000 7f078f400700 1 -- 172.21.15.69:0/560545187 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f07840119e0 con 0x7f079010a500 2024-05-14T15:04:57.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.741+0000 7f0797600700 1 -- 172.21.15.69:0/560545187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f079010a500 msgr2=0x7f079010c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:57.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.741+0000 7f0797600700 1 --2- 172.21.15.69:0/560545187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f079010a500 0x7f079010c920 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f07840098a0 tx=0x7f0784009bb0 comp rx=0 tx=0).stop 2024-05-14T15:04:57.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.741+0000 7f0797600700 1 -- 172.21.15.69:0/560545187 shutdown_connections 2024-05-14T15:04:57.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.741+0000 7f0797600700 1 --2- 172.21.15.69:0/560545187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f079010a500 0x7f079010c920 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:57.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.741+0000 7f0797600700 1 -- 172.21.15.69:0/560545187 >> 172.21.15.69:0/560545187 conn(0x7f0790103f00 msgr2=0x7f07901063b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:57.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.741+0000 7f0797600700 1 -- 172.21.15.69:0/560545187 shutdown_connections 2024-05-14T15:04:57.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.741+0000 7f0797600700 1 -- 172.21.15.69:0/560545187 wait complete. 2024-05-14T15:04:57.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.742+0000 7f0797600700 1 Processor -- start 2024-05-14T15:04:57.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.742+0000 7f0797600700 1 -- start start 2024-05-14T15:04:57.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.743+0000 7f0797600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f079010a500 0x7f079019feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:57.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.743+0000 7f0797600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f079010dd00 con 0x7f079010a500 2024-05-14T15:04:57.799 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.743+0000 7f0794c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f079010a500 0x7f079019feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:57.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.743+0000 7f0794c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f079010a500 0x7f079019feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56214/0 (socket says 172.21.15.69:56214) 2024-05-14T15:04:57.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.743+0000 7f0794c00700 1 -- 172.21.15.69:0/2923142257 learned_addr learned my addr 172.21.15.69:0/2923142257 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:57.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.743+0000 7f0794c00700 1 -- 172.21.15.69:0/2923142257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07901a03f0 con 0x7f079010a500 2024-05-14T15:04:57.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.744+0000 7f0794c00700 1 --2- 172.21.15.69:0/2923142257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f079010a500 0x7f079019feb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f07840119b0 tx=0x7f0784011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:57.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.744+0000 7f078d600700 1 -- 172.21.15.69:0/2923142257 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0784003af0 con 0x7f079010a500 2024-05-14T15:04:57.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.744+0000 7f078d600700 1 -- 172.21.15.69:0/2923142257 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f078401a8a0 con 0x7f079010a500 2024-05-14T15:04:57.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.744+0000 7f078d600700 1 -- 172.21.15.69:0/2923142257 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0784024830 con 0x7f079010a500 2024-05-14T15:04:57.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.744+0000 7f0797600700 1 -- 172.21.15.69:0/2923142257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07901a0680 con 0x7f079010a500 2024-05-14T15:04:57.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.744+0000 7f0797600700 1 -- 172.21.15.69:0/2923142257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07901a3290 con 0x7f079010a500 2024-05-14T15:04:57.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.745+0000 7f0797600700 1 -- 172.21.15.69:0/2923142257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0790064e20 con 0x7f079010a500 2024-05-14T15:04:57.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.746+0000 7f078d600700 1 -- 172.21.15.69:0/2923142257 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 4) ==== 50211+0+0 (secure 0 0 0) 0x7f0784022020 con 0x7f079010a500 2024-05-14T15:04:57.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.746+0000 7f078d600700 1 --2- 172.21.15.69:0/2923142257 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f077803e530 0x7f0778040a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:57.800 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.746+0000 7f078d600700 1 -- 172.21.15.69:0/2923142257 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0784053650 con 0x7f079010a500 2024-05-14T15:04:57.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.746+0000 7f078fe00700 1 --2- 172.21.15.69:0/2923142257 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f077803e530 0x7f0778040a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:57.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.747+0000 7f078fe00700 1 --2- 172.21.15.69:0/2923142257 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f077803e530 0x7f0778040a40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f077c006fd0 tx=0x7f077c006e40 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:57.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:56.752+0000 7f078d600700 1 -- 172.21.15.69:0/2923142257 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f07840533b0 con 0x7f079010a500 2024-05-14T15:04:57.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:57.043+0000 7f0797600700 1 -- 172.21.15.69:0/2923142257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f079002e5f0 con 0x7f079010a500 2024-05-14T15:04:57.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:57.097+0000 7f078d600700 1 -- 172.21.15.69:0/2923142257 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f079002e5f0 con 0x7f079010a500 2024-05-14T15:04:57.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:57.100+0000 7f0797600700 1 -- 172.21.15.69:0/2923142257 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f077803e530 msgr2=0x7f0778040a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:57.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:57.100+0000 7f0797600700 1 --2- 172.21.15.69:0/2923142257 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f077803e530 0x7f0778040a40 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f077c006fd0 tx=0x7f077c006e40 comp rx=0 tx=0).stop 2024-05-14T15:04:57.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:57.100+0000 7f0797600700 1 -- 172.21.15.69:0/2923142257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f079010a500 msgr2=0x7f079019feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:57.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:57.101+0000 7f078d600700 1 -- 172.21.15.69:0/2923142257 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f078401a430 con 0x7f079010a500 2024-05-14T15:04:57.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:57.101+0000 7f0797600700 1 --2- 172.21.15.69:0/2923142257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f079010a500 0x7f079019feb0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f07840119b0 tx=0x7f0784011a90 comp rx=0 tx=0).stop 2024-05-14T15:04:57.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:57.101+0000 7f0797600700 1 -- 172.21.15.69:0/2923142257 shutdown_connections 2024-05-14T15:04:57.801 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:57.101+0000 7f0797600700 1 --2- 172.21.15.69:0/2923142257 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f077803e530 0x7f0778040a40 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:57.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:57.101+0000 7f0797600700 1 --2- 172.21.15.69:0/2923142257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f079010a500 0x7f079019feb0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:57.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:57.101+0000 7f0797600700 1 -- 172.21.15.69:0/2923142257 >> 172.21.15.69:0/2923142257 conn(0x7f0790103f00 msgr2=0x7f0790108480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:57.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:57.102+0000 7f0797600700 1 -- 172.21.15.69:0/2923142257 shutdown_connections 2024-05-14T15:04:57.802 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:57.102+0000 7f0797600700 1 -- 172.21.15.69:0/2923142257 wait complete. 2024-05-14T15:04:57.944 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:57.833+0000 7f58ad4df200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T15:04:58.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:58 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2923142257' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-14T15:04:58.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:58 smithi069 ceph-mon[31270]: mgrmap e5: x(active, since 5s) 2024-05-14T15:04:58.502 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:58 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:58.250+0000 7f58ad4df200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T15:04:58.502 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:58 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:58.371+0000 7f58ad4df200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T15:04:59.463 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:04:59 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2039328260' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-14T15:04:59.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2024-05-14T15:04:59.586 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-05-14T15:04:59.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-14T15:04:59.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-14T15:04:59.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-14T15:04:59.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2024-05-14T15:04:59.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.511+0000 7f2167200700 1 Processor -- start 2024-05-14T15:04:59.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.511+0000 7f2167200700 1 -- start start 2024-05-14T15:04:59.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.511+0000 7f2167200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f216807edd0 0x7f216807d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:59.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.511+0000 7f2167200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f216807d740 con 0x7f216807edd0 2024-05-14T15:04:59.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.512+0000 7f2165e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f216807edd0 0x7f216807d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:59.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.512+0000 7f2165e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f216807edd0 0x7f216807d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56256/0 (socket says 172.21.15.69:56256) 2024-05-14T15:04:59.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.512+0000 7f2165e00700 1 -- 172.21.15.69:0/637559521 learned_addr learned my addr 172.21.15.69:0/637559521 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:59.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.513+0000 7f2165e00700 1 -- 172.21.15.69:0/637559521 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f216807d8c0 con 0x7f216807edd0 2024-05-14T15:04:59.587 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.513+0000 7f2165e00700 1 --2- 172.21.15.69:0/637559521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f216807edd0 0x7f216807d200 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f21580098a0 tx=0x7f2158009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c9dd34028d3eb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:59.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.513+0000 7f2164a00700 1 -- 172.21.15.69:0/637559521 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2158004160 con 0x7f216807edd0 2024-05-14T15:04:59.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.513+0000 7f2164a00700 1 -- 172.21.15.69:0/637559521 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f2158004300 con 0x7f216807edd0 2024-05-14T15:04:59.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.513+0000 7f2164a00700 1 -- 172.21.15.69:0/637559521 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21580119e0 con 0x7f216807edd0 2024-05-14T15:04:59.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.514+0000 7f2167200700 1 -- 172.21.15.69:0/637559521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f216807edd0 msgr2=0x7f216807d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:59.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.514+0000 7f2167200700 1 --2- 172.21.15.69:0/637559521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f216807edd0 0x7f216807d200 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f21580098a0 tx=0x7f2158009bb0 comp rx=0 tx=0).stop 2024-05-14T15:04:59.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.514+0000 7f2167200700 1 -- 172.21.15.69:0/637559521 shutdown_connections 2024-05-14T15:04:59.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.514+0000 7f2167200700 1 --2- 172.21.15.69:0/637559521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f216807edd0 0x7f216807d200 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:59.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.514+0000 7f2167200700 1 -- 172.21.15.69:0/637559521 >> 172.21.15.69:0/637559521 conn(0x7f2168104e60 msgr2=0x7f21681072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:59.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.515+0000 7f2167200700 1 -- 172.21.15.69:0/637559521 shutdown_connections 2024-05-14T15:04:59.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.515+0000 7f2167200700 1 -- 172.21.15.69:0/637559521 wait complete. 2024-05-14T15:04:59.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.516+0000 7f2167200700 1 Processor -- start 2024-05-14T15:04:59.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.516+0000 7f2167200700 1 -- start start 2024-05-14T15:04:59.588 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.517+0000 7f2167200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f216807edd0 0x7f216819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:59.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.517+0000 7f2167200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f216810fd20 con 0x7f216807edd0 2024-05-14T15:04:59.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.517+0000 7f2165e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f216807edd0 0x7f216819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:04:59.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.517+0000 7f2165e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f216807edd0 0x7f216819fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56264/0 (socket says 172.21.15.69:56264) 2024-05-14T15:04:59.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.517+0000 7f2165e00700 1 -- 172.21.15.69:0/2039328260 learned_addr learned my addr 172.21.15.69:0/2039328260 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:04:59.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.517+0000 7f2165e00700 1 -- 172.21.15.69:0/2039328260 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21681a0200 con 0x7f216807edd0 2024-05-14T15:04:59.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.518+0000 7f2165e00700 1 --2- 172.21.15.69:0/2039328260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f216807edd0 0x7f216819fcc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f21580119b0 tx=0x7f2158011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:04:59.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.518+0000 7f215ea00700 1 -- 172.21.15.69:0/2039328260 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2158003af0 con 0x7f216807edd0 2024-05-14T15:04:59.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.518+0000 7f215ea00700 1 -- 172.21.15.69:0/2039328260 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f215801a8a0 con 0x7f216807edd0 2024-05-14T15:04:59.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.518+0000 7f215ea00700 1 -- 172.21.15.69:0/2039328260 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2158024830 con 0x7f216807edd0 2024-05-14T15:04:59.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.518+0000 7f2167200700 1 -- 172.21.15.69:0/2039328260 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21681a0490 con 0x7f216807edd0 2024-05-14T15:04:59.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.518+0000 7f2167200700 1 -- 172.21.15.69:0/2039328260 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21681a30a0 con 0x7f216807edd0 2024-05-14T15:04:59.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.519+0000 7f2167200700 1 -- 172.21.15.69:0/2039328260 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2168064e20 con 0x7f216807edd0 2024-05-14T15:04:59.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.520+0000 7f215ea00700 1 -- 172.21.15.69:0/2039328260 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f2158022020 con 0x7f216807edd0 2024-05-14T15:04:59.589 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.521+0000 7f215ea00700 1 --2- 172.21.15.69:0/2039328260 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f214c03e530 0x7f214c040a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:04:59.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.521+0000 7f215ea00700 1 -- 172.21.15.69:0/2039328260 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f21580535e0 con 0x7f216807edd0 2024-05-14T15:04:59.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.521+0000 7f2165400700 1 -- 172.21.15.69:0/2039328260 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f214c03e530 msgr2=0x7f214c040a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/586229880 2024-05-14T15:04:59.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.521+0000 7f2165400700 1 --2- 172.21.15.69:0/2039328260 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f214c03e530 0x7f214c040a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T15:04:59.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.526+0000 7f215ea00700 1 -- 172.21.15.69:0/2039328260 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f215800f2e0 con 0x7f216807edd0 2024-05-14T15:04:59.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.722+0000 7f2165400700 1 -- 172.21.15.69:0/2039328260 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f214c03e530 msgr2=0x7f214c040a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/586229880 2024-05-14T15:04:59.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.722+0000 7f2165400700 1 --2- 172.21.15.69:0/2039328260 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f214c03e530 0x7f214c040a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T15:04:59.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.819+0000 7f2167200700 1 -- 172.21.15.69:0/2039328260 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f21681a3390 con 0x7f216807edd0 2024-05-14T15:04:59.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.820+0000 7f215ea00700 1 -- 172.21.15.69:0/2039328260 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f21580532c0 con 0x7f216807edd0 2024-05-14T15:04:59.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.824+0000 7f2167200700 1 -- 172.21.15.69:0/2039328260 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f214c03e530 msgr2=0x7f214c040a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T15:04:59.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.824+0000 7f2167200700 1 --2- 172.21.15.69:0/2039328260 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f214c03e530 0x7f214c040a40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:59.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.824+0000 7f2167200700 1 -- 172.21.15.69:0/2039328260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f216807edd0 msgr2=0x7f216819fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:04:59.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.824+0000 7f2167200700 1 --2- 172.21.15.69:0/2039328260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f216807edd0 0x7f216819fcc0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f21580119b0 tx=0x7f2158011a90 comp rx=0 tx=0).stop 2024-05-14T15:04:59.590 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.824+0000 7f2167200700 1 -- 172.21.15.69:0/2039328260 shutdown_connections 2024-05-14T15:04:59.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.824+0000 7f2167200700 1 --2- 172.21.15.69:0/2039328260 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f214c03e530 0x7f214c040a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:59.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.824+0000 7f2167200700 1 --2- 172.21.15.69:0/2039328260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f216807edd0 0x7f216819fcc0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:04:59.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.824+0000 7f2167200700 1 -- 172.21.15.69:0/2039328260 >> 172.21.15.69:0/2039328260 conn(0x7f2168104e60 msgr2=0x7f21681066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:04:59.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.824+0000 7f2167200700 1 -- 172.21.15.69:0/2039328260 shutdown_connections 2024-05-14T15:04:59.591 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:04:58.825+0000 7f2167200700 1 -- 172.21.15.69:0/2039328260 wait complete. 2024-05-14T15:04:59.591 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for the mgr to restart... 2024-05-14T15:04:59.591 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mgr epoch 5... 2024-05-14T15:05:00.141 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:04:59 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:04:59.942+0000 7f58ad4df200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T15:05:00.462 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:00.178+0000 7f58ad4df200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T15:05:00.463 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:00.396+0000 7f58ad4df200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T15:05:01.143 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:00.778+0000 7f58ad4df200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T15:05:01.143 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:00.902+0000 7f58ad4df200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T15:05:01.400 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:01 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:01.152+0000 7f58ad4df200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T15:05:01.704 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:01 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:01.409+0000 7f58ad4df200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:05:02.463 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:02 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:02.190+0000 7f58ad4df200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T15:05:02.963 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:02 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:02.475+0000 7f58ad4df200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T15:05:03.306 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:03 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:03.025+0000 7f58ad4df200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T15:05:03.306 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:03 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:03.152+0000 7f58ad4df200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T15:05:03.963 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:03 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:03.613+0000 7f58ad4df200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T15:05:04.463 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:04 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:04.060+0000 7f58ad4df200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T15:05:04.463 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:04 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:04.186+0000 7f58ad4df200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T15:05:04.806 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:04 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:04.508+0000 7f58ad4df200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T15:05:04.806 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:04 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:04.687+0000 7f58ad4df200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T15:05:04.806 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:04 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:04.815+0000 7f58ad4df200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T15:05:05.463 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:05 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:05.208+0000 7f58ad4df200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T15:05:05.463 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:05 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:05.333+0000 7f58ad4df200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T15:05:06.360 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:06 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:06.082+0000 7f58ad4df200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T15:05:06.361 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:06 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:06.368+0000 7f58ad4df200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T15:05:06.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:06 smithi069 ceph-mon[31270]: Active manager daemon x restarted 2024-05-14T15:05:06.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:06 smithi069 ceph-mon[31270]: Activating manager daemon x 2024-05-14T15:05:06.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:06 smithi069 ceph-mon[31270]: osdmap e2: 0 total, 0 up, 0 in 2024-05-14T15:05:06.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:06 smithi069 ceph-mon[31270]: mgrmap e6: x(active, starting, since 0.0103948s) 2024-05-14T15:05:06.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:06 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:05:06.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:06 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-14T15:05:06.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:06 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-14T15:05:06.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:06 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-14T15:05:06.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:06 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-14T15:05:06.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:06 smithi069 ceph-mon[31270]: Manager daemon x is now available 2024-05-14T15:05:07.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:07 smithi069 ceph-mon[31270]: Found migration_current of "None". Setting to last migration. 2024-05-14T15:05:07.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:07 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' 2024-05-14T15:05:07.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:07 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' 2024-05-14T15:05:07.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:07 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:05:07.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:07 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:05:07.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:07 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-14T15:05:07.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:07 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-14T15:05:07.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:07 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' 2024-05-14T15:05:07.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:07 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' 2024-05-14T15:05:07.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:07 smithi069 ceph-mon[31270]: [14/May/2024:15:05:07] ENGINE Bus STARTING 2024-05-14T15:05:07.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:07 smithi069 ceph-mon[31270]: [14/May/2024:15:05:07] ENGINE Serving on http://172.21.15.69:8765 2024-05-14T15:05:07.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:07 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:05:07.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:07 smithi069 ceph-mon[31270]: mgrmap e7: x(active, since 1.01963s) 2024-05-14T15:05:08.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2024-05-14T15:05:08.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-05-14T15:05:08.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-14T15:05:08.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2024-05-14T15:05:08.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.301+0000 7f0f0a600700 1 Processor -- start 2024-05-14T15:05:08.096 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.301+0000 7f0f0a600700 1 -- start start 2024-05-14T15:05:08.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.302+0000 7f0f0a600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0410a410 0x7f0f0410c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:08.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.302+0000 7f0f0a600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0407ce40 con 0x7f0f0410a410 2024-05-14T15:05:08.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.302+0000 7f0f03400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0410a410 0x7f0f0410c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:08.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.302+0000 7f0f03400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0410a410 0x7f0f0410c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56272/0 (socket says 172.21.15.69:56272) 2024-05-14T15:05:08.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.302+0000 7f0f03400700 1 -- 172.21.15.69:0/2075249300 learned_addr learned my addr 172.21.15.69:0/2075249300 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:08.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.303+0000 7f0f03400700 1 -- 172.21.15.69:0/2075249300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0410cd70 con 0x7f0f0410a410 2024-05-14T15:05:08.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.303+0000 7f0f03400700 1 --2- 172.21.15.69:0/2075249300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0410a410 0x7f0f0410c830 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0ef40098a0 tx=0x7f0ef4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=777a8de7c00c7fdd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:08.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.303+0000 7f0f02000700 1 -- 172.21.15.69:0/2075249300 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef4004160 con 0x7f0f0410a410 2024-05-14T15:05:08.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.303+0000 7f0f02000700 1 -- 172.21.15.69:0/2075249300 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0ef4004300 con 0x7f0f0410a410 2024-05-14T15:05:08.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.303+0000 7f0f02000700 1 -- 172.21.15.69:0/2075249300 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef40119e0 con 0x7f0f0410a410 2024-05-14T15:05:08.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.304+0000 7f0f0a600700 1 -- 172.21.15.69:0/2075249300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0410a410 msgr2=0x7f0f0410c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:08.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.304+0000 7f0f0a600700 1 --2- 172.21.15.69:0/2075249300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0410a410 0x7f0f0410c830 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f0ef40098a0 tx=0x7f0ef4009bb0 comp rx=0 tx=0).stop 2024-05-14T15:05:08.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.304+0000 7f0f0a600700 1 -- 172.21.15.69:0/2075249300 shutdown_connections 2024-05-14T15:05:08.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.304+0000 7f0f0a600700 1 --2- 172.21.15.69:0/2075249300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0410a410 0x7f0f0410c830 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:08.097 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.304+0000 7f0f0a600700 1 -- 172.21.15.69:0/2075249300 >> 172.21.15.69:0/2075249300 conn(0x7f0f04103ed0 msgr2=0x7f0f04106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:08.098 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.304+0000 7f0f0a600700 1 -- 172.21.15.69:0/2075249300 shutdown_connections 2024-05-14T15:05:08.098 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.305+0000 7f0f0a600700 1 -- 172.21.15.69:0/2075249300 wait complete. 2024-05-14T15:05:08.098 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.305+0000 7f0f0a600700 1 Processor -- start 2024-05-14T15:05:08.098 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.306+0000 7f0f0a600700 1 -- start start 2024-05-14T15:05:08.098 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.306+0000 7f0f0a600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0410a410 0x7f0f0419fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:08.098 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.306+0000 7f0f0a600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0410dcd0 con 0x7f0f0410a410 2024-05-14T15:05:08.098 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.306+0000 7f0f03400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0410a410 0x7f0f0419fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:08.098 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.306+0000 7f0f03400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0410a410 0x7f0f0419fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56274/0 (socket says 172.21.15.69:56274) 2024-05-14T15:05:08.098 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.306+0000 7f0f03400700 1 -- 172.21.15.69:0/3591193773 learned_addr learned my addr 172.21.15.69:0/3591193773 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:08.098 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.307+0000 7f0f03400700 1 -- 172.21.15.69:0/3591193773 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f041a03a0 con 0x7f0f0410a410 2024-05-14T15:05:08.098 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.307+0000 7f0f03400700 1 --2- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0410a410 0x7f0f0419fe60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0ef40119b0 tx=0x7f0ef4011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:08.098 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.307+0000 7f0efbe00700 1 -- 172.21.15.69:0/3591193773 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef4003af0 con 0x7f0f0410a410 2024-05-14T15:05:08.098 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.307+0000 7f0efbe00700 1 -- 172.21.15.69:0/3591193773 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f0ef401a8a0 con 0x7f0f0410a410 2024-05-14T15:05:08.098 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.307+0000 7f0f0a600700 1 -- 172.21.15.69:0/3591193773 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f041a0630 con 0x7f0f0410a410 2024-05-14T15:05:08.099 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.307+0000 7f0efbe00700 1 -- 172.21.15.69:0/3591193773 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ef4024830 con 0x7f0f0410a410 2024-05-14T15:05:08.099 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.308+0000 7f0f0a600700 1 -- 172.21.15.69:0/3591193773 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f041a3240 con 0x7f0f0410a410 2024-05-14T15:05:08.099 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.309+0000 7f0efbe00700 1 -- 172.21.15.69:0/3591193773 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 5) ==== 50222+0+0 (secure 0 0 0) 0x7f0ef4022020 con 0x7f0f0410a410 2024-05-14T15:05:08.099 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.309+0000 7f0efbe00700 1 --2- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f0ee803e580 0x7f0ee8040a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:08.099 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.310+0000 7f0efbe00700 1 -- 172.21.15.69:0/3591193773 --> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0ee80411a0 con 0x7f0ee803e580 2024-05-14T15:05:08.099 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.310+0000 7f0efbe00700 1 -- 172.21.15.69:0/3591193773 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0ef40535c0 con 0x7f0f0410a410 2024-05-14T15:05:08.099 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.310+0000 7f0f02a00700 1 -- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f0ee803e580 msgr2=0x7f0ee8040a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/586229880 2024-05-14T15:05:08.099 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.310+0000 7f0f02a00700 1 --2- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f0ee803e580 0x7f0ee8040a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T15:05:08.099 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.511+0000 7f0f02a00700 1 -- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f0ee803e580 msgr2=0x7f0ee8040a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/586229880 2024-05-14T15:05:08.099 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.511+0000 7f0f02a00700 1 --2- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f0ee803e580 0x7f0ee8040a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T15:05:08.099 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.912+0000 7f0f02a00700 1 -- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f0ee803e580 msgr2=0x7f0ee8040a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/586229880 2024-05-14T15:05:08.099 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:00.912+0000 7f0f02a00700 1 --2- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f0ee803e580 0x7f0ee8040a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-14T15:05:08.099 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:01.713+0000 7f0f02a00700 1 -- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f0ee803e580 msgr2=0x7f0ee8040a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/586229880 2024-05-14T15:05:08.099 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:01.713+0000 7f0f02a00700 1 --2- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f0ee803e580 0x7f0ee8040a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-14T15:05:08.100 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:03.315+0000 7f0f02a00700 1 -- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f0ee803e580 msgr2=0x7f0ee8040a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/586229880 2024-05-14T15:05:08.100 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:03.315+0000 7f0f02a00700 1 --2- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f0ee803e580 0x7f0ee8040a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-14T15:05:08.100 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:06.379+0000 7f0efbe00700 1 -- 172.21.15.69:0/3591193773 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mgrmap(e 6) ==== 49989+0+0 (secure 0 0 0) 0x7f0ef401aa50 con 0x7f0f0410a410 2024-05-14T15:05:08.100 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:06.380+0000 7f0efbe00700 1 -- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f0ee803e580 msgr2=0x7f0ee8040a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T15:05:08.100 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:06.380+0000 7f0efbe00700 1 --2- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f0ee803e580 0x7f0ee8040a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:08.100 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.384+0000 7f0efbe00700 1 -- 172.21.15.69:0/3591193773 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 7) ==== 50116+0+0 (secure 0 0 0) 0x7f0ef402c3a0 con 0x7f0f0410a410 2024-05-14T15:05:08.100 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.385+0000 7f0efbe00700 1 --2- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f0ee8041ec0 0x7f0ee80442e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:08.100 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.385+0000 7f0efbe00700 1 -- 172.21.15.69:0/3591193773 --> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0ef402ae50 con 0x7f0ee8041ec0 2024-05-14T15:05:08.100 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.387+0000 7f0f02a00700 1 --2- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f0ee8041ec0 0x7f0ee80442e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:08.100 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.390+0000 7f0f02a00700 1 --2- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f0ee8041ec0 0x7f0ee80442e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0003a10 tx=0x7f0ef00092b0 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:08.100 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.392+0000 7f0efbe00700 1 -- 172.21.15.69:0/3591193773 <== mgr.14120 v2:172.21.15.69:6800/2718114316 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f0ef402ae50 con 0x7f0ee8041ec0 2024-05-14T15:05:08.100 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.402+0000 7f0f0a600700 1 -- 172.21.15.69:0/3591193773 --> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f0f04064e20 con 0x7f0ee8041ec0 2024-05-14T15:05:08.100 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.402+0000 7f0efbe00700 1 -- 172.21.15.69:0/3591193773 <== mgr.14120 v2:172.21.15.69:6800/2718114316 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f0f04064e20 con 0x7f0ee8041ec0 2024-05-14T15:05:08.100 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.403+0000 7f0f0a600700 1 -- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f0ee8041ec0 msgr2=0x7f0ee80442e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:08.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.403+0000 7f0f0a600700 1 --2- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f0ee8041ec0 0x7f0ee80442e0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0003a10 tx=0x7f0ef00092b0 comp rx=0 tx=0).stop 2024-05-14T15:05:08.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.403+0000 7f0f0a600700 1 -- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0410a410 msgr2=0x7f0f0419fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:08.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.403+0000 7f0f0a600700 1 --2- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0410a410 0x7f0f0419fe60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0ef40119b0 tx=0x7f0ef4011a90 comp rx=0 tx=0).stop 2024-05-14T15:05:08.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.403+0000 7f0f0a600700 1 -- 172.21.15.69:0/3591193773 shutdown_connections 2024-05-14T15:05:08.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.403+0000 7f0f0a600700 1 --2- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f0ee8041ec0 0x7f0ee80442e0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:08.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.403+0000 7f0f0a600700 1 --2- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f0410a410 0x7f0f0419fe60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:08.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.403+0000 7f0f0a600700 1 --2- 172.21.15.69:0/3591193773 >> [v2:172.21.15.69:6800/586229880,v1:172.21.15.69:6801/586229880] conn(0x7f0ee803e580 0x7f0ee8040a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:08.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.403+0000 7f0f0a600700 1 -- 172.21.15.69:0/3591193773 >> 172.21.15.69:0/3591193773 conn(0x7f0f04103ed0 msgr2=0x7f0f04108390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:08.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.403+0000 7f0f0a600700 1 -- 172.21.15.69:0/3591193773 shutdown_connections 2024-05-14T15:05:08.101 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:07.403+0000 7f0f0a600700 1 -- 172.21.15.69:0/3591193773 wait complete. 2024-05-14T15:05:08.101 INFO:teuthology.orchestra.run.smithi069.stdout:mgr epoch 5 is available 2024-05-14T15:05:08.101 INFO:teuthology.orchestra.run.smithi069.stdout:Setting orchestrator backend to cephadm... 2024-05-14T15:05:08.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:08 smithi069 ceph-mon[31270]: [14/May/2024:15:05:07] ENGINE Serving on https://172.21.15.69:7150 2024-05-14T15:05:08.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:08 smithi069 ceph-mon[31270]: [14/May/2024:15:05:07] ENGINE Bus STARTED 2024-05-14T15:05:08.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:08 smithi069 ceph-mon[31270]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-14T15:05:08.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:08 smithi069 ceph-mon[31270]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-14T15:05:09.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:09 smithi069 ceph-mon[31270]: mgrmap e8: x(active, since 2s) 2024-05-14T15:05:09.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:09 smithi069 ceph-mon[31270]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:05:09.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:09 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' 2024-05-14T15:05:09.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:09 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:05:09.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.827+0000 7ff182e00700 1 Processor -- start 2024-05-14T15:05:09.774 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.827+0000 7ff182e00700 1 -- start start 2024-05-14T15:05:09.774 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.828+0000 7ff182e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff17c10bbc0 0x7ff17c10bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:09.774 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.828+0000 7ff182e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff17c10c5c0 con 0x7ff17c10bbc0 2024-05-14T15:05:09.774 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.828+0000 7ff17be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff17c10bbc0 0x7ff17c10bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:09.774 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.829+0000 7ff17be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff17c10bbc0 0x7ff17c10bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39154/0 (socket says 172.21.15.69:39154) 2024-05-14T15:05:09.774 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.829+0000 7ff17be00700 1 -- 172.21.15.69:0/4217621363 learned_addr learned my addr 172.21.15.69:0/4217621363 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:09.774 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.829+0000 7ff17be00700 1 -- 172.21.15.69:0/4217621363 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17c10cd40 con 0x7ff17c10bbc0 2024-05-14T15:05:09.774 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.829+0000 7ff17be00700 1 --2- 172.21.15.69:0/4217621363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff17c10bbc0 0x7ff17c10bfd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0098a0 tx=0x7ff16c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7641467b95f153be server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:09.774 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.830+0000 7ff17aa00700 1 -- 172.21.15.69:0/4217621363 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff16c004160 con 0x7ff17c10bbc0 2024-05-14T15:05:09.775 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.830+0000 7ff17aa00700 1 -- 172.21.15.69:0/4217621363 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ff16c004300 con 0x7ff17c10bbc0 2024-05-14T15:05:09.775 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.830+0000 7ff17aa00700 1 -- 172.21.15.69:0/4217621363 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff16c0119e0 con 0x7ff17c10bbc0 2024-05-14T15:05:09.775 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.831+0000 7ff182e00700 1 -- 172.21.15.69:0/4217621363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff17c10bbc0 msgr2=0x7ff17c10bfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:09.775 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.831+0000 7ff182e00700 1 --2- 172.21.15.69:0/4217621363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff17c10bbc0 0x7ff17c10bfd0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0098a0 tx=0x7ff16c009bb0 comp rx=0 tx=0).stop 2024-05-14T15:05:09.775 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.831+0000 7ff182e00700 1 -- 172.21.15.69:0/4217621363 shutdown_connections 2024-05-14T15:05:09.775 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.831+0000 7ff182e00700 1 --2- 172.21.15.69:0/4217621363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff17c10bbc0 0x7ff17c10bfd0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:09.775 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.831+0000 7ff182e00700 1 -- 172.21.15.69:0/4217621363 >> 172.21.15.69:0/4217621363 conn(0x7ff17c07f050 msgr2=0x7ff17c109d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:09.775 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.831+0000 7ff182e00700 1 -- 172.21.15.69:0/4217621363 shutdown_connections 2024-05-14T15:05:09.775 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.831+0000 7ff182e00700 1 -- 172.21.15.69:0/4217621363 wait complete. 2024-05-14T15:05:09.775 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.832+0000 7ff182e00700 1 Processor -- start 2024-05-14T15:05:09.775 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.832+0000 7ff182e00700 1 -- start start 2024-05-14T15:05:09.775 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.833+0000 7ff182e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff17c10bbc0 0x7ff17c19fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:09.775 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.833+0000 7ff182e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff17c1100f0 con 0x7ff17c10bbc0 2024-05-14T15:05:09.775 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.833+0000 7ff17be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff17c10bbc0 0x7ff17c19fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:09.776 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.833+0000 7ff17be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff17c10bbc0 0x7ff17c19fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39158/0 (socket says 172.21.15.69:39158) 2024-05-14T15:05:09.776 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.833+0000 7ff17be00700 1 -- 172.21.15.69:0/666876478 learned_addr learned my addr 172.21.15.69:0/666876478 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:09.776 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.833+0000 7ff17be00700 1 -- 172.21.15.69:0/666876478 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff17c1a03e0 con 0x7ff17c10bbc0 2024-05-14T15:05:09.776 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.834+0000 7ff17be00700 1 --2- 172.21.15.69:0/666876478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff17c10bbc0 0x7ff17c19fea0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0119b0 tx=0x7ff16c011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:09.776 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.834+0000 7ff178c00700 1 -- 172.21.15.69:0/666876478 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff16c003970 con 0x7ff17c10bbc0 2024-05-14T15:05:09.776 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.834+0000 7ff178c00700 1 -- 172.21.15.69:0/666876478 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7ff16c003b10 con 0x7ff17c10bbc0 2024-05-14T15:05:09.776 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.834+0000 7ff178c00700 1 -- 172.21.15.69:0/666876478 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff16c024610 con 0x7ff17c10bbc0 2024-05-14T15:05:09.776 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.834+0000 7ff182e00700 1 -- 172.21.15.69:0/666876478 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff17c1a0670 con 0x7ff17c10bbc0 2024-05-14T15:05:09.776 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.834+0000 7ff182e00700 1 -- 172.21.15.69:0/666876478 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff17c1a3280 con 0x7ff17c10bbc0 2024-05-14T15:05:09.776 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.836+0000 7ff182e00700 1 -- 172.21.15.69:0/666876478 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff17c064e20 con 0x7ff17c10bbc0 2024-05-14T15:05:09.776 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.836+0000 7ff178c00700 1 -- 172.21.15.69:0/666876478 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7ff16c01a430 con 0x7ff17c10bbc0 2024-05-14T15:05:09.776 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.836+0000 7ff178c00700 1 --2- 172.21.15.69:0/666876478 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7ff16003e580 0x7ff160040a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:09.776 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.836+0000 7ff178c00700 1 -- 172.21.15.69:0/666876478 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff16c0539d0 con 0x7ff17c10bbc0 2024-05-14T15:05:09.776 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.837+0000 7ff17b400700 1 --2- 172.21.15.69:0/666876478 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7ff16003e580 0x7ff160040a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:09.776 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.837+0000 7ff17b400700 1 --2- 172.21.15.69:0/666876478 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7ff16003e580 0x7ff160040a90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff168006fd0 tx=0x7ff168006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:09.777 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:08.843+0000 7ff178c00700 1 -- 172.21.15.69:0/666876478 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff16c0212a0 con 0x7ff17c10bbc0 2024-05-14T15:05:09.777 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:09.088+0000 7ff182e00700 1 -- 172.21.15.69:0/666876478 --> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7ff17c109800 con 0x7ff16003e580 2024-05-14T15:05:09.777 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:09.099+0000 7ff178c00700 1 -- 172.21.15.69:0/666876478 <== mgr.14120 v2:172.21.15.69:6800/2718114316 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff17c109800 con 0x7ff16003e580 2024-05-14T15:05:09.777 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:09.102+0000 7ff182e00700 1 -- 172.21.15.69:0/666876478 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7ff16003e580 msgr2=0x7ff160040a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:09.777 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:09.102+0000 7ff182e00700 1 --2- 172.21.15.69:0/666876478 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7ff16003e580 0x7ff160040a90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff168006fd0 tx=0x7ff168006e40 comp rx=0 tx=0).stop 2024-05-14T15:05:09.777 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:09.102+0000 7ff182e00700 1 -- 172.21.15.69:0/666876478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff17c10bbc0 msgr2=0x7ff17c19fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:09.777 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:09.102+0000 7ff182e00700 1 --2- 172.21.15.69:0/666876478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff17c10bbc0 0x7ff17c19fea0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0119b0 tx=0x7ff16c011a90 comp rx=0 tx=0).stop 2024-05-14T15:05:09.777 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:09.102+0000 7ff182e00700 1 -- 172.21.15.69:0/666876478 shutdown_connections 2024-05-14T15:05:09.777 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:09.102+0000 7ff182e00700 1 --2- 172.21.15.69:0/666876478 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7ff16003e580 0x7ff160040a90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:09.777 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:09.102+0000 7ff182e00700 1 --2- 172.21.15.69:0/666876478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff17c10bbc0 0x7ff17c19fea0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:09.777 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:09.102+0000 7ff182e00700 1 -- 172.21.15.69:0/666876478 >> 172.21.15.69:0/666876478 conn(0x7ff17c07f050 msgr2=0x7ff17c1090f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:09.777 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:09.102+0000 7ff182e00700 1 -- 172.21.15.69:0/666876478 shutdown_connections 2024-05-14T15:05:09.777 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:09.103+0000 7ff182e00700 1 -- 172.21.15.69:0/666876478 wait complete. 2024-05-14T15:05:11.463 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout value unchanged 2024-05-14T15:05:11.463 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.449+0000 7f7b57e00700 1 Processor -- start 2024-05-14T15:05:11.463 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.449+0000 7f7b57e00700 1 -- start start 2024-05-14T15:05:11.463 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.450+0000 7f7b57e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5807ee10 0x7f7b5807d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:11.464 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.450+0000 7f7b57e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5807d810 con 0x7f7b5807ee10 2024-05-14T15:05:11.464 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.450+0000 7f7b56a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5807ee10 0x7f7b5807d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:11.464 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.450+0000 7f7b56a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5807ee10 0x7f7b5807d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39172/0 (socket says 172.21.15.69:39172) 2024-05-14T15:05:11.464 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.450+0000 7f7b56a00700 1 -- 172.21.15.69:0/2224195646 learned_addr learned my addr 172.21.15.69:0/2224195646 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:11.464 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.451+0000 7f7b56a00700 1 -- 172.21.15.69:0/2224195646 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b5807d990 con 0x7f7b5807ee10 2024-05-14T15:05:11.464 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.451+0000 7f7b56a00700 1 --2- 172.21.15.69:0/2224195646 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5807ee10 0x7f7b5807d240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7b480098a0 tx=0x7f7b48009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731ed74b0f175b02 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:11.464 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.451+0000 7f7b55600700 1 -- 172.21.15.69:0/2224195646 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b48004160 con 0x7f7b5807ee10 2024-05-14T15:05:11.464 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.451+0000 7f7b55600700 1 -- 172.21.15.69:0/2224195646 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f7b48004300 con 0x7f7b5807ee10 2024-05-14T15:05:11.464 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.451+0000 7f7b55600700 1 -- 172.21.15.69:0/2224195646 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b480119e0 con 0x7f7b5807ee10 2024-05-14T15:05:11.464 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.452+0000 7f7b57e00700 1 -- 172.21.15.69:0/2224195646 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5807ee10 msgr2=0x7f7b5807d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:11.464 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.452+0000 7f7b57e00700 1 --2- 172.21.15.69:0/2224195646 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5807ee10 0x7f7b5807d240 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7b480098a0 tx=0x7f7b48009bb0 comp rx=0 tx=0).stop 2024-05-14T15:05:11.464 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.452+0000 7f7b57e00700 1 -- 172.21.15.69:0/2224195646 shutdown_connections 2024-05-14T15:05:11.464 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.452+0000 7f7b57e00700 1 --2- 172.21.15.69:0/2224195646 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5807ee10 0x7f7b5807d240 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:11.464 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.452+0000 7f7b57e00700 1 -- 172.21.15.69:0/2224195646 >> 172.21.15.69:0/2224195646 conn(0x7f7b58104e60 msgr2=0x7f7b581072b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:11.465 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.452+0000 7f7b57e00700 1 -- 172.21.15.69:0/2224195646 shutdown_connections 2024-05-14T15:05:11.465 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.452+0000 7f7b57e00700 1 -- 172.21.15.69:0/2224195646 wait complete. 2024-05-14T15:05:11.465 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.453+0000 7f7b57e00700 1 Processor -- start 2024-05-14T15:05:11.465 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.454+0000 7f7b57e00700 1 -- start start 2024-05-14T15:05:11.465 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.454+0000 7f7b57e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5807ee10 0x7f7b5819fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:11.465 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.454+0000 7f7b57e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7b5810fd40 con 0x7f7b5807ee10 2024-05-14T15:05:11.465 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.454+0000 7f7b56a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5807ee10 0x7f7b5819fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:11.465 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.454+0000 7f7b56a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5807ee10 0x7f7b5819fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39184/0 (socket says 172.21.15.69:39184) 2024-05-14T15:05:11.465 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.454+0000 7f7b56a00700 1 -- 172.21.15.69:0/1260555004 learned_addr learned my addr 172.21.15.69:0/1260555004 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:11.465 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.455+0000 7f7b56a00700 1 -- 172.21.15.69:0/1260555004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b581a0200 con 0x7f7b5807ee10 2024-05-14T15:05:11.466 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.455+0000 7f7b56a00700 1 --2- 172.21.15.69:0/1260555004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5807ee10 0x7f7b5819fcc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7b480119b0 tx=0x7f7b48011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:11.466 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.455+0000 7f7b5ca00700 1 -- 172.21.15.69:0/1260555004 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b48003af0 con 0x7f7b5807ee10 2024-05-14T15:05:11.466 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.455+0000 7f7b5ca00700 1 -- 172.21.15.69:0/1260555004 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f7b4801a8a0 con 0x7f7b5807ee10 2024-05-14T15:05:11.466 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.455+0000 7f7b57e00700 1 -- 172.21.15.69:0/1260555004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b581a0490 con 0x7f7b5807ee10 2024-05-14T15:05:11.466 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.455+0000 7f7b5ca00700 1 -- 172.21.15.69:0/1260555004 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b48024830 con 0x7f7b5807ee10 2024-05-14T15:05:11.466 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.456+0000 7f7b57e00700 1 -- 172.21.15.69:0/1260555004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b581a30a0 con 0x7f7b5807ee10 2024-05-14T15:05:11.466 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.457+0000 7f7b57e00700 1 -- 172.21.15.69:0/1260555004 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b58064e20 con 0x7f7b5807ee10 2024-05-14T15:05:11.466 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.457+0000 7f7b5ca00700 1 -- 172.21.15.69:0/1260555004 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f7b48022020 con 0x7f7b5807ee10 2024-05-14T15:05:11.466 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.458+0000 7f7b5ca00700 1 --2- 172.21.15.69:0/1260555004 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f7b3c03e580 0x7f7b3c040a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:11.466 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.458+0000 7f7b5ca00700 1 -- 172.21.15.69:0/1260555004 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7b48053920 con 0x7f7b5807ee10 2024-05-14T15:05:11.466 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.458+0000 7f7b56000700 1 --2- 172.21.15.69:0/1260555004 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f7b3c03e580 0x7f7b3c040a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:11.466 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.459+0000 7f7b56000700 1 --2- 172.21.15.69:0/1260555004 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f7b3c03e580 0x7f7b3c040a90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7b44006fd0 tx=0x7f7b44006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:11.466 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.464+0000 7f7b5ca00700 1 -- 172.21.15.69:0/1260555004 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7b4800e260 con 0x7f7b5807ee10 2024-05-14T15:05:11.467 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.691+0000 7f7b57e00700 1 -- 172.21.15.69:0/1260555004 --> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f7b58106dd0 con 0x7f7b3c03e580 2024-05-14T15:05:11.467 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.692+0000 7f7b5ca00700 1 -- 172.21.15.69:0/1260555004 <== mgr.14120 v2:172.21.15.69:6800/2718114316 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f7b58106dd0 con 0x7f7b3c03e580 2024-05-14T15:05:11.467 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.695+0000 7f7b57e00700 1 -- 172.21.15.69:0/1260555004 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f7b3c03e580 msgr2=0x7f7b3c040a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:11.467 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.695+0000 7f7b57e00700 1 --2- 172.21.15.69:0/1260555004 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f7b3c03e580 0x7f7b3c040a90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f7b44006fd0 tx=0x7f7b44006e40 comp rx=0 tx=0).stop 2024-05-14T15:05:11.467 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.695+0000 7f7b57e00700 1 -- 172.21.15.69:0/1260555004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5807ee10 msgr2=0x7f7b5819fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:11.467 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.695+0000 7f7b57e00700 1 --2- 172.21.15.69:0/1260555004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5807ee10 0x7f7b5819fcc0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f7b480119b0 tx=0x7f7b48011a90 comp rx=0 tx=0).stop 2024-05-14T15:05:11.467 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.695+0000 7f7b57e00700 1 -- 172.21.15.69:0/1260555004 shutdown_connections 2024-05-14T15:05:11.467 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.695+0000 7f7b57e00700 1 --2- 172.21.15.69:0/1260555004 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f7b3c03e580 0x7f7b3c040a90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:11.467 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.695+0000 7f7b57e00700 1 --2- 172.21.15.69:0/1260555004 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b5807ee10 0x7f7b5819fcc0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:11.467 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.695+0000 7f7b57e00700 1 -- 172.21.15.69:0/1260555004 >> 172.21.15.69:0/1260555004 conn(0x7f7b58104e60 msgr2=0x7f7b581066c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:11.467 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.696+0000 7f7b57e00700 1 -- 172.21.15.69:0/1260555004 shutdown_connections 2024-05-14T15:05:11.467 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:10.696+0000 7f7b57e00700 1 -- 172.21.15.69:0/1260555004 wait complete. 2024-05-14T15:05:11.467 INFO:teuthology.orchestra.run.smithi069.stdout:Generating ssh key... 2024-05-14T15:05:11.607 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:11 smithi069 ceph-mon[31270]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:05:12.943 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: Generating public/private rsa key pair. 2024-05-14T15:05:12.943 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: Your identification has been saved in /tmp/tmpsz57hxhm/key. 2024-05-14T15:05:12.943 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: Your public key has been saved in /tmp/tmpsz57hxhm/key.pub. 2024-05-14T15:05:12.943 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: The key fingerprint is: 2024-05-14T15:05:12.943 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: SHA256:43EHwNS2Tv2wM9bBuKwcEjbUrCQTnXL89JQb969UV1Q ceph-1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:05:12.943 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: The key's randomart image is: 2024-05-14T15:05:12.943 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: +---[RSA 3072]----+ 2024-05-14T15:05:12.944 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: | .*o= . .E| 2024-05-14T15:05:12.944 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: | + O.* + . .| 2024-05-14T15:05:12.944 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: | B =.= * ..| 2024-05-14T15:05:12.944 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: | = +.* o +| 2024-05-14T15:05:12.944 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: | .S=...* oo| 2024-05-14T15:05:12.944 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: | ..+o.B + .| 2024-05-14T15:05:12.944 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: | .o + + . | 2024-05-14T15:05:12.944 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: | o . | 2024-05-14T15:05:12.944 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: | | 2024-05-14T15:05:12.944 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: +----[SHA256]-----+ 2024-05-14T15:05:13.212 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.130+0000 7f4e95400700 1 Processor -- start 2024-05-14T15:05:13.213 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.130+0000 7f4e95400700 1 -- start start 2024-05-14T15:05:13.213 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.130+0000 7f4e95400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e9010bb40 0x7f4e9010bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:13.213 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.130+0000 7f4e95400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9010c540 con 0x7f4e9010bb40 2024-05-14T15:05:13.213 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.131+0000 7f4e8e800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e9010bb40 0x7f4e9010bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:13.213 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.131+0000 7f4e8e800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e9010bb40 0x7f4e9010bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39200/0 (socket says 172.21.15.69:39200) 2024-05-14T15:05:13.213 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.131+0000 7f4e8e800700 1 -- 172.21.15.69:0/3261261431 learned_addr learned my addr 172.21.15.69:0/3261261431 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:13.213 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.131+0000 7f4e8e800700 1 -- 172.21.15.69:0/3261261431 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9010cd10 con 0x7f4e9010bb40 2024-05-14T15:05:13.213 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.132+0000 7f4e8e800700 1 --2- 172.21.15.69:0/3261261431 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e9010bb40 0x7f4e9010bf50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4e800098a0 tx=0x7f4e80009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d6cf31be1e75295 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:13.213 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.132+0000 7f4e8de00700 1 -- 172.21.15.69:0/3261261431 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e80004160 con 0x7f4e9010bb40 2024-05-14T15:05:13.213 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.132+0000 7f4e8de00700 1 -- 172.21.15.69:0/3261261431 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4e80004300 con 0x7f4e9010bb40 2024-05-14T15:05:13.214 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.132+0000 7f4e8de00700 1 -- 172.21.15.69:0/3261261431 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e800119e0 con 0x7f4e9010bb40 2024-05-14T15:05:13.214 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.133+0000 7f4e95400700 1 -- 172.21.15.69:0/3261261431 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e9010bb40 msgr2=0x7f4e9010bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:13.214 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.133+0000 7f4e95400700 1 --2- 172.21.15.69:0/3261261431 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e9010bb40 0x7f4e9010bf50 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f4e800098a0 tx=0x7f4e80009bb0 comp rx=0 tx=0).stop 2024-05-14T15:05:13.214 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.133+0000 7f4e95400700 1 -- 172.21.15.69:0/3261261431 shutdown_connections 2024-05-14T15:05:13.214 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.133+0000 7f4e95400700 1 --2- 172.21.15.69:0/3261261431 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e9010bb40 0x7f4e9010bf50 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:13.214 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.133+0000 7f4e95400700 1 -- 172.21.15.69:0/3261261431 >> 172.21.15.69:0/3261261431 conn(0x7f4e90107480 msgr2=0x7f4e901098a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:13.214 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.133+0000 7f4e95400700 1 -- 172.21.15.69:0/3261261431 shutdown_connections 2024-05-14T15:05:13.214 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.133+0000 7f4e95400700 1 -- 172.21.15.69:0/3261261431 wait complete. 2024-05-14T15:05:13.214 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.134+0000 7f4e95400700 1 Processor -- start 2024-05-14T15:05:13.214 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.134+0000 7f4e95400700 1 -- start start 2024-05-14T15:05:13.214 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.135+0000 7f4e95400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e9010bb40 0x7f4e9019fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:13.215 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.135+0000 7f4e95400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4e901100c0 con 0x7f4e9010bb40 2024-05-14T15:05:13.215 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.135+0000 7f4e8e800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e9010bb40 0x7f4e9019fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:13.215 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.135+0000 7f4e8e800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e9010bb40 0x7f4e9019fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39202/0 (socket says 172.21.15.69:39202) 2024-05-14T15:05:13.215 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.135+0000 7f4e8e800700 1 -- 172.21.15.69:0/2193292867 learned_addr learned my addr 172.21.15.69:0/2193292867 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:13.215 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.136+0000 7f4e8e800700 1 -- 172.21.15.69:0/2193292867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e901a03e0 con 0x7f4e9010bb40 2024-05-14T15:05:13.215 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.136+0000 7f4e8e800700 1 --2- 172.21.15.69:0/2193292867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e9010bb40 0x7f4e9019fea0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4e800119b0 tx=0x7f4e80011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:13.215 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.136+0000 7f4e87e00700 1 -- 172.21.15.69:0/2193292867 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e80003970 con 0x7f4e9010bb40 2024-05-14T15:05:13.215 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.136+0000 7f4e87e00700 1 -- 172.21.15.69:0/2193292867 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f4e80003b10 con 0x7f4e9010bb40 2024-05-14T15:05:13.215 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.136+0000 7f4e95400700 1 -- 172.21.15.69:0/2193292867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e901a0670 con 0x7f4e9010bb40 2024-05-14T15:05:13.215 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.136+0000 7f4e87e00700 1 -- 172.21.15.69:0/2193292867 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4e80024610 con 0x7f4e9010bb40 2024-05-14T15:05:13.215 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.136+0000 7f4e95400700 1 -- 172.21.15.69:0/2193292867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e901a3280 con 0x7f4e9010bb40 2024-05-14T15:05:13.216 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.138+0000 7f4e95400700 1 -- 172.21.15.69:0/2193292867 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e90064e20 con 0x7f4e9010bb40 2024-05-14T15:05:13.216 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.138+0000 7f4e87e00700 1 -- 172.21.15.69:0/2193292867 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f4e8001a430 con 0x7f4e9010bb40 2024-05-14T15:05:13.216 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.138+0000 7f4e87e00700 1 --2- 172.21.15.69:0/2193292867 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f4e7403e580 0x7f4e74040a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:13.216 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.138+0000 7f4e87e00700 1 -- 172.21.15.69:0/2193292867 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4e80053990 con 0x7f4e9010bb40 2024-05-14T15:05:13.216 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.139+0000 7f4e85e00700 1 --2- 172.21.15.69:0/2193292867 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f4e7403e580 0x7f4e74040a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:13.216 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.139+0000 7f4e85e00700 1 --2- 172.21.15.69:0/2193292867 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f4e7403e580 0x7f4e74040a90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4e78006fd0 tx=0x7f4e78006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:13.216 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.144+0000 7f4e87e00700 1 -- 172.21.15.69:0/2193292867 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4e800212a0 con 0x7f4e9010bb40 2024-05-14T15:05:13.216 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.373+0000 7f4e95400700 1 -- 172.21.15.69:0/2193292867 --> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7f4e90109360 con 0x7f4e7403e580 2024-05-14T15:05:13.216 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.582+0000 7f4e87e00700 1 -- 172.21.15.69:0/2193292867 <== mgr.14120 v2:172.21.15.69:6800/2718114316 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4e90109360 con 0x7f4e7403e580 2024-05-14T15:05:13.216 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.585+0000 7f4e95400700 1 -- 172.21.15.69:0/2193292867 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f4e7403e580 msgr2=0x7f4e74040a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:13.216 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.585+0000 7f4e95400700 1 --2- 172.21.15.69:0/2193292867 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f4e7403e580 0x7f4e74040a90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4e78006fd0 tx=0x7f4e78006e40 comp rx=0 tx=0).stop 2024-05-14T15:05:13.216 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.585+0000 7f4e95400700 1 -- 172.21.15.69:0/2193292867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e9010bb40 msgr2=0x7f4e9019fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:13.216 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.585+0000 7f4e95400700 1 --2- 172.21.15.69:0/2193292867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e9010bb40 0x7f4e9019fea0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f4e800119b0 tx=0x7f4e80011a90 comp rx=0 tx=0).stop 2024-05-14T15:05:13.216 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.585+0000 7f4e95400700 1 -- 172.21.15.69:0/2193292867 shutdown_connections 2024-05-14T15:05:13.217 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.585+0000 7f4e95400700 1 --2- 172.21.15.69:0/2193292867 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f4e7403e580 0x7f4e74040a90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:13.217 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.585+0000 7f4e95400700 1 --2- 172.21.15.69:0/2193292867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e9010bb40 0x7f4e9019fea0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:13.217 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.586+0000 7f4e95400700 1 -- 172.21.15.69:0/2193292867 >> 172.21.15.69:0/2193292867 conn(0x7f4e90107480 msgr2=0x7f4e90108c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:13.217 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.586+0000 7f4e95400700 1 -- 172.21.15.69:0/2193292867 shutdown_connections 2024-05-14T15:05:13.217 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:12.586+0000 7f4e95400700 1 -- 172.21.15.69:0/2193292867 wait complete. 2024-05-14T15:05:13.782 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:13 smithi069 ceph-mon[31270]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:05:13.782 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:13 smithi069 ceph-mon[31270]: Generating ssh key... 2024-05-14T15:05:13.782 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:13 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' 2024-05-14T15:05:13.782 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:13 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' 2024-05-14T15:05:14.885 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:14 smithi069 ceph-mon[31270]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:05:14.912 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/6fBXIt2hmyrZ6wNDo5qbG/JMsbv64ofYujPk5iGQZeoWde/ruWgNSGEJK2BNv0cpOCpFFoxIX7CENelbNOK/bpbE8X5NXaHg/0feUoxNCZnjh+mhO0tlQSSK2ZLZiBIBiQAOh8v7x73iODhdJ6fOxw8vQeFbXdbNMCTh6mHv02g7QduRscTYqJQeGQMyYp/xGP1hXtoT1jKlvV99lOJmge3RRLIpKRv4d4/kccHD/SFVaYH5LCFok3DAzVYvlefZc6HroDD3ZbJoay/YWKSmhgkedX9WqSJYUXEfyzM9k19EHXV540B97rZo/JHyHxfhbnZb/P8TSIdeCxz4Pk2CmeUEBWKgv3Is8l3Dk6Wptnd3TdIzlP/nBnPMYroJR3hRc1c9aHqJQnF58s4KLYTxAELeaF2hlcybw5xTqu5u4fPnqABE7wi3U6dr1XHyqjFo4MueI58jvc1j78cwwayR7XERWVY9LQVEEsmkp1tApYFYqQoaYAXtpoerbtoQHgs= ceph-1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:05:14.912 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.910+0000 7f9c8c200700 1 Processor -- start 2024-05-14T15:05:14.912 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.910+0000 7f9c8c200700 1 -- start start 2024-05-14T15:05:14.912 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.911+0000 7f9c8c200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c841107b0 0x7f9c84112bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:14.912 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.911+0000 7f9c8c200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9c841131a0 con 0x7f9c841107b0 2024-05-14T15:05:14.912 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.911+0000 7f9c89800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c841107b0 0x7f9c84112bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:14.912 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.912+0000 7f9c89800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c841107b0 0x7f9c84112bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56022/0 (socket says 172.21.15.69:56022) 2024-05-14T15:05:14.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.912+0000 7f9c89800700 1 -- 172.21.15.69:0/4181672992 learned_addr learned my addr 172.21.15.69:0/4181672992 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:14.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.912+0000 7f9c89800700 1 -- 172.21.15.69:0/4181672992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c84113320 con 0x7f9c841107b0 2024-05-14T15:05:14.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.912+0000 7f9c89800700 1 --2- 172.21.15.69:0/4181672992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c841107b0 0x7f9c84112bd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c780098a0 tx=0x7f9c78009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc665e3557e9929 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:14.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.913+0000 7f9c83e00700 1 -- 172.21.15.69:0/4181672992 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c78004160 con 0x7f9c841107b0 2024-05-14T15:05:14.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.913+0000 7f9c83e00700 1 -- 172.21.15.69:0/4181672992 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f9c78004300 con 0x7f9c841107b0 2024-05-14T15:05:14.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.913+0000 7f9c83e00700 1 -- 172.21.15.69:0/4181672992 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c780119e0 con 0x7f9c841107b0 2024-05-14T15:05:14.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.914+0000 7f9c8c200700 1 -- 172.21.15.69:0/4181672992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c841107b0 msgr2=0x7f9c84112bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:14.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.914+0000 7f9c8c200700 1 --2- 172.21.15.69:0/4181672992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c841107b0 0x7f9c84112bd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f9c780098a0 tx=0x7f9c78009bb0 comp rx=0 tx=0).stop 2024-05-14T15:05:14.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.914+0000 7f9c8c200700 1 -- 172.21.15.69:0/4181672992 shutdown_connections 2024-05-14T15:05:14.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.914+0000 7f9c8c200700 1 --2- 172.21.15.69:0/4181672992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c841107b0 0x7f9c84112bd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:14.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.914+0000 7f9c8c200700 1 -- 172.21.15.69:0/4181672992 >> 172.21.15.69:0/4181672992 conn(0x7f9c8407f0d0 msgr2=0x7f9c840814f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:14.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.914+0000 7f9c8c200700 1 -- 172.21.15.69:0/4181672992 shutdown_connections 2024-05-14T15:05:14.913 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.914+0000 7f9c8c200700 1 -- 172.21.15.69:0/4181672992 wait complete. 2024-05-14T15:05:14.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.915+0000 7f9c8c200700 1 Processor -- start 2024-05-14T15:05:14.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.916+0000 7f9c8c200700 1 -- start start 2024-05-14T15:05:14.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.916+0000 7f9c8c200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c841107b0 0x7f9c841a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:14.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.916+0000 7f9c8c200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9c84114340 con 0x7f9c841107b0 2024-05-14T15:05:14.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.916+0000 7f9c89800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c841107b0 0x7f9c841a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:14.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.916+0000 7f9c89800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c841107b0 0x7f9c841a4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56030/0 (socket says 172.21.15.69:56030) 2024-05-14T15:05:14.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.916+0000 7f9c89800700 1 -- 172.21.15.69:0/2459279706 learned_addr learned my addr 172.21.15.69:0/2459279706 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:14.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.917+0000 7f9c89800700 1 -- 172.21.15.69:0/2459279706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c841a47a0 con 0x7f9c841107b0 2024-05-14T15:05:14.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.917+0000 7f9c89800700 1 --2- 172.21.15.69:0/2459279706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c841107b0 0x7f9c841a4260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9c780119b0 tx=0x7f9c78011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:14.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.917+0000 7f9c82000700 1 -- 172.21.15.69:0/2459279706 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c78003af0 con 0x7f9c841107b0 2024-05-14T15:05:14.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.917+0000 7f9c82000700 1 -- 172.21.15.69:0/2459279706 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f9c7801a8a0 con 0x7f9c841107b0 2024-05-14T15:05:14.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.917+0000 7f9c82000700 1 -- 172.21.15.69:0/2459279706 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c78024830 con 0x7f9c841107b0 2024-05-14T15:05:14.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.917+0000 7f9c8c200700 1 -- 172.21.15.69:0/2459279706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c841a4a30 con 0x7f9c841107b0 2024-05-14T15:05:14.914 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.918+0000 7f9c8c200700 1 -- 172.21.15.69:0/2459279706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c841a7640 con 0x7f9c841107b0 2024-05-14T15:05:14.915 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.919+0000 7f9c8c200700 1 -- 172.21.15.69:0/2459279706 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c84064e20 con 0x7f9c841107b0 2024-05-14T15:05:14.915 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.919+0000 7f9c82000700 1 -- 172.21.15.69:0/2459279706 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f9c78022020 con 0x7f9c841107b0 2024-05-14T15:05:14.915 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.919+0000 7f9c82000700 1 --2- 172.21.15.69:0/2459279706 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f9c6c03e580 0x7f9c6c040a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:14.915 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.920+0000 7f9c82000700 1 -- 172.21.15.69:0/2459279706 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f9c78053870 con 0x7f9c841107b0 2024-05-14T15:05:14.915 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.920+0000 7f9c88e00700 1 --2- 172.21.15.69:0/2459279706 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f9c6c03e580 0x7f9c6c040a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:14.915 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.920+0000 7f9c88e00700 1 --2- 172.21.15.69:0/2459279706 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f9c6c03e580 0x7f9c6c040a90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9c70006fd0 tx=0x7f9c70006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:14.915 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:13.925+0000 7f9c82000700 1 -- 172.21.15.69:0/2459279706 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9c7800f2e0 con 0x7f9c841107b0 2024-05-14T15:05:14.915 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:14.160+0000 7f9c8c200700 1 -- 172.21.15.69:0/2459279706 --> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f9c8407ff90 con 0x7f9c6c03e580 2024-05-14T15:05:14.915 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:14.163+0000 7f9c82000700 1 -- 172.21.15.69:0/2459279706 <== mgr.14120 v2:172.21.15.69:6800/2718114316 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f9c8407ff90 con 0x7f9c6c03e580 2024-05-14T15:05:14.915 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:14.167+0000 7f9c8c200700 1 -- 172.21.15.69:0/2459279706 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f9c6c03e580 msgr2=0x7f9c6c040a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:14.915 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:14.167+0000 7f9c8c200700 1 --2- 172.21.15.69:0/2459279706 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f9c6c03e580 0x7f9c6c040a90 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9c70006fd0 tx=0x7f9c70006e40 comp rx=0 tx=0).stop 2024-05-14T15:05:14.915 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:14.167+0000 7f9c8c200700 1 -- 172.21.15.69:0/2459279706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c841107b0 msgr2=0x7f9c841a4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:14.915 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:14.167+0000 7f9c8c200700 1 --2- 172.21.15.69:0/2459279706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c841107b0 0x7f9c841a4260 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f9c780119b0 tx=0x7f9c78011a90 comp rx=0 tx=0).stop 2024-05-14T15:05:14.916 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:14.167+0000 7f9c8c200700 1 -- 172.21.15.69:0/2459279706 shutdown_connections 2024-05-14T15:05:14.916 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:14.167+0000 7f9c8c200700 1 --2- 172.21.15.69:0/2459279706 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f9c6c03e580 0x7f9c6c040a90 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:14.916 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:14.167+0000 7f9c8c200700 1 --2- 172.21.15.69:0/2459279706 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c841107b0 0x7f9c841a4260 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:14.916 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:14.167+0000 7f9c8c200700 1 -- 172.21.15.69:0/2459279706 >> 172.21.15.69:0/2459279706 conn(0x7f9c8407f0d0 msgr2=0x7f9c8407f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:14.916 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:14.168+0000 7f9c8c200700 1 -- 172.21.15.69:0/2459279706 shutdown_connections 2024-05-14T15:05:14.916 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:14.168+0000 7f9c8c200700 1 -- 172.21.15.69:0/2459279706 wait complete. 2024-05-14T15:05:14.916 INFO:teuthology.orchestra.run.smithi069.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-14T15:05:14.916 INFO:teuthology.orchestra.run.smithi069.stdout:Adding key to root@localhost authorized_keys... 2024-05-14T15:05:14.916 INFO:teuthology.orchestra.run.smithi069.stdout:Adding host smithi069... 2024-05-14T15:05:16.438 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:16 smithi069 ceph-mon[31270]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi069", "addr": "172.21.15.69", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:05:17.621 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:17 smithi069 ceph-mon[31270]: Deploying cephadm binary to smithi069 2024-05-14T15:05:22.440 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout Added host 'smithi069' with addr '172.21.15.69' 2024-05-14T15:05:22.440 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.579+0000 7f5fe7c00700 1 Processor -- start 2024-05-14T15:05:22.440 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.580+0000 7f5fe7c00700 1 -- start start 2024-05-14T15:05:22.440 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.580+0000 7f5fe7c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fe0108280 0x7f5fe0108690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:22.440 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.580+0000 7f5fe7c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe007cdc0 con 0x7f5fe0108280 2024-05-14T15:05:22.440 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.581+0000 7f5fe5200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fe0108280 0x7f5fe0108690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:22.441 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.581+0000 7f5fe5200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fe0108280 0x7f5fe0108690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56044/0 (socket says 172.21.15.69:56044) 2024-05-14T15:05:22.441 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.581+0000 7f5fe5200700 1 -- 172.21.15.69:0/94422982 learned_addr learned my addr 172.21.15.69:0/94422982 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:22.441 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.581+0000 7f5fe5200700 1 -- 172.21.15.69:0/94422982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe0108bd0 con 0x7f5fe0108280 2024-05-14T15:05:22.441 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.582+0000 7f5fe5200700 1 --2- 172.21.15.69:0/94422982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fe0108280 0x7f5fe0108690 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40098a0 tx=0x7f5fd4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e72f2bbe7708dfd7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:22.441 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.582+0000 7f5fdf400700 1 -- 172.21.15.69:0/94422982 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd4004160 con 0x7f5fe0108280 2024-05-14T15:05:22.441 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.582+0000 7f5fdf400700 1 -- 172.21.15.69:0/94422982 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f5fd4004300 con 0x7f5fe0108280 2024-05-14T15:05:22.441 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.582+0000 7f5fdf400700 1 -- 172.21.15.69:0/94422982 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd40119e0 con 0x7f5fe0108280 2024-05-14T15:05:22.442 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.583+0000 7f5fe7c00700 1 -- 172.21.15.69:0/94422982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fe0108280 msgr2=0x7f5fe0108690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:22.442 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.583+0000 7f5fe7c00700 1 --2- 172.21.15.69:0/94422982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fe0108280 0x7f5fe0108690 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40098a0 tx=0x7f5fd4009bb0 comp rx=0 tx=0).stop 2024-05-14T15:05:22.442 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.583+0000 7f5fe7c00700 1 -- 172.21.15.69:0/94422982 shutdown_connections 2024-05-14T15:05:22.442 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.583+0000 7f5fe7c00700 1 --2- 172.21.15.69:0/94422982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fe0108280 0x7f5fe0108690 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:22.442 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.583+0000 7f5fe7c00700 1 -- 172.21.15.69:0/94422982 >> 172.21.15.69:0/94422982 conn(0x7f5fe0103ed0 msgr2=0x7f5fe0106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:22.442 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.583+0000 7f5fe7c00700 1 -- 172.21.15.69:0/94422982 shutdown_connections 2024-05-14T15:05:22.442 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.583+0000 7f5fe7c00700 1 -- 172.21.15.69:0/94422982 wait complete. 2024-05-14T15:05:22.442 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.584+0000 7f5fe7c00700 1 Processor -- start 2024-05-14T15:05:22.443 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.584+0000 7f5fe7c00700 1 -- start start 2024-05-14T15:05:22.443 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.585+0000 7f5fe7c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fe0108280 0x7f5fe019fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:22.443 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.585+0000 7f5fe7c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5fe0109bf0 con 0x7f5fe0108280 2024-05-14T15:05:22.443 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.585+0000 7f5fe5200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fe0108280 0x7f5fe019fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:22.443 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.585+0000 7f5fe5200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fe0108280 0x7f5fe019fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56052/0 (socket says 172.21.15.69:56052) 2024-05-14T15:05:22.443 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.585+0000 7f5fe5200700 1 -- 172.21.15.69:0/4254423881 learned_addr learned my addr 172.21.15.69:0/4254423881 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:22.443 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.586+0000 7f5fe5200700 1 -- 172.21.15.69:0/4254423881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fe01a0380 con 0x7f5fe0108280 2024-05-14T15:05:22.443 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.586+0000 7f5fe5200700 1 --2- 172.21.15.69:0/4254423881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fe0108280 0x7f5fe019fe40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40119b0 tx=0x7f5fd4011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:22.443 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.586+0000 7f5fdd600700 1 -- 172.21.15.69:0/4254423881 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd4003af0 con 0x7f5fe0108280 2024-05-14T15:05:22.444 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.586+0000 7f5fdd600700 1 -- 172.21.15.69:0/4254423881 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f5fd401a8a0 con 0x7f5fe0108280 2024-05-14T15:05:22.444 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.586+0000 7f5fe7c00700 1 -- 172.21.15.69:0/4254423881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fe01a0610 con 0x7f5fe0108280 2024-05-14T15:05:22.444 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.586+0000 7f5fdd600700 1 -- 172.21.15.69:0/4254423881 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5fd4024830 con 0x7f5fe0108280 2024-05-14T15:05:22.444 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.586+0000 7f5fe7c00700 1 -- 172.21.15.69:0/4254423881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fe01a3220 con 0x7f5fe0108280 2024-05-14T15:05:22.444 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.588+0000 7f5fe7c00700 1 -- 172.21.15.69:0/4254423881 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fe0064e20 con 0x7f5fe0108280 2024-05-14T15:05:22.444 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.588+0000 7f5fdd600700 1 -- 172.21.15.69:0/4254423881 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f5fd4022020 con 0x7f5fe0108280 2024-05-14T15:05:22.444 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.588+0000 7f5fdd600700 1 --2- 172.21.15.69:0/4254423881 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f5fc803e580 0x7f5fc8040a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:22.444 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.588+0000 7f5fdd600700 1 -- 172.21.15.69:0/4254423881 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f5fd4053890 con 0x7f5fe0108280 2024-05-14T15:05:22.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.589+0000 7f5fdfe00700 1 --2- 172.21.15.69:0/4254423881 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f5fc803e580 0x7f5fc8040a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:22.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.589+0000 7f5fdfe00700 1 --2- 172.21.15.69:0/4254423881 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f5fc803e580 0x7f5fc8040a90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc006fd0 tx=0x7f5fcc006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:22.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.594+0000 7f5fdd600700 1 -- 172.21.15.69:0/4254423881 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5fd40212c0 con 0x7f5fe0108280 2024-05-14T15:05:22.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:15.825+0000 7f5fe7c00700 1 -- 172.21.15.69:0/4254423881 --> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi069", "addr": "172.21.15.69", "target": ["mon-mgr", ""]}) -- 0x7f5fe002e960 con 0x7f5fc803e580 2024-05-14T15:05:22.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:21.730+0000 7f5fdd600700 1 -- 172.21.15.69:0/4254423881 <== mgr.14120 v2:172.21.15.69:6800/2718114316 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f5fe002e960 con 0x7f5fc803e580 2024-05-14T15:05:22.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:21.735+0000 7f5fe7c00700 1 -- 172.21.15.69:0/4254423881 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f5fc803e580 msgr2=0x7f5fc8040a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:22.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:21.735+0000 7f5fe7c00700 1 --2- 172.21.15.69:0/4254423881 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f5fc803e580 0x7f5fc8040a90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc006fd0 tx=0x7f5fcc006e40 comp rx=0 tx=0).stop 2024-05-14T15:05:22.445 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:21.735+0000 7f5fe7c00700 1 -- 172.21.15.69:0/4254423881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fe0108280 msgr2=0x7f5fe019fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:22.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:21.735+0000 7f5fe7c00700 1 --2- 172.21.15.69:0/4254423881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fe0108280 0x7f5fe019fe40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40119b0 tx=0x7f5fd4011a90 comp rx=0 tx=0).stop 2024-05-14T15:05:22.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:21.735+0000 7f5fe7c00700 1 -- 172.21.15.69:0/4254423881 shutdown_connections 2024-05-14T15:05:22.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:21.735+0000 7f5fe7c00700 1 --2- 172.21.15.69:0/4254423881 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f5fc803e580 0x7f5fc8040a90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:22.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:21.735+0000 7f5fe7c00700 1 --2- 172.21.15.69:0/4254423881 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fe0108280 0x7f5fe019fe40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:22.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:21.735+0000 7f5fe7c00700 1 -- 172.21.15.69:0/4254423881 >> 172.21.15.69:0/4254423881 conn(0x7f5fe0103ed0 msgr2=0x7f5fe0193df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:22.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:21.735+0000 7f5fe7c00700 1 -- 172.21.15.69:0/4254423881 shutdown_connections 2024-05-14T15:05:22.446 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:21.736+0000 7f5fe7c00700 1 -- 172.21.15.69:0/4254423881 wait complete. 2024-05-14T15:05:22.446 INFO:teuthology.orchestra.run.smithi069.stdout:Deploying unmanaged mon service... 2024-05-14T15:05:22.976 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:22 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' 2024-05-14T15:05:22.976 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:22 smithi069 ceph-mon[31270]: Added host smithi069 2024-05-14T15:05:22.977 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:22 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:05:24.631 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-05-14T15:05:24.631 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.205+0000 7f50e2c00700 1 Processor -- start 2024-05-14T15:05:24.631 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.205+0000 7f50e2c00700 1 -- start start 2024-05-14T15:05:24.631 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.205+0000 7f50e2c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50dc108200 0x7f50dc10a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:24.631 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.205+0000 7f50e2c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc07ce40 con 0x7f50dc108200 2024-05-14T15:05:24.631 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.206+0000 7f50dbe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50dc108200 0x7f50dc10a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:24.631 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.206+0000 7f50dbe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50dc108200 0x7f50dc10a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59660/0 (socket says 172.21.15.69:59660) 2024-05-14T15:05:24.632 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.206+0000 7f50dbe00700 1 -- 172.21.15.69:0/4045843669 learned_addr learned my addr 172.21.15.69:0/4045843669 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:24.632 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.206+0000 7f50dbe00700 1 -- 172.21.15.69:0/4045843669 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50dc10ab60 con 0x7f50dc108200 2024-05-14T15:05:24.632 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.206+0000 7f50dbe00700 1 --2- 172.21.15.69:0/4045843669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50dc108200 0x7f50dc10a620 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009e80 tx=0x7f50cc00b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=243f1897c3d34ac5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:24.632 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.207+0000 7f50daa00700 1 -- 172.21.15.69:0/4045843669 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50cc017070 con 0x7f50dc108200 2024-05-14T15:05:24.632 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.207+0000 7f50daa00700 1 -- 172.21.15.69:0/4045843669 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f50cc00b8c0 con 0x7f50dc108200 2024-05-14T15:05:24.632 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.207+0000 7f50daa00700 1 -- 172.21.15.69:0/4045843669 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50cc004420 con 0x7f50dc108200 2024-05-14T15:05:24.632 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.208+0000 7f50e2c00700 1 -- 172.21.15.69:0/4045843669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50dc108200 msgr2=0x7f50dc10a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:24.636 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.208+0000 7f50e2c00700 1 --2- 172.21.15.69:0/4045843669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50dc108200 0x7f50dc10a620 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009e80 tx=0x7f50cc00b330 comp rx=0 tx=0).stop 2024-05-14T15:05:24.636 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.208+0000 7f50e2c00700 1 -- 172.21.15.69:0/4045843669 shutdown_connections 2024-05-14T15:05:24.636 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.208+0000 7f50e2c00700 1 --2- 172.21.15.69:0/4045843669 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50dc108200 0x7f50dc10a620 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:24.636 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.208+0000 7f50e2c00700 1 -- 172.21.15.69:0/4045843669 >> 172.21.15.69:0/4045843669 conn(0x7f50dc103ed0 msgr2=0x7f50dc106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:24.636 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.208+0000 7f50e2c00700 1 -- 172.21.15.69:0/4045843669 shutdown_connections 2024-05-14T15:05:24.636 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.208+0000 7f50e2c00700 1 -- 172.21.15.69:0/4045843669 wait complete. 2024-05-14T15:05:24.636 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.209+0000 7f50e2c00700 1 Processor -- start 2024-05-14T15:05:24.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.209+0000 7f50e2c00700 1 -- start start 2024-05-14T15:05:24.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.209+0000 7f50e2c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50dc108200 0x7f50dc1a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:24.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.209+0000 7f50e2c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f50dc10bb80 con 0x7f50dc108200 2024-05-14T15:05:24.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.210+0000 7f50dbe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50dc108200 0x7f50dc1a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:24.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.210+0000 7f50dbe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50dc108200 0x7f50dc1a4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59666/0 (socket says 172.21.15.69:59666) 2024-05-14T15:05:24.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.210+0000 7f50dbe00700 1 -- 172.21.15.69:0/2191802969 learned_addr learned my addr 172.21.15.69:0/2191802969 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:24.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.210+0000 7f50dbe00700 1 -- 172.21.15.69:0/2191802969 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50dc1a47c0 con 0x7f50dc108200 2024-05-14T15:05:24.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.210+0000 7f50dbe00700 1 --2- 172.21.15.69:0/2191802969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50dc108200 0x7f50dc1a4280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009680 tx=0x7f50cc003a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:24.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.211+0000 7f50d8c00700 1 -- 172.21.15.69:0/2191802969 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50cc020020 con 0x7f50dc108200 2024-05-14T15:05:24.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.211+0000 7f50d8c00700 1 -- 172.21.15.69:0/2191802969 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f50cc003da0 con 0x7f50dc108200 2024-05-14T15:05:24.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.211+0000 7f50d8c00700 1 -- 172.21.15.69:0/2191802969 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50cc017040 con 0x7f50dc108200 2024-05-14T15:05:24.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.211+0000 7f50e2c00700 1 -- 172.21.15.69:0/2191802969 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50dc1a4a50 con 0x7f50dc108200 2024-05-14T15:05:24.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.211+0000 7f50e2c00700 1 -- 172.21.15.69:0/2191802969 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50dc1a7660 con 0x7f50dc108200 2024-05-14T15:05:24.637 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.212+0000 7f50d8c00700 1 -- 172.21.15.69:0/2191802969 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f50cc023020 con 0x7f50dc108200 2024-05-14T15:05:24.638 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.212+0000 7f50e2c00700 1 -- 172.21.15.69:0/2191802969 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50dc064e20 con 0x7f50dc108200 2024-05-14T15:05:24.638 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.213+0000 7f50d8c00700 1 --2- 172.21.15.69:0/2191802969 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f50c003e580 0x7f50c0040a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:24.638 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.213+0000 7f50d8c00700 1 -- 172.21.15.69:0/2191802969 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f50cc00f050 con 0x7f50dc108200 2024-05-14T15:05:24.638 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.213+0000 7f50db400700 1 --2- 172.21.15.69:0/2191802969 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f50c003e580 0x7f50c0040a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:24.638 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.214+0000 7f50db400700 1 --2- 172.21.15.69:0/2191802969 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f50c003e580 0x7f50c0040a90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f50c8006fd0 tx=0x7f50c8006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:24.638 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.219+0000 7f50d8c00700 1 -- 172.21.15.69:0/2191802969 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f50cc02a020 con 0x7f50dc108200 2024-05-14T15:05:24.638 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.487+0000 7f50e2c00700 1 -- 172.21.15.69:0/2191802969 --> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f50dc02e960 con 0x7f50c003e580 2024-05-14T15:05:24.638 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.498+0000 7f50d8c00700 1 -- 172.21.15.69:0/2191802969 <== mgr.14120 v2:172.21.15.69:6800/2718114316 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f50dc02e960 con 0x7f50c003e580 2024-05-14T15:05:24.638 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.501+0000 7f50e2c00700 1 -- 172.21.15.69:0/2191802969 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f50c003e580 msgr2=0x7f50c0040a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:24.638 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.501+0000 7f50e2c00700 1 --2- 172.21.15.69:0/2191802969 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f50c003e580 0x7f50c0040a90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f50c8006fd0 tx=0x7f50c8006e40 comp rx=0 tx=0).stop 2024-05-14T15:05:24.638 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.501+0000 7f50e2c00700 1 -- 172.21.15.69:0/2191802969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50dc108200 msgr2=0x7f50dc1a4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:24.638 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.501+0000 7f50e2c00700 1 --2- 172.21.15.69:0/2191802969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50dc108200 0x7f50dc1a4280 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f50cc009680 tx=0x7f50cc003a20 comp rx=0 tx=0).stop 2024-05-14T15:05:24.638 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.502+0000 7f50e2c00700 1 -- 172.21.15.69:0/2191802969 shutdown_connections 2024-05-14T15:05:24.638 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.502+0000 7f50e2c00700 1 --2- 172.21.15.69:0/2191802969 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f50c003e580 0x7f50c0040a90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:24.639 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.502+0000 7f50e2c00700 1 --2- 172.21.15.69:0/2191802969 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f50dc108200 0x7f50dc1a4280 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:24.639 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.502+0000 7f50e2c00700 1 -- 172.21.15.69:0/2191802969 >> 172.21.15.69:0/2191802969 conn(0x7f50dc103ed0 msgr2=0x7f50dc1062f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:24.639 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.502+0000 7f50e2c00700 1 -- 172.21.15.69:0/2191802969 shutdown_connections 2024-05-14T15:05:24.639 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:23.502+0000 7f50e2c00700 1 -- 172.21.15.69:0/2191802969 wait complete. 2024-05-14T15:05:24.639 INFO:teuthology.orchestra.run.smithi069.stdout:Deploying unmanaged mgr service... 2024-05-14T15:05:24.799 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:24 smithi069 ceph-mon[31270]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:05:24.799 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:24 smithi069 ceph-mon[31270]: Saving service mon spec with placement count:5 2024-05-14T15:05:24.799 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:24 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' 2024-05-14T15:05:26.242 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-05-14T15:05:26.244 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.325+0000 7f52c6a00700 1 Processor -- start 2024-05-14T15:05:26.244 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.325+0000 7f52c6a00700 1 -- start start 2024-05-14T15:05:26.244 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.326+0000 7f52c6a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52c007f840 0x7f52c007dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:26.244 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.326+0000 7f52c6a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f52c007e240 con 0x7f52c007f840 2024-05-14T15:05:26.244 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.326+0000 7f52bfe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52c007f840 0x7f52c007dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:26.244 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.326+0000 7f52bfe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52c007f840 0x7f52c007dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59676/0 (socket says 172.21.15.69:59676) 2024-05-14T15:05:26.244 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.326+0000 7f52bfe00700 1 -- 172.21.15.69:0/3419117083 learned_addr learned my addr 172.21.15.69:0/3419117083 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:26.244 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.327+0000 7f52bfe00700 1 -- 172.21.15.69:0/3419117083 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c007e3c0 con 0x7f52c007f840 2024-05-14T15:05:26.244 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.327+0000 7f52bfe00700 1 --2- 172.21.15.69:0/3419117083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52c007f840 0x7f52c007dc70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f52b00098a0 tx=0x7f52b0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c7c49bdd5c0394 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:26.244 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.327+0000 7f52bea00700 1 -- 172.21.15.69:0/3419117083 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b0004160 con 0x7f52c007f840 2024-05-14T15:05:26.244 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.327+0000 7f52bea00700 1 -- 172.21.15.69:0/3419117083 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f52b0004300 con 0x7f52c007f840 2024-05-14T15:05:26.245 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.327+0000 7f52bea00700 1 -- 172.21.15.69:0/3419117083 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b00119e0 con 0x7f52c007f840 2024-05-14T15:05:26.246 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.328+0000 7f52c6a00700 1 -- 172.21.15.69:0/3419117083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52c007f840 msgr2=0x7f52c007dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:26.247 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.328+0000 7f52c6a00700 1 --2- 172.21.15.69:0/3419117083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52c007f840 0x7f52c007dc70 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f52b00098a0 tx=0x7f52b0009bb0 comp rx=0 tx=0).stop 2024-05-14T15:05:26.247 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.328+0000 7f52c6a00700 1 -- 172.21.15.69:0/3419117083 shutdown_connections 2024-05-14T15:05:26.247 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.328+0000 7f52c6a00700 1 --2- 172.21.15.69:0/3419117083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52c007f840 0x7f52c007dc70 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:26.247 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.328+0000 7f52c6a00700 1 -- 172.21.15.69:0/3419117083 >> 172.21.15.69:0/3419117083 conn(0x7f52c0105000 msgr2=0x7f52c0107470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:26.247 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.328+0000 7f52c6a00700 1 -- 172.21.15.69:0/3419117083 shutdown_connections 2024-05-14T15:05:26.247 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.329+0000 7f52c6a00700 1 -- 172.21.15.69:0/3419117083 wait complete. 2024-05-14T15:05:26.247 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.330+0000 7f52c6a00700 1 Processor -- start 2024-05-14T15:05:26.247 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.330+0000 7f52c6a00700 1 -- start start 2024-05-14T15:05:26.247 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.330+0000 7f52c6a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52c007f840 0x7f52c019fe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:26.247 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.330+0000 7f52c6a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f52c010ff20 con 0x7f52c007f840 2024-05-14T15:05:26.248 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.330+0000 7f52bfe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52c007f840 0x7f52c019fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:26.248 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.330+0000 7f52bfe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52c007f840 0x7f52c019fe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59688/0 (socket says 172.21.15.69:59688) 2024-05-14T15:05:26.248 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.330+0000 7f52bfe00700 1 -- 172.21.15.69:0/2314803964 learned_addr learned my addr 172.21.15.69:0/2314803964 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:26.248 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.331+0000 7f52bfe00700 1 -- 172.21.15.69:0/2314803964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c01a0380 con 0x7f52c007f840 2024-05-14T15:05:26.248 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.331+0000 7f52bfe00700 1 --2- 172.21.15.69:0/2314803964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52c007f840 0x7f52c019fe40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f52b00119b0 tx=0x7f52b0011a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:26.248 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.332+0000 7f52bcc00700 1 -- 172.21.15.69:0/2314803964 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b0003af0 con 0x7f52c007f840 2024-05-14T15:05:26.248 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.332+0000 7f52bcc00700 1 -- 172.21.15.69:0/2314803964 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1032+0+0 (secure 0 0 0) 0x7f52b001a8a0 con 0x7f52c007f840 2024-05-14T15:05:26.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.332+0000 7f52c6a00700 1 -- 172.21.15.69:0/2314803964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c01a0610 con 0x7f52c007f840 2024-05-14T15:05:26.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.332+0000 7f52bcc00700 1 -- 172.21.15.69:0/2314803964 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52b0024830 con 0x7f52c007f840 2024-05-14T15:05:26.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.332+0000 7f52c6a00700 1 -- 172.21.15.69:0/2314803964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c01a3220 con 0x7f52c007f840 2024-05-14T15:05:26.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.333+0000 7f52bcc00700 1 -- 172.21.15.69:0/2314803964 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f52b0022020 con 0x7f52c007f840 2024-05-14T15:05:26.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.334+0000 7f52c6a00700 1 -- 172.21.15.69:0/2314803964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c0064e20 con 0x7f52c007f840 2024-05-14T15:05:26.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.334+0000 7f52bcc00700 1 --2- 172.21.15.69:0/2314803964 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f52a403e530 0x7f52a4040a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:26.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.334+0000 7f52bcc00700 1 -- 172.21.15.69:0/2314803964 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f52b0053960 con 0x7f52c007f840 2024-05-14T15:05:26.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.334+0000 7f52bf400700 1 --2- 172.21.15.69:0/2314803964 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f52a403e530 0x7f52a4040a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:26.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.335+0000 7f52bf400700 1 --2- 172.21.15.69:0/2314803964 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f52a403e530 0x7f52a4040a40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f52ac006fd0 tx=0x7f52ac006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:26.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.340+0000 7f52bcc00700 1 -- 172.21.15.69:0/2314803964 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f52b00212c0 con 0x7f52c007f840 2024-05-14T15:05:26.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.589+0000 7f52c6a00700 1 -- 172.21.15.69:0/2314803964 --> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f52c0105f50 con 0x7f52a403e530 2024-05-14T15:05:26.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.601+0000 7f52bcc00700 1 -- 172.21.15.69:0/2314803964 <== mgr.14120 v2:172.21.15.69:6800/2718114316 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f52c0105f50 con 0x7f52a403e530 2024-05-14T15:05:26.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.605+0000 7f52c6a00700 1 -- 172.21.15.69:0/2314803964 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f52a403e530 msgr2=0x7f52a4040a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:26.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.605+0000 7f52c6a00700 1 --2- 172.21.15.69:0/2314803964 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f52a403e530 0x7f52a4040a40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f52ac006fd0 tx=0x7f52ac006e40 comp rx=0 tx=0).stop 2024-05-14T15:05:26.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.605+0000 7f52c6a00700 1 -- 172.21.15.69:0/2314803964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52c007f840 msgr2=0x7f52c019fe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:26.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.605+0000 7f52c6a00700 1 --2- 172.21.15.69:0/2314803964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52c007f840 0x7f52c019fe40 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f52b00119b0 tx=0x7f52b0011a90 comp rx=0 tx=0).stop 2024-05-14T15:05:26.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.605+0000 7f52c6a00700 1 -- 172.21.15.69:0/2314803964 shutdown_connections 2024-05-14T15:05:26.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.605+0000 7f52c6a00700 1 --2- 172.21.15.69:0/2314803964 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f52a403e530 0x7f52a4040a40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:26.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.605+0000 7f52c6a00700 1 --2- 172.21.15.69:0/2314803964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f52c007f840 0x7f52c019fe40 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:26.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.605+0000 7f52c6a00700 1 -- 172.21.15.69:0/2314803964 >> 172.21.15.69:0/2314803964 conn(0x7f52c0105000 msgr2=0x7f52c0105840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:26.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.605+0000 7f52c6a00700 1 -- 172.21.15.69:0/2314803964 shutdown_connections 2024-05-14T15:05:26.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:25.605+0000 7f52c6a00700 1 -- 172.21.15.69:0/2314803964 wait complete. 2024-05-14T15:05:26.790 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:26 smithi069 ceph-mon[31270]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:05:26.791 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:26 smithi069 ceph-mon[31270]: Saving service mgr spec with placement count:2 2024-05-14T15:05:26.791 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:26 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' 2024-05-14T15:05:26.791 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:26 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' 2024-05-14T15:05:27.937 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:27 smithi069 ceph-mon[31270]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:05:27.937 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:27 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' 2024-05-14T15:05:27.937 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:27 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/945850232' entity='client.admin' 2024-05-14T15:05:27.944 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.955+0000 7f20fd600700 1 Processor -- start 2024-05-14T15:05:27.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.955+0000 7f20fd600700 1 -- start start 2024-05-14T15:05:27.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.955+0000 7f20fd600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20f8109960 0x7f20f8109d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:27.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.955+0000 7f20fd600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f20f810a360 con 0x7f20f8109960 2024-05-14T15:05:27.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.956+0000 7f20f6a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20f8109960 0x7f20f8109d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:27.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.956+0000 7f20f6a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20f8109960 0x7f20f8109d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59694/0 (socket says 172.21.15.69:59694) 2024-05-14T15:05:27.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.956+0000 7f20f6a00700 1 -- 172.21.15.69:0/4214231295 learned_addr learned my addr 172.21.15.69:0/4214231295 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:27.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.957+0000 7f20f6a00700 1 -- 172.21.15.69:0/4214231295 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f810ab30 con 0x7f20f8109960 2024-05-14T15:05:27.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.957+0000 7f20f6a00700 1 --2- 172.21.15.69:0/4214231295 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20f8109960 0x7f20f8109d70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f20e80098a0 tx=0x7f20e8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1190eee33e23cbef server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:27.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.957+0000 7f20f5600700 1 -- 172.21.15.69:0/4214231295 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20e8004160 con 0x7f20f8109960 2024-05-14T15:05:27.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.957+0000 7f20f5600700 1 -- 172.21.15.69:0/4214231295 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20e8004300 con 0x7f20f8109960 2024-05-14T15:05:27.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.957+0000 7f20f5600700 1 -- 172.21.15.69:0/4214231295 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20e8011960 con 0x7f20f8109960 2024-05-14T15:05:27.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.959+0000 7f20fd600700 1 -- 172.21.15.69:0/4214231295 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20f8109960 msgr2=0x7f20f8109d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:27.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.959+0000 7f20fd600700 1 --2- 172.21.15.69:0/4214231295 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20f8109960 0x7f20f8109d70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f20e80098a0 tx=0x7f20e8009bb0 comp rx=0 tx=0).stop 2024-05-14T15:05:27.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.959+0000 7f20fd600700 1 -- 172.21.15.69:0/4214231295 shutdown_connections 2024-05-14T15:05:27.957 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.959+0000 7f20fd600700 1 --2- 172.21.15.69:0/4214231295 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20f8109960 0x7f20f8109d70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:27.957 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.959+0000 7f20fd600700 1 -- 172.21.15.69:0/4214231295 >> 172.21.15.69:0/4214231295 conn(0x7f20f8105060 msgr2=0x7f20f81074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:27.957 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.959+0000 7f20fd600700 1 -- 172.21.15.69:0/4214231295 shutdown_connections 2024-05-14T15:05:27.957 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.959+0000 7f20fd600700 1 -- 172.21.15.69:0/4214231295 wait complete. 2024-05-14T15:05:27.957 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.960+0000 7f20fd600700 1 Processor -- start 2024-05-14T15:05:27.957 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.961+0000 7f20fd600700 1 -- start start 2024-05-14T15:05:27.957 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.961+0000 7f20fd600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20f8109960 0x7f20f819dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:27.957 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.961+0000 7f20fd600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f20f810dee0 con 0x7f20f8109960 2024-05-14T15:05:27.957 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.961+0000 7f20f6a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20f8109960 0x7f20f819dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:27.957 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.961+0000 7f20f6a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20f8109960 0x7f20f819dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59706/0 (socket says 172.21.15.69:59706) 2024-05-14T15:05:27.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.961+0000 7f20f6a00700 1 -- 172.21.15.69:0/945850232 learned_addr learned my addr 172.21.15.69:0/945850232 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:27.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.962+0000 7f20f6a00700 1 -- 172.21.15.69:0/945850232 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20f819e240 con 0x7f20f8109960 2024-05-14T15:05:27.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.962+0000 7f20f6a00700 1 --2- 172.21.15.69:0/945850232 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20f8109960 0x7f20f819dd00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f20e8006af0 tx=0x7f20e8011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:27.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.962+0000 7f20ef400700 1 -- 172.21.15.69:0/945850232 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20e8003af0 con 0x7f20f8109960 2024-05-14T15:05:27.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.962+0000 7f20ef400700 1 -- 172.21.15.69:0/945850232 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f20e801b8d0 con 0x7f20f8109960 2024-05-14T15:05:27.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.962+0000 7f20fd600700 1 -- 172.21.15.69:0/945850232 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20f819e4d0 con 0x7f20f8109960 2024-05-14T15:05:27.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.963+0000 7f20ef400700 1 -- 172.21.15.69:0/945850232 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f20e8023820 con 0x7f20f8109960 2024-05-14T15:05:27.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.963+0000 7f20fd600700 1 -- 172.21.15.69:0/945850232 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20f81a10e0 con 0x7f20f8109960 2024-05-14T15:05:27.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.964+0000 7f20fd600700 1 -- 172.21.15.69:0/945850232 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20f8064e20 con 0x7f20f8109960 2024-05-14T15:05:27.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.964+0000 7f20ef400700 1 -- 172.21.15.69:0/945850232 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f20e801b440 con 0x7f20f8109960 2024-05-14T15:05:27.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.965+0000 7f20ef400700 1 --2- 172.21.15.69:0/945850232 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f20dc03e530 0x7f20dc040a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:27.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.965+0000 7f20ef400700 1 -- 172.21.15.69:0/945850232 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f20e8054040 con 0x7f20f8109960 2024-05-14T15:05:27.958 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.965+0000 7f20f6000700 1 --2- 172.21.15.69:0/945850232 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f20dc03e530 0x7f20dc040a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:27.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.966+0000 7f20f6000700 1 --2- 172.21.15.69:0/945850232 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f20dc03e530 0x7f20dc040a40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f20e4006fd0 tx=0x7f20e4006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:27.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:26.970+0000 7f20ef400700 1 -- 172.21.15.69:0/945850232 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f20e801f030 con 0x7f20f8109960 2024-05-14T15:05:27.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:27.201+0000 7f20fd600700 1 -- 172.21.15.69:0/945850232 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f20f81a12b0 con 0x7f20f8109960 2024-05-14T15:05:27.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:27.206+0000 7f20ef400700 1 -- 172.21.15.69:0/945850232 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7f20e8053990 con 0x7f20f8109960 2024-05-14T15:05:27.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:27.209+0000 7f20fd600700 1 -- 172.21.15.69:0/945850232 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f20dc03e530 msgr2=0x7f20dc040a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:27.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:27.209+0000 7f20fd600700 1 --2- 172.21.15.69:0/945850232 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f20dc03e530 0x7f20dc040a40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f20e4006fd0 tx=0x7f20e4006e40 comp rx=0 tx=0).stop 2024-05-14T15:05:27.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:27.209+0000 7f20fd600700 1 -- 172.21.15.69:0/945850232 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20f8109960 msgr2=0x7f20f819dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:27.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:27.209+0000 7f20fd600700 1 --2- 172.21.15.69:0/945850232 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20f8109960 0x7f20f819dd00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f20e8006af0 tx=0x7f20e8011a30 comp rx=0 tx=0).stop 2024-05-14T15:05:27.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:27.210+0000 7f20fd600700 1 -- 172.21.15.69:0/945850232 shutdown_connections 2024-05-14T15:05:27.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:27.210+0000 7f20fd600700 1 --2- 172.21.15.69:0/945850232 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f20dc03e530 0x7f20dc040a40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:27.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:27.210+0000 7f20fd600700 1 --2- 172.21.15.69:0/945850232 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20f8109960 0x7f20f819dd00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:27.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:27.210+0000 7f20fd600700 1 -- 172.21.15.69:0/945850232 >> 172.21.15.69:0/945850232 conn(0x7f20f8105060 msgr2=0x7f20f8106940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:27.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:27.210+0000 7f20fd600700 1 -- 172.21.15.69:0/945850232 shutdown_connections 2024-05-14T15:05:27.959 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:27.210+0000 7f20fd600700 1 -- 172.21.15.69:0/945850232 wait complete. 2024-05-14T15:05:29.765 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.668+0000 7fc3d9200700 1 Processor -- start 2024-05-14T15:05:29.765 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.668+0000 7fc3d9200700 1 -- start start 2024-05-14T15:05:29.765 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.668+0000 7fc3d9200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d4108830 0x7fc3d4108c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:29.765 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.668+0000 7fc3d9200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d4109230 con 0x7fc3d4108830 2024-05-14T15:05:29.765 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.669+0000 7fc3d1e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d4108830 0x7fc3d4108c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:29.765 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.669+0000 7fc3d1e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d4108830 0x7fc3d4108c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59710/0 (socket says 172.21.15.69:59710) 2024-05-14T15:05:29.765 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.669+0000 7fc3d1e00700 1 -- 172.21.15.69:0/2289350584 learned_addr learned my addr 172.21.15.69:0/2289350584 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:29.765 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.669+0000 7fc3d1e00700 1 -- 172.21.15.69:0/2289350584 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d4109a00 con 0x7fc3d4108830 2024-05-14T15:05:29.766 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.669+0000 7fc3d1e00700 1 --2- 172.21.15.69:0/2289350584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d4108830 0x7fc3d4108c40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400bb40 tx=0x7fc3c400be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3db1d61655f62896 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:29.766 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.670+0000 7fc3d0a00700 1 -- 172.21.15.69:0/2289350584 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3c400dbe0 con 0x7fc3d4108830 2024-05-14T15:05:29.766 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.670+0000 7fc3d0a00700 1 -- 172.21.15.69:0/2289350584 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3c40044c0 con 0x7fc3d4108830 2024-05-14T15:05:29.766 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.670+0000 7fc3d0a00700 1 -- 172.21.15.69:0/2289350584 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3c4003e20 con 0x7fc3d4108830 2024-05-14T15:05:29.766 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.671+0000 7fc3d9200700 1 -- 172.21.15.69:0/2289350584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d4108830 msgr2=0x7fc3d4108c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:29.766 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.671+0000 7fc3d9200700 1 --2- 172.21.15.69:0/2289350584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d4108830 0x7fc3d4108c40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fc3c400bb40 tx=0x7fc3c400be50 comp rx=0 tx=0).stop 2024-05-14T15:05:29.766 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.671+0000 7fc3d9200700 1 -- 172.21.15.69:0/2289350584 shutdown_connections 2024-05-14T15:05:29.766 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.671+0000 7fc3d9200700 1 --2- 172.21.15.69:0/2289350584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d4108830 0x7fc3d4108c40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:29.766 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.671+0000 7fc3d9200700 1 -- 172.21.15.69:0/2289350584 >> 172.21.15.69:0/2289350584 conn(0x7fc3d4103ed0 msgr2=0x7fc3d4106320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:29.766 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.671+0000 7fc3d9200700 1 -- 172.21.15.69:0/2289350584 shutdown_connections 2024-05-14T15:05:29.766 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.671+0000 7fc3d9200700 1 -- 172.21.15.69:0/2289350584 wait complete. 2024-05-14T15:05:29.766 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.673+0000 7fc3d9200700 1 Processor -- start 2024-05-14T15:05:29.766 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.673+0000 7fc3d9200700 1 -- start start 2024-05-14T15:05:29.767 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.673+0000 7fc3d9200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d4108830 0x7fc3d41a00d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:29.767 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.673+0000 7fc3d9200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d407bf90 con 0x7fc3d4108830 2024-05-14T15:05:29.767 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.674+0000 7fc3d1e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d4108830 0x7fc3d41a00d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:29.767 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.674+0000 7fc3d1e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d4108830 0x7fc3d41a00d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59722/0 (socket says 172.21.15.69:59722) 2024-05-14T15:05:29.767 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.674+0000 7fc3d1e00700 1 -- 172.21.15.69:0/245044406 learned_addr learned my addr 172.21.15.69:0/245044406 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:29.767 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.674+0000 7fc3d1e00700 1 -- 172.21.15.69:0/245044406 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d41a0610 con 0x7fc3d4108830 2024-05-14T15:05:29.767 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.675+0000 7fc3d1e00700 1 --2- 172.21.15.69:0/245044406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d4108830 0x7fc3d41a00d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40046b0 tx=0x7fc3c4003b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:29.767 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.675+0000 7fc3caa00700 1 -- 172.21.15.69:0/245044406 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3c4010500 con 0x7fc3d4108830 2024-05-14T15:05:29.767 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.675+0000 7fc3caa00700 1 -- 172.21.15.69:0/245044406 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3c401d070 con 0x7fc3d4108830 2024-05-14T15:05:29.767 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.675+0000 7fc3caa00700 1 -- 172.21.15.69:0/245044406 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3c4019790 con 0x7fc3d4108830 2024-05-14T15:05:29.767 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.675+0000 7fc3d9200700 1 -- 172.21.15.69:0/245044406 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d41a08a0 con 0x7fc3d4108830 2024-05-14T15:05:29.767 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.675+0000 7fc3d9200700 1 -- 172.21.15.69:0/245044406 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d41a34b0 con 0x7fc3d4108830 2024-05-14T15:05:29.767 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.677+0000 7fc3d9200700 1 -- 172.21.15.69:0/245044406 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d4064e20 con 0x7fc3d4108830 2024-05-14T15:05:29.767 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.677+0000 7fc3caa00700 1 -- 172.21.15.69:0/245044406 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7fc3c4028060 con 0x7fc3d4108830 2024-05-14T15:05:29.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.677+0000 7fc3caa00700 1 --2- 172.21.15.69:0/245044406 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fc3b803e580 0x7fc3b8040a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:29.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.677+0000 7fc3caa00700 1 -- 172.21.15.69:0/245044406 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc3c40536a0 con 0x7fc3d4108830 2024-05-14T15:05:29.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.678+0000 7fc3d1400700 1 --2- 172.21.15.69:0/245044406 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fc3b803e580 0x7fc3b8040a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:29.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.678+0000 7fc3d1400700 1 --2- 172.21.15.69:0/245044406 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fc3b803e580 0x7fc3b8040a90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0006fd0 tx=0x7fc3c0006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:29.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.683+0000 7fc3caa00700 1 -- 172.21.15.69:0/245044406 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc3c4015070 con 0x7fc3d4108830 2024-05-14T15:05:29.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.908+0000 7fc3d9200700 1 -- 172.21.15.69:0/245044406 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fc3d402e760 con 0x7fc3d4108830 2024-05-14T15:05:29.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.914+0000 7fc3caa00700 1 -- 172.21.15.69:0/245044406 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fc3c4022d60 con 0x7fc3d4108830 2024-05-14T15:05:29.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.918+0000 7fc3d9200700 1 -- 172.21.15.69:0/245044406 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fc3b803e580 msgr2=0x7fc3b8040a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:29.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.918+0000 7fc3d9200700 1 --2- 172.21.15.69:0/245044406 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fc3b803e580 0x7fc3b8040a90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc3c0006fd0 tx=0x7fc3c0006e40 comp rx=0 tx=0).stop 2024-05-14T15:05:29.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.918+0000 7fc3d9200700 1 -- 172.21.15.69:0/245044406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d4108830 msgr2=0x7fc3d41a00d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:29.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.918+0000 7fc3d9200700 1 --2- 172.21.15.69:0/245044406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d4108830 0x7fc3d41a00d0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc3c40046b0 tx=0x7fc3c4003b20 comp rx=0 tx=0).stop 2024-05-14T15:05:29.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.918+0000 7fc3d9200700 1 -- 172.21.15.69:0/245044406 shutdown_connections 2024-05-14T15:05:29.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.918+0000 7fc3d9200700 1 --2- 172.21.15.69:0/245044406 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fc3b803e580 0x7fc3b8040a90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:29.768 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.918+0000 7fc3d9200700 1 --2- 172.21.15.69:0/245044406 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3d4108830 0x7fc3d41a00d0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:29.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.918+0000 7fc3d9200700 1 -- 172.21.15.69:0/245044406 >> 172.21.15.69:0/245044406 conn(0x7fc3d4103ed0 msgr2=0x7fc3d4194420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:29.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.918+0000 7fc3d9200700 1 -- 172.21.15.69:0/245044406 shutdown_connections 2024-05-14T15:05:29.769 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:28.918+0000 7fc3d9200700 1 -- 172.21.15.69:0/245044406 wait complete. 2024-05-14T15:05:29.769 INFO:teuthology.orchestra.run.smithi069.stdout:Enabling the dashboard module... 2024-05-14T15:05:30.105 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:29 smithi069 ceph-mon[31270]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:05:30.105 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:29 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/245044406' entity='client.admin' 2024-05-14T15:05:32.017 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:31 smithi069 ceph-mon[31270]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:05:32.017 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:31 smithi069 ceph-mon[31270]: from='mgr.14120 172.21.15.69:0/4125718948' entity='mgr.x' 2024-05-14T15:05:32.017 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:31 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1506769518' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-14T15:05:32.297 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:32 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: ignoring --setuser ceph since I am not root 2024-05-14T15:05:32.297 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:32 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: ignoring --setgroup ceph since I am not root 2024-05-14T15:05:32.565 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:32 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:32.323+0000 7f6643d5c200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T15:05:32.566 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:32 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:32.573+0000 7f6643d5c200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:05:32.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.757+0000 7f2856e00700 1 Processor -- start 2024-05-14T15:05:32.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.757+0000 7f2856e00700 1 -- start start 2024-05-14T15:05:32.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.757+0000 7f2856e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28501107b0 0x7f2850112bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:32.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.757+0000 7f2856e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f28501131a0 con 0x7f28501107b0 2024-05-14T15:05:32.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.758+0000 7f284fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28501107b0 0x7f2850112bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:32.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.758+0000 7f284fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28501107b0 0x7f2850112bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59732/0 (socket says 172.21.15.69:59732) 2024-05-14T15:05:32.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.758+0000 7f284fe00700 1 -- 172.21.15.69:0/3690468462 learned_addr learned my addr 172.21.15.69:0/3690468462 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:32.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.759+0000 7f284fe00700 1 -- 172.21.15.69:0/3690468462 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2850113320 con 0x7f28501107b0 2024-05-14T15:05:32.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.759+0000 7f284fe00700 1 --2- 172.21.15.69:0/3690468462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28501107b0 0x7f2850112bd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28400098a0 tx=0x7f2840009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e3523746c824468 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:32.675 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.759+0000 7f284ea00700 1 -- 172.21.15.69:0/3690468462 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2840004160 con 0x7f28501107b0 2024-05-14T15:05:32.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.759+0000 7f284ea00700 1 -- 172.21.15.69:0/3690468462 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2840004300 con 0x7f28501107b0 2024-05-14T15:05:32.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.759+0000 7f284ea00700 1 -- 172.21.15.69:0/3690468462 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2840011960 con 0x7f28501107b0 2024-05-14T15:05:32.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.760+0000 7f2856e00700 1 -- 172.21.15.69:0/3690468462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28501107b0 msgr2=0x7f2850112bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:32.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.760+0000 7f2856e00700 1 --2- 172.21.15.69:0/3690468462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28501107b0 0x7f2850112bd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f28400098a0 tx=0x7f2840009bb0 comp rx=0 tx=0).stop 2024-05-14T15:05:32.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.760+0000 7f2856e00700 1 -- 172.21.15.69:0/3690468462 shutdown_connections 2024-05-14T15:05:32.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.760+0000 7f2856e00700 1 --2- 172.21.15.69:0/3690468462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28501107b0 0x7f2850112bd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:32.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.760+0000 7f2856e00700 1 -- 172.21.15.69:0/3690468462 >> 172.21.15.69:0/3690468462 conn(0x7f285007f0d0 msgr2=0x7f28500814f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:32.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.761+0000 7f2856e00700 1 -- 172.21.15.69:0/3690468462 shutdown_connections 2024-05-14T15:05:32.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.761+0000 7f2856e00700 1 -- 172.21.15.69:0/3690468462 wait complete. 2024-05-14T15:05:32.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.762+0000 7f2856e00700 1 Processor -- start 2024-05-14T15:05:32.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.762+0000 7f2856e00700 1 -- start start 2024-05-14T15:05:32.676 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.762+0000 7f2856e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28501107b0 0x7f28501a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:32.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.762+0000 7f2856e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2850114380 con 0x7f28501107b0 2024-05-14T15:05:32.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.763+0000 7f284fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28501107b0 0x7f28501a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:32.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.763+0000 7f284fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28501107b0 0x7f28501a4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59744/0 (socket says 172.21.15.69:59744) 2024-05-14T15:05:32.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.763+0000 7f284fe00700 1 -- 172.21.15.69:0/1506769518 learned_addr learned my addr 172.21.15.69:0/1506769518 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:32.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.763+0000 7f284fe00700 1 -- 172.21.15.69:0/1506769518 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28501a47c0 con 0x7f28501107b0 2024-05-14T15:05:32.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.763+0000 7f284fe00700 1 --2- 172.21.15.69:0/1506769518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28501107b0 0x7f28501a4280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2840011670 tx=0x7f2840011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:32.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.764+0000 7f284cc00700 1 -- 172.21.15.69:0/1506769518 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2840003a60 con 0x7f28501107b0 2024-05-14T15:05:32.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.764+0000 7f284cc00700 1 -- 172.21.15.69:0/1506769518 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f284001b8d0 con 0x7f28501107b0 2024-05-14T15:05:32.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.764+0000 7f2856e00700 1 -- 172.21.15.69:0/1506769518 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28501a4a50 con 0x7f28501107b0 2024-05-14T15:05:32.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.764+0000 7f284cc00700 1 -- 172.21.15.69:0/1506769518 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2840023790 con 0x7f28501107b0 2024-05-14T15:05:32.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.764+0000 7f2856e00700 1 -- 172.21.15.69:0/1506769518 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28501a7660 con 0x7f28501107b0 2024-05-14T15:05:32.677 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.765+0000 7f2856e00700 1 -- 172.21.15.69:0/1506769518 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2850064e20 con 0x7f28501107b0 2024-05-14T15:05:32.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.765+0000 7f284cc00700 1 -- 172.21.15.69:0/1506769518 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 8) ==== 50222+0+0 (secure 0 0 0) 0x7f284001b440 con 0x7f28501107b0 2024-05-14T15:05:32.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.766+0000 7f284cc00700 1 --2- 172.21.15.69:0/1506769518 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f283403e580 0x7f2834040a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:32.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.766+0000 7f284cc00700 1 -- 172.21.15.69:0/1506769518 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f2840053ee0 con 0x7f28501107b0 2024-05-14T15:05:32.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.766+0000 7f284f400700 1 --2- 172.21.15.69:0/1506769518 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f283403e580 0x7f2834040a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:32.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.767+0000 7f284f400700 1 --2- 172.21.15.69:0/1506769518 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f283403e580 0x7f2834040a90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2838006fd0 tx=0x7f2838006e40 comp rx=0 tx=0).ready entity=mgr.14120 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:32.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:30.772+0000 7f284cc00700 1 -- 172.21.15.69:0/1506769518 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f284001f030 con 0x7f28501107b0 2024-05-14T15:05:32.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:31.069+0000 7f2856e00700 1 -- 172.21.15.69:0/1506769518 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7f28501a7830 con 0x7f28501107b0 2024-05-14T15:05:32.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:31.918+0000 7f284cc00700 1 -- 172.21.15.69:0/1506769518 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7f284001a3d0 con 0x7f28501107b0 2024-05-14T15:05:32.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:31.922+0000 7f284cc00700 1 -- 172.21.15.69:0/1506769518 <== mon.0 v2:172.21.15.69:3300/0 8 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f2840057030 con 0x7f28501107b0 2024-05-14T15:05:32.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:31.923+0000 7f2856e00700 1 -- 172.21.15.69:0/1506769518 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f283403e580 msgr2=0x7f2834040a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:32.678 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:31.923+0000 7f2856e00700 1 --2- 172.21.15.69:0/1506769518 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f283403e580 0x7f2834040a90 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2838006fd0 tx=0x7f2838006e40 comp rx=0 tx=0).stop 2024-05-14T15:05:32.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:31.923+0000 7f2856e00700 1 -- 172.21.15.69:0/1506769518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28501107b0 msgr2=0x7f28501a4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:32.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:31.923+0000 7f2856e00700 1 --2- 172.21.15.69:0/1506769518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28501107b0 0x7f28501a4280 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2840011670 tx=0x7f2840011a30 comp rx=0 tx=0).stop 2024-05-14T15:05:32.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:31.923+0000 7f2856e00700 1 -- 172.21.15.69:0/1506769518 shutdown_connections 2024-05-14T15:05:32.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:31.923+0000 7f2856e00700 1 --2- 172.21.15.69:0/1506769518 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f283403e580 0x7f2834040a90 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:32.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:31.923+0000 7f2856e00700 1 --2- 172.21.15.69:0/1506769518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28501107b0 0x7f28501a4280 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:32.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:31.923+0000 7f2856e00700 1 -- 172.21.15.69:0/1506769518 >> 172.21.15.69:0/1506769518 conn(0x7f285007f0d0 msgr2=0x7f285007f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:32.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:31.924+0000 7f2856e00700 1 -- 172.21.15.69:0/1506769518 shutdown_connections 2024-05-14T15:05:32.679 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:31.924+0000 7f2856e00700 1 -- 172.21.15.69:0/1506769518 wait complete. 2024-05-14T15:05:32.821 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:32 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:32.710+0000 7f6643d5c200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T15:05:33.119 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:32 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1506769518' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-14T15:05:33.119 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:32 smithi069 ceph-mon[31270]: mgrmap e9: x(active, since 25s) 2024-05-14T15:05:33.369 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:33 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:33.127+0000 7f6643d5c200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T15:05:33.369 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:33 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:33.249+0000 7f6643d5c200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T15:05:33.963 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:33 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1586422555' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-14T15:05:34.377 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2024-05-14T15:05:34.378 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-05-14T15:05:34.378 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "available": true, 2024-05-14T15:05:34.378 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-05-14T15:05:34.378 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-05-14T15:05:34.383 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2024-05-14T15:05:34.383 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.376+0000 7f88dc400700 1 Processor -- start 2024-05-14T15:05:34.383 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.376+0000 7f88dc400700 1 -- start start 2024-05-14T15:05:34.383 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.377+0000 7f88dc400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88d407edc0 0x7f88d407d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:34.383 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.377+0000 7f88dc400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f88d407d780 con 0x7f88d407edc0 2024-05-14T15:05:34.383 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.377+0000 7f88d9a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88d407edc0 0x7f88d407d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:34.383 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.377+0000 7f88d9a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88d407edc0 0x7f88d407d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44712/0 (socket says 172.21.15.69:44712) 2024-05-14T15:05:34.383 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.377+0000 7f88d9a00700 1 -- 172.21.15.69:0/4124157311 learned_addr learned my addr 172.21.15.69:0/4124157311 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:34.383 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.378+0000 7f88d9a00700 1 -- 172.21.15.69:0/4124157311 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d407d900 con 0x7f88d407edc0 2024-05-14T15:05:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.378+0000 7f88d9a00700 1 --2- 172.21.15.69:0/4124157311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88d407edc0 0x7f88d407d240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f88c80098a0 tx=0x7f88c8009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bbab75dafcf9046 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.378+0000 7f88d3e00700 1 -- 172.21.15.69:0/4124157311 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c8004160 con 0x7f88d407edc0 2024-05-14T15:05:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.378+0000 7f88d3e00700 1 -- 172.21.15.69:0/4124157311 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88c8004300 con 0x7f88d407edc0 2024-05-14T15:05:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.378+0000 7f88d3e00700 1 -- 172.21.15.69:0/4124157311 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c8011960 con 0x7f88d407edc0 2024-05-14T15:05:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.379+0000 7f88dc400700 1 -- 172.21.15.69:0/4124157311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88d407edc0 msgr2=0x7f88d407d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.379+0000 7f88dc400700 1 --2- 172.21.15.69:0/4124157311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88d407edc0 0x7f88d407d240 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f88c80098a0 tx=0x7f88c8009bb0 comp rx=0 tx=0).stop 2024-05-14T15:05:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.380+0000 7f88dc400700 1 -- 172.21.15.69:0/4124157311 shutdown_connections 2024-05-14T15:05:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.380+0000 7f88dc400700 1 --2- 172.21.15.69:0/4124157311 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88d407edc0 0x7f88d407d240 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.380+0000 7f88dc400700 1 -- 172.21.15.69:0/4124157311 >> 172.21.15.69:0/4124157311 conn(0x7f88d4105030 msgr2=0x7f88d41074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.380+0000 7f88dc400700 1 -- 172.21.15.69:0/4124157311 shutdown_connections 2024-05-14T15:05:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.380+0000 7f88dc400700 1 -- 172.21.15.69:0/4124157311 wait complete. 2024-05-14T15:05:34.384 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.381+0000 7f88dc400700 1 Processor -- start 2024-05-14T15:05:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.381+0000 7f88dc400700 1 -- start start 2024-05-14T15:05:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.381+0000 7f88dc400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88d407edc0 0x7f88d419fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.381+0000 7f88dc400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f88d410ff50 con 0x7f88d407edc0 2024-05-14T15:05:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.382+0000 7f88d9a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88d407edc0 0x7f88d419fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.382+0000 7f88d9a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88d407edc0 0x7f88d419fed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44724/0 (socket says 172.21.15.69:44724) 2024-05-14T15:05:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.382+0000 7f88d9a00700 1 -- 172.21.15.69:0/1586422555 learned_addr learned my addr 172.21.15.69:0/1586422555 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.382+0000 7f88d9a00700 1 -- 172.21.15.69:0/1586422555 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88d41a0410 con 0x7f88d407edc0 2024-05-14T15:05:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.382+0000 7f88d9a00700 1 --2- 172.21.15.69:0/1586422555 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88d407edc0 0x7f88d419fed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f88c8011670 tx=0x7f88c8011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.383+0000 7f88d2000700 1 -- 172.21.15.69:0/1586422555 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c8003a60 con 0x7f88d407edc0 2024-05-14T15:05:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.383+0000 7f88dc400700 1 -- 172.21.15.69:0/1586422555 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88d41a06a0 con 0x7f88d407edc0 2024-05-14T15:05:34.385 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.383+0000 7f88d2000700 1 -- 172.21.15.69:0/1586422555 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88c801b8d0 con 0x7f88d407edc0 2024-05-14T15:05:34.386 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.383+0000 7f88d2000700 1 -- 172.21.15.69:0/1586422555 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f88c80237d0 con 0x7f88d407edc0 2024-05-14T15:05:34.386 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.383+0000 7f88dc400700 1 -- 172.21.15.69:0/1586422555 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88d41a32b0 con 0x7f88d407edc0 2024-05-14T15:05:34.386 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.384+0000 7f88d2000700 1 -- 172.21.15.69:0/1586422555 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7f88c8023ad0 con 0x7f88d407edc0 2024-05-14T15:05:34.386 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.384+0000 7f88dc400700 1 -- 172.21.15.69:0/1586422555 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88d4064e20 con 0x7f88d407edc0 2024-05-14T15:05:34.386 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.385+0000 7f88d2000700 1 --2- 172.21.15.69:0/1586422555 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f88bc03e580 0x7f88bc040a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:34.386 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.385+0000 7f88d2000700 1 -- 172.21.15.69:0/1586422555 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f88c8054130 con 0x7f88d407edc0 2024-05-14T15:05:34.386 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.385+0000 7f88d9000700 1 -- 172.21.15.69:0/1586422555 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f88bc03e580 msgr2=0x7f88bc040a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2718114316 2024-05-14T15:05:34.386 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.385+0000 7f88d9000700 1 --2- 172.21.15.69:0/1586422555 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f88bc03e580 0x7f88bc040a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T15:05:34.386 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.390+0000 7f88d2000700 1 -- 172.21.15.69:0/1586422555 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f88c801f030 con 0x7f88d407edc0 2024-05-14T15:05:34.386 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.586+0000 7f88d9000700 1 -- 172.21.15.69:0/1586422555 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f88bc03e580 msgr2=0x7f88bc040a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2718114316 2024-05-14T15:05:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.587+0000 7f88d9000700 1 --2- 172.21.15.69:0/1586422555 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f88bc03e580 0x7f88bc040a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T15:05:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.680+0000 7f88dc400700 1 -- 172.21.15.69:0/1586422555 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f88d41a35a0 con 0x7f88d407edc0 2024-05-14T15:05:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.680+0000 7f88d2000700 1 -- 172.21.15.69:0/1586422555 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f88c800b3e0 con 0x7f88d407edc0 2024-05-14T15:05:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.683+0000 7f88dc400700 1 -- 172.21.15.69:0/1586422555 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f88bc03e580 msgr2=0x7f88bc040a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T15:05:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.683+0000 7f88dc400700 1 --2- 172.21.15.69:0/1586422555 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f88bc03e580 0x7f88bc040a90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.683+0000 7f88dc400700 1 -- 172.21.15.69:0/1586422555 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88d407edc0 msgr2=0x7f88d419fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.683+0000 7f88dc400700 1 --2- 172.21.15.69:0/1586422555 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88d407edc0 0x7f88d419fed0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f88c8011670 tx=0x7f88c8011aa0 comp rx=0 tx=0).stop 2024-05-14T15:05:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.684+0000 7f88dc400700 1 -- 172.21.15.69:0/1586422555 shutdown_connections 2024-05-14T15:05:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.684+0000 7f88dc400700 1 --2- 172.21.15.69:0/1586422555 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7f88bc03e580 0x7f88bc040a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.684+0000 7f88dc400700 1 --2- 172.21.15.69:0/1586422555 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f88d407edc0 0x7f88d419fed0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.684+0000 7f88dc400700 1 -- 172.21.15.69:0/1586422555 >> 172.21.15.69:0/1586422555 conn(0x7f88d4105030 msgr2=0x7f88d4105940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.684+0000 7f88dc400700 1 -- 172.21.15.69:0/1586422555 shutdown_connections 2024-05-14T15:05:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:33.684+0000 7f88dc400700 1 -- 172.21.15.69:0/1586422555 wait complete. 2024-05-14T15:05:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for the mgr to restart... 2024-05-14T15:05:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:Waiting for mgr epoch 9... 2024-05-14T15:05:34.963 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:34 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:34.840+0000 7f6643d5c200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T15:05:35.276 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:35 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:35.083+0000 7f6643d5c200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T15:05:35.676 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:35 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:35.298+0000 7f6643d5c200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T15:05:35.676 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:35 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:35.684+0000 7f6643d5c200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T15:05:35.963 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:35 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:35.810+0000 7f6643d5c200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T15:05:36.320 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:36 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:36.071+0000 7f6643d5c200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T15:05:36.321 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:36 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:36.329+0000 7f6643d5c200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:05:37.394 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:37 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:37.114+0000 7f6643d5c200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T15:05:37.394 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:37 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:37.402+0000 7f6643d5c200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T15:05:38.213 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:37 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:37.963+0000 7f6643d5c200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T15:05:38.214 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:38.093+0000 7f6643d5c200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T15:05:38.964 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:38.563+0000 7f6643d5c200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T15:05:39.463 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:39 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:39.019+0000 7f6643d5c200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T15:05:39.464 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:39 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:39.146+0000 7f6643d5c200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T15:05:39.785 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:39 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:39.478+0000 7f6643d5c200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T15:05:39.785 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:39 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:39.661+0000 7f6643d5c200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T15:05:39.785 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:39 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:39.793+0000 7f6643d5c200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T15:05:40.464 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:40 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:40.196+0000 7f6643d5c200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T15:05:40.465 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:40 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:40.326+0000 7f6643d5c200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T15:05:41.372 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:41 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:41.090+0000 7f6643d5c200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T15:05:41.372 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:05:41 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:05:41.380+0000 7f6643d5c200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T15:05:41.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:41 smithi069 ceph-mon[31270]: Active manager daemon x restarted 2024-05-14T15:05:41.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:41 smithi069 ceph-mon[31270]: Activating manager daemon x 2024-05-14T15:05:41.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:41 smithi069 ceph-mon[31270]: osdmap e3: 0 total, 0 up, 0 in 2024-05-14T15:05:41.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:41 smithi069 ceph-mon[31270]: mgrmap e10: x(active, starting, since 0.012378s) 2024-05-14T15:05:41.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:05:41.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-14T15:05:41.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-14T15:05:41.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-14T15:05:41.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-14T15:05:41.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:41 smithi069 ceph-mon[31270]: Manager daemon x is now available 2024-05-14T15:05:42.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:05:42.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-14T15:05:42.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-14T15:05:42.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:42 smithi069 ceph-mon[31270]: [14/May/2024:15:05:41] ENGINE Bus STARTING 2024-05-14T15:05:42.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:42 smithi069 ceph-mon[31270]: [14/May/2024:15:05:42] ENGINE Serving on https://172.21.15.69:7150 2024-05-14T15:05:42.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:42 smithi069 ceph-mon[31270]: mgrmap e11: x(active, since 1.00964s) 2024-05-14T15:05:43.241 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout { 2024-05-14T15:05:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-05-14T15:05:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout "initialized": true 2024-05-14T15:05:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout } 2024-05-14T15:05:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.075+0000 7fe991c00700 1 Processor -- start 2024-05-14T15:05:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.076+0000 7fe991c00700 1 -- start start 2024-05-14T15:05:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.076+0000 7fe991c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c07ed80 0x7fe98c07d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:43.242 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.076+0000 7fe991c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c07d740 con 0x7fe98c07ed80 2024-05-14T15:05:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.076+0000 7fe98aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c07ed80 0x7fe98c07d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.076+0000 7fe98aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c07ed80 0x7fe98c07d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44736/0 (socket says 172.21.15.69:44736) 2024-05-14T15:05:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.076+0000 7fe98aa00700 1 -- 172.21.15.69:0/1145424247 learned_addr learned my addr 172.21.15.69:0/1145424247 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.077+0000 7fe98aa00700 1 -- 172.21.15.69:0/1145424247 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98c07d8c0 con 0x7fe98c07ed80 2024-05-14T15:05:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.077+0000 7fe98aa00700 1 --2- 172.21.15.69:0/1145424247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c07ed80 0x7fe98c07d200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0098a0 tx=0x7fe97c009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=995071acfb6ecbd0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.077+0000 7fe989600700 1 -- 172.21.15.69:0/1145424247 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97c004160 con 0x7fe98c07ed80 2024-05-14T15:05:43.249 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.077+0000 7fe989600700 1 -- 172.21.15.69:0/1145424247 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe97c004300 con 0x7fe98c07ed80 2024-05-14T15:05:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.078+0000 7fe989600700 1 -- 172.21.15.69:0/1145424247 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97c011960 con 0x7fe98c07ed80 2024-05-14T15:05:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.078+0000 7fe991c00700 1 -- 172.21.15.69:0/1145424247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c07ed80 msgr2=0x7fe98c07d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.078+0000 7fe991c00700 1 --2- 172.21.15.69:0/1145424247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c07ed80 0x7fe98c07d200 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0098a0 tx=0x7fe97c009bb0 comp rx=0 tx=0).stop 2024-05-14T15:05:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.078+0000 7fe991c00700 1 -- 172.21.15.69:0/1145424247 shutdown_connections 2024-05-14T15:05:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.078+0000 7fe991c00700 1 --2- 172.21.15.69:0/1145424247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c07ed80 0x7fe98c07d200 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.078+0000 7fe991c00700 1 -- 172.21.15.69:0/1145424247 >> 172.21.15.69:0/1145424247 conn(0x7fe98c105030 msgr2=0x7fe98c1074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.079+0000 7fe991c00700 1 -- 172.21.15.69:0/1145424247 shutdown_connections 2024-05-14T15:05:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.079+0000 7fe991c00700 1 -- 172.21.15.69:0/1145424247 wait complete. 2024-05-14T15:05:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.080+0000 7fe991c00700 1 Processor -- start 2024-05-14T15:05:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.080+0000 7fe991c00700 1 -- start start 2024-05-14T15:05:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.080+0000 7fe991c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c07ed80 0x7fe98c19fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.080+0000 7fe991c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe98c10ff40 con 0x7fe98c07ed80 2024-05-14T15:05:43.250 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.080+0000 7fe98aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c07ed80 0x7fe98c19fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.081+0000 7fe98aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c07ed80 0x7fe98c19fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44744/0 (socket says 172.21.15.69:44744) 2024-05-14T15:05:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.081+0000 7fe98aa00700 1 -- 172.21.15.69:0/3063195825 learned_addr learned my addr 172.21.15.69:0/3063195825 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.081+0000 7fe98aa00700 1 -- 172.21.15.69:0/3063195825 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe98c1a03a0 con 0x7fe98c07ed80 2024-05-14T15:05:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.081+0000 7fe98aa00700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c07ed80 0x7fe98c19fe60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe97c011670 tx=0x7fe97c011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.081+0000 7fe983400700 1 -- 172.21.15.69:0/3063195825 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97c003a60 con 0x7fe98c07ed80 2024-05-14T15:05:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.081+0000 7fe983400700 1 -- 172.21.15.69:0/3063195825 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe97c01b8d0 con 0x7fe98c07ed80 2024-05-14T15:05:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.081+0000 7fe983400700 1 -- 172.21.15.69:0/3063195825 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe97c023790 con 0x7fe98c07ed80 2024-05-14T15:05:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.081+0000 7fe991c00700 1 -- 172.21.15.69:0/3063195825 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe98c1a0630 con 0x7fe98c07ed80 2024-05-14T15:05:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.082+0000 7fe991c00700 1 -- 172.21.15.69:0/3063195825 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe98c1a3240 con 0x7fe98c07ed80 2024-05-14T15:05:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.083+0000 7fe983400700 1 -- 172.21.15.69:0/3063195825 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 9) ==== 50235+0+0 (secure 0 0 0) 0x7fe97c023a40 con 0x7fe98c07ed80 2024-05-14T15:05:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.083+0000 7fe983400700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fe97003e5e0 0x7fe970040af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.083+0000 7fe983400700 1 -- 172.21.15.69:0/3063195825 --> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe970041200 con 0x7fe97003e5e0 2024-05-14T15:05:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.083+0000 7fe983400700 1 -- 172.21.15.69:0/3063195825 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe97c053ff0 con 0x7fe98c07ed80 2024-05-14T15:05:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.084+0000 7fe98a000700 1 -- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fe97003e5e0 msgr2=0x7fe970040af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2718114316 2024-05-14T15:05:43.251 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.084+0000 7fe98a000700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fe97003e5e0 0x7fe970040af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T15:05:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.285+0000 7fe98a000700 1 -- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fe97003e5e0 msgr2=0x7fe970040af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2718114316 2024-05-14T15:05:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.285+0000 7fe98a000700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fe97003e5e0 0x7fe970040af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T15:05:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.686+0000 7fe98a000700 1 -- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fe97003e5e0 msgr2=0x7fe970040af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2718114316 2024-05-14T15:05:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:35.686+0000 7fe98a000700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fe97003e5e0 0x7fe970040af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-05-14T15:05:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:36.487+0000 7fe98a000700 1 -- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fe97003e5e0 msgr2=0x7fe970040af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2718114316 2024-05-14T15:05:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:36.487+0000 7fe98a000700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fe97003e5e0 0x7fe970040af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-05-14T15:05:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:38.089+0000 7fe98a000700 1 -- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fe97003e5e0 msgr2=0x7fe970040af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2718114316 2024-05-14T15:05:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:38.089+0000 7fe98a000700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fe97003e5e0 0x7fe970040af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 3.200000 2024-05-14T15:05:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:41.293+0000 7fe98a000700 1 -- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fe97003e5e0 msgr2=0x7fe970040af0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2718114316 2024-05-14T15:05:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:41.293+0000 7fe98a000700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fe97003e5e0 0x7fe970040af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 6.400000 2024-05-14T15:05:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:41.391+0000 7fe983400700 1 -- 172.21.15.69:0/3063195825 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mgrmap(e 10) ==== 50002+0+0 (secure 0 0 0) 0x7fe97c02c3f0 con 0x7fe98c07ed80 2024-05-14T15:05:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:41.391+0000 7fe983400700 1 -- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fe97003e5e0 msgr2=0x7fe970040af0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T15:05:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:41.391+0000 7fe983400700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fe97003e5e0 0x7fe970040af0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.389+0000 7fe983400700 1 -- 172.21.15.69:0/3063195825 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mgrmap(e 11) ==== 50129+0+0 (secure 0 0 0) 0x7fe97c055610 con 0x7fe98c07ed80 2024-05-14T15:05:43.252 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.389+0000 7fe983400700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe97c053ba0 0x7fe970043fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.389+0000 7fe983400700 1 -- 172.21.15.69:0/3063195825 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe97c007e50 con 0x7fe97c053ba0 2024-05-14T15:05:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.390+0000 7fe98a000700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe97c053ba0 0x7fe970043fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.392+0000 7fe98a000700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe97c053ba0 0x7fe970043fd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe978003a10 tx=0x7fe978009270 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.393+0000 7fe983400700 1 -- 172.21.15.69:0/3063195825 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fe97c007e50 con 0x7fe97c053ba0 2024-05-14T15:05:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.401+0000 7fe980c00700 1 -- 172.21.15.69:0/3063195825 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fe964002600 con 0x7fe97c053ba0 2024-05-14T15:05:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.402+0000 7fe983400700 1 -- 172.21.15.69:0/3063195825 <== mgr.14152 v2:172.21.15.69:6800/2537958790 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7fe964002600 con 0x7fe97c053ba0 2024-05-14T15:05:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.402+0000 7fe980c00700 1 -- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe97c053ba0 msgr2=0x7fe970043fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.402+0000 7fe980c00700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe97c053ba0 0x7fe970043fd0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe978003a10 tx=0x7fe978009270 comp rx=0 tx=0).stop 2024-05-14T15:05:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.402+0000 7fe980c00700 1 -- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c07ed80 msgr2=0x7fe98c19fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.402+0000 7fe980c00700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c07ed80 0x7fe98c19fe60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe97c011670 tx=0x7fe97c011a30 comp rx=0 tx=0).stop 2024-05-14T15:05:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.402+0000 7fe980c00700 1 -- 172.21.15.69:0/3063195825 shutdown_connections 2024-05-14T15:05:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.402+0000 7fe980c00700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe97c053ba0 0x7fe970043fd0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.402+0000 7fe980c00700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe98c07ed80 0x7fe98c19fe60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:43.253 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.402+0000 7fe980c00700 1 --2- 172.21.15.69:0/3063195825 >> [v2:172.21.15.69:6800/2718114316,v1:172.21.15.69:6801/2718114316] conn(0x7fe97003e5e0 0x7fe970040af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.402+0000 7fe980c00700 1 -- 172.21.15.69:0/3063195825 >> 172.21.15.69:0/3063195825 conn(0x7fe98c105030 msgr2=0x7fe98c105890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.403+0000 7fe980c00700 1 -- 172.21.15.69:0/3063195825 shutdown_connections 2024-05-14T15:05:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:42.403+0000 7fe980c00700 1 -- 172.21.15.69:0/3063195825 wait complete. 2024-05-14T15:05:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:mgr epoch 9 is available 2024-05-14T15:05:43.254 INFO:teuthology.orchestra.run.smithi069.stdout:Generating a dashboard self-signed certificate... 2024-05-14T15:05:43.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:43 smithi069 ceph-mon[31270]: [14/May/2024:15:05:42] ENGINE Serving on http://172.21.15.69:8765 2024-05-14T15:05:43.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:43 smithi069 ceph-mon[31270]: [14/May/2024:15:05:42] ENGINE Bus STARTED 2024-05-14T15:05:43.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:43 smithi069 ceph-mon[31270]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-14T15:05:43.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:43 smithi069 ceph-mon[31270]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-14T15:05:44.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:44 smithi069 ceph-mon[31270]: mgrmap e12: x(active, since 2s) 2024-05-14T15:05:44.713 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:44 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:05:45.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-05-14T15:05:45.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.383+0000 7fec83e00700 1 Processor -- start 2024-05-14T15:05:45.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.383+0000 7fec83e00700 1 -- start start 2024-05-14T15:05:45.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.383+0000 7fec83e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c109990 0x7fec7c109da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:45.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.383+0000 7fec83e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c10a390 con 0x7fec7c109990 2024-05-14T15:05:45.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.384+0000 7fec81400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c109990 0x7fec7c109da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:45.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.384+0000 7fec81400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c109990 0x7fec7c109da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52406/0 (socket says 172.21.15.69:52406) 2024-05-14T15:05:45.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.384+0000 7fec81400700 1 -- 172.21.15.69:0/1673547907 learned_addr learned my addr 172.21.15.69:0/1673547907 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:45.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.384+0000 7fec81400700 1 -- 172.21.15.69:0/1673547907 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c10ab10 con 0x7fec7c109990 2024-05-14T15:05:45.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.385+0000 7fec81400700 1 --2- 172.21.15.69:0/1673547907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c109990 0x7fec7c109da0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fec700098a0 tx=0x7fec70009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4653f595caf1cc73 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:45.517 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.385+0000 7fec7be00700 1 -- 172.21.15.69:0/1673547907 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec70004160 con 0x7fec7c109990 2024-05-14T15:05:45.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.385+0000 7fec7be00700 1 -- 172.21.15.69:0/1673547907 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec70004300 con 0x7fec7c109990 2024-05-14T15:05:45.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.385+0000 7fec7be00700 1 -- 172.21.15.69:0/1673547907 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec70011960 con 0x7fec7c109990 2024-05-14T15:05:45.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.386+0000 7fec83e00700 1 -- 172.21.15.69:0/1673547907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c109990 msgr2=0x7fec7c109da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:45.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.386+0000 7fec83e00700 1 --2- 172.21.15.69:0/1673547907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c109990 0x7fec7c109da0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fec700098a0 tx=0x7fec70009bb0 comp rx=0 tx=0).stop 2024-05-14T15:05:45.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.386+0000 7fec83e00700 1 -- 172.21.15.69:0/1673547907 shutdown_connections 2024-05-14T15:05:45.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.386+0000 7fec83e00700 1 --2- 172.21.15.69:0/1673547907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c109990 0x7fec7c109da0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:45.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.386+0000 7fec83e00700 1 -- 172.21.15.69:0/1673547907 >> 172.21.15.69:0/1673547907 conn(0x7fec7c105070 msgr2=0x7fec7c1074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:45.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.387+0000 7fec83e00700 1 -- 172.21.15.69:0/1673547907 shutdown_connections 2024-05-14T15:05:45.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.387+0000 7fec83e00700 1 -- 172.21.15.69:0/1673547907 wait complete. 2024-05-14T15:05:45.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.388+0000 7fec83e00700 1 Processor -- start 2024-05-14T15:05:45.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.388+0000 7fec83e00700 1 -- start start 2024-05-14T15:05:45.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.388+0000 7fec83e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c109990 0x7fec7c07f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:45.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.388+0000 7fec83e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c10dec0 con 0x7fec7c109990 2024-05-14T15:05:45.518 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.389+0000 7fec81400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c109990 0x7fec7c07f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:45.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.389+0000 7fec81400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c109990 0x7fec7c07f2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52414/0 (socket says 172.21.15.69:52414) 2024-05-14T15:05:45.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.389+0000 7fec81400700 1 -- 172.21.15.69:0/1930768178 learned_addr learned my addr 172.21.15.69:0/1930768178 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:45.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.389+0000 7fec81400700 1 -- 172.21.15.69:0/1930768178 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c07f800 con 0x7fec7c109990 2024-05-14T15:05:45.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.389+0000 7fec81400700 1 --2- 172.21.15.69:0/1930768178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c109990 0x7fec7c07f2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fec70006af0 tx=0x7fec70011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:45.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.390+0000 7fec7a000700 1 -- 172.21.15.69:0/1930768178 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec70003af0 con 0x7fec7c109990 2024-05-14T15:05:45.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.390+0000 7fec7a000700 1 -- 172.21.15.69:0/1930768178 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec7001b8d0 con 0x7fec7c109990 2024-05-14T15:05:45.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.390+0000 7fec83e00700 1 -- 172.21.15.69:0/1930768178 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7c07da50 con 0x7fec7c109990 2024-05-14T15:05:45.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.390+0000 7fec7a000700 1 -- 172.21.15.69:0/1930768178 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec70023820 con 0x7fec7c109990 2024-05-14T15:05:45.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.390+0000 7fec83e00700 1 -- 172.21.15.69:0/1930768178 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7c07df30 con 0x7fec7c109990 2024-05-14T15:05:45.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.391+0000 7fec7a000700 1 -- 172.21.15.69:0/1930768178 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7fec7001b440 con 0x7fec7c109990 2024-05-14T15:05:45.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.392+0000 7fec83e00700 1 -- 172.21.15.69:0/1930768178 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec7c064e20 con 0x7fec7c109990 2024-05-14T15:05:45.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.392+0000 7fec7a000700 1 --2- 172.21.15.69:0/1930768178 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fec6403e5e0 0x7fec64040af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:45.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.392+0000 7fec7a000700 1 -- 172.21.15.69:0/1930768178 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fec70054080 con 0x7fec7c109990 2024-05-14T15:05:45.519 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.393+0000 7fec80a00700 1 --2- 172.21.15.69:0/1930768178 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fec6403e5e0 0x7fec64040af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:45.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.393+0000 7fec80a00700 1 --2- 172.21.15.69:0/1930768178 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fec6403e5e0 0x7fec64040af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fec68006fd0 tx=0x7fec68006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:45.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.399+0000 7fec7a000700 1 -- 172.21.15.69:0/1930768178 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fec7001f030 con 0x7fec7c109990 2024-05-14T15:05:45.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.699+0000 7fec83e00700 1 -- 172.21.15.69:0/1930768178 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fec7c07e670 con 0x7fec6403e5e0 2024-05-14T15:05:45.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.824+0000 7fec7a000700 1 -- 172.21.15.69:0/1930768178 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fec7c07e670 con 0x7fec6403e5e0 2024-05-14T15:05:45.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.827+0000 7fec83e00700 1 -- 172.21.15.69:0/1930768178 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fec6403e5e0 msgr2=0x7fec64040af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:45.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.827+0000 7fec83e00700 1 --2- 172.21.15.69:0/1930768178 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fec6403e5e0 0x7fec64040af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fec68006fd0 tx=0x7fec68006e40 comp rx=0 tx=0).stop 2024-05-14T15:05:45.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.827+0000 7fec83e00700 1 -- 172.21.15.69:0/1930768178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c109990 msgr2=0x7fec7c07f2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:45.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.827+0000 7fec83e00700 1 --2- 172.21.15.69:0/1930768178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c109990 0x7fec7c07f2c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fec70006af0 tx=0x7fec70011a30 comp rx=0 tx=0).stop 2024-05-14T15:05:45.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.827+0000 7fec83e00700 1 -- 172.21.15.69:0/1930768178 shutdown_connections 2024-05-14T15:05:45.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.827+0000 7fec83e00700 1 --2- 172.21.15.69:0/1930768178 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fec6403e5e0 0x7fec64040af0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:45.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.827+0000 7fec83e00700 1 --2- 172.21.15.69:0/1930768178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c109990 0x7fec7c07f2c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:45.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.827+0000 7fec83e00700 1 -- 172.21.15.69:0/1930768178 >> 172.21.15.69:0/1930768178 conn(0x7fec7c105070 msgr2=0x7fec7c106960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:45.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.828+0000 7fec83e00700 1 -- 172.21.15.69:0/1930768178 shutdown_connections 2024-05-14T15:05:45.520 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:44.828+0000 7fec83e00700 1 -- 172.21.15.69:0/1930768178 wait complete. 2024-05-14T15:05:45.520 INFO:teuthology.orchestra.run.smithi069.stdout:Creating initial admin user... 2024-05-14T15:05:46.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:45 smithi069 ceph-mon[31270]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:05:46.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:45 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:05:46.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:45 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:05:47.019 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:46 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:05:47.020 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:46 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:05:48.192 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:47 smithi069 ceph-mon[31270]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:05:48.199 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$.TFNNad8RUtR2KsROZQOdev1YwrY.I.rSQHsubm3.hY7fd8dkGbeW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1715699146, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-14T15:05:48.201 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.225+0000 7f9c5ce00700 1 Processor -- start 2024-05-14T15:05:48.201 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.225+0000 7f9c5ce00700 1 -- start start 2024-05-14T15:05:48.201 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.225+0000 7f9c5ce00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c58109960 0x7f9c58109d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:48.201 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.225+0000 7f9c5ce00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5810a360 con 0x7f9c58109960 2024-05-14T15:05:48.201 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.226+0000 7f9c55e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c58109960 0x7f9c58109d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:48.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.226+0000 7f9c55e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c58109960 0x7f9c58109d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52424/0 (socket says 172.21.15.69:52424) 2024-05-14T15:05:48.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.226+0000 7f9c55e00700 1 -- 172.21.15.69:0/333531472 learned_addr learned my addr 172.21.15.69:0/333531472 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:48.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.226+0000 7f9c55e00700 1 -- 172.21.15.69:0/333531472 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5810ab30 con 0x7f9c58109960 2024-05-14T15:05:48.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.227+0000 7f9c55e00700 1 --2- 172.21.15.69:0/333531472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c58109960 0x7f9c58109d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9c480098a0 tx=0x7f9c48009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c02d9716618143f9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:48.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.227+0000 7f9c54a00700 1 -- 172.21.15.69:0/333531472 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c48004160 con 0x7f9c58109960 2024-05-14T15:05:48.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.227+0000 7f9c54a00700 1 -- 172.21.15.69:0/333531472 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c48004300 con 0x7f9c58109960 2024-05-14T15:05:48.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.227+0000 7f9c54a00700 1 -- 172.21.15.69:0/333531472 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c48011960 con 0x7f9c58109960 2024-05-14T15:05:48.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.228+0000 7f9c5ce00700 1 -- 172.21.15.69:0/333531472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c58109960 msgr2=0x7f9c58109d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:48.207 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.228+0000 7f9c5ce00700 1 --2- 172.21.15.69:0/333531472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c58109960 0x7f9c58109d70 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9c480098a0 tx=0x7f9c48009bb0 comp rx=0 tx=0).stop 2024-05-14T15:05:48.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.228+0000 7f9c5ce00700 1 -- 172.21.15.69:0/333531472 shutdown_connections 2024-05-14T15:05:48.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.228+0000 7f9c5ce00700 1 --2- 172.21.15.69:0/333531472 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c58109960 0x7f9c58109d70 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:48.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.228+0000 7f9c5ce00700 1 -- 172.21.15.69:0/333531472 >> 172.21.15.69:0/333531472 conn(0x7f9c58105060 msgr2=0x7f9c581074b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:48.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.228+0000 7f9c5ce00700 1 -- 172.21.15.69:0/333531472 shutdown_connections 2024-05-14T15:05:48.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.228+0000 7f9c5ce00700 1 -- 172.21.15.69:0/333531472 wait complete. 2024-05-14T15:05:48.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.229+0000 7f9c5ce00700 1 Processor -- start 2024-05-14T15:05:48.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.230+0000 7f9c5ce00700 1 -- start start 2024-05-14T15:05:48.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.230+0000 7f9c5ce00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c58109960 0x7f9c5819ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:48.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.230+0000 7f9c5ce00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5810dee0 con 0x7f9c58109960 2024-05-14T15:05:48.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.230+0000 7f9c55e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c58109960 0x7f9c5819ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:48.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.230+0000 7f9c55e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c58109960 0x7f9c5819ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52428/0 (socket says 172.21.15.69:52428) 2024-05-14T15:05:48.208 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.230+0000 7f9c55e00700 1 -- 172.21.15.69:0/3355004702 learned_addr learned my addr 172.21.15.69:0/3355004702 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:48.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.231+0000 7f9c55e00700 1 -- 172.21.15.69:0/3355004702 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c581a0450 con 0x7f9c58109960 2024-05-14T15:05:48.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.231+0000 7f9c55e00700 1 --2- 172.21.15.69:0/3355004702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c58109960 0x7f9c5819ff10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9c48006af0 tx=0x7f9c48011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:48.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.231+0000 7f9c4ea00700 1 -- 172.21.15.69:0/3355004702 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c48003af0 con 0x7f9c58109960 2024-05-14T15:05:48.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.231+0000 7f9c5ce00700 1 -- 172.21.15.69:0/3355004702 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c581a06e0 con 0x7f9c58109960 2024-05-14T15:05:48.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.231+0000 7f9c4ea00700 1 -- 172.21.15.69:0/3355004702 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c4801b8d0 con 0x7f9c58109960 2024-05-14T15:05:48.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.231+0000 7f9c4ea00700 1 -- 172.21.15.69:0/3355004702 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9c48023820 con 0x7f9c58109960 2024-05-14T15:05:48.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.232+0000 7f9c5ce00700 1 -- 172.21.15.69:0/3355004702 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c581a32f0 con 0x7f9c58109960 2024-05-14T15:05:48.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.233+0000 7f9c5ce00700 1 -- 172.21.15.69:0/3355004702 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c58064e20 con 0x7f9c58109960 2024-05-14T15:05:48.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.233+0000 7f9c4ea00700 1 -- 172.21.15.69:0/3355004702 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 12) ==== 50235+0+0 (secure 0 0 0) 0x7f9c4801b440 con 0x7f9c58109960 2024-05-14T15:05:48.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.233+0000 7f9c4ea00700 1 --2- 172.21.15.69:0/3355004702 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9c3c03e5e0 0x7f9c3c040af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:48.209 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.234+0000 7f9c4ea00700 1 -- 172.21.15.69:0/3355004702 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f9c48054080 con 0x7f9c58109960 2024-05-14T15:05:48.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.234+0000 7f9c55400700 1 --2- 172.21.15.69:0/3355004702 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9c3c03e5e0 0x7f9c3c040af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:48.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.235+0000 7f9c55400700 1 --2- 172.21.15.69:0/3355004702 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9c3c03e5e0 0x7f9c3c040af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9c44006fd0 tx=0x7f9c44006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:48.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.239+0000 7f9c4ea00700 1 -- 172.21.15.69:0/3355004702 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9c4801f030 con 0x7f9c58109960 2024-05-14T15:05:48.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.480+0000 7f9c5ce00700 1 -- 172.21.15.69:0/3355004702 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7f9c581a3580 con 0x7f9c3c03e5e0 2024-05-14T15:05:48.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.719+0000 7f9c4ea00700 1 -- 172.21.15.69:0/3355004702 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7f9c581a3580 con 0x7f9c3c03e5e0 2024-05-14T15:05:48.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.723+0000 7f9c5ce00700 1 -- 172.21.15.69:0/3355004702 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9c3c03e5e0 msgr2=0x7f9c3c040af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:48.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.723+0000 7f9c5ce00700 1 --2- 172.21.15.69:0/3355004702 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9c3c03e5e0 0x7f9c3c040af0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f9c44006fd0 tx=0x7f9c44006e40 comp rx=0 tx=0).stop 2024-05-14T15:05:48.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.723+0000 7f9c5ce00700 1 -- 172.21.15.69:0/3355004702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c58109960 msgr2=0x7f9c5819ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:48.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.723+0000 7f9c5ce00700 1 --2- 172.21.15.69:0/3355004702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c58109960 0x7f9c5819ff10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9c48006af0 tx=0x7f9c48011a30 comp rx=0 tx=0).stop 2024-05-14T15:05:48.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.723+0000 7f9c5ce00700 1 -- 172.21.15.69:0/3355004702 shutdown_connections 2024-05-14T15:05:48.210 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.723+0000 7f9c5ce00700 1 --2- 172.21.15.69:0/3355004702 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9c3c03e5e0 0x7f9c3c040af0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:48.211 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.723+0000 7f9c5ce00700 1 --2- 172.21.15.69:0/3355004702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c58109960 0x7f9c5819ff10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:48.211 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.723+0000 7f9c5ce00700 1 -- 172.21.15.69:0/3355004702 >> 172.21.15.69:0/3355004702 conn(0x7f9c58105060 msgr2=0x7f9c5807da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:48.211 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.724+0000 7f9c5ce00700 1 -- 172.21.15.69:0/3355004702 shutdown_connections 2024-05-14T15:05:48.211 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:46.724+0000 7f9c5ce00700 1 -- 172.21.15.69:0/3355004702 wait complete. 2024-05-14T15:05:48.211 INFO:teuthology.orchestra.run.smithi069.stdout:Fetching dashboard port number... 2024-05-14T15:05:48.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:48 smithi069 ceph-mon[31270]: mgrmap e13: x(active, since 6s) 2024-05-14T15:05:50.139 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:49 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2844393079' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-14T15:05:50.456 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stdout 8443 2024-05-14T15:05:50.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.503+0000 7f25e5200700 1 Processor -- start 2024-05-14T15:05:50.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.503+0000 7f25e5200700 1 -- start start 2024-05-14T15:05:50.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.504+0000 7f25e5200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25e0109e60 0x7f25e010a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:50.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.504+0000 7f25e5200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f25e010a840 con 0x7f25e0109e60 2024-05-14T15:05:50.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.504+0000 7f25dde00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25e0109e60 0x7f25e010a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:50.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.504+0000 7f25dde00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25e0109e60 0x7f25e010a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52442/0 (socket says 172.21.15.69:52442) 2024-05-14T15:05:50.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.504+0000 7f25dde00700 1 -- 172.21.15.69:0/1020654992 learned_addr learned my addr 172.21.15.69:0/1020654992 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:50.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.505+0000 7f25dde00700 1 -- 172.21.15.69:0/1020654992 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e0108ae0 con 0x7f25e0109e60 2024-05-14T15:05:50.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.505+0000 7f25dde00700 1 --2- 172.21.15.69:0/1020654992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25e0109e60 0x7f25e010a270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f25d00098a0 tx=0x7f25d0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6b3ecd6e271385 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:50.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.506+0000 7f25dca00700 1 -- 172.21.15.69:0/1020654992 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25d0004160 con 0x7f25e0109e60 2024-05-14T15:05:50.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.506+0000 7f25dca00700 1 -- 172.21.15.69:0/1020654992 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25d0004300 con 0x7f25e0109e60 2024-05-14T15:05:50.457 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.506+0000 7f25dca00700 1 -- 172.21.15.69:0/1020654992 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25d0011960 con 0x7f25e0109e60 2024-05-14T15:05:50.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.506+0000 7f25e5200700 1 -- 172.21.15.69:0/1020654992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25e0109e60 msgr2=0x7f25e010a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:50.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.506+0000 7f25e5200700 1 --2- 172.21.15.69:0/1020654992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25e0109e60 0x7f25e010a270 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f25d00098a0 tx=0x7f25d0009bb0 comp rx=0 tx=0).stop 2024-05-14T15:05:50.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.507+0000 7f25e5200700 1 -- 172.21.15.69:0/1020654992 shutdown_connections 2024-05-14T15:05:50.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.507+0000 7f25e5200700 1 --2- 172.21.15.69:0/1020654992 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25e0109e60 0x7f25e010a270 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:50.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.507+0000 7f25e5200700 1 -- 172.21.15.69:0/1020654992 >> 172.21.15.69:0/1020654992 conn(0x7f25e01036e0 msgr2=0x7f25e0105b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:50.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.507+0000 7f25e5200700 1 -- 172.21.15.69:0/1020654992 shutdown_connections 2024-05-14T15:05:50.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.507+0000 7f25e5200700 1 -- 172.21.15.69:0/1020654992 wait complete. 2024-05-14T15:05:50.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.508+0000 7f25e5200700 1 Processor -- start 2024-05-14T15:05:50.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.508+0000 7f25e5200700 1 -- start start 2024-05-14T15:05:50.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.508+0000 7f25e5200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25e0109e60 0x7f25e019dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:50.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.508+0000 7f25e5200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f25e010cea0 con 0x7f25e0109e60 2024-05-14T15:05:50.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.509+0000 7f25dde00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25e0109e60 0x7f25e019dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:50.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.509+0000 7f25dde00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25e0109e60 0x7f25e019dc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52444/0 (socket says 172.21.15.69:52444) 2024-05-14T15:05:50.458 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.509+0000 7f25dde00700 1 -- 172.21.15.69:0/2844393079 learned_addr learned my addr 172.21.15.69:0/2844393079 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:50.459 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.509+0000 7f25dde00700 1 -- 172.21.15.69:0/2844393079 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25e019e1b0 con 0x7f25e0109e60 2024-05-14T15:05:50.459 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.509+0000 7f25dde00700 1 --2- 172.21.15.69:0/2844393079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25e0109e60 0x7f25e019dc70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f25d0000c00 tx=0x7f25d0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:50.459 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.510+0000 7f25d6a00700 1 -- 172.21.15.69:0/2844393079 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25d0003a60 con 0x7f25e0109e60 2024-05-14T15:05:50.459 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.510+0000 7f25d6a00700 1 -- 172.21.15.69:0/2844393079 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25d001b8d0 con 0x7f25e0109e60 2024-05-14T15:05:50.459 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.510+0000 7f25d6a00700 1 -- 172.21.15.69:0/2844393079 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25d0019780 con 0x7f25e0109e60 2024-05-14T15:05:50.459 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.510+0000 7f25e5200700 1 -- 172.21.15.69:0/2844393079 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25e019e440 con 0x7f25e0109e60 2024-05-14T15:05:50.459 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.510+0000 7f25e5200700 1 -- 172.21.15.69:0/2844393079 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25e01a1050 con 0x7f25e0109e60 2024-05-14T15:05:50.459 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.511+0000 7f25e5200700 1 -- 172.21.15.69:0/2844393079 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25e010d020 con 0x7f25e0109e60 2024-05-14T15:05:50.459 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.511+0000 7f25d6a00700 1 -- 172.21.15.69:0/2844393079 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f25d001b440 con 0x7f25e0109e60 2024-05-14T15:05:50.459 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.512+0000 7f25d6a00700 1 --2- 172.21.15.69:0/2844393079 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f25c403e680 0x7f25c4040b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:50.459 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.512+0000 7f25d6a00700 1 -- 172.21.15.69:0/2844393079 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f25d0053f60 con 0x7f25e0109e60 2024-05-14T15:05:50.459 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.512+0000 7f25dd400700 1 --2- 172.21.15.69:0/2844393079 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f25c403e680 0x7f25c4040b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:50.459 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.513+0000 7f25dd400700 1 --2- 172.21.15.69:0/2844393079 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f25c403e680 0x7f25c4040b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f25cc006fd0 tx=0x7f25cc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:50.460 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.518+0000 7f25d6a00700 1 -- 172.21.15.69:0/2844393079 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f25d001f030 con 0x7f25e0109e60 2024-05-14T15:05:50.460 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.748+0000 7f25e5200700 1 -- 172.21.15.69:0/2844393079 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f25e002e880 con 0x7f25e0109e60 2024-05-14T15:05:50.460 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.749+0000 7f25d6a00700 1 -- 172.21.15.69:0/2844393079 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f25d000e260 con 0x7f25e0109e60 2024-05-14T15:05:50.460 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.752+0000 7f25e5200700 1 -- 172.21.15.69:0/2844393079 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f25c403e680 msgr2=0x7f25c4040b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:50.460 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.752+0000 7f25e5200700 1 --2- 172.21.15.69:0/2844393079 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f25c403e680 0x7f25c4040b90 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f25cc006fd0 tx=0x7f25cc006e40 comp rx=0 tx=0).stop 2024-05-14T15:05:50.460 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.752+0000 7f25e5200700 1 -- 172.21.15.69:0/2844393079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25e0109e60 msgr2=0x7f25e019dc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:50.460 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.752+0000 7f25e5200700 1 --2- 172.21.15.69:0/2844393079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25e0109e60 0x7f25e019dc70 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f25d0000c00 tx=0x7f25d0011a30 comp rx=0 tx=0).stop 2024-05-14T15:05:50.460 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.752+0000 7f25e5200700 1 -- 172.21.15.69:0/2844393079 shutdown_connections 2024-05-14T15:05:50.460 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.752+0000 7f25e5200700 1 --2- 172.21.15.69:0/2844393079 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f25c403e680 0x7f25c4040b90 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:50.460 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.752+0000 7f25e5200700 1 --2- 172.21.15.69:0/2844393079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25e0109e60 0x7f25e019dc70 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:50.460 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.752+0000 7f25e5200700 1 -- 172.21.15.69:0/2844393079 >> 172.21.15.69:0/2844393079 conn(0x7f25e01036e0 msgr2=0x7f25e0194270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:50.460 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.753+0000 7f25e5200700 1 -- 172.21.15.69:0/2844393079 shutdown_connections 2024-05-14T15:05:50.460 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:49.753+0000 7f25e5200700 1 -- 172.21.15.69:0/2844393079 wait complete. 2024-05-14T15:05:50.488 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-05-14T15:05:50.488 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout disabled 2024-05-14T15:05:50.509 INFO:teuthology.orchestra.run.smithi069.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-05-14T15:05:50.509 INFO:teuthology.orchestra.run.smithi069.stdout:systemctl: stdout inactive 2024-05-14T15:05:50.509 INFO:teuthology.orchestra.run.smithi069.stdout:firewalld.service is not enabled 2024-05-14T15:05:50.509 INFO:teuthology.orchestra.run.smithi069.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-14T15:05:50.512 INFO:teuthology.orchestra.run.smithi069.stdout:Ceph Dashboard is now available at: 2024-05-14T15:05:50.512 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:05:50.512 INFO:teuthology.orchestra.run.smithi069.stdout: URL: https://smithi069.front.sepia.ceph.com:8443/ 2024-05-14T15:05:50.512 INFO:teuthology.orchestra.run.smithi069.stdout: User: admin 2024-05-14T15:05:50.513 INFO:teuthology.orchestra.run.smithi069.stdout: Password: rz8f33328d 2024-05-14T15:05:50.513 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:05:50.513 INFO:teuthology.orchestra.run.smithi069.stdout:Saving cluster configuration to /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config directory 2024-05-14T15:05:50.514 INFO:teuthology.orchestra.run.smithi069.stdout:Enabling autotune for osd_memory_target 2024-05-14T15:05:52.187 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.235+0000 7f45fa800700 1 Processor -- start 2024-05-14T15:05:52.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.235+0000 7f45fa800700 1 -- start start 2024-05-14T15:05:52.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.236+0000 7f45fa800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45f407ed80 0x7f45f407d200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:52.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.236+0000 7f45fa800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f45f407d740 con 0x7f45f407ed80 2024-05-14T15:05:52.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.236+0000 7f45f3400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45f407ed80 0x7f45f407d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:52.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.236+0000 7f45f3400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45f407ed80 0x7f45f407d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52448/0 (socket says 172.21.15.69:52448) 2024-05-14T15:05:52.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.236+0000 7f45f3400700 1 -- 172.21.15.69:0/2591892015 learned_addr learned my addr 172.21.15.69:0/2591892015 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:52.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.237+0000 7f45f3400700 1 -- 172.21.15.69:0/2591892015 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f407d8c0 con 0x7f45f407ed80 2024-05-14T15:05:52.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.237+0000 7f45f3400700 1 --2- 172.21.15.69:0/2591892015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45f407ed80 0x7f45f407d200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f45e40098a0 tx=0x7f45e4009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228896636070c856 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:52.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.237+0000 7f45f2a00700 1 -- 172.21.15.69:0/2591892015 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e4004160 con 0x7f45f407ed80 2024-05-14T15:05:52.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.237+0000 7f45f2a00700 1 -- 172.21.15.69:0/2591892015 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45e4004300 con 0x7f45f407ed80 2024-05-14T15:05:52.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.237+0000 7f45f2a00700 1 -- 172.21.15.69:0/2591892015 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e4011960 con 0x7f45f407ed80 2024-05-14T15:05:52.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.238+0000 7f45fa800700 1 -- 172.21.15.69:0/2591892015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45f407ed80 msgr2=0x7f45f407d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:52.188 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.238+0000 7f45fa800700 1 --2- 172.21.15.69:0/2591892015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45f407ed80 0x7f45f407d200 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f45e40098a0 tx=0x7f45e4009bb0 comp rx=0 tx=0).stop 2024-05-14T15:05:52.189 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.238+0000 7f45fa800700 1 -- 172.21.15.69:0/2591892015 shutdown_connections 2024-05-14T15:05:52.189 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.238+0000 7f45fa800700 1 --2- 172.21.15.69:0/2591892015 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45f407ed80 0x7f45f407d200 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:52.189 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.238+0000 7f45fa800700 1 -- 172.21.15.69:0/2591892015 >> 172.21.15.69:0/2591892015 conn(0x7f45f4105030 msgr2=0x7f45f41074c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:52.189 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.239+0000 7f45fa800700 1 -- 172.21.15.69:0/2591892015 shutdown_connections 2024-05-14T15:05:52.189 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.239+0000 7f45fa800700 1 -- 172.21.15.69:0/2591892015 wait complete. 2024-05-14T15:05:52.189 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.240+0000 7f45fa800700 1 Processor -- start 2024-05-14T15:05:52.189 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.240+0000 7f45fa800700 1 -- start start 2024-05-14T15:05:52.189 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.240+0000 7f45fa800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45f407ed80 0x7f45f419fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:52.189 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.240+0000 7f45fa800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f45f410ff40 con 0x7f45f407ed80 2024-05-14T15:05:52.189 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.241+0000 7f45f3400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45f407ed80 0x7f45f419fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:52.189 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.241+0000 7f45f3400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45f407ed80 0x7f45f419fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52452/0 (socket says 172.21.15.69:52452) 2024-05-14T15:05:52.189 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.241+0000 7f45f3400700 1 -- 172.21.15.69:0/1765216385 learned_addr learned my addr 172.21.15.69:0/1765216385 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:52.189 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.241+0000 7f45f3400700 1 -- 172.21.15.69:0/1765216385 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45f41a0400 con 0x7f45f407ed80 2024-05-14T15:05:52.189 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.241+0000 7f45f3400700 1 --2- 172.21.15.69:0/1765216385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45f407ed80 0x7f45f419fec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f45e4011670 tx=0x7f45e4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:52.190 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.242+0000 7f45f0c00700 1 -- 172.21.15.69:0/1765216385 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e4003a60 con 0x7f45f407ed80 2024-05-14T15:05:52.190 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.242+0000 7f45f0c00700 1 -- 172.21.15.69:0/1765216385 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45e401b8d0 con 0x7f45f407ed80 2024-05-14T15:05:52.190 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.242+0000 7f45f0c00700 1 -- 172.21.15.69:0/1765216385 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45e4023750 con 0x7f45f407ed80 2024-05-14T15:05:52.190 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.242+0000 7f45fa800700 1 -- 172.21.15.69:0/1765216385 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45f41a0690 con 0x7f45f407ed80 2024-05-14T15:05:52.190 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.242+0000 7f45fa800700 1 -- 172.21.15.69:0/1765216385 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45f41a32a0 con 0x7f45f407ed80 2024-05-14T15:05:52.190 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.243+0000 7f45fa800700 1 -- 172.21.15.69:0/1765216385 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45f4064e20 con 0x7f45f407ed80 2024-05-14T15:05:52.190 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.243+0000 7f45f0c00700 1 -- 172.21.15.69:0/1765216385 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f45e401b440 con 0x7f45f407ed80 2024-05-14T15:05:52.190 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.244+0000 7f45f0c00700 1 --2- 172.21.15.69:0/1765216385 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f45d803e5d0 0x7f45d8040ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:52.190 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.244+0000 7f45f0c00700 1 -- 172.21.15.69:0/1765216385 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f45e4054290 con 0x7f45f407ed80 2024-05-14T15:05:52.190 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.244+0000 7f45eaa00700 1 --2- 172.21.15.69:0/1765216385 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f45d803e5d0 0x7f45d8040ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:52.190 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.245+0000 7f45eaa00700 1 --2- 172.21.15.69:0/1765216385 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f45d803e5d0 0x7f45d8040ae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f45dc006fd0 tx=0x7f45dc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:52.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.250+0000 7f45f0c00700 1 -- 172.21.15.69:0/1765216385 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f45e401f030 con 0x7f45f407ed80 2024-05-14T15:05:52.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.481+0000 7f45fa800700 1 -- 172.21.15.69:0/1765216385 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) -- 0x7f45f41a3470 con 0x7f45f407ed80 2024-05-14T15:05:52.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.482+0000 7f45f0c00700 1 -- 172.21.15.69:0/1765216385 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) ==== 127+0+0 (secure 0 0 0) 0x7f45e40187d0 con 0x7f45f407ed80 2024-05-14T15:05:52.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.485+0000 7f45fa800700 1 -- 172.21.15.69:0/1765216385 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f45d803e5d0 msgr2=0x7f45d8040ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:52.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.485+0000 7f45fa800700 1 --2- 172.21.15.69:0/1765216385 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f45d803e5d0 0x7f45d8040ae0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f45dc006fd0 tx=0x7f45dc006e40 comp rx=0 tx=0).stop 2024-05-14T15:05:52.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.485+0000 7f45fa800700 1 -- 172.21.15.69:0/1765216385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45f407ed80 msgr2=0x7f45f419fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:52.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.485+0000 7f45fa800700 1 --2- 172.21.15.69:0/1765216385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45f407ed80 0x7f45f419fec0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f45e4011670 tx=0x7f45e4011a30 comp rx=0 tx=0).stop 2024-05-14T15:05:52.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.486+0000 7f45fa800700 1 -- 172.21.15.69:0/1765216385 shutdown_connections 2024-05-14T15:05:52.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.486+0000 7f45fa800700 1 --2- 172.21.15.69:0/1765216385 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f45d803e5d0 0x7f45d8040ae0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:52.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.486+0000 7f45fa800700 1 --2- 172.21.15.69:0/1765216385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45f407ed80 0x7f45f419fec0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:52.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.486+0000 7f45fa800700 1 -- 172.21.15.69:0/1765216385 >> 172.21.15.69:0/1765216385 conn(0x7f45f4105030 msgr2=0x7f45f4105880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:52.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.486+0000 7f45fa800700 1 -- 172.21.15.69:0/1765216385 shutdown_connections 2024-05-14T15:05:52.191 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:51.486+0000 7f45fa800700 1 -- 172.21.15.69:0/1765216385 wait complete. 2024-05-14T15:05:53.953 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.904+0000 7f1006800700 1 Processor -- start 2024-05-14T15:05:53.953 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.905+0000 7f1006800700 1 -- start start 2024-05-14T15:05:53.953 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.905+0000 7f1006800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10001107b0 0x7f1000112bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:53.953 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.905+0000 7f1006800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f10001131a0 con 0x7f10001107b0 2024-05-14T15:05:53.953 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.905+0000 7f0fff400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10001107b0 0x7f1000112bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:53.953 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.906+0000 7f0fff400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10001107b0 0x7f1000112bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42078/0 (socket says 172.21.15.69:42078) 2024-05-14T15:05:53.953 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.906+0000 7f0fff400700 1 -- 172.21.15.69:0/224415528 learned_addr learned my addr 172.21.15.69:0/224415528 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:53.953 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.906+0000 7f0fff400700 1 -- 172.21.15.69:0/224415528 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1000113320 con 0x7f10001107b0 2024-05-14T15:05:53.953 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.907+0000 7f0fff400700 1 --2- 172.21.15.69:0/224415528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10001107b0 0x7f1000112bd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00098a0 tx=0x7f0ff0009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=499e676e56b881e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:53.953 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.907+0000 7f0ffe000700 1 -- 172.21.15.69:0/224415528 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ff0004160 con 0x7f10001107b0 2024-05-14T15:05:53.953 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.907+0000 7f0ffe000700 1 -- 172.21.15.69:0/224415528 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ff0004300 con 0x7f10001107b0 2024-05-14T15:05:53.953 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.907+0000 7f0ffe000700 1 -- 172.21.15.69:0/224415528 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ff0011960 con 0x7f10001107b0 2024-05-14T15:05:53.954 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.908+0000 7f1006800700 1 -- 172.21.15.69:0/224415528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10001107b0 msgr2=0x7f1000112bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:53.954 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.908+0000 7f1006800700 1 --2- 172.21.15.69:0/224415528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10001107b0 0x7f1000112bd0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0ff00098a0 tx=0x7f0ff0009bb0 comp rx=0 tx=0).stop 2024-05-14T15:05:53.954 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.908+0000 7f1006800700 1 -- 172.21.15.69:0/224415528 shutdown_connections 2024-05-14T15:05:53.954 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.908+0000 7f1006800700 1 --2- 172.21.15.69:0/224415528 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10001107b0 0x7f1000112bd0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:53.954 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.908+0000 7f1006800700 1 -- 172.21.15.69:0/224415528 >> 172.21.15.69:0/224415528 conn(0x7f100007f0d0 msgr2=0x7f10000814f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:53.954 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.908+0000 7f1006800700 1 -- 172.21.15.69:0/224415528 shutdown_connections 2024-05-14T15:05:53.954 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.908+0000 7f1006800700 1 -- 172.21.15.69:0/224415528 wait complete. 2024-05-14T15:05:53.954 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.909+0000 7f1006800700 1 Processor -- start 2024-05-14T15:05:53.954 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.909+0000 7f1006800700 1 -- start start 2024-05-14T15:05:53.954 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.910+0000 7f1006800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10001107b0 0x7f10001a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:53.954 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.910+0000 7f1006800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1000114380 con 0x7f10001107b0 2024-05-14T15:05:53.954 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.910+0000 7f0fff400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10001107b0 0x7f10001a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:53.954 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.910+0000 7f0fff400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10001107b0 0x7f10001a4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42094/0 (socket says 172.21.15.69:42094) 2024-05-14T15:05:53.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.910+0000 7f0fff400700 1 -- 172.21.15.69:0/1779829846 learned_addr learned my addr 172.21.15.69:0/1779829846 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:53.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.910+0000 7f0fff400700 1 -- 172.21.15.69:0/1779829846 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10001a47c0 con 0x7f10001107b0 2024-05-14T15:05:53.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.911+0000 7f0fff400700 1 --2- 172.21.15.69:0/1779829846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10001107b0 0x7f10001a4280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0011670 tx=0x7f0ff0011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:53.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.911+0000 7f0ff7e00700 1 -- 172.21.15.69:0/1779829846 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ff0003a60 con 0x7f10001107b0 2024-05-14T15:05:53.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.911+0000 7f0ff7e00700 1 -- 172.21.15.69:0/1779829846 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ff001b8d0 con 0x7f10001107b0 2024-05-14T15:05:53.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.911+0000 7f1006800700 1 -- 172.21.15.69:0/1779829846 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10001a4a50 con 0x7f10001107b0 2024-05-14T15:05:53.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.911+0000 7f0ff7e00700 1 -- 172.21.15.69:0/1779829846 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ff0023790 con 0x7f10001107b0 2024-05-14T15:05:53.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.911+0000 7f1006800700 1 -- 172.21.15.69:0/1779829846 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10001a7660 con 0x7f10001107b0 2024-05-14T15:05:53.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.912+0000 7f1006800700 1 -- 172.21.15.69:0/1779829846 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1000064e20 con 0x7f10001107b0 2024-05-14T15:05:53.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.912+0000 7f0ff7e00700 1 -- 172.21.15.69:0/1779829846 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f0ff0023a40 con 0x7f10001107b0 2024-05-14T15:05:53.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.913+0000 7f0ff7e00700 1 --2- 172.21.15.69:0/1779829846 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0fe403e680 0x7f0fe4040b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:53.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.913+0000 7f0ff7e00700 1 -- 172.21.15.69:0/1779829846 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f0ff0054220 con 0x7f10001107b0 2024-05-14T15:05:53.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.913+0000 7f0ffea00700 1 --2- 172.21.15.69:0/1779829846 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0fe403e680 0x7f0fe4040b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:53.955 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.914+0000 7f0ffea00700 1 --2- 172.21.15.69:0/1779829846 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0fe403e680 0x7f0fe4040b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0fec006fd0 tx=0x7f0fec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:53.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:52.918+0000 7f0ff7e00700 1 -- 172.21.15.69:0/1779829846 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0ff001f030 con 0x7f10001107b0 2024-05-14T15:05:53.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:53.259+0000 7f1006800700 1 -- 172.21.15.69:0/1779829846 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f10001a7830 con 0x7f10001107b0 2024-05-14T15:05:53.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:53.262+0000 7f0ff7e00700 1 -- 172.21.15.69:0/1779829846 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v27)=0 set mgr/dashboard/cluster/status v27) ==== 153+0+0 (secure 0 0 0) 0x7f0ff000b3e0 con 0x7f10001107b0 2024-05-14T15:05:53.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:53.265+0000 7f1006800700 1 -- 172.21.15.69:0/1779829846 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0fe403e680 msgr2=0x7f0fe4040b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:53.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:53.265+0000 7f1006800700 1 --2- 172.21.15.69:0/1779829846 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0fe403e680 0x7f0fe4040b90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f0fec006fd0 tx=0x7f0fec006e40 comp rx=0 tx=0).stop 2024-05-14T15:05:53.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:53.265+0000 7f1006800700 1 -- 172.21.15.69:0/1779829846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10001107b0 msgr2=0x7f10001a4280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:53.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:53.265+0000 7f1006800700 1 --2- 172.21.15.69:0/1779829846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10001107b0 0x7f10001a4280 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0ff0011670 tx=0x7f0ff0011a30 comp rx=0 tx=0).stop 2024-05-14T15:05:53.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:53.265+0000 7f1006800700 1 -- 172.21.15.69:0/1779829846 shutdown_connections 2024-05-14T15:05:53.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:53.265+0000 7f1006800700 1 --2- 172.21.15.69:0/1779829846 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0fe403e680 0x7f0fe4040b90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:53.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:53.265+0000 7f1006800700 1 --2- 172.21.15.69:0/1779829846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10001107b0 0x7f10001a4280 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:53.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:53.265+0000 7f1006800700 1 -- 172.21.15.69:0/1779829846 >> 172.21.15.69:0/1779829846 conn(0x7f100007f0d0 msgr2=0x7f100007f880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:53.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:53.266+0000 7f1006800700 1 -- 172.21.15.69:0/1779829846 shutdown_connections 2024-05-14T15:05:53.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr 2024-05-14T15:05:53.266+0000 7f1006800700 1 -- 172.21.15.69:0/1779829846 wait complete. 2024-05-14T15:05:53.956 INFO:teuthology.orchestra.run.smithi069.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-05-14T15:05:53.957 INFO:teuthology.orchestra.run.smithi069.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-05-14T15:05:53.957 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:05:53.957 INFO:teuthology.orchestra.run.smithi069.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-14T15:05:53.957 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:05:53.957 INFO:teuthology.orchestra.run.smithi069.stdout:Or, if you are only running a single cluster on this host: 2024-05-14T15:05:53.957 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:05:53.957 INFO:teuthology.orchestra.run.smithi069.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-05-14T15:05:53.957 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:05:53.957 INFO:teuthology.orchestra.run.smithi069.stdout:Please consider enabling telemetry to help improve Ceph: 2024-05-14T15:05:53.957 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:05:53.957 INFO:teuthology.orchestra.run.smithi069.stdout: ceph telemetry on 2024-05-14T15:05:53.957 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:05:53.957 INFO:teuthology.orchestra.run.smithi069.stdout:For more information see: 2024-05-14T15:05:53.957 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:05:53.957 INFO:teuthology.orchestra.run.smithi069.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-05-14T15:05:53.957 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:05:53.958 INFO:teuthology.orchestra.run.smithi069.stdout:Bootstrap complete. 2024-05-14T15:05:54.028 INFO:tasks.cephadm:Fetching config... 2024-05-14T15:05:54.028 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:05:54.028 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-14T15:05:54.072 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-14T15:05:54.072 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:05:54.072 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-14T15:05:54.154 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-14T15:05:54.155 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:05:54.155 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-14T15:05:54.269 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-14T15:05:54.270 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:05:54.270 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-14T15:05:54.361 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-14T15:05:54.361 DEBUG:teuthology.orchestra.run.smithi069:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/6fBXIt2hmyrZ6wNDo5qbG/JMsbv64ofYujPk5iGQZeoWde/ruWgNSGEJK2BNv0cpOCpFFoxIX7CENelbNOK/bpbE8X5NXaHg/0feUoxNCZnjh+mhO0tlQSSK2ZLZiBIBiQAOh8v7x73iODhdJ6fOxw8vQeFbXdbNMCTh6mHv02g7QduRscTYqJQeGQMyYp/xGP1hXtoT1jKlvV99lOJmge3RRLIpKRv4d4/kccHD/SFVaYH5LCFok3DAzVYvlefZc6HroDD3ZbJoay/YWKSmhgkedX9WqSJYUXEfyzM9k19EHXV540B97rZo/JHyHxfhbnZb/P8TSIdeCxz4Pk2CmeUEBWKgv3Is8l3Dk6Wptnd3TdIzlP/nBnPMYroJR3hRc1c9aHqJQnF58s4KLYTxAELeaF2hlcybw5xTqu5u4fPnqABE7wi3U6dr1XHyqjFo4MueI58jvc1j78cwwayR7XERWVY9LQVEEsmkp1tApYFYqQoaYAXtpoerbtoQHgs= ceph-1cc2580e-1203-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-14T15:05:54.464 INFO:teuthology.orchestra.run.smithi069.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/6fBXIt2hmyrZ6wNDo5qbG/JMsbv64ofYujPk5iGQZeoWde/ruWgNSGEJK2BNv0cpOCpFFoxIX7CENelbNOK/bpbE8X5NXaHg/0feUoxNCZnjh+mhO0tlQSSK2ZLZiBIBiQAOh8v7x73iODhdJ6fOxw8vQeFbXdbNMCTh6mHv02g7QduRscTYqJQeGQMyYp/xGP1hXtoT1jKlvV99lOJmge3RRLIpKRv4d4/kccHD/SFVaYH5LCFok3DAzVYvlefZc6HroDD3ZbJoay/YWKSmhgkedX9WqSJYUXEfyzM9k19EHXV540B97rZo/JHyHxfhbnZb/P8TSIdeCxz4Pk2CmeUEBWKgv3Is8l3Dk6Wptnd3TdIzlP/nBnPMYroJR3hRc1c9aHqJQnF58s4KLYTxAELeaF2hlcybw5xTqu5u4fPnqABE7wi3U6dr1XHyqjFo4MueI58jvc1j78cwwayR7XERWVY9LQVEEsmkp1tApYFYqQoaYAXtpoerbtoQHgs= ceph-1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:05:54.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:54 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1779829846' entity='client.admin' 2024-05-14T15:05:54.500 DEBUG:teuthology.orchestra.run.smithi092:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/6fBXIt2hmyrZ6wNDo5qbG/JMsbv64ofYujPk5iGQZeoWde/ruWgNSGEJK2BNv0cpOCpFFoxIX7CENelbNOK/bpbE8X5NXaHg/0feUoxNCZnjh+mhO0tlQSSK2ZLZiBIBiQAOh8v7x73iODhdJ6fOxw8vQeFbXdbNMCTh6mHv02g7QduRscTYqJQeGQMyYp/xGP1hXtoT1jKlvV99lOJmge3RRLIpKRv4d4/kccHD/SFVaYH5LCFok3DAzVYvlefZc6HroDD3ZbJoay/YWKSmhgkedX9WqSJYUXEfyzM9k19EHXV540B97rZo/JHyHxfhbnZb/P8TSIdeCxz4Pk2CmeUEBWKgv3Is8l3Dk6Wptnd3TdIzlP/nBnPMYroJR3hRc1c9aHqJQnF58s4KLYTxAELeaF2hlcybw5xTqu5u4fPnqABE7wi3U6dr1XHyqjFo4MueI58jvc1j78cwwayR7XERWVY9LQVEEsmkp1tApYFYqQoaYAXtpoerbtoQHgs= ceph-1cc2580e-1203-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-14T15:05:54.616 INFO:teuthology.orchestra.run.smithi092.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/6fBXIt2hmyrZ6wNDo5qbG/JMsbv64ofYujPk5iGQZeoWde/ruWgNSGEJK2BNv0cpOCpFFoxIX7CENelbNOK/bpbE8X5NXaHg/0feUoxNCZnjh+mhO0tlQSSK2ZLZiBIBiQAOh8v7x73iODhdJ6fOxw8vQeFbXdbNMCTh6mHv02g7QduRscTYqJQeGQMyYp/xGP1hXtoT1jKlvV99lOJmge3RRLIpKRv4d4/kccHD/SFVaYH5LCFok3DAzVYvlefZc6HroDD3ZbJoay/YWKSmhgkedX9WqSJYUXEfyzM9k19EHXV540B97rZo/JHyHxfhbnZb/P8TSIdeCxz4Pk2CmeUEBWKgv3Is8l3Dk6Wptnd3TdIzlP/nBnPMYroJR3hRc1c9aHqJQnF58s4KLYTxAELeaF2hlcybw5xTqu5u4fPnqABE7wi3U6dr1XHyqjFo4MueI58jvc1j78cwwayR7XERWVY9LQVEEsmkp1tApYFYqQoaYAXtpoerbtoQHgs= ceph-1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:05:54.674 DEBUG:teuthology.orchestra.run.smithi203:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/6fBXIt2hmyrZ6wNDo5qbG/JMsbv64ofYujPk5iGQZeoWde/ruWgNSGEJK2BNv0cpOCpFFoxIX7CENelbNOK/bpbE8X5NXaHg/0feUoxNCZnjh+mhO0tlQSSK2ZLZiBIBiQAOh8v7x73iODhdJ6fOxw8vQeFbXdbNMCTh6mHv02g7QduRscTYqJQeGQMyYp/xGP1hXtoT1jKlvV99lOJmge3RRLIpKRv4d4/kccHD/SFVaYH5LCFok3DAzVYvlefZc6HroDD3ZbJoay/YWKSmhgkedX9WqSJYUXEfyzM9k19EHXV540B97rZo/JHyHxfhbnZb/P8TSIdeCxz4Pk2CmeUEBWKgv3Is8l3Dk6Wptnd3TdIzlP/nBnPMYroJR3hRc1c9aHqJQnF58s4KLYTxAELeaF2hlcybw5xTqu5u4fPnqABE7wi3U6dr1XHyqjFo4MueI58jvc1j78cwwayR7XERWVY9LQVEEsmkp1tApYFYqQoaYAXtpoerbtoQHgs= ceph-1cc2580e-1203-11ef-bc98-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-14T15:05:54.787 INFO:teuthology.orchestra.run.smithi203.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC/6fBXIt2hmyrZ6wNDo5qbG/JMsbv64ofYujPk5iGQZeoWde/ruWgNSGEJK2BNv0cpOCpFFoxIX7CENelbNOK/bpbE8X5NXaHg/0feUoxNCZnjh+mhO0tlQSSK2ZLZiBIBiQAOh8v7x73iODhdJ6fOxw8vQeFbXdbNMCTh6mHv02g7QduRscTYqJQeGQMyYp/xGP1hXtoT1jKlvV99lOJmge3RRLIpKRv4d4/kccHD/SFVaYH5LCFok3DAzVYvlefZc6HroDD3ZbJoay/YWKSmhgkedX9WqSJYUXEfyzM9k19EHXV540B97rZo/JHyHxfhbnZb/P8TSIdeCxz4Pk2CmeUEBWKgv3Is8l3Dk6Wptnd3TdIzlP/nBnPMYroJR3hRc1c9aHqJQnF58s4KLYTxAELeaF2hlcybw5xTqu5u4fPnqABE7wi3U6dr1XHyqjFo4MueI58jvc1j78cwwayR7XERWVY9LQVEEsmkp1tApYFYqQoaYAXtpoerbtoQHgs= ceph-1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:05:54.837 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-14T15:05:55.259 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:05:57.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.978+0000 7f3409800700 1 -- 172.21.15.69:0/2759527380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3404105c50 msgr2=0x7f3404106060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:57.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.978+0000 7f3409800700 1 --2- 172.21.15.69:0/2759527380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3404105c50 0x7f3404106060 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f33f4009910 tx=0x7f33f4009c20 comp rx=0 tx=0).stop 2024-05-14T15:05:57.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.978+0000 7f3409800700 1 -- 172.21.15.69:0/2759527380 shutdown_connections 2024-05-14T15:05:57.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.978+0000 7f3409800700 1 --2- 172.21.15.69:0/2759527380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3404105c50 0x7f3404106060 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:57.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.978+0000 7f3409800700 1 -- 172.21.15.69:0/2759527380 >> 172.21.15.69:0/2759527380 conn(0x7f3404101270 msgr2=0x7f3404103740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:57.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.978+0000 7f3409800700 1 -- 172.21.15.69:0/2759527380 shutdown_connections 2024-05-14T15:05:57.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.978+0000 7f3409800700 1 -- 172.21.15.69:0/2759527380 wait complete. 2024-05-14T15:05:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.980+0000 7f3409800700 1 Processor -- start 2024-05-14T15:05:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.980+0000 7f3409800700 1 -- start start 2024-05-14T15:05:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.980+0000 7f3409800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3404105c50 0x7f340419b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.980+0000 7f3409800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f340410bac0 con 0x7f3404105c50 2024-05-14T15:05:57.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.981+0000 7f3403e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3404105c50 0x7f340419b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:57.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.981+0000 7f3403e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3404105c50 0x7f340419b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42116/0 (socket says 172.21.15.69:42116) 2024-05-14T15:05:57.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.981+0000 7f3403e00700 1 -- 172.21.15.69:0/1026859971 learned_addr learned my addr 172.21.15.69:0/1026859971 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:05:57.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.981+0000 7f3403e00700 1 -- 172.21.15.69:0/1026859971 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f340419bbf0 con 0x7f3404105c50 2024-05-14T15:05:57.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.981+0000 7f3403e00700 1 --2- 172.21.15.69:0/1026859971 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3404105c50 0x7f340419b6b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f33f4005950 tx=0x7f33f4005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:57.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.982+0000 7f3400c00700 1 -- 172.21.15.69:0/1026859971 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33f4027070 con 0x7f3404105c50 2024-05-14T15:05:57.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.982+0000 7f3400c00700 1 -- 172.21.15.69:0/1026859971 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f33f400bdf0 con 0x7f3404105c50 2024-05-14T15:05:57.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.982+0000 7f3400c00700 1 -- 172.21.15.69:0/1026859971 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f33f400fdb0 con 0x7f3404105c50 2024-05-14T15:05:57.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.982+0000 7f3409800700 1 -- 172.21.15.69:0/1026859971 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f340419be80 con 0x7f3404105c50 2024-05-14T15:05:57.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.982+0000 7f3409800700 1 -- 172.21.15.69:0/1026859971 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f340419ea90 con 0x7f3404105c50 2024-05-14T15:05:57.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.983+0000 7f3409800700 1 -- 172.21.15.69:0/1026859971 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f340410c240 con 0x7f3404105c50 2024-05-14T15:05:57.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.983+0000 7f3400c00700 1 -- 172.21.15.69:0/1026859971 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f33f402a070 con 0x7f3404105c50 2024-05-14T15:05:57.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.984+0000 7f3400c00700 1 --2- 172.21.15.69:0/1026859971 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f33e803e570 0x7f33e8040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:05:57.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.984+0000 7f3400c00700 1 -- 172.21.15.69:0/1026859971 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f33f4053be0 con 0x7f3404105c50 2024-05-14T15:05:57.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.984+0000 7f3403400700 1 --2- 172.21.15.69:0/1026859971 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f33e803e570 0x7f33e8040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:05:57.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.985+0000 7f3403400700 1 --2- 172.21.15.69:0/1026859971 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f33e803e570 0x7f33e8040a80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f33ec006fd0 tx=0x7f33ec006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:05:57.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:57.990+0000 7f3400c00700 1 -- 172.21.15.69:0/1026859971 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f33f4013070 con 0x7f3404105c50 2024-05-14T15:05:58.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:58.220+0000 7f3409800700 1 -- 172.21.15.69:0/1026859971 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f340402e700 con 0x7f3404105c50 2024-05-14T15:05:58.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:58.225+0000 7f3400c00700 1 -- 172.21.15.69:0/1026859971 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f33f40310c0 con 0x7f3404105c50 2024-05-14T15:05:58.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:58.228+0000 7f3409800700 1 -- 172.21.15.69:0/1026859971 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f33e803e570 msgr2=0x7f33e8040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:58.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:58.228+0000 7f3409800700 1 --2- 172.21.15.69:0/1026859971 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f33e803e570 0x7f33e8040a80 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f33ec006fd0 tx=0x7f33ec006e40 comp rx=0 tx=0).stop 2024-05-14T15:05:58.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:58.228+0000 7f3409800700 1 -- 172.21.15.69:0/1026859971 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3404105c50 msgr2=0x7f340419b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:05:58.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:58.228+0000 7f3409800700 1 --2- 172.21.15.69:0/1026859971 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3404105c50 0x7f340419b6b0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f33f4005950 tx=0x7f33f4005810 comp rx=0 tx=0).stop 2024-05-14T15:05:58.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:58.229+0000 7f3409800700 1 -- 172.21.15.69:0/1026859971 shutdown_connections 2024-05-14T15:05:58.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:58.229+0000 7f3409800700 1 --2- 172.21.15.69:0/1026859971 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f33e803e570 0x7f33e8040a80 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:58.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:58.229+0000 7f3409800700 1 --2- 172.21.15.69:0/1026859971 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3404105c50 0x7f340419b6b0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:05:58.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:58.229+0000 7f3409800700 1 -- 172.21.15.69:0/1026859971 >> 172.21.15.69:0/1026859971 conn(0x7f3404101270 msgr2=0x7f3404102010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:05:58.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:58.229+0000 7f3409800700 1 -- 172.21.15.69:0/1026859971 shutdown_connections 2024-05-14T15:05:58.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:05:58.229+0000 7f3409800700 1 -- 172.21.15.69:0/1026859971 wait complete. 2024-05-14T15:05:58.612 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:05:58.612 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:05:58.612 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi069", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:05:58.612 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:05:58.612 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:05:58.612 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:05:58.612 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:58 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1026859971' entity='client.admin' 2024-05-14T15:05:58.612 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:05:58.612 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:05:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:05:58.930 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-14T15:05:58.930 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-14T15:05:59.358 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:06:01.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.385+0000 7f3babe00700 1 -- 172.21.15.69:0/3821127113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ba4105de0 msgr2=0x7f3ba41061f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:01.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.385+0000 7f3babe00700 1 --2- 172.21.15.69:0/3821127113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ba4105de0 0x7f3ba41061f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3b98009910 tx=0x7f3b98009c20 comp rx=0 tx=0).stop 2024-05-14T15:06:01.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.385+0000 7f3babe00700 1 -- 172.21.15.69:0/3821127113 shutdown_connections 2024-05-14T15:06:01.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.385+0000 7f3babe00700 1 --2- 172.21.15.69:0/3821127113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ba4105de0 0x7f3ba41061f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:01.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.385+0000 7f3babe00700 1 -- 172.21.15.69:0/3821127113 >> 172.21.15.69:0/3821127113 conn(0x7f3ba4101420 msgr2=0x7f3ba41038d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:01.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.385+0000 7f3babe00700 1 -- 172.21.15.69:0/3821127113 shutdown_connections 2024-05-14T15:06:01.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.385+0000 7f3babe00700 1 -- 172.21.15.69:0/3821127113 wait complete. 2024-05-14T15:06:01.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.386+0000 7f3babe00700 1 Processor -- start 2024-05-14T15:06:01.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.386+0000 7f3babe00700 1 -- start start 2024-05-14T15:06:01.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.387+0000 7f3babe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ba4105de0 0x7f3ba419b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:01.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.387+0000 7f3babe00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3ba410bc50 con 0x7f3ba4105de0 2024-05-14T15:06:01.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.387+0000 7f3ba9400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ba4105de0 0x7f3ba419b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:01.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.387+0000 7f3ba9400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ba4105de0 0x7f3ba419b860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42130/0 (socket says 172.21.15.69:42130) 2024-05-14T15:06:01.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.387+0000 7f3ba9400700 1 -- 172.21.15.69:0/166010982 learned_addr learned my addr 172.21.15.69:0/166010982 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:06:01.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.387+0000 7f3ba9400700 1 -- 172.21.15.69:0/166010982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ba419bda0 con 0x7f3ba4105de0 2024-05-14T15:06:01.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.388+0000 7f3ba9400700 1 --2- 172.21.15.69:0/166010982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ba4105de0 0x7f3ba419b860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3b98005760 tx=0x7f3b98004f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:01.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.388+0000 7f3ba2000700 1 -- 172.21.15.69:0/166010982 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b98027070 con 0x7f3ba4105de0 2024-05-14T15:06:01.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.388+0000 7f3ba2000700 1 -- 172.21.15.69:0/166010982 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3b9800bdf0 con 0x7f3ba4105de0 2024-05-14T15:06:01.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.388+0000 7f3babe00700 1 -- 172.21.15.69:0/166010982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ba419c030 con 0x7f3ba4105de0 2024-05-14T15:06:01.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.388+0000 7f3ba2000700 1 -- 172.21.15.69:0/166010982 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b9800fd70 con 0x7f3ba4105de0 2024-05-14T15:06:01.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.388+0000 7f3babe00700 1 -- 172.21.15.69:0/166010982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ba419ec40 con 0x7f3ba4105de0 2024-05-14T15:06:01.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.389+0000 7f3babe00700 1 -- 172.21.15.69:0/166010982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ba4194aa0 con 0x7f3ba4105de0 2024-05-14T15:06:01.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.390+0000 7f3ba2000700 1 -- 172.21.15.69:0/166010982 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f3b9802a070 con 0x7f3ba4105de0 2024-05-14T15:06:01.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.390+0000 7f3ba2000700 1 --2- 172.21.15.69:0/166010982 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f3b8c03e510 0x7f3b8c040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:01.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.390+0000 7f3ba2000700 1 -- 172.21.15.69:0/166010982 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f3b98053a60 con 0x7f3ba4105de0 2024-05-14T15:06:01.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.391+0000 7f3ba8a00700 1 --2- 172.21.15.69:0/166010982 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f3b8c03e510 0x7f3b8c040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:01.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.391+0000 7f3ba8a00700 1 --2- 172.21.15.69:0/166010982 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f3b8c03e510 0x7f3b8c040a20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3b90006fd0 tx=0x7f3b90006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:01.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.396+0000 7f3ba2000700 1 -- 172.21.15.69:0/166010982 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3b98013070 con 0x7f3ba4105de0 2024-05-14T15:06:01.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.630+0000 7f3babe00700 1 -- 172.21.15.69:0/166010982 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f3ba402e700 con 0x7f3b8c03e510 2024-05-14T15:06:01.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.641+0000 7f3ba2000700 1 -- 172.21.15.69:0/166010982 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3ba402e700 con 0x7f3b8c03e510 2024-05-14T15:06:01.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.645+0000 7f3babe00700 1 -- 172.21.15.69:0/166010982 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f3b8c03e510 msgr2=0x7f3b8c040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:01.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.645+0000 7f3babe00700 1 --2- 172.21.15.69:0/166010982 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f3b8c03e510 0x7f3b8c040a20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3b90006fd0 tx=0x7f3b90006e40 comp rx=0 tx=0).stop 2024-05-14T15:06:01.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.645+0000 7f3babe00700 1 -- 172.21.15.69:0/166010982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ba4105de0 msgr2=0x7f3ba419b860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:01.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.645+0000 7f3babe00700 1 --2- 172.21.15.69:0/166010982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ba4105de0 0x7f3ba419b860 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f3b98005760 tx=0x7f3b98004f60 comp rx=0 tx=0).stop 2024-05-14T15:06:01.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.645+0000 7f3babe00700 1 -- 172.21.15.69:0/166010982 shutdown_connections 2024-05-14T15:06:01.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.645+0000 7f3babe00700 1 --2- 172.21.15.69:0/166010982 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f3b8c03e510 0x7f3b8c040a20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:01.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.645+0000 7f3babe00700 1 --2- 172.21.15.69:0/166010982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3ba4105de0 0x7f3ba419b860 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:01.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.645+0000 7f3babe00700 1 -- 172.21.15.69:0/166010982 >> 172.21.15.69:0/166010982 conn(0x7f3ba4101420 msgr2=0x7f3ba4102180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:01.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.645+0000 7f3babe00700 1 -- 172.21.15.69:0/166010982 shutdown_connections 2024-05-14T15:06:01.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:01.645+0000 7f3babe00700 1 -- 172.21.15.69:0/166010982 wait complete. 2024-05-14T15:06:02.419 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi092 2024-05-14T15:06:02.419 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-05-14T15:06:02.419 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/etc/ceph/ceph.conf 2024-05-14T15:06:02.478 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-05-14T15:06:02.478 DEBUG:teuthology.orchestra.run.smithi092:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:06:02.573 INFO:tasks.cephadm:Adding host smithi092 to orchestrator... 2024-05-14T15:06:02.573 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch host add smithi092 2024-05-14T15:06:02.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:02 smithi069 ceph-mon[31270]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:02.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:02 smithi069 ceph-mon[31270]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:06:02.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:02.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:06:02.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:06:02.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:06:02.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:02 smithi069 ceph-mon[31270]: Updating smithi069:/etc/ceph/ceph.conf 2024-05-14T15:06:02.984 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:06:03.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:03 smithi069 ceph-mon[31270]: Updating smithi069:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:06:03.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:03 smithi069 ceph-mon[31270]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:06:04.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:04 smithi069 ceph-mon[31270]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:04.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:04 smithi069 ceph-mon[31270]: Updating smithi069:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T15:06:04.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:04 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:04.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:04 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:04.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:04 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:05.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.253+0000 7f5186600700 1 -- 172.21.15.69:0/2154633678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5180105fe0 msgr2=0x7f51801063f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:05.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.253+0000 7f5186600700 1 --2- 172.21.15.69:0/2154633678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5180105fe0 0x7f51801063f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5170009910 tx=0x7f5170009c20 comp rx=0 tx=0).stop 2024-05-14T15:06:05.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.253+0000 7f5186600700 1 -- 172.21.15.69:0/2154633678 shutdown_connections 2024-05-14T15:06:05.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.253+0000 7f5186600700 1 --2- 172.21.15.69:0/2154633678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5180105fe0 0x7f51801063f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:05.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.253+0000 7f5186600700 1 -- 172.21.15.69:0/2154633678 >> 172.21.15.69:0/2154633678 conn(0x7f51801018b0 msgr2=0x7f5180103d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:05.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.253+0000 7f5186600700 1 -- 172.21.15.69:0/2154633678 shutdown_connections 2024-05-14T15:06:05.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.253+0000 7f5186600700 1 -- 172.21.15.69:0/2154633678 wait complete. 2024-05-14T15:06:05.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.254+0000 7f5186600700 1 Processor -- start 2024-05-14T15:06:05.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.254+0000 7f5186600700 1 -- start start 2024-05-14T15:06:05.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.255+0000 7f5186600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5180105fe0 0x7f51801a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:05.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.255+0000 7f5186600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5180110180 con 0x7f5180105fe0 2024-05-14T15:06:05.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.255+0000 7f517f400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5180105fe0 0x7f51801a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:05.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.255+0000 7f517f400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5180105fe0 0x7f51801a1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43354/0 (socket says 172.21.15.69:43354) 2024-05-14T15:06:05.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.255+0000 7f517f400700 1 -- 172.21.15.69:0/2503538442 learned_addr learned my addr 172.21.15.69:0/2503538442 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:06:05.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.255+0000 7f517f400700 1 -- 172.21.15.69:0/2503538442 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51801a1bb0 con 0x7f5180105fe0 2024-05-14T15:06:05.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.256+0000 7f517f400700 1 --2- 172.21.15.69:0/2503538442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5180105fe0 0x7f51801a1670 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5170005660 tx=0x7f5170005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:05.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.256+0000 7f517cc00700 1 -- 172.21.15.69:0/2503538442 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5170026070 con 0x7f5180105fe0 2024-05-14T15:06:05.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.256+0000 7f517cc00700 1 -- 172.21.15.69:0/2503538442 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f517000b6f0 con 0x7f5180105fe0 2024-05-14T15:06:05.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.256+0000 7f5186600700 1 -- 172.21.15.69:0/2503538442 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51801a1ea0 con 0x7f5180105fe0 2024-05-14T15:06:05.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.256+0000 7f517cc00700 1 -- 172.21.15.69:0/2503538442 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f51700037b0 con 0x7f5180105fe0 2024-05-14T15:06:05.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.256+0000 7f5186600700 1 -- 172.21.15.69:0/2503538442 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f518019b890 con 0x7f5180105fe0 2024-05-14T15:06:05.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.258+0000 7f5186600700 1 -- 172.21.15.69:0/2503538442 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5180107490 con 0x7f5180105fe0 2024-05-14T15:06:05.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.258+0000 7f517cc00700 1 -- 172.21.15.69:0/2503538442 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f5170029070 con 0x7f5180105fe0 2024-05-14T15:06:05.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.258+0000 7f517cc00700 1 --2- 172.21.15.69:0/2503538442 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f516403e510 0x7f5164040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:05.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.258+0000 7f517cc00700 1 -- 172.21.15.69:0/2503538442 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f517001e070 con 0x7f5180105fe0 2024-05-14T15:06:05.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.258+0000 7f5177e00700 1 --2- 172.21.15.69:0/2503538442 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f516403e510 0x7f5164040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:05.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.259+0000 7f5177e00700 1 --2- 172.21.15.69:0/2503538442 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f516403e510 0x7f5164040a20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5168006fd0 tx=0x7f5168006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:05.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.264+0000 7f517cc00700 1 -- 172.21.15.69:0/2503538442 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5170013070 con 0x7f5180105fe0 2024-05-14T15:06:05.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:05.509+0000 7f5186600700 1 -- 172.21.15.69:0/2503538442 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi092", "target": ["mon-mgr", ""]}) -- 0x7f518019cdc0 con 0x7f516403e510 2024-05-14T15:06:06.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:06 smithi069 ceph-mon[31270]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:06.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:06 smithi069 ceph-mon[31270]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi092", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:06:07.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:07 smithi069 ceph-mon[31270]: Deploying cephadm binary to smithi092 2024-05-14T15:06:08.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:08 smithi069 ceph-mon[31270]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:10.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:10 smithi069 ceph-mon[31270]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:11.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:11.649+0000 7f517cc00700 1 -- 172.21.15.69:0/2503538442 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f518019cdc0 con 0x7f516403e510 2024-05-14T15:06:11.641 INFO:teuthology.orchestra.run.smithi069.stdout:Added host 'smithi092' with addr '172.21.15.92' 2024-05-14T15:06:11.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:11.653+0000 7f5186600700 1 -- 172.21.15.69:0/2503538442 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f516403e510 msgr2=0x7f5164040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:11.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:11.653+0000 7f5186600700 1 --2- 172.21.15.69:0/2503538442 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f516403e510 0x7f5164040a20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f5168006fd0 tx=0x7f5168006e40 comp rx=0 tx=0).stop 2024-05-14T15:06:11.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:11.653+0000 7f5186600700 1 -- 172.21.15.69:0/2503538442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5180105fe0 msgr2=0x7f51801a1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:11.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:11.653+0000 7f5186600700 1 --2- 172.21.15.69:0/2503538442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5180105fe0 0x7f51801a1670 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5170005660 tx=0x7f5170005740 comp rx=0 tx=0).stop 2024-05-14T15:06:11.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:11.653+0000 7f5186600700 1 -- 172.21.15.69:0/2503538442 shutdown_connections 2024-05-14T15:06:11.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:11.653+0000 7f5186600700 1 --2- 172.21.15.69:0/2503538442 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f516403e510 0x7f5164040a20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:11.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:11.653+0000 7f5186600700 1 --2- 172.21.15.69:0/2503538442 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5180105fe0 0x7f51801a1670 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:11.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:11.653+0000 7f5186600700 1 -- 172.21.15.69:0/2503538442 >> 172.21.15.69:0/2503538442 conn(0x7f51801018b0 msgr2=0x7f518010bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:11.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:11.653+0000 7f5186600700 1 -- 172.21.15.69:0/2503538442 shutdown_connections 2024-05-14T15:06:11.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:11.653+0000 7f5186600700 1 -- 172.21.15.69:0/2503538442 wait complete. 2024-05-14T15:06:12.447 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch host ls --format=json 2024-05-14T15:06:12.883 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:06:12.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:12 smithi069 ceph-mon[31270]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:12.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:12 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:12.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:12 smithi069 ceph-mon[31270]: Added host smithi092 2024-05-14T15:06:12.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:12 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:06:12.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:12 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:14.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:14 smithi069 ceph-mon[31270]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:14.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:14 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:14.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.993+0000 7f120de00700 1 -- 172.21.15.69:0/1508259584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f120810a3d0 msgr2=0x7f120810a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:14.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.993+0000 7f120de00700 1 --2- 172.21.15.69:0/1508259584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f120810a3d0 0x7f120810a7e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f11f8009910 tx=0x7f11f8009c20 comp rx=0 tx=0).stop 2024-05-14T15:06:14.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.993+0000 7f120de00700 1 -- 172.21.15.69:0/1508259584 shutdown_connections 2024-05-14T15:06:14.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.993+0000 7f120de00700 1 --2- 172.21.15.69:0/1508259584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f120810a3d0 0x7f120810a7e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:14.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.993+0000 7f120de00700 1 -- 172.21.15.69:0/1508259584 >> 172.21.15.69:0/1508259584 conn(0x7f12080799f0 msgr2=0x7f12081085e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:14.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.993+0000 7f120de00700 1 -- 172.21.15.69:0/1508259584 shutdown_connections 2024-05-14T15:06:14.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.993+0000 7f120de00700 1 -- 172.21.15.69:0/1508259584 wait complete. 2024-05-14T15:06:14.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.995+0000 7f120de00700 1 Processor -- start 2024-05-14T15:06:14.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.995+0000 7f120de00700 1 -- start start 2024-05-14T15:06:14.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.995+0000 7f120de00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f120810a3d0 0x7f120819fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:14.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.995+0000 7f120de00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1208114570 con 0x7f120810a3d0 2024-05-14T15:06:14.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.995+0000 7f1206a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f120810a3d0 0x7f120819fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:14.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.995+0000 7f1206a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f120810a3d0 0x7f120819fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51014/0 (socket says 172.21.15.69:51014) 2024-05-14T15:06:14.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.995+0000 7f1206a00700 1 -- 172.21.15.69:0/3029790487 learned_addr learned my addr 172.21.15.69:0/3029790487 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:06:14.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.996+0000 7f1206a00700 1 -- 172.21.15.69:0/3029790487 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12081a03a0 con 0x7f120810a3d0 2024-05-14T15:06:14.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.996+0000 7f1206a00700 1 --2- 172.21.15.69:0/3029790487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f120810a3d0 0x7f120819fe60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f11f8006010 tx=0x7f11f8005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:14.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.996+0000 7f120ca00700 1 -- 172.21.15.69:0/3029790487 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11f8026070 con 0x7f120810a3d0 2024-05-14T15:06:14.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.996+0000 7f120ca00700 1 -- 172.21.15.69:0/3029790487 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11f800b6f0 con 0x7f120810a3d0 2024-05-14T15:06:14.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.996+0000 7f120de00700 1 -- 172.21.15.69:0/3029790487 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12081a0690 con 0x7f120810a3d0 2024-05-14T15:06:14.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.997+0000 7f120ca00700 1 -- 172.21.15.69:0/3029790487 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f11f8003810 con 0x7f120810a3d0 2024-05-14T15:06:14.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.997+0000 7f120de00700 1 -- 172.21.15.69:0/3029790487 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12081a4690 con 0x7f120810a3d0 2024-05-14T15:06:14.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.998+0000 7f120de00700 1 -- 172.21.15.69:0/3029790487 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f120810b880 con 0x7f120810a3d0 2024-05-14T15:06:14.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.998+0000 7f120ca00700 1 -- 172.21.15.69:0/3029790487 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f11f8029070 con 0x7f120810a3d0 2024-05-14T15:06:14.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.999+0000 7f120ca00700 1 --2- 172.21.15.69:0/3029790487 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11ec03e570 0x7f11ec040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:14.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.999+0000 7f120ca00700 1 -- 172.21.15.69:0/3029790487 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f11f801e070 con 0x7f120810a3d0 2024-05-14T15:06:14.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:14.999+0000 7f1206000700 1 --2- 172.21.15.69:0/3029790487 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11ec03e570 0x7f11ec040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:14.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:15.000+0000 7f1206000700 1 --2- 172.21.15.69:0/3029790487 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11ec03e570 0x7f11ec040a80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f11f4006fd0 tx=0x7f11f4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:14.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:15.005+0000 7f120ca00700 1 -- 172.21.15.69:0/3029790487 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f11f8013070 con 0x7f120810a3d0 2024-05-14T15:06:15.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:15.245+0000 7f120de00700 1 -- 172.21.15.69:0/3029790487 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f12081a11c0 con 0x7f11ec03e570 2024-05-14T15:06:15.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:15.248+0000 7f120ca00700 1 -- 172.21.15.69:0/3029790487 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+159 (secure 0 0 0) 0x7f12081a11c0 con 0x7f11ec03e570 2024-05-14T15:06:15.240 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:06:15.240 INFO:teuthology.orchestra.run.smithi069.stdout:[{"addr": "172.21.15.69", "hostname": "smithi069", "labels": [], "status": ""}, {"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}] 2024-05-14T15:06:15.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:15.251+0000 7f120de00700 1 -- 172.21.15.69:0/3029790487 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11ec03e570 msgr2=0x7f11ec040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:15.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:15.251+0000 7f120de00700 1 --2- 172.21.15.69:0/3029790487 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11ec03e570 0x7f11ec040a80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f11f4006fd0 tx=0x7f11f4006e40 comp rx=0 tx=0).stop 2024-05-14T15:06:15.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:15.251+0000 7f120de00700 1 -- 172.21.15.69:0/3029790487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f120810a3d0 msgr2=0x7f120819fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:15.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:15.251+0000 7f120de00700 1 --2- 172.21.15.69:0/3029790487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f120810a3d0 0x7f120819fe60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f11f8006010 tx=0x7f11f8005710 comp rx=0 tx=0).stop 2024-05-14T15:06:15.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:15.252+0000 7f120de00700 1 -- 172.21.15.69:0/3029790487 shutdown_connections 2024-05-14T15:06:15.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:15.252+0000 7f120de00700 1 --2- 172.21.15.69:0/3029790487 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11ec03e570 0x7f11ec040a80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:15.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:15.252+0000 7f120de00700 1 --2- 172.21.15.69:0/3029790487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f120810a3d0 0x7f120819fe60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:15.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:15.252+0000 7f120de00700 1 -- 172.21.15.69:0/3029790487 >> 172.21.15.69:0/3029790487 conn(0x7f12080799f0 msgr2=0x7f120810bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:15.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:15.252+0000 7f120de00700 1 -- 172.21.15.69:0/3029790487 shutdown_connections 2024-05-14T15:06:15.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:15.252+0000 7f120de00700 1 -- 172.21.15.69:0/3029790487 wait complete. 2024-05-14T15:06:16.041 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi203 2024-05-14T15:06:16.042 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-05-14T15:06:16.042 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/etc/ceph/ceph.conf 2024-05-14T15:06:16.100 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-05-14T15:06:16.100 DEBUG:teuthology.orchestra.run.smithi203:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:06:16.196 INFO:tasks.cephadm:Adding host smithi203 to orchestrator... 2024-05-14T15:06:16.196 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch host add smithi203 2024-05-14T15:06:16.609 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:06:16.885 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:16 smithi069 ceph-mon[31270]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:06:16.885 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:16 smithi069 ceph-mon[31270]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:16.885 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:16 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.733+0000 7ff5f8200700 1 -- 172.21.15.69:0/3886974313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5f0103df0 msgr2=0x7ff5f0104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.733+0000 7ff5f8200700 1 --2- 172.21.15.69:0/3886974313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5f0103df0 0x7ff5f0104200 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4009910 tx=0x7ff5e4009c20 comp rx=0 tx=0).stop 2024-05-14T15:06:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.733+0000 7ff5f8200700 1 -- 172.21.15.69:0/3886974313 shutdown_connections 2024-05-14T15:06:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.733+0000 7ff5f8200700 1 --2- 172.21.15.69:0/3886974313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5f0103df0 0x7ff5f0104200 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.733+0000 7ff5f8200700 1 -- 172.21.15.69:0/3886974313 >> 172.21.15.69:0/3886974313 conn(0x7ff5f00ff6a0 msgr2=0x7ff5f0101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:18.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.733+0000 7ff5f8200700 1 -- 172.21.15.69:0/3886974313 shutdown_connections 2024-05-14T15:06:18.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.733+0000 7ff5f8200700 1 -- 172.21.15.69:0/3886974313 wait complete. 2024-05-14T15:06:18.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.734+0000 7ff5f8200700 1 Processor -- start 2024-05-14T15:06:18.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.734+0000 7ff5f8200700 1 -- start start 2024-05-14T15:06:18.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.735+0000 7ff5f8200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5f0103df0 0x7ff5f01a16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:18.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.735+0000 7ff5f8200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff5f010df90 con 0x7ff5f0103df0 2024-05-14T15:06:18.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.735+0000 7ff5f5800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5f0103df0 0x7ff5f01a16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:18.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.735+0000 7ff5f5800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5f0103df0 0x7ff5f01a16b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51032/0 (socket says 172.21.15.69:51032) 2024-05-14T15:06:18.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.735+0000 7ff5f5800700 1 -- 172.21.15.69:0/3349448339 learned_addr learned my addr 172.21.15.69:0/3349448339 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:06:18.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.736+0000 7ff5f5800700 1 -- 172.21.15.69:0/3349448339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5f01a1bf0 con 0x7ff5f0103df0 2024-05-14T15:06:18.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.736+0000 7ff5f5800700 1 --2- 172.21.15.69:0/3349448339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5f0103df0 0x7ff5f01a16b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4006010 tx=0x7ff5e4005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:18.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.736+0000 7ff5ee000700 1 -- 172.21.15.69:0/3349448339 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5e4026070 con 0x7ff5f0103df0 2024-05-14T15:06:18.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.736+0000 7ff5ee000700 1 -- 172.21.15.69:0/3349448339 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff5e400b6f0 con 0x7ff5f0103df0 2024-05-14T15:06:18.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.736+0000 7ff5f8200700 1 -- 172.21.15.69:0/3349448339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5f01a1ee0 con 0x7ff5f0103df0 2024-05-14T15:06:18.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.736+0000 7ff5ee000700 1 -- 172.21.15.69:0/3349448339 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5e4003810 con 0x7ff5f0103df0 2024-05-14T15:06:18.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.736+0000 7ff5f8200700 1 -- 172.21.15.69:0/3349448339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5f019b8d0 con 0x7ff5f0103df0 2024-05-14T15:06:18.729 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:18 smithi069 ceph-mon[31270]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:18.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.738+0000 7ff5f8200700 1 -- 172.21.15.69:0/3349448339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5f01052a0 con 0x7ff5f0103df0 2024-05-14T15:06:18.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.738+0000 7ff5ee000700 1 -- 172.21.15.69:0/3349448339 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7ff5e4029070 con 0x7ff5f0103df0 2024-05-14T15:06:18.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.739+0000 7ff5ee000700 1 --2- 172.21.15.69:0/3349448339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff5d803e510 0x7ff5d8040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:18.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.739+0000 7ff5ee000700 1 -- 172.21.15.69:0/3349448339 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ff5e401e070 con 0x7ff5f0103df0 2024-05-14T15:06:18.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.739+0000 7ff5f4e00700 1 --2- 172.21.15.69:0/3349448339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff5d803e510 0x7ff5d8040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:18.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.740+0000 7ff5f4e00700 1 --2- 172.21.15.69:0/3349448339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff5d803e510 0x7ff5d8040a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc006fd0 tx=0x7ff5dc006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:18.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.744+0000 7ff5ee000700 1 -- 172.21.15.69:0/3349448339 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff5e4013070 con 0x7ff5f0103df0 2024-05-14T15:06:18.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:18.985+0000 7ff5f8200700 1 -- 172.21.15.69:0/3349448339 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi203", "target": ["mon-mgr", ""]}) -- 0x7ff5f019ce70 con 0x7ff5d803e510 2024-05-14T15:06:19.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:19 smithi069 ceph-mon[31270]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi203", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:06:20.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:20 smithi069 ceph-mon[31270]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:20.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:20 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:20.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:20 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:20.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:20 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:20.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:20 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:20.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:20 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:06:20.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:20 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:06:20.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:20 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:06:21.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:21 smithi069 ceph-mon[31270]: Deploying cephadm binary to smithi203 2024-05-14T15:06:21.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:21 smithi069 ceph-mon[31270]: Updating smithi092:/etc/ceph/ceph.conf 2024-05-14T15:06:22.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:22 smithi069 ceph-mon[31270]: Updating smithi092:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:06:22.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:22 smithi069 ceph-mon[31270]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:24.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:24 smithi069 ceph-mon[31270]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:25.141+0000 7ff5ee000700 1 -- 172.21.15.69:0/3349448339 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7ff5f019ce70 con 0x7ff5d803e510 2024-05-14T15:06:25.134 INFO:teuthology.orchestra.run.smithi069.stdout:Added host 'smithi203' with addr '172.21.15.203' 2024-05-14T15:06:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:25.145+0000 7ff5f8200700 1 -- 172.21.15.69:0/3349448339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff5d803e510 msgr2=0x7ff5d8040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:25.145+0000 7ff5f8200700 1 --2- 172.21.15.69:0/3349448339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff5d803e510 0x7ff5d8040a20 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ff5dc006fd0 tx=0x7ff5dc006e40 comp rx=0 tx=0).stop 2024-05-14T15:06:25.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:25.145+0000 7ff5f8200700 1 -- 172.21.15.69:0/3349448339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5f0103df0 msgr2=0x7ff5f01a16b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:25.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:25.145+0000 7ff5f8200700 1 --2- 172.21.15.69:0/3349448339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5f0103df0 0x7ff5f01a16b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7ff5e4006010 tx=0x7ff5e4005710 comp rx=0 tx=0).stop 2024-05-14T15:06:25.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:25.145+0000 7ff5f8200700 1 -- 172.21.15.69:0/3349448339 shutdown_connections 2024-05-14T15:06:25.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:25.145+0000 7ff5f8200700 1 --2- 172.21.15.69:0/3349448339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff5d803e510 0x7ff5d8040a20 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:25.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:25.145+0000 7ff5f8200700 1 --2- 172.21.15.69:0/3349448339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff5f0103df0 0x7ff5f01a16b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:25.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:25.145+0000 7ff5f8200700 1 -- 172.21.15.69:0/3349448339 >> 172.21.15.69:0/3349448339 conn(0x7ff5f00ff6a0 msgr2=0x7ff5f0075c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:25.145+0000 7ff5f8200700 1 -- 172.21.15.69:0/3349448339 shutdown_connections 2024-05-14T15:06:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:25.145+0000 7ff5f8200700 1 -- 172.21.15.69:0/3349448339 wait complete. 2024-05-14T15:06:25.874 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch host ls --format=json 2024-05-14T15:06:26.305 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:06:26.456 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:26 smithi069 ceph-mon[31270]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:06:26.456 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:26.456 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:26 smithi069 ceph-mon[31270]: Added host smithi203 2024-05-14T15:06:26.456 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:26.456 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:26.456 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:27.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:27 smithi069 ceph-mon[31270]: Updating smithi092:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T15:06:27.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:27 smithi069 ceph-mon[31270]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:27.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:27 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:06:28.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.552+0000 7f10b3e00700 1 -- 172.21.15.69:0/1243310885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10ac10a3d0 msgr2=0x7f10ac10a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:28.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.552+0000 7f10b3e00700 1 --2- 172.21.15.69:0/1243310885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10ac10a3d0 0x7f10ac10a7e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f10a0009910 tx=0x7f10a0009c20 comp rx=0 tx=0).stop 2024-05-14T15:06:28.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.553+0000 7f10b3e00700 1 -- 172.21.15.69:0/1243310885 shutdown_connections 2024-05-14T15:06:28.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.553+0000 7f10b3e00700 1 --2- 172.21.15.69:0/1243310885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10ac10a3d0 0x7f10ac10a7e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:28.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.553+0000 7f10b3e00700 1 -- 172.21.15.69:0/1243310885 >> 172.21.15.69:0/1243310885 conn(0x7f10ac0799f0 msgr2=0x7f10ac1085e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:28.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.553+0000 7f10b3e00700 1 -- 172.21.15.69:0/1243310885 shutdown_connections 2024-05-14T15:06:28.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.553+0000 7f10b3e00700 1 -- 172.21.15.69:0/1243310885 wait complete. 2024-05-14T15:06:28.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.554+0000 7f10b3e00700 1 Processor -- start 2024-05-14T15:06:28.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.554+0000 7f10b3e00700 1 -- start start 2024-05-14T15:06:28.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.554+0000 7f10b3e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10ac10a3d0 0x7f10ac19fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:28.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.554+0000 7f10b3e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f10ac114570 con 0x7f10ac10a3d0 2024-05-14T15:06:28.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.555+0000 7f10b1400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10ac10a3d0 0x7f10ac19fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:28.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.555+0000 7f10b1400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10ac10a3d0 0x7f10ac19fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59218/0 (socket says 172.21.15.69:59218) 2024-05-14T15:06:28.547 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.555+0000 7f10b1400700 1 -- 172.21.15.69:0/3349601296 learned_addr learned my addr 172.21.15.69:0/3349601296 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:06:28.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.555+0000 7f10b1400700 1 -- 172.21.15.69:0/3349601296 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10ac1a03a0 con 0x7f10ac10a3d0 2024-05-14T15:06:28.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.556+0000 7f10b1400700 1 --2- 172.21.15.69:0/3349601296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10ac10a3d0 0x7f10ac19fe60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f10a0005660 tx=0x7f10a0005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:28.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.556+0000 7f10aa000700 1 -- 172.21.15.69:0/3349601296 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10a0026070 con 0x7f10ac10a3d0 2024-05-14T15:06:28.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.556+0000 7f10aa000700 1 -- 172.21.15.69:0/3349601296 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f10a000b6f0 con 0x7f10ac10a3d0 2024-05-14T15:06:28.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.556+0000 7f10b3e00700 1 -- 172.21.15.69:0/3349601296 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10ac1a0690 con 0x7f10ac10a3d0 2024-05-14T15:06:28.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.556+0000 7f10aa000700 1 -- 172.21.15.69:0/3349601296 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10a00037b0 con 0x7f10ac10a3d0 2024-05-14T15:06:28.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.556+0000 7f10b3e00700 1 -- 172.21.15.69:0/3349601296 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10ac1a4690 con 0x7f10ac10a3d0 2024-05-14T15:06:28.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.557+0000 7f10b3e00700 1 -- 172.21.15.69:0/3349601296 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10ac10b880 con 0x7f10ac10a3d0 2024-05-14T15:06:28.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.557+0000 7f10aa000700 1 -- 172.21.15.69:0/3349601296 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f10a0029070 con 0x7f10ac10a3d0 2024-05-14T15:06:28.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.558+0000 7f10aa000700 1 --2- 172.21.15.69:0/3349601296 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f109403e570 0x7f1094040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:28.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.558+0000 7f10aa000700 1 -- 172.21.15.69:0/3349601296 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f10a001e070 con 0x7f10ac10a3d0 2024-05-14T15:06:28.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.558+0000 7f10b0a00700 1 --2- 172.21.15.69:0/3349601296 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f109403e570 0x7f1094040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:28.551 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.559+0000 7f10b0a00700 1 --2- 172.21.15.69:0/3349601296 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f109403e570 0x7f1094040a80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1098006fd0 tx=0x7f1098006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:28.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.564+0000 7f10aa000700 1 -- 172.21.15.69:0/3349601296 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f10a0013070 con 0x7f10ac10a3d0 2024-05-14T15:06:28.556 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:28 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:28.556 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:28 smithi069 ceph-mon[31270]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:28.556 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:28 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:28.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.805+0000 7f10b3e00700 1 -- 172.21.15.69:0/3349601296 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f10ac1a11c0 con 0x7f109403e570 2024-05-14T15:06:28.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.807+0000 7f10aa000700 1 -- 172.21.15.69:0/3349601296 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+239 (secure 0 0 0) 0x7f10ac1a11c0 con 0x7f109403e570 2024-05-14T15:06:28.799 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:06:28.799 INFO:teuthology.orchestra.run.smithi069.stdout:[{"addr": "172.21.15.69", "hostname": "smithi069", "labels": [], "status": ""}, {"addr": "172.21.15.92", "hostname": "smithi092", "labels": [], "status": ""}, {"addr": "172.21.15.203", "hostname": "smithi203", "labels": [], "status": ""}] 2024-05-14T15:06:28.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.810+0000 7f10b3e00700 1 -- 172.21.15.69:0/3349601296 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f109403e570 msgr2=0x7f1094040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:28.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.810+0000 7f10b3e00700 1 --2- 172.21.15.69:0/3349601296 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f109403e570 0x7f1094040a80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f1098006fd0 tx=0x7f1098006e40 comp rx=0 tx=0).stop 2024-05-14T15:06:28.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.810+0000 7f10b3e00700 1 -- 172.21.15.69:0/3349601296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10ac10a3d0 msgr2=0x7f10ac19fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:28.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.810+0000 7f10b3e00700 1 --2- 172.21.15.69:0/3349601296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10ac10a3d0 0x7f10ac19fe60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f10a0005660 tx=0x7f10a0005740 comp rx=0 tx=0).stop 2024-05-14T15:06:28.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.810+0000 7f10b3e00700 1 -- 172.21.15.69:0/3349601296 shutdown_connections 2024-05-14T15:06:28.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.810+0000 7f10b3e00700 1 --2- 172.21.15.69:0/3349601296 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f109403e570 0x7f1094040a80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:28.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.810+0000 7f10b3e00700 1 --2- 172.21.15.69:0/3349601296 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f10ac10a3d0 0x7f10ac19fe60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:28.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.810+0000 7f10b3e00700 1 -- 172.21.15.69:0/3349601296 >> 172.21.15.69:0/3349601296 conn(0x7f10ac0799f0 msgr2=0x7f10ac10bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:28.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.810+0000 7f10b3e00700 1 -- 172.21.15.69:0/3349601296 shutdown_connections 2024-05-14T15:06:28.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:28.810+0000 7f10b3e00700 1 -- 172.21.15.69:0/3349601296 wait complete. 2024-05-14T15:06:29.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:29 smithi069 ceph-mon[31270]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:06:29.638 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-14T15:06:29.638 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd crush tunables default 2024-05-14T15:06:30.071 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:06:30.487 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:30 smithi069 ceph-mon[31270]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:30.488 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:30 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:32.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.307+0000 7f5cb2a00700 1 -- 172.21.15.69:0/2309501598 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5cac105fe0 msgr2=0x7f5cac1063f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:32.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.307+0000 7f5cb2a00700 1 --2- 172.21.15.69:0/2309501598 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5cac105fe0 0x7f5cac1063f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009910 tx=0x7f5c9c009c20 comp rx=0 tx=0).stop 2024-05-14T15:06:32.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.307+0000 7f5cb2a00700 1 -- 172.21.15.69:0/2309501598 shutdown_connections 2024-05-14T15:06:32.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.307+0000 7f5cb2a00700 1 --2- 172.21.15.69:0/2309501598 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5cac105fe0 0x7f5cac1063f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:32.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.307+0000 7f5cb2a00700 1 -- 172.21.15.69:0/2309501598 >> 172.21.15.69:0/2309501598 conn(0x7f5cac101890 msgr2=0x7f5cac103ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:32.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.308+0000 7f5cb2a00700 1 -- 172.21.15.69:0/2309501598 shutdown_connections 2024-05-14T15:06:32.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.308+0000 7f5cb2a00700 1 -- 172.21.15.69:0/2309501598 wait complete. 2024-05-14T15:06:32.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.309+0000 7f5cb2a00700 1 Processor -- start 2024-05-14T15:06:32.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.309+0000 7f5cb2a00700 1 -- start start 2024-05-14T15:06:32.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.310+0000 7f5cb2a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5cac105fe0 0x7f5cac1a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:32.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.310+0000 7f5cb2a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5cac110180 con 0x7f5cac105fe0 2024-05-14T15:06:32.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.310+0000 7f5cabe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5cac105fe0 0x7f5cac1a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:32.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.310+0000 7f5cabe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5cac105fe0 0x7f5cac1a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59240/0 (socket says 172.21.15.69:59240) 2024-05-14T15:06:32.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.310+0000 7f5cabe00700 1 -- 172.21.15.69:0/1621512424 learned_addr learned my addr 172.21.15.69:0/1621512424 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:06:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.310+0000 7f5cabe00700 1 -- 172.21.15.69:0/1621512424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cac1a1c50 con 0x7f5cac105fe0 2024-05-14T15:06:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.311+0000 7f5cabe00700 1 --2- 172.21.15.69:0/1621512424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5cac105fe0 0x7f5cac1a1710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c005660 tx=0x7f5c9c005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.311+0000 7f5ca8c00700 1 -- 172.21.15.69:0/1621512424 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c9c026070 con 0x7f5cac105fe0 2024-05-14T15:06:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.311+0000 7f5ca8c00700 1 -- 172.21.15.69:0/1621512424 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5c9c00b6f0 con 0x7f5cac105fe0 2024-05-14T15:06:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.311+0000 7f5cb2a00700 1 -- 172.21.15.69:0/1621512424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cac1a1f40 con 0x7f5cac105fe0 2024-05-14T15:06:32.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.311+0000 7f5ca8c00700 1 -- 172.21.15.69:0/1621512424 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c9c0037b0 con 0x7f5cac105fe0 2024-05-14T15:06:32.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.312+0000 7f5cb2a00700 1 -- 172.21.15.69:0/1621512424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cac19b930 con 0x7f5cac105fe0 2024-05-14T15:06:32.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.313+0000 7f5ca8c00700 1 -- 172.21.15.69:0/1621512424 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f5c9c029070 con 0x7f5cac105fe0 2024-05-14T15:06:32.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.313+0000 7f5cb2a00700 1 -- 172.21.15.69:0/1621512424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cac107490 con 0x7f5cac105fe0 2024-05-14T15:06:32.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.313+0000 7f5ca8c00700 1 --2- 172.21.15.69:0/1621512424 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5c9003e510 0x7f5c90040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:32.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.313+0000 7f5ca8c00700 1 -- 172.21.15.69:0/1621512424 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f5c9c059060 con 0x7f5cac105fe0 2024-05-14T15:06:32.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.314+0000 7f5cab400700 1 --2- 172.21.15.69:0/1621512424 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5c9003e510 0x7f5c90040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:32.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.314+0000 7f5cab400700 1 --2- 172.21.15.69:0/1621512424 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5c9003e510 0x7f5c90040a20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5c94006fd0 tx=0x7f5c94006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:32.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.320+0000 7f5ca8c00700 1 -- 172.21.15.69:0/1621512424 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5c9c013070 con 0x7f5cac105fe0 2024-05-14T15:06:32.550 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:32.558+0000 7f5cb2a00700 1 -- 172.21.15.69:0/1621512424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f5cac19ce60 con 0x7f5cac105fe0 2024-05-14T15:06:32.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:32 smithi069 ceph-mon[31270]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:33.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:33.468+0000 7f5ca8c00700 1 -- 172.21.15.69:0/1621512424 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f5c9c0142b0 con 0x7f5cac105fe0 2024-05-14T15:06:33.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:33.473+0000 7f5cb2a00700 1 -- 172.21.15.69:0/1621512424 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5c9003e510 msgr2=0x7f5c90040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:33.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:33.473+0000 7f5cb2a00700 1 --2- 172.21.15.69:0/1621512424 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5c9003e510 0x7f5c90040a20 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5c94006fd0 tx=0x7f5c94006e40 comp rx=0 tx=0).stop 2024-05-14T15:06:33.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:33.473+0000 7f5cb2a00700 1 -- 172.21.15.69:0/1621512424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5cac105fe0 msgr2=0x7f5cac1a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:33.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:33.473+0000 7f5cb2a00700 1 --2- 172.21.15.69:0/1621512424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5cac105fe0 0x7f5cac1a1710 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c005660 tx=0x7f5c9c005740 comp rx=0 tx=0).stop 2024-05-14T15:06:33.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:33.473+0000 7f5cb2a00700 1 -- 172.21.15.69:0/1621512424 shutdown_connections 2024-05-14T15:06:33.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:33.473+0000 7f5cb2a00700 1 --2- 172.21.15.69:0/1621512424 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5c9003e510 0x7f5c90040a20 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:33.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:33.473+0000 7f5cb2a00700 1 --2- 172.21.15.69:0/1621512424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5cac105fe0 0x7f5cac1a1710 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:33.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:33.473+0000 7f5cb2a00700 1 -- 172.21.15.69:0/1621512424 >> 172.21.15.69:0/1621512424 conn(0x7f5cac101890 msgr2=0x7f5cac10bb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:33.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:33.473+0000 7f5cb2a00700 1 -- 172.21.15.69:0/1621512424 shutdown_connections 2024-05-14T15:06:33.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:06:33.473+0000 7f5cb2a00700 1 -- 172.21.15.69:0/1621512424 wait complete. 2024-05-14T15:06:33.467 INFO:teuthology.orchestra.run.smithi069.stderr:adjusted tunables profile to default 2024-05-14T15:06:33.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:33 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1621512424' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-14T15:06:34.234 INFO:tasks.cephadm:Adding mon.a on smithi069 2024-05-14T15:06:34.234 INFO:tasks.cephadm:Adding mon.b on smithi092 2024-05-14T15:06:34.234 INFO:tasks.cephadm:Adding mon.c on smithi203 2024-05-14T15:06:34.235 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch apply mon '3;smithi069:172.21.15.69=a;smithi092:172.21.15.92=b;smithi203:172.21.15.203=c' 2024-05-14T15:06:34.714 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:34 smithi069 ceph-mon[31270]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:34.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:34 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1621512424' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-14T15:06:34.715 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:34 smithi069 ceph-mon[31270]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T15:06:35.425 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-14T15:06:35.524 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /etc/ceph/ceph.conf 2024-05-14T15:06:36.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:36 smithi069 ceph-mon[31270]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:36.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:36 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:36.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:36 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:36.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:36 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:36.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:36 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:36.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:36 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi203", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:06:36.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:36 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:06:36.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:36 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:06:36.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:36 smithi069 ceph-mon[31270]: Updating smithi203:/etc/ceph/ceph.conf 2024-05-14T15:06:36.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:36 smithi069 ceph-mon[31270]: Updating smithi203:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:06:37.740 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.746+0000 7fa0eec00700 1 -- 172.21.15.203:0/1590763682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0e8075bb0 msgr2=0x7fa0e8075fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:37.740 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.746+0000 7fa0eec00700 1 --2- 172.21.15.203:0/1590763682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0e8075bb0 0x7fa0e8075fc0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc009910 tx=0x7fa0dc009c20 comp rx=0 tx=0).stop 2024-05-14T15:06:37.740 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.746+0000 7fa0eec00700 1 -- 172.21.15.203:0/1590763682 shutdown_connections 2024-05-14T15:06:37.740 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.746+0000 7fa0eec00700 1 --2- 172.21.15.203:0/1590763682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0e8075bb0 0x7fa0e8075fc0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:37.740 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.747+0000 7fa0eec00700 1 -- 172.21.15.203:0/1590763682 >> 172.21.15.203:0/1590763682 conn(0x7fa0e80ff050 msgr2=0x7fa0e8101500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:37.740 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.747+0000 7fa0eec00700 1 -- 172.21.15.203:0/1590763682 shutdown_connections 2024-05-14T15:06:37.740 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.747+0000 7fa0eec00700 1 -- 172.21.15.203:0/1590763682 wait complete. 2024-05-14T15:06:37.741 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.748+0000 7fa0eec00700 1 Processor -- start 2024-05-14T15:06:37.741 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.749+0000 7fa0eec00700 1 -- start start 2024-05-14T15:06:37.741 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.749+0000 7fa0eec00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0e8075bb0 0x7fa0e819b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:37.742 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.749+0000 7fa0eec00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa0e810bb90 con 0x7fa0e8075bb0 2024-05-14T15:06:37.742 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.750+0000 7fa0ed800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0e8075bb0 0x7fa0e819b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:37.742 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.750+0000 7fa0ed800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0e8075bb0 0x7fa0e819b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.203:57200/0 (socket says 172.21.15.203:57200) 2024-05-14T15:06:37.742 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.750+0000 7fa0ed800700 1 -- 172.21.15.203:0/938851280 learned_addr learned my addr 172.21.15.203:0/938851280 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-05-14T15:06:37.743 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.750+0000 7fa0ed800700 1 -- 172.21.15.203:0/938851280 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0e819bce0 con 0x7fa0e8075bb0 2024-05-14T15:06:37.743 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.751+0000 7fa0ed800700 1 --2- 172.21.15.203:0/938851280 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0e8075bb0 0x7fa0e819b7a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc005120 tx=0x7fa0dc005810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:37.744 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.751+0000 7fa0e6000700 1 -- 172.21.15.203:0/938851280 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc027070 con 0x7fa0e8075bb0 2024-05-14T15:06:37.744 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.751+0000 7fa0eec00700 1 -- 172.21.15.203:0/938851280 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0e819bf70 con 0x7fa0e8075bb0 2024-05-14T15:06:37.744 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.751+0000 7fa0e6000700 1 -- 172.21.15.203:0/938851280 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa0dc00bdf0 con 0x7fa0e8075bb0 2024-05-14T15:06:37.744 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.751+0000 7fa0e6000700 1 -- 172.21.15.203:0/938851280 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa0dc00fd70 con 0x7fa0e8075bb0 2024-05-14T15:06:37.744 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.751+0000 7fa0eec00700 1 -- 172.21.15.203:0/938851280 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0e819eb80 con 0x7fa0e8075bb0 2024-05-14T15:06:37.745 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.752+0000 7fa0eec00700 1 -- 172.21.15.203:0/938851280 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0e81949e0 con 0x7fa0e8075bb0 2024-05-14T15:06:37.746 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.754+0000 7fa0e6000700 1 -- 172.21.15.203:0/938851280 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fa0dc02a070 con 0x7fa0e8075bb0 2024-05-14T15:06:37.747 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.754+0000 7fa0e6000700 1 --2- 172.21.15.203:0/938851280 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa0d003e510 0x7fa0d0040a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:37.747 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.754+0000 7fa0e6000700 1 -- 172.21.15.203:0/938851280 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa0dc0539e0 con 0x7fa0e8075bb0 2024-05-14T15:06:37.747 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.755+0000 7fa0ece00700 1 --2- 172.21.15.203:0/938851280 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa0d003e510 0x7fa0d0040a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:37.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.756+0000 7fa0ece00700 1 --2- 172.21.15.203:0/938851280 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa0d003e510 0x7fa0d0040a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4006fd0 tx=0x7fa0d4006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:37.764 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:37.772+0000 7fa0e6000700 1 -- 172.21.15.203:0/938851280 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa0dc013070 con 0x7fa0e8075bb0 2024-05-14T15:06:37.964 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:37 smithi069 ceph-mon[31270]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:06:38.016 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:38.023+0000 7fa0eec00700 1 -- 172.21.15.203:0/938851280 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi069:172.21.15.69=a;smithi092:172.21.15.92=b;smithi203:172.21.15.203=c", "target": ["mon-mgr", ""]}) -- 0x7fa0e8063cc0 con 0x7fa0d003e510 2024-05-14T15:06:38.033 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:38.040+0000 7fa0e6000700 1 -- 172.21.15.203:0/938851280 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fa0e8063cc0 con 0x7fa0d003e510 2024-05-14T15:06:38.033 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mon update... 2024-05-14T15:06:38.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:38.043+0000 7fa0eec00700 1 -- 172.21.15.203:0/938851280 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa0d003e510 msgr2=0x7fa0d0040a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:38.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:38.043+0000 7fa0eec00700 1 --2- 172.21.15.203:0/938851280 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa0d003e510 0x7fa0d0040a20 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fa0d4006fd0 tx=0x7fa0d4006e40 comp rx=0 tx=0).stop 2024-05-14T15:06:38.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:38.043+0000 7fa0eec00700 1 -- 172.21.15.203:0/938851280 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0e8075bb0 msgr2=0x7fa0e819b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:38.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:38.043+0000 7fa0eec00700 1 --2- 172.21.15.203:0/938851280 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0e8075bb0 0x7fa0e819b7a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa0dc005120 tx=0x7fa0dc005810 comp rx=0 tx=0).stop 2024-05-14T15:06:38.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:38.043+0000 7fa0eec00700 1 -- 172.21.15.203:0/938851280 shutdown_connections 2024-05-14T15:06:38.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:38.043+0000 7fa0eec00700 1 --2- 172.21.15.203:0/938851280 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa0d003e510 0x7fa0d0040a20 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:38.036 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:38.043+0000 7fa0eec00700 1 --2- 172.21.15.203:0/938851280 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa0e8075bb0 0x7fa0e819b7a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:38.037 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:38.043+0000 7fa0eec00700 1 -- 172.21.15.203:0/938851280 >> 172.21.15.203:0/938851280 conn(0x7fa0e80ff050 msgr2=0x7fa0e80ffd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:38.037 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:38.043+0000 7fa0eec00700 1 -- 172.21.15.203:0/938851280 shutdown_connections 2024-05-14T15:06:38.037 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:38.043+0000 7fa0eec00700 1 -- 172.21.15.203:0/938851280 wait complete. 2024-05-14T15:06:38.823 DEBUG:teuthology.orchestra.run.smithi092:mon.b> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mon.b.service 2024-05-14T15:06:38.831 DEBUG:teuthology.orchestra.run.smithi203:mon.c> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mon.c.service 2024-05-14T15:06:38.836 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-14T15:06:38.836 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-14T15:06:39.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:39 smithi069 ceph-mon[31270]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:39.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:39 smithi069 ceph-mon[31270]: Updating smithi203:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T15:06:39.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:39 smithi069 ceph-mon[31270]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi069:172.21.15.69=a;smithi092:172.21.15.92=b;smithi203:172.21.15.203=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:06:39.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:39 smithi069 ceph-mon[31270]: Saving service mon spec with placement smithi069:172.21.15.69=a;smithi092:172.21.15.92=b;smithi203:172.21.15.203=c;count:3 2024-05-14T15:06:39.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:39 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:39.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:39 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:39.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:39 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:39.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:39 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:39.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:39 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T15:06:39.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:39 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:06:40.393 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:06:40.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:40 smithi069 ceph-mon[31270]: Deploying daemon mon.c on smithi203 2024-05-14T15:06:41.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:41 smithi069 ceph-mon[31270]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:43.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:43 smithi069 ceph-mon[31270]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:43.748 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.755+0000 7f2892e00700 1 -- 172.21.15.203:0/1392308047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f288c103df0 msgr2=0x7f288c104200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:43.748 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.755+0000 7f2892e00700 1 --2- 172.21.15.203:0/1392308047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f288c103df0 0x7f288c104200 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f287c009910 tx=0x7f287c009c20 comp rx=0 tx=0).stop 2024-05-14T15:06:43.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.755+0000 7f2892e00700 1 -- 172.21.15.203:0/1392308047 shutdown_connections 2024-05-14T15:06:43.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.755+0000 7f2892e00700 1 --2- 172.21.15.203:0/1392308047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f288c103df0 0x7f288c104200 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:43.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.755+0000 7f2892e00700 1 -- 172.21.15.203:0/1392308047 >> 172.21.15.203:0/1392308047 conn(0x7f288c0ff6a0 msgr2=0x7f288c101af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:43.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.755+0000 7f2892e00700 1 -- 172.21.15.203:0/1392308047 shutdown_connections 2024-05-14T15:06:43.749 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.755+0000 7f2892e00700 1 -- 172.21.15.203:0/1392308047 wait complete. 2024-05-14T15:06:43.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.756+0000 7f2892e00700 1 Processor -- start 2024-05-14T15:06:43.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.757+0000 7f2892e00700 1 -- start start 2024-05-14T15:06:43.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.757+0000 7f2892e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f288c103df0 0x7f288c075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:43.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.757+0000 7f2892e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f288c10df90 con 0x7f288c103df0 2024-05-14T15:06:43.750 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.758+0000 7f288be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f288c103df0 0x7f288c075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:43.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.758+0000 7f288be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f288c103df0 0x7f288c075ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.203:54618/0 (socket says 172.21.15.203:54618) 2024-05-14T15:06:43.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.758+0000 7f288be00700 1 -- 172.21.15.203:0/4111444488 learned_addr learned my addr 172.21.15.203:0/4111444488 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-05-14T15:06:43.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.758+0000 7f288be00700 1 -- 172.21.15.203:0/4111444488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f288c077910 con 0x7f288c103df0 2024-05-14T15:06:43.751 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.759+0000 7f288be00700 1 --2- 172.21.15.203:0/4111444488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f288c103df0 0x7f288c075ac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f287c006010 tx=0x7f287c005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:43.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.759+0000 7f2888c00700 1 -- 172.21.15.203:0/4111444488 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f287c026070 con 0x7f288c103df0 2024-05-14T15:06:43.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.759+0000 7f2892e00700 1 -- 172.21.15.203:0/4111444488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f288c076000 con 0x7f288c103df0 2024-05-14T15:06:43.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.759+0000 7f2888c00700 1 -- 172.21.15.203:0/4111444488 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f287c00b6f0 con 0x7f288c103df0 2024-05-14T15:06:43.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.759+0000 7f2888c00700 1 -- 172.21.15.203:0/4111444488 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f287c003810 con 0x7f288c103df0 2024-05-14T15:06:43.752 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.760+0000 7f2892e00700 1 -- 172.21.15.203:0/4111444488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f288c0764c0 con 0x7f288c103df0 2024-05-14T15:06:43.753 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.760+0000 7f2892e00700 1 -- 172.21.15.203:0/4111444488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f288c1052a0 con 0x7f288c103df0 2024-05-14T15:06:43.754 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.761+0000 7f2888c00700 1 -- 172.21.15.203:0/4111444488 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f287c029070 con 0x7f288c103df0 2024-05-14T15:06:43.754 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.762+0000 7f2888c00700 1 --2- 172.21.15.203:0/4111444488 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f287003e570 0x7f2870040a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:43.754 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.762+0000 7f2888c00700 1 -- 172.21.15.203:0/4111444488 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f287c01e070 con 0x7f288c103df0 2024-05-14T15:06:43.755 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.762+0000 7f288b400700 1 --2- 172.21.15.203:0/4111444488 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f287003e570 0x7f2870040a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:43.756 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.763+0000 7f288b400700 1 --2- 172.21.15.203:0/4111444488 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f287003e570 0x7f2870040a80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2878006fd0 tx=0x7f2878006e40 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:43.771 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:43.778+0000 7f2888c00700 1 -- 172.21.15.203:0/4111444488 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f287c013070 con 0x7f288c103df0 2024-05-14T15:06:44.127 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:44.134+0000 7f2892e00700 1 -- 172.21.15.203:0/4111444488 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f288c077020 con 0x7f288c103df0 2024-05-14T15:06:44.128 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:44.135+0000 7f2888c00700 1 -- 172.21.15.203:0/4111444488 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f287c020370 con 0x7f288c103df0 2024-05-14T15:06:44.128 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:06:44.128 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":1,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","modified":"2024-05-14T15:04:26.570547Z","created":"2024-05-14T15:04:26.570547Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3300","nonce":0},{"type":"v1","addr":"172.21.15.69:6789","nonce":0}]},"addr":"172.21.15.69:6789/0","public_addr":"172.21.15.69:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-14T15:06:44.131 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:44.138+0000 7f2892e00700 1 -- 172.21.15.203:0/4111444488 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f287003e570 msgr2=0x7f2870040a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:44.131 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:44.138+0000 7f2892e00700 1 --2- 172.21.15.203:0/4111444488 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f287003e570 0x7f2870040a80 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2878006fd0 tx=0x7f2878006e40 comp rx=0 tx=0).stop 2024-05-14T15:06:44.131 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:44.138+0000 7f2892e00700 1 -- 172.21.15.203:0/4111444488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f288c103df0 msgr2=0x7f288c075ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:44.131 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:44.138+0000 7f2892e00700 1 --2- 172.21.15.203:0/4111444488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f288c103df0 0x7f288c075ac0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f287c006010 tx=0x7f287c005710 comp rx=0 tx=0).stop 2024-05-14T15:06:44.132 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:44.138+0000 7f2892e00700 1 -- 172.21.15.203:0/4111444488 shutdown_connections 2024-05-14T15:06:44.132 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:44.138+0000 7f2892e00700 1 --2- 172.21.15.203:0/4111444488 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f287003e570 0x7f2870040a80 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:44.132 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:44.138+0000 7f2892e00700 1 --2- 172.21.15.203:0/4111444488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f288c103df0 0x7f288c075ac0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:44.132 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:44.138+0000 7f2892e00700 1 -- 172.21.15.203:0/4111444488 >> 172.21.15.203:0/4111444488 conn(0x7f288c0ff6a0 msgr2=0x7f288c101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:44.132 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:44.138+0000 7f2892e00700 1 -- 172.21.15.203:0/4111444488 shutdown_connections 2024-05-14T15:06:44.132 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:44.138+0000 7f2892e00700 1 -- 172.21.15.203:0/4111444488 wait complete. 2024-05-14T15:06:44.132 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 1 2024-05-14T15:06:44.586 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:44 smithi203 systemd[1]: Starting Ceph mon.c for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:06:45.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:45 smithi069 ceph-mon[31270]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:45.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:45 smithi069 ceph-mon[31270]: from='client.? 172.21.15.203:0/4111444488' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T15:06:45.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 podman[34549]: 2024-05-14 15:06:45.247178539 +0000 UTC m=+0.034544791 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:06:45.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 podman[34549]: 2024-05-14 15:06:45.4590285 +0000 UTC m=+0.246394776 container create d39800e8b6ba3b1203c6bec0cb4fa50fa424ca7396112af5adec02e5849ecf58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-c, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux ) 2024-05-14T15:06:46.047 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-14T15:06:46.048 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-14T15:06:46.086 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 podman[34549]: 2024-05-14 15:06:45.712663181 +0000 UTC m=+0.500029500 container init d39800e8b6ba3b1203c6bec0cb4fa50fa424ca7396112af5adec02e5849ecf58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-c, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507) 2024-05-14T15:06:46.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 podman[34549]: 2024-05-14 15:06:45.725023409 +0000 UTC m=+0.512389691 container start d39800e8b6ba3b1203c6bec0cb4fa50fa424ca7396112af5adec02e5849ecf58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-c, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T15:06:46.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: set uid:gid to 167:167 (ceph:ceph) 2024-05-14T15:06:46.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev), process ceph-mon, pid 2 2024-05-14T15:06:46.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pidfile_write: ignore empty --pid-file 2024-05-14T15:06:46.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: load: jerasure load: lrc 2024-05-14T15:06:46.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: RocksDB version: 7.9.2 2024-05-14T15:06:46.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 bash[34549]: d39800e8b6ba3b1203c6bec0cb4fa50fa424ca7396112af5adec02e5849ecf58 2024-05-14T15:06:46.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Git sha 0 2024-05-14T15:06:46.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Compile date 2024-05-09 05:50:40 2024-05-14T15:06:46.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: DB SUMMARY 2024-05-14T15:06:46.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: DB Session ID: IMAVLDXIKTI5YDP2GD2Q 2024-05-14T15:06:46.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: CURRENT file: CURRENT 2024-05-14T15:06:46.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: IDENTITY file: IDENTITY 2024-05-14T15:06:46.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-14T15:06:46.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-05-14T15:06:46.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-05-14T15:06:46.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.error_if_exists: 0 2024-05-14T15:06:46.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.create_if_missing: 0 2024-05-14T15:06:46.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.paranoid_checks: 1 2024-05-14T15:06:46.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-14T15:06:46.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-14T15:06:46.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-14T15:06:46.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.env: 0x559d02c67500 2024-05-14T15:06:46.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.fs: PosixFileSystem 2024-05-14T15:06:46.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.info_log: 0x559d045f0060 2024-05-14T15:06:46.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_file_opening_threads: 16 2024-05-14T15:06:46.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.statistics: (nil) 2024-05-14T15:06:46.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.use_fsync: 0 2024-05-14T15:06:46.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_log_file_size: 0 2024-05-14T15:06:46.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-14T15:06:46.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-14T15:06:46.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.keep_log_file_num: 1000 2024-05-14T15:06:46.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.recycle_log_file_num: 0 2024-05-14T15:06:46.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.allow_fallocate: 1 2024-05-14T15:06:46.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.allow_mmap_reads: 0 2024-05-14T15:06:46.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.allow_mmap_writes: 0 2024-05-14T15:06:46.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.use_direct_reads: 0 2024-05-14T15:06:46.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-14T15:06:46.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.create_missing_column_families: 0 2024-05-14T15:06:46.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.db_log_dir: 2024-05-14T15:06:46.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.wal_dir: 2024-05-14T15:06:46.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-14T15:06:46.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-14T15:06:46.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-14T15:06:46.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-14T15:06:46.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-14T15:06:46.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-14T15:06:46.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.advise_random_on_open: 1 2024-05-14T15:06:46.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.db_write_buffer_size: 0 2024-05-14T15:06:46.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.write_buffer_manager: 0x559d044ba8c0 2024-05-14T15:06:46.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-14T15:06:46.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-14T15:06:46.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-14T15:06:46.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.rate_limiter: (nil) 2024-05-14T15:06:46.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-14T15:06:46.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.wal_recovery_mode: 2 2024-05-14T15:06:46.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.enable_thread_tracking: 0 2024-05-14T15:06:46.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.enable_pipelined_write: 0 2024-05-14T15:06:46.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.unordered_write: 0 2024-05-14T15:06:46.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-14T15:06:46.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-14T15:06:46.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-14T15:06:46.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-14T15:06:46.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.row_cache: None 2024-05-14T15:06:46.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.wal_filter: None 2024-05-14T15:06:46.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-14T15:06:46.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.allow_ingest_behind: 0 2024-05-14T15:06:46.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.two_write_queues: 0 2024-05-14T15:06:46.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.manual_wal_flush: 0 2024-05-14T15:06:46.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.wal_compression: 0 2024-05-14T15:06:46.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.atomic_flush: 0 2024-05-14T15:06:46.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-14T15:06:46.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-14T15:06:46.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-14T15:06:46.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.log_readahead_size: 0 2024-05-14T15:06:46.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-14T15:06:46.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.best_efforts_recovery: 0 2024-05-14T15:06:46.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-14T15:06:46.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-14T15:06:46.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.allow_data_in_errors: 0 2024-05-14T15:06:46.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.db_host_id: __hostname__ 2024-05-14T15:06:46.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-14T15:06:46.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_background_jobs: 2 2024-05-14T15:06:46.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_background_compactions: -1 2024-05-14T15:06:46.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_subcompactions: 1 2024-05-14T15:06:46.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-14T15:06:46.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-14T15:06:46.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-14T15:06:46.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_total_wal_size: 0 2024-05-14T15:06:46.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-14T15:06:46.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-14T15:06:46.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-14T15:06:46.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-14T15:06:46.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_open_files: -1 2024-05-14T15:06:46.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.bytes_per_sync: 0 2024-05-14T15:06:46.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-14T15:06:46.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-14T15:06:46.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compaction_readahead_size: 0 2024-05-14T15:06:46.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_background_flushes: -1 2024-05-14T15:06:46.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Compression algorithms supported: 2024-05-14T15:06:46.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-14T15:06:46.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: kZSTD supported: 0 2024-05-14T15:06:46.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: kXpressCompression supported: 0 2024-05-14T15:06:46.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: kLZ4HCCompression supported: 1 2024-05-14T15:06:46.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: kZlibCompression supported: 1 2024-05-14T15:06:46.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: kSnappyCompression supported: 1 2024-05-14T15:06:46.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: kLZ4Compression supported: 1 2024-05-14T15:06:46.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: kBZip2Compression supported: 0 2024-05-14T15:06:46.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-14T15:06:46.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-14T15:06:46.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-05-14T15:06:46.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-14T15:06:46.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-14T15:06:46.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.merge_operator: 2024-05-14T15:06:46.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compaction_filter: None 2024-05-14T15:06:46.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compaction_filter_factory: None 2024-05-14T15:06:46.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.sst_partitioner_factory: None 2024-05-14T15:06:46.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-14T15:06:46.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-14T15:06:46.098 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x559d045f0220) 2024-05-14T15:06:46.098 INFO:journalctl@ceph.mon.c.smithi203.stdout: cache_index_and_filter_blocks: 1 2024-05-14T15:06:46.098 INFO:journalctl@ceph.mon.c.smithi203.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-14T15:06:46.098 INFO:journalctl@ceph.mon.c.smithi203.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-14T15:06:46.098 INFO:journalctl@ceph.mon.c.smithi203.stdout: pin_top_level_index_and_filter: 1 2024-05-14T15:06:46.098 INFO:journalctl@ceph.mon.c.smithi203.stdout: index_type: 0 2024-05-14T15:06:46.098 INFO:journalctl@ceph.mon.c.smithi203.stdout: data_block_index_type: 0 2024-05-14T15:06:46.098 INFO:journalctl@ceph.mon.c.smithi203.stdout: index_shortening: 1 2024-05-14T15:06:46.098 INFO:journalctl@ceph.mon.c.smithi203.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-14T15:06:46.098 INFO:journalctl@ceph.mon.c.smithi203.stdout: checksum: 4 2024-05-14T15:06:46.098 INFO:journalctl@ceph.mon.c.smithi203.stdout: no_block_cache: 0 2024-05-14T15:06:46.098 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_cache: 0x559d044ed1f0 2024-05-14T15:06:46.098 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_cache_name: BinnedLRUCache 2024-05-14T15:06:46.098 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_cache_options: 2024-05-14T15:06:46.099 INFO:journalctl@ceph.mon.c.smithi203.stdout: capacity : 536870912 2024-05-14T15:06:46.099 INFO:journalctl@ceph.mon.c.smithi203.stdout: num_shard_bits : 4 2024-05-14T15:06:46.099 INFO:journalctl@ceph.mon.c.smithi203.stdout: strict_capacity_limit : 0 2024-05-14T15:06:46.099 INFO:journalctl@ceph.mon.c.smithi203.stdout: high_pri_pool_ratio: 0.000 2024-05-14T15:06:46.099 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_cache_compressed: (nil) 2024-05-14T15:06:46.099 INFO:journalctl@ceph.mon.c.smithi203.stdout: persistent_cache: (nil) 2024-05-14T15:06:46.099 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_size: 4096 2024-05-14T15:06:46.099 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_size_deviation: 10 2024-05-14T15:06:46.099 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_restart_interval: 16 2024-05-14T15:06:46.099 INFO:journalctl@ceph.mon.c.smithi203.stdout: index_block_restart_interval: 1 2024-05-14T15:06:46.099 INFO:journalctl@ceph.mon.c.smithi203.stdout: metadata_block_size: 4096 2024-05-14T15:06:46.099 INFO:journalctl@ceph.mon.c.smithi203.stdout: partition_filters: 0 2024-05-14T15:06:46.099 INFO:journalctl@ceph.mon.c.smithi203.stdout: use_delta_encoding: 1 2024-05-14T15:06:46.099 INFO:journalctl@ceph.mon.c.smithi203.stdout: filter_policy: bloomfilter 2024-05-14T15:06:46.099 INFO:journalctl@ceph.mon.c.smithi203.stdout: whole_key_filtering: 1 2024-05-14T15:06:46.099 INFO:journalctl@ceph.mon.c.smithi203.stdout: verify_compression: 0 2024-05-14T15:06:46.100 INFO:journalctl@ceph.mon.c.smithi203.stdout: read_amp_bytes_per_bit: 0 2024-05-14T15:06:46.100 INFO:journalctl@ceph.mon.c.smithi203.stdout: format_version: 5 2024-05-14T15:06:46.100 INFO:journalctl@ceph.mon.c.smithi203.stdout: enable_index_compression: 1 2024-05-14T15:06:46.100 INFO:journalctl@ceph.mon.c.smithi203.stdout: block_align: 0 2024-05-14T15:06:46.100 INFO:journalctl@ceph.mon.c.smithi203.stdout: max_auto_readahead_size: 262144 2024-05-14T15:06:46.100 INFO:journalctl@ceph.mon.c.smithi203.stdout: prepopulate_block_cache: 0 2024-05-14T15:06:46.100 INFO:journalctl@ceph.mon.c.smithi203.stdout: initial_auto_readahead_size: 8192 2024-05-14T15:06:46.100 INFO:journalctl@ceph.mon.c.smithi203.stdout: num_file_reads_for_auto_readahead: 2 2024-05-14T15:06:46.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.write_buffer_size: 33554432 2024-05-14T15:06:46.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_write_buffer_number: 2 2024-05-14T15:06:46.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compression: NoCompression 2024-05-14T15:06:46.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.bottommost_compression: Disabled 2024-05-14T15:06:46.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.prefix_extractor: nullptr 2024-05-14T15:06:46.100 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-14T15:06:46.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.num_levels: 7 2024-05-14T15:06:46.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-14T15:06:46.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-14T15:06:46.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-14T15:06:46.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-14T15:06:46.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-14T15:06:46.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-14T15:06:46.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-14T15:06:46.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-14T15:06:46.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-14T15:06:46.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-14T15:06:46.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-14T15:06:46.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-14T15:06:46.101 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-14T15:06:46.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compression_opts.level: 32767 2024-05-14T15:06:46.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compression_opts.strategy: 0 2024-05-14T15:06:46.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-14T15:06:46.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-14T15:06:46.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-14T15:06:46.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-14T15:06:46.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compression_opts.enabled: false 2024-05-14T15:06:46.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-14T15:06:46.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-14T15:06:46.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-14T15:06:46.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-14T15:06:46.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.target_file_size_base: 67108864 2024-05-14T15:06:46.102 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-14T15:06:46.103 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-14T15:06:46.103 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-14T15:06:46.103 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-14T15:06:46.103 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-14T15:06:46.103 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-14T15:06:46.103 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-14T15:06:46.103 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-14T15:06:46.103 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-14T15:06:46.103 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-14T15:06:46.103 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-14T15:06:46.103 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-14T15:06:46.103 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-14T15:06:46.103 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-14T15:06:46.103 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.arena_block_size: 1048576 2024-05-14T15:06:46.103 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-14T15:06:46.104 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-14T15:06:46.104 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.disable_auto_compactions: 0 2024-05-14T15:06:46.104 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-14T15:06:46.104 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-14T15:06:46.104 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-14T15:06:46.104 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-14T15:06:46.104 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-14T15:06:46.104 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-14T15:06:46.104 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-14T15:06:46.104 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-14T15:06:46.104 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-14T15:06:46.104 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-14T15:06:46.104 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-14T15:06:46.104 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.inplace_update_support: 0 2024-05-14T15:06:46.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-14T15:06:46.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-14T15:06:46.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-14T15:06:46.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-14T15:06:46.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.bloom_locality: 0 2024-05-14T15:06:46.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.max_successive_merges: 0 2024-05-14T15:06:46.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-14T15:06:46.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.paranoid_file_checks: 0 2024-05-14T15:06:46.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.force_consistency_checks: 1 2024-05-14T15:06:46.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.report_bg_io_stats: 0 2024-05-14T15:06:46.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.ttl: 2592000 2024-05-14T15:06:46.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-14T15:06:46.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-14T15:06:46.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-14T15:06:46.105 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.enable_blob_files: false 2024-05-14T15:06:46.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.min_blob_size: 0 2024-05-14T15:06:46.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.blob_file_size: 268435456 2024-05-14T15:06:46.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-14T15:06:46.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-14T15:06:46.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-14T15:06:46.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-14T15:06:46.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-14T15:06:46.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.blob_file_starting_level: 0 2024-05-14T15:06:46.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-14T15:06:46.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-14T15:06:46.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-14T15:06:46.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: dd74d04c-0a19-4899-a217-a68a89070547 2024-05-14T15:06:46.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715699205855980, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-14T15:06:46.106 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-14T15:06:46.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715699205857388, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715699205, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "dd74d04c-0a19-4899-a217-a68a89070547", "db_session_id": "IMAVLDXIKTI5YDP2GD2Q", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-14T15:06:46.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715699205857654, "job": 1, "event": "recovery_finished"} 2024-05-14T15:06:46.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-14T15:06:46.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-14T15:06:46.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x559d044d1c00 2024-05-14T15:06:46.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: DB pointer 0x559d092c4000 2024-05-14T15:06:46.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-14T15:06:46.107 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-14T15:06:46.107 INFO:journalctl@ceph.mon.c.smithi203.stdout: ** DB Stats ** 2024-05-14T15:06:46.107 INFO:journalctl@ceph.mon.c.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-14T15:06:46.107 INFO:journalctl@ceph.mon.c.smithi203.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-14T15:06:46.108 INFO:journalctl@ceph.mon.c.smithi203.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-14T15:06:46.108 INFO:journalctl@ceph.mon.c.smithi203.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-14T15:06:46.108 INFO:journalctl@ceph.mon.c.smithi203.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-14T15:06:46.108 INFO:journalctl@ceph.mon.c.smithi203.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-14T15:06:46.108 INFO:journalctl@ceph.mon.c.smithi203.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-14T15:06:46.108 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-05-14T15:06:46.108 INFO:journalctl@ceph.mon.c.smithi203.stdout: ** Compaction Stats [default] ** 2024-05-14T15:06:46.108 INFO:journalctl@ceph.mon.c.smithi203.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-14T15:06:46.108 INFO:journalctl@ceph.mon.c.smithi203.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-14T15:06:46.108 INFO:journalctl@ceph.mon.c.smithi203.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T15:06:46.108 INFO:journalctl@ceph.mon.c.smithi203.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T15:06:46.108 INFO:journalctl@ceph.mon.c.smithi203.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T15:06:46.108 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-05-14T15:06:46.108 INFO:journalctl@ceph.mon.c.smithi203.stdout: ** Compaction Stats [default] ** 2024-05-14T15:06:46.109 INFO:journalctl@ceph.mon.c.smithi203.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-14T15:06:46.109 INFO:journalctl@ceph.mon.c.smithi203.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-14T15:06:46.109 INFO:journalctl@ceph.mon.c.smithi203.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.2 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T15:06:46.109 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-05-14T15:06:46.109 INFO:journalctl@ceph.mon.c.smithi203.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-14T15:06:46.109 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-05-14T15:06:46.109 INFO:journalctl@ceph.mon.c.smithi203.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-14T15:06:46.109 INFO:journalctl@ceph.mon.c.smithi203.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-14T15:06:46.109 INFO:journalctl@ceph.mon.c.smithi203.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-14T15:06:46.109 INFO:journalctl@ceph.mon.c.smithi203.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-14T15:06:46.109 INFO:journalctl@ceph.mon.c.smithi203.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-14T15:06:46.109 INFO:journalctl@ceph.mon.c.smithi203.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-14T15:06:46.110 INFO:journalctl@ceph.mon.c.smithi203.stdout: Cumulative compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-14T15:06:46.110 INFO:journalctl@ceph.mon.c.smithi203.stdout: Interval compaction: 0.00 GB write, 0.24 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-14T15:06:46.110 INFO:journalctl@ceph.mon.c.smithi203.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-14T15:06:46.110 INFO:journalctl@ceph.mon.c.smithi203.stdout: Block cache BinnedLRUCache@0x559d044ed1f0#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.2e-05 secs_since: 0 2024-05-14T15:06:46.110 INFO:journalctl@ceph.mon.c.smithi203.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-14T15:06:46.110 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-05-14T15:06:46.110 INFO:journalctl@ceph.mon.c.smithi203.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-14T15:06:46.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-05-14T15:06:46.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: using public_addr v2:172.21.15.203:0/0 -> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-05-14T15:06:46.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 systemd[1]: Started Ceph mon.c for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:06:46.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: starting mon.c rank -1 at public addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] at bind addrs [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:06:46.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: mon.c@-1(???) e0 preinit fsid 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:06:46.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: mon.c@-1(synchronizing).mds e1 new map 2024-05-14T15:06:46.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: mon.c@-1(synchronizing).mds e1 print_map 2024-05-14T15:06:46.111 INFO:journalctl@ceph.mon.c.smithi203.stdout: e1 2024-05-14T15:06:46.111 INFO:journalctl@ceph.mon.c.smithi203.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-14T15:06:46.111 INFO:journalctl@ceph.mon.c.smithi203.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-14T15:06:46.111 INFO:journalctl@ceph.mon.c.smithi203.stdout: legacy client fscid: -1 2024-05-14T15:06:46.111 INFO:journalctl@ceph.mon.c.smithi203.stdout: 2024-05-14T15:06:46.111 INFO:journalctl@ceph.mon.c.smithi203.stdout: No filesystems configured 2024-05-14T15:06:46.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-14T15:06:46.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-14T15:06:46.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-14T15:06:46.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-14T15:06:46.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-14T15:06:46.112 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-14T15:06:46.112 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-14T15:06:46.112 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T15:06:46.112 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T15:06:46.112 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T15:06:46.112 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.113 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.113 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.113 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: Added host smithi092 2024-05-14T15:06:46.113 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:06:46.113 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.113 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.113 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.113 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:06:46.113 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.113 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.113 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.113 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi203", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:06:46.113 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.114 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.114 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.114 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.114 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.114 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:06:46.114 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:06:46.114 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:06:46.114 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: Deploying cephadm binary to smithi203 2024-05-14T15:06:46.114 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: Updating smithi092:/etc/ceph/ceph.conf 2024-05-14T15:06:46.114 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: Updating smithi092:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:06:46.114 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.114 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:06:46.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: Added host smithi203 2024-05-14T15:06:46.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: Updating smithi092:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T15:06:46.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:06:46.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:06:46.115 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1621512424' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-14T15:06:46.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1621512424' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-14T15:06:46.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T15:06:46.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi203", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:06:46.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:06:46.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:06:46.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: Updating smithi203:/etc/ceph/ceph.conf 2024-05-14T15:06:46.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: Updating smithi203:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:06:46.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:06:46.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: Updating smithi203:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T15:06:46.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi069:172.21.15.69=a;smithi092:172.21.15.92=b;smithi203:172.21.15.203=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:06:46.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: Saving service mon spec with placement smithi069:172.21.15.69=a;smithi092:172.21.15.92=b;smithi203:172.21.15.203=c;count:3 2024-05-14T15:06:46.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:46.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T15:06:46.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:06:46.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: Deploying daemon mon.c on smithi203 2024-05-14T15:06:46.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:46.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: from='client.? 172.21.15.203:0/4111444488' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T15:06:46.118 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:45 smithi203 ceph-mon[34567]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-05-14T15:06:46.484 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:06:51.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:51.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:51.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:06:51.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: mon.a calling monitor election 2024-05-14T15:06:51.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:51.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:51.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:51.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:51.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: mon.c calling monitor election 2024-05-14T15:06:51.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:51.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:51.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:51.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:51.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-14T15:06:51.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: monmap epoch 2 2024-05-14T15:06:51.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: fsid 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:06:51.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: last_changed 2024-05-14T15:06:45.909586+0000 2024-05-14T15:06:51.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: created 2024-05-14T15:04:26.570547+0000 2024-05-14T15:06:51.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: min_mon_release 19 (squid) 2024-05-14T15:06:51.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: election_strategy: 1 2024-05-14T15:06:51.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-05-14T15:06:51.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-05-14T15:06:51.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: fsmap 2024-05-14T15:06:51.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T15:06:51.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: mgrmap e13: x(active, since 69s) 2024-05-14T15:06:51.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: overall HEALTH_OK 2024-05-14T15:06:51.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:51.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:51.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:50 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:51.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:51.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:51.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:06:51.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: mon.a calling monitor election 2024-05-14T15:06:51.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:51.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:51.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:51.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:51.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: mon.c calling monitor election 2024-05-14T15:06:51.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:51.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:51.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:51.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:51.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-14T15:06:51.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: monmap epoch 2 2024-05-14T15:06:51.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: fsid 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:06:51.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: last_changed 2024-05-14T15:06:45.909586+0000 2024-05-14T15:06:51.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: created 2024-05-14T15:04:26.570547+0000 2024-05-14T15:06:51.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: min_mon_release 19 (squid) 2024-05-14T15:06:51.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: election_strategy: 1 2024-05-14T15:06:51.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-05-14T15:06:51.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-05-14T15:06:51.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: fsmap 2024-05-14T15:06:51.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T15:06:51.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: mgrmap e13: x(active, since 69s) 2024-05-14T15:06:51.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: overall HEALTH_OK 2024-05-14T15:06:51.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:51.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:51.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:50 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:51.662 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.668+0000 7f3e36600700 1 -- 172.21.15.203:0/1526429039 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e140035c0 msgr2=0x7f3e14005aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:51.662 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.668+0000 7f3e36600700 1 --2- 172.21.15.203:0/1526429039 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e140035c0 0x7f3e14005aa0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3e3006bd60 tx=0x7f3e2000feb0 comp rx=0 tx=0).stop 2024-05-14T15:06:51.662 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.669+0000 7f3e36600700 1 -- 172.21.15.203:0/1526429039 shutdown_connections 2024-05-14T15:06:51.662 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.669+0000 7f3e36600700 1 --2- 172.21.15.203:0/1526429039 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e140035c0 0x7f3e14005aa0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:51.662 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.669+0000 7f3e36600700 1 -- 172.21.15.203:0/1526429039 >> 172.21.15.203:0/1526429039 conn(0x7f3e300fe640 msgr2=0x7f3e30100a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:51.662 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.669+0000 7f3e36600700 1 -- 172.21.15.203:0/1526429039 shutdown_connections 2024-05-14T15:06:51.662 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.669+0000 7f3e36600700 1 -- 172.21.15.203:0/1526429039 wait complete. 2024-05-14T15:06:51.664 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.672+0000 7f3e36600700 1 Processor -- start 2024-05-14T15:06:51.664 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.672+0000 7f3e36600700 1 -- start start 2024-05-14T15:06:51.665 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.673+0000 7f3e36600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e140035c0 0x7f3e301a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:51.665 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.673+0000 7f3e36600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e301a1d90 0x7f3e3019ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:51.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.673+0000 7f3e36600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3010bad0 con 0x7f3e301a1d90 2024-05-14T15:06:51.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.673+0000 7f3e36600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3e3010b950 con 0x7f3e140035c0 2024-05-14T15:06:51.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.674+0000 7f3e26a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e301a1d90 0x7f3e3019ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:51.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.674+0000 7f3e26a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e301a1d90 0x7f3e3019ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.203:56052/0 (socket says 172.21.15.203:56052) 2024-05-14T15:06:51.666 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.674+0000 7f3e26a00700 1 -- 172.21.15.203:0/1142918047 learned_addr learned my addr 172.21.15.203:0/1142918047 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-05-14T15:06:51.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.674+0000 7f3e2f400700 1 --2- 172.21.15.203:0/1142918047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e140035c0 0x7f3e301a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:51.667 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.675+0000 7f3e2f400700 1 -- 172.21.15.203:0/1142918047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e140035c0 msgr2=0x7f3e301a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-05-14T15:06:51.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.675+0000 7f3e2f400700 1 -- 172.21.15.203:0/1142918047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e140035c0 msgr2=0x7f3e301a1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-14T15:06:51.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.675+0000 7f3e2f400700 1 --2- 172.21.15.203:0/1142918047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e140035c0 0x7f3e301a1850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-14T15:06:51.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.675+0000 7f3e2f400700 1 --2- 172.21.15.203:0/1142918047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e140035c0 0x7f3e301a1850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T15:06:51.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.675+0000 7f3e26a00700 1 -- 172.21.15.203:0/1142918047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e140035c0 msgr2=0x7f3e301a1850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T15:06:51.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.675+0000 7f3e26a00700 1 --2- 172.21.15.203:0/1142918047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e140035c0 0x7f3e301a1850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:51.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.675+0000 7f3e26a00700 1 -- 172.21.15.203:0/1142918047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e301a2360 con 0x7f3e301a1d90 2024-05-14T15:06:51.668 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.676+0000 7f3e26a00700 1 --2- 172.21.15.203:0/1142918047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e301a1d90 0x7f3e3019ba70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800bb00 tx=0x7f3e1800bec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:51.669 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.676+0000 7f3e2cc00700 1 -- 172.21.15.203:0/1142918047 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3e18003bc0 con 0x7f3e301a1d90 2024-05-14T15:06:51.669 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.676+0000 7f3e2cc00700 1 -- 172.21.15.203:0/1142918047 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3e18003d60 con 0x7f3e301a1d90 2024-05-14T15:06:51.669 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.676+0000 7f3e2cc00700 1 -- 172.21.15.203:0/1142918047 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f3e18004430 con 0x7f3e301a1d90 2024-05-14T15:06:51.669 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.676+0000 7f3e36600700 1 -- 172.21.15.203:0/1142918047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e3019c010 con 0x7f3e301a1d90 2024-05-14T15:06:51.669 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.676+0000 7f3e36600700 1 -- 172.21.15.203:0/1142918047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e3019c5a0 con 0x7f3e301a1d90 2024-05-14T15:06:51.670 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.678+0000 7f3e36600700 1 -- 172.21.15.203:0/1142918047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e3019c8b0 con 0x7f3e301a1d90 2024-05-14T15:06:51.670 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.678+0000 7f3e2cc00700 1 -- 172.21.15.203:0/1142918047 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f3e180045d0 con 0x7f3e301a1d90 2024-05-14T15:06:51.671 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.679+0000 7f3e2cc00700 1 --2- 172.21.15.203:0/1142918047 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f3e0c03e2b0 0x7f3e0c0407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:51.671 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.679+0000 7f3e2cc00700 1 -- 172.21.15.203:0/1142918047 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3e18051d30 con 0x7f3e301a1d90 2024-05-14T15:06:51.671 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.679+0000 7f3e2f400700 1 --2- 172.21.15.203:0/1142918047 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f3e0c03e2b0 0x7f3e0c0407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:51.673 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.681+0000 7f3e2f400700 1 --2- 172.21.15.203:0/1142918047 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f3e0c03e2b0 0x7f3e0c0407c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000f8d0 tx=0x7f3e2000f4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:51.687 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:51.695+0000 7f3e2cc00700 1 -- 172.21.15.203:0/1142918047 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3e18013390 con 0x7f3e301a1d90 2024-05-14T15:06:52.019 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:52.027+0000 7f3e36600700 1 -- 172.21.15.203:0/1142918047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f3e3002e5f0 con 0x7f3e301a1d90 2024-05-14T15:06:52.020 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:52.028+0000 7f3e2cc00700 1 -- 172.21.15.203:0/1142918047 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f3e180092e0 con 0x7f3e301a1d90 2024-05-14T15:06:52.021 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:06:52.021 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":2,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","modified":"2024-05-14T15:06:45.909586Z","created":"2024-05-14T15:04:26.570547Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3300","nonce":0},{"type":"v1","addr":"172.21.15.69:6789","nonce":0}]},"addr":"172.21.15.69:6789/0","public_addr":"172.21.15.69:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-14T15:06:52.024 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:52.031+0000 7f3e36600700 1 -- 172.21.15.203:0/1142918047 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f3e0c03e2b0 msgr2=0x7f3e0c0407c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:52.024 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:52.031+0000 7f3e36600700 1 --2- 172.21.15.203:0/1142918047 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f3e0c03e2b0 0x7f3e0c0407c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3e2000f8d0 tx=0x7f3e2000f4c0 comp rx=0 tx=0).stop 2024-05-14T15:06:52.024 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:52.031+0000 7f3e36600700 1 -- 172.21.15.203:0/1142918047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e301a1d90 msgr2=0x7f3e3019ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:52.024 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:52.031+0000 7f3e36600700 1 --2- 172.21.15.203:0/1142918047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e301a1d90 0x7f3e3019ba70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3e1800bb00 tx=0x7f3e1800bec0 comp rx=0 tx=0).stop 2024-05-14T15:06:52.024 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:52.031+0000 7f3e36600700 1 -- 172.21.15.203:0/1142918047 shutdown_connections 2024-05-14T15:06:52.025 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:52.031+0000 7f3e36600700 1 --2- 172.21.15.203:0/1142918047 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f3e0c03e2b0 0x7f3e0c0407c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:52.025 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:52.031+0000 7f3e36600700 1 --2- 172.21.15.203:0/1142918047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3e140035c0 0x7f3e301a1850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:52.025 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:52.031+0000 7f3e36600700 1 --2- 172.21.15.203:0/1142918047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3e301a1d90 0x7f3e3019ba70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:52.025 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:52.031+0000 7f3e36600700 1 -- 172.21.15.203:0/1142918047 >> 172.21.15.203:0/1142918047 conn(0x7f3e300fe640 msgr2=0x7f3e301005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:52.025 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:52.032+0000 7f3e36600700 1 -- 172.21.15.203:0/1142918047 shutdown_connections 2024-05-14T15:06:52.025 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:52.032+0000 7f3e36600700 1 -- 172.21.15.203:0/1142918047 wait complete. 2024-05-14T15:06:52.026 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 2 2024-05-14T15:06:52.335 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:51 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T15:06:52.335 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:51 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:06:52.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:51 smithi203 ceph-mon[34567]: Deploying daemon mon.b on smithi092 2024-05-14T15:06:52.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:51 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:52.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:51 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T15:06:52.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:51 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:06:52.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:51 smithi069 ceph-mon[31270]: Deploying daemon mon.b on smithi092 2024-05-14T15:06:52.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:51 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:53.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:53 smithi203 ceph-mon[34567]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:53.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:53 smithi203 ceph-mon[34567]: from='client.? 172.21.15.203:0/1142918047' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T15:06:53.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:53 smithi069 ceph-mon[31270]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:53.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:53 smithi069 ceph-mon[31270]: from='client.? 172.21.15.203:0/1142918047' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T15:06:53.696 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-14T15:06:53.696 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-14T15:06:54.127 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:06:55.268 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:55 smithi069 ceph-mon[31270]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:55.285 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:55 smithi203 ceph-mon[34567]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:56.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.410+0000 7fa783e00700 1 -- 172.21.15.203:0/1894493354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa77c103ec0 msgr2=0x7fa77c1042d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:56.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.410+0000 7fa783e00700 1 --2- 172.21.15.203:0/1894493354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa77c103ec0 0x7fa77c1042d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fa770009910 tx=0x7fa770009c20 comp rx=0 tx=0).stop 2024-05-14T15:06:56.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.411+0000 7fa783e00700 1 -- 172.21.15.203:0/1894493354 shutdown_connections 2024-05-14T15:06:56.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.411+0000 7fa783e00700 1 --2- 172.21.15.203:0/1894493354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa77c103ec0 0x7fa77c1042d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:56.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.411+0000 7fa783e00700 1 -- 172.21.15.203:0/1894493354 >> 172.21.15.203:0/1894493354 conn(0x7fa77c0ff770 msgr2=0x7fa77c101bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:56.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.411+0000 7fa783e00700 1 -- 172.21.15.203:0/1894493354 shutdown_connections 2024-05-14T15:06:56.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.411+0000 7fa783e00700 1 -- 172.21.15.203:0/1894493354 wait complete. 2024-05-14T15:06:56.404 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.412+0000 7fa783e00700 1 Processor -- start 2024-05-14T15:06:56.405 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.412+0000 7fa783e00700 1 -- start start 2024-05-14T15:06:56.405 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.413+0000 7fa783e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa77c103ec0 0x7fa77c075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:56.405 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.413+0000 7fa783e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa77c076000 0x7fa77c076410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:56.405 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.413+0000 7fa783e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c10e060 con 0x7fa77c076000 2024-05-14T15:06:56.405 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.413+0000 7fa783e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa77c10dee0 con 0x7fa77c103ec0 2024-05-14T15:06:56.405 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.413+0000 7fa781400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa77c103ec0 0x7fa77c075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:56.405 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.413+0000 7fa780a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa77c076000 0x7fa77c076410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:56.405 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.413+0000 7fa781400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa77c103ec0 0x7fa77c075ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:44054/0 (socket says 172.21.15.203:44054) 2024-05-14T15:06:56.406 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.413+0000 7fa780a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa77c076000 0x7fa77c076410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.203:56072/0 (socket says 172.21.15.203:56072) 2024-05-14T15:06:56.406 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.413+0000 7fa781400700 1 -- 172.21.15.203:0/1838851352 learned_addr learned my addr 172.21.15.203:0/1838851352 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-05-14T15:06:56.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.414+0000 7fa781400700 1 -- 172.21.15.203:0/1838851352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa77c076000 msgr2=0x7fa77c076410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:56.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.414+0000 7fa781400700 1 --2- 172.21.15.203:0/1838851352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa77c076000 0x7fa77c076410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:56.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.414+0000 7fa781400700 1 -- 172.21.15.203:0/1838851352 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa77c0779f0 con 0x7fa77c103ec0 2024-05-14T15:06:56.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.414+0000 7fa780a00700 1 --2- 172.21.15.203:0/1838851352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa77c076000 0x7fa77c076410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:06:56.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.414+0000 7fa781400700 1 --2- 172.21.15.203:0/1838851352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa77c103ec0 0x7fa77c075ac0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa7700056d0 tx=0x7fa770005700 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:56.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.415+0000 7fa77a000700 1 -- 172.21.15.203:0/1838851352 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa770004f60 con 0x7fa77c103ec0 2024-05-14T15:06:56.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.415+0000 7fa77a000700 1 -- 172.21.15.203:0/1838851352 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa770005dc0 con 0x7fa77c103ec0 2024-05-14T15:06:56.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.415+0000 7fa783e00700 1 -- 172.21.15.203:0/1838851352 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa77c1a5de0 con 0x7fa77c103ec0 2024-05-14T15:06:56.407 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.415+0000 7fa77a000700 1 -- 172.21.15.203:0/1838851352 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fa770022cb0 con 0x7fa77c103ec0 2024-05-14T15:06:56.408 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.415+0000 7fa783e00700 1 -- 172.21.15.203:0/1838851352 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa77c1a62e0 con 0x7fa77c103ec0 2024-05-14T15:06:56.408 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.416+0000 7fa783e00700 1 -- 172.21.15.203:0/1838851352 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa77c105370 con 0x7fa77c103ec0 2024-05-14T15:06:56.408 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.416+0000 7fa77a000700 1 -- 172.21.15.203:0/1838851352 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7fa77002a070 con 0x7fa77c103ec0 2024-05-14T15:06:56.409 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.417+0000 7fa77a000700 1 --2- 172.21.15.203:0/1838851352 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa76403e300 0x7fa764040810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:06:56.409 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.417+0000 7fa77a000700 1 -- 172.21.15.203:0/1838851352 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fa77001e030 con 0x7fa77c103ec0 2024-05-14T15:06:56.409 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.417+0000 7fa780a00700 1 --2- 172.21.15.203:0/1838851352 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa76403e300 0x7fa764040810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:06:56.410 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.418+0000 7fa780a00700 1 --2- 172.21.15.203:0/1838851352 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa76403e300 0x7fa764040810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa77c10c120 tx=0x7fa768009210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:06:56.416 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.424+0000 7fa77a000700 1 -- 172.21.15.203:0/1838851352 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa770013070 con 0x7fa77c103ec0 2024-05-14T15:06:56.734 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.742+0000 7fa783e00700 1 -- 172.21.15.203:0/1838851352 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fa77c1a6600 con 0x7fa77c103ec0 2024-05-14T15:06:56.735 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.743+0000 7fa77a000700 1 -- 172.21.15.203:0/1838851352 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fa77002c440 con 0x7fa77c103ec0 2024-05-14T15:06:56.735 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:06:56.735 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":2,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","modified":"2024-05-14T15:06:45.909586Z","created":"2024-05-14T15:04:26.570547Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3300","nonce":0},{"type":"v1","addr":"172.21.15.69:6789","nonce":0}]},"addr":"172.21.15.69:6789/0","public_addr":"172.21.15.69:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-14T15:06:56.739 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.746+0000 7fa783e00700 1 -- 172.21.15.203:0/1838851352 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa76403e300 msgr2=0x7fa764040810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:56.739 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.746+0000 7fa783e00700 1 --2- 172.21.15.203:0/1838851352 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa76403e300 0x7fa764040810 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fa77c10c120 tx=0x7fa768009210 comp rx=0 tx=0).stop 2024-05-14T15:06:56.739 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.746+0000 7fa783e00700 1 -- 172.21.15.203:0/1838851352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa77c103ec0 msgr2=0x7fa77c075ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:06:56.739 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.746+0000 7fa783e00700 1 --2- 172.21.15.203:0/1838851352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa77c103ec0 0x7fa77c075ac0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa7700056d0 tx=0x7fa770005700 comp rx=0 tx=0).stop 2024-05-14T15:06:56.739 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.746+0000 7fa783e00700 1 -- 172.21.15.203:0/1838851352 shutdown_connections 2024-05-14T15:06:56.739 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.747+0000 7fa783e00700 1 --2- 172.21.15.203:0/1838851352 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa76403e300 0x7fa764040810 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:56.739 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.747+0000 7fa783e00700 1 --2- 172.21.15.203:0/1838851352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa77c103ec0 0x7fa77c075ac0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:56.739 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.747+0000 7fa783e00700 1 --2- 172.21.15.203:0/1838851352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa77c076000 0x7fa77c076410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:06:56.739 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.747+0000 7fa783e00700 1 -- 172.21.15.203:0/1838851352 >> 172.21.15.203:0/1838851352 conn(0x7fa77c0ff770 msgr2=0x7fa77c10b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:06:56.739 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.747+0000 7fa783e00700 1 -- 172.21.15.203:0/1838851352 shutdown_connections 2024-05-14T15:06:56.740 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:06:56.747+0000 7fa783e00700 1 -- 172.21.15.203:0/1838851352 wait complete. 2024-05-14T15:06:56.740 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 2 2024-05-14T15:06:57.056 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:56 smithi092 podman[34710]: 2024-05-14 15:06:56.791871336 +0000 UTC m=+0.164127747 container create 34b43213dadf372def6ec68030b2dc51577d3ffad9d2dfc27d3d9e9ff73add39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-b, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-14T15:06:57.056 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 podman[34710]: 2024-05-14 15:06:57.062022107 +0000 UTC m=+0.434278524 container init 34b43213dadf372def6ec68030b2dc51577d3ffad9d2dfc27d3d9e9ff73add39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-b, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T15:06:57.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:57 smithi069 ceph-mon[31270]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:06:57 smithi069 ceph-mon[31270]: from='client.? 172.21.15.203:0/1838851352' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T15:06:57.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:57 smithi203 ceph-mon[34567]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:06:57 smithi203 ceph-mon[34567]: from='client.? 172.21.15.203:0/1838851352' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T15:06:57.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 podman[34710]: 2024-05-14 15:06:57.072372255 +0000 UTC m=+0.444628633 container start 34b43213dadf372def6ec68030b2dc51577d3ffad9d2dfc27d3d9e9ff73add39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-b, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-14T15:06:57.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 bash[34710]: 34b43213dadf372def6ec68030b2dc51577d3ffad9d2dfc27d3d9e9ff73add39 2024-05-14T15:06:57.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 systemd[1]: Started Ceph mon.b for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:06:57.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: set uid:gid to 167:167 (ceph:ceph) 2024-05-14T15:06:57.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev), process ceph-mon, pid 2 2024-05-14T15:06:57.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pidfile_write: ignore empty --pid-file 2024-05-14T15:06:57.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: load: jerasure load: lrc 2024-05-14T15:06:57.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: RocksDB version: 7.9.2 2024-05-14T15:06:57.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Git sha 0 2024-05-14T15:06:57.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Compile date 2024-05-09 05:50:40 2024-05-14T15:06:57.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: DB SUMMARY 2024-05-14T15:06:57.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: DB Session ID: WRWX6H2F4OLCICEJTWPG 2024-05-14T15:06:57.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: CURRENT file: CURRENT 2024-05-14T15:06:57.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: IDENTITY file: IDENTITY 2024-05-14T15:06:57.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-05-14T15:06:57.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-05-14T15:06:57.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-05-14T15:06:57.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.error_if_exists: 0 2024-05-14T15:06:57.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.create_if_missing: 0 2024-05-14T15:06:57.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.paranoid_checks: 1 2024-05-14T15:06:57.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-14T15:06:57.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-14T15:06:57.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-14T15:06:57.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.env: 0x557bb854d500 2024-05-14T15:06:57.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.fs: PosixFileSystem 2024-05-14T15:06:57.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.info_log: 0x557bed21a060 2024-05-14T15:06:57.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_file_opening_threads: 16 2024-05-14T15:06:57.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.statistics: (nil) 2024-05-14T15:06:57.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.use_fsync: 0 2024-05-14T15:06:57.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_log_file_size: 0 2024-05-14T15:06:57.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-14T15:06:57.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-14T15:06:57.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.keep_log_file_num: 1000 2024-05-14T15:06:57.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.recycle_log_file_num: 0 2024-05-14T15:06:57.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.allow_fallocate: 1 2024-05-14T15:06:57.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.allow_mmap_reads: 0 2024-05-14T15:06:57.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.allow_mmap_writes: 0 2024-05-14T15:06:57.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.use_direct_reads: 0 2024-05-14T15:06:57.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-14T15:06:57.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.create_missing_column_families: 0 2024-05-14T15:06:57.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.db_log_dir: 2024-05-14T15:06:57.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.wal_dir: 2024-05-14T15:06:57.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-14T15:06:57.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-14T15:06:57.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-14T15:06:57.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-14T15:06:57.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-14T15:06:57.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-14T15:06:57.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.advise_random_on_open: 1 2024-05-14T15:06:57.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.db_write_buffer_size: 0 2024-05-14T15:06:57.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.write_buffer_manager: 0x557bed0e48c0 2024-05-14T15:06:57.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-14T15:06:57.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-14T15:06:57.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-14T15:06:57.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.rate_limiter: (nil) 2024-05-14T15:06:57.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-14T15:06:57.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.wal_recovery_mode: 2 2024-05-14T15:06:57.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.enable_thread_tracking: 0 2024-05-14T15:06:57.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.enable_pipelined_write: 0 2024-05-14T15:06:57.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.unordered_write: 0 2024-05-14T15:06:57.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-14T15:06:57.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-14T15:06:57.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-14T15:06:57.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-14T15:06:57.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.row_cache: None 2024-05-14T15:06:57.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.wal_filter: None 2024-05-14T15:06:57.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-14T15:06:57.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.allow_ingest_behind: 0 2024-05-14T15:06:57.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.two_write_queues: 0 2024-05-14T15:06:57.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.manual_wal_flush: 0 2024-05-14T15:06:57.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.wal_compression: 0 2024-05-14T15:06:57.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.atomic_flush: 0 2024-05-14T15:06:57.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-14T15:06:57.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-14T15:06:57.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-14T15:06:57.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.log_readahead_size: 0 2024-05-14T15:06:57.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-14T15:06:57.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.best_efforts_recovery: 0 2024-05-14T15:06:57.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-14T15:06:57.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-14T15:06:57.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.allow_data_in_errors: 0 2024-05-14T15:06:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.db_host_id: __hostname__ 2024-05-14T15:06:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-14T15:06:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_background_jobs: 2 2024-05-14T15:06:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_background_compactions: -1 2024-05-14T15:06:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_subcompactions: 1 2024-05-14T15:06:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-14T15:06:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-14T15:06:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-14T15:06:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_total_wal_size: 0 2024-05-14T15:06:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-14T15:06:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-14T15:06:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-14T15:06:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-14T15:06:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_open_files: -1 2024-05-14T15:06:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.bytes_per_sync: 0 2024-05-14T15:06:57.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-14T15:06:57.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-14T15:06:57.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compaction_readahead_size: 0 2024-05-14T15:06:57.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_background_flushes: -1 2024-05-14T15:06:57.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Compression algorithms supported: 2024-05-14T15:06:57.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-14T15:06:57.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: kZSTD supported: 0 2024-05-14T15:06:57.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: kXpressCompression supported: 0 2024-05-14T15:06:57.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: kLZ4HCCompression supported: 1 2024-05-14T15:06:57.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: kZlibCompression supported: 1 2024-05-14T15:06:57.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: kSnappyCompression supported: 1 2024-05-14T15:06:57.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: kLZ4Compression supported: 1 2024-05-14T15:06:57.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: kBZip2Compression supported: 0 2024-05-14T15:06:57.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-14T15:06:57.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-14T15:06:57.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-05-14T15:06:57.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-14T15:06:57.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-14T15:06:57.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.merge_operator: 2024-05-14T15:06:57.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compaction_filter: None 2024-05-14T15:06:57.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compaction_filter_factory: None 2024-05-14T15:06:57.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.sst_partitioner_factory: None 2024-05-14T15:06:57.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-14T15:06:57.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-14T15:06:57.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x557bed21a220) 2024-05-14T15:06:57.445 INFO:journalctl@ceph.mon.b.smithi092.stdout: cache_index_and_filter_blocks: 1 2024-05-14T15:06:57.445 INFO:journalctl@ceph.mon.b.smithi092.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-14T15:06:57.445 INFO:journalctl@ceph.mon.b.smithi092.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-14T15:06:57.445 INFO:journalctl@ceph.mon.b.smithi092.stdout: pin_top_level_index_and_filter: 1 2024-05-14T15:06:57.445 INFO:journalctl@ceph.mon.b.smithi092.stdout: index_type: 0 2024-05-14T15:06:57.446 INFO:journalctl@ceph.mon.b.smithi092.stdout: data_block_index_type: 0 2024-05-14T15:06:57.446 INFO:journalctl@ceph.mon.b.smithi092.stdout: index_shortening: 1 2024-05-14T15:06:57.446 INFO:journalctl@ceph.mon.b.smithi092.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-14T15:06:57.446 INFO:journalctl@ceph.mon.b.smithi092.stdout: checksum: 4 2024-05-14T15:06:57.446 INFO:journalctl@ceph.mon.b.smithi092.stdout: no_block_cache: 0 2024-05-14T15:06:57.446 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_cache: 0x557bed1171f0 2024-05-14T15:06:57.446 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_cache_name: BinnedLRUCache 2024-05-14T15:06:57.446 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_cache_options: 2024-05-14T15:06:57.446 INFO:journalctl@ceph.mon.b.smithi092.stdout: capacity : 536870912 2024-05-14T15:06:57.446 INFO:journalctl@ceph.mon.b.smithi092.stdout: num_shard_bits : 4 2024-05-14T15:06:57.446 INFO:journalctl@ceph.mon.b.smithi092.stdout: strict_capacity_limit : 0 2024-05-14T15:06:57.446 INFO:journalctl@ceph.mon.b.smithi092.stdout: high_pri_pool_ratio: 0.000 2024-05-14T15:06:57.446 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_cache_compressed: (nil) 2024-05-14T15:06:57.446 INFO:journalctl@ceph.mon.b.smithi092.stdout: persistent_cache: (nil) 2024-05-14T15:06:57.446 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_size: 4096 2024-05-14T15:06:57.447 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_size_deviation: 10 2024-05-14T15:06:57.447 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_restart_interval: 16 2024-05-14T15:06:57.447 INFO:journalctl@ceph.mon.b.smithi092.stdout: index_block_restart_interval: 1 2024-05-14T15:06:57.447 INFO:journalctl@ceph.mon.b.smithi092.stdout: metadata_block_size: 4096 2024-05-14T15:06:57.447 INFO:journalctl@ceph.mon.b.smithi092.stdout: partition_filters: 0 2024-05-14T15:06:57.447 INFO:journalctl@ceph.mon.b.smithi092.stdout: use_delta_encoding: 1 2024-05-14T15:06:57.447 INFO:journalctl@ceph.mon.b.smithi092.stdout: filter_policy: bloomfilter 2024-05-14T15:06:57.447 INFO:journalctl@ceph.mon.b.smithi092.stdout: whole_key_filtering: 1 2024-05-14T15:06:57.447 INFO:journalctl@ceph.mon.b.smithi092.stdout: verify_compression: 0 2024-05-14T15:06:57.447 INFO:journalctl@ceph.mon.b.smithi092.stdout: read_amp_bytes_per_bit: 0 2024-05-14T15:06:57.447 INFO:journalctl@ceph.mon.b.smithi092.stdout: format_version: 5 2024-05-14T15:06:57.447 INFO:journalctl@ceph.mon.b.smithi092.stdout: enable_index_compression: 1 2024-05-14T15:06:57.447 INFO:journalctl@ceph.mon.b.smithi092.stdout: block_align: 0 2024-05-14T15:06:57.447 INFO:journalctl@ceph.mon.b.smithi092.stdout: max_auto_readahead_size: 262144 2024-05-14T15:06:57.448 INFO:journalctl@ceph.mon.b.smithi092.stdout: prepopulate_block_cache: 0 2024-05-14T15:06:57.448 INFO:journalctl@ceph.mon.b.smithi092.stdout: initial_auto_readahead_size: 8192 2024-05-14T15:06:57.448 INFO:journalctl@ceph.mon.b.smithi092.stdout: num_file_reads_for_auto_readahead: 2 2024-05-14T15:06:57.448 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.write_buffer_size: 33554432 2024-05-14T15:06:57.448 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_write_buffer_number: 2 2024-05-14T15:06:57.448 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compression: NoCompression 2024-05-14T15:06:57.448 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.bottommost_compression: Disabled 2024-05-14T15:06:57.448 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.prefix_extractor: nullptr 2024-05-14T15:06:57.448 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-14T15:06:57.448 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.num_levels: 7 2024-05-14T15:06:57.448 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-14T15:06:57.448 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-14T15:06:57.448 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-14T15:06:57.448 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-14T15:06:57.448 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-14T15:06:57.449 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-14T15:06:57.449 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-14T15:06:57.449 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-14T15:06:57.449 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-14T15:06:57.449 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-14T15:06:57.449 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-14T15:06:57.449 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-14T15:06:57.449 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-14T15:06:57.449 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compression_opts.level: 32767 2024-05-14T15:06:57.449 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compression_opts.strategy: 0 2024-05-14T15:06:57.449 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-14T15:06:57.449 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-14T15:06:57.449 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-14T15:06:57.449 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-14T15:06:57.450 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compression_opts.enabled: false 2024-05-14T15:06:57.450 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-14T15:06:57.450 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-14T15:06:57.450 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-14T15:06:57.450 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-14T15:06:57.450 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.target_file_size_base: 67108864 2024-05-14T15:06:57.450 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-14T15:06:57.450 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-14T15:06:57.450 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-14T15:06:57.450 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-14T15:06:57.450 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-14T15:06:57.450 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-14T15:06:57.450 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-14T15:06:57.450 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-14T15:06:57.451 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-14T15:06:57.451 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-14T15:06:57.451 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-14T15:06:57.451 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-14T15:06:57.451 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-14T15:06:57.451 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-14T15:06:57.451 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.arena_block_size: 1048576 2024-05-14T15:06:57.451 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-14T15:06:57.451 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-14T15:06:57.451 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.disable_auto_compactions: 0 2024-05-14T15:06:57.451 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-14T15:06:57.451 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-14T15:06:57.451 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-14T15:06:57.451 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-14T15:06:57.451 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-14T15:06:57.452 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-14T15:06:57.452 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-14T15:06:57.452 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-14T15:06:57.452 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-14T15:06:57.452 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-14T15:06:57.452 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-05-14T15:06:57.452 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.inplace_update_support: 0 2024-05-14T15:06:57.452 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-14T15:06:57.452 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-14T15:06:57.452 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-14T15:06:57.452 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-14T15:06:57.452 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.bloom_locality: 0 2024-05-14T15:06:57.452 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.max_successive_merges: 0 2024-05-14T15:06:57.452 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-14T15:06:57.452 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.paranoid_file_checks: 0 2024-05-14T15:06:57.453 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.force_consistency_checks: 1 2024-05-14T15:06:57.453 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.report_bg_io_stats: 0 2024-05-14T15:06:57.453 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.ttl: 2592000 2024-05-14T15:06:57.453 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-14T15:06:57.453 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-14T15:06:57.453 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-14T15:06:57.453 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.enable_blob_files: false 2024-05-14T15:06:57.453 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.min_blob_size: 0 2024-05-14T15:06:57.453 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.blob_file_size: 268435456 2024-05-14T15:06:57.453 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-14T15:06:57.453 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-14T15:06:57.454 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-14T15:06:57.454 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-14T15:06:57.455 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-14T15:06:57.455 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.blob_file_starting_level: 0 2024-05-14T15:06:57.455 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-14T15:06:57.455 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-14T15:06:57.455 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-05-14T15:06:57.455 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 3fdebc24-7c14-4fd4-87db-e023b7227e04 2024-05-14T15:06:57.455 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715699217204569, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-14T15:06:57.455 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-05-14T15:06:57.455 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715699217205483, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1715699217, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "3fdebc24-7c14-4fd4-87db-e023b7227e04", "db_session_id": "WRWX6H2F4OLCICEJTWPG", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-05-14T15:06:57.455 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: EVENT_LOG_v1 {"time_micros": 1715699217205768, "job": 1, "event": "recovery_finished"} 2024-05-14T15:06:57.455 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-05-14T15:06:57.455 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-14T15:06:57.455 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x557bed0fbc00 2024-05-14T15:06:57.455 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: DB pointer 0x557bf1eee000 2024-05-14T15:06:57.456 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-14T15:06:57.456 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-14T15:06:57.456 INFO:journalctl@ceph.mon.b.smithi092.stdout: ** DB Stats ** 2024-05-14T15:06:57.456 INFO:journalctl@ceph.mon.b.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-14T15:06:57.456 INFO:journalctl@ceph.mon.b.smithi092.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-14T15:06:57.456 INFO:journalctl@ceph.mon.b.smithi092.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-14T15:06:57.456 INFO:journalctl@ceph.mon.b.smithi092.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-14T15:06:57.456 INFO:journalctl@ceph.mon.b.smithi092.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-14T15:06:57.456 INFO:journalctl@ceph.mon.b.smithi092.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-14T15:06:57.456 INFO:journalctl@ceph.mon.b.smithi092.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-14T15:06:57.456 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2024-05-14T15:06:57.456 INFO:journalctl@ceph.mon.b.smithi092.stdout: ** Compaction Stats [default] ** 2024-05-14T15:06:57.456 INFO:journalctl@ceph.mon.b.smithi092.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-14T15:06:57.456 INFO:journalctl@ceph.mon.b.smithi092.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-14T15:06:57.457 INFO:journalctl@ceph.mon.b.smithi092.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T15:06:57.457 INFO:journalctl@ceph.mon.b.smithi092.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T15:06:57.457 INFO:journalctl@ceph.mon.b.smithi092.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T15:06:57.457 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2024-05-14T15:06:57.457 INFO:journalctl@ceph.mon.b.smithi092.stdout: ** Compaction Stats [default] ** 2024-05-14T15:06:57.457 INFO:journalctl@ceph.mon.b.smithi092.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-14T15:06:57.457 INFO:journalctl@ceph.mon.b.smithi092.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-14T15:06:57.457 INFO:journalctl@ceph.mon.b.smithi092.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-14T15:06:57.457 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2024-05-14T15:06:57.457 INFO:journalctl@ceph.mon.b.smithi092.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-14T15:06:57.457 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2024-05-14T15:06:57.457 INFO:journalctl@ceph.mon.b.smithi092.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-14T15:06:57.457 INFO:journalctl@ceph.mon.b.smithi092.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-14T15:06:57.457 INFO:journalctl@ceph.mon.b.smithi092.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-14T15:06:57.457 INFO:journalctl@ceph.mon.b.smithi092.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-14T15:06:57.458 INFO:journalctl@ceph.mon.b.smithi092.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-14T15:06:57.458 INFO:journalctl@ceph.mon.b.smithi092.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-14T15:06:57.458 INFO:journalctl@ceph.mon.b.smithi092.stdout: Cumulative compaction: 0.00 GB write, 0.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-14T15:06:57.458 INFO:journalctl@ceph.mon.b.smithi092.stdout: Interval compaction: 0.00 GB write, 0.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-14T15:06:57.458 INFO:journalctl@ceph.mon.b.smithi092.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-14T15:06:57.458 INFO:journalctl@ceph.mon.b.smithi092.stdout: Block cache BinnedLRUCache@0x557bed1171f0#2 capacity: 512.00 MB usage: 0.23 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-05-14T15:06:57.458 INFO:journalctl@ceph.mon.b.smithi092.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.12 KB,2.23517e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-05-14T15:06:57.458 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2024-05-14T15:06:57.458 INFO:journalctl@ceph.mon.b.smithi092.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-14T15:06:57.458 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-05-14T15:06:57.458 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: using public_addr v2:172.21.15.92:0/0 -> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] 2024-05-14T15:06:57.458 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: starting mon.b rank -1 at public addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] at bind addrs [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:06:57.458 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.b@-1(???) e0 preinit fsid 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:06:57.458 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.b@-1(synchronizing).mds e1 new map 2024-05-14T15:06:57.459 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.b@-1(synchronizing).mds e1 print_map 2024-05-14T15:06:57.459 INFO:journalctl@ceph.mon.b.smithi092.stdout: e1 2024-05-14T15:06:57.459 INFO:journalctl@ceph.mon.b.smithi092.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-14T15:06:57.459 INFO:journalctl@ceph.mon.b.smithi092.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-14T15:06:57.459 INFO:journalctl@ceph.mon.b.smithi092.stdout: legacy client fscid: -1 2024-05-14T15:06:57.459 INFO:journalctl@ceph.mon.b.smithi092.stdout: 2024-05-14T15:06:57.459 INFO:journalctl@ceph.mon.b.smithi092.stdout: No filesystems configured 2024-05-14T15:06:57.459 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-14T15:06:57.459 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-14T15:06:57.459 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-14T15:06:57.459 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-14T15:06:57.459 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-14T15:06:57.459 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-14T15:06:57.459 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-14T15:06:57.460 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T15:06:57.460 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T15:06:57.460 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-14T15:06:57.460 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.460 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.460 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.460 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: Added host smithi092 2024-05-14T15:06:57.460 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:06:57.460 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.460 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.460 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.460 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:06:57.460 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.460 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.461 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.461 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi203", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:06:57.461 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.461 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.461 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.461 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.461 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.461 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi092", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:06:57.461 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:06:57.461 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:06:57.461 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: Deploying cephadm binary to smithi203 2024-05-14T15:06:57.461 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: Updating smithi092:/etc/ceph/ceph.conf 2024-05-14T15:06:57.461 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: Updating smithi092:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:06:57.461 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.461 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.462 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:06:57.462 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.462 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: Added host smithi203 2024-05-14T15:06:57.462 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.462 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.462 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.462 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: Updating smithi092:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T15:06:57.462 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.462 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:06:57.462 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.462 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.462 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.462 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:06:57.462 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.463 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.463 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.463 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1621512424' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-14T15:06:57.463 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.463 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1621512424' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-14T15:06:57.463 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T15:06:57.463 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.463 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.463 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.463 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.463 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.463 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi203", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:06:57.463 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:06:57.463 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:06:57.463 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: Updating smithi203:/etc/ceph/ceph.conf 2024-05-14T15:06:57.464 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: Updating smithi203:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:06:57.464 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:06:57.464 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.464 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: Updating smithi203:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T15:06:57.464 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='client.14188 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi069:172.21.15.69=a;smithi092:172.21.15.92=b;smithi203:172.21.15.203=c", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:06:57.464 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: Saving service mon spec with placement smithi069:172.21.15.69=a;smithi092:172.21.15.92=b;smithi203:172.21.15.203=c;count:3 2024-05-14T15:06:57.464 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.464 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.464 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.464 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.464 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T15:06:57.464 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:06:57.464 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: Deploying daemon mon.c on smithi203 2024-05-14T15:06:57.464 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.464 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.465 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.465 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='client.? 172.21.15.203:0/4111444488' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T15:06:57.465 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.465 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:57.465 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:06:57.465 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.a calling monitor election 2024-05-14T15:06:57.465 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:57.465 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:57.465 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.465 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:57.465 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.c calling monitor election 2024-05-14T15:06:57.465 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:57.465 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.465 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:57.465 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:57.466 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-14T15:06:57.466 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: monmap epoch 2 2024-05-14T15:06:57.466 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: fsid 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:06:57.466 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: last_changed 2024-05-14T15:06:45.909586+0000 2024-05-14T15:06:57.466 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: created 2024-05-14T15:04:26.570547+0000 2024-05-14T15:06:57.466 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: min_mon_release 19 (squid) 2024-05-14T15:06:57.466 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: election_strategy: 1 2024-05-14T15:06:57.466 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-05-14T15:06:57.466 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-05-14T15:06:57.466 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: fsmap 2024-05-14T15:06:57.466 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T15:06:57.466 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mgrmap e13: x(active, since 69s) 2024-05-14T15:06:57.466 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: overall HEALTH_OK 2024-05-14T15:06:57.466 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.466 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:06:57.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T15:06:57.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:06:57.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: Deploying daemon mon.b on smithi092 2024-05-14T15:06:57.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:06:57.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='client.? 172.21.15.203:0/1142918047' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T15:06:57.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:06:57.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: from='client.? 172.21.15.203:0/1838851352' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T15:06:57.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:06:57 smithi092 ceph-mon[34729]: mon.b@-1(synchronizing).paxosservice(auth 1..4) refresh upgraded, format 0 -> 3 2024-05-14T15:06:58.455 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-14T15:06:58.455 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph mon dump -f json 2024-05-14T15:06:58.869 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:07:02.503 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.509+0000 7f8836600700 1 -- 172.21.15.203:0/941967023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8830075d30 msgr2=0x7f8830076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:02.503 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.509+0000 7f8836600700 1 --2- 172.21.15.203:0/941967023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8830075d30 0x7f8830076140 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f8818005fa0 tx=0x7f881800fe80 comp rx=0 tx=0).stop 2024-05-14T15:07:02.503 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.510+0000 7f8836600700 1 -- 172.21.15.203:0/941967023 shutdown_connections 2024-05-14T15:07:02.503 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.510+0000 7f8836600700 1 --2- 172.21.15.203:0/941967023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8830075d30 0x7f8830076140 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:02.503 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.510+0000 7f8836600700 1 -- 172.21.15.203:0/941967023 >> 172.21.15.203:0/941967023 conn(0x7f88300ff590 msgr2=0x7f88301019e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:07:02.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.510+0000 7f8836600700 1 -- 172.21.15.203:0/941967023 shutdown_connections 2024-05-14T15:07:02.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.510+0000 7f8836600700 1 -- 172.21.15.203:0/941967023 wait complete. 2024-05-14T15:07:02.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.512+0000 7f8836600700 1 Processor -- start 2024-05-14T15:07:02.504 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.512+0000 7f8836600700 1 -- start start 2024-05-14T15:07:02.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.513+0000 7f8836600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8830075d30 0x7f88301a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:02.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.513+0000 7f8836600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88301a1db0 0x7f883019ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:02.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.513+0000 7f8836600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f883019bfd0 0x7f883019c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:02.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.513+0000 7f8836600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f88301100c0 con 0x7f8830075d30 2024-05-14T15:07:02.505 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.513+0000 7f8836600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f883010ff40 con 0x7f883019bfd0 2024-05-14T15:07:02.506 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.513+0000 7f8836600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8830110240 con 0x7f88301a1db0 2024-05-14T15:07:02.507 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.513+0000 7f8827e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88301a1db0 0x7f883019ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:02.507 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.514+0000 7f8827e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88301a1db0 0x7f883019ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:52294/0 (socket says 172.21.15.203:52294) 2024-05-14T15:07:02.507 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.514+0000 7f8835200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8830075d30 0x7f88301a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:02.507 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.514+0000 7f8827e00700 1 -- 172.21.15.203:0/2909750271 learned_addr learned my addr 172.21.15.203:0/2909750271 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-05-14T15:07:02.507 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.514+0000 7f8835c00700 1 --2- 172.21.15.203:0/2909750271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f883019bfd0 0x7f883019c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:02.507 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.514+0000 7f8827e00700 1 -- 172.21.15.203:0/2909750271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f883019bfd0 msgr2=0x7f883019c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:02.507 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.514+0000 7f8827e00700 1 --2- 172.21.15.203:0/2909750271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f883019bfd0 0x7f883019c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:02.507 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.514+0000 7f8827e00700 1 -- 172.21.15.203:0/2909750271 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8830075d30 msgr2=0x7f88301a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:02.507 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.514+0000 7f8827e00700 1 --2- 172.21.15.203:0/2909750271 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8830075d30 0x7f88301a1870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:02.507 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.514+0000 7f8827e00700 1 -- 172.21.15.203:0/2909750271 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88301a8700 con 0x7f88301a1db0 2024-05-14T15:07:02.507 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.515+0000 7f8827e00700 1 --2- 172.21.15.203:0/2909750271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88301a1db0 0x7f883019ba90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f882000b780 tx=0x7f882000ba90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:07:02.508 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.515+0000 7f882e000700 1 -- 172.21.15.203:0/2909750271 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8820004230 con 0x7f88301a1db0 2024-05-14T15:07:02.508 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.515+0000 7f882e000700 1 -- 172.21.15.203:0/2909750271 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f88200043d0 con 0x7f88301a1db0 2024-05-14T15:07:02.508 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.515+0000 7f882e000700 1 -- 172.21.15.203:0/2909750271 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8820011a60 con 0x7f88301a1db0 2024-05-14T15:07:02.508 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.515+0000 7f8836600700 1 -- 172.21.15.203:0/2909750271 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88301a8990 con 0x7f88301a1db0 2024-05-14T15:07:02.508 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.515+0000 7f8836600700 1 -- 172.21.15.203:0/2909750271 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88301a8ef0 con 0x7f88301a1db0 2024-05-14T15:07:02.509 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.517+0000 7f882e000700 1 -- 172.21.15.203:0/2909750271 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f8820011c00 con 0x7f88301a1db0 2024-05-14T15:07:02.509 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.517+0000 7f8836600700 1 -- 172.21.15.203:0/2909750271 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8830064e20 con 0x7f88301a1db0 2024-05-14T15:07:02.510 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.517+0000 7f882e000700 1 --2- 172.21.15.203:0/2909750271 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f881003e9a0 0x7f8810040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:02.510 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.518+0000 7f882e000700 1 -- 172.21.15.203:0/2909750271 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f8820052390 con 0x7f88301a1db0 2024-05-14T15:07:02.510 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.518+0000 7f8835200700 1 --2- 172.21.15.203:0/2909750271 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f881003e9a0 0x7f8810040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:02.511 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.519+0000 7f8835200700 1 --2- 172.21.15.203:0/2909750271 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f881003e9a0 0x7f8810040eb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8818005fd0 tx=0x7f881801e040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:07:02.517 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.525+0000 7f882e000700 1 -- 172.21.15.203:0/2909750271 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f88200193a0 con 0x7f88301a1db0 2024-05-14T15:07:02.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:07:02.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: mon.a calling monitor election 2024-05-14T15:07:02.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: mon.c calling monitor election 2024-05-14T15:07:02.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:07:02.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:02.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: mon.b calling monitor election 2024-05-14T15:07:02.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:02.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:02.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-14T15:07:02.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: monmap epoch 3 2024-05-14T15:07:02.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: fsid 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:07:02.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: last_changed 2024-05-14T15:06:57.259815+0000 2024-05-14T15:07:02.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: created 2024-05-14T15:04:26.570547+0000 2024-05-14T15:07:02.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: min_mon_release 19 (squid) 2024-05-14T15:07:02.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: election_strategy: 1 2024-05-14T15:07:02.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-05-14T15:07:02.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-05-14T15:07:02.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: 2: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.b 2024-05-14T15:07:02.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: fsmap 2024-05-14T15:07:02.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T15:07:02.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: mgrmap e13: x(active, since 80s) 2024-05-14T15:07:02.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: overall HEALTH_OK 2024-05-14T15:07:02.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:02.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:02.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:02.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:07:02.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: mon.a calling monitor election 2024-05-14T15:07:02.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: mon.c calling monitor election 2024-05-14T15:07:02.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:07:02.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:02.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: mon.b calling monitor election 2024-05-14T15:07:02.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:02.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:02.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-14T15:07:02.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: monmap epoch 3 2024-05-14T15:07:02.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: fsid 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:07:02.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: last_changed 2024-05-14T15:06:57.259815+0000 2024-05-14T15:07:02.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: created 2024-05-14T15:04:26.570547+0000 2024-05-14T15:07:02.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: min_mon_release 19 (squid) 2024-05-14T15:07:02.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: election_strategy: 1 2024-05-14T15:07:02.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-05-14T15:07:02.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-05-14T15:07:02.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: 2: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.b 2024-05-14T15:07:02.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: fsmap 2024-05-14T15:07:02.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T15:07:02.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: mgrmap e13: x(active, since 80s) 2024-05-14T15:07:02.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: overall HEALTH_OK 2024-05-14T15:07:02.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:02.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:02.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:02.836 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:07:02.836 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: mon.a calling monitor election 2024-05-14T15:07:02.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: mon.c calling monitor election 2024-05-14T15:07:02.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:07:02.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:02.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: mon.b calling monitor election 2024-05-14T15:07:02.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:02.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:02.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:02.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-14T15:07:02.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: monmap epoch 3 2024-05-14T15:07:02.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: fsid 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:07:02.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: last_changed 2024-05-14T15:06:57.259815+0000 2024-05-14T15:07:02.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: created 2024-05-14T15:04:26.570547+0000 2024-05-14T15:07:02.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: min_mon_release 19 (squid) 2024-05-14T15:07:02.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: election_strategy: 1 2024-05-14T15:07:02.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: 0: [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] mon.a 2024-05-14T15:07:02.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: 1: [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] mon.c 2024-05-14T15:07:02.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: 2: [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] mon.b 2024-05-14T15:07:02.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: fsmap 2024-05-14T15:07:02.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: osdmap e4: 0 total, 0 up, 0 in 2024-05-14T15:07:02.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: mgrmap e13: x(active, since 80s) 2024-05-14T15:07:02.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: overall HEALTH_OK 2024-05-14T15:07:02.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:02.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:02.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:02.843 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.851+0000 7f8836600700 1 -- 172.21.15.203:0/2909750271 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f88301a91b0 con 0x7f88301a1db0 2024-05-14T15:07:02.844 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.852+0000 7f882e000700 1 -- 172.21.15.203:0/2909750271 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1281 (secure 0 0 0) 0x7f8820040090 con 0x7f88301a1db0 2024-05-14T15:07:02.844 INFO:teuthology.orchestra.run.smithi203.stdout: 2024-05-14T15:07:02.844 INFO:teuthology.orchestra.run.smithi203.stdout:{"epoch":3,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","modified":"2024-05-14T15:06:57.259815Z","created":"2024-05-14T15:04:26.570547Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:3300","nonce":0},{"type":"v1","addr":"172.21.15.69:6789","nonce":0}]},"addr":"172.21.15.69:6789/0","public_addr":"172.21.15.69:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:3300","nonce":0},{"type":"v1","addr":"172.21.15.203:6789","nonce":0}]},"addr":"172.21.15.203:6789/0","public_addr":"172.21.15.203:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:3300","nonce":0},{"type":"v1","addr":"172.21.15.92:6789","nonce":0}]},"addr":"172.21.15.92:6789/0","public_addr":"172.21.15.92:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-14T15:07:02.847 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.855+0000 7f8836600700 1 -- 172.21.15.203:0/2909750271 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f881003e9a0 msgr2=0x7f8810040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:02.847 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.855+0000 7f8836600700 1 --2- 172.21.15.203:0/2909750271 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f881003e9a0 0x7f8810040eb0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8818005fd0 tx=0x7f881801e040 comp rx=0 tx=0).stop 2024-05-14T15:07:02.847 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.855+0000 7f8836600700 1 -- 172.21.15.203:0/2909750271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88301a1db0 msgr2=0x7f883019ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:02.847 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.855+0000 7f8836600700 1 --2- 172.21.15.203:0/2909750271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88301a1db0 0x7f883019ba90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f882000b780 tx=0x7f882000ba90 comp rx=0 tx=0).stop 2024-05-14T15:07:02.848 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.855+0000 7f8836600700 1 -- 172.21.15.203:0/2909750271 shutdown_connections 2024-05-14T15:07:02.848 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.855+0000 7f8836600700 1 --2- 172.21.15.203:0/2909750271 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8830075d30 0x7f88301a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:02.848 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.855+0000 7f8836600700 1 --2- 172.21.15.203:0/2909750271 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f881003e9a0 0x7f8810040eb0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:02.848 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.855+0000 7f8836600700 1 --2- 172.21.15.203:0/2909750271 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f883019bfd0 0x7f883019c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:02.848 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.855+0000 7f8836600700 1 --2- 172.21.15.203:0/2909750271 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f88301a1db0 0x7f883019ba90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:02.848 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.855+0000 7f8836600700 1 -- 172.21.15.203:0/2909750271 >> 172.21.15.203:0/2909750271 conn(0x7f88300ff590 msgr2=0x7f883010c410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:07:02.848 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.855+0000 7f8836600700 1 -- 172.21.15.203:0/2909750271 shutdown_connections 2024-05-14T15:07:02.848 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:02.855+0000 7f8836600700 1 -- 172.21.15.203:0/2909750271 wait complete. 2024-05-14T15:07:02.849 INFO:teuthology.orchestra.run.smithi203.stderr:dumped monmap epoch 3 2024-05-14T15:07:03.434 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:03 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:03.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:03 smithi092 ceph-mon[34729]: from='client.? 172.21.15.203:0/2909750271' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T15:07:03.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:03 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:03.574 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:03 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:03.574 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:03 smithi203 ceph-mon[34567]: from='client.? 172.21.15.203:0/2909750271' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T15:07:03.574 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:03 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:03.627 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-14T15:07:03.627 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph config generate-minimal-conf 2024-05-14T15:07:03.690 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:03 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:03.690 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:03 smithi069 ceph-mon[31270]: from='client.? 172.21.15.203:0/2909750271' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-14T15:07:03.690 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:03 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:07:04.052 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:07:04.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:04 smithi069 ceph-mon[31270]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:04.657 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:04 smithi203 ceph-mon[34567]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:04.684 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:04 smithi092 ceph-mon[34729]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:05.698 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:05.698 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:05.698 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:05.698 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:05.698 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:05.698 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:05.698 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:05 smithi069 ceph-mon[31270]: Updating smithi069:/etc/ceph/ceph.conf 2024-05-14T15:07:05.698 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:05 smithi069 ceph-mon[31270]: Updating smithi092:/etc/ceph/ceph.conf 2024-05-14T15:07:05.699 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:05 smithi069 ceph-mon[31270]: Updating smithi203:/etc/ceph/ceph.conf 2024-05-14T15:07:05.934 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:05.935 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:05.935 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:05.935 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:05.935 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:05.935 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:05.935 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:05 smithi092 ceph-mon[34729]: Updating smithi069:/etc/ceph/ceph.conf 2024-05-14T15:07:05.935 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:05 smithi092 ceph-mon[34729]: Updating smithi092:/etc/ceph/ceph.conf 2024-05-14T15:07:05.935 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:05 smithi092 ceph-mon[34729]: Updating smithi203:/etc/ceph/ceph.conf 2024-05-14T15:07:06.086 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:06.086 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:06.086 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:06.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:06.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:06.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:06.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:05 smithi203 ceph-mon[34567]: Updating smithi069:/etc/ceph/ceph.conf 2024-05-14T15:07:06.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:05 smithi203 ceph-mon[34567]: Updating smithi092:/etc/ceph/ceph.conf 2024-05-14T15:07:06.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:05 smithi203 ceph-mon[34567]: Updating smithi203:/etc/ceph/ceph.conf 2024-05-14T15:07:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.429+0000 7ff28b000700 1 -- 172.21.15.69:0/2815398980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28410a3d0 msgr2=0x7ff28410a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.429+0000 7ff28b000700 1 --2- 172.21.15.69:0/2815398980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28410a3d0 0x7ff28410a7e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff274009910 tx=0x7ff274009c20 comp rx=0 tx=0).stop 2024-05-14T15:07:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.429+0000 7ff28b000700 1 -- 172.21.15.69:0/2815398980 shutdown_connections 2024-05-14T15:07:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.429+0000 7ff28b000700 1 --2- 172.21.15.69:0/2815398980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff28410a3d0 0x7ff28410a7e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.429+0000 7ff28b000700 1 -- 172.21.15.69:0/2815398980 >> 172.21.15.69:0/2815398980 conn(0x7ff2840799f0 msgr2=0x7ff2841085e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:07:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.429+0000 7ff28b000700 1 -- 172.21.15.69:0/2815398980 shutdown_connections 2024-05-14T15:07:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.429+0000 7ff28b000700 1 -- 172.21.15.69:0/2815398980 wait complete. 2024-05-14T15:07:06.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.430+0000 7ff28b000700 1 Processor -- start 2024-05-14T15:07:06.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.430+0000 7ff28b000700 1 -- start start 2024-05-14T15:07:06.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.431+0000 7ff28b000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff28410a3d0 0x7ff2841a0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:06.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.431+0000 7ff28b000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2841a0740 0x7ff2841a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:06.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.431+0000 7ff28b000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2841a4f70 0x7ff2841a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:06.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.431+0000 7ff28b000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff284114570 con 0x7ff2841a4f70 2024-05-14T15:07:06.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.431+0000 7ff28b000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff2841143f0 con 0x7ff2841a0740 2024-05-14T15:07:06.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.431+0000 7ff28b000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff2841146f0 con 0x7ff28410a3d0 2024-05-14T15:07:06.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.431+0000 7ff289000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2841a4f70 0x7ff2841a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:06.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.431+0000 7ff289000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2841a4f70 0x7ff2841a5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47830/0 (socket says 172.21.15.69:47830) 2024-05-14T15:07:06.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.431+0000 7ff289000700 1 -- 172.21.15.69:0/2853786174 learned_addr learned my addr 172.21.15.69:0/2853786174 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:07:06.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.431+0000 7ff283e00700 1 --2- 172.21.15.69:0/2853786174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff28410a3d0 0x7ff2841a0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:06.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.431+0000 7ff283400700 1 --2- 172.21.15.69:0/2853786174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2841a0740 0x7ff2841a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:06.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.432+0000 7ff289000700 1 -- 172.21.15.69:0/2853786174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff28410a3d0 msgr2=0x7ff2841a0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:06.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.432+0000 7ff289000700 1 --2- 172.21.15.69:0/2853786174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff28410a3d0 0x7ff2841a0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:06.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.432+0000 7ff289000700 1 -- 172.21.15.69:0/2853786174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2841a0740 msgr2=0x7ff2841a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:06.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.432+0000 7ff289000700 1 --2- 172.21.15.69:0/2853786174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2841a0740 0x7ff2841a4a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:06.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.432+0000 7ff289000700 1 -- 172.21.15.69:0/2853786174 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2841acce0 con 0x7ff2841a4f70 2024-05-14T15:07:06.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.432+0000 7ff289000700 1 --2- 172.21.15.69:0/2853786174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2841a4f70 0x7ff2841a5380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00ba50 tx=0x7ff27c00bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:07:06.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.432+0000 7ff280c00700 1 -- 172.21.15.69:0/2853786174 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c019070 con 0x7ff2841a4f70 2024-05-14T15:07:06.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.432+0000 7ff280c00700 1 -- 172.21.15.69:0/2853786174 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff27c00ce40 con 0x7ff2841a4f70 2024-05-14T15:07:06.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.432+0000 7ff28b000700 1 -- 172.21.15.69:0/2853786174 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2841acf10 con 0x7ff2841a4f70 2024-05-14T15:07:06.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.432+0000 7ff280c00700 1 -- 172.21.15.69:0/2853786174 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27c007350 con 0x7ff2841a4f70 2024-05-14T15:07:06.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.433+0000 7ff28b000700 1 -- 172.21.15.69:0/2853786174 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2841ad360 con 0x7ff2841a4f70 2024-05-14T15:07:06.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.434+0000 7ff28b000700 1 -- 172.21.15.69:0/2853786174 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff284064e20 con 0x7ff2841a4f70 2024-05-14T15:07:06.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.434+0000 7ff280c00700 1 -- 172.21.15.69:0/2853786174 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7ff27c01c070 con 0x7ff2841a4f70 2024-05-14T15:07:06.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.434+0000 7ff280c00700 1 --2- 172.21.15.69:0/2853786174 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff26803e9a0 0x7ff268040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:06.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.435+0000 7ff280c00700 1 -- 172.21.15.69:0/2853786174 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff27c051e30 con 0x7ff2841a4f70 2024-05-14T15:07:06.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.435+0000 7ff283e00700 1 --2- 172.21.15.69:0/2853786174 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff26803e9a0 0x7ff268040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:06.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.436+0000 7ff283e00700 1 --2- 172.21.15.69:0/2853786174 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff26803e9a0 0x7ff268040eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff27400b5c0 tx=0x7ff274005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:07:06.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.441+0000 7ff280c00700 1 -- 172.21.15.69:0/2853786174 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff27c014440 con 0x7ff2841a4f70 2024-05-14T15:07:06.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.676+0000 7ff28b000700 1 -- 172.21.15.69:0/2853786174 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7ff2841ad7b0 con 0x7ff2841a4f70 2024-05-14T15:07:06.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.677+0000 7ff280c00700 1 -- 172.21.15.69:0/2853786174 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+273 (secure 0 0 0) 0x7ff27c007d90 con 0x7ff2841a4f70 2024-05-14T15:07:06.670 INFO:teuthology.orchestra.run.smithi069.stdout:# minimal ceph.conf for 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:07:06.670 INFO:teuthology.orchestra.run.smithi069.stdout:[global] 2024-05-14T15:07:06.670 INFO:teuthology.orchestra.run.smithi069.stdout: fsid = 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:07:06.670 INFO:teuthology.orchestra.run.smithi069.stdout: mon_host = [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] 2024-05-14T15:07:06.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.681+0000 7ff28b000700 1 -- 172.21.15.69:0/2853786174 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff26803e9a0 msgr2=0x7ff268040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:06.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.681+0000 7ff28b000700 1 --2- 172.21.15.69:0/2853786174 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff26803e9a0 0x7ff268040eb0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff27400b5c0 tx=0x7ff274005fb0 comp rx=0 tx=0).stop 2024-05-14T15:07:06.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.681+0000 7ff28b000700 1 -- 172.21.15.69:0/2853786174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2841a4f70 msgr2=0x7ff2841a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:06.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.681+0000 7ff28b000700 1 --2- 172.21.15.69:0/2853786174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2841a4f70 0x7ff2841a5380 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7ff27c00ba50 tx=0x7ff27c00bd60 comp rx=0 tx=0).stop 2024-05-14T15:07:06.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.681+0000 7ff28b000700 1 -- 172.21.15.69:0/2853786174 shutdown_connections 2024-05-14T15:07:06.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.681+0000 7ff28b000700 1 --2- 172.21.15.69:0/2853786174 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2841a4f70 0x7ff2841a5380 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:06.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.681+0000 7ff28b000700 1 --2- 172.21.15.69:0/2853786174 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff26803e9a0 0x7ff268040eb0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:06.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.681+0000 7ff28b000700 1 --2- 172.21.15.69:0/2853786174 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff28410a3d0 0x7ff2841a0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:06.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.681+0000 7ff28b000700 1 --2- 172.21.15.69:0/2853786174 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2841a0740 0x7ff2841a4a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:06.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.681+0000 7ff28b000700 1 -- 172.21.15.69:0/2853786174 >> 172.21.15.69:0/2853786174 conn(0x7ff2840799f0 msgr2=0x7ff28410be10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:07:06.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.682+0000 7ff28b000700 1 -- 172.21.15.69:0/2853786174 shutdown_connections 2024-05-14T15:07:06.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:06.682+0000 7ff28b000700 1 -- 172.21.15.69:0/2853786174 wait complete. 2024-05-14T15:07:07.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:07.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: Updating smithi092:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:07:07.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: Updating smithi069:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:07:07.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: Updating smithi203:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:07:07.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2853786174' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:07.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T15:07:07.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T15:07:07.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:07.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:07.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: Updating smithi092:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:07:07.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: Updating smithi069:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:07:07.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: Updating smithi203:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:07:07.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2853786174' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:07.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T15:07:07.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T15:07:07.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:07.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:07.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: Updating smithi092:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:07:07.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: Updating smithi069:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:07:07.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: Updating smithi203:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:07:07.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.459 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2853786174' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:07.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:07.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T15:07:07.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T15:07:07.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:07.512 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-14T15:07:07.513 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:07:07.513 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.conf 2024-05-14T15:07:07.587 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:07:07.587 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:07:07.697 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-05-14T15:07:07.697 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.conf 2024-05-14T15:07:07.781 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-05-14T15:07:07.782 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:07:07.903 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-05-14T15:07:07.903 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.conf 2024-05-14T15:07:07.996 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-05-14T15:07:07.996 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:07:08.127 INFO:tasks.cephadm:Adding mgr.x on smithi069 2024-05-14T15:07:08.127 INFO:tasks.cephadm:Adding mgr.y on smithi092 2024-05-14T15:07:08.127 INFO:tasks.cephadm:Adding mgr.z on smithi203 2024-05-14T15:07:08.127 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch apply mgr '3;smithi069=x;smithi092=y;smithi203=z' 2024-05-14T15:07:08.246 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:08 smithi203 ceph-mon[34567]: Reconfiguring mon.a (unknown last config time)... 2024-05-14T15:07:08.246 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:08 smithi203 ceph-mon[34567]: Reconfiguring daemon mon.a on smithi069 2024-05-14T15:07:08.434 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:08 smithi092 ceph-mon[34729]: Reconfiguring mon.a (unknown last config time)... 2024-05-14T15:07:08.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:08 smithi092 ceph-mon[34729]: Reconfiguring daemon mon.a on smithi069 2024-05-14T15:07:08.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:08 smithi069 ceph-mon[31270]: Reconfiguring mon.a (unknown last config time)... 2024-05-14T15:07:08.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:08 smithi069 ceph-mon[31270]: Reconfiguring daemon mon.a on smithi069 2024-05-14T15:07:08.596 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:07:09.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:09 smithi069 ceph-mon[31270]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:09.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:09 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:09.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:09 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:09.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:09 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T15:07:09.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:09 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T15:07:09.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:09 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:09.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:09 smithi203 ceph-mon[34567]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:09.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:09 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:09.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:09 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:09.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:09 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T15:07:09.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:09 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T15:07:09.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:09 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:09.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:09 smithi092 ceph-mon[34729]: pgmap v37: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:09.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:09 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:09.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:09 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:09.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:09 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T15:07:09.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:09 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T15:07:09.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:09 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:10.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:10 smithi092 ceph-mon[34729]: Reconfiguring mon.b (monmap changed)... 2024-05-14T15:07:10.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:10 smithi092 ceph-mon[34729]: Reconfiguring daemon mon.b on smithi092 2024-05-14T15:07:10.246 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:10 smithi203 ceph-mon[34567]: Reconfiguring mon.b (monmap changed)... 2024-05-14T15:07:10.246 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:10 smithi203 ceph-mon[34567]: Reconfiguring daemon mon.b on smithi092 2024-05-14T15:07:10.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:10 smithi069 ceph-mon[31270]: Reconfiguring mon.b (monmap changed)... 2024-05-14T15:07:10.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:10 smithi069 ceph-mon[31270]: Reconfiguring daemon mon.b on smithi092 2024-05-14T15:07:10.849 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.855+0000 7f0ed9000700 1 -- 172.21.15.203:0/2055906985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed4077720 msgr2=0x7f0ed4075b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:10.849 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.855+0000 7f0ed9000700 1 --2- 172.21.15.203:0/2055906985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed4077720 0x7f0ed4075b50 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4009910 tx=0x7f0ec4009c20 comp rx=0 tx=0).stop 2024-05-14T15:07:10.849 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.855+0000 7f0ed9000700 1 -- 172.21.15.203:0/2055906985 shutdown_connections 2024-05-14T15:07:10.849 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.855+0000 7f0ed9000700 1 --2- 172.21.15.203:0/2055906985 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed4077720 0x7f0ed4075b50 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:10.849 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.855+0000 7f0ed9000700 1 -- 172.21.15.203:0/2055906985 >> 172.21.15.203:0/2055906985 conn(0x7f0ed40ff370 msgr2=0x7f0ed4101820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:07:10.850 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.855+0000 7f0ed9000700 1 -- 172.21.15.203:0/2055906985 shutdown_connections 2024-05-14T15:07:10.850 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.855+0000 7f0ed9000700 1 -- 172.21.15.203:0/2055906985 wait complete. 2024-05-14T15:07:10.850 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.857+0000 7f0ed9000700 1 Processor -- start 2024-05-14T15:07:10.850 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.857+0000 7f0ed9000700 1 -- start start 2024-05-14T15:07:10.852 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.857+0000 7f0ed9000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ed4077720 0x7f0ed419ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:10.852 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.857+0000 7f0ed9000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ed419bfd0 0x7f0ed41a0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:10.852 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.857+0000 7f0ed9000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed41a14a0 0x7f0ed41a38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:10.852 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.857+0000 7f0ed9000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed410bd40 con 0x7f0ed41a14a0 2024-05-14T15:07:10.852 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.857+0000 7f0ed9000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed410bbc0 con 0x7f0ed419bfd0 2024-05-14T15:07:10.852 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.857+0000 7f0ed9000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0ed410bec0 con 0x7f0ed4077720 2024-05-14T15:07:10.852 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.858+0000 7f0ed1e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ed4077720 0x7f0ed419ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:10.852 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.858+0000 7f0ed1e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ed4077720 0x7f0ed419ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:52304/0 (socket says 172.21.15.203:52304) 2024-05-14T15:07:10.853 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.858+0000 7f0ed1e00700 1 -- 172.21.15.203:0/580491495 learned_addr learned my addr 172.21.15.203:0/580491495 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-05-14T15:07:10.853 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.858+0000 7f0ed2800700 1 --2- 172.21.15.203:0/580491495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed41a14a0 0x7f0ed41a38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:10.853 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.858+0000 7f0ed1e00700 1 -- 172.21.15.203:0/580491495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ed419bfd0 msgr2=0x7f0ed41a0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:10.853 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.858+0000 7f0ed1e00700 1 --2- 172.21.15.203:0/580491495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ed419bfd0 0x7f0ed41a0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:10.853 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.858+0000 7f0ed1e00700 1 -- 172.21.15.203:0/580491495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed41a14a0 msgr2=0x7f0ed41a38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:10.853 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.858+0000 7f0ed1e00700 1 --2- 172.21.15.203:0/580491495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed41a14a0 0x7f0ed41a38c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:10.853 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.858+0000 7f0ed1e00700 1 -- 172.21.15.203:0/580491495 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ed41a3e30 con 0x7f0ed4077720 2024-05-14T15:07:10.853 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.859+0000 7f0ed1e00700 1 --2- 172.21.15.203:0/580491495 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ed4077720 0x7f0ed419ba90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4004f90 tx=0x7f0ec4004790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:07:10.854 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.859+0000 7f0ecaa00700 1 -- 172.21.15.203:0/580491495 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4027070 con 0x7f0ed4077720 2024-05-14T15:07:10.854 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.859+0000 7f0ed9000700 1 -- 172.21.15.203:0/580491495 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ed41a40c0 con 0x7f0ed4077720 2024-05-14T15:07:10.855 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.859+0000 7f0ecaa00700 1 -- 172.21.15.203:0/580491495 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0ec400bdf0 con 0x7f0ed4077720 2024-05-14T15:07:10.855 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.859+0000 7f0ecaa00700 1 -- 172.21.15.203:0/580491495 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ec4022de0 con 0x7f0ed4077720 2024-05-14T15:07:10.855 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.859+0000 7f0ed9000700 1 -- 172.21.15.203:0/580491495 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ed41a4620 con 0x7f0ed4077720 2024-05-14T15:07:10.855 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.860+0000 7f0ecaa00700 1 -- 172.21.15.203:0/580491495 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f0ec402a070 con 0x7f0ed4077720 2024-05-14T15:07:10.855 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.861+0000 7f0ed9000700 1 -- 172.21.15.203:0/580491495 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ed4064e20 con 0x7f0ed4077720 2024-05-14T15:07:10.855 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.861+0000 7f0ecaa00700 1 --2- 172.21.15.203:0/580491495 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0eb803e9a0 0x7f0eb8040eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:10.855 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.861+0000 7f0ecaa00700 1 -- 172.21.15.203:0/580491495 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0ec4053af0 con 0x7f0ed4077720 2024-05-14T15:07:10.855 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.862+0000 7f0ed1400700 1 --2- 172.21.15.203:0/580491495 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0eb803e9a0 0x7f0eb8040eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:10.857 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.863+0000 7f0ed1400700 1 --2- 172.21.15.203:0/580491495 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0eb803e9a0 0x7f0eb8040eb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0ed419cb40 tx=0x7f0ec0006dd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:07:10.861 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:10.868+0000 7f0ecaa00700 1 -- 172.21.15.203:0/580491495 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0ec4013070 con 0x7f0ed4077720 2024-05-14T15:07:11.110 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:11.116+0000 7f0ed9000700 1 -- 172.21.15.203:0/580491495 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi069=x;smithi092=y;smithi203=z", "target": ["mon-mgr", ""]}) -- 0x7f0ed4101200 con 0x7f0eb803e9a0 2024-05-14T15:07:11.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:11 smithi203 ceph-mon[34567]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:11.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:11.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:11.110 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T15:07:11.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T15:07:11.111 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:11.124 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:11.131+0000 7f0ecaa00700 1 -- 172.21.15.203:0/580491495 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f0ed4101200 con 0x7f0eb803e9a0 2024-05-14T15:07:11.125 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mgr update... 2024-05-14T15:07:11.128 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:11.134+0000 7f0ed9000700 1 -- 172.21.15.203:0/580491495 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0eb803e9a0 msgr2=0x7f0eb8040eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:11.128 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:11.134+0000 7f0ed9000700 1 --2- 172.21.15.203:0/580491495 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0eb803e9a0 0x7f0eb8040eb0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f0ed419cb40 tx=0x7f0ec0006dd0 comp rx=0 tx=0).stop 2024-05-14T15:07:11.128 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:11.134+0000 7f0ed9000700 1 -- 172.21.15.203:0/580491495 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ed4077720 msgr2=0x7f0ed419ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:11.128 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:11.134+0000 7f0ed9000700 1 --2- 172.21.15.203:0/580491495 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ed4077720 0x7f0ed419ba90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0ec4004f90 tx=0x7f0ec4004790 comp rx=0 tx=0).stop 2024-05-14T15:07:11.128 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:11.134+0000 7f0ed9000700 1 -- 172.21.15.203:0/580491495 shutdown_connections 2024-05-14T15:07:11.128 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:11.134+0000 7f0ed9000700 1 --2- 172.21.15.203:0/580491495 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0ed41a14a0 0x7f0ed41a38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:11.128 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:11.134+0000 7f0ed9000700 1 --2- 172.21.15.203:0/580491495 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0eb803e9a0 0x7f0eb8040eb0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:11.128 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:11.134+0000 7f0ed9000700 1 --2- 172.21.15.203:0/580491495 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0ed4077720 0x7f0ed419ba90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:11.128 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:11.134+0000 7f0ed9000700 1 --2- 172.21.15.203:0/580491495 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0ed419bfd0 0x7f0ed41a0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:11.128 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:11.134+0000 7f0ed9000700 1 -- 172.21.15.203:0/580491495 >> 172.21.15.203:0/580491495 conn(0x7f0ed40ff370 msgr2=0x7f0ed4100af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:07:11.129 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:11.135+0000 7f0ed9000700 1 -- 172.21.15.203:0/580491495 shutdown_connections 2024-05-14T15:07:11.129 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:07:11.135+0000 7f0ed9000700 1 -- 172.21.15.203:0/580491495 wait complete. 2024-05-14T15:07:11.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:11 smithi092 ceph-mon[34729]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:11.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:11.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:11.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T15:07:11.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T15:07:11.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:11.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:11 smithi069 ceph-mon[31270]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:11.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:11.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:11.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-14T15:07:11.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-14T15:07:11.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:11.852 DEBUG:teuthology.orchestra.run.smithi092:mgr.y> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mgr.y.service 2024-05-14T15:07:11.859 DEBUG:teuthology.orchestra.run.smithi203:mgr.z> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mgr.z.service 2024-05-14T15:07:11.864 INFO:tasks.cephadm:Deploying OSDs... 2024-05-14T15:07:11.864 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:07:11.865 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T15:07:11.922 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T15:07:11.922 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_1 2024-05-14T15:07:11.976 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T15:07:11.976 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:07:11.976 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 631 Links: 1 2024-05-14T15:07:11.976 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:07:11.977 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:07:11.977 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-05-14 15:05:55.636897331 +0000 2024-05-14T15:07:11.977 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-05-14 15:00:14.613888481 +0000 2024-05-14T15:07:11.977 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-05-14 15:00:14.613888481 +0000 2024-05-14T15:07:11.977 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-05-14 15:00:14.613888481 +0000 2024-05-14T15:07:11.977 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T15:07:12.060 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2024-05-14T15:07:12.060 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2024-05-14T15:07:12.060 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000373557 s, 1.4 MB/s 2024-05-14T15:07:12.063 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T15:07:12.122 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_2 2024-05-14T15:07:12.174 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T15:07:12.174 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:07:12.174 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-05-14T15:07:12.174 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:07:12.174 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:07:12.174 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-05-14 15:05:55.688896178 +0000 2024-05-14T15:07:12.174 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-05-14 15:00:15.225874987 +0000 2024-05-14T15:07:12.175 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-05-14 15:00:15.225874987 +0000 2024-05-14T15:07:12.175 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-05-14 15:00:15.225874987 +0000 2024-05-14T15:07:12.175 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T15:07:12.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:12 smithi092 ceph-mon[34729]: Reconfiguring mon.c (monmap changed)... 2024-05-14T15:07:12.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:12 smithi092 ceph-mon[34729]: Reconfiguring daemon mon.c on smithi203 2024-05-14T15:07:12.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:12 smithi092 ceph-mon[34729]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi069=x;smithi092=y;smithi203=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:07:12.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:12 smithi092 ceph-mon[34729]: Saving service mgr spec with placement smithi069=x;smithi092=y;smithi203=z;count:3 2024-05-14T15:07:12.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:12 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:12.250 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2024-05-14T15:07:12.251 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2024-05-14T15:07:12.251 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.0004818 s, 1.1 MB/s 2024-05-14T15:07:12.255 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T15:07:12.311 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_3 2024-05-14T15:07:12.361 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T15:07:12.361 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:07:12.361 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 670 Links: 1 2024-05-14T15:07:12.361 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:07:12.361 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:07:12.361 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-05-14 15:05:55.741895003 +0000 2024-05-14T15:07:12.361 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-05-14 15:00:15.812862043 +0000 2024-05-14T15:07:12.361 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-05-14 15:00:15.812862043 +0000 2024-05-14T15:07:12.361 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-05-14 15:00:15.812862043 +0000 2024-05-14T15:07:12.362 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T15:07:12.377 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:12 smithi203 ceph-mon[34567]: Reconfiguring mon.c (monmap changed)... 2024-05-14T15:07:12.377 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:12 smithi203 ceph-mon[34567]: Reconfiguring daemon mon.c on smithi203 2024-05-14T15:07:12.377 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:12 smithi203 ceph-mon[34567]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi069=x;smithi092=y;smithi203=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:07:12.377 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:12 smithi203 ceph-mon[34567]: Saving service mgr spec with placement smithi069=x;smithi092=y;smithi203=z;count:3 2024-05-14T15:07:12.377 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:12 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:12.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:12 smithi069 ceph-mon[31270]: Reconfiguring mon.c (monmap changed)... 2024-05-14T15:07:12.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:12 smithi069 ceph-mon[31270]: Reconfiguring daemon mon.c on smithi203 2024-05-14T15:07:12.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:12 smithi069 ceph-mon[31270]: from='client.24109 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi069=x;smithi092=y;smithi203=z", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:07:12.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:12 smithi069 ceph-mon[31270]: Saving service mgr spec with placement smithi069=x;smithi092=y;smithi203=z;count:3 2024-05-14T15:07:12.433 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:12 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:12.442 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2024-05-14T15:07:12.442 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2024-05-14T15:07:12.443 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000387576 s, 1.3 MB/s 2024-05-14T15:07:12.446 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T15:07:12.502 DEBUG:teuthology.orchestra.run.smithi069:> stat /dev/vg_nvme/lv_4 2024-05-14T15:07:12.552 INFO:teuthology.orchestra.run.smithi069.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T15:07:12.552 INFO:teuthology.orchestra.run.smithi069.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:07:12.552 INFO:teuthology.orchestra.run.smithi069.stdout:Device: 6h/6d Inode: 690 Links: 1 2024-05-14T15:07:12.552 INFO:teuthology.orchestra.run.smithi069.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:07:12.552 INFO:teuthology.orchestra.run.smithi069.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:07:12.553 INFO:teuthology.orchestra.run.smithi069.stdout:Access: 2024-05-14 15:05:55.785894027 +0000 2024-05-14T15:07:12.553 INFO:teuthology.orchestra.run.smithi069.stdout:Modify: 2024-05-14 15:00:16.392849254 +0000 2024-05-14T15:07:12.553 INFO:teuthology.orchestra.run.smithi069.stdout:Change: 2024-05-14 15:00:16.392849254 +0000 2024-05-14T15:07:12.553 INFO:teuthology.orchestra.run.smithi069.stdout: Birth: 2024-05-14 15:00:16.392849254 +0000 2024-05-14T15:07:12.553 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T15:07:12.628 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records in 2024-05-14T15:07:12.628 INFO:teuthology.orchestra.run.smithi069.stderr:1+0 records out 2024-05-14T15:07:12.628 INFO:teuthology.orchestra.run.smithi069.stderr:512 bytes copied, 0.000571636 s, 896 kB/s 2024-05-14T15:07:12.632 DEBUG:teuthology.orchestra.run.smithi069:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T15:07:12.684 DEBUG:teuthology.orchestra.run.smithi092:> set -ex 2024-05-14T15:07:12.684 DEBUG:teuthology.orchestra.run.smithi092:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T15:07:12.743 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T15:07:12.743 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_1 2024-05-14T15:07:12.794 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T15:07:12.794 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:07:12.794 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 632 Links: 1 2024-05-14T15:07:12.794 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:07:12.794 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:07:12.795 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-05-14 15:06:56.223962743 +0000 2024-05-14T15:07:12.795 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-05-14 15:00:15.302822227 +0000 2024-05-14T15:07:12.795 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-05-14 15:00:15.302822227 +0000 2024-05-14T15:07:12.795 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-05-14 15:00:15.302822227 +0000 2024-05-14T15:07:12.795 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T15:07:12.874 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-05-14T15:07:12.874 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-05-14T15:07:12.874 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000359986 s, 1.4 MB/s 2024-05-14T15:07:12.877 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T15:07:12.933 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_2 2024-05-14T15:07:12.981 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T15:07:12.981 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:07:12.981 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 653 Links: 1 2024-05-14T15:07:12.981 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:07:12.981 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:07:12.981 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-05-14 15:06:56.223962743 +0000 2024-05-14T15:07:12.981 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-05-14 15:00:15.882806079 +0000 2024-05-14T15:07:12.981 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-05-14 15:00:15.882806079 +0000 2024-05-14T15:07:12.982 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-05-14 15:00:15.882806079 +0000 2024-05-14T15:07:12.982 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T15:07:13.056 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-05-14T15:07:13.057 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-05-14T15:07:13.057 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000336411 s, 1.5 MB/s 2024-05-14T15:07:13.060 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T15:07:13.116 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_3 2024-05-14T15:07:13.165 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T15:07:13.165 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:07:13.166 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 672 Links: 1 2024-05-14T15:07:13.166 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:07:13.166 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:07:13.166 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-05-14 15:06:56.225962687 +0000 2024-05-14T15:07:13.166 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-05-14 15:00:16.481789401 +0000 2024-05-14T15:07:13.166 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-05-14 15:00:16.481789401 +0000 2024-05-14T15:07:13.166 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-05-14 15:00:16.481789401 +0000 2024-05-14T15:07:13.166 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T15:07:13.238 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-05-14T15:07:13.238 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-05-14T15:07:13.238 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000363936 s, 1.4 MB/s 2024-05-14T15:07:13.241 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T15:07:13.298 DEBUG:teuthology.orchestra.run.smithi092:> stat /dev/vg_nvme/lv_4 2024-05-14T15:07:13.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:13 smithi203 ceph-mon[34567]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:13.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:13 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:13.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:13 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:13.348 INFO:teuthology.orchestra.run.smithi092.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T15:07:13.348 INFO:teuthology.orchestra.run.smithi092.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:07:13.348 INFO:teuthology.orchestra.run.smithi092.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-05-14T15:07:13.348 INFO:teuthology.orchestra.run.smithi092.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:07:13.348 INFO:teuthology.orchestra.run.smithi092.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:07:13.348 INFO:teuthology.orchestra.run.smithi092.stdout:Access: 2024-05-14 15:06:56.225962687 +0000 2024-05-14T15:07:13.348 INFO:teuthology.orchestra.run.smithi092.stdout:Modify: 2024-05-14 15:00:17.063773197 +0000 2024-05-14T15:07:13.348 INFO:teuthology.orchestra.run.smithi092.stdout:Change: 2024-05-14 15:00:17.063773197 +0000 2024-05-14T15:07:13.348 INFO:teuthology.orchestra.run.smithi092.stdout: Birth: 2024-05-14 15:00:17.063773197 +0000 2024-05-14T15:07:13.349 DEBUG:teuthology.orchestra.run.smithi092:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T15:07:13.416 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:13 smithi092 ceph-mon[34729]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:13.416 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:13 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:13.417 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:13 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:13.424 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records in 2024-05-14T15:07:13.424 INFO:teuthology.orchestra.run.smithi092.stderr:1+0 records out 2024-05-14T15:07:13.425 INFO:teuthology.orchestra.run.smithi092.stderr:512 bytes copied, 0.000340202 s, 1.5 MB/s 2024-05-14T15:07:13.429 DEBUG:teuthology.orchestra.run.smithi092:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T15:07:13.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:13 smithi069 ceph-mon[31270]: pgmap v39: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:13.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:13 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:13.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:13 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:13.482 DEBUG:teuthology.orchestra.run.smithi203:> set -ex 2024-05-14T15:07:13.482 DEBUG:teuthology.orchestra.run.smithi203:> dd if=/scratch_devs of=/dev/stdout 2024-05-14T15:07:13.539 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-14T15:07:13.539 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_1 2024-05-14T15:07:13.584 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-14T15:07:13.584 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:07:13.584 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 6h/6d Inode: 634 Links: 1 2024-05-14T15:07:13.585 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:07:13.585 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:07:13.585 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-05-14 15:06:44.284620899 +0000 2024-05-14T15:07:13.585 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-05-14 15:00:16.956223476 +0000 2024-05-14T15:07:13.585 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-05-14 15:00:16.956223476 +0000 2024-05-14T15:07:13.585 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-05-14 15:00:16.956223476 +0000 2024-05-14T15:07:13.585 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-14T15:07:13.704 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-05-14T15:07:13.704 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-05-14T15:07:13.704 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000343473 s, 1.5 MB/s 2024-05-14T15:07:13.708 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-14T15:07:13.758 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_2 2024-05-14T15:07:13.801 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-14T15:07:13.802 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:07:13.802 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 6h/6d Inode: 651 Links: 1 2024-05-14T15:07:13.802 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:07:13.802 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:07:13.802 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-05-14 15:06:44.286620851 +0000 2024-05-14T15:07:13.802 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-05-14 15:00:17.594208333 +0000 2024-05-14T15:07:13.802 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-05-14 15:00:17.594208333 +0000 2024-05-14T15:07:13.802 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-05-14 15:00:17.594208333 +0000 2024-05-14T15:07:13.802 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-14T15:07:13.908 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-05-14T15:07:13.909 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-05-14T15:07:13.909 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000299648 s, 1.7 MB/s 2024-05-14T15:07:13.911 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-14T15:07:13.954 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_3 2024-05-14T15:07:14.040 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-14T15:07:14.040 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:07:14.040 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 6h/6d Inode: 669 Links: 1 2024-05-14T15:07:14.040 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:07:14.040 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:07:14.040 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-05-14 15:06:44.287620828 +0000 2024-05-14T15:07:14.040 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-05-14 15:00:18.226193332 +0000 2024-05-14T15:07:14.040 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-05-14 15:00:18.226193332 +0000 2024-05-14T15:07:14.041 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-05-14 15:00:18.226193332 +0000 2024-05-14T15:07:14.041 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-14T15:07:14.140 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-05-14T15:07:14.141 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-05-14T15:07:14.141 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.00031343 s, 1.6 MB/s 2024-05-14T15:07:14.144 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-14T15:07:14.188 DEBUG:teuthology.orchestra.run.smithi203:> stat /dev/vg_nvme/lv_4 2024-05-14T15:07:14.282 INFO:teuthology.orchestra.run.smithi203.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-14T15:07:14.282 INFO:teuthology.orchestra.run.smithi203.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-14T15:07:14.282 INFO:teuthology.orchestra.run.smithi203.stdout:Device: 6h/6d Inode: 688 Links: 1 2024-05-14T15:07:14.282 INFO:teuthology.orchestra.run.smithi203.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-14T15:07:14.283 INFO:teuthology.orchestra.run.smithi203.stdout:Context: system_u:object_r:device_t:s0 2024-05-14T15:07:14.283 INFO:teuthology.orchestra.run.smithi203.stdout:Access: 2024-05-14 15:06:44.288620804 +0000 2024-05-14T15:07:14.283 INFO:teuthology.orchestra.run.smithi203.stdout:Modify: 2024-05-14 15:00:18.826179091 +0000 2024-05-14T15:07:14.283 INFO:teuthology.orchestra.run.smithi203.stdout:Change: 2024-05-14 15:00:18.826179091 +0000 2024-05-14T15:07:14.283 INFO:teuthology.orchestra.run.smithi203.stdout: Birth: 2024-05-14 15:00:18.826179091 +0000 2024-05-14T15:07:14.283 DEBUG:teuthology.orchestra.run.smithi203:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-14T15:07:14.367 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records in 2024-05-14T15:07:14.367 INFO:teuthology.orchestra.run.smithi203.stderr:1+0 records out 2024-05-14T15:07:14.367 INFO:teuthology.orchestra.run.smithi203.stderr:512 bytes copied, 0.000337923 s, 1.5 MB/s 2024-05-14T15:07:14.371 DEBUG:teuthology.orchestra.run.smithi203:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-14T15:07:14.387 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:14 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:14.387 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:14 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:14.387 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:14 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:14.387 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:14 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:14.387 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:14 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T15:07:14.387 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:14 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T15:07:14.387 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:14 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T15:07:14.387 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:14 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:14.420 INFO:tasks.cephadm:Deploying osd.0 on smithi069 with /dev/vg_nvme/lv_4... 2024-05-14T15:07:14.420 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-14T15:07:14.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:14 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:14.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:14 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:14.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:14 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:14.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:14 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:14.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:14 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T15:07:14.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:14 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T15:07:14.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:14 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T15:07:14.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:14 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:14.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:14 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:14.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:14 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:14.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:14 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:14.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:14 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:14.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:14 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T15:07:14.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:14 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T15:07:14.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:14 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T15:07:14.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:14 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:14.838 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:07:15.326 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:15 smithi069 ceph-mon[31270]: Deploying daemon mgr.z on smithi203 2024-05-14T15:07:15.326 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:15 smithi069 ceph-mon[31270]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:15.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:15 smithi092 ceph-mon[34729]: Deploying daemon mgr.z on smithi203 2024-05-14T15:07:15.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:15 smithi092 ceph-mon[34729]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:15.586 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:15 smithi203 ceph-mon[34567]: Deploying daemon mgr.z on smithi203 2024-05-14T15:07:15.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:15 smithi203 ceph-mon[34567]: pgmap v40: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:16.337 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:16 smithi203 systemd[1]: Starting Ceph mgr.z for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:07:16.642 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:16 smithi203 podman[36546]: 2024-05-14 15:07:16.268573904 +0000 UTC m=+0.031953505 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:07:16.642 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:16 smithi203 podman[36546]: 2024-05-14 15:07:16.379402743 +0000 UTC m=+0.142782388 container create 2f68526f6c2f8dbfa11cd7232a38601e4ae676252a767c202a0c210d92a7a440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:07:16.643 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:16 smithi203 podman[36546]: 2024-05-14 15:07:16.649612623 +0000 UTC m=+0.412992288 container init 2f68526f6c2f8dbfa11cd7232a38601e4ae676252a767c202a0c210d92a7a440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux ) 2024-05-14T15:07:16.983 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:16 smithi203 podman[36546]: 2024-05-14 15:07:16.659604579 +0000 UTC m=+0.422984185 container start 2f68526f6c2f8dbfa11cd7232a38601e4ae676252a767c202a0c210d92a7a440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-14T15:07:16.983 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:16 smithi203 bash[36546]: 2f68526f6c2f8dbfa11cd7232a38601e4ae676252a767c202a0c210d92a7a440 2024-05-14T15:07:16.983 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:16 smithi203 systemd[1]: Started Ceph mgr.z for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:07:16.983 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:16 smithi203 ceph-mgr[36564]: -- 172.21.15.203:0/157351824 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56209ed3a5a0 con 0x5620a3ac4480 2024-05-14T15:07:17.239 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:17 smithi203 ceph-mon[34567]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:17.239 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:17.239 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:17.239 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:17.239 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T15:07:17.239 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T15:07:17.239 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T15:07:17.239 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:17.239 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:16.988+0000 7f3c759b1200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T15:07:17.240 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:17.244+0000 7f3c759b1200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:07:17.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:17 smithi092 ceph-mon[34729]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:17.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:17.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:17.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:17.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T15:07:17.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T15:07:17.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T15:07:17.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:17.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:17 smithi069 ceph-mon[31270]: pgmap v41: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:17.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:17.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:17.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:17.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T15:07:17.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-14T15:07:17.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T15:07:17.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:17.586 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:17.377+0000 7f3c759b1200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T15:07:17.708 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-14T15:07:17.708 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-14T15:07:17.708 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2024-05-14T15:07:17.709 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2024-05-14T15:07:17.709 INFO:teuthology.orchestra.run.smithi069.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0367968 s, 285 MB/s 2024-05-14T15:07:17.709 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2024-05-14T15:07:18.087 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:17.777+0000 7f3c759b1200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T15:07:18.087 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:17.893+0000 7f3c759b1200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T15:07:18.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:18 smithi092 ceph-mon[34729]: Deploying daemon mgr.y on smithi092 2024-05-14T15:07:18.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:18 smithi069 ceph-mon[31270]: Deploying daemon mgr.y on smithi092 2024-05-14T15:07:18.569 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi069:vg_nvme/lv_4 2024-05-14T15:07:18.586 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:18 smithi203 ceph-mon[34567]: Deploying daemon mgr.y on smithi092 2024-05-14T15:07:19.046 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:07:19.434 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:19 smithi092 ceph-mon[34729]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:19.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:19 smithi069 ceph-mon[31270]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:19.476 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:19 smithi203 ceph-mon[34567]: pgmap v42: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:19.837 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:19.482+0000 7f3c759b1200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T15:07:19.837 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:19.711+0000 7f3c759b1200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T15:07:19.935 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:19 smithi092 systemd[1]: Starting Ceph mgr.y for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:07:20.264 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:20 smithi092 podman[36088]: 2024-05-14 15:07:19.927392174 +0000 UTC m=+0.047110635 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:07:20.264 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:20 smithi092 podman[36088]: 2024-05-14 15:07:20.049907288 +0000 UTC m=+0.169625746 container create 408ee8c8735f9984f892e58278f70988c502f626c21c6dd4c21d87a4e1512da8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-14T15:07:20.264 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:20 smithi092 podman[36088]: 2024-05-14 15:07:20.270489587 +0000 UTC m=+0.390208052 container init 408ee8c8735f9984f892e58278f70988c502f626c21c6dd4c21d87a4e1512da8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-14T15:07:20.317 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:19.938+0000 7f3c759b1200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T15:07:20.317 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:20.322+0000 7f3c759b1200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T15:07:20.585 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:20 smithi092 podman[36088]: 2024-05-14 15:07:20.27962597 +0000 UTC m=+0.399344421 container start 408ee8c8735f9984f892e58278f70988c502f626c21c6dd4c21d87a4e1512da8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-14T15:07:20.585 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:20 smithi092 bash[36088]: 408ee8c8735f9984f892e58278f70988c502f626c21c6dd4c21d87a4e1512da8 2024-05-14T15:07:20.586 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:20 smithi092 systemd[1]: Started Ceph mgr.y for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:07:20.586 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:20 smithi092 ceph-mgr[36107]: -- 172.21.15.92:0/1693253610 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e4c39f45a0 con 0x55e4c8788000 2024-05-14T15:07:20.586 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:20.448+0000 7f3c759b1200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T15:07:20.848 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:20 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:20.591+0000 7ff4babe0200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T15:07:20.848 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:20 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:20.854+0000 7ff4babe0200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:07:20.959 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:20.709+0000 7f3c759b1200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T15:07:21.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.159+0000 7f3816600700 1 -- 172.21.15.69:0/3470817267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3810107680 msgr2=0x7f3810107a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:21.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.159+0000 7f3816600700 1 --2- 172.21.15.69:0/3470817267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3810107680 0x7f3810107a90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f37fc009990 tx=0x7f37fc009ca0 comp rx=0 tx=0).stop 2024-05-14T15:07:21.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.159+0000 7f3816600700 1 -- 172.21.15.69:0/3470817267 shutdown_connections 2024-05-14T15:07:21.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.159+0000 7f3816600700 1 --2- 172.21.15.69:0/3470817267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3810108020 0x7f381010e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:21.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.159+0000 7f3816600700 1 --2- 172.21.15.69:0/3470817267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3810106550 0x7f3810106960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:21.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.159+0000 7f3816600700 1 --2- 172.21.15.69:0/3470817267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3810107680 0x7f3810107a90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:21.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.159+0000 7f3816600700 1 -- 172.21.15.69:0/3470817267 >> 172.21.15.69:0/3470817267 conn(0x7f3810101bd0 msgr2=0x7f3810104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:07:21.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.159+0000 7f3816600700 1 -- 172.21.15.69:0/3470817267 shutdown_connections 2024-05-14T15:07:21.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.159+0000 7f3816600700 1 -- 172.21.15.69:0/3470817267 wait complete. 2024-05-14T15:07:21.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.160+0000 7f3816600700 1 Processor -- start 2024-05-14T15:07:21.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.160+0000 7f3816600700 1 -- start start 2024-05-14T15:07:21.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.161+0000 7f3816600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3810106550 0x7f381019ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:21.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.161+0000 7f3816600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3810107680 0x7f381019cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:21.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.161+0000 7f3816600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3810108020 0x7f38101a3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:21.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.161+0000 7f3816600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3810111ee0 con 0x7f3810108020 2024-05-14T15:07:21.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.161+0000 7f3816600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3810111d60 con 0x7f3810106550 2024-05-14T15:07:21.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.161+0000 7f3816600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3810112060 con 0x7f3810107680 2024-05-14T15:07:21.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.161+0000 7f380f400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3810106550 0x7f381019ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:21.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.161+0000 7f380f400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3810106550 0x7f381019ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:52580/0 (socket says 172.21.15.69:52580) 2024-05-14T15:07:21.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.161+0000 7f380f400700 1 -- 172.21.15.69:0/572899438 learned_addr learned my addr 172.21.15.69:0/572899438 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:07:21.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.161+0000 7f380ea00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3810107680 0x7f381019cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:21.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.161+0000 7f380fe00700 1 --2- 172.21.15.69:0/572899438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3810108020 0x7f38101a3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:21.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.162+0000 7f380f400700 1 -- 172.21.15.69:0/572899438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3810107680 msgr2=0x7f381019cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:21.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.162+0000 7f380f400700 1 --2- 172.21.15.69:0/572899438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3810107680 0x7f381019cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:21.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.162+0000 7f380f400700 1 -- 172.21.15.69:0/572899438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3810108020 msgr2=0x7f38101a3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:21.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.162+0000 7f380f400700 1 --2- 172.21.15.69:0/572899438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3810108020 0x7f38101a3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:21.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.162+0000 7f380f400700 1 -- 172.21.15.69:0/572899438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38101a45e0 con 0x7f3810106550 2024-05-14T15:07:21.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.163+0000 7f380f400700 1 --2- 172.21.15.69:0/572899438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3810106550 0x7f381019ca80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f380000e940 tx=0x7f380000ec50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:07:21.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.163+0000 7f3807e00700 1 -- 172.21.15.69:0/572899438 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3800004220 con 0x7f3810106550 2024-05-14T15:07:21.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.163+0000 7f3807e00700 1 -- 172.21.15.69:0/572899438 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f38000043c0 con 0x7f3810106550 2024-05-14T15:07:21.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.163+0000 7f3816600700 1 -- 172.21.15.69:0/572899438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38101a48d0 con 0x7f3810106550 2024-05-14T15:07:21.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.163+0000 7f3807e00700 1 -- 172.21.15.69:0/572899438 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3800003bf0 con 0x7f3810106550 2024-05-14T15:07:21.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.164+0000 7f3816600700 1 -- 172.21.15.69:0/572899438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38101a4e90 con 0x7f3810106550 2024-05-14T15:07:21.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.165+0000 7f3816600700 1 -- 172.21.15.69:0/572899438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38100512c0 con 0x7f3810106550 2024-05-14T15:07:21.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.165+0000 7f3807e00700 1 -- 172.21.15.69:0/572899438 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 13) ==== 50278+0+0 (secure 0 0 0) 0x7f3800021440 con 0x7f3810106550 2024-05-14T15:07:21.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.166+0000 7f3807e00700 1 --2- 172.21.15.69:0/572899438 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f37f403e750 0x7f37f4040c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:21.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.166+0000 7f3807e00700 1 -- 172.21.15.69:0/572899438 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3800052b40 con 0x7f3810106550 2024-05-14T15:07:21.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.166+0000 7f380ea00700 1 --2- 172.21.15.69:0/572899438 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f37f403e750 0x7f37f4040c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:21.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.166+0000 7f380ea00700 1 --2- 172.21.15.69:0/572899438 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f37f403e750 0x7f37f4040c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00b650 tx=0x7f37fc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:07:21.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.176+0000 7f3807e00700 1 -- 172.21.15.69:0/572899438 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3800016950 con 0x7f3810106550 2024-05-14T15:07:21.169 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:20 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:20.997+0000 7ff4babe0200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T15:07:21.336 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:20.966+0000 7f3c759b1200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:07:21.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:21 smithi203 ceph-mon[34567]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:21.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:21 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:21.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:21 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:21.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:21 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:21.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:21 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:21.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:21 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:21.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:21.420+0000 7f3816600700 1 -- 172.21.15.69:0/572899438 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3810063cc0 con 0x7f37f403e750 2024-05-14T15:07:21.415 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:21 smithi069 ceph-mon[31270]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:21.415 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:21 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:21.415 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:21 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:21.415 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:21 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:21.415 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:21 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:21.415 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:21 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:21.421 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:21 smithi092 ceph-mon[34729]: pgmap v43: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:21.421 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:21 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:21.421 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:21 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:21.421 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:21 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:21.421 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:21 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:21.422 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:21 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:21.684 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:21 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:21.427+0000 7ff4babe0200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T15:07:21.685 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:21 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:21.548+0000 7ff4babe0200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T15:07:22.086 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:21.813+0000 7f3c759b1200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T15:07:22.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:22 smithi092 ceph-mon[34729]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:22.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:22 smithi092 ceph-mon[34729]: from='client.34115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:07:22.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:22 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:07:22.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:22 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:07:22.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:22 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:22.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:22 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:22.453 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:22.109+0000 7f3c759b1200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T15:07:22.454 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:22 smithi203 ceph-mon[34567]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:22.454 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:22 smithi203 ceph-mon[34567]: from='client.34115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:07:22.454 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:22 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:07:22.454 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:22 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:07:22.454 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:22 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:22.454 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:22 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:22.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:22 smithi069 ceph-mon[31270]: pgmap v44: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:22.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:22 smithi069 ceph-mon[31270]: from='client.34115 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:07:22.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:22 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:07:22.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:22 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:07:22.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:22 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:22.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:22 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:22.826 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:22.685+0000 7f3c759b1200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T15:07:23.086 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:22.832+0000 7f3c759b1200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T15:07:23.586 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:23.308+0000 7f3c759b1200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T15:07:23.652 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:23 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:23.198+0000 7ff4babe0200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T15:07:23.652 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:23 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:23.438+0000 7ff4babe0200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T15:07:23.652 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:23 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:23.659+0000 7ff4babe0200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T15:07:23.935 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:23 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:23.935 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:23 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:23.935 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:23 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:23.935 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:23 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:24.086 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:23 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:24.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:23 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:24.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:23 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:24.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:23 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:24.087 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:23.757+0000 7f3c759b1200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T15:07:24.087 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:23.885+0000 7f3c759b1200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T15:07:24.103 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:23 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:24.103 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:23 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:24.103 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:23 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:24.104 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:23 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:24.435 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:24 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:24.066+0000 7ff4babe0200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T15:07:24.435 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:24 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:24.194+0000 7ff4babe0200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T15:07:24.522 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:24 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:24.213+0000 7f3c759b1200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T15:07:24.522 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:24 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:24.399+0000 7f3c759b1200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T15:07:24.522 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:24 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:24.527+0000 7f3c759b1200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T15:07:24.694 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:24 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:24.446+0000 7ff4babe0200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T15:07:24.694 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:24 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:24.700+0000 7ff4babe0200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:07:25.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:24 smithi092 ceph-mon[34729]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:25.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:25.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:25.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:25.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T15:07:25.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T15:07:25.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:25.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:24 smithi069 ceph-mon[31270]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:25.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:25.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:25.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:25.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T15:07:25.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T15:07:25.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:25.337 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:24 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:24.961+0000 7f3c759b1200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T15:07:25.337 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:25 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:25.087+0000 7f3c759b1200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T15:07:25.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:24 smithi203 ceph-mon[34567]: pgmap v45: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:25.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:25.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:25.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:25.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-14T15:07:25.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-14T15:07:25.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:25.771 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:25 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:25.492+0000 7ff4babe0200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T15:07:25.771 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:25 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:25.777+0000 7ff4babe0200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T15:07:26.135 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:25 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:25.855+0000 7f3c759b1200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T15:07:26.135 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:25 smithi203 ceph-mon[34567]: Reconfiguring mgr.x (unknown last config time)... 2024-05-14T15:07:26.135 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:25 smithi203 ceph-mon[34567]: Reconfiguring daemon mgr.x on smithi069 2024-05-14T15:07:26.135 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:25 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/4149486884' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8640de99-c23a-494e-a100-aafd04fe1867"}]: dispatch 2024-05-14T15:07:26.136 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:25 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/4149486884' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8640de99-c23a-494e-a100-aafd04fe1867"}]': finished 2024-05-14T15:07:26.136 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:25 smithi203 ceph-mon[34567]: osdmap e5: 1 total, 0 up, 1 in 2024-05-14T15:07:26.136 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:25 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:26.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:25 smithi092 ceph-mon[34729]: Reconfiguring mgr.x (unknown last config time)... 2024-05-14T15:07:26.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:25 smithi092 ceph-mon[34729]: Reconfiguring daemon mgr.x on smithi069 2024-05-14T15:07:26.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:25 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/4149486884' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8640de99-c23a-494e-a100-aafd04fe1867"}]: dispatch 2024-05-14T15:07:26.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:25 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/4149486884' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8640de99-c23a-494e-a100-aafd04fe1867"}]': finished 2024-05-14T15:07:26.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:25 smithi092 ceph-mon[34729]: osdmap e5: 1 total, 0 up, 1 in 2024-05-14T15:07:26.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:25 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:26.194 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:25 smithi069 ceph-mon[31270]: Reconfiguring mgr.x (unknown last config time)... 2024-05-14T15:07:26.194 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:25 smithi069 ceph-mon[31270]: Reconfiguring daemon mgr.x on smithi069 2024-05-14T15:07:26.194 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:25 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/4149486884' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8640de99-c23a-494e-a100-aafd04fe1867"}]: dispatch 2024-05-14T15:07:26.194 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:25 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/4149486884' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8640de99-c23a-494e-a100-aafd04fe1867"}]': finished 2024-05-14T15:07:26.194 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:25 smithi069 ceph-mon[31270]: osdmap e5: 1 total, 0 up, 1 in 2024-05-14T15:07:26.194 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:25 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:26.587 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:07:26 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:07:26.139+0000 7f3c759b1200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T15:07:26.685 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:26 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:26.333+0000 7ff4babe0200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T15:07:26.685 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:26 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:26.460+0000 7ff4babe0200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T15:07:26.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:26.966+0000 7f3807e00700 1 -- 172.21.15.69:0/572899438 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mgrmap(e 14) ==== 99937+0+0 (secure 0 0 0) 0x7f3800007d10 con 0x7f3810106550 2024-05-14T15:07:27.042 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:26 smithi203 ceph-mon[34567]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:27.042 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:26 smithi203 ceph-mon[34567]: Standby manager daemon z started 2024-05-14T15:07:27.042 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:26 smithi203 ceph-mon[34567]: from='mgr.? 172.21.15.203:0/2395527779' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-14T15:07:27.042 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:26 smithi203 ceph-mon[34567]: from='mgr.? 172.21.15.203:0/2395527779' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T15:07:27.042 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:26 smithi203 ceph-mon[34567]: from='mgr.? 172.21.15.203:0/2395527779' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-14T15:07:27.042 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:26 smithi203 ceph-mon[34567]: from='mgr.? 172.21.15.203:0/2395527779' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T15:07:27.042 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:26 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1328754033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:07:27.185 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:26 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:26.939+0000 7ff4babe0200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T15:07:27.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:26 smithi092 ceph-mon[34729]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:27.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:26 smithi092 ceph-mon[34729]: Standby manager daemon z started 2024-05-14T15:07:27.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:26 smithi092 ceph-mon[34729]: from='mgr.? 172.21.15.203:0/2395527779' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-14T15:07:27.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:26 smithi092 ceph-mon[34729]: from='mgr.? 172.21.15.203:0/2395527779' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T15:07:27.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:26 smithi092 ceph-mon[34729]: from='mgr.? 172.21.15.203:0/2395527779' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-14T15:07:27.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:26 smithi092 ceph-mon[34729]: from='mgr.? 172.21.15.203:0/2395527779' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T15:07:27.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:26 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1328754033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:07:27.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:26 smithi069 ceph-mon[31270]: pgmap v46: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:27.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:26 smithi069 ceph-mon[31270]: Standby manager daemon z started 2024-05-14T15:07:27.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:26 smithi069 ceph-mon[31270]: from='mgr.? 172.21.15.203:0/2395527779' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-14T15:07:27.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:26 smithi069 ceph-mon[31270]: from='mgr.? 172.21.15.203:0/2395527779' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T15:07:27.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:26 smithi069 ceph-mon[31270]: from='mgr.? 172.21.15.203:0/2395527779' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-14T15:07:27.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:26 smithi069 ceph-mon[31270]: from='mgr.? 172.21.15.203:0/2395527779' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T15:07:27.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:26 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1328754033' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:07:27.685 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:27 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:27.391+0000 7ff4babe0200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T15:07:27.685 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:27 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:27.515+0000 7ff4babe0200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T15:07:28.143 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:27 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:27.838+0000 7ff4babe0200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T15:07:28.143 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:28 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:28.021+0000 7ff4babe0200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T15:07:28.143 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:28 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:28.149+0000 7ff4babe0200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T15:07:28.143 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:27 smithi092 ceph-mon[34729]: mgrmap e14: x(active, since 105s), standbys: z 2024-05-14T15:07:28.143 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:27 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-14T15:07:28.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:27 smithi069 ceph-mon[31270]: mgrmap e14: x(active, since 105s), standbys: z 2024-05-14T15:07:28.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:27 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-14T15:07:28.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:27 smithi203 ceph-mon[34567]: mgrmap e14: x(active, since 105s), standbys: z 2024-05-14T15:07:28.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:27 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-14T15:07:28.935 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:28 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:28.549+0000 7ff4babe0200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T15:07:28.935 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:28 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:28.676+0000 7ff4babe0200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T15:07:29.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:28 smithi203 ceph-mon[34567]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:29.433 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:28 smithi092 ceph-mon[34729]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:29.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:28 smithi069 ceph-mon[31270]: pgmap v48: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:29.685 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:29 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:29.439+0000 7ff4babe0200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T15:07:29.971 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:07:29 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:07:29.726+0000 7ff4babe0200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T15:07:30.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:30.005+0000 7f3807e00700 1 -- 172.21.15.69:0/572899438 <== mon.2 v2:172.21.15.92:3300/0 8 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f380000fce0 con 0x7f3810106550 2024-05-14T15:07:30.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:29 smithi203 ceph-mon[34567]: Standby manager daemon y started 2024-05-14T15:07:30.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:29 smithi203 ceph-mon[34567]: from='mgr.? 172.21.15.92:0/494553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-14T15:07:30.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:29 smithi203 ceph-mon[34567]: from='mgr.? 172.21.15.92:0/494553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T15:07:30.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:29 smithi203 ceph-mon[34567]: from='mgr.? 172.21.15.92:0/494553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-14T15:07:30.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:29 smithi203 ceph-mon[34567]: from='mgr.? 172.21.15.92:0/494553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T15:07:30.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:29 smithi092 ceph-mon[34729]: Standby manager daemon y started 2024-05-14T15:07:30.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:29 smithi092 ceph-mon[34729]: from='mgr.? 172.21.15.92:0/494553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-14T15:07:30.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:29 smithi092 ceph-mon[34729]: from='mgr.? 172.21.15.92:0/494553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T15:07:30.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:29 smithi092 ceph-mon[34729]: from='mgr.? 172.21.15.92:0/494553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-14T15:07:30.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:29 smithi092 ceph-mon[34729]: from='mgr.? 172.21.15.92:0/494553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T15:07:30.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:29 smithi069 ceph-mon[31270]: Standby manager daemon y started 2024-05-14T15:07:30.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:29 smithi069 ceph-mon[31270]: from='mgr.? 172.21.15.92:0/494553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-14T15:07:30.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:29 smithi069 ceph-mon[31270]: from='mgr.? 172.21.15.92:0/494553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T15:07:30.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:29 smithi069 ceph-mon[31270]: from='mgr.? 172.21.15.92:0/494553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-14T15:07:30.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:29 smithi069 ceph-mon[31270]: from='mgr.? 172.21.15.92:0/494553872' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T15:07:31.093 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:30 smithi069 ceph-mon[31270]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:31.093 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:30 smithi069 ceph-mon[31270]: mgrmap e15: x(active, since 108s), standbys: z, y 2024-05-14T15:07:31.093 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:30 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-14T15:07:31.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:30 smithi203 ceph-mon[34567]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:31.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:30 smithi203 ceph-mon[34567]: mgrmap e15: x(active, since 108s), standbys: z, y 2024-05-14T15:07:31.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:30 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-14T15:07:31.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:30 smithi092 ceph-mon[34729]: pgmap v49: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:31.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:30 smithi092 ceph-mon[34729]: mgrmap e15: x(active, since 108s), standbys: z, y 2024-05-14T15:07:31.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:30 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-14T15:07:33.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:33 smithi069 ceph-mon[31270]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:33.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:33.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:33.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:33.269 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:33 smithi092 ceph-mon[34729]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:33.269 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:33.269 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:33.269 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:33.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:33 smithi203 ceph-mon[34567]: pgmap v50: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:33.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:33.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:33.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:34.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:34.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:34.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:34.290 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:34.290 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:34.290 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:34.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:34.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:34.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:35.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:35 smithi092 ceph-mon[34729]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:35.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:35 smithi069 ceph-mon[31270]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:35.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:35 smithi203 ceph-mon[34567]: pgmap v51: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:36.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:36 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-14T15:07:36.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:36 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:36.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:36 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-14T15:07:36.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:36 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:36.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:36 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-14T15:07:36.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:36 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:37.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:37 smithi203 ceph-mon[34567]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:37.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:37 smithi203 ceph-mon[34567]: Deploying daemon osd.0 on smithi069 2024-05-14T15:07:37.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:37 smithi092 ceph-mon[34729]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:37.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:37 smithi092 ceph-mon[34729]: Deploying daemon osd.0 on smithi069 2024-05-14T15:07:37.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:37 smithi069 ceph-mon[31270]: pgmap v52: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:37.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:37 smithi069 ceph-mon[31270]: Deploying daemon osd.0 on smithi069 2024-05-14T15:07:39.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:39 smithi203 ceph-mon[34567]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:39.377 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:39 smithi069 ceph-mon[31270]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:39.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:39 smithi092 ceph-mon[34729]: pgmap v53: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:41.322 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:41 smithi069 ceph-mon[31270]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:41.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:41 smithi203 ceph-mon[34567]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:41.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:41 smithi092 ceph-mon[34729]: pgmap v54: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:43.291 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:43 smithi069 ceph-mon[31270]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:43.336 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:43 smithi203 ceph-mon[34567]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:43.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:43 smithi092 ceph-mon[34729]: pgmap v55: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:45.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:45 smithi092 ceph-mon[34729]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:45.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:45 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:45.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:45 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:45.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:45 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:45.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:45 smithi203 ceph-mon[34567]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:45.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:45.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:45.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:45.395 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:45 smithi069 ceph-mon[31270]: pgmap v56: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:45.395 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:45 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:45.395 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:45 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:45.395 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:45 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:47.190 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:47 smithi069 ceph-mon[31270]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:47.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:47 smithi203 ceph-mon[34567]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:47.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:47 smithi092 ceph-mon[34729]: pgmap v57: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:49.326 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:49 smithi069 ceph-mon[31270]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:49.326 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:49.326 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:49.327 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:49.327 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:49.327 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:49.327 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:49 smithi069 ceph-mon[31270]: from='osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-14T15:07:49.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:49 smithi092 ceph-mon[34729]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:49.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:49.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:49.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:49.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:49.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:49.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:49 smithi092 ceph-mon[34729]: from='osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-14T15:07:49.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:49 smithi203 ceph-mon[34567]: pgmap v58: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:49.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:49.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:49.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:49.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:49.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:49.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:49 smithi203 ceph-mon[34567]: from='osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-14T15:07:50.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:50.243+0000 7f3807e00700 1 -- 172.21.15.69:0/572899438 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3810063cc0 con 0x7f37f403e750 2024-05-14T15:07:50.237 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 0 on host 'smithi069' 2024-05-14T15:07:50.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:50.249+0000 7f3816600700 1 -- 172.21.15.69:0/572899438 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f37f403e750 msgr2=0x7f37f4040c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:50.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:50.249+0000 7f3816600700 1 --2- 172.21.15.69:0/572899438 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f37f403e750 0x7f37f4040c60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00b650 tx=0x7f37fc01a040 comp rx=0 tx=0).stop 2024-05-14T15:07:50.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:50.249+0000 7f3816600700 1 -- 172.21.15.69:0/572899438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3810106550 msgr2=0x7f381019ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:50.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:50.249+0000 7f3816600700 1 --2- 172.21.15.69:0/572899438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3810106550 0x7f381019ca80 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f380000e940 tx=0x7f380000ec50 comp rx=0 tx=0).stop 2024-05-14T15:07:50.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:50.250+0000 7f3816600700 1 -- 172.21.15.69:0/572899438 shutdown_connections 2024-05-14T15:07:50.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:50.250+0000 7f3816600700 1 --2- 172.21.15.69:0/572899438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3810108020 0x7f38101a3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:50.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:50.250+0000 7f3816600700 1 --2- 172.21.15.69:0/572899438 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f37f403e750 0x7f37f4040c60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:50.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:50.250+0000 7f3816600700 1 --2- 172.21.15.69:0/572899438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3810106550 0x7f381019ca80 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:50.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:50.250+0000 7f3816600700 1 --2- 172.21.15.69:0/572899438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3810107680 0x7f381019cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:50.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:50.250+0000 7f3816600700 1 -- 172.21.15.69:0/572899438 >> 172.21.15.69:0/572899438 conn(0x7f3810101bd0 msgr2=0x7f381010a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:07:50.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:50.250+0000 7f3816600700 1 -- 172.21.15.69:0/572899438 shutdown_connections 2024-05-14T15:07:50.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:07:50.250+0000 7f3816600700 1 -- 172.21.15.69:0/572899438 wait complete. 2024-05-14T15:07:50.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:50 smithi092 ceph-mon[34729]: from='osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-14T15:07:50.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:50 smithi092 ceph-mon[34729]: osdmap e6: 1 total, 0 up, 1 in 2024-05-14T15:07:50.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:50 smithi092 ceph-mon[34729]: from='osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-05-14T15:07:50.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:50 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:50.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:50 smithi069 ceph-mon[31270]: from='osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-14T15:07:50.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:50 smithi069 ceph-mon[31270]: osdmap e6: 1 total, 0 up, 1 in 2024-05-14T15:07:50.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:50 smithi069 ceph-mon[31270]: from='osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-05-14T15:07:50.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:50 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:50.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:50 smithi203 ceph-mon[34567]: from='osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-14T15:07:50.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:50 smithi203 ceph-mon[34567]: osdmap e6: 1 total, 0 up, 1 in 2024-05-14T15:07:50.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:50 smithi203 ceph-mon[34567]: from='osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-05-14T15:07:50.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:50 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:51.120 DEBUG:teuthology.orchestra.run.smithi069:osd.0> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.0.service 2024-05-14T15:07:51.125 INFO:tasks.cephadm:Deploying osd.1 on smithi092 with /dev/vg_nvme/lv_4... 2024-05-14T15:07:51.126 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-14T15:07:51.392 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:51 smithi069 ceph-mon[31270]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:51.392 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:51 smithi069 ceph-mon[31270]: from='osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-05-14T15:07:51.392 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:51 smithi069 ceph-mon[31270]: osdmap e7: 1 total, 0 up, 1 in 2024-05-14T15:07:51.392 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:51 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:51.392 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:51 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:51.392 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:51 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:51.392 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:51 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:51.392 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:51 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:51.392 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:51 smithi069 ceph-mon[31270]: from='osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601]' entity='osd.0' 2024-05-14T15:07:51.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:51 smithi092 ceph-mon[34729]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:51.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:51 smithi092 ceph-mon[34729]: from='osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-05-14T15:07:51.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:51 smithi092 ceph-mon[34729]: osdmap e7: 1 total, 0 up, 1 in 2024-05-14T15:07:51.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:51 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:51.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:51 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:51.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:51 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:51.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:51 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:51.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:51 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:51.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:51 smithi092 ceph-mon[34729]: from='osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601]' entity='osd.0' 2024-05-14T15:07:51.540 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T15:07:51.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:51 smithi203 ceph-mon[34567]: pgmap v60: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:51.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:51 smithi203 ceph-mon[34567]: from='osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-05-14T15:07:51.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:51 smithi203 ceph-mon[34567]: osdmap e7: 1 total, 0 up, 1 in 2024-05-14T15:07:51.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:51 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:51.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:51 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:07:51.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:51 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:51.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:51 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:51.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:51 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:51.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:51 smithi203 ceph-mon[34567]: from='osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601]' entity='osd.0' 2024-05-14T15:07:52.435 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:52 smithi092 ceph-mon[34729]: purged_snaps scrub starts 2024-05-14T15:07:52.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:52 smithi092 ceph-mon[34729]: purged_snaps scrub ok 2024-05-14T15:07:52.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:52 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:52.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:52 smithi092 ceph-mon[34729]: osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601] boot 2024-05-14T15:07:52.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:52 smithi092 ceph-mon[34729]: osdmap e8: 1 total, 1 up, 1 in 2024-05-14T15:07:52.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:52 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:52.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:52 smithi069 ceph-mon[31270]: purged_snaps scrub starts 2024-05-14T15:07:52.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:52 smithi069 ceph-mon[31270]: purged_snaps scrub ok 2024-05-14T15:07:52.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:52 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:52.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:52 smithi069 ceph-mon[31270]: osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601] boot 2024-05-14T15:07:52.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:52 smithi069 ceph-mon[31270]: osdmap e8: 1 total, 1 up, 1 in 2024-05-14T15:07:52.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:52 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:52.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:52 smithi203 ceph-mon[34567]: purged_snaps scrub starts 2024-05-14T15:07:52.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:52 smithi203 ceph-mon[34567]: purged_snaps scrub ok 2024-05-14T15:07:52.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:52 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:52.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:52 smithi203 ceph-mon[34567]: osd.0 [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601] boot 2024-05-14T15:07:52.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:52 smithi203 ceph-mon[34567]: osdmap e8: 1 total, 1 up, 1 in 2024-05-14T15:07:52.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:52 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:07:53.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:53 smithi092 ceph-mon[34729]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:53.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:53 smithi069 ceph-mon[31270]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:53.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:53 smithi203 ceph-mon[34567]: pgmap v62: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-14T15:07:54.407 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-14T15:07:54.407 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-14T15:07:54.407 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2024-05-14T15:07:54.407 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2024-05-14T15:07:54.407 INFO:teuthology.orchestra.run.smithi092.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0372971 s, 281 MB/s 2024-05-14T15:07:54.407 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2024-05-14T15:07:54.455 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:54 smithi092 ceph-mon[34729]: osdmap e9: 1 total, 1 up, 1 in 2024-05-14T15:07:54.455 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:54 smithi092 ceph-mon[34729]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:07:54.465 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:54 smithi069 ceph-mon[31270]: osdmap e9: 1 total, 1 up, 1 in 2024-05-14T15:07:54.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:54 smithi069 ceph-mon[31270]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:07:54.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:54 smithi203 ceph-mon[34567]: osdmap e9: 1 total, 1 up, 1 in 2024-05-14T15:07:54.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:54 smithi203 ceph-mon[34567]: pgmap v65: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:07:55.245 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_4 2024-05-14T15:07:55.648 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T15:07:56.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:56 smithi092 ceph-mon[34729]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:07:56.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:56 smithi092 ceph-mon[34729]: Detected new or changed devices on smithi069 2024-05-14T15:07:56.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:56 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:56.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:56 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:56.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:56 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:07:56.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:56 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi069 to 17089M 2024-05-14T15:07:56.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:56 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:56.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:56 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:56.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:56 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:56.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:56 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:57.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:56 smithi203 ceph-mon[34567]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:07:57.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:56 smithi203 ceph-mon[34567]: Detected new or changed devices on smithi069 2024-05-14T15:07:57.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:56 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:57.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:56 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:57.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:56 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:07:57.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:56 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi069 to 17089M 2024-05-14T15:07:57.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:56 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:57.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:56 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:57.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:56 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:57.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:56 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:57.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:56 smithi069 ceph-mon[31270]: pgmap v66: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:07:57.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:56 smithi069 ceph-mon[31270]: Detected new or changed devices on smithi069 2024-05-14T15:07:57.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:56 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:57.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:56 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:57.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:56 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:07:57.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:56 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi069 to 17089M 2024-05-14T15:07:57.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:56 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:57.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:56 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:57.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:56 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:07:57.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:56 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:07:57.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.810+0000 7f2ecf600700 1 -- 172.21.15.92:0/1838618090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec810c420 msgr2=0x7f2ec8112cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:57.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.810+0000 7f2ecf600700 1 --2- 172.21.15.92:0/1838618090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec810c420 0x7f2ec8112cd0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2ec000b0a0 tx=0x7f2ec000b3b0 comp rx=0 tx=0).stop 2024-05-14T15:07:57.804 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.810+0000 7f2ecf600700 1 -- 172.21.15.92:0/1838618090 shutdown_connections 2024-05-14T15:07:57.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.810+0000 7f2ecf600700 1 --2- 172.21.15.92:0/1838618090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec810c420 0x7f2ec8112cd0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:57.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.810+0000 7f2ecf600700 1 --2- 172.21.15.92:0/1838618090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ec810ab10 0x7f2ec810af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:57.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.810+0000 7f2ecf600700 1 --2- 172.21.15.92:0/1838618090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ec810ba80 0x7f2ec810be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:57.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.810+0000 7f2ecf600700 1 -- 172.21.15.92:0/1838618090 >> 172.21.15.92:0/1838618090 conn(0x7f2ec80799c0 msgr2=0x7f2ec807be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:07:57.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.810+0000 7f2ecf600700 1 -- 172.21.15.92:0/1838618090 shutdown_connections 2024-05-14T15:07:57.805 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.810+0000 7f2ecf600700 1 -- 172.21.15.92:0/1838618090 wait complete. 2024-05-14T15:07:57.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.811+0000 7f2ecf600700 1 Processor -- start 2024-05-14T15:07:57.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.812+0000 7f2ecf600700 1 -- start start 2024-05-14T15:07:57.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.812+0000 7f2ecf600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ec810ab10 0x7f2ec81a0dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:57.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.812+0000 7f2ecf600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec810ba80 0x7f2ec81a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:57.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.812+0000 7f2ecf600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ec810c420 0x7f2ec81a8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:57.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.812+0000 7f2ecf600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec81162c0 con 0x7f2ec810ab10 2024-05-14T15:07:57.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.812+0000 7f2ecf600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec8116140 con 0x7f2ec810ba80 2024-05-14T15:07:57.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.812+0000 7f2ecf600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2ec8116440 con 0x7f2ec810c420 2024-05-14T15:07:57.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.812+0000 7f2ec7e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec810ba80 0x7f2ec81a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:57.807 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.812+0000 7f2ec7e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec810ba80 0x7f2ec81a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:55268/0 (socket says 172.21.15.92:55268) 2024-05-14T15:07:57.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.812+0000 7f2ec7e00700 1 -- 172.21.15.92:0/1571986761 learned_addr learned my addr 172.21.15.92:0/1571986761 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-05-14T15:07:57.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.812+0000 7f2eccc00700 1 --2- 172.21.15.92:0/1571986761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ec810ab10 0x7f2ec81a0dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:57.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.813+0000 7f2ecd600700 1 --2- 172.21.15.92:0/1571986761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ec810c420 0x7f2ec81a8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:57.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.813+0000 7f2ec7e00700 1 -- 172.21.15.92:0/1571986761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ec810c420 msgr2=0x7f2ec81a8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:57.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.813+0000 7f2ec7e00700 1 --2- 172.21.15.92:0/1571986761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ec810c420 0x7f2ec81a8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:57.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.813+0000 7f2ec7e00700 1 -- 172.21.15.92:0/1571986761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ec810ab10 msgr2=0x7f2ec81a0dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:07:57.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.813+0000 7f2ec7e00700 1 --2- 172.21.15.92:0/1571986761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ec810ab10 0x7f2ec81a0dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:07:57.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.813+0000 7f2ec7e00700 1 -- 172.21.15.92:0/1571986761 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ec81a8940 con 0x7f2ec810ba80 2024-05-14T15:07:57.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.813+0000 7f2eccc00700 1 --2- 172.21.15.92:0/1571986761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ec810ab10 0x7f2ec81a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:07:57.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.813+0000 7f2ec7e00700 1 --2- 172.21.15.92:0/1571986761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec810ba80 0x7f2ec81a1310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800d950 tx=0x7f2eb800dd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:07:57.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.813+0000 7f2ec5600700 1 -- 172.21.15.92:0/1571986761 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb8016070 con 0x7f2ec810ba80 2024-05-14T15:07:57.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.813+0000 7f2ec5600700 1 -- 172.21.15.92:0/1571986761 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2eb8010460 con 0x7f2ec810ba80 2024-05-14T15:07:57.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.813+0000 7f2ecf600700 1 -- 172.21.15.92:0/1571986761 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ec81a8c30 con 0x7f2ec810ba80 2024-05-14T15:07:57.808 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.814+0000 7f2ec5600700 1 -- 172.21.15.92:0/1571986761 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2eb800f620 con 0x7f2ec810ba80 2024-05-14T15:07:57.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.814+0000 7f2ecf600700 1 -- 172.21.15.92:0/1571986761 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ec81a9170 con 0x7f2ec810ba80 2024-05-14T15:07:57.809 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.815+0000 7f2ecf600700 1 -- 172.21.15.92:0/1571986761 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2ec80512c0 con 0x7f2ec810ba80 2024-05-14T15:07:57.810 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.817+0000 7f2ec5600700 1 -- 172.21.15.92:0/1571986761 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7f2eb8019070 con 0x7f2ec810ba80 2024-05-14T15:07:57.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.819+0000 7f2ec5600700 1 --2- 172.21.15.92:0/1571986761 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f2eb00b27f0 0x7f2eb00b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:07:57.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.820+0000 7f2ec5600700 1 -- 172.21.15.92:0/1571986761 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1767+0+0 (secure 0 0 0) 0x7f2eb80e0750 con 0x7f2ec810ba80 2024-05-14T15:07:57.813 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.820+0000 7f2eccc00700 1 --2- 172.21.15.92:0/1571986761 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f2eb00b27f0 0x7f2eb00b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:07:57.814 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.821+0000 7f2eccc00700 1 --2- 172.21.15.92:0/1571986761 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f2eb00b27f0 0x7f2eb00b4d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc005950 tx=0x7f2ebc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:07:57.819 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:57.825+0000 7f2ec5600700 1 -- 172.21.15.92:0/1571986761 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2eb80a9e40 con 0x7f2ec810ba80 2024-05-14T15:07:58.061 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:07:58.068+0000 7f2ecf600700 1 -- 172.21.15.92:0/1571986761 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f2ec8063c00 con 0x7f2eb00b27f0 2024-05-14T15:07:58.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:58 smithi069 ceph-mon[31270]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:07:58.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:58 smithi069 ceph-mon[31270]: from='client.34139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:07:58.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:07:58.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:07:58.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:07:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:59.027 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:58 smithi092 ceph-mon[34729]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:07:59.027 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:58 smithi092 ceph-mon[34729]: from='client.34139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:07:59.027 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:58 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:07:59.028 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:58 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:07:59.028 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:07:58 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:07:59.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:58 smithi203 ceph-mon[34567]: pgmap v67: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:07:59.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:58 smithi203 ceph-mon[34567]: from='client.34139 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:07:59.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:58 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:07:59.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:58 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:07:59.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:07:58 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:08:00.935 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:00 smithi092 ceph-mon[34729]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:01.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:00 smithi203 ceph-mon[34567]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:01.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:00 smithi069 ceph-mon[31270]: pgmap v68: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:03.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:02 smithi203 ceph-mon[34567]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:03.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:02 smithi203 ceph-mon[34567]: from='client.? 172.21.15.92:0/1913966999' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89f78a32-7afb-49f3-9287-5478a1cc8829"}]: dispatch 2024-05-14T15:08:03.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:02 smithi203 ceph-mon[34567]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89f78a32-7afb-49f3-9287-5478a1cc8829"}]: dispatch 2024-05-14T15:08:03.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:02 smithi203 ceph-mon[34567]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89f78a32-7afb-49f3-9287-5478a1cc8829"}]': finished 2024-05-14T15:08:03.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:02 smithi203 ceph-mon[34567]: osdmap e10: 2 total, 1 up, 2 in 2024-05-14T15:08:03.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:03.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:02 smithi092 ceph-mon[34729]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:03.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:02 smithi092 ceph-mon[34729]: from='client.? 172.21.15.92:0/1913966999' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89f78a32-7afb-49f3-9287-5478a1cc8829"}]: dispatch 2024-05-14T15:08:03.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:02 smithi092 ceph-mon[34729]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89f78a32-7afb-49f3-9287-5478a1cc8829"}]: dispatch 2024-05-14T15:08:03.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:02 smithi092 ceph-mon[34729]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89f78a32-7afb-49f3-9287-5478a1cc8829"}]': finished 2024-05-14T15:08:03.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:02 smithi092 ceph-mon[34729]: osdmap e10: 2 total, 1 up, 2 in 2024-05-14T15:08:03.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:03.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:02 smithi069 ceph-mon[31270]: pgmap v69: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:03.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:02 smithi069 ceph-mon[31270]: from='client.? 172.21.15.92:0/1913966999' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89f78a32-7afb-49f3-9287-5478a1cc8829"}]: dispatch 2024-05-14T15:08:03.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:02 smithi069 ceph-mon[31270]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "89f78a32-7afb-49f3-9287-5478a1cc8829"}]: dispatch 2024-05-14T15:08:03.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:02 smithi069 ceph-mon[31270]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "89f78a32-7afb-49f3-9287-5478a1cc8829"}]': finished 2024-05-14T15:08:03.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:02 smithi069 ceph-mon[31270]: osdmap e10: 2 total, 1 up, 2 in 2024-05-14T15:08:03.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:04.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:03 smithi203 ceph-mon[34567]: from='client.? 172.21.15.92:0/2143578455' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:08:04.087 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:03 smithi092 ceph-mon[34729]: from='client.? 172.21.15.92:0/2143578455' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:08:04.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:03 smithi069 ceph-mon[31270]: from='client.? 172.21.15.92:0/2143578455' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:08:05.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:04 smithi203 ceph-mon[34567]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:05.103 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:04 smithi092 ceph-mon[34729]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:05.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:04 smithi069 ceph-mon[31270]: pgmap v71: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:06.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:06 smithi092 ceph-mon[34729]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:07.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:06 smithi203 ceph-mon[34567]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:07.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:06 smithi069 ceph-mon[31270]: pgmap v72: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:08.935 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:08 smithi092 ceph-mon[34729]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:08.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:08 smithi069 ceph-mon[31270]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:09.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:08 smithi203 ceph-mon[34567]: pgmap v73: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:11.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:10 smithi203 ceph-mon[34567]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:11.186 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:10 smithi092 ceph-mon[34729]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:11.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:10 smithi069 ceph-mon[31270]: pgmap v74: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:12.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-14T15:08:12.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:08:12.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-14T15:08:12.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:08:12.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-14T15:08:12.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:08:12.935 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:12 smithi092 ceph-mon[34729]: Deploying daemon osd.1 on smithi092 2024-05-14T15:08:12.935 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:12 smithi092 ceph-mon[34729]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:13.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:12 smithi203 ceph-mon[34567]: Deploying daemon osd.1 on smithi092 2024-05-14T15:08:13.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:12 smithi203 ceph-mon[34567]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:13.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:12 smithi069 ceph-mon[31270]: Deploying daemon osd.1 on smithi092 2024-05-14T15:08:13.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:12 smithi069 ceph-mon[31270]: pgmap v75: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:15.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:14 smithi203 ceph-mon[34567]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:15.095 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:14 smithi092 ceph-mon[34729]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:15.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:14 smithi069 ceph-mon[31270]: pgmap v76: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:17.051 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:16 smithi092 ceph-mon[34729]: pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:17.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:16 smithi203 ceph-mon[34567]: pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:17.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:16 smithi069 ceph-mon[31270]: pgmap v77: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:18.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:18 smithi092 ceph-mon[34729]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:19.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:18 smithi203 ceph-mon[34567]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:19.216 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:18 smithi069 ceph-mon[31270]: pgmap v78: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:21.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:21 smithi092 ceph-mon[34729]: pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:21.427 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:21 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:21.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:21 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:21.428 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:21 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:08:21.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:21 smithi069 ceph-mon[31270]: pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:21.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:21 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:21.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:21 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:21.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:21 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:08:21.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:21 smithi203 ceph-mon[34567]: pgmap v79: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:21.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:21 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:21.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:21 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:21.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:21 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:08:23.328 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:23 smithi092 ceph-mon[34729]: pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:23.328 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:23 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:23.328 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:23 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:23.328 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:23 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:08:23.328 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:23 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:08:23.328 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:23 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:23.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:23 smithi069 ceph-mon[31270]: pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:23.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:23 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:23.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:23 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:23.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:23 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:08:23.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:23 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:08:23.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:23 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:23.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:23 smithi203 ceph-mon[34567]: pgmap v80: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:23.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:23 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:23.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:23 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:23.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:23 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:08:23.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:23 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:08:23.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:23 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:24.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:24 smithi069 ceph-mon[31270]: pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:24.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:24 smithi203 ceph-mon[34567]: pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:24.638 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:24 smithi092 ceph-mon[34729]: pgmap v81: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:25.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:25 smithi092 ceph-mon[34729]: from='osd.1 [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T15:08:25.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:25 smithi092 ceph-mon[34729]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T15:08:25.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:25 smithi069 ceph-mon[31270]: from='osd.1 [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T15:08:25.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:25 smithi069 ceph-mon[31270]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T15:08:25.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:25 smithi203 ceph-mon[34567]: from='osd.1 [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T15:08:25.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:25 smithi203 ceph-mon[34567]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-14T15:08:25.679 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:08:25.685+0000 7f2ec5600700 1 -- 172.21.15.92:0/1571986761 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2ec8063c00 con 0x7f2eb00b27f0 2024-05-14T15:08:25.679 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 1 on host 'smithi092' 2024-05-14T15:08:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:08:25.688+0000 7f2ecf600700 1 -- 172.21.15.92:0/1571986761 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f2eb00b27f0 msgr2=0x7f2eb00b4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:08:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:08:25.688+0000 7f2ecf600700 1 --2- 172.21.15.92:0/1571986761 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f2eb00b27f0 0x7f2eb00b4d00 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2ebc005950 tx=0x7f2ebc0058e0 comp rx=0 tx=0).stop 2024-05-14T15:08:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:08:25.688+0000 7f2ecf600700 1 -- 172.21.15.92:0/1571986761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec810ba80 msgr2=0x7f2ec81a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:08:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:08:25.688+0000 7f2ecf600700 1 --2- 172.21.15.92:0/1571986761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec810ba80 0x7f2ec81a1310 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f2eb800d950 tx=0x7f2eb800dd10 comp rx=0 tx=0).stop 2024-05-14T15:08:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:08:25.689+0000 7f2ecf600700 1 -- 172.21.15.92:0/1571986761 shutdown_connections 2024-05-14T15:08:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:08:25.689+0000 7f2ecf600700 1 --2- 172.21.15.92:0/1571986761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2ec810ab10 0x7f2ec81a0dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:08:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:08:25.689+0000 7f2ecf600700 1 --2- 172.21.15.92:0/1571986761 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f2eb00b27f0 0x7f2eb00b4d00 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:08:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:08:25.689+0000 7f2ecf600700 1 --2- 172.21.15.92:0/1571986761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2ec810c420 0x7f2ec81a8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:08:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:08:25.689+0000 7f2ecf600700 1 --2- 172.21.15.92:0/1571986761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2ec810ba80 0x7f2ec81a1310 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:08:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:08:25.689+0000 7f2ecf600700 1 -- 172.21.15.92:0/1571986761 >> 172.21.15.92:0/1571986761 conn(0x7f2ec80799c0 msgr2=0x7f2ec810ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:08:25.683 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:08:25.689+0000 7f2ecf600700 1 -- 172.21.15.92:0/1571986761 shutdown_connections 2024-05-14T15:08:25.684 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:08:25.689+0000 7f2ecf600700 1 -- 172.21.15.92:0/1571986761 wait complete. 2024-05-14T15:08:26.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:26 smithi092 ceph-mon[34729]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-14T15:08:26.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:26 smithi092 ceph-mon[34729]: osdmap e11: 2 total, 1 up, 2 in 2024-05-14T15:08:26.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:26 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:26.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:26 smithi092 ceph-mon[34729]: from='osd.1 [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:08:26.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:26 smithi092 ceph-mon[34729]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:08:26.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:26 smithi092 ceph-mon[34729]: pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:26.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:26 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:26.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:26 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:26.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:26 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:08:26.534 DEBUG:teuthology.orchestra.run.smithi092:osd.1> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.1.service 2024-05-14T15:08:26.539 INFO:tasks.cephadm:Deploying osd.2 on smithi203 with /dev/vg_nvme/lv_4... 2024-05-14T15:08:26.539 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-14T15:08:26.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:26 smithi203 ceph-mon[34567]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-14T15:08:26.587 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:26 smithi203 ceph-mon[34567]: osdmap e11: 2 total, 1 up, 2 in 2024-05-14T15:08:26.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:26 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:26.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:26 smithi203 ceph-mon[34567]: from='osd.1 [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:08:26.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:26 smithi203 ceph-mon[34567]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:08:26.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:26 smithi203 ceph-mon[34567]: pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:26.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:26 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:26.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:26 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:26.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:26 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:08:26.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:26 smithi069 ceph-mon[31270]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-14T15:08:26.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:26 smithi069 ceph-mon[31270]: osdmap e11: 2 total, 1 up, 2 in 2024-05-14T15:08:26.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:26.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:26 smithi069 ceph-mon[31270]: from='osd.1 [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:08:26.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:26 smithi069 ceph-mon[31270]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:08:26.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:26 smithi069 ceph-mon[31270]: pgmap v83: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:26.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:26.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:26.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:08:26.976 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:08:27.371 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:27 smithi203 ceph-mon[34567]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-05-14T15:08:27.371 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:27 smithi203 ceph-mon[34567]: osdmap e12: 2 total, 1 up, 2 in 2024-05-14T15:08:27.371 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:27 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:27.371 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:27 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:27.371 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:27 smithi203 ceph-mon[34567]: from='osd.1 ' entity='osd.1' 2024-05-14T15:08:27.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:27 smithi092 ceph-mon[34729]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-05-14T15:08:27.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:27 smithi092 ceph-mon[34729]: osdmap e12: 2 total, 1 up, 2 in 2024-05-14T15:08:27.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:27 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:27.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:27 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:27.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:27 smithi092 ceph-mon[34729]: from='osd.1 ' entity='osd.1' 2024-05-14T15:08:27.436 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:08:27 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-1[39280]: 2024-05-14T15:08:27.077+0000 7f19cfc00700 -1 osd.1 0 waiting for initial osdmap 2024-05-14T15:08:27.437 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:08:27 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-1[39280]: 2024-05-14T15:08:27.093+0000 7f19c5a00700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T15:08:27.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:27 smithi069 ceph-mon[31270]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-05-14T15:08:27.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:27 smithi069 ceph-mon[31270]: osdmap e12: 2 total, 1 up, 2 in 2024-05-14T15:08:27.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:27 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:27.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:27 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:27.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:27 smithi069 ceph-mon[31270]: from='osd.1 ' entity='osd.1' 2024-05-14T15:08:28.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:28 smithi203 ceph-mon[34567]: purged_snaps scrub starts 2024-05-14T15:08:28.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:28 smithi203 ceph-mon[34567]: purged_snaps scrub ok 2024-05-14T15:08:28.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:28 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:28.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:28 smithi203 ceph-mon[34567]: pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:28.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:28 smithi203 ceph-mon[34567]: osd.1 [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776] boot 2024-05-14T15:08:28.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:28 smithi203 ceph-mon[34567]: osdmap e13: 2 total, 2 up, 2 in 2024-05-14T15:08:28.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:28 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:28.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:28 smithi092 ceph-mon[34729]: purged_snaps scrub starts 2024-05-14T15:08:28.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:28 smithi092 ceph-mon[34729]: purged_snaps scrub ok 2024-05-14T15:08:28.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:28 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:28.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:28 smithi092 ceph-mon[34729]: pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:28.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:28 smithi092 ceph-mon[34729]: osd.1 [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776] boot 2024-05-14T15:08:28.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:28 smithi092 ceph-mon[34729]: osdmap e13: 2 total, 2 up, 2 in 2024-05-14T15:08:28.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:28 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:28.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:28 smithi069 ceph-mon[31270]: purged_snaps scrub starts 2024-05-14T15:08:28.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:28 smithi069 ceph-mon[31270]: purged_snaps scrub ok 2024-05-14T15:08:28.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:28 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:28.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:28 smithi069 ceph-mon[31270]: pgmap v85: 0 pgs: ; 0 B data, 31 MiB used, 89 GiB / 89 GiB avail 2024-05-14T15:08:28.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:28 smithi069 ceph-mon[31270]: osd.1 [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776] boot 2024-05-14T15:08:28.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:28 smithi069 ceph-mon[31270]: osdmap e13: 2 total, 2 up, 2 in 2024-05-14T15:08:28.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:28 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:08:30.007 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-14T15:08:30.008 INFO:teuthology.orchestra.run.smithi203.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-14T15:08:30.008 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10+0 records in 2024-05-14T15:08:30.008 INFO:teuthology.orchestra.run.smithi203.stderr:10+0 records out 2024-05-14T15:08:30.008 INFO:teuthology.orchestra.run.smithi203.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0357943 s, 293 MB/s 2024-05-14T15:08:30.008 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping successful for: 2024-05-14T15:08:30.337 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:30 smithi203 ceph-mon[34567]: osdmap e14: 2 total, 2 up, 2 in 2024-05-14T15:08:30.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:30 smithi203 ceph-mon[34567]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:30.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:30 smithi092 ceph-mon[34729]: osdmap e14: 2 total, 2 up, 2 in 2024-05-14T15:08:30.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:30 smithi092 ceph-mon[34729]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:30.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:30 smithi069 ceph-mon[31270]: osdmap e14: 2 total, 2 up, 2 in 2024-05-14T15:08:30.716 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:30 smithi069 ceph-mon[31270]: pgmap v88: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:30.819 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_4 2024-05-14T15:08:31.309 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:08:32.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:32 smithi203 ceph-mon[34567]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:32.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:32 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:32.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:32 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:32.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:32 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:08:32.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:32 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:32.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:32 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:08:32.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:32 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:08:32.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:32 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:32.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:32 smithi092 ceph-mon[34729]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:32.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:32 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:32.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:32 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:32.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:32 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:08:32.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:32 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:32.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:32 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:08:32.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:32 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:08:32.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:32 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:32.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:32 smithi069 ceph-mon[31270]: pgmap v89: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:32.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:32 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:32.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:32 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:32.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:32 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:08:32.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:32 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:32.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:32 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:08:32.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:32 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:08:32.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:32 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:33.536 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.542+0000 7fc7d7e00700 1 -- 172.21.15.203:0/3199588971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7d010ba80 msgr2=0x7fc7d010be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:08:33.536 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.542+0000 7fc7d7e00700 1 --2- 172.21.15.203:0/3199588971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7d010ba80 0x7fc7d010be90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc7bc009990 tx=0x7fc7bc009ca0 comp rx=0 tx=0).stop 2024-05-14T15:08:33.537 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.542+0000 7fc7d7e00700 1 -- 172.21.15.203:0/3199588971 shutdown_connections 2024-05-14T15:08:33.537 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.542+0000 7fc7d7e00700 1 --2- 172.21.15.203:0/3199588971 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7d010c420 0x7fc7d0112cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:08:33.537 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.542+0000 7fc7d7e00700 1 --2- 172.21.15.203:0/3199588971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7d010ab10 0x7fc7d010af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:08:33.537 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.542+0000 7fc7d7e00700 1 --2- 172.21.15.203:0/3199588971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7d010ba80 0x7fc7d010be90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:08:33.537 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.542+0000 7fc7d7e00700 1 -- 172.21.15.203:0/3199588971 >> 172.21.15.203:0/3199588971 conn(0x7fc7d00799c0 msgr2=0x7fc7d007be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:08:33.537 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.542+0000 7fc7d7e00700 1 -- 172.21.15.203:0/3199588971 shutdown_connections 2024-05-14T15:08:33.537 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.543+0000 7fc7d7e00700 1 -- 172.21.15.203:0/3199588971 wait complete. 2024-05-14T15:08:33.539 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.544+0000 7fc7d7e00700 1 Processor -- start 2024-05-14T15:08:33.539 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.544+0000 7fc7d7e00700 1 -- start start 2024-05-14T15:08:33.539 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.544+0000 7fc7d7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7d010ab10 0x7fc7d01a0e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:08:33.540 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.545+0000 7fc7d7e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7d010ba80 0x7fc7d01a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:08:33.540 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.545+0000 7fc7d7e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7d010c420 0x7fc7d01a8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:08:33.540 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.545+0000 7fc7d7e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d01162c0 con 0x7fc7d010ab10 2024-05-14T15:08:33.540 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.545+0000 7fc7d7e00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d0116140 con 0x7fc7d010ba80 2024-05-14T15:08:33.540 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.545+0000 7fc7d7e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc7d0116440 con 0x7fc7d010c420 2024-05-14T15:08:33.540 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.545+0000 7fc7d5e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7d010c420 0x7fc7d01a8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:08:33.540 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.545+0000 7fc7d5e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7d010c420 0x7fc7d01a8340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:58266/0 (socket says 172.21.15.203:58266) 2024-05-14T15:08:33.540 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.545+0000 7fc7d5e00700 1 -- 172.21.15.203:0/26781876 learned_addr learned my addr 172.21.15.203:0/26781876 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-05-14T15:08:33.540 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.545+0000 7fc7d4a00700 1 --2- 172.21.15.203:0/26781876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7d010ba80 0x7fc7d01a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:08:33.541 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.545+0000 7fc7d5400700 1 --2- 172.21.15.203:0/26781876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7d010ab10 0x7fc7d01a0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:08:33.541 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.546+0000 7fc7d5e00700 1 -- 172.21.15.203:0/26781876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7d010ba80 msgr2=0x7fc7d01a13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:08:33.541 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.546+0000 7fc7d5e00700 1 --2- 172.21.15.203:0/26781876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7d010ba80 0x7fc7d01a13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:08:33.541 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.546+0000 7fc7d5e00700 1 -- 172.21.15.203:0/26781876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7d010ab10 msgr2=0x7fc7d01a0e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:08:33.541 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.546+0000 7fc7d5e00700 1 --2- 172.21.15.203:0/26781876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7d010ab10 0x7fc7d01a0e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:08:33.541 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.546+0000 7fc7d5e00700 1 -- 172.21.15.203:0/26781876 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7d01a8930 con 0x7fc7d010c420 2024-05-14T15:08:33.541 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:33 smithi203 ceph-mon[34567]: Detected new or changed devices on smithi092 2024-05-14T15:08:33.542 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:33 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi092 to 17089M 2024-05-14T15:08:33.543 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.546+0000 7fc7d5e00700 1 --2- 172.21.15.203:0/26781876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7d010c420 0x7fc7d01a8340 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8007d70 tx=0x7fc7c800a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:08:33.543 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.546+0000 7fc7ce000700 1 -- 172.21.15.203:0/26781876 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c8016020 con 0x7fc7d010c420 2024-05-14T15:08:33.543 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.546+0000 7fc7ce000700 1 -- 172.21.15.203:0/26781876 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc7c800ac90 con 0x7fc7d010c420 2024-05-14T15:08:33.543 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.547+0000 7fc7d7e00700 1 -- 172.21.15.203:0/26781876 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7d01a8c20 con 0x7fc7d010c420 2024-05-14T15:08:33.543 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.547+0000 7fc7ce000700 1 -- 172.21.15.203:0/26781876 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc7c80115e0 con 0x7fc7d010c420 2024-05-14T15:08:33.543 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.547+0000 7fc7d7e00700 1 -- 172.21.15.203:0/26781876 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7d01a9160 con 0x7fc7d010c420 2024-05-14T15:08:33.543 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.548+0000 7fc7d7e00700 1 -- 172.21.15.203:0/26781876 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7d00512c0 con 0x7fc7d010c420 2024-05-14T15:08:33.545 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.552+0000 7fc7ce000700 1 -- 172.21.15.203:0/26781876 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 15) ==== 149596+0+0 (secure 0 0 0) 0x7fc7c8019020 con 0x7fc7d010c420 2024-05-14T15:08:33.546 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.553+0000 7fc7ce000700 1 --2- 172.21.15.203:0/26781876 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc7b80b2870 0x7fc7b80b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:08:33.547 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.553+0000 7fc7ce000700 1 -- 172.21.15.203:0/26781876 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2309+0+0 (secure 0 0 0) 0x7fc7c80e0930 con 0x7fc7d010c420 2024-05-14T15:08:33.547 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.554+0000 7fc7d5400700 1 --2- 172.21.15.203:0/26781876 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc7b80b2870 0x7fc7b80b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:08:33.548 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.555+0000 7fc7d5400700 1 --2- 172.21.15.203:0/26781876 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc7b80b2870 0x7fc7b80b4d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc7d010b9b0 tx=0x7fc7c400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:08:33.552 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.559+0000 7fc7ce000700 1 -- 172.21.15.203:0/26781876 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc7c8020020 con 0x7fc7d010c420 2024-05-14T15:08:33.793 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:08:33.799+0000 7fc7d7e00700 1 -- 172.21.15.203:0/26781876 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fc7d0063c00 con 0x7fc7b80b2870 2024-05-14T15:08:33.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:33 smithi092 ceph-mon[34729]: Detected new or changed devices on smithi092 2024-05-14T15:08:33.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:33 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi092 to 17089M 2024-05-14T15:08:33.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:33 smithi069 ceph-mon[31270]: Detected new or changed devices on smithi092 2024-05-14T15:08:33.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:33 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi092 to 17089M 2024-05-14T15:08:34.761 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:34 smithi203 ceph-mon[34567]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:34.761 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:34 smithi203 ceph-mon[34567]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:08:34.761 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:08:34.761 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:08:34.761 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:08:34.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:34 smithi092 ceph-mon[34729]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:34.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:34 smithi092 ceph-mon[34729]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:08:34.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:08:34.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:08:34.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:08:34.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:34 smithi069 ceph-mon[31270]: pgmap v90: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:34.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:34 smithi069 ceph-mon[31270]: from='client.24169 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:08:34.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:08:34.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:08:34.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:08:36.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:36 smithi203 ceph-mon[34567]: pgmap v91: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:36.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:36 smithi092 ceph-mon[34729]: pgmap v91: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:36.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:36 smithi069 ceph-mon[31270]: pgmap v91: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:38.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:38 smithi203 ceph-mon[34567]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:38.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:38 smithi203 ceph-mon[34567]: from='client.? 172.21.15.203:0/2394676975' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151"}]: dispatch 2024-05-14T15:08:38.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:38 smithi203 ceph-mon[34567]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151"}]: dispatch 2024-05-14T15:08:38.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:38 smithi203 ceph-mon[34567]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151"}]': finished 2024-05-14T15:08:38.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:38 smithi203 ceph-mon[34567]: osdmap e15: 3 total, 2 up, 3 in 2024-05-14T15:08:38.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:08:38.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:38 smithi092 ceph-mon[34729]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:38.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:38 smithi092 ceph-mon[34729]: from='client.? 172.21.15.203:0/2394676975' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151"}]: dispatch 2024-05-14T15:08:38.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:38 smithi092 ceph-mon[34729]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151"}]: dispatch 2024-05-14T15:08:38.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:38 smithi092 ceph-mon[34729]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151"}]': finished 2024-05-14T15:08:38.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:38 smithi092 ceph-mon[34729]: osdmap e15: 3 total, 2 up, 3 in 2024-05-14T15:08:38.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:08:38.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:38 smithi069 ceph-mon[31270]: pgmap v92: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:38.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:38 smithi069 ceph-mon[31270]: from='client.? 172.21.15.203:0/2394676975' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151"}]: dispatch 2024-05-14T15:08:38.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:38 smithi069 ceph-mon[31270]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151"}]: dispatch 2024-05-14T15:08:38.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:38 smithi069 ceph-mon[31270]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151"}]': finished 2024-05-14T15:08:38.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:38 smithi069 ceph-mon[31270]: osdmap e15: 3 total, 2 up, 3 in 2024-05-14T15:08:38.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:08:39.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:39 smithi203 ceph-mon[34567]: from='client.? 172.21.15.203:0/3377219440' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:08:39.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:39 smithi092 ceph-mon[34729]: from='client.? 172.21.15.203:0/3377219440' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:08:39.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:39 smithi069 ceph-mon[31270]: from='client.? 172.21.15.203:0/3377219440' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:08:40.837 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:40 smithi203 ceph-mon[34567]: pgmap v94: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:40.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:40 smithi092 ceph-mon[34729]: pgmap v94: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:40.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:40 smithi069 ceph-mon[31270]: pgmap v94: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:42.781 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:42 smithi203 ceph-mon[34567]: pgmap v95: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:42.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:42 smithi092 ceph-mon[34729]: pgmap v95: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:42.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:42 smithi069 ceph-mon[31270]: pgmap v95: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:44.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:44 smithi203 ceph-mon[34567]: pgmap v96: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:44.847 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:44 smithi092 ceph-mon[34729]: pgmap v96: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:44.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:44 smithi069 ceph-mon[31270]: pgmap v96: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:46.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:46 smithi203 ceph-mon[34567]: pgmap v97: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:46.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:46 smithi092 ceph-mon[34729]: pgmap v97: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:46.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:46 smithi069 ceph-mon[31270]: pgmap v97: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:47.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:47 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-14T15:08:47.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:47 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:08:47.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:47 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-14T15:08:47.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:47 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:08:47.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:47 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-14T15:08:47.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:47 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:08:48.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:48 smithi203 ceph-mon[34567]: Deploying daemon osd.2 on smithi203 2024-05-14T15:08:48.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:48 smithi203 ceph-mon[34567]: pgmap v98: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:48.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:48 smithi092 ceph-mon[34729]: Deploying daemon osd.2 on smithi203 2024-05-14T15:08:48.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:48 smithi092 ceph-mon[34729]: pgmap v98: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:48.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:48 smithi069 ceph-mon[31270]: Deploying daemon osd.2 on smithi203 2024-05-14T15:08:48.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:48 smithi069 ceph-mon[31270]: pgmap v98: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:50.724 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:50 smithi203 ceph-mon[34567]: pgmap v99: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:50.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:50 smithi092 ceph-mon[34729]: pgmap v99: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:50.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:50 smithi069 ceph-mon[31270]: pgmap v99: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:52.783 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:52 smithi203 ceph-mon[34567]: pgmap v100: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:52.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:52 smithi092 ceph-mon[34729]: pgmap v100: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:52.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:52 smithi069 ceph-mon[31270]: pgmap v100: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:54.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:54 smithi092 ceph-mon[34729]: pgmap v101: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:54.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:54 smithi069 ceph-mon[31270]: pgmap v101: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:55.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:54 smithi203 ceph-mon[34567]: pgmap v101: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:56.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:56 smithi092 ceph-mon[34729]: pgmap v102: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:56.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:56 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:56.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:56 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:56.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:56 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:08:56.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:56 smithi069 ceph-mon[31270]: pgmap v102: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:56.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:56 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:56.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:56 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:56.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:56 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:08:57.087 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:56 smithi203 ceph-mon[34567]: pgmap v102: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:57.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:56 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:57.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:56 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:08:57.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:56 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:08:58.661 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:08:58 smithi203 ceph-mon[34567]: pgmap v103: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:58.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:08:58 smithi092 ceph-mon[34729]: pgmap v103: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:08:58.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:08:58 smithi069 ceph-mon[31270]: pgmap v103: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:09:01.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:00 smithi069 ceph-mon[31270]: pgmap v104: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:09:01.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:00 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:01.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:00 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:01.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:00 smithi069 ceph-mon[31270]: from='osd.2 [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T15:09:01.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:00 smithi069 ceph-mon[31270]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T15:09:01.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:00 smithi203 ceph-mon[34567]: pgmap v104: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:09:01.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:00 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:01.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:00 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:01.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:00 smithi203 ceph-mon[34567]: from='osd.2 [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T15:09:01.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:00 smithi203 ceph-mon[34567]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T15:09:01.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:00 smithi092 ceph-mon[34729]: pgmap v104: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:09:01.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:00 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:01.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:00 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:01.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:00 smithi092 ceph-mon[34729]: from='osd.2 [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T15:09:01.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:00 smithi092 ceph-mon[34729]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-14T15:09:01.564 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:09:01.569+0000 7fc7ce000700 1 -- 172.21.15.203:0/26781876 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc7d0063c00 con 0x7fc7b80b2870 2024-05-14T15:09:01.565 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 2 on host 'smithi203' 2024-05-14T15:09:01.568 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:09:01.574+0000 7fc7d7e00700 1 -- 172.21.15.203:0/26781876 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc7b80b2870 msgr2=0x7fc7b80b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:09:01.568 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:09:01.574+0000 7fc7d7e00700 1 --2- 172.21.15.203:0/26781876 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc7b80b2870 0x7fc7b80b4d80 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc7d010b9b0 tx=0x7fc7c400a380 comp rx=0 tx=0).stop 2024-05-14T15:09:01.568 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:09:01.574+0000 7fc7d7e00700 1 -- 172.21.15.203:0/26781876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7d010c420 msgr2=0x7fc7d01a8340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:09:01.568 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:09:01.574+0000 7fc7d7e00700 1 --2- 172.21.15.203:0/26781876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7d010c420 0x7fc7d01a8340 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fc7c8007d70 tx=0x7fc7c800a340 comp rx=0 tx=0).stop 2024-05-14T15:09:01.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:09:01.574+0000 7fc7d7e00700 1 -- 172.21.15.203:0/26781876 shutdown_connections 2024-05-14T15:09:01.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:09:01.574+0000 7fc7d7e00700 1 --2- 172.21.15.203:0/26781876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc7d010ab10 0x7fc7d01a0e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:01.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:09:01.574+0000 7fc7d7e00700 1 --2- 172.21.15.203:0/26781876 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc7b80b2870 0x7fc7b80b4d80 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:01.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:09:01.574+0000 7fc7d7e00700 1 --2- 172.21.15.203:0/26781876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc7d010c420 0x7fc7d01a8340 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:01.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:09:01.574+0000 7fc7d7e00700 1 --2- 172.21.15.203:0/26781876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc7d010ba80 0x7fc7d01a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:01.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:09:01.574+0000 7fc7d7e00700 1 -- 172.21.15.203:0/26781876 >> 172.21.15.203:0/26781876 conn(0x7fc7d00799c0 msgr2=0x7fc7d010ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:09:01.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:09:01.574+0000 7fc7d7e00700 1 -- 172.21.15.203:0/26781876 shutdown_connections 2024-05-14T15:09:01.569 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:09:01.574+0000 7fc7d7e00700 1 -- 172.21.15.203:0/26781876 wait complete. 2024-05-14T15:09:02.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:02 smithi203 ceph-mon[34567]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-14T15:09:02.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:02 smithi203 ceph-mon[34567]: osdmap e16: 3 total, 2 up, 3 in 2024-05-14T15:09:02.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:09:02.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:02 smithi203 ceph-mon[34567]: from='osd.2 [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:09:02.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:02 smithi203 ceph-mon[34567]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:09:02.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:02.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:09:02.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:02.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:02.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:02.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:09:02.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:02 smithi092 ceph-mon[34729]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-14T15:09:02.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:02 smithi092 ceph-mon[34729]: osdmap e16: 3 total, 2 up, 3 in 2024-05-14T15:09:02.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:09:02.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:02 smithi092 ceph-mon[34729]: from='osd.2 [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:09:02.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:02 smithi092 ceph-mon[34729]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:09:02.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:02.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:09:02.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:02.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:02.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:02.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:09:02.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:01 smithi069 ceph-mon[31270]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-14T15:09:02.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:02 smithi069 ceph-mon[31270]: osdmap e16: 3 total, 2 up, 3 in 2024-05-14T15:09:02.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:09:02.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:02 smithi069 ceph-mon[31270]: from='osd.2 [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:09:02.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:02 smithi069 ceph-mon[31270]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:09:02.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:02.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:09:02.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:02.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:02.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:02.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:09:02.495 DEBUG:teuthology.orchestra.run.smithi203:osd.2> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.2.service 2024-05-14T15:09:02.502 INFO:tasks.cephadm:Deploying osd.3 on smithi069 with /dev/vg_nvme/lv_3... 2024-05-14T15:09:02.503 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-14T15:09:02.954 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:09:03.330 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:03 smithi069 ceph-mon[31270]: pgmap v106: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:09:03.331 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:03 smithi069 ceph-mon[31270]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-05-14T15:09:03.331 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:03 smithi069 ceph-mon[31270]: osdmap e17: 3 total, 2 up, 3 in 2024-05-14T15:09:03.331 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:03 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:09:03.331 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:03 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:09:03.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:03 smithi203 ceph-mon[34567]: pgmap v106: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:09:03.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:03 smithi203 ceph-mon[34567]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-05-14T15:09:03.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:03 smithi203 ceph-mon[34567]: osdmap e17: 3 total, 2 up, 3 in 2024-05-14T15:09:03.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:03 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:09:03.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:03 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:09:03.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:03 smithi092 ceph-mon[34729]: pgmap v106: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-05-14T15:09:03.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:03 smithi092 ceph-mon[34729]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-05-14T15:09:03.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:03 smithi092 ceph-mon[34729]: osdmap e17: 3 total, 2 up, 3 in 2024-05-14T15:09:03.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:03 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:09:03.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:03 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:09:04.318 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:04 smithi203 ceph-mon[34567]: purged_snaps scrub starts 2024-05-14T15:09:04.318 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:04 smithi203 ceph-mon[34567]: purged_snaps scrub ok 2024-05-14T15:09:04.318 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:04 smithi203 ceph-mon[34567]: osd.2 [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513] boot 2024-05-14T15:09:04.318 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:04 smithi203 ceph-mon[34567]: osdmap e18: 3 total, 3 up, 3 in 2024-05-14T15:09:04.318 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:04 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:09:04.318 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:04 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-14T15:09:04.370 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:04 smithi069 ceph-mon[31270]: purged_snaps scrub starts 2024-05-14T15:09:04.370 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:04 smithi069 ceph-mon[31270]: purged_snaps scrub ok 2024-05-14T15:09:04.370 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:04 smithi069 ceph-mon[31270]: osd.2 [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513] boot 2024-05-14T15:09:04.371 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:04 smithi069 ceph-mon[31270]: osdmap e18: 3 total, 3 up, 3 in 2024-05-14T15:09:04.371 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:04 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:09:04.371 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:04 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-14T15:09:04.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:04 smithi092 ceph-mon[34729]: purged_snaps scrub starts 2024-05-14T15:09:04.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:04 smithi092 ceph-mon[34729]: purged_snaps scrub ok 2024-05-14T15:09:04.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:04 smithi092 ceph-mon[34729]: osd.2 [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513] boot 2024-05-14T15:09:04.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:04 smithi092 ceph-mon[34729]: osdmap e18: 3 total, 3 up, 3 in 2024-05-14T15:09:04.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:04 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:09:04.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:04 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-05-14T15:09:05.269 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:05 smithi069 ceph-mon[31270]: pgmap v109: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:05.269 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-14T15:09:05.269 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:05 smithi069 ceph-mon[31270]: osdmap e19: 3 total, 3 up, 3 in 2024-05-14T15:09:05.269 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-14T15:09:05.270 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:09:05 smithi069 sudo[47549]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T15:09:05.270 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:09:05 smithi069 sudo[47549]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T15:09:05.270 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:09:05 smithi069 sudo[47549]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T15:09:05.270 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:09:05 smithi069 sudo[47549]: pam_unix(sudo:session): session closed for user root 2024-05-14T15:09:05.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:05 smithi203 ceph-mon[34567]: pgmap v109: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:05.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-14T15:09:05.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:05 smithi203 ceph-mon[34567]: osdmap e19: 3 total, 3 up, 3 in 2024-05-14T15:09:05.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-14T15:09:05.395 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:05 smithi092 ceph-mon[34729]: pgmap v109: 0 pgs: ; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:05.396 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-05-14T15:09:05.396 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:05 smithi092 ceph-mon[34729]: osdmap e19: 3 total, 3 up, 3 in 2024-05-14T15:09:05.396 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-14T15:09:05.595 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:09:05 smithi069 sudo[47553]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T15:09:05.595 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:09:05 smithi069 sudo[47553]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T15:09:05.595 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:09:05 smithi069 sudo[47553]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T15:09:05.595 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:09:05 smithi069 sudo[47553]: pam_unix(sudo:session): session closed for user root 2024-05-14T15:09:05.687 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:09:05 smithi092 sudo[43315]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T15:09:05.687 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:09:05 smithi092 sudo[43315]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T15:09:05.687 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:09:05 smithi092 sudo[43315]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T15:09:05.687 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:09:05 smithi092 sudo[43315]: pam_unix(sudo:session): session closed for user root 2024-05-14T15:09:05.687 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:09:05 smithi092 sudo[43318]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T15:09:05.687 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:09:05 smithi092 sudo[43318]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T15:09:05.687 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:09:05 smithi092 sudo[43318]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T15:09:05.687 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:09:05 smithi092 sudo[43318]: pam_unix(sudo:session): session closed for user root 2024-05-14T15:09:05.838 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:09:05 smithi203 sudo[41475]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T15:09:05.838 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:09:05 smithi203 sudo[41475]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T15:09:05.838 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:09:05 smithi203 sudo[41475]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T15:09:05.838 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:09:05 smithi203 sudo[41475]: pam_unix(sudo:session): session closed for user root 2024-05-14T15:09:05.838 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:09:05 smithi203 sudo[41481]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T15:09:05.838 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:09:05 smithi203 sudo[41481]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T15:09:05.839 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:09:05 smithi203 sudo[41481]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T15:09:05.839 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:09:05 smithi203 sudo[41481]: pam_unix(sudo:session): session closed for user root 2024-05-14T15:09:05.910 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-14T15:09:05.910 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-14T15:09:05.911 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2024-05-14T15:09:05.911 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2024-05-14T15:09:05.911 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.034737 s, 302 MB/s 2024-05-14T15:09:05.911 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2024-05-14T15:09:05.911 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:05 smithi069 sudo[47578]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T15:09:05.911 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:05 smithi069 sudo[47578]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T15:09:05.911 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:05 smithi069 sudo[47578]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T15:09:05.911 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:05 smithi069 sudo[47578]: pam_unix(sudo:session): session closed for user root 2024-05-14T15:09:05.911 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:05 smithi069 sudo[47583]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T15:09:05.911 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:05 smithi069 sudo[47583]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T15:09:05.912 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:05 smithi069 sudo[47583]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T15:09:05.912 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:05 smithi069 sudo[47583]: pam_unix(sudo:session): session closed for user root 2024-05-14T15:09:06.190 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:05 smithi203 sudo[41781]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T15:09:06.190 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:05 smithi203 sudo[41781]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T15:09:06.190 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:05 smithi203 sudo[41781]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T15:09:06.190 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:05 smithi203 sudo[41781]: pam_unix(sudo:session): session closed for user root 2024-05-14T15:09:06.191 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:05 smithi203 sudo[42062]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T15:09:06.191 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:05 smithi203 sudo[42062]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T15:09:06.191 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:05 smithi203 sudo[42062]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T15:09:06.191 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:05 smithi203 sudo[42062]: pam_unix(sudo:session): session closed for user root 2024-05-14T15:09:06.191 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-14T15:09:06.191 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: osdmap e20: 3 total, 3 up, 3 in 2024-05-14T15:09:06.191 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:06.191 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:06.191 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:06.191 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T15:09:06.191 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T15:09:06.191 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:09:06.191 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:09:06.192 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:09:06.192 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T15:09:06.192 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:09:06.192 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:09:06.192 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:09:06.192 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T15:09:06.192 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T15:09:06.192 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:09:06.192 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:09:06.192 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:09:06.192 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:06 smithi203 ceph-mon[34567]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T15:09:06.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-14T15:09:06.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: osdmap e20: 3 total, 3 up, 3 in 2024-05-14T15:09:06.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:06.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:06.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:06.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T15:09:06.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T15:09:06.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:09:06.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:09:06.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:09:06.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T15:09:06.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:09:06.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:09:06.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:09:06.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T15:09:06.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T15:09:06.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:09:06.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:09:06.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:09:06.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:06 smithi069 ceph-mon[31270]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T15:09:06.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:05 smithi092 sudo[43321]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-14T15:09:06.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:05 smithi092 sudo[43321]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T15:09:06.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:05 smithi092 sudo[43321]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T15:09:06.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:05 smithi092 sudo[43321]: pam_unix(sudo:session): session closed for user root 2024-05-14T15:09:06.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 sudo[43324]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-14T15:09:06.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 sudo[43324]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-05-14T15:09:06.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 sudo[43324]: pam_unix(sudo:session): session opened for user root by (uid=167) 2024-05-14T15:09:06.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 sudo[43324]: pam_unix(sudo:session): session closed for user root 2024-05-14T15:09:06.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-14T15:09:06.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: osdmap e20: 3 total, 3 up, 3 in 2024-05-14T15:09:06.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:06.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:06.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:06.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T15:09:06.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T15:09:06.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:09:06.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:09:06.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:09:06.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T15:09:06.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:09:06.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:09:06.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:09:06.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T15:09:06.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-14T15:09:06.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:09:06.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:09:06.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:09:06.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:06 smithi092 ceph-mon[34729]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-14T15:09:06.789 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi069:vg_nvme/lv_3 2024-05-14T15:09:07.201 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:09:07.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:07 smithi203 ceph-mon[34567]: pgmap v112: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:07.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:07 smithi203 ceph-mon[34567]: osdmap e21: 3 total, 3 up, 3 in 2024-05-14T15:09:07.338 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:07 smithi203 ceph-mon[34567]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-05-14T15:09:07.352 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:07 smithi069 ceph-mon[31270]: pgmap v112: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:07.352 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:07 smithi069 ceph-mon[31270]: osdmap e21: 3 total, 3 up, 3 in 2024-05-14T15:09:07.352 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:07 smithi069 ceph-mon[31270]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-05-14T15:09:07.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:07 smithi092 ceph-mon[34729]: pgmap v112: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:07.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:07 smithi092 ceph-mon[34729]: osdmap e21: 3 total, 3 up, 3 in 2024-05-14T15:09:07.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:07 smithi092 ceph-mon[34729]: mgrmap e16: x(active, since 3m), standbys: z, y 2024-05-14T15:09:08.409 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:08 smithi069 ceph-mon[31270]: Detected new or changed devices on smithi203 2024-05-14T15:09:08.409 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:08 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:08.409 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:08 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:08.409 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:08 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:09:08.410 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:08 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi203 to 17089M 2024-05-14T15:09:08.410 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:08 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:08.410 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:08 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:08.410 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:08 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:09:08.410 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:08 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:08.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:08 smithi092 ceph-mon[34729]: Detected new or changed devices on smithi203 2024-05-14T15:09:08.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:08 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:08.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:08 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:08.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:08 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:09:08.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:08 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi203 to 17089M 2024-05-14T15:09:08.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:08 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:08.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:08 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:08.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:08 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:09:08.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:08 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:08.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:08 smithi203 ceph-mon[34567]: Detected new or changed devices on smithi203 2024-05-14T15:09:08.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:08 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:08.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:08 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:08.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:08 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:09:08.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:08 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi203 to 17089M 2024-05-14T15:09:08.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:08 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:08.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:08 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:08.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:08 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:09:08.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:08 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:09.305 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:09 smithi069 ceph-mon[31270]: pgmap v114: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:09.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:09 smithi092 ceph-mon[34729]: pgmap v114: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:09.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:09 smithi203 ceph-mon[34567]: pgmap v114: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:09.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.657+0000 7f6c33e00700 1 -- 172.21.15.69:0/4066567389 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c34104150 msgr2=0x7f6c34104560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:09:09.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.657+0000 7f6c33e00700 1 --2- 172.21.15.69:0/4066567389 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c34104150 0x7f6c34104560 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f6c24009990 tx=0x7f6c24009ca0 comp rx=0 tx=0).stop 2024-05-14T15:09:09.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.657+0000 7f6c33e00700 1 -- 172.21.15.69:0/4066567389 shutdown_connections 2024-05-14T15:09:09.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.657+0000 7f6c33e00700 1 --2- 172.21.15.69:0/4066567389 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c34104150 0x7f6c34104560 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:09.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.657+0000 7f6c33e00700 1 --2- 172.21.15.69:0/4066567389 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c34105c20 0x7f6c3410c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:09.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.657+0000 7f6c33e00700 1 --2- 172.21.15.69:0/4066567389 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c34105280 0x7f6c34105690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:09.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.657+0000 7f6c33e00700 1 -- 172.21.15.69:0/4066567389 >> 172.21.15.69:0/4066567389 conn(0x7f6c340ff7b0 msgr2=0x7f6c34101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:09:09.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.657+0000 7f6c33e00700 1 -- 172.21.15.69:0/4066567389 shutdown_connections 2024-05-14T15:09:09.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.657+0000 7f6c33e00700 1 -- 172.21.15.69:0/4066567389 wait complete. 2024-05-14T15:09:09.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.659+0000 7f6c33e00700 1 Processor -- start 2024-05-14T15:09:09.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.659+0000 7f6c33e00700 1 -- start start 2024-05-14T15:09:09.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.660+0000 7f6c33e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c34104150 0x7f6c34077460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:09:09.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.660+0000 7f6c33e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c34105280 0x7f6c34075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:09:09.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.660+0000 7f6c33e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c34105c20 0x7f6c34076050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:09:09.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.660+0000 7f6c33e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3410fac0 con 0x7f6c34105c20 2024-05-14T15:09:09.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.660+0000 7f6c33e00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3410f940 con 0x7f6c34104150 2024-05-14T15:09:09.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.660+0000 7f6c33e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3410fc40 con 0x7f6c34105280 2024-05-14T15:09:09.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.660+0000 7f6c33400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c34105c20 0x7f6c34076050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:09:09.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.660+0000 7f6c33400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c34105c20 0x7f6c34076050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45286/0 (socket says 172.21.15.69:45286) 2024-05-14T15:09:09.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.660+0000 7f6c33400700 1 -- 172.21.15.69:0/2369694230 learned_addr learned my addr 172.21.15.69:0/2369694230 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:09:09.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.660+0000 7f6c32a00700 1 --2- 172.21.15.69:0/2369694230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c34104150 0x7f6c34077460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:09:09.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.661+0000 7f6c32000700 1 --2- 172.21.15.69:0/2369694230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c34105280 0x7f6c34075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:09:09.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.661+0000 7f6c33400700 1 -- 172.21.15.69:0/2369694230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c34105280 msgr2=0x7f6c34075b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:09:09.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.661+0000 7f6c33400700 1 --2- 172.21.15.69:0/2369694230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c34105280 0x7f6c34075b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:09.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.661+0000 7f6c33400700 1 -- 172.21.15.69:0/2369694230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c34104150 msgr2=0x7f6c34077460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:09:09.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.661+0000 7f6c33400700 1 --2- 172.21.15.69:0/2369694230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c34104150 0x7f6c34077460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:09.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.661+0000 7f6c33400700 1 -- 172.21.15.69:0/2369694230 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c34076720 con 0x7f6c34105c20 2024-05-14T15:09:09.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.661+0000 7f6c33400700 1 --2- 172.21.15.69:0/2369694230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c34105c20 0x7f6c34076050 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c007d70 tx=0x7f6c2c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:09:09.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.662+0000 7f6c2b400700 1 -- 172.21.15.69:0/2369694230 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c016020 con 0x7f6c34105c20 2024-05-14T15:09:09.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.662+0000 7f6c2b400700 1 -- 172.21.15.69:0/2369694230 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c2c00ac90 con 0x7f6c34105c20 2024-05-14T15:09:09.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.662+0000 7f6c33e00700 1 -- 172.21.15.69:0/2369694230 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c341a4810 con 0x7f6c34105c20 2024-05-14T15:09:09.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.662+0000 7f6c2b400700 1 -- 172.21.15.69:0/2369694230 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0115e0 con 0x7f6c34105c20 2024-05-14T15:09:09.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.662+0000 7f6c33e00700 1 -- 172.21.15.69:0/2369694230 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c341a4c60 con 0x7f6c34105c20 2024-05-14T15:09:09.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.663+0000 7f6c33e00700 1 -- 172.21.15.69:0/2369694230 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c340512c0 con 0x7f6c34105c20 2024-05-14T15:09:09.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.667+0000 7f6c2b400700 1 -- 172.21.15.69:0/2369694230 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6c2c019020 con 0x7f6c34105c20 2024-05-14T15:09:09.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.669+0000 7f6c2b400700 1 --2- 172.21.15.69:0/2369694230 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6c180b2900 0x7f6c180b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:09:09.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.669+0000 7f6c2b400700 1 -- 172.21.15.69:0/2369694230 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3237+0+0 (secure 0 0 0) 0x7f6c2c0e12b0 con 0x7f6c34105c20 2024-05-14T15:09:09.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.669+0000 7f6c32a00700 1 --2- 172.21.15.69:0/2369694230 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6c180b2900 0x7f6c180b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:09:09.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.670+0000 7f6c32a00700 1 --2- 172.21.15.69:0/2369694230 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6c180b2900 0x7f6c180b4e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6c24003820 tx=0x7f6c2401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:09:09.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.671+0000 7f6c2b400700 1 -- 172.21.15.69:0/2369694230 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6c2c020020 con 0x7f6c34105c20 2024-05-14T15:09:09.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:09.915+0000 7f6c33e00700 1 -- 172.21.15.69:0/2369694230 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6c34063c00 con 0x7f6c180b2900 2024-05-14T15:09:10.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:10 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:09:10.217 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:10 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:09:10.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:10 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:10.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:10 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:09:10.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:10 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:09:10.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:10 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:10.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:10 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:09:10.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:10 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:09:10.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:10 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:11.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:11 smithi092 ceph-mon[34729]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:11.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:11 smithi092 ceph-mon[34729]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:09:11.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:11 smithi069 ceph-mon[31270]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:11.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:11 smithi069 ceph-mon[31270]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:09:11.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:11 smithi203 ceph-mon[34567]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:11.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:11 smithi203 ceph-mon[34567]: from='client.14307 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:09:13.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:13 smithi092 ceph-mon[34729]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:13.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:13 smithi069 ceph-mon[31270]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:13.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:13 smithi203 ceph-mon[34567]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:15.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:15 smithi092 ceph-mon[34729]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:15.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:15 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2755085383' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81409850-de26-4520-972c-31a716adf4cf"}]: dispatch 2024-05-14T15:09:15.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:15 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2755085383' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81409850-de26-4520-972c-31a716adf4cf"}]': finished 2024-05-14T15:09:15.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:15 smithi092 ceph-mon[34729]: osdmap e22: 4 total, 3 up, 4 in 2024-05-14T15:09:15.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:15 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:09:15.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:15 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3139824575' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:09:15.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:15 smithi069 ceph-mon[31270]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:15.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:15 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2755085383' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81409850-de26-4520-972c-31a716adf4cf"}]: dispatch 2024-05-14T15:09:15.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:15 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2755085383' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81409850-de26-4520-972c-31a716adf4cf"}]': finished 2024-05-14T15:09:15.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:15 smithi069 ceph-mon[31270]: osdmap e22: 4 total, 3 up, 4 in 2024-05-14T15:09:15.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:15 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:09:15.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:15 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3139824575' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:09:15.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:15 smithi203 ceph-mon[34567]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:15.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:15 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2755085383' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81409850-de26-4520-972c-31a716adf4cf"}]: dispatch 2024-05-14T15:09:15.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:15 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2755085383' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81409850-de26-4520-972c-31a716adf4cf"}]': finished 2024-05-14T15:09:15.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:15 smithi203 ceph-mon[34567]: osdmap e22: 4 total, 3 up, 4 in 2024-05-14T15:09:15.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:15 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:09:15.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:15 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3139824575' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:09:17.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:17 smithi069 ceph-mon[31270]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:17.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:17 smithi092 ceph-mon[34729]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:17.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:17 smithi203 ceph-mon[34567]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:19.436 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:19 smithi092 ceph-mon[34729]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:19.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:19 smithi069 ceph-mon[31270]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:19.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:19 smithi203 ceph-mon[34567]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:21.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:21 smithi069 ceph-mon[31270]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:21.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:21 smithi203 ceph-mon[34567]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:21.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:21 smithi092 ceph-mon[34729]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:22.442 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:22 smithi069 ceph-mon[31270]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:22.588 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:22 smithi203 ceph-mon[34567]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:22.686 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:22 smithi092 ceph-mon[34729]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:24.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:24 smithi203 ceph-mon[34567]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:24.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-14T15:09:24.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:24.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:24 smithi203 ceph-mon[34567]: Deploying daemon osd.3 on smithi069 2024-05-14T15:09:24.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:24 smithi092 ceph-mon[34729]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:24.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-14T15:09:24.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:24.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:24 smithi092 ceph-mon[34729]: Deploying daemon osd.3 on smithi069 2024-05-14T15:09:24.953 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:24 smithi069 ceph-mon[31270]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:24.953 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-14T15:09:24.953 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:24.953 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:24 smithi069 ceph-mon[31270]: Deploying daemon osd.3 on smithi069 2024-05-14T15:09:26.774 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:26 smithi069 ceph-mon[31270]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:26.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:26 smithi203 ceph-mon[34567]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:26.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:26 smithi092 ceph-mon[34729]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:28.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:28 smithi203 ceph-mon[34567]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:28.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:28 smithi092 ceph-mon[34729]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:28.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:28 smithi069 ceph-mon[31270]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:30.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:30 smithi203 ceph-mon[34567]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:30.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:30 smithi092 ceph-mon[34729]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:30.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:30 smithi069 ceph-mon[31270]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:32.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:32 smithi069 ceph-mon[31270]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:32.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:32 smithi203 ceph-mon[34567]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:32.936 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:32 smithi092 ceph-mon[34729]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:34.889 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:34 smithi069 ceph-mon[31270]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:34.889 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:34.889 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:34.889 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:09:34.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:34 smithi092 ceph-mon[34729]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:34.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:34.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:34.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:09:35.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:34 smithi203 ceph-mon[34567]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:35.089 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:35.089 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:35.089 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:09:36.690 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:36 smithi069 ceph-mon[31270]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:36.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:36 smithi092 ceph-mon[34729]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:37.088 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:36 smithi203 ceph-mon[34567]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:38.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:38.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:38 smithi069 ceph-mon[31270]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:38.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:38.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:38 smithi069 ceph-mon[31270]: from='osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-14T15:09:38.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:38.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:38 smithi203 ceph-mon[34567]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:38.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:38.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:38 smithi203 ceph-mon[34567]: from='osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-14T15:09:38.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:38.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:38 smithi092 ceph-mon[34729]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:38.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:38.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:38 smithi092 ceph-mon[34729]: from='osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-14T15:09:39.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:39 smithi203 ceph-mon[34567]: from='osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-14T15:09:39.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:39 smithi203 ceph-mon[34567]: osdmap e23: 4 total, 3 up, 4 in 2024-05-14T15:09:39.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:39 smithi203 ceph-mon[34567]: from='osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-05-14T15:09:39.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:39 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:09:39.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:39 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:39.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:39 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:09:39.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:39 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:39.872 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 3 on host 'smithi069' 2024-05-14T15:09:39.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:39.875+0000 7f6c2b400700 1 -- 172.21.15.69:0/2369694230 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6c34063c00 con 0x7f6c180b2900 2024-05-14T15:09:39.873 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:39 smithi069 ceph-mon[31270]: from='osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-14T15:09:39.873 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:39 smithi069 ceph-mon[31270]: osdmap e23: 4 total, 3 up, 4 in 2024-05-14T15:09:39.873 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:39 smithi069 ceph-mon[31270]: from='osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-05-14T15:09:39.873 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:39 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:09:39.873 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:39 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:39.873 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:39 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:09:39.873 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:39 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:39.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:39.879+0000 7f6c33e00700 1 -- 172.21.15.69:0/2369694230 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6c180b2900 msgr2=0x7f6c180b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:09:39.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:39.879+0000 7f6c33e00700 1 --2- 172.21.15.69:0/2369694230 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6c180b2900 0x7f6c180b4e10 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6c24003820 tx=0x7f6c2401a040 comp rx=0 tx=0).stop 2024-05-14T15:09:39.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:39.880+0000 7f6c33e00700 1 -- 172.21.15.69:0/2369694230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c34105c20 msgr2=0x7f6c34076050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:09:39.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:39.880+0000 7f6c33e00700 1 --2- 172.21.15.69:0/2369694230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c34105c20 0x7f6c34076050 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c007d70 tx=0x7f6c2c00a340 comp rx=0 tx=0).stop 2024-05-14T15:09:39.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:39.880+0000 7f6c33e00700 1 -- 172.21.15.69:0/2369694230 shutdown_connections 2024-05-14T15:09:39.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:39.880+0000 7f6c33e00700 1 --2- 172.21.15.69:0/2369694230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c34105c20 0x7f6c34076050 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:39.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:39.880+0000 7f6c33e00700 1 --2- 172.21.15.69:0/2369694230 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6c180b2900 0x7f6c180b4e10 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:39.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:39.880+0000 7f6c33e00700 1 --2- 172.21.15.69:0/2369694230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c34104150 0x7f6c34077460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:39.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:39.880+0000 7f6c33e00700 1 --2- 172.21.15.69:0/2369694230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c34105280 0x7f6c34075b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:39.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:39.880+0000 7f6c33e00700 1 -- 172.21.15.69:0/2369694230 >> 172.21.15.69:0/2369694230 conn(0x7f6c340ff7b0 msgr2=0x7f6c34108520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:09:39.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:39.881+0000 7f6c33e00700 1 -- 172.21.15.69:0/2369694230 shutdown_connections 2024-05-14T15:09:39.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:09:39.881+0000 7f6c33e00700 1 -- 172.21.15.69:0/2369694230 wait complete. 2024-05-14T15:09:39.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:39 smithi092 ceph-mon[34729]: from='osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-14T15:09:39.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:39 smithi092 ceph-mon[34729]: osdmap e23: 4 total, 3 up, 4 in 2024-05-14T15:09:39.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:39 smithi092 ceph-mon[34729]: from='osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-05-14T15:09:39.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:39 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:09:39.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:39 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:39.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:39 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:09:39.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:39 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:40 smithi069 ceph-mon[31270]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:40 smithi069 ceph-mon[31270]: from='osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-05-14T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:40 smithi069 ceph-mon[31270]: osdmap e24: 4 total, 3 up, 4 in 2024-05-14T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:40 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:40 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:40 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:40 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:40 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:40 smithi069 ceph-mon[31270]: from='osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620]' entity='osd.3' 2024-05-14T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:40 smithi069 ceph-mon[31270]: osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620] boot 2024-05-14T15:09:40.667 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:40 smithi069 ceph-mon[31270]: osdmap e25: 4 total, 4 up, 4 in 2024-05-14T15:09:40.718 DEBUG:teuthology.orchestra.run.smithi069:osd.3> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.3.service 2024-05-14T15:09:40.722 INFO:tasks.cephadm:Deploying osd.4 on smithi092 with /dev/vg_nvme/lv_3... 2024-05-14T15:09:40.723 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-14T15:09:40.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:40 smithi092 ceph-mon[34729]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:40.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:40 smithi092 ceph-mon[34729]: from='osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-05-14T15:09:40.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:40 smithi092 ceph-mon[34729]: osdmap e24: 4 total, 3 up, 4 in 2024-05-14T15:09:40.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:40 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:09:40.801 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:40 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:09:40.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:40 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:09:40.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:40 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:40.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:40 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:40.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:40 smithi092 ceph-mon[34729]: from='osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620]' entity='osd.3' 2024-05-14T15:09:40.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:40 smithi092 ceph-mon[34729]: osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620] boot 2024-05-14T15:09:40.802 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:40 smithi092 ceph-mon[34729]: osdmap e25: 4 total, 4 up, 4 in 2024-05-14T15:09:40.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:40 smithi203 ceph-mon[34567]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-05-14T15:09:40.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:40 smithi203 ceph-mon[34567]: from='osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-05-14T15:09:40.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:40 smithi203 ceph-mon[34567]: osdmap e24: 4 total, 3 up, 4 in 2024-05-14T15:09:40.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:40 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:09:40.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:40 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:09:40.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:40 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:09:40.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:40 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:40.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:40 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:40.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:40 smithi203 ceph-mon[34567]: from='osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620]' entity='osd.3' 2024-05-14T15:09:40.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:40 smithi203 ceph-mon[34567]: osd.3 [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620] boot 2024-05-14T15:09:40.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:40 smithi203 ceph-mon[34567]: osdmap e25: 4 total, 4 up, 4 in 2024-05-14T15:09:41.164 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T15:09:41.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:41 smithi092 ceph-mon[34729]: purged_snaps scrub starts 2024-05-14T15:09:41.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:41 smithi092 ceph-mon[34729]: purged_snaps scrub ok 2024-05-14T15:09:41.646 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:09:41.647 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:41 smithi092 ceph-mon[34729]: osdmap e26: 4 total, 4 up, 4 in 2024-05-14T15:09:41.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:41 smithi069 ceph-mon[31270]: purged_snaps scrub starts 2024-05-14T15:09:41.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:41 smithi069 ceph-mon[31270]: purged_snaps scrub ok 2024-05-14T15:09:41.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:09:41.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:41 smithi069 ceph-mon[31270]: osdmap e26: 4 total, 4 up, 4 in 2024-05-14T15:09:41.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:41 smithi203 ceph-mon[34567]: purged_snaps scrub starts 2024-05-14T15:09:41.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:41 smithi203 ceph-mon[34567]: purged_snaps scrub ok 2024-05-14T15:09:41.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:09:41.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:41 smithi203 ceph-mon[34567]: osdmap e26: 4 total, 4 up, 4 in 2024-05-14T15:09:42.636 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:42 smithi069 ceph-mon[31270]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:09:42.636 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:42 smithi069 ceph-mon[31270]: osdmap e27: 4 total, 4 up, 4 in 2024-05-14T15:09:42.784 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:42 smithi092 ceph-mon[34729]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:09:42.784 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:42 smithi092 ceph-mon[34729]: osdmap e27: 4 total, 4 up, 4 in 2024-05-14T15:09:42.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:42 smithi203 ceph-mon[34567]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:09:42.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:42 smithi203 ceph-mon[34567]: osdmap e27: 4 total, 4 up, 4 in 2024-05-14T15:09:44.075 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-14T15:09:44.075 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-14T15:09:44.075 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2024-05-14T15:09:44.075 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2024-05-14T15:09:44.075 INFO:teuthology.orchestra.run.smithi092.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0384518 s, 273 MB/s 2024-05-14T15:09:44.075 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2024-05-14T15:09:44.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:44 smithi203 ceph-mon[34567]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-14T15:09:44.855 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:44 smithi092 ceph-mon[34729]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-14T15:09:44.919 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_3 2024-05-14T15:09:44.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:44 smithi069 ceph-mon[31270]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 357 GiB / 358 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-05-14T15:09:45.360 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T15:09:46.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:46 smithi092 ceph-mon[34729]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T15:09:46.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:46 smithi092 ceph-mon[34729]: Detected new or changed devices on smithi069 2024-05-14T15:09:46.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:46 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:46.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:46 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:46.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:46 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:09:46.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:46 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:09:46.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:46 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi069 to 8544M 2024-05-14T15:09:46.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:46 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:46.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:46 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:46.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:46 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:09:46.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:46 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:46.829 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:46 smithi069 ceph-mon[31270]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T15:09:46.829 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:46 smithi069 ceph-mon[31270]: Detected new or changed devices on smithi069 2024-05-14T15:09:46.829 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:46 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:46.829 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:46 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:46.829 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:46 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:09:46.829 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:46 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:09:46.829 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:46 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi069 to 8544M 2024-05-14T15:09:46.829 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:46 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:46.830 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:46 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:46.830 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:46 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:09:46.830 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:46 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:46.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:46 smithi203 ceph-mon[34567]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 392 MiB used, 357 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-05-14T15:09:46.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:46 smithi203 ceph-mon[34567]: Detected new or changed devices on smithi069 2024-05-14T15:09:46.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:46 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:46.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:46 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:46.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:46 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:09:46.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:46 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:09:46.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:46 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi069 to 8544M 2024-05-14T15:09:46.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:46 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:46.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:46 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:46.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:46 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:09:46.840 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:46 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:09:47.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.656+0000 7f7a19600700 1 -- 172.21.15.92:0/2497825654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a141074a0 msgr2=0x7f7a14109960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:09:47.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.656+0000 7f7a19600700 1 --2- 172.21.15.92:0/2497825654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a141074a0 0x7f7a14109960 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7a00009990 tx=0x7f7a00009ca0 comp rx=0 tx=0).stop 2024-05-14T15:09:47.652 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.656+0000 7f7a19600700 1 -- 172.21.15.92:0/2497825654 shutdown_connections 2024-05-14T15:09:47.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.656+0000 7f7a19600700 1 --2- 172.21.15.92:0/2497825654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a1406c2b0 0x7f7a14106ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:47.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.656+0000 7f7a19600700 1 --2- 172.21.15.92:0/2497825654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a14109ff0 0x7f7a1410c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:47.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.656+0000 7f7a19600700 1 --2- 172.21.15.92:0/2497825654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a141074a0 0x7f7a14109960 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:47.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.656+0000 7f7a19600700 1 -- 172.21.15.92:0/2497825654 >> 172.21.15.92:0/2497825654 conn(0x7f7a140fe880 msgr2=0x7f7a14100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:09:47.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.656+0000 7f7a19600700 1 -- 172.21.15.92:0/2497825654 shutdown_connections 2024-05-14T15:09:47.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.657+0000 7f7a19600700 1 -- 172.21.15.92:0/2497825654 wait complete. 2024-05-14T15:09:47.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.658+0000 7f7a19600700 1 Processor -- start 2024-05-14T15:09:47.653 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.658+0000 7f7a19600700 1 -- start start 2024-05-14T15:09:47.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.658+0000 7f7a19600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a1406c2b0 0x7f7a1419ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:09:47.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.658+0000 7f7a19600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a141074a0 0x7f7a1419cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:09:47.655 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.658+0000 7f7a19600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a14109ff0 0x7f7a141a3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:09:47.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.658+0000 7f7a19600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1410fc50 con 0x7f7a1406c2b0 2024-05-14T15:09:47.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.658+0000 7f7a19600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1410fad0 con 0x7f7a141074a0 2024-05-14T15:09:47.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.658+0000 7f7a19600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7a1410fdd0 con 0x7f7a14109ff0 2024-05-14T15:09:47.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.658+0000 7f7a12000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a141074a0 0x7f7a1419cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:09:47.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.658+0000 7f7a12000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a141074a0 0x7f7a1419cf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:39660/0 (socket says 172.21.15.92:39660) 2024-05-14T15:09:47.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.658+0000 7f7a12000700 1 -- 172.21.15.92:0/1216504274 learned_addr learned my addr 172.21.15.92:0/1216504274 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-05-14T15:09:47.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.659+0000 7f7a12a00700 1 --2- 172.21.15.92:0/1216504274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a1406c2b0 0x7f7a1419ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:09:47.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.659+0000 7f7a13400700 1 --2- 172.21.15.92:0/1216504274 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a14109ff0 0x7f7a141a3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:09:47.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.659+0000 7f7a12000700 1 -- 172.21.15.92:0/1216504274 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a14109ff0 msgr2=0x7f7a141a3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:09:47.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.659+0000 7f7a12000700 1 --2- 172.21.15.92:0/1216504274 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a14109ff0 0x7f7a141a3ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:47.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.659+0000 7f7a12000700 1 -- 172.21.15.92:0/1216504274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a1406c2b0 msgr2=0x7f7a1419ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:09:47.656 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.659+0000 7f7a12000700 1 --2- 172.21.15.92:0/1216504274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a1406c2b0 0x7f7a1419ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:09:47.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.659+0000 7f7a12000700 1 -- 172.21.15.92:0/1216504274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a141a4570 con 0x7f7a141074a0 2024-05-14T15:09:47.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.659+0000 7f7a12000700 1 --2- 172.21.15.92:0/1216504274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a141074a0 0x7f7a1419cf50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7a000098e0 tx=0x7f7a000047b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:09:47.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.660+0000 7f7a0b400700 1 -- 172.21.15.92:0/1216504274 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00003c10 con 0x7f7a141074a0 2024-05-14T15:09:47.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.660+0000 7f7a19600700 1 -- 172.21.15.92:0/1216504274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a141a4800 con 0x7f7a141074a0 2024-05-14T15:09:47.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.660+0000 7f7a0b400700 1 -- 172.21.15.92:0/1216504274 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a00004830 con 0x7f7a141074a0 2024-05-14T15:09:47.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.660+0000 7f7a0b400700 1 -- 172.21.15.92:0/1216504274 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a00005350 con 0x7f7a141074a0 2024-05-14T15:09:47.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.660+0000 7f7a19600700 1 -- 172.21.15.92:0/1216504274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a141a4bf0 con 0x7f7a141074a0 2024-05-14T15:09:47.657 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.661+0000 7f7a19600700 1 -- 172.21.15.92:0/1216504274 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a140512c0 con 0x7f7a141074a0 2024-05-14T15:09:47.658 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.664+0000 7f7a0b400700 1 -- 172.21.15.92:0/1216504274 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7a000054f0 con 0x7f7a141074a0 2024-05-14T15:09:47.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.666+0000 7f7a0b400700 1 --2- 172.21.15.92:0/1216504274 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f79f80b2880 0x7f79f80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:09:47.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.666+0000 7f7a0b400700 1 -- 172.21.15.92:0/1216504274 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 3669+0+0 (secure 0 0 0) 0x7f7a000e25c0 con 0x7f7a141074a0 2024-05-14T15:09:47.661 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.667+0000 7f7a12a00700 1 --2- 172.21.15.92:0/1216504274 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f79f80b2880 0x7f79f80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:09:47.662 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.668+0000 7f7a12a00700 1 --2- 172.21.15.92:0/1216504274 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f79f80b2880 0x7f79f80b4d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7a04005950 tx=0x7f7a040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:09:47.665 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.670+0000 7f7a0b400700 1 -- 172.21.15.92:0/1216504274 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7a00013070 con 0x7f7a141074a0 2024-05-14T15:09:47.908 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:09:47.913+0000 7f7a19600700 1 -- 172.21.15.92:0/1216504274 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f7a1410adc0 con 0x7f79f80b2880 2024-05-14T15:09:48.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:48 smithi203 ceph-mon[34567]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-05-14T15:09:48.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:48 smithi203 ceph-mon[34567]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:09:48.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:09:48.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:09:48.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:48.870 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:48 smithi092 ceph-mon[34729]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-05-14T15:09:48.870 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:48 smithi092 ceph-mon[34729]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:09:48.871 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:09:48.871 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:09:48.871 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:48.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:48 smithi069 ceph-mon[31270]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 83 KiB/s, 0 objects/s recovering 2024-05-14T15:09:48.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:48 smithi069 ceph-mon[31270]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:09:48.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:09:48.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:09:48.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:09:50.687 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:50 smithi092 ceph-mon[34729]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T15:09:50.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:50 smithi203 ceph-mon[34567]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T15:09:50.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:50 smithi069 ceph-mon[31270]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T15:09:52.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:52 smithi092 ceph-mon[34729]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:09:52.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:52 smithi092 ceph-mon[34729]: from='client.? 172.21.15.92:0/3708894303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9aa3a6b0-cc63-4eae-8416-8ab630994985"}]: dispatch 2024-05-14T15:09:52.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:52 smithi092 ceph-mon[34729]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9aa3a6b0-cc63-4eae-8416-8ab630994985"}]: dispatch 2024-05-14T15:09:52.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:52 smithi092 ceph-mon[34729]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9aa3a6b0-cc63-4eae-8416-8ab630994985"}]': finished 2024-05-14T15:09:52.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:52 smithi092 ceph-mon[34729]: osdmap e28: 5 total, 4 up, 5 in 2024-05-14T15:09:52.831 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:52 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:09:52.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:52 smithi203 ceph-mon[34567]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:09:52.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:52 smithi203 ceph-mon[34567]: from='client.? 172.21.15.92:0/3708894303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9aa3a6b0-cc63-4eae-8416-8ab630994985"}]: dispatch 2024-05-14T15:09:52.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:52 smithi203 ceph-mon[34567]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9aa3a6b0-cc63-4eae-8416-8ab630994985"}]: dispatch 2024-05-14T15:09:52.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:52 smithi203 ceph-mon[34567]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9aa3a6b0-cc63-4eae-8416-8ab630994985"}]': finished 2024-05-14T15:09:52.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:52 smithi203 ceph-mon[34567]: osdmap e28: 5 total, 4 up, 5 in 2024-05-14T15:09:52.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:52 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:09:52.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:52 smithi069 ceph-mon[31270]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:09:52.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:52 smithi069 ceph-mon[31270]: from='client.? 172.21.15.92:0/3708894303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9aa3a6b0-cc63-4eae-8416-8ab630994985"}]: dispatch 2024-05-14T15:09:52.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:52 smithi069 ceph-mon[31270]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9aa3a6b0-cc63-4eae-8416-8ab630994985"}]: dispatch 2024-05-14T15:09:52.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:52 smithi069 ceph-mon[31270]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9aa3a6b0-cc63-4eae-8416-8ab630994985"}]': finished 2024-05-14T15:09:52.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:52 smithi069 ceph-mon[31270]: osdmap e28: 5 total, 4 up, 5 in 2024-05-14T15:09:52.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:52 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:09:53.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:53 smithi203 ceph-mon[34567]: from='client.? 172.21.15.92:0/619728815' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:09:53.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:53 smithi092 ceph-mon[34729]: from='client.? 172.21.15.92:0/619728815' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:09:53.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:53 smithi069 ceph-mon[31270]: from='client.? 172.21.15.92:0/619728815' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:09:54.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:54 smithi203 ceph-mon[34567]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:09:54.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:54 smithi092 ceph-mon[34729]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:09:54.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:54 smithi069 ceph-mon[31270]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:09:56.802 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:56 smithi069 ceph-mon[31270]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:09:56.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:56 smithi203 ceph-mon[34567]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:09:56.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:56 smithi092 ceph-mon[34729]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:09:58.717 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:09:58 smithi069 ceph-mon[31270]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:09:58.809 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:09:58 smithi092 ceph-mon[34729]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:09:58.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:09:58 smithi203 ceph-mon[34567]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:00.823 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:00 smithi092 ceph-mon[34729]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:00.824 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:00 smithi092 ceph-mon[34729]: overall HEALTH_OK 2024-05-14T15:10:00.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:00 smithi203 ceph-mon[34567]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:00.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:00 smithi203 ceph-mon[34567]: overall HEALTH_OK 2024-05-14T15:10:00.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:00 smithi069 ceph-mon[31270]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:00.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:00 smithi069 ceph-mon[31270]: overall HEALTH_OK 2024-05-14T15:10:02.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:02 smithi203 ceph-mon[34567]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:02.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-14T15:10:02.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:02.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:02 smithi203 ceph-mon[34567]: Deploying daemon osd.4 on smithi092 2024-05-14T15:10:02.842 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:02 smithi092 ceph-mon[34729]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:02.842 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-14T15:10:02.842 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:02.842 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:02 smithi092 ceph-mon[34729]: Deploying daemon osd.4 on smithi092 2024-05-14T15:10:02.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:02 smithi069 ceph-mon[31270]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:02.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-14T15:10:02.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:02.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:02 smithi069 ceph-mon[31270]: Deploying daemon osd.4 on smithi092 2024-05-14T15:10:04.728 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:04 smithi092 ceph-mon[34729]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:04.838 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:04 smithi203 ceph-mon[34567]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:04.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:04 smithi069 ceph-mon[31270]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:06.736 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:06 smithi092 ceph-mon[34729]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:06.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:06 smithi203 ceph-mon[34567]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:06.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:06 smithi069 ceph-mon[31270]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:08.937 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:08 smithi092 ceph-mon[34729]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:08.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:08 smithi069 ceph-mon[31270]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:09.089 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:08 smithi203 ceph-mon[34567]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:10.819 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:10 smithi092 ceph-mon[34729]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:10.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:10 smithi203 ceph-mon[34567]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:10.967 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:10 smithi069 ceph-mon[31270]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:12.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:12 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:12.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:12 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:10:12.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:12 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:12.349 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:12 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:12.349 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:12 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:10:12.349 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:12 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:12.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:12 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:12.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:12 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:10:12.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:12 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:13.187 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:13 smithi092 ceph-mon[34729]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:13.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:13 smithi203 ceph-mon[34567]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:13.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:13 smithi069 ceph-mon[31270]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:15.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:15 smithi203 ceph-mon[34567]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:15.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:15 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:15.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:15 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:15.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:15 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:15.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:15 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:10:15.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:15 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:15.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:15 smithi092 ceph-mon[34729]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:15.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:15 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:15.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:15 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:15.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:15 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:15.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:15 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:10:15.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:15 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:15.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:15 smithi069 ceph-mon[31270]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:15.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:15 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:15.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:15 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:15.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:15 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:15.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:15 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:10:15.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:15 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:16.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:16 smithi203 ceph-mon[34567]: from='osd.4 [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T15:10:16.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:16 smithi203 ceph-mon[34567]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T15:10:16.395 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:16 smithi092 ceph-mon[34729]: from='osd.4 [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T15:10:16.395 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:16 smithi092 ceph-mon[34729]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T15:10:16.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:16 smithi069 ceph-mon[31270]: from='osd.4 [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T15:10:16.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:16 smithi069 ceph-mon[31270]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-14T15:10:16.536 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:10:16.541+0000 7f7a0b400700 1 -- 172.21.15.92:0/1216504274 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7a1410adc0 con 0x7f79f80b2880 2024-05-14T15:10:16.536 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 4 on host 'smithi092' 2024-05-14T15:10:16.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:10:16.544+0000 7f7a19600700 1 -- 172.21.15.92:0/1216504274 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f79f80b2880 msgr2=0x7f79f80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:10:16.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:10:16.544+0000 7f7a19600700 1 --2- 172.21.15.92:0/1216504274 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f79f80b2880 0x7f79f80b4d90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f7a04005950 tx=0x7f7a040058e0 comp rx=0 tx=0).stop 2024-05-14T15:10:16.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:10:16.544+0000 7f7a19600700 1 -- 172.21.15.92:0/1216504274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a141074a0 msgr2=0x7f7a1419cf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:10:16.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:10:16.544+0000 7f7a19600700 1 --2- 172.21.15.92:0/1216504274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a141074a0 0x7f7a1419cf50 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7a000098e0 tx=0x7f7a000047b0 comp rx=0 tx=0).stop 2024-05-14T15:10:16.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:10:16.545+0000 7f7a19600700 1 -- 172.21.15.92:0/1216504274 shutdown_connections 2024-05-14T15:10:16.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:10:16.545+0000 7f7a19600700 1 --2- 172.21.15.92:0/1216504274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a1406c2b0 0x7f7a1419ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:10:16.540 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:10:16.545+0000 7f7a19600700 1 --2- 172.21.15.92:0/1216504274 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f79f80b2880 0x7f79f80b4d90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:10:16.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:10:16.545+0000 7f7a19600700 1 --2- 172.21.15.92:0/1216504274 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a14109ff0 0x7f7a141a3ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:10:16.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:10:16.545+0000 7f7a19600700 1 --2- 172.21.15.92:0/1216504274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a141074a0 0x7f7a1419cf50 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:10:16.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:10:16.545+0000 7f7a19600700 1 -- 172.21.15.92:0/1216504274 >> 172.21.15.92:0/1216504274 conn(0x7f7a140fe880 msgr2=0x7f7a14100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:10:16.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:10:16.545+0000 7f7a19600700 1 -- 172.21.15.92:0/1216504274 shutdown_connections 2024-05-14T15:10:16.541 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:10:16.545+0000 7f7a19600700 1 -- 172.21.15.92:0/1216504274 wait complete. 2024-05-14T15:10:17.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:17 smithi203 ceph-mon[34567]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:17.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:17 smithi203 ceph-mon[34567]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-14T15:10:17.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:17 smithi203 ceph-mon[34567]: osdmap e29: 5 total, 4 up, 5 in 2024-05-14T15:10:17.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:10:17.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:17 smithi203 ceph-mon[34567]: from='osd.4 [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:10:17.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:17 smithi203 ceph-mon[34567]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:10:17.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:17.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:17.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:10:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:17 smithi092 ceph-mon[34729]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:17 smithi092 ceph-mon[34729]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-14T15:10:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:17 smithi092 ceph-mon[34729]: osdmap e29: 5 total, 4 up, 5 in 2024-05-14T15:10:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:10:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:17 smithi092 ceph-mon[34729]: from='osd.4 [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:10:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:17 smithi092 ceph-mon[34729]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:10:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:17.377 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:10:17.426 DEBUG:teuthology.orchestra.run.smithi092:osd.4> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.4.service 2024-05-14T15:10:17.430 INFO:tasks.cephadm:Deploying osd.5 on smithi203 with /dev/vg_nvme/lv_3... 2024-05-14T15:10:17.430 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-14T15:10:17.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:17 smithi069 ceph-mon[31270]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:17.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:17 smithi069 ceph-mon[31270]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-14T15:10:17.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:17 smithi069 ceph-mon[31270]: osdmap e29: 5 total, 4 up, 5 in 2024-05-14T15:10:17.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:10:17.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:17 smithi069 ceph-mon[31270]: from='osd.4 [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:10:17.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:17 smithi069 ceph-mon[31270]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:10:17.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:17.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:17.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:10:17.881 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:10:18.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:18 smithi203 ceph-mon[34567]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-05-14T15:10:18.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:18 smithi203 ceph-mon[34567]: osdmap e30: 5 total, 4 up, 5 in 2024-05-14T15:10:18.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:18 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:10:18.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:18 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:10:18.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:18 smithi203 ceph-mon[34567]: from='osd.4 ' entity='osd.4' 2024-05-14T15:10:18.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:18 smithi092 ceph-mon[34729]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-05-14T15:10:18.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:18 smithi092 ceph-mon[34729]: osdmap e30: 5 total, 4 up, 5 in 2024-05-14T15:10:18.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:18 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:10:18.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:18 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:10:18.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:18 smithi092 ceph-mon[34729]: from='osd.4 ' entity='osd.4' 2024-05-14T15:10:18.438 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:10:17 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4[46159]: 2024-05-14T15:10:17.980+0000 7f362dc00700 -1 osd.4 0 waiting for initial osdmap 2024-05-14T15:10:18.439 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:10:18 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4[46159]: 2024-05-14T15:10:18.008+0000 7f3623a00700 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T15:10:18.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:18 smithi069 ceph-mon[31270]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-05-14T15:10:18.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:18 smithi069 ceph-mon[31270]: osdmap e30: 5 total, 4 up, 5 in 2024-05-14T15:10:18.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:18 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:10:18.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:18 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:10:18.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:18 smithi069 ceph-mon[31270]: from='osd.4 ' entity='osd.4' 2024-05-14T15:10:19.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:19 smithi203 ceph-mon[34567]: purged_snaps scrub starts 2024-05-14T15:10:19.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:19 smithi203 ceph-mon[34567]: purged_snaps scrub ok 2024-05-14T15:10:19.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:19 smithi203 ceph-mon[34567]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:19.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:19 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:10:19.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:19 smithi203 ceph-mon[34567]: osd.4 [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048] boot 2024-05-14T15:10:19.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:19 smithi203 ceph-mon[34567]: osdmap e31: 5 total, 5 up, 5 in 2024-05-14T15:10:19.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:19 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:10:19.422 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:19 smithi092 ceph-mon[34729]: purged_snaps scrub starts 2024-05-14T15:10:19.422 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:19 smithi092 ceph-mon[34729]: purged_snaps scrub ok 2024-05-14T15:10:19.422 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:19 smithi092 ceph-mon[34729]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:19.422 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:19 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:10:19.422 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:19 smithi092 ceph-mon[34729]: osd.4 [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048] boot 2024-05-14T15:10:19.422 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:19 smithi092 ceph-mon[34729]: osdmap e31: 5 total, 5 up, 5 in 2024-05-14T15:10:19.422 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:19 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:10:19.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:19 smithi069 ceph-mon[31270]: purged_snaps scrub starts 2024-05-14T15:10:19.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:19 smithi069 ceph-mon[31270]: purged_snaps scrub ok 2024-05-14T15:10:19.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:19 smithi069 ceph-mon[31270]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 120 MiB used, 357 GiB / 358 GiB avail 2024-05-14T15:10:19.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:19 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:10:19.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:19 smithi069 ceph-mon[31270]: osd.4 [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048] boot 2024-05-14T15:10:19.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:19 smithi069 ceph-mon[31270]: osdmap e31: 5 total, 5 up, 5 in 2024-05-14T15:10:19.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:19 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:10:20.941 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-14T15:10:20.941 INFO:teuthology.orchestra.run.smithi203.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-14T15:10:20.941 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10+0 records in 2024-05-14T15:10:20.941 INFO:teuthology.orchestra.run.smithi203.stderr:10+0 records out 2024-05-14T15:10:20.941 INFO:teuthology.orchestra.run.smithi203.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0335749 s, 312 MB/s 2024-05-14T15:10:20.942 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping successful for: 2024-05-14T15:10:21.187 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:20 smithi092 ceph-mon[34729]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:21.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:20 smithi092 ceph-mon[34729]: osdmap e32: 5 total, 5 up, 5 in 2024-05-14T15:10:21.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:20 smithi203 ceph-mon[34567]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:21.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:20 smithi203 ceph-mon[34567]: osdmap e32: 5 total, 5 up, 5 in 2024-05-14T15:10:21.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:20 smithi069 ceph-mon[31270]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:21.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:20 smithi069 ceph-mon[31270]: osdmap e32: 5 total, 5 up, 5 in 2024-05-14T15:10:21.765 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_3 2024-05-14T15:10:22.209 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:10:23.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:22 smithi203 ceph-mon[34567]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:23.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:22 smithi203 ceph-mon[34567]: Detected new or changed devices on smithi092 2024-05-14T15:10:23.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:22 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:23.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:22 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:23.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:22 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:10:23.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:22 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:10:23.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:22 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi092 to 8544M 2024-05-14T15:10:23.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:22 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:23.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:22 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:23.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:22 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:10:23.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:22 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:23.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:22 smithi092 ceph-mon[34729]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:23.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:22 smithi092 ceph-mon[34729]: Detected new or changed devices on smithi092 2024-05-14T15:10:23.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:22 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:23.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:22 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:23.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:22 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:10:23.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:22 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:10:23.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:22 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi092 to 8544M 2024-05-14T15:10:23.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:22 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:23.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:22 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:23.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:22 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:10:23.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:22 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:23.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:22 smithi069 ceph-mon[31270]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:23.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:22 smithi069 ceph-mon[31270]: Detected new or changed devices on smithi092 2024-05-14T15:10:23.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:22 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:23.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:22 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:23.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:22 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:10:23.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:22 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:10:23.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:22 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi092 to 8544M 2024-05-14T15:10:23.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:22 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:23.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:22 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:23.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:22 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:10:23.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:22 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:24.477 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.481+0000 7fbbc3200700 1 -- 172.21.15.203:0/2598751615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbc4106380 msgr2=0x7fbbc4106790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:10:24.477 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.481+0000 7fbbc3200700 1 --2- 172.21.15.203:0/2598751615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbc4106380 0x7fbbc4106790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4009990 tx=0x7fbbb4009ca0 comp rx=0 tx=0).stop 2024-05-14T15:10:24.478 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.482+0000 7fbbc3200700 1 -- 172.21.15.203:0/2598751615 shutdown_connections 2024-05-14T15:10:24.478 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.482+0000 7fbbc3200700 1 --2- 172.21.15.203:0/2598751615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbc4107e50 0x7fbbc410e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:10:24.478 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.482+0000 7fbbc3200700 1 --2- 172.21.15.203:0/2598751615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbc4106380 0x7fbbc4106790 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:10:24.478 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.482+0000 7fbbc3200700 1 --2- 172.21.15.203:0/2598751615 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbc41074b0 0x7fbbc41078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:10:24.478 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.482+0000 7fbbc3200700 1 -- 172.21.15.203:0/2598751615 >> 172.21.15.203:0/2598751615 conn(0x7fbbc41019c0 msgr2=0x7fbbc4103e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:10:24.478 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.482+0000 7fbbc3200700 1 -- 172.21.15.203:0/2598751615 shutdown_connections 2024-05-14T15:10:24.478 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.482+0000 7fbbc3200700 1 -- 172.21.15.203:0/2598751615 wait complete. 2024-05-14T15:10:24.479 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.483+0000 7fbbc3200700 1 Processor -- start 2024-05-14T15:10:24.479 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.483+0000 7fbbc3200700 1 -- start start 2024-05-14T15:10:24.479 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.484+0000 7fbbc3200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbc4106380 0x7fbbc419c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:10:24.480 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.484+0000 7fbbc3200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbc41074b0 0x7fbbc419cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:10:24.480 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.484+0000 7fbbc3200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbc4107e50 0x7fbbc41a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:10:24.480 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.484+0000 7fbbc3200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc4111c70 con 0x7fbbc41074b0 2024-05-14T15:10:24.480 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.484+0000 7fbbc3200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc4111af0 con 0x7fbbc4107e50 2024-05-14T15:10:24.480 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.484+0000 7fbbc3200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbbc4111df0 con 0x7fbbc4106380 2024-05-14T15:10:24.480 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.484+0000 7fbbc1e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbc4106380 0x7fbbc419c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:10:24.480 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.484+0000 7fbbc1e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbc4106380 0x7fbbc419c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:33952/0 (socket says 172.21.15.203:33952) 2024-05-14T15:10:24.480 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.484+0000 7fbbc1e00700 1 -- 172.21.15.203:0/3867370498 learned_addr learned my addr 172.21.15.203:0/3867370498 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-05-14T15:10:24.480 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.484+0000 7fbbc1400700 1 --2- 172.21.15.203:0/3867370498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbc41074b0 0x7fbbc419cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:10:24.480 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.484+0000 7fbbc2800700 1 --2- 172.21.15.203:0/3867370498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbc4107e50 0x7fbbc41a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:10:24.480 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.485+0000 7fbbc1e00700 1 -- 172.21.15.203:0/3867370498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbc4107e50 msgr2=0x7fbbc41a3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:10:24.480 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.485+0000 7fbbc1e00700 1 --2- 172.21.15.203:0/3867370498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbc4107e50 0x7fbbc41a3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:10:24.480 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.485+0000 7fbbc1e00700 1 -- 172.21.15.203:0/3867370498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbc41074b0 msgr2=0x7fbbc419cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:10:24.481 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.485+0000 7fbbc1e00700 1 --2- 172.21.15.203:0/3867370498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbc41074b0 0x7fbbc419cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:10:24.481 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.485+0000 7fbbc1e00700 1 -- 172.21.15.203:0/3867370498 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbc41a43d0 con 0x7fbbc4106380 2024-05-14T15:10:24.482 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.485+0000 7fbbc1e00700 1 --2- 172.21.15.203:0/3867370498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbc4106380 0x7fbbc419c870 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4000c00 tx=0x7fbbb4009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:10:24.482 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.485+0000 7fbbbaa00700 1 -- 172.21.15.203:0/3867370498 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4027070 con 0x7fbbc4106380 2024-05-14T15:10:24.482 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.485+0000 7fbbbaa00700 1 -- 172.21.15.203:0/3867370498 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbbb40040a0 con 0x7fbbc4106380 2024-05-14T15:10:24.482 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.485+0000 7fbbc3200700 1 -- 172.21.15.203:0/3867370498 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbc41a4660 con 0x7fbbc4106380 2024-05-14T15:10:24.482 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.485+0000 7fbbbaa00700 1 -- 172.21.15.203:0/3867370498 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbbb4022c90 con 0x7fbbc4106380 2024-05-14T15:10:24.482 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.486+0000 7fbbc3200700 1 -- 172.21.15.203:0/3867370498 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbc41a4b10 con 0x7fbbc4106380 2024-05-14T15:10:24.482 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.487+0000 7fbbc3200700 1 -- 172.21.15.203:0/3867370498 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbc40512c0 con 0x7fbbc4106380 2024-05-14T15:10:24.484 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.489+0000 7fbbbaa00700 1 -- 172.21.15.203:0/3867370498 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fbbb402a070 con 0x7fbbc4106380 2024-05-14T15:10:24.485 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.491+0000 7fbbbaa00700 1 --2- 172.21.15.203:0/3867370498 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbba80b2900 0x7fbba80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:10:24.486 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.491+0000 7fbbbaa00700 1 -- 172.21.15.203:0/3867370498 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 4101+0+0 (secure 0 0 0) 0x7fbbb40e2250 con 0x7fbbc4106380 2024-05-14T15:10:24.486 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.491+0000 7fbbc1400700 1 --2- 172.21.15.203:0/3867370498 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbba80b2900 0x7fbba80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:10:24.487 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.492+0000 7fbbc1400700 1 --2- 172.21.15.203:0/3867370498 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbba80b2900 0x7fbba80b4e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0005950 tx=0x7fbbb00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:10:24.491 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.496+0000 7fbbbaa00700 1 -- 172.21.15.203:0/3867370498 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbbb4013070 con 0x7fbbc4106380 2024-05-14T15:10:24.734 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:24.738+0000 7fbbc3200700 1 -- 172.21.15.203:0/3867370498 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fbbc4063c00 con 0x7fbba80b2900 2024-05-14T15:10:25.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:24 smithi203 ceph-mon[34567]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:25.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:10:25.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:10:25.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:25.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:24 smithi092 ceph-mon[34729]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:25.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:10:25.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:10:25.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:25.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:24 smithi069 ceph-mon[31270]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:25.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:10:25.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:10:25.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:26.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:26 smithi203 ceph-mon[34567]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:10:26.370 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:26 smithi069 ceph-mon[31270]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:10:26.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:26 smithi092 ceph-mon[34729]: from='client.24232 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:10:27.241 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:27 smithi203 ceph-mon[34567]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:27.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:27 smithi092 ceph-mon[34729]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:27.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:27 smithi069 ceph-mon[31270]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:29.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:29 smithi203 ceph-mon[34567]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:29.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:29 smithi092 ceph-mon[34729]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:29.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:29 smithi069 ceph-mon[31270]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:30.089 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:30 smithi203 ceph-mon[34567]: from='client.? 172.21.15.203:0/717711495' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7fcde57-e280-494b-a45f-8fa007ed9ee9"}]: dispatch 2024-05-14T15:10:30.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:30 smithi203 ceph-mon[34567]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7fcde57-e280-494b-a45f-8fa007ed9ee9"}]: dispatch 2024-05-14T15:10:30.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:30 smithi203 ceph-mon[34567]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7fcde57-e280-494b-a45f-8fa007ed9ee9"}]': finished 2024-05-14T15:10:30.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:30 smithi203 ceph-mon[34567]: osdmap e33: 6 total, 5 up, 6 in 2024-05-14T15:10:30.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:30 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:30.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:30 smithi092 ceph-mon[34729]: from='client.? 172.21.15.203:0/717711495' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7fcde57-e280-494b-a45f-8fa007ed9ee9"}]: dispatch 2024-05-14T15:10:30.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:30 smithi092 ceph-mon[34729]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7fcde57-e280-494b-a45f-8fa007ed9ee9"}]: dispatch 2024-05-14T15:10:30.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:30 smithi092 ceph-mon[34729]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7fcde57-e280-494b-a45f-8fa007ed9ee9"}]': finished 2024-05-14T15:10:30.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:30 smithi092 ceph-mon[34729]: osdmap e33: 6 total, 5 up, 6 in 2024-05-14T15:10:30.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:30 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:30.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:30 smithi069 ceph-mon[31270]: from='client.? 172.21.15.203:0/717711495' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7fcde57-e280-494b-a45f-8fa007ed9ee9"}]: dispatch 2024-05-14T15:10:30.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:30 smithi069 ceph-mon[31270]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f7fcde57-e280-494b-a45f-8fa007ed9ee9"}]: dispatch 2024-05-14T15:10:30.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:30 smithi069 ceph-mon[31270]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f7fcde57-e280-494b-a45f-8fa007ed9ee9"}]': finished 2024-05-14T15:10:30.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:30 smithi069 ceph-mon[31270]: osdmap e33: 6 total, 5 up, 6 in 2024-05-14T15:10:30.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:30 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:31.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:31 smithi203 ceph-mon[34567]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:31.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:31 smithi203 ceph-mon[34567]: from='client.? 172.21.15.203:0/3388282364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:10:31.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:31 smithi092 ceph-mon[34729]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:31.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:31 smithi092 ceph-mon[34729]: from='client.? 172.21.15.203:0/3388282364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:10:31.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:31 smithi069 ceph-mon[31270]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:31.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:31 smithi069 ceph-mon[31270]: from='client.? 172.21.15.203:0/3388282364' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:10:33.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:33 smithi203 ceph-mon[34567]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:33.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:33 smithi092 ceph-mon[34729]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:33.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:33 smithi069 ceph-mon[31270]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:35.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:35 smithi203 ceph-mon[34567]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:35.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:35 smithi092 ceph-mon[34729]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:35.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:35 smithi069 ceph-mon[31270]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:37.289 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:37 smithi203 ceph-mon[34567]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:37.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:37 smithi092 ceph-mon[34729]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:37.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:37 smithi069 ceph-mon[31270]: pgmap v170: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:39.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:39 smithi203 ceph-mon[34567]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:39.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:39 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-14T15:10:39.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:39 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:39.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:39 smithi092 ceph-mon[34729]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:39.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:39 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-14T15:10:39.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:39 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:39.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:39 smithi069 ceph-mon[31270]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:39.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:39 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-14T15:10:39.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:39 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:40.229 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:40 smithi203 ceph-mon[34567]: Deploying daemon osd.5 on smithi203 2024-05-14T15:10:40.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:40 smithi092 ceph-mon[34729]: Deploying daemon osd.5 on smithi203 2024-05-14T15:10:40.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:40 smithi069 ceph-mon[31270]: Deploying daemon osd.5 on smithi203 2024-05-14T15:10:41.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:41 smithi203 ceph-mon[34567]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:41.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:41 smithi092 ceph-mon[34729]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:41.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:41 smithi069 ceph-mon[31270]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:43.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:43 smithi203 ceph-mon[34567]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:43.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:43 smithi092 ceph-mon[34729]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:43.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:43 smithi069 ceph-mon[31270]: pgmap v173: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:45.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:45 smithi203 ceph-mon[34567]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:45.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:45 smithi092 ceph-mon[34729]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:45.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:45 smithi069 ceph-mon[31270]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:47.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:47 smithi203 ceph-mon[34567]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:47.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:47 smithi092 ceph-mon[34729]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:47.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:47 smithi069 ceph-mon[31270]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:49.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:49 smithi203 ceph-mon[34567]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:49.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:49.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:49.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:10:49.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:49 smithi092 ceph-mon[34729]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:49.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:49.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:49.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:10:49.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:49 smithi069 ceph-mon[31270]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:49.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:49.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:49.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:10:51.405 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:51 smithi203 ceph-mon[34567]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:51.437 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:51 smithi092 ceph-mon[34729]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:51.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:51 smithi069 ceph-mon[31270]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:52.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:52 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:52.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:52 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:52.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:52 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:52.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:52 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:10:52.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:52 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:52.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:52 smithi203 ceph-mon[34567]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:52.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:52 smithi203 ceph-mon[34567]: from='osd.5 [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T15:10:52.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:52 smithi203 ceph-mon[34567]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T15:10:52.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:52 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:52.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:52 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:52.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:52 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:52.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:52 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:10:52.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:52 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:52.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:52 smithi092 ceph-mon[34729]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:52.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:52 smithi092 ceph-mon[34729]: from='osd.5 [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T15:10:52.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:52 smithi092 ceph-mon[34729]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T15:10:52.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:52 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:52.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:52 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:52.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:52 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:10:52.719 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:52 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:10:52.719 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:52 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:52.719 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:52 smithi069 ceph-mon[31270]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:52.719 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:52 smithi069 ceph-mon[31270]: from='osd.5 [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T15:10:52.719 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:52 smithi069 ceph-mon[31270]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-14T15:10:53.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:53 smithi203 ceph-mon[34567]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-14T15:10:53.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:53 smithi203 ceph-mon[34567]: from='osd.5 [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:10:53.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:53 smithi203 ceph-mon[34567]: osdmap e34: 6 total, 5 up, 6 in 2024-05-14T15:10:53.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:53 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:53.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:53 smithi203 ceph-mon[34567]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:10:53.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:53 smithi092 ceph-mon[34729]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-14T15:10:53.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:53 smithi092 ceph-mon[34729]: from='osd.5 [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:10:53.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:53 smithi092 ceph-mon[34729]: osdmap e34: 6 total, 5 up, 6 in 2024-05-14T15:10:53.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:53 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:53.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:53 smithi092 ceph-mon[34729]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:10:53.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:53 smithi069 ceph-mon[31270]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-14T15:10:53.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:53 smithi069 ceph-mon[31270]: from='osd.5 [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:10:53.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:53 smithi069 ceph-mon[31270]: osdmap e34: 6 total, 5 up, 6 in 2024-05-14T15:10:53.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:53 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:53.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:53 smithi069 ceph-mon[31270]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:10:54.204 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 5 on host 'smithi203' 2024-05-14T15:10:54.204 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:54.207+0000 7fbbbaa00700 1 -- 172.21.15.203:0/3867370498 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fbbc4063c00 con 0x7fbba80b2900 2024-05-14T15:10:54.208 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:54.211+0000 7fbbc3200700 1 -- 172.21.15.203:0/3867370498 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbba80b2900 msgr2=0x7fbba80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:10:54.208 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:54.211+0000 7fbbc3200700 1 --2- 172.21.15.203:0/3867370498 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbba80b2900 0x7fbba80b4e10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0005950 tx=0x7fbbb00058e0 comp rx=0 tx=0).stop 2024-05-14T15:10:54.208 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:54.211+0000 7fbbc3200700 1 -- 172.21.15.203:0/3867370498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbc4106380 msgr2=0x7fbbc419c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:10:54.208 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:54.211+0000 7fbbc3200700 1 --2- 172.21.15.203:0/3867370498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbc4106380 0x7fbbc419c870 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbbb4000c00 tx=0x7fbbb4009510 comp rx=0 tx=0).stop 2024-05-14T15:10:54.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:54.212+0000 7fbbc3200700 1 -- 172.21.15.203:0/3867370498 shutdown_connections 2024-05-14T15:10:54.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:54.212+0000 7fbbc3200700 1 --2- 172.21.15.203:0/3867370498 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbba80b2900 0x7fbba80b4e10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:10:54.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:54.212+0000 7fbbc3200700 1 --2- 172.21.15.203:0/3867370498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbbc4107e50 0x7fbbc41a3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:10:54.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:54.212+0000 7fbbc3200700 1 --2- 172.21.15.203:0/3867370498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbbc4106380 0x7fbbc419c870 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:10:54.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:54.212+0000 7fbbc3200700 1 --2- 172.21.15.203:0/3867370498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbbc41074b0 0x7fbbc419cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:10:54.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:54.212+0000 7fbbc3200700 1 -- 172.21.15.203:0/3867370498 >> 172.21.15.203:0/3867370498 conn(0x7fbbc41019c0 msgr2=0x7fbbc410a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:10:54.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:54.212+0000 7fbbc3200700 1 -- 172.21.15.203:0/3867370498 shutdown_connections 2024-05-14T15:10:54.209 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:10:54.212+0000 7fbbc3200700 1 -- 172.21.15.203:0/3867370498 wait complete. 2024-05-14T15:10:54.708 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:54 smithi203 ceph-mon[34567]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-05-14T15:10:54.708 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:54 smithi203 ceph-mon[34567]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:54.709 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:54 smithi203 ceph-mon[34567]: osdmap e35: 6 total, 5 up, 6 in 2024-05-14T15:10:54.709 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:54 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:54.709 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:54 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:54.709 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:54 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:54.709 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:54 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:54.709 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:54 smithi203 ceph-mon[34567]: osdmap e36: 6 total, 5 up, 6 in 2024-05-14T15:10:54.709 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:54 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:54.709 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:54 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:10:54.709 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:54 smithi203 ceph-mon[34567]: from='osd.5 ' entity='osd.5' 2024-05-14T15:10:54.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:54 smithi092 ceph-mon[34729]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-05-14T15:10:54.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:54 smithi092 ceph-mon[34729]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:54.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:54 smithi092 ceph-mon[34729]: osdmap e35: 6 total, 5 up, 6 in 2024-05-14T15:10:54.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:54 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:54.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:54 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:54.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:54 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:54.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:54 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:54.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:54 smithi092 ceph-mon[34729]: osdmap e36: 6 total, 5 up, 6 in 2024-05-14T15:10:54.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:54 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:54.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:54 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:10:54.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:54 smithi092 ceph-mon[34729]: from='osd.5 ' entity='osd.5' 2024-05-14T15:10:54.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:54 smithi069 ceph-mon[31270]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-05-14T15:10:54.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:54 smithi069 ceph-mon[31270]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:54.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:54 smithi069 ceph-mon[31270]: osdmap e35: 6 total, 5 up, 6 in 2024-05-14T15:10:54.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:54 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:54.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:54 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:54.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:54 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:54.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:54 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:10:54.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:54 smithi069 ceph-mon[31270]: osdmap e36: 6 total, 5 up, 6 in 2024-05-14T15:10:54.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:54 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:54.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:54 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:10:54.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:54 smithi069 ceph-mon[31270]: from='osd.5 ' entity='osd.5' 2024-05-14T15:10:55.131 DEBUG:teuthology.orchestra.run.smithi203:osd.5> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.5.service 2024-05-14T15:10:55.136 INFO:tasks.cephadm:Deploying osd.6 on smithi069 with /dev/vg_nvme/lv_2... 2024-05-14T15:10:55.136 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-14T15:10:55.573 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:10:55.625 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:55 smithi203 ceph-mon[34567]: purged_snaps scrub starts 2024-05-14T15:10:55.625 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:55 smithi203 ceph-mon[34567]: purged_snaps scrub ok 2024-05-14T15:10:55.625 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:55 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:55.626 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:55 smithi203 ceph-mon[34567]: osd.5 [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851] boot 2024-05-14T15:10:55.626 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:55 smithi203 ceph-mon[34567]: osdmap e37: 6 total, 6 up, 6 in 2024-05-14T15:10:55.626 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:55 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:55.754 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:55 smithi069 ceph-mon[31270]: purged_snaps scrub starts 2024-05-14T15:10:55.754 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:55 smithi069 ceph-mon[31270]: purged_snaps scrub ok 2024-05-14T15:10:55.754 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:55 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:55.754 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:55 smithi069 ceph-mon[31270]: osd.5 [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851] boot 2024-05-14T15:10:55.754 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:55 smithi069 ceph-mon[31270]: osdmap e37: 6 total, 6 up, 6 in 2024-05-14T15:10:55.754 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:55 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:55.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:55 smithi092 ceph-mon[34729]: purged_snaps scrub starts 2024-05-14T15:10:55.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:55 smithi092 ceph-mon[34729]: purged_snaps scrub ok 2024-05-14T15:10:55.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:55 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:55.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:55 smithi092 ceph-mon[34729]: osd.5 [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851] boot 2024-05-14T15:10:55.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:55 smithi092 ceph-mon[34729]: osdmap e37: 6 total, 6 up, 6 in 2024-05-14T15:10:55.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:55 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:10:57.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:57 smithi203 ceph-mon[34567]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:57.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:57 smithi203 ceph-mon[34567]: osdmap e38: 6 total, 6 up, 6 in 2024-05-14T15:10:57.401 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:57 smithi069 ceph-mon[31270]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:57.401 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:57 smithi069 ceph-mon[31270]: osdmap e38: 6 total, 6 up, 6 in 2024-05-14T15:10:57.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:57 smithi092 ceph-mon[34729]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-05-14T15:10:57.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:57 smithi092 ceph-mon[34729]: osdmap e38: 6 total, 6 up, 6 in 2024-05-14T15:10:58.576 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:58 smithi069 ceph-mon[31270]: osdmap e39: 6 total, 6 up, 6 in 2024-05-14T15:10:58.577 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-14T15:10:58.577 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-14T15:10:58.577 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2024-05-14T15:10:58.577 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2024-05-14T15:10:58.577 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0357275 s, 293 MB/s 2024-05-14T15:10:58.577 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2024-05-14T15:10:58.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:58 smithi203 ceph-mon[34567]: osdmap e39: 6 total, 6 up, 6 in 2024-05-14T15:10:58.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:58 smithi092 ceph-mon[34729]: osdmap e39: 6 total, 6 up, 6 in 2024-05-14T15:10:59.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:10:59 smithi069 ceph-mon[31270]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:10:59.492 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:10:59 smithi203 ceph-mon[34567]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:10:59.545 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi069:vg_nvme/lv_2 2024-05-14T15:10:59.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:10:59 smithi092 ceph-mon[34729]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:10:59.982 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:11:01.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:01 smithi092 ceph-mon[34729]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-05-14T15:11:01.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:01 smithi092 ceph-mon[34729]: Detected new or changed devices on smithi203 2024-05-14T15:11:01.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:01 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:01.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:01 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:01.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:01 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:11:01.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:01 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:11:01.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:01 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi203 to 8544M 2024-05-14T15:11:01.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:01 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:01.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:01 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:01.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:01 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:11:01.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:01 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:01.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:01 smithi069 ceph-mon[31270]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-05-14T15:11:01.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:01 smithi069 ceph-mon[31270]: Detected new or changed devices on smithi203 2024-05-14T15:11:01.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:01 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:01.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:01 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:01.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:01 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:11:01.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:01 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:11:01.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:01 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi203 to 8544M 2024-05-14T15:11:01.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:01 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:01.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:01 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:01.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:01 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:11:01.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:01 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:01.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:01 smithi203 ceph-mon[34567]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-05-14T15:11:01.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:01 smithi203 ceph-mon[34567]: Detected new or changed devices on smithi203 2024-05-14T15:11:01.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:01 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:01.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:01 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:01.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:01 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:11:01.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:01 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:11:01.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:01 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi203 to 8544M 2024-05-14T15:11:01.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:01 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:01.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:01 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:01.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:01 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:11:01.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:01 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:02.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.473+0000 7f201a400700 1 -- 172.21.15.69:0/1215755698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20141052a0 msgr2=0x7f20141056b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:11:02.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.473+0000 7f201a400700 1 --2- 172.21.15.69:0/1215755698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20141052a0 0x7f20141056b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2004009990 tx=0x7f2004009ca0 comp rx=0 tx=0).stop 2024-05-14T15:11:02.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.473+0000 7f201a400700 1 -- 172.21.15.69:0/1215755698 shutdown_connections 2024-05-14T15:11:02.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.473+0000 7f201a400700 1 --2- 172.21.15.69:0/1215755698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2014105c40 0x7f201410c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:11:02.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.473+0000 7f201a400700 1 --2- 172.21.15.69:0/1215755698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2014104170 0x7f2014104580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:11:02.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.473+0000 7f201a400700 1 --2- 172.21.15.69:0/1215755698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20141052a0 0x7f20141056b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:11:02.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.473+0000 7f201a400700 1 -- 172.21.15.69:0/1215755698 >> 172.21.15.69:0/1215755698 conn(0x7f20140ff7b0 msgr2=0x7f2014101c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:11:02.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.473+0000 7f201a400700 1 -- 172.21.15.69:0/1215755698 shutdown_connections 2024-05-14T15:11:02.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.474+0000 7f201a400700 1 -- 172.21.15.69:0/1215755698 wait complete. 2024-05-14T15:11:02.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.475+0000 7f201a400700 1 Processor -- start 2024-05-14T15:11:02.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.475+0000 7f201a400700 1 -- start start 2024-05-14T15:11:02.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.475+0000 7f201a400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2014104170 0x7f2014077460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:11:02.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.475+0000 7f201a400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20141052a0 0x7f2014075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:11:02.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.475+0000 7f201a400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2014105c40 0x7f2014076050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:11:02.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.475+0000 7f201a400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f201410fad0 con 0x7f2014104170 2024-05-14T15:11:02.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.475+0000 7f201a400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f201410f950 con 0x7f20141052a0 2024-05-14T15:11:02.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.475+0000 7f201a400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f201410fc50 con 0x7f2014105c40 2024-05-14T15:11:02.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.475+0000 7f2019000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2014104170 0x7f2014077460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:11:02.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.475+0000 7f2019000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2014104170 0x7f2014077460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48806/0 (socket says 172.21.15.69:48806) 2024-05-14T15:11:02.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.475+0000 7f2019000700 1 -- 172.21.15.69:0/733761434 learned_addr learned my addr 172.21.15.69:0/733761434 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:11:02.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.476+0000 7f2019a00700 1 --2- 172.21.15.69:0/733761434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2014105c40 0x7f2014076050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:11:02.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.476+0000 7f2019000700 1 -- 172.21.15.69:0/733761434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2014105c40 msgr2=0x7f2014076050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:11:02.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.476+0000 7f2019000700 1 --2- 172.21.15.69:0/733761434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2014105c40 0x7f2014076050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:11:02.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.476+0000 7f2013e00700 1 --2- 172.21.15.69:0/733761434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20141052a0 0x7f2014075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:11:02.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.476+0000 7f2019000700 1 -- 172.21.15.69:0/733761434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20141052a0 msgr2=0x7f2014075b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:11:02.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.476+0000 7f2019000700 1 --2- 172.21.15.69:0/733761434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20141052a0 0x7f2014075b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:11:02.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.476+0000 7f2019000700 1 -- 172.21.15.69:0/733761434 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20140767b0 con 0x7f2014104170 2024-05-14T15:11:02.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.476+0000 7f2019000700 1 --2- 172.21.15.69:0/733761434 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2014104170 0x7f2014077460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f200800d950 tx=0x7f200800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:11:02.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.476+0000 7f2011600700 1 -- 172.21.15.69:0/733761434 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2008017070 con 0x7f2014104170 2024-05-14T15:11:02.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.477+0000 7f2011600700 1 -- 172.21.15.69:0/733761434 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f200800de30 con 0x7f2014104170 2024-05-14T15:11:02.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.477+0000 7f2011600700 1 -- 172.21.15.69:0/733761434 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2008003aa0 con 0x7f2014104170 2024-05-14T15:11:02.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.477+0000 7f201a400700 1 -- 172.21.15.69:0/733761434 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20141a47a0 con 0x7f2014104170 2024-05-14T15:11:02.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.477+0000 7f201a400700 1 -- 172.21.15.69:0/733761434 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20141a4cd0 con 0x7f2014104170 2024-05-14T15:11:02.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.478+0000 7f201a400700 1 -- 172.21.15.69:0/733761434 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20140512c0 con 0x7f2014104170 2024-05-14T15:11:02.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.481+0000 7f2011600700 1 -- 172.21.15.69:0/733761434 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2008003c40 con 0x7f2014104170 2024-05-14T15:11:02.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.482+0000 7f2011600700 1 --2- 172.21.15.69:0/733761434 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1ffc0b2900 0x7f1ffc0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:11:02.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.483+0000 7f2011600700 1 -- 172.21.15.69:0/733761434 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(39..39 src has 1..39) ==== 4533+0+0 (secure 0 0 0) 0x7f20080e1710 con 0x7f2014104170 2024-05-14T15:11:02.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.483+0000 7f2013e00700 1 --2- 172.21.15.69:0/733761434 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1ffc0b2900 0x7f1ffc0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:11:02.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.484+0000 7f2013e00700 1 --2- 172.21.15.69:0/733761434 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1ffc0b2900 0x7f1ffc0b4e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2004006010 tx=0x7f2004005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:11:02.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.488+0000 7f2011600700 1 -- 172.21.15.69:0/733761434 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2008020030 con 0x7f2014104170 2024-05-14T15:11:02.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:02.730+0000 7f201a400700 1 -- 172.21.15.69:0/733761434 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f2014063c00 con 0x7f1ffc0b2900 2024-05-14T15:11:03.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:03 smithi069 ceph-mon[31270]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-05-14T15:11:03.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:03 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:11:03.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:03 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:11:03.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:03 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:03.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:03 smithi203 ceph-mon[34567]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-05-14T15:11:03.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:03 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:11:03.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:03 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:11:03.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:03 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:03.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:03 smithi092 ceph-mon[34729]: pgmap v189: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-05-14T15:11:03.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:03 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:11:03.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:03 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:11:03.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:03 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:04.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:04 smithi069 ceph-mon[31270]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:11:04.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:04 smithi203 ceph-mon[34567]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:11:04.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:04 smithi092 ceph-mon[34729]: from='client.14376 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:11:05.338 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:05 smithi069 ceph-mon[31270]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T15:11:05.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:05 smithi203 ceph-mon[34567]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T15:11:05.590 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:05 smithi092 ceph-mon[34729]: pgmap v190: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-05-14T15:11:07.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:07 smithi069 ceph-mon[31270]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-14T15:11:07.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:07 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/4102851823' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86f1373a-3b39-4a7f-b14c-9bf8695c6b91"}]: dispatch 2024-05-14T15:11:07.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:07 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/4102851823' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86f1373a-3b39-4a7f-b14c-9bf8695c6b91"}]': finished 2024-05-14T15:11:07.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:07 smithi069 ceph-mon[31270]: osdmap e40: 7 total, 6 up, 7 in 2024-05-14T15:11:07.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:07.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:07 smithi203 ceph-mon[34567]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-14T15:11:07.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:07 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/4102851823' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86f1373a-3b39-4a7f-b14c-9bf8695c6b91"}]: dispatch 2024-05-14T15:11:07.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:07 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/4102851823' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86f1373a-3b39-4a7f-b14c-9bf8695c6b91"}]': finished 2024-05-14T15:11:07.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:07 smithi203 ceph-mon[34567]: osdmap e40: 7 total, 6 up, 7 in 2024-05-14T15:11:07.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:07.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:07 smithi092 ceph-mon[34729]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-14T15:11:07.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:07 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/4102851823' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "86f1373a-3b39-4a7f-b14c-9bf8695c6b91"}]: dispatch 2024-05-14T15:11:07.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:07 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/4102851823' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "86f1373a-3b39-4a7f-b14c-9bf8695c6b91"}]': finished 2024-05-14T15:11:07.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:07 smithi092 ceph-mon[34729]: osdmap e40: 7 total, 6 up, 7 in 2024-05-14T15:11:07.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:08.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:08 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3172783461' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:11:08.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:08 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3172783461' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:11:08.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:08 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3172783461' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:11:09.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:09 smithi069 ceph-mon[31270]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:11:09.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:09 smithi203 ceph-mon[34567]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:11:09.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:09 smithi092 ceph-mon[34729]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:11:10.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:10 smithi203 ceph-mon[34567]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:10.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:10 smithi092 ceph-mon[34729]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:10.718 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:10 smithi069 ceph-mon[31270]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:12.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:12 smithi203 ceph-mon[34567]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:12.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:12 smithi092 ceph-mon[34729]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:12.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:12 smithi069 ceph-mon[31270]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:14.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:14 smithi203 ceph-mon[34567]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:14.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:14 smithi092 ceph-mon[34729]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:14.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:14 smithi069 ceph-mon[31270]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:16.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:16 smithi203 ceph-mon[34567]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:16.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:16 smithi092 ceph-mon[34729]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:16.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:16 smithi069 ceph-mon[31270]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:17.840 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-14T15:11:17.840 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:17.840 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:17 smithi203 ceph-mon[34567]: Deploying daemon osd.6 on smithi069 2024-05-14T15:11:17.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-14T15:11:17.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:17.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:17 smithi092 ceph-mon[34729]: Deploying daemon osd.6 on smithi069 2024-05-14T15:11:17.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-14T15:11:17.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:17.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:17 smithi069 ceph-mon[31270]: Deploying daemon osd.6 on smithi069 2024-05-14T15:11:18.839 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:18 smithi203 ceph-mon[34567]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:18.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:18 smithi092 ceph-mon[34729]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:18.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:18 smithi069 ceph-mon[31270]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:20.840 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:20 smithi203 ceph-mon[34567]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:20.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:20 smithi092 ceph-mon[34729]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:20.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:20 smithi069 ceph-mon[31270]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:22.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:22 smithi203 ceph-mon[34567]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:22.882 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:22 smithi069 ceph-mon[31270]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:22.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:22 smithi092 ceph-mon[34729]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:24.840 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:24 smithi203 ceph-mon[34567]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:24.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:24 smithi092 ceph-mon[34729]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:24.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:24 smithi069 ceph-mon[31270]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:26.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:26 smithi092 ceph-mon[34729]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:26.968 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:26 smithi069 ceph-mon[31270]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:27.089 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:26 smithi203 ceph-mon[34567]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:28.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:27 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:28.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:27 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:28.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:27 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:11:28.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:27 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:28.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:27 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:28.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:27 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:11:28.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:27 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:28.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:27 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:28.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:27 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:11:28.932 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:28 smithi069 ceph-mon[31270]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:29.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:28 smithi092 ceph-mon[34729]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:29.339 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:28 smithi203 ceph-mon[34567]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:31.142 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:30 smithi203 ceph-mon[34567]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:31.142 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:30 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:31.143 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:30 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:31.143 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:30 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:31.143 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:30 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:11:31.143 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:30 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:31.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:30 smithi092 ceph-mon[34729]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:31.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:30 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:31.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:30 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:31.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:30 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:31.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:30 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:11:31.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:30 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:31.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:30 smithi069 ceph-mon[31270]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:31.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:30 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:31.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:30 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:31.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:30 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:31.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:30 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:11:31.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:30 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:32.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:31 smithi092 ceph-mon[34729]: from='osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-14T15:11:32.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:31 smithi069 ceph-mon[31270]: from='osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-14T15:11:32.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:31 smithi203 ceph-mon[34567]: from='osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-14T15:11:32.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:32.926+0000 7f2011600700 1 -- 172.21.15.69:0/733761434 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2014063c00 con 0x7f1ffc0b2900 2024-05-14T15:11:32.924 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 6 on host 'smithi069' 2024-05-14T15:11:32.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:32.931+0000 7f201a400700 1 -- 172.21.15.69:0/733761434 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1ffc0b2900 msgr2=0x7f1ffc0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:11:32.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:32.931+0000 7f201a400700 1 --2- 172.21.15.69:0/733761434 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1ffc0b2900 0x7f1ffc0b4e10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f2004006010 tx=0x7f2004005ee0 comp rx=0 tx=0).stop 2024-05-14T15:11:32.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:32.931+0000 7f201a400700 1 -- 172.21.15.69:0/733761434 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2014104170 msgr2=0x7f2014077460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:11:32.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:32.931+0000 7f201a400700 1 --2- 172.21.15.69:0/733761434 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2014104170 0x7f2014077460 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f200800d950 tx=0x7f200800dd10 comp rx=0 tx=0).stop 2024-05-14T15:11:32.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:32.931+0000 7f201a400700 1 -- 172.21.15.69:0/733761434 shutdown_connections 2024-05-14T15:11:32.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:32.931+0000 7f201a400700 1 --2- 172.21.15.69:0/733761434 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2014104170 0x7f2014077460 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:11:32.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:32.931+0000 7f201a400700 1 --2- 172.21.15.69:0/733761434 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1ffc0b2900 0x7f1ffc0b4e10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:11:32.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:32.931+0000 7f201a400700 1 --2- 172.21.15.69:0/733761434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2014105c40 0x7f2014076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:11:32.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:32.931+0000 7f201a400700 1 --2- 172.21.15.69:0/733761434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20141052a0 0x7f2014075b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:11:32.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:32.931+0000 7f201a400700 1 -- 172.21.15.69:0/733761434 >> 172.21.15.69:0/733761434 conn(0x7f20140ff7b0 msgr2=0x7f20141084d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:11:32.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:32.932+0000 7f201a400700 1 -- 172.21.15.69:0/733761434 shutdown_connections 2024-05-14T15:11:32.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:11:32.932+0000 7f201a400700 1 -- 172.21.15.69:0/733761434 wait complete. 2024-05-14T15:11:33.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:32 smithi203 ceph-mon[34567]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:33.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:32 smithi203 ceph-mon[34567]: from='osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-14T15:11:33.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:32 smithi203 ceph-mon[34567]: osdmap e41: 7 total, 6 up, 7 in 2024-05-14T15:11:33.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:32 smithi203 ceph-mon[34567]: from='osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-05-14T15:11:33.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:32 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:33.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:32 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:33.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:32 smithi092 ceph-mon[34729]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:33.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:32 smithi092 ceph-mon[34729]: from='osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-14T15:11:33.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:32 smithi092 ceph-mon[34729]: osdmap e41: 7 total, 6 up, 7 in 2024-05-14T15:11:33.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:32 smithi092 ceph-mon[34729]: from='osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-05-14T15:11:33.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:32 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:33.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:32 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:33.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:32 smithi069 ceph-mon[31270]: pgmap v205: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:33.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:32 smithi069 ceph-mon[31270]: from='osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-14T15:11:33.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:32 smithi069 ceph-mon[31270]: osdmap e41: 7 total, 6 up, 7 in 2024-05-14T15:11:33.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:32 smithi069 ceph-mon[31270]: from='osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-05-14T15:11:33.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:32 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:33.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:32 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:33.887 DEBUG:teuthology.orchestra.run.smithi069:osd.6> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.6.service 2024-05-14T15:11:33.891 INFO:tasks.cephadm:Deploying osd.7 on smithi092 with /dev/vg_nvme/lv_2... 2024-05-14T15:11:33.891 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-14T15:11:34.067 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:33 smithi069 ceph-mon[31270]: from='osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-05-14T15:11:34.068 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:33 smithi069 ceph-mon[31270]: osdmap e42: 7 total, 6 up, 7 in 2024-05-14T15:11:34.068 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:34.068 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:34.068 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:11:34.068 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:34.068 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:33 smithi069 ceph-mon[31270]: from='osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819]' entity='osd.6' 2024-05-14T15:11:34.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:33 smithi092 ceph-mon[34729]: from='osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-05-14T15:11:34.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:33 smithi092 ceph-mon[34729]: osdmap e42: 7 total, 6 up, 7 in 2024-05-14T15:11:34.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:34.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:34.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:11:34.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:34.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:33 smithi092 ceph-mon[34729]: from='osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819]' entity='osd.6' 2024-05-14T15:11:34.326 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T15:11:34.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:33 smithi203 ceph-mon[34567]: from='osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-05-14T15:11:34.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:33 smithi203 ceph-mon[34567]: osdmap e42: 7 total, 6 up, 7 in 2024-05-14T15:11:34.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:34.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:34.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:11:34.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:34.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:33 smithi203 ceph-mon[34567]: from='osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819]' entity='osd.6' 2024-05-14T15:11:35.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:34 smithi092 ceph-mon[34729]: purged_snaps scrub starts 2024-05-14T15:11:35.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:34 smithi092 ceph-mon[34729]: purged_snaps scrub ok 2024-05-14T15:11:35.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:34 smithi092 ceph-mon[34729]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:35.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:35.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:34 smithi092 ceph-mon[34729]: osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819] boot 2024-05-14T15:11:35.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:34 smithi092 ceph-mon[34729]: osdmap e43: 7 total, 7 up, 7 in 2024-05-14T15:11:35.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:35.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:34 smithi069 ceph-mon[31270]: purged_snaps scrub starts 2024-05-14T15:11:35.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:34 smithi069 ceph-mon[31270]: purged_snaps scrub ok 2024-05-14T15:11:35.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:34 smithi069 ceph-mon[31270]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:35.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:35.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:34 smithi069 ceph-mon[31270]: osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819] boot 2024-05-14T15:11:35.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:34 smithi069 ceph-mon[31270]: osdmap e43: 7 total, 7 up, 7 in 2024-05-14T15:11:35.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:35.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:34 smithi203 ceph-mon[34567]: purged_snaps scrub starts 2024-05-14T15:11:35.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:34 smithi203 ceph-mon[34567]: purged_snaps scrub ok 2024-05-14T15:11:35.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:34 smithi203 ceph-mon[34567]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 182 MiB used, 536 GiB / 536 GiB avail 2024-05-14T15:11:35.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:35.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:34 smithi203 ceph-mon[34567]: osd.6 [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819] boot 2024-05-14T15:11:35.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:34 smithi203 ceph-mon[34567]: osdmap e43: 7 total, 7 up, 7 in 2024-05-14T15:11:35.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:11:37.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:36 smithi092 ceph-mon[34729]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:37.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:36 smithi092 ceph-mon[34729]: osdmap e44: 7 total, 7 up, 7 in 2024-05-14T15:11:37.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:36 smithi069 ceph-mon[31270]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:37.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:36 smithi069 ceph-mon[31270]: osdmap e44: 7 total, 7 up, 7 in 2024-05-14T15:11:37.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:36 smithi203 ceph-mon[34567]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:37.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:36 smithi203 ceph-mon[34567]: osdmap e44: 7 total, 7 up, 7 in 2024-05-14T15:11:37.374 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-14T15:11:37.374 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-14T15:11:37.374 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2024-05-14T15:11:37.374 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2024-05-14T15:11:37.374 INFO:teuthology.orchestra.run.smithi092.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0347975 s, 301 MB/s 2024-05-14T15:11:37.374 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2024-05-14T15:11:38.196 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_2 2024-05-14T15:11:38.615 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T15:11:39.070 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:38 smithi092 ceph-mon[34729]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:39.070 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:39.070 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:39.070 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:11:39.070 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:11:39.070 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:11:39.070 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:39.070 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:39.070 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:11:39.070 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:38 smithi069 ceph-mon[31270]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:39.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:11:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:11:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:11:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:11:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:39.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:38 smithi203 ceph-mon[34567]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 213 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:39.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:39.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:39.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:11:39.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:11:39.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:11:39.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:39.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:39.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:11:39.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:11:40.148 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:39 smithi092 ceph-mon[34729]: Detected new or changed devices on smithi069 2024-05-14T15:11:40.148 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:39 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi069 to 5696M 2024-05-14T15:11:40.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:39 smithi069 ceph-mon[31270]: Detected new or changed devices on smithi069 2024-05-14T15:11:40.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:39 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi069 to 5696M 2024-05-14T15:11:40.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:39 smithi203 ceph-mon[34567]: Detected new or changed devices on smithi069 2024-05-14T15:11:40.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:39 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi069 to 5696M 2024-05-14T15:11:40.996 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.000+0000 7fe869600700 1 -- 172.21.15.92:0/2346148788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8641074e0 msgr2=0x7fe8641078f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:11:40.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.000+0000 7fe869600700 1 --2- 172.21.15.92:0/2346148788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8641074e0 0x7fe8641078f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fe8500099a0 tx=0x7fe850009cb0 comp rx=0 tx=0).stop 2024-05-14T15:11:40.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.000+0000 7fe869600700 1 -- 172.21.15.92:0/2346148788 shutdown_connections 2024-05-14T15:11:40.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.000+0000 7fe869600700 1 --2- 172.21.15.92:0/2346148788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe864107e80 0x7fe86410e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:11:40.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.000+0000 7fe869600700 1 --2- 172.21.15.92:0/2346148788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8641063b0 0x7fe8641067c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:11:40.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.000+0000 7fe869600700 1 --2- 172.21.15.92:0/2346148788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8641074e0 0x7fe8641078f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:11:40.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.000+0000 7fe869600700 1 -- 172.21.15.92:0/2346148788 >> 172.21.15.92:0/2346148788 conn(0x7fe8641019f0 msgr2=0x7fe864103ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:11:40.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.000+0000 7fe869600700 1 -- 172.21.15.92:0/2346148788 shutdown_connections 2024-05-14T15:11:40.997 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.000+0000 7fe869600700 1 -- 172.21.15.92:0/2346148788 wait complete. 2024-05-14T15:11:40.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.001+0000 7fe869600700 1 Processor -- start 2024-05-14T15:11:40.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.001+0000 7fe869600700 1 -- start start 2024-05-14T15:11:40.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.002+0000 7fe869600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8641063b0 0x7fe86419c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:11:40.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.002+0000 7fe869600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8641074e0 0x7fe86419ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:11:40.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.002+0000 7fe869600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe864107e80 0x7fe8641a3dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:11:40.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.002+0000 7fe869600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe864111cd0 con 0x7fe864107e80 2024-05-14T15:11:40.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.002+0000 7fe869600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe864111b50 con 0x7fe8641063b0 2024-05-14T15:11:40.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.002+0000 7fe869600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe864111e50 con 0x7fe8641074e0 2024-05-14T15:11:40.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.002+0000 7fe863e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8641063b0 0x7fe86419c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:11:40.999 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.002+0000 7fe863e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8641063b0 0x7fe86419c8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:57054/0 (socket says 172.21.15.92:57054) 2024-05-14T15:11:41.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.002+0000 7fe863e00700 1 -- 172.21.15.92:0/2782606657 learned_addr learned my addr 172.21.15.92:0/2782606657 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-05-14T15:11:41.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.002+0000 7fe863400700 1 --2- 172.21.15.92:0/2782606657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8641074e0 0x7fe86419ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:11:41.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.002+0000 7fe868c00700 1 --2- 172.21.15.92:0/2782606657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe864107e80 0x7fe8641a3dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:11:41.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.002+0000 7fe863e00700 1 -- 172.21.15.92:0/2782606657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8641074e0 msgr2=0x7fe86419ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:11:41.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.002+0000 7fe863e00700 1 --2- 172.21.15.92:0/2782606657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8641074e0 0x7fe86419ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:11:41.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.002+0000 7fe863e00700 1 -- 172.21.15.92:0/2782606657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe864107e80 msgr2=0x7fe8641a3dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:11:41.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.002+0000 7fe863e00700 1 --2- 172.21.15.92:0/2782606657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe864107e80 0x7fe8641a3dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:11:41.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.003+0000 7fe863e00700 1 -- 172.21.15.92:0/2782606657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8641a43b0 con 0x7fe8641063b0 2024-05-14T15:11:41.000 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.003+0000 7fe863e00700 1 --2- 172.21.15.92:0/2782606657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8641063b0 0x7fe86419c8e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe85400c970 tx=0x7fe85400cd30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:11:41.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.003+0000 7fe860c00700 1 -- 172.21.15.92:0/2782606657 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854004220 con 0x7fe8641063b0 2024-05-14T15:11:41.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.003+0000 7fe869600700 1 -- 172.21.15.92:0/2782606657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8641a46a0 con 0x7fe8641063b0 2024-05-14T15:11:41.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.003+0000 7fe860c00700 1 -- 172.21.15.92:0/2782606657 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe854007d90 con 0x7fe8641063b0 2024-05-14T15:11:41.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.003+0000 7fe860c00700 1 -- 172.21.15.92:0/2782606657 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe854003c80 con 0x7fe8641063b0 2024-05-14T15:11:41.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.003+0000 7fe869600700 1 -- 172.21.15.92:0/2782606657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8641a4c30 con 0x7fe8641063b0 2024-05-14T15:11:41.001 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.004+0000 7fe869600700 1 -- 172.21.15.92:0/2782606657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8640512c0 con 0x7fe8641063b0 2024-05-14T15:11:41.003 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.007+0000 7fe860c00700 1 -- 172.21.15.92:0/2782606657 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe8540043c0 con 0x7fe8641063b0 2024-05-14T15:11:41.003 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:40 smithi092 ceph-mon[34729]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:41.005 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.010+0000 7fe860c00700 1 --2- 172.21.15.92:0/2782606657 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe8480b2900 0x7fe8480b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:11:41.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.010+0000 7fe860c00700 1 -- 172.21.15.92:0/2782606657 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7fe8540e14b0 con 0x7fe8641063b0 2024-05-14T15:11:41.006 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.010+0000 7fe863400700 1 --2- 172.21.15.92:0/2782606657 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe8480b2900 0x7fe8480b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:11:41.007 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.012+0000 7fe863400700 1 --2- 172.21.15.92:0/2782606657 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe8480b2900 0x7fe8480b4e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe850005ae0 tx=0x7fe850005a50 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:11:41.009 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.014+0000 7fe860c00700 1 -- 172.21.15.92:0/2782606657 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe854014030 con 0x7fe8641063b0 2024-05-14T15:11:41.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:40 smithi069 ceph-mon[31270]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:41.245 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:11:41.249+0000 7fe869600700 1 -- 172.21.15.92:0/2782606657 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe864063c00 con 0x7fe8480b2900 2024-05-14T15:11:41.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:40 smithi203 ceph-mon[34567]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:42.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:11:42.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:11:42.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:42.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:11:42.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:11:42.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:42.240 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:11:42.240 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:11:42.240 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:43.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:42 smithi069 ceph-mon[31270]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:11:43.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:42 smithi069 ceph-mon[31270]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:43.239 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:42 smithi092 ceph-mon[34729]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:11:43.239 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:42 smithi092 ceph-mon[34729]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:43.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:42 smithi203 ceph-mon[34567]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:11:43.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:42 smithi203 ceph-mon[34567]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:45.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:44 smithi069 ceph-mon[31270]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:45.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:44 smithi203 ceph-mon[34567]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:45.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:44 smithi092 ceph-mon[34729]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:46.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:45 smithi069 ceph-mon[31270]: from='client.? 172.21.15.92:0/2508058736' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e790fbf1-3e34-4950-bdfa-cf1adbd451c0"}]: dispatch 2024-05-14T15:11:46.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:45 smithi069 ceph-mon[31270]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e790fbf1-3e34-4950-bdfa-cf1adbd451c0"}]: dispatch 2024-05-14T15:11:46.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:45 smithi069 ceph-mon[31270]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e790fbf1-3e34-4950-bdfa-cf1adbd451c0"}]': finished 2024-05-14T15:11:46.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:45 smithi069 ceph-mon[31270]: osdmap e45: 8 total, 7 up, 8 in 2024-05-14T15:11:46.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:45 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:11:46.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:45 smithi203 ceph-mon[34567]: from='client.? 172.21.15.92:0/2508058736' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e790fbf1-3e34-4950-bdfa-cf1adbd451c0"}]: dispatch 2024-05-14T15:11:46.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:45 smithi203 ceph-mon[34567]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e790fbf1-3e34-4950-bdfa-cf1adbd451c0"}]: dispatch 2024-05-14T15:11:46.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:45 smithi203 ceph-mon[34567]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e790fbf1-3e34-4950-bdfa-cf1adbd451c0"}]': finished 2024-05-14T15:11:46.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:45 smithi203 ceph-mon[34567]: osdmap e45: 8 total, 7 up, 8 in 2024-05-14T15:11:46.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:45 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:11:46.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:45 smithi092 ceph-mon[34729]: from='client.? 172.21.15.92:0/2508058736' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e790fbf1-3e34-4950-bdfa-cf1adbd451c0"}]: dispatch 2024-05-14T15:11:46.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:45 smithi092 ceph-mon[34729]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e790fbf1-3e34-4950-bdfa-cf1adbd451c0"}]: dispatch 2024-05-14T15:11:46.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:45 smithi092 ceph-mon[34729]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e790fbf1-3e34-4950-bdfa-cf1adbd451c0"}]': finished 2024-05-14T15:11:46.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:45 smithi092 ceph-mon[34729]: osdmap e45: 8 total, 7 up, 8 in 2024-05-14T15:11:46.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:45 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:11:47.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:46 smithi069 ceph-mon[31270]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:47.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:46 smithi069 ceph-mon[31270]: from='client.? 172.21.15.92:0/425393589' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:11:47.280 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:46 smithi092 ceph-mon[34729]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:47.280 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:46 smithi092 ceph-mon[34729]: from='client.? 172.21.15.92:0/425393589' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:11:47.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:46 smithi203 ceph-mon[34567]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:47.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:46 smithi203 ceph-mon[34567]: from='client.? 172.21.15.92:0/425393589' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:11:49.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:48 smithi069 ceph-mon[31270]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:49.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:48 smithi203 ceph-mon[34567]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:49.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:48 smithi092 ceph-mon[34729]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:51.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:50 smithi092 ceph-mon[34729]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:51.219 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:50 smithi069 ceph-mon[31270]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:51.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:50 smithi203 ceph-mon[34567]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:53.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:52 smithi092 ceph-mon[34729]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:53.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:52 smithi203 ceph-mon[34567]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:53.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:52 smithi069 ceph-mon[31270]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:55.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:54 smithi092 ceph-mon[34729]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:55.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:54 smithi203 ceph-mon[34567]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:55.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:54 smithi069 ceph-mon[31270]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:56.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:55 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-14T15:11:56.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:55 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:56.355 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:55 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-14T15:11:56.355 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:55 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:56.371 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:55 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-14T15:11:56.371 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:55 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:11:57.275 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:56 smithi092 ceph-mon[34729]: Deploying daemon osd.7 on smithi092 2024-05-14T15:11:57.275 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:56 smithi092 ceph-mon[34729]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:57.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:56 smithi203 ceph-mon[34567]: Deploying daemon osd.7 on smithi092 2024-05-14T15:11:57.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:56 smithi203 ceph-mon[34567]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:57.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:56 smithi069 ceph-mon[31270]: Deploying daemon osd.7 on smithi092 2024-05-14T15:11:57.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:56 smithi069 ceph-mon[31270]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:59.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:11:59 smithi203 ceph-mon[34567]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:59.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:11:59 smithi092 ceph-mon[34729]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:11:59.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:11:59 smithi069 ceph-mon[31270]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:01.273 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:01 smithi092 ceph-mon[34729]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:01.283 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:01 smithi203 ceph-mon[34567]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:01.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:01 smithi069 ceph-mon[31270]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:03.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:03 smithi203 ceph-mon[34567]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:03.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:03 smithi092 ceph-mon[34729]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:03.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:03 smithi069 ceph-mon[31270]: pgmap v225: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:05.281 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:05 smithi092 ceph-mon[34729]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:05.281 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:05.281 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:05.281 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:12:05.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:05 smithi203 ceph-mon[34567]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:05.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:05.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:05.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:12:05.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:05 smithi069 ceph-mon[31270]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:05.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:05.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:05.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:12:07.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:07 smithi203 ceph-mon[34567]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:07.385 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:07 smithi092 ceph-mon[34729]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:07.435 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:07 smithi069 ceph-mon[31270]: pgmap v227: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:09.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:09 smithi203 ceph-mon[34567]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:09.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:09 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:09.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:09 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:09.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:09 smithi092 ceph-mon[34729]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:09.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:09 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:09.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:09 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:09.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:09 smithi069 ceph-mon[31270]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:09.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:09 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:09.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:09 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:10.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:10 smithi203 ceph-mon[34567]: from='osd.7 [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T15:12:10.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:10 smithi203 ceph-mon[34567]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T15:12:10.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:10 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:10.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:10 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:12:10.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:10 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:10.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:10 smithi092 ceph-mon[34729]: from='osd.7 [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T15:12:10.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:10 smithi092 ceph-mon[34729]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T15:12:10.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:10 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:10.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:10 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:12:10.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:10 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:10.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:10 smithi069 ceph-mon[31270]: from='osd.7 [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T15:12:10.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:10 smithi069 ceph-mon[31270]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-14T15:12:10.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:10 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:10.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:10 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:12:10.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:10 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:10.621 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 7 on host 'smithi092' 2024-05-14T15:12:10.621 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:12:10.624+0000 7fe860c00700 1 -- 172.21.15.92:0/2782606657 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe864063c00 con 0x7fe8480b2900 2024-05-14T15:12:10.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:12:10.627+0000 7fe869600700 1 -- 172.21.15.92:0/2782606657 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe8480b2900 msgr2=0x7fe8480b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:12:10.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:12:10.628+0000 7fe869600700 1 --2- 172.21.15.92:0/2782606657 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe8480b2900 0x7fe8480b4e10 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe850005ae0 tx=0x7fe850005a50 comp rx=0 tx=0).stop 2024-05-14T15:12:10.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:12:10.628+0000 7fe869600700 1 -- 172.21.15.92:0/2782606657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8641063b0 msgr2=0x7fe86419c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:12:10.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:12:10.628+0000 7fe869600700 1 --2- 172.21.15.92:0/2782606657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8641063b0 0x7fe86419c8e0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fe85400c970 tx=0x7fe85400cd30 comp rx=0 tx=0).stop 2024-05-14T15:12:10.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:12:10.628+0000 7fe869600700 1 -- 172.21.15.92:0/2782606657 shutdown_connections 2024-05-14T15:12:10.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:12:10.628+0000 7fe869600700 1 --2- 172.21.15.92:0/2782606657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe864107e80 0x7fe8641a3dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:10.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:12:10.628+0000 7fe869600700 1 --2- 172.21.15.92:0/2782606657 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe8480b2900 0x7fe8480b4e10 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:10.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:12:10.628+0000 7fe869600700 1 --2- 172.21.15.92:0/2782606657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe8641063b0 0x7fe86419c8e0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:10.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:12:10.628+0000 7fe869600700 1 --2- 172.21.15.92:0/2782606657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe8641074e0 0x7fe86419ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:10.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:12:10.628+0000 7fe869600700 1 -- 172.21.15.92:0/2782606657 >> 172.21.15.92:0/2782606657 conn(0x7fe8641019f0 msgr2=0x7fe86410a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:12:10.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:12:10.628+0000 7fe869600700 1 -- 172.21.15.92:0/2782606657 shutdown_connections 2024-05-14T15:12:10.625 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:12:10.628+0000 7fe869600700 1 -- 172.21.15.92:0/2782606657 wait complete. 2024-05-14T15:12:11.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:11 smithi203 ceph-mon[34567]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:11.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:11 smithi203 ceph-mon[34567]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-14T15:12:11.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:11 smithi203 ceph-mon[34567]: from='osd.7 [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:12:11.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:11 smithi203 ceph-mon[34567]: osdmap e46: 8 total, 7 up, 8 in 2024-05-14T15:12:11.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:12:11.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:11 smithi203 ceph-mon[34567]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:12:11.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:11.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:12:11.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:11.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:11 smithi092 ceph-mon[34729]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:11.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:11 smithi092 ceph-mon[34729]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-14T15:12:11.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:11 smithi092 ceph-mon[34729]: from='osd.7 [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:12:11.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:11 smithi092 ceph-mon[34729]: osdmap e46: 8 total, 7 up, 8 in 2024-05-14T15:12:11.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:12:11.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:11 smithi092 ceph-mon[34729]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:12:11.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:11.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:12:11.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:11.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:11 smithi069 ceph-mon[31270]: pgmap v229: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:11.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:11 smithi069 ceph-mon[31270]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-14T15:12:11.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:11 smithi069 ceph-mon[31270]: from='osd.7 [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:12:11.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:11 smithi069 ceph-mon[31270]: osdmap e46: 8 total, 7 up, 8 in 2024-05-14T15:12:11.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:12:11.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:11 smithi069 ceph-mon[31270]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:12:11.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:11.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:12:11.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:11.649 DEBUG:teuthology.orchestra.run.smithi092:osd.7> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.7.service 2024-05-14T15:12:11.655 INFO:tasks.cephadm:Deploying osd.8 on smithi203 with /dev/vg_nvme/lv_2... 2024-05-14T15:12:11.655 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-14T15:12:12.103 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:12:12.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:12 smithi092 ceph-mon[34729]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-05-14T15:12:12.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:12 smithi092 ceph-mon[34729]: osdmap e47: 8 total, 7 up, 8 in 2024-05-14T15:12:12.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:12 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:12:12.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:12 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:12:12.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:12 smithi092 ceph-mon[34729]: from='osd.7 ' entity='osd.7' 2024-05-14T15:12:12.189 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:12:11 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:12:11.984+0000 7f58ac800700 -1 osd.7 0 waiting for initial osdmap 2024-05-14T15:12:12.189 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:12:12 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:12:12.018+0000 7f58a2600700 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T15:12:12.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:12 smithi203 ceph-mon[34567]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-05-14T15:12:12.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:12 smithi203 ceph-mon[34567]: osdmap e47: 8 total, 7 up, 8 in 2024-05-14T15:12:12.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:12 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:12:12.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:12 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:12:12.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:12 smithi203 ceph-mon[34567]: from='osd.7 ' entity='osd.7' 2024-05-14T15:12:12.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:12 smithi069 ceph-mon[31270]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-05-14T15:12:12.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:12 smithi069 ceph-mon[31270]: osdmap e47: 8 total, 7 up, 8 in 2024-05-14T15:12:12.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:12 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:12:12.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:12 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:12:12.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:12 smithi069 ceph-mon[31270]: from='osd.7 ' entity='osd.7' 2024-05-14T15:12:13.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:13 smithi092 ceph-mon[34729]: purged_snaps scrub starts 2024-05-14T15:12:13.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:13 smithi092 ceph-mon[34729]: purged_snaps scrub ok 2024-05-14T15:12:13.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:13 smithi092 ceph-mon[34729]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:13.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:13 smithi092 ceph-mon[34729]: osd.7 [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582] boot 2024-05-14T15:12:13.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:13 smithi092 ceph-mon[34729]: osdmap e48: 8 total, 8 up, 8 in 2024-05-14T15:12:13.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:13 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:12:13.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:13 smithi069 ceph-mon[31270]: purged_snaps scrub starts 2024-05-14T15:12:13.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:13 smithi069 ceph-mon[31270]: purged_snaps scrub ok 2024-05-14T15:12:13.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:13 smithi069 ceph-mon[31270]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:13.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:13 smithi069 ceph-mon[31270]: osd.7 [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582] boot 2024-05-14T15:12:13.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:13 smithi069 ceph-mon[31270]: osdmap e48: 8 total, 8 up, 8 in 2024-05-14T15:12:13.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:13 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:12:13.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:13 smithi203 ceph-mon[34567]: purged_snaps scrub starts 2024-05-14T15:12:13.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:13 smithi203 ceph-mon[34567]: purged_snaps scrub ok 2024-05-14T15:12:13.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:13 smithi203 ceph-mon[34567]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 214 MiB used, 626 GiB / 626 GiB avail 2024-05-14T15:12:13.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:13 smithi203 ceph-mon[34567]: osd.7 [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582] boot 2024-05-14T15:12:13.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:13 smithi203 ceph-mon[34567]: osdmap e48: 8 total, 8 up, 8 in 2024-05-14T15:12:13.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:13 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:12:14.188 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:14 smithi092 ceph-mon[34729]: osdmap e49: 8 total, 8 up, 8 in 2024-05-14T15:12:14.309 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:14 smithi203 ceph-mon[34567]: osdmap e49: 8 total, 8 up, 8 in 2024-05-14T15:12:14.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:14 smithi069 ceph-mon[31270]: osdmap e49: 8 total, 8 up, 8 in 2024-05-14T15:12:15.326 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:15 smithi203 ceph-mon[34567]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:15.326 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:15 smithi203 ceph-mon[34567]: osdmap e50: 8 total, 8 up, 8 in 2024-05-14T15:12:15.326 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-14T15:12:15.326 INFO:teuthology.orchestra.run.smithi203.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-14T15:12:15.327 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10+0 records in 2024-05-14T15:12:15.327 INFO:teuthology.orchestra.run.smithi203.stderr:10+0 records out 2024-05-14T15:12:15.327 INFO:teuthology.orchestra.run.smithi203.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0324614 s, 323 MB/s 2024-05-14T15:12:15.327 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping successful for: 2024-05-14T15:12:15.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:15 smithi092 ceph-mon[34729]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:15.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:15 smithi092 ceph-mon[34729]: osdmap e50: 8 total, 8 up, 8 in 2024-05-14T15:12:15.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:15 smithi069 ceph-mon[31270]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:15.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:15 smithi069 ceph-mon[31270]: osdmap e50: 8 total, 8 up, 8 in 2024-05-14T15:12:16.304 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_2 2024-05-14T15:12:16.736 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:12:17.135 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:17 smithi203 ceph-mon[34567]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:17.135 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:17.135 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:17.135 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:17.135 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:17.135 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:17.135 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:17.135 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:17.135 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:12:17.135 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:17.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:17 smithi092 ceph-mon[34729]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:17.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:17.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:17.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:17.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:17.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:17.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:17.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:17.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:12:17.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:17.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:17 smithi069 ceph-mon[31270]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:17.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:17.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:17.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:17.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:17.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:17.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:17.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:17.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:12:17.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:18.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:18 smithi092 ceph-mon[34729]: Detected new or changed devices on smithi092 2024-05-14T15:12:18.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:18 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi092 to 5696M 2024-05-14T15:12:18.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:18 smithi069 ceph-mon[31270]: Detected new or changed devices on smithi092 2024-05-14T15:12:18.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:18 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi092 to 5696M 2024-05-14T15:12:18.536 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:18 smithi203 ceph-mon[34567]: Detected new or changed devices on smithi092 2024-05-14T15:12:18.537 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:18 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi092 to 5696M 2024-05-14T15:12:19.231 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.233+0000 7fe394a00700 1 -- 172.21.15.203:0/2673684180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe390106550 msgr2=0x7fe390106960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:12:19.231 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.233+0000 7fe394a00700 1 --2- 172.21.15.203:0/2673684180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe390106550 0x7fe390106960 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fe380009990 tx=0x7fe380009ca0 comp rx=0 tx=0).stop 2024-05-14T15:12:19.231 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.233+0000 7fe394a00700 1 -- 172.21.15.203:0/2673684180 shutdown_connections 2024-05-14T15:12:19.231 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.233+0000 7fe394a00700 1 --2- 172.21.15.203:0/2673684180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe390108020 0x7fe39010e8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:19.231 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.233+0000 7fe394a00700 1 --2- 172.21.15.203:0/2673684180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe390106550 0x7fe390106960 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:19.231 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.233+0000 7fe394a00700 1 --2- 172.21.15.203:0/2673684180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe390107680 0x7fe390107a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:19.231 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.233+0000 7fe394a00700 1 -- 172.21.15.203:0/2673684180 >> 172.21.15.203:0/2673684180 conn(0x7fe390101b90 msgr2=0x7fe390104040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:12:19.232 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.233+0000 7fe394a00700 1 -- 172.21.15.203:0/2673684180 shutdown_connections 2024-05-14T15:12:19.232 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.233+0000 7fe394a00700 1 -- 172.21.15.203:0/2673684180 wait complete. 2024-05-14T15:12:19.234 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.234+0000 7fe394a00700 1 Processor -- start 2024-05-14T15:12:19.234 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.234+0000 7fe394a00700 1 -- start start 2024-05-14T15:12:19.234 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.235+0000 7fe394a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe390106550 0x7fe39007c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:12:19.234 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.235+0000 7fe394a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe390107680 0x7fe39007ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:12:19.234 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.235+0000 7fe394a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe390108020 0x7fe390079080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:12:19.234 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.235+0000 7fe394a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe390111e50 con 0x7fe390106550 2024-05-14T15:12:19.234 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.235+0000 7fe394a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe390111cd0 con 0x7fe390107680 2024-05-14T15:12:19.234 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.235+0000 7fe394a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe390111fd0 con 0x7fe390108020 2024-05-14T15:12:19.235 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.235+0000 7fe38e800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe390108020 0x7fe390079080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:12:19.235 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.235+0000 7fe38e800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe390108020 0x7fe390079080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:48018/0 (socket says 172.21.15.203:48018) 2024-05-14T15:12:19.235 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.235+0000 7fe38e800700 1 -- 172.21.15.203:0/2693464035 learned_addr learned my addr 172.21.15.203:0/2693464035 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-05-14T15:12:19.235 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.235+0000 7fe38de00700 1 --2- 172.21.15.203:0/2693464035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe390106550 0x7fe39007c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:12:19.235 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.235+0000 7fe38d400700 1 --2- 172.21.15.203:0/2693464035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe390107680 0x7fe39007ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:12:19.235 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.236+0000 7fe38e800700 1 -- 172.21.15.203:0/2693464035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe390107680 msgr2=0x7fe39007ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:12:19.235 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.236+0000 7fe38e800700 1 --2- 172.21.15.203:0/2693464035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe390107680 0x7fe39007ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:19.235 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.236+0000 7fe38e800700 1 -- 172.21.15.203:0/2693464035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe390106550 msgr2=0x7fe39007c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:12:19.235 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.236+0000 7fe38e800700 1 --2- 172.21.15.203:0/2693464035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe390106550 0x7fe39007c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:19.235 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.236+0000 7fe38e800700 1 -- 172.21.15.203:0/2693464035 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe390079890 con 0x7fe390108020 2024-05-14T15:12:19.235 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.236+0000 7fe38d400700 1 --2- 172.21.15.203:0/2693464035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe390107680 0x7fe39007ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:12:19.235 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.236+0000 7fe38e800700 1 --2- 172.21.15.203:0/2693464035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe390108020 0x7fe390079080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe38800ef30 tx=0x7fe38800c3a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:12:19.235 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.236+0000 7fe386a00700 1 -- 172.21.15.203:0/2693464035 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3880092e0 con 0x7fe390108020 2024-05-14T15:12:19.235 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.237+0000 7fe386a00700 1 -- 172.21.15.203:0/2693464035 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe388004bb0 con 0x7fe390108020 2024-05-14T15:12:19.236 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.237+0000 7fe386a00700 1 -- 172.21.15.203:0/2693464035 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388004020 con 0x7fe390108020 2024-05-14T15:12:19.236 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.237+0000 7fe394a00700 1 -- 172.21.15.203:0/2693464035 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe390079b20 con 0x7fe390108020 2024-05-14T15:12:19.236 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.237+0000 7fe394a00700 1 -- 172.21.15.203:0/2693464035 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3901a90e0 con 0x7fe390108020 2024-05-14T15:12:19.236 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.238+0000 7fe394a00700 1 -- 172.21.15.203:0/2693464035 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3900512c0 con 0x7fe390108020 2024-05-14T15:12:19.237 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.240+0000 7fe386a00700 1 -- 172.21.15.203:0/2693464035 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe38801b030 con 0x7fe390108020 2024-05-14T15:12:19.239 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.242+0000 7fe386a00700 1 --2- 172.21.15.203:0/2693464035 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe3740b2880 0x7fe3740b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:12:19.239 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.242+0000 7fe386a00700 1 -- 172.21.15.203:0/2693464035 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5397+0+0 (secure 0 0 0) 0x7fe3880e12d0 con 0x7fe390108020 2024-05-14T15:12:19.239 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.242+0000 7fe38de00700 1 --2- 172.21.15.203:0/2693464035 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe3740b2880 0x7fe3740b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:12:19.240 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.243+0000 7fe38de00700 1 --2- 172.21.15.203:0/2693464035 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe3740b2880 0x7fe3740b4d90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe38000b2e0 tx=0x7fe38001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:12:19.244 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.247+0000 7fe386a00700 1 -- 172.21.15.203:0/2693464035 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe388022020 con 0x7fe390108020 2024-05-14T15:12:19.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:19 smithi092 ceph-mon[34729]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:19.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:19 smithi069 ceph-mon[31270]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:19.485 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:19.487+0000 7fe394a00700 1 -- 172.21.15.203:0/2693464035 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fe390063cc0 con 0x7fe3740b2880 2024-05-14T15:12:19.485 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:19 smithi203 ceph-mon[34567]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:20.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:20 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:12:20.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:20 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:12:20.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:20 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:20.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:20 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:12:20.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:20 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:12:20.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:20 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:20.577 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:20 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:12:20.577 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:20 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:12:20.577 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:20 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:21.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:21 smithi092 ceph-mon[34729]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:12:21.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:21 smithi092 ceph-mon[34729]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-14T15:12:21.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:21 smithi069 ceph-mon[31270]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:12:21.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:21 smithi069 ceph-mon[31270]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-14T15:12:21.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:21 smithi203 ceph-mon[34567]: from='client.24289 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:12:21.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:21 smithi203 ceph-mon[34567]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 78 KiB/s, 0 objects/s recovering 2024-05-14T15:12:23.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:23 smithi092 ceph-mon[34729]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-05-14T15:12:23.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:23 smithi069 ceph-mon[31270]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-05-14T15:12:23.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:23 smithi203 ceph-mon[34567]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-05-14T15:12:24.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:24 smithi092 ceph-mon[34729]: from='client.? 172.21.15.203:0/1786479390' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65019fee-6b18-4d13-841a-2e3acb51f180"}]: dispatch 2024-05-14T15:12:24.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:24 smithi092 ceph-mon[34729]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65019fee-6b18-4d13-841a-2e3acb51f180"}]: dispatch 2024-05-14T15:12:24.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:24 smithi092 ceph-mon[34729]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65019fee-6b18-4d13-841a-2e3acb51f180"}]': finished 2024-05-14T15:12:24.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:24 smithi092 ceph-mon[34729]: osdmap e51: 9 total, 8 up, 9 in 2024-05-14T15:12:24.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:24.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:24 smithi069 ceph-mon[31270]: from='client.? 172.21.15.203:0/1786479390' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65019fee-6b18-4d13-841a-2e3acb51f180"}]: dispatch 2024-05-14T15:12:24.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:24 smithi069 ceph-mon[31270]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65019fee-6b18-4d13-841a-2e3acb51f180"}]: dispatch 2024-05-14T15:12:24.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:24 smithi069 ceph-mon[31270]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65019fee-6b18-4d13-841a-2e3acb51f180"}]': finished 2024-05-14T15:12:24.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:24 smithi069 ceph-mon[31270]: osdmap e51: 9 total, 8 up, 9 in 2024-05-14T15:12:24.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:24.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:24 smithi203 ceph-mon[34567]: from='client.? 172.21.15.203:0/1786479390' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65019fee-6b18-4d13-841a-2e3acb51f180"}]: dispatch 2024-05-14T15:12:24.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:24 smithi203 ceph-mon[34567]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "65019fee-6b18-4d13-841a-2e3acb51f180"}]: dispatch 2024-05-14T15:12:24.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:24 smithi203 ceph-mon[34567]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "65019fee-6b18-4d13-841a-2e3acb51f180"}]': finished 2024-05-14T15:12:24.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:24 smithi203 ceph-mon[34567]: osdmap e51: 9 total, 8 up, 9 in 2024-05-14T15:12:24.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:25.438 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:25 smithi092 ceph-mon[34729]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:12:25.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:25 smithi092 ceph-mon[34729]: from='client.? 172.21.15.203:0/3654401024' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:12:25.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:25 smithi069 ceph-mon[31270]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:12:25.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:25 smithi069 ceph-mon[31270]: from='client.? 172.21.15.203:0/3654401024' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:12:25.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:25 smithi203 ceph-mon[34567]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:12:25.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:25 smithi203 ceph-mon[34567]: from='client.? 172.21.15.203:0/3654401024' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:12:27.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:27 smithi069 ceph-mon[31270]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:12:27.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:27 smithi203 ceph-mon[34567]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:12:27.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:27 smithi092 ceph-mon[34729]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:12:29.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:29 smithi203 ceph-mon[34567]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:12:29.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:29 smithi069 ceph-mon[31270]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:12:29.688 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:29 smithi092 ceph-mon[34729]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:12:31.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:31 smithi069 ceph-mon[31270]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:31.512 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:31 smithi203 ceph-mon[34567]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:31.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:31 smithi092 ceph-mon[34729]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:33.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:33 smithi069 ceph-mon[31270]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:33.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:33 smithi203 ceph-mon[34567]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:33.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:33 smithi092 ceph-mon[34729]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:34.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-14T15:12:34.340 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:34.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-14T15:12:34.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:34.719 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-05-14T15:12:34.719 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:35.511 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:35 smithi203 ceph-mon[34567]: Deploying daemon osd.8 on smithi203 2024-05-14T15:12:35.511 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:35 smithi203 ceph-mon[34567]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:35.591 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:35 smithi092 ceph-mon[34729]: Deploying daemon osd.8 on smithi203 2024-05-14T15:12:35.591 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:35 smithi092 ceph-mon[34729]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:35.719 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:35 smithi069 ceph-mon[31270]: Deploying daemon osd.8 on smithi203 2024-05-14T15:12:35.719 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:35 smithi069 ceph-mon[31270]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:36.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:36 smithi203 ceph-mon[34567]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:36.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:36 smithi092 ceph-mon[34729]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:36.719 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:36 smithi069 ceph-mon[31270]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:38.719 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:38 smithi069 ceph-mon[31270]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:38.840 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:38 smithi203 ceph-mon[34567]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:38.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:38 smithi092 ceph-mon[34729]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:40.840 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:40 smithi203 ceph-mon[34567]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:40.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:40 smithi092 ceph-mon[34729]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:40.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:40 smithi069 ceph-mon[31270]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:42.840 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:42 smithi203 ceph-mon[34567]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:42.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:42 smithi092 ceph-mon[34729]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:42.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:42 smithi069 ceph-mon[31270]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:43.797 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:43 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:43.797 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:43 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:43.797 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:43 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:12:43.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:43 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:43.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:43 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:43.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:43 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:12:43.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:43 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:43.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:43 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:43.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:43 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:12:44.840 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:44 smithi203 ceph-mon[34567]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:44.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:44 smithi069 ceph-mon[31270]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:45.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:44 smithi092 ceph-mon[34729]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:46.840 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:46 smithi203 ceph-mon[34567]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:46.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:46 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:46.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:46 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:46.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:46 smithi092 ceph-mon[34729]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:46.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:46 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:46.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:46 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:46.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:46 smithi069 ceph-mon[31270]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:46.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:46 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:46.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:46 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:47.961 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:47 smithi203 ceph-mon[34567]: from='osd.8 [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T15:12:47.961 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:47 smithi203 ceph-mon[34567]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T15:12:47.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:47 smithi069 ceph-mon[31270]: from='osd.8 [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T15:12:47.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:47 smithi069 ceph-mon[31270]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T15:12:48.054 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:48.056+0000 7fe386a00700 1 -- 172.21.15.203:0/2693464035 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fe390063cc0 con 0x7fe3740b2880 2024-05-14T15:12:48.054 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 8 on host 'smithi203' 2024-05-14T15:12:48.057 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:48.060+0000 7fe394a00700 1 -- 172.21.15.203:0/2693464035 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe3740b2880 msgr2=0x7fe3740b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:12:48.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:48.060+0000 7fe394a00700 1 --2- 172.21.15.203:0/2693464035 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe3740b2880 0x7fe3740b4d90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fe38000b2e0 tx=0x7fe38001a040 comp rx=0 tx=0).stop 2024-05-14T15:12:48.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:48.060+0000 7fe394a00700 1 -- 172.21.15.203:0/2693464035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe390108020 msgr2=0x7fe390079080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:12:48.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:48.060+0000 7fe394a00700 1 --2- 172.21.15.203:0/2693464035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe390108020 0x7fe390079080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe38800ef30 tx=0x7fe38800c3a0 comp rx=0 tx=0).stop 2024-05-14T15:12:48.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:48.060+0000 7fe394a00700 1 -- 172.21.15.203:0/2693464035 shutdown_connections 2024-05-14T15:12:48.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:48.060+0000 7fe394a00700 1 --2- 172.21.15.203:0/2693464035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe390106550 0x7fe39007c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:48.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:48.060+0000 7fe394a00700 1 --2- 172.21.15.203:0/2693464035 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe3740b2880 0x7fe3740b4d90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:48.058 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:48.060+0000 7fe394a00700 1 --2- 172.21.15.203:0/2693464035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe390108020 0x7fe390079080 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:48.059 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:48.060+0000 7fe394a00700 1 --2- 172.21.15.203:0/2693464035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe390107680 0x7fe39007ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:48.059 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:48.060+0000 7fe394a00700 1 -- 172.21.15.203:0/2693464035 >> 172.21.15.203:0/2693464035 conn(0x7fe390101b90 msgr2=0x7fe39010a8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:12:48.059 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:48.061+0000 7fe394a00700 1 -- 172.21.15.203:0/2693464035 shutdown_connections 2024-05-14T15:12:48.059 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:12:48.061+0000 7fe394a00700 1 -- 172.21.15.203:0/2693464035 wait complete. 2024-05-14T15:12:48.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:47 smithi092 ceph-mon[34729]: from='osd.8 [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T15:12:48.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:47 smithi092 ceph-mon[34729]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-05-14T15:12:48.791 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:48 smithi203 ceph-mon[34567]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:48.792 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:48 smithi203 ceph-mon[34567]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-14T15:12:48.792 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:48 smithi203 ceph-mon[34567]: osdmap e52: 9 total, 8 up, 9 in 2024-05-14T15:12:48.792 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:48.792 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:48 smithi203 ceph-mon[34567]: from='osd.8 [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:12:48.792 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:48 smithi203 ceph-mon[34567]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:12:48.792 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:48.792 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:12:48.792 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:48.792 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:48.792 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:48.792 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:12:49.127 DEBUG:teuthology.orchestra.run.smithi203:osd.8> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.8.service 2024-05-14T15:12:49.131 INFO:tasks.cephadm:Deploying osd.9 on smithi069 with /dev/vg_nvme/lv_1... 2024-05-14T15:12:49.131 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-14T15:12:49.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:48 smithi092 ceph-mon[34729]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:49.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:48 smithi092 ceph-mon[34729]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-14T15:12:49.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:48 smithi092 ceph-mon[34729]: osdmap e52: 9 total, 8 up, 9 in 2024-05-14T15:12:49.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:49.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:48 smithi092 ceph-mon[34729]: from='osd.8 [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:12:49.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:48 smithi092 ceph-mon[34729]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:12:49.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:49.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:12:49.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:49.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:49.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:49.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:12:49.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:48 smithi069 ceph-mon[31270]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:49.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:48 smithi069 ceph-mon[31270]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-05-14T15:12:49.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:48 smithi069 ceph-mon[31270]: osdmap e52: 9 total, 8 up, 9 in 2024-05-14T15:12:49.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:49.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:48 smithi069 ceph-mon[31270]: from='osd.8 [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:12:49.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:48 smithi069 ceph-mon[31270]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:12:49.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:49.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:12:49.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:49.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:49.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:49.210 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:12:49.567 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:12:49.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:49 smithi069 ceph-mon[31270]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-05-14T15:12:49.965 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:49 smithi069 ceph-mon[31270]: osdmap e53: 9 total, 8 up, 9 in 2024-05-14T15:12:49.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:49.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:49.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:49 smithi069 ceph-mon[31270]: osdmap e54: 9 total, 8 up, 9 in 2024-05-14T15:12:49.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:49.966 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:49 smithi069 ceph-mon[31270]: from='osd.8 ' entity='osd.8' 2024-05-14T15:12:50.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:49 smithi203 ceph-mon[34567]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-05-14T15:12:50.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:49 smithi203 ceph-mon[34567]: osdmap e53: 9 total, 8 up, 9 in 2024-05-14T15:12:50.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:50.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:50.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:49 smithi203 ceph-mon[34567]: osdmap e54: 9 total, 8 up, 9 in 2024-05-14T15:12:50.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:50.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:49 smithi203 ceph-mon[34567]: from='osd.8 ' entity='osd.8' 2024-05-14T15:12:50.093 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:12:49 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:12:49.648+0000 7ff8dee00700 -1 osd.8 0 waiting for initial osdmap 2024-05-14T15:12:50.093 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:12:49 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:12:49.676+0000 7ff8d4c00700 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T15:12:50.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:49 smithi092 ceph-mon[34729]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-05-14T15:12:50.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:49 smithi092 ceph-mon[34729]: osdmap e53: 9 total, 8 up, 9 in 2024-05-14T15:12:50.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:50.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:50.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:49 smithi092 ceph-mon[34729]: osdmap e54: 9 total, 8 up, 9 in 2024-05-14T15:12:50.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:50.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:49 smithi092 ceph-mon[34729]: from='osd.8 ' entity='osd.8' 2024-05-14T15:12:50.925 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:50 smithi203 ceph-mon[34567]: purged_snaps scrub starts 2024-05-14T15:12:50.925 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:50 smithi203 ceph-mon[34567]: purged_snaps scrub ok 2024-05-14T15:12:50.925 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:50 smithi203 ceph-mon[34567]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:50.925 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:50 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:50.925 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:50 smithi203 ceph-mon[34567]: osd.8 [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249] boot 2024-05-14T15:12:50.925 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:50 smithi203 ceph-mon[34567]: osdmap e55: 9 total, 9 up, 9 in 2024-05-14T15:12:50.925 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:50 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:50.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:50 smithi069 ceph-mon[31270]: purged_snaps scrub starts 2024-05-14T15:12:50.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:50 smithi069 ceph-mon[31270]: purged_snaps scrub ok 2024-05-14T15:12:50.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:50 smithi069 ceph-mon[31270]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:50.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:50 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:50.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:50 smithi069 ceph-mon[31270]: osd.8 [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249] boot 2024-05-14T15:12:50.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:50 smithi069 ceph-mon[31270]: osdmap e55: 9 total, 9 up, 9 in 2024-05-14T15:12:50.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:50 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:51.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:50 smithi092 ceph-mon[34729]: purged_snaps scrub starts 2024-05-14T15:12:51.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:50 smithi092 ceph-mon[34729]: purged_snaps scrub ok 2024-05-14T15:12:51.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:50 smithi092 ceph-mon[34729]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-05-14T15:12:51.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:50 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:51.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:50 smithi092 ceph-mon[34729]: osd.8 [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249] boot 2024-05-14T15:12:51.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:50 smithi092 ceph-mon[34729]: osdmap e55: 9 total, 9 up, 9 in 2024-05-14T15:12:51.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:50 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:12:52.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:52 smithi203 ceph-mon[34567]: osdmap e56: 9 total, 9 up, 9 in 2024-05-14T15:12:52.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:52 smithi203 ceph-mon[34567]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:12:52.633 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:52 smithi069 ceph-mon[31270]: osdmap e56: 9 total, 9 up, 9 in 2024-05-14T15:12:52.633 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:52 smithi069 ceph-mon[31270]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:12:52.633 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-14T15:12:52.634 INFO:teuthology.orchestra.run.smithi069.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-14T15:12:52.634 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10+0 records in 2024-05-14T15:12:52.634 INFO:teuthology.orchestra.run.smithi069.stderr:10+0 records out 2024-05-14T15:12:52.634 INFO:teuthology.orchestra.run.smithi069.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0326993 s, 321 MB/s 2024-05-14T15:12:52.634 INFO:teuthology.orchestra.run.smithi069.stderr:--> Zapping successful for: 2024-05-14T15:12:52.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:52 smithi092 ceph-mon[34729]: osdmap e56: 9 total, 9 up, 9 in 2024-05-14T15:12:52.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:52 smithi092 ceph-mon[34729]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:12:53.469 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:53 smithi069 ceph-mon[31270]: osdmap e57: 9 total, 9 up, 9 in 2024-05-14T15:12:53.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:53 smithi203 ceph-mon[34567]: osdmap e57: 9 total, 9 up, 9 in 2024-05-14T15:12:53.592 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi069:vg_nvme/lv_1 2024-05-14T15:12:53.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:53 smithi092 ceph-mon[34729]: osdmap e57: 9 total, 9 up, 9 in 2024-05-14T15:12:54.031 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:12:54.461 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:54 smithi069 ceph-mon[31270]: pgmap v263: 1 pgs: 1 activating+degraded; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-14T15:12:54.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:54 smithi203 ceph-mon[34567]: pgmap v263: 1 pgs: 1 activating+degraded; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-14T15:12:54.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:54 smithi092 ceph-mon[34729]: pgmap v263: 1 pgs: 1 activating+degraded; 577 KiB data, 276 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-14T15:12:55.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:55 smithi069 ceph-mon[31270]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-14T15:12:55.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:55 smithi069 ceph-mon[31270]: Detected new or changed devices on smithi203 2024-05-14T15:12:55.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:55 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:55.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:55 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:55.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:55 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:55.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:55 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:55.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:55 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:55.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:55 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi203 to 5696M 2024-05-14T15:12:55.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:55 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:55.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:55 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:55.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:55 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:12:55.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:55 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:55.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:55 smithi203 ceph-mon[34567]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-14T15:12:55.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:55 smithi203 ceph-mon[34567]: Detected new or changed devices on smithi203 2024-05-14T15:12:55.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:55 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:55.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:55 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:55.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:55 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:55.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:55 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:55.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:55 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:55.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:55 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi203 to 5696M 2024-05-14T15:12:55.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:55 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:55.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:55 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:55.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:55 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:12:55.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:55 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:55.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:55 smithi092 ceph-mon[34729]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-14T15:12:55.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:55 smithi092 ceph-mon[34729]: Detected new or changed devices on smithi203 2024-05-14T15:12:55.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:55 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:55.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:55 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:55.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:55 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:55.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:55 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:55.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:55 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:12:55.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:55 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi203 to 5696M 2024-05-14T15:12:55.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:55 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:55.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:55 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:55.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:55 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:12:55.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:55 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:12:56.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.496+0000 7ff19e400700 1 -- 172.21.15.69:0/90125645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1981077a0 msgr2=0x7ff198109bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:12:56.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.496+0000 7ff19e400700 1 --2- 172.21.15.69:0/90125645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1981077a0 0x7ff198109bc0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7ff184009990 tx=0x7ff184009ca0 comp rx=0 tx=0).stop 2024-05-14T15:12:56.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.496+0000 7ff19e400700 1 -- 172.21.15.69:0/90125645 shutdown_connections 2024-05-14T15:12:56.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.496+0000 7ff19e400700 1 --2- 172.21.15.69:0/90125645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff19810a100 0x7ff19810c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:56.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.496+0000 7ff19e400700 1 --2- 172.21.15.69:0/90125645 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff198104e40 0x7ff198107260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:56.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.496+0000 7ff19e400700 1 --2- 172.21.15.69:0/90125645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1981077a0 0x7ff198109bc0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:56.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.496+0000 7ff19e400700 1 -- 172.21.15.69:0/90125645 >> 172.21.15.69:0/90125645 conn(0x7ff1980fe880 msgr2=0x7ff198100d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:12:56.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.496+0000 7ff19e400700 1 -- 172.21.15.69:0/90125645 shutdown_connections 2024-05-14T15:12:56.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.496+0000 7ff19e400700 1 -- 172.21.15.69:0/90125645 wait complete. 2024-05-14T15:12:56.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.497+0000 7ff19e400700 1 Processor -- start 2024-05-14T15:12:56.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.497+0000 7ff19e400700 1 -- start start 2024-05-14T15:12:56.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.498+0000 7ff19e400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff198104e40 0x7ff19819cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:12:56.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.498+0000 7ff19e400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1981077a0 0x7ff19819d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:12:56.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.498+0000 7ff19e400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff19810a100 0x7ff1981a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:12:56.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.498+0000 7ff19e400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff19810fc90 con 0x7ff1981077a0 2024-05-14T15:12:56.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.498+0000 7ff19e400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff19810fb10 con 0x7ff198104e40 2024-05-14T15:12:56.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.498+0000 7ff19e400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff19810fe10 con 0x7ff19810a100 2024-05-14T15:12:56.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.498+0000 7ff196a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1981077a0 0x7ff19819d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:12:56.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.498+0000 7ff196a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1981077a0 0x7ff19819d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44174/0 (socket says 172.21.15.69:44174) 2024-05-14T15:12:56.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.498+0000 7ff196a00700 1 -- 172.21.15.69:0/2684856159 learned_addr learned my addr 172.21.15.69:0/2684856159 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:12:56.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.498+0000 7ff197400700 1 --2- 172.21.15.69:0/2684856159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff198104e40 0x7ff19819cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:12:56.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.498+0000 7ff197e00700 1 --2- 172.21.15.69:0/2684856159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff19810a100 0x7ff1981a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:12:56.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.499+0000 7ff196a00700 1 -- 172.21.15.69:0/2684856159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff19810a100 msgr2=0x7ff1981a4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:12:56.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.499+0000 7ff196a00700 1 --2- 172.21.15.69:0/2684856159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff19810a100 0x7ff1981a4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:56.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.499+0000 7ff196a00700 1 -- 172.21.15.69:0/2684856159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff198104e40 msgr2=0x7ff19819cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:12:56.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.499+0000 7ff196a00700 1 --2- 172.21.15.69:0/2684856159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff198104e40 0x7ff19819cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:12:56.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.499+0000 7ff196a00700 1 -- 172.21.15.69:0/2684856159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1981a4690 con 0x7ff1981077a0 2024-05-14T15:12:56.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.499+0000 7ff196a00700 1 --2- 172.21.15.69:0/2684856159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1981077a0 0x7ff19819d070 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff184000c00 tx=0x7ff1840047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:12:56.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.499+0000 7ff18fe00700 1 -- 172.21.15.69:0/2684856159 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184004830 con 0x7ff1981077a0 2024-05-14T15:12:56.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.499+0000 7ff18fe00700 1 -- 172.21.15.69:0/2684856159 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff184003b90 con 0x7ff1981077a0 2024-05-14T15:12:56.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.499+0000 7ff18fe00700 1 -- 172.21.15.69:0/2684856159 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff184005280 con 0x7ff1981077a0 2024-05-14T15:12:56.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.499+0000 7ff19e400700 1 -- 172.21.15.69:0/2684856159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1981a4920 con 0x7ff1981077a0 2024-05-14T15:12:56.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.500+0000 7ff19e400700 1 -- 172.21.15.69:0/2684856159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1981a4cc0 con 0x7ff1981077a0 2024-05-14T15:12:56.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.501+0000 7ff19e400700 1 -- 172.21.15.69:0/2684856159 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1980512c0 con 0x7ff1981077a0 2024-05-14T15:12:56.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.503+0000 7ff18fe00700 1 -- 172.21.15.69:0/2684856159 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff184005420 con 0x7ff1981077a0 2024-05-14T15:12:56.502 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:56 smithi069 ceph-mon[31270]: pgmap v264: 1 pgs: 1 activating+degraded; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-14T15:12:56.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.506+0000 7ff18fe00700 1 --2- 172.21.15.69:0/2684856159 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff17c0b2900 0x7ff17c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:12:56.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.506+0000 7ff18fe00700 1 -- 172.21.15.69:0/2684856159 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5829+0+0 (secure 0 0 0) 0x7ff1840e2c00 con 0x7ff1981077a0 2024-05-14T15:12:56.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.506+0000 7ff197400700 1 --2- 172.21.15.69:0/2684856159 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff17c0b2900 0x7ff17c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:12:56.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.507+0000 7ff197400700 1 --2- 172.21.15.69:0/2684856159 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff17c0b2900 0x7ff17c0b4e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff188005950 tx=0x7ff18800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:12:56.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.511+0000 7ff18fe00700 1 -- 172.21.15.69:0/2684856159 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff184013070 con 0x7ff1981077a0 2024-05-14T15:12:56.590 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:56 smithi203 ceph-mon[34567]: pgmap v264: 1 pgs: 1 activating+degraded; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-14T15:12:56.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:56 smithi092 ceph-mon[34729]: pgmap v264: 1 pgs: 1 activating+degraded; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-14T15:12:56.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:12:56.757+0000 7ff19e400700 1 -- 172.21.15.69:0/2684856159 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7ff198103d70 con 0x7ff17c0b2900 2024-05-14T15:12:57.569 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:57 smithi203 ceph-mon[34567]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:12:57.569 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:57 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:12:57.569 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:57 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:12:57.569 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:57 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:57.689 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:57 smithi069 ceph-mon[31270]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:12:57.689 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:57 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:12:57.689 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:57 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:12:57.689 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:57 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:57.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:57 smithi092 ceph-mon[34729]: from='client.14436 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi069:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:12:57.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:12:57.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:12:57.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:12:58.395 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:58 smithi069 ceph-mon[31270]: pgmap v265: 1 pgs: 1 activating+degraded; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-14T15:12:58.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:58 smithi203 ceph-mon[34567]: pgmap v265: 1 pgs: 1 activating+degraded; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-14T15:12:58.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:58 smithi092 ceph-mon[34729]: pgmap v265: 1 pgs: 1 activating+degraded; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 2/6 objects degraded (33.333%) 2024-05-14T15:12:59.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:59 smithi092 ceph-mon[34729]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-14T15:12:59.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:12:59 smithi092 ceph-mon[34729]: Cluster is now healthy 2024-05-14T15:12:59.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:59 smithi069 ceph-mon[31270]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-14T15:12:59.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:12:59 smithi069 ceph-mon[31270]: Cluster is now healthy 2024-05-14T15:13:00.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:59 smithi203 ceph-mon[34567]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-14T15:13:00.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:12:59 smithi203 ceph-mon[34567]: Cluster is now healthy 2024-05-14T15:13:00.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:00 smithi092 ceph-mon[34729]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-14T15:13:00.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:00 smithi069 ceph-mon[31270]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-14T15:13:01.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:00 smithi203 ceph-mon[34567]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-05-14T15:13:01.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:01 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/336920463' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa"}]: dispatch 2024-05-14T15:13:01.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:01 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/336920463' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa"}]': finished 2024-05-14T15:13:01.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:01 smithi092 ceph-mon[34729]: osdmap e58: 10 total, 9 up, 10 in 2024-05-14T15:13:01.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:01 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:01.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:01 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/336920463' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa"}]: dispatch 2024-05-14T15:13:01.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:01 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/336920463' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa"}]': finished 2024-05-14T15:13:01.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:01 smithi069 ceph-mon[31270]: osdmap e58: 10 total, 9 up, 10 in 2024-05-14T15:13:01.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:01 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:01.993 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:01 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/336920463' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa"}]: dispatch 2024-05-14T15:13:01.993 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:01 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/336920463' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa"}]': finished 2024-05-14T15:13:01.993 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:01 smithi203 ceph-mon[34567]: osdmap e58: 10 total, 9 up, 10 in 2024-05-14T15:13:01.993 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:01 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:02.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:02 smithi092 ceph-mon[34729]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-14T15:13:02.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:02 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3589489315' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:13:02.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:02 smithi069 ceph-mon[31270]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-14T15:13:02.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:02 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3589489315' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:13:03.031 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:02 smithi203 ceph-mon[34567]: pgmap v268: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-05-14T15:13:03.031 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:02 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3589489315' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:13:04.841 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:04 smithi203 ceph-mon[34567]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:13:04.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:04 smithi092 ceph-mon[34729]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:13:04.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:04 smithi069 ceph-mon[31270]: pgmap v269: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:13:06.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:06 smithi092 ceph-mon[34729]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:13:06.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:06 smithi069 ceph-mon[31270]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:13:07.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:06 smithi203 ceph-mon[34567]: pgmap v270: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:13:08.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:08 smithi092 ceph-mon[34729]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:13:08.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:08 smithi069 ceph-mon[31270]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:13:09.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:08 smithi203 ceph-mon[34567]: pgmap v271: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:13:10.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:10 smithi092 ceph-mon[34729]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:10.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:10 smithi069 ceph-mon[31270]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:11.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:10 smithi203 ceph-mon[34567]: pgmap v272: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:11.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-14T15:13:11.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:13:11.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:11 smithi092 ceph-mon[34729]: Deploying daemon osd.9 on smithi069 2024-05-14T15:13:11.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-14T15:13:11.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:13:11.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:11 smithi069 ceph-mon[31270]: Deploying daemon osd.9 on smithi069 2024-05-14T15:13:12.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-05-14T15:13:12.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:13:12.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:11 smithi203 ceph-mon[34567]: Deploying daemon osd.9 on smithi069 2024-05-14T15:13:12.719 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:12 smithi069 ceph-mon[31270]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:12.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:12 smithi092 ceph-mon[34729]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:13.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:12 smithi203 ceph-mon[34567]: pgmap v273: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:14.898 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:14 smithi069 ceph-mon[31270]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:14.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:14 smithi092 ceph-mon[34729]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:15.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:14 smithi203 ceph-mon[34567]: pgmap v274: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:16.961 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:16 smithi069 ceph-mon[31270]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:17.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:16 smithi203 ceph-mon[34567]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:17.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:16 smithi092 ceph-mon[34729]: pgmap v275: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:18.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:18 smithi069 ceph-mon[31270]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:19.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:18 smithi203 ceph-mon[34567]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:19.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:18 smithi092 ceph-mon[34729]: pgmap v276: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:20.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:20 smithi069 ceph-mon[31270]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:20.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:20 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:20.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:20 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:21.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:20 smithi203 ceph-mon[34567]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:21.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:20 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:21.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:20 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:21.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:20 smithi092 ceph-mon[34729]: pgmap v277: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:21.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:20 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:21.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:20 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:21.865 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:21 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:13:22.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:21 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:13:22.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:21 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:13:22.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:22 smithi069 ceph-mon[31270]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:23.090 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:22 smithi203 ceph-mon[34567]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:23.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:22 smithi092 ceph-mon[34729]: pgmap v278: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:24.969 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:24 smithi069 ceph-mon[31270]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:24.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:24.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:25.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:24 smithi203 ceph-mon[34567]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:25.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:25.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:25.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:24 smithi092 ceph-mon[34729]: pgmap v279: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:25.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:25.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:26.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:25 smithi203 ceph-mon[34567]: from='osd.9 [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-14T15:13:26.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:25 smithi092 ceph-mon[34729]: from='osd.9 [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-14T15:13:26.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:25 smithi069 ceph-mon[31270]: from='osd.9 [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-05-14T15:13:26.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:13:26.410+0000 7ff18fe00700 1 -- 172.21.15.69:0/2684856159 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff198103d70 con 0x7ff17c0b2900 2024-05-14T15:13:26.409 INFO:teuthology.orchestra.run.smithi069.stdout:Created osd(s) 9 on host 'smithi069' 2024-05-14T15:13:26.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:13:26.414+0000 7ff19e400700 1 -- 172.21.15.69:0/2684856159 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff17c0b2900 msgr2=0x7ff17c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:13:26.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:13:26.414+0000 7ff19e400700 1 --2- 172.21.15.69:0/2684856159 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff17c0b2900 0x7ff17c0b4e10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff188005950 tx=0x7ff18800b410 comp rx=0 tx=0).stop 2024-05-14T15:13:26.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:13:26.414+0000 7ff19e400700 1 -- 172.21.15.69:0/2684856159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1981077a0 msgr2=0x7ff19819d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:13:26.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:13:26.414+0000 7ff19e400700 1 --2- 172.21.15.69:0/2684856159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1981077a0 0x7ff19819d070 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff184000c00 tx=0x7ff1840047b0 comp rx=0 tx=0).stop 2024-05-14T15:13:26.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:13:26.414+0000 7ff19e400700 1 -- 172.21.15.69:0/2684856159 shutdown_connections 2024-05-14T15:13:26.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:13:26.414+0000 7ff19e400700 1 --2- 172.21.15.69:0/2684856159 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff17c0b2900 0x7ff17c0b4e10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:13:26.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:13:26.414+0000 7ff19e400700 1 --2- 172.21.15.69:0/2684856159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff19810a100 0x7ff1981a4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:13:26.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:13:26.414+0000 7ff19e400700 1 --2- 172.21.15.69:0/2684856159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff198104e40 0x7ff19819cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:13:26.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:13:26.414+0000 7ff19e400700 1 --2- 172.21.15.69:0/2684856159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1981077a0 0x7ff19819d070 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:13:26.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:13:26.414+0000 7ff19e400700 1 -- 172.21.15.69:0/2684856159 >> 172.21.15.69:0/2684856159 conn(0x7ff1980fe880 msgr2=0x7ff198103660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:13:26.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:13:26.414+0000 7ff19e400700 1 -- 172.21.15.69:0/2684856159 shutdown_connections 2024-05-14T15:13:26.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:13:26.415+0000 7ff19e400700 1 -- 172.21.15.69:0/2684856159 wait complete. 2024-05-14T15:13:27.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:26 smithi203 ceph-mon[34567]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:27.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:26 smithi203 ceph-mon[34567]: from='osd.9 [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-14T15:13:27.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:26 smithi203 ceph-mon[34567]: osdmap e59: 10 total, 9 up, 10 in 2024-05-14T15:13:27.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:26 smithi203 ceph-mon[34567]: from='osd.9 [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-05-14T15:13:27.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:26 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:27.116 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:26 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:13:27.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:26 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:13:27.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:26 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:27.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:26 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:27.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:26 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:27.117 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:26 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:13:27.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:26 smithi092 ceph-mon[34729]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:27.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:26 smithi092 ceph-mon[34729]: from='osd.9 [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-14T15:13:27.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:26 smithi092 ceph-mon[34729]: osdmap e59: 10 total, 9 up, 10 in 2024-05-14T15:13:27.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:26 smithi092 ceph-mon[34729]: from='osd.9 [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-05-14T15:13:27.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:26 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:27.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:26 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:13:27.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:26 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:13:27.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:26 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:27.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:26 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:27.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:26 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:27.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:26 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:13:27.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:26 smithi069 ceph-mon[31270]: pgmap v280: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:27.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:26 smithi069 ceph-mon[31270]: from='osd.9 [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-05-14T15:13:27.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:26 smithi069 ceph-mon[31270]: osdmap e59: 10 total, 9 up, 10 in 2024-05-14T15:13:27.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:26 smithi069 ceph-mon[31270]: from='osd.9 [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]: dispatch 2024-05-14T15:13:27.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:27.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:13:27.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:13:27.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:27.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:27.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:27.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:13:27.353 DEBUG:teuthology.orchestra.run.smithi069:osd.9> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.9.service 2024-05-14T15:13:27.361 INFO:tasks.cephadm:Deploying osd.10 on smithi092 with /dev/vg_nvme/lv_1... 2024-05-14T15:13:27.361 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-14T15:13:27.813 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T15:13:27.894 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:27 smithi069 ceph-mon[31270]: from='osd.9 [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-05-14T15:13:27.894 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:27 smithi069 ceph-mon[31270]: osdmap e60: 10 total, 9 up, 10 in 2024-05-14T15:13:27.894 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:27 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:27.894 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:27 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:28.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:27 smithi203 ceph-mon[34567]: from='osd.9 [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-05-14T15:13:28.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:27 smithi203 ceph-mon[34567]: osdmap e60: 10 total, 9 up, 10 in 2024-05-14T15:13:28.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:27 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:28.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:27 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:28.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:27 smithi092 ceph-mon[34729]: from='osd.9 [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi069", "root=default"]}]': finished 2024-05-14T15:13:28.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:27 smithi092 ceph-mon[34729]: osdmap e60: 10 total, 9 up, 10 in 2024-05-14T15:13:28.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:27 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:28.185 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:27 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:28.944 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:28 smithi069 ceph-mon[31270]: purged_snaps scrub starts 2024-05-14T15:13:28.944 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:28 smithi069 ceph-mon[31270]: purged_snaps scrub ok 2024-05-14T15:13:28.944 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:28 smithi069 ceph-mon[31270]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:28.944 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:28 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:28.945 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:28 smithi069 ceph-mon[31270]: osd.9 [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866] boot 2024-05-14T15:13:28.945 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:28 smithi069 ceph-mon[31270]: osdmap e61: 10 total, 10 up, 10 in 2024-05-14T15:13:28.945 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:28 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:29.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:28 smithi203 ceph-mon[34567]: purged_snaps scrub starts 2024-05-14T15:13:29.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:28 smithi203 ceph-mon[34567]: purged_snaps scrub ok 2024-05-14T15:13:29.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:28 smithi203 ceph-mon[34567]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:29.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:28 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:29.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:28 smithi203 ceph-mon[34567]: osd.9 [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866] boot 2024-05-14T15:13:29.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:28 smithi203 ceph-mon[34567]: osdmap e61: 10 total, 10 up, 10 in 2024-05-14T15:13:29.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:28 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:29.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:28 smithi092 ceph-mon[34729]: purged_snaps scrub starts 2024-05-14T15:13:29.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:28 smithi092 ceph-mon[34729]: purged_snaps scrub ok 2024-05-14T15:13:29.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:28 smithi092 ceph-mon[34729]: pgmap v283: 1 pgs: 1 active+clean; 577 KiB data, 277 MiB used, 804 GiB / 805 GiB avail 2024-05-14T15:13:29.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:28 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:29.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:28 smithi092 ceph-mon[34729]: osd.9 [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866] boot 2024-05-14T15:13:29.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:28 smithi092 ceph-mon[34729]: osdmap e61: 10 total, 10 up, 10 in 2024-05-14T15:13:29.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:28 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:13:29.841 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:29 smithi092 ceph-mon[34729]: osdmap e62: 10 total, 10 up, 10 in 2024-05-14T15:13:29.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:29 smithi069 ceph-mon[31270]: osdmap e62: 10 total, 10 up, 10 in 2024-05-14T15:13:30.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:29 smithi203 ceph-mon[34567]: osdmap e62: 10 total, 10 up, 10 in 2024-05-14T15:13:30.891 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-14T15:13:30.891 INFO:teuthology.orchestra.run.smithi092.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-14T15:13:30.891 INFO:teuthology.orchestra.run.smithi092.stderr: stderr: 10+0 records in 2024-05-14T15:13:30.891 INFO:teuthology.orchestra.run.smithi092.stderr:10+0 records out 2024-05-14T15:13:30.892 INFO:teuthology.orchestra.run.smithi092.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0344526 s, 304 MB/s 2024-05-14T15:13:30.892 INFO:teuthology.orchestra.run.smithi092.stderr:--> Zapping successful for: 2024-05-14T15:13:31.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:30 smithi203 ceph-mon[34567]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:31.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:30 smithi092 ceph-mon[34729]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:31.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:30 smithi069 ceph-mon[31270]: pgmap v286: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:31.909 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi092:vg_nvme/lv_1 2024-05-14T15:13:32.330 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T15:13:33.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:33 smithi092 ceph-mon[34729]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:33.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:33 smithi092 ceph-mon[34729]: Detected new or changed devices on smithi069 2024-05-14T15:13:33.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:33.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:33.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:13:33.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:13:33.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:13:33.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:13:33.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:33 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi069 to 4272M 2024-05-14T15:13:33.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:33.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:13:33.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:13:33.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:33 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:33.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:33 smithi069 ceph-mon[31270]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:33.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:33 smithi069 ceph-mon[31270]: Detected new or changed devices on smithi069 2024-05-14T15:13:33.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:33.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:33.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:13:33.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:13:33.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:13:33.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:13:33.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:33 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi069 to 4272M 2024-05-14T15:13:33.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:33.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:13:33.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:13:33.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:33 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:33.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:33 smithi203 ceph-mon[34567]: pgmap v287: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:33 smithi203 ceph-mon[34567]: Detected new or changed devices on smithi069 2024-05-14T15:13:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:13:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:13:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:13:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:13:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:33 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi069 to 4272M 2024-05-14T15:13:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:13:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:13:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:33 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:34.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.609+0000 7f444aa00700 1 -- 172.21.15.92:0/3173420592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4444104370 msgr2=0x7f4444104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:13:34.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.609+0000 7f444aa00700 1 --2- 172.21.15.92:0/3173420592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4444104370 0x7f4444104780 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4434009990 tx=0x7f4434009ca0 comp rx=0 tx=0).stop 2024-05-14T15:13:34.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.609+0000 7f444aa00700 1 -- 172.21.15.92:0/3173420592 shutdown_connections 2024-05-14T15:13:34.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.609+0000 7f444aa00700 1 --2- 172.21.15.92:0/3173420592 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4444105e40 0x7f444410c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:13:34.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.609+0000 7f444aa00700 1 --2- 172.21.15.92:0/3173420592 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4444104370 0x7f4444104780 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:13:34.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.609+0000 7f444aa00700 1 --2- 172.21.15.92:0/3173420592 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f44441054a0 0x7f44441058b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:13:34.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.609+0000 7f444aa00700 1 -- 172.21.15.92:0/3173420592 >> 172.21.15.92:0/3173420592 conn(0x7f44440ff9d0 msgr2=0x7f4444101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:13:34.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.609+0000 7f444aa00700 1 -- 172.21.15.92:0/3173420592 shutdown_connections 2024-05-14T15:13:34.608 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.610+0000 7f444aa00700 1 -- 172.21.15.92:0/3173420592 wait complete. 2024-05-14T15:13:34.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.611+0000 7f444aa00700 1 Processor -- start 2024-05-14T15:13:34.609 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.611+0000 7f444aa00700 1 -- start start 2024-05-14T15:13:34.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.611+0000 7f444aa00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4444104370 0x7f444419ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:13:34.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.611+0000 7f444aa00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44441054a0 0x7f444419cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:13:34.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.611+0000 7f444aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4444105e40 0x7f44441a3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:13:34.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.611+0000 7f444aa00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f444410fc60 con 0x7f4444105e40 2024-05-14T15:13:34.611 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.611+0000 7f444aa00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f444410fae0 con 0x7f44441054a0 2024-05-14T15:13:34.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.611+0000 7f444aa00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f444410fde0 con 0x7f4444104370 2024-05-14T15:13:34.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.612+0000 7f4443400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44441054a0 0x7f444419cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:13:34.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.612+0000 7f4443400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44441054a0 0x7f444419cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.92:46688/0 (socket says 172.21.15.92:46688) 2024-05-14T15:13:34.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.612+0000 7f4443400700 1 -- 172.21.15.92:0/1265460210 learned_addr learned my addr 172.21.15.92:0/1265460210 (peer_addr_for_me v2:172.21.15.92:0/0) 2024-05-14T15:13:34.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.612+0000 7f4443e00700 1 --2- 172.21.15.92:0/1265460210 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4444104370 0x7f444419ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:13:34.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.612+0000 7f4448a00700 1 --2- 172.21.15.92:0/1265460210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4444105e40 0x7f44441a3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:13:34.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.612+0000 7f4443400700 1 -- 172.21.15.92:0/1265460210 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4444104370 msgr2=0x7f444419ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:13:34.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.612+0000 7f4443400700 1 --2- 172.21.15.92:0/1265460210 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4444104370 0x7f444419ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:13:34.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.612+0000 7f4443400700 1 -- 172.21.15.92:0/1265460210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4444105e40 msgr2=0x7f44441a3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:13:34.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.612+0000 7f4443400700 1 --2- 172.21.15.92:0/1265460210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4444105e40 0x7f44441a3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:13:34.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.612+0000 7f4443400700 1 -- 172.21.15.92:0/1265460210 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44441a45a0 con 0x7f44441054a0 2024-05-14T15:13:34.612 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.612+0000 7f4443400700 1 --2- 172.21.15.92:0/1265460210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44441054a0 0x7f444419cf80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f443000eb30 tx=0x7f443000eef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:13:34.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.613+0000 7f4440c00700 1 -- 172.21.15.92:0/1265460210 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f443000cd40 con 0x7f44441054a0 2024-05-14T15:13:34.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.613+0000 7f4440c00700 1 -- 172.21.15.92:0/1265460210 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f44300044b0 con 0x7f44441054a0 2024-05-14T15:13:34.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.613+0000 7f444aa00700 1 -- 172.21.15.92:0/1265460210 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44441a4890 con 0x7f44441054a0 2024-05-14T15:13:34.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.613+0000 7f4440c00700 1 -- 172.21.15.92:0/1265460210 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4430010430 con 0x7f44441054a0 2024-05-14T15:13:34.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.613+0000 7f444aa00700 1 -- 172.21.15.92:0/1265460210 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44441a4e20 con 0x7f44441054a0 2024-05-14T15:13:34.613 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.614+0000 7f444aa00700 1 -- 172.21.15.92:0/1265460210 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44440512c0 con 0x7f44441054a0 2024-05-14T15:13:34.614 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.617+0000 7f4440c00700 1 -- 172.21.15.92:0/1265460210 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f4430003f10 con 0x7f44441054a0 2024-05-14T15:13:34.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.618+0000 7f4440c00700 1 --2- 172.21.15.92:0/1265460210 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f44280b2900 0x7f44280b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:13:34.616 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.618+0000 7f4440c00700 1 -- 172.21.15.92:0/1265460210 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(62..62 src has 1..62) ==== 6261+0+0 (secure 0 0 0) 0x7f44300e1e30 con 0x7f44441054a0 2024-05-14T15:13:34.617 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.619+0000 7f4443e00700 1 --2- 172.21.15.92:0/1265460210 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f44280b2900 0x7f44280b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:13:34.618 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.620+0000 7f4443e00700 1 --2- 172.21.15.92:0/1265460210 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f44280b2900 0x7f44280b4e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f443400b650 tx=0x7f443401a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:13:34.619 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.621+0000 7f4440c00700 1 -- 172.21.15.92:0/1265460210 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f44300aa340 con 0x7f44441054a0 2024-05-14T15:13:34.863 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:13:34.864+0000 7f444aa00700 1 -- 172.21.15.92:0/1265460210 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f44441a50b0 con 0x7f44280b2900 2024-05-14T15:13:35.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:35 smithi092 ceph-mon[34729]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:35.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:35 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:13:35.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:35 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:13:35.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:35 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:13:35.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:35 smithi069 ceph-mon[31270]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:35.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:35 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:13:35.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:35 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:13:35.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:35 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:13:35.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:35 smithi203 ceph-mon[34567]: pgmap v288: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:35.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:35 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:13:35.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:35 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:13:35.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:35 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:13:36.348 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:36 smithi092 ceph-mon[34729]: from='client.34331 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:13:36.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:36 smithi069 ceph-mon[31270]: from='client.34331 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:13:36.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:36 smithi203 ceph-mon[34567]: from='client.34331 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi092:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:13:37.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:37 smithi092 ceph-mon[34729]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:37.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:37 smithi069 ceph-mon[31270]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:37.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:37 smithi203 ceph-mon[34567]: pgmap v289: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:39.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:39 smithi069 ceph-mon[31270]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:39.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:39 smithi203 ceph-mon[34567]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:39.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:39 smithi092 ceph-mon[34729]: pgmap v290: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:40.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:40 smithi069 ceph-mon[31270]: from='client.? 172.21.15.92:0/2663619659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45287823-f7ea-431f-ac01-a72762b01a9f"}]: dispatch 2024-05-14T15:13:40.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:40 smithi069 ceph-mon[31270]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45287823-f7ea-431f-ac01-a72762b01a9f"}]: dispatch 2024-05-14T15:13:40.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:40 smithi069 ceph-mon[31270]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45287823-f7ea-431f-ac01-a72762b01a9f"}]': finished 2024-05-14T15:13:40.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:40 smithi069 ceph-mon[31270]: osdmap e63: 11 total, 10 up, 11 in 2024-05-14T15:13:40.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:40 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:13:40.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:40 smithi203 ceph-mon[34567]: from='client.? 172.21.15.92:0/2663619659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45287823-f7ea-431f-ac01-a72762b01a9f"}]: dispatch 2024-05-14T15:13:40.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:40 smithi203 ceph-mon[34567]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45287823-f7ea-431f-ac01-a72762b01a9f"}]: dispatch 2024-05-14T15:13:40.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:40 smithi203 ceph-mon[34567]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45287823-f7ea-431f-ac01-a72762b01a9f"}]': finished 2024-05-14T15:13:40.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:40 smithi203 ceph-mon[34567]: osdmap e63: 11 total, 10 up, 11 in 2024-05-14T15:13:40.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:40 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:13:40.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:40 smithi092 ceph-mon[34729]: from='client.? 172.21.15.92:0/2663619659' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45287823-f7ea-431f-ac01-a72762b01a9f"}]: dispatch 2024-05-14T15:13:40.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:40 smithi092 ceph-mon[34729]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45287823-f7ea-431f-ac01-a72762b01a9f"}]: dispatch 2024-05-14T15:13:40.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:40 smithi092 ceph-mon[34729]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45287823-f7ea-431f-ac01-a72762b01a9f"}]': finished 2024-05-14T15:13:40.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:40 smithi092 ceph-mon[34729]: osdmap e63: 11 total, 10 up, 11 in 2024-05-14T15:13:40.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:40 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:13:41.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:41 smithi069 ceph-mon[31270]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:41.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:41 smithi069 ceph-mon[31270]: from='client.? 172.21.15.92:0/640741842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:13:41.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:41 smithi203 ceph-mon[34567]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:41.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:41 smithi203 ceph-mon[34567]: from='client.? 172.21.15.92:0/640741842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:13:41.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:41 smithi092 ceph-mon[34729]: pgmap v292: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:41.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:41 smithi092 ceph-mon[34729]: from='client.? 172.21.15.92:0/640741842' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:13:43.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:43 smithi069 ceph-mon[31270]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:43.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:43 smithi203 ceph-mon[34567]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:43.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:43 smithi092 ceph-mon[34729]: pgmap v293: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:45.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:45 smithi069 ceph-mon[31270]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:45.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:45 smithi203 ceph-mon[34567]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:45.625 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:45 smithi092 ceph-mon[34729]: pgmap v294: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:47.539 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:47 smithi092 ceph-mon[34729]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:47.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:47 smithi203 ceph-mon[34567]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:47.720 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:47 smithi069 ceph-mon[31270]: pgmap v295: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:49.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:49 smithi203 ceph-mon[34567]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:49.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-14T15:13:49.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:13:49.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:49 smithi092 ceph-mon[34729]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:49.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-14T15:13:49.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:13:49.720 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:49 smithi069 ceph-mon[31270]: pgmap v296: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:49.720 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-05-14T15:13:49.720 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:13:50.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:50 smithi203 ceph-mon[34567]: Deploying daemon osd.10 on smithi092 2024-05-14T15:13:50.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:50 smithi092 ceph-mon[34729]: Deploying daemon osd.10 on smithi092 2024-05-14T15:13:50.720 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:50 smithi069 ceph-mon[31270]: Deploying daemon osd.10 on smithi092 2024-05-14T15:13:51.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:51 smithi092 ceph-mon[34729]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:51.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:51 smithi203 ceph-mon[34567]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:51.720 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:51 smithi069 ceph-mon[31270]: pgmap v297: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:53.439 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:53 smithi092 ceph-mon[34729]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:53.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:53 smithi203 ceph-mon[34567]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:53.720 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:53 smithi069 ceph-mon[31270]: pgmap v298: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:55.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:55 smithi203 ceph-mon[34567]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:55.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:55 smithi092 ceph-mon[34729]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:55.720 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:55 smithi069 ceph-mon[31270]: pgmap v299: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:56.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:56 smithi203 ceph-mon[34567]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:56.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:56 smithi092 ceph-mon[34729]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:56.720 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:56 smithi069 ceph-mon[31270]: pgmap v300: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:58.857 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:58 smithi092 ceph-mon[34729]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:58.858 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:58 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:13:58.858 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:58 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:58.858 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:13:58 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:58.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:58 smithi069 ceph-mon[31270]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:58.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:13:58.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:58.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:13:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:59.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:58 smithi203 ceph-mon[34567]: pgmap v301: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:13:59.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:58 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:13:59.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:58 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:13:59.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:13:58 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:00.689 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:00 smithi092 ceph-mon[34729]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:14:00.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:00 smithi069 ceph-mon[31270]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:14:01.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:00 smithi203 ceph-mon[34567]: pgmap v302: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:14:02.865 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:02 smithi092 ceph-mon[34729]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:14:02.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:02 smithi069 ceph-mon[31270]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:14:03.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:02 smithi203 ceph-mon[34567]: pgmap v303: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:14:03.833 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:14:03.835+0000 7f4440c00700 1 -- 172.21.15.92:0/1265460210 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f44441a50b0 con 0x7f44280b2900 2024-05-14T15:14:03.833 INFO:teuthology.orchestra.run.smithi092.stdout:Created osd(s) 10 on host 'smithi092' 2024-05-14T15:14:03.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:14:03.838+0000 7f444aa00700 1 -- 172.21.15.92:0/1265460210 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f44280b2900 msgr2=0x7f44280b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:03.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:14:03.838+0000 7f444aa00700 1 --2- 172.21.15.92:0/1265460210 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f44280b2900 0x7f44280b4e10 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f443400b650 tx=0x7f443401a040 comp rx=0 tx=0).stop 2024-05-14T15:14:03.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:14:03.838+0000 7f444aa00700 1 -- 172.21.15.92:0/1265460210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44441054a0 msgr2=0x7f444419cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:03.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:14:03.838+0000 7f444aa00700 1 --2- 172.21.15.92:0/1265460210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44441054a0 0x7f444419cf80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f443000eb30 tx=0x7f443000eef0 comp rx=0 tx=0).stop 2024-05-14T15:14:03.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:14:03.838+0000 7f444aa00700 1 -- 172.21.15.92:0/1265460210 shutdown_connections 2024-05-14T15:14:03.836 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:14:03.838+0000 7f444aa00700 1 --2- 172.21.15.92:0/1265460210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4444105e40 0x7f44441a3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:03.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:14:03.838+0000 7f444aa00700 1 --2- 172.21.15.92:0/1265460210 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f44280b2900 0x7f44280b4e10 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:03.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:14:03.838+0000 7f444aa00700 1 --2- 172.21.15.92:0/1265460210 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4444104370 0x7f444419ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:03.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:14:03.838+0000 7f444aa00700 1 --2- 172.21.15.92:0/1265460210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f44441054a0 0x7f444419cf80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:03.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:14:03.839+0000 7f444aa00700 1 -- 172.21.15.92:0/1265460210 >> 172.21.15.92:0/1265460210 conn(0x7f44440ff9d0 msgr2=0x7f4444076b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:14:03.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:14:03.839+0000 7f444aa00700 1 -- 172.21.15.92:0/1265460210 shutdown_connections 2024-05-14T15:14:03.837 INFO:teuthology.orchestra.run.smithi092.stderr:2024-05-14T15:14:03.839+0000 7f444aa00700 1 -- 172.21.15.92:0/1265460210 wait complete. 2024-05-14T15:14:03.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:03 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:03.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:03 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:03.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:03 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:03.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:03 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:14:03.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:03 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:03.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:03 smithi092 ceph-mon[34729]: from='osd.10 [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T15:14:03.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:03 smithi092 ceph-mon[34729]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T15:14:03.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:03 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:03.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:03 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:03.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:03 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:03.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:03 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:14:03.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:03 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:03.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:03 smithi069 ceph-mon[31270]: from='osd.10 [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T15:14:03.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:03 smithi069 ceph-mon[31270]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T15:14:03.993 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:03 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:03.994 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:03 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:03.994 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:03 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:03.994 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:03 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:14:03.994 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:03 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:03.994 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:03 smithi203 ceph-mon[34567]: from='osd.10 [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T15:14:03.994 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:03 smithi203 ceph-mon[34567]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-05-14T15:14:04.827 DEBUG:teuthology.orchestra.run.smithi092:osd.10> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.10.service 2024-05-14T15:14:04.832 INFO:tasks.cephadm:Deploying osd.11 on smithi203 with /dev/vg_nvme/lv_1... 2024-05-14T15:14:04.832 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-14T15:14:04.921 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:04 smithi203 ceph-mon[34567]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:14:04.921 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:04 smithi203 ceph-mon[34567]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-14T15:14:04.921 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:04 smithi203 ceph-mon[34567]: osdmap e64: 11 total, 10 up, 11 in 2024-05-14T15:14:04.921 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:04 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:14:04.921 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:04 smithi203 ceph-mon[34567]: from='osd.10 [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:14:04.921 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:04 smithi203 ceph-mon[34567]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:14:04.921 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:04 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:04.922 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:04 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:14:04.922 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:04 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:04.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:04 smithi092 ceph-mon[34729]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:14:04.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:04 smithi092 ceph-mon[34729]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-14T15:14:04.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:04 smithi092 ceph-mon[34729]: osdmap e64: 11 total, 10 up, 11 in 2024-05-14T15:14:04.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:04 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:14:04.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:04 smithi092 ceph-mon[34729]: from='osd.10 [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:14:04.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:04 smithi092 ceph-mon[34729]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:14:04.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:04 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:04.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:04 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:14:04.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:04 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:04.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:04 smithi069 ceph-mon[31270]: pgmap v304: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:14:04.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:04 smithi069 ceph-mon[31270]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-05-14T15:14:04.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:04 smithi069 ceph-mon[31270]: osdmap e64: 11 total, 10 up, 11 in 2024-05-14T15:14:04.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:04 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:14:04.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:04 smithi069 ceph-mon[31270]: from='osd.10 [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:14:04.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:04 smithi069 ceph-mon[31270]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]: dispatch 2024-05-14T15:14:04.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:04 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:04.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:04 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:14:04.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:04 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:05.268 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:14:05.690 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:14:05 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:14:05.547+0000 7ff4e1000700 -1 osd.10 0 waiting for initial osdmap 2024-05-14T15:14:05.690 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:14:05 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:14:05.605+0000 7ff4d6e00700 -1 osd.10 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T15:14:05.949 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:05 smithi203 ceph-mon[34567]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-05-14T15:14:05.949 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:05 smithi203 ceph-mon[34567]: osdmap e65: 11 total, 10 up, 11 in 2024-05-14T15:14:05.949 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:14:05.949 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:14:05.949 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:05 smithi203 ceph-mon[34567]: from='osd.10 ' entity='osd.10' 2024-05-14T15:14:05.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:05 smithi069 ceph-mon[31270]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-05-14T15:14:05.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:05 smithi069 ceph-mon[31270]: osdmap e65: 11 total, 10 up, 11 in 2024-05-14T15:14:05.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:14:05.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:14:05.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:05 smithi069 ceph-mon[31270]: from='osd.10 ' entity='osd.10' 2024-05-14T15:14:05.982 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:05 smithi092 ceph-mon[34729]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi092", "root=default"]}]': finished 2024-05-14T15:14:05.982 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:05 smithi092 ceph-mon[34729]: osdmap e65: 11 total, 10 up, 11 in 2024-05-14T15:14:05.982 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:14:05.982 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:14:05.982 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:05 smithi092 ceph-mon[34729]: from='osd.10 ' entity='osd.10' 2024-05-14T15:14:06.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:06 smithi092 ceph-mon[34729]: purged_snaps scrub starts 2024-05-14T15:14:06.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:06 smithi092 ceph-mon[34729]: purged_snaps scrub ok 2024-05-14T15:14:06.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:06 smithi092 ceph-mon[34729]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:14:06.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:06 smithi092 ceph-mon[34729]: osd.10 [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776] boot 2024-05-14T15:14:06.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:06 smithi092 ceph-mon[34729]: osdmap e66: 11 total, 11 up, 11 in 2024-05-14T15:14:06.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:06 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:14:06.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:06 smithi069 ceph-mon[31270]: purged_snaps scrub starts 2024-05-14T15:14:06.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:06 smithi069 ceph-mon[31270]: purged_snaps scrub ok 2024-05-14T15:14:06.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:06 smithi069 ceph-mon[31270]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:14:06.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:06 smithi069 ceph-mon[31270]: osd.10 [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776] boot 2024-05-14T15:14:06.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:06 smithi069 ceph-mon[31270]: osdmap e66: 11 total, 11 up, 11 in 2024-05-14T15:14:06.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:06 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:14:07.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:06 smithi203 ceph-mon[34567]: purged_snaps scrub starts 2024-05-14T15:14:07.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:06 smithi203 ceph-mon[34567]: purged_snaps scrub ok 2024-05-14T15:14:07.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:06 smithi203 ceph-mon[34567]: pgmap v307: 1 pgs: 1 active+clean; 577 KiB data, 304 MiB used, 894 GiB / 894 GiB avail 2024-05-14T15:14:07.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:06 smithi203 ceph-mon[34567]: osd.10 [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776] boot 2024-05-14T15:14:07.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:06 smithi203 ceph-mon[34567]: osdmap e66: 11 total, 11 up, 11 in 2024-05-14T15:14:07.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:06 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:14:08.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:07 smithi203 ceph-mon[34567]: osdmap e67: 11 total, 11 up, 11 in 2024-05-14T15:14:08.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:07 smithi092 ceph-mon[34729]: osdmap e67: 11 total, 11 up, 11 in 2024-05-14T15:14:08.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:07 smithi069 ceph-mon[31270]: osdmap e67: 11 total, 11 up, 11 in 2024-05-14T15:14:08.442 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-14T15:14:08.442 INFO:teuthology.orchestra.run.smithi203.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-14T15:14:08.442 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10+0 records in 2024-05-14T15:14:08.442 INFO:teuthology.orchestra.run.smithi203.stderr:10+0 records out 2024-05-14T15:14:08.442 INFO:teuthology.orchestra.run.smithi203.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0330915 s, 317 MB/s 2024-05-14T15:14:08.442 INFO:teuthology.orchestra.run.smithi203.stderr:--> Zapping successful for: 2024-05-14T15:14:08.939 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:08 smithi092 ceph-mon[34729]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:08.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:08 smithi092 ceph-mon[34729]: osdmap e68: 11 total, 11 up, 11 in 2024-05-14T15:14:09.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:08 smithi203 ceph-mon[34567]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:09.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:08 smithi203 ceph-mon[34567]: osdmap e68: 11 total, 11 up, 11 in 2024-05-14T15:14:09.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:08 smithi069 ceph-mon[31270]: pgmap v310: 1 pgs: 1 active+clean; 577 KiB data, 335 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:09.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:08 smithi069 ceph-mon[31270]: osdmap e68: 11 total, 11 up, 11 in 2024-05-14T15:14:09.423 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch daemon add osd smithi203:vg_nvme/lv_1 2024-05-14T15:14:09.867 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:14:09.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:09 smithi092 ceph-mon[34729]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-14T15:14:09.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:09 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:09.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:09 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:09.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:09 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:09.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:09 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:09.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:09 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:09.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:09 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:10.064 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:09 smithi069 ceph-mon[31270]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-14T15:14:10.064 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:09 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:10.064 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:09 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:10.064 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:09 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:10.064 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:09 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:10.064 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:09 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:10.064 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:09 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:10.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:09 smithi203 ceph-mon[34567]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-05-14T15:14:10.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:09 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:10.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:09 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:10.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:09 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:10.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:09 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:10.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:09 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:10.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:09 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:11.053 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:10 smithi203 ceph-mon[34567]: pgmap v312: 1 pgs: 1 activating+degraded; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-05-14T15:14:11.053 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:10 smithi203 ceph-mon[34567]: Detected new or changed devices on smithi092 2024-05-14T15:14:11.053 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:10 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi092 to 4272M 2024-05-14T15:14:11.053 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:10 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:11.054 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:10 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:11.054 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:10 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:14:11.054 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:10 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:11.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:10 smithi092 ceph-mon[34729]: pgmap v312: 1 pgs: 1 activating+degraded; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-05-14T15:14:11.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:10 smithi092 ceph-mon[34729]: Detected new or changed devices on smithi092 2024-05-14T15:14:11.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:10 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi092 to 4272M 2024-05-14T15:14:11.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:10 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:11.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:10 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:11.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:10 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:14:11.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:10 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:11.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:10 smithi069 ceph-mon[31270]: pgmap v312: 1 pgs: 1 activating+degraded; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-05-14T15:14:11.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:10 smithi069 ceph-mon[31270]: Detected new or changed devices on smithi092 2024-05-14T15:14:11.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:10 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi092 to 4272M 2024-05-14T15:14:11.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:10 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:11.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:10 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:11.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:10 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:14:11.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:10 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:12.162 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.163+0000 7fa056e00700 1 -- 172.21.15.203:0/1352707696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa050105c20 msgr2=0x7fa05010c4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:12.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.163+0000 7fa056e00700 1 --2- 172.21.15.203:0/1352707696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa050105c20 0x7fa05010c4d0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa04800b0a0 tx=0x7fa04800b3b0 comp rx=0 tx=0).stop 2024-05-14T15:14:12.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.164+0000 7fa056e00700 1 -- 172.21.15.203:0/1352707696 shutdown_connections 2024-05-14T15:14:12.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.164+0000 7fa056e00700 1 --2- 172.21.15.203:0/1352707696 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa050105c20 0x7fa05010c4d0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:12.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.164+0000 7fa056e00700 1 --2- 172.21.15.203:0/1352707696 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa050104150 0x7fa050104560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:12.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.164+0000 7fa056e00700 1 --2- 172.21.15.203:0/1352707696 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa050105280 0x7fa050105690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:12.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.164+0000 7fa056e00700 1 -- 172.21.15.203:0/1352707696 >> 172.21.15.203:0/1352707696 conn(0x7fa0500ff7b0 msgr2=0x7fa050101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:14:12.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.164+0000 7fa056e00700 1 -- 172.21.15.203:0/1352707696 shutdown_connections 2024-05-14T15:14:12.163 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.164+0000 7fa056e00700 1 -- 172.21.15.203:0/1352707696 wait complete. 2024-05-14T15:14:12.164 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.165+0000 7fa056e00700 1 Processor -- start 2024-05-14T15:14:12.164 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.165+0000 7fa056e00700 1 -- start start 2024-05-14T15:14:12.164 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.165+0000 7fa056e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa050104150 0x7fa050077460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:12.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.166+0000 7fa056e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa050105280 0x7fa050075b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:12.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.166+0000 7fa056e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa050105c20 0x7fa050076050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:12.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.166+0000 7fa056e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa05010fad0 con 0x7fa050105c20 2024-05-14T15:14:12.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.166+0000 7fa056e00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa05010f950 con 0x7fa050105280 2024-05-14T15:14:12.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.166+0000 7fa056e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa05010fc50 con 0x7fa050104150 2024-05-14T15:14:12.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.166+0000 7fa055a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa050104150 0x7fa050077460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:12.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.166+0000 7fa055a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa050104150 0x7fa050077460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:45814/0 (socket says 172.21.15.203:45814) 2024-05-14T15:14:12.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.166+0000 7fa055a00700 1 -- 172.21.15.203:0/4065844856 learned_addr learned my addr 172.21.15.203:0/4065844856 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-05-14T15:14:12.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.166+0000 7fa055000700 1 --2- 172.21.15.203:0/4065844856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa050105280 0x7fa050075b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:12.165 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.166+0000 7fa056400700 1 --2- 172.21.15.203:0/4065844856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa050105c20 0x7fa050076050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:12.166 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.167+0000 7fa055a00700 1 -- 172.21.15.203:0/4065844856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa050105280 msgr2=0x7fa050075b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:12.166 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.167+0000 7fa055a00700 1 --2- 172.21.15.203:0/4065844856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa050105280 0x7fa050075b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:12.166 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.167+0000 7fa055a00700 1 -- 172.21.15.203:0/4065844856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa050105c20 msgr2=0x7fa050076050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:12.166 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.167+0000 7fa055a00700 1 --2- 172.21.15.203:0/4065844856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa050105c20 0x7fa050076050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:12.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.167+0000 7fa055a00700 1 -- 172.21.15.203:0/4065844856 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0500767b0 con 0x7fa050104150 2024-05-14T15:14:12.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.167+0000 7fa056400700 1 --2- 172.21.15.203:0/4065844856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa050105c20 0x7fa050076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:14:12.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.167+0000 7fa055a00700 1 --2- 172.21.15.203:0/4065844856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa050104150 0x7fa050077460 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa04400c970 tx=0x7fa04400cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:14:12.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.167+0000 7fa04e000700 1 -- 172.21.15.203:0/4065844856 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04400ce60 con 0x7fa050104150 2024-05-14T15:14:12.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.167+0000 7fa04e000700 1 -- 172.21.15.203:0/4065844856 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa044007900 con 0x7fa050104150 2024-05-14T15:14:12.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.167+0000 7fa056e00700 1 -- 172.21.15.203:0/4065844856 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0501a4740 con 0x7fa050104150 2024-05-14T15:14:12.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.168+0000 7fa04e000700 1 -- 172.21.15.203:0/4065844856 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044003bf0 con 0x7fa050104150 2024-05-14T15:14:12.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.168+0000 7fa056e00700 1 -- 172.21.15.203:0/4065844856 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0501a4c70 con 0x7fa050104150 2024-05-14T15:14:12.167 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.169+0000 7fa056e00700 1 -- 172.21.15.203:0/4065844856 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0500512c0 con 0x7fa050104150 2024-05-14T15:14:12.169 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.171+0000 7fa04e000700 1 -- 172.21.15.203:0/4065844856 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fa044007ab0 con 0x7fa050104150 2024-05-14T15:14:12.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.173+0000 7fa04e000700 1 --2- 172.21.15.203:0/4065844856 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa0380b2900 0x7fa0380b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:12.171 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.173+0000 7fa04e000700 1 -- 172.21.15.203:0/4065844856 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 6694+0+0 (secure 0 0 0) 0x7fa0440e16f0 con 0x7fa050104150 2024-05-14T15:14:12.172 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.173+0000 7fa055000700 1 --2- 172.21.15.203:0/4065844856 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa0380b2900 0x7fa0380b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:12.173 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.175+0000 7fa055000700 1 --2- 172.21.15.203:0/4065844856 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa0380b2900 0x7fa0380b4e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa040005950 tx=0x7fa04000a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:14:12.175 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.177+0000 7fa04e000700 1 -- 172.21.15.203:0/4065844856 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa044014030 con 0x7fa050104150 2024-05-14T15:14:12.417 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:12.419+0000 7fa056e00700 1 -- 172.21.15.203:0/4065844856 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fa050063c00 con 0x7fa0380b2900 2024-05-14T15:14:13.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:12 smithi203 ceph-mon[34567]: pgmap v313: 1 pgs: 1 activating+degraded; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-05-14T15:14:13.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:12 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:14:13.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:12 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:14:13.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:12 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:13.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:12 smithi092 ceph-mon[34729]: pgmap v313: 1 pgs: 1 activating+degraded; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-05-14T15:14:13.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:12 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:14:13.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:12 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:14:13.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:12 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:13.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:12 smithi069 ceph-mon[31270]: pgmap v313: 1 pgs: 1 activating+degraded; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-05-14T15:14:13.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:12 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-14T15:14:13.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:12 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-14T15:14:13.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:12 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:14.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:13 smithi203 ceph-mon[34567]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:14:14.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:13 smithi092 ceph-mon[34729]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:14:14.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:13 smithi069 ceph-mon[31270]: from='client.24346 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi203:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:14:14.953 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:14 smithi203 ceph-mon[34567]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-05-14T15:14:14.953 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:14 smithi203 ceph-mon[34567]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-14T15:14:14.954 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:14 smithi203 ceph-mon[34567]: Cluster is now healthy 2024-05-14T15:14:15.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:14 smithi092 ceph-mon[34729]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-05-14T15:14:15.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:14 smithi092 ceph-mon[34729]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-14T15:14:15.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:14 smithi092 ceph-mon[34729]: Cluster is now healthy 2024-05-14T15:14:15.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:14 smithi069 ceph-mon[31270]: pgmap v314: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-05-14T15:14:15.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:14 smithi069 ceph-mon[31270]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-05-14T15:14:15.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:14 smithi069 ceph-mon[31270]: Cluster is now healthy 2024-05-14T15:14:17.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:16 smithi203 ceph-mon[34567]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-05-14T15:14:17.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:16 smithi203 ceph-mon[34567]: from='client.? 172.21.15.203:0/1310382901' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f3a10f9-2414-4151-b1cf-3db68b2a66fb"}]: dispatch 2024-05-14T15:14:17.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:16 smithi203 ceph-mon[34567]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f3a10f9-2414-4151-b1cf-3db68b2a66fb"}]: dispatch 2024-05-14T15:14:17.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:16 smithi203 ceph-mon[34567]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f3a10f9-2414-4151-b1cf-3db68b2a66fb"}]': finished 2024-05-14T15:14:17.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:16 smithi203 ceph-mon[34567]: osdmap e69: 12 total, 11 up, 12 in 2024-05-14T15:14:17.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:16 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:17.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:16 smithi092 ceph-mon[34729]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-05-14T15:14:17.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:16 smithi092 ceph-mon[34729]: from='client.? 172.21.15.203:0/1310382901' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f3a10f9-2414-4151-b1cf-3db68b2a66fb"}]: dispatch 2024-05-14T15:14:17.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:16 smithi092 ceph-mon[34729]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f3a10f9-2414-4151-b1cf-3db68b2a66fb"}]: dispatch 2024-05-14T15:14:17.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:16 smithi092 ceph-mon[34729]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f3a10f9-2414-4151-b1cf-3db68b2a66fb"}]': finished 2024-05-14T15:14:17.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:16 smithi092 ceph-mon[34729]: osdmap e69: 12 total, 11 up, 12 in 2024-05-14T15:14:17.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:16 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:17.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:16 smithi069 ceph-mon[31270]: pgmap v315: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-05-14T15:14:17.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:16 smithi069 ceph-mon[31270]: from='client.? 172.21.15.203:0/1310382901' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f3a10f9-2414-4151-b1cf-3db68b2a66fb"}]: dispatch 2024-05-14T15:14:17.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:16 smithi069 ceph-mon[31270]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2f3a10f9-2414-4151-b1cf-3db68b2a66fb"}]: dispatch 2024-05-14T15:14:17.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:16 smithi069 ceph-mon[31270]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2f3a10f9-2414-4151-b1cf-3db68b2a66fb"}]': finished 2024-05-14T15:14:17.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:16 smithi069 ceph-mon[31270]: osdmap e69: 12 total, 11 up, 12 in 2024-05-14T15:14:17.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:16 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:18.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:17 smithi203 ceph-mon[34567]: from='client.? 172.21.15.203:0/2404870225' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:14:18.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:17 smithi092 ceph-mon[34729]: from='client.? 172.21.15.203:0/2404870225' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:14:18.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:17 smithi069 ceph-mon[31270]: from='client.? 172.21.15.203:0/2404870225' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-14T15:14:19.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:18 smithi092 ceph-mon[34729]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-14T15:14:19.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:18 smithi069 ceph-mon[31270]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-14T15:14:19.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:18 smithi203 ceph-mon[34567]: pgmap v317: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 59 KiB/s, 0 objects/s recovering 2024-05-14T15:14:21.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:20 smithi092 ceph-mon[34729]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:14:21.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:20 smithi069 ceph-mon[31270]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:14:21.255 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:20 smithi203 ceph-mon[34567]: pgmap v318: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:14:23.122 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:22 smithi203 ceph-mon[34567]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:14:23.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:22 smithi092 ceph-mon[34729]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:14:23.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:22 smithi069 ceph-mon[31270]: pgmap v319: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-05-14T15:14:25.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:24 smithi203 ceph-mon[34567]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:25.189 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:24 smithi092 ceph-mon[34729]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:25.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:24 smithi069 ceph-mon[31270]: pgmap v320: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:27.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:26 smithi092 ceph-mon[34729]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:27.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:26 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-14T15:14:27.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:26 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:27.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:26 smithi069 ceph-mon[31270]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:27.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-14T15:14:27.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:26 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:27.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:26 smithi203 ceph-mon[34567]: pgmap v321: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:27.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:26 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-05-14T15:14:27.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:26 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:28.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:27 smithi092 ceph-mon[34729]: Deploying daemon osd.11 on smithi203 2024-05-14T15:14:28.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:27 smithi069 ceph-mon[31270]: Deploying daemon osd.11 on smithi203 2024-05-14T15:14:28.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:27 smithi203 ceph-mon[34567]: Deploying daemon osd.11 on smithi203 2024-05-14T15:14:29.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:28 smithi203 ceph-mon[34567]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:29.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:28 smithi092 ceph-mon[34729]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:29.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:28 smithi069 ceph-mon[31270]: pgmap v322: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:31.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:30 smithi203 ceph-mon[34567]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:31.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:30 smithi092 ceph-mon[34729]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:31.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:30 smithi069 ceph-mon[31270]: pgmap v323: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:33.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:32 smithi092 ceph-mon[34729]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:33.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:32 smithi069 ceph-mon[31270]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:33.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:32 smithi203 ceph-mon[34567]: pgmap v324: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:35.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:34 smithi092 ceph-mon[34729]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:35.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:34 smithi069 ceph-mon[31270]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:35.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:34 smithi203 ceph-mon[34567]: pgmap v325: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:37.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:36 smithi203 ceph-mon[34567]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:37.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:36 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:37.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:36 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:37.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:36 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:14:37.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:36 smithi092 ceph-mon[34729]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:37.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:36 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:37.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:36 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:37.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:36 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:14:37.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:36 smithi069 ceph-mon[31270]: pgmap v326: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:37.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:36 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:37.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:36 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:37.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:36 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:14:39.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:38 smithi092 ceph-mon[34729]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:39.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:38 smithi069 ceph-mon[31270]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:39.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:38 smithi203 ceph-mon[34567]: pgmap v327: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:41.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:41 smithi092 ceph-mon[34729]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:41.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:41.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:41.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:41.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:14:41.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:41.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:41 smithi092 ceph-mon[34729]: from='osd.11 [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T15:14:41.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:41 smithi092 ceph-mon[34729]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T15:14:41.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:41 smithi069 ceph-mon[31270]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:41.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:41.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:41.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:41.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:14:41.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:41.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:41 smithi069 ceph-mon[31270]: from='osd.11 [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T15:14:41.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:41 smithi069 ceph-mon[31270]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T15:14:41.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:41 smithi203 ceph-mon[34567]: pgmap v328: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:41.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:41.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:41.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:41.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:14:41.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:41.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:41 smithi203 ceph-mon[34567]: from='osd.11 [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T15:14:41.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:41 smithi203 ceph-mon[34567]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-05-14T15:14:41.854 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:41.856+0000 7fa04e000700 1 -- 172.21.15.203:0/4065844856 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7fa050063c00 con 0x7fa0380b2900 2024-05-14T15:14:41.854 INFO:teuthology.orchestra.run.smithi203.stdout:Created osd(s) 11 on host 'smithi203' 2024-05-14T15:14:41.857 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:41.860+0000 7fa056e00700 1 -- 172.21.15.203:0/4065844856 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa0380b2900 msgr2=0x7fa0380b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:41.858 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:41.860+0000 7fa056e00700 1 --2- 172.21.15.203:0/4065844856 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa0380b2900 0x7fa0380b4e10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa040005950 tx=0x7fa04000a300 comp rx=0 tx=0).stop 2024-05-14T15:14:41.858 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:41.860+0000 7fa056e00700 1 -- 172.21.15.203:0/4065844856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa050104150 msgr2=0x7fa050077460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:41.858 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:41.860+0000 7fa056e00700 1 --2- 172.21.15.203:0/4065844856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa050104150 0x7fa050077460 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa04400c970 tx=0x7fa04400cc80 comp rx=0 tx=0).stop 2024-05-14T15:14:41.861 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:41.860+0000 7fa056e00700 1 -- 172.21.15.203:0/4065844856 shutdown_connections 2024-05-14T15:14:41.861 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:41.860+0000 7fa056e00700 1 --2- 172.21.15.203:0/4065844856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa050105c20 0x7fa050076050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:41.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:41.860+0000 7fa056e00700 1 --2- 172.21.15.203:0/4065844856 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa0380b2900 0x7fa0380b4e10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:41.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:41.860+0000 7fa056e00700 1 --2- 172.21.15.203:0/4065844856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa050104150 0x7fa050077460 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:41.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:41.860+0000 7fa056e00700 1 --2- 172.21.15.203:0/4065844856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa050105280 0x7fa050075b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:41.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:41.860+0000 7fa056e00700 1 -- 172.21.15.203:0/4065844856 >> 172.21.15.203:0/4065844856 conn(0x7fa0500ff7b0 msgr2=0x7fa0501084b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:14:41.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:41.861+0000 7fa056e00700 1 -- 172.21.15.203:0/4065844856 shutdown_connections 2024-05-14T15:14:41.862 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:41.861+0000 7fa056e00700 1 -- 172.21.15.203:0/4065844856 wait complete. 2024-05-14T15:14:42.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:42 smithi092 ceph-mon[34729]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-14T15:14:42.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:42 smithi092 ceph-mon[34729]: osdmap e70: 12 total, 11 up, 12 in 2024-05-14T15:14:42.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:42.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:42 smithi092 ceph-mon[34729]: from='osd.11 [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:14:42.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:42 smithi092 ceph-mon[34729]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:14:42.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:42.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:42.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:14:42.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:42 smithi069 ceph-mon[31270]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-14T15:14:42.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:42 smithi069 ceph-mon[31270]: osdmap e70: 12 total, 11 up, 12 in 2024-05-14T15:14:42.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:42.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:42 smithi069 ceph-mon[31270]: from='osd.11 [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:14:42.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:42 smithi069 ceph-mon[31270]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:14:42.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:42.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:42.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:14:42.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:42 smithi203 ceph-mon[34567]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-05-14T15:14:42.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:42 smithi203 ceph-mon[34567]: osdmap e70: 12 total, 11 up, 12 in 2024-05-14T15:14:42.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:42.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:42 smithi203 ceph-mon[34567]: from='osd.11 [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:14:42.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:42 smithi203 ceph-mon[34567]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]: dispatch 2024-05-14T15:14:42.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:42.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:42.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:14:42.745 DEBUG:teuthology.orchestra.run.smithi203:osd.11> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.11.service 2024-05-14T15:14:42.750 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-05-14T15:14:42.750 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd stat -f json 2024-05-14T15:14:43.199 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:14:43.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:43 smithi203 ceph-mon[34567]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:43.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:43 smithi203 ceph-mon[34567]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-05-14T15:14:43.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:43 smithi203 ceph-mon[34567]: osdmap e71: 12 total, 11 up, 12 in 2024-05-14T15:14:43.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:43 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:43.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:43 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:43.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:43 smithi203 ceph-mon[34567]: from='osd.11 ' entity='osd.11' 2024-05-14T15:14:43.344 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:14:43 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:14:43.046+0000 7f1110e00700 -1 osd.11 0 waiting for initial osdmap 2024-05-14T15:14:43.344 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:14:43 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:14:43.075+0000 7f1106c00700 -1 osd.11 71 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-14T15:14:43.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:43 smithi092 ceph-mon[34729]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:43.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:43 smithi092 ceph-mon[34729]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-05-14T15:14:43.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:43 smithi092 ceph-mon[34729]: osdmap e71: 12 total, 11 up, 12 in 2024-05-14T15:14:43.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:43 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:43.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:43 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:43.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:43 smithi092 ceph-mon[34729]: from='osd.11 ' entity='osd.11' 2024-05-14T15:14:43.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:43 smithi069 ceph-mon[31270]: pgmap v330: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:43.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:43 smithi069 ceph-mon[31270]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi203", "root=default"]}]': finished 2024-05-14T15:14:43.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:43 smithi069 ceph-mon[31270]: osdmap e71: 12 total, 11 up, 12 in 2024-05-14T15:14:43.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:43 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:43.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:43 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:43.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:43 smithi069 ceph-mon[31270]: from='osd.11 ' entity='osd.11' 2024-05-14T15:14:44.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:44 smithi092 ceph-mon[34729]: purged_snaps scrub starts 2024-05-14T15:14:44.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:44 smithi092 ceph-mon[34729]: purged_snaps scrub ok 2024-05-14T15:14:44.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:44 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:44.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:44 smithi092 ceph-mon[34729]: osd.11 [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806] boot 2024-05-14T15:14:44.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:44 smithi092 ceph-mon[34729]: osdmap e72: 12 total, 12 up, 12 in 2024-05-14T15:14:44.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:44 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:44.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:44 smithi069 ceph-mon[31270]: purged_snaps scrub starts 2024-05-14T15:14:44.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:44 smithi069 ceph-mon[31270]: purged_snaps scrub ok 2024-05-14T15:14:44.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:44 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:44.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:44 smithi069 ceph-mon[31270]: osd.11 [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806] boot 2024-05-14T15:14:44.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:44 smithi069 ceph-mon[31270]: osdmap e72: 12 total, 12 up, 12 in 2024-05-14T15:14:44.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:44 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:44.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:44 smithi203 ceph-mon[34567]: purged_snaps scrub starts 2024-05-14T15:14:44.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:44 smithi203 ceph-mon[34567]: purged_snaps scrub ok 2024-05-14T15:14:44.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:44 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:44.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:44 smithi203 ceph-mon[34567]: osd.11 [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806] boot 2024-05-14T15:14:44.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:44 smithi203 ceph-mon[34567]: osdmap e72: 12 total, 12 up, 12 in 2024-05-14T15:14:44.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:44 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:14:45.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:45 smithi203 ceph-mon[34567]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:45.464 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:45 smithi069 ceph-mon[31270]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:45.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:45 smithi092 ceph-mon[34729]: pgmap v332: 1 pgs: 1 active+clean; 577 KiB data, 336 MiB used, 983 GiB / 983 GiB avail 2024-05-14T15:14:45.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.706+0000 7f5de6e00700 1 -- 172.21.15.69:0/1683036056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5de0104180 msgr2=0x7f5de0104590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:45.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.706+0000 7f5de6e00700 1 --2- 172.21.15.69:0/1683036056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5de0104180 0x7f5de0104590 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc009990 tx=0x7f5dcc009ca0 comp rx=0 tx=0).stop 2024-05-14T15:14:45.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.706+0000 7f5de6e00700 1 -- 172.21.15.69:0/1683036056 shutdown_connections 2024-05-14T15:14:45.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.706+0000 7f5de6e00700 1 --2- 172.21.15.69:0/1683036056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5de0104b20 0x7f5de010b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:45.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.706+0000 7f5de6e00700 1 --2- 172.21.15.69:0/1683036056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5de0103050 0x7f5de0103460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:45.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.706+0000 7f5de6e00700 1 --2- 172.21.15.69:0/1683036056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5de0104180 0x7f5de0104590 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:45.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.706+0000 7f5de6e00700 1 -- 172.21.15.69:0/1683036056 >> 172.21.15.69:0/1683036056 conn(0x7f5de00fe690 msgr2=0x7f5de0100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:14:45.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.706+0000 7f5de6e00700 1 -- 172.21.15.69:0/1683036056 shutdown_connections 2024-05-14T15:14:45.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.706+0000 7f5de6e00700 1 -- 172.21.15.69:0/1683036056 wait complete. 2024-05-14T15:14:45.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.707+0000 7f5de6e00700 1 Processor -- start 2024-05-14T15:14:45.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.708+0000 7f5de6e00700 1 -- start start 2024-05-14T15:14:45.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.708+0000 7f5de6e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5de0103050 0x7f5de019c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:45.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.708+0000 7f5de6e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5de0104180 0x7f5de019cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:45.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.708+0000 7f5de6e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5de0104b20 0x7f5de01a3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:45.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.708+0000 7f5de6e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5de010e9c0 con 0x7f5de0103050 2024-05-14T15:14:45.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.708+0000 7f5de6e00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5de010e840 con 0x7f5de0104180 2024-05-14T15:14:45.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.708+0000 7f5de6e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5de010eb40 con 0x7f5de0104b20 2024-05-14T15:14:45.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.708+0000 7f5de5a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5de0103050 0x7f5de019c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:45.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.709+0000 7f5de5a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5de0103050 0x7f5de019c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53476/0 (socket says 172.21.15.69:53476) 2024-05-14T15:14:45.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.709+0000 7f5de5a00700 1 -- 172.21.15.69:0/2202584120 learned_addr learned my addr 172.21.15.69:0/2202584120 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:14:45.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.709+0000 7f5de5000700 1 --2- 172.21.15.69:0/2202584120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5de0104180 0x7f5de019cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:45.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.709+0000 7f5de6400700 1 --2- 172.21.15.69:0/2202584120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5de0104b20 0x7f5de01a3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:45.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.709+0000 7f5de5a00700 1 -- 172.21.15.69:0/2202584120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5de0104b20 msgr2=0x7f5de01a3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:45.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.709+0000 7f5de5a00700 1 --2- 172.21.15.69:0/2202584120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5de0104b20 0x7f5de01a3d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:45.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.709+0000 7f5de5a00700 1 -- 172.21.15.69:0/2202584120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5de0104180 msgr2=0x7f5de019cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:45.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.709+0000 7f5de5a00700 1 --2- 172.21.15.69:0/2202584120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5de0104180 0x7f5de019cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:45.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.709+0000 7f5de5a00700 1 -- 172.21.15.69:0/2202584120 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de01a4410 con 0x7f5de0103050 2024-05-14T15:14:45.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.709+0000 7f5de5a00700 1 --2- 172.21.15.69:0/2202584120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5de0103050 0x7f5de019c8b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400d950 tx=0x7f5dd400dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:14:45.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.710+0000 7f5dde000700 1 -- 172.21.15.69:0/2202584120 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4017070 con 0x7f5de0103050 2024-05-14T15:14:45.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.710+0000 7f5de6e00700 1 -- 172.21.15.69:0/2202584120 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5de01a4700 con 0x7f5de0103050 2024-05-14T15:14:45.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.710+0000 7f5dde000700 1 -- 172.21.15.69:0/2202584120 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5dd400de30 con 0x7f5de0103050 2024-05-14T15:14:45.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.710+0000 7f5dde000700 1 -- 172.21.15.69:0/2202584120 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dd4003aa0 con 0x7f5de0103050 2024-05-14T15:14:45.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.710+0000 7f5de6e00700 1 -- 172.21.15.69:0/2202584120 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5de01a4c40 con 0x7f5de0103050 2024-05-14T15:14:45.709 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.711+0000 7f5de6e00700 1 -- 172.21.15.69:0/2202584120 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5de00512c0 con 0x7f5de0103050 2024-05-14T15:14:45.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.714+0000 7f5dde000700 1 -- 172.21.15.69:0/2202584120 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f5dd4003c40 con 0x7f5de0103050 2024-05-14T15:14:45.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.716+0000 7f5dde000700 1 --2- 172.21.15.69:0/2202584120 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5dc80b2880 0x7f5dc80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:45.714 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.717+0000 7f5dde000700 1 -- 172.21.15.69:0/2202584120 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f5dd40e2160 con 0x7f5de0103050 2024-05-14T15:14:45.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.717+0000 7f5de5000700 1 --2- 172.21.15.69:0/2202584120 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5dc80b2880 0x7f5dc80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:45.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.718+0000 7f5de5000700 1 --2- 172.21.15.69:0/2202584120 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5dc80b2880 0x7f5dc80b4d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc006010 tx=0x7f5dcc01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:14:45.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.720+0000 7f5dde000700 1 -- 172.21.15.69:0/2202584120 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5dd4020030 con 0x7f5de0103050 2024-05-14T15:14:45.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.955+0000 7f5de6e00700 1 -- 172.21.15.69:0/2202584120 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5de01a5060 con 0x7f5de0103050 2024-05-14T15:14:45.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.956+0000 7f5dde000700 1 -- 172.21.15.69:0/2202584120 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f5dd4009940 con 0x7f5de0103050 2024-05-14T15:14:45.957 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:14:45.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.960+0000 7f5de6e00700 1 -- 172.21.15.69:0/2202584120 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5dc80b2880 msgr2=0x7f5dc80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:45.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.960+0000 7f5de6e00700 1 --2- 172.21.15.69:0/2202584120 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5dc80b2880 0x7f5dc80b4d90 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc006010 tx=0x7f5dcc01a040 comp rx=0 tx=0).stop 2024-05-14T15:14:45.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.960+0000 7f5de6e00700 1 -- 172.21.15.69:0/2202584120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5de0103050 msgr2=0x7f5de019c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:45.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.961+0000 7f5de6e00700 1 --2- 172.21.15.69:0/2202584120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5de0103050 0x7f5de019c8b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400d950 tx=0x7f5dd400dd10 comp rx=0 tx=0).stop 2024-05-14T15:14:45.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.961+0000 7f5de6e00700 1 -- 172.21.15.69:0/2202584120 shutdown_connections 2024-05-14T15:14:45.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.961+0000 7f5de6e00700 1 --2- 172.21.15.69:0/2202584120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5de0103050 0x7f5de019c8b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:45.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.961+0000 7f5de6e00700 1 --2- 172.21.15.69:0/2202584120 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5dc80b2880 0x7f5dc80b4d90 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:45.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.961+0000 7f5de6e00700 1 --2- 172.21.15.69:0/2202584120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5de0104b20 0x7f5de01a3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:45.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.961+0000 7f5de6e00700 1 --2- 172.21.15.69:0/2202584120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5de0104180 0x7f5de019cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:45.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.961+0000 7f5de6e00700 1 -- 172.21.15.69:0/2202584120 >> 172.21.15.69:0/2202584120 conn(0x7f5de00fe690 msgr2=0x7f5de0100070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:14:45.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.961+0000 7f5de6e00700 1 -- 172.21.15.69:0/2202584120 shutdown_connections 2024-05-14T15:14:45.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:45.961+0000 7f5de6e00700 1 -- 172.21.15.69:0/2202584120 wait complete. 2024-05-14T15:14:46.407 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:46 smithi069 ceph-mon[31270]: osdmap e73: 12 total, 12 up, 12 in 2024-05-14T15:14:46.408 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:46 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2202584120' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-14T15:14:46.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:46 smithi203 ceph-mon[34567]: osdmap e73: 12 total, 12 up, 12 in 2024-05-14T15:14:46.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:46 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2202584120' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-14T15:14:46.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:46 smithi092 ceph-mon[34729]: osdmap e73: 12 total, 12 up, 12 in 2024-05-14T15:14:46.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:46 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2202584120' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-14T15:14:46.845 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":73,"num_osds":12,"num_up_osds":12,"osd_up_since":1715699684,"num_in_osds":12,"osd_in_since":1715699656,"num_remapped_pgs":0} 2024-05-14T15:14:46.846 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T15:14:47.273 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:14:47.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:47 smithi203 ceph-mon[34567]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:47.619 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:47 smithi069 ceph-mon[31270]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:47.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:47 smithi092 ceph-mon[34729]: pgmap v335: 1 pgs: 1 active+clean; 577 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:48.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:48 smithi069 ceph-mon[31270]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:48.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:48 smithi069 ceph-mon[31270]: Detected new or changed devices on smithi203 2024-05-14T15:14:48.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:48.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:48.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:48.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:48.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:48.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:48.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:48 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi203 to 4272M 2024-05-14T15:14:48.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:48.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:48.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:14:48.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:48 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:49.069 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:48 smithi203 ceph-mon[34567]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:49.069 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:48 smithi203 ceph-mon[34567]: Detected new or changed devices on smithi203 2024-05-14T15:14:49.069 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:49.070 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:49.070 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:49.070 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:49.070 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:49.070 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:49.070 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:48 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi203 to 4272M 2024-05-14T15:14:49.070 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:49.070 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:49.070 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:14:49.070 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:48 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:49.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:48 smithi092 ceph-mon[34729]: pgmap v336: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:49.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:48 smithi092 ceph-mon[34729]: Detected new or changed devices on smithi203 2024-05-14T15:14:49.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:49.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:49.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:49.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:49.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:49.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:14:49.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:48 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi203 to 4272M 2024-05-14T15:14:49.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:49.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:49.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:14:49.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:48 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.652+0000 7f760f200700 1 -- 172.21.15.69:0/1799888428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7610104420 msgr2=0x7f7610104830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.652+0000 7f760f200700 1 --2- 172.21.15.69:0/1799888428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7610104420 0x7f7610104830 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f76000099c0 tx=0x7f7600009cd0 comp rx=0 tx=0).stop 2024-05-14T15:14:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.653+0000 7f760f200700 1 -- 172.21.15.69:0/1799888428 shutdown_connections 2024-05-14T15:14:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.653+0000 7f760f200700 1 --2- 172.21.15.69:0/1799888428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7610104420 0x7f7610104830 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.653+0000 7f760f200700 1 --2- 172.21.15.69:0/1799888428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76101096a0 0x7f7610111000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.653+0000 7f760f200700 1 --2- 172.21.15.69:0/1799888428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7610108d50 0x7f7610109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.653+0000 7f760f200700 1 -- 172.21.15.69:0/1799888428 >> 172.21.15.69:0/1799888428 conn(0x7f761007acb0 msgr2=0x7f761007b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:14:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.653+0000 7f760f200700 1 -- 172.21.15.69:0/1799888428 shutdown_connections 2024-05-14T15:14:49.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.653+0000 7f760f200700 1 -- 172.21.15.69:0/1799888428 wait complete. 2024-05-14T15:14:49.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.654+0000 7f760f200700 1 Processor -- start 2024-05-14T15:14:49.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.654+0000 7f760f200700 1 -- start start 2024-05-14T15:14:49.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.655+0000 7f760f200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7610104420 0x7f76101a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:49.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.655+0000 7f760f200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7610108d50 0x7f76101a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:49.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.655+0000 7f760f200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76101096a0 0x7f761019aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:49.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.655+0000 7f760f200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7610114180 con 0x7f7610108d50 2024-05-14T15:14:49.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.655+0000 7f760f200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7610114000 con 0x7f7610104420 2024-05-14T15:14:49.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.655+0000 7f760f200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7610114300 con 0x7f76101096a0 2024-05-14T15:14:49.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.655+0000 7f760d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7610108d50 0x7f76101a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:49.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.655+0000 7f760d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7610108d50 0x7f76101a0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53482/0 (socket says 172.21.15.69:53482) 2024-05-14T15:14:49.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.655+0000 7f760d400700 1 -- 172.21.15.69:0/520535701 learned_addr learned my addr 172.21.15.69:0/520535701 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:14:49.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.656+0000 7f760de00700 1 --2- 172.21.15.69:0/520535701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7610104420 0x7f76101a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:49.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.656+0000 7f760e800700 1 --2- 172.21.15.69:0/520535701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76101096a0 0x7f761019aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:49.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.656+0000 7f760d400700 1 -- 172.21.15.69:0/520535701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76101096a0 msgr2=0x7f761019aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:49.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.656+0000 7f760d400700 1 --2- 172.21.15.69:0/520535701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76101096a0 0x7f761019aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:49.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.656+0000 7f760d400700 1 -- 172.21.15.69:0/520535701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7610104420 msgr2=0x7f76101a07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:49.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.656+0000 7f760d400700 1 --2- 172.21.15.69:0/520535701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7610104420 0x7f76101a07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:49.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.656+0000 7f760d400700 1 -- 172.21.15.69:0/520535701 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f761019b040 con 0x7f7610108d50 2024-05-14T15:14:49.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.656+0000 7f760de00700 1 --2- 172.21.15.69:0/520535701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7610104420 0x7f76101a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:14:49.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.656+0000 7f760d400700 1 --2- 172.21.15.69:0/520535701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7610108d50 0x7f76101a0d20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00c9e0 tx=0x7f75fc00cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:14:49.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.657+0000 7f7606a00700 1 -- 172.21.15.69:0/520535701 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc007aa0 con 0x7f7610108d50 2024-05-14T15:14:49.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.657+0000 7f7606a00700 1 -- 172.21.15.69:0/520535701 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f75fc007c40 con 0x7f7610108d50 2024-05-14T15:14:49.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.657+0000 7f760f200700 1 -- 172.21.15.69:0/520535701 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f761019b330 con 0x7f7610108d50 2024-05-14T15:14:49.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.657+0000 7f7606a00700 1 -- 172.21.15.69:0/520535701 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75fc018660 con 0x7f7610108d50 2024-05-14T15:14:49.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.657+0000 7f760f200700 1 -- 172.21.15.69:0/520535701 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76101a7670 con 0x7f7610108d50 2024-05-14T15:14:49.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.658+0000 7f760f200700 1 -- 172.21.15.69:0/520535701 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76100512c0 con 0x7f7610108d50 2024-05-14T15:14:49.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.660+0000 7f7606a00700 1 -- 172.21.15.69:0/520535701 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f75fc018800 con 0x7f7610108d50 2024-05-14T15:14:49.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.662+0000 7f7606a00700 1 --2- 172.21.15.69:0/520535701 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f75f40b2900 0x7f75f40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:49.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.662+0000 7f7606a00700 1 -- 172.21.15.69:0/520535701 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f75fc0e1d20 con 0x7f7610108d50 2024-05-14T15:14:49.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.662+0000 7f760de00700 1 --2- 172.21.15.69:0/520535701 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f75f40b2900 0x7f75f40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:49.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.663+0000 7f760de00700 1 --2- 172.21.15.69:0/520535701 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f75f40b2900 0x7f75f40b4e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7600009990 tx=0x7f7600005ab0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:14:49.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.667+0000 7f7606a00700 1 -- 172.21.15.69:0/520535701 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f75fc014030 con 0x7f7610108d50 2024-05-14T15:14:49.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.899+0000 7f760f200700 1 -- 172.21.15.69:0/520535701 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f761019bf60 con 0x7f7610108d50 2024-05-14T15:14:49.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.902+0000 7f7606a00700 1 -- 172.21.15.69:0/520535701 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) ==== 74+0+18419 (secure 0 0 0) 0x7f761019bf60 con 0x7f7610108d50 2024-05-14T15:14:49.901 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:14:49.902 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":73,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","created":"2024-05-14T15:04:32.074994+0000","modified":"2024-05-14T15:14:45.195171+0000","last_up_change":"2024-05-14T15:14:44.049523+0000","last_in_change":"2024-05-14T15:14:16.752653+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:09:03.561841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"8640de99-c23a-494e-a100-aafd04fe1867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6803","nonce":301095601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6805","nonce":301095601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6809","nonce":301095601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6807","nonce":301095601}]},"public_addr":"172.21.15.69:6803/301095601","cluster_addr":"172.21.15.69:6805/301095601","heartbeat_back_addr":"172.21.15.69:6809/301095601","heartbeat_front_addr":"172.21.15.69:6807/301095601","state":["exists","up"]},{"osd":1,"uuid":"89f78a32-7afb-49f3-9287-5478a1cc8829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":38,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6801","nonce":2774122776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6803","nonce":2774122776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6807","nonce":2774122776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6805","nonce":2774122776}]},"public_addr":"172.21.15.92:6801/2774122776","cluster_addr":"172.21.15.92:6803/2774122776","heartbeat_back_addr":"172.21.15.92:6807/2774122776","heartbeat_front_addr":"172.21.15.92:6805/2774122776","state":["exists","up"]},{"osd":2,"uuid":"a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6801","nonce":2836920513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6803","nonce":2836920513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6807","nonce":2836920513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6805","nonce":2836920513}]},"public_addr":"172.21.15.203:6801/2836920513","cluster_addr":"172.21.15.203:6803/2836920513","heartbeat_back_addr":"172.21.15.203:6807/2836920513","heartbeat_front_addr":"172.21.15.203:6805/2836920513","state":["exists","up"]},{"osd":3,"uuid":"81409850-de26-4520-972c-31a716adf4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6811","nonce":680308620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6813","nonce":680308620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6817","nonce":680308620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6815","nonce":680308620}]},"public_addr":"172.21.15.69:6811/680308620","cluster_addr":"172.21.15.69:6813/680308620","heartbeat_back_addr":"172.21.15.69:6817/680308620","heartbeat_front_addr":"172.21.15.69:6815/680308620","state":["exists","up"]},{"osd":4,"uuid":"9aa3a6b0-cc63-4eae-8416-8ab630994985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6809","nonce":1071971048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6811","nonce":1071971048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6815","nonce":1071971048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6813","nonce":1071971048}]},"public_addr":"172.21.15.92:6809/1071971048","cluster_addr":"172.21.15.92:6811/1071971048","heartbeat_back_addr":"172.21.15.92:6815/1071971048","heartbeat_front_addr":"172.21.15.92:6813/1071971048","state":["exists","up"]},{"osd":5,"uuid":"f7fcde57-e280-494b-a45f-8fa007ed9ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6809","nonce":1404230851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6811","nonce":1404230851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6815","nonce":1404230851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6813","nonce":1404230851}]},"public_addr":"172.21.15.203:6809/1404230851","cluster_addr":"172.21.15.203:6811/1404230851","heartbeat_back_addr":"172.21.15.203:6815/1404230851","heartbeat_front_addr":"172.21.15.203:6813/1404230851","state":["exists","up"]},{"osd":6,"uuid":"86f1373a-3b39-4a7f-b14c-9bf8695c6b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6819","nonce":1213427819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6821","nonce":1213427819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6825","nonce":1213427819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6823","nonce":1213427819}]},"public_addr":"172.21.15.69:6819/1213427819","cluster_addr":"172.21.15.69:6821/1213427819","heartbeat_back_addr":"172.21.15.69:6825/1213427819","heartbeat_front_addr":"172.21.15.69:6823/1213427819","state":["exists","up"]},{"osd":7,"uuid":"e790fbf1-3e34-4950-bdfa-cf1adbd451c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6817","nonce":4274774582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6819","nonce":4274774582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6823","nonce":4274774582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6821","nonce":4274774582}]},"public_addr":"172.21.15.92:6817/4274774582","cluster_addr":"172.21.15.92:6819/4274774582","heartbeat_back_addr":"172.21.15.92:6823/4274774582","heartbeat_front_addr":"172.21.15.92:6821/4274774582","state":["exists","up"]},{"osd":8,"uuid":"65019fee-6b18-4d13-841a-2e3acb51f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6817","nonce":2480959249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6819","nonce":2480959249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6823","nonce":2480959249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6821","nonce":2480959249}]},"public_addr":"172.21.15.203:6817/2480959249","cluster_addr":"172.21.15.203:6819/2480959249","heartbeat_back_addr":"172.21.15.203:6823/2480959249","heartbeat_front_addr":"172.21.15.203:6821/2480959249","state":["exists","up"]},{"osd":9,"uuid":"b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6827","nonce":2649966866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6829","nonce":2649966866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6833","nonce":2649966866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6831","nonce":2649966866}]},"public_addr":"172.21.15.69:6827/2649966866","cluster_addr":"172.21.15.69:6829/2649966866","heartbeat_back_addr":"172.21.15.69:6833/2649966866","heartbeat_front_addr":"172.21.15.69:6831/2649966866","state":["exists","up"]},{"osd":10,"uuid":"45287823-f7ea-431f-ac01-a72762b01a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6825","nonce":3650822776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6827","nonce":3650822776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6831","nonce":3650822776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6829","nonce":3650822776}]},"public_addr":"172.21.15.92:6825/3650822776","cluster_addr":"172.21.15.92:6827/3650822776","heartbeat_back_addr":"172.21.15.92:6831/3650822776","heartbeat_front_addr":"172.21.15.92:6829/3650822776","state":["exists","up"]},{"osd":11,"uuid":"2f3a10f9-2414-4151-b1cf-3db68b2a66fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6825","nonce":2590258806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6827","nonce":2590258806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6831","nonce":2590258806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6829","nonce":2590258806}]},"public_addr":"172.21.15.203:6825/2590258806","cluster_addr":"172.21.15.203:6827/2590258806","heartbeat_back_addr":"172.21.15.203:6831/2590258806","heartbeat_front_addr":"172.21.15.203:6829/2590258806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:07:50.047712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:08:25.223293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:01.269713+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:38.679607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:16.161314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:53.323450+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:11:31.930106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:10.173015+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:48.056752+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:13:25.780142+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:03.705208+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:41.267371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/151981233":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/3776172313":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/1288620257":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/2718114316":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/1655882616":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/4183332474":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/2806878946":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/2718114316":"2024-05-15T15:05:41.383453+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:14:49.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.906+0000 7f760f200700 1 -- 172.21.15.69:0/520535701 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f75f40b2900 msgr2=0x7f75f40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:49.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.906+0000 7f760f200700 1 --2- 172.21.15.69:0/520535701 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f75f40b2900 0x7f75f40b4e10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f7600009990 tx=0x7f7600005ab0 comp rx=0 tx=0).stop 2024-05-14T15:14:49.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.906+0000 7f760f200700 1 -- 172.21.15.69:0/520535701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7610108d50 msgr2=0x7f76101a0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:49.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.906+0000 7f760f200700 1 --2- 172.21.15.69:0/520535701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7610108d50 0x7f76101a0d20 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f75fc00c9e0 tx=0x7f75fc00cda0 comp rx=0 tx=0).stop 2024-05-14T15:14:49.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.906+0000 7f760f200700 1 -- 172.21.15.69:0/520535701 shutdown_connections 2024-05-14T15:14:49.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.906+0000 7f760f200700 1 --2- 172.21.15.69:0/520535701 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f75f40b2900 0x7f75f40b4e10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:49.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.906+0000 7f760f200700 1 --2- 172.21.15.69:0/520535701 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f76101096a0 0x7f761019aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:49.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.906+0000 7f760f200700 1 --2- 172.21.15.69:0/520535701 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7610104420 0x7f76101a07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:49.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.906+0000 7f760f200700 1 --2- 172.21.15.69:0/520535701 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7610108d50 0x7f76101a0d20 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:49.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.906+0000 7f760f200700 1 -- 172.21.15.69:0/520535701 >> 172.21.15.69:0/520535701 conn(0x7f761007acb0 msgr2=0x7f76101018e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:14:49.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.906+0000 7f760f200700 1 -- 172.21.15.69:0/520535701 shutdown_connections 2024-05-14T15:14:49.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:49.907+0000 7f760f200700 1 -- 172.21.15.69:0/520535701 wait complete. 2024-05-14T15:14:50.690 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T15:09:03.561841+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-05-14T15:14:50.690 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-14T15:14:50.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:50 smithi069 ceph-mon[31270]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:50.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:50 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/520535701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:14:51.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:50 smithi203 ceph-mon[34567]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:51.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:50 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/520535701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:14:51.122 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:14:51.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:50 smithi092 ceph-mon[34729]: pgmap v337: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:51.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:50 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/520535701' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:14:52.883 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:52 smithi069 ceph-mon[31270]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:53.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:52 smithi203 ceph-mon[34567]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:53.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:52 smithi092 ceph-mon[34729]: pgmap v338: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:53.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.529+0000 7f12d6000700 1 -- 172.21.15.69:0/1457337005 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12d0102ae0 msgr2=0x7f12d0102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:53.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.529+0000 7f12d6000700 1 --2- 172.21.15.69:0/1457337005 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12d0102ae0 0x7f12d0102ef0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f12c00099c0 tx=0x7f12c0009cd0 comp rx=0 tx=0).stop 2024-05-14T15:14:53.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.529+0000 7f12d6000700 1 -- 172.21.15.69:0/1457337005 shutdown_connections 2024-05-14T15:14:53.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.529+0000 7f12d6000700 1 --2- 172.21.15.69:0/1457337005 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12d0102ae0 0x7f12d0102ef0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:53.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.529+0000 7f12d6000700 1 --2- 172.21.15.69:0/1457337005 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12d0109850 0x7f12d01111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:53.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.529+0000 7f12d6000700 1 --2- 172.21.15.69:0/1457337005 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d0108f00 0x7f12d0109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:53.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.529+0000 7f12d6000700 1 -- 172.21.15.69:0/1457337005 >> 172.21.15.69:0/1457337005 conn(0x7f12d00fe500 msgr2=0x7f12d0100950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:14:53.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.529+0000 7f12d6000700 1 -- 172.21.15.69:0/1457337005 shutdown_connections 2024-05-14T15:14:53.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.529+0000 7f12d6000700 1 -- 172.21.15.69:0/1457337005 wait complete. 2024-05-14T15:14:53.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.530+0000 7f12d6000700 1 Processor -- start 2024-05-14T15:14:53.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.530+0000 7f12d6000700 1 -- start start 2024-05-14T15:14:53.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.530+0000 7f12d6000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12d0102ae0 0x7f12d019cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:53.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.530+0000 7f12d6000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12d0108f00 0x7f12d019d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:53.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.530+0000 7f12d6000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d0109850 0x7f12d01a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:53.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.531+0000 7f12d6000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f12d0114330 con 0x7f12d0102ae0 2024-05-14T15:14:53.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.531+0000 7f12d6000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01141b0 con 0x7f12d0109850 2024-05-14T15:14:53.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.531+0000 7f12d6000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f12d01144b0 con 0x7f12d0108f00 2024-05-14T15:14:53.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.531+0000 7f12cf400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12d0102ae0 0x7f12d019cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:53.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.531+0000 7f12cf400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12d0102ae0 0x7f12d019cf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44198/0 (socket says 172.21.15.69:44198) 2024-05-14T15:14:53.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.531+0000 7f12cf400700 1 -- 172.21.15.69:0/927161339 learned_addr learned my addr 172.21.15.69:0/927161339 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:14:53.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.531+0000 7f12cfe00700 1 --2- 172.21.15.69:0/927161339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d0109850 0x7f12d01a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:53.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.531+0000 7f12cea00700 1 --2- 172.21.15.69:0/927161339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12d0108f00 0x7f12d019d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:53.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.531+0000 7f12cf400700 1 -- 172.21.15.69:0/927161339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12d0108f00 msgr2=0x7f12d019d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:53.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.531+0000 7f12cf400700 1 --2- 172.21.15.69:0/927161339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12d0108f00 0x7f12d019d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:53.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.531+0000 7f12cf400700 1 -- 172.21.15.69:0/927161339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d0109850 msgr2=0x7f12d01a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:53.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.531+0000 7f12cf400700 1 --2- 172.21.15.69:0/927161339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d0109850 0x7f12d01a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:53.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.531+0000 7f12cf400700 1 -- 172.21.15.69:0/927161339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d01a1d80 con 0x7f12d0102ae0 2024-05-14T15:14:53.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.531+0000 7f12cea00700 1 --2- 172.21.15.69:0/927161339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12d0108f00 0x7f12d019d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:14:53.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.532+0000 7f12cf400700 1 --2- 172.21.15.69:0/927161339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12d0102ae0 0x7f12d019cf60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f12c0000c00 tx=0x7f12c000f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:14:53.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.532+0000 7f12c7e00700 1 -- 172.21.15.69:0/927161339 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c000f940 con 0x7f12d0102ae0 2024-05-14T15:14:53.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.532+0000 7f12c7e00700 1 -- 172.21.15.69:0/927161339 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f12c0004830 con 0x7f12d0102ae0 2024-05-14T15:14:53.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.532+0000 7f12c7e00700 1 -- 172.21.15.69:0/927161339 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c00054b0 con 0x7f12d0102ae0 2024-05-14T15:14:53.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.532+0000 7f12d6000700 1 -- 172.21.15.69:0/927161339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d01a2010 con 0x7f12d0102ae0 2024-05-14T15:14:53.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.532+0000 7f12d6000700 1 -- 172.21.15.69:0/927161339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d01a24e0 con 0x7f12d0102ae0 2024-05-14T15:14:53.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.533+0000 7f12d6000700 1 -- 172.21.15.69:0/927161339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12d00512c0 con 0x7f12d0102ae0 2024-05-14T15:14:53.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.536+0000 7f12c7e00700 1 -- 172.21.15.69:0/927161339 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f12c0029060 con 0x7f12d0102ae0 2024-05-14T15:14:53.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.538+0000 7f12c7e00700 1 --2- 172.21.15.69:0/927161339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f12b40b2900 0x7f12b40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:53.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.538+0000 7f12c7e00700 1 -- 172.21.15.69:0/927161339 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f12c00e2c40 con 0x7f12d0102ae0 2024-05-14T15:14:53.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.538+0000 7f12cea00700 1 --2- 172.21.15.69:0/927161339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f12b40b2900 0x7f12b40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:53.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.539+0000 7f12cea00700 1 --2- 172.21.15.69:0/927161339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f12b40b2900 0x7f12b40b4e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12bc005fd0 tx=0x7f12bc005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:14:53.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.540+0000 7f12c7e00700 1 -- 172.21.15.69:0/927161339 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f12c0013070 con 0x7f12d0102ae0 2024-05-14T15:14:53.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.773+0000 7f12d6000700 1 -- 172.21.15.69:0/927161339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f12d01a9a40 con 0x7f12d0102ae0 2024-05-14T15:14:53.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.774+0000 7f12c7e00700 1 -- 172.21.15.69:0/927161339 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) ==== 93+0+10 (secure 0 0 0) 0x7f12c00aadf0 con 0x7f12d0102ae0 2024-05-14T15:14:53.773 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-05-14T15:14:53.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.777+0000 7f12d6000700 1 -- 172.21.15.69:0/927161339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f12b40b2900 msgr2=0x7f12b40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:53.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.777+0000 7f12d6000700 1 --2- 172.21.15.69:0/927161339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f12b40b2900 0x7f12b40b4e10 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f12bc005fd0 tx=0x7f12bc005ee0 comp rx=0 tx=0).stop 2024-05-14T15:14:53.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.777+0000 7f12d6000700 1 -- 172.21.15.69:0/927161339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12d0102ae0 msgr2=0x7f12d019cf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:53.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.777+0000 7f12d6000700 1 --2- 172.21.15.69:0/927161339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12d0102ae0 0x7f12d019cf60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f12c0000c00 tx=0x7f12c000f510 comp rx=0 tx=0).stop 2024-05-14T15:14:53.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.777+0000 7f12d6000700 1 -- 172.21.15.69:0/927161339 shutdown_connections 2024-05-14T15:14:53.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.777+0000 7f12d6000700 1 --2- 172.21.15.69:0/927161339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f12d0102ae0 0x7f12d019cf60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:53.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.777+0000 7f12d6000700 1 --2- 172.21.15.69:0/927161339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f12b40b2900 0x7f12b40b4e10 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:53.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.777+0000 7f12d6000700 1 --2- 172.21.15.69:0/927161339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f12d0109850 0x7f12d01a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:53.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.777+0000 7f12d6000700 1 --2- 172.21.15.69:0/927161339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f12d0108f00 0x7f12d019d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:53.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.777+0000 7f12d6000700 1 -- 172.21.15.69:0/927161339 >> 172.21.15.69:0/927161339 conn(0x7f12d00fe500 msgr2=0x7f12d010a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:14:53.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.777+0000 7f12d6000700 1 -- 172.21.15.69:0/927161339 shutdown_connections 2024-05-14T15:14:53.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:14:53.777+0000 7f12d6000700 1 -- 172.21.15.69:0/927161339 wait complete. 2024-05-14T15:14:54.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:53 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/927161339' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T15:14:54.132 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:53 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/927161339' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T15:14:54.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:53 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/927161339' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T15:14:54.599 INFO:tasks.cephadm:Adding mds.a on smithi069 2024-05-14T15:14:54.600 INFO:tasks.cephadm:Adding mds.d on smithi069 2024-05-14T15:14:54.600 INFO:tasks.cephadm:Adding mds.g on smithi069 2024-05-14T15:14:54.600 INFO:tasks.cephadm:Adding mds.j on smithi069 2024-05-14T15:14:54.600 INFO:tasks.cephadm:Adding mds.b on smithi092 2024-05-14T15:14:54.600 INFO:tasks.cephadm:Adding mds.e on smithi092 2024-05-14T15:14:54.600 INFO:tasks.cephadm:Adding mds.h on smithi092 2024-05-14T15:14:54.600 INFO:tasks.cephadm:Adding mds.k on smithi092 2024-05-14T15:14:54.600 INFO:tasks.cephadm:Adding mds.c on smithi203 2024-05-14T15:14:54.600 INFO:tasks.cephadm:Adding mds.f on smithi203 2024-05-14T15:14:54.600 INFO:tasks.cephadm:Adding mds.i on smithi203 2024-05-14T15:14:54.600 INFO:tasks.cephadm:Adding mds.l on smithi203 2024-05-14T15:14:54.600 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph orch apply mds all '12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l' 2024-05-14T15:14:55.053 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:14:55.091 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:54 smithi203 ceph-mon[34567]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:55.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:54 smithi092 ceph-mon[34729]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:55.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:54 smithi069 ceph-mon[31270]: pgmap v339: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:57.030 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:56 smithi203 ceph-mon[34567]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:57.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:56 smithi092 ceph-mon[34729]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:57.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:56 smithi069 ceph-mon[31270]: pgmap v340: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:57.383 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.384+0000 7f429bc00700 1 -- 172.21.15.203:0/2833503806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f429410ab10 msgr2=0x7f429410af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:57.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.384+0000 7f429bc00700 1 --2- 172.21.15.203:0/2833503806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f429410ab10 0x7f429410af20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f4288009990 tx=0x7f4288009ca0 comp rx=0 tx=0).stop 2024-05-14T15:14:57.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.384+0000 7f429bc00700 1 -- 172.21.15.203:0/2833503806 shutdown_connections 2024-05-14T15:14:57.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.384+0000 7f429bc00700 1 --2- 172.21.15.203:0/2833503806 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f429410c420 0x7f4294112cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:57.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.384+0000 7f429bc00700 1 --2- 172.21.15.203:0/2833503806 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f429410ab10 0x7f429410af20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:57.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.384+0000 7f429bc00700 1 --2- 172.21.15.203:0/2833503806 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f429410ba80 0x7f429410be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:57.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.384+0000 7f429bc00700 1 -- 172.21.15.203:0/2833503806 >> 172.21.15.203:0/2833503806 conn(0x7f42940799c0 msgr2=0x7f429407be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:14:57.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.384+0000 7f429bc00700 1 -- 172.21.15.203:0/2833503806 shutdown_connections 2024-05-14T15:14:57.384 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.384+0000 7f429bc00700 1 -- 172.21.15.203:0/2833503806 wait complete. 2024-05-14T15:14:57.386 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.386+0000 7f429bc00700 1 Processor -- start 2024-05-14T15:14:57.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.386+0000 7f429bc00700 1 -- start start 2024-05-14T15:14:57.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.386+0000 7f429bc00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f429410ab10 0x7f42941a0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:57.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.386+0000 7f429bc00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f429410ba80 0x7f42941a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:57.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.386+0000 7f429bc00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f429410c420 0x7f42941a8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:57.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.386+0000 7f429bc00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4294116290 con 0x7f429410ba80 2024-05-14T15:14:57.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.386+0000 7f429bc00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4294116110 con 0x7f429410c420 2024-05-14T15:14:57.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.386+0000 7f429bc00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4294116410 con 0x7f429410ab10 2024-05-14T15:14:57.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.386+0000 7f4299200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f429410ab10 0x7f42941a0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:57.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.386+0000 7f4299200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f429410ab10 0x7f42941a0e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.203:52066/0 (socket says 172.21.15.203:52066) 2024-05-14T15:14:57.387 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.386+0000 7f4299200700 1 -- 172.21.15.203:0/4261135140 learned_addr learned my addr 172.21.15.203:0/4261135140 (peer_addr_for_me v2:172.21.15.203:0/0) 2024-05-14T15:14:57.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.387+0000 7f4293e00700 1 --2- 172.21.15.203:0/4261135140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f429410ba80 0x7f42941a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:57.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.387+0000 7f4299200700 1 -- 172.21.15.203:0/4261135140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f429410c420 msgr2=0x7f42941a8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:57.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.387+0000 7f4299c00700 1 --2- 172.21.15.203:0/4261135140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f429410c420 0x7f42941a8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:57.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.387+0000 7f4299200700 1 --2- 172.21.15.203:0/4261135140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f429410c420 0x7f42941a8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:57.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.387+0000 7f4299200700 1 -- 172.21.15.203:0/4261135140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f429410ba80 msgr2=0x7f42941a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:57.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.387+0000 7f4299200700 1 --2- 172.21.15.203:0/4261135140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f429410ba80 0x7f42941a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:57.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.387+0000 7f4299200700 1 -- 172.21.15.203:0/4261135140 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42941a89a0 con 0x7f429410ab10 2024-05-14T15:14:57.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.387+0000 7f4293e00700 1 --2- 172.21.15.203:0/4261135140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f429410ba80 0x7f42941a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:14:57.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.387+0000 7f4299200700 1 --2- 172.21.15.203:0/4261135140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f429410ab10 0x7f42941a0e40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4288006010 tx=0x7f4288009510 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:14:57.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.388+0000 7f4291600700 1 -- 172.21.15.203:0/4261135140 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4288026070 con 0x7f429410ab10 2024-05-14T15:14:57.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.388+0000 7f429bc00700 1 -- 172.21.15.203:0/4261135140 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42941a8c30 con 0x7f429410ab10 2024-05-14T15:14:57.388 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.388+0000 7f4291600700 1 -- 172.21.15.203:0/4261135140 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42880040a0 con 0x7f429410ab10 2024-05-14T15:14:57.389 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.388+0000 7f4291600700 1 -- 172.21.15.203:0/4261135140 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f428800fca0 con 0x7f429410ab10 2024-05-14T15:14:57.389 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.388+0000 7f429bc00700 1 -- 172.21.15.203:0/4261135140 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42941a90e0 con 0x7f429410ab10 2024-05-14T15:14:57.389 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.389+0000 7f429bc00700 1 -- 172.21.15.203:0/4261135140 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42940512c0 con 0x7f429410ab10 2024-05-14T15:14:57.390 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.391+0000 7f4291600700 1 -- 172.21.15.203:0/4261135140 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f4288029070 con 0x7f429410ab10 2024-05-14T15:14:57.392 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.394+0000 7f4291600700 1 --2- 172.21.15.203:0/4261135140 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f427c0b2880 0x7f427c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:14:57.392 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.394+0000 7f4291600700 1 -- 172.21.15.203:0/4261135140 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f42880e2e40 con 0x7f429410ab10 2024-05-14T15:14:57.393 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.395+0000 7f4293e00700 1 --2- 172.21.15.203:0/4261135140 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f427c0b2880 0x7f427c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:14:57.394 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.396+0000 7f4293e00700 1 --2- 172.21.15.203:0/4261135140 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f427c0b2880 0x7f427c0b4d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4280005fd0 tx=0x7f4280005f00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:14:57.395 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.397+0000 7f4291600700 1 -- 172.21.15.203:0/4261135140 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4288013070 con 0x7f429410ab10 2024-05-14T15:14:57.640 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.641+0000 7f429bc00700 1 -- 172.21.15.203:0/4261135140 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l", "target": ["mon-mgr", ""]}) -- 0x7f4294063ec0 con 0x7f427c0b2880 2024-05-14T15:14:57.659 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.660+0000 7f4291600700 1 -- 172.21.15.203:0/4261135140 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f4294063ec0 con 0x7f427c0b2880 2024-05-14T15:14:57.659 INFO:teuthology.orchestra.run.smithi203.stdout:Scheduled mds.all update... 2024-05-14T15:14:57.663 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.664+0000 7f429bc00700 1 -- 172.21.15.203:0/4261135140 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f427c0b2880 msgr2=0x7f427c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:57.663 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.664+0000 7f429bc00700 1 --2- 172.21.15.203:0/4261135140 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f427c0b2880 0x7f427c0b4d90 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4280005fd0 tx=0x7f4280005f00 comp rx=0 tx=0).stop 2024-05-14T15:14:57.663 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.664+0000 7f429bc00700 1 -- 172.21.15.203:0/4261135140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f429410ab10 msgr2=0x7f42941a0e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:14:57.664 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.664+0000 7f429bc00700 1 --2- 172.21.15.203:0/4261135140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f429410ab10 0x7f42941a0e40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f4288006010 tx=0x7f4288009510 comp rx=0 tx=0).stop 2024-05-14T15:14:57.664 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.664+0000 7f429bc00700 1 -- 172.21.15.203:0/4261135140 shutdown_connections 2024-05-14T15:14:57.664 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.664+0000 7f429bc00700 1 --2- 172.21.15.203:0/4261135140 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f427c0b2880 0x7f427c0b4d90 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:57.664 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.664+0000 7f429bc00700 1 --2- 172.21.15.203:0/4261135140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f429410c420 0x7f42941a8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:57.664 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.664+0000 7f429bc00700 1 --2- 172.21.15.203:0/4261135140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f429410ab10 0x7f42941a0e40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:57.664 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.664+0000 7f429bc00700 1 --2- 172.21.15.203:0/4261135140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f429410ba80 0x7f42941a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:14:57.664 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.665+0000 7f429bc00700 1 -- 172.21.15.203:0/4261135140 >> 172.21.15.203:0/4261135140 conn(0x7f42940799c0 msgr2=0x7f429410ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:14:57.664 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.665+0000 7f429bc00700 1 -- 172.21.15.203:0/4261135140 shutdown_connections 2024-05-14T15:14:57.664 INFO:teuthology.orchestra.run.smithi203.stderr:2024-05-14T15:14:57.665+0000 7f429bc00700 1 -- 172.21.15.203:0/4261135140 wait complete. 2024-05-14T15:14:58.546 DEBUG:teuthology.orchestra.run.smithi069:mds.a> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.a.service 2024-05-14T15:14:58.554 DEBUG:teuthology.orchestra.run.smithi069:mds.d> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.d.service 2024-05-14T15:14:58.600 DEBUG:teuthology.orchestra.run.smithi069:mds.g> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.g.service 2024-05-14T15:14:58.651 DEBUG:teuthology.orchestra.run.smithi069:mds.j> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.j.service 2024-05-14T15:14:58.697 DEBUG:teuthology.orchestra.run.smithi092:mds.b> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.b.service 2024-05-14T15:14:58.705 DEBUG:teuthology.orchestra.run.smithi092:mds.e> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.e.service 2024-05-14T15:14:58.751 DEBUG:teuthology.orchestra.run.smithi092:mds.h> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.h.service 2024-05-14T15:14:58.797 DEBUG:teuthology.orchestra.run.smithi092:mds.k> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.k.service 2024-05-14T15:14:58.811 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:58 smithi203 ceph-mon[34567]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:58.811 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:58 smithi203 ceph-mon[34567]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:14:58.811 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:58 smithi203 ceph-mon[34567]: Saving service mds.all spec with placement smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l;count:12 2024-05-14T15:14:58.812 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:58 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:58.812 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:58 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:14:58.812 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:58 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:58.812 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:58 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:14:58.812 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:58 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:58.812 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:58 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:14:58.812 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:58 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:14:58.812 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:58 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:58.812 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:14:58 smithi203 ceph-mon[34567]: Deploying daemon mds.l on smithi203 2024-05-14T15:14:58.842 DEBUG:teuthology.orchestra.run.smithi203:mds.c> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.c.service 2024-05-14T15:14:58.851 DEBUG:teuthology.orchestra.run.smithi203:mds.f> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.f.service 2024-05-14T15:14:58.896 DEBUG:teuthology.orchestra.run.smithi203:mds.i> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.i.service 2024-05-14T15:14:58.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:58 smithi092 ceph-mon[34729]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:58.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:58 smithi092 ceph-mon[34729]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:14:58.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:58 smithi092 ceph-mon[34729]: Saving service mds.all spec with placement smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l;count:12 2024-05-14T15:14:58.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:58 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:58.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:58 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:14:58.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:58 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:58.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:58 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:14:58.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:58 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:58.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:58 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:14:58.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:58 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:14:58.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:58 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:58.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:14:58 smithi092 ceph-mon[34729]: Deploying daemon mds.l on smithi203 2024-05-14T15:14:58.942 DEBUG:teuthology.orchestra.run.smithi203:mds.l> sudo journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.l.service 2024-05-14T15:14:58.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:58 smithi069 ceph-mon[31270]: pgmap v341: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:14:58.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:58 smithi069 ceph-mon[31270]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:14:58.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:58 smithi069 ceph-mon[31270]: Saving service mds.all spec with placement smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l;count:12 2024-05-14T15:14:58.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:58.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:14:58.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:58.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:14:58.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:14:58.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:14:58.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:14:58.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:14:58.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:14:58 smithi069 ceph-mon[31270]: Deploying daemon mds.l on smithi203 2024-05-14T15:14:58.987 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-05-14T15:14:58.988 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:14:59.409 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:15:00.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:00 smithi092 ceph-mon[34729]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:00.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:00 smithi069 ceph-mon[31270]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:01.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:00 smithi203 ceph-mon[34567]: pgmap v342: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:01.450 INFO:journalctl@ceph.mds.l.smithi203.stdout:May 14 15:15:01 smithi203 systemd[1]: Starting Ceph mds.l for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:15:01.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.750+0000 7fc6bde00700 1 -- 172.21.15.69:0/3007714208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6b810e8f0 msgr2=0x7fc6b8110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:01.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.750+0000 7fc6bde00700 1 --2- 172.21.15.69:0/3007714208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6b810e8f0 0x7fc6b8110dd0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc6b000b0a0 tx=0x7fc6b000b3b0 comp rx=0 tx=0).stop 2024-05-14T15:15:01.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.750+0000 7fc6bde00700 1 -- 172.21.15.69:0/3007714208 shutdown_connections 2024-05-14T15:15:01.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.750+0000 7fc6bde00700 1 --2- 172.21.15.69:0/3007714208 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6b810e8f0 0x7fc6b8110dd0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:01.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.750+0000 7fc6bde00700 1 --2- 172.21.15.69:0/3007714208 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6b8105480 0x7fc6b8105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:01.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.750+0000 7fc6bde00700 1 --2- 172.21.15.69:0/3007714208 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b8105dd0 0x7fc6b810e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:01.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.750+0000 7fc6bde00700 1 -- 172.21.15.69:0/3007714208 >> 172.21.15.69:0/3007714208 conn(0x7fc6b80fef30 msgr2=0x7fc6b8101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:01.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.750+0000 7fc6bde00700 1 -- 172.21.15.69:0/3007714208 shutdown_connections 2024-05-14T15:15:01.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.750+0000 7fc6bde00700 1 -- 172.21.15.69:0/3007714208 wait complete. 2024-05-14T15:15:01.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.752+0000 7fc6bde00700 1 Processor -- start 2024-05-14T15:15:01.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.752+0000 7fc6bde00700 1 -- start start 2024-05-14T15:15:01.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.752+0000 7fc6bde00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b8105480 0x7fc6b819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:01.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.752+0000 7fc6bde00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6b8105dd0 0x7fc6b819d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:01.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.752+0000 7fc6bde00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6b810e8f0 0x7fc6b81a1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:01.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.752+0000 7fc6bde00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b8114320 con 0x7fc6b8105dd0 2024-05-14T15:15:01.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.752+0000 7fc6bde00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b81141a0 con 0x7fc6b8105480 2024-05-14T15:15:01.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.752+0000 7fc6bde00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc6b81144a0 con 0x7fc6b810e8f0 2024-05-14T15:15:01.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.752+0000 7fc6ae000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6b8105dd0 0x7fc6b819d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:01.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.752+0000 7fc6ae000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6b8105dd0 0x7fc6b819d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44222/0 (socket says 172.21.15.69:44222) 2024-05-14T15:15:01.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.752+0000 7fc6ae000700 1 -- 172.21.15.69:0/4165266195 learned_addr learned my addr 172.21.15.69:0/4165266195 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:15:01.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.753+0000 7fc6b6a00700 1 --2- 172.21.15.69:0/4165266195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b8105480 0x7fc6b819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:01.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.753+0000 7fc6b7400700 1 --2- 172.21.15.69:0/4165266195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6b810e8f0 0x7fc6b81a1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:01.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.753+0000 7fc6ae000700 1 -- 172.21.15.69:0/4165266195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6b810e8f0 msgr2=0x7fc6b81a1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:01.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.753+0000 7fc6ae000700 1 --2- 172.21.15.69:0/4165266195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6b810e8f0 0x7fc6b81a1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:01.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.753+0000 7fc6ae000700 1 -- 172.21.15.69:0/4165266195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b8105480 msgr2=0x7fc6b819cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:01.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.753+0000 7fc6ae000700 1 --2- 172.21.15.69:0/4165266195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b8105480 0x7fc6b819cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:01.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.753+0000 7fc6ae000700 1 -- 172.21.15.69:0/4165266195 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6b81a1de0 con 0x7fc6b8105dd0 2024-05-14T15:15:01.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.753+0000 7fc6ae000700 1 --2- 172.21.15.69:0/4165266195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6b8105dd0 0x7fc6b819d4b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000d950 tx=0x7fc6a000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:01.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.754+0000 7fc6bca00700 1 -- 172.21.15.69:0/4165266195 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0016070 con 0x7fc6b8105dd0 2024-05-14T15:15:01.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.754+0000 7fc6bca00700 1 -- 172.21.15.69:0/4165266195 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc6a0010460 con 0x7fc6b8105dd0 2024-05-14T15:15:01.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.754+0000 7fc6bde00700 1 -- 172.21.15.69:0/4165266195 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6b81a20d0 con 0x7fc6b8105dd0 2024-05-14T15:15:01.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.754+0000 7fc6bca00700 1 -- 172.21.15.69:0/4165266195 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6a000f620 con 0x7fc6b8105dd0 2024-05-14T15:15:01.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.754+0000 7fc6bde00700 1 -- 172.21.15.69:0/4165266195 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6b81a99f0 con 0x7fc6b8105dd0 2024-05-14T15:15:01.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.755+0000 7fc6bde00700 1 -- 172.21.15.69:0/4165266195 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6b80512c0 con 0x7fc6b8105dd0 2024-05-14T15:15:01.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.757+0000 7fc6bca00700 1 -- 172.21.15.69:0/4165266195 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc6a0019070 con 0x7fc6b8105dd0 2024-05-14T15:15:01.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.759+0000 7fc6bca00700 1 --2- 172.21.15.69:0/4165266195 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc69c0b2900 0x7fc69c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:01.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.759+0000 7fc6bca00700 1 -- 172.21.15.69:0/4165266195 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fc6a00e1910 con 0x7fc6b8105dd0 2024-05-14T15:15:01.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.759+0000 7fc6b6a00700 1 --2- 172.21.15.69:0/4165266195 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc69c0b2900 0x7fc69c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:01.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.760+0000 7fc6b6a00700 1 --2- 172.21.15.69:0/4165266195 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc69c0b2900 0x7fc69c0b4e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8005950 tx=0x7fc6a80058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:01.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:01.762+0000 7fc6bca00700 1 -- 172.21.15.69:0/4165266195 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc6a00a9a30 con 0x7fc6b8105dd0 2024-05-14T15:15:01.813 INFO:journalctl@ceph.mds.l.smithi203.stdout:May 14 15:15:01 smithi203 podman[64504]: 2024-05-14 15:15:01.361122547 +0000 UTC m=+0.038810089 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:15:01.813 INFO:journalctl@ceph.mds.l.smithi203.stdout:May 14 15:15:01 smithi203 podman[64504]: 2024-05-14 15:15:01.485241826 +0000 UTC m=+0.162929380 container create 0daa61d8b7f7ca7468d1f6128b87848b8ec3f4360eb742625e1fb23430bd242a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T15:15:01.813 INFO:journalctl@ceph.mds.l.smithi203.stdout:May 14 15:15:01 smithi203 podman[64504]: 2024-05-14 15:15:01.814923759 +0000 UTC m=+0.492611296 container init 0daa61d8b7f7ca7468d1f6128b87848b8ec3f4360eb742625e1fb23430bd242a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-l, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, ceph=True) 2024-05-14T15:15:02.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:02.041+0000 7fc6bde00700 1 -- 172.21.15.69:0/4165266195 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6b802e5f0 con 0x7fc6b8105dd0 2024-05-14T15:15:02.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:02.049+0000 7fc6bca00700 1 -- 172.21.15.69:0/4165266195 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1396 (secure 0 0 0) 0x7fc6a00a9330 con 0x7fc6b8105dd0 2024-05-14T15:15:02.048 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:15:02.048 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-14T15:15:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:02.052+0000 7fc6bde00700 1 -- 172.21.15.69:0/4165266195 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc69c0b2900 msgr2=0x7fc69c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:02.052+0000 7fc6bde00700 1 --2- 172.21.15.69:0/4165266195 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc69c0b2900 0x7fc69c0b4e10 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc6a8005950 tx=0x7fc6a80058e0 comp rx=0 tx=0).stop 2024-05-14T15:15:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:02.052+0000 7fc6bde00700 1 -- 172.21.15.69:0/4165266195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6b8105dd0 msgr2=0x7fc6b819d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:02.052+0000 7fc6bde00700 1 --2- 172.21.15.69:0/4165266195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6b8105dd0 0x7fc6b819d4b0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc6a000d950 tx=0x7fc6a000dd10 comp rx=0 tx=0).stop 2024-05-14T15:15:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:02.052+0000 7fc6bde00700 1 -- 172.21.15.69:0/4165266195 shutdown_connections 2024-05-14T15:15:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:02.052+0000 7fc6bde00700 1 --2- 172.21.15.69:0/4165266195 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc69c0b2900 0x7fc69c0b4e10 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:02.052+0000 7fc6bde00700 1 --2- 172.21.15.69:0/4165266195 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc6b810e8f0 0x7fc6b81a1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:02.052+0000 7fc6bde00700 1 --2- 172.21.15.69:0/4165266195 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc6b8105480 0x7fc6b819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:02.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:02.052+0000 7fc6bde00700 1 --2- 172.21.15.69:0/4165266195 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc6b8105dd0 0x7fc6b819d4b0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:02.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:02.052+0000 7fc6bde00700 1 -- 172.21.15.69:0/4165266195 >> 172.21.15.69:0/4165266195 conn(0x7fc6b80fef30 msgr2=0x7fc6b8103280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:02.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:02.052+0000 7fc6bde00700 1 -- 172.21.15.69:0/4165266195 shutdown_connections 2024-05-14T15:15:02.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:02.052+0000 7fc6bde00700 1 -- 172.21.15.69:0/4165266195 wait complete. 2024-05-14T15:15:02.052 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 2 2024-05-14T15:15:02.092 INFO:journalctl@ceph.mds.l.smithi203.stdout:May 14 15:15:01 smithi203 podman[64504]: 2024-05-14 15:15:01.825123406 +0000 UTC m=+0.502810943 container start 0daa61d8b7f7ca7468d1f6128b87848b8ec3f4360eb742625e1fb23430bd242a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-l, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T15:15:02.092 INFO:journalctl@ceph.mds.l.smithi203.stdout:May 14 15:15:01 smithi203 bash[64504]: 0daa61d8b7f7ca7468d1f6128b87848b8ec3f4360eb742625e1fb23430bd242a 2024-05-14T15:15:02.092 INFO:journalctl@ceph.mds.l.smithi203.stdout:May 14 15:15:01 smithi203 ceph-mds[64522]: -- 172.21.15.203:0/70531008 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55963ed71a40 con 0x55963edb9600 2024-05-14T15:15:02.092 INFO:journalctl@ceph.mds.l.smithi203.stdout:May 14 15:15:01 smithi203 systemd[1]: Started Ceph mds.l for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:15:02.092 INFO:journalctl@ceph.mds.l.smithi203.stdout:May 14 15:15:01 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-l[64518]: starting mds.l at 2024-05-14T15:15:03.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:02 smithi069 ceph-mon[31270]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:03.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:02 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.203:6832/3479394720,v1:172.21.15.203:6833/3479394720] up:boot 2024-05-14T15:15:03.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:02 smithi069 ceph-mon[31270]: fsmap 1 up:standby 2024-05-14T15:15:03.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-14T15:15:03.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:03.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:03.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:02 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/4165266195' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:03.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:03.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:03.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:03.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:02 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:03.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:02 smithi069 ceph-mon[31270]: Deploying daemon mds.k on smithi092 2024-05-14T15:15:03.331 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:02 smithi092 ceph-mon[34729]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:03.331 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:02 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.203:6832/3479394720,v1:172.21.15.203:6833/3479394720] up:boot 2024-05-14T15:15:03.331 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:02 smithi092 ceph-mon[34729]: fsmap 1 up:standby 2024-05-14T15:15:03.331 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-14T15:15:03.331 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:03.331 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:03.331 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:02 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/4165266195' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:03.332 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:03.332 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:03.332 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:03.332 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:02 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:03.332 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:02 smithi092 ceph-mon[34729]: Deploying daemon mds.k on smithi092 2024-05-14T15:15:03.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:02 smithi203 ceph-mon[34567]: pgmap v343: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:03.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:02 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.203:6832/3479394720,v1:172.21.15.203:6833/3479394720] up:boot 2024-05-14T15:15:03.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:02 smithi203 ceph-mon[34567]: fsmap 1 up:standby 2024-05-14T15:15:03.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-14T15:15:03.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:03.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:03.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:02 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/4165266195' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:03.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:03.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:03.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:03.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:02 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:03.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:02 smithi203 ceph-mon[34567]: Deploying daemon mds.k on smithi092 2024-05-14T15:15:04.929 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:15:05.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:04 smithi069 ceph-mon[31270]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:05.250 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:04 smithi092 ceph-mon[34729]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:05.341 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:04 smithi203 ceph-mon[34567]: pgmap v344: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:05.364 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:15:05.607 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:15:05 smithi092 systemd[1]: Starting Ceph mds.k for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:15:05.926 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:15:05 smithi092 podman[63605]: 2024-05-14 15:15:05.526601126 +0000 UTC m=+0.031982036 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:15:05.927 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:15:05 smithi092 podman[63605]: 2024-05-14 15:15:05.669105571 +0000 UTC m=+0.174486518 container create 0e121ec7b39a0b6ed0ba460af8990578d78c081e86fc4b6a7a87f23043c903d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-k, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.build-date=20240507) 2024-05-14T15:15:06.190 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:15:05 smithi092 podman[63605]: 2024-05-14 15:15:05.96548088 +0000 UTC m=+0.470861865 container init 0e121ec7b39a0b6ed0ba460af8990578d78c081e86fc4b6a7a87f23043c903d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-k, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True) 2024-05-14T15:15:06.190 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:15:05 smithi092 podman[63605]: 2024-05-14 15:15:05.975333754 +0000 UTC m=+0.480714721 container start 0e121ec7b39a0b6ed0ba460af8990578d78c081e86fc4b6a7a87f23043c903d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-k, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=) 2024-05-14T15:15:06.191 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:15:06 smithi092 bash[63605]: 0e121ec7b39a0b6ed0ba460af8990578d78c081e86fc4b6a7a87f23043c903d1 2024-05-14T15:15:06.191 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:15:06 smithi092 ceph-mds[63632]: -- 172.21.15.92:0/3970842622 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x559f3f9c64e0 con 0x559f3fa11600 2024-05-14T15:15:06.191 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:15:06 smithi092 ceph-mds[63632]: -- 172.21.15.92:0/3970842622 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559f3f9c9a40 con 0x559f3fa11600 2024-05-14T15:15:06.191 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:15:06 smithi092 systemd[1]: Started Ceph mds.k for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:15:06.191 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:15:06 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-k[63623]: starting mds.k at 2024-05-14T15:15:07.339 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:07 smithi069 ceph-mon[31270]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:07.339 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:07.339 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:07.339 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:07.339 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:07.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:07.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:07.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:07 smithi069 ceph-mon[31270]: Deploying daemon mds.j on smithi069 2024-05-14T15:15:07.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:07 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] up:boot 2024-05-14T15:15:07.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:07 smithi069 ceph-mon[31270]: fsmap 2 up:standby 2024-05-14T15:15:07.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-14T15:15:07.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:07 smithi092 ceph-mon[34729]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:07.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:07.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:07.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:07.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:07.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:07.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:07.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:07 smithi092 ceph-mon[34729]: Deploying daemon mds.j on smithi069 2024-05-14T15:15:07.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:07 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] up:boot 2024-05-14T15:15:07.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:07 smithi092 ceph-mon[34729]: fsmap 2 up:standby 2024-05-14T15:15:07.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-14T15:15:07.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:07 smithi203 ceph-mon[34567]: pgmap v345: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:07.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:07.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:07.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:07.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:07.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:07.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:07.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:07 smithi203 ceph-mon[34567]: Deploying daemon mds.j on smithi069 2024-05-14T15:15:07.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:07 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] up:boot 2024-05-14T15:15:07.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:07 smithi203 ceph-mon[34567]: fsmap 2 up:standby 2024-05-14T15:15:07.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-14T15:15:07.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.680+0000 7fd528800700 1 -- 172.21.15.69:0/1523677707 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd520110ba0 msgr2=0x7fd520113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:07.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.680+0000 7fd528800700 1 --2- 172.21.15.69:0/1523677707 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd520110ba0 0x7fd520113000 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00b0a0 tx=0x7fd51c00b3b0 comp rx=0 tx=0).stop 2024-05-14T15:15:07.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.680+0000 7fd528800700 1 -- 172.21.15.69:0/1523677707 shutdown_connections 2024-05-14T15:15:07.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.680+0000 7fd528800700 1 --2- 172.21.15.69:0/1523677707 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd520110ba0 0x7fd520113000 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:07.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.680+0000 7fd528800700 1 --2- 172.21.15.69:0/1523677707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd520075d30 0x7fd520076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:07.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.680+0000 7fd528800700 1 --2- 172.21.15.69:0/1523677707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd520076680 0x7fd520110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:07.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.680+0000 7fd528800700 1 -- 172.21.15.69:0/1523677707 >> 172.21.15.69:0/1523677707 conn(0x7fd520100040 msgr2=0x7fd520102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:07.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.680+0000 7fd528800700 1 -- 172.21.15.69:0/1523677707 shutdown_connections 2024-05-14T15:15:07.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.680+0000 7fd528800700 1 -- 172.21.15.69:0/1523677707 wait complete. 2024-05-14T15:15:07.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.681+0000 7fd528800700 1 Processor -- start 2024-05-14T15:15:07.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.681+0000 7fd528800700 1 -- start start 2024-05-14T15:15:07.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.682+0000 7fd528800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd520075d30 0x7fd52019cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:07.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.682+0000 7fd528800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd520076680 0x7fd52019d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:07.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.682+0000 7fd528800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd520110ba0 0x7fd5201a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:07.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.682+0000 7fd528800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd520116530 con 0x7fd520110ba0 2024-05-14T15:15:07.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.682+0000 7fd528800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd5201163b0 con 0x7fd520076680 2024-05-14T15:15:07.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.682+0000 7fd528800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd5201166b0 con 0x7fd520075d30 2024-05-14T15:15:07.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.682+0000 7fd526800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd520110ba0 0x7fd5201a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:07.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.682+0000 7fd526800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd520110ba0 0x7fd5201a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55366/0 (socket says 172.21.15.69:55366) 2024-05-14T15:15:07.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.682+0000 7fd526800700 1 -- 172.21.15.69:0/3118808692 learned_addr learned my addr 172.21.15.69:0/3118808692 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:15:07.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.682+0000 7fd525e00700 1 --2- 172.21.15.69:0/3118808692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd520075d30 0x7fd52019cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:07.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.682+0000 7fd525400700 1 --2- 172.21.15.69:0/3118808692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd520076680 0x7fd52019d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:07.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.682+0000 7fd526800700 1 -- 172.21.15.69:0/3118808692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd520075d30 msgr2=0x7fd52019cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:07.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.682+0000 7fd526800700 1 --2- 172.21.15.69:0/3118808692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd520075d30 0x7fd52019cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:07.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.682+0000 7fd526800700 1 -- 172.21.15.69:0/3118808692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd520076680 msgr2=0x7fd52019d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:07.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.682+0000 7fd526800700 1 --2- 172.21.15.69:0/3118808692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd520076680 0x7fd52019d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:07.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.682+0000 7fd526800700 1 -- 172.21.15.69:0/3118808692 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5201a1db0 con 0x7fd520110ba0 2024-05-14T15:15:07.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.683+0000 7fd526800700 1 --2- 172.21.15.69:0/3118808692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd520110ba0 0x7fd5201a1710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00b830 tx=0x7fd51c004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:07.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.683+0000 7fd51aa00700 1 -- 172.21.15.69:0/3118808692 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c021070 con 0x7fd520110ba0 2024-05-14T15:15:07.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.683+0000 7fd528800700 1 -- 172.21.15.69:0/3118808692 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5201a2040 con 0x7fd520110ba0 2024-05-14T15:15:07.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.683+0000 7fd51aa00700 1 -- 172.21.15.69:0/3118808692 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd51c007c80 con 0x7fd520110ba0 2024-05-14T15:15:07.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.683+0000 7fd528800700 1 -- 172.21.15.69:0/3118808692 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5201a2520 con 0x7fd520110ba0 2024-05-14T15:15:07.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.684+0000 7fd51aa00700 1 -- 172.21.15.69:0/3118808692 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd51c0075c0 con 0x7fd520110ba0 2024-05-14T15:15:07.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.685+0000 7fd528800700 1 -- 172.21.15.69:0/3118808692 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5200512c0 con 0x7fd520110ba0 2024-05-14T15:15:07.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.687+0000 7fd51aa00700 1 -- 172.21.15.69:0/3118808692 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fd51c024070 con 0x7fd520110ba0 2024-05-14T15:15:07.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.688+0000 7fd51aa00700 1 --2- 172.21.15.69:0/3118808692 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fd5080b2a20 0x7fd5080b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:07.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.689+0000 7fd51aa00700 1 -- 172.21.15.69:0/3118808692 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fd51c0e3690 con 0x7fd520110ba0 2024-05-14T15:15:07.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.689+0000 7fd525e00700 1 --2- 172.21.15.69:0/3118808692 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fd5080b2a20 0x7fd5080b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:07.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.689+0000 7fd525e00700 1 --2- 172.21.15.69:0/3118808692 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fd5080b2a20 0x7fd5080b4f30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd514005950 tx=0x7fd5140058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:07.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.691+0000 7fd51aa00700 1 -- 172.21.15.69:0/3118808692 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd51c02b020 con 0x7fd520110ba0 2024-05-14T15:15:07.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.979+0000 7fd528800700 1 -- 172.21.15.69:0/3118808692 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd52002e5f0 con 0x7fd520110ba0 2024-05-14T15:15:07.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.980+0000 7fd51aa00700 1 -- 172.21.15.69:0/3118808692 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+2221 (secure 0 0 0) 0x7fd51c0ab840 con 0x7fd520110ba0 2024-05-14T15:15:07.978 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:15:07.978 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34409,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-14T15:15:07.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.983+0000 7fd528800700 1 -- 172.21.15.69:0/3118808692 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fd5080b2a20 msgr2=0x7fd5080b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:07.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.983+0000 7fd528800700 1 --2- 172.21.15.69:0/3118808692 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fd5080b2a20 0x7fd5080b4f30 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd514005950 tx=0x7fd5140058e0 comp rx=0 tx=0).stop 2024-05-14T15:15:07.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.983+0000 7fd528800700 1 -- 172.21.15.69:0/3118808692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd520110ba0 msgr2=0x7fd5201a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:07.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.983+0000 7fd528800700 1 --2- 172.21.15.69:0/3118808692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd520110ba0 0x7fd5201a1710 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd51c00b830 tx=0x7fd51c004db0 comp rx=0 tx=0).stop 2024-05-14T15:15:07.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.983+0000 7fd528800700 1 -- 172.21.15.69:0/3118808692 shutdown_connections 2024-05-14T15:15:07.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.983+0000 7fd528800700 1 --2- 172.21.15.69:0/3118808692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd520110ba0 0x7fd5201a1710 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:07.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.983+0000 7fd528800700 1 --2- 172.21.15.69:0/3118808692 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fd5080b2a20 0x7fd5080b4f30 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:07.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.983+0000 7fd528800700 1 --2- 172.21.15.69:0/3118808692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd520075d30 0x7fd52019cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:07.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.983+0000 7fd528800700 1 --2- 172.21.15.69:0/3118808692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd520076680 0x7fd52019d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:07.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.983+0000 7fd528800700 1 -- 172.21.15.69:0/3118808692 >> 172.21.15.69:0/3118808692 conn(0x7fd520100040 msgr2=0x7fd5201006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:07.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.983+0000 7fd528800700 1 -- 172.21.15.69:0/3118808692 shutdown_connections 2024-05-14T15:15:07.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:07.983+0000 7fd528800700 1 -- 172.21.15.69:0/3118808692 wait complete. 2024-05-14T15:15:07.983 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 3 2024-05-14T15:15:08.434 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:08 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3118808692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:08.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:08 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3118808692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:08.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:08 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3118808692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:09.448 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:09 smithi069 ceph-mon[31270]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:09.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:09 smithi203 ceph-mon[34567]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:09.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:09 smithi092 ceph-mon[34729]: pgmap v346: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:10.698 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:15:10 smithi069 podman[68922]: 2024-05-14 15:15:10.511988107 +0000 UTC m=+0.198133919 container create e71b1e048153fe2997fda96c267e7fba244836da8eaef0d01ee4fbb97dd13f79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-j, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True) 2024-05-14T15:15:11.210 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:15:10 smithi069 podman[68922]: 2024-05-14 15:15:10.825145601 +0000 UTC m=+0.511291460 container init e71b1e048153fe2997fda96c267e7fba244836da8eaef0d01ee4fbb97dd13f79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-j, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True) 2024-05-14T15:15:11.211 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:15:10 smithi069 podman[68922]: 2024-05-14 15:15:10.834687196 +0000 UTC m=+0.520833015 container start e71b1e048153fe2997fda96c267e7fba244836da8eaef0d01ee4fbb97dd13f79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-j, ceph=True, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T15:15:11.211 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:15:10 smithi069 ceph-mds[68942]: -- 172.21.15.69:0/553686388 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5629fb281a40 con 0x5629fb2c9a80 2024-05-14T15:15:11.211 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:15:10 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-j[68938]: starting mds.j at 2024-05-14T15:15:11.211 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:15:10 smithi069 bash[68922]: e71b1e048153fe2997fda96c267e7fba244836da8eaef0d01ee4fbb97dd13f79 2024-05-14T15:15:11.211 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:15:10 smithi069 systemd[1]: Started Ceph mds.j for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:15:11.211 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:11 smithi069 ceph-mon[31270]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:11.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:11.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:11.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:11.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:11.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:11.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:11 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:11.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:11 smithi203 ceph-mon[34567]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:11.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:11.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:11.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:11.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:11.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:11.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:11 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:11.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:11 smithi092 ceph-mon[34729]: pgmap v347: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:11.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:11.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:11.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:11.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:11.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:11.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:11 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:11.909 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:15:12.526 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:12 smithi069 ceph-mon[31270]: Deploying daemon mds.d on smithi069 2024-05-14T15:15:12.526 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:12 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.69:6834/2193159926,v1:172.21.15.69:6835/2193159926] up:boot 2024-05-14T15:15:12.526 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:12 smithi069 ceph-mon[31270]: fsmap 3 up:standby 2024-05-14T15:15:12.526 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:12 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-14T15:15:12.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:12 smithi203 ceph-mon[34567]: Deploying daemon mds.d on smithi069 2024-05-14T15:15:12.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:12 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.69:6834/2193159926,v1:172.21.15.69:6835/2193159926] up:boot 2024-05-14T15:15:12.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:12 smithi203 ceph-mon[34567]: fsmap 3 up:standby 2024-05-14T15:15:12.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:12 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-14T15:15:12.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:12 smithi092 ceph-mon[34729]: Deploying daemon mds.d on smithi069 2024-05-14T15:15:12.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:12 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.69:6834/2193159926,v1:172.21.15.69:6835/2193159926] up:boot 2024-05-14T15:15:12.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:12 smithi092 ceph-mon[34729]: fsmap 3 up:standby 2024-05-14T15:15:12.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:12 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-14T15:15:13.334 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:15:13.488 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:13 smithi069 ceph-mon[31270]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:13.591 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:13 smithi203 ceph-mon[34567]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:13.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:13 smithi092 ceph-mon[34729]: pgmap v348: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:14.471 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:15:14 smithi069 systemd[1]: Starting Ceph mds.d for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:15:15.234 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:15:15 smithi069 podman[69319]: 2024-05-14 15:15:15.106681783 +0000 UTC m=+0.044642509 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:15:15.520 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:15 smithi069 ceph-mon[31270]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:15.520 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:15:15 smithi069 podman[69319]: 2024-05-14 15:15:15.235701143 +0000 UTC m=+0.173661910 container create 2638599ce9a6e0411394fc6863fee59ccab887c2c85794642e8fd28aa5af0223 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-d, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-14T15:15:15.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:15 smithi203 ceph-mon[34567]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:15.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:15 smithi092 ceph-mon[34729]: pgmap v349: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:15.871 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:15:15 smithi069 podman[69319]: 2024-05-14 15:15:15.74367039 +0000 UTC m=+0.681631125 container init 2638599ce9a6e0411394fc6863fee59ccab887c2c85794642e8fd28aa5af0223 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-d, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-14T15:15:15.871 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:15:15 smithi069 podman[69319]: 2024-05-14 15:15:15.753586217 +0000 UTC m=+0.691546975 container start 2638599ce9a6e0411394fc6863fee59ccab887c2c85794642e8fd28aa5af0223 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-d, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-14T15:15:16.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.115+0000 7f6546a00700 1 -- 172.21.15.69:0/3967885975 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6540105350 msgr2=0x7f6540105760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:16.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.115+0000 7f6546a00700 1 --2- 172.21.15.69:0/3967885975 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6540105350 0x7f6540105760 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f653400b0a0 tx=0x7f653400b3b0 comp rx=0 tx=0).stop 2024-05-14T15:15:16.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.115+0000 7f6546a00700 1 -- 172.21.15.69:0/3967885975 shutdown_connections 2024-05-14T15:15:16.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.115+0000 7f6546a00700 1 --2- 172.21.15.69:0/3967885975 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6540105350 0x7f6540105760 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:16.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.115+0000 7f6546a00700 1 --2- 172.21.15.69:0/3967885975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f654010e730 0x7f6540110c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:16.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.115+0000 7f6546a00700 1 --2- 172.21.15.69:0/3967885975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6540105ca0 0x7f654010e1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:16.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.115+0000 7f6546a00700 1 -- 172.21.15.69:0/3967885975 >> 172.21.15.69:0/3967885975 conn(0x7f6540078ac0 msgr2=0x7f6540078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:16.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.115+0000 7f6546a00700 1 -- 172.21.15.69:0/3967885975 shutdown_connections 2024-05-14T15:15:16.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.115+0000 7f6546a00700 1 -- 172.21.15.69:0/3967885975 wait complete. 2024-05-14T15:15:16.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.116+0000 7f6546a00700 1 Processor -- start 2024-05-14T15:15:16.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.116+0000 7f6546a00700 1 -- start start 2024-05-14T15:15:16.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.117+0000 7f6546a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6540105350 0x7f6540103040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:16.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.117+0000 7f6546a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6540105ca0 0x7f6540103580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:16.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.117+0000 7f6546a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f654010e730 0x7f6540103ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:16.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.117+0000 7f6546a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6540114200 con 0x7f654010e730 2024-05-14T15:15:16.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.117+0000 7f6546a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6540114080 con 0x7f6540105350 2024-05-14T15:15:16.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.117+0000 7f6546a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6540114380 con 0x7f6540105ca0 2024-05-14T15:15:16.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.117+0000 7f6546000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f654010e730 0x7f6540103ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:16.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.117+0000 7f6546000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f654010e730 0x7f6540103ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44060/0 (socket says 172.21.15.69:44060) 2024-05-14T15:15:16.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.117+0000 7f6546000700 1 -- 172.21.15.69:0/561287838 learned_addr learned my addr 172.21.15.69:0/561287838 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:15:16.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.117+0000 7f6545600700 1 --2- 172.21.15.69:0/561287838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6540105350 0x7f6540103040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:16.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.117+0000 7f6544c00700 1 --2- 172.21.15.69:0/561287838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6540105ca0 0x7f6540103580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:16.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.118+0000 7f6546000700 1 -- 172.21.15.69:0/561287838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6540105ca0 msgr2=0x7f6540103580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:16.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.118+0000 7f6546000700 1 --2- 172.21.15.69:0/561287838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6540105ca0 0x7f6540103580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:16.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.118+0000 7f6546000700 1 -- 172.21.15.69:0/561287838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6540105350 msgr2=0x7f6540103040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:16.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.118+0000 7f6546000700 1 --2- 172.21.15.69:0/561287838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6540105350 0x7f6540103040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:16.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.118+0000 7f6546000700 1 -- 172.21.15.69:0/561287838 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65401a9050 con 0x7f654010e730 2024-05-14T15:15:16.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.118+0000 7f6545600700 1 --2- 172.21.15.69:0/561287838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6540105350 0x7f6540103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:15:16.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.118+0000 7f6546000700 1 --2- 172.21.15.69:0/561287838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f654010e730 0x7f6540103ac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f653800b550 tx=0x7f653800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:16.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.119+0000 7f653e000700 1 -- 172.21.15.69:0/561287838 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538015020 con 0x7f654010e730 2024-05-14T15:15:16.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.119+0000 7f653e000700 1 -- 172.21.15.69:0/561287838 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6538011cc0 con 0x7f654010e730 2024-05-14T15:15:16.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.119+0000 7f6546a00700 1 -- 172.21.15.69:0/561287838 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65401a9340 con 0x7f654010e730 2024-05-14T15:15:16.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.119+0000 7f653e000700 1 -- 172.21.15.69:0/561287838 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6538010c70 con 0x7f654010e730 2024-05-14T15:15:16.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.119+0000 7f6546a00700 1 -- 172.21.15.69:0/561287838 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65401a9880 con 0x7f654010e730 2024-05-14T15:15:16.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.120+0000 7f6546a00700 1 -- 172.21.15.69:0/561287838 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65400512c0 con 0x7f654010e730 2024-05-14T15:15:16.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.124+0000 7f653e000700 1 -- 172.21.15.69:0/561287838 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6538018020 con 0x7f654010e730 2024-05-14T15:15:16.123 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:15:15 smithi069 ceph-mds[69361]: -- 172.21.15.69:0/1855193346 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5647e0eada40 con 0x5647e0ef5180 2024-05-14T15:15:16.123 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:15:15 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-d[69352]: starting mds.d at 2024-05-14T15:15:16.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.126+0000 7f653e000700 1 --2- 172.21.15.69:0/561287838 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f65280b2900 0x7f65280b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:16.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.126+0000 7f653e000700 1 -- 172.21.15.69:0/561287838 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f65380e1b10 con 0x7f654010e730 2024-05-14T15:15:16.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.126+0000 7f6545600700 1 --2- 172.21.15.69:0/561287838 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f65280b2900 0x7f65280b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:16.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.127+0000 7f6545600700 1 --2- 172.21.15.69:0/561287838 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f65280b2900 0x7f65280b4e10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6534009e60 tx=0x7f6534009880 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:16.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.129+0000 7f653e000700 1 -- 172.21.15.69:0/561287838 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f653801f020 con 0x7f654010e730 2024-05-14T15:15:16.429 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:15:16 smithi069 bash[69319]: 2638599ce9a6e0411394fc6863fee59ccab887c2c85794642e8fd28aa5af0223 2024-05-14T15:15:16.430 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:15:16 smithi069 systemd[1]: Started Ceph mds.d for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:15:16.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.429+0000 7f6546a00700 1 -- 172.21.15.69:0/561287838 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f654002e5f0 con 0x7f654010e730 2024-05-14T15:15:16.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.430+0000 7f653e000700 1 -- 172.21.15.69:0/561287838 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3871 (secure 0 0 0) 0x7f65380a9c30 con 0x7f654010e730 2024-05-14T15:15:16.431 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:15:16.431 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":5,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34409,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-14T15:15:16.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.434+0000 7f6546a00700 1 -- 172.21.15.69:0/561287838 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f65280b2900 msgr2=0x7f65280b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:16.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.434+0000 7f6546a00700 1 --2- 172.21.15.69:0/561287838 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f65280b2900 0x7f65280b4e10 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6534009e60 tx=0x7f6534009880 comp rx=0 tx=0).stop 2024-05-14T15:15:16.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.434+0000 7f6546a00700 1 -- 172.21.15.69:0/561287838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f654010e730 msgr2=0x7f6540103ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:16.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.434+0000 7f6546a00700 1 --2- 172.21.15.69:0/561287838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f654010e730 0x7f6540103ac0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f653800b550 tx=0x7f653800b910 comp rx=0 tx=0).stop 2024-05-14T15:15:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.434+0000 7f6546a00700 1 -- 172.21.15.69:0/561287838 shutdown_connections 2024-05-14T15:15:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.434+0000 7f6546a00700 1 --2- 172.21.15.69:0/561287838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f654010e730 0x7f6540103ac0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.434+0000 7f6546a00700 1 --2- 172.21.15.69:0/561287838 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f65280b2900 0x7f65280b4e10 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.434+0000 7f6546a00700 1 --2- 172.21.15.69:0/561287838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6540105350 0x7f6540103040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.434+0000 7f6546a00700 1 --2- 172.21.15.69:0/561287838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6540105ca0 0x7f6540103580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.434+0000 7f6546a00700 1 -- 172.21.15.69:0/561287838 >> 172.21.15.69:0/561287838 conn(0x7f6540078ac0 msgr2=0x7f65400fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.434+0000 7f6546a00700 1 -- 172.21.15.69:0/561287838 shutdown_connections 2024-05-14T15:15:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:16.434+0000 7f6546a00700 1 -- 172.21.15.69:0/561287838 wait complete. 2024-05-14T15:15:16.433 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 5 2024-05-14T15:15:17.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:17 smithi069 ceph-mon[31270]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:17.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:17 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.69:6836/2968592361,v1:172.21.15.69:6837/2968592361] up:boot 2024-05-14T15:15:17.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:17 smithi069 ceph-mon[31270]: fsmap 4 up:standby 2024-05-14T15:15:17.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-14T15:15:17.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:17.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:17.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:17.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:17.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:17.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:17 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:17.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:17 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/561287838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:17.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:17 smithi203 ceph-mon[34567]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:17.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:17 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.69:6836/2968592361,v1:172.21.15.69:6837/2968592361] up:boot 2024-05-14T15:15:17.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:17 smithi203 ceph-mon[34567]: fsmap 4 up:standby 2024-05-14T15:15:17.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-14T15:15:17.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:17.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:17.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:17.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:17.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:17.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:17 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:17.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:17 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/561287838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:17.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:17 smithi092 ceph-mon[34729]: pgmap v350: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:17.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:17 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.69:6836/2968592361,v1:172.21.15.69:6837/2968592361] up:boot 2024-05-14T15:15:17.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:17 smithi092 ceph-mon[34729]: fsmap 4 up:standby 2024-05-14T15:15:17.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-14T15:15:17.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:17.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:17.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:17.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:17.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:17.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:17 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:17.631 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:17 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/561287838' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:18.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:18 smithi203 ceph-mon[34567]: Deploying daemon mds.e on smithi092 2024-05-14T15:15:18.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:18 smithi092 ceph-mon[34729]: Deploying daemon mds.e on smithi092 2024-05-14T15:15:18.721 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:18 smithi069 ceph-mon[31270]: Deploying daemon mds.e on smithi092 2024-05-14T15:15:19.253 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:15:19.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:19 smithi203 ceph-mon[34567]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:19.608 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:19 smithi092 ceph-mon[34729]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:19.713 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:15:19.720 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:19 smithi069 ceph-mon[31270]: pgmap v351: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:19.941 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:15:19 smithi092 systemd[1]: Starting Ceph mds.e for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:15:20.305 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:15:19 smithi092 podman[63919]: 2024-05-14 15:15:19.886160453 +0000 UTC m=+0.032882785 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:15:20.305 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:15:20 smithi092 podman[63919]: 2024-05-14 15:15:20.007973757 +0000 UTC m=+0.154696119 container create fcffe07313c6834f0be8009a0652385a9a639561d453a94e41def9d1bda2737a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507) 2024-05-14T15:15:20.305 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:15:20 smithi092 podman[63919]: 2024-05-14 15:15:20.305935034 +0000 UTC m=+0.452657428 container init fcffe07313c6834f0be8009a0652385a9a639561d453a94e41def9d1bda2737a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-14T15:15:20.691 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:15:20 smithi092 podman[63919]: 2024-05-14 15:15:20.318128754 +0000 UTC m=+0.464851093 container start fcffe07313c6834f0be8009a0652385a9a639561d453a94e41def9d1bda2737a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-05-14T15:15:20.691 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:15:20 smithi092 bash[63919]: fcffe07313c6834f0be8009a0652385a9a639561d453a94e41def9d1bda2737a 2024-05-14T15:15:20.691 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:15:20 smithi092 systemd[1]: Started Ceph mds.e for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:15:20.691 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:15:20 smithi092 ceph-mds[63938]: -- 172.21.15.92:0/1645228214 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560de69d7a40 con 0x560de6a1fa80 2024-05-14T15:15:20.691 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:15:20 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: starting mds.e at 2024-05-14T15:15:21.445 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:21 smithi069 ceph-mon[31270]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:21.445 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:21 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:21.445 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:21 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:21.445 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:21 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:21.445 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:21 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:21.445 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:21 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:21.445 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:21 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:21.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:21 smithi203 ceph-mon[34567]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:21.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:21 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:21.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:21 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:21.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:21 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:21.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:21 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:21.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:21 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:21.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:21 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:21.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:21 smithi092 ceph-mon[34729]: pgmap v352: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:21.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:21 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:21.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:21 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:21.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:21 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:21.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:21 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:21.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:21 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:21.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:21 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:22.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.071+0000 7f0476400700 1 -- 172.21.15.69:0/1986060261 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0470108f20 msgr2=0x7f0470109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:22.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.071+0000 7f0476400700 1 --2- 172.21.15.69:0/1986060261 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0470108f20 0x7f0470109330 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f045c0099c0 tx=0x7f045c009cd0 comp rx=0 tx=0).stop 2024-05-14T15:15:22.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.071+0000 7f0476400700 1 -- 172.21.15.69:0/1986060261 shutdown_connections 2024-05-14T15:15:22.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.071+0000 7f0476400700 1 --2- 172.21.15.69:0/1986060261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0470109870 0x7f04701111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:22.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.071+0000 7f0476400700 1 --2- 172.21.15.69:0/1986060261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04701045f0 0x7f0470104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:22.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.071+0000 7f0476400700 1 --2- 172.21.15.69:0/1986060261 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0470108f20 0x7f0470109330 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:22.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.071+0000 7f0476400700 1 -- 172.21.15.69:0/1986060261 >> 172.21.15.69:0/1986060261 conn(0x7f0470100040 msgr2=0x7f0470102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:22.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.071+0000 7f0476400700 1 -- 172.21.15.69:0/1986060261 shutdown_connections 2024-05-14T15:15:22.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.071+0000 7f0476400700 1 -- 172.21.15.69:0/1986060261 wait complete. 2024-05-14T15:15:22.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.072+0000 7f0476400700 1 Processor -- start 2024-05-14T15:15:22.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.072+0000 7f0476400700 1 -- start start 2024-05-14T15:15:22.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.073+0000 7f0476400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04701045f0 0x7f047019ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:22.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.073+0000 7f0476400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0470108f20 0x7f047019b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:22.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.073+0000 7f0476400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0470109870 0x7f047019f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:22.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.073+0000 7f0476400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0470114330 con 0x7f0470108f20 2024-05-14T15:15:22.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.073+0000 7f0476400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f04701141b0 con 0x7f04701045f0 2024-05-14T15:15:22.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.073+0000 7f0476400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f04701144b0 con 0x7f0470109870 2024-05-14T15:15:22.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.073+0000 7f046ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0470108f20 0x7f047019b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:22.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.073+0000 7f046ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0470108f20 0x7f047019b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44074/0 (socket says 172.21.15.69:44074) 2024-05-14T15:15:22.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.073+0000 7f046ea00700 1 -- 172.21.15.69:0/214744590 learned_addr learned my addr 172.21.15.69:0/214744590 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:15:22.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.074+0000 7f046f400700 1 --2- 172.21.15.69:0/214744590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04701045f0 0x7f047019ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:22.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.074+0000 7f046fe00700 1 --2- 172.21.15.69:0/214744590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0470109870 0x7f047019f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:22.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.074+0000 7f046ea00700 1 -- 172.21.15.69:0/214744590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0470109870 msgr2=0x7f047019f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:22.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.074+0000 7f046ea00700 1 --2- 172.21.15.69:0/214744590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0470109870 0x7f047019f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:22.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.074+0000 7f046ea00700 1 -- 172.21.15.69:0/214744590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04701045f0 msgr2=0x7f047019ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:22.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.074+0000 7f046ea00700 1 --2- 172.21.15.69:0/214744590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04701045f0 0x7f047019ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:22.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.074+0000 7f046ea00700 1 -- 172.21.15.69:0/214744590 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f047019fc50 con 0x7f0470108f20 2024-05-14T15:15:22.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.074+0000 7f046f400700 1 --2- 172.21.15.69:0/214744590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04701045f0 0x7f047019ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:15:22.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.074+0000 7f046ea00700 1 --2- 172.21.15.69:0/214744590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0470108f20 0x7f047019b320 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f045c006010 tx=0x7f045c0055f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:22.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.075+0000 7f0467e00700 1 -- 172.21.15.69:0/214744590 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c026070 con 0x7f0470108f20 2024-05-14T15:15:22.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.075+0000 7f0467e00700 1 -- 172.21.15.69:0/214744590 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f045c00f460 con 0x7f0470108f20 2024-05-14T15:15:22.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.075+0000 7f0476400700 1 -- 172.21.15.69:0/214744590 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f047019fee0 con 0x7f0470108f20 2024-05-14T15:15:22.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.075+0000 7f0467e00700 1 -- 172.21.15.69:0/214744590 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f045c009e60 con 0x7f0470108f20 2024-05-14T15:15:22.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.075+0000 7f0476400700 1 -- 172.21.15.69:0/214744590 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04701a03c0 con 0x7f0470108f20 2024-05-14T15:15:22.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.076+0000 7f0476400700 1 -- 172.21.15.69:0/214744590 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04700512c0 con 0x7f0470108f20 2024-05-14T15:15:22.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.079+0000 7f0467e00700 1 -- 172.21.15.69:0/214744590 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f045c029070 con 0x7f0470108f20 2024-05-14T15:15:22.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.080+0000 7f0467e00700 1 --2- 172.21.15.69:0/214744590 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f04540b2880 0x7f04540b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:22.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.080+0000 7f0467e00700 1 -- 172.21.15.69:0/214744590 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f045c0e2f90 con 0x7f0470108f20 2024-05-14T15:15:22.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.081+0000 7f046f400700 1 --2- 172.21.15.69:0/214744590 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f04540b2880 0x7f04540b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:22.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.081+0000 7f046f400700 1 --2- 172.21.15.69:0/214744590 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f04540b2880 0x7f04540b4d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0460009cb0 tx=0x7f0460009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:22.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.084+0000 7f0467e00700 1 -- 172.21.15.69:0/214744590 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f045c013070 con 0x7f0470108f20 2024-05-14T15:15:22.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.365+0000 7f0476400700 1 -- 172.21.15.69:0/214744590 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f047002e5f0 con 0x7f0470108f20 2024-05-14T15:15:22.363 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:22 smithi069 ceph-mon[31270]: Deploying daemon mds.f on smithi203 2024-05-14T15:15:22.364 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:22 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] up:boot 2024-05-14T15:15:22.364 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:22 smithi069 ceph-mon[31270]: fsmap 5 up:standby 2024-05-14T15:15:22.364 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:22 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-14T15:15:22.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.366+0000 7f0467e00700 1 -- 172.21.15.69:0/214744590 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4693 (secure 0 0 0) 0x7f045c0ab140 con 0x7f0470108f20 2024-05-14T15:15:22.364 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:15:22.364 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":6,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":34409,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34433,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-14T15:15:22.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.369+0000 7f0476400700 1 -- 172.21.15.69:0/214744590 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f04540b2880 msgr2=0x7f04540b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:22.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.369+0000 7f0476400700 1 --2- 172.21.15.69:0/214744590 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f04540b2880 0x7f04540b4d90 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f0460009cb0 tx=0x7f0460009260 comp rx=0 tx=0).stop 2024-05-14T15:15:22.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.369+0000 7f0476400700 1 -- 172.21.15.69:0/214744590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0470108f20 msgr2=0x7f047019b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:22.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.369+0000 7f0476400700 1 --2- 172.21.15.69:0/214744590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0470108f20 0x7f047019b320 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f045c006010 tx=0x7f045c0055f0 comp rx=0 tx=0).stop 2024-05-14T15:15:22.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.369+0000 7f0476400700 1 -- 172.21.15.69:0/214744590 shutdown_connections 2024-05-14T15:15:22.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.369+0000 7f0476400700 1 --2- 172.21.15.69:0/214744590 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f04540b2880 0x7f04540b4d90 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:22.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.369+0000 7f0476400700 1 --2- 172.21.15.69:0/214744590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0470109870 0x7f047019f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:22.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.369+0000 7f0476400700 1 --2- 172.21.15.69:0/214744590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04701045f0 0x7f047019ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:22.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.369+0000 7f0476400700 1 --2- 172.21.15.69:0/214744590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0470108f20 0x7f047019b320 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:22.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.369+0000 7f0476400700 1 -- 172.21.15.69:0/214744590 >> 172.21.15.69:0/214744590 conn(0x7f0470100040 msgr2=0x7f047010a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:22.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.369+0000 7f0476400700 1 -- 172.21.15.69:0/214744590 shutdown_connections 2024-05-14T15:15:22.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:22.369+0000 7f0476400700 1 -- 172.21.15.69:0/214744590 wait complete. 2024-05-14T15:15:22.369 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 6 2024-05-14T15:15:22.579 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:22 smithi203 ceph-mon[34567]: Deploying daemon mds.f on smithi203 2024-05-14T15:15:22.579 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:22 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] up:boot 2024-05-14T15:15:22.579 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:22 smithi203 ceph-mon[34567]: fsmap 5 up:standby 2024-05-14T15:15:22.579 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:22 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-14T15:15:22.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:22 smithi092 ceph-mon[34729]: Deploying daemon mds.f on smithi203 2024-05-14T15:15:22.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:22 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] up:boot 2024-05-14T15:15:22.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:22 smithi092 ceph-mon[34729]: fsmap 5 up:standby 2024-05-14T15:15:22.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:22 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-14T15:15:23.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:23 smithi203 ceph-mon[34567]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:23.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:23 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/214744590' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:23.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:23 smithi069 ceph-mon[31270]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:23.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:23 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/214744590' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:23.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:23 smithi092 ceph-mon[34729]: pgmap v353: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:23.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:23 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/214744590' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:24.260 INFO:journalctl@ceph.mds.f.smithi203.stdout:May 14 15:15:23 smithi203 systemd[1]: Starting Ceph mds.f for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:15:24.589 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:24 smithi203 ceph-mon[34567]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:24.589 INFO:journalctl@ceph.mds.f.smithi203.stdout:May 14 15:15:24 smithi203 podman[64815]: 2024-05-14 15:15:24.167231591 +0000 UTC m=+0.037472984 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:15:24.589 INFO:journalctl@ceph.mds.f.smithi203.stdout:May 14 15:15:24 smithi203 podman[64815]: 2024-05-14 15:15:24.286036919 +0000 UTC m=+0.156278358 container create 0b60258cc0f91101db9ad0a9de6e1c4b87bc20b619828f7a15dc4443d383e370 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-14T15:15:24.589 INFO:journalctl@ceph.mds.f.smithi203.stdout:May 14 15:15:24 smithi203 podman[64815]: 2024-05-14 15:15:24.590925984 +0000 UTC m=+0.461167440 container init 0b60258cc0f91101db9ad0a9de6e1c4b87bc20b619828f7a15dc4443d383e370 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T15:15:24.690 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:24 smithi092 ceph-mon[34729]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:24.721 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:24 smithi069 ceph-mon[31270]: pgmap v354: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:24.842 INFO:journalctl@ceph.mds.f.smithi203.stdout:May 14 15:15:24 smithi203 podman[64815]: 2024-05-14 15:15:24.599588535 +0000 UTC m=+0.469829982 container start 0b60258cc0f91101db9ad0a9de6e1c4b87bc20b619828f7a15dc4443d383e370 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD) 2024-05-14T15:15:24.842 INFO:journalctl@ceph.mds.f.smithi203.stdout:May 14 15:15:24 smithi203 bash[64815]: 0b60258cc0f91101db9ad0a9de6e1c4b87bc20b619828f7a15dc4443d383e370 2024-05-14T15:15:24.842 INFO:journalctl@ceph.mds.f.smithi203.stdout:May 14 15:15:24 smithi203 systemd[1]: Started Ceph mds.f for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:15:24.842 INFO:journalctl@ceph.mds.f.smithi203.stdout:May 14 15:15:24 smithi203 ceph-mds[64835]: -- 172.21.15.203:0/1646361464 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ded90bfa40 con 0x55ded9107a80 2024-05-14T15:15:24.843 INFO:journalctl@ceph.mds.f.smithi203.stdout:May 14 15:15:24 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-f[64830]: starting mds.f at 2024-05-14T15:15:25.179 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:15:25.621 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:15:26.034 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:25 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:26.034 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:25 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:26.034 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:25 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:26.034 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:25 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:26.034 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:25 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:26.034 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:25 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:26.034 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:25 smithi069 ceph-mon[31270]: Deploying daemon mds.c on smithi203 2024-05-14T15:15:26.035 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:25 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.203:6834/2407601401,v1:172.21.15.203:6835/2407601401] up:boot 2024-05-14T15:15:26.035 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:25 smithi069 ceph-mon[31270]: fsmap 6 up:standby 2024-05-14T15:15:26.035 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:25 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-14T15:15:26.046 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:25 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:26.046 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:25 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:26.046 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:25 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:26.046 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:25 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:26.046 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:25 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:26.047 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:25 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:26.047 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:25 smithi203 ceph-mon[34567]: Deploying daemon mds.c on smithi203 2024-05-14T15:15:26.047 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:25 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.203:6834/2407601401,v1:172.21.15.203:6835/2407601401] up:boot 2024-05-14T15:15:26.047 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:25 smithi203 ceph-mon[34567]: fsmap 6 up:standby 2024-05-14T15:15:26.047 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:25 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-14T15:15:26.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:25 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:26.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:25 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:26.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:25 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:26.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:25 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:26.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:25 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:26.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:25 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:26.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:25 smithi092 ceph-mon[34729]: Deploying daemon mds.c on smithi203 2024-05-14T15:15:26.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:25 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.203:6834/2407601401,v1:172.21.15.203:6835/2407601401] up:boot 2024-05-14T15:15:26.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:25 smithi092 ceph-mon[34729]: fsmap 6 up:standby 2024-05-14T15:15:26.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:25 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-14T15:15:26.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:26 smithi069 ceph-mon[31270]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:27.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:26 smithi203 ceph-mon[34567]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:27.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:26 smithi092 ceph-mon[34729]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:28.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.020+0000 7f4618a00700 1 -- 172.21.15.69:0/622307493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4614110990 msgr2=0x7f4614110da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:28.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.020+0000 7f4618a00700 1 --2- 172.21.15.69:0/622307493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4614110990 0x7f4614110da0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f4604009990 tx=0x7f4604009ca0 comp rx=0 tx=0).stop 2024-05-14T15:15:28.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.020+0000 7f4618a00700 1 -- 172.21.15.69:0/622307493 shutdown_connections 2024-05-14T15:15:28.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.020+0000 7f4618a00700 1 --2- 172.21.15.69:0/622307493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4614110990 0x7f4614110da0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:28.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.020+0000 7f4618a00700 1 --2- 172.21.15.69:0/622307493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f461410b2b0 0x7f4614117830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:28.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.020+0000 7f4618a00700 1 --2- 172.21.15.69:0/622307493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f461410a960 0x7f461410ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:28.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.020+0000 7f4618a00700 1 -- 172.21.15.69:0/622307493 >> 172.21.15.69:0/622307493 conn(0x7f4614076d30 msgr2=0x7f4614077140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:28.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.020+0000 7f4618a00700 1 -- 172.21.15.69:0/622307493 shutdown_connections 2024-05-14T15:15:28.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.020+0000 7f4618a00700 1 -- 172.21.15.69:0/622307493 wait complete. 2024-05-14T15:15:28.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.021+0000 7f4618a00700 1 Processor -- start 2024-05-14T15:15:28.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.022+0000 7f4618a00700 1 -- start start 2024-05-14T15:15:28.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.022+0000 7f4618a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f461410a960 0x7f46141a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:28.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.022+0000 7f4618a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f461410b2b0 0x7f46141a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:28.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.022+0000 7f4618a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4614110990 0x7f46141a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:28.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.022+0000 7f4618a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f461411a940 con 0x7f461410a960 2024-05-14T15:15:28.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.022+0000 7f4618a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f461411a7c0 con 0x7f4614110990 2024-05-14T15:15:28.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.022+0000 7f4618a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f461411aac0 con 0x7f461410b2b0 2024-05-14T15:15:28.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.023+0000 7f4611e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f461410a960 0x7f46141a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:28.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.023+0000 7f4611e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f461410a960 0x7f46141a1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48198/0 (socket says 172.21.15.69:48198) 2024-05-14T15:15:28.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.023+0000 7f4611e00700 1 -- 172.21.15.69:0/4288617335 learned_addr learned my addr 172.21.15.69:0/4288617335 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:15:28.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.023+0000 7f4611400700 1 --2- 172.21.15.69:0/4288617335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f461410b2b0 0x7f46141a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:28.021 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.023+0000 7f4612800700 1 --2- 172.21.15.69:0/4288617335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4614110990 0x7f46141a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:28.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.023+0000 7f4611e00700 1 -- 172.21.15.69:0/4288617335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f461410b2b0 msgr2=0x7f46141a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:28.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.023+0000 7f4611e00700 1 --2- 172.21.15.69:0/4288617335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f461410b2b0 0x7f46141a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:28.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.023+0000 7f4611e00700 1 -- 172.21.15.69:0/4288617335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4614110990 msgr2=0x7f46141a5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:28.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.023+0000 7f4611e00700 1 --2- 172.21.15.69:0/4288617335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4614110990 0x7f46141a5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:28.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.023+0000 7f4611e00700 1 -- 172.21.15.69:0/4288617335 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46141a6260 con 0x7f461410a960 2024-05-14T15:15:28.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.024+0000 7f4611e00700 1 --2- 172.21.15.69:0/4288617335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f461410a960 0x7f46141a1390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4604000c00 tx=0x7f46040047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:28.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.024+0000 7f460aa00700 1 -- 172.21.15.69:0/4288617335 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604027070 con 0x7f461410a960 2024-05-14T15:15:28.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.024+0000 7f460aa00700 1 -- 172.21.15.69:0/4288617335 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f460400fb00 con 0x7f461410a960 2024-05-14T15:15:28.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.024+0000 7f4618a00700 1 -- 172.21.15.69:0/4288617335 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46141a64f0 con 0x7f461410a960 2024-05-14T15:15:28.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.024+0000 7f460aa00700 1 -- 172.21.15.69:0/4288617335 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4604022c40 con 0x7f461410a960 2024-05-14T15:15:28.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.025+0000 7f4618a00700 1 -- 172.21.15.69:0/4288617335 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46141ade70 con 0x7f461410a960 2024-05-14T15:15:28.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.027+0000 7f4618a00700 1 -- 172.21.15.69:0/4288617335 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f461410c0a0 con 0x7f461410a960 2024-05-14T15:15:28.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.029+0000 7f460aa00700 1 -- 172.21.15.69:0/4288617335 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f460402a070 con 0x7f461410a960 2024-05-14T15:15:28.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.031+0000 7f460aa00700 1 --2- 172.21.15.69:0/4288617335 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f45f80b2900 0x7f45f80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:28.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.031+0000 7f460aa00700 1 -- 172.21.15.69:0/4288617335 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f46040e2dc0 con 0x7f461410a960 2024-05-14T15:15:28.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.031+0000 7f4611400700 1 --2- 172.21.15.69:0/4288617335 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f45f80b2900 0x7f45f80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:28.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.032+0000 7f4611400700 1 --2- 172.21.15.69:0/4288617335 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f45f80b2900 0x7f45f80b4e10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4614108770 tx=0x7f460000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:28.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.036+0000 7f460aa00700 1 -- 172.21.15.69:0/4288617335 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4604013070 con 0x7f461410a960 2024-05-14T15:15:28.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.318+0000 7f4618a00700 1 -- 172.21.15.69:0/4288617335 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f46140512c0 con 0x7f461410a960 2024-05-14T15:15:28.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.319+0000 7f460aa00700 1 -- 172.21.15.69:0/4288617335 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5521 (secure 0 0 0) 0x7f46040aaf70 con 0x7f461410a960 2024-05-14T15:15:28.318 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:15:28.318 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":7,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":34409,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34433,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-05-14T15:15:28.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.323+0000 7f4618a00700 1 -- 172.21.15.69:0/4288617335 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f45f80b2900 msgr2=0x7f45f80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:28.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.323+0000 7f4618a00700 1 --2- 172.21.15.69:0/4288617335 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f45f80b2900 0x7f45f80b4e10 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f4614108770 tx=0x7f460000b410 comp rx=0 tx=0).stop 2024-05-14T15:15:28.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.323+0000 7f4618a00700 1 -- 172.21.15.69:0/4288617335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f461410a960 msgr2=0x7f46141a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:28.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.323+0000 7f4618a00700 1 --2- 172.21.15.69:0/4288617335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f461410a960 0x7f46141a1390 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f4604000c00 tx=0x7f46040047b0 comp rx=0 tx=0).stop 2024-05-14T15:15:28.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.323+0000 7f4618a00700 1 -- 172.21.15.69:0/4288617335 shutdown_connections 2024-05-14T15:15:28.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.323+0000 7f4618a00700 1 --2- 172.21.15.69:0/4288617335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f461410a960 0x7f46141a1390 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.323+0000 7f4618a00700 1 --2- 172.21.15.69:0/4288617335 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f45f80b2900 0x7f45f80b4e10 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.323+0000 7f4618a00700 1 --2- 172.21.15.69:0/4288617335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4614110990 0x7f46141a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.323+0000 7f4618a00700 1 --2- 172.21.15.69:0/4288617335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f461410b2b0 0x7f46141a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.323+0000 7f4618a00700 1 -- 172.21.15.69:0/4288617335 >> 172.21.15.69:0/4288617335 conn(0x7f4614076d30 msgr2=0x7f4614109290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.323+0000 7f4618a00700 1 -- 172.21.15.69:0/4288617335 shutdown_connections 2024-05-14T15:15:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:28.323+0000 7f4618a00700 1 -- 172.21.15.69:0/4288617335 wait complete. 2024-05-14T15:15:28.322 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 7 2024-05-14T15:15:28.593 INFO:journalctl@ceph.mds.c.smithi203.stdout:May 14 15:15:28 smithi203 systemd[1]: Starting Ceph mds.c for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:15:28.858 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:28 smithi203 ceph-mon[34567]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:28.859 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:28 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/4288617335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:28.859 INFO:journalctl@ceph.mds.c.smithi203.stdout:May 14 15:15:28 smithi203 podman[65123]: 2024-05-14 15:15:28.515148132 +0000 UTC m=+0.034439276 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:15:28.859 INFO:journalctl@ceph.mds.c.smithi203.stdout:May 14 15:15:28 smithi203 podman[65123]: 2024-05-14 15:15:28.63737355 +0000 UTC m=+0.156664724 container create 9b8e97558b07912d3b247745b9ca17e26edd1359345db8281e799e1444c535a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-c, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240507) 2024-05-14T15:15:28.970 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:28 smithi069 ceph-mon[31270]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:28.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:28 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/4288617335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:29.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:28 smithi092 ceph-mon[34729]: pgmap v356: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:29.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:28 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/4288617335' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:29.342 INFO:journalctl@ceph.mds.c.smithi203.stdout:May 14 15:15:28 smithi203 podman[65123]: 2024-05-14 15:15:28.975125449 +0000 UTC m=+0.494416649 container init 9b8e97558b07912d3b247745b9ca17e26edd1359345db8281e799e1444c535a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.build-date=20240507) 2024-05-14T15:15:29.343 INFO:journalctl@ceph.mds.c.smithi203.stdout:May 14 15:15:28 smithi203 podman[65123]: 2024-05-14 15:15:28.985152693 +0000 UTC m=+0.504443870 container start 9b8e97558b07912d3b247745b9ca17e26edd1359345db8281e799e1444c535a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-c, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T15:15:29.343 INFO:journalctl@ceph.mds.c.smithi203.stdout:May 14 15:15:29 smithi203 ceph-mds[65142]: -- 172.21.15.203:0/441983721 <== mon.1 v2:172.21.15.203:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5628c0603a40 con 0x5628c064b180 2024-05-14T15:15:29.343 INFO:journalctl@ceph.mds.c.smithi203.stdout:May 14 15:15:29 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-c[65138]: starting mds.c at 2024-05-14T15:15:29.343 INFO:journalctl@ceph.mds.c.smithi203.stdout:May 14 15:15:29 smithi203 bash[65123]: 9b8e97558b07912d3b247745b9ca17e26edd1359345db8281e799e1444c535a4 2024-05-14T15:15:29.343 INFO:journalctl@ceph.mds.c.smithi203.stdout:May 14 15:15:29 smithi203 systemd[1]: Started Ceph mds.c for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:15:30.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:30 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:30.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:30 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:30.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:30 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:30.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:30 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:30.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:30 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:30.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:30 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:30.467 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:30 smithi092 ceph-mon[34729]: Deploying daemon mds.h on smithi092 2024-05-14T15:15:30.468 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:30 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.203:6836/3006378390,v1:172.21.15.203:6837/3006378390] up:boot 2024-05-14T15:15:30.468 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:30 smithi092 ceph-mon[34729]: fsmap 7 up:standby 2024-05-14T15:15:30.468 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:30 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-14T15:15:30.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:30 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:30.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:30 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:30.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:30 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:30.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:30 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:30.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:30 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:30.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:30 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:30.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:30 smithi069 ceph-mon[31270]: Deploying daemon mds.h on smithi092 2024-05-14T15:15:30.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:30 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.203:6836/3006378390,v1:172.21.15.203:6837/3006378390] up:boot 2024-05-14T15:15:30.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:30 smithi069 ceph-mon[31270]: fsmap 7 up:standby 2024-05-14T15:15:30.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:30 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-14T15:15:30.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:30 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:30.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:30 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:30.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:30 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:30.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:30 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:30.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:30 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:30.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:30 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:30.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:30 smithi203 ceph-mon[34567]: Deploying daemon mds.h on smithi092 2024-05-14T15:15:30.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:30 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.203:6836/3006378390,v1:172.21.15.203:6837/3006378390] up:boot 2024-05-14T15:15:30.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:30 smithi203 ceph-mon[34567]: fsmap 7 up:standby 2024-05-14T15:15:30.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:30 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-14T15:15:31.211 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:15:31.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:31 smithi092 ceph-mon[34729]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:31.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:31 smithi203 ceph-mon[34567]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:31.663 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:15:31.721 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:31 smithi069 ceph-mon[31270]: pgmap v357: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:32.869 INFO:journalctl@ceph.mds.h.smithi092.stdout:May 14 15:15:32 smithi092 systemd[1]: Starting Ceph mds.h for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:15:33.183 INFO:journalctl@ceph.mds.h.smithi092.stdout:May 14 15:15:32 smithi092 podman[64223]: 2024-05-14 15:15:32.778346339 +0000 UTC m=+0.036583723 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:15:33.183 INFO:journalctl@ceph.mds.h.smithi092.stdout:May 14 15:15:32 smithi092 podman[64223]: 2024-05-14 15:15:32.896578472 +0000 UTC m=+0.154815877 container create 8fc665051fca720fcdbcb91f7a19075d3baf342061c3762feb0c27056f1a64a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-h, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-14T15:15:33.183 INFO:journalctl@ceph.mds.h.smithi092.stdout:May 14 15:15:33 smithi092 podman[64223]: 2024-05-14 15:15:33.182501204 +0000 UTC m=+0.440738612 container init 8fc665051fca720fcdbcb91f7a19075d3baf342061c3762feb0c27056f1a64a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-h, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-14T15:15:33.404 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:33 smithi069 ceph-mon[31270]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:33.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:33 smithi092 ceph-mon[34729]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:33.441 INFO:journalctl@ceph.mds.h.smithi092.stdout:May 14 15:15:33 smithi092 podman[64223]: 2024-05-14 15:15:33.193411331 +0000 UTC m=+0.451648704 container start 8fc665051fca720fcdbcb91f7a19075d3baf342061c3762feb0c27056f1a64a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-h, org.label-schema.build-date=20240507, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:15:33.441 INFO:journalctl@ceph.mds.h.smithi092.stdout:May 14 15:15:33 smithi092 bash[64223]: 8fc665051fca720fcdbcb91f7a19075d3baf342061c3762feb0c27056f1a64a5 2024-05-14T15:15:33.441 INFO:journalctl@ceph.mds.h.smithi092.stdout:May 14 15:15:33 smithi092 systemd[1]: Started Ceph mds.h for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:15:33.441 INFO:journalctl@ceph.mds.h.smithi092.stdout:May 14 15:15:33 smithi092 ceph-mds[64242]: -- 172.21.15.92:0/3862751381 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558f49301a40 con 0x558f49349600 2024-05-14T15:15:33.441 INFO:journalctl@ceph.mds.h.smithi092.stdout:May 14 15:15:33 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-h[64238]: starting mds.h at 2024-05-14T15:15:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:33 smithi203 ceph-mon[34567]: pgmap v358: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:34.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.001+0000 7f6888a00700 1 -- 172.21.15.69:0/3081500465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6884105310 msgr2=0x7f6884105720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:34.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.001+0000 7f6888a00700 1 --2- 172.21.15.69:0/3081500465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6884105310 0x7f6884105720 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f6874009990 tx=0x7f6874009ca0 comp rx=0 tx=0).stop 2024-05-14T15:15:34.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.001+0000 7f6888a00700 1 -- 172.21.15.69:0/3081500465 shutdown_connections 2024-05-14T15:15:34.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.001+0000 7f6888a00700 1 --2- 172.21.15.69:0/3081500465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6884105310 0x7f6884105720 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:34.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.001+0000 7f6888a00700 1 --2- 172.21.15.69:0/3081500465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f688410e740 0x7f6884110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:34.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.001+0000 7f6888a00700 1 --2- 172.21.15.69:0/3081500465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6884105c60 0x7f688410e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:34.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.001+0000 7f6888a00700 1 -- 172.21.15.69:0/3081500465 >> 172.21.15.69:0/3081500465 conn(0x7f6884078ac0 msgr2=0x7f6884078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:34.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.001+0000 7f6888a00700 1 -- 172.21.15.69:0/3081500465 shutdown_connections 2024-05-14T15:15:34.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.001+0000 7f6888a00700 1 -- 172.21.15.69:0/3081500465 wait complete. 2024-05-14T15:15:34.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.003+0000 7f6888a00700 1 Processor -- start 2024-05-14T15:15:34.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.003+0000 7f6888a00700 1 -- start start 2024-05-14T15:15:34.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.004+0000 7f6888a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6884105310 0x7f68841a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:34.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.004+0000 7f6888a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6884105c60 0x7f68841a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:34.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.004+0000 7f6888a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f688410e740 0x7f688419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:34.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.004+0000 7f6888a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6884114100 con 0x7f6884105310 2024-05-14T15:15:34.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.004+0000 7f6888a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6884113f80 con 0x7f6884105c60 2024-05-14T15:15:34.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.004+0000 7f6888a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6884114280 con 0x7f688410e740 2024-05-14T15:15:34.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.004+0000 7f6883400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6884105310 0x7f68841a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:34.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.004+0000 7f6883400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6884105310 0x7f68841a0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46760/0 (socket says 172.21.15.69:46760) 2024-05-14T15:15:34.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.004+0000 7f6883400700 1 -- 172.21.15.69:0/481171934 learned_addr learned my addr 172.21.15.69:0/481171934 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:15:34.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.004+0000 7f687be00700 1 --2- 172.21.15.69:0/481171934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6884105c60 0x7f68841a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:34.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.004+0000 7f6883e00700 1 --2- 172.21.15.69:0/481171934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f688410e740 0x7f688419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:34.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.004+0000 7f6883400700 1 -- 172.21.15.69:0/481171934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f688410e740 msgr2=0x7f688419a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:34.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.004+0000 7f6883400700 1 --2- 172.21.15.69:0/481171934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f688410e740 0x7f688419a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:34.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.004+0000 7f6883400700 1 -- 172.21.15.69:0/481171934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6884105c60 msgr2=0x7f68841a0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:34.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.004+0000 7f6883400700 1 --2- 172.21.15.69:0/481171934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6884105c60 0x7f68841a0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:34.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.004+0000 7f6883400700 1 -- 172.21.15.69:0/481171934 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f688419afe0 con 0x7f6884105310 2024-05-14T15:15:34.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.005+0000 7f6883e00700 1 --2- 172.21.15.69:0/481171934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f688410e740 0x7f688419a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:34.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.005+0000 7f6883400700 1 --2- 172.21.15.69:0/481171934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6884105310 0x7f68841a0780 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6874000c00 tx=0x7f68740047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:34.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.005+0000 7f6880c00700 1 -- 172.21.15.69:0/481171934 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6874027070 con 0x7f6884105310 2024-05-14T15:15:34.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.005+0000 7f6880c00700 1 -- 172.21.15.69:0/481171934 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f687400fdb0 con 0x7f6884105310 2024-05-14T15:15:34.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.005+0000 7f6888a00700 1 -- 172.21.15.69:0/481171934 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f688419b270 con 0x7f6884105310 2024-05-14T15:15:34.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.005+0000 7f6880c00700 1 -- 172.21.15.69:0/481171934 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68740173f0 con 0x7f6884105310 2024-05-14T15:15:34.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.005+0000 7f6888a00700 1 -- 172.21.15.69:0/481171934 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f688419b7a0 con 0x7f6884105310 2024-05-14T15:15:34.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.007+0000 7f6888a00700 1 -- 172.21.15.69:0/481171934 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68840512c0 con 0x7f6884105310 2024-05-14T15:15:34.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.009+0000 7f6880c00700 1 -- 172.21.15.69:0/481171934 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f687402a070 con 0x7f6884105310 2024-05-14T15:15:34.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.011+0000 7f6880c00700 1 --2- 172.21.15.69:0/481171934 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f68680b2900 0x7f68680b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:34.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.011+0000 7f6880c00700 1 -- 172.21.15.69:0/481171934 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f68740e32b0 con 0x7f6884105310 2024-05-14T15:15:34.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.011+0000 7f687be00700 1 --2- 172.21.15.69:0/481171934 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f68680b2900 0x7f68680b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:34.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.012+0000 7f687be00700 1 --2- 172.21.15.69:0/481171934 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f68680b2900 0x7f68680b4e10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f686c005fd0 tx=0x7f686c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:34.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.014+0000 7f6880c00700 1 -- 172.21.15.69:0/481171934 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6874031080 con 0x7f6884105310 2024-05-14T15:15:34.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.293+0000 7f6888a00700 1 -- 172.21.15.69:0/481171934 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f688402e5f0 con 0x7f6884105310 2024-05-14T15:15:34.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.294+0000 7f6880c00700 1 -- 172.21.15.69:0/481171934 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7174 (secure 0 0 0) 0x7f6874013070 con 0x7f6884105310 2024-05-14T15:15:34.292 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:15:34.292 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":9,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24442,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":34409,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34433,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34460,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-14T15:15:34.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.297+0000 7f6888a00700 1 -- 172.21.15.69:0/481171934 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f68680b2900 msgr2=0x7f68680b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:34.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.297+0000 7f6888a00700 1 --2- 172.21.15.69:0/481171934 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f68680b2900 0x7f68680b4e10 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f686c005fd0 tx=0x7f686c00a560 comp rx=0 tx=0).stop 2024-05-14T15:15:34.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.297+0000 7f6888a00700 1 -- 172.21.15.69:0/481171934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6884105310 msgr2=0x7f68841a0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:34.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.297+0000 7f6888a00700 1 --2- 172.21.15.69:0/481171934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6884105310 0x7f68841a0780 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6874000c00 tx=0x7f68740047b0 comp rx=0 tx=0).stop 2024-05-14T15:15:34.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.298+0000 7f6888a00700 1 -- 172.21.15.69:0/481171934 shutdown_connections 2024-05-14T15:15:34.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.298+0000 7f6888a00700 1 --2- 172.21.15.69:0/481171934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6884105310 0x7f68841a0780 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:34.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.298+0000 7f6888a00700 1 --2- 172.21.15.69:0/481171934 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f68680b2900 0x7f68680b4e10 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:34.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.298+0000 7f6888a00700 1 --2- 172.21.15.69:0/481171934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f688410e740 0x7f688419a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:34.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.298+0000 7f6888a00700 1 --2- 172.21.15.69:0/481171934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6884105c60 0x7f68841a0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:34.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.298+0000 7f6888a00700 1 -- 172.21.15.69:0/481171934 >> 172.21.15.69:0/481171934 conn(0x7f6884078ac0 msgr2=0x7f68840fffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:34.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.298+0000 7f6888a00700 1 -- 172.21.15.69:0/481171934 shutdown_connections 2024-05-14T15:15:34.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:34.298+0000 7f6888a00700 1 -- 172.21.15.69:0/481171934 wait complete. 2024-05-14T15:15:34.297 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 9 2024-05-14T15:15:34.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:34.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:34.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:34.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:34.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:34.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:34.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:34 smithi092 ceph-mon[34729]: Deploying daemon mds.i on smithi203 2024-05-14T15:15:34.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:34 smithi092 ceph-mon[34729]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:34.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:34 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] up:boot 2024-05-14T15:15:34.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:34 smithi092 ceph-mon[34729]: fsmap 8 up:standby 2024-05-14T15:15:34.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:34 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-14T15:15:34.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:34 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/481171934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:34.721 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:34.721 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:34.721 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:34.721 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:34.722 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:34.722 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:34.722 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:34 smithi069 ceph-mon[31270]: Deploying daemon mds.i on smithi203 2024-05-14T15:15:34.722 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:34 smithi069 ceph-mon[31270]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:34.722 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:34 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] up:boot 2024-05-14T15:15:34.722 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:34 smithi069 ceph-mon[31270]: fsmap 8 up:standby 2024-05-14T15:15:34.722 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:34 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-14T15:15:34.722 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:34 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/481171934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:34.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:34.737 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:34.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:34.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:34.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:34.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:34.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:34 smithi203 ceph-mon[34567]: Deploying daemon mds.i on smithi203 2024-05-14T15:15:34.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:34 smithi203 ceph-mon[34567]: pgmap v359: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:34.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:34 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] up:boot 2024-05-14T15:15:34.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:34 smithi203 ceph-mon[34567]: fsmap 8 up:standby 2024-05-14T15:15:34.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:34 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-14T15:15:34.738 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:34 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/481171934' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:36.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:36 smithi092 ceph-mon[34729]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:36.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:36 smithi069 ceph-mon[31270]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:37.059 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:36 smithi203 ceph-mon[34567]: pgmap v360: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:37.059 INFO:journalctl@ceph.mds.i.smithi203.stdout:May 14 15:15:36 smithi203 systemd[1]: Starting Ceph mds.i for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:15:37.212 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:15:37.342 INFO:journalctl@ceph.mds.i.smithi203.stdout:May 14 15:15:37 smithi203 podman[65425]: 2024-05-14 15:15:37.052845837 +0000 UTC m=+0.032491764 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:15:37.342 INFO:journalctl@ceph.mds.i.smithi203.stdout:May 14 15:15:37 smithi203 podman[65425]: 2024-05-14 15:15:37.197681142 +0000 UTC m=+0.177327136 container create d9cb71fb793dc81af53abce90ed1beaa8c6b9dae3d8c867619b2984be48cf64a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-i, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T15:15:37.668 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:15:37.842 INFO:journalctl@ceph.mds.i.smithi203.stdout:May 14 15:15:37 smithi203 podman[65425]: 2024-05-14 15:15:37.469401793 +0000 UTC m=+0.449047763 container init d9cb71fb793dc81af53abce90ed1beaa8c6b9dae3d8c867619b2984be48cf64a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-i, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-14T15:15:37.843 INFO:journalctl@ceph.mds.i.smithi203.stdout:May 14 15:15:37 smithi203 podman[65425]: 2024-05-14 15:15:37.479674551 +0000 UTC m=+0.459320486 container start d9cb71fb793dc81af53abce90ed1beaa8c6b9dae3d8c867619b2984be48cf64a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-i, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240507) 2024-05-14T15:15:37.843 INFO:journalctl@ceph.mds.i.smithi203.stdout:May 14 15:15:37 smithi203 bash[65425]: d9cb71fb793dc81af53abce90ed1beaa8c6b9dae3d8c867619b2984be48cf64a 2024-05-14T15:15:37.843 INFO:journalctl@ceph.mds.i.smithi203.stdout:May 14 15:15:37 smithi203 systemd[1]: Started Ceph mds.i for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:15:37.843 INFO:journalctl@ceph.mds.i.smithi203.stdout:May 14 15:15:37 smithi203 ceph-mds[65451]: -- 172.21.15.203:0/2541200941 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5640ab183a40 con 0x5640ab1cb600 2024-05-14T15:15:37.843 INFO:journalctl@ceph.mds.i.smithi203.stdout:May 14 15:15:37 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-i[65447]: starting mds.i at 2024-05-14T15:15:38.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:38 smithi092 ceph-mon[34729]: pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:38.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:38 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] up:boot 2024-05-14T15:15:38.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:38 smithi092 ceph-mon[34729]: fsmap 9 up:standby 2024-05-14T15:15:38.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-14T15:15:38.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:38.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:38.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:38.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:38.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:38.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:38 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:38.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:38 smithi092 ceph-mon[34729]: Deploying daemon mds.g on smithi069 2024-05-14T15:15:38.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:38 smithi069 ceph-mon[31270]: pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:38.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:38 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] up:boot 2024-05-14T15:15:38.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:38 smithi069 ceph-mon[31270]: fsmap 9 up:standby 2024-05-14T15:15:38.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-14T15:15:38.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:38.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:38.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:38.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:38.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:38.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:38 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:38.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:38 smithi069 ceph-mon[31270]: Deploying daemon mds.g on smithi069 2024-05-14T15:15:39.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:38 smithi203 ceph-mon[34567]: pgmap v361: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:39.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:38 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] up:boot 2024-05-14T15:15:39.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:38 smithi203 ceph-mon[34567]: fsmap 9 up:standby 2024-05-14T15:15:39.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-14T15:15:39.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:39.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:39.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:39.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:39.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:39.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:38 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:39.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:38 smithi203 ceph-mon[34567]: Deploying daemon mds.g on smithi069 2024-05-14T15:15:40.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.127+0000 7f6be2200700 1 -- 172.21.15.69:0/709114387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc110970 msgr2=0x7f6bdc110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:40.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.127+0000 7f6be2200700 1 --2- 172.21.15.69:0/709114387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc110970 0x7f6bdc110d80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc009990 tx=0x7f6bcc009ca0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.127+0000 7f6be2200700 1 -- 172.21.15.69:0/709114387 shutdown_connections 2024-05-14T15:15:40.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.127+0000 7f6be2200700 1 --2- 172.21.15.69:0/709114387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc110970 0x7f6bdc110d80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.127+0000 7f6be2200700 1 --2- 172.21.15.69:0/709114387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bdc10b2e0 0x7f6bdc117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.127+0000 7f6be2200700 1 --2- 172.21.15.69:0/709114387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bdc10a990 0x7f6bdc10ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.127+0000 7f6be2200700 1 -- 172.21.15.69:0/709114387 >> 172.21.15.69:0/709114387 conn(0x7f6bdc077c80 msgr2=0x7f6bdc0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:40.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.127+0000 7f6be2200700 1 -- 172.21.15.69:0/709114387 shutdown_connections 2024-05-14T15:15:40.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.127+0000 7f6be2200700 1 -- 172.21.15.69:0/709114387 wait complete. 2024-05-14T15:15:40.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.128+0000 7f6be2200700 1 Processor -- start 2024-05-14T15:15:40.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.129+0000 7f6be2200700 1 -- start start 2024-05-14T15:15:40.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.129+0000 7f6be2200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bdc10a990 0x7f6bdc1a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:40.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.129+0000 7f6be2200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc10b2e0 0x7f6bdc1a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:40.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.129+0000 7f6be2200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bdc110970 0x7f6bdc1a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:40.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.129+0000 7f6be2200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc11a970 con 0x7f6bdc10b2e0 2024-05-14T15:15:40.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.129+0000 7f6be2200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc11a7f0 con 0x7f6bdc110970 2024-05-14T15:15:40.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.129+0000 7f6be2200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6bdc11aaf0 con 0x7f6bdc10a990 2024-05-14T15:15:40.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.129+0000 7f6bdaa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc10b2e0 0x7f6bdc1a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:40.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.129+0000 7f6bdaa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc10b2e0 0x7f6bdc1a1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46776/0 (socket says 172.21.15.69:46776) 2024-05-14T15:15:40.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.129+0000 7f6bdaa00700 1 -- 172.21.15.69:0/378620065 learned_addr learned my addr 172.21.15.69:0/378620065 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:15:40.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.130+0000 7f6bdb400700 1 --2- 172.21.15.69:0/378620065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bdc10a990 0x7f6bdc1a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:40.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.130+0000 7f6bdbe00700 1 --2- 172.21.15.69:0/378620065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bdc110970 0x7f6bdc1a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:40.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.130+0000 7f6bdaa00700 1 -- 172.21.15.69:0/378620065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bdc10a990 msgr2=0x7f6bdc1a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:40.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.130+0000 7f6bdaa00700 1 --2- 172.21.15.69:0/378620065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bdc10a990 0x7f6bdc1a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.130+0000 7f6bdaa00700 1 -- 172.21.15.69:0/378620065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bdc110970 msgr2=0x7f6bdc1a5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:40.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.130+0000 7f6bdaa00700 1 --2- 172.21.15.69:0/378620065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bdc110970 0x7f6bdc1a5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.130+0000 7f6bdaa00700 1 -- 172.21.15.69:0/378620065 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bdc1a6230 con 0x7f6bdc10b2e0 2024-05-14T15:15:40.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.130+0000 7f6bdbe00700 1 --2- 172.21.15.69:0/378620065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bdc110970 0x7f6bdc1a5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:15:40.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.130+0000 7f6bdaa00700 1 --2- 172.21.15.69:0/378620065 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc10b2e0 0x7f6bdc1a1900 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800d980 tx=0x7f6bc800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:40.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.130+0000 7f6bd3e00700 1 -- 172.21.15.69:0/378620065 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc8017070 con 0x7f6bdc10b2e0 2024-05-14T15:15:40.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.130+0000 7f6bd3e00700 1 -- 172.21.15.69:0/378620065 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bc8010460 con 0x7f6bdc10b2e0 2024-05-14T15:15:40.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.131+0000 7f6be2200700 1 -- 172.21.15.69:0/378620065 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bdc1a6520 con 0x7f6bdc10b2e0 2024-05-14T15:15:40.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.131+0000 7f6bd3e00700 1 -- 172.21.15.69:0/378620065 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bc800de60 con 0x7f6bdc10b2e0 2024-05-14T15:15:40.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.131+0000 7f6be2200700 1 -- 172.21.15.69:0/378620065 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bdc1ade40 con 0x7f6bdc10b2e0 2024-05-14T15:15:40.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.132+0000 7f6be2200700 1 -- 172.21.15.69:0/378620065 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bdc0512c0 con 0x7f6bdc10b2e0 2024-05-14T15:15:40.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.135+0000 7f6bd3e00700 1 -- 172.21.15.69:0/378620065 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f6bc8010610 con 0x7f6bdc10b2e0 2024-05-14T15:15:40.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.137+0000 7f6bd3e00700 1 --2- 172.21.15.69:0/378620065 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6bc00b2900 0x7f6bc00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:40.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.138+0000 7f6bd3e00700 1 -- 172.21.15.69:0/378620065 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f6bc80e1900 con 0x7f6bdc10b2e0 2024-05-14T15:15:40.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.138+0000 7f6bdb400700 1 --2- 172.21.15.69:0/378620065 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6bc00b2900 0x7f6bc00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:40.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.139+0000 7f6bdb400700 1 --2- 172.21.15.69:0/378620065 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6bc00b2900 0x7f6bc00b4e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00b5c0 tx=0x7f6bcc005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:40.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.142+0000 7f6bd3e00700 1 -- 172.21.15.69:0/378620065 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6bc80a9a20 con 0x7f6bdc10b2e0 2024-05-14T15:15:40.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.423+0000 7f6be2200700 1 -- 172.21.15.69:0/378620065 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6bdc02e5f0 con 0x7f6bdc10b2e0 2024-05-14T15:15:40.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.424+0000 7f6bd3e00700 1 -- 172.21.15.69:0/378620065 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 10 v10) ==== 94+0+8004 (secure 0 0 0) 0x7f6bc80a9320 con 0x7f6bdc10b2e0 2024-05-14T15:15:40.424 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:15:40.424 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":10,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24442,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24451,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34409,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34433,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34460,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-14T15:15:40.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.427+0000 7f6be2200700 1 -- 172.21.15.69:0/378620065 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6bc00b2900 msgr2=0x7f6bc00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:40.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.427+0000 7f6be2200700 1 --2- 172.21.15.69:0/378620065 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6bc00b2900 0x7f6bc00b4e10 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6bcc00b5c0 tx=0x7f6bcc005fb0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.427+0000 7f6be2200700 1 -- 172.21.15.69:0/378620065 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc10b2e0 msgr2=0x7f6bdc1a1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:40.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.427+0000 7f6be2200700 1 --2- 172.21.15.69:0/378620065 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc10b2e0 0x7f6bdc1a1900 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6bc800d980 tx=0x7f6bc800dd40 comp rx=0 tx=0).stop 2024-05-14T15:15:40.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.428+0000 7f6be2200700 1 -- 172.21.15.69:0/378620065 shutdown_connections 2024-05-14T15:15:40.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.428+0000 7f6be2200700 1 --2- 172.21.15.69:0/378620065 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6bc00b2900 0x7f6bc00b4e10 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.428+0000 7f6be2200700 1 --2- 172.21.15.69:0/378620065 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bdc110970 0x7f6bdc1a5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.428+0000 7f6be2200700 1 --2- 172.21.15.69:0/378620065 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bdc10a990 0x7f6bdc1a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.428+0000 7f6be2200700 1 --2- 172.21.15.69:0/378620065 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bdc10b2e0 0x7f6bdc1a1900 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:40.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.428+0000 7f6be2200700 1 -- 172.21.15.69:0/378620065 >> 172.21.15.69:0/378620065 conn(0x7f6bdc077c80 msgr2=0x7f6bdc10e770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:40.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.428+0000 7f6be2200700 1 -- 172.21.15.69:0/378620065 shutdown_connections 2024-05-14T15:15:40.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:40.428+0000 7f6be2200700 1 -- 172.21.15.69:0/378620065 wait complete. 2024-05-14T15:15:40.428 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 10 2024-05-14T15:15:40.907 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:40 smithi069 ceph-mon[31270]: pgmap v362: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:40.907 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:40 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/378620065' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:40.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:40 smithi092 ceph-mon[34729]: pgmap v362: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:40.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:40 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/378620065' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:41.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:40 smithi203 ceph-mon[34567]: pgmap v362: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:41.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:40 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/378620065' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:42.454 INFO:journalctl@ceph.mds.g.smithi069.stdout:May 14 15:15:42 smithi069 systemd[1]: Starting Ceph mds.g for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:15:42.705 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:42 smithi069 ceph-mon[31270]: pgmap v363: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:42.705 INFO:journalctl@ceph.mds.g.smithi069.stdout:May 14 15:15:42 smithi069 podman[70328]: 2024-05-14 15:15:42.360296134 +0000 UTC m=+0.034707798 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:15:42.705 INFO:journalctl@ceph.mds.g.smithi069.stdout:May 14 15:15:42 smithi069 podman[70328]: 2024-05-14 15:15:42.522948756 +0000 UTC m=+0.197360436 container create 17f68fe0585dd1f9de39fd7429b1f88a0bbd35ac2acbb417188ab0e03ff59171 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-g, ceph=True, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-14T15:15:42.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:42 smithi092 ceph-mon[34729]: pgmap v363: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:43.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:42 smithi203 ceph-mon[34567]: pgmap v363: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:43.221 INFO:journalctl@ceph.mds.g.smithi069.stdout:May 14 15:15:42 smithi069 podman[70328]: 2024-05-14 15:15:42.810252183 +0000 UTC m=+0.484663916 container init 17f68fe0585dd1f9de39fd7429b1f88a0bbd35ac2acbb417188ab0e03ff59171 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-g, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-14T15:15:43.221 INFO:journalctl@ceph.mds.g.smithi069.stdout:May 14 15:15:42 smithi069 podman[70328]: 2024-05-14 15:15:42.820790212 +0000 UTC m=+0.495201899 container start 17f68fe0585dd1f9de39fd7429b1f88a0bbd35ac2acbb417188ab0e03ff59171 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-g, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240507) 2024-05-14T15:15:43.221 INFO:journalctl@ceph.mds.g.smithi069.stdout:May 14 15:15:42 smithi069 ceph-mds[70347]: -- 172.21.15.69:0/3925112568 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5567e3a09a40 con 0x5567e3a51600 2024-05-14T15:15:43.221 INFO:journalctl@ceph.mds.g.smithi069.stdout:May 14 15:15:42 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-g[70343]: starting mds.g at 2024-05-14T15:15:43.221 INFO:journalctl@ceph.mds.g.smithi069.stdout:May 14 15:15:42 smithi069 bash[70328]: 17f68fe0585dd1f9de39fd7429b1f88a0bbd35ac2acbb417188ab0e03ff59171 2024-05-14T15:15:43.221 INFO:journalctl@ceph.mds.g.smithi069.stdout:May 14 15:15:42 smithi069 systemd[1]: Started Ceph mds.g for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:15:43.718 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:15:44.339 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:44 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:44.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:44 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:44.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:44 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:44.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:44 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:44.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:44 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:44.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:44 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:44.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:44 smithi069 ceph-mon[31270]: Deploying daemon mds.a on smithi069 2024-05-14T15:15:44.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:44 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.69:6838/561211426,v1:172.21.15.69:6839/561211426] up:boot 2024-05-14T15:15:44.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:44 smithi069 ceph-mon[31270]: fsmap 10 up:standby 2024-05-14T15:15:44.340 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:44 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-14T15:15:44.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:44 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:44.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:44 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:44.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:44 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:44.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:44 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:44.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:44 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:44.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:44 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:44.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:44 smithi203 ceph-mon[34567]: Deploying daemon mds.a on smithi069 2024-05-14T15:15:44.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:44 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.69:6838/561211426,v1:172.21.15.69:6839/561211426] up:boot 2024-05-14T15:15:44.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:44 smithi203 ceph-mon[34567]: fsmap 10 up:standby 2024-05-14T15:15:44.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:44 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-14T15:15:44.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:44 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:44.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:44 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:44.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:44 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:44.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:44 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:44.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:44 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:44.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:44 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:44.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:44 smithi092 ceph-mon[34729]: Deploying daemon mds.a on smithi069 2024-05-14T15:15:44.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:44 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.69:6838/561211426,v1:172.21.15.69:6839/561211426] up:boot 2024-05-14T15:15:44.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:44 smithi092 ceph-mon[34729]: fsmap 10 up:standby 2024-05-14T15:15:44.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:44 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-14T15:15:44.910 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:15:45.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:45 smithi092 ceph-mon[34729]: pgmap v364: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:45.449 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:45 smithi069 ceph-mon[31270]: pgmap v364: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:45.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:45 smithi203 ceph-mon[34567]: pgmap v364: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:46.471 INFO:journalctl@ceph.mds.a.smithi069.stdout:May 14 15:15:46 smithi069 systemd[1]: Starting Ceph mds.a for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:15:47.199 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:47 smithi069 ceph-mon[31270]: pgmap v365: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:47.401 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:47 smithi203 ceph-mon[34567]: pgmap v365: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:47.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:47 smithi092 ceph-mon[34729]: pgmap v365: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:47.471 INFO:journalctl@ceph.mds.a.smithi069.stdout:May 14 15:15:47 smithi069 podman[70731]: 2024-05-14 15:15:47.105233677 +0000 UTC m=+0.038614940 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:15:47.471 INFO:journalctl@ceph.mds.a.smithi069.stdout:May 14 15:15:47 smithi069 podman[70731]: 2024-05-14 15:15:47.23739992 +0000 UTC m=+0.170781190 container create 1ec93ab2325da832c95800336154c4ad6d07e324582c8a98d8f7ea4b05e0691f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-a, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-14T15:15:47.768 INFO:journalctl@ceph.mds.a.smithi069.stdout:May 14 15:15:47 smithi069 podman[70731]: 2024-05-14 15:15:47.642614482 +0000 UTC m=+0.575995789 container init 1ec93ab2325da832c95800336154c4ad6d07e324582c8a98d8f7ea4b05e0691f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-a, ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0) 2024-05-14T15:15:47.768 INFO:journalctl@ceph.mds.a.smithi069.stdout:May 14 15:15:47 smithi069 podman[70731]: 2024-05-14 15:15:47.653209927 +0000 UTC m=+0.586591274 container start 1ec93ab2325da832c95800336154c4ad6d07e324582c8a98d8f7ea4b05e0691f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5) 2024-05-14T15:15:48.109 INFO:journalctl@ceph.mds.a.smithi069.stdout:May 14 15:15:47 smithi069 ceph-mds[70769]: -- 172.21.15.69:0/4053443490 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e7a02dfa40 con 0x55e7a0327180 2024-05-14T15:15:48.109 INFO:journalctl@ceph.mds.a.smithi069.stdout:May 14 15:15:47 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-a[70763]: starting mds.a at 2024-05-14T15:15:48.109 INFO:journalctl@ceph.mds.a.smithi069.stdout:May 14 15:15:47 smithi069 bash[70731]: 1ec93ab2325da832c95800336154c4ad6d07e324582c8a98d8f7ea4b05e0691f 2024-05-14T15:15:48.110 INFO:journalctl@ceph.mds.a.smithi069.stdout:May 14 15:15:47 smithi069 systemd[1]: Started Ceph mds.a for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:15:48.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.237+0000 7f5449800700 1 -- 172.21.15.69:0/3892556867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f544410e940 msgr2=0x7f5444110e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:48.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.237+0000 7f5449800700 1 --2- 172.21.15.69:0/3892556867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f544410e940 0x7f5444110e10 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f543c00b0a0 tx=0x7f543c00b3b0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.237+0000 7f5449800700 1 -- 172.21.15.69:0/3892556867 shutdown_connections 2024-05-14T15:15:48.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.237+0000 7f5449800700 1 --2- 172.21.15.69:0/3892556867 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f544410e940 0x7f5444110e10 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.237+0000 7f5449800700 1 --2- 172.21.15.69:0/3892556867 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5444105480 0x7f5444105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.237+0000 7f5449800700 1 --2- 172.21.15.69:0/3892556867 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5444105e60 0x7f544410e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.237+0000 7f5449800700 1 -- 172.21.15.69:0/3892556867 >> 172.21.15.69:0/3892556867 conn(0x7f54440fef50 msgr2=0x7f5444101370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:48.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.238+0000 7f5449800700 1 -- 172.21.15.69:0/3892556867 shutdown_connections 2024-05-14T15:15:48.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.238+0000 7f5449800700 1 -- 172.21.15.69:0/3892556867 wait complete. 2024-05-14T15:15:48.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.239+0000 7f5449800700 1 Processor -- start 2024-05-14T15:15:48.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.239+0000 7f5449800700 1 -- start start 2024-05-14T15:15:48.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.239+0000 7f5449800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5444105480 0x7f544419cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:48.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.239+0000 7f5449800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5444105e60 0x7f544419d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:48.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.239+0000 7f5449800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f544410e940 0x7f54441a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:48.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.239+0000 7f5449800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f54441143b0 con 0x7f544410e940 2024-05-14T15:15:48.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.239+0000 7f5449800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5444114230 con 0x7f5444105480 2024-05-14T15:15:48.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.239+0000 7f5449800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5444114530 con 0x7f5444105e60 2024-05-14T15:15:48.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.240+0000 7f5442a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5444105480 0x7f544419cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:48.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.240+0000 7f5443400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f544410e940 0x7f54441a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:48.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.240+0000 7f5442a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5444105480 0x7f544419cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:50314/0 (socket says 172.21.15.69:50314) 2024-05-14T15:15:48.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.240+0000 7f5443400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f544410e940 0x7f54441a17b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32772/0 (socket says 172.21.15.69:32772) 2024-05-14T15:15:48.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.240+0000 7f5442a00700 1 -- 172.21.15.69:0/3403246692 learned_addr learned my addr 172.21.15.69:0/3403246692 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:15:48.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.240+0000 7f5442000700 1 --2- 172.21.15.69:0/3403246692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5444105e60 0x7f544419d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:48.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.240+0000 7f5443400700 1 -- 172.21.15.69:0/3403246692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5444105e60 msgr2=0x7f544419d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:48.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.240+0000 7f5443400700 1 --2- 172.21.15.69:0/3403246692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5444105e60 0x7f544419d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.240+0000 7f5443400700 1 -- 172.21.15.69:0/3403246692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5444105480 msgr2=0x7f544419cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:48.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.240+0000 7f5443400700 1 --2- 172.21.15.69:0/3403246692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5444105480 0x7f544419cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.240+0000 7f5443400700 1 -- 172.21.15.69:0/3403246692 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54441a1e50 con 0x7f544410e940 2024-05-14T15:15:48.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.240+0000 7f5442a00700 1 --2- 172.21.15.69:0/3403246692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5444105480 0x7f544419cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:15:48.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.240+0000 7f5443400700 1 --2- 172.21.15.69:0/3403246692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f544410e940 0x7f54441a17b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f543c00b070 tx=0x7f543c004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:48.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.241+0000 7f543b400700 1 -- 172.21.15.69:0/3403246692 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543c021070 con 0x7f544410e940 2024-05-14T15:15:48.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.241+0000 7f543b400700 1 -- 172.21.15.69:0/3403246692 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f543c007b80 con 0x7f544410e940 2024-05-14T15:15:48.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.241+0000 7f5449800700 1 -- 172.21.15.69:0/3403246692 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54441a20e0 con 0x7f544410e940 2024-05-14T15:15:48.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.241+0000 7f543b400700 1 -- 172.21.15.69:0/3403246692 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543c0052a0 con 0x7f544410e940 2024-05-14T15:15:48.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.241+0000 7f5449800700 1 -- 172.21.15.69:0/3403246692 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54441a25c0 con 0x7f544410e940 2024-05-14T15:15:48.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.242+0000 7f5449800700 1 -- 172.21.15.69:0/3403246692 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54440512c0 con 0x7f544410e940 2024-05-14T15:15:48.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.245+0000 7f543b400700 1 -- 172.21.15.69:0/3403246692 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f543c024070 con 0x7f544410e940 2024-05-14T15:15:48.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.246+0000 7f543b400700 1 --2- 172.21.15.69:0/3403246692 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f54280b2880 0x7f54280b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:48.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.247+0000 7f543b400700 1 -- 172.21.15.69:0/3403246692 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f543c00f020 con 0x7f544410e940 2024-05-14T15:15:48.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.247+0000 7f5442a00700 1 --2- 172.21.15.69:0/3403246692 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f54280b2880 0x7f54280b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:48.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.248+0000 7f5442a00700 1 --2- 172.21.15.69:0/3403246692 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f54280b2880 0x7f54280b4d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5434005950 tx=0x7f543400a400 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:48.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.249+0000 7f543b400700 1 -- 172.21.15.69:0/3403246692 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f543c02b020 con 0x7f544410e940 2024-05-14T15:15:48.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.513+0000 7f5449800700 1 -- 172.21.15.69:0/3403246692 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f54441a9b20 con 0x7f544410e940 2024-05-14T15:15:48.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.514+0000 7f543b400700 1 -- 172.21.15.69:0/3403246692 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9653 (secure 0 0 0) 0x7f543c0aba60 con 0x7f544410e940 2024-05-14T15:15:48.513 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:15:48.513 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":12,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24442,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24451,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34409,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34433,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34460,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-05-14T15:15:48.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.516+0000 7f5449800700 1 -- 172.21.15.69:0/3403246692 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f54280b2880 msgr2=0x7f54280b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:48.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.516+0000 7f5449800700 1 --2- 172.21.15.69:0/3403246692 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f54280b2880 0x7f54280b4d90 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f5434005950 tx=0x7f543400a400 comp rx=0 tx=0).stop 2024-05-14T15:15:48.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.516+0000 7f5449800700 1 -- 172.21.15.69:0/3403246692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f544410e940 msgr2=0x7f54441a17b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:48.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.516+0000 7f5449800700 1 --2- 172.21.15.69:0/3403246692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f544410e940 0x7f54441a17b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f543c00b070 tx=0x7f543c004c80 comp rx=0 tx=0).stop 2024-05-14T15:15:48.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.517+0000 7f5449800700 1 -- 172.21.15.69:0/3403246692 shutdown_connections 2024-05-14T15:15:48.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.517+0000 7f5449800700 1 --2- 172.21.15.69:0/3403246692 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f544410e940 0x7f54441a17b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.517+0000 7f5449800700 1 --2- 172.21.15.69:0/3403246692 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f54280b2880 0x7f54280b4d90 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.517+0000 7f5449800700 1 --2- 172.21.15.69:0/3403246692 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5444105480 0x7f544419cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.517+0000 7f5449800700 1 --2- 172.21.15.69:0/3403246692 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5444105e60 0x7f544419d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:48.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.517+0000 7f5449800700 1 -- 172.21.15.69:0/3403246692 >> 172.21.15.69:0/3403246692 conn(0x7f54440fef50 msgr2=0x7f5444103140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:48.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.517+0000 7f5449800700 1 -- 172.21.15.69:0/3403246692 shutdown_connections 2024-05-14T15:15:48.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:48.517+0000 7f5449800700 1 -- 172.21.15.69:0/3403246692 wait complete. 2024-05-14T15:15:48.517 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 12 2024-05-14T15:15:49.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:49 smithi069 ceph-mon[31270]: pgmap v366: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:49.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:49.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:49.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:49.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:49.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:49.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:49.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:49 smithi069 ceph-mon[31270]: Deploying daemon mds.b on smithi092 2024-05-14T15:15:49.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:49 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.69:6840/2134585816,v1:172.21.15.69:6841/2134585816] up:boot 2024-05-14T15:15:49.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:49 smithi069 ceph-mon[31270]: fsmap 11 up:standby 2024-05-14T15:15:49.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:49 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-14T15:15:49.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:49 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3403246692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:49.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:49 smithi092 ceph-mon[34729]: pgmap v366: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:49.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:49.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:49.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:49.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:49.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:49.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:49.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:49 smithi092 ceph-mon[34729]: Deploying daemon mds.b on smithi092 2024-05-14T15:15:49.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:49 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.69:6840/2134585816,v1:172.21.15.69:6841/2134585816] up:boot 2024-05-14T15:15:49.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:49 smithi092 ceph-mon[34729]: fsmap 11 up:standby 2024-05-14T15:15:49.305 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:49 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-14T15:15:49.306 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:49 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3403246692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:49.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:49 smithi203 ceph-mon[34567]: pgmap v366: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:49.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:49.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:49.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:49.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-05-14T15:15:49.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-05-14T15:15:49.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:15:49.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:49 smithi203 ceph-mon[34567]: Deploying daemon mds.b on smithi092 2024-05-14T15:15:49.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:49 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.69:6840/2134585816,v1:172.21.15.69:6841/2134585816] up:boot 2024-05-14T15:15:49.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:49 smithi203 ceph-mon[34567]: fsmap 11 up:standby 2024-05-14T15:15:49.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:49 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-14T15:15:49.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:49 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3403246692' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:51.167 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:51 smithi092 ceph-mon[34729]: pgmap v367: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:51.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:51 smithi203 ceph-mon[34567]: pgmap v367: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:51.436 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:15:51.440 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:15:51 smithi092 systemd[1]: Starting Ceph mds.b for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:15:51.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:51 smithi069 ceph-mon[31270]: pgmap v367: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:51.855 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:15:51 smithi092 podman[64538]: 2024-05-14 15:15:51.46174159 +0000 UTC m=+0.041768219 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:15:51.855 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:15:51 smithi092 podman[64538]: 2024-05-14 15:15:51.59310283 +0000 UTC m=+0.173129441 container create bc41471641aefa1ed89602b147212d427d0617c12f51ab48c068ca50b53ca30d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.vendor=CentOS) 2024-05-14T15:15:51.855 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:15:51 smithi092 podman[64538]: 2024-05-14 15:15:51.856025769 +0000 UTC m=+0.436052403 container init bc41471641aefa1ed89602b147212d427d0617c12f51ab48c068ca50b53ca30d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507) 2024-05-14T15:15:51.885 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:15:52.191 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:15:51 smithi092 podman[64538]: 2024-05-14 15:15:51.864732082 +0000 UTC m=+0.444758697 container start bc41471641aefa1ed89602b147212d427d0617c12f51ab48c068ca50b53ca30d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-14T15:15:52.192 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:15:51 smithi092 bash[64538]: bc41471641aefa1ed89602b147212d427d0617c12f51ab48c068ca50b53ca30d 2024-05-14T15:15:52.192 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:15:51 smithi092 systemd[1]: Started Ceph mds.b for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:15:52.192 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:15:51 smithi092 ceph-mds[64564]: -- 172.21.15.92:0/3760747997 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557991d27a40 con 0x557991d6fa80 2024-05-14T15:15:52.192 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:15:51 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b[64556]: starting mds.b at 2024-05-14T15:15:53.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:53 smithi092 ceph-mon[34729]: pgmap v368: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:53.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:53 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] up:boot 2024-05-14T15:15:53.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:53 smithi092 ceph-mon[34729]: fsmap 12 up:standby 2024-05-14T15:15:53.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:53 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-14T15:15:53.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:53 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:53.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:53 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:53.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:53 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:53.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:53 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:53.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:53 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:53.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:53 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:15:53.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:53 smithi069 ceph-mon[31270]: pgmap v368: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:53.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:53 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] up:boot 2024-05-14T15:15:53.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:53 smithi069 ceph-mon[31270]: fsmap 12 up:standby 2024-05-14T15:15:53.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:53 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-14T15:15:53.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:53 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:53.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:53 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:53.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:53 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:53.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:53 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:53.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:53 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:53.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:53 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:15:53.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:53 smithi203 ceph-mon[34567]: pgmap v368: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:53.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:53 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] up:boot 2024-05-14T15:15:53.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:53 smithi203 ceph-mon[34567]: fsmap 12 up:standby 2024-05-14T15:15:53.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:53 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-14T15:15:53.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:53 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:53.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:53 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:53.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:53 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:53.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:53 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:53.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:53 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:53.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:53 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:15:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.223+0000 7fbe97c00700 1 -- 172.21.15.69:0/3515767860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe90108f20 msgr2=0x7fbe90109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.223+0000 7fbe97c00700 1 --2- 172.21.15.69:0/3515767860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe90108f20 0x7fbe90109330 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c0099c0 tx=0x7fbe7c009cd0 comp rx=0 tx=0).stop 2024-05-14T15:15:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.223+0000 7fbe97c00700 1 -- 172.21.15.69:0/3515767860 shutdown_connections 2024-05-14T15:15:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.223+0000 7fbe97c00700 1 --2- 172.21.15.69:0/3515767860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe90109870 0x7fbe901111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.223+0000 7fbe97c00700 1 --2- 172.21.15.69:0/3515767860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe901045f0 0x7fbe90104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.223+0000 7fbe97c00700 1 --2- 172.21.15.69:0/3515767860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe90108f20 0x7fbe90109330 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.223+0000 7fbe97c00700 1 -- 172.21.15.69:0/3515767860 >> 172.21.15.69:0/3515767860 conn(0x7fbe90100040 msgr2=0x7fbe90102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.223+0000 7fbe97c00700 1 -- 172.21.15.69:0/3515767860 shutdown_connections 2024-05-14T15:15:54.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.223+0000 7fbe97c00700 1 -- 172.21.15.69:0/3515767860 wait complete. 2024-05-14T15:15:54.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.224+0000 7fbe97c00700 1 Processor -- start 2024-05-14T15:15:54.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.224+0000 7fbe97c00700 1 -- start start 2024-05-14T15:15:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.225+0000 7fbe97c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe901045f0 0x7fbe9019ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.225+0000 7fbe97c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe90108f20 0x7fbe9019b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.225+0000 7fbe97c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe90109870 0x7fbe9019f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.225+0000 7fbe97c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbe90114330 con 0x7fbe901045f0 2024-05-14T15:15:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.225+0000 7fbe97c00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbe901141b0 con 0x7fbe90108f20 2024-05-14T15:15:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.225+0000 7fbe97c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbe901144b0 con 0x7fbe90109870 2024-05-14T15:15:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.225+0000 7fbe95200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe901045f0 0x7fbe9019ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.225+0000 7fbe95200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe901045f0 0x7fbe9019ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37988/0 (socket says 172.21.15.69:37988) 2024-05-14T15:15:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.225+0000 7fbe95200700 1 -- 172.21.15.69:0/3330701203 learned_addr learned my addr 172.21.15.69:0/3330701203 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:15:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.225+0000 7fbe8fe00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe90108f20 0x7fbe9019b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:54.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.226+0000 7fbe95c00700 1 --2- 172.21.15.69:0/3330701203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe90109870 0x7fbe9019f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:54.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.226+0000 7fbe95200700 1 -- 172.21.15.69:0/3330701203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe90109870 msgr2=0x7fbe9019f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:54.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.226+0000 7fbe95200700 1 --2- 172.21.15.69:0/3330701203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe90109870 0x7fbe9019f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:54.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.226+0000 7fbe95200700 1 -- 172.21.15.69:0/3330701203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe90108f20 msgr2=0x7fbe9019b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:54.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.226+0000 7fbe95200700 1 --2- 172.21.15.69:0/3330701203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe90108f20 0x7fbe9019b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:54.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.226+0000 7fbe95200700 1 -- 172.21.15.69:0/3330701203 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe9019fbf0 con 0x7fbe901045f0 2024-05-14T15:15:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.226+0000 7fbe8fe00700 1 --2- 172.21.15.69:0/3330701203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe90108f20 0x7fbe9019b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:15:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.226+0000 7fbe95200700 1 --2- 172.21.15.69:0/3330701203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe901045f0 0x7fbe9019ad20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400d950 tx=0x7fbe8400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.226+0000 7fbe8d600700 1 -- 172.21.15.69:0/3330701203 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe84016070 con 0x7fbe901045f0 2024-05-14T15:15:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.227+0000 7fbe97c00700 1 -- 172.21.15.69:0/3330701203 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe9019fee0 con 0x7fbe901045f0 2024-05-14T15:15:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.227+0000 7fbe8d600700 1 -- 172.21.15.69:0/3330701203 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe84009dd0 con 0x7fbe901045f0 2024-05-14T15:15:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.227+0000 7fbe8d600700 1 -- 172.21.15.69:0/3330701203 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe8400f3c0 con 0x7fbe901045f0 2024-05-14T15:15:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.227+0000 7fbe97c00700 1 -- 172.21.15.69:0/3330701203 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe901a7800 con 0x7fbe901045f0 2024-05-14T15:15:54.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.228+0000 7fbe97c00700 1 -- 172.21.15.69:0/3330701203 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe90105aa0 con 0x7fbe901045f0 2024-05-14T15:15:54.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.231+0000 7fbe8d600700 1 -- 172.21.15.69:0/3330701203 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fbe84019070 con 0x7fbe901045f0 2024-05-14T15:15:54.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.232+0000 7fbe8d600700 1 --2- 172.21.15.69:0/3330701203 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbe780b2880 0x7fbe780b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:54.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.233+0000 7fbe8d600700 1 -- 172.21.15.69:0/3330701203 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7fbe840e19f0 con 0x7fbe901045f0 2024-05-14T15:15:54.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.233+0000 7fbe8fe00700 1 --2- 172.21.15.69:0/3330701203 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbe780b2880 0x7fbe780b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:54.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.234+0000 7fbe8fe00700 1 --2- 172.21.15.69:0/3330701203 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbe780b2880 0x7fbe780b4d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c000c00 tx=0x7fbe7c01a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:54.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.238+0000 7fbe8d600700 1 -- 172.21.15.69:0/3330701203 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbe840a9b10 con 0x7fbe901045f0 2024-05-14T15:15:54.539 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.541+0000 7fbe97c00700 1 -- 172.21.15.69:0/3330701203 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe9019c080 con 0x7fbe901045f0 2024-05-14T15:15:54.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.542+0000 7fbe8d600700 1 -- 172.21.15.69:0/3330701203 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10479 (secure 0 0 0) 0x7fbe840a9410 con 0x7fbe901045f0 2024-05-14T15:15:54.540 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:15:54.540 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":13,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24442,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24451,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34409,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34433,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34460,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":34490,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-05-14T15:15:54.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.544+0000 7fbe97c00700 1 -- 172.21.15.69:0/3330701203 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbe780b2880 msgr2=0x7fbe780b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:54.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.544+0000 7fbe97c00700 1 --2- 172.21.15.69:0/3330701203 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbe780b2880 0x7fbe780b4d90 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fbe7c000c00 tx=0x7fbe7c01a040 comp rx=0 tx=0).stop 2024-05-14T15:15:54.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.544+0000 7fbe97c00700 1 -- 172.21.15.69:0/3330701203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe901045f0 msgr2=0x7fbe9019ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:54.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.544+0000 7fbe97c00700 1 --2- 172.21.15.69:0/3330701203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe901045f0 0x7fbe9019ad20 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbe8400d950 tx=0x7fbe8400dc60 comp rx=0 tx=0).stop 2024-05-14T15:15:54.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.545+0000 7fbe97c00700 1 -- 172.21.15.69:0/3330701203 shutdown_connections 2024-05-14T15:15:54.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.545+0000 7fbe97c00700 1 --2- 172.21.15.69:0/3330701203 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe901045f0 0x7fbe9019ad20 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:54.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.545+0000 7fbe97c00700 1 --2- 172.21.15.69:0/3330701203 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbe780b2880 0x7fbe780b4d90 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:54.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.545+0000 7fbe97c00700 1 --2- 172.21.15.69:0/3330701203 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe90109870 0x7fbe9019f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:54.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.545+0000 7fbe97c00700 1 --2- 172.21.15.69:0/3330701203 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe90108f20 0x7fbe9019b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:54.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.545+0000 7fbe97c00700 1 -- 172.21.15.69:0/3330701203 >> 172.21.15.69:0/3330701203 conn(0x7fbe90100040 msgr2=0x7fbe9010a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:54.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.545+0000 7fbe97c00700 1 -- 172.21.15.69:0/3330701203 shutdown_connections 2024-05-14T15:15:54.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:54.545+0000 7fbe97c00700 1 -- 172.21.15.69:0/3330701203 wait complete. 2024-05-14T15:15:54.544 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 13 2024-05-14T15:15:54.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:54 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:54.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:54 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:54.744 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:54 smithi069 ceph-mon[31270]: pgmap v369: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:54.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:54 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:54.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:54 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:54.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:54 smithi203 ceph-mon[34567]: pgmap v369: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:54.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:54 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:54.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:54 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:54.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:54 smithi092 ceph-mon[34729]: pgmap v369: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:55.627 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-05-14T15:15:55.746 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:55 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3330701203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:55.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:55 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3330701203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:55.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:55 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3330701203' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:15:56.119 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:15:56.576 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:56 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:56.576 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:56 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:56.576 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:56 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:56.576 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:56 smithi069 ceph-mon[31270]: pgmap v370: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:56.576 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:56 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:56.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:56 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:56.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:56 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:56.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:56 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:56.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:56 smithi203 ceph-mon[34567]: pgmap v370: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:56.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:56 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:56.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:56 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:56.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:56 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:56.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:56 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:56.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:56 smithi092 ceph-mon[34729]: pgmap v370: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:56.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:56 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:57.789 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:57 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:57.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:57 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:57.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:57 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:58.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.438+0000 7f94da800700 1 -- 172.21.15.69:0/1491800600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f94d4109850 msgr2=0x7f94d41111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:58.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.438+0000 7f94da800700 1 --2- 172.21.15.69:0/1491800600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f94d4109850 0x7f94d41111b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f94cc00b0d0 tx=0x7f94cc00b3e0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.438+0000 7f94da800700 1 -- 172.21.15.69:0/1491800600 shutdown_connections 2024-05-14T15:15:58.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.438+0000 7f94da800700 1 --2- 172.21.15.69:0/1491800600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f94d4109850 0x7f94d41111b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.438+0000 7f94da800700 1 --2- 172.21.15.69:0/1491800600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94d41045d0 0x7f94d41049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.438+0000 7f94da800700 1 --2- 172.21.15.69:0/1491800600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94d4108f00 0x7f94d4109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.438+0000 7f94da800700 1 -- 172.21.15.69:0/1491800600 >> 172.21.15.69:0/1491800600 conn(0x7f94d40ffea0 msgr2=0x7f94d41022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:58.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.438+0000 7f94da800700 1 -- 172.21.15.69:0/1491800600 shutdown_connections 2024-05-14T15:15:58.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.438+0000 7f94da800700 1 -- 172.21.15.69:0/1491800600 wait complete. 2024-05-14T15:15:58.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.440+0000 7f94da800700 1 Processor -- start 2024-05-14T15:15:58.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.440+0000 7f94da800700 1 -- start start 2024-05-14T15:15:58.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.441+0000 7f94da800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94d41045d0 0x7f94d419ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.441+0000 7f94da800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94d4108f00 0x7f94d419b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.441+0000 7f94da800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f94d4109850 0x7f94d419f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.441+0000 7f94da800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f94d4114330 con 0x7f94d4109850 2024-05-14T15:15:58.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.441+0000 7f94da800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f94d41141b0 con 0x7f94d41045d0 2024-05-14T15:15:58.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.441+0000 7f94da800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f94d41144b0 con 0x7f94d4108f00 2024-05-14T15:15:58.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.441+0000 7f94d3e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f94d4109850 0x7f94d419f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.441+0000 7f94d3e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f94d4109850 0x7f94d419f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38014/0 (socket says 172.21.15.69:38014) 2024-05-14T15:15:58.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.441+0000 7f94d3e00700 1 -- 172.21.15.69:0/1507716790 learned_addr learned my addr 172.21.15.69:0/1507716790 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:15:58.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.441+0000 7f94d3400700 1 --2- 172.21.15.69:0/1507716790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94d41045d0 0x7f94d419ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.441+0000 7f94d2a00700 1 --2- 172.21.15.69:0/1507716790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94d4108f00 0x7f94d419b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.442+0000 7f94d3e00700 1 -- 172.21.15.69:0/1507716790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94d4108f00 msgr2=0x7f94d419b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:58.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.442+0000 7f94d3e00700 1 --2- 172.21.15.69:0/1507716790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94d4108f00 0x7f94d419b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.442+0000 7f94d3e00700 1 -- 172.21.15.69:0/1507716790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94d41045d0 msgr2=0x7f94d419ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:58.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.442+0000 7f94d3e00700 1 --2- 172.21.15.69:0/1507716790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94d41045d0 0x7f94d419ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.442+0000 7f94d3e00700 1 -- 172.21.15.69:0/1507716790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d419fbf0 con 0x7f94d4109850 2024-05-14T15:15:58.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.442+0000 7f94d3e00700 1 --2- 172.21.15.69:0/1507716790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f94d4109850 0x7f94d419f550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009850 tx=0x7f94cc007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:58.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.443+0000 7f94cbe00700 1 -- 172.21.15.69:0/1507716790 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc01f070 con 0x7f94d4109850 2024-05-14T15:15:58.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.443+0000 7f94cbe00700 1 -- 172.21.15.69:0/1507716790 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f94cc004c50 con 0x7f94d4109850 2024-05-14T15:15:58.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.443+0000 7f94cbe00700 1 -- 172.21.15.69:0/1507716790 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94cc01b690 con 0x7f94d4109850 2024-05-14T15:15:58.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.443+0000 7f94da800700 1 -- 172.21.15.69:0/1507716790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d419fe80 con 0x7f94d4109850 2024-05-14T15:15:58.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.443+0000 7f94da800700 1 -- 172.21.15.69:0/1507716790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d4076b00 con 0x7f94d4109850 2024-05-14T15:15:58.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.444+0000 7f94da800700 1 -- 172.21.15.69:0/1507716790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d4105a80 con 0x7f94d4109850 2024-05-14T15:15:58.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.449+0000 7f94cbe00700 1 -- 172.21.15.69:0/1507716790 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f94cc022070 con 0x7f94d4109850 2024-05-14T15:15:58.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.450+0000 7f94cbe00700 1 --2- 172.21.15.69:0/1507716790 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f94b80b2900 0x7f94b80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:15:58.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.450+0000 7f94cbe00700 1 -- 172.21.15.69:0/1507716790 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f94cc00f020 con 0x7f94d4109850 2024-05-14T15:15:58.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.451+0000 7f94d3400700 1 --2- 172.21.15.69:0/1507716790 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f94b80b2900 0x7f94b80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:15:58.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.452+0000 7f94d3400700 1 --2- 172.21.15.69:0/1507716790 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f94b80b2900 0x7f94b80b4e10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f94c4007be0 tx=0x7f94c40073d0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:15:58.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.454+0000 7f94cbe00700 1 -- 172.21.15.69:0/1507716790 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f94cc029020 con 0x7f94d4109850 2024-05-14T15:15:58.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.693+0000 7f94da800700 1 -- 172.21.15.69:0/1507716790 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f94d419c080 con 0x7f94d4109850 2024-05-14T15:15:58.692 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:58 smithi069 ceph-mon[31270]: pgmap v371: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:58.692 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:58.692 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:58 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:58.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.694+0000 7f94cbe00700 1 -- 172.21.15.69:0/1507716790 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) ==== 84+0+65 (secure 0 0 0) 0x7f94cc0ab4e0 con 0x7f94d4109850 2024-05-14T15:15:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:15:58.693 INFO:teuthology.orchestra.run.smithi069.stdout:[ 2024-05-14T15:15:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:15:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: "poolnum": 1, 2024-05-14T15:15:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: "poolname": ".mgr" 2024-05-14T15:15:58.693 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:15:58.693 INFO:teuthology.orchestra.run.smithi069.stdout:] 2024-05-14T15:15:58.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.697+0000 7f94da800700 1 -- 172.21.15.69:0/1507716790 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f94b80b2900 msgr2=0x7f94b80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:58.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.697+0000 7f94da800700 1 --2- 172.21.15.69:0/1507716790 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f94b80b2900 0x7f94b80b4e10 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f94c4007be0 tx=0x7f94c40073d0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.697+0000 7f94da800700 1 -- 172.21.15.69:0/1507716790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f94d4109850 msgr2=0x7f94d419f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:15:58.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.697+0000 7f94da800700 1 --2- 172.21.15.69:0/1507716790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f94d4109850 0x7f94d419f550 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f94cc009850 tx=0x7f94cc007a20 comp rx=0 tx=0).stop 2024-05-14T15:15:58.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.697+0000 7f94da800700 1 -- 172.21.15.69:0/1507716790 shutdown_connections 2024-05-14T15:15:58.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.697+0000 7f94da800700 1 --2- 172.21.15.69:0/1507716790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f94d4109850 0x7f94d419f550 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.697+0000 7f94da800700 1 --2- 172.21.15.69:0/1507716790 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f94b80b2900 0x7f94b80b4e10 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.697+0000 7f94da800700 1 --2- 172.21.15.69:0/1507716790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f94d41045d0 0x7f94d419ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.697+0000 7f94da800700 1 --2- 172.21.15.69:0/1507716790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f94d4108f00 0x7f94d419b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:15:58.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.697+0000 7f94da800700 1 -- 172.21.15.69:0/1507716790 >> 172.21.15.69:0/1507716790 conn(0x7f94d40ffea0 msgr2=0x7f94d41086a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:15:58.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.697+0000 7f94da800700 1 -- 172.21.15.69:0/1507716790 shutdown_connections 2024-05-14T15:15:58.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:15:58.697+0000 7f94da800700 1 -- 172.21.15.69:0/1507716790 wait complete. 2024-05-14T15:15:58.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:58 smithi203 ceph-mon[34567]: pgmap v371: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:58.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:58 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:58.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:58 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:58.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:58 smithi092 ceph-mon[34729]: pgmap v371: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:15:58.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:58 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:58.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:58 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:15:59.655 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-14T15:15:59.655 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-14T15:15:59.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:15:59 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1507716790' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-14T15:15:59.890 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:15:59 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1507716790' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-14T15:15:59.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:15:59 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1507716790' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-05-14T15:16:00.063 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:16:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:00 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:16:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:00 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:16:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:00 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:00 smithi203 ceph-mon[34567]: pgmap v372: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:00.842 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:00 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:16:00.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:00 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:16:00.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:00 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:16:00.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:00 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:00.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:00 smithi092 ceph-mon[34729]: pgmap v372: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:00.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:00 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:16:00.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:00 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:16:00.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:00 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:16:00.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:00 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:00.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:00 smithi069 ceph-mon[31270]: pgmap v372: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:00.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:00 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:16:02.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.374+0000 7f9d0b200700 1 -- 172.21.15.69:0/549966922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d0c10a7c0 msgr2=0x7f9d0c10abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:02.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.374+0000 7f9d0b200700 1 --2- 172.21.15.69:0/549966922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d0c10a7c0 0x7f9d0c10abd0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f9cf8009990 tx=0x7f9cf8009ca0 comp rx=0 tx=0).stop 2024-05-14T15:16:02.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.374+0000 7f9d0b200700 1 -- 172.21.15.69:0/549966922 shutdown_connections 2024-05-14T15:16:02.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.374+0000 7f9d0b200700 1 --2- 172.21.15.69:0/549966922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d0c10b110 0x7f9d0c117620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:02.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.374+0000 7f9d0b200700 1 --2- 172.21.15.69:0/549966922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d0c10f6c0 0x7f9d0c10fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:02.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.374+0000 7f9d0b200700 1 --2- 172.21.15.69:0/549966922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d0c10a7c0 0x7f9d0c10abd0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:02.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.374+0000 7f9d0b200700 1 -- 172.21.15.69:0/549966922 >> 172.21.15.69:0/549966922 conn(0x7f9d0c076b00 msgr2=0x7f9d0c076f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:02.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.374+0000 7f9d0b200700 1 -- 172.21.15.69:0/549966922 shutdown_connections 2024-05-14T15:16:02.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.374+0000 7f9d0b200700 1 -- 172.21.15.69:0/549966922 wait complete. 2024-05-14T15:16:02.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.376+0000 7f9d0b200700 1 Processor -- start 2024-05-14T15:16:02.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.376+0000 7f9d0b200700 1 -- start start 2024-05-14T15:16:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.377+0000 7f9d0b200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d0c10a7c0 0x7f9d0c1a1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.377+0000 7f9d0b200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d0c10b110 0x7f9d0c1a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.377+0000 7f9d0b200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d0c10f6c0 0x7f9d0c1a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.377+0000 7f9d0b200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c11a7d0 con 0x7f9d0c10a7c0 2024-05-14T15:16:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.377+0000 7f9d0b200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c11a650 con 0x7f9d0c10b110 2024-05-14T15:16:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.377+0000 7f9d0b200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0c11a950 con 0x7f9d0c10f6c0 2024-05-14T15:16:02.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.377+0000 7f9d09e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d0c10a7c0 0x7f9d0c1a1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:02.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.377+0000 7f9d09e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d0c10a7c0 0x7f9d0c1a1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38024/0 (socket says 172.21.15.69:38024) 2024-05-14T15:16:02.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.377+0000 7f9d09e00700 1 -- 172.21.15.69:0/1157097243 learned_addr learned my addr 172.21.15.69:0/1157097243 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:02.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.377+0000 7f9d0a800700 1 --2- 172.21.15.69:0/1157097243 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d0c10f6c0 0x7f9d0c1a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:02.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.377+0000 7f9d09400700 1 --2- 172.21.15.69:0/1157097243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d0c10b110 0x7f9d0c1a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:02.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.377+0000 7f9d09e00700 1 -- 172.21.15.69:0/1157097243 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d0c10f6c0 msgr2=0x7f9d0c1a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:02.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.377+0000 7f9d09e00700 1 --2- 172.21.15.69:0/1157097243 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d0c10f6c0 0x7f9d0c1a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:02.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.377+0000 7f9d09e00700 1 -- 172.21.15.69:0/1157097243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d0c10b110 msgr2=0x7f9d0c1a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:02.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.377+0000 7f9d09e00700 1 --2- 172.21.15.69:0/1157097243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d0c10b110 0x7f9d0c1a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:02.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.377+0000 7f9d09e00700 1 -- 172.21.15.69:0/1157097243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d0c1a6030 con 0x7f9d0c10a7c0 2024-05-14T15:16:02.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.378+0000 7f9d09e00700 1 --2- 172.21.15.69:0/1157097243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d0c10a7c0 0x7f9d0c1a1160 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00e9a0 tx=0x7f9cfc00ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:02.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.378+0000 7f9d02a00700 1 -- 172.21.15.69:0/1157097243 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc00cbd0 con 0x7f9d0c10a7c0 2024-05-14T15:16:02.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.378+0000 7f9d0b200700 1 -- 172.21.15.69:0/1157097243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d0c1a6320 con 0x7f9d0c10a7c0 2024-05-14T15:16:02.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.378+0000 7f9d02a00700 1 -- 172.21.15.69:0/1157097243 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9cfc00cd70 con 0x7f9d0c10a7c0 2024-05-14T15:16:02.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.378+0000 7f9d02a00700 1 -- 172.21.15.69:0/1157097243 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cfc018680 con 0x7f9d0c10a7c0 2024-05-14T15:16:02.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.378+0000 7f9d0b200700 1 -- 172.21.15.69:0/1157097243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d0c1adc40 con 0x7f9d0c10a7c0 2024-05-14T15:16:02.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.379+0000 7f9d0b200700 1 -- 172.21.15.69:0/1157097243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d0c0512c0 con 0x7f9d0c10a7c0 2024-05-14T15:16:02.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.382+0000 7f9d02a00700 1 -- 172.21.15.69:0/1157097243 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9cfc010950 con 0x7f9d0c10a7c0 2024-05-14T15:16:02.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.385+0000 7f9d02a00700 1 --2- 172.21.15.69:0/1157097243 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9cf00b2900 0x7f9cf00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:02.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.385+0000 7f9d02a00700 1 -- 172.21.15.69:0/1157097243 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 7127+0+0 (secure 0 0 0) 0x7f9cfc0e2260 con 0x7f9d0c10a7c0 2024-05-14T15:16:02.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.385+0000 7f9d09400700 1 --2- 172.21.15.69:0/1157097243 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9cf00b2900 0x7f9cf00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:02.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.386+0000 7f9d09400700 1 --2- 172.21.15.69:0/1157097243 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9cf00b2900 0x7f9cf00b4e10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800b2e0 tx=0x7f9cf8005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:02.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.387+0000 7f9d02a00700 1 -- 172.21.15.69:0/1157097243 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9cfc0aa380 con 0x7f9d0c10a7c0 2024-05-14T15:16:02.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.623+0000 7f9d0b200700 1 -- 172.21.15.69:0/1157097243 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9d0c1a24c0 con 0x7f9d0c10a7c0 2024-05-14T15:16:02.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.693+0000 7f9d02a00700 1 -- 172.21.15.69:0/1157097243 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) ==== 138+0+0 (secure 0 0 0) 0x7f9cfc0a9c80 con 0x7f9d0c10a7c0 2024-05-14T15:16:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.697+0000 7f9d0b200700 1 -- 172.21.15.69:0/1157097243 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9cf00b2900 msgr2=0x7f9cf00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.697+0000 7f9d0b200700 1 --2- 172.21.15.69:0/1157097243 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9cf00b2900 0x7f9cf00b4e10 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f9cf800b2e0 tx=0x7f9cf8005fb0 comp rx=0 tx=0).stop 2024-05-14T15:16:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.697+0000 7f9d0b200700 1 -- 172.21.15.69:0/1157097243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d0c10a7c0 msgr2=0x7f9d0c1a1160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:02.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.697+0000 7f9d0b200700 1 --2- 172.21.15.69:0/1157097243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d0c10a7c0 0x7f9d0c1a1160 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9cfc00e9a0 tx=0x7f9cfc00ed60 comp rx=0 tx=0).stop 2024-05-14T15:16:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.697+0000 7f9d0b200700 1 -- 172.21.15.69:0/1157097243 shutdown_connections 2024-05-14T15:16:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.697+0000 7f9d0b200700 1 --2- 172.21.15.69:0/1157097243 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d0c10a7c0 0x7f9d0c1a1160 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.697+0000 7f9d0b200700 1 --2- 172.21.15.69:0/1157097243 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9cf00b2900 0x7f9cf00b4e10 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.697+0000 7f9d0b200700 1 --2- 172.21.15.69:0/1157097243 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d0c10f6c0 0x7f9d0c1a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.697+0000 7f9d0b200700 1 --2- 172.21.15.69:0/1157097243 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d0c10b110 0x7f9d0c1a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:02.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.697+0000 7f9d0b200700 1 -- 172.21.15.69:0/1157097243 >> 172.21.15.69:0/1157097243 conn(0x7f9d0c076b00 msgr2=0x7f9d0c1088e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:02.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.698+0000 7f9d0b200700 1 -- 172.21.15.69:0/1157097243 shutdown_connections 2024-05-14T15:16:02.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:02.698+0000 7f9d0b200700 1 -- 172.21.15.69:0/1157097243 wait complete. 2024-05-14T15:16:02.703 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_metadata' created 2024-05-14T15:16:02.938 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:02 smithi092 ceph-mon[34729]: pgmap v373: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:02.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:02 smithi069 ceph-mon[31270]: pgmap v373: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:03.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:02 smithi203 ceph-mon[34567]: pgmap v373: 1 pgs: 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:03.785 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-14T15:16:03.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:03 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1157097243' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-14T15:16:03.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:03 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1157097243' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-14T15:16:03.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:03 smithi092 ceph-mon[34729]: osdmap e74: 12 total, 12 up, 12 in 2024-05-14T15:16:03.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:03 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:03.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:03 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:03.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:03 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:03.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:03 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:03.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:03 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1157097243' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-14T15:16:03.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:03 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1157097243' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-14T15:16:03.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:03 smithi069 ceph-mon[31270]: osdmap e74: 12 total, 12 up, 12 in 2024-05-14T15:16:03.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:03 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:03.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:03 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:03.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:03 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:03.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:03 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:04.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:03 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1157097243' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-05-14T15:16:04.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:03 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1157097243' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-05-14T15:16:04.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:03 smithi203 ceph-mon[34567]: osdmap e74: 12 total, 12 up, 12 in 2024-05-14T15:16:04.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:03 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:04.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:03 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:04.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:03 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:04.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:03 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:04.209 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:16:04.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:04 smithi069 ceph-mon[31270]: pgmap v375: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:04.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:04 smithi069 ceph-mon[31270]: osdmap e75: 12 total, 12 up, 12 in 2024-05-14T15:16:04.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:04 smithi069 ceph-mon[31270]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T15:16:05.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:04 smithi203 ceph-mon[34567]: pgmap v375: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:05.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:04 smithi203 ceph-mon[34567]: osdmap e75: 12 total, 12 up, 12 in 2024-05-14T15:16:05.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:04 smithi203 ceph-mon[34567]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T15:16:05.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:04 smithi092 ceph-mon[34729]: pgmap v375: 33 pgs: 7 creating+peering, 25 unknown, 1 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:05.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:04 smithi092 ceph-mon[34729]: osdmap e75: 12 total, 12 up, 12 in 2024-05-14T15:16:05.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:04 smithi092 ceph-mon[34729]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T15:16:05.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:05 smithi069 ceph-mon[31270]: osdmap e76: 12 total, 12 up, 12 in 2024-05-14T15:16:05.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:05.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:05.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:16:05.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:16:05.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:05 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:05.995 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:05 smithi203 ceph-mon[34567]: osdmap e76: 12 total, 12 up, 12 in 2024-05-14T15:16:05.995 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:05.995 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:05.995 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:16:05.995 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:16:05.995 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:05 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:06.093 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:05 smithi092 ceph-mon[34729]: osdmap e76: 12 total, 12 up, 12 in 2024-05-14T15:16:06.093 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:06.093 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:06.093 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:16:06.093 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:16:06.093 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:05 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:16:06.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.683+0000 7fc371a00700 1 -- 172.21.15.69:0/3647038404 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc36c109870 msgr2=0x7fc36c1111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:06.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.683+0000 7fc371a00700 1 --2- 172.21.15.69:0/3647038404 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc36c109870 0x7fc36c1111d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fc36400b0d0 tx=0x7fc36400b3e0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.683+0000 7fc371a00700 1 -- 172.21.15.69:0/3647038404 shutdown_connections 2024-05-14T15:16:06.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.683+0000 7fc371a00700 1 --2- 172.21.15.69:0/3647038404 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc36c109870 0x7fc36c1111d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.683+0000 7fc371a00700 1 --2- 172.21.15.69:0/3647038404 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc36c1045f0 0x7fc36c104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.683+0000 7fc371a00700 1 --2- 172.21.15.69:0/3647038404 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc36c108f20 0x7fc36c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.683+0000 7fc371a00700 1 -- 172.21.15.69:0/3647038404 >> 172.21.15.69:0/3647038404 conn(0x7fc36c0ffec0 msgr2=0x7fc36c102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:06.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.683+0000 7fc371a00700 1 -- 172.21.15.69:0/3647038404 shutdown_connections 2024-05-14T15:16:06.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.684+0000 7fc371a00700 1 -- 172.21.15.69:0/3647038404 wait complete. 2024-05-14T15:16:06.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.685+0000 7fc371a00700 1 Processor -- start 2024-05-14T15:16:06.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.685+0000 7fc371a00700 1 -- start start 2024-05-14T15:16:06.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.685+0000 7fc371a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc36c1045f0 0x7fc36c19ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.685+0000 7fc371a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc36c108f20 0x7fc36c19b2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.686+0000 7fc371a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc36c109870 0x7fc36c19f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.686+0000 7fc371a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c1143a0 con 0x7fc36c109870 2024-05-14T15:16:06.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.686+0000 7fc371a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c114220 con 0x7fc36c1045f0 2024-05-14T15:16:06.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.686+0000 7fc371a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc36c114520 con 0x7fc36c108f20 2024-05-14T15:16:06.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.686+0000 7fc36b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc36c109870 0x7fc36c19f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.686+0000 7fc36b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc36c109870 0x7fc36c19f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51080/0 (socket says 172.21.15.69:51080) 2024-05-14T15:16:06.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.686+0000 7fc36b400700 1 -- 172.21.15.69:0/622036827 learned_addr learned my addr 172.21.15.69:0/622036827 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:06.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.686+0000 7fc36a000700 1 --2- 172.21.15.69:0/622036827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc36c108f20 0x7fc36c19b2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.686+0000 7fc36aa00700 1 --2- 172.21.15.69:0/622036827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc36c1045f0 0x7fc36c19ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.686+0000 7fc36b400700 1 -- 172.21.15.69:0/622036827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc36c108f20 msgr2=0x7fc36c19b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.686+0000 7fc36b400700 1 --2- 172.21.15.69:0/622036827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc36c108f20 0x7fc36c19b2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.686+0000 7fc36b400700 1 -- 172.21.15.69:0/622036827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc36c1045f0 msgr2=0x7fc36c19ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.686+0000 7fc36b400700 1 --2- 172.21.15.69:0/622036827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc36c1045f0 0x7fc36c19ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.686+0000 7fc36b400700 1 -- 172.21.15.69:0/622036827 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc36c19fbe0 con 0x7fc36c109870 2024-05-14T15:16:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.687+0000 7fc36b400700 1 --2- 172.21.15.69:0/622036827 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc36c109870 0x7fc36c19f540 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc364007d10 tx=0x7fc364007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.687+0000 7fc363400700 1 -- 172.21.15.69:0/622036827 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36401f020 con 0x7fc36c109870 2024-05-14T15:16:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.687+0000 7fc363400700 1 -- 172.21.15.69:0/622036827 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc364003e10 con 0x7fc36c109870 2024-05-14T15:16:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.687+0000 7fc371a00700 1 -- 172.21.15.69:0/622036827 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc36c19fe70 con 0x7fc36c109870 2024-05-14T15:16:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.687+0000 7fc363400700 1 -- 172.21.15.69:0/622036827 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc36401bab0 con 0x7fc36c109870 2024-05-14T15:16:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.687+0000 7fc371a00700 1 -- 172.21.15.69:0/622036827 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc36c1a77f0 con 0x7fc36c109870 2024-05-14T15:16:06.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.688+0000 7fc371a00700 1 -- 172.21.15.69:0/622036827 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc36c105aa0 con 0x7fc36c109870 2024-05-14T15:16:06.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.691+0000 7fc363400700 1 -- 172.21.15.69:0/622036827 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc364022020 con 0x7fc36c109870 2024-05-14T15:16:06.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.694+0000 7fc363400700 1 --2- 172.21.15.69:0/622036827 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc3500b2900 0x7fc3500b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:06.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.694+0000 7fc363400700 1 -- 172.21.15.69:0/622036827 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7497+0+0 (secure 0 0 0) 0x7fc36400f020 con 0x7fc36c109870 2024-05-14T15:16:06.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.694+0000 7fc36aa00700 1 --2- 172.21.15.69:0/622036827 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc3500b2900 0x7fc3500b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:06.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.695+0000 7fc36aa00700 1 --2- 172.21.15.69:0/622036827 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc3500b2900 0x7fc3500b4e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc35c005fd0 tx=0x7fc35c00a560 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:06.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.697+0000 7fc363400700 1 -- 172.21.15.69:0/622036827 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc3640abce0 con 0x7fc36c109870 2024-05-14T15:16:06.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:06.928+0000 7fc371a00700 1 -- 172.21.15.69:0/622036827 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fc36c02e5f0 con 0x7fc36c109870 2024-05-14T15:16:06.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:06 smithi069 ceph-mon[31270]: pgmap v378: 33 pgs: 1 creating+activating, 7 creating+peering, 9 unknown, 16 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:07.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:06 smithi203 ceph-mon[34567]: pgmap v378: 33 pgs: 1 creating+activating, 7 creating+peering, 9 unknown, 16 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:07.123 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:06 smithi092 ceph-mon[34729]: pgmap v378: 33 pgs: 1 creating+activating, 7 creating+peering, 9 unknown, 16 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:07.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:07.738+0000 7fc363400700 1 -- 172.21.15.69:0/622036827 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v77) ==== 171+0+0 (secure 0 0 0) 0x7fc364009cb0 con 0x7fc36c109870 2024-05-14T15:16:07.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:07.743+0000 7fc371a00700 1 -- 172.21.15.69:0/622036827 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc3500b2900 msgr2=0x7fc3500b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:07.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:07.743+0000 7fc371a00700 1 --2- 172.21.15.69:0/622036827 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc3500b2900 0x7fc3500b4e10 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc35c005fd0 tx=0x7fc35c00a560 comp rx=0 tx=0).stop 2024-05-14T15:16:07.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:07.743+0000 7fc371a00700 1 -- 172.21.15.69:0/622036827 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc36c109870 msgr2=0x7fc36c19f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:07.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:07.743+0000 7fc371a00700 1 --2- 172.21.15.69:0/622036827 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc36c109870 0x7fc36c19f540 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc364007d10 tx=0x7fc364007df0 comp rx=0 tx=0).stop 2024-05-14T15:16:07.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:07.743+0000 7fc371a00700 1 -- 172.21.15.69:0/622036827 shutdown_connections 2024-05-14T15:16:07.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:07.743+0000 7fc371a00700 1 --2- 172.21.15.69:0/622036827 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc36c109870 0x7fc36c19f540 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:07.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:07.743+0000 7fc371a00700 1 --2- 172.21.15.69:0/622036827 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc3500b2900 0x7fc3500b4e10 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:07.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:07.743+0000 7fc371a00700 1 --2- 172.21.15.69:0/622036827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc36c1045f0 0x7fc36c19ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:07.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:07.743+0000 7fc371a00700 1 --2- 172.21.15.69:0/622036827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc36c108f20 0x7fc36c19b2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:07.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:07.743+0000 7fc371a00700 1 -- 172.21.15.69:0/622036827 >> 172.21.15.69:0/622036827 conn(0x7fc36c0ffec0 msgr2=0x7fc36c1086c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:07.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:07.743+0000 7fc371a00700 1 -- 172.21.15.69:0/622036827 shutdown_connections 2024-05-14T15:16:07.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:07.743+0000 7fc371a00700 1 -- 172.21.15.69:0/622036827 wait complete. 2024-05-14T15:16:07.743 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data' created 2024-05-14T15:16:08.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:07 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/622036827' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-14T15:16:08.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:07 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/622036827' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-14T15:16:08.204 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:07 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/622036827' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-05-14T15:16:08.631 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-14T15:16:08.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:08 smithi092 ceph-mon[34729]: pgmap v379: 33 pgs: 1 creating+activating, 7 creating+peering, 25 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:08.940 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:08 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/622036827' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-14T15:16:08.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:08 smithi092 ceph-mon[34729]: osdmap e77: 12 total, 12 up, 12 in 2024-05-14T15:16:08.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:08 smithi069 ceph-mon[31270]: pgmap v379: 33 pgs: 1 creating+activating, 7 creating+peering, 25 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:08.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:08 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/622036827' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-14T15:16:08.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:08 smithi069 ceph-mon[31270]: osdmap e77: 12 total, 12 up, 12 in 2024-05-14T15:16:09.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:08 smithi203 ceph-mon[34567]: pgmap v379: 33 pgs: 1 creating+activating, 7 creating+peering, 25 active+clean; 577 KiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:09.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:08 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/622036827' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-05-14T15:16:09.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:08 smithi203 ceph-mon[34567]: osdmap e77: 12 total, 12 up, 12 in 2024-05-14T15:16:09.101 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:16:09.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:09 smithi069 ceph-mon[31270]: osdmap e78: 12 total, 12 up, 12 in 2024-05-14T15:16:10.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:09 smithi203 ceph-mon[34567]: osdmap e78: 12 total, 12 up, 12 in 2024-05-14T15:16:10.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:09 smithi092 ceph-mon[34729]: osdmap e78: 12 total, 12 up, 12 in 2024-05-14T15:16:11.036 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:10 smithi069 ceph-mon[31270]: pgmap v382: 97 pgs: 35 unknown, 18 creating+peering, 44 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:11.036 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:10 smithi069 ceph-mon[31270]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T15:16:11.036 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:10 smithi069 ceph-mon[31270]: osdmap e79: 12 total, 12 up, 12 in 2024-05-14T15:16:11.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:10 smithi203 ceph-mon[34567]: pgmap v382: 97 pgs: 35 unknown, 18 creating+peering, 44 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:11.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:10 smithi203 ceph-mon[34567]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T15:16:11.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:10 smithi203 ceph-mon[34567]: osdmap e79: 12 total, 12 up, 12 in 2024-05-14T15:16:11.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:10 smithi092 ceph-mon[34729]: pgmap v382: 97 pgs: 35 unknown, 18 creating+peering, 44 active+clean; 577 KiB data, 372 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:11.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:10 smithi092 ceph-mon[34729]: Health check update: 2 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T15:16:11.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:10 smithi092 ceph-mon[34729]: osdmap e79: 12 total, 12 up, 12 in 2024-05-14T15:16:11.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.417+0000 7f4fe7200700 1 -- 172.21.15.69:0/4039204827 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fe0106610 msgr2=0x7f4fe0106a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:11.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.417+0000 7f4fe7200700 1 --2- 172.21.15.69:0/4039204827 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fe0106610 0x7f4fe0106a20 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f4fd40099c0 tx=0x7f4fd4009cd0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.417+0000 7f4fe7200700 1 -- 172.21.15.69:0/4039204827 shutdown_connections 2024-05-14T15:16:11.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.417+0000 7f4fe7200700 1 --2- 172.21.15.69:0/4039204827 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fe0106610 0x7f4fe0106a20 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.417+0000 7f4fe7200700 1 --2- 172.21.15.69:0/4039204827 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fe010b890 0x7f4fe01131f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.417+0000 7f4fe7200700 1 --2- 172.21.15.69:0/4039204827 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4fe010af40 0x7f4fe010b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.417+0000 7f4fe7200700 1 -- 172.21.15.69:0/4039204827 >> 172.21.15.69:0/4039204827 conn(0x7f4fe0101ed0 msgr2=0x7f4fe01042f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:11.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.417+0000 7f4fe7200700 1 -- 172.21.15.69:0/4039204827 shutdown_connections 2024-05-14T15:16:11.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.417+0000 7f4fe7200700 1 -- 172.21.15.69:0/4039204827 wait complete. 2024-05-14T15:16:11.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.419+0000 7f4fe7200700 1 Processor -- start 2024-05-14T15:16:11.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.419+0000 7f4fe7200700 1 -- start start 2024-05-14T15:16:11.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.420+0000 7f4fe7200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4fe0106610 0x7f4fe019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.420+0000 7f4fe7200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fe010af40 0x7f4fe019d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.420+0000 7f4fe7200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fe010b890 0x7f4fe01a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.420+0000 7f4fe7200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe01163c0 con 0x7f4fe010af40 2024-05-14T15:16:11.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.420+0000 7f4fe7200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe0116240 con 0x7f4fe010b890 2024-05-14T15:16:11.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.420+0000 7f4fe7200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe0116540 con 0x7f4fe0106610 2024-05-14T15:16:11.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.420+0000 7f4fe5400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fe010af40 0x7f4fe019d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.420+0000 7f4fe5400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fe010af40 0x7f4fe019d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51092/0 (socket says 172.21.15.69:51092) 2024-05-14T15:16:11.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.420+0000 7f4fe5400700 1 -- 172.21.15.69:0/3494779012 learned_addr learned my addr 172.21.15.69:0/3494779012 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:11.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.420+0000 7f4fe5e00700 1 --2- 172.21.15.69:0/3494779012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4fe0106610 0x7f4fe019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.420+0000 7f4fe6800700 1 --2- 172.21.15.69:0/3494779012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fe010b890 0x7f4fe01a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.421+0000 7f4fe5400700 1 -- 172.21.15.69:0/3494779012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4fe0106610 msgr2=0x7f4fe019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.421+0000 7f4fe5400700 1 --2- 172.21.15.69:0/3494779012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4fe0106610 0x7f4fe019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.421+0000 7f4fe5400700 1 -- 172.21.15.69:0/3494779012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fe010b890 msgr2=0x7f4fe01a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.421+0000 7f4fe5400700 1 --2- 172.21.15.69:0/3494779012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fe010b890 0x7f4fe01a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.421+0000 7f4fe5400700 1 -- 172.21.15.69:0/3494779012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe01a1c80 con 0x7f4fe010af40 2024-05-14T15:16:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.421+0000 7f4fe5400700 1 --2- 172.21.15.69:0/3494779012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fe010af40 0x7f4fe019d350 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000d980 tx=0x7f4fd000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.422+0000 7f4fdaa00700 1 -- 172.21.15.69:0/3494779012 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd0017070 con 0x7f4fe010af40 2024-05-14T15:16:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.422+0000 7f4fdaa00700 1 -- 172.21.15.69:0/3494779012 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4fd000fd20 con 0x7f4fe010af40 2024-05-14T15:16:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.422+0000 7f4fdaa00700 1 -- 172.21.15.69:0/3494779012 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd000e3b0 con 0x7f4fe010af40 2024-05-14T15:16:11.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.422+0000 7f4fe7200700 1 -- 172.21.15.69:0/3494779012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe01a1f70 con 0x7f4fe010af40 2024-05-14T15:16:11.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.422+0000 7f4fe7200700 1 -- 172.21.15.69:0/3494779012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe01a9890 con 0x7f4fe010af40 2024-05-14T15:16:11.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.423+0000 7f4fe7200700 1 -- 172.21.15.69:0/3494779012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fe00512c0 con 0x7f4fe010af40 2024-05-14T15:16:11.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.427+0000 7f4fdaa00700 1 -- 172.21.15.69:0/3494779012 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f4fd000f890 con 0x7f4fe010af40 2024-05-14T15:16:11.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.429+0000 7f4fdaa00700 1 --2- 172.21.15.69:0/3494779012 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4fc80b2880 0x7f4fc80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:11.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.429+0000 7f4fdaa00700 1 -- 172.21.15.69:0/3494779012 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 7879+0+0 (secure 0 0 0) 0x7f4fd00e1b90 con 0x7f4fe010af40 2024-05-14T15:16:11.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.429+0000 7f4fe5e00700 1 --2- 172.21.15.69:0/3494779012 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4fc80b2880 0x7f4fc80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:11.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.430+0000 7f4fe5e00700 1 --2- 172.21.15.69:0/3494779012 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4fc80b2880 0x7f4fc80b4d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4000c00 tx=0x7f4fd4005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:11.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.432+0000 7f4fdaa00700 1 -- 172.21.15.69:0/3494779012 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4fd00a99c0 con 0x7f4fe010af40 2024-05-14T15:16:11.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.714+0000 7f4fe7200700 1 -- 172.21.15.69:0/3494779012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f4fe002e5f0 con 0x7f4fe010af40 2024-05-14T15:16:11.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.804+0000 7f4fdaa00700 1 -- 172.21.15.69:0/3494779012 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f4fd00a92c0 con 0x7f4fe010af40 2024-05-14T15:16:11.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.808+0000 7f4fe7200700 1 -- 172.21.15.69:0/3494779012 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4fc80b2880 msgr2=0x7f4fc80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:11.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.808+0000 7f4fe7200700 1 --2- 172.21.15.69:0/3494779012 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4fc80b2880 0x7f4fc80b4d90 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4000c00 tx=0x7f4fd4005fb0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.808+0000 7f4fe7200700 1 -- 172.21.15.69:0/3494779012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fe010af40 msgr2=0x7f4fe019d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.808+0000 7f4fe7200700 1 --2- 172.21.15.69:0/3494779012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fe010af40 0x7f4fe019d350 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4fd000d980 tx=0x7f4fd000dc90 comp rx=0 tx=0).stop 2024-05-14T15:16:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.808+0000 7f4fe7200700 1 -- 172.21.15.69:0/3494779012 shutdown_connections 2024-05-14T15:16:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.808+0000 7f4fe7200700 1 --2- 172.21.15.69:0/3494779012 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4fc80b2880 0x7f4fc80b4d90 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.808+0000 7f4fe7200700 1 --2- 172.21.15.69:0/3494779012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4fe010b890 0x7f4fe01a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.808+0000 7f4fe7200700 1 --2- 172.21.15.69:0/3494779012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4fe0106610 0x7f4fe019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.808+0000 7f4fe7200700 1 --2- 172.21.15.69:0/3494779012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4fe010af40 0x7f4fe019d350 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.808+0000 7f4fe7200700 1 -- 172.21.15.69:0/3494779012 >> 172.21.15.69:0/3494779012 conn(0x7f4fe0101ed0 msgr2=0x7f4fe010c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:11.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.809+0000 7f4fe7200700 1 -- 172.21.15.69:0/3494779012 shutdown_connections 2024-05-14T15:16:11.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:11.809+0000 7f4fe7200700 1 -- 172.21.15.69:0/3494779012 wait complete. 2024-05-14T15:16:11.808 INFO:teuthology.orchestra.run.smithi069.stderr:new fs with metadata pool 2 and data pool 3 2024-05-14T15:16:11.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:11 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3494779012' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-14T15:16:11.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:11 smithi069 ceph-mon[31270]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-14T15:16:12.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:11 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3494779012' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-14T15:16:12.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:11 smithi203 ceph-mon[34567]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-14T15:16:12.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:11 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3494779012' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-05-14T15:16:12.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:11 smithi092 ceph-mon[34729]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-05-14T15:16:12.675 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-14T15:16:12.675 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-14T15:16:12.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:12 smithi069 ceph-mon[31270]: pgmap v384: 97 pgs: 8 unknown, 18 creating+peering, 71 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:12.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:12 smithi069 ceph-mon[31270]: osdmap e80: 12 total, 12 up, 12 in 2024-05-14T15:16:12.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:12 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3494779012' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-14T15:16:12.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:12 smithi069 ceph-mon[31270]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-14T15:16:12.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:12 smithi069 ceph-mon[31270]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-14T15:16:13.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:12 smithi203 ceph-mon[34567]: pgmap v384: 97 pgs: 8 unknown, 18 creating+peering, 71 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:13.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:12 smithi203 ceph-mon[34567]: osdmap e80: 12 total, 12 up, 12 in 2024-05-14T15:16:13.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:12 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3494779012' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-14T15:16:13.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:12 smithi203 ceph-mon[34567]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-14T15:16:13.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:12 smithi203 ceph-mon[34567]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-14T15:16:13.116 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:16:13.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:12 smithi092 ceph-mon[34729]: pgmap v384: 97 pgs: 8 unknown, 18 creating+peering, 71 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:13.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:12 smithi092 ceph-mon[34729]: osdmap e80: 12 total, 12 up, 12 in 2024-05-14T15:16:13.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:12 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3494779012' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-05-14T15:16:13.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:12 smithi092 ceph-mon[34729]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-05-14T15:16:13.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:12 smithi092 ceph-mon[34729]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-05-14T15:16:14.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:13 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] up:active 2024-05-14T15:16:14.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:13 smithi203 ceph-mon[34567]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-14T15:16:14.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:13 smithi203 ceph-mon[34567]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-14T15:16:14.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:13 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] up:active 2024-05-14T15:16:14.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:13 smithi092 ceph-mon[34729]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-14T15:16:14.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:13 smithi092 ceph-mon[34729]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-14T15:16:14.198 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:13 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] up:active 2024-05-14T15:16:14.199 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:13 smithi069 ceph-mon[31270]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-14T15:16:14.199 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:13 smithi069 ceph-mon[31270]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-14T15:16:14.957 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:14 smithi069 ceph-mon[31270]: pgmap v386: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 0 op/s 2024-05-14T15:16:14.957 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:14 smithi069 ceph-mon[31270]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-14T15:16:14.958 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:14 smithi069 ceph-mon[31270]: Cluster is now healthy 2024-05-14T15:16:15.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:14 smithi203 ceph-mon[34567]: pgmap v386: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 0 op/s 2024-05-14T15:16:15.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:14 smithi203 ceph-mon[34567]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-14T15:16:15.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:14 smithi203 ceph-mon[34567]: Cluster is now healthy 2024-05-14T15:16:15.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:14 smithi092 ceph-mon[34729]: pgmap v386: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.2 KiB/s wr, 0 op/s 2024-05-14T15:16:15.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:14 smithi092 ceph-mon[34729]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-05-14T15:16:15.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:14 smithi092 ceph-mon[34729]: Cluster is now healthy 2024-05-14T15:16:15.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.572+0000 7fc903200700 1 -- 172.21.15.69:0/1122682413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc904106620 msgr2=0x7fc904106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.572+0000 7fc903200700 1 --2- 172.21.15.69:0/1122682413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc904106620 0x7fc904106a30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fc8f40099c0 tx=0x7fc8f4009cd0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.572+0000 7fc903200700 1 -- 172.21.15.69:0/1122682413 shutdown_connections 2024-05-14T15:16:15.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.572+0000 7fc903200700 1 --2- 172.21.15.69:0/1122682413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc904106620 0x7fc904106a30 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.572+0000 7fc903200700 1 --2- 172.21.15.69:0/1122682413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc90410b8a0 0x7fc904113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.572+0000 7fc903200700 1 --2- 172.21.15.69:0/1122682413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc90410af50 0x7fc90410b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.572+0000 7fc903200700 1 -- 172.21.15.69:0/1122682413 >> 172.21.15.69:0/1122682413 conn(0x7fc904102030 msgr2=0x7fc904104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:15.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.572+0000 7fc903200700 1 -- 172.21.15.69:0/1122682413 shutdown_connections 2024-05-14T15:16:15.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.572+0000 7fc903200700 1 -- 172.21.15.69:0/1122682413 wait complete. 2024-05-14T15:16:15.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.573+0000 7fc903200700 1 Processor -- start 2024-05-14T15:16:15.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.573+0000 7fc903200700 1 -- start start 2024-05-14T15:16:15.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.574+0000 7fc903200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc904106620 0x7fc90419ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.574+0000 7fc903200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc90410af50 0x7fc90419d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.574+0000 7fc903200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc90410b8a0 0x7fc9041a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.574+0000 7fc903200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc904116380 con 0x7fc904106620 2024-05-14T15:16:15.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.574+0000 7fc903200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc904116200 con 0x7fc90410af50 2024-05-14T15:16:15.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.574+0000 7fc903200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc904116500 con 0x7fc90410b8a0 2024-05-14T15:16:15.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.574+0000 7fc901e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc904106620 0x7fc90419ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.574+0000 7fc901e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc904106620 0x7fc90419ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44024/0 (socket says 172.21.15.69:44024) 2024-05-14T15:16:15.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.574+0000 7fc901e00700 1 -- 172.21.15.69:0/232626393 learned_addr learned my addr 172.21.15.69:0/232626393 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:15.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.574+0000 7fc901400700 1 --2- 172.21.15.69:0/232626393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc90410af50 0x7fc90419d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.575+0000 7fc902800700 1 --2- 172.21.15.69:0/232626393 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc90410b8a0 0x7fc9041a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.575+0000 7fc901e00700 1 -- 172.21.15.69:0/232626393 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc90410b8a0 msgr2=0x7fc9041a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.575+0000 7fc901e00700 1 --2- 172.21.15.69:0/232626393 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc90410b8a0 0x7fc9041a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.575+0000 7fc901e00700 1 -- 172.21.15.69:0/232626393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc90410af50 msgr2=0x7fc90419d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:15.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.575+0000 7fc901e00700 1 --2- 172.21.15.69:0/232626393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc90410af50 0x7fc90419d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:15.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.575+0000 7fc901e00700 1 -- 172.21.15.69:0/232626393 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9041a1c30 con 0x7fc904106620 2024-05-14T15:16:15.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.575+0000 7fc901400700 1 --2- 172.21.15.69:0/232626393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc90410af50 0x7fc90419d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:15.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.575+0000 7fc902800700 1 --2- 172.21.15.69:0/232626393 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc90410b8a0 0x7fc9041a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:15.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.575+0000 7fc901e00700 1 --2- 172.21.15.69:0/232626393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc904106620 0x7fc90419ce10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4000c00 tx=0x7fc8f400f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.575+0000 7fc8faa00700 1 -- 172.21.15.69:0/232626393 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f400f940 con 0x7fc904106620 2024-05-14T15:16:15.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.575+0000 7fc903200700 1 -- 172.21.15.69:0/232626393 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9041a1ec0 con 0x7fc904106620 2024-05-14T15:16:15.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.576+0000 7fc903200700 1 -- 172.21.15.69:0/232626393 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9041a2390 con 0x7fc904106620 2024-05-14T15:16:15.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.576+0000 7fc8faa00700 1 -- 172.21.15.69:0/232626393 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc8f4004830 con 0x7fc904106620 2024-05-14T15:16:15.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.576+0000 7fc8faa00700 1 -- 172.21.15.69:0/232626393 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4005480 con 0x7fc904106620 2024-05-14T15:16:15.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.577+0000 7fc903200700 1 -- 172.21.15.69:0/232626393 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9040512c0 con 0x7fc904106620 2024-05-14T15:16:15.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.579+0000 7fc8faa00700 1 -- 172.21.15.69:0/232626393 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc8f4029060 con 0x7fc904106620 2024-05-14T15:16:15.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.581+0000 7fc8faa00700 1 --2- 172.21.15.69:0/232626393 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc8e80b2880 0x7fc8e80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:15.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.581+0000 7fc8faa00700 1 -- 172.21.15.69:0/232626393 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7979+0+0 (secure 0 0 0) 0x7fc8f40e2fb0 con 0x7fc904106620 2024-05-14T15:16:15.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.581+0000 7fc901400700 1 --2- 172.21.15.69:0/232626393 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc8e80b2880 0x7fc8e80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:15.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.582+0000 7fc901400700 1 --2- 172.21.15.69:0/232626393 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc8e80b2880 0x7fc8e80b4d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0005fd0 tx=0x7fc8f0005e20 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:15.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.585+0000 7fc8faa00700 1 -- 172.21.15.69:0/232626393 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc8f4013070 con 0x7fc904106620 2024-05-14T15:16:15.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:15.827+0000 7fc903200700 1 -- 172.21.15.69:0/232626393 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fc90402e5f0 con 0x7fc904106620 2024-05-14T15:16:16.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:16.835+0000 7fc8faa00700 1 -- 172.21.15.69:0/232626393 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v81) ==== 157+0+0 (secure 0 0 0) 0x7fc8f40aae10 con 0x7fc904106620 2024-05-14T15:16:16.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:16.841+0000 7fc903200700 1 -- 172.21.15.69:0/232626393 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc8e80b2880 msgr2=0x7fc8e80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:16.841+0000 7fc903200700 1 --2- 172.21.15.69:0/232626393 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc8e80b2880 0x7fc8e80b4d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0005fd0 tx=0x7fc8f0005e20 comp rx=0 tx=0).stop 2024-05-14T15:16:16.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:16.841+0000 7fc903200700 1 -- 172.21.15.69:0/232626393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc904106620 msgr2=0x7fc90419ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:16.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:16.841+0000 7fc903200700 1 --2- 172.21.15.69:0/232626393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc904106620 0x7fc90419ce10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4000c00 tx=0x7fc8f400f510 comp rx=0 tx=0).stop 2024-05-14T15:16:16.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:16.841+0000 7fc903200700 1 -- 172.21.15.69:0/232626393 shutdown_connections 2024-05-14T15:16:16.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:16.842+0000 7fc903200700 1 --2- 172.21.15.69:0/232626393 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc904106620 0x7fc90419ce10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:16.842+0000 7fc903200700 1 --2- 172.21.15.69:0/232626393 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc8e80b2880 0x7fc8e80b4d90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:16.842+0000 7fc903200700 1 --2- 172.21.15.69:0/232626393 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc90410b8a0 0x7fc9041a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:16.842+0000 7fc903200700 1 --2- 172.21.15.69:0/232626393 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc90410af50 0x7fc90419d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:16.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:16.842+0000 7fc903200700 1 -- 172.21.15.69:0/232626393 >> 172.21.15.69:0/232626393 conn(0x7fc904102030 msgr2=0x7fc90410a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:16.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:16.842+0000 7fc903200700 1 -- 172.21.15.69:0/232626393 shutdown_connections 2024-05-14T15:16:16.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:16.842+0000 7fc903200700 1 -- 172.21.15.69:0/232626393 wait complete. 2024-05-14T15:16:17.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:16 smithi203 ceph-mon[34567]: pgmap v387: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 2 op/s 2024-05-14T15:16:17.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:16 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/232626393' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-14T15:16:17.191 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:16:17 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b[64556]: 2024-05-14T15:16:17.061+0000 7f1325e00700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-14T15:16:17.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:16 smithi092 ceph-mon[34729]: pgmap v387: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 2 op/s 2024-05-14T15:16:17.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:16 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/232626393' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-14T15:16:17.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:16 smithi069 ceph-mon[31270]: pgmap v387: 97 pgs: 97 active+clean; 577 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 KiB/s wr, 2 op/s 2024-05-14T15:16:17.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:16 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/232626393' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-05-14T15:16:17.781 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-14T15:16:17.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:17 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/232626393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-14T15:16:17.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:17 smithi069 ceph-mon[31270]: osdmap e81: 12 total, 12 up, 12 in 2024-05-14T15:16:18.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:17 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/232626393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-14T15:16:18.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:17 smithi203 ceph-mon[34567]: osdmap e81: 12 total, 12 up, 12 in 2024-05-14T15:16:18.146 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:17 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/232626393' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-05-14T15:16:18.146 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:17 smithi092 ceph-mon[34729]: osdmap e81: 12 total, 12 up, 12 in 2024-05-14T15:16:18.232 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:16:19.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:18 smithi203 ceph-mon[34567]: pgmap v389: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-05-14T15:16:19.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:18 smithi092 ceph-mon[34729]: pgmap v389: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-05-14T15:16:19.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:18 smithi069 ceph-mon[31270]: pgmap v389: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-05-14T15:16:20.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.566+0000 7fc3fca00700 1 -- 172.21.15.69:0/1007995634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f8110a30 msgr2=0x7fc3f8112e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:20.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.566+0000 7fc3fca00700 1 --2- 172.21.15.69:0/1007995634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f8110a30 0x7fc3f8112e50 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000b0a0 tx=0x7fc3f000b3b0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.566+0000 7fc3fca00700 1 -- 172.21.15.69:0/1007995634 shutdown_connections 2024-05-14T15:16:20.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.566+0000 7fc3fca00700 1 --2- 172.21.15.69:0/1007995634 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f8110a30 0x7fc3f8112e50 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.566+0000 7fc3fca00700 1 --2- 172.21.15.69:0/1007995634 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f8075ae0 0x7fc3f8075ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.566+0000 7fc3fca00700 1 --2- 172.21.15.69:0/1007995634 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3f8076430 0x7fc3f81104f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.566+0000 7fc3fca00700 1 -- 172.21.15.69:0/1007995634 >> 172.21.15.69:0/1007995634 conn(0x7fc3f8079d10 msgr2=0x7fc3f807a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:20.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.567+0000 7fc3fca00700 1 -- 172.21.15.69:0/1007995634 shutdown_connections 2024-05-14T15:16:20.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.567+0000 7fc3fca00700 1 -- 172.21.15.69:0/1007995634 wait complete. 2024-05-14T15:16:20.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.568+0000 7fc3fca00700 1 Processor -- start 2024-05-14T15:16:20.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.568+0000 7fc3fca00700 1 -- start start 2024-05-14T15:16:20.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.568+0000 7fc3fca00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f8075ae0 0x7fc3f81a29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:20.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.568+0000 7fc3fca00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3f8076430 0x7fc3f81a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:20.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.568+0000 7fc3fca00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f8110a30 0x7fc3f819cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:20.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.568+0000 7fc3fca00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f8116370 con 0x7fc3f8110a30 2024-05-14T15:16:20.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.568+0000 7fc3fca00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f81161f0 con 0x7fc3f8076430 2024-05-14T15:16:20.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.568+0000 7fc3fca00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f81164f0 con 0x7fc3f8075ae0 2024-05-14T15:16:20.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.569+0000 7fc3f7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f8110a30 0x7fc3f819cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:20.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.569+0000 7fc3f7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f8110a30 0x7fc3f819cb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44042/0 (socket says 172.21.15.69:44042) 2024-05-14T15:16:20.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.569+0000 7fc3f7e00700 1 -- 172.21.15.69:0/114041291 learned_addr learned my addr 172.21.15.69:0/114041291 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:20.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.569+0000 7fc3f7400700 1 --2- 172.21.15.69:0/114041291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f8075ae0 0x7fc3f81a29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:20.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.569+0000 7fc3f6a00700 1 --2- 172.21.15.69:0/114041291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3f8076430 0x7fc3f81a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:20.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.569+0000 7fc3f7e00700 1 -- 172.21.15.69:0/114041291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f8075ae0 msgr2=0x7fc3f81a29a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:20.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.569+0000 7fc3f7e00700 1 --2- 172.21.15.69:0/114041291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f8075ae0 0x7fc3f81a29a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.569+0000 7fc3f7e00700 1 -- 172.21.15.69:0/114041291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3f8076430 msgr2=0x7fc3f81a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:20.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.569+0000 7fc3f7e00700 1 --2- 172.21.15.69:0/114041291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3f8076430 0x7fc3f81a2ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:20.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.569+0000 7fc3f7e00700 1 -- 172.21.15.69:0/114041291 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f819d1d0 con 0x7fc3f8110a30 2024-05-14T15:16:20.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.570+0000 7fc3f7e00700 1 --2- 172.21.15.69:0/114041291 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f8110a30 0x7fc3f819cb30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00062a0 tx=0x7fc3f0004ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:20.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.570+0000 7fc3efe00700 1 -- 172.21.15.69:0/114041291 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0021070 con 0x7fc3f8110a30 2024-05-14T15:16:20.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.570+0000 7fc3efe00700 1 -- 172.21.15.69:0/114041291 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3f0007d00 con 0x7fc3f8110a30 2024-05-14T15:16:20.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.570+0000 7fc3fca00700 1 -- 172.21.15.69:0/114041291 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f819d460 con 0x7fc3f8110a30 2024-05-14T15:16:20.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.570+0000 7fc3efe00700 1 -- 172.21.15.69:0/114041291 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f0005280 con 0x7fc3f8110a30 2024-05-14T15:16:20.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.570+0000 7fc3fca00700 1 -- 172.21.15.69:0/114041291 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f819d940 con 0x7fc3f8110a30 2024-05-14T15:16:20.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.571+0000 7fc3fca00700 1 -- 172.21.15.69:0/114041291 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3f8077220 con 0x7fc3f8110a30 2024-05-14T15:16:20.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.574+0000 7fc3efe00700 1 -- 172.21.15.69:0/114041291 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc3f0024070 con 0x7fc3f8110a30 2024-05-14T15:16:20.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.575+0000 7fc3efe00700 1 --2- 172.21.15.69:0/114041291 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc3dc0b2880 0x7fc3dc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:20.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.575+0000 7fc3efe00700 1 -- 172.21.15.69:0/114041291 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 8277+0+0 (secure 0 0 0) 0x7fc3f000f020 con 0x7fc3f8110a30 2024-05-14T15:16:20.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.575+0000 7fc3f7400700 1 --2- 172.21.15.69:0/114041291 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc3dc0b2880 0x7fc3dc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:20.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.576+0000 7fc3f7400700 1 --2- 172.21.15.69:0/114041291 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc3dc0b2880 0x7fc3dc0b4d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8005ea0 tx=0x7fc3e8005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:20.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.578+0000 7fc3efe00700 1 -- 172.21.15.69:0/114041291 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc3f002b020 con 0x7fc3f8110a30 2024-05-14T15:16:20.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:20.812+0000 7fc3fca00700 1 -- 172.21.15.69:0/114041291 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fc3f802e5f0 con 0x7fc3f8110a30 2024-05-14T15:16:21.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:20 smithi092 ceph-mon[34729]: pgmap v390: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-14T15:16:21.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:20 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/114041291' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-14T15:16:21.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:20 smithi069 ceph-mon[31270]: pgmap v390: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-14T15:16:21.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:20 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/114041291' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-14T15:16:21.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:20 smithi203 ceph-mon[34567]: pgmap v390: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-05-14T15:16:21.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:20 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/114041291' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-05-14T15:16:21.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:21.863+0000 7fc3efe00700 1 -- 172.21.15.69:0/114041291 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v83) ==== 228+0+0 (secure 0 0 0) 0x7fc3f00abbf0 con 0x7fc3f8110a30 2024-05-14T15:16:21.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:21.867+0000 7fc3fca00700 1 -- 172.21.15.69:0/114041291 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc3dc0b2880 msgr2=0x7fc3dc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:21.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:21.867+0000 7fc3fca00700 1 --2- 172.21.15.69:0/114041291 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc3dc0b2880 0x7fc3dc0b4d90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8005ea0 tx=0x7fc3e8005e30 comp rx=0 tx=0).stop 2024-05-14T15:16:21.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:21.867+0000 7fc3fca00700 1 -- 172.21.15.69:0/114041291 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f8110a30 msgr2=0x7fc3f819cb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:21.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:21.867+0000 7fc3fca00700 1 --2- 172.21.15.69:0/114041291 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f8110a30 0x7fc3f819cb30 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fc3f00062a0 tx=0x7fc3f0004ed0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:21.867+0000 7fc3fca00700 1 -- 172.21.15.69:0/114041291 shutdown_connections 2024-05-14T15:16:21.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:21.867+0000 7fc3fca00700 1 --2- 172.21.15.69:0/114041291 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f8110a30 0x7fc3f819cb30 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:21.867+0000 7fc3fca00700 1 --2- 172.21.15.69:0/114041291 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc3dc0b2880 0x7fc3dc0b4d90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:21.867+0000 7fc3fca00700 1 --2- 172.21.15.69:0/114041291 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f8075ae0 0x7fc3f81a29a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:21.867+0000 7fc3fca00700 1 --2- 172.21.15.69:0/114041291 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3f8076430 0x7fc3f81a2ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:21.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:21.867+0000 7fc3fca00700 1 -- 172.21.15.69:0/114041291 >> 172.21.15.69:0/114041291 conn(0x7fc3f8079d10 msgr2=0x7fc3f8100f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:21.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:21.868+0000 7fc3fca00700 1 -- 172.21.15.69:0/114041291 shutdown_connections 2024-05-14T15:16:21.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:21.868+0000 7fc3fca00700 1 -- 172.21.15.69:0/114041291 wait complete. 2024-05-14T15:16:21.869 INFO:teuthology.orchestra.run.smithi069.stderr:pool 'cephfs_data_ec' created 2024-05-14T15:16:22.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:21 smithi092 ceph-mon[34729]: osdmap e82: 12 total, 12 up, 12 in 2024-05-14T15:16:22.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:21 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/114041291' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-14T15:16:22.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:21 smithi092 ceph-mon[34729]: osdmap e83: 12 total, 12 up, 12 in 2024-05-14T15:16:22.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:21 smithi069 ceph-mon[31270]: osdmap e82: 12 total, 12 up, 12 in 2024-05-14T15:16:22.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:21 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/114041291' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-14T15:16:22.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:21 smithi069 ceph-mon[31270]: osdmap e83: 12 total, 12 up, 12 in 2024-05-14T15:16:22.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:21 smithi203 ceph-mon[34567]: osdmap e82: 12 total, 12 up, 12 in 2024-05-14T15:16:22.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:21 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/114041291' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-05-14T15:16:22.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:21 smithi203 ceph-mon[34567]: osdmap e83: 12 total, 12 up, 12 in 2024-05-14T15:16:22.832 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-14T15:16:23.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:22 smithi092 ceph-mon[34729]: pgmap v392: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s wr, 5 op/s 2024-05-14T15:16:23.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:22 smithi092 ceph-mon[34729]: osdmap e84: 12 total, 12 up, 12 in 2024-05-14T15:16:23.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:22 smithi069 ceph-mon[31270]: pgmap v392: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s wr, 5 op/s 2024-05-14T15:16:23.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:22 smithi069 ceph-mon[31270]: osdmap e84: 12 total, 12 up, 12 in 2024-05-14T15:16:23.288 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:16:23.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:22 smithi203 ceph-mon[34567]: pgmap v392: 97 pgs: 97 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail; 895 B/s wr, 5 op/s 2024-05-14T15:16:23.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:22 smithi203 ceph-mon[34567]: osdmap e84: 12 total, 12 up, 12 in 2024-05-14T15:16:25.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:24 smithi092 ceph-mon[34729]: pgmap v395: 129 pgs: 2 creating+peering, 24 unknown, 103 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:25.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:24 smithi092 ceph-mon[34729]: osdmap e85: 12 total, 12 up, 12 in 2024-05-14T15:16:25.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:24 smithi092 ceph-mon[34729]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T15:16:25.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:24 smithi069 ceph-mon[31270]: pgmap v395: 129 pgs: 2 creating+peering, 24 unknown, 103 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:25.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:24 smithi069 ceph-mon[31270]: osdmap e85: 12 total, 12 up, 12 in 2024-05-14T15:16:25.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:24 smithi069 ceph-mon[31270]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T15:16:25.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:24 smithi203 ceph-mon[34567]: pgmap v395: 129 pgs: 2 creating+peering, 24 unknown, 103 active+clean; 579 KiB data, 373 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:25.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:24 smithi203 ceph-mon[34567]: osdmap e85: 12 total, 12 up, 12 in 2024-05-14T15:16:25.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:24 smithi203 ceph-mon[34567]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-05-14T15:16:25.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.500+0000 7fc17be00700 1 -- 172.21.15.69:0/3708091461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc17c104400 msgr2=0x7fc17c104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:25.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.500+0000 7fc17be00700 1 --2- 172.21.15.69:0/3708091461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc17c104400 0x7fc17c104810 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc16c0099c0 tx=0x7fc16c009cd0 comp rx=0 tx=0).stop 2024-05-14T15:16:25.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.500+0000 7fc17be00700 1 -- 172.21.15.69:0/3708091461 shutdown_connections 2024-05-14T15:16:25.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.500+0000 7fc17be00700 1 --2- 172.21.15.69:0/3708091461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc17c104400 0x7fc17c104810 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:25.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.500+0000 7fc17be00700 1 --2- 172.21.15.69:0/3708091461 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc17c109680 0x7fc17c110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:25.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.500+0000 7fc17be00700 1 --2- 172.21.15.69:0/3708091461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc17c108d30 0x7fc17c109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:25.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.500+0000 7fc17be00700 1 -- 172.21.15.69:0/3708091461 >> 172.21.15.69:0/3708091461 conn(0x7fc17c079d10 msgr2=0x7fc17c07a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:25.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.500+0000 7fc17be00700 1 -- 172.21.15.69:0/3708091461 shutdown_connections 2024-05-14T15:16:25.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.500+0000 7fc17be00700 1 -- 172.21.15.69:0/3708091461 wait complete. 2024-05-14T15:16:25.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.501+0000 7fc17be00700 1 Processor -- start 2024-05-14T15:16:25.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.501+0000 7fc17be00700 1 -- start start 2024-05-14T15:16:25.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.502+0000 7fc17be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc17c104400 0x7fc17c075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:25.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.502+0000 7fc17be00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc17c108d30 0x7fc17c076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:25.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.502+0000 7fc17be00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc17c109680 0x7fc17c076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:25.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.502+0000 7fc17be00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c1141b0 con 0x7fc17c104400 2024-05-14T15:16:25.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.502+0000 7fc17be00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c114030 con 0x7fc17c108d30 2024-05-14T15:16:25.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.502+0000 7fc17be00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc17c114330 con 0x7fc17c109680 2024-05-14T15:16:25.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.502+0000 7fc17aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc17c104400 0x7fc17c075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:25.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.502+0000 7fc17aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc17c104400 0x7fc17c075ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50744/0 (socket says 172.21.15.69:50744) 2024-05-14T15:16:25.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.502+0000 7fc17aa00700 1 -- 172.21.15.69:0/1682503308 learned_addr learned my addr 172.21.15.69:0/1682503308 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:25.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.503+0000 7fc172000700 1 --2- 172.21.15.69:0/1682503308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc17c108d30 0x7fc17c076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:25.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.503+0000 7fc17b400700 1 --2- 172.21.15.69:0/1682503308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc17c109680 0x7fc17c076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:25.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.503+0000 7fc17aa00700 1 -- 172.21.15.69:0/1682503308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc17c109680 msgr2=0x7fc17c076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:25.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.503+0000 7fc17aa00700 1 --2- 172.21.15.69:0/1682503308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc17c109680 0x7fc17c076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:25.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.503+0000 7fc17aa00700 1 -- 172.21.15.69:0/1682503308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc17c108d30 msgr2=0x7fc17c076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:25.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.503+0000 7fc17aa00700 1 --2- 172.21.15.69:0/1682503308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc17c108d30 0x7fc17c076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:25.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.503+0000 7fc17aa00700 1 -- 172.21.15.69:0/1682503308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc17c1a8f50 con 0x7fc17c104400 2024-05-14T15:16:25.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.503+0000 7fc17b400700 1 --2- 172.21.15.69:0/1682503308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc17c109680 0x7fc17c076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:25.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.503+0000 7fc17aa00700 1 --2- 172.21.15.69:0/1682503308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc17c104400 0x7fc17c075ac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00b580 tx=0x7fc16c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:25.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.504+0000 7fc173e00700 1 -- 172.21.15.69:0/1682503308 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c026070 con 0x7fc17c104400 2024-05-14T15:16:25.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.504+0000 7fc173e00700 1 -- 172.21.15.69:0/1682503308 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc16c0054c0 con 0x7fc17c104400 2024-05-14T15:16:25.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.504+0000 7fc173e00700 1 -- 172.21.15.69:0/1682503308 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc16c004c00 con 0x7fc17c104400 2024-05-14T15:16:25.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.504+0000 7fc17be00700 1 -- 172.21.15.69:0/1682503308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc17c1a91e0 con 0x7fc17c104400 2024-05-14T15:16:25.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.504+0000 7fc17be00700 1 -- 172.21.15.69:0/1682503308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc17c1a95e0 con 0x7fc17c104400 2024-05-14T15:16:25.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.505+0000 7fc17be00700 1 -- 172.21.15.69:0/1682503308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc17c1058b0 con 0x7fc17c104400 2024-05-14T15:16:25.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.508+0000 7fc173e00700 1 -- 172.21.15.69:0/1682503308 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fc16c029070 con 0x7fc17c104400 2024-05-14T15:16:25.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.510+0000 7fc173e00700 1 --2- 172.21.15.69:0/1682503308 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc1600b2880 0x7fc1600b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:25.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.510+0000 7fc173e00700 1 -- 172.21.15.69:0/1682503308 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8770+0+0 (secure 0 0 0) 0x7fc16c0e3440 con 0x7fc17c104400 2024-05-14T15:16:25.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.510+0000 7fc172000700 1 --2- 172.21.15.69:0/1682503308 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc1600b2880 0x7fc1600b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:25.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.511+0000 7fc172000700 1 --2- 172.21.15.69:0/1682503308 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc1600b2880 0x7fc1600b4d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc164005ea0 tx=0x7fc164005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:25.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.513+0000 7fc173e00700 1 -- 172.21.15.69:0/1682503308 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc16c030080 con 0x7fc17c104400 2024-05-14T15:16:25.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.753+0000 7fc17be00700 1 -- 172.21.15.69:0/1682503308 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fc17c02e820 con 0x7fc17c104400 2024-05-14T15:16:25.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.891+0000 7fc173e00700 1 -- 172.21.15.69:0/1682503308 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v86) ==== 169+0+0 (secure 0 0 0) 0x7fc16c013070 con 0x7fc17c104400 2024-05-14T15:16:25.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.896+0000 7fc17be00700 1 -- 172.21.15.69:0/1682503308 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc1600b2880 msgr2=0x7fc1600b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:25.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.896+0000 7fc17be00700 1 --2- 172.21.15.69:0/1682503308 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc1600b2880 0x7fc1600b4d90 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc164005ea0 tx=0x7fc164005e30 comp rx=0 tx=0).stop 2024-05-14T15:16:25.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.896+0000 7fc17be00700 1 -- 172.21.15.69:0/1682503308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc17c104400 msgr2=0x7fc17c075ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:25.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.896+0000 7fc17be00700 1 --2- 172.21.15.69:0/1682503308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc17c104400 0x7fc17c075ac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc16c00b580 tx=0x7fc16c00f740 comp rx=0 tx=0).stop 2024-05-14T15:16:25.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.897+0000 7fc17be00700 1 -- 172.21.15.69:0/1682503308 shutdown_connections 2024-05-14T15:16:25.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.897+0000 7fc17be00700 1 --2- 172.21.15.69:0/1682503308 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc17c104400 0x7fc17c075ac0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:25.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.897+0000 7fc17be00700 1 --2- 172.21.15.69:0/1682503308 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc1600b2880 0x7fc1600b4d90 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:25.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.897+0000 7fc17be00700 1 --2- 172.21.15.69:0/1682503308 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc17c109680 0x7fc17c076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:25.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.897+0000 7fc17be00700 1 --2- 172.21.15.69:0/1682503308 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc17c108d30 0x7fc17c076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:25.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.897+0000 7fc17be00700 1 -- 172.21.15.69:0/1682503308 >> 172.21.15.69:0/1682503308 conn(0x7fc17c079d10 msgr2=0x7fc17c101f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:25.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.897+0000 7fc17be00700 1 -- 172.21.15.69:0/1682503308 shutdown_connections 2024-05-14T15:16:25.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:25.897+0000 7fc17be00700 1 -- 172.21.15.69:0/1682503308 wait complete. 2024-05-14T15:16:25.899 INFO:teuthology.orchestra.run.smithi069.stderr:set pool 4 allow_ec_overwrites to true 2024-05-14T15:16:26.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:25 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1682503308' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-14T15:16:26.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:25 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1682503308' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-14T15:16:26.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:25 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1682503308' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-05-14T15:16:26.796 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-14T15:16:27.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:26 smithi092 ceph-mon[34729]: pgmap v397: 129 pgs: 2 creating+peering, 1 unknown, 126 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:27.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:26 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1682503308' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-14T15:16:27.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:26 smithi092 ceph-mon[34729]: osdmap e86: 12 total, 12 up, 12 in 2024-05-14T15:16:27.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:26 smithi069 ceph-mon[31270]: pgmap v397: 129 pgs: 2 creating+peering, 1 unknown, 126 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:27.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:26 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1682503308' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-14T15:16:27.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:26 smithi069 ceph-mon[31270]: osdmap e86: 12 total, 12 up, 12 in 2024-05-14T15:16:27.240 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:16:27.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:26 smithi203 ceph-mon[34567]: pgmap v397: 129 pgs: 2 creating+peering, 1 unknown, 126 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:27.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:26 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1682503308' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-05-14T15:16:27.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:26 smithi203 ceph-mon[34567]: osdmap e86: 12 total, 12 up, 12 in 2024-05-14T15:16:28.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:28 smithi069 ceph-mon[31270]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:29.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:28 smithi092 ceph-mon[34729]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:29.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:28 smithi203 ceph-mon[34567]: pgmap v399: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:29.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.629+0000 7f57e3000700 1 -- 172.21.15.69:0/3520019035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc10c5c0 msgr2=0x7f57dc10c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:29.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.629+0000 7f57e3000700 1 --2- 172.21.15.69:0/3520019035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc10c5c0 0x7f57dc10c9d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f57cc009990 tx=0x7f57cc009ca0 comp rx=0 tx=0).stop 2024-05-14T15:16:29.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.629+0000 7f57e3000700 1 -- 172.21.15.69:0/3520019035 shutdown_connections 2024-05-14T15:16:29.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.629+0000 7f57e3000700 1 --2- 172.21.15.69:0/3520019035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc10c5c0 0x7f57dc10c9d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:29.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.629+0000 7f57e3000700 1 --2- 172.21.15.69:0/3520019035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57dc106ed0 0x7f57dc113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:29.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.629+0000 7f57e3000700 1 --2- 172.21.15.69:0/3520019035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57dc106580 0x7f57dc106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:29.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.629+0000 7f57e3000700 1 -- 172.21.15.69:0/3520019035 >> 172.21.15.69:0/3520019035 conn(0x7f57dc102080 msgr2=0x7f57dc1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:29.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.629+0000 7f57e3000700 1 -- 172.21.15.69:0/3520019035 shutdown_connections 2024-05-14T15:16:29.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.629+0000 7f57e3000700 1 -- 172.21.15.69:0/3520019035 wait complete. 2024-05-14T15:16:29.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.630+0000 7f57e3000700 1 Processor -- start 2024-05-14T15:16:29.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.631+0000 7f57e3000700 1 -- start start 2024-05-14T15:16:29.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.631+0000 7f57e3000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57dc106580 0x7f57dc19cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:29.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.631+0000 7f57e3000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57dc106ed0 0x7f57dc19d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:29.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.631+0000 7f57e3000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc10c5c0 0x7f57dc1a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:29.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.631+0000 7f57e3000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc1165d0 con 0x7f57dc10c5c0 2024-05-14T15:16:29.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.631+0000 7f57e3000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc116450 con 0x7f57dc106ed0 2024-05-14T15:16:29.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.631+0000 7f57e3000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f57dc116750 con 0x7f57dc106580 2024-05-14T15:16:29.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.631+0000 7f57e1000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc10c5c0 0x7f57dc1a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:29.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.632+0000 7f57e1000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc10c5c0 0x7f57dc1a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50766/0 (socket says 172.21.15.69:50766) 2024-05-14T15:16:29.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.632+0000 7f57e1000700 1 -- 172.21.15.69:0/3736074187 learned_addr learned my addr 172.21.15.69:0/3736074187 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:29.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.632+0000 7f57db400700 1 --2- 172.21.15.69:0/3736074187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57dc106ed0 0x7f57dc19d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:29.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.632+0000 7f57dbe00700 1 --2- 172.21.15.69:0/3736074187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57dc106580 0x7f57dc19cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:29.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.632+0000 7f57e1000700 1 -- 172.21.15.69:0/3736074187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57dc106580 msgr2=0x7f57dc19cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:29.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.632+0000 7f57e1000700 1 --2- 172.21.15.69:0/3736074187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57dc106580 0x7f57dc19cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:29.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.632+0000 7f57e1000700 1 -- 172.21.15.69:0/3736074187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57dc106ed0 msgr2=0x7f57dc19d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:29.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.632+0000 7f57e1000700 1 --2- 172.21.15.69:0/3736074187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57dc106ed0 0x7f57dc19d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:29.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.632+0000 7f57e1000700 1 -- 172.21.15.69:0/3736074187 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57dc1a1e70 con 0x7f57dc10c5c0 2024-05-14T15:16:29.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.633+0000 7f57e1000700 1 --2- 172.21.15.69:0/3736074187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc10c5c0 0x7f57dc1a17d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f57d400ada0 tx=0x7f57d400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:29.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.633+0000 7f57d8c00700 1 -- 172.21.15.69:0/3736074187 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d4017020 con 0x7f57dc10c5c0 2024-05-14T15:16:29.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.633+0000 7f57d8c00700 1 -- 172.21.15.69:0/3736074187 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57d400cd60 con 0x7f57dc10c5c0 2024-05-14T15:16:29.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.633+0000 7f57e3000700 1 -- 172.21.15.69:0/3736074187 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57dc1a2160 con 0x7f57dc10c5c0 2024-05-14T15:16:29.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.633+0000 7f57d8c00700 1 -- 172.21.15.69:0/3736074187 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57d4005280 con 0x7f57dc10c5c0 2024-05-14T15:16:29.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.633+0000 7f57e3000700 1 -- 172.21.15.69:0/3736074187 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57dc1a9a80 con 0x7f57dc10c5c0 2024-05-14T15:16:29.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.635+0000 7f57e3000700 1 -- 172.21.15.69:0/3736074187 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57dc10e980 con 0x7f57dc10c5c0 2024-05-14T15:16:29.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.637+0000 7f57d8c00700 1 -- 172.21.15.69:0/3736074187 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f57d400c8d0 con 0x7f57dc10c5c0 2024-05-14T15:16:29.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.639+0000 7f57d8c00700 1 --2- 172.21.15.69:0/3736074187 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f57c00b2880 0x7f57c00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:29.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.639+0000 7f57d8c00700 1 -- 172.21.15.69:0/3736074187 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8770+0+0 (secure 0 0 0) 0x7f57d40e2210 con 0x7f57dc10c5c0 2024-05-14T15:16:29.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.639+0000 7f57dbe00700 1 --2- 172.21.15.69:0/3736074187 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f57c00b2880 0x7f57c00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:29.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.640+0000 7f57dbe00700 1 --2- 172.21.15.69:0/3736074187 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f57c00b2880 0x7f57c00b4d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f57cc006010 tx=0x7f57cc00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:29.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.642+0000 7f57d8c00700 1 -- 172.21.15.69:0/3736074187 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f57d4021020 con 0x7f57dc10c5c0 2024-05-14T15:16:29.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:29.930+0000 7f57e3000700 1 -- 172.21.15.69:0/3736074187 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f57dc19e300 con 0x7f57dc10c5c0 2024-05-14T15:16:30.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:30.926+0000 7f57d8c00700 1 -- 172.21.15.69:0/3736074187 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7f57d40a9d40 con 0x7f57dc10c5c0 2024-05-14T15:16:30.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:30.930+0000 7f57e3000700 1 -- 172.21.15.69:0/3736074187 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f57c00b2880 msgr2=0x7f57c00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:30.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:30.930+0000 7f57e3000700 1 --2- 172.21.15.69:0/3736074187 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f57c00b2880 0x7f57c00b4d90 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f57cc006010 tx=0x7f57cc00b540 comp rx=0 tx=0).stop 2024-05-14T15:16:30.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:30.930+0000 7f57e3000700 1 -- 172.21.15.69:0/3736074187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc10c5c0 msgr2=0x7f57dc1a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:30.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:30.930+0000 7f57e3000700 1 --2- 172.21.15.69:0/3736074187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc10c5c0 0x7f57dc1a17d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f57d400ada0 tx=0x7f57d400c330 comp rx=0 tx=0).stop 2024-05-14T15:16:30.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:30.930+0000 7f57e3000700 1 -- 172.21.15.69:0/3736074187 shutdown_connections 2024-05-14T15:16:30.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:30.930+0000 7f57e3000700 1 --2- 172.21.15.69:0/3736074187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57dc10c5c0 0x7f57dc1a17d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:30.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:30.930+0000 7f57e3000700 1 --2- 172.21.15.69:0/3736074187 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f57c00b2880 0x7f57c00b4d90 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:30.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:30.930+0000 7f57e3000700 1 --2- 172.21.15.69:0/3736074187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57dc106580 0x7f57dc19cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:30.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:30.930+0000 7f57e3000700 1 --2- 172.21.15.69:0/3736074187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57dc106ed0 0x7f57dc19d540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:30.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:30.930+0000 7f57e3000700 1 -- 172.21.15.69:0/3736074187 >> 172.21.15.69:0/3736074187 conn(0x7f57dc102080 msgr2=0x7f57dc104860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:30.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:30.931+0000 7f57e3000700 1 -- 172.21.15.69:0/3736074187 shutdown_connections 2024-05-14T15:16:30.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:30.931+0000 7f57e3000700 1 -- 172.21.15.69:0/3736074187 wait complete. 2024-05-14T15:16:30.932 INFO:teuthology.orchestra.run.smithi069.stderr:added data pool 4 to fsmap 2024-05-14T15:16:31.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:30 smithi092 ceph-mon[34729]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:31.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:30 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3736074187' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-14T15:16:31.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:30 smithi069 ceph-mon[31270]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:31.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:30 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3736074187' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-14T15:16:31.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:30 smithi203 ceph-mon[34567]: pgmap v400: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:31.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:30 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3736074187' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-05-14T15:16:31.900 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:16:32.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:31 smithi092 ceph-mon[34729]: osdmap e87: 12 total, 12 up, 12 in 2024-05-14T15:16:32.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:31 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3736074187' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-14T15:16:32.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:31 smithi092 ceph-mon[34729]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-14T15:16:32.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:31 smithi069 ceph-mon[31270]: osdmap e87: 12 total, 12 up, 12 in 2024-05-14T15:16:32.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:31 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3736074187' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-14T15:16:32.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:31 smithi069 ceph-mon[31270]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-14T15:16:32.333 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:16:32.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:31 smithi203 ceph-mon[34567]: osdmap e87: 12 total, 12 up, 12 in 2024-05-14T15:16:32.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:31 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3736074187' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-05-14T15:16:32.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:31 smithi203 ceph-mon[34567]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-14T15:16:33.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:32 smithi092 ceph-mon[34729]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:33.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:32 smithi092 ceph-mon[34729]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-14T15:16:33.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:32 smithi092 ceph-mon[34729]: Cluster is now healthy 2024-05-14T15:16:33.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:32 smithi069 ceph-mon[31270]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:33.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:32 smithi069 ceph-mon[31270]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-14T15:16:33.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:32 smithi069 ceph-mon[31270]: Cluster is now healthy 2024-05-14T15:16:33.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:32 smithi203 ceph-mon[34567]: pgmap v402: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:33.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:32 smithi203 ceph-mon[34567]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-05-14T15:16:33.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:32 smithi203 ceph-mon[34567]: Cluster is now healthy 2024-05-14T15:16:34.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.788+0000 7fe736000700 1 -- 172.21.15.69:0/1604617101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe730108d30 msgr2=0x7fe730109140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:34.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.788+0000 7fe736000700 1 --2- 172.21.15.69:0/1604617101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe730108d30 0x7fe730109140 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fe71c0099c0 tx=0x7fe71c009cd0 comp rx=0 tx=0).stop 2024-05-14T15:16:34.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.788+0000 7fe736000700 1 -- 172.21.15.69:0/1604617101 shutdown_connections 2024-05-14T15:16:34.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.788+0000 7fe736000700 1 --2- 172.21.15.69:0/1604617101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe730109680 0x7fe730110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:34.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.788+0000 7fe736000700 1 --2- 172.21.15.69:0/1604617101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe730104400 0x7fe730104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:34.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.788+0000 7fe736000700 1 --2- 172.21.15.69:0/1604617101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe730108d30 0x7fe730109140 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:34.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.788+0000 7fe736000700 1 -- 172.21.15.69:0/1604617101 >> 172.21.15.69:0/1604617101 conn(0x7fe730079d10 msgr2=0x7fe73007a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:34.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.788+0000 7fe736000700 1 -- 172.21.15.69:0/1604617101 shutdown_connections 2024-05-14T15:16:34.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.788+0000 7fe736000700 1 -- 172.21.15.69:0/1604617101 wait complete. 2024-05-14T15:16:34.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.789+0000 7fe736000700 1 Processor -- start 2024-05-14T15:16:34.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.790+0000 7fe736000700 1 -- start start 2024-05-14T15:16:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.790+0000 7fe736000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe730104400 0x7fe7301a0760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.790+0000 7fe736000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe730108d30 0x7fe7301a0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.790+0000 7fe736000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe730109680 0x7fe73019a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.790+0000 7fe736000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe730114140 con 0x7fe730108d30 2024-05-14T15:16:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.790+0000 7fe736000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe730113fc0 con 0x7fe730104400 2024-05-14T15:16:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.790+0000 7fe736000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe7301142c0 con 0x7fe730109680 2024-05-14T15:16:34.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.791+0000 7fe72fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe730108d30 0x7fe7301a0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.791+0000 7fe72fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe730108d30 0x7fe7301a0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58988/0 (socket says 172.21.15.69:58988) 2024-05-14T15:16:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.791+0000 7fe72fe00700 1 -- 172.21.15.69:0/192316898 learned_addr learned my addr 172.21.15.69:0/192316898 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.791+0000 7fe734c00700 1 --2- 172.21.15.69:0/192316898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe730104400 0x7fe7301a0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:34.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.791+0000 7fe735600700 1 --2- 172.21.15.69:0/192316898 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe730109680 0x7fe73019a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:34.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.791+0000 7fe72fe00700 1 -- 172.21.15.69:0/192316898 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe730109680 msgr2=0x7fe73019a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:34.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.791+0000 7fe72fe00700 1 --2- 172.21.15.69:0/192316898 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe730109680 0x7fe73019a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:34.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.791+0000 7fe72fe00700 1 -- 172.21.15.69:0/192316898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe730104400 msgr2=0x7fe7301a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:34.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.791+0000 7fe72fe00700 1 --2- 172.21.15.69:0/192316898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe730104400 0x7fe7301a0760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:34.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.791+0000 7fe72fe00700 1 -- 172.21.15.69:0/192316898 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73019afc0 con 0x7fe730108d30 2024-05-14T15:16:34.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.792+0000 7fe72fe00700 1 --2- 172.21.15.69:0/192316898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe730108d30 0x7fe7301a0ca0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00b580 tx=0x7fe71c00f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:34.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.792+0000 7fe72d600700 1 -- 172.21.15.69:0/192316898 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c026070 con 0x7fe730108d30 2024-05-14T15:16:34.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.792+0000 7fe72d600700 1 -- 172.21.15.69:0/192316898 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe71c005030 con 0x7fe730108d30 2024-05-14T15:16:34.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.792+0000 7fe736000700 1 -- 172.21.15.69:0/192316898 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe73019b250 con 0x7fe730108d30 2024-05-14T15:16:34.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.792+0000 7fe72d600700 1 -- 172.21.15.69:0/192316898 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe71c0049f0 con 0x7fe730108d30 2024-05-14T15:16:34.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.792+0000 7fe736000700 1 -- 172.21.15.69:0/192316898 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73019b730 con 0x7fe730108d30 2024-05-14T15:16:34.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.793+0000 7fe736000700 1 -- 172.21.15.69:0/192316898 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7301058b0 con 0x7fe730108d30 2024-05-14T15:16:34.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.796+0000 7fe72d600700 1 -- 172.21.15.69:0/192316898 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fe71c029070 con 0x7fe730108d30 2024-05-14T15:16:34.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.797+0000 7fe72d600700 1 --2- 172.21.15.69:0/192316898 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe7180b2880 0x7fe7180b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:34.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.798+0000 7fe72d600700 1 -- 172.21.15.69:0/192316898 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fe71c0e3280 con 0x7fe730108d30 2024-05-14T15:16:34.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.798+0000 7fe734c00700 1 --2- 172.21.15.69:0/192316898 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe7180b2880 0x7fe7180b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:34.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.799+0000 7fe734c00700 1 --2- 172.21.15.69:0/192316898 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe7180b2880 0x7fe7180b4d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe724005ea0 tx=0x7fe724005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:34.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:34.802+0000 7fe72d600700 1 -- 172.21.15.69:0/192316898 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe71c030080 con 0x7fe730108d30 2024-05-14T15:16:35.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:35.086+0000 7fe736000700 1 -- 172.21.15.69:0/192316898 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe73002e5f0 con 0x7fe730108d30 2024-05-14T15:16:35.085 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:34 smithi069 ceph-mon[31270]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:35.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:35.087+0000 7fe72d600700 1 -- 172.21.15.69:0/192316898 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11797 (secure 0 0 0) 0x7fe71c013070 con 0x7fe730108d30 2024-05-14T15:16:35.086 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:16:35.087 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24442,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24451,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34409,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34433,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34460,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:16:11.716543+0000","modified":"2024-05-14T15:16:29.932683+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34490":{"gid":34490,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34490,"qdb_cluster":[34490]},"id":1}]} 2024-05-14T15:16:35.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:35.091+0000 7fe736000700 1 -- 172.21.15.69:0/192316898 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe7180b2880 msgr2=0x7fe7180b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:35.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:35.091+0000 7fe736000700 1 --2- 172.21.15.69:0/192316898 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe7180b2880 0x7fe7180b4d90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe724005ea0 tx=0x7fe724005e30 comp rx=0 tx=0).stop 2024-05-14T15:16:35.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:35.091+0000 7fe736000700 1 -- 172.21.15.69:0/192316898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe730108d30 msgr2=0x7fe7301a0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:35.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:35.091+0000 7fe736000700 1 --2- 172.21.15.69:0/192316898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe730108d30 0x7fe7301a0ca0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe71c00b580 tx=0x7fe71c00f510 comp rx=0 tx=0).stop 2024-05-14T15:16:35.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:35.091+0000 7fe736000700 1 -- 172.21.15.69:0/192316898 shutdown_connections 2024-05-14T15:16:35.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:35.091+0000 7fe736000700 1 --2- 172.21.15.69:0/192316898 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe7180b2880 0x7fe7180b4d90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:35.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:35.091+0000 7fe736000700 1 --2- 172.21.15.69:0/192316898 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe730109680 0x7fe73019a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:35.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:35.091+0000 7fe736000700 1 --2- 172.21.15.69:0/192316898 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe730104400 0x7fe7301a0760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:35.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:35.091+0000 7fe736000700 1 --2- 172.21.15.69:0/192316898 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe730108d30 0x7fe7301a0ca0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:35.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:35.091+0000 7fe736000700 1 -- 172.21.15.69:0/192316898 >> 172.21.15.69:0/192316898 conn(0x7fe730079d10 msgr2=0x7fe730101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:35.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:35.091+0000 7fe736000700 1 -- 172.21.15.69:0/192316898 shutdown_connections 2024-05-14T15:16:35.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:35.092+0000 7fe736000700 1 -- 172.21.15.69:0/192316898 wait complete. 2024-05-14T15:16:35.091 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 17 2024-05-14T15:16:35.172 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:34 smithi203 ceph-mon[34567]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:35.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:34 smithi092 ceph-mon[34729]: pgmap v403: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:36.029 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T15:16:36.190 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:35 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/192316898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:16:36.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:35 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/192316898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:16:36.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:35 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/192316898' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:16:36.482 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:16:37.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:36 smithi203 ceph-mon[34567]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:37.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:36 smithi092 ceph-mon[34729]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:37.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:36 smithi069 ceph-mon[31270]: pgmap v404: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:38.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.755+0000 7f7f86000700 1 -- 172.21.15.69:0/3318491956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f8010b2e0 msgr2=0x7f7f80117810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.755+0000 7f7f86000700 1 --2- 172.21.15.69:0/3318491956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f8010b2e0 0x7f7f80117810 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f7f7800b0a0 tx=0x7f7f7800b3b0 comp rx=0 tx=0).stop 2024-05-14T15:16:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.755+0000 7f7f86000700 1 -- 172.21.15.69:0/3318491956 shutdown_connections 2024-05-14T15:16:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.755+0000 7f7f86000700 1 --2- 172.21.15.69:0/3318491956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f8010b2e0 0x7f7f80117810 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.755+0000 7f7f86000700 1 --2- 172.21.15.69:0/3318491956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f80110970 0x7f7f80110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.755+0000 7f7f86000700 1 --2- 172.21.15.69:0/3318491956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f8010a990 0x7f7f8010ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.756+0000 7f7f86000700 1 -- 172.21.15.69:0/3318491956 >> 172.21.15.69:0/3318491956 conn(0x7f7f80077c80 msgr2=0x7f7f800780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.756+0000 7f7f86000700 1 -- 172.21.15.69:0/3318491956 shutdown_connections 2024-05-14T15:16:38.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.756+0000 7f7f86000700 1 -- 172.21.15.69:0/3318491956 wait complete. 2024-05-14T15:16:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.757+0000 7f7f86000700 1 Processor -- start 2024-05-14T15:16:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.757+0000 7f7f86000700 1 -- start start 2024-05-14T15:16:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.757+0000 7f7f86000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f8010a990 0x7f7f801a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.757+0000 7f7f86000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f8010b2e0 0x7f7f801a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.757+0000 7f7f86000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f80110970 0x7f7f801a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.757+0000 7f7f86000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8011a990 con 0x7f7f8010b2e0 2024-05-14T15:16:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.758+0000 7f7f86000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8011a810 con 0x7f7f8010a990 2024-05-14T15:16:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.758+0000 7f7f86000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7f8011ab10 con 0x7f7f80110970 2024-05-14T15:16:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.758+0000 7f7f7ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f8010b2e0 0x7f7f801a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.758+0000 7f7f7ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f8010b2e0 0x7f7f801a1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59012/0 (socket says 172.21.15.69:59012) 2024-05-14T15:16:38.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.758+0000 7f7f7ea00700 1 -- 172.21.15.69:0/126600188 learned_addr learned my addr 172.21.15.69:0/126600188 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.758+0000 7f7f7f400700 1 --2- 172.21.15.69:0/126600188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f8010a990 0x7f7f801a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.758+0000 7f7f7fe00700 1 --2- 172.21.15.69:0/126600188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f80110970 0x7f7f801a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.758+0000 7f7f7ea00700 1 -- 172.21.15.69:0/126600188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f80110970 msgr2=0x7f7f801a5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.758+0000 7f7f7ea00700 1 --2- 172.21.15.69:0/126600188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f80110970 0x7f7f801a5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.758+0000 7f7f7ea00700 1 -- 172.21.15.69:0/126600188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f8010a990 msgr2=0x7f7f801a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.758+0000 7f7f7ea00700 1 --2- 172.21.15.69:0/126600188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f8010a990 0x7f7f801a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:38.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.758+0000 7f7f7ea00700 1 -- 172.21.15.69:0/126600188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f801a6230 con 0x7f7f8010b2e0 2024-05-14T15:16:38.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.759+0000 7f7f7ea00700 1 --2- 172.21.15.69:0/126600188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f8010b2e0 0x7f7f801a1900 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00d980 tx=0x7f7f6c00dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:38.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.759+0000 7f7f77e00700 1 -- 172.21.15.69:0/126600188 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c017070 con 0x7f7f8010b2e0 2024-05-14T15:16:38.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.759+0000 7f7f77e00700 1 -- 172.21.15.69:0/126600188 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7f6c00fd20 con 0x7f7f8010b2e0 2024-05-14T15:16:38.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.759+0000 7f7f86000700 1 -- 172.21.15.69:0/126600188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f801a64c0 con 0x7f7f8010b2e0 2024-05-14T15:16:38.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.759+0000 7f7f77e00700 1 -- 172.21.15.69:0/126600188 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f6c00e3b0 con 0x7f7f8010b2e0 2024-05-14T15:16:38.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.759+0000 7f7f86000700 1 -- 172.21.15.69:0/126600188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f801ade40 con 0x7f7f8010b2e0 2024-05-14T15:16:38.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.760+0000 7f7f86000700 1 -- 172.21.15.69:0/126600188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f8010c080 con 0x7f7f8010b2e0 2024-05-14T15:16:38.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.763+0000 7f7f77e00700 1 -- 172.21.15.69:0/126600188 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7f6c00f890 con 0x7f7f8010b2e0 2024-05-14T15:16:38.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.765+0000 7f7f77e00700 1 --2- 172.21.15.69:0/126600188 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f7f640b2900 0x7f7f640b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:38.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.765+0000 7f7f77e00700 1 -- 172.21.15.69:0/126600188 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f7f6c0e1e70 con 0x7f7f8010b2e0 2024-05-14T15:16:38.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.765+0000 7f7f7f400700 1 --2- 172.21.15.69:0/126600188 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f7f640b2900 0x7f7f640b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:38.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.766+0000 7f7f7f400700 1 --2- 172.21.15.69:0/126600188 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f7f640b2900 0x7f7f640b4e10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7f70005950 tx=0x7f7f7000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:38.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:38.767+0000 7f7f77e00700 1 -- 172.21.15.69:0/126600188 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7f6c0a9970 con 0x7f7f8010b2e0 2024-05-14T15:16:39.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:39.008+0000 7f7f86000700 1 -- 172.21.15.69:0/126600188 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7f8002e5f0 con 0x7f7f8010b2e0 2024-05-14T15:16:39.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:39.012+0000 7f7f77e00700 1 -- 172.21.15.69:0/126600188 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24091 (secure 0 0 0) 0x7f7f6c0a9270 con 0x7f7f8010b2e0 2024-05-14T15:16:39.011 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:16:39.011 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":87,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","created":"2024-05-14T15:04:32.074994+0000","modified":"2024-05-14T15:16:29.932498+0000","last_up_change":"2024-05-14T15:14:44.049523+0000","last_in_change":"2024-05-14T15:14:16.752653+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:09:03.561841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:16:02.641690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:16:06.949687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:16:20.891122+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8640de99-c23a-494e-a100-aafd04fe1867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6803","nonce":301095601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6805","nonce":301095601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6809","nonce":301095601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6807","nonce":301095601}]},"public_addr":"172.21.15.69:6803/301095601","cluster_addr":"172.21.15.69:6805/301095601","heartbeat_back_addr":"172.21.15.69:6809/301095601","heartbeat_front_addr":"172.21.15.69:6807/301095601","state":["exists","up"]},{"osd":1,"uuid":"89f78a32-7afb-49f3-9287-5478a1cc8829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6801","nonce":2774122776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6803","nonce":2774122776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6807","nonce":2774122776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6805","nonce":2774122776}]},"public_addr":"172.21.15.92:6801/2774122776","cluster_addr":"172.21.15.92:6803/2774122776","heartbeat_back_addr":"172.21.15.92:6807/2774122776","heartbeat_front_addr":"172.21.15.92:6805/2774122776","state":["exists","up"]},{"osd":2,"uuid":"a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6801","nonce":2836920513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6803","nonce":2836920513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6807","nonce":2836920513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6805","nonce":2836920513}]},"public_addr":"172.21.15.203:6801/2836920513","cluster_addr":"172.21.15.203:6803/2836920513","heartbeat_back_addr":"172.21.15.203:6807/2836920513","heartbeat_front_addr":"172.21.15.203:6805/2836920513","state":["exists","up"]},{"osd":3,"uuid":"81409850-de26-4520-972c-31a716adf4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6811","nonce":680308620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6813","nonce":680308620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6817","nonce":680308620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6815","nonce":680308620}]},"public_addr":"172.21.15.69:6811/680308620","cluster_addr":"172.21.15.69:6813/680308620","heartbeat_back_addr":"172.21.15.69:6817/680308620","heartbeat_front_addr":"172.21.15.69:6815/680308620","state":["exists","up"]},{"osd":4,"uuid":"9aa3a6b0-cc63-4eae-8416-8ab630994985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6809","nonce":1071971048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6811","nonce":1071971048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6815","nonce":1071971048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6813","nonce":1071971048}]},"public_addr":"172.21.15.92:6809/1071971048","cluster_addr":"172.21.15.92:6811/1071971048","heartbeat_back_addr":"172.21.15.92:6815/1071971048","heartbeat_front_addr":"172.21.15.92:6813/1071971048","state":["exists","up"]},{"osd":5,"uuid":"f7fcde57-e280-494b-a45f-8fa007ed9ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6809","nonce":1404230851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6811","nonce":1404230851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6815","nonce":1404230851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6813","nonce":1404230851}]},"public_addr":"172.21.15.203:6809/1404230851","cluster_addr":"172.21.15.203:6811/1404230851","heartbeat_back_addr":"172.21.15.203:6815/1404230851","heartbeat_front_addr":"172.21.15.203:6813/1404230851","state":["exists","up"]},{"osd":6,"uuid":"86f1373a-3b39-4a7f-b14c-9bf8695c6b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6819","nonce":1213427819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6821","nonce":1213427819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6825","nonce":1213427819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6823","nonce":1213427819}]},"public_addr":"172.21.15.69:6819/1213427819","cluster_addr":"172.21.15.69:6821/1213427819","heartbeat_back_addr":"172.21.15.69:6825/1213427819","heartbeat_front_addr":"172.21.15.69:6823/1213427819","state":["exists","up"]},{"osd":7,"uuid":"e790fbf1-3e34-4950-bdfa-cf1adbd451c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6817","nonce":4274774582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6819","nonce":4274774582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6823","nonce":4274774582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6821","nonce":4274774582}]},"public_addr":"172.21.15.92:6817/4274774582","cluster_addr":"172.21.15.92:6819/4274774582","heartbeat_back_addr":"172.21.15.92:6823/4274774582","heartbeat_front_addr":"172.21.15.92:6821/4274774582","state":["exists","up"]},{"osd":8,"uuid":"65019fee-6b18-4d13-841a-2e3acb51f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6817","nonce":2480959249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6819","nonce":2480959249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6823","nonce":2480959249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6821","nonce":2480959249}]},"public_addr":"172.21.15.203:6817/2480959249","cluster_addr":"172.21.15.203:6819/2480959249","heartbeat_back_addr":"172.21.15.203:6823/2480959249","heartbeat_front_addr":"172.21.15.203:6821/2480959249","state":["exists","up"]},{"osd":9,"uuid":"b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6827","nonce":2649966866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6829","nonce":2649966866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6833","nonce":2649966866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6831","nonce":2649966866}]},"public_addr":"172.21.15.69:6827/2649966866","cluster_addr":"172.21.15.69:6829/2649966866","heartbeat_back_addr":"172.21.15.69:6833/2649966866","heartbeat_front_addr":"172.21.15.69:6831/2649966866","state":["exists","up"]},{"osd":10,"uuid":"45287823-f7ea-431f-ac01-a72762b01a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6825","nonce":3650822776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6827","nonce":3650822776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6831","nonce":3650822776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6829","nonce":3650822776}]},"public_addr":"172.21.15.92:6825/3650822776","cluster_addr":"172.21.15.92:6827/3650822776","heartbeat_back_addr":"172.21.15.92:6831/3650822776","heartbeat_front_addr":"172.21.15.92:6829/3650822776","state":["exists","up"]},{"osd":11,"uuid":"2f3a10f9-2414-4151-b1cf-3db68b2a66fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6825","nonce":2590258806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6827","nonce":2590258806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6831","nonce":2590258806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6829","nonce":2590258806}]},"public_addr":"172.21.15.203:6825/2590258806","cluster_addr":"172.21.15.203:6827/2590258806","heartbeat_back_addr":"172.21.15.203:6831/2590258806","heartbeat_front_addr":"172.21.15.203:6829/2590258806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:07:50.047712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:08:25.223293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:01.269713+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:38.679607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:16.161314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:53.323450+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:11:31.930106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:10.173015+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:48.056752+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:13:25.780142+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:03.705208+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:41.267371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/151981233":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/3776172313":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/1288620257":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/2718114316":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/1655882616":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/4183332474":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/2806878946":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/2718114316":"2024-05-15T15:05:41.383453+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:16:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:39.015+0000 7f7f86000700 1 -- 172.21.15.69:0/126600188 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f7f640b2900 msgr2=0x7f7f640b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:39.015+0000 7f7f86000700 1 --2- 172.21.15.69:0/126600188 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f7f640b2900 0x7f7f640b4e10 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f7f70005950 tx=0x7f7f7000b410 comp rx=0 tx=0).stop 2024-05-14T15:16:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:39.015+0000 7f7f86000700 1 -- 172.21.15.69:0/126600188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f8010b2e0 msgr2=0x7f7f801a1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:39.015+0000 7f7f86000700 1 --2- 172.21.15.69:0/126600188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f8010b2e0 0x7f7f801a1900 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c00d980 tx=0x7f7f6c00dc90 comp rx=0 tx=0).stop 2024-05-14T15:16:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:39.015+0000 7f7f86000700 1 -- 172.21.15.69:0/126600188 shutdown_connections 2024-05-14T15:16:39.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:39.015+0000 7f7f86000700 1 --2- 172.21.15.69:0/126600188 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f7f640b2900 0x7f7f640b4e10 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:39.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:39.015+0000 7f7f86000700 1 --2- 172.21.15.69:0/126600188 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7f80110970 0x7f7f801a5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:39.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:39.015+0000 7f7f86000700 1 --2- 172.21.15.69:0/126600188 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7f8010a990 0x7f7f801a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:39.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:39.015+0000 7f7f86000700 1 --2- 172.21.15.69:0/126600188 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7f8010b2e0 0x7f7f801a1900 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:39.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:39.016+0000 7f7f86000700 1 -- 172.21.15.69:0/126600188 >> 172.21.15.69:0/126600188 conn(0x7f7f80077c80 msgr2=0x7f7f8007b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:39.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:39.016+0000 7f7f86000700 1 -- 172.21.15.69:0/126600188 shutdown_connections 2024-05-14T15:16:39.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:39.016+0000 7f7f86000700 1 -- 172.21.15.69:0/126600188 wait complete. 2024-05-14T15:16:39.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:38 smithi092 ceph-mon[34729]: pgmap v405: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:39.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:38 smithi069 ceph-mon[31270]: pgmap v405: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:39.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:38 smithi203 ceph-mon[34567]: pgmap v405: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:39.775 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T15:16:40.190 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:16:40.220 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:39 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/126600188' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:16:40.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:39 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/126600188' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:16:40.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:39 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/126600188' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:16:41.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:40 smithi069 ceph-mon[31270]: pgmap v406: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:41.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:40 smithi203 ceph-mon[34567]: pgmap v406: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:41.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:40 smithi092 ceph-mon[34729]: pgmap v406: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:42.238 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-05-14T15:16:42.238 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-05-14T15:16:42.238 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-05-14T15:16:42.238 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]: dispatch 2024-05-14T15:16:42.238 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-05-14T15:16:42.239 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-05-14T15:16:42.239 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-05-14T15:16:42.239 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-05-14T15:16:42.239 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 10]}]: dispatch 2024-05-14T15:16:42.239 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:41 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]: dispatch 2024-05-14T15:16:42.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-05-14T15:16:42.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-05-14T15:16:42.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-05-14T15:16:42.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]: dispatch 2024-05-14T15:16:42.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-05-14T15:16:42.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-05-14T15:16:42.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-05-14T15:16:42.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-05-14T15:16:42.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 10]}]: dispatch 2024-05-14T15:16:42.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:41 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]: dispatch 2024-05-14T15:16:42.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]: dispatch 2024-05-14T15:16:42.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-05-14T15:16:42.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]: dispatch 2024-05-14T15:16:42.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]: dispatch 2024-05-14T15:16:42.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]: dispatch 2024-05-14T15:16:42.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]: dispatch 2024-05-14T15:16:42.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]: dispatch 2024-05-14T15:16:42.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]: dispatch 2024-05-14T15:16:42.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 10]}]: dispatch 2024-05-14T15:16:42.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:41 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]: dispatch 2024-05-14T15:16:42.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.640+0000 7fb197200700 1 -- 172.21.15.69:0/1598519384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb190108740 msgr2=0x7fb1901100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:42.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.640+0000 7fb197200700 1 --2- 172.21.15.69:0/1598519384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb190108740 0x7fb1901100a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb18800b0d0 tx=0x7fb18800b3e0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.640+0000 7fb197200700 1 -- 172.21.15.69:0/1598519384 shutdown_connections 2024-05-14T15:16:42.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.640+0000 7fb197200700 1 --2- 172.21.15.69:0/1598519384 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb190108740 0x7fb1901100a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.640+0000 7fb197200700 1 --2- 172.21.15.69:0/1598519384 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1901034c0 0x7fb1901038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.640+0000 7fb197200700 1 --2- 172.21.15.69:0/1598519384 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb190107df0 0x7fb190108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.640+0000 7fb197200700 1 -- 172.21.15.69:0/1598519384 >> 172.21.15.69:0/1598519384 conn(0x7fb1900fedc0 msgr2=0x7fb1901011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:42.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.640+0000 7fb197200700 1 -- 172.21.15.69:0/1598519384 shutdown_connections 2024-05-14T15:16:42.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.640+0000 7fb197200700 1 -- 172.21.15.69:0/1598519384 wait complete. 2024-05-14T15:16:42.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.641+0000 7fb197200700 1 Processor -- start 2024-05-14T15:16:42.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.642+0000 7fb197200700 1 -- start start 2024-05-14T15:16:42.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.642+0000 7fb197200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1901034c0 0x7fb19019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.642+0000 7fb197200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb190107df0 0x7fb19019d430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.642+0000 7fb197200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb190108740 0x7fb1901a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.642+0000 7fb197200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb190113220 con 0x7fb1901034c0 2024-05-14T15:16:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.642+0000 7fb197200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb1901130a0 con 0x7fb190107df0 2024-05-14T15:16:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.642+0000 7fb197200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb1901133a0 con 0x7fb190108740 2024-05-14T15:16:42.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.643+0000 7fb18fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1901034c0 0x7fb19019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.643+0000 7fb18fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1901034c0 0x7fb19019ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59038/0 (socket says 172.21.15.69:59038) 2024-05-14T15:16:42.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.643+0000 7fb18fe00700 1 -- 172.21.15.69:0/1869744227 learned_addr learned my addr 172.21.15.69:0/1869744227 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:42.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.643+0000 7fb18f400700 1 --2- 172.21.15.69:0/1869744227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb190107df0 0x7fb19019d430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.643+0000 7fb195200700 1 --2- 172.21.15.69:0/1869744227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb190108740 0x7fb1901a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.643+0000 7fb18fe00700 1 -- 172.21.15.69:0/1869744227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb190108740 msgr2=0x7fb1901a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.643+0000 7fb18fe00700 1 --2- 172.21.15.69:0/1869744227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb190108740 0x7fb1901a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.643+0000 7fb18fe00700 1 -- 172.21.15.69:0/1869744227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb190107df0 msgr2=0x7fb19019d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.643+0000 7fb18fe00700 1 --2- 172.21.15.69:0/1869744227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb190107df0 0x7fb19019d430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.643+0000 7fb18fe00700 1 -- 172.21.15.69:0/1869744227 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1901a1cb0 con 0x7fb1901034c0 2024-05-14T15:16:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.643+0000 7fb195200700 1 --2- 172.21.15.69:0/1869744227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb190108740 0x7fb1901a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:16:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.643+0000 7fb18f400700 1 --2- 172.21.15.69:0/1869744227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb190107df0 0x7fb19019d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:16:42.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.644+0000 7fb18fe00700 1 --2- 172.21.15.69:0/1869744227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1901034c0 0x7fb19019ce90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb18000c9b0 tx=0x7fb18000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.644+0000 7fb18cc00700 1 -- 172.21.15.69:0/1869744227 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb180007b00 con 0x7fb1901034c0 2024-05-14T15:16:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.644+0000 7fb197200700 1 -- 172.21.15.69:0/1869744227 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1901a1fa0 con 0x7fb1901034c0 2024-05-14T15:16:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.644+0000 7fb18cc00700 1 -- 172.21.15.69:0/1869744227 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb180007ca0 con 0x7fb1901034c0 2024-05-14T15:16:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.644+0000 7fb18cc00700 1 -- 172.21.15.69:0/1869744227 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb180018660 con 0x7fb1901034c0 2024-05-14T15:16:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.644+0000 7fb197200700 1 -- 172.21.15.69:0/1869744227 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1901a24e0 con 0x7fb1901034c0 2024-05-14T15:16:42.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.646+0000 7fb197200700 1 -- 172.21.15.69:0/1869744227 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1900512c0 con 0x7fb1901034c0 2024-05-14T15:16:42.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.648+0000 7fb18cc00700 1 -- 172.21.15.69:0/1869744227 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb18000f450 con 0x7fb1901034c0 2024-05-14T15:16:42.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.650+0000 7fb18cc00700 1 --2- 172.21.15.69:0/1869744227 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1740b2880 0x7fb1740b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:42.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.650+0000 7fb18cc00700 1 -- 172.21.15.69:0/1869744227 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 9092+0+0 (secure 0 0 0) 0x7fb1800e2960 con 0x7fb1901034c0 2024-05-14T15:16:42.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.650+0000 7fb18f400700 1 --2- 172.21.15.69:0/1869744227 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1740b2880 0x7fb1740b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:42.649 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.651+0000 7fb18f400700 1 --2- 172.21.15.69:0/1869744227 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1740b2880 0x7fb1740b4d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb17c005e10 tx=0x7fb17c005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:42.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.652+0000 7fb18cc00700 1 -- 172.21.15.69:0/1869744227 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb180014030 con 0x7fb1901034c0 2024-05-14T15:16:42.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.885+0000 7fb197200700 1 -- 172.21.15.69:0/1869744227 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb19019e220 con 0x7fb1901034c0 2024-05-14T15:16:42.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.888+0000 7fb18cc00700 1 -- 172.21.15.69:0/1869744227 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) ==== 74+0+24674 (secure 0 0 0) 0x7fb19019e220 con 0x7fb1901034c0 2024-05-14T15:16:42.887 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:16:42.887 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":88,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","created":"2024-05-14T15:04:32.074994+0000","modified":"2024-05-14T15:16:41.963510+0000","last_up_change":"2024-05-14T15:14:44.049523+0000","last_in_change":"2024-05-14T15:14:16.752653+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:09:03.561841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:16:02.641690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:16:06.949687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:16:20.891122+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8640de99-c23a-494e-a100-aafd04fe1867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6803","nonce":301095601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6805","nonce":301095601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6809","nonce":301095601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6807","nonce":301095601}]},"public_addr":"172.21.15.69:6803/301095601","cluster_addr":"172.21.15.69:6805/301095601","heartbeat_back_addr":"172.21.15.69:6809/301095601","heartbeat_front_addr":"172.21.15.69:6807/301095601","state":["exists","up"]},{"osd":1,"uuid":"89f78a32-7afb-49f3-9287-5478a1cc8829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6801","nonce":2774122776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6803","nonce":2774122776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6807","nonce":2774122776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6805","nonce":2774122776}]},"public_addr":"172.21.15.92:6801/2774122776","cluster_addr":"172.21.15.92:6803/2774122776","heartbeat_back_addr":"172.21.15.92:6807/2774122776","heartbeat_front_addr":"172.21.15.92:6805/2774122776","state":["exists","up"]},{"osd":2,"uuid":"a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6801","nonce":2836920513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6803","nonce":2836920513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6807","nonce":2836920513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6805","nonce":2836920513}]},"public_addr":"172.21.15.203:6801/2836920513","cluster_addr":"172.21.15.203:6803/2836920513","heartbeat_back_addr":"172.21.15.203:6807/2836920513","heartbeat_front_addr":"172.21.15.203:6805/2836920513","state":["exists","up"]},{"osd":3,"uuid":"81409850-de26-4520-972c-31a716adf4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6811","nonce":680308620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6813","nonce":680308620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6817","nonce":680308620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6815","nonce":680308620}]},"public_addr":"172.21.15.69:6811/680308620","cluster_addr":"172.21.15.69:6813/680308620","heartbeat_back_addr":"172.21.15.69:6817/680308620","heartbeat_front_addr":"172.21.15.69:6815/680308620","state":["exists","up"]},{"osd":4,"uuid":"9aa3a6b0-cc63-4eae-8416-8ab630994985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6809","nonce":1071971048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6811","nonce":1071971048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6815","nonce":1071971048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6813","nonce":1071971048}]},"public_addr":"172.21.15.92:6809/1071971048","cluster_addr":"172.21.15.92:6811/1071971048","heartbeat_back_addr":"172.21.15.92:6815/1071971048","heartbeat_front_addr":"172.21.15.92:6813/1071971048","state":["exists","up"]},{"osd":5,"uuid":"f7fcde57-e280-494b-a45f-8fa007ed9ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6809","nonce":1404230851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6811","nonce":1404230851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6815","nonce":1404230851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6813","nonce":1404230851}]},"public_addr":"172.21.15.203:6809/1404230851","cluster_addr":"172.21.15.203:6811/1404230851","heartbeat_back_addr":"172.21.15.203:6815/1404230851","heartbeat_front_addr":"172.21.15.203:6813/1404230851","state":["exists","up"]},{"osd":6,"uuid":"86f1373a-3b39-4a7f-b14c-9bf8695c6b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6819","nonce":1213427819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6821","nonce":1213427819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6825","nonce":1213427819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6823","nonce":1213427819}]},"public_addr":"172.21.15.69:6819/1213427819","cluster_addr":"172.21.15.69:6821/1213427819","heartbeat_back_addr":"172.21.15.69:6825/1213427819","heartbeat_front_addr":"172.21.15.69:6823/1213427819","state":["exists","up"]},{"osd":7,"uuid":"e790fbf1-3e34-4950-bdfa-cf1adbd451c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6817","nonce":4274774582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6819","nonce":4274774582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6823","nonce":4274774582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6821","nonce":4274774582}]},"public_addr":"172.21.15.92:6817/4274774582","cluster_addr":"172.21.15.92:6819/4274774582","heartbeat_back_addr":"172.21.15.92:6823/4274774582","heartbeat_front_addr":"172.21.15.92:6821/4274774582","state":["exists","up"]},{"osd":8,"uuid":"65019fee-6b18-4d13-841a-2e3acb51f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6817","nonce":2480959249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6819","nonce":2480959249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6823","nonce":2480959249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6821","nonce":2480959249}]},"public_addr":"172.21.15.203:6817/2480959249","cluster_addr":"172.21.15.203:6819/2480959249","heartbeat_back_addr":"172.21.15.203:6823/2480959249","heartbeat_front_addr":"172.21.15.203:6821/2480959249","state":["exists","up"]},{"osd":9,"uuid":"b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6827","nonce":2649966866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6829","nonce":2649966866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6833","nonce":2649966866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6831","nonce":2649966866}]},"public_addr":"172.21.15.69:6827/2649966866","cluster_addr":"172.21.15.69:6829/2649966866","heartbeat_back_addr":"172.21.15.69:6833/2649966866","heartbeat_front_addr":"172.21.15.69:6831/2649966866","state":["exists","up"]},{"osd":10,"uuid":"45287823-f7ea-431f-ac01-a72762b01a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6825","nonce":3650822776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6827","nonce":3650822776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6831","nonce":3650822776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6829","nonce":3650822776}]},"public_addr":"172.21.15.92:6825/3650822776","cluster_addr":"172.21.15.92:6827/3650822776","heartbeat_back_addr":"172.21.15.92:6831/3650822776","heartbeat_front_addr":"172.21.15.92:6829/3650822776","state":["exists","up"]},{"osd":11,"uuid":"2f3a10f9-2414-4151-b1cf-3db68b2a66fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6825","nonce":2590258806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6827","nonce":2590258806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6831","nonce":2590258806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6829","nonce":2590258806}]},"public_addr":"172.21.15.203:6825/2590258806","cluster_addr":"172.21.15.203:6827/2590258806","heartbeat_back_addr":"172.21.15.203:6831/2590258806","heartbeat_front_addr":"172.21.15.203:6829/2590258806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:07:50.047712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:08:25.223293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:01.269713+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:38.679607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:16.161314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:53.323450+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:11:31.930106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:10.173015+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:48.056752+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:13:25.780142+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:03.705208+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:41.267371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/151981233":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/3776172313":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/1288620257":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/2718114316":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/1655882616":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/4183332474":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/2806878946":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/2718114316":"2024-05-15T15:05:41.383453+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:16:42.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.891+0000 7fb197200700 1 -- 172.21.15.69:0/1869744227 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1740b2880 msgr2=0x7fb1740b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:42.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.891+0000 7fb197200700 1 --2- 172.21.15.69:0/1869744227 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1740b2880 0x7fb1740b4d90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb17c005e10 tx=0x7fb17c005d60 comp rx=0 tx=0).stop 2024-05-14T15:16:42.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.891+0000 7fb197200700 1 -- 172.21.15.69:0/1869744227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1901034c0 msgr2=0x7fb19019ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:42.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.891+0000 7fb197200700 1 --2- 172.21.15.69:0/1869744227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1901034c0 0x7fb19019ce90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb18000c9b0 tx=0x7fb18000cd70 comp rx=0 tx=0).stop 2024-05-14T15:16:42.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.891+0000 7fb197200700 1 -- 172.21.15.69:0/1869744227 shutdown_connections 2024-05-14T15:16:42.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.891+0000 7fb197200700 1 --2- 172.21.15.69:0/1869744227 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1901034c0 0x7fb19019ce90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.891+0000 7fb197200700 1 --2- 172.21.15.69:0/1869744227 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1740b2880 0x7fb1740b4d90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.891+0000 7fb197200700 1 --2- 172.21.15.69:0/1869744227 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb190108740 0x7fb1901a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.891+0000 7fb197200700 1 --2- 172.21.15.69:0/1869744227 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb190107df0 0x7fb19019d430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:42.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.891+0000 7fb197200700 1 -- 172.21.15.69:0/1869744227 >> 172.21.15.69:0/1869744227 conn(0x7fb1900fedc0 msgr2=0x7fb19010ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:42.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.892+0000 7fb197200700 1 -- 172.21.15.69:0/1869744227 shutdown_connections 2024-05-14T15:16:42.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:42.892+0000 7fb197200700 1 -- 172.21.15.69:0/1869744227 wait complete. 2024-05-14T15:16:43.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:42 smithi069 ceph-mon[31270]: pgmap v407: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:43.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-05-14T15:16:43.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-05-14T15:16:43.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-05-14T15:16:43.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]': finished 2024-05-14T15:16:43.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-05-14T15:16:43.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-05-14T15:16:43.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-05-14T15:16:43.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-05-14T15:16:43.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 10]}]': finished 2024-05-14T15:16:43.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2024-05-14T15:16:43.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:42 smithi069 ceph-mon[31270]: osdmap e88: 12 total, 12 up, 12 in 2024-05-14T15:16:43.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:42 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1869744227' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:16:43.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:42 smithi203 ceph-mon[34567]: pgmap v407: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:43.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-05-14T15:16:43.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-05-14T15:16:43.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-05-14T15:16:43.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]': finished 2024-05-14T15:16:43.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-05-14T15:16:43.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-05-14T15:16:43.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-05-14T15:16:43.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-05-14T15:16:43.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 10]}]': finished 2024-05-14T15:16:43.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2024-05-14T15:16:43.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:42 smithi203 ceph-mon[34567]: osdmap e88: 12 total, 12 up, 12 in 2024-05-14T15:16:43.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:42 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1869744227' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:16:43.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:42 smithi092 ceph-mon[34729]: pgmap v407: 129 pgs: 129 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:43.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.8", "id": [2, 11]}]': finished 2024-05-14T15:16:43.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-05-14T15:16:43.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.0", "id": [4, 6]}]': finished 2024-05-14T15:16:43.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.28", "id": [5, 7]}]': finished 2024-05-14T15:16:43.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2c", "id": [4, 9]}]': finished 2024-05-14T15:16:43.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.31", "id": [4, 8]}]': finished 2024-05-14T15:16:43.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [9, 8]}]': finished 2024-05-14T15:16:43.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.f", "id": [9, 8]}]': finished 2024-05-14T15:16:43.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.16", "id": [9, 10]}]': finished 2024-05-14T15:16:43.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1a", "id": [5, 8]}]': finished 2024-05-14T15:16:43.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:42 smithi092 ceph-mon[34729]: osdmap e88: 12 total, 12 up, 12 in 2024-05-14T15:16:43.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:42 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1869744227' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:16:43.737 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:16:44.185 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:16:44.334 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:44 smithi069 ceph-mon[31270]: osdmap e89: 12 total, 12 up, 12 in 2024-05-14T15:16:44.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:44 smithi203 ceph-mon[34567]: osdmap e89: 12 total, 12 up, 12 in 2024-05-14T15:16:44.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:44 smithi092 ceph-mon[34729]: osdmap e89: 12 total, 12 up, 12 in 2024-05-14T15:16:45.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:45 smithi069 ceph-mon[31270]: pgmap v410: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:45.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:45 smithi203 ceph-mon[34567]: pgmap v410: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:45.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:45 smithi092 ceph-mon[34729]: pgmap v410: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 374 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:46.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.598+0000 7f7d3d200700 1 -- 172.21.15.69:0/2083531649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d38109870 msgr2=0x7f7d381111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:46.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.598+0000 7f7d3d200700 1 --2- 172.21.15.69:0/2083531649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d38109870 0x7f7d381111d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000b0d0 tx=0x7f7d3000b3e0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.598+0000 7f7d3d200700 1 -- 172.21.15.69:0/2083531649 shutdown_connections 2024-05-14T15:16:46.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.598+0000 7f7d3d200700 1 --2- 172.21.15.69:0/2083531649 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d38109870 0x7f7d381111d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.598+0000 7f7d3d200700 1 --2- 172.21.15.69:0/2083531649 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d381045f0 0x7f7d38104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.598+0000 7f7d3d200700 1 --2- 172.21.15.69:0/2083531649 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d38108f20 0x7f7d38109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.598+0000 7f7d3d200700 1 -- 172.21.15.69:0/2083531649 >> 172.21.15.69:0/2083531649 conn(0x7f7d38100040 msgr2=0x7f7d38102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:46.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.598+0000 7f7d3d200700 1 -- 172.21.15.69:0/2083531649 shutdown_connections 2024-05-14T15:16:46.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.598+0000 7f7d3d200700 1 -- 172.21.15.69:0/2083531649 wait complete. 2024-05-14T15:16:46.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.600+0000 7f7d3d200700 1 Processor -- start 2024-05-14T15:16:46.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.600+0000 7f7d3d200700 1 -- start start 2024-05-14T15:16:46.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.601+0000 7f7d3d200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d381045f0 0x7f7d3819ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:46.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.601+0000 7f7d3d200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d38108f20 0x7f7d3819b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:46.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.601+0000 7f7d3d200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d38109870 0x7f7d3819f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:46.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.601+0000 7f7d3d200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7d38114370 con 0x7f7d38108f20 2024-05-14T15:16:46.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.601+0000 7f7d3d200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7d381141f0 con 0x7f7d38109870 2024-05-14T15:16:46.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.601+0000 7f7d3d200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7d381144f0 con 0x7f7d381045f0 2024-05-14T15:16:46.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.601+0000 7f7d35400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d38108f20 0x7f7d3819b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:46.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.601+0000 7f7d35400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d38108f20 0x7f7d3819b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45070/0 (socket says 172.21.15.69:45070) 2024-05-14T15:16:46.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.601+0000 7f7d35400700 1 -- 172.21.15.69:0/1359393568 learned_addr learned my addr 172.21.15.69:0/1359393568 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:46.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.601+0000 7f7d35e00700 1 --2- 172.21.15.69:0/1359393568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d381045f0 0x7f7d3819ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:46.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.601+0000 7f7d36800700 1 --2- 172.21.15.69:0/1359393568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d38109870 0x7f7d3819f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:46.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.602+0000 7f7d35400700 1 -- 172.21.15.69:0/1359393568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d381045f0 msgr2=0x7f7d3819ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:46.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.602+0000 7f7d35400700 1 --2- 172.21.15.69:0/1359393568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d381045f0 0x7f7d3819ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.602+0000 7f7d35400700 1 -- 172.21.15.69:0/1359393568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d38109870 msgr2=0x7f7d3819f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:46.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.602+0000 7f7d35400700 1 --2- 172.21.15.69:0/1359393568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d38109870 0x7f7d3819f570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.602+0000 7f7d35400700 1 -- 172.21.15.69:0/1359393568 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d3819fc10 con 0x7f7d38108f20 2024-05-14T15:16:46.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.602+0000 7f7d35400700 1 --2- 172.21.15.69:0/1359393568 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d38108f20 0x7f7d3819b2e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7d2400d950 tx=0x7f7d2400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:46.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.602+0000 7f7d2ea00700 1 -- 172.21.15.69:0/1359393568 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d24017070 con 0x7f7d38108f20 2024-05-14T15:16:46.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.602+0000 7f7d2ea00700 1 -- 172.21.15.69:0/1359393568 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7d24005020 con 0x7f7d38108f20 2024-05-14T15:16:46.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.602+0000 7f7d3d200700 1 -- 172.21.15.69:0/1359393568 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3819ff00 con 0x7f7d38108f20 2024-05-14T15:16:46.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.602+0000 7f7d2ea00700 1 -- 172.21.15.69:0/1359393568 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2400f980 con 0x7f7d38108f20 2024-05-14T15:16:46.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.603+0000 7f7d3d200700 1 -- 172.21.15.69:0/1359393568 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d381a7820 con 0x7f7d38108f20 2024-05-14T15:16:46.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.604+0000 7f7d3d200700 1 -- 172.21.15.69:0/1359393568 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d380512c0 con 0x7f7d38108f20 2024-05-14T15:16:46.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.606+0000 7f7d2ea00700 1 -- 172.21.15.69:0/1359393568 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f7d24004a30 con 0x7f7d38108f20 2024-05-14T15:16:46.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.608+0000 7f7d2ea00700 1 --2- 172.21.15.69:0/1359393568 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f7d1c0b2900 0x7f7d1c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:46.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.608+0000 7f7d2ea00700 1 -- 172.21.15.69:0/1359393568 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f7d240e20c0 con 0x7f7d38108f20 2024-05-14T15:16:46.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.608+0000 7f7d35e00700 1 --2- 172.21.15.69:0/1359393568 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f7d1c0b2900 0x7f7d1c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:46.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.609+0000 7f7d35e00700 1 --2- 172.21.15.69:0/1359393568 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f7d1c0b2900 0x7f7d1c0b4e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7d28005950 tx=0x7f7d2800b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:46.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.611+0000 7f7d2ea00700 1 -- 172.21.15.69:0/1359393568 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7d240a9aa0 con 0x7f7d38108f20 2024-05-14T15:16:46.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.892+0000 7f7d3d200700 1 -- 172.21.15.69:0/1359393568 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7d3802e5f0 con 0x7f7d38108f20 2024-05-14T15:16:46.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.894+0000 7f7d2ea00700 1 -- 172.21.15.69:0/1359393568 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11797 (secure 0 0 0) 0x7f7d240a93a0 con 0x7f7d38108f20 2024-05-14T15:16:46.893 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:16:46.893 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14613,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24430,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24442,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24451,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":34409,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":34433,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":34460,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-14T15:16:11.716543+0000","modified":"2024-05-14T15:16:29.932683+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34490},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34490":{"gid":34490,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34490,"qdb_cluster":[34490]},"id":1}]} 2024-05-14T15:16:46.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.897+0000 7f7d3d200700 1 -- 172.21.15.69:0/1359393568 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f7d1c0b2900 msgr2=0x7f7d1c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:46.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.897+0000 7f7d3d200700 1 --2- 172.21.15.69:0/1359393568 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f7d1c0b2900 0x7f7d1c0b4e10 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f7d28005950 tx=0x7f7d2800b410 comp rx=0 tx=0).stop 2024-05-14T15:16:46.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.897+0000 7f7d3d200700 1 -- 172.21.15.69:0/1359393568 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d38108f20 msgr2=0x7f7d3819b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:46.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.897+0000 7f7d3d200700 1 --2- 172.21.15.69:0/1359393568 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d38108f20 0x7f7d3819b2e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f7d2400d950 tx=0x7f7d2400dc60 comp rx=0 tx=0).stop 2024-05-14T15:16:46.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.897+0000 7f7d3d200700 1 -- 172.21.15.69:0/1359393568 shutdown_connections 2024-05-14T15:16:46.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.897+0000 7f7d3d200700 1 --2- 172.21.15.69:0/1359393568 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f7d1c0b2900 0x7f7d1c0b4e10 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.897+0000 7f7d3d200700 1 --2- 172.21.15.69:0/1359393568 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7d38109870 0x7f7d3819f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.897+0000 7f7d3d200700 1 --2- 172.21.15.69:0/1359393568 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7d381045f0 0x7f7d3819ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.897+0000 7f7d3d200700 1 --2- 172.21.15.69:0/1359393568 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7d38108f20 0x7f7d3819b2e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:46.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.897+0000 7f7d3d200700 1 -- 172.21.15.69:0/1359393568 >> 172.21.15.69:0/1359393568 conn(0x7f7d38100040 msgr2=0x7f7d3810a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:46.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.898+0000 7f7d3d200700 1 -- 172.21.15.69:0/1359393568 shutdown_connections 2024-05-14T15:16:46.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:46.898+0000 7f7d3d200700 1 -- 172.21.15.69:0/1359393568 wait complete. 2024-05-14T15:16:46.898 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 17 2024-05-14T15:16:47.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:47 smithi203 ceph-mon[34567]: pgmap v411: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:47.092 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:47 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1359393568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:16:47.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:47 smithi069 ceph-mon[31270]: pgmap v411: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:47.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:47 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1359393568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:16:47.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:47 smithi092 ceph-mon[34729]: pgmap v411: 129 pgs: 2 peering, 127 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:47.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:47 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1359393568' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:16:47.774 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T15:16:48.217 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:16:49.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:49 smithi092 ceph-mon[34729]: pgmap v412: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:49.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:49 smithi069 ceph-mon[31270]: pgmap v412: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:49.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:49 smithi203 ceph-mon[34567]: pgmap v412: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:50.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.478+0000 7fbb2d000700 1 -- 172.21.15.69:0/2293425597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb28105550 msgr2=0x7fbb28105960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:50.477 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.478+0000 7fbb2d000700 1 --2- 172.21.15.69:0/2293425597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb28105550 0x7fbb28105960 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fbb18009990 tx=0x7fbb18009ca0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.478+0000 7fbb2d000700 1 -- 172.21.15.69:0/2293425597 shutdown_connections 2024-05-14T15:16:50.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.478+0000 7fbb2d000700 1 --2- 172.21.15.69:0/2293425597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb28105550 0x7fbb28105960 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.478+0000 7fbb2d000700 1 --2- 172.21.15.69:0/2293425597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb2810e930 0x7fbb28110e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.478+0000 7fbb2d000700 1 --2- 172.21.15.69:0/2293425597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb28105ea0 0x7fbb2810e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.478+0000 7fbb2d000700 1 -- 172.21.15.69:0/2293425597 >> 172.21.15.69:0/2293425597 conn(0x7fbb28078e00 msgr2=0x7fbb28079240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:50.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.478+0000 7fbb2d000700 1 -- 172.21.15.69:0/2293425597 shutdown_connections 2024-05-14T15:16:50.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.478+0000 7fbb2d000700 1 -- 172.21.15.69:0/2293425597 wait complete. 2024-05-14T15:16:50.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.479+0000 7fbb2d000700 1 Processor -- start 2024-05-14T15:16:50.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.480+0000 7fbb2d000700 1 -- start start 2024-05-14T15:16:50.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.480+0000 7fbb2d000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb28105550 0x7fbb2819d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:50.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.480+0000 7fbb2d000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb28105ea0 0x7fbb2819d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:50.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.480+0000 7fbb2d000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb2810e930 0x7fbb281a1850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:50.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.480+0000 7fbb2d000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbb28114370 con 0x7fbb2810e930 2024-05-14T15:16:50.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.480+0000 7fbb2d000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb281141f0 con 0x7fbb28105ea0 2024-05-14T15:16:50.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.480+0000 7fbb2d000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbb281144f0 con 0x7fbb28105550 2024-05-14T15:16:50.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.481+0000 7fbb26800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb2810e930 0x7fbb281a1850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:50.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.481+0000 7fbb26800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb2810e930 0x7fbb281a1850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45090/0 (socket says 172.21.15.69:45090) 2024-05-14T15:16:50.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.481+0000 7fbb26800700 1 -- 172.21.15.69:0/3951075462 learned_addr learned my addr 172.21.15.69:0/3951075462 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:50.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.481+0000 7fbb25e00700 1 --2- 172.21.15.69:0/3951075462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb28105550 0x7fbb2819d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:50.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.481+0000 7fbb25400700 1 --2- 172.21.15.69:0/3951075462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb28105ea0 0x7fbb2819d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:50.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.481+0000 7fbb26800700 1 -- 172.21.15.69:0/3951075462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb28105550 msgr2=0x7fbb2819d020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:50.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.481+0000 7fbb26800700 1 --2- 172.21.15.69:0/3951075462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb28105550 0x7fbb2819d020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.481+0000 7fbb26800700 1 -- 172.21.15.69:0/3951075462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb28105ea0 msgr2=0x7fbb2819d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:50.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.481+0000 7fbb26800700 1 --2- 172.21.15.69:0/3951075462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb28105ea0 0x7fbb2819d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.481+0000 7fbb26800700 1 -- 172.21.15.69:0/3951075462 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb281a1e40 con 0x7fbb2810e930 2024-05-14T15:16:50.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.481+0000 7fbb26800700 1 --2- 172.21.15.69:0/3951075462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb2810e930 0x7fbb281a1850 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbb20007d70 tx=0x7fbb2000a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:50.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.482+0000 7fbb1ea00700 1 -- 172.21.15.69:0/3951075462 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb20016020 con 0x7fbb2810e930 2024-05-14T15:16:50.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.482+0000 7fbb1ea00700 1 -- 172.21.15.69:0/3951075462 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb2000ad40 con 0x7fbb2810e930 2024-05-14T15:16:50.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.482+0000 7fbb2d000700 1 -- 172.21.15.69:0/3951075462 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb281a2130 con 0x7fbb2810e930 2024-05-14T15:16:50.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.482+0000 7fbb1ea00700 1 -- 172.21.15.69:0/3951075462 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb200115e0 con 0x7fbb2810e930 2024-05-14T15:16:50.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.482+0000 7fbb2d000700 1 -- 172.21.15.69:0/3951075462 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb281a2670 con 0x7fbb2810e930 2024-05-14T15:16:50.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.483+0000 7fbb2d000700 1 -- 172.21.15.69:0/3951075462 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb280512c0 con 0x7fbb2810e930 2024-05-14T15:16:50.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.487+0000 7fbb1ea00700 1 -- 172.21.15.69:0/3951075462 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fbb20019020 con 0x7fbb2810e930 2024-05-14T15:16:50.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.489+0000 7fbb1ea00700 1 --2- 172.21.15.69:0/3951075462 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbb0c0b2900 0x7fbb0c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:50.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.489+0000 7fbb1ea00700 1 -- 172.21.15.69:0/3951075462 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fbb200e2930 con 0x7fbb2810e930 2024-05-14T15:16:50.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.489+0000 7fbb25e00700 1 --2- 172.21.15.69:0/3951075462 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbb0c0b2900 0x7fbb0c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:50.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.489+0000 7fbb25e00700 1 --2- 172.21.15.69:0/3951075462 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbb0c0b2900 0x7fbb0c0b4e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800b5c0 tx=0x7fbb18005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:50.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.491+0000 7fbb1ea00700 1 -- 172.21.15.69:0/3951075462 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbb20020020 con 0x7fbb2810e930 2024-05-14T15:16:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.724+0000 7fbb2d000700 1 -- 172.21.15.69:0/3951075462 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbb2819e380 con 0x7fbb2810e930 2024-05-14T15:16:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.727+0000 7fbb1ea00700 1 -- 172.21.15.69:0/3951075462 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24674 (secure 0 0 0) 0x7fbb200aa290 con 0x7fbb2810e930 2024-05-14T15:16:50.727 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:16:50.728 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":89,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","created":"2024-05-14T15:04:32.074994+0000","modified":"2024-05-14T15:16:42.977203+0000","last_up_change":"2024-05-14T15:14:44.049523+0000","last_in_change":"2024-05-14T15:14:16.752653+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:09:03.561841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:16:02.641690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:16:06.949687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:16:20.891122+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8640de99-c23a-494e-a100-aafd04fe1867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6803","nonce":301095601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6805","nonce":301095601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6809","nonce":301095601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6807","nonce":301095601}]},"public_addr":"172.21.15.69:6803/301095601","cluster_addr":"172.21.15.69:6805/301095601","heartbeat_back_addr":"172.21.15.69:6809/301095601","heartbeat_front_addr":"172.21.15.69:6807/301095601","state":["exists","up"]},{"osd":1,"uuid":"89f78a32-7afb-49f3-9287-5478a1cc8829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6801","nonce":2774122776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6803","nonce":2774122776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6807","nonce":2774122776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6805","nonce":2774122776}]},"public_addr":"172.21.15.92:6801/2774122776","cluster_addr":"172.21.15.92:6803/2774122776","heartbeat_back_addr":"172.21.15.92:6807/2774122776","heartbeat_front_addr":"172.21.15.92:6805/2774122776","state":["exists","up"]},{"osd":2,"uuid":"a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6801","nonce":2836920513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6803","nonce":2836920513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6807","nonce":2836920513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6805","nonce":2836920513}]},"public_addr":"172.21.15.203:6801/2836920513","cluster_addr":"172.21.15.203:6803/2836920513","heartbeat_back_addr":"172.21.15.203:6807/2836920513","heartbeat_front_addr":"172.21.15.203:6805/2836920513","state":["exists","up"]},{"osd":3,"uuid":"81409850-de26-4520-972c-31a716adf4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6811","nonce":680308620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6813","nonce":680308620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6817","nonce":680308620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6815","nonce":680308620}]},"public_addr":"172.21.15.69:6811/680308620","cluster_addr":"172.21.15.69:6813/680308620","heartbeat_back_addr":"172.21.15.69:6817/680308620","heartbeat_front_addr":"172.21.15.69:6815/680308620","state":["exists","up"]},{"osd":4,"uuid":"9aa3a6b0-cc63-4eae-8416-8ab630994985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6809","nonce":1071971048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6811","nonce":1071971048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6815","nonce":1071971048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6813","nonce":1071971048}]},"public_addr":"172.21.15.92:6809/1071971048","cluster_addr":"172.21.15.92:6811/1071971048","heartbeat_back_addr":"172.21.15.92:6815/1071971048","heartbeat_front_addr":"172.21.15.92:6813/1071971048","state":["exists","up"]},{"osd":5,"uuid":"f7fcde57-e280-494b-a45f-8fa007ed9ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6809","nonce":1404230851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6811","nonce":1404230851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6815","nonce":1404230851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6813","nonce":1404230851}]},"public_addr":"172.21.15.203:6809/1404230851","cluster_addr":"172.21.15.203:6811/1404230851","heartbeat_back_addr":"172.21.15.203:6815/1404230851","heartbeat_front_addr":"172.21.15.203:6813/1404230851","state":["exists","up"]},{"osd":6,"uuid":"86f1373a-3b39-4a7f-b14c-9bf8695c6b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6819","nonce":1213427819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6821","nonce":1213427819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6825","nonce":1213427819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6823","nonce":1213427819}]},"public_addr":"172.21.15.69:6819/1213427819","cluster_addr":"172.21.15.69:6821/1213427819","heartbeat_back_addr":"172.21.15.69:6825/1213427819","heartbeat_front_addr":"172.21.15.69:6823/1213427819","state":["exists","up"]},{"osd":7,"uuid":"e790fbf1-3e34-4950-bdfa-cf1adbd451c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6817","nonce":4274774582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6819","nonce":4274774582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6823","nonce":4274774582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6821","nonce":4274774582}]},"public_addr":"172.21.15.92:6817/4274774582","cluster_addr":"172.21.15.92:6819/4274774582","heartbeat_back_addr":"172.21.15.92:6823/4274774582","heartbeat_front_addr":"172.21.15.92:6821/4274774582","state":["exists","up"]},{"osd":8,"uuid":"65019fee-6b18-4d13-841a-2e3acb51f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6817","nonce":2480959249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6819","nonce":2480959249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6823","nonce":2480959249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6821","nonce":2480959249}]},"public_addr":"172.21.15.203:6817/2480959249","cluster_addr":"172.21.15.203:6819/2480959249","heartbeat_back_addr":"172.21.15.203:6823/2480959249","heartbeat_front_addr":"172.21.15.203:6821/2480959249","state":["exists","up"]},{"osd":9,"uuid":"b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6827","nonce":2649966866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6829","nonce":2649966866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6833","nonce":2649966866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6831","nonce":2649966866}]},"public_addr":"172.21.15.69:6827/2649966866","cluster_addr":"172.21.15.69:6829/2649966866","heartbeat_back_addr":"172.21.15.69:6833/2649966866","heartbeat_front_addr":"172.21.15.69:6831/2649966866","state":["exists","up"]},{"osd":10,"uuid":"45287823-f7ea-431f-ac01-a72762b01a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6825","nonce":3650822776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6827","nonce":3650822776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6831","nonce":3650822776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6829","nonce":3650822776}]},"public_addr":"172.21.15.92:6825/3650822776","cluster_addr":"172.21.15.92:6827/3650822776","heartbeat_back_addr":"172.21.15.92:6831/3650822776","heartbeat_front_addr":"172.21.15.92:6829/3650822776","state":["exists","up"]},{"osd":11,"uuid":"2f3a10f9-2414-4151-b1cf-3db68b2a66fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6825","nonce":2590258806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6827","nonce":2590258806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6831","nonce":2590258806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6829","nonce":2590258806}]},"public_addr":"172.21.15.203:6825/2590258806","cluster_addr":"172.21.15.203:6827/2590258806","heartbeat_back_addr":"172.21.15.203:6831/2590258806","heartbeat_front_addr":"172.21.15.203:6829/2590258806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:07:50.047712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:08:25.223293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:01.269713+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:38.679607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:16.161314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:53.323450+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:11:31.930106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:10.173015+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:48.056752+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:13:25.780142+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:03.705208+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:41.267371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/151981233":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/3776172313":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/1288620257":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/2718114316":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/1655882616":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/4183332474":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/2806878946":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/2718114316":"2024-05-15T15:05:41.383453+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:16:50.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.730+0000 7fbb2d000700 1 -- 172.21.15.69:0/3951075462 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbb0c0b2900 msgr2=0x7fbb0c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:50.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.730+0000 7fbb2d000700 1 --2- 172.21.15.69:0/3951075462 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbb0c0b2900 0x7fbb0c0b4e10 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbb1800b5c0 tx=0x7fbb18005fb0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.730+0000 7fbb2d000700 1 -- 172.21.15.69:0/3951075462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb2810e930 msgr2=0x7fbb281a1850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.730+0000 7fbb2d000700 1 --2- 172.21.15.69:0/3951075462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb2810e930 0x7fbb281a1850 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbb20007d70 tx=0x7fbb2000a340 comp rx=0 tx=0).stop 2024-05-14T15:16:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.731+0000 7fbb2d000700 1 -- 172.21.15.69:0/3951075462 shutdown_connections 2024-05-14T15:16:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.731+0000 7fbb2d000700 1 --2- 172.21.15.69:0/3951075462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb2810e930 0x7fbb281a1850 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.731+0000 7fbb2d000700 1 --2- 172.21.15.69:0/3951075462 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbb0c0b2900 0x7fbb0c0b4e10 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.731+0000 7fbb2d000700 1 --2- 172.21.15.69:0/3951075462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb28105550 0x7fbb2819d020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.731+0000 7fbb2d000700 1 --2- 172.21.15.69:0/3951075462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb28105ea0 0x7fbb2819d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.731+0000 7fbb2d000700 1 -- 172.21.15.69:0/3951075462 >> 172.21.15.69:0/3951075462 conn(0x7fbb28078e00 msgr2=0x7fbb281043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.731+0000 7fbb2d000700 1 -- 172.21.15.69:0/3951075462 shutdown_connections 2024-05-14T15:16:50.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:50.731+0000 7fbb2d000700 1 -- 172.21.15.69:0/3951075462 wait complete. 2024-05-14T15:16:51.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:51 smithi203 ceph-mon[34567]: pgmap v413: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:51.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:51 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3951075462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:16:51.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:51 smithi092 ceph-mon[34729]: pgmap v413: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:51.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:51 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3951075462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:16:51.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:51 smithi069 ceph-mon[31270]: pgmap v413: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:51.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:51 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3951075462' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:16:51.588 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-14T15:16:11.716543+0000', 'modified': '2024-05-14T15:16:29.932683+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 34490}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_34490': {'gid': 34490, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.92:6839/2029564385', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 2029564385}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 2029564385}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 34490, 'qdb_cluster': [34490]} 2024-05-14T15:16:51.589 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-14T15:16:51.589 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.b status 2024-05-14T15:16:52.028 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:16:53.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:53 smithi203 ceph-mon[34567]: pgmap v414: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:53.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:53 smithi092 ceph-mon[34729]: pgmap v414: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:53.454 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:53 smithi069 ceph-mon[31270]: pgmap v414: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:54.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.413+0000 7fb5a3a00700 1 -- 172.21.15.69:0/4104334782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb59c110970 msgr2=0x7fb59c110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.413+0000 7fb5a3a00700 1 --2- 172.21.15.69:0/4104334782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb59c110970 0x7fb59c110d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fb590009990 tx=0x7fb590009ca0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.413+0000 7fb5a3a00700 1 -- 172.21.15.69:0/4104334782 shutdown_connections 2024-05-14T15:16:54.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.413+0000 7fb5a3a00700 1 --2- 172.21.15.69:0/4104334782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb59c110970 0x7fb59c110d80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.413+0000 7fb5a3a00700 1 --2- 172.21.15.69:0/4104334782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb59c10b2e0 0x7fb59c117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.413+0000 7fb5a3a00700 1 --2- 172.21.15.69:0/4104334782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb59c10a990 0x7fb59c10ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.413+0000 7fb5a3a00700 1 -- 172.21.15.69:0/4104334782 >> 172.21.15.69:0/4104334782 conn(0x7fb59c077c80 msgr2=0x7fb59c0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:54.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.413+0000 7fb5a3a00700 1 -- 172.21.15.69:0/4104334782 shutdown_connections 2024-05-14T15:16:54.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.413+0000 7fb5a3a00700 1 -- 172.21.15.69:0/4104334782 wait complete. 2024-05-14T15:16:54.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.414+0000 7fb5a3a00700 1 Processor -- start 2024-05-14T15:16:54.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.414+0000 7fb5a3a00700 1 -- start start 2024-05-14T15:16:54.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.415+0000 7fb5a3a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb59c10a990 0x7fb59c1a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.415+0000 7fb5a3a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb59c10b2e0 0x7fb59c1a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.415+0000 7fb5a3a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb59c110970 0x7fb59c1a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.415+0000 7fb5a3a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb59c11a950 con 0x7fb59c110970 2024-05-14T15:16:54.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.415+0000 7fb5a3a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb59c11a7d0 con 0x7fb59c10b2e0 2024-05-14T15:16:54.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.415+0000 7fb5a3a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb59c11aad0 con 0x7fb59c10a990 2024-05-14T15:16:54.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.415+0000 7fb5a1a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb59c110970 0x7fb59c1a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.415+0000 7fb5a1a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb59c110970 0x7fb59c1a5bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38182/0 (socket says 172.21.15.69:38182) 2024-05-14T15:16:54.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.415+0000 7fb5a1a00700 1 -- 172.21.15.69:0/2705198698 learned_addr learned my addr 172.21.15.69:0/2705198698 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:54.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.415+0000 7fb5a1000700 1 --2- 172.21.15.69:0/2705198698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb59c10a990 0x7fb59c1a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.415+0000 7fb59be00700 1 --2- 172.21.15.69:0/2705198698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb59c10b2e0 0x7fb59c1a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.415+0000 7fb5a1a00700 1 -- 172.21.15.69:0/2705198698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb59c10a990 msgr2=0x7fb59c1a13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.415+0000 7fb5a1a00700 1 --2- 172.21.15.69:0/2705198698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb59c10a990 0x7fb59c1a13a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.415+0000 7fb5a1a00700 1 -- 172.21.15.69:0/2705198698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb59c10b2e0 msgr2=0x7fb59c1a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.415+0000 7fb5a1a00700 1 --2- 172.21.15.69:0/2705198698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb59c10b2e0 0x7fb59c1a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.416+0000 7fb5a1a00700 1 -- 172.21.15.69:0/2705198698 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59c1a6270 con 0x7fb59c110970 2024-05-14T15:16:54.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.416+0000 7fb5a1a00700 1 --2- 172.21.15.69:0/2705198698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb59c110970 0x7fb59c1a5bd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb59400ef30 tx=0x7fb59400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:54.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.416+0000 7fb599600700 1 -- 172.21.15.69:0/2705198698 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5940092e0 con 0x7fb59c110970 2024-05-14T15:16:54.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.416+0000 7fb599600700 1 -- 172.21.15.69:0/2705198698 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb594004bb0 con 0x7fb59c110970 2024-05-14T15:16:54.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.416+0000 7fb5a3a00700 1 -- 172.21.15.69:0/2705198698 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb59c1a6500 con 0x7fb59c110970 2024-05-14T15:16:54.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.416+0000 7fb599600700 1 -- 172.21.15.69:0/2705198698 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594004080 con 0x7fb59c110970 2024-05-14T15:16:54.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.416+0000 7fb5a3a00700 1 -- 172.21.15.69:0/2705198698 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb59c1a69f0 con 0x7fb59c110970 2024-05-14T15:16:54.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.420+0000 7fb599600700 1 -- 172.21.15.69:0/2705198698 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7fb59401b030 con 0x7fb59c110970 2024-05-14T15:16:54.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.421+0000 7fb5b261eb80 1 Processor -- start 2024-05-14T15:16:54.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.422+0000 7fb5b261eb80 1 -- start start 2024-05-14T15:16:54.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.422+0000 7fb5b261eb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560dddd18df0 0x560ddde9c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.422+0000 7fb5b261eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ddde9c7e0 0x560ddde96460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.422+0000 7fb5b261eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde969a0 0x560ddde96db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.422+0000 7fb5b261eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560ddddb89d0 con 0x560ddde969a0 2024-05-14T15:16:54.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.422+0000 7fb5b261eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560dddd56710 con 0x560ddde9c7e0 2024-05-14T15:16:54.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.422+0000 7fb5b261eb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560ddddb4990 con 0x560dddd18df0 2024-05-14T15:16:54.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.423+0000 7fb59be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde969a0 0x560ddde96db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.423+0000 7fb599600700 1 --2- 172.21.15.69:0/2705198698 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb5840b2880 0x7fb5840b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.423+0000 7fb59be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde969a0 0x560ddde96db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38190/0 (socket says 172.21.15.69:38190) 2024-05-14T15:16:54.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.423+0000 7fb59be00700 1 -- 172.21.15.69:0/1314658722 learned_addr learned my addr 172.21.15.69:0/1314658722 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:54.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.423+0000 7fb59be00700 1 --2- 172.21.15.69:0/1314658722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560dddd18df0 0x560ddde9c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.423+0000 7fb5a1000700 1 --2- 172.21.15.69:0/1314658722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ddde9c7e0 0x560ddde96460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.423+0000 7fb599600700 1 -- 172.21.15.69:0/2705198698 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fb5940e2170 con 0x7fb59c110970 2024-05-14T15:16:54.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.423+0000 7fb5a1a00700 1 --2- 172.21.15.69:0/2705198698 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb5840b2880 0x7fb5840b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.423+0000 7fb59be00700 1 -- 172.21.15.69:0/1314658722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560dddd18df0 msgr2=0x560ddde9c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:54.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.424+0000 7fb59be00700 1 --2- 172.21.15.69:0/1314658722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560dddd18df0 0x560ddde9c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.424+0000 7fb59be00700 1 -- 172.21.15.69:0/1314658722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ddde9c7e0 msgr2=0x560ddde96460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:54.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.424+0000 7fb59be00700 1 --2- 172.21.15.69:0/1314658722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ddde9c7e0 0x560ddde96460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.424+0000 7fb59be00700 1 -- 172.21.15.69:0/1314658722 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560dddd05880 con 0x560ddde969a0 2024-05-14T15:16:54.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.424+0000 7fb5a1000700 1 --2- 172.21.15.69:0/1314658722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ddde9c7e0 0x560ddde96460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:16:54.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.424+0000 7fb59be00700 1 --2- 172.21.15.69:0/1314658722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde969a0 0x560ddde96db0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb5880127d0 tx=0x7fb588009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f323b1318c22aeb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.424+0000 7fb5a1a00700 1 --2- 172.21.15.69:0/2705198698 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb5840b2880 0x7fb5840b4d90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb5940090a0 tx=0x7fb594009ed0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.424+0000 7fb58e000700 1 -- 172.21.15.69:0/1314658722 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588012df0 con 0x560ddde969a0 2024-05-14T15:16:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.425+0000 7fb58e000700 1 -- 172.21.15.69:0/1314658722 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5880044c0 con 0x560ddde969a0 2024-05-14T15:16:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.425+0000 7fb58e000700 1 -- 172.21.15.69:0/1314658722 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58800f450 con 0x560ddde969a0 2024-05-14T15:16:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.426+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1314658722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde969a0 msgr2=0x560ddde96db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.426+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/1314658722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde969a0 0x560ddde96db0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb5880127d0 tx=0x7fb588009750 comp rx=0 tx=0).stop 2024-05-14T15:16:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.426+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1314658722 shutdown_connections 2024-05-14T15:16:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.426+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/1314658722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde969a0 0x560ddde96db0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.426+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/1314658722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560dddd18df0 0x560ddde9c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.426+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/1314658722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ddde9c7e0 0x560ddde96460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.426+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1314658722 >> 172.21.15.69:0/1314658722 conn(0x560dddd5df20 msgr2=0x560ddde91280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.426+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1314658722 shutdown_connections 2024-05-14T15:16:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.426+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1314658722 wait complete. 2024-05-14T15:16:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.427+0000 7fb5b261eb80 1 -- start start 2024-05-14T15:16:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.427+0000 7fb5b261eb80 1 Processor -- start 2024-05-14T15:16:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.427+0000 7fb5b261eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560dddd18df0 0x560ddde9ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.427+0000 7fb5b261eb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ddde969a0 0x560dddea0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.427+0000 7fb5b261eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560dddea0990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.427+0000 7fb5b261eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560dddea32c0 con 0x560ddde9c7e0 2024-05-14T15:16:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.427+0000 7fb5b261eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560dddd1ead0 con 0x560dddd18df0 2024-05-14T15:16:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.427+0000 7fb5b261eb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560dddea3440 con 0x560ddde969a0 2024-05-14T15:16:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.428+0000 7fb5b261eb80 10 client.0 _ll_register_callbacks cb 0x560dddd5fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:16:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.428+0000 7fb59be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560dddea0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.428+0000 7fb59be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560dddea0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38198/0 (socket says 172.21.15.69:38198) 2024-05-14T15:16:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.428+0000 7fb59be00700 1 -- 172.21.15.69:0/1984453919 learned_addr learned my addr 172.21.15.69:0/1984453919 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.428+0000 7fb59be00700 1 --2- 172.21.15.69:0/1984453919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560dddd18df0 0x560ddde9ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.428+0000 7fb5a1000700 1 --2- 172.21.15.69:0/1984453919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ddde969a0 0x560dddea0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.428+0000 7fb59be00700 1 -- 172.21.15.69:0/1984453919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ddde969a0 msgr2=0x560dddea0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.428+0000 7fb59be00700 1 --2- 172.21.15.69:0/1984453919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ddde969a0 0x560dddea0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.428+0000 7fb59be00700 1 -- 172.21.15.69:0/1984453919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560dddd18df0 msgr2=0x560ddde9ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:54.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.428+0000 7fb59be00700 1 --2- 172.21.15.69:0/1984453919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560dddd18df0 0x560ddde9ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.429+0000 7fb59be00700 1 -- 172.21.15.69:0/1984453919 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dddd7e3d0 con 0x560ddde9c7e0 2024-05-14T15:16:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.429+0000 7fb59be00700 1 --2- 172.21.15.69:0/1984453919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560dddea0990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb588001eb0 tx=0x7fb588017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f241f34b4693c0f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.429+0000 7fb582a00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:16:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.429+0000 7fb582a00700 1 -- 172.21.15.69:0/1984453919 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588021030 con 0x560ddde9c7e0 2024-05-14T15:16:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.429+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1984453919 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5880044c0 con 0x560ddde9c7e0 2024-05-14T15:16:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.429+0000 7fb582a00700 1 -- 172.21.15.69:0/1984453919 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fb5880211d0 con 0x560ddde9c7e0 2024-05-14T15:16:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.429+0000 7fb582a00700 1 -- 172.21.15.69:0/1984453919 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb588032050 con 0x560ddde9c7e0 2024-05-14T15:16:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.430+0000 7fb5b261eb80 10 client.14721 fetch_fsmap learned FSMap version 17 2024-05-14T15:16:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.430+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1984453919 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x560dddeadd70 con 0x560ddde9c7e0 2024-05-14T15:16:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.430+0000 7fb582a00700 1 -- 172.21.15.69:0/1984453919 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5880044c0 con 0x560ddde9c7e0 2024-05-14T15:16:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.430+0000 7fb582a00700 1 -- 172.21.15.69:0/1984453919 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7fb58800f450 con 0x560ddde9c7e0 2024-05-14T15:16:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.430+0000 7fb5b261eb80 10 client.14721 fetch_fsmap finished waiting for FSMap version 17 2024-05-14T15:16:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.430+0000 7fb5b261eb80 10 client.14721 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T15:16:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.430+0000 7fb5b261eb80 20 client.14721 populate_metadata read hostname 'smithi069' 2024-05-14T15:16:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.430+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/1984453919 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560dddeb0100 0x560dddeb1570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.430+0000 7fb5b261eb80 4 client.14721 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:16:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.430+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1984453919 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ddde63170 con 0x560dddeb0100 2024-05-14T15:16:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.431+0000 7fb5a1000700 1 --2- 172.21.15.69:0/1984453919 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560dddeb0100 0x560dddeb1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.432+0000 7fb5a1000700 1 --2- 172.21.15.69:0/1984453919 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560dddeb0100 0x560dddeb1570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d05d13e1dc17cb8c server_cookie=82ceb2db954857ab in_seq=0 out_seq=0 2024-05-14T15:16:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.432+0000 7fb582a00700 10 client.14721 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:16:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.435+0000 7fb582a00700 1 -- 172.21.15.69:0/1984453919 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560ddde63170 con 0x560dddeb0100 2024-05-14T15:16:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.435+0000 7fb582a00700 10 client.14721 handle_command_reply: tid=0 2024-05-14T15:16:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.435+0000 7fb5b261eb80 1 client.14721 shutdown 2024-05-14T15:16:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.435+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1984453919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 msgr2=0x560dddea0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.435+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/1984453919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560dddea0990 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb588001eb0 tx=0x7fb588017040 comp rx=0 tx=0).stop 2024-05-14T15:16:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.435+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1984453919 shutdown_connections 2024-05-14T15:16:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.435+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/1984453919 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560dddeb0100 0x560dddeb1570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.435+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/1984453919 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560dddea0990 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.435+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/1984453919 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560dddd18df0 0x560ddde9ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.435+0000 7fb582a00700 0 client.14721 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:16:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.435+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/1984453919 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ddde969a0 0x560dddea0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.435+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1984453919 >> 172.21.15.69:0/1984453919 conn(0x560dddd5df20 msgr2=0x560ddde95450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.435+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1984453919 shutdown_connections 2024-05-14T15:16:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.435+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1984453919 wait complete. 2024-05-14T15:16:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.435+0000 7fb5b261eb80 20 client.14721 trim_cache size 0 max 16384 2024-05-14T15:16:54.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.458+0000 7fb5b261eb80 1 Processor -- start 2024-05-14T15:16:54.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.458+0000 7fb5b261eb80 1 -- start start 2024-05-14T15:16:54.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.459+0000 7fb5b261eb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560dddd18df0 0x560ddde96460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.459+0000 7fb5b261eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ddde969a0 0x560ddde91d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.459+0000 7fb5b261eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560ddde90c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.459+0000 7fb5b261eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560dddeaf8b0 con 0x560ddde9c7e0 2024-05-14T15:16:54.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.459+0000 7fb5b261eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560dddeaff80 con 0x560ddde969a0 2024-05-14T15:16:54.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.459+0000 7fb5b261eb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560dddeb0650 con 0x560dddd18df0 2024-05-14T15:16:54.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.459+0000 7fb59be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560ddde90c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.459+0000 7fb59be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560ddde90c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38202/0 (socket says 172.21.15.69:38202) 2024-05-14T15:16:54.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.459+0000 7fb59be00700 1 -- 172.21.15.69:0/1150047999 learned_addr learned my addr 172.21.15.69:0/1150047999 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:54.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.459+0000 7fb59be00700 1 --2- 172.21.15.69:0/1150047999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560dddd18df0 0x560ddde96460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.459+0000 7fb5a1000700 1 --2- 172.21.15.69:0/1150047999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ddde969a0 0x560ddde91d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.460+0000 7fb59be00700 1 -- 172.21.15.69:0/1150047999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560dddd18df0 msgr2=0x560ddde96460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:54.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.460+0000 7fb59be00700 1 --2- 172.21.15.69:0/1150047999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560dddd18df0 0x560ddde96460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.460+0000 7fb59be00700 1 -- 172.21.15.69:0/1150047999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ddde969a0 msgr2=0x560ddde91d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:54.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.460+0000 7fb59be00700 1 --2- 172.21.15.69:0/1150047999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ddde969a0 0x560ddde91d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.460+0000 7fb59be00700 1 -- 172.21.15.69:0/1150047999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ddde9ccb0 con 0x560ddde9c7e0 2024-05-14T15:16:54.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.460+0000 7fb59be00700 1 --2- 172.21.15.69:0/1150047999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560ddde90c80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb588030040 tx=0x7fb588009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3621f4ed065e327 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:54.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.461+0000 7fb58d600700 1 -- 172.21.15.69:0/1150047999 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588009a80 con 0x560ddde9c7e0 2024-05-14T15:16:54.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.461+0000 7fb58d600700 1 -- 172.21.15.69:0/1150047999 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5880046e0 con 0x560ddde9c7e0 2024-05-14T15:16:54.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.461+0000 7fb58d600700 1 -- 172.21.15.69:0/1150047999 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588005260 con 0x560ddde9c7e0 2024-05-14T15:16:54.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.462+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1150047999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 msgr2=0x560ddde90c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.462+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/1150047999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560ddde90c80 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb588030040 tx=0x7fb588009f90 comp rx=0 tx=0).stop 2024-05-14T15:16:54.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.462+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1150047999 shutdown_connections 2024-05-14T15:16:54.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.462+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/1150047999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560ddde90c80 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.462+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/1150047999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560dddd18df0 0x560ddde96460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.462+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/1150047999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ddde969a0 0x560ddde91d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.462+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1150047999 >> 172.21.15.69:0/1150047999 conn(0x560dddd5df20 msgr2=0x560dddeaf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:54.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.462+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1150047999 shutdown_connections 2024-05-14T15:16:54.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.462+0000 7fb5b261eb80 1 -- 172.21.15.69:0/1150047999 wait complete. 2024-05-14T15:16:54.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.462+0000 7fb5b261eb80 1 -- start start 2024-05-14T15:16:54.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.463+0000 7fb5b261eb80 1 Processor -- start 2024-05-14T15:16:54.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.463+0000 7fb5b261eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560dddd18df0 0x560ddde955d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.463+0000 7fb5b261eb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ddde969a0 0x560ddde95b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.463+0000 7fb5b261eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560ddde96050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.463+0000 7fb5b261eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560dddeb13f0 con 0x560ddde9c7e0 2024-05-14T15:16:54.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.463+0000 7fb5b261eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560dddeb0d20 con 0x560dddd18df0 2024-05-14T15:16:54.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.463+0000 7fb5b261eb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560dddeb1ac0 con 0x560ddde969a0 2024-05-14T15:16:54.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.463+0000 7fb5b261eb80 10 client.0 _ll_register_callbacks cb 0x560dddd5fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:16:54.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.464+0000 7fb59be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560ddde96050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.464+0000 7fb59be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560ddde96050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38210/0 (socket says 172.21.15.69:38210) 2024-05-14T15:16:54.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.464+0000 7fb59be00700 1 -- 172.21.15.69:0/2990691102 learned_addr learned my addr 172.21.15.69:0/2990691102 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:54.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.464+0000 7fb5a1000700 1 --2- 172.21.15.69:0/2990691102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ddde969a0 0x560ddde95b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.464+0000 7fb59be00700 1 --2- 172.21.15.69:0/2990691102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560dddd18df0 0x560ddde955d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.464+0000 7fb59be00700 1 -- 172.21.15.69:0/2990691102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ddde969a0 msgr2=0x560ddde95b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:54.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.464+0000 7fb59be00700 1 --2- 172.21.15.69:0/2990691102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ddde969a0 0x560ddde95b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.464+0000 7fb59be00700 1 -- 172.21.15.69:0/2990691102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560dddd18df0 msgr2=0x560ddde955d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:16:54.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.464+0000 7fb59be00700 1 --2- 172.21.15.69:0/2990691102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560dddd18df0 0x560ddde955d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.464+0000 7fb59be00700 1 -- 172.21.15.69:0/2990691102 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560dddeb8d90 con 0x560ddde9c7e0 2024-05-14T15:16:54.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.464+0000 7fb5a1000700 1 --2- 172.21.15.69:0/2990691102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ddde969a0 0x560ddde95b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:16:54.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.464+0000 7fb59be00700 1 --2- 172.21.15.69:0/2990691102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560ddde96050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb58800fc60 tx=0x7fb588017040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc19346a451f7b03 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:54.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.464+0000 7fb582a00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:16:54.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.465+0000 7fb582a00700 1 -- 172.21.15.69:0/2990691102 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb588021030 con 0x560ddde9c7e0 2024-05-14T15:16:54.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.465+0000 7fb582a00700 1 -- 172.21.15.69:0/2990691102 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fb588040040 con 0x560ddde9c7e0 2024-05-14T15:16:54.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.465+0000 7fb5b261eb80 1 -- 172.21.15.69:0/2990691102 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5880046e0 con 0x560ddde9c7e0 2024-05-14T15:16:54.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.465+0000 7fb582a00700 1 -- 172.21.15.69:0/2990691102 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7fb5880211d0 con 0x560ddde9c7e0 2024-05-14T15:16:54.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.465+0000 7fb5b261eb80 10 client.14727 fetch_fsmap learned FSMap version 17 2024-05-14T15:16:54.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.465+0000 7fb5b261eb80 1 -- 172.21.15.69:0/2990691102 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x560dddf1b7c0 con 0x560ddde9c7e0 2024-05-14T15:16:54.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.465+0000 7fb582a00700 1 -- 172.21.15.69:0/2990691102 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5880046e0 con 0x560ddde9c7e0 2024-05-14T15:16:54.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.465+0000 7fb582a00700 1 -- 172.21.15.69:0/2990691102 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 17) ==== 8342+0+0 (secure 0 0 0) 0x7fb588004c80 con 0x560ddde9c7e0 2024-05-14T15:16:54.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.466+0000 7fb5b261eb80 10 client.14727 fetch_fsmap finished waiting for FSMap version 17 2024-05-14T15:16:54.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.466+0000 7fb5b261eb80 10 client.14727 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T15:16:54.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.466+0000 7fb5b261eb80 20 client.14727 populate_metadata read hostname 'smithi069' 2024-05-14T15:16:54.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.466+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/2990691102 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560dddf1d810 0x560dddf1ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:54.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.466+0000 7fb5b261eb80 4 client.14727 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T15:16:54.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.466+0000 7fb5b261eb80 1 -- 172.21.15.69:0/2990691102 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "status"}) -- 0x560ddddc63b0 con 0x560dddf1d810 2024-05-14T15:16:54.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.466+0000 7fb5a1000700 1 --2- 172.21.15.69:0/2990691102 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560dddf1d810 0x560dddf1ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:54.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.467+0000 7fb5a1000700 1 --2- 172.21.15.69:0/2990691102 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560dddf1d810 0x560dddf1ec80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f4b3c74c3af78ec1 server_cookie=21a32d55395e3f5f in_seq=0 out_seq=0 2024-05-14T15:16:54.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.467+0000 7fb582a00700 10 client.14727 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:16:54.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.468+0000 7fb582a00700 1 -- 172.21.15.69:0/2990691102 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+326 (crc 0 0 0) 0x560ddddc63b0 con 0x560dddf1d810 2024-05-14T15:16:54.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.468+0000 7fb582a00700 10 client.14727 handle_command_reply: tid=0 2024-05-14T15:16:54.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.468+0000 7fb5b261eb80 1 client.14727 shutdown 2024-05-14T15:16:54.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.468+0000 7fb5b261eb80 1 -- 172.21.15.69:0/2990691102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 msgr2=0x560ddde96050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.468+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/2990691102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560ddde96050 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb58800fc60 tx=0x7fb588017040 comp rx=0 tx=0).stop 2024-05-14T15:16:54.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.468+0000 7fb5b261eb80 1 -- 172.21.15.69:0/2990691102 shutdown_connections 2024-05-14T15:16:54.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.468+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/2990691102 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560dddf1d810 0x560dddf1ec80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.468+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/2990691102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ddde9c7e0 0x560ddde96050 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.468+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/2990691102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560dddd18df0 0x560ddde955d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.468+0000 7fb5b261eb80 1 --2- 172.21.15.69:0/2990691102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ddde969a0 0x560ddde95b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.468+0000 7fb5b261eb80 1 -- 172.21.15.69:0/2990691102 >> 172.21.15.69:0/2990691102 conn(0x560dddd5df20 msgr2=0x560ddde90be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:54.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.468+0000 7fb582a00700 0 client.14727 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:16:54.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.468+0000 7fb5b261eb80 1 -- 172.21.15.69:0/2990691102 shutdown_connections 2024-05-14T15:16:54.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.468+0000 7fb5b261eb80 1 -- 172.21.15.69:0/2990691102 wait complete. 2024-05-14T15:16:54.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.469+0000 7fb5b261eb80 20 client.14727 trim_cache size 0 max 16384 2024-05-14T15:16:54.472 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:16:54.472 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "1cc2580e-1203-11ef-bc98-c7b262605968", 2024-05-14T15:16:54.472 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2024-05-14T15:16:54.472 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 34490, 2024-05-14T15:16:54.472 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-05-14T15:16:54.472 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-05-14T15:16:54.472 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-05-14T15:16:54.472 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 42.659351291, 2024-05-14T15:16:54.472 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 17, 2024-05-14T15:16:54.472 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 89, 2024-05-14T15:16:54.472 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 87, 2024-05-14T15:16:54.473 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 62.479422554000003 2024-05-14T15:16:54.473 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:16:54.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.469+0000 7fb5a3a00700 1 -- 172.21.15.69:0/2705198698 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb5840b2880 msgr2=0x7fb5840b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.469+0000 7fb5a3a00700 1 --2- 172.21.15.69:0/2705198698 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb5840b2880 0x7fb5840b4d90 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fb5940090a0 tx=0x7fb594009ed0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.469+0000 7fb5a3a00700 1 -- 172.21.15.69:0/2705198698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb59c110970 msgr2=0x7fb59c1a5bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:54.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.469+0000 7fb5a3a00700 1 --2- 172.21.15.69:0/2705198698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb59c110970 0x7fb59c1a5bd0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb59400ef30 tx=0x7fb59400c450 comp rx=0 tx=0).stop 2024-05-14T15:16:54.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.470+0000 7fb5a3a00700 1 -- 172.21.15.69:0/2705198698 shutdown_connections 2024-05-14T15:16:54.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.470+0000 7fb5a3a00700 1 --2- 172.21.15.69:0/2705198698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb59c110970 0x7fb59c1a5bd0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.470+0000 7fb5a3a00700 1 --2- 172.21.15.69:0/2705198698 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb5840b2880 0x7fb5840b4d90 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.470+0000 7fb5a3a00700 1 --2- 172.21.15.69:0/2705198698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb59c10a990 0x7fb59c1a13a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.470+0000 7fb5a3a00700 1 --2- 172.21.15.69:0/2705198698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb59c10b2e0 0x7fb59c1a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:54.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.470+0000 7fb5a3a00700 1 -- 172.21.15.69:0/2705198698 >> 172.21.15.69:0/2705198698 conn(0x7fb59c077c80 msgr2=0x7fb59c07bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:54.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.470+0000 7fb5a3a00700 1 -- 172.21.15.69:0/2705198698 shutdown_connections 2024-05-14T15:16:54.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:54.470+0000 7fb5a3a00700 1 -- 172.21.15.69:0/2705198698 wait complete. 2024-05-14T15:16:55.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:55 smithi069 ceph-mon[31270]: pgmap v415: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:55.302 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T15:16:55.302 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-14T15:16:55.302 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs ls 2024-05-14T15:16:55.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:55 smithi203 ceph-mon[34567]: pgmap v415: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:55.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:55 smithi092 ceph-mon[34729]: pgmap v415: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:55.743 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:16:57.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:57 smithi069 ceph-mon[31270]: pgmap v416: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:57.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:57 smithi203 ceph-mon[34567]: pgmap v416: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:57.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:57 smithi092 ceph-mon[34729]: pgmap v416: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s, 0 objects/s recovering 2024-05-14T15:16:58.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.161+0000 7f2382a00700 1 -- 172.21.15.69:0/1618929766 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f237c1034c0 msgr2=0x7f237c1038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:58.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.161+0000 7f2382a00700 1 --2- 172.21.15.69:0/1618929766 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f237c1034c0 0x7f237c1038d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f236c0099c0 tx=0x7f236c009cd0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.162+0000 7f2382a00700 1 -- 172.21.15.69:0/1618929766 shutdown_connections 2024-05-14T15:16:58.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.162+0000 7f2382a00700 1 --2- 172.21.15.69:0/1618929766 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f237c1034c0 0x7f237c1038d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.162+0000 7f2382a00700 1 --2- 172.21.15.69:0/1618929766 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f237c108740 0x7f237c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.162+0000 7f2382a00700 1 --2- 172.21.15.69:0/1618929766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f237c107df0 0x7f237c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.162+0000 7f2382a00700 1 -- 172.21.15.69:0/1618929766 >> 172.21.15.69:0/1618929766 conn(0x7f237c0fedc0 msgr2=0x7f237c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:58.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.162+0000 7f2382a00700 1 -- 172.21.15.69:0/1618929766 shutdown_connections 2024-05-14T15:16:58.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.162+0000 7f2382a00700 1 -- 172.21.15.69:0/1618929766 wait complete. 2024-05-14T15:16:58.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.163+0000 7f2382a00700 1 Processor -- start 2024-05-14T15:16:58.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.163+0000 7f2382a00700 1 -- start start 2024-05-14T15:16:58.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.164+0000 7f2382a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f237c1034c0 0x7f237c19ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:58.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.164+0000 7f2382a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f237c107df0 0x7f237c19b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:58.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.164+0000 7f2382a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f237c108740 0x7f237c19f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:58.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.164+0000 7f2382a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f237c113270 con 0x7f237c107df0 2024-05-14T15:16:58.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.164+0000 7f2382a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f237c1130f0 con 0x7f237c108740 2024-05-14T15:16:58.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.164+0000 7f2382a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f237c1133f0 con 0x7f237c1034c0 2024-05-14T15:16:58.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.164+0000 7f237b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f237c107df0 0x7f237c19b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:58.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.164+0000 7f237b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f237c107df0 0x7f237c19b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38230/0 (socket says 172.21.15.69:38230) 2024-05-14T15:16:58.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.164+0000 7f237b400700 1 -- 172.21.15.69:0/2015089372 learned_addr learned my addr 172.21.15.69:0/2015089372 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:16:58.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.164+0000 7f237be00700 1 --2- 172.21.15.69:0/2015089372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f237c1034c0 0x7f237c19ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:58.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.164+0000 7f2380a00700 1 --2- 172.21.15.69:0/2015089372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f237c108740 0x7f237c19f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:58.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.164+0000 7f237b400700 1 -- 172.21.15.69:0/2015089372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f237c1034c0 msgr2=0x7f237c19ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:58.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.164+0000 7f237b400700 1 --2- 172.21.15.69:0/2015089372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f237c1034c0 0x7f237c19ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.164+0000 7f237b400700 1 -- 172.21.15.69:0/2015089372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f237c108740 msgr2=0x7f237c19f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:58.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.164+0000 7f237b400700 1 --2- 172.21.15.69:0/2015089372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f237c108740 0x7f237c19f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.164+0000 7f237b400700 1 -- 172.21.15.69:0/2015089372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f237c19fc20 con 0x7f237c107df0 2024-05-14T15:16:58.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.165+0000 7f2380a00700 1 --2- 172.21.15.69:0/2015089372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f237c108740 0x7f237c19f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:16:58.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.165+0000 7f237b400700 1 --2- 172.21.15.69:0/2015089372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f237c107df0 0x7f237c19b2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f236800d980 tx=0x7f236800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:58.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.165+0000 7f2378c00700 1 -- 172.21.15.69:0/2015089372 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2368017070 con 0x7f237c107df0 2024-05-14T15:16:58.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.165+0000 7f2378c00700 1 -- 172.21.15.69:0/2015089372 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2368010460 con 0x7f237c107df0 2024-05-14T15:16:58.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.165+0000 7f2382a00700 1 -- 172.21.15.69:0/2015089372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f237c19ff10 con 0x7f237c107df0 2024-05-14T15:16:58.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.165+0000 7f2378c00700 1 -- 172.21.15.69:0/2015089372 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f236800de60 con 0x7f237c107df0 2024-05-14T15:16:58.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.165+0000 7f2382a00700 1 -- 172.21.15.69:0/2015089372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f237c1a7830 con 0x7f237c107df0 2024-05-14T15:16:58.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.166+0000 7f2382a00700 1 -- 172.21.15.69:0/2015089372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f237c0512c0 con 0x7f237c107df0 2024-05-14T15:16:58.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.169+0000 7f2378c00700 1 -- 172.21.15.69:0/2015089372 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f2368010610 con 0x7f237c107df0 2024-05-14T15:16:58.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.170+0000 7f2378c00700 1 --2- 172.21.15.69:0/2015089372 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f23600b2880 0x7f23600b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:16:58.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.170+0000 7f2378c00700 1 -- 172.21.15.69:0/2015089372 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f23680e2100 con 0x7f237c107df0 2024-05-14T15:16:58.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.171+0000 7f237be00700 1 --2- 172.21.15.69:0/2015089372 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f23600b2880 0x7f23600b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:16:58.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.171+0000 7f237be00700 1 --2- 172.21.15.69:0/2015089372 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f23600b2880 0x7f23600b4d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f236c0098e0 tx=0x7f236c000bc0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:16:58.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.173+0000 7f2378c00700 1 -- 172.21.15.69:0/2015089372 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f23680a9a60 con 0x7f237c107df0 2024-05-14T15:16:58.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.452+0000 7f2382a00700 1 -- 172.21.15.69:0/2015089372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f237c02e5f0 con 0x7f237c107df0 2024-05-14T15:16:58.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.454+0000 7f2378c00700 1 -- 172.21.15.69:0/2015089372 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f23680a9360 con 0x7f237c107df0 2024-05-14T15:16:58.452 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-14T15:16:58.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.456+0000 7f2382a00700 1 -- 172.21.15.69:0/2015089372 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f23600b2880 msgr2=0x7f23600b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:58.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.456+0000 7f2382a00700 1 --2- 172.21.15.69:0/2015089372 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f23600b2880 0x7f23600b4d90 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f236c0098e0 tx=0x7f236c000bc0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.456+0000 7f2382a00700 1 -- 172.21.15.69:0/2015089372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f237c107df0 msgr2=0x7f237c19b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:16:58.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.456+0000 7f2382a00700 1 --2- 172.21.15.69:0/2015089372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f237c107df0 0x7f237c19b2f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f236800d980 tx=0x7f236800dd40 comp rx=0 tx=0).stop 2024-05-14T15:16:58.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.457+0000 7f2382a00700 1 -- 172.21.15.69:0/2015089372 shutdown_connections 2024-05-14T15:16:58.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.457+0000 7f2382a00700 1 --2- 172.21.15.69:0/2015089372 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f23600b2880 0x7f23600b4d90 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.457+0000 7f2382a00700 1 --2- 172.21.15.69:0/2015089372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f237c108740 0x7f237c19f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.457+0000 7f2382a00700 1 --2- 172.21.15.69:0/2015089372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f237c1034c0 0x7f237c19ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.457+0000 7f2382a00700 1 --2- 172.21.15.69:0/2015089372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f237c107df0 0x7f237c19b2f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:16:58.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.457+0000 7f2382a00700 1 -- 172.21.15.69:0/2015089372 >> 172.21.15.69:0/2015089372 conn(0x7f237c0fedc0 msgr2=0x7f237c06b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:16:58.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.457+0000 7f2382a00700 1 -- 172.21.15.69:0/2015089372 shutdown_connections 2024-05-14T15:16:58.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:58.457+0000 7f2382a00700 1 -- 172.21.15.69:0/2015089372 wait complete. 2024-05-14T15:16:59.196 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:59 smithi069 ceph-mon[31270]: pgmap v417: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:59.196 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:16:59 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2015089372' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-14T15:16:59.265 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-14T15:16:59.265 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T15:16:59.266 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi069.front.sepia.ceph.com 2024-05-14T15:16:59.266 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-14T15:16:59.266 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-14T15:16:59.266 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-14T15:16:59.266 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T15:16:59.266 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T15:16:59.266 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-14T15:16:59.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:59.266 DEBUG:teuthology.orchestra.run.smithi069:> ip addr 2024-05-14T15:16:59.322 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T15:16:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T15:16:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T15:16:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2024-05-14T15:16:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:59.322 INFO:teuthology.orchestra.run.smithi069.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:16:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c2 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:59.322 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f0 2024-05-14T15:16:59.322 INFO:teuthology.orchestra.run.smithi069.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:16:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c3 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f1 2024-05-14T15:16:59.323 INFO:teuthology.orchestra.run.smithi069.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:16:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:36 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:59.323 INFO:teuthology.orchestra.run.smithi069.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T15:16:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:37 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:16:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.21.15.69/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-14T15:16:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft 41824sec preferred_lft 41824sec 2024-05-14T15:16:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::ec4:7aff:fe8f:d737/64 scope link 2024-05-14T15:16:59.323 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:16:59.324 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-14T15:16:59.325 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:59.325 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-05-14T15:16:59.325 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add name ceph-brx type bridge 2024-05-14T15:16:59.325 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr flush dev ceph-brx 2024-05-14T15:16:59.325 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set ceph-brx up 2024-05-14T15:16:59.325 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-14T15:16:59.325 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-05-14T15:16:59.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:59 smithi203 ceph-mon[34567]: pgmap v417: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:59.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:16:59 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2015089372' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-14T15:16:59.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:16:59.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:59 smithi092 ceph-mon[34729]: pgmap v417: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:16:59.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:16:59 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2015089372' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-14T15:16:59.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:16:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:16:59.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:59.817 DEBUG:teuthology.orchestra.run.smithi069:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T15:16:59.881 INFO:teuthology.orchestra.run.smithi069.stdout:1 2024-05-14T15:16:59.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:16:59.885 DEBUG:teuthology.orchestra.run.smithi069:> route 2024-05-14T15:16:59.936 INFO:teuthology.orchestra.run.smithi069.stdout:Kernel IP routing table 2024-05-14T15:16:59.936 INFO:teuthology.orchestra.run.smithi069.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T15:16:59.936 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-14T15:16:59.937 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-14T15:16:59.937 INFO:teuthology.orchestra.run.smithi069.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T15:16:59.937 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:16:59.937 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-05-14T15:16:59.937 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-14T15:16:59.937 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-14T15:16:59.937 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-14T15:16:59.937 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-05-14T15:17:00.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:17:00.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:17:00.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:00.715 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2024-05-14T15:17:00.770 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:00.770 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list-id 2024-05-14T15:17:00.820 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:17:00.821 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-05-14T15:17:00.821 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T15:17:00.821 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-14T15:17:00.821 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-05-14T15:17:00.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:00 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:17:00.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:17:00.999 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-14T15:17:00.999 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:17:01.000 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-05-14T15:17:01.000 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-14T15:17:01.000 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-14T15:17:01.000 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-14T15:17:01.000 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-14T15:17:01.000 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-14T15:17:01.000 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-05-14T15:17:01.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:17:01.218 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:01 smithi069 ceph-mon[31270]: pgmap v418: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:01.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:17:01.294 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:17:01.294 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-05-14T15:17:01.294 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set brx.0 up 2024-05-14T15:17:01.294 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set dev brx.0 master ceph-brx 2024-05-14T15:17:01.295 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-05-14T15:17:01.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:01 smithi203 ceph-mon[34567]: pgmap v418: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:01.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:17:01.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:01 smithi092 ceph-mon[34729]: pgmap v418: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:01.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:17:01.494 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-14T15:17:01.494 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T15:17:01.494 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-14T15:17:01.539 INFO:teuthology.orchestra.run.smithi069.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-14T15:17:01.539 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T15:17:01.539 DEBUG:teuthology.orchestra.run.smithi069:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-14T15:17:01.633 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2024-05-14T15:17:01.705 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:17:01.752 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2024-05-14T15:17:01.752 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2024-05-14T15:17:01.752 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2024-05-14T15:17:01.752 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2024-05-14T15:17:01.752 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2024-05-14T15:17:01.752 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2024-05-14T15:17:01.752 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2024-05-14T15:17:01.752 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2024-05-14T15:17:01.752 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2024-05-14T15:17:01.752 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2024-05-14T15:17:01.753 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2024-05-14T15:17:01.753 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/selinux 2024-05-14T15:17:01.753 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:17:01.753 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2024-05-14T15:17:01.753 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2024-05-14T15:17:01.753 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2024-05-14T15:17:01.753 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2024-05-14T15:17:01.753 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2024-05-14T15:17:01.753 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2024-05-14T15:17:01.753 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:17:01.753 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:17:01.753 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:17:01.753 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:17:01.753 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2024-05-14T15:17:01.753 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2024-05-14T15:17:01.754 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay 2024-05-14T15:17:01.754 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/5e40dcee2d34a7c73312d2a62b71b273d7836197c328f2cd1e28f2747834d977/merged 2024-05-14T15:17:01.754 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/42a44ff852989d71ff9a897904d6b347f51d25b6a57af244156c764075ff3af4/merged 2024-05-14T15:17:01.754 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/0 2024-05-14T15:17:01.754 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:17:01.754 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/b8624fa2e7b18aecb475451084832d73f5d668c63b5da4a1fbfe8b742561717a/merged 2024-05-14T15:17:01.754 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/b67af23fe014f7a3b108526f9a0c8a2894d29db7b285ec99143475cac7dacb5f/merged 2024-05-14T15:17:01.754 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/81eb344721fe12b43e9c2a86db05cb2de131cc235bef4301e1eeedaa8388cbd0/merged 2024-05-14T15:17:01.754 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/0ca3d4e915c5e200ec9d2c97b5327557927f34b22e7b181f51a17e2aae97e635/merged 2024-05-14T15:17:01.754 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/bdacda6ce5aaf45c1476023ef9d3f231de86b4f2deeef927301aff2e4707e393/merged 2024-05-14T15:17:01.754 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/156f4db5c94684f70faa9684e7fc8c64f9155ad03c356113bb75f0c85aaa3e68/merged 2024-05-14T15:17:01.754 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/108b890c31e910e20019fffa3abeebced11a3c4b53e2ea2a411560bbabc9d3d6/merged 2024-05-14T15:17:01.754 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/d30df3a851fc743e5fd93c9c6b69fceae321ee98ed59178c5cdc8543b4bf743d/merged 2024-05-14T15:17:01.754 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2024-05-14T15:17:01.755 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T15:17:01.755 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T15:17:01.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:01.756 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2024-05-14T15:17:01.805 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-14T15:17:01.806 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-14T15:17:01.811 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2024-05-14T15:17:01.881 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:17:01.922 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2024-05-14T15:17:01.923 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2024-05-14T15:17:01.923 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2024-05-14T15:17:01.923 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2024-05-14T15:17:01.923 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2024-05-14T15:17:01.923 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2024-05-14T15:17:01.923 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2024-05-14T15:17:01.923 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2024-05-14T15:17:01.923 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2024-05-14T15:17:01.923 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2024-05-14T15:17:01.923 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2024-05-14T15:17:01.923 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/selinux 2024-05-14T15:17:01.923 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:17:01.923 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2024-05-14T15:17:01.924 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2024-05-14T15:17:01.924 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2024-05-14T15:17:01.924 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2024-05-14T15:17:01.924 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2024-05-14T15:17:01.924 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2024-05-14T15:17:01.924 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:17:01.924 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:17:01.924 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:17:01.924 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:17:01.924 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2024-05-14T15:17:01.924 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2024-05-14T15:17:01.924 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay 2024-05-14T15:17:01.924 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/5e40dcee2d34a7c73312d2a62b71b273d7836197c328f2cd1e28f2747834d977/merged 2024-05-14T15:17:01.924 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/42a44ff852989d71ff9a897904d6b347f51d25b6a57af244156c764075ff3af4/merged 2024-05-14T15:17:01.925 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/0 2024-05-14T15:17:01.925 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:17:01.925 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/b8624fa2e7b18aecb475451084832d73f5d668c63b5da4a1fbfe8b742561717a/merged 2024-05-14T15:17:01.925 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/b67af23fe014f7a3b108526f9a0c8a2894d29db7b285ec99143475cac7dacb5f/merged 2024-05-14T15:17:01.925 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/81eb344721fe12b43e9c2a86db05cb2de131cc235bef4301e1eeedaa8388cbd0/merged 2024-05-14T15:17:01.925 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/0ca3d4e915c5e200ec9d2c97b5327557927f34b22e7b181f51a17e2aae97e635/merged 2024-05-14T15:17:01.925 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/bdacda6ce5aaf45c1476023ef9d3f231de86b4f2deeef927301aff2e4707e393/merged 2024-05-14T15:17:01.925 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/156f4db5c94684f70faa9684e7fc8c64f9155ad03c356113bb75f0c85aaa3e68/merged 2024-05-14T15:17:01.925 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/108b890c31e910e20019fffa3abeebced11a3c4b53e2ea2a411560bbabc9d3d6/merged 2024-05-14T15:17:01.925 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/d30df3a851fc743e5fd93c9c6b69fceae321ee98ed59178c5cdc8543b4bf743d/merged 2024-05-14T15:17:01.925 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2024-05-14T15:17:01.925 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T15:17:01.925 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T15:17:01.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:01.927 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2024-05-14T15:17:02.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi069.stderr:2024-05-14T15:17:02.132+0000 7f1d08464480 -1 init, newargv = 0x7f1cec056f20 newargc=15 2024-05-14T15:17:02.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi069.stderr:ceph-fuse[74754]: starting ceph client 2024-05-14T15:17:02.147 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi069.stderr:ceph-fuse[74754]: starting fuse 2024-05-14T15:17:03.119 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2024-05-14T15:17:03.214 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:17:03.269 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2024-05-14T15:17:03.269 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2024-05-14T15:17:03.269 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2024-05-14T15:17:03.269 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2024-05-14T15:17:03.269 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2024-05-14T15:17:03.269 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2024-05-14T15:17:03.269 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2024-05-14T15:17:03.269 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2024-05-14T15:17:03.269 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2024-05-14T15:17:03.270 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2024-05-14T15:17:03.270 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2024-05-14T15:17:03.270 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/selinux 2024-05-14T15:17:03.270 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:17:03.270 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2024-05-14T15:17:03.270 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2024-05-14T15:17:03.270 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2024-05-14T15:17:03.270 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2024-05-14T15:17:03.270 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2024-05-14T15:17:03.270 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2024-05-14T15:17:03.270 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:17:03.271 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:17:03.271 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:17:03.271 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:17:03.271 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2024-05-14T15:17:03.271 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2024-05-14T15:17:03.271 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay 2024-05-14T15:17:03.271 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/5e40dcee2d34a7c73312d2a62b71b273d7836197c328f2cd1e28f2747834d977/merged 2024-05-14T15:17:03.271 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/42a44ff852989d71ff9a897904d6b347f51d25b6a57af244156c764075ff3af4/merged 2024-05-14T15:17:03.271 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/0 2024-05-14T15:17:03.271 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:17:03.271 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/b8624fa2e7b18aecb475451084832d73f5d668c63b5da4a1fbfe8b742561717a/merged 2024-05-14T15:17:03.271 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/b67af23fe014f7a3b108526f9a0c8a2894d29db7b285ec99143475cac7dacb5f/merged 2024-05-14T15:17:03.271 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/81eb344721fe12b43e9c2a86db05cb2de131cc235bef4301e1eeedaa8388cbd0/merged 2024-05-14T15:17:03.271 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/0ca3d4e915c5e200ec9d2c97b5327557927f34b22e7b181f51a17e2aae97e635/merged 2024-05-14T15:17:03.271 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/bdacda6ce5aaf45c1476023ef9d3f231de86b4f2deeef927301aff2e4707e393/merged 2024-05-14T15:17:03.272 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/156f4db5c94684f70faa9684e7fc8c64f9155ad03c356113bb75f0c85aaa3e68/merged 2024-05-14T15:17:03.272 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/108b890c31e910e20019fffa3abeebced11a3c4b53e2ea2a411560bbabc9d3d6/merged 2024-05-14T15:17:03.272 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/d30df3a851fc743e5fd93c9c6b69fceae321ee98ed59178c5cdc8543b4bf743d/merged 2024-05-14T15:17:03.272 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2024-05-14T15:17:03.272 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T15:17:03.272 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T15:17:03.272 INFO:teuthology.orchestra.run.smithi069.stdout:/home/ubuntu/cephtest/mnt.admin 2024-05-14T15:17:03.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:03.273 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2024-05-14T15:17:03.327 INFO:teuthology.orchestra.run.smithi069.stdout:119 2024-05-14T15:17:03.327 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-05-14T15:17:03.327 DEBUG:teuthology.orchestra.run.smithi069:> sudo stdin-killer -- python3 -c ' 2024-05-14T15:17:03.328 DEBUG:teuthology.orchestra.run.smithi069:> import glob 2024-05-14T15:17:03.328 DEBUG:teuthology.orchestra.run.smithi069:> import re 2024-05-14T15:17:03.328 DEBUG:teuthology.orchestra.run.smithi069:> import os 2024-05-14T15:17:03.328 DEBUG:teuthology.orchestra.run.smithi069:> import subprocess 2024-05-14T15:17:03.328 DEBUG:teuthology.orchestra.run.smithi069:> 2024-05-14T15:17:03.328 DEBUG:teuthology.orchestra.run.smithi069:> def _find_admin_socket(client_name): 2024-05-14T15:17:03.328 DEBUG:teuthology.orchestra.run.smithi069:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-14T15:17:03.328 DEBUG:teuthology.orchestra.run.smithi069:> files = glob.glob(asok_path) 2024-05-14T15:17:03.328 DEBUG:teuthology.orchestra.run.smithi069:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-14T15:17:03.328 DEBUG:teuthology.orchestra.run.smithi069:> 2024-05-14T15:17:03.328 DEBUG:teuthology.orchestra.run.smithi069:> # Given a non-glob path, it better be there 2024-05-14T15:17:03.328 DEBUG:teuthology.orchestra.run.smithi069:> if "*" not in asok_path: 2024-05-14T15:17:03.328 DEBUG:teuthology.orchestra.run.smithi069:> assert(len(files) == 1) 2024-05-14T15:17:03.328 DEBUG:teuthology.orchestra.run.smithi069:> return files[0] 2024-05-14T15:17:03.329 DEBUG:teuthology.orchestra.run.smithi069:> 2024-05-14T15:17:03.329 DEBUG:teuthology.orchestra.run.smithi069:> for f in files: 2024-05-14T15:17:03.329 DEBUG:teuthology.orchestra.run.smithi069:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T15:17:03.329 DEBUG:teuthology.orchestra.run.smithi069:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T15:17:03.329 DEBUG:teuthology.orchestra.run.smithi069:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T15:17:03.329 DEBUG:teuthology.orchestra.run.smithi069:> contents = proc_f.read() 2024-05-14T15:17:03.329 DEBUG:teuthology.orchestra.run.smithi069:> if mountpoint in contents: 2024-05-14T15:17:03.329 DEBUG:teuthology.orchestra.run.smithi069:> return f 2024-05-14T15:17:03.329 DEBUG:teuthology.orchestra.run.smithi069:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T15:17:03.329 DEBUG:teuthology.orchestra.run.smithi069:> 2024-05-14T15:17:03.329 DEBUG:teuthology.orchestra.run.smithi069:> print(_find_admin_socket("client.admin")) 2024-05-14T15:17:03.329 DEBUG:teuthology.orchestra.run.smithi069:> ' 2024-05-14T15:17:03.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:03 smithi203 ceph-mon[34567]: pgmap v419: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:03.395 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:03 smithi069 ceph-mon[31270]: pgmap v419: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:03.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:03 smithi092 ceph-mon[34729]: pgmap v419: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:03.485 INFO:teuthology.orchestra.run.smithi069.stdout:/var/run/ceph/ceph-client.admin.74754.asok 2024-05-14T15:17:03.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:17:03.502 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.74754.asok 2024-05-14T15:17:03.502 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:03.502 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.74754.asok status 2024-05-14T15:17:03.799 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:17:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "metadata": { 2024-05-14T15:17:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_sha1": "e2b755a64f0d72176b57299d02e880cf0620d780", 2024-05-14T15:17:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T15:17:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "entity_id": "admin", 2024-05-14T15:17:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": "smithi069", 2024-05-14T15:17:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-14T15:17:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "pid": "74754", 2024-05-14T15:17:03.799 INFO:teuthology.orchestra.run.smithi069.stdout: "root": "/" 2024-05-14T15:17:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:17:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_count": 0, 2024-05-14T15:17:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_pinned_count": 0, 2024-05-14T15:17:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 14739, 2024-05-14T15:17:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: "inst": { 2024-05-14T15:17:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: "name": { 2024-05-14T15:17:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "client", 2024-05-14T15:17:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: "num": 14739 2024-05-14T15:17:03.800 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:17:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2024-05-14T15:17:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2024-05-14T15:17:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "192.168.0.1:0", 2024-05-14T15:17:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 4008322637 2024-05-14T15:17:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:17:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:17:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2024-05-14T15:17:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2024-05-14T15:17:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "192.168.0.1:0", 2024-05-14T15:17:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 4008322637 2024-05-14T15:17:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:17:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "inst_str": "client.14739 192.168.0.1:0/4008322637", 2024-05-14T15:17:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "addr_str": "192.168.0.1:0/4008322637", 2024-05-14T15:17:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "inode_count": 1, 2024-05-14T15:17:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_epoch": 17, 2024-05-14T15:17:03.801 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch": 89, 2024-05-14T15:17:03.802 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch_barrier": 0, 2024-05-14T15:17:03.802 INFO:teuthology.orchestra.run.smithi069.stdout: "blocklisted": false, 2024-05-14T15:17:03.802 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs" 2024-05-14T15:17:03.802 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:17:03.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:03.821 DEBUG:teuthology.orchestra.run.smithi069:> stat --file-system '--printf=%T 2024-05-14T15:17:03.821 DEBUG:teuthology.orchestra.run.smithi069:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-14T15:17:03.872 INFO:teuthology.orchestra.run.smithi069.stdout:fuseblk 2024-05-14T15:17:03.872 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-14T15:17:03.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:03.872 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-14T15:17:03.953 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-14T15:17:04.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-14T15:17:04.108 INFO:teuthology.orchestra.run.smithi069.stdout:# file: . 2024-05-14T15:17:04.109 INFO:teuthology.orchestra.run.smithi069.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-14T15:17:04.109 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:17:04.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:17:04.119 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:17:04.119 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:17:04.173 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd blocklist ls 2024-05-14T15:17:04.654 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:17:05.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:05 smithi203 ceph-mon[34567]: pgmap v420: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:05.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:05 smithi092 ceph-mon[34729]: pgmap v420: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:05.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:05 smithi069 ceph-mon[31270]: pgmap v420: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:06.342 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:06 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:17:06.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:06 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:17:06.444 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:06 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:17:07.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.006+0000 7f90c7000700 1 -- 172.21.15.69:0/3778376748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90c010e8f0 msgr2=0x7f90c0110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:07.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.006+0000 7f90c7000700 1 --2- 172.21.15.69:0/3778376748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90c010e8f0 0x7f90c0110dd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f90b800b0a0 tx=0x7f90b800b3b0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.006+0000 7f90c7000700 1 -- 172.21.15.69:0/3778376748 shutdown_connections 2024-05-14T15:17:07.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.006+0000 7f90c7000700 1 --2- 172.21.15.69:0/3778376748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90c010e8f0 0x7f90c0110dd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.006+0000 7f90c7000700 1 --2- 172.21.15.69:0/3778376748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90c0105480 0x7f90c0105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.006+0000 7f90c7000700 1 --2- 172.21.15.69:0/3778376748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90c0105dd0 0x7f90c010e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.006+0000 7f90c7000700 1 -- 172.21.15.69:0/3778376748 >> 172.21.15.69:0/3778376748 conn(0x7f90c00fef30 msgr2=0x7f90c0101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:07.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.006+0000 7f90c7000700 1 -- 172.21.15.69:0/3778376748 shutdown_connections 2024-05-14T15:17:07.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.006+0000 7f90c7000700 1 -- 172.21.15.69:0/3778376748 wait complete. 2024-05-14T15:17:07.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.007+0000 7f90c7000700 1 Processor -- start 2024-05-14T15:17:07.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.008+0000 7f90c7000700 1 -- start start 2024-05-14T15:17:07.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.008+0000 7f90c7000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90c0105480 0x7f90c01a09b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:07.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.008+0000 7f90c7000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90c0105dd0 0x7f90c01a0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:07.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.008+0000 7f90c7000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90c010e8f0 0x7f90c019ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:07.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.008+0000 7f90c7000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f90c0114320 con 0x7f90c0105dd0 2024-05-14T15:17:07.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.008+0000 7f90c7000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f90c01141a0 con 0x7f90c010e8f0 2024-05-14T15:17:07.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.008+0000 7f90c7000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f90c01144a0 con 0x7f90c0105480 2024-05-14T15:17:07.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.009+0000 7f90bf400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90c0105dd0 0x7f90c01a0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:07.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.009+0000 7f90bfe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90c0105480 0x7f90c01a09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:07.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.009+0000 7f90bf400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90c0105dd0 0x7f90c01a0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42090/0 (socket says 172.21.15.69:42090) 2024-05-14T15:17:07.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.009+0000 7f90bf400700 1 -- 172.21.15.69:0/1578622367 learned_addr learned my addr 172.21.15.69:0/1578622367 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:17:07.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.009+0000 7f90c5000700 1 --2- 172.21.15.69:0/1578622367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90c010e8f0 0x7f90c019ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:07.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.009+0000 7f90bfe00700 1 -- 172.21.15.69:0/1578622367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90c010e8f0 msgr2=0x7f90c019ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:07.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.009+0000 7f90bfe00700 1 --2- 172.21.15.69:0/1578622367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90c010e8f0 0x7f90c019ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.009+0000 7f90bfe00700 1 -- 172.21.15.69:0/1578622367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90c0105dd0 msgr2=0x7f90c01a0ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:07.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.009+0000 7f90bfe00700 1 --2- 172.21.15.69:0/1578622367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90c0105dd0 0x7f90c01a0ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.009+0000 7f90bfe00700 1 -- 172.21.15.69:0/1578622367 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90c019b270 con 0x7f90c0105480 2024-05-14T15:17:07.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.010+0000 7f90bfe00700 1 --2- 172.21.15.69:0/1578622367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90c0105480 0x7f90c01a09b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f90b000e9f0 tx=0x7f90b000ed00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:07.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.010+0000 7f90bcc00700 1 -- 172.21.15.69:0/1578622367 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b0004220 con 0x7f90c0105480 2024-05-14T15:17:07.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.010+0000 7f90c7000700 1 -- 172.21.15.69:0/1578622367 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90c019b500 con 0x7f90c0105480 2024-05-14T15:17:07.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.010+0000 7f90bcc00700 1 -- 172.21.15.69:0/1578622367 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f90b00043c0 con 0x7f90c0105480 2024-05-14T15:17:07.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.010+0000 7f90bcc00700 1 -- 172.21.15.69:0/1578622367 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90b000ce30 con 0x7f90c0105480 2024-05-14T15:17:07.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.010+0000 7f90c7000700 1 -- 172.21.15.69:0/1578622367 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90c01a7760 con 0x7f90c0105480 2024-05-14T15:17:07.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.011+0000 7f90c7000700 1 -- 172.21.15.69:0/1578622367 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90c006c920 con 0x7f90c0105480 2024-05-14T15:17:07.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.016+0000 7f90bcc00700 1 -- 172.21.15.69:0/1578622367 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f90b0004750 con 0x7f90c0105480 2024-05-14T15:17:07.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.017+0000 7f90bcc00700 1 --2- 172.21.15.69:0/1578622367 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f90a40b2880 0x7f90a40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:07.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.017+0000 7f90bcc00700 1 -- 172.21.15.69:0/1578622367 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f90b00e2610 con 0x7f90c0105480 2024-05-14T15:17:07.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.018+0000 7f90bf400700 1 --2- 172.21.15.69:0/1578622367 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f90a40b2880 0x7f90a40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:07.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.018+0000 7f90bf400700 1 --2- 172.21.15.69:0/1578622367 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f90a40b2880 0x7f90a40b4d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f90c019c270 tx=0x7f90ac007480 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:07.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.029+0000 7f90bcc00700 1 -- 172.21.15.69:0/1578622367 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f90b00aa060 con 0x7f90c0105480 2024-05-14T15:17:07.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.304+0000 7f90c7000700 1 -- 172.21.15.69:0/1578622367 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f90c002e5f0 con 0x7f90c0105480 2024-05-14T15:17:07.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.305+0000 7f90bcc00700 1 -- 172.21.15.69:0/1578622367 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+589 (secure 0 0 0) 0x7f90b00a9960 con 0x7f90c0105480 2024-05-14T15:17:07.305 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/151981233 2024-05-15T15:05:41.383453+0000 2024-05-14T15:17:07.306 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3776172313 2024-05-15T15:05:41.383453+0000 2024-05-14T15:17:07.306 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/1288620257 2024-05-15T15:05:41.383453+0000 2024-05-14T15:17:07.306 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/2718114316 2024-05-15T15:05:41.383453+0000 2024-05-14T15:17:07.306 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/586229880 2024-05-15T15:05:06.373096+0000 2024-05-14T15:17:07.306 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/1655882616 2024-05-15T15:05:06.373096+0000 2024-05-14T15:17:07.306 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/4183332474 2024-05-15T15:05:06.373096+0000 2024-05-14T15:17:07.306 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/586229880 2024-05-15T15:05:06.373096+0000 2024-05-14T15:17:07.306 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/2806878946 2024-05-15T15:05:06.373096+0000 2024-05-14T15:17:07.306 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/2718114316 2024-05-15T15:05:41.383453+0000 2024-05-14T15:17:07.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.309+0000 7f90c7000700 1 -- 172.21.15.69:0/1578622367 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f90a40b2880 msgr2=0x7f90a40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:07.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.309+0000 7f90c7000700 1 --2- 172.21.15.69:0/1578622367 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f90a40b2880 0x7f90a40b4d90 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f90c019c270 tx=0x7f90ac007480 comp rx=0 tx=0).stop 2024-05-14T15:17:07.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.309+0000 7f90c7000700 1 -- 172.21.15.69:0/1578622367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90c0105480 msgr2=0x7f90c01a09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:07.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.309+0000 7f90c7000700 1 --2- 172.21.15.69:0/1578622367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90c0105480 0x7f90c01a09b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f90b000e9f0 tx=0x7f90b000ed00 comp rx=0 tx=0).stop 2024-05-14T15:17:07.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.309+0000 7f90c7000700 1 -- 172.21.15.69:0/1578622367 shutdown_connections 2024-05-14T15:17:07.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.309+0000 7f90c7000700 1 --2- 172.21.15.69:0/1578622367 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f90a40b2880 0x7f90a40b4d90 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.309+0000 7f90c7000700 1 --2- 172.21.15.69:0/1578622367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90c010e8f0 0x7f90c019ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.309+0000 7f90c7000700 1 --2- 172.21.15.69:0/1578622367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f90c0105480 0x7f90c01a09b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.309+0000 7f90c7000700 1 --2- 172.21.15.69:0/1578622367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90c0105dd0 0x7f90c01a0ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:07.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.309+0000 7f90c7000700 1 -- 172.21.15.69:0/1578622367 >> 172.21.15.69:0/1578622367 conn(0x7f90c00fef30 msgr2=0x7f90c0100ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:07.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.309+0000 7f90c7000700 1 -- 172.21.15.69:0/1578622367 shutdown_connections 2024-05-14T15:17:07.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:07.309+0000 7f90c7000700 1 -- 172.21.15.69:0/1578622367 wait complete. 2024-05-14T15:17:07.310 INFO:teuthology.orchestra.run.smithi069.stderr:listed 10 entries 2024-05-14T15:17:07.334 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:07 smithi069 ceph-mon[31270]: pgmap v421: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:07.334 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:07.334 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:07.334 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:07.334 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:07 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:07.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:07 smithi203 ceph-mon[34567]: pgmap v421: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:07.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:07.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:07.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:07.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:07 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:07.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:07 smithi092 ceph-mon[34729]: pgmap v421: 129 pgs: 129 active+clean; 579 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:07.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:07.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:07.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:07.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:07 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:08.306 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:08 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1578622367' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T15:17:08.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:08 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1578622367' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T15:17:08.374 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:17:08.374 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:17:08.430 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd blocklist ls 2024-05-14T15:17:08.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:08 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1578622367' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T15:17:08.883 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:17:09.403 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:09 smithi069 ceph-mon[31270]: pgmap v422: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:09.440 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:09 smithi092 ceph-mon[34729]: pgmap v422: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:09.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:09 smithi203 ceph-mon[34567]: pgmap v422: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:10.905 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:10 smithi069 ceph-mon[31270]: pgmap v423: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:10.905 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:10 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:10.906 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:10 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:10.906 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:10 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:10.906 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:10 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:10.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:10 smithi092 ceph-mon[34729]: pgmap v423: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:10.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:10 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:10.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:10 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:10.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:10 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:10.941 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:10 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:11.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:10 smithi203 ceph-mon[34567]: pgmap v423: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:11.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:10 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:11.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:10 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:11.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:10 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:11.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:10 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:11.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.150+0000 7f9909c00700 1 -- 172.21.15.69:0/2306391438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f990410b150 msgr2=0x7f9904117680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:11.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.150+0000 7f9909c00700 1 --2- 172.21.15.69:0/2306391438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f990410b150 0x7f9904117680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00b0a0 tx=0x7f98fc00b3b0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.150+0000 7f9909c00700 1 -- 172.21.15.69:0/2306391438 shutdown_connections 2024-05-14T15:17:11.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.150+0000 7f9909c00700 1 --2- 172.21.15.69:0/2306391438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f990410b150 0x7f9904117680 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.150+0000 7f9909c00700 1 --2- 172.21.15.69:0/2306391438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99041107e0 0x7f9904110bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.150+0000 7f9909c00700 1 --2- 172.21.15.69:0/2306391438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f990410a800 0x7f990410ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.150+0000 7f9909c00700 1 -- 172.21.15.69:0/2306391438 >> 172.21.15.69:0/2306391438 conn(0x7f9904076b00 msgr2=0x7f9904076f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:11.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.150+0000 7f9909c00700 1 -- 172.21.15.69:0/2306391438 shutdown_connections 2024-05-14T15:17:11.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.150+0000 7f9909c00700 1 -- 172.21.15.69:0/2306391438 wait complete. 2024-05-14T15:17:11.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.151+0000 7f9909c00700 1 Processor -- start 2024-05-14T15:17:11.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.152+0000 7f9909c00700 1 -- start start 2024-05-14T15:17:11.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.152+0000 7f9909c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f990410a800 0x7f99041a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:11.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.152+0000 7f9909c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f990410b150 0x7f99041a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:11.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.152+0000 7f9909c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99041107e0 0x7f99041a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:11.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.152+0000 7f9909c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f990411a7c0 con 0x7f99041107e0 2024-05-14T15:17:11.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.152+0000 7f9909c00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f990411a640 con 0x7f990410b150 2024-05-14T15:17:11.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.152+0000 7f9909c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f990411a940 con 0x7f990410a800 2024-05-14T15:17:11.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.153+0000 7f9909200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99041107e0 0x7f99041a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:11.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.153+0000 7f9909200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99041107e0 0x7f99041a5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42120/0 (socket says 172.21.15.69:42120) 2024-05-14T15:17:11.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.153+0000 7f9909200700 1 -- 172.21.15.69:0/763643145 learned_addr learned my addr 172.21.15.69:0/763643145 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:17:11.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.153+0000 7f9903400700 1 --2- 172.21.15.69:0/763643145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f990410b150 0x7f99041a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:11.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.153+0000 7f9903e00700 1 --2- 172.21.15.69:0/763643145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f990410a800 0x7f99041a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:11.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.153+0000 7f9909200700 1 -- 172.21.15.69:0/763643145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f990410a800 msgr2=0x7f99041a10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:11.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.153+0000 7f9909200700 1 --2- 172.21.15.69:0/763643145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f990410a800 0x7f99041a10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.153+0000 7f9909200700 1 -- 172.21.15.69:0/763643145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f990410b150 msgr2=0x7f99041a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:11.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.153+0000 7f9909200700 1 --2- 172.21.15.69:0/763643145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f990410b150 0x7f99041a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.153+0000 7f9909200700 1 -- 172.21.15.69:0/763643145 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99041a5ef0 con 0x7f99041107e0 2024-05-14T15:17:11.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.153+0000 7f9903400700 1 --2- 172.21.15.69:0/763643145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f990410b150 0x7f99041a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:17:11.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.154+0000 7f9909200700 1 --2- 172.21.15.69:0/763643145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99041107e0 0x7f99041a5900 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00b830 tx=0x7f98fc004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:11.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.154+0000 7f9900c00700 1 -- 172.21.15.69:0/763643145 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc021070 con 0x7f99041107e0 2024-05-14T15:17:11.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.154+0000 7f9909c00700 1 -- 172.21.15.69:0/763643145 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99041a6180 con 0x7f99041107e0 2024-05-14T15:17:11.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.154+0000 7f9900c00700 1 -- 172.21.15.69:0/763643145 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f98fc007b80 con 0x7f99041107e0 2024-05-14T15:17:11.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.154+0000 7f9900c00700 1 -- 172.21.15.69:0/763643145 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98fc0052a0 con 0x7f99041107e0 2024-05-14T15:17:11.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.154+0000 7f9909c00700 1 -- 172.21.15.69:0/763643145 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99041a66b0 con 0x7f99041107e0 2024-05-14T15:17:11.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.156+0000 7f9909c00700 1 -- 172.21.15.69:0/763643145 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99040512c0 con 0x7f99041107e0 2024-05-14T15:17:11.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.160+0000 7f9900c00700 1 -- 172.21.15.69:0/763643145 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f98fc024070 con 0x7f99041107e0 2024-05-14T15:17:11.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.161+0000 7f9900c00700 1 --2- 172.21.15.69:0/763643145 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f98e80b2880 0x7f98e80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:11.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.162+0000 7f9900c00700 1 -- 172.21.15.69:0/763643145 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f98fc00f020 con 0x7f99041107e0 2024-05-14T15:17:11.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.162+0000 7f9903e00700 1 --2- 172.21.15.69:0/763643145 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f98e80b2880 0x7f98e80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:11.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.163+0000 7f9903e00700 1 --2- 172.21.15.69:0/763643145 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f98e80b2880 0x7f98e80b4d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f98f4005950 tx=0x7f98f400b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:11.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.165+0000 7f9900c00700 1 -- 172.21.15.69:0/763643145 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f98fc02b020 con 0x7f99041107e0 2024-05-14T15:17:11.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.415+0000 7f9909c00700 1 -- 172.21.15.69:0/763643145 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f99041a2430 con 0x7f99041107e0 2024-05-14T15:17:11.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.416+0000 7f9900c00700 1 -- 172.21.15.69:0/763643145 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v89) ==== 81+0+589 (secure 0 0 0) 0x7f98fc0ab9e0 con 0x7f99041107e0 2024-05-14T15:17:11.416 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/151981233 2024-05-15T15:05:41.383453+0000 2024-05-14T15:17:11.416 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3776172313 2024-05-15T15:05:41.383453+0000 2024-05-14T15:17:11.416 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/1288620257 2024-05-15T15:05:41.383453+0000 2024-05-14T15:17:11.416 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/2718114316 2024-05-15T15:05:41.383453+0000 2024-05-14T15:17:11.416 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/586229880 2024-05-15T15:05:06.373096+0000 2024-05-14T15:17:11.416 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/1655882616 2024-05-15T15:05:06.373096+0000 2024-05-14T15:17:11.416 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/4183332474 2024-05-15T15:05:06.373096+0000 2024-05-14T15:17:11.416 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/586229880 2024-05-15T15:05:06.373096+0000 2024-05-14T15:17:11.416 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/2806878946 2024-05-15T15:05:06.373096+0000 2024-05-14T15:17:11.417 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/2718114316 2024-05-15T15:05:41.383453+0000 2024-05-14T15:17:11.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.419+0000 7f9909c00700 1 -- 172.21.15.69:0/763643145 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f98e80b2880 msgr2=0x7f98e80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:11.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.419+0000 7f9909c00700 1 --2- 172.21.15.69:0/763643145 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f98e80b2880 0x7f98e80b4d90 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f98f4005950 tx=0x7f98f400b410 comp rx=0 tx=0).stop 2024-05-14T15:17:11.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.419+0000 7f9909c00700 1 -- 172.21.15.69:0/763643145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99041107e0 msgr2=0x7f99041a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:11.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.419+0000 7f9909c00700 1 --2- 172.21.15.69:0/763643145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99041107e0 0x7f99041a5900 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f98fc00b830 tx=0x7f98fc004d00 comp rx=0 tx=0).stop 2024-05-14T15:17:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.419+0000 7f9909c00700 1 -- 172.21.15.69:0/763643145 shutdown_connections 2024-05-14T15:17:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.419+0000 7f9909c00700 1 --2- 172.21.15.69:0/763643145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99041107e0 0x7f99041a5900 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.419+0000 7f9909c00700 1 --2- 172.21.15.69:0/763643145 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f98e80b2880 0x7f98e80b4d90 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.419+0000 7f9909c00700 1 --2- 172.21.15.69:0/763643145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f990410a800 0x7f99041a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.419+0000 7f9909c00700 1 --2- 172.21.15.69:0/763643145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f990410b150 0x7f99041a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.420+0000 7f9909c00700 1 -- 172.21.15.69:0/763643145 >> 172.21.15.69:0/763643145 conn(0x7f9904076b00 msgr2=0x7f99041087c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.420+0000 7f9909c00700 1 -- 172.21.15.69:0/763643145 shutdown_connections 2024-05-14T15:17:11.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:11.420+0000 7f9909c00700 1 -- 172.21.15.69:0/763643145 wait complete. 2024-05-14T15:17:11.421 INFO:teuthology.orchestra.run.smithi069.stderr:listed 10 entries 2024-05-14T15:17:12.263 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi069.front.sepia.ceph.com... 2024-05-14T15:17:12.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:12.263 DEBUG:teuthology.orchestra.run.smithi069:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-14T15:17:12.345 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi069.stderr:ceph-fuse[74754]: fuse finished with error 0 and tester_r 0 2024-05-14T15:17:12.351 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:17:12.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:12 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:12.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:12 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:12.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:12 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/763643145' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T15:17:12.444 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:12 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:12.444 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:12 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:12.444 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:12 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/763643145' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T15:17:12.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:12 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:12.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:12 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:12.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:12 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/763643145' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T15:17:13.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:13 smithi092 ceph-mon[34729]: pgmap v424: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:13.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:13 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:17:13.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:13 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:17:13.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:13 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:13.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:13 smithi069 ceph-mon[31270]: pgmap v424: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:13.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:13 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:17:13.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:13 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:17:13.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:13 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:13.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:13 smithi203 ceph-mon[34567]: pgmap v424: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:13.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:13 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:17:13.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:13 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:17:13.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:13 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:17:15.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:15 smithi092 ceph-mon[34729]: pgmap v425: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:15.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:15 smithi069 ceph-mon[31270]: pgmap v425: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:15.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:15 smithi203 ceph-mon[34567]: pgmap v425: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:17.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:17 smithi092 ceph-mon[34729]: pgmap v426: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:17.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:17 smithi069 ceph-mon[31270]: pgmap v426: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:17.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:17 smithi203 ceph-mon[34567]: pgmap v426: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:18.452 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi069.front.sepia.ceph.com 2024-05-14T15:17:18.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:17:18.452 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-14T15:17:18.522 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T15:17:18.981 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:17:19.391 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:19 smithi069 ceph-mon[31270]: pgmap v427: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-14T15:17:19.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:19 smithi092 ceph-mon[34729]: pgmap v427: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-14T15:17:19.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:19 smithi203 ceph-mon[34567]: pgmap v427: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-05-14T15:17:21.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.348+0000 7ff162600700 1 -- 172.21.15.69:0/80617505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff15c10af20 msgr2=0x7ff15c10b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:21.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.348+0000 7ff162600700 1 --2- 172.21.15.69:0/80617505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff15c10af20 0x7ff15c10b330 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff1480099c0 tx=0x7ff148009cd0 comp rx=0 tx=0).stop 2024-05-14T15:17:21.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.348+0000 7ff162600700 1 -- 172.21.15.69:0/80617505 shutdown_connections 2024-05-14T15:17:21.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.348+0000 7ff162600700 1 --2- 172.21.15.69:0/80617505 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff15c10b870 0x7ff15c1131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:21.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.348+0000 7ff162600700 1 --2- 172.21.15.69:0/80617505 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff15c106640 0x7ff15c106a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:21.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.348+0000 7ff162600700 1 --2- 172.21.15.69:0/80617505 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff15c10af20 0x7ff15c10b330 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:21.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.348+0000 7ff162600700 1 -- 172.21.15.69:0/80617505 >> 172.21.15.69:0/80617505 conn(0x7ff15c102030 msgr2=0x7ff15c104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:21.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.348+0000 7ff162600700 1 -- 172.21.15.69:0/80617505 shutdown_connections 2024-05-14T15:17:21.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.348+0000 7ff162600700 1 -- 172.21.15.69:0/80617505 wait complete. 2024-05-14T15:17:21.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.349+0000 7ff162600700 1 Processor -- start 2024-05-14T15:17:21.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.350+0000 7ff162600700 1 -- start start 2024-05-14T15:17:21.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.350+0000 7ff162600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff15c106640 0x7ff15c19cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:21.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.350+0000 7ff162600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff15c10af20 0x7ff15c19d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:21.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.350+0000 7ff162600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff15c10b870 0x7ff15c1a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:21.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.350+0000 7ff162600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c116380 con 0x7ff15c10b870 2024-05-14T15:17:21.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.350+0000 7ff162600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c116200 con 0x7ff15c106640 2024-05-14T15:17:21.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.350+0000 7ff162600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff15c116500 con 0x7ff15c10af20 2024-05-14T15:17:21.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.350+0000 7ff161c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff15c10b870 0x7ff15c1a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:21.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.351+0000 7ff161c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff15c10b870 0x7ff15c1a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:50252/0 (socket says 172.21.15.69:50252) 2024-05-14T15:17:21.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.351+0000 7ff161c00700 1 -- 172.21.15.69:0/2328901749 learned_addr learned my addr 172.21.15.69:0/2328901749 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:17:21.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.351+0000 7ff161200700 1 --2- 172.21.15.69:0/2328901749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff15c106640 0x7ff15c19cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:21.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.351+0000 7ff15be00700 1 --2- 172.21.15.69:0/2328901749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff15c10af20 0x7ff15c19d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:21.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.351+0000 7ff161c00700 1 -- 172.21.15.69:0/2328901749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff15c10af20 msgr2=0x7ff15c19d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:21.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.351+0000 7ff161c00700 1 --2- 172.21.15.69:0/2328901749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff15c10af20 0x7ff15c19d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:21.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.351+0000 7ff161c00700 1 -- 172.21.15.69:0/2328901749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff15c106640 msgr2=0x7ff15c19cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:21.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.351+0000 7ff161c00700 1 --2- 172.21.15.69:0/2328901749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff15c106640 0x7ff15c19cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:21.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.351+0000 7ff161c00700 1 -- 172.21.15.69:0/2328901749 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff15c1a1c80 con 0x7ff15c10b870 2024-05-14T15:17:21.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.351+0000 7ff161c00700 1 --2- 172.21.15.69:0/2328901749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff15c10b870 0x7ff15c1a15e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff15400ef30 tx=0x7ff15400c450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:21.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.352+0000 7ff159600700 1 -- 172.21.15.69:0/2328901749 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1540092e0 con 0x7ff15c10b870 2024-05-14T15:17:21.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.352+0000 7ff159600700 1 -- 172.21.15.69:0/2328901749 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff154004bb0 con 0x7ff15c10b870 2024-05-14T15:17:21.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.352+0000 7ff162600700 1 -- 172.21.15.69:0/2328901749 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff15c1a1f10 con 0x7ff15c10b870 2024-05-14T15:17:21.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.352+0000 7ff159600700 1 -- 172.21.15.69:0/2328901749 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff154004080 con 0x7ff15c10b870 2024-05-14T15:17:21.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.352+0000 7ff162600700 1 -- 172.21.15.69:0/2328901749 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff15c1a2420 con 0x7ff15c10b870 2024-05-14T15:17:21.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.353+0000 7ff162600700 1 -- 172.21.15.69:0/2328901749 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff15c0512c0 con 0x7ff15c10b870 2024-05-14T15:17:21.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.355+0000 7ff159600700 1 -- 172.21.15.69:0/2328901749 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7ff15401b030 con 0x7ff15c10b870 2024-05-14T15:17:21.354 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:21 smithi069 ceph-mon[31270]: pgmap v428: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T15:17:21.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.358+0000 7ff159600700 1 --2- 172.21.15.69:0/2328901749 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff1440b2900 0x7ff1440b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:21.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.358+0000 7ff159600700 1 -- 172.21.15.69:0/2328901749 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff1540e2a60 con 0x7ff15c10b870 2024-05-14T15:17:21.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.358+0000 7ff161200700 1 --2- 172.21.15.69:0/2328901749 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff1440b2900 0x7ff1440b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:21.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.359+0000 7ff161200700 1 --2- 172.21.15.69:0/2328901749 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff1440b2900 0x7ff1440b4e10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff150009bf0 tx=0x7ff150009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:21.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.361+0000 7ff159600700 1 -- 172.21.15.69:0/2328901749 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff154022020 con 0x7ff15c10b870 2024-05-14T15:17:21.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:21 smithi092 ceph-mon[34729]: pgmap v428: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T15:17:21.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:21 smithi203 ceph-mon[34567]: pgmap v428: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T15:17:21.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.596+0000 7ff162600700 1 -- 172.21.15.69:0/2328901749 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff15c02e5f0 con 0x7ff15c10b870 2024-05-14T15:17:21.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.599+0000 7ff159600700 1 -- 172.21.15.69:0/2328901749 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24674 (secure 0 0 0) 0x7ff154010040 con 0x7ff15c10b870 2024-05-14T15:17:21.599 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:17:21.599 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":89,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","created":"2024-05-14T15:04:32.074994+0000","modified":"2024-05-14T15:16:42.977203+0000","last_up_change":"2024-05-14T15:14:44.049523+0000","last_in_change":"2024-05-14T15:14:16.752653+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:09:03.561841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:16:02.641690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:16:06.949687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:16:20.891122+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8640de99-c23a-494e-a100-aafd04fe1867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6803","nonce":301095601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6805","nonce":301095601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6809","nonce":301095601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6807","nonce":301095601}]},"public_addr":"172.21.15.69:6803/301095601","cluster_addr":"172.21.15.69:6805/301095601","heartbeat_back_addr":"172.21.15.69:6809/301095601","heartbeat_front_addr":"172.21.15.69:6807/301095601","state":["exists","up"]},{"osd":1,"uuid":"89f78a32-7afb-49f3-9287-5478a1cc8829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6801","nonce":2774122776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6803","nonce":2774122776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6807","nonce":2774122776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6805","nonce":2774122776}]},"public_addr":"172.21.15.92:6801/2774122776","cluster_addr":"172.21.15.92:6803/2774122776","heartbeat_back_addr":"172.21.15.92:6807/2774122776","heartbeat_front_addr":"172.21.15.92:6805/2774122776","state":["exists","up"]},{"osd":2,"uuid":"a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6801","nonce":2836920513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6803","nonce":2836920513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6807","nonce":2836920513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6805","nonce":2836920513}]},"public_addr":"172.21.15.203:6801/2836920513","cluster_addr":"172.21.15.203:6803/2836920513","heartbeat_back_addr":"172.21.15.203:6807/2836920513","heartbeat_front_addr":"172.21.15.203:6805/2836920513","state":["exists","up"]},{"osd":3,"uuid":"81409850-de26-4520-972c-31a716adf4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6811","nonce":680308620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6813","nonce":680308620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6817","nonce":680308620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6815","nonce":680308620}]},"public_addr":"172.21.15.69:6811/680308620","cluster_addr":"172.21.15.69:6813/680308620","heartbeat_back_addr":"172.21.15.69:6817/680308620","heartbeat_front_addr":"172.21.15.69:6815/680308620","state":["exists","up"]},{"osd":4,"uuid":"9aa3a6b0-cc63-4eae-8416-8ab630994985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6809","nonce":1071971048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6811","nonce":1071971048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6815","nonce":1071971048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6813","nonce":1071971048}]},"public_addr":"172.21.15.92:6809/1071971048","cluster_addr":"172.21.15.92:6811/1071971048","heartbeat_back_addr":"172.21.15.92:6815/1071971048","heartbeat_front_addr":"172.21.15.92:6813/1071971048","state":["exists","up"]},{"osd":5,"uuid":"f7fcde57-e280-494b-a45f-8fa007ed9ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6809","nonce":1404230851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6811","nonce":1404230851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6815","nonce":1404230851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6813","nonce":1404230851}]},"public_addr":"172.21.15.203:6809/1404230851","cluster_addr":"172.21.15.203:6811/1404230851","heartbeat_back_addr":"172.21.15.203:6815/1404230851","heartbeat_front_addr":"172.21.15.203:6813/1404230851","state":["exists","up"]},{"osd":6,"uuid":"86f1373a-3b39-4a7f-b14c-9bf8695c6b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6819","nonce":1213427819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6821","nonce":1213427819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6825","nonce":1213427819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6823","nonce":1213427819}]},"public_addr":"172.21.15.69:6819/1213427819","cluster_addr":"172.21.15.69:6821/1213427819","heartbeat_back_addr":"172.21.15.69:6825/1213427819","heartbeat_front_addr":"172.21.15.69:6823/1213427819","state":["exists","up"]},{"osd":7,"uuid":"e790fbf1-3e34-4950-bdfa-cf1adbd451c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6817","nonce":4274774582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6819","nonce":4274774582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6823","nonce":4274774582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6821","nonce":4274774582}]},"public_addr":"172.21.15.92:6817/4274774582","cluster_addr":"172.21.15.92:6819/4274774582","heartbeat_back_addr":"172.21.15.92:6823/4274774582","heartbeat_front_addr":"172.21.15.92:6821/4274774582","state":["exists","up"]},{"osd":8,"uuid":"65019fee-6b18-4d13-841a-2e3acb51f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6817","nonce":2480959249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6819","nonce":2480959249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6823","nonce":2480959249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6821","nonce":2480959249}]},"public_addr":"172.21.15.203:6817/2480959249","cluster_addr":"172.21.15.203:6819/2480959249","heartbeat_back_addr":"172.21.15.203:6823/2480959249","heartbeat_front_addr":"172.21.15.203:6821/2480959249","state":["exists","up"]},{"osd":9,"uuid":"b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6827","nonce":2649966866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6829","nonce":2649966866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6833","nonce":2649966866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6831","nonce":2649966866}]},"public_addr":"172.21.15.69:6827/2649966866","cluster_addr":"172.21.15.69:6829/2649966866","heartbeat_back_addr":"172.21.15.69:6833/2649966866","heartbeat_front_addr":"172.21.15.69:6831/2649966866","state":["exists","up"]},{"osd":10,"uuid":"45287823-f7ea-431f-ac01-a72762b01a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6825","nonce":3650822776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6827","nonce":3650822776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6831","nonce":3650822776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6829","nonce":3650822776}]},"public_addr":"172.21.15.92:6825/3650822776","cluster_addr":"172.21.15.92:6827/3650822776","heartbeat_back_addr":"172.21.15.92:6831/3650822776","heartbeat_front_addr":"172.21.15.92:6829/3650822776","state":["exists","up"]},{"osd":11,"uuid":"2f3a10f9-2414-4151-b1cf-3db68b2a66fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6825","nonce":2590258806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6827","nonce":2590258806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6831","nonce":2590258806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6829","nonce":2590258806}]},"public_addr":"172.21.15.203:6825/2590258806","cluster_addr":"172.21.15.203:6827/2590258806","heartbeat_back_addr":"172.21.15.203:6831/2590258806","heartbeat_front_addr":"172.21.15.203:6829/2590258806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:07:50.047712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:08:25.223293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:01.269713+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:38.679607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:16.161314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:53.323450+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:11:31.930106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:10.173015+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:48.056752+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:13:25.780142+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:03.705208+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:41.267371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/151981233":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/3776172313":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/1288620257":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/2718114316":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/1655882616":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/4183332474":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/2806878946":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/2718114316":"2024-05-15T15:05:41.383453+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:17:21.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.602+0000 7ff162600700 1 -- 172.21.15.69:0/2328901749 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff1440b2900 msgr2=0x7ff1440b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:21.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.602+0000 7ff162600700 1 --2- 172.21.15.69:0/2328901749 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff1440b2900 0x7ff1440b4e10 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff150009bf0 tx=0x7ff150009260 comp rx=0 tx=0).stop 2024-05-14T15:17:21.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.602+0000 7ff162600700 1 -- 172.21.15.69:0/2328901749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff15c10b870 msgr2=0x7ff15c1a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:21.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.602+0000 7ff162600700 1 --2- 172.21.15.69:0/2328901749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff15c10b870 0x7ff15c1a15e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7ff15400ef30 tx=0x7ff15400c450 comp rx=0 tx=0).stop 2024-05-14T15:17:21.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.603+0000 7ff162600700 1 -- 172.21.15.69:0/2328901749 shutdown_connections 2024-05-14T15:17:21.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.603+0000 7ff162600700 1 --2- 172.21.15.69:0/2328901749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff15c10b870 0x7ff15c1a15e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:21.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.603+0000 7ff162600700 1 --2- 172.21.15.69:0/2328901749 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff1440b2900 0x7ff1440b4e10 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:21.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.603+0000 7ff162600700 1 --2- 172.21.15.69:0/2328901749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff15c106640 0x7ff15c19cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:21.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.603+0000 7ff162600700 1 --2- 172.21.15.69:0/2328901749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff15c10af20 0x7ff15c19d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:21.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.603+0000 7ff162600700 1 -- 172.21.15.69:0/2328901749 >> 172.21.15.69:0/2328901749 conn(0x7ff15c102030 msgr2=0x7ff15c10a690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:21.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.603+0000 7ff162600700 1 -- 172.21.15.69:0/2328901749 shutdown_connections 2024-05-14T15:17:21.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:21.603+0000 7ff162600700 1 -- 172.21.15.69:0/2328901749 wait complete. 2024-05-14T15:17:22.320 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:22 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2328901749' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:17:22.406 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T15:17:22.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:22 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2328901749' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:17:22.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:22 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2328901749' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:17:22.827 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:17:23.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:23 smithi069 ceph-mon[31270]: pgmap v429: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T15:17:23.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:23 smithi092 ceph-mon[34729]: pgmap v429: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T15:17:23.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:23 smithi203 ceph-mon[34567]: pgmap v429: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T15:17:25.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.213+0000 7f1a1b000700 1 -- 172.21.15.69:0/2108066059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a14106ed0 msgr2=0x7f1a14113360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:25.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.213+0000 7f1a1b000700 1 --2- 172.21.15.69:0/2108066059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a14106ed0 0x7f1a14113360 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c00b0a0 tx=0x7f1a0c00b3b0 comp rx=0 tx=0).stop 2024-05-14T15:17:25.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.213+0000 7f1a1b000700 1 -- 172.21.15.69:0/2108066059 shutdown_connections 2024-05-14T15:17:25.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.213+0000 7f1a1b000700 1 --2- 172.21.15.69:0/2108066059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a14106ed0 0x7f1a14113360 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:25.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.213+0000 7f1a1b000700 1 --2- 172.21.15.69:0/2108066059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a1410c5c0 0x7f1a1410c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:25.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.213+0000 7f1a1b000700 1 --2- 172.21.15.69:0/2108066059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a14106580 0x7f1a14106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:25.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.213+0000 7f1a1b000700 1 -- 172.21.15.69:0/2108066059 >> 172.21.15.69:0/2108066059 conn(0x7f1a14102080 msgr2=0x7f1a141044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:25.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.213+0000 7f1a1b000700 1 -- 172.21.15.69:0/2108066059 shutdown_connections 2024-05-14T15:17:25.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.213+0000 7f1a1b000700 1 -- 172.21.15.69:0/2108066059 wait complete. 2024-05-14T15:17:25.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.214+0000 7f1a1b000700 1 Processor -- start 2024-05-14T15:17:25.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.214+0000 7f1a1b000700 1 -- start start 2024-05-14T15:17:25.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.215+0000 7f1a1b000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a14106580 0x7f1a1419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:25.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.215+0000 7f1a1b000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a14106ed0 0x7f1a1419d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:25.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.215+0000 7f1a1b000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a1410c5c0 0x7f1a141a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:25.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.215+0000 7f1a1b000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1a141165a0 con 0x7f1a14106ed0 2024-05-14T15:17:25.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.215+0000 7f1a1b000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1a14116420 con 0x7f1a14106580 2024-05-14T15:17:25.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.215+0000 7f1a1b000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1a14116720 con 0x7f1a1410c5c0 2024-05-14T15:17:25.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.215+0000 7f1a13400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a14106ed0 0x7f1a1419d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:25.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.215+0000 7f1a13400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a14106ed0 0x7f1a1419d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35156/0 (socket says 172.21.15.69:35156) 2024-05-14T15:17:25.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.215+0000 7f1a13400700 1 -- 172.21.15.69:0/2974327339 learned_addr learned my addr 172.21.15.69:0/2974327339 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:17:25.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.215+0000 7f1a13e00700 1 --2- 172.21.15.69:0/2974327339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a14106580 0x7f1a1419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:25.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.215+0000 7f1a19000700 1 --2- 172.21.15.69:0/2974327339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a1410c5c0 0x7f1a141a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:25.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.216+0000 7f1a13400700 1 -- 172.21.15.69:0/2974327339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a1410c5c0 msgr2=0x7f1a141a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:25.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.216+0000 7f1a13400700 1 --2- 172.21.15.69:0/2974327339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a1410c5c0 0x7f1a141a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:25.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.216+0000 7f1a13400700 1 -- 172.21.15.69:0/2974327339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a14106580 msgr2=0x7f1a1419ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:25.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.216+0000 7f1a13400700 1 --2- 172.21.15.69:0/2974327339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a14106580 0x7f1a1419ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:25.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.216+0000 7f1a13400700 1 -- 172.21.15.69:0/2974327339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a141a1cf0 con 0x7f1a14106ed0 2024-05-14T15:17:25.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.216+0000 7f1a13400700 1 --2- 172.21.15.69:0/2974327339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a14106ed0 0x7f1a1419d470 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1a0000c9b0 tx=0x7f1a0000cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:25.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.216+0000 7f1a10c00700 1 -- 172.21.15.69:0/2974327339 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a00007aa0 con 0x7f1a14106ed0 2024-05-14T15:17:25.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.216+0000 7f1a10c00700 1 -- 172.21.15.69:0/2974327339 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1a00007c40 con 0x7f1a14106ed0 2024-05-14T15:17:25.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.216+0000 7f1a1b000700 1 -- 172.21.15.69:0/2974327339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a141a1fe0 con 0x7f1a14106ed0 2024-05-14T15:17:25.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.216+0000 7f1a10c00700 1 -- 172.21.15.69:0/2974327339 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a00018660 con 0x7f1a14106ed0 2024-05-14T15:17:25.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.216+0000 7f1a1b000700 1 -- 172.21.15.69:0/2974327339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a141a99b0 con 0x7f1a14106ed0 2024-05-14T15:17:25.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.218+0000 7f1a1b000700 1 -- 172.21.15.69:0/2974327339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a140512c0 con 0x7f1a14106ed0 2024-05-14T15:17:25.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.222+0000 7f1a10c00700 1 -- 172.21.15.69:0/2974327339 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1a0000f450 con 0x7f1a14106ed0 2024-05-14T15:17:25.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.223+0000 7f1a10c00700 1 --2- 172.21.15.69:0/2974327339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f19f80b2900 0x7f19f80b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:25.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.224+0000 7f1a10c00700 1 -- 172.21.15.69:0/2974327339 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f1a000e2880 con 0x7f1a14106ed0 2024-05-14T15:17:25.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.224+0000 7f1a13e00700 1 --2- 172.21.15.69:0/2974327339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f19f80b2900 0x7f19f80b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:25.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.224+0000 7f1a13e00700 1 --2- 172.21.15.69:0/2974327339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f19f80b2900 0x7f19f80b4e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1a04005950 tx=0x7f1a040058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:25.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.226+0000 7f1a10c00700 1 -- 172.21.15.69:0/2974327339 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1a00014030 con 0x7f1a14106ed0 2024-05-14T15:17:25.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.459+0000 7f1a1b000700 1 -- 172.21.15.69:0/2974327339 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a1419e230 con 0x7f1a14106ed0 2024-05-14T15:17:25.460 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:25 smithi069 ceph-mon[31270]: pgmap v430: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T15:17:25.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.464+0000 7f1a10c00700 1 -- 172.21.15.69:0/2974327339 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24674 (secure 0 0 0) 0x7f1a000a9c10 con 0x7f1a14106ed0 2024-05-14T15:17:25.464 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:17:25.467 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":89,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","created":"2024-05-14T15:04:32.074994+0000","modified":"2024-05-14T15:16:42.977203+0000","last_up_change":"2024-05-14T15:14:44.049523+0000","last_in_change":"2024-05-14T15:14:16.752653+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:09:03.561841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:16:02.641690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:16:06.949687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:16:20.891122+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8640de99-c23a-494e-a100-aafd04fe1867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6803","nonce":301095601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6805","nonce":301095601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6809","nonce":301095601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6807","nonce":301095601}]},"public_addr":"172.21.15.69:6803/301095601","cluster_addr":"172.21.15.69:6805/301095601","heartbeat_back_addr":"172.21.15.69:6809/301095601","heartbeat_front_addr":"172.21.15.69:6807/301095601","state":["exists","up"]},{"osd":1,"uuid":"89f78a32-7afb-49f3-9287-5478a1cc8829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6801","nonce":2774122776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6803","nonce":2774122776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6807","nonce":2774122776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6805","nonce":2774122776}]},"public_addr":"172.21.15.92:6801/2774122776","cluster_addr":"172.21.15.92:6803/2774122776","heartbeat_back_addr":"172.21.15.92:6807/2774122776","heartbeat_front_addr":"172.21.15.92:6805/2774122776","state":["exists","up"]},{"osd":2,"uuid":"a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6801","nonce":2836920513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6803","nonce":2836920513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6807","nonce":2836920513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6805","nonce":2836920513}]},"public_addr":"172.21.15.203:6801/2836920513","cluster_addr":"172.21.15.203:6803/2836920513","heartbeat_back_addr":"172.21.15.203:6807/2836920513","heartbeat_front_addr":"172.21.15.203:6805/2836920513","state":["exists","up"]},{"osd":3,"uuid":"81409850-de26-4520-972c-31a716adf4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6811","nonce":680308620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6813","nonce":680308620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6817","nonce":680308620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6815","nonce":680308620}]},"public_addr":"172.21.15.69:6811/680308620","cluster_addr":"172.21.15.69:6813/680308620","heartbeat_back_addr":"172.21.15.69:6817/680308620","heartbeat_front_addr":"172.21.15.69:6815/680308620","state":["exists","up"]},{"osd":4,"uuid":"9aa3a6b0-cc63-4eae-8416-8ab630994985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6809","nonce":1071971048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6811","nonce":1071971048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6815","nonce":1071971048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6813","nonce":1071971048}]},"public_addr":"172.21.15.92:6809/1071971048","cluster_addr":"172.21.15.92:6811/1071971048","heartbeat_back_addr":"172.21.15.92:6815/1071971048","heartbeat_front_addr":"172.21.15.92:6813/1071971048","state":["exists","up"]},{"osd":5,"uuid":"f7fcde57-e280-494b-a45f-8fa007ed9ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6809","nonce":1404230851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6811","nonce":1404230851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6815","nonce":1404230851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6813","nonce":1404230851}]},"public_addr":"172.21.15.203:6809/1404230851","cluster_addr":"172.21.15.203:6811/1404230851","heartbeat_back_addr":"172.21.15.203:6815/1404230851","heartbeat_front_addr":"172.21.15.203:6813/1404230851","state":["exists","up"]},{"osd":6,"uuid":"86f1373a-3b39-4a7f-b14c-9bf8695c6b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6819","nonce":1213427819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6821","nonce":1213427819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6825","nonce":1213427819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6823","nonce":1213427819}]},"public_addr":"172.21.15.69:6819/1213427819","cluster_addr":"172.21.15.69:6821/1213427819","heartbeat_back_addr":"172.21.15.69:6825/1213427819","heartbeat_front_addr":"172.21.15.69:6823/1213427819","state":["exists","up"]},{"osd":7,"uuid":"e790fbf1-3e34-4950-bdfa-cf1adbd451c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6817","nonce":4274774582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6819","nonce":4274774582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6823","nonce":4274774582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6821","nonce":4274774582}]},"public_addr":"172.21.15.92:6817/4274774582","cluster_addr":"172.21.15.92:6819/4274774582","heartbeat_back_addr":"172.21.15.92:6823/4274774582","heartbeat_front_addr":"172.21.15.92:6821/4274774582","state":["exists","up"]},{"osd":8,"uuid":"65019fee-6b18-4d13-841a-2e3acb51f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6817","nonce":2480959249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6819","nonce":2480959249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6823","nonce":2480959249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6821","nonce":2480959249}]},"public_addr":"172.21.15.203:6817/2480959249","cluster_addr":"172.21.15.203:6819/2480959249","heartbeat_back_addr":"172.21.15.203:6823/2480959249","heartbeat_front_addr":"172.21.15.203:6821/2480959249","state":["exists","up"]},{"osd":9,"uuid":"b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6827","nonce":2649966866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6829","nonce":2649966866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6833","nonce":2649966866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6831","nonce":2649966866}]},"public_addr":"172.21.15.69:6827/2649966866","cluster_addr":"172.21.15.69:6829/2649966866","heartbeat_back_addr":"172.21.15.69:6833/2649966866","heartbeat_front_addr":"172.21.15.69:6831/2649966866","state":["exists","up"]},{"osd":10,"uuid":"45287823-f7ea-431f-ac01-a72762b01a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6825","nonce":3650822776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6827","nonce":3650822776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6831","nonce":3650822776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6829","nonce":3650822776}]},"public_addr":"172.21.15.92:6825/3650822776","cluster_addr":"172.21.15.92:6827/3650822776","heartbeat_back_addr":"172.21.15.92:6831/3650822776","heartbeat_front_addr":"172.21.15.92:6829/3650822776","state":["exists","up"]},{"osd":11,"uuid":"2f3a10f9-2414-4151-b1cf-3db68b2a66fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6825","nonce":2590258806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6827","nonce":2590258806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6831","nonce":2590258806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6829","nonce":2590258806}]},"public_addr":"172.21.15.203:6825/2590258806","cluster_addr":"172.21.15.203:6827/2590258806","heartbeat_back_addr":"172.21.15.203:6831/2590258806","heartbeat_front_addr":"172.21.15.203:6829/2590258806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:07:50.047712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:08:25.223293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:01.269713+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:38.679607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:16.161314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:53.323450+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:11:31.930106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:10.173015+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:48.056752+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:13:25.780142+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:03.705208+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:41.267371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/151981233":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/3776172313":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/1288620257":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/2718114316":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/1655882616":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/4183332474":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/2806878946":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/2718114316":"2024-05-15T15:05:41.383453+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:17:25.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.467+0000 7f1a1b000700 1 -- 172.21.15.69:0/2974327339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f19f80b2900 msgr2=0x7f19f80b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:25.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.467+0000 7f1a1b000700 1 --2- 172.21.15.69:0/2974327339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f19f80b2900 0x7f19f80b4e10 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1a04005950 tx=0x7f1a040058e0 comp rx=0 tx=0).stop 2024-05-14T15:17:25.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.467+0000 7f1a1b000700 1 -- 172.21.15.69:0/2974327339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a14106ed0 msgr2=0x7f1a1419d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:25.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.467+0000 7f1a1b000700 1 --2- 172.21.15.69:0/2974327339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a14106ed0 0x7f1a1419d470 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f1a0000c9b0 tx=0x7f1a0000cd70 comp rx=0 tx=0).stop 2024-05-14T15:17:25.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.467+0000 7f1a1b000700 1 -- 172.21.15.69:0/2974327339 shutdown_connections 2024-05-14T15:17:25.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.467+0000 7f1a1b000700 1 --2- 172.21.15.69:0/2974327339 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f19f80b2900 0x7f19f80b4e10 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:25.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.467+0000 7f1a1b000700 1 --2- 172.21.15.69:0/2974327339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1a1410c5c0 0x7f1a141a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:25.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.467+0000 7f1a1b000700 1 --2- 172.21.15.69:0/2974327339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1a14106580 0x7f1a1419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:25.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.467+0000 7f1a1b000700 1 --2- 172.21.15.69:0/2974327339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1a14106ed0 0x7f1a1419d470 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:25.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.467+0000 7f1a1b000700 1 -- 172.21.15.69:0/2974327339 >> 172.21.15.69:0/2974327339 conn(0x7f1a14102080 msgr2=0x7f1a14104820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:25.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.468+0000 7f1a1b000700 1 -- 172.21.15.69:0/2974327339 shutdown_connections 2024-05-14T15:17:25.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:25.468+0000 7f1a1b000700 1 -- 172.21.15.69:0/2974327339 wait complete. 2024-05-14T15:17:25.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:25 smithi203 ceph-mon[34567]: pgmap v430: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T15:17:25.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:25 smithi092 ceph-mon[34729]: pgmap v430: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T15:17:26.253 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-05-14T15:17:26.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:26 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2974327339' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:17:26.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:26 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2974327339' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:17:26.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:26 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2974327339' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:17:26.702 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:17:27.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:27 smithi069 ceph-mon[31270]: pgmap v431: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T15:17:27.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:27 smithi203 ceph-mon[34567]: pgmap v431: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T15:17:27.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:27 smithi092 ceph-mon[34729]: pgmap v431: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T15:17:29.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.079+0000 7f9db3400700 1 -- 172.21.15.69:0/2874297304 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dac1045f0 msgr2=0x7f9dac104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:29.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.079+0000 7f9db3400700 1 --2- 172.21.15.69:0/2874297304 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dac1045f0 0x7f9dac104a00 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f9da00099c0 tx=0x7f9da0009cd0 comp rx=0 tx=0).stop 2024-05-14T15:17:29.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.079+0000 7f9db3400700 1 -- 172.21.15.69:0/2874297304 shutdown_connections 2024-05-14T15:17:29.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.079+0000 7f9db3400700 1 --2- 172.21.15.69:0/2874297304 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dac1045f0 0x7f9dac104a00 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:29.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.079+0000 7f9db3400700 1 --2- 172.21.15.69:0/2874297304 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dac109870 0x7f9dac1111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:29.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.079+0000 7f9db3400700 1 --2- 172.21.15.69:0/2874297304 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dac108f20 0x7f9dac109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:29.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.079+0000 7f9db3400700 1 -- 172.21.15.69:0/2874297304 >> 172.21.15.69:0/2874297304 conn(0x7f9dac0fffe0 msgr2=0x7f9dac102400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:29.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.079+0000 7f9db3400700 1 -- 172.21.15.69:0/2874297304 shutdown_connections 2024-05-14T15:17:29.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.079+0000 7f9db3400700 1 -- 172.21.15.69:0/2874297304 wait complete. 2024-05-14T15:17:29.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.081+0000 7f9db3400700 1 Processor -- start 2024-05-14T15:17:29.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.081+0000 7f9db3400700 1 -- start start 2024-05-14T15:17:29.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.081+0000 7f9db3400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dac1045f0 0x7f9dac19adb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:29.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.081+0000 7f9db3400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dac108f20 0x7f9dac19b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:29.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.081+0000 7f9db3400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dac109870 0x7f9dac19f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:29.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.081+0000 7f9db3400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac1143a0 con 0x7f9dac108f20 2024-05-14T15:17:29.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.081+0000 7f9db3400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac114220 con 0x7f9dac109870 2024-05-14T15:17:29.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.081+0000 7f9db3400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac114520 con 0x7f9dac1045f0 2024-05-14T15:17:29.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.082+0000 7f9dabe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dac108f20 0x7f9dac19b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:29.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.082+0000 7f9dabe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dac108f20 0x7f9dac19b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35166/0 (socket says 172.21.15.69:35166) 2024-05-14T15:17:29.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.082+0000 7f9dabe00700 1 -- 172.21.15.69:0/4165266663 learned_addr learned my addr 172.21.15.69:0/4165266663 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:17:29.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.082+0000 7f9db0a00700 1 --2- 172.21.15.69:0/4165266663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dac1045f0 0x7f9dac19adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:29.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.082+0000 7f9db1400700 1 --2- 172.21.15.69:0/4165266663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dac109870 0x7f9dac19f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:29.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.082+0000 7f9dabe00700 1 -- 172.21.15.69:0/4165266663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dac1045f0 msgr2=0x7f9dac19adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:29.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.082+0000 7f9dabe00700 1 --2- 172.21.15.69:0/4165266663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dac1045f0 0x7f9dac19adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:29.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.082+0000 7f9dabe00700 1 -- 172.21.15.69:0/4165266663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dac109870 msgr2=0x7f9dac19f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:29.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.082+0000 7f9dabe00700 1 --2- 172.21.15.69:0/4165266663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dac109870 0x7f9dac19f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:29.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.082+0000 7f9dabe00700 1 -- 172.21.15.69:0/4165266663 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dac19fc80 con 0x7f9dac108f20 2024-05-14T15:17:29.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.082+0000 7f9db0a00700 1 --2- 172.21.15.69:0/4165266663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dac1045f0 0x7f9dac19adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:17:29.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.083+0000 7f9dabe00700 1 --2- 172.21.15.69:0/4165266663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dac108f20 0x7f9dac19b350 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800d980 tx=0x7f9d9800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:29.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.083+0000 7f9da9600700 1 -- 172.21.15.69:0/4165266663 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d98017070 con 0x7f9dac108f20 2024-05-14T15:17:29.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.083+0000 7f9da9600700 1 -- 172.21.15.69:0/4165266663 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d98010460 con 0x7f9dac108f20 2024-05-14T15:17:29.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.083+0000 7f9db3400700 1 -- 172.21.15.69:0/4165266663 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dac19ff70 con 0x7f9dac108f20 2024-05-14T15:17:29.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.083+0000 7f9da9600700 1 -- 172.21.15.69:0/4165266663 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d9800de60 con 0x7f9dac108f20 2024-05-14T15:17:29.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.083+0000 7f9db3400700 1 -- 172.21.15.69:0/4165266663 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dac0759f0 con 0x7f9dac108f20 2024-05-14T15:17:29.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.084+0000 7f9db3400700 1 -- 172.21.15.69:0/4165266663 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dac105aa0 con 0x7f9dac108f20 2024-05-14T15:17:29.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.087+0000 7f9da9600700 1 -- 172.21.15.69:0/4165266663 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f9d98010610 con 0x7f9dac108f20 2024-05-14T15:17:29.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.088+0000 7f9da9600700 1 --2- 172.21.15.69:0/4165266663 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9d940b2880 0x7f9d940b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:29.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.089+0000 7f9da9600700 1 -- 172.21.15.69:0/4165266663 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f9d980e2130 con 0x7f9dac108f20 2024-05-14T15:17:29.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.089+0000 7f9db0a00700 1 --2- 172.21.15.69:0/4165266663 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9d940b2880 0x7f9d940b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:29.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.089+0000 7f9db0a00700 1 --2- 172.21.15.69:0/4165266663 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9d940b2880 0x7f9d940b4d90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9da0000c00 tx=0x7f9da0005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:29.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.094+0000 7f9da9600700 1 -- 172.21.15.69:0/4165266663 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9d980a9a90 con 0x7f9dac108f20 2024-05-14T15:17:29.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:29.374+0000 7f9db3400700 1 -- 172.21.15.69:0/4165266663 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9dac19c110 con 0x7f9dac108f20 2024-05-14T15:17:29.374 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:29 smithi069 ceph-mon[31270]: pgmap v432: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T15:17:29.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:29 smithi203 ceph-mon[34567]: pgmap v432: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T15:17:29.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:29 smithi092 ceph-mon[34729]: pgmap v432: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-05-14T15:17:30.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:30.235+0000 7f9da9600700 1 -- 172.21.15.69:0/4165266663 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7f9d980a9390 con 0x7f9dac108f20 2024-05-14T15:17:30.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:30.239+0000 7f9db3400700 1 -- 172.21.15.69:0/4165266663 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9d940b2880 msgr2=0x7f9d940b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:30.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:30.239+0000 7f9db3400700 1 --2- 172.21.15.69:0/4165266663 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9d940b2880 0x7f9d940b4d90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f9da0000c00 tx=0x7f9da0005fd0 comp rx=0 tx=0).stop 2024-05-14T15:17:30.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:30.240+0000 7f9db3400700 1 -- 172.21.15.69:0/4165266663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dac108f20 msgr2=0x7f9dac19b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:30.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:30.240+0000 7f9db3400700 1 --2- 172.21.15.69:0/4165266663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dac108f20 0x7f9dac19b350 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9d9800d980 tx=0x7f9d9800dd40 comp rx=0 tx=0).stop 2024-05-14T15:17:30.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:30.240+0000 7f9db3400700 1 -- 172.21.15.69:0/4165266663 shutdown_connections 2024-05-14T15:17:30.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:30.240+0000 7f9db3400700 1 --2- 172.21.15.69:0/4165266663 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9d940b2880 0x7f9d940b4d90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:30.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:30.240+0000 7f9db3400700 1 --2- 172.21.15.69:0/4165266663 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dac109870 0x7f9dac19f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:30.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:30.240+0000 7f9db3400700 1 --2- 172.21.15.69:0/4165266663 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dac1045f0 0x7f9dac19adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:30.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:30.240+0000 7f9db3400700 1 --2- 172.21.15.69:0/4165266663 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dac108f20 0x7f9dac19b350 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:30.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:30.240+0000 7f9db3400700 1 -- 172.21.15.69:0/4165266663 >> 172.21.15.69:0/4165266663 conn(0x7f9dac0fffe0 msgr2=0x7f9dac107250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:30.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:30.240+0000 7f9db3400700 1 -- 172.21.15.69:0/4165266663 shutdown_connections 2024-05-14T15:17:30.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:30.240+0000 7f9db3400700 1 -- 172.21.15.69:0/4165266663 wait complete. 2024-05-14T15:17:30.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:30 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/4165266663' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-14T15:17:30.631 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:30 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/4165266663' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-14T15:17:30.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:30 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/4165266663' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-05-14T15:17:31.084 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2, 'subvol_options': '--namespace-isolated'}} 2024-05-14T15:17:31.085 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs set cephfs max_mds 5 2024-05-14T15:17:31.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:31 smithi069 ceph-mon[31270]: pgmap v433: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:31.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:31 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/4165266663' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-14T15:17:31.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:31 smithi069 ceph-mon[31270]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-14T15:17:31.548 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:17:31.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:31 smithi203 ceph-mon[34567]: pgmap v433: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:31.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:31 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/4165266663' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-14T15:17:31.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:31 smithi203 ceph-mon[34567]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-14T15:17:31.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:31 smithi092 ceph-mon[34729]: pgmap v433: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:31.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:31 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/4165266663' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-05-14T15:17:31.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:31 smithi092 ceph-mon[34729]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-14T15:17:33.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:33 smithi069 ceph-mon[31270]: pgmap v434: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:33.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:33 smithi203 ceph-mon[34567]: pgmap v434: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:33.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:33 smithi092 ceph-mon[34729]: pgmap v434: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:33.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.806+0000 7f5d4e600700 1 -- 172.21.15.69:0/2506226751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d480764b0 msgr2=0x7f5d48114e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:33.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.806+0000 7f5d4e600700 1 --2- 172.21.15.69:0/2506226751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d480764b0 0x7f5d48114e30 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5d34009990 tx=0x7f5d34009ca0 comp rx=0 tx=0).stop 2024-05-14T15:17:33.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.806+0000 7f5d4e600700 1 -- 172.21.15.69:0/2506226751 shutdown_connections 2024-05-14T15:17:33.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.806+0000 7f5d4e600700 1 --2- 172.21.15.69:0/2506226751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d48115370 0x7f5d48117790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:33.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.806+0000 7f5d4e600700 1 --2- 172.21.15.69:0/2506226751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d48075b60 0x7f5d48075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:33.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.806+0000 7f5d4e600700 1 --2- 172.21.15.69:0/2506226751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d480764b0 0x7f5d48114e30 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:33.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.806+0000 7f5d4e600700 1 -- 172.21.15.69:0/2506226751 >> 172.21.15.69:0/2506226751 conn(0x7f5d48100040 msgr2=0x7f5d48102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:33.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.807+0000 7f5d4e600700 1 -- 172.21.15.69:0/2506226751 shutdown_connections 2024-05-14T15:17:33.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.807+0000 7f5d4e600700 1 -- 172.21.15.69:0/2506226751 wait complete. 2024-05-14T15:17:33.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.808+0000 7f5d4e600700 1 Processor -- start 2024-05-14T15:17:33.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.808+0000 7f5d4e600700 1 -- start start 2024-05-14T15:17:33.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.808+0000 7f5d4e600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d48075b60 0x7f5d481a13a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:33.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.808+0000 7f5d4e600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d480764b0 0x7f5d481a1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:33.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.808+0000 7f5d4e600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d48115370 0x7f5d481a5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:33.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.808+0000 7f5d4e600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4811a970 con 0x7f5d48075b60 2024-05-14T15:17:33.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.808+0000 7f5d4e600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4811a7f0 con 0x7f5d480764b0 2024-05-14T15:17:33.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.808+0000 7f5d4e600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5d4811aaf0 con 0x7f5d48115370 2024-05-14T15:17:33.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.809+0000 7f5d47400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d48075b60 0x7f5d481a13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:33.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.809+0000 7f5d47400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d48075b60 0x7f5d481a13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46666/0 (socket says 172.21.15.69:46666) 2024-05-14T15:17:33.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.809+0000 7f5d47400700 1 -- 172.21.15.69:0/3150869516 learned_addr learned my addr 172.21.15.69:0/3150869516 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:17:33.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.809+0000 7f5d47e00700 1 --2- 172.21.15.69:0/3150869516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d48115370 0x7f5d481a5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:33.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.809+0000 7f5d46a00700 1 --2- 172.21.15.69:0/3150869516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d480764b0 0x7f5d481a1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:33.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.809+0000 7f5d47400700 1 -- 172.21.15.69:0/3150869516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d48115370 msgr2=0x7f5d481a5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.809+0000 7f5d47400700 1 --2- 172.21.15.69:0/3150869516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d48115370 0x7f5d481a5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.809+0000 7f5d47400700 1 -- 172.21.15.69:0/3150869516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d480764b0 msgr2=0x7f5d481a1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.809+0000 7f5d47400700 1 --2- 172.21.15.69:0/3150869516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d480764b0 0x7f5d481a1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.809+0000 7f5d47400700 1 -- 172.21.15.69:0/3150869516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d481a6270 con 0x7f5d48075b60 2024-05-14T15:17:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.810+0000 7f5d47400700 1 --2- 172.21.15.69:0/3150869516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d48075b60 0x7f5d481a13a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800e9a0 tx=0x7f5d3800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.810+0000 7f5d3fe00700 1 -- 172.21.15.69:0/3150869516 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d3800cbd0 con 0x7f5d48075b60 2024-05-14T15:17:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.810+0000 7f5d3fe00700 1 -- 172.21.15.69:0/3150869516 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d3800cd70 con 0x7f5d48075b60 2024-05-14T15:17:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.810+0000 7f5d4e600700 1 -- 172.21.15.69:0/3150869516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d481a6560 con 0x7f5d48075b60 2024-05-14T15:17:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.810+0000 7f5d3fe00700 1 -- 172.21.15.69:0/3150869516 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d38018680 con 0x7f5d48075b60 2024-05-14T15:17:33.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.810+0000 7f5d4e600700 1 -- 172.21.15.69:0/3150869516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d481ade80 con 0x7f5d48075b60 2024-05-14T15:17:33.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.812+0000 7f5d4e600700 1 -- 172.21.15.69:0/3150869516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d480772a0 con 0x7f5d48075b60 2024-05-14T15:17:33.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.814+0000 7f5d3fe00700 1 -- 172.21.15.69:0/3150869516 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f5d38010430 con 0x7f5d48075b60 2024-05-14T15:17:33.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.816+0000 7f5d3fe00700 1 --2- 172.21.15.69:0/3150869516 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5d2c0b2880 0x7f5d2c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:33.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.816+0000 7f5d3fe00700 1 -- 172.21.15.69:0/3150869516 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f5d380e28e0 con 0x7f5d48075b60 2024-05-14T15:17:33.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.816+0000 7f5d46a00700 1 --2- 172.21.15.69:0/3150869516 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5d2c0b2880 0x7f5d2c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:33.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.817+0000 7f5d46a00700 1 --2- 172.21.15.69:0/3150869516 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5d2c0b2880 0x7f5d2c0b4d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400b2e0 tx=0x7f5d34005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:33.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:33.821+0000 7f5d3fe00700 1 -- 172.21.15.69:0/3150869516 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5d380aa240 con 0x7f5d48075b60 2024-05-14T15:17:34.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:34.102+0000 7f5d4e600700 1 -- 172.21.15.69:0/3150869516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f5d481a2700 con 0x7f5d48075b60 2024-05-14T15:17:34.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:34.262+0000 7f5d3fe00700 1 -- 172.21.15.69:0/3150869516 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7f5d380b22c0 con 0x7f5d48075b60 2024-05-14T15:17:34.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:34.266+0000 7f5d4e600700 1 -- 172.21.15.69:0/3150869516 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5d2c0b2880 msgr2=0x7f5d2c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:34.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:34.266+0000 7f5d4e600700 1 --2- 172.21.15.69:0/3150869516 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5d2c0b2880 0x7f5d2c0b4d90 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400b2e0 tx=0x7f5d34005fb0 comp rx=0 tx=0).stop 2024-05-14T15:17:34.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:34.266+0000 7f5d4e600700 1 -- 172.21.15.69:0/3150869516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d48075b60 msgr2=0x7f5d481a13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:34.265 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:34.266+0000 7f5d4e600700 1 --2- 172.21.15.69:0/3150869516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d48075b60 0x7f5d481a13a0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5d3800e9a0 tx=0x7f5d3800ed60 comp rx=0 tx=0).stop 2024-05-14T15:17:34.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:34.266+0000 7f5d4e600700 1 -- 172.21.15.69:0/3150869516 shutdown_connections 2024-05-14T15:17:34.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:34.266+0000 7f5d4e600700 1 --2- 172.21.15.69:0/3150869516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d48075b60 0x7f5d481a13a0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:34.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:34.267+0000 7f5d4e600700 1 --2- 172.21.15.69:0/3150869516 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5d2c0b2880 0x7f5d2c0b4d90 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:34.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:34.267+0000 7f5d4e600700 1 --2- 172.21.15.69:0/3150869516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d48115370 0x7f5d481a5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:34.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:34.267+0000 7f5d4e600700 1 --2- 172.21.15.69:0/3150869516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d480764b0 0x7f5d481a1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:34.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:34.267+0000 7f5d4e600700 1 -- 172.21.15.69:0/3150869516 >> 172.21.15.69:0/3150869516 conn(0x7f5d48100040 msgr2=0x7f5d48102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:34.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:34.267+0000 7f5d4e600700 1 -- 172.21.15.69:0/3150869516 shutdown_connections 2024-05-14T15:17:34.266 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:34.267+0000 7f5d4e600700 1 -- 172.21.15.69:0/3150869516 wait complete. 2024-05-14T15:17:34.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:34 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3150869516' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-14T15:17:34.592 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:34 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3150869516' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-14T15:17:34.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:34 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3150869516' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]: dispatch 2024-05-14T15:17:35.139 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-05-14T15:17:35.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:35 smithi069 ceph-mon[31270]: pgmap v435: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:35.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:35 smithi069 ceph-mon[31270]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-14T15:17:35.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:35 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3150869516' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-14T15:17:35.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:35 smithi069 ceph-mon[31270]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-14T15:17:35.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:35 smithi069 ceph-mon[31270]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-14T15:17:35.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:35 smithi069 ceph-mon[31270]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-14T15:17:35.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:35 smithi069 ceph-mon[31270]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-14T15:17:35.585 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:17:35.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:35 smithi203 ceph-mon[34567]: pgmap v435: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:35.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:35 smithi203 ceph-mon[34567]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-14T15:17:35.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:35 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3150869516' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-14T15:17:35.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:35 smithi203 ceph-mon[34567]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-14T15:17:35.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:35 smithi203 ceph-mon[34567]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-14T15:17:35.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:35 smithi203 ceph-mon[34567]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-14T15:17:35.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:35 smithi203 ceph-mon[34567]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-14T15:17:35.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:35 smithi092 ceph-mon[34729]: pgmap v435: 129 pgs: 129 active+clean; 581 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:17:35.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:35 smithi092 ceph-mon[34729]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-05-14T15:17:35.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:35 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3150869516' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]': finished 2024-05-14T15:17:35.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:35 smithi092 ceph-mon[34729]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-05-14T15:17:35.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:35 smithi092 ceph-mon[34729]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-05-14T15:17:35.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:35 smithi092 ceph-mon[34729]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-05-14T15:17:35.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:35 smithi092 ceph-mon[34729]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-05-14T15:17:36.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:36 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] up:active 2024-05-14T15:17:36.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:36 smithi203 ceph-mon[34567]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-14T15:17:36.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:36 smithi203 ceph-mon[34567]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-14T15:17:36.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:36 smithi203 ceph-mon[34567]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-05-14T15:17:36.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:36 smithi203 ceph-mon[34567]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-05-14T15:17:36.593 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:36 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] up:active 2024-05-14T15:17:36.594 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:36 smithi092 ceph-mon[34729]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-14T15:17:36.594 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:36 smithi092 ceph-mon[34729]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-14T15:17:36.594 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:36 smithi092 ceph-mon[34729]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-05-14T15:17:36.594 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:36 smithi092 ceph-mon[34729]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-05-14T15:17:36.677 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:36 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] up:active 2024-05-14T15:17:36.677 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:36 smithi069 ceph-mon[31270]: daemon mds.e assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-05-14T15:17:36.677 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:36 smithi069 ceph-mon[31270]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-05-14T15:17:36.677 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:36 smithi069 ceph-mon[31270]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:creating} 9 up:standby 2024-05-14T15:17:36.677 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:36 smithi069 ceph-mon[31270]: daemon mds.e is now active in filesystem cephfs as rank 2 2024-05-14T15:17:37.441 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:17:37 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b[64556]: 2024-05-14T15:17:37.070+0000 7f1325e00700 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-05-14T15:17:37.441 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:17:37 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b[64556]: 2024-05-14T15:17:37.070+0000 7f1325e00700 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-05-14T15:17:37.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:37 smithi092 ceph-mon[34729]: pgmap v436: 129 pgs: 129 active+clean; 582 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:37.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:37 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] up:active 2024-05-14T15:17:37.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:37 smithi092 ceph-mon[34729]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-14T15:17:37.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:37 smithi092 ceph-mon[34729]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-14T15:17:37.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:37 smithi092 ceph-mon[34729]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:creating} 8 up:standby 2024-05-14T15:17:37.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:37 smithi092 ceph-mon[34729]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-05-14T15:17:37.570 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:37 smithi069 ceph-mon[31270]: pgmap v436: 129 pgs: 129 active+clean; 582 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:37.570 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:37 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] up:active 2024-05-14T15:17:37.570 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:37 smithi069 ceph-mon[31270]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-14T15:17:37.570 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:37 smithi069 ceph-mon[31270]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-14T15:17:37.570 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:37 smithi069 ceph-mon[31270]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:creating} 8 up:standby 2024-05-14T15:17:37.570 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:37 smithi069 ceph-mon[31270]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-05-14T15:17:37.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:37 smithi203 ceph-mon[34567]: pgmap v436: 129 pgs: 129 active+clean; 582 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-05-14T15:17:37.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:37 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] up:active 2024-05-14T15:17:37.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:37 smithi203 ceph-mon[34567]: daemon mds.k assigned to filesystem cephfs as rank 3 (now has 4 ranks) 2024-05-14T15:17:37.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:37 smithi203 ceph-mon[34567]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=e=up:active} 9 up:standby 2024-05-14T15:17:37.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:37 smithi203 ceph-mon[34567]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:creating} 8 up:standby 2024-05-14T15:17:37.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:37 smithi203 ceph-mon[34567]: daemon mds.k is now active in filesystem cephfs as rank 3 2024-05-14T15:17:37.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.971+0000 7f281a400700 1 -- 172.21.15.69:0/1543447682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f281410a990 msgr2=0x7f281410ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:37.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.971+0000 7f281a400700 1 --2- 172.21.15.69:0/1543447682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f281410a990 0x7f281410ada0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f2800009990 tx=0x7f2800009ca0 comp rx=0 tx=0).stop 2024-05-14T15:17:37.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.972+0000 7f281a400700 1 -- 172.21.15.69:0/1543447682 shutdown_connections 2024-05-14T15:17:37.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.972+0000 7f281a400700 1 --2- 172.21.15.69:0/1543447682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f281410b2e0 0x7f2814117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:37.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.972+0000 7f281a400700 1 --2- 172.21.15.69:0/1543447682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2814110970 0x7f2814110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:37.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.972+0000 7f281a400700 1 --2- 172.21.15.69:0/1543447682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f281410a990 0x7f281410ada0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:37.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.972+0000 7f281a400700 1 -- 172.21.15.69:0/1543447682 >> 172.21.15.69:0/1543447682 conn(0x7f2814077c80 msgr2=0x7f28140780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:37.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.972+0000 7f281a400700 1 -- 172.21.15.69:0/1543447682 shutdown_connections 2024-05-14T15:17:37.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.972+0000 7f281a400700 1 -- 172.21.15.69:0/1543447682 wait complete. 2024-05-14T15:17:37.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.973+0000 7f281a400700 1 Processor -- start 2024-05-14T15:17:37.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.973+0000 7f281a400700 1 -- start start 2024-05-14T15:17:37.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.974+0000 7f281a400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f281410a990 0x7f28141a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:37.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.974+0000 7f281a400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f281410b2e0 0x7f28141a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:37.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.974+0000 7f281a400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2814110970 0x7f28141a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:37.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.974+0000 7f281a400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f281411a940 con 0x7f281410b2e0 2024-05-14T15:17:37.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.974+0000 7f281a400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f281411a7c0 con 0x7f2814110970 2024-05-14T15:17:37.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.974+0000 7f281a400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f281411aac0 con 0x7f281410a990 2024-05-14T15:17:37.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.974+0000 7f2812a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f281410b2e0 0x7f28141a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:37.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.974+0000 7f2812a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f281410b2e0 0x7f28141a1910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46688/0 (socket says 172.21.15.69:46688) 2024-05-14T15:17:37.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.974+0000 7f2812a00700 1 -- 172.21.15.69:0/3253771132 learned_addr learned my addr 172.21.15.69:0/3253771132 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:17:37.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.975+0000 7f2813400700 1 --2- 172.21.15.69:0/3253771132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f281410a990 0x7f28141a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:37.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.975+0000 7f2813e00700 1 --2- 172.21.15.69:0/3253771132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2814110970 0x7f28141a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:37.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.975+0000 7f2812a00700 1 -- 172.21.15.69:0/3253771132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f281410a990 msgr2=0x7f28141a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:37.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.975+0000 7f2812a00700 1 --2- 172.21.15.69:0/3253771132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f281410a990 0x7f28141a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:37.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.975+0000 7f2812a00700 1 -- 172.21.15.69:0/3253771132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2814110970 msgr2=0x7f28141a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:37.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.975+0000 7f2812a00700 1 --2- 172.21.15.69:0/3253771132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2814110970 0x7f28141a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:37.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.975+0000 7f2812a00700 1 -- 172.21.15.69:0/3253771132 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28141a6190 con 0x7f281410b2e0 2024-05-14T15:17:37.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.975+0000 7f2813e00700 1 --2- 172.21.15.69:0/3253771132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2814110970 0x7f28141a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:17:37.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.975+0000 7f2813400700 1 --2- 172.21.15.69:0/3253771132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f281410a990 0x7f28141a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:17:37.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.975+0000 7f2812a00700 1 --2- 172.21.15.69:0/3253771132 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f281410b2e0 0x7f28141a1910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2800006010 tx=0x7f2800005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:37.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.976+0000 7f280be00700 1 -- 172.21.15.69:0/3253771132 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2800027070 con 0x7f281410b2e0 2024-05-14T15:17:37.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.976+0000 7f280be00700 1 -- 172.21.15.69:0/3253771132 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f280000fc40 con 0x7f281410b2e0 2024-05-14T15:17:37.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.976+0000 7f281a400700 1 -- 172.21.15.69:0/3253771132 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28141a6420 con 0x7f281410b2e0 2024-05-14T15:17:37.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.976+0000 7f280be00700 1 -- 172.21.15.69:0/3253771132 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2800022c90 con 0x7f281410b2e0 2024-05-14T15:17:37.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.976+0000 7f281a400700 1 -- 172.21.15.69:0/3253771132 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28141a6900 con 0x7f281410b2e0 2024-05-14T15:17:37.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.977+0000 7f281a400700 1 -- 172.21.15.69:0/3253771132 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28140512c0 con 0x7f281410b2e0 2024-05-14T15:17:37.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.980+0000 7f280be00700 1 -- 172.21.15.69:0/3253771132 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f280002a070 con 0x7f281410b2e0 2024-05-14T15:17:37.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.981+0000 7f280be00700 1 --2- 172.21.15.69:0/3253771132 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f27f80b2880 0x7f27f80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:37.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.981+0000 7f280be00700 1 -- 172.21.15.69:0/3253771132 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f28000e3960 con 0x7f281410b2e0 2024-05-14T15:17:37.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.981+0000 7f2813400700 1 --2- 172.21.15.69:0/3253771132 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f27f80b2880 0x7f27f80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:37.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.982+0000 7f2813400700 1 --2- 172.21.15.69:0/3253771132 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f27f80b2880 0x7f27f80b4d90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2804005fd0 tx=0x7f280400a5e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:37.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:37.984+0000 7f280be00700 1 -- 172.21.15.69:0/3253771132 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f280005fdf0 con 0x7f281410b2e0 2024-05-14T15:17:38.267 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:38.268+0000 7f281a400700 1 -- 172.21.15.69:0/3253771132 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7f281402e5f0 con 0x7f281410b2e0 2024-05-14T15:17:38.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:38.345+0000 7f280be00700 1 -- 172.21.15.69:0/3253771132 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v27) ==== 121+0+0 (secure 0 0 0) 0x7f2800013070 con 0x7f281410b2e0 2024-05-14T15:17:38.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:38.349+0000 7f281a400700 1 -- 172.21.15.69:0/3253771132 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f27f80b2880 msgr2=0x7f27f80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:38.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:38.349+0000 7f281a400700 1 --2- 172.21.15.69:0/3253771132 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f27f80b2880 0x7f27f80b4d90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2804005fd0 tx=0x7f280400a5e0 comp rx=0 tx=0).stop 2024-05-14T15:17:38.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:38.349+0000 7f281a400700 1 -- 172.21.15.69:0/3253771132 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f281410b2e0 msgr2=0x7f28141a1910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:38.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:38.349+0000 7f281a400700 1 --2- 172.21.15.69:0/3253771132 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f281410b2e0 0x7f28141a1910 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f2800006010 tx=0x7f2800005ef0 comp rx=0 tx=0).stop 2024-05-14T15:17:38.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:38.349+0000 7f281a400700 1 -- 172.21.15.69:0/3253771132 shutdown_connections 2024-05-14T15:17:38.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:38.349+0000 7f281a400700 1 --2- 172.21.15.69:0/3253771132 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f27f80b2880 0x7f27f80b4d90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:38.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:38.349+0000 7f281a400700 1 --2- 172.21.15.69:0/3253771132 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2814110970 0x7f28141a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:38.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:38.349+0000 7f281a400700 1 --2- 172.21.15.69:0/3253771132 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f281410a990 0x7f28141a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:38.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:38.349+0000 7f281a400700 1 --2- 172.21.15.69:0/3253771132 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f281410b2e0 0x7f28141a1910 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:38.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:38.349+0000 7f281a400700 1 -- 172.21.15.69:0/3253771132 >> 172.21.15.69:0/3253771132 conn(0x7f2814077c80 msgr2=0x7f281407b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:38.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:38.350+0000 7f281a400700 1 -- 172.21.15.69:0/3253771132 shutdown_connections 2024-05-14T15:17:38.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:38.350+0000 7f281a400700 1 -- 172.21.15.69:0/3253771132 wait complete. 2024-05-14T15:17:38.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:38 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] up:active 2024-05-14T15:17:38.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:38 smithi203 ceph-mon[34567]: daemon mds.i assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-14T15:17:38.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:38 smithi203 ceph-mon[34567]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-14T15:17:38.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:38 smithi203 ceph-mon[34567]: Cluster is now healthy 2024-05-14T15:17:38.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:38 smithi203 ceph-mon[34567]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:active} 8 up:standby 2024-05-14T15:17:38.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:38 smithi203 ceph-mon[34567]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-14T15:17:38.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:38 smithi203 ceph-mon[34567]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-05-14T15:17:38.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:38 smithi203 ceph-mon[34567]: pgmap v437: 129 pgs: 129 active+clean; 583 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 2 op/s 2024-05-14T15:17:38.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:38 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3253771132' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-14T15:17:38.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:38 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] up:active 2024-05-14T15:17:38.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:38 smithi092 ceph-mon[34729]: daemon mds.i assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-14T15:17:38.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:38 smithi092 ceph-mon[34729]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-14T15:17:38.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:38 smithi092 ceph-mon[34729]: Cluster is now healthy 2024-05-14T15:17:38.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:38 smithi092 ceph-mon[34729]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:active} 8 up:standby 2024-05-14T15:17:38.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:38 smithi092 ceph-mon[34729]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-14T15:17:38.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:38 smithi092 ceph-mon[34729]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-05-14T15:17:38.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:38 smithi092 ceph-mon[34729]: pgmap v437: 129 pgs: 129 active+clean; 583 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 2 op/s 2024-05-14T15:17:38.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:38 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3253771132' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-14T15:17:38.722 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:38 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] up:active 2024-05-14T15:17:38.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:38 smithi069 ceph-mon[31270]: daemon mds.i assigned to filesystem cephfs as rank 4 (now has 5 ranks) 2024-05-14T15:17:38.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:38 smithi069 ceph-mon[31270]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-05-14T15:17:38.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:38 smithi069 ceph-mon[31270]: Cluster is now healthy 2024-05-14T15:17:38.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:38 smithi069 ceph-mon[31270]: fsmap cephfs:4 {0=b=up:active,1=h=up:active,2=e=up:active,3=k=up:active} 8 up:standby 2024-05-14T15:17:38.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:38 smithi069 ceph-mon[31270]: fsmap cephfs:5 1 up:creating 7 up:standby 4 up:active 2024-05-14T15:17:38.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:38 smithi069 ceph-mon[31270]: daemon mds.i is now active in filesystem cephfs as rank 4 2024-05-14T15:17:38.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:38 smithi069 ceph-mon[31270]: pgmap v437: 129 pgs: 129 active+clean; 583 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 682 B/s wr, 2 op/s 2024-05-14T15:17:38.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:38 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3253771132' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-05-14T15:17:39.159 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-05-14T15:17:39.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:39 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3253771132' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-14T15:17:39.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:39 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] up:active 2024-05-14T15:17:39.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:39 smithi069 ceph-mon[31270]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-14T15:17:39.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:39 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:17:39.604 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:17:39.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:39 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3253771132' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-14T15:17:39.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:39 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] up:active 2024-05-14T15:17:39.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:39 smithi092 ceph-mon[34729]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-14T15:17:39.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:39 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:17:39.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:39 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3253771132' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-05-14T15:17:39.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:39 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] up:active 2024-05-14T15:17:39.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:39 smithi203 ceph-mon[34567]: fsmap cephfs:5 7 up:standby 5 up:active 2024-05-14T15:17:39.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:39 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:17:40.645 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:40 smithi069 ceph-mon[31270]: pgmap v438: 129 pgs: 129 active+clean; 585 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.4 KiB/s wr, 10 op/s 2024-05-14T15:17:40.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:40 smithi092 ceph-mon[34729]: pgmap v438: 129 pgs: 129 active+clean; 585 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.4 KiB/s wr, 10 op/s 2024-05-14T15:17:40.843 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:40 smithi203 ceph-mon[34567]: pgmap v438: 129 pgs: 129 active+clean; 585 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 1023 B/s rd, 2.4 KiB/s wr, 10 op/s 2024-05-14T15:17:41.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.935+0000 7f9725800700 1 -- 172.21.15.69:0/3123488544 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9720110970 msgr2=0x7f9720110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:41.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.935+0000 7f9725800700 1 --2- 172.21.15.69:0/3123488544 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9720110970 0x7f9720110d80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9710009990 tx=0x7f9710009ca0 comp rx=0 tx=0).stop 2024-05-14T15:17:41.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.935+0000 7f9725800700 1 -- 172.21.15.69:0/3123488544 shutdown_connections 2024-05-14T15:17:41.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.935+0000 7f9725800700 1 --2- 172.21.15.69:0/3123488544 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9720110970 0x7f9720110d80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:41.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.935+0000 7f9725800700 1 --2- 172.21.15.69:0/3123488544 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f972010b2e0 0x7f9720117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:41.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.935+0000 7f9725800700 1 --2- 172.21.15.69:0/3123488544 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f972010a990 0x7f972010ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:41.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.935+0000 7f9725800700 1 -- 172.21.15.69:0/3123488544 >> 172.21.15.69:0/3123488544 conn(0x7f9720077c80 msgr2=0x7f97200780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:41.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.936+0000 7f9725800700 1 -- 172.21.15.69:0/3123488544 shutdown_connections 2024-05-14T15:17:41.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.936+0000 7f9725800700 1 -- 172.21.15.69:0/3123488544 wait complete. 2024-05-14T15:17:41.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.937+0000 7f9725800700 1 Processor -- start 2024-05-14T15:17:41.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.937+0000 7f9725800700 1 -- start start 2024-05-14T15:17:41.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.937+0000 7f9725800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f972010a990 0x7f97201a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:41.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.937+0000 7f9725800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f972010b2e0 0x7f97201a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:41.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.937+0000 7f9725800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9720110970 0x7f97201a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:41.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.937+0000 7f9725800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f972011a920 con 0x7f972010a990 2024-05-14T15:17:41.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.937+0000 7f9725800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f972011a7a0 con 0x7f9720110970 2024-05-14T15:17:41.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.937+0000 7f9725800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f972011aaa0 con 0x7f972010b2e0 2024-05-14T15:17:41.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.938+0000 7f971ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f972010a990 0x7f97201a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:41.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.938+0000 7f971ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f972010a990 0x7f97201a1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46710/0 (socket says 172.21.15.69:46710) 2024-05-14T15:17:41.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.938+0000 7f971ea00700 1 -- 172.21.15.69:0/2374176319 learned_addr learned my addr 172.21.15.69:0/2374176319 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:17:41.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.938+0000 7f971f400700 1 --2- 172.21.15.69:0/2374176319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9720110970 0x7f97201a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:41.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.938+0000 7f971e000700 1 --2- 172.21.15.69:0/2374176319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f972010b2e0 0x7f97201a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:41.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.938+0000 7f971ea00700 1 -- 172.21.15.69:0/2374176319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f972010b2e0 msgr2=0x7f97201a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:41.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.938+0000 7f971ea00700 1 --2- 172.21.15.69:0/2374176319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f972010b2e0 0x7f97201a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:41.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.938+0000 7f971ea00700 1 -- 172.21.15.69:0/2374176319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9720110970 msgr2=0x7f97201a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:41.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.938+0000 7f971ea00700 1 --2- 172.21.15.69:0/2374176319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9720110970 0x7f97201a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:41.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.938+0000 7f971ea00700 1 -- 172.21.15.69:0/2374176319 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97201a6240 con 0x7f972010a990 2024-05-14T15:17:41.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.939+0000 7f971ea00700 1 --2- 172.21.15.69:0/2374176319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f972010a990 0x7f97201a1370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9710000c00 tx=0x7f9710009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:41.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.939+0000 7f9717400700 1 -- 172.21.15.69:0/2374176319 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710027070 con 0x7f972010a990 2024-05-14T15:17:41.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.939+0000 7f9717400700 1 -- 172.21.15.69:0/2374176319 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f971000fc70 con 0x7f972010a990 2024-05-14T15:17:41.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.939+0000 7f9725800700 1 -- 172.21.15.69:0/2374176319 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97201a64d0 con 0x7f972010a990 2024-05-14T15:17:41.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.939+0000 7f9717400700 1 -- 172.21.15.69:0/2374176319 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710022d30 con 0x7f972010a990 2024-05-14T15:17:41.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.939+0000 7f9725800700 1 -- 172.21.15.69:0/2374176319 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97201ade50 con 0x7f972010a990 2024-05-14T15:17:41.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.940+0000 7f9725800700 1 -- 172.21.15.69:0/2374176319 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f972010c080 con 0x7f972010a990 2024-05-14T15:17:41.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.943+0000 7f9717400700 1 -- 172.21.15.69:0/2374176319 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f971002a070 con 0x7f972010a990 2024-05-14T15:17:41.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.944+0000 7f9717400700 1 --2- 172.21.15.69:0/2374176319 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f97040b2900 0x7f97040b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:41.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.944+0000 7f9717400700 1 -- 172.21.15.69:0/2374176319 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f97100e33b0 con 0x7f972010a990 2024-05-14T15:17:41.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.944+0000 7f971e000700 1 --2- 172.21.15.69:0/2374176319 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f97040b2900 0x7f97040b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:41.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.945+0000 7f971e000700 1 --2- 172.21.15.69:0/2374176319 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f97040b2900 0x7f97040b4e10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f970c005950 tx=0x7f970c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:41.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:41.949+0000 7f9717400700 1 -- 172.21.15.69:0/2374176319 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9710013070 con 0x7f972010a990 2024-05-14T15:17:42.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:42.232+0000 7f9725800700 1 -- 172.21.15.69:0/2374176319 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f97200512c0 con 0x7f972010a990 2024-05-14T15:17:42.441 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:17:42 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b[64556]: 2024-05-14T15:17:42.071+0000 7f1325e00700 -1 mds.pinger is_rank_lagging: rank=4 was never sent ping request. 2024-05-14T15:17:42.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:42.695+0000 7f9717400700 1 -- 172.21.15.69:0/2374176319 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v29) ==== 115+0+0 (secure 0 0 0) 0x7f97100a4e20 con 0x7f972010a990 2024-05-14T15:17:42.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:42.700+0000 7f9725800700 1 -- 172.21.15.69:0/2374176319 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f97040b2900 msgr2=0x7f97040b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:42.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:42.700+0000 7f9725800700 1 --2- 172.21.15.69:0/2374176319 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f97040b2900 0x7f97040b4e10 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f970c005950 tx=0x7f970c0058e0 comp rx=0 tx=0).stop 2024-05-14T15:17:42.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:42.700+0000 7f9725800700 1 -- 172.21.15.69:0/2374176319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f972010a990 msgr2=0x7f97201a1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:42.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:42.700+0000 7f9725800700 1 --2- 172.21.15.69:0/2374176319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f972010a990 0x7f97201a1370 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9710000c00 tx=0x7f9710009f90 comp rx=0 tx=0).stop 2024-05-14T15:17:42.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:42.700+0000 7f9725800700 1 -- 172.21.15.69:0/2374176319 shutdown_connections 2024-05-14T15:17:42.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:42.700+0000 7f9725800700 1 --2- 172.21.15.69:0/2374176319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f972010a990 0x7f97201a1370 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:42.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:42.700+0000 7f9725800700 1 --2- 172.21.15.69:0/2374176319 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f97040b2900 0x7f97040b4e10 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:42.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:42.700+0000 7f9725800700 1 --2- 172.21.15.69:0/2374176319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9720110970 0x7f97201a5ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:42.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:42.700+0000 7f9725800700 1 --2- 172.21.15.69:0/2374176319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f972010b2e0 0x7f97201a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:42.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:42.700+0000 7f9725800700 1 -- 172.21.15.69:0/2374176319 >> 172.21.15.69:0/2374176319 conn(0x7f9720077c80 msgr2=0x7f972007bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:42.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:42.701+0000 7f9725800700 1 -- 172.21.15.69:0/2374176319 shutdown_connections 2024-05-14T15:17:42.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:42.701+0000 7f9725800700 1 -- 172.21.15.69:0/2374176319 wait complete. 2024-05-14T15:17:42.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:42 smithi069 ceph-mon[31270]: pgmap v439: 129 pgs: 129 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-05-14T15:17:42.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-05-14T15:17:42.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]}]: dispatch 2024-05-14T15:17:42.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]: dispatch 2024-05-14T15:17:42.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:42 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 6]}]: dispatch 2024-05-14T15:17:42.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:42 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2374176319' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-14T15:17:43.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:42 smithi203 ceph-mon[34567]: pgmap v439: 129 pgs: 129 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-05-14T15:17:43.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-05-14T15:17:43.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]}]: dispatch 2024-05-14T15:17:43.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]: dispatch 2024-05-14T15:17:43.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:42 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 6]}]: dispatch 2024-05-14T15:17:43.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:42 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2374176319' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-14T15:17:43.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:42 smithi092 ceph-mon[34729]: pgmap v439: 129 pgs: 129 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 4.0 KiB/s wr, 16 op/s 2024-05-14T15:17:43.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]: dispatch 2024-05-14T15:17:43.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]}]: dispatch 2024-05-14T15:17:43.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]: dispatch 2024-05-14T15:17:43.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:42 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 6]}]: dispatch 2024-05-14T15:17:43.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:42 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2374176319' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-05-14T15:17:43.554 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2, 'subvol_options': '--namespace-isolated'} subvols for filesystem 'cephfs' 2024-05-14T15:17:43.554 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-05-14T15:17:43.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:43 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2374176319' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-14T15:17:43.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:43 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:17:43.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:43 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-05-14T15:17:43.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:43 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]}]': finished 2024-05-14T15:17:43.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:43 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]': finished 2024-05-14T15:17:43.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:43 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 6]}]': finished 2024-05-14T15:17:43.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:43 smithi069 ceph-mon[31270]: osdmap e90: 12 total, 12 up, 12 in 2024-05-14T15:17:43.994 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:17:44.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:43 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2374176319' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-14T15:17:44.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:43 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:17:44.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:43 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-05-14T15:17:44.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:43 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]}]': finished 2024-05-14T15:17:44.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:43 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]': finished 2024-05-14T15:17:44.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:43 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 6]}]': finished 2024-05-14T15:17:44.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:43 smithi203 ceph-mon[34567]: osdmap e90: 12 total, 12 up, 12 in 2024-05-14T15:17:44.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:43 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2374176319' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-05-14T15:17:44.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:43 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:17:44.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:43 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.c", "id": [3, 9]}]': finished 2024-05-14T15:17:44.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:43 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.14", "id": [1, 9]}]': finished 2024-05-14T15:17:44.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:43 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.2a", "id": [3, 8]}]': finished 2024-05-14T15:17:44.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:43 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.38", "id": [5, 6]}]': finished 2024-05-14T15:17:44.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:43 smithi092 ceph-mon[34729]: osdmap e90: 12 total, 12 up, 12 in 2024-05-14T15:17:45.014 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:44 smithi069 ceph-mon[31270]: pgmap v441: 129 pgs: 2 peering, 127 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.8 KiB/s wr, 21 op/s 2024-05-14T15:17:45.015 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:44 smithi069 ceph-mon[31270]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-14T15:17:45.015 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:44 smithi069 ceph-mon[31270]: osdmap e91: 12 total, 12 up, 12 in 2024-05-14T15:17:45.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:44 smithi203 ceph-mon[34567]: pgmap v441: 129 pgs: 2 peering, 127 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.8 KiB/s wr, 21 op/s 2024-05-14T15:17:45.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:44 smithi203 ceph-mon[34567]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-14T15:17:45.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:44 smithi203 ceph-mon[34567]: osdmap e91: 12 total, 12 up, 12 in 2024-05-14T15:17:45.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:44 smithi092 ceph-mon[34729]: pgmap v441: 129 pgs: 2 peering, 127 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 4.8 KiB/s wr, 21 op/s 2024-05-14T15:17:45.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:44 smithi092 ceph-mon[34729]: Health check failed: Reduced data availability: 2 pgs peering (PG_AVAILABILITY) 2024-05-14T15:17:45.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:44 smithi092 ceph-mon[34729]: osdmap e91: 12 total, 12 up, 12 in 2024-05-14T15:17:46.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.287+0000 7f1ea9800700 1 -- 172.21.15.69:0/2873246306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ea4106580 msgr2=0x7f1ea4106990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:46.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.287+0000 7f1ea9800700 1 --2- 172.21.15.69:0/2873246306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ea4106580 0x7f1ea4106990 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f1e90009990 tx=0x7f1e90009ca0 comp rx=0 tx=0).stop 2024-05-14T15:17:46.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.287+0000 7f1ea9800700 1 -- 172.21.15.69:0/2873246306 shutdown_connections 2024-05-14T15:17:46.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.287+0000 7f1ea9800700 1 --2- 172.21.15.69:0/2873246306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea4106ed0 0x7f1ea4113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:46.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.287+0000 7f1ea9800700 1 --2- 172.21.15.69:0/2873246306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ea410c5c0 0x7f1ea410c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:46.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.287+0000 7f1ea9800700 1 --2- 172.21.15.69:0/2873246306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ea4106580 0x7f1ea4106990 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:46.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.287+0000 7f1ea9800700 1 -- 172.21.15.69:0/2873246306 >> 172.21.15.69:0/2873246306 conn(0x7f1ea4102080 msgr2=0x7f1ea41044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:46.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.288+0000 7f1ea9800700 1 -- 172.21.15.69:0/2873246306 shutdown_connections 2024-05-14T15:17:46.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.288+0000 7f1ea9800700 1 -- 172.21.15.69:0/2873246306 wait complete. 2024-05-14T15:17:46.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.289+0000 7f1ea9800700 1 Processor -- start 2024-05-14T15:17:46.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.289+0000 7f1ea9800700 1 -- start start 2024-05-14T15:17:46.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.289+0000 7f1ea9800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ea4106580 0x7f1ea419d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:46.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.289+0000 7f1ea9800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea4106ed0 0x7f1ea419d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:46.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.289+0000 7f1ea9800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ea410c5c0 0x7f1ea41a1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:46.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.289+0000 7f1ea9800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea41165a0 con 0x7f1ea4106580 2024-05-14T15:17:46.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.289+0000 7f1ea9800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea4116420 con 0x7f1ea4106ed0 2024-05-14T15:17:46.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.289+0000 7f1ea9800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1ea4116720 con 0x7f1ea410c5c0 2024-05-14T15:17:46.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.290+0000 7f1ea2a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ea4106580 0x7f1ea419d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:46.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.290+0000 7f1ea2a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ea4106580 0x7f1ea419d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57666/0 (socket says 172.21.15.69:57666) 2024-05-14T15:17:46.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.290+0000 7f1ea2a00700 1 -- 172.21.15.69:0/3272771671 learned_addr learned my addr 172.21.15.69:0/3272771671 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:17:46.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.290+0000 7f1ea2000700 1 --2- 172.21.15.69:0/3272771671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea4106ed0 0x7f1ea419d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:46.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.290+0000 7f1ea3400700 1 --2- 172.21.15.69:0/3272771671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ea410c5c0 0x7f1ea41a1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:46.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.290+0000 7f1ea2a00700 1 -- 172.21.15.69:0/3272771671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ea410c5c0 msgr2=0x7f1ea41a1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:46.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.290+0000 7f1ea2a00700 1 --2- 172.21.15.69:0/3272771671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ea410c5c0 0x7f1ea41a1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:46.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.290+0000 7f1ea2a00700 1 -- 172.21.15.69:0/3272771671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea4106ed0 msgr2=0x7f1ea419d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:46.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.290+0000 7f1ea2a00700 1 --2- 172.21.15.69:0/3272771671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea4106ed0 0x7f1ea419d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:46.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.290+0000 7f1ea2a00700 1 -- 172.21.15.69:0/3272771671 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ea41a1f20 con 0x7f1ea4106580 2024-05-14T15:17:46.291 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.291+0000 7f1ea2a00700 1 --2- 172.21.15.69:0/3272771671 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ea4106580 0x7f1ea419d050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400d980 tx=0x7f1e9400dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:46.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.291+0000 7f1e9b400700 1 -- 172.21.15.69:0/3272771671 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e94017070 con 0x7f1ea4106580 2024-05-14T15:17:46.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.291+0000 7f1e9b400700 1 -- 172.21.15.69:0/3272771671 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1e94010460 con 0x7f1ea4106580 2024-05-14T15:17:46.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.291+0000 7f1e9b400700 1 -- 172.21.15.69:0/3272771671 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e9400de60 con 0x7f1ea4106580 2024-05-14T15:17:46.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.291+0000 7f1ea9800700 1 -- 172.21.15.69:0/3272771671 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ea41a2210 con 0x7f1ea4106580 2024-05-14T15:17:46.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.291+0000 7f1ea9800700 1 -- 172.21.15.69:0/3272771671 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ea41a9b30 con 0x7f1ea4106580 2024-05-14T15:17:46.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.292+0000 7f1ea9800700 1 -- 172.21.15.69:0/3272771671 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ea4107ca0 con 0x7f1ea4106580 2024-05-14T15:17:46.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.295+0000 7f1e9b400700 1 -- 172.21.15.69:0/3272771671 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 16) ==== 149652+0+0 (secure 0 0 0) 0x7f1e94010610 con 0x7f1ea4106580 2024-05-14T15:17:46.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.296+0000 7f1e9b400700 1 --2- 172.21.15.69:0/3272771671 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1e880b2880 0x7f1e880b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:46.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.297+0000 7f1e9b400700 1 -- 172.21.15.69:0/3272771671 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f1e940e2120 con 0x7f1ea4106580 2024-05-14T15:17:46.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.297+0000 7f1ea2000700 1 --2- 172.21.15.69:0/3272771671 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1e880b2880 0x7f1e880b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:46.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.298+0000 7f1ea2000700 1 --2- 172.21.15.69:0/3272771671 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1e880b2880 0x7f1e880b4d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1e90000c00 tx=0x7f1e9000b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:46.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.301+0000 7f1e9b400700 1 -- 172.21.15.69:0/3272771671 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1e940a9a10 con 0x7f1ea4106580 2024-05-14T15:17:46.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.565+0000 7f1ea9800700 1 -- 172.21.15.69:0/3272771671 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f1ea4063c00 con 0x7f1e880b2880 2024-05-14T15:17:46.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.659+0000 7f1e9b400700 1 -- 172.21.15.69:0/3272771671 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1ea4063c00 con 0x7f1e880b2880 2024-05-14T15:17:46.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.662+0000 7f1ea9800700 1 -- 172.21.15.69:0/3272771671 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1e880b2880 msgr2=0x7f1e880b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.662+0000 7f1ea9800700 1 --2- 172.21.15.69:0/3272771671 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1e880b2880 0x7f1e880b4d90 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f1e90000c00 tx=0x7f1e9000b540 comp rx=0 tx=0).stop 2024-05-14T15:17:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.662+0000 7f1ea9800700 1 -- 172.21.15.69:0/3272771671 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ea4106580 msgr2=0x7f1ea419d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.662+0000 7f1ea9800700 1 --2- 172.21.15.69:0/3272771671 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ea4106580 0x7f1ea419d050 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1e9400d980 tx=0x7f1e9400dd40 comp rx=0 tx=0).stop 2024-05-14T15:17:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.663+0000 7f1ea9800700 1 -- 172.21.15.69:0/3272771671 shutdown_connections 2024-05-14T15:17:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.663+0000 7f1ea9800700 1 --2- 172.21.15.69:0/3272771671 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ea4106580 0x7f1ea419d050 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.663+0000 7f1ea9800700 1 --2- 172.21.15.69:0/3272771671 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1e880b2880 0x7f1e880b4d90 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.663+0000 7f1ea9800700 1 --2- 172.21.15.69:0/3272771671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ea410c5c0 0x7f1ea41a1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.663+0000 7f1ea9800700 1 --2- 172.21.15.69:0/3272771671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ea4106ed0 0x7f1ea419d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.663+0000 7f1ea9800700 1 -- 172.21.15.69:0/3272771671 >> 172.21.15.69:0/3272771671 conn(0x7f1ea4102080 msgr2=0x7f1ea41049f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.663+0000 7f1ea9800700 1 -- 172.21.15.69:0/3272771671 shutdown_connections 2024-05-14T15:17:46.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:46.663+0000 7f1ea9800700 1 -- 172.21.15.69:0/3272771671 wait complete. 2024-05-14T15:17:46.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:46 smithi069 ceph-mon[31270]: pgmap v443: 129 pgs: 1 activating, 2 peering, 126 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 KiB/s wr, 26 op/s 2024-05-14T15:17:46.972 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:17:46 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:17:46.576+0000 7f6598200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:17:46.972 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:17:46 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:17:46.576+0000 7f6598200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:17:46.972 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:17:46 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:17:46.576+0000 7f6598200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:17:46.972 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:17:46 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:17:46.576+0000 7f6598200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:17:46.972 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:17:46 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:17:46.576+0000 7f6598200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:17:47.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:46 smithi203 ceph-mon[34567]: pgmap v443: 129 pgs: 1 activating, 2 peering, 126 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 KiB/s wr, 26 op/s 2024-05-14T15:17:47.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:46 smithi092 ceph-mon[34729]: pgmap v443: 129 pgs: 1 activating, 2 peering, 126 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 5.0 KiB/s wr, 26 op/s 2024-05-14T15:17:47.495 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-05-14T15:17:47.940 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:17:48.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:47 smithi069 ceph-mon[31270]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:17:48.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:47 smithi203 ceph-mon[34567]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:17:48.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:47 smithi092 ceph-mon[34729]: from='client.14793 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:17:49.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:48 smithi203 ceph-mon[34567]: pgmap v444: 129 pgs: 1 activating, 2 peering, 126 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.4 KiB/s wr, 16 op/s 2024-05-14T15:17:49.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:48 smithi092 ceph-mon[34729]: pgmap v444: 129 pgs: 1 activating, 2 peering, 126 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.4 KiB/s wr, 16 op/s 2024-05-14T15:17:49.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:48 smithi069 ceph-mon[31270]: pgmap v444: 129 pgs: 1 activating, 2 peering, 126 active+clean; 587 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 2.4 KiB/s wr, 16 op/s 2024-05-14T15:17:49.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:49 smithi069 ceph-mon[31270]: mgrmap e17: x(active, since 12m), standbys: z, y 2024-05-14T15:17:50.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:49 smithi203 ceph-mon[34567]: mgrmap e17: x(active, since 12m), standbys: z, y 2024-05-14T15:17:50.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:49 smithi092 ceph-mon[34729]: mgrmap e17: x(active, since 12m), standbys: z, y 2024-05-14T15:17:50.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.238+0000 7f5fc6e00700 1 -- 172.21.15.69:0/2507956512 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0106570 msgr2=0x7f5fc0106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:50.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.238+0000 7f5fc6e00700 1 --2- 172.21.15.69:0/2507956512 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0106570 0x7f5fc0106980 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5fac009990 tx=0x7f5fac009ca0 comp rx=0 tx=0).stop 2024-05-14T15:17:50.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.238+0000 7f5fc6e00700 1 -- 172.21.15.69:0/2507956512 shutdown_connections 2024-05-14T15:17:50.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.238+0000 7f5fc6e00700 1 --2- 172.21.15.69:0/2507956512 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc0106ec0 0x7f5fc0113350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:50.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.238+0000 7f5fc6e00700 1 --2- 172.21.15.69:0/2507956512 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fc010c5b0 0x7f5fc010c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:50.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.238+0000 7f5fc6e00700 1 --2- 172.21.15.69:0/2507956512 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0106570 0x7f5fc0106980 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:50.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.238+0000 7f5fc6e00700 1 -- 172.21.15.69:0/2507956512 >> 172.21.15.69:0/2507956512 conn(0x7f5fc0102050 msgr2=0x7f5fc01044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:50.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.238+0000 7f5fc6e00700 1 -- 172.21.15.69:0/2507956512 shutdown_connections 2024-05-14T15:17:50.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.238+0000 7f5fc6e00700 1 -- 172.21.15.69:0/2507956512 wait complete. 2024-05-14T15:17:50.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.239+0000 7f5fc6e00700 1 Processor -- start 2024-05-14T15:17:50.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.240+0000 7f5fc6e00700 1 -- start start 2024-05-14T15:17:50.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.240+0000 7f5fc6e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0106570 0x7f5fc019cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:50.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.240+0000 7f5fc6e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc0106ec0 0x7f5fc019d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:50.240 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.240+0000 7f5fc6e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fc010c5b0 0x7f5fc01a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:50.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.240+0000 7f5fc6e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc0116540 con 0x7f5fc0106570 2024-05-14T15:17:50.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.240+0000 7f5fc6e00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc01163c0 con 0x7f5fc0106ec0 2024-05-14T15:17:50.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.240+0000 7f5fc6e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc01166c0 con 0x7f5fc010c5b0 2024-05-14T15:17:50.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.241+0000 7f5fbfe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0106570 0x7f5fc019cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:50.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.241+0000 7f5fbfe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0106570 0x7f5fc019cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57702/0 (socket says 172.21.15.69:57702) 2024-05-14T15:17:50.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.241+0000 7f5fbfe00700 1 -- 172.21.15.69:0/1599528493 learned_addr learned my addr 172.21.15.69:0/1599528493 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:17:50.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.241+0000 7f5fbf400700 1 --2- 172.21.15.69:0/1599528493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc0106ec0 0x7f5fc019d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:50.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.241+0000 7f5fbfe00700 1 -- 172.21.15.69:0/1599528493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fc010c5b0 msgr2=0x7f5fc01a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:50.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.241+0000 7f5fbfe00700 1 --2- 172.21.15.69:0/1599528493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fc010c5b0 0x7f5fc01a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:50.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.241+0000 7f5fbfe00700 1 -- 172.21.15.69:0/1599528493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc0106ec0 msgr2=0x7f5fc019d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:50.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.241+0000 7f5fbfe00700 1 --2- 172.21.15.69:0/1599528493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc0106ec0 0x7f5fc019d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:50.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.241+0000 7f5fbfe00700 1 -- 172.21.15.69:0/1599528493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc01a1d10 con 0x7f5fc0106570 2024-05-14T15:17:50.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.241+0000 7f5fbf400700 1 --2- 172.21.15.69:0/1599528493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc0106ec0 0x7f5fc019d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:17:50.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.242+0000 7f5fbfe00700 1 --2- 172.21.15.69:0/1599528493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0106570 0x7f5fc019cef0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000c9e0 tx=0x7f5fb000cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:50.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.242+0000 7f5fbcc00700 1 -- 172.21.15.69:0/1599528493 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0007aa0 con 0x7f5fc0106570 2024-05-14T15:17:50.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.242+0000 7f5fbcc00700 1 -- 172.21.15.69:0/1599528493 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5fb0007c40 con 0x7f5fc0106570 2024-05-14T15:17:50.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.242+0000 7f5fc6e00700 1 -- 172.21.15.69:0/1599528493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fc01a2000 con 0x7f5fc0106570 2024-05-14T15:17:50.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.242+0000 7f5fbcc00700 1 -- 172.21.15.69:0/1599528493 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0018660 con 0x7f5fc0106570 2024-05-14T15:17:50.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.242+0000 7f5fc6e00700 1 -- 172.21.15.69:0/1599528493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fc01a99d0 con 0x7f5fc0106570 2024-05-14T15:17:50.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.244+0000 7f5fc6e00700 1 -- 172.21.15.69:0/1599528493 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fc00512c0 con 0x7f5fc0106570 2024-05-14T15:17:50.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.248+0000 7f5fbcc00700 1 -- 172.21.15.69:0/1599528493 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f5fb0018800 con 0x7f5fc0106570 2024-05-14T15:17:50.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.249+0000 7f5fbcc00700 1 --2- 172.21.15.69:0/1599528493 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5fa40b2990 0x7f5fa40b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:50.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.249+0000 7f5fbcc00700 1 -- 172.21.15.69:0/1599528493 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f5fb00e2890 con 0x7f5fc0106570 2024-05-14T15:17:50.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.250+0000 7f5fbf400700 1 --2- 172.21.15.69:0/1599528493 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5fa40b2990 0x7f5fa40b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:50.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.250+0000 7f5fbf400700 1 --2- 172.21.15.69:0/1599528493 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5fa40b2990 0x7f5fa40b4ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0105510 tx=0x7f5fac00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:50.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.252+0000 7f5fbcc00700 1 -- 172.21.15.69:0/1599528493 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5fb0054df0 con 0x7f5fc0106570 2024-05-14T15:17:50.522 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.522+0000 7f5fc6e00700 1 -- 172.21.15.69:0/1599528493 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f5fc0063c00 con 0x7f5fa40b2990 2024-05-14T15:17:50.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.595+0000 7f5fbcc00700 1 -- 172.21.15.69:0/1599528493 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f5fc0063c00 con 0x7f5fa40b2990 2024-05-14T15:17:50.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.599+0000 7f5fc6e00700 1 -- 172.21.15.69:0/1599528493 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5fa40b2990 msgr2=0x7f5fa40b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:50.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.599+0000 7f5fc6e00700 1 --2- 172.21.15.69:0/1599528493 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5fa40b2990 0x7f5fa40b4ea0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5fc0105510 tx=0x7f5fac00b540 comp rx=0 tx=0).stop 2024-05-14T15:17:50.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.599+0000 7f5fc6e00700 1 -- 172.21.15.69:0/1599528493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0106570 msgr2=0x7f5fc019cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:50.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.599+0000 7f5fc6e00700 1 --2- 172.21.15.69:0/1599528493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0106570 0x7f5fc019cef0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f5fb000c9e0 tx=0x7f5fb000cda0 comp rx=0 tx=0).stop 2024-05-14T15:17:50.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.599+0000 7f5fc6e00700 1 -- 172.21.15.69:0/1599528493 shutdown_connections 2024-05-14T15:17:50.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.599+0000 7f5fc6e00700 1 --2- 172.21.15.69:0/1599528493 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5fc0106570 0x7f5fc019cef0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:50.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.599+0000 7f5fc6e00700 1 --2- 172.21.15.69:0/1599528493 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5fa40b2990 0x7f5fa40b4ea0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:50.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.599+0000 7f5fc6e00700 1 --2- 172.21.15.69:0/1599528493 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5fc010c5b0 0x7f5fc01a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:50.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.599+0000 7f5fc6e00700 1 --2- 172.21.15.69:0/1599528493 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5fc0106ec0 0x7f5fc019d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:50.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.599+0000 7f5fc6e00700 1 -- 172.21.15.69:0/1599528493 >> 172.21.15.69:0/1599528493 conn(0x7f5fc0102050 msgr2=0x7f5fc01035f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:50.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.599+0000 7f5fc6e00700 1 -- 172.21.15.69:0/1599528493 shutdown_connections 2024-05-14T15:17:50.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:50.599+0000 7f5fc6e00700 1 -- 172.21.15.69:0/1599528493 wait complete. 2024-05-14T15:17:51.064 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:50 smithi069 ceph-mon[31270]: pgmap v445: 129 pgs: 129 active+clean; 588 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-14T15:17:51.064 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:50 smithi069 ceph-mon[31270]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-14T15:17:51.064 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:50 smithi069 ceph-mon[31270]: Cluster is now healthy 2024-05-14T15:17:51.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:50 smithi203 ceph-mon[34567]: pgmap v445: 129 pgs: 129 active+clean; 588 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-14T15:17:51.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:50 smithi203 ceph-mon[34567]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-14T15:17:51.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:50 smithi203 ceph-mon[34567]: Cluster is now healthy 2024-05-14T15:17:51.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:50 smithi092 ceph-mon[34729]: pgmap v445: 129 pgs: 129 active+clean; 588 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-14T15:17:51.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:50 smithi092 ceph-mon[34729]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 2 pgs peering) 2024-05-14T15:17:51.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:50 smithi092 ceph-mon[34729]: Cluster is now healthy 2024-05-14T15:17:51.600 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-05-14T15:17:52.036 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:17:52.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:51 smithi203 ceph-mon[34567]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:17:52.181 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:51 smithi069 ceph-mon[31270]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:17:52.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:51 smithi092 ceph-mon[34729]: from='client.14805 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:17:53.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:52 smithi203 ceph-mon[34567]: pgmap v446: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2024-05-14T15:17:53.137 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:52 smithi069 ceph-mon[31270]: pgmap v446: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2024-05-14T15:17:53.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:52 smithi092 ceph-mon[34729]: pgmap v446: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.4 KiB/s rd, 3.2 KiB/s wr, 14 op/s 2024-05-14T15:17:54.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.561+0000 7f11c1400700 1 -- 172.21.15.69:0/2095903502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11bc110be0 msgr2=0x7f11bc113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:54.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.561+0000 7f11c1400700 1 --2- 172.21.15.69:0/2095903502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11bc110be0 0x7f11bc113000 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f11b400b0a0 tx=0x7f11b400b3b0 comp rx=0 tx=0).stop 2024-05-14T15:17:54.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.561+0000 7f11c1400700 1 -- 172.21.15.69:0/2095903502 shutdown_connections 2024-05-14T15:17:54.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.561+0000 7f11c1400700 1 --2- 172.21.15.69:0/2095903502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11bc110be0 0x7f11bc113000 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:54.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.561+0000 7f11c1400700 1 --2- 172.21.15.69:0/2095903502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11bc076c10 0x7f11bc077020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:54.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.561+0000 7f11c1400700 1 --2- 172.21.15.69:0/2095903502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11bc077560 0x7f11bc1106a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:54.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.561+0000 7f11c1400700 1 -- 172.21.15.69:0/2095903502 >> 172.21.15.69:0/2095903502 conn(0x7f11bc0ffea0 msgr2=0x7f11bc1022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:54.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.561+0000 7f11c1400700 1 -- 172.21.15.69:0/2095903502 shutdown_connections 2024-05-14T15:17:54.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.561+0000 7f11c1400700 1 -- 172.21.15.69:0/2095903502 wait complete. 2024-05-14T15:17:54.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.562+0000 7f11c1400700 1 Processor -- start 2024-05-14T15:17:54.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.563+0000 7f11c1400700 1 -- start start 2024-05-14T15:17:54.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.563+0000 7f11c1400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11bc076c10 0x7f11bc19d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:54.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.563+0000 7f11c1400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11bc077560 0x7f11bc19d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:54.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.563+0000 7f11c1400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11bc110be0 0x7f11bc1a1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:54.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.563+0000 7f11c1400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc116630 con 0x7f11bc077560 2024-05-14T15:17:54.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.563+0000 7f11c1400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc1164b0 con 0x7f11bc076c10 2024-05-14T15:17:54.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.563+0000 7f11c1400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc1167b0 con 0x7f11bc110be0 2024-05-14T15:17:54.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.563+0000 7f11b9e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11bc077560 0x7f11bc19d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:54.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.564+0000 7f11b9e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11bc077560 0x7f11bc19d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56150/0 (socket says 172.21.15.69:56150) 2024-05-14T15:17:54.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.564+0000 7f11b9e00700 1 -- 172.21.15.69:0/3021934318 learned_addr learned my addr 172.21.15.69:0/3021934318 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:17:54.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.564+0000 7f11ba800700 1 --2- 172.21.15.69:0/3021934318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11bc076c10 0x7f11bc19d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:54.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.564+0000 7f11bb200700 1 --2- 172.21.15.69:0/3021934318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11bc110be0 0x7f11bc1a1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:54.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.564+0000 7f11b9e00700 1 -- 172.21.15.69:0/3021934318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11bc110be0 msgr2=0x7f11bc1a1890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:54.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.564+0000 7f11b9e00700 1 --2- 172.21.15.69:0/3021934318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11bc110be0 0x7f11bc1a1890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:54.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.564+0000 7f11b9e00700 1 -- 172.21.15.69:0/3021934318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11bc076c10 msgr2=0x7f11bc19d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:54.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.564+0000 7f11b9e00700 1 --2- 172.21.15.69:0/3021934318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11bc076c10 0x7f11bc19d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:54.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.564+0000 7f11b9e00700 1 -- 172.21.15.69:0/3021934318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc1a1f30 con 0x7f11bc077560 2024-05-14T15:17:54.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.564+0000 7f11b9e00700 1 --2- 172.21.15.69:0/3021934318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11bc077560 0x7f11bc19d600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f11a800b500 tx=0x7f11a800b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:54.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.565+0000 7f11b3400700 1 -- 172.21.15.69:0/3021934318 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8015020 con 0x7f11bc077560 2024-05-14T15:17:54.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.565+0000 7f11b3400700 1 -- 172.21.15.69:0/3021934318 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11a8011cc0 con 0x7f11bc077560 2024-05-14T15:17:54.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.565+0000 7f11c1400700 1 -- 172.21.15.69:0/3021934318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11bc1a2220 con 0x7f11bc077560 2024-05-14T15:17:54.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.565+0000 7f11b3400700 1 -- 172.21.15.69:0/3021934318 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a8010c80 con 0x7f11bc077560 2024-05-14T15:17:54.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.565+0000 7f11c1400700 1 -- 172.21.15.69:0/3021934318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11bc1a9b40 con 0x7f11bc077560 2024-05-14T15:17:54.566 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.566+0000 7f11c1400700 1 -- 172.21.15.69:0/3021934318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11bc0512c0 con 0x7f11bc077560 2024-05-14T15:17:54.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.569+0000 7f11b3400700 1 -- 172.21.15.69:0/3021934318 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f11a8018020 con 0x7f11bc077560 2024-05-14T15:17:54.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.571+0000 7f11b3400700 1 --2- 172.21.15.69:0/3021934318 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11a00b2990 0x7f11a00b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:54.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.571+0000 7f11b3400700 1 -- 172.21.15.69:0/3021934318 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f11a80e2430 con 0x7f11bc077560 2024-05-14T15:17:54.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.571+0000 7f11ba800700 1 --2- 172.21.15.69:0/3021934318 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11a00b2990 0x7f11a00b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:54.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.572+0000 7f11ba800700 1 --2- 172.21.15.69:0/3021934318 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11a00b2990 0x7f11a00b4ea0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f11ac006fd0 tx=0x7f11ac008040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:54.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.573+0000 7f11b3400700 1 -- 172.21.15.69:0/3021934318 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f11a801f020 con 0x7f11bc077560 2024-05-14T15:17:54.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.827+0000 7f11c1400700 1 -- 172.21.15.69:0/3021934318 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f11bc19e3c0 con 0x7f11a00b2990 2024-05-14T15:17:54.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.842+0000 7f11b3400700 1 -- 172.21.15.69:0/3021934318 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f11bc19e3c0 con 0x7f11a00b2990 2024-05-14T15:17:54.842 INFO:teuthology.orchestra.run.smithi069.stdout:/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66 2024-05-14T15:17:54.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.845+0000 7f11c1400700 1 -- 172.21.15.69:0/3021934318 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11a00b2990 msgr2=0x7f11a00b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:54.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.845+0000 7f11c1400700 1 --2- 172.21.15.69:0/3021934318 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11a00b2990 0x7f11a00b4ea0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f11ac006fd0 tx=0x7f11ac008040 comp rx=0 tx=0).stop 2024-05-14T15:17:54.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.845+0000 7f11c1400700 1 -- 172.21.15.69:0/3021934318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11bc077560 msgr2=0x7f11bc19d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:54.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.845+0000 7f11c1400700 1 --2- 172.21.15.69:0/3021934318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11bc077560 0x7f11bc19d600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f11a800b500 tx=0x7f11a800b8c0 comp rx=0 tx=0).stop 2024-05-14T15:17:54.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.845+0000 7f11c1400700 1 -- 172.21.15.69:0/3021934318 shutdown_connections 2024-05-14T15:17:54.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.845+0000 7f11c1400700 1 --2- 172.21.15.69:0/3021934318 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11a00b2990 0x7f11a00b4ea0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:54.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.845+0000 7f11c1400700 1 --2- 172.21.15.69:0/3021934318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11bc110be0 0x7f11bc1a1890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:54.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.845+0000 7f11c1400700 1 --2- 172.21.15.69:0/3021934318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11bc076c10 0x7f11bc19d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:54.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.845+0000 7f11c1400700 1 --2- 172.21.15.69:0/3021934318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11bc077560 0x7f11bc19d600 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:54.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.845+0000 7f11c1400700 1 -- 172.21.15.69:0/3021934318 >> 172.21.15.69:0/3021934318 conn(0x7f11bc0ffea0 msgr2=0x7f11bc100590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:54.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.845+0000 7f11c1400700 1 -- 172.21.15.69:0/3021934318 shutdown_connections 2024-05-14T15:17:54.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:54.845+0000 7f11c1400700 1 -- 172.21.15.69:0/3021934318 wait complete. 2024-05-14T15:17:55.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:54 smithi203 ceph-mon[34567]: pgmap v447: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-05-14T15:17:55.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:54 smithi092 ceph-mon[34729]: pgmap v447: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-05-14T15:17:55.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:54 smithi069 ceph-mon[31270]: pgmap v447: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.1 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-05-14T15:17:55.797 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-05-14T15:17:56.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:55 smithi092 ceph-mon[34729]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:17:56.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:55 smithi069 ceph-mon[31270]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:17:56.258 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:17:56.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:55 smithi203 ceph-mon[34567]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:17:57.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:56 smithi092 ceph-mon[34729]: pgmap v448: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-05-14T15:17:57.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:56 smithi069 ceph-mon[31270]: pgmap v448: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-05-14T15:17:57.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:56 smithi203 ceph-mon[34567]: pgmap v448: 129 pgs: 129 active+clean; 608 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.0 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-05-14T15:17:58.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.582+0000 7f613f000700 1 -- 172.21.15.69:0/2377207611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6138075b60 msgr2=0x7f6138075f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:58.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.582+0000 7f613f000700 1 --2- 172.21.15.69:0/2377207611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6138075b60 0x7f6138075f70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f6128009990 tx=0x7f6128009ca0 comp rx=0 tx=0).stop 2024-05-14T15:17:58.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.583+0000 7f613f000700 1 -- 172.21.15.69:0/2377207611 shutdown_connections 2024-05-14T15:17:58.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.583+0000 7f613f000700 1 --2- 172.21.15.69:0/2377207611 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6138075b60 0x7f6138075f70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:58.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.583+0000 7f613f000700 1 --2- 172.21.15.69:0/2377207611 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6138115370 0x7f6138117790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:58.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.583+0000 7f613f000700 1 --2- 172.21.15.69:0/2377207611 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f61380764b0 0x7f6138114e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:58.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.583+0000 7f613f000700 1 -- 172.21.15.69:0/2377207611 >> 172.21.15.69:0/2377207611 conn(0x7f6138100040 msgr2=0x7f6138102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:58.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.583+0000 7f613f000700 1 -- 172.21.15.69:0/2377207611 shutdown_connections 2024-05-14T15:17:58.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.583+0000 7f613f000700 1 -- 172.21.15.69:0/2377207611 wait complete. 2024-05-14T15:17:58.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.584+0000 7f613f000700 1 Processor -- start 2024-05-14T15:17:58.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.584+0000 7f613f000700 1 -- start start 2024-05-14T15:17:58.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.585+0000 7f613f000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6138075b60 0x7f61381a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:58.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.585+0000 7f613f000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61380764b0 0x7f61381a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:58.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.585+0000 7f613f000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6138115370 0x7f61381a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:58.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.585+0000 7f613f000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f613811a950 con 0x7f61380764b0 2024-05-14T15:17:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.585+0000 7f613f000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f613811a7d0 con 0x7f6138115370 2024-05-14T15:17:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.585+0000 7f613f000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f613811aad0 con 0x7f6138075b60 2024-05-14T15:17:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.585+0000 7f6137400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61380764b0 0x7f61381a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.585+0000 7f6137400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61380764b0 0x7f61381a1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56162/0 (socket says 172.21.15.69:56162) 2024-05-14T15:17:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.585+0000 7f6137400700 1 -- 172.21.15.69:0/2840969629 learned_addr learned my addr 172.21.15.69:0/2840969629 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:17:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.585+0000 7f6137e00700 1 --2- 172.21.15.69:0/2840969629 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6138075b60 0x7f61381a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:58.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.586+0000 7f613d000700 1 --2- 172.21.15.69:0/2840969629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6138115370 0x7f61381a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:58.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.586+0000 7f6137400700 1 -- 172.21.15.69:0/2840969629 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6138075b60 msgr2=0x7f61381a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:58.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.586+0000 7f6137400700 1 --2- 172.21.15.69:0/2840969629 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6138075b60 0x7f61381a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:58.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.586+0000 7f6137400700 1 -- 172.21.15.69:0/2840969629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6138115370 msgr2=0x7f61381a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:58.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.586+0000 7f6137400700 1 --2- 172.21.15.69:0/2840969629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6138115370 0x7f61381a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:58.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.586+0000 7f6137400700 1 -- 172.21.15.69:0/2840969629 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61381a6250 con 0x7f61380764b0 2024-05-14T15:17:58.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.586+0000 7f613d000700 1 --2- 172.21.15.69:0/2840969629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6138115370 0x7f61381a5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:17:58.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.586+0000 7f6137400700 1 --2- 172.21.15.69:0/2840969629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61380764b0 0x7f61381a1920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f612400d980 tx=0x7f612400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:58.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.587+0000 7f6134c00700 1 -- 172.21.15.69:0/2840969629 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124017070 con 0x7f61380764b0 2024-05-14T15:17:58.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.587+0000 7f6134c00700 1 -- 172.21.15.69:0/2840969629 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6124005020 con 0x7f61380764b0 2024-05-14T15:17:58.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.587+0000 7f613f000700 1 -- 172.21.15.69:0/2840969629 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61381a6540 con 0x7f61380764b0 2024-05-14T15:17:58.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.587+0000 7f6134c00700 1 -- 172.21.15.69:0/2840969629 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6124009ab0 con 0x7f61380764b0 2024-05-14T15:17:58.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.587+0000 7f613f000700 1 -- 172.21.15.69:0/2840969629 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61381ade60 con 0x7f61380764b0 2024-05-14T15:17:58.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.588+0000 7f613f000700 1 -- 172.21.15.69:0/2840969629 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61380772a0 con 0x7f61380764b0 2024-05-14T15:17:58.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.591+0000 7f6134c00700 1 -- 172.21.15.69:0/2840969629 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f61240051d0 con 0x7f61380764b0 2024-05-14T15:17:58.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.594+0000 7f6134c00700 1 --2- 172.21.15.69:0/2840969629 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f611c0b2910 0x7f611c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:17:58.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.594+0000 7f6134c00700 1 -- 172.21.15.69:0/2840969629 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f61240e26b0 con 0x7f61380764b0 2024-05-14T15:17:58.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.594+0000 7f6137e00700 1 --2- 172.21.15.69:0/2840969629 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f611c0b2910 0x7f611c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:17:58.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.595+0000 7f6137e00700 1 --2- 172.21.15.69:0/2840969629 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f611c0b2910 0x7f611c0b4e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f612800b5c0 tx=0x7f6128005960 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:17:58.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.599+0000 7f6134c00700 1 -- 172.21.15.69:0/2840969629 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6124020020 con 0x7f61380764b0 2024-05-14T15:17:58.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.864+0000 7f613f000700 1 -- 172.21.15.69:0/2840969629 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f6138063c00 con 0x7f611c0b2910 2024-05-14T15:17:58.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.946+0000 7f6134c00700 1 -- 172.21.15.69:0/2840969629 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f6138063c00 con 0x7f611c0b2910 2024-05-14T15:17:58.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.948+0000 7f613f000700 1 -- 172.21.15.69:0/2840969629 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f611c0b2910 msgr2=0x7f611c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:58.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.948+0000 7f613f000700 1 --2- 172.21.15.69:0/2840969629 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f611c0b2910 0x7f611c0b4e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f612800b5c0 tx=0x7f6128005960 comp rx=0 tx=0).stop 2024-05-14T15:17:58.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.948+0000 7f613f000700 1 -- 172.21.15.69:0/2840969629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61380764b0 msgr2=0x7f61381a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:17:58.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.948+0000 7f613f000700 1 --2- 172.21.15.69:0/2840969629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61380764b0 0x7f61381a1920 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f612400d980 tx=0x7f612400dc90 comp rx=0 tx=0).stop 2024-05-14T15:17:58.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.949+0000 7f613f000700 1 -- 172.21.15.69:0/2840969629 shutdown_connections 2024-05-14T15:17:58.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.949+0000 7f613f000700 1 --2- 172.21.15.69:0/2840969629 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f611c0b2910 0x7f611c0b4e20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:58.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.949+0000 7f613f000700 1 --2- 172.21.15.69:0/2840969629 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6138115370 0x7f61381a5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:58.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.949+0000 7f613f000700 1 --2- 172.21.15.69:0/2840969629 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6138075b60 0x7f61381a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:58.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.949+0000 7f613f000700 1 --2- 172.21.15.69:0/2840969629 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f61380764b0 0x7f61381a1920 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:17:58.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.949+0000 7f613f000700 1 -- 172.21.15.69:0/2840969629 >> 172.21.15.69:0/2840969629 conn(0x7f6138100040 msgr2=0x7f61381006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:17:58.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.949+0000 7f613f000700 1 -- 172.21.15.69:0/2840969629 shutdown_connections 2024-05-14T15:17:58.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:17:58.949+0000 7f613f000700 1 -- 172.21.15.69:0/2840969629 wait complete. 2024-05-14T15:17:59.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:58 smithi092 ceph-mon[34729]: pgmap v449: 129 pgs: 129 active+clean; 614 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-05-14T15:17:59.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:58 smithi069 ceph-mon[31270]: pgmap v449: 129 pgs: 129 active+clean; 614 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-05-14T15:17:59.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:58 smithi203 ceph-mon[34567]: pgmap v449: 129 pgs: 129 active+clean; 614 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.0 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-05-14T15:17:59.897 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-05-14T15:18:00.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:17:59 smithi092 ceph-mon[34729]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:18:00.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:17:59 smithi069 ceph-mon[31270]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:18:00.343 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:00.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:17:59 smithi203 ceph-mon[34567]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:18:01.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:00 smithi092 ceph-mon[34729]: pgmap v450: 129 pgs: 129 active+clean; 614 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-05-14T15:18:01.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:00 smithi069 ceph-mon[31270]: pgmap v450: 129 pgs: 129 active+clean; 614 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-05-14T15:18:01.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:00 smithi203 ceph-mon[34567]: pgmap v450: 129 pgs: 129 active+clean; 614 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.2 KiB/s rd, 3.3 KiB/s wr, 12 op/s 2024-05-14T15:18:02.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.750+0000 7f04aa400700 1 -- 172.21.15.69:0/1744486102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04a4110c00 msgr2=0x7f04a4113020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:02.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.750+0000 7f04aa400700 1 --2- 172.21.15.69:0/1744486102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04a4110c00 0x7f04a4113020 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f049c009990 tx=0x7f049c009ca0 comp rx=0 tx=0).stop 2024-05-14T15:18:02.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.750+0000 7f04aa400700 1 -- 172.21.15.69:0/1744486102 shutdown_connections 2024-05-14T15:18:02.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.750+0000 7f04aa400700 1 --2- 172.21.15.69:0/1744486102 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04a4110c00 0x7f04a4113020 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:02.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.750+0000 7f04aa400700 1 --2- 172.21.15.69:0/1744486102 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04a4075b00 0x7f04a4075f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:02.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.750+0000 7f04aa400700 1 --2- 172.21.15.69:0/1744486102 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04a4076450 0x7f04a41106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:02.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.750+0000 7f04aa400700 1 -- 172.21.15.69:0/1744486102 >> 172.21.15.69:0/1744486102 conn(0x7f04a4100040 msgr2=0x7f04a4102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:02.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.750+0000 7f04aa400700 1 -- 172.21.15.69:0/1744486102 shutdown_connections 2024-05-14T15:18:02.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.750+0000 7f04aa400700 1 -- 172.21.15.69:0/1744486102 wait complete. 2024-05-14T15:18:02.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.751+0000 7f04aa400700 1 Processor -- start 2024-05-14T15:18:02.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.752+0000 7f04aa400700 1 -- start start 2024-05-14T15:18:02.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.752+0000 7f04aa400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04a4075b00 0x7f04a419cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:02.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.752+0000 7f04aa400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04a4076450 0x7f04a419d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:02.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.752+0000 7f04aa400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04a4110c00 0x7f04a41a1730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:02.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.752+0000 7f04aa400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f04a4116570 con 0x7f04a4076450 2024-05-14T15:18:02.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.752+0000 7f04aa400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f04a41163f0 con 0x7f04a4110c00 2024-05-14T15:18:02.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.752+0000 7f04aa400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f04a41166f0 con 0x7f04a4075b00 2024-05-14T15:18:02.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.752+0000 7f049aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04a4076450 0x7f04a419d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:02.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.753+0000 7f049aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04a4076450 0x7f04a419d4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56184/0 (socket says 172.21.15.69:56184) 2024-05-14T15:18:02.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.753+0000 7f049aa00700 1 -- 172.21.15.69:0/1359004257 learned_addr learned my addr 172.21.15.69:0/1359004257 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:02.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.753+0000 7f04a3400700 1 --2- 172.21.15.69:0/1359004257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04a4075b00 0x7f04a419cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:02.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.753+0000 7f04a3e00700 1 --2- 172.21.15.69:0/1359004257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04a4110c00 0x7f04a41a1730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:02.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.753+0000 7f049aa00700 1 -- 172.21.15.69:0/1359004257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04a4075b00 msgr2=0x7f04a419cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:02.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.753+0000 7f049aa00700 1 --2- 172.21.15.69:0/1359004257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04a4075b00 0x7f04a419cf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:02.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.753+0000 7f049aa00700 1 -- 172.21.15.69:0/1359004257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04a4110c00 msgr2=0x7f04a41a1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:02.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.753+0000 7f049aa00700 1 --2- 172.21.15.69:0/1359004257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04a4110c00 0x7f04a41a1730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:02.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.753+0000 7f049aa00700 1 -- 172.21.15.69:0/1359004257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04a41a1dd0 con 0x7f04a4076450 2024-05-14T15:18:02.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.753+0000 7f04a3400700 1 --2- 172.21.15.69:0/1359004257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04a4075b00 0x7f04a419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:18:02.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.753+0000 7f049aa00700 1 --2- 172.21.15.69:0/1359004257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04a4076450 0x7f04a419d4a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f048c00d980 tx=0x7f048c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:02.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.754+0000 7f04a0c00700 1 -- 172.21.15.69:0/1359004257 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c017070 con 0x7f04a4076450 2024-05-14T15:18:02.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.754+0000 7f04aa400700 1 -- 172.21.15.69:0/1359004257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04a41a20c0 con 0x7f04a4076450 2024-05-14T15:18:02.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.754+0000 7f04a0c00700 1 -- 172.21.15.69:0/1359004257 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f048c010460 con 0x7f04a4076450 2024-05-14T15:18:02.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.754+0000 7f04aa400700 1 -- 172.21.15.69:0/1359004257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04a41a99e0 con 0x7f04a4076450 2024-05-14T15:18:02.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.754+0000 7f04a0c00700 1 -- 172.21.15.69:0/1359004257 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048c020060 con 0x7f04a4076450 2024-05-14T15:18:02.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.755+0000 7f04aa400700 1 -- 172.21.15.69:0/1359004257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04a40512c0 con 0x7f04a4076450 2024-05-14T15:18:02.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.758+0000 7f04a0c00700 1 -- 172.21.15.69:0/1359004257 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f048c010610 con 0x7f04a4076450 2024-05-14T15:18:02.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.759+0000 7f04a0c00700 1 --2- 172.21.15.69:0/1359004257 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f04880b2910 0x7f04880b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:02.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.759+0000 7f04a0c00700 1 -- 172.21.15.69:0/1359004257 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f048c0e2880 con 0x7f04a4076450 2024-05-14T15:18:02.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.760+0000 7f04a3400700 1 --2- 172.21.15.69:0/1359004257 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f04880b2910 0x7f04880b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:02.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.760+0000 7f04a3400700 1 --2- 172.21.15.69:0/1359004257 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f04880b2910 0x7f04880b4e20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0494009dd0 tx=0x7f0494009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:02.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:02.762+0000 7f04a0c00700 1 -- 172.21.15.69:0/1359004257 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f048c0aa010 con 0x7f04a4076450 2024-05-14T15:18:03.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:03.033+0000 7f04aa400700 1 -- 172.21.15.69:0/1359004257 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f04a4063c00 con 0x7f04880b2910 2024-05-14T15:18:03.034 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:02 smithi069 ceph-mon[31270]: pgmap v451: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-05-14T15:18:03.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:03.047+0000 7f04a0c00700 1 -- 172.21.15.69:0/1359004257 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f04a4063c00 con 0x7f04880b2910 2024-05-14T15:18:03.047 INFO:teuthology.orchestra.run.smithi069.stdout:/volumes/qa/sv_1/477e1683-aa56-4507-b219-2efdf9bb8ab8 2024-05-14T15:18:03.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:03.050+0000 7f04aa400700 1 -- 172.21.15.69:0/1359004257 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f04880b2910 msgr2=0x7f04880b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:03.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:03.050+0000 7f04aa400700 1 --2- 172.21.15.69:0/1359004257 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f04880b2910 0x7f04880b4e20 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0494009dd0 tx=0x7f0494009040 comp rx=0 tx=0).stop 2024-05-14T15:18:03.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:03.050+0000 7f04aa400700 1 -- 172.21.15.69:0/1359004257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04a4076450 msgr2=0x7f04a419d4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:03.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:03.050+0000 7f04aa400700 1 --2- 172.21.15.69:0/1359004257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04a4076450 0x7f04a419d4a0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f048c00d980 tx=0x7f048c00dd40 comp rx=0 tx=0).stop 2024-05-14T15:18:03.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:03.050+0000 7f04aa400700 1 -- 172.21.15.69:0/1359004257 shutdown_connections 2024-05-14T15:18:03.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:03.050+0000 7f04aa400700 1 --2- 172.21.15.69:0/1359004257 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f04880b2910 0x7f04880b4e20 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:03.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:03.050+0000 7f04aa400700 1 --2- 172.21.15.69:0/1359004257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04a4110c00 0x7f04a41a1730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:03.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:03.050+0000 7f04aa400700 1 --2- 172.21.15.69:0/1359004257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04a4075b00 0x7f04a419cf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:03.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:03.050+0000 7f04aa400700 1 --2- 172.21.15.69:0/1359004257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04a4076450 0x7f04a419d4a0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:03.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:03.050+0000 7f04aa400700 1 -- 172.21.15.69:0/1359004257 >> 172.21.15.69:0/1359004257 conn(0x7f04a4100040 msgr2=0x7f04a4100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:03.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:03.051+0000 7f04aa400700 1 -- 172.21.15.69:0/1359004257 shutdown_connections 2024-05-14T15:18:03.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:03.051+0000 7f04aa400700 1 -- 172.21.15.69:0/1359004257 wait complete. 2024-05-14T15:18:03.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:02 smithi092 ceph-mon[34729]: pgmap v451: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-05-14T15:18:03.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:02 smithi203 ceph-mon[34567]: pgmap v451: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 9.7 KiB/s rd, 4.7 KiB/s wr, 13 op/s 2024-05-14T15:18:03.894 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:18:04.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:03 smithi092 ceph-mon[34729]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:18:04.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:03 smithi069 ceph-mon[31270]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:18:04.332 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:04.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:03 smithi203 ceph-mon[34567]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:18:05.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:04 smithi092 ceph-mon[34729]: pgmap v452: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-05-14T15:18:05.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:04 smithi069 ceph-mon[31270]: pgmap v452: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-05-14T15:18:05.245 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:04 smithi203 ceph-mon[34567]: pgmap v452: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 2.6 KiB/s wr, 10 op/s 2024-05-14T15:18:06.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.683+0000 7f35a2c00700 1 -- 172.21.15.69:0/4095641121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f359c10a960 msgr2=0x7f359c10ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:06.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.683+0000 7f35a2c00700 1 --2- 172.21.15.69:0/4095641121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f359c10a960 0x7f359c10ad70 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3588009990 tx=0x7f3588009ca0 comp rx=0 tx=0).stop 2024-05-14T15:18:06.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.683+0000 7f35a2c00700 1 -- 172.21.15.69:0/4095641121 shutdown_connections 2024-05-14T15:18:06.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.683+0000 7f35a2c00700 1 --2- 172.21.15.69:0/4095641121 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f359c10b2b0 0x7f359c117830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:06.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.683+0000 7f35a2c00700 1 --2- 172.21.15.69:0/4095641121 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f359c110990 0x7f359c110da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:06.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.683+0000 7f35a2c00700 1 --2- 172.21.15.69:0/4095641121 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f359c10a960 0x7f359c10ad70 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:06.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.683+0000 7f35a2c00700 1 -- 172.21.15.69:0/4095641121 >> 172.21.15.69:0/4095641121 conn(0x7f359c076d30 msgr2=0x7f359c077140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:06.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.683+0000 7f35a2c00700 1 -- 172.21.15.69:0/4095641121 shutdown_connections 2024-05-14T15:18:06.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.683+0000 7f35a2c00700 1 -- 172.21.15.69:0/4095641121 wait complete. 2024-05-14T15:18:06.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.684+0000 7f35a2c00700 1 Processor -- start 2024-05-14T15:18:06.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.684+0000 7f35a2c00700 1 -- start start 2024-05-14T15:18:06.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.685+0000 7f35a2c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f359c10a960 0x7f359c1a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:06.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.685+0000 7f35a2c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f359c10b2b0 0x7f359c1a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:06.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.685+0000 7f35a2c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f359c110990 0x7f359c1a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:06.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.685+0000 7f35a2c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f359c11a960 con 0x7f359c110990 2024-05-14T15:18:06.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.685+0000 7f35a2c00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f359c11a7e0 con 0x7f359c10a960 2024-05-14T15:18:06.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.685+0000 7f35a2c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f359c11aae0 con 0x7f359c10b2b0 2024-05-14T15:18:06.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.685+0000 7f35a0c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f359c110990 0x7f359c1a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:06.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.685+0000 7f35a0c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f359c110990 0x7f359c1a5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56434/0 (socket says 172.21.15.69:56434) 2024-05-14T15:18:06.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.685+0000 7f35a0c00700 1 -- 172.21.15.69:0/1730894977 learned_addr learned my addr 172.21.15.69:0/1730894977 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:06.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.685+0000 7f359be00700 1 --2- 172.21.15.69:0/1730894977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f359c10a960 0x7f359c1a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:06.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.685+0000 7f359b400700 1 --2- 172.21.15.69:0/1730894977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f359c10b2b0 0x7f359c1a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.686+0000 7f35a0c00700 1 -- 172.21.15.69:0/1730894977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f359c10b2b0 msgr2=0x7f359c1a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.686+0000 7f35a0c00700 1 --2- 172.21.15.69:0/1730894977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f359c10b2b0 0x7f359c1a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.686+0000 7f35a0c00700 1 -- 172.21.15.69:0/1730894977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f359c10a960 msgr2=0x7f359c1a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.686+0000 7f35a0c00700 1 --2- 172.21.15.69:0/1730894977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f359c10a960 0x7f359c1a1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.686+0000 7f35a0c00700 1 -- 172.21.15.69:0/1730894977 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359c1a61b0 con 0x7f359c110990 2024-05-14T15:18:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.686+0000 7f35a0c00700 1 --2- 172.21.15.69:0/1730894977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f359c110990 0x7f359c1a5bc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f359400ada0 tx=0x7f359400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.686+0000 7f3598c00700 1 -- 172.21.15.69:0/1730894977 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594017020 con 0x7f359c110990 2024-05-14T15:18:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.686+0000 7f3598c00700 1 -- 172.21.15.69:0/1730894977 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f359400cd60 con 0x7f359c110990 2024-05-14T15:18:06.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.686+0000 7f35a2c00700 1 -- 172.21.15.69:0/1730894977 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f359c1a64a0 con 0x7f359c110990 2024-05-14T15:18:06.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.686+0000 7f3598c00700 1 -- 172.21.15.69:0/1730894977 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3594005280 con 0x7f359c110990 2024-05-14T15:18:06.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.687+0000 7f35a2c00700 1 -- 172.21.15.69:0/1730894977 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f359c1a69b0 con 0x7f359c110990 2024-05-14T15:18:06.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.688+0000 7f35a2c00700 1 -- 172.21.15.69:0/1730894977 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f359c0512c0 con 0x7f359c110990 2024-05-14T15:18:06.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.690+0000 7f3598c00700 1 -- 172.21.15.69:0/1730894977 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f359400c8d0 con 0x7f359c110990 2024-05-14T15:18:06.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.692+0000 7f3598c00700 1 --2- 172.21.15.69:0/1730894977 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f35800b2990 0x7f35800b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:06.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.692+0000 7f3598c00700 1 -- 172.21.15.69:0/1730894977 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f35940e24d0 con 0x7f359c110990 2024-05-14T15:18:06.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.692+0000 7f359be00700 1 --2- 172.21.15.69:0/1730894977 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f35800b2990 0x7f35800b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:06.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.693+0000 7f359be00700 1 --2- 172.21.15.69:0/1730894977 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f35800b2990 0x7f35800b4ea0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f359c10baa0 tx=0x7f358c00a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:06.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.695+0000 7f3598c00700 1 -- 172.21.15.69:0/1730894977 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3594021020 con 0x7f359c110990 2024-05-14T15:18:06.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:06 smithi069 ceph-mon[31270]: pgmap v453: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-05-14T15:18:06.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.982+0000 7f35a2c00700 1 -- 172.21.15.69:0/1730894977 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f359c02e5f0 con 0x7f359c110990 2024-05-14T15:18:06.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.983+0000 7f3598c00700 1 -- 172.21.15.69:0/1730894977 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11932 (secure 0 0 0) 0x7f35940a9cf0 con 0x7f359c110990 2024-05-14T15:18:06.982 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:18:06.982 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T15:16:11.716543+0000","modified":"2024-05-14T15:17:42.234289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34490,"mds_1":34460,"mds_2":34433,"mds_3":34409,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":31,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":35,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34490":{"gid":34490,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34490,"qdb_cluster":[24451,34433,34409,34460,34490]},"id":1}]} 2024-05-14T15:18:06.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.986+0000 7f35a2c00700 1 -- 172.21.15.69:0/1730894977 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f35800b2990 msgr2=0x7f35800b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:06.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.986+0000 7f35a2c00700 1 --2- 172.21.15.69:0/1730894977 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f35800b2990 0x7f35800b4ea0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f359c10baa0 tx=0x7f358c00a380 comp rx=0 tx=0).stop 2024-05-14T15:18:06.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.986+0000 7f35a2c00700 1 -- 172.21.15.69:0/1730894977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f359c110990 msgr2=0x7f359c1a5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:06.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.986+0000 7f35a2c00700 1 --2- 172.21.15.69:0/1730894977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f359c110990 0x7f359c1a5bc0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f359400ada0 tx=0x7f359400c330 comp rx=0 tx=0).stop 2024-05-14T15:18:06.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.987+0000 7f35a2c00700 1 -- 172.21.15.69:0/1730894977 shutdown_connections 2024-05-14T15:18:06.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.987+0000 7f35a2c00700 1 --2- 172.21.15.69:0/1730894977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f359c110990 0x7f359c1a5bc0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:06.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.987+0000 7f35a2c00700 1 --2- 172.21.15.69:0/1730894977 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f35800b2990 0x7f35800b4ea0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:06.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.987+0000 7f35a2c00700 1 --2- 172.21.15.69:0/1730894977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f359c10a960 0x7f359c1a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:06.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.987+0000 7f35a2c00700 1 --2- 172.21.15.69:0/1730894977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f359c10b2b0 0x7f359c1a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:06.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.987+0000 7f35a2c00700 1 -- 172.21.15.69:0/1730894977 >> 172.21.15.69:0/1730894977 conn(0x7f359c076d30 msgr2=0x7f359c108940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:06.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.987+0000 7f35a2c00700 1 -- 172.21.15.69:0/1730894977 shutdown_connections 2024-05-14T15:18:06.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:06.987+0000 7f35a2c00700 1 -- 172.21.15.69:0/1730894977 wait complete. 2024-05-14T15:18:06.988 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 29 2024-05-14T15:18:07.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:06 smithi092 ceph-mon[34729]: pgmap v453: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-05-14T15:18:07.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:06 smithi203 ceph-mon[34567]: pgmap v453: 129 pgs: 129 active+clean; 632 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 2.7 KiB/s wr, 12 op/s 2024-05-14T15:18:07.953 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T15:18:08.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:07 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1730894977' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:18:08.221 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:07 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1730894977' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:18:08.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:07 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1730894977' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:18:08.390 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:09.060 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:08 smithi069 ceph-mon[31270]: pgmap v454: 129 pgs: 129 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-05-14T15:18:09.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:08 smithi092 ceph-mon[34729]: pgmap v454: 129 pgs: 129 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-05-14T15:18:09.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:08 smithi203 ceph-mon[34567]: pgmap v454: 129 pgs: 129 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 9.3 KiB/s rd, 3.3 KiB/s wr, 11 op/s 2024-05-14T15:18:10.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.704+0000 7f4e18a00700 1 -- 172.21.15.69:0/2017520597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e14077790 msgr2=0x7f4e14110640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:10.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.704+0000 7f4e18a00700 1 --2- 172.21.15.69:0/2017520597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e14077790 0x7f4e14110640 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4e00009990 tx=0x7f4e00009ca0 comp rx=0 tx=0).stop 2024-05-14T15:18:10.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.704+0000 7f4e18a00700 1 -- 172.21.15.69:0/2017520597 shutdown_connections 2024-05-14T15:18:10.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.704+0000 7f4e18a00700 1 --2- 172.21.15.69:0/2017520597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e14110b80 0x7f4e14112fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:10.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.704+0000 7f4e18a00700 1 --2- 172.21.15.69:0/2017520597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e14076e40 0x7f4e14077250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:10.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.704+0000 7f4e18a00700 1 --2- 172.21.15.69:0/2017520597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e14077790 0x7f4e14110640 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:10.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.704+0000 7f4e18a00700 1 -- 172.21.15.69:0/2017520597 >> 172.21.15.69:0/2017520597 conn(0x7f4e140ffea0 msgr2=0x7f4e141022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:10.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.704+0000 7f4e18a00700 1 -- 172.21.15.69:0/2017520597 shutdown_connections 2024-05-14T15:18:10.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.704+0000 7f4e18a00700 1 -- 172.21.15.69:0/2017520597 wait complete. 2024-05-14T15:18:10.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.705+0000 7f4e18a00700 1 Processor -- start 2024-05-14T15:18:10.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.705+0000 7f4e18a00700 1 -- start start 2024-05-14T15:18:10.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.706+0000 7f4e18a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e14076e40 0x7f4e141042a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:10.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.706+0000 7f4e18a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e14077790 0x7f4e141047e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:10.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.706+0000 7f4e18a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e14110b80 0x7f4e14104d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:10.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.706+0000 7f4e18a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4e14116580 con 0x7f4e14076e40 2024-05-14T15:18:10.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.706+0000 7f4e18a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4e14116400 con 0x7f4e14110b80 2024-05-14T15:18:10.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.706+0000 7f4e18a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4e14116700 con 0x7f4e14077790 2024-05-14T15:18:10.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.706+0000 7f4e11e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e14076e40 0x7f4e141042a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:10.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.706+0000 7f4e11e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e14076e40 0x7f4e141042a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56448/0 (socket says 172.21.15.69:56448) 2024-05-14T15:18:10.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.706+0000 7f4e11e00700 1 -- 172.21.15.69:0/376341285 learned_addr learned my addr 172.21.15.69:0/376341285 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:10.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.706+0000 7f4e12800700 1 --2- 172.21.15.69:0/376341285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e14110b80 0x7f4e14104d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:10.706 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.706+0000 7f4e11400700 1 --2- 172.21.15.69:0/376341285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e14077790 0x7f4e141047e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:10.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.707+0000 7f4e11e00700 1 -- 172.21.15.69:0/376341285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e14077790 msgr2=0x7f4e141047e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:10.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.707+0000 7f4e11e00700 1 --2- 172.21.15.69:0/376341285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e14077790 0x7f4e141047e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:10.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.707+0000 7f4e11e00700 1 -- 172.21.15.69:0/376341285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e14110b80 msgr2=0x7f4e14104d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:10.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.707+0000 7f4e11e00700 1 --2- 172.21.15.69:0/376341285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e14110b80 0x7f4e14104d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:10.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.707+0000 7f4e11e00700 1 -- 172.21.15.69:0/376341285 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e141ad590 con 0x7f4e14076e40 2024-05-14T15:18:10.707 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.707+0000 7f4e12800700 1 --2- 172.21.15.69:0/376341285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e14110b80 0x7f4e14104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:18:10.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.707+0000 7f4e11e00700 1 --2- 172.21.15.69:0/376341285 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e14076e40 0x7f4e141042a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400c920 tx=0x7f4e0400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:10.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.707+0000 7f4e0aa00700 1 -- 172.21.15.69:0/376341285 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e04007b00 con 0x7f4e14076e40 2024-05-14T15:18:10.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.707+0000 7f4e0aa00700 1 -- 172.21.15.69:0/376341285 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e04004cc0 con 0x7f4e14076e40 2024-05-14T15:18:10.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.707+0000 7f4e18a00700 1 -- 172.21.15.69:0/376341285 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e141ad7c0 con 0x7f4e14076e40 2024-05-14T15:18:10.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.707+0000 7f4e0aa00700 1 -- 172.21.15.69:0/376341285 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e040054f0 con 0x7f4e14076e40 2024-05-14T15:18:10.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.708+0000 7f4e18a00700 1 -- 172.21.15.69:0/376341285 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e141adcd0 con 0x7f4e14076e40 2024-05-14T15:18:10.708 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.709+0000 7f4e18a00700 1 -- 172.21.15.69:0/376341285 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e140783b0 con 0x7f4e14076e40 2024-05-14T15:18:10.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.711+0000 7f4e0aa00700 1 -- 172.21.15.69:0/376341285 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f4e04007ca0 con 0x7f4e14076e40 2024-05-14T15:18:10.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.713+0000 7f4e0aa00700 1 --2- 172.21.15.69:0/376341285 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4df80b2910 0x7f4df80b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:10.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.713+0000 7f4e0aa00700 1 -- 172.21.15.69:0/376341285 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f4e040e2410 con 0x7f4e14076e40 2024-05-14T15:18:10.712 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.713+0000 7f4e11400700 1 --2- 172.21.15.69:0/376341285 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4df80b2910 0x7f4df80b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:10.713 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.714+0000 7f4e11400700 1 --2- 172.21.15.69:0/376341285 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4df80b2910 0x7f4df80b4e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000b5c0 tx=0x7f4e00005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:10.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.718+0000 7f4e0aa00700 1 -- 172.21.15.69:0/376341285 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4e04014030 con 0x7f4e14076e40 2024-05-14T15:18:10.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.955+0000 7f4e18a00700 1 -- 172.21.15.69:0/376341285 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e1402e5f0 con 0x7f4e14076e40 2024-05-14T15:18:10.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.957+0000 7f4e0aa00700 1 -- 172.21.15.69:0/376341285 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24861 (secure 0 0 0) 0x7f4e040a9ba0 con 0x7f4e14076e40 2024-05-14T15:18:10.957 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:18:10.957 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":91,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","created":"2024-05-14T15:04:32.074994+0000","modified":"2024-05-14T15:17:43.708185+0000","last_up_change":"2024-05-14T15:14:44.049523+0000","last_in_change":"2024-05-14T15:14:16.752653+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:09:03.561841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:16:02.641690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:16:06.949687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:16:20.891122+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8640de99-c23a-494e-a100-aafd04fe1867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6803","nonce":301095601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6805","nonce":301095601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6809","nonce":301095601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6807","nonce":301095601}]},"public_addr":"172.21.15.69:6803/301095601","cluster_addr":"172.21.15.69:6805/301095601","heartbeat_back_addr":"172.21.15.69:6809/301095601","heartbeat_front_addr":"172.21.15.69:6807/301095601","state":["exists","up"]},{"osd":1,"uuid":"89f78a32-7afb-49f3-9287-5478a1cc8829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6801","nonce":2774122776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6803","nonce":2774122776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6807","nonce":2774122776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6805","nonce":2774122776}]},"public_addr":"172.21.15.92:6801/2774122776","cluster_addr":"172.21.15.92:6803/2774122776","heartbeat_back_addr":"172.21.15.92:6807/2774122776","heartbeat_front_addr":"172.21.15.92:6805/2774122776","state":["exists","up"]},{"osd":2,"uuid":"a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6801","nonce":2836920513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6803","nonce":2836920513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6807","nonce":2836920513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6805","nonce":2836920513}]},"public_addr":"172.21.15.203:6801/2836920513","cluster_addr":"172.21.15.203:6803/2836920513","heartbeat_back_addr":"172.21.15.203:6807/2836920513","heartbeat_front_addr":"172.21.15.203:6805/2836920513","state":["exists","up"]},{"osd":3,"uuid":"81409850-de26-4520-972c-31a716adf4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6811","nonce":680308620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6813","nonce":680308620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6817","nonce":680308620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6815","nonce":680308620}]},"public_addr":"172.21.15.69:6811/680308620","cluster_addr":"172.21.15.69:6813/680308620","heartbeat_back_addr":"172.21.15.69:6817/680308620","heartbeat_front_addr":"172.21.15.69:6815/680308620","state":["exists","up"]},{"osd":4,"uuid":"9aa3a6b0-cc63-4eae-8416-8ab630994985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6809","nonce":1071971048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6811","nonce":1071971048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6815","nonce":1071971048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6813","nonce":1071971048}]},"public_addr":"172.21.15.92:6809/1071971048","cluster_addr":"172.21.15.92:6811/1071971048","heartbeat_back_addr":"172.21.15.92:6815/1071971048","heartbeat_front_addr":"172.21.15.92:6813/1071971048","state":["exists","up"]},{"osd":5,"uuid":"f7fcde57-e280-494b-a45f-8fa007ed9ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6809","nonce":1404230851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6811","nonce":1404230851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6815","nonce":1404230851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6813","nonce":1404230851}]},"public_addr":"172.21.15.203:6809/1404230851","cluster_addr":"172.21.15.203:6811/1404230851","heartbeat_back_addr":"172.21.15.203:6815/1404230851","heartbeat_front_addr":"172.21.15.203:6813/1404230851","state":["exists","up"]},{"osd":6,"uuid":"86f1373a-3b39-4a7f-b14c-9bf8695c6b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6819","nonce":1213427819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6821","nonce":1213427819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6825","nonce":1213427819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6823","nonce":1213427819}]},"public_addr":"172.21.15.69:6819/1213427819","cluster_addr":"172.21.15.69:6821/1213427819","heartbeat_back_addr":"172.21.15.69:6825/1213427819","heartbeat_front_addr":"172.21.15.69:6823/1213427819","state":["exists","up"]},{"osd":7,"uuid":"e790fbf1-3e34-4950-bdfa-cf1adbd451c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6817","nonce":4274774582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6819","nonce":4274774582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6823","nonce":4274774582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6821","nonce":4274774582}]},"public_addr":"172.21.15.92:6817/4274774582","cluster_addr":"172.21.15.92:6819/4274774582","heartbeat_back_addr":"172.21.15.92:6823/4274774582","heartbeat_front_addr":"172.21.15.92:6821/4274774582","state":["exists","up"]},{"osd":8,"uuid":"65019fee-6b18-4d13-841a-2e3acb51f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6817","nonce":2480959249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6819","nonce":2480959249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6823","nonce":2480959249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6821","nonce":2480959249}]},"public_addr":"172.21.15.203:6817/2480959249","cluster_addr":"172.21.15.203:6819/2480959249","heartbeat_back_addr":"172.21.15.203:6823/2480959249","heartbeat_front_addr":"172.21.15.203:6821/2480959249","state":["exists","up"]},{"osd":9,"uuid":"b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6827","nonce":2649966866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6829","nonce":2649966866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6833","nonce":2649966866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6831","nonce":2649966866}]},"public_addr":"172.21.15.69:6827/2649966866","cluster_addr":"172.21.15.69:6829/2649966866","heartbeat_back_addr":"172.21.15.69:6833/2649966866","heartbeat_front_addr":"172.21.15.69:6831/2649966866","state":["exists","up"]},{"osd":10,"uuid":"45287823-f7ea-431f-ac01-a72762b01a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6825","nonce":3650822776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6827","nonce":3650822776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6831","nonce":3650822776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6829","nonce":3650822776}]},"public_addr":"172.21.15.92:6825/3650822776","cluster_addr":"172.21.15.92:6827/3650822776","heartbeat_back_addr":"172.21.15.92:6831/3650822776","heartbeat_front_addr":"172.21.15.92:6829/3650822776","state":["exists","up"]},{"osd":11,"uuid":"2f3a10f9-2414-4151-b1cf-3db68b2a66fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6825","nonce":2590258806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6827","nonce":2590258806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6831","nonce":2590258806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6829","nonce":2590258806}]},"public_addr":"172.21.15.203:6825/2590258806","cluster_addr":"172.21.15.203:6827/2590258806","heartbeat_back_addr":"172.21.15.203:6831/2590258806","heartbeat_front_addr":"172.21.15.203:6829/2590258806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:07:50.047712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:08:25.223293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:01.269713+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:38.679607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:16.161314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:53.323450+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:11:31.930106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:10.173015+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:48.056752+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:13:25.780142+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:03.705208+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:41.267371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":5,"to":6}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/151981233":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/3776172313":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/1288620257":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/2718114316":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/1655882616":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/4183332474":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/2806878946":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/2718114316":"2024-05-15T15:05:41.383453+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:18:10.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.961+0000 7f4e18a00700 1 -- 172.21.15.69:0/376341285 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4df80b2910 msgr2=0x7f4df80b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:10.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.961+0000 7f4e18a00700 1 --2- 172.21.15.69:0/376341285 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4df80b2910 0x7f4df80b4e20 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f4e0000b5c0 tx=0x7f4e00005fb0 comp rx=0 tx=0).stop 2024-05-14T15:18:10.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.961+0000 7f4e18a00700 1 -- 172.21.15.69:0/376341285 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e14076e40 msgr2=0x7f4e141042a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:10.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.961+0000 7f4e18a00700 1 --2- 172.21.15.69:0/376341285 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e14076e40 0x7f4e141042a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4e0400c920 tx=0x7f4e0400cce0 comp rx=0 tx=0).stop 2024-05-14T15:18:10.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.961+0000 7f4e18a00700 1 -- 172.21.15.69:0/376341285 shutdown_connections 2024-05-14T15:18:10.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.961+0000 7f4e18a00700 1 --2- 172.21.15.69:0/376341285 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e14076e40 0x7f4e141042a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:10.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.961+0000 7f4e18a00700 1 --2- 172.21.15.69:0/376341285 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4df80b2910 0x7f4df80b4e20 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:10.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.961+0000 7f4e18a00700 1 --2- 172.21.15.69:0/376341285 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e14110b80 0x7f4e14104d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:10.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.961+0000 7f4e18a00700 1 --2- 172.21.15.69:0/376341285 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e14077790 0x7f4e141047e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:10.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.961+0000 7f4e18a00700 1 -- 172.21.15.69:0/376341285 >> 172.21.15.69:0/376341285 conn(0x7f4e140ffea0 msgr2=0x7f4e141005f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:10.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.961+0000 7f4e18a00700 1 -- 172.21.15.69:0/376341285 shutdown_connections 2024-05-14T15:18:10.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:10.961+0000 7f4e18a00700 1 -- 172.21.15.69:0/376341285 wait complete. 2024-05-14T15:18:10.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:10 smithi069 ceph-mon[31270]: pgmap v455: 129 pgs: 129 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-14T15:18:11.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:10 smithi092 ceph-mon[34729]: pgmap v455: 129 pgs: 129 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-14T15:18:11.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:10 smithi203 ceph-mon[34567]: pgmap v455: 129 pgs: 129 active+clean; 640 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.8 KiB/s rd, 2.7 KiB/s wr, 11 op/s 2024-05-14T15:18:11.862 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-14T15:18:11.862 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-14T15:18:12.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:11 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/376341285' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:18:12.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:11 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/376341285' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:18:12.314 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:12.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:11 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/376341285' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:18:13.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:12 smithi092 ceph-mon[34729]: pgmap v456: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-05-14T15:18:13.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:12 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:18:13.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:12 smithi069 ceph-mon[31270]: pgmap v456: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-05-14T15:18:13.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:12 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:18:13.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:12 smithi203 ceph-mon[34567]: pgmap v456: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 8.5 KiB/s rd, 3.2 KiB/s wr, 12 op/s 2024-05-14T15:18:13.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:12 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:18:14.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.921+0000 7f903ec00700 1 -- 172.21.15.69:0/2128512533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9038109300 msgr2=0x7f9038109710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:14.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.921+0000 7f903ec00700 1 --2- 172.21.15.69:0/2128512533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9038109300 0x7f9038109710 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f902800b0a0 tx=0x7f902800b3b0 comp rx=0 tx=0).stop 2024-05-14T15:18:14.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.921+0000 7f903ec00700 1 -- 172.21.15.69:0/2128512533 shutdown_connections 2024-05-14T15:18:14.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.921+0000 7f903ec00700 1 --2- 172.21.15.69:0/2128512533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9038109300 0x7f9038109710 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:14.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.921+0000 7f903ec00700 1 --2- 172.21.15.69:0/2128512533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f90381030e0 0x7f9038111170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:14.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.921+0000 7f903ec00700 1 --2- 172.21.15.69:0/2128512533 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9038102790 0x7f9038102ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:14.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.921+0000 7f903ec00700 1 -- 172.21.15.69:0/2128512533 >> 172.21.15.69:0/2128512533 conn(0x7f90380fe520 msgr2=0x7f9038100970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:14.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.921+0000 7f903ec00700 1 -- 172.21.15.69:0/2128512533 shutdown_connections 2024-05-14T15:18:14.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.921+0000 7f903ec00700 1 -- 172.21.15.69:0/2128512533 wait complete. 2024-05-14T15:18:14.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.923+0000 7f903ec00700 1 Processor -- start 2024-05-14T15:18:14.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.923+0000 7f903ec00700 1 -- start start 2024-05-14T15:18:14.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.923+0000 7f903ec00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9038102790 0x7f903819d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:14.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.924+0000 7f903ec00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90381030e0 0x7f903819d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:14.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.924+0000 7f903ec00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9038109300 0x7f90381a1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:14.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.924+0000 7f903ec00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9038114490 con 0x7f90381030e0 2024-05-14T15:18:14.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.924+0000 7f903ec00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9038114310 con 0x7f9038109300 2024-05-14T15:18:14.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.924+0000 7f903ec00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9038114610 con 0x7f9038102790 2024-05-14T15:18:14.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.924+0000 7f902f400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90381030e0 0x7f903819d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:14.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.924+0000 7f903cc00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9038109300 0x7f90381a1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:14.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.924+0000 7f902f400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90381030e0 0x7f903819d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37566/0 (socket says 172.21.15.69:37566) 2024-05-14T15:18:14.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.924+0000 7f902f400700 1 -- 172.21.15.69:0/1535787504 learned_addr learned my addr 172.21.15.69:0/1535787504 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:14.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.924+0000 7f9037e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9038102790 0x7f903819d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:14.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.925+0000 7f902f400700 1 -- 172.21.15.69:0/1535787504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9038102790 msgr2=0x7f903819d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:14.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.925+0000 7f902f400700 1 --2- 172.21.15.69:0/1535787504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9038102790 0x7f903819d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:14.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.925+0000 7f902f400700 1 -- 172.21.15.69:0/1535787504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9038109300 msgr2=0x7f90381a1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:14.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.925+0000 7f902f400700 1 --2- 172.21.15.69:0/1535787504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9038109300 0x7f90381a1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:14.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.925+0000 7f902f400700 1 -- 172.21.15.69:0/1535787504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90381a2010 con 0x7f90381030e0 2024-05-14T15:18:14.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.925+0000 7f902f400700 1 --2- 172.21.15.69:0/1535787504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90381030e0 0x7f903819d6e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f902000e970 tx=0x7f902000ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:14.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.925+0000 7f9035600700 1 -- 172.21.15.69:0/1535787504 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9020004a30 con 0x7f90381030e0 2024-05-14T15:18:14.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.926+0000 7f9035600700 1 -- 172.21.15.69:0/1535787504 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f902000cc70 con 0x7f90381030e0 2024-05-14T15:18:14.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.926+0000 7f903ec00700 1 -- 172.21.15.69:0/1535787504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90381a22a0 con 0x7f90381030e0 2024-05-14T15:18:14.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.926+0000 7f9035600700 1 -- 172.21.15.69:0/1535787504 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9020005520 con 0x7f90381030e0 2024-05-14T15:18:14.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.926+0000 7f903ec00700 1 -- 172.21.15.69:0/1535787504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90381a9c20 con 0x7f90381030e0 2024-05-14T15:18:14.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.927+0000 7f903ec00700 1 -- 172.21.15.69:0/1535787504 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90380512c0 con 0x7f90381030e0 2024-05-14T15:18:14.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.932+0000 7f9035600700 1 -- 172.21.15.69:0/1535787504 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f902000c7e0 con 0x7f90381030e0 2024-05-14T15:18:14.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.933+0000 7f9035600700 1 --2- 172.21.15.69:0/1535787504 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f901c0b2910 0x7f901c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:14.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.933+0000 7f9035600700 1 -- 172.21.15.69:0/1535787504 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f90200e2c50 con 0x7f90381030e0 2024-05-14T15:18:14.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.933+0000 7f9037e00700 1 --2- 172.21.15.69:0/1535787504 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f901c0b2910 0x7f901c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:14.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.934+0000 7f9037e00700 1 --2- 172.21.15.69:0/1535787504 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f901c0b2910 0x7f901c0b4e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f902800b780 tx=0x7f9028006210 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:14.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:14.936+0000 7f9035600700 1 -- 172.21.15.69:0/1535787504 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f902000ce20 con 0x7f90381030e0 2024-05-14T15:18:15.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:15.170+0000 7f903ec00700 1 -- 172.21.15.69:0/1535787504 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9038104980 con 0x7f901c0b2910 2024-05-14T15:18:15.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:15.193+0000 7f9035600700 1 -- 172.21.15.69:0/1535787504 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340461 (secure 0 0 0) 0x7f9038104980 con 0x7f901c0b2910 2024-05-14T15:18:15.192 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:14 smithi069 ceph-mon[31270]: pgmap v457: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-05-14T15:18:15.199 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:18:15.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:15.200+0000 7f903ec00700 1 -- 172.21.15.69:0/1535787504 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f901c0b2910 msgr2=0x7f901c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:15.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:15.200+0000 7f903ec00700 1 --2- 172.21.15.69:0/1535787504 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f901c0b2910 0x7f901c0b4e20 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f902800b780 tx=0x7f9028006210 comp rx=0 tx=0).stop 2024-05-14T15:18:15.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:15.200+0000 7f903ec00700 1 -- 172.21.15.69:0/1535787504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90381030e0 msgr2=0x7f903819d6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:15.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:15.200+0000 7f903ec00700 1 --2- 172.21.15.69:0/1535787504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90381030e0 0x7f903819d6e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f902000e970 tx=0x7f902000ec80 comp rx=0 tx=0).stop 2024-05-14T15:18:15.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:15.200+0000 7f903ec00700 1 -- 172.21.15.69:0/1535787504 shutdown_connections 2024-05-14T15:18:15.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:15.200+0000 7f903ec00700 1 --2- 172.21.15.69:0/1535787504 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f901c0b2910 0x7f901c0b4e20 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:15.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:15.200+0000 7f903ec00700 1 --2- 172.21.15.69:0/1535787504 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9038109300 0x7f90381a1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:15.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:15.200+0000 7f903ec00700 1 --2- 172.21.15.69:0/1535787504 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9038102790 0x7f903819d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:15.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:15.200+0000 7f903ec00700 1 --2- 172.21.15.69:0/1535787504 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f90381030e0 0x7f903819d6e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:15.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:15.200+0000 7f903ec00700 1 -- 172.21.15.69:0/1535787504 >> 172.21.15.69:0/1535787504 conn(0x7f90380fe520 msgr2=0x7f90381075a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:15.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:15.200+0000 7f903ec00700 1 -- 172.21.15.69:0/1535787504 shutdown_connections 2024-05-14T15:18:15.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:15.200+0000 7f903ec00700 1 -- 172.21.15.69:0/1535787504 wait complete. 2024-05-14T15:18:15.203 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-05-14T15:18:15.342 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:14 smithi203 ceph-mon[34567]: pgmap v457: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-05-14T15:18:15.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:14 smithi092 ceph-mon[34729]: pgmap v457: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 1.5 KiB/s wr, 10 op/s 2024-05-14T15:18:16.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:15 smithi069 ceph-mon[31270]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:18:16.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:15 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:16.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:15 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:16.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:15 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:16.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:15 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:16.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:15 smithi203 ceph-mon[34567]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:18:16.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:15 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:16.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:15 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:16.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:15 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:16.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:15 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:16.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:15 smithi092 ceph-mon[34729]: from='client.14841 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:18:16.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:15 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:16.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:15 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:16.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:15 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:16.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:15 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:16.581 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":457,"stamp":"2024-05-14T15:18:13.655157+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":660804,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":453,"num_read_kb":329,"num_write":375,"num_write_kb":2295,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":310,"ondisk_log_size":310,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384504,"kb_used_data":14536,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557320,"statfs":{"total":1151940427776,"available":1151546695680,"internally_reserved":0,"allocated":14884864,"data_stored":8272824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":13842,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":112,"num_read_kb":64,"num_write":13,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007295"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.855003+0000","last_change":"2024-05-14T15:16:08.799448+0000","last_active":"2024-05-14T15:17:43.855003+0000","last_peered":"2024-05-14T15:17:43.855003+0000","last_clean":"2024-05-14T15:17:43.855003+0000","last_became_active":"2024-05-14T15:16:08.799025+0000","last_became_peered":"2024-05-14T15:16:08.799025+0000","last_unstale":"2024-05-14T15:17:43.855003+0000","last_undegraded":"2024-05-14T15:17:43.855003+0000","last_fullsized":"2024-05-14T15:17:43.855003+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:25:56.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.844948+0000","last_change":"2024-05-14T15:16:08.796943+0000","last_active":"2024-05-14T15:17:43.844948+0000","last_peered":"2024-05-14T15:17:43.844948+0000","last_clean":"2024-05-14T15:17:43.844948+0000","last_became_active":"2024-05-14T15:16:08.796044+0000","last_became_peered":"2024-05-14T15:16:08.796044+0000","last_unstale":"2024-05-14T15:17:43.844948+0000","last_undegraded":"2024-05-14T15:17:43.844948+0000","last_fullsized":"2024-05-14T15:17:43.844948+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:26:22.103727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.844534+0000","last_change":"2024-05-14T15:16:08.794020+0000","last_active":"2024-05-14T15:17:43.844534+0000","last_peered":"2024-05-14T15:17:43.844534+0000","last_clean":"2024-05-14T15:17:43.844534+0000","last_became_active":"2024-05-14T15:16:08.793677+0000","last_became_peered":"2024-05-14T15:16:08.793677+0000","last_unstale":"2024-05-14T15:17:43.844534+0000","last_undegraded":"2024-05-14T15:17:43.844534+0000","last_fullsized":"2024-05-14T15:17:43.844534+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.615815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.759017+0000","last_change":"2024-05-14T15:16:08.787482+0000","last_active":"2024-05-14T15:17:43.759017+0000","last_peered":"2024-05-14T15:17:43.759017+0000","last_clean":"2024-05-14T15:17:43.759017+0000","last_became_active":"2024-05-14T15:16:08.787087+0000","last_became_peered":"2024-05-14T15:16:08.787087+0000","last_unstale":"2024-05-14T15:17:43.759017+0000","last_undegraded":"2024-05-14T15:17:43.759017+0000","last_fullsized":"2024-05-14T15:17:43.759017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:18:51.433751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852674+0000","last_change":"2024-05-14T15:16:08.785982+0000","last_active":"2024-05-14T15:17:43.852674+0000","last_peered":"2024-05-14T15:17:43.852674+0000","last_clean":"2024-05-14T15:17:43.852674+0000","last_became_active":"2024-05-14T15:16:08.784980+0000","last_became_peered":"2024-05-14T15:16:08.784980+0000","last_unstale":"2024-05-14T15:17:43.852674+0000","last_undegraded":"2024-05-14T15:17:43.852674+0000","last_fullsized":"2024-05-14T15:17:43.852674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:07:50.390637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.847832+0000","last_change":"2024-05-14T15:16:08.784622+0000","last_active":"2024-05-14T15:17:43.847832+0000","last_peered":"2024-05-14T15:17:43.847832+0000","last_clean":"2024-05-14T15:17:43.847832+0000","last_became_active":"2024-05-14T15:16:08.784206+0000","last_became_peered":"2024-05-14T15:16:08.784206+0000","last_unstale":"2024-05-14T15:17:43.847832+0000","last_undegraded":"2024-05-14T15:17:43.847832+0000","last_fullsized":"2024-05-14T15:17:43.847832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:40:56.578935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.737912+0000","last_change":"2024-05-14T15:16:08.786381+0000","last_active":"2024-05-14T15:17:43.737912+0000","last_peered":"2024-05-14T15:17:43.737912+0000","last_clean":"2024-05-14T15:17:43.737912+0000","last_became_active":"2024-05-14T15:16:08.781231+0000","last_became_peered":"2024-05-14T15:16:08.781231+0000","last_unstale":"2024-05-14T15:17:43.737912+0000","last_undegraded":"2024-05-14T15:17:43.737912+0000","last_fullsized":"2024-05-14T15:17:43.737912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:51:16.961187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850244+0000","last_change":"2024-05-14T15:17:43.850244+0000","last_active":"2024-05-14T15:17:43.850244+0000","last_peered":"2024-05-14T15:17:43.850244+0000","last_clean":"2024-05-14T15:17:43.850244+0000","last_became_active":"2024-05-14T15:17:43.849671+0000","last_became_peered":"2024-05-14T15:17:43.849671+0000","last_unstale":"2024-05-14T15:17:43.850244+0000","last_undegraded":"2024-05-14T15:17:43.850244+0000","last_fullsized":"2024-05-14T15:17:43.850244+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:21:05.537250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,10],"acting":[3,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.728131+0000","last_change":"2024-05-14T15:16:08.785644+0000","last_active":"2024-05-14T15:17:43.728131+0000","last_peered":"2024-05-14T15:17:43.728131+0000","last_clean":"2024-05-14T15:17:43.728131+0000","last_became_active":"2024-05-14T15:16:08.785224+0000","last_became_peered":"2024-05-14T15:16:08.785224+0000","last_unstale":"2024-05-14T15:17:43.728131+0000","last_undegraded":"2024-05-14T15:17:43.728131+0000","last_fullsized":"2024-05-14T15:17:43.728131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:05:10.868610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.848126+0000","last_change":"2024-05-14T15:16:08.784425+0000","last_active":"2024-05-14T15:17:43.848126+0000","last_peered":"2024-05-14T15:17:43.848126+0000","last_clean":"2024-05-14T15:17:43.848126+0000","last_became_active":"2024-05-14T15:16:08.782889+0000","last_became_peered":"2024-05-14T15:16:08.782889+0000","last_unstale":"2024-05-14T15:17:43.848126+0000","last_undegraded":"2024-05-14T15:17:43.848126+0000","last_fullsized":"2024-05-14T15:17:43.848126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:40:11.043101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.739350+0000","last_change":"2024-05-14T15:16:08.782675+0000","last_active":"2024-05-14T15:17:43.739350+0000","last_peered":"2024-05-14T15:17:43.739350+0000","last_clean":"2024-05-14T15:17:43.739350+0000","last_became_active":"2024-05-14T15:16:08.781994+0000","last_became_peered":"2024-05-14T15:16:08.781994+0000","last_unstale":"2024-05-14T15:17:43.739350+0000","last_undegraded":"2024-05-14T15:17:43.739350+0000","last_fullsized":"2024-05-14T15:17:43.739350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:00:59.625493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.758867+0000","last_change":"2024-05-14T15:16:08.785655+0000","last_active":"2024-05-14T15:17:43.758867+0000","last_peered":"2024-05-14T15:17:43.758867+0000","last_clean":"2024-05-14T15:17:43.758867+0000","last_became_active":"2024-05-14T15:16:08.785273+0000","last_became_peered":"2024-05-14T15:16:08.785273+0000","last_unstale":"2024-05-14T15:17:43.758867+0000","last_undegraded":"2024-05-14T15:17:43.758867+0000","last_fullsized":"2024-05-14T15:17:43.758867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:11:51.971909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845952+0000","last_change":"2024-05-14T15:16:08.775558+0000","last_active":"2024-05-14T15:17:43.845952+0000","last_peered":"2024-05-14T15:17:43.845952+0000","last_clean":"2024-05-14T15:17:43.845952+0000","last_became_active":"2024-05-14T15:16:08.773465+0000","last_became_peered":"2024-05-14T15:16:08.773465+0000","last_unstale":"2024-05-14T15:17:43.845952+0000","last_undegraded":"2024-05-14T15:17:43.845952+0000","last_fullsized":"2024-05-14T15:17:43.845952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:16:17.151374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.844538+0000","last_change":"2024-05-14T15:16:08.786160+0000","last_active":"2024-05-14T15:17:43.844538+0000","last_peered":"2024-05-14T15:17:43.844538+0000","last_clean":"2024-05-14T15:17:43.844538+0000","last_became_active":"2024-05-14T15:16:08.781257+0000","last_became_peered":"2024-05-14T15:16:08.781257+0000","last_unstale":"2024-05-14T15:17:43.844538+0000","last_undegraded":"2024-05-14T15:17:43.844538+0000","last_fullsized":"2024-05-14T15:17:43.844538+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:13:03.974692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.844650+0000","last_change":"2024-05-14T15:16:43.014673+0000","last_active":"2024-05-14T15:17:43.844650+0000","last_peered":"2024-05-14T15:17:43.844650+0000","last_clean":"2024-05-14T15:17:43.844650+0000","last_became_active":"2024-05-14T15:16:43.013718+0000","last_became_peered":"2024-05-14T15:16:43.013718+0000","last_unstale":"2024-05-14T15:17:43.844650+0000","last_undegraded":"2024-05-14T15:17:43.844650+0000","last_fullsized":"2024-05-14T15:17:43.844650+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:08:42.885151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.726759+0000","last_change":"2024-05-14T15:16:08.784437+0000","last_active":"2024-05-14T15:17:43.726759+0000","last_peered":"2024-05-14T15:17:43.726759+0000","last_clean":"2024-05-14T15:17:43.726759+0000","last_became_active":"2024-05-14T15:16:08.784030+0000","last_became_peered":"2024-05-14T15:16:08.784030+0000","last_unstale":"2024-05-14T15:17:43.726759+0000","last_undegraded":"2024-05-14T15:17:43.726759+0000","last_fullsized":"2024-05-14T15:17:43.726759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:57:43.025679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.854589+0000","last_change":"2024-05-14T15:16:08.798419+0000","last_active":"2024-05-14T15:17:43.854589+0000","last_peered":"2024-05-14T15:17:43.854589+0000","last_clean":"2024-05-14T15:17:43.854589+0000","last_became_active":"2024-05-14T15:16:08.798066+0000","last_became_peered":"2024-05-14T15:16:08.798066+0000","last_unstale":"2024-05-14T15:17:43.854589+0000","last_undegraded":"2024-05-14T15:17:43.854589+0000","last_fullsized":"2024-05-14T15:17:43.854589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:55:29.921745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.727718+0000","last_change":"2024-05-14T15:16:08.780638+0000","last_active":"2024-05-14T15:17:43.727718+0000","last_peered":"2024-05-14T15:17:43.727718+0000","last_clean":"2024-05-14T15:17:43.727718+0000","last_became_active":"2024-05-14T15:16:08.778675+0000","last_became_peered":"2024-05-14T15:16:08.778675+0000","last_unstale":"2024-05-14T15:17:43.727718+0000","last_undegraded":"2024-05-14T15:17:43.727718+0000","last_fullsized":"2024-05-14T15:17:43.727718+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:29.780036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.731256+0000","last_change":"2024-05-14T15:16:08.791729+0000","last_active":"2024-05-14T15:17:43.731256+0000","last_peered":"2024-05-14T15:17:43.731256+0000","last_clean":"2024-05-14T15:17:43.731256+0000","last_became_active":"2024-05-14T15:16:08.791367+0000","last_became_peered":"2024-05-14T15:16:08.791367+0000","last_unstale":"2024-05-14T15:17:43.731256+0000","last_undegraded":"2024-05-14T15:17:43.731256+0000","last_fullsized":"2024-05-14T15:17:43.731256+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:03:00.148744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730762+0000","last_change":"2024-05-14T15:16:22.909315+0000","last_active":"2024-05-14T15:17:43.730762+0000","last_peered":"2024-05-14T15:17:43.730762+0000","last_clean":"2024-05-14T15:17:43.730762+0000","last_became_active":"2024-05-14T15:16:22.908846+0000","last_became_peered":"2024-05-14T15:16:22.908846+0000","last_unstale":"2024-05-14T15:17:43.730762+0000","last_undegraded":"2024-05-14T15:17:43.730762+0000","last_fullsized":"2024-05-14T15:17:43.730762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:20:50.338711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":90,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:08.465638+0000","last_change":"2024-05-14T15:16:03.729599+0000","last_active":"2024-05-14T15:18:08.465638+0000","last_peered":"2024-05-14T15:18:08.465638+0000","last_clean":"2024-05-14T15:18:08.465638+0000","last_became_active":"2024-05-14T15:16:03.728659+0000","last_became_peered":"2024-05-14T15:16:03.728659+0000","last_unstale":"2024-05-14T15:18:08.465638+0000","last_undegraded":"2024-05-14T15:18:08.465638+0000","last_fullsized":"2024-05-14T15:18:08.465638+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:54:18.989059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.737150+0000","last_change":"2024-05-14T15:16:08.790296+0000","last_active":"2024-05-14T15:17:43.737150+0000","last_peered":"2024-05-14T15:17:43.737150+0000","last_clean":"2024-05-14T15:17:43.737150+0000","last_became_active":"2024-05-14T15:16:08.789899+0000","last_became_peered":"2024-05-14T15:16:08.789899+0000","last_unstale":"2024-05-14T15:17:43.737150+0000","last_undegraded":"2024-05-14T15:17:43.737150+0000","last_fullsized":"2024-05-14T15:17:43.737150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:23:15.626580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.757523+0000","last_change":"2024-05-14T15:16:22.904857+0000","last_active":"2024-05-14T15:17:43.757523+0000","last_peered":"2024-05-14T15:17:43.757523+0000","last_clean":"2024-05-14T15:17:43.757523+0000","last_became_active":"2024-05-14T15:16:22.903747+0000","last_became_peered":"2024-05-14T15:16:22.903747+0000","last_unstale":"2024-05-14T15:17:43.757523+0000","last_undegraded":"2024-05-14T15:17:43.757523+0000","last_fullsized":"2024-05-14T15:17:43.757523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:58:27.937637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.737501+0000","last_change":"2024-05-14T15:16:03.840248+0000","last_active":"2024-05-14T15:17:43.737501+0000","last_peered":"2024-05-14T15:17:43.737501+0000","last_clean":"2024-05-14T15:17:43.737501+0000","last_became_active":"2024-05-14T15:16:03.839731+0000","last_became_peered":"2024-05-14T15:16:03.839731+0000","last_unstale":"2024-05-14T15:17:43.737501+0000","last_undegraded":"2024-05-14T15:17:43.737501+0000","last_fullsized":"2024-05-14T15:17:43.737501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:31:25.981757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845075+0000","last_change":"2024-05-14T15:16:08.791233+0000","last_active":"2024-05-14T15:17:43.845075+0000","last_peered":"2024-05-14T15:17:43.845075+0000","last_clean":"2024-05-14T15:17:43.845075+0000","last_became_active":"2024-05-14T15:16:08.790376+0000","last_became_peered":"2024-05-14T15:16:08.790376+0000","last_unstale":"2024-05-14T15:17:43.845075+0000","last_undegraded":"2024-05-14T15:17:43.845075+0000","last_fullsized":"2024-05-14T15:17:43.845075+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:35.203663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.758099+0000","last_change":"2024-05-14T15:16:22.906435+0000","last_active":"2024-05-14T15:17:43.758099+0000","last_peered":"2024-05-14T15:17:43.758099+0000","last_clean":"2024-05-14T15:17:43.758099+0000","last_became_active":"2024-05-14T15:16:22.905558+0000","last_became_peered":"2024-05-14T15:16:22.905558+0000","last_unstale":"2024-05-14T15:17:43.758099+0000","last_undegraded":"2024-05-14T15:17:43.758099+0000","last_fullsized":"2024-05-14T15:17:43.758099+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:43:15.748904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.853411+0000","last_change":"2024-05-14T15:16:43.026454+0000","last_active":"2024-05-14T15:17:43.853411+0000","last_peered":"2024-05-14T15:17:43.853411+0000","last_clean":"2024-05-14T15:17:43.853411+0000","last_became_active":"2024-05-14T15:16:43.019742+0000","last_became_peered":"2024-05-14T15:16:43.019742+0000","last_unstale":"2024-05-14T15:17:43.853411+0000","last_undegraded":"2024-05-14T15:17:43.853411+0000","last_fullsized":"2024-05-14T15:17:43.853411+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:38:38.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.727529+0000","last_change":"2024-05-14T15:16:08.774669+0000","last_active":"2024-05-14T15:17:43.727529+0000","last_peered":"2024-05-14T15:17:43.727529+0000","last_clean":"2024-05-14T15:17:43.727529+0000","last_became_active":"2024-05-14T15:16:08.773996+0000","last_became_peered":"2024-05-14T15:16:08.773996+0000","last_unstale":"2024-05-14T15:17:43.727529+0000","last_undegraded":"2024-05-14T15:17:43.727529+0000","last_fullsized":"2024-05-14T15:17:43.727529+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:21:58.199462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.757727+0000","last_change":"2024-05-14T15:16:43.065743+0000","last_active":"2024-05-14T15:17:43.757727+0000","last_peered":"2024-05-14T15:17:43.757727+0000","last_clean":"2024-05-14T15:17:43.757727+0000","last_became_active":"2024-05-14T15:16:43.064426+0000","last_became_peered":"2024-05-14T15:16:43.064426+0000","last_unstale":"2024-05-14T15:17:43.757727+0000","last_undegraded":"2024-05-14T15:17:43.757727+0000","last_fullsized":"2024-05-14T15:17:43.757727+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:15:44.230694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852419+0000","last_change":"2024-05-14T15:16:03.732142+0000","last_active":"2024-05-14T15:17:43.852419+0000","last_peered":"2024-05-14T15:17:43.852419+0000","last_clean":"2024-05-14T15:17:43.852419+0000","last_became_active":"2024-05-14T15:16:03.731590+0000","last_became_peered":"2024-05-14T15:16:03.731590+0000","last_unstale":"2024-05-14T15:17:43.852419+0000","last_undegraded":"2024-05-14T15:17:43.852419+0000","last_fullsized":"2024-05-14T15:17:43.852419+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:05:23.760541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850258+0000","last_change":"2024-05-14T15:16:08.780895+0000","last_active":"2024-05-14T15:17:43.850258+0000","last_peered":"2024-05-14T15:17:43.850258+0000","last_clean":"2024-05-14T15:17:43.850258+0000","last_became_active":"2024-05-14T15:16:08.780472+0000","last_became_peered":"2024-05-14T15:16:08.780472+0000","last_unstale":"2024-05-14T15:17:43.850258+0000","last_undegraded":"2024-05-14T15:17:43.850258+0000","last_fullsized":"2024-05-14T15:17:43.850258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:49.508043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730798+0000","last_change":"2024-05-14T15:16:22.915997+0000","last_active":"2024-05-14T15:17:43.730798+0000","last_peered":"2024-05-14T15:17:43.730798+0000","last_clean":"2024-05-14T15:17:43.730798+0000","last_became_active":"2024-05-14T15:16:22.915466+0000","last_became_peered":"2024-05-14T15:16:22.915466+0000","last_unstale":"2024-05-14T15:17:43.730798+0000","last_undegraded":"2024-05-14T15:17:43.730798+0000","last_fullsized":"2024-05-14T15:17:43.730798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:50:39.748860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'6","reported_seq":86,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:09.473068+0000","last_change":"2024-05-14T15:16:03.733796+0000","last_active":"2024-05-14T15:18:09.473068+0000","last_peered":"2024-05-14T15:18:09.473068+0000","last_clean":"2024-05-14T15:18:09.473068+0000","last_became_active":"2024-05-14T15:16:03.732467+0000","last_became_peered":"2024-05-14T15:16:03.732467+0000","last_unstale":"2024-05-14T15:18:09.473068+0000","last_undegraded":"2024-05-14T15:18:09.473068+0000","last_fullsized":"2024-05-14T15:18:09.473068+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:28.388120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":36,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852045+0000","last_change":"2024-05-14T15:16:08.793287+0000","last_active":"2024-05-14T15:17:43.852045+0000","last_peered":"2024-05-14T15:17:43.852045+0000","last_clean":"2024-05-14T15:17:43.852045+0000","last_became_active":"2024-05-14T15:16:08.791173+0000","last_became_peered":"2024-05-14T15:16:08.791173+0000","last_unstale":"2024-05-14T15:17:43.852045+0000","last_undegraded":"2024-05-14T15:17:43.852045+0000","last_fullsized":"2024-05-14T15:17:43.852045+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:24:49.644251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730420+0000","last_change":"2024-05-14T15:16:22.914734+0000","last_active":"2024-05-14T15:17:43.730420+0000","last_peered":"2024-05-14T15:17:43.730420+0000","last_clean":"2024-05-14T15:17:43.730420+0000","last_became_active":"2024-05-14T15:16:22.914267+0000","last_became_peered":"2024-05-14T15:16:22.914267+0000","last_unstale":"2024-05-14T15:17:43.730420+0000","last_undegraded":"2024-05-14T15:17:43.730420+0000","last_fullsized":"2024-05-14T15:17:43.730420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:04:50.809564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.847453+0000","last_change":"2024-05-14T15:16:03.729217+0000","last_active":"2024-05-14T15:17:43.847453+0000","last_peered":"2024-05-14T15:17:43.847453+0000","last_clean":"2024-05-14T15:17:43.847453+0000","last_became_active":"2024-05-14T15:16:03.727453+0000","last_became_peered":"2024-05-14T15:16:03.727453+0000","last_unstale":"2024-05-14T15:17:43.847453+0000","last_undegraded":"2024-05-14T15:17:43.847453+0000","last_fullsized":"2024-05-14T15:17:43.847453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:40:27.820618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.851574+0000","last_change":"2024-05-14T15:16:08.783861+0000","last_active":"2024-05-14T15:17:43.851574+0000","last_peered":"2024-05-14T15:17:43.851574+0000","last_clean":"2024-05-14T15:17:43.851574+0000","last_became_active":"2024-05-14T15:16:08.782986+0000","last_became_peered":"2024-05-14T15:16:08.782986+0000","last_unstale":"2024-05-14T15:17:43.851574+0000","last_undegraded":"2024-05-14T15:17:43.851574+0000","last_fullsized":"2024-05-14T15:17:43.851574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:52.453137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.854720+0000","last_change":"2024-05-14T15:16:22.912295+0000","last_active":"2024-05-14T15:17:43.854720+0000","last_peered":"2024-05-14T15:17:43.854720+0000","last_clean":"2024-05-14T15:17:43.854720+0000","last_became_active":"2024-05-14T15:16:22.911779+0000","last_became_peered":"2024-05-14T15:16:22.911779+0000","last_unstale":"2024-05-14T15:17:43.854720+0000","last_undegraded":"2024-05-14T15:17:43.854720+0000","last_fullsized":"2024-05-14T15:17:43.854720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:47:45.153619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845398+0000","last_change":"2024-05-14T15:16:03.729590+0000","last_active":"2024-05-14T15:17:43.845398+0000","last_peered":"2024-05-14T15:17:43.845398+0000","last_clean":"2024-05-14T15:17:43.845398+0000","last_became_active":"2024-05-14T15:16:03.727790+0000","last_became_peered":"2024-05-14T15:16:03.727790+0000","last_unstale":"2024-05-14T15:17:43.845398+0000","last_undegraded":"2024-05-14T15:17:43.845398+0000","last_fullsized":"2024-05-14T15:17:43.845398+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:13:31.960505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.735546+0000","last_change":"2024-05-14T15:16:08.789872+0000","last_active":"2024-05-14T15:17:43.735546+0000","last_peered":"2024-05-14T15:17:43.735546+0000","last_clean":"2024-05-14T15:17:43.735546+0000","last_became_active":"2024-05-14T15:16:08.786817+0000","last_became_peered":"2024-05-14T15:16:08.786817+0000","last_unstale":"2024-05-14T15:17:43.735546+0000","last_undegraded":"2024-05-14T15:17:43.735546+0000","last_fullsized":"2024-05-14T15:17:43.735546+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:09:41.042473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.844639+0000","last_change":"2024-05-14T15:16:22.903302+0000","last_active":"2024-05-14T15:17:43.844639+0000","last_peered":"2024-05-14T15:17:43.844639+0000","last_clean":"2024-05-14T15:17:43.844639+0000","last_became_active":"2024-05-14T15:16:22.902830+0000","last_became_peered":"2024-05-14T15:16:22.902830+0000","last_unstale":"2024-05-14T15:17:43.844639+0000","last_undegraded":"2024-05-14T15:17:43.844639+0000","last_fullsized":"2024-05-14T15:17:43.844639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:18:57.467319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849106+0000","last_change":"2024-05-14T15:16:03.738372+0000","last_active":"2024-05-14T15:17:43.849106+0000","last_peered":"2024-05-14T15:17:43.849106+0000","last_clean":"2024-05-14T15:17:43.849106+0000","last_became_active":"2024-05-14T15:16:03.737815+0000","last_became_peered":"2024-05-14T15:16:03.737815+0000","last_unstale":"2024-05-14T15:17:43.849106+0000","last_undegraded":"2024-05-14T15:17:43.849106+0000","last_fullsized":"2024-05-14T15:17:43.849106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:19:19.702318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.725615+0000","last_change":"2024-05-14T15:16:08.781979+0000","last_active":"2024-05-14T15:17:43.725615+0000","last_peered":"2024-05-14T15:17:43.725615+0000","last_clean":"2024-05-14T15:17:43.725615+0000","last_became_active":"2024-05-14T15:16:08.777257+0000","last_became_peered":"2024-05-14T15:16:08.777257+0000","last_unstale":"2024-05-14T15:17:43.725615+0000","last_undegraded":"2024-05-14T15:17:43.725615+0000","last_fullsized":"2024-05-14T15:17:43.725615+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:31.154921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.735561+0000","last_change":"2024-05-14T15:16:22.901107+0000","last_active":"2024-05-14T15:17:43.735561+0000","last_peered":"2024-05-14T15:17:43.735561+0000","last_clean":"2024-05-14T15:17:43.735561+0000","last_became_active":"2024-05-14T15:16:22.900578+0000","last_became_peered":"2024-05-14T15:16:22.900578+0000","last_unstale":"2024-05-14T15:17:43.735561+0000","last_undegraded":"2024-05-14T15:17:43.735561+0000","last_fullsized":"2024-05-14T15:17:43.735561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:11:23.019455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":114,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:10.474541+0000","last_change":"2024-05-14T15:16:03.730145+0000","last_active":"2024-05-14T15:18:10.474541+0000","last_peered":"2024-05-14T15:18:10.474541+0000","last_clean":"2024-05-14T15:18:10.474541+0000","last_became_active":"2024-05-14T15:16:03.728119+0000","last_became_peered":"2024-05-14T15:16:03.728119+0000","last_unstale":"2024-05-14T15:18:10.474541+0000","last_undegraded":"2024-05-14T15:18:10.474541+0000","last_fullsized":"2024-05-14T15:18:10.474541+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:19:57.596282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":66,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.728267+0000","last_change":"2024-05-14T15:16:08.781834+0000","last_active":"2024-05-14T15:17:43.728267+0000","last_peered":"2024-05-14T15:17:43.728267+0000","last_clean":"2024-05-14T15:17:43.728267+0000","last_became_active":"2024-05-14T15:16:08.781451+0000","last_became_peered":"2024-05-14T15:16:08.781451+0000","last_unstale":"2024-05-14T15:17:43.728267+0000","last_undegraded":"2024-05-14T15:17:43.728267+0000","last_fullsized":"2024-05-14T15:17:43.728267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:17:33.147475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.725263+0000","last_change":"2024-05-14T15:16:22.910711+0000","last_active":"2024-05-14T15:17:43.725263+0000","last_peered":"2024-05-14T15:17:43.725263+0000","last_clean":"2024-05-14T15:17:43.725263+0000","last_became_active":"2024-05-14T15:16:22.910076+0000","last_became_peered":"2024-05-14T15:16:22.910076+0000","last_unstale":"2024-05-14T15:17:43.725263+0000","last_undegraded":"2024-05-14T15:17:43.725263+0000","last_fullsized":"2024-05-14T15:17:43.725263+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:11:05.867547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.739312+0000","last_change":"2024-05-14T15:16:03.736682+0000","last_active":"2024-05-14T15:17:43.739312+0000","last_peered":"2024-05-14T15:17:43.739312+0000","last_clean":"2024-05-14T15:17:43.739312+0000","last_became_active":"2024-05-14T15:16:03.733676+0000","last_became_peered":"2024-05-14T15:16:03.733676+0000","last_unstale":"2024-05-14T15:17:43.739312+0000","last_undegraded":"2024-05-14T15:17:43.739312+0000","last_fullsized":"2024-05-14T15:17:43.739312+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:12:12.814817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845105+0000","last_change":"2024-05-14T15:16:08.797256+0000","last_active":"2024-05-14T15:17:43.845105+0000","last_peered":"2024-05-14T15:17:43.845105+0000","last_clean":"2024-05-14T15:17:43.845105+0000","last_became_active":"2024-05-14T15:16:08.796675+0000","last_became_peered":"2024-05-14T15:16:08.796675+0000","last_unstale":"2024-05-14T15:17:43.845105+0000","last_undegraded":"2024-05-14T15:17:43.845105+0000","last_fullsized":"2024-05-14T15:17:43.845105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:08.026962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.758609+0000","last_change":"2024-05-14T15:16:22.914775+0000","last_active":"2024-05-14T15:17:43.758609+0000","last_peered":"2024-05-14T15:17:43.758609+0000","last_clean":"2024-05-14T15:17:43.758609+0000","last_became_active":"2024-05-14T15:16:22.912853+0000","last_became_peered":"2024-05-14T15:16:22.912853+0000","last_unstale":"2024-05-14T15:17:43.758609+0000","last_undegraded":"2024-05-14T15:17:43.758609+0000","last_fullsized":"2024-05-14T15:17:43.758609+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:01:11.652074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849919+0000","last_change":"2024-05-14T15:16:03.845365+0000","last_active":"2024-05-14T15:17:43.849919+0000","last_peered":"2024-05-14T15:17:43.849919+0000","last_clean":"2024-05-14T15:17:43.849919+0000","last_became_active":"2024-05-14T15:16:03.842557+0000","last_became_peered":"2024-05-14T15:16:03.842557+0000","last_unstale":"2024-05-14T15:17:43.849919+0000","last_undegraded":"2024-05-14T15:17:43.849919+0000","last_fullsized":"2024-05-14T15:17:43.849919+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:26:21.515074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.855838+0000","last_change":"2024-05-14T15:17:43.855838+0000","last_active":"2024-05-14T15:17:43.855838+0000","last_peered":"2024-05-14T15:17:43.855838+0000","last_clean":"2024-05-14T15:17:43.855838+0000","last_became_active":"2024-05-14T15:17:43.855462+0000","last_became_peered":"2024-05-14T15:17:43.855462+0000","last_unstale":"2024-05-14T15:17:43.855838+0000","last_undegraded":"2024-05-14T15:17:43.855838+0000","last_fullsized":"2024-05-14T15:17:43.855838+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:56:06.442987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,4],"acting":[9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.725833+0000","last_change":"2024-05-14T15:16:22.905266+0000","last_active":"2024-05-14T15:17:43.725833+0000","last_peered":"2024-05-14T15:17:43.725833+0000","last_clean":"2024-05-14T15:17:43.725833+0000","last_became_active":"2024-05-14T15:16:22.903397+0000","last_became_peered":"2024-05-14T15:16:22.903397+0000","last_unstale":"2024-05-14T15:17:43.725833+0000","last_undegraded":"2024-05-14T15:17:43.725833+0000","last_fullsized":"2024-05-14T15:17:43.725833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:48:37.616028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'35","reported_seq":154,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:10.487594+0000","last_change":"2024-05-14T15:16:03.735261+0000","last_active":"2024-05-14T15:18:10.487594+0000","last_peered":"2024-05-14T15:18:10.487594+0000","last_clean":"2024-05-14T15:18:10.487594+0000","last_became_active":"2024-05-14T15:16:03.732725+0000","last_became_peered":"2024-05-14T15:16:03.732725+0000","last_unstale":"2024-05-14T15:18:10.487594+0000","last_undegraded":"2024-05-14T15:18:10.487594+0000","last_fullsized":"2024-05-14T15:18:10.487594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:44:51.777221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62216,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":75,"num_read_kb":97,"num_write":37,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.853987+0000","last_change":"2024-05-14T15:16:08.783758+0000","last_active":"2024-05-14T15:17:43.853987+0000","last_peered":"2024-05-14T15:17:43.853987+0000","last_clean":"2024-05-14T15:17:43.853987+0000","last_became_active":"2024-05-14T15:16:08.782465+0000","last_became_peered":"2024-05-14T15:16:08.782465+0000","last_unstale":"2024-05-14T15:17:43.853987+0000","last_undegraded":"2024-05-14T15:17:43.853987+0000","last_fullsized":"2024-05-14T15:17:43.853987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:37:36.921823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.851260+0000","last_change":"2024-05-14T15:16:22.899606+0000","last_active":"2024-05-14T15:17:43.851260+0000","last_peered":"2024-05-14T15:17:43.851260+0000","last_clean":"2024-05-14T15:17:43.851260+0000","last_became_active":"2024-05-14T15:16:22.898810+0000","last_became_peered":"2024-05-14T15:16:22.898810+0000","last_unstale":"2024-05-14T15:17:43.851260+0000","last_undegraded":"2024-05-14T15:17:43.851260+0000","last_fullsized":"2024-05-14T15:17:43.851260+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:49:07.068713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730324+0000","last_change":"2024-05-14T15:16:03.728561+0000","last_active":"2024-05-14T15:17:43.730324+0000","last_peered":"2024-05-14T15:17:43.730324+0000","last_clean":"2024-05-14T15:17:43.730324+0000","last_became_active":"2024-05-14T15:16:03.727273+0000","last_became_peered":"2024-05-14T15:16:03.727273+0000","last_unstale":"2024-05-14T15:17:43.730324+0000","last_undegraded":"2024-05-14T15:17:43.730324+0000","last_fullsized":"2024-05-14T15:17:43.730324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:06.487549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845716+0000","last_change":"2024-05-14T15:16:08.788199+0000","last_active":"2024-05-14T15:17:43.845716+0000","last_peered":"2024-05-14T15:17:43.845716+0000","last_clean":"2024-05-14T15:17:43.845716+0000","last_became_active":"2024-05-14T15:16:08.786477+0000","last_became_peered":"2024-05-14T15:16:08.786477+0000","last_unstale":"2024-05-14T15:17:43.845716+0000","last_undegraded":"2024-05-14T15:17:43.845716+0000","last_fullsized":"2024-05-14T15:17:43.845716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:40:33.441154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850727+0000","last_change":"2024-05-14T15:16:22.911265+0000","last_active":"2024-05-14T15:17:43.850727+0000","last_peered":"2024-05-14T15:17:43.850727+0000","last_clean":"2024-05-14T15:17:43.850727+0000","last_became_active":"2024-05-14T15:16:22.910297+0000","last_became_peered":"2024-05-14T15:16:22.910297+0000","last_unstale":"2024-05-14T15:17:43.850727+0000","last_undegraded":"2024-05-14T15:17:43.850727+0000","last_fullsized":"2024-05-14T15:17:43.850727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:43:37.894409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.854048+0000","last_change":"2024-05-14T15:16:03.735122+0000","last_active":"2024-05-14T15:17:43.854048+0000","last_peered":"2024-05-14T15:17:43.854048+0000","last_clean":"2024-05-14T15:17:43.854048+0000","last_became_active":"2024-05-14T15:16:03.734746+0000","last_became_peered":"2024-05-14T15:16:03.734746+0000","last_unstale":"2024-05-14T15:17:43.854048+0000","last_undegraded":"2024-05-14T15:17:43.854048+0000","last_fullsized":"2024-05-14T15:17:43.854048+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:36:48.070577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.738567+0000","last_change":"2024-05-14T15:16:08.791427+0000","last_active":"2024-05-14T15:17:43.738567+0000","last_peered":"2024-05-14T15:17:43.738567+0000","last_clean":"2024-05-14T15:17:43.738567+0000","last_became_active":"2024-05-14T15:16:08.791070+0000","last_became_peered":"2024-05-14T15:16:08.791070+0000","last_unstale":"2024-05-14T15:17:43.738567+0000","last_undegraded":"2024-05-14T15:17:43.738567+0000","last_fullsized":"2024-05-14T15:17:43.738567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:15:13.153055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.725931+0000","last_change":"2024-05-14T15:16:22.896084+0000","last_active":"2024-05-14T15:17:43.725931+0000","last_peered":"2024-05-14T15:17:43.725931+0000","last_clean":"2024-05-14T15:17:43.725931+0000","last_became_active":"2024-05-14T15:16:22.894473+0000","last_became_peered":"2024-05-14T15:16:22.894473+0000","last_unstale":"2024-05-14T15:17:43.725931+0000","last_undegraded":"2024-05-14T15:17:43.725931+0000","last_fullsized":"2024-05-14T15:17:43.725931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:18:18.844423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'6","reported_seq":84,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:07.488080+0000","last_change":"2024-05-14T15:16:03.728070+0000","last_active":"2024-05-14T15:18:07.488080+0000","last_peered":"2024-05-14T15:18:07.488080+0000","last_clean":"2024-05-14T15:18:07.488080+0000","last_became_active":"2024-05-14T15:16:03.726155+0000","last_became_peered":"2024-05-14T15:16:03.726155+0000","last_unstale":"2024-05-14T15:18:07.488080+0000","last_undegraded":"2024-05-14T15:18:07.488080+0000","last_fullsized":"2024-05-14T15:18:07.488080+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:50:43.447812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":35,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.738212+0000","last_change":"2024-05-14T15:16:08.787281+0000","last_active":"2024-05-14T15:17:43.738212+0000","last_peered":"2024-05-14T15:17:43.738212+0000","last_clean":"2024-05-14T15:17:43.738212+0000","last_became_active":"2024-05-14T15:16:08.786910+0000","last_became_peered":"2024-05-14T15:16:08.786910+0000","last_unstale":"2024-05-14T15:17:43.738212+0000","last_undegraded":"2024-05-14T15:17:43.738212+0000","last_fullsized":"2024-05-14T15:17:43.738212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:03:35.421845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846246+0000","last_change":"2024-05-14T15:16:43.066135+0000","last_active":"2024-05-14T15:17:43.846246+0000","last_peered":"2024-05-14T15:17:43.846246+0000","last_clean":"2024-05-14T15:17:43.846246+0000","last_became_active":"2024-05-14T15:16:43.064558+0000","last_became_peered":"2024-05-14T15:16:43.064558+0000","last_unstale":"2024-05-14T15:17:43.846246+0000","last_undegraded":"2024-05-14T15:17:43.846246+0000","last_fullsized":"2024-05-14T15:17:43.846246+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:21:25.441639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":62,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850407+0000","last_change":"2024-05-14T15:16:03.841009+0000","last_active":"2024-05-14T15:17:43.850407+0000","last_peered":"2024-05-14T15:17:43.850407+0000","last_clean":"2024-05-14T15:17:43.850407+0000","last_became_active":"2024-05-14T15:16:03.839514+0000","last_became_peered":"2024-05-14T15:16:03.839514+0000","last_unstale":"2024-05-14T15:17:43.850407+0000","last_undegraded":"2024-05-14T15:17:43.850407+0000","last_fullsized":"2024-05-14T15:17:43.850407+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:34:55.588072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849973+0000","last_change":"2024-05-14T15:16:08.774343+0000","last_active":"2024-05-14T15:17:43.849973+0000","last_peered":"2024-05-14T15:17:43.849973+0000","last_clean":"2024-05-14T15:17:43.849973+0000","last_became_active":"2024-05-14T15:16:08.773826+0000","last_became_peered":"2024-05-14T15:16:08.773826+0000","last_unstale":"2024-05-14T15:17:43.849973+0000","last_undegraded":"2024-05-14T15:17:43.849973+0000","last_fullsized":"2024-05-14T15:17:43.849973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:30:51.648019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849689+0000","last_change":"2024-05-14T15:16:22.889838+0000","last_active":"2024-05-14T15:17:43.849689+0000","last_peered":"2024-05-14T15:17:43.849689+0000","last_clean":"2024-05-14T15:17:43.849689+0000","last_became_active":"2024-05-14T15:16:22.888604+0000","last_became_peered":"2024-05-14T15:16:22.888604+0000","last_unstale":"2024-05-14T15:17:43.849689+0000","last_undegraded":"2024-05-14T15:17:43.849689+0000","last_fullsized":"2024-05-14T15:17:43.849689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:26:53.176588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.853807+0000","last_change":"2024-05-14T15:16:03.731499+0000","last_active":"2024-05-14T15:17:43.853807+0000","last_peered":"2024-05-14T15:17:43.853807+0000","last_clean":"2024-05-14T15:17:43.853807+0000","last_became_active":"2024-05-14T15:16:03.729387+0000","last_became_peered":"2024-05-14T15:16:03.729387+0000","last_unstale":"2024-05-14T15:17:43.853807+0000","last_undegraded":"2024-05-14T15:17:43.853807+0000","last_fullsized":"2024-05-14T15:17:43.853807+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:52:24.287236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852263+0000","last_change":"2024-05-14T15:16:08.787376+0000","last_active":"2024-05-14T15:17:43.852263+0000","last_peered":"2024-05-14T15:17:43.852263+0000","last_clean":"2024-05-14T15:17:43.852263+0000","last_became_active":"2024-05-14T15:16:08.786057+0000","last_became_peered":"2024-05-14T15:16:08.786057+0000","last_unstale":"2024-05-14T15:17:43.852263+0000","last_undegraded":"2024-05-14T15:17:43.852263+0000","last_fullsized":"2024-05-14T15:17:43.852263+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:17:16.582656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852579+0000","last_change":"2024-05-14T15:16:23.049639+0000","last_active":"2024-05-14T15:17:43.852579+0000","last_peered":"2024-05-14T15:17:43.852579+0000","last_clean":"2024-05-14T15:17:43.852579+0000","last_became_active":"2024-05-14T15:16:23.047746+0000","last_became_peered":"2024-05-14T15:16:23.047746+0000","last_unstale":"2024-05-14T15:17:43.852579+0000","last_undegraded":"2024-05-14T15:17:43.852579+0000","last_fullsized":"2024-05-14T15:17:43.852579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:22:27.129466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.726894+0000","last_change":"2024-05-14T15:16:03.842156+0000","last_active":"2024-05-14T15:17:43.726894+0000","last_peered":"2024-05-14T15:17:43.726894+0000","last_clean":"2024-05-14T15:17:43.726894+0000","last_became_active":"2024-05-14T15:16:03.841626+0000","last_became_peered":"2024-05-14T15:16:03.841626+0000","last_unstale":"2024-05-14T15:17:43.726894+0000","last_undegraded":"2024-05-14T15:17:43.726894+0000","last_fullsized":"2024-05-14T15:17:43.726894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:40.955009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.848075+0000","last_change":"2024-05-14T15:16:08.780632+0000","last_active":"2024-05-14T15:17:43.848075+0000","last_peered":"2024-05-14T15:17:43.848075+0000","last_clean":"2024-05-14T15:17:43.848075+0000","last_became_active":"2024-05-14T15:16:08.779743+0000","last_became_peered":"2024-05-14T15:16:08.779743+0000","last_unstale":"2024-05-14T15:17:43.848075+0000","last_undegraded":"2024-05-14T15:17:43.848075+0000","last_fullsized":"2024-05-14T15:17:43.848075+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:53:45.608716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846100+0000","last_change":"2024-05-14T15:16:22.894512+0000","last_active":"2024-05-14T15:17:43.846100+0000","last_peered":"2024-05-14T15:17:43.846100+0000","last_clean":"2024-05-14T15:17:43.846100+0000","last_became_active":"2024-05-14T15:16:22.893566+0000","last_became_peered":"2024-05-14T15:16:22.893566+0000","last_unstale":"2024-05-14T15:17:43.846100+0000","last_undegraded":"2024-05-14T15:17:43.846100+0000","last_fullsized":"2024-05-14T15:17:43.846100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:45:39.571364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'6","reported_seq":88,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:11.475404+0000","last_change":"2024-05-14T15:16:03.730782+0000","last_active":"2024-05-14T15:18:11.475404+0000","last_peered":"2024-05-14T15:18:11.475404+0000","last_clean":"2024-05-14T15:18:11.475404+0000","last_became_active":"2024-05-14T15:16:03.729703+0000","last_became_peered":"2024-05-14T15:16:03.729703+0000","last_unstale":"2024-05-14T15:18:11.475404+0000","last_undegraded":"2024-05-14T15:18:11.475404+0000","last_fullsized":"2024-05-14T15:18:11.475404+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:30:30.379450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":37,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.847421+0000","last_change":"2024-05-14T15:16:08.792362+0000","last_active":"2024-05-14T15:17:43.847421+0000","last_peered":"2024-05-14T15:17:43.847421+0000","last_clean":"2024-05-14T15:17:43.847421+0000","last_became_active":"2024-05-14T15:16:08.791836+0000","last_became_peered":"2024-05-14T15:16:08.791836+0000","last_unstale":"2024-05-14T15:17:43.847421+0000","last_undegraded":"2024-05-14T15:17:43.847421+0000","last_fullsized":"2024-05-14T15:17:43.847421+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:50:07.142474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846345+0000","last_change":"2024-05-14T15:16:23.048324+0000","last_active":"2024-05-14T15:17:43.846345+0000","last_peered":"2024-05-14T15:17:43.846345+0000","last_clean":"2024-05-14T15:17:43.846345+0000","last_became_active":"2024-05-14T15:16:23.047829+0000","last_became_peered":"2024-05-14T15:16:23.047829+0000","last_unstale":"2024-05-14T15:17:43.846345+0000","last_undegraded":"2024-05-14T15:17:43.846345+0000","last_fullsized":"2024-05-14T15:17:43.846345+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:13.018847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849948+0000","last_change":"2024-05-14T15:16:43.013252+0000","last_active":"2024-05-14T15:17:43.849948+0000","last_peered":"2024-05-14T15:17:43.849948+0000","last_clean":"2024-05-14T15:17:43.849948+0000","last_became_active":"2024-05-14T15:16:43.011962+0000","last_became_peered":"2024-05-14T15:16:43.011962+0000","last_unstale":"2024-05-14T15:17:43.849948+0000","last_undegraded":"2024-05-14T15:17:43.849948+0000","last_fullsized":"2024-05-14T15:17:43.849948+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:06.204259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":83,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:09.493114+0000","last_change":"2024-05-14T15:16:03.840983+0000","last_active":"2024-05-14T15:18:09.493114+0000","last_peered":"2024-05-14T15:18:09.493114+0000","last_clean":"2024-05-14T15:18:09.493114+0000","last_became_active":"2024-05-14T15:16:03.839117+0000","last_became_peered":"2024-05-14T15:16:03.839117+0000","last_unstale":"2024-05-14T15:18:09.493114+0000","last_undegraded":"2024-05-14T15:18:09.493114+0000","last_fullsized":"2024-05-14T15:18:09.493114+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:57.163543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.739156+0000","last_change":"2024-05-14T15:16:22.914744+0000","last_active":"2024-05-14T15:17:43.739156+0000","last_peered":"2024-05-14T15:17:43.739156+0000","last_clean":"2024-05-14T15:17:43.739156+0000","last_became_active":"2024-05-14T15:16:22.913661+0000","last_became_peered":"2024-05-14T15:16:22.913661+0000","last_unstale":"2024-05-14T15:17:43.739156+0000","last_undegraded":"2024-05-14T15:17:43.739156+0000","last_fullsized":"2024-05-14T15:17:43.739156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:45.957828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.735855+0000","last_change":"2024-05-14T15:16:08.791872+0000","last_active":"2024-05-14T15:17:43.735855+0000","last_peered":"2024-05-14T15:17:43.735855+0000","last_clean":"2024-05-14T15:17:43.735855+0000","last_became_active":"2024-05-14T15:16:08.791229+0000","last_became_peered":"2024-05-14T15:16:08.791229+0000","last_unstale":"2024-05-14T15:17:43.735855+0000","last_undegraded":"2024-05-14T15:17:43.735855+0000","last_fullsized":"2024-05-14T15:17:43.735855+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:36:26.391077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.758292+0000","last_change":"2024-05-14T15:16:03.732872+0000","last_active":"2024-05-14T15:17:43.758292+0000","last_peered":"2024-05-14T15:17:43.758292+0000","last_clean":"2024-05-14T15:17:43.758292+0000","last_became_active":"2024-05-14T15:16:03.732188+0000","last_became_peered":"2024-05-14T15:16:03.732188+0000","last_unstale":"2024-05-14T15:17:43.758292+0000","last_undegraded":"2024-05-14T15:17:43.758292+0000","last_fullsized":"2024-05-14T15:17:43.758292+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:20:56.776521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":119,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.737469+0000","last_change":"2024-05-14T15:14:08.407259+0000","last_active":"2024-05-14T15:17:43.737469+0000","last_peered":"2024-05-14T15:17:43.737469+0000","last_clean":"2024-05-14T15:17:43.737469+0000","last_became_active":"2024-05-14T15:14:08.398012+0000","last_became_peered":"2024-05-14T15:14:08.398012+0000","last_unstale":"2024-05-14T15:17:43.737469+0000","last_undegraded":"2024-05-14T15:17:43.737469+0000","last_fullsized":"2024-05-14T15:17:43.737469+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:09:04.015044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:09:04.015044+0000","last_clean_scrub_stamp":"2024-05-14T15:09:04.015044+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:37.256490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852180+0000","last_change":"2024-05-14T15:16:23.053989+0000","last_active":"2024-05-14T15:17:43.852180+0000","last_peered":"2024-05-14T15:17:43.852180+0000","last_clean":"2024-05-14T15:17:43.852180+0000","last_became_active":"2024-05-14T15:16:23.052585+0000","last_became_peered":"2024-05-14T15:16:23.052585+0000","last_unstale":"2024-05-14T15:17:43.852180+0000","last_undegraded":"2024-05-14T15:17:43.852180+0000","last_fullsized":"2024-05-14T15:17:43.852180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:30.104518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845166+0000","last_change":"2024-05-14T15:16:08.775447+0000","last_active":"2024-05-14T15:17:43.845166+0000","last_peered":"2024-05-14T15:17:43.845166+0000","last_clean":"2024-05-14T15:17:43.845166+0000","last_became_active":"2024-05-14T15:16:08.775055+0000","last_became_peered":"2024-05-14T15:16:08.775055+0000","last_unstale":"2024-05-14T15:17:43.845166+0000","last_undegraded":"2024-05-14T15:17:43.845166+0000","last_fullsized":"2024-05-14T15:17:43.845166+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:57:24.668939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.738150+0000","last_change":"2024-05-14T15:16:03.735221+0000","last_active":"2024-05-14T15:17:43.738150+0000","last_peered":"2024-05-14T15:17:43.738150+0000","last_clean":"2024-05-14T15:17:43.738150+0000","last_became_active":"2024-05-14T15:16:03.731910+0000","last_became_peered":"2024-05-14T15:16:03.731910+0000","last_unstale":"2024-05-14T15:17:43.738150+0000","last_undegraded":"2024-05-14T15:17:43.738150+0000","last_fullsized":"2024-05-14T15:17:43.738150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:57:18.030308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850335+0000","last_change":"2024-05-14T15:16:22.910564+0000","last_active":"2024-05-14T15:17:43.850335+0000","last_peered":"2024-05-14T15:17:43.850335+0000","last_clean":"2024-05-14T15:17:43.850335+0000","last_became_active":"2024-05-14T15:16:22.910003+0000","last_became_peered":"2024-05-14T15:16:22.910003+0000","last_unstale":"2024-05-14T15:17:43.850335+0000","last_undegraded":"2024-05-14T15:17:43.850335+0000","last_fullsized":"2024-05-14T15:17:43.850335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:47.895767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.854379+0000","last_change":"2024-05-14T15:16:03.844236+0000","last_active":"2024-05-14T15:17:43.854379+0000","last_peered":"2024-05-14T15:17:43.854379+0000","last_clean":"2024-05-14T15:17:43.854379+0000","last_became_active":"2024-05-14T15:16:03.841253+0000","last_became_peered":"2024-05-14T15:16:03.841253+0000","last_unstale":"2024-05-14T15:17:43.854379+0000","last_undegraded":"2024-05-14T15:17:43.854379+0000","last_fullsized":"2024-05-14T15:17:43.854379+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:40:24.440707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846207+0000","last_change":"2024-05-14T15:16:08.782849+0000","last_active":"2024-05-14T15:17:43.846207+0000","last_peered":"2024-05-14T15:17:43.846207+0000","last_clean":"2024-05-14T15:17:43.846207+0000","last_became_active":"2024-05-14T15:16:08.781999+0000","last_became_peered":"2024-05-14T15:16:08.781999+0000","last_unstale":"2024-05-14T15:17:43.846207+0000","last_undegraded":"2024-05-14T15:17:43.846207+0000","last_fullsized":"2024-05-14T15:17:43.846207+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:33:03.997615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.735546+0000","last_change":"2024-05-14T15:16:23.049719+0000","last_active":"2024-05-14T15:17:43.735546+0000","last_peered":"2024-05-14T15:17:43.735546+0000","last_clean":"2024-05-14T15:17:43.735546+0000","last_became_active":"2024-05-14T15:16:23.048547+0000","last_became_peered":"2024-05-14T15:16:23.048547+0000","last_unstale":"2024-05-14T15:17:43.735546+0000","last_undegraded":"2024-05-14T15:17:43.735546+0000","last_fullsized":"2024-05-14T15:17:43.735546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:41:49.790521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'15","reported_seq":59,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:02.843727+0000","last_change":"2024-05-14T15:16:03.729413+0000","last_active":"2024-05-14T15:18:02.843727+0000","last_peered":"2024-05-14T15:18:02.843727+0000","last_clean":"2024-05-14T15:18:02.843727+0000","last_became_active":"2024-05-14T15:16:03.728491+0000","last_became_peered":"2024-05-14T15:16:03.728491+0000","last_unstale":"2024-05-14T15:18:02.843727+0000","last_undegraded":"2024-05-14T15:18:02.843727+0000","last_fullsized":"2024-05-14T15:18:02.843727+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:34:04.811775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.736423+0000","last_change":"2024-05-14T15:16:08.784237+0000","last_active":"2024-05-14T15:17:43.736423+0000","last_peered":"2024-05-14T15:17:43.736423+0000","last_clean":"2024-05-14T15:17:43.736423+0000","last_became_active":"2024-05-14T15:16:08.783908+0000","last_became_peered":"2024-05-14T15:16:08.783908+0000","last_unstale":"2024-05-14T15:17:43.736423+0000","last_undegraded":"2024-05-14T15:17:43.736423+0000","last_fullsized":"2024-05-14T15:17:43.736423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:43:24.621314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.729419+0000","last_change":"2024-05-14T15:16:22.909928+0000","last_active":"2024-05-14T15:17:43.729419+0000","last_peered":"2024-05-14T15:17:43.729419+0000","last_clean":"2024-05-14T15:17:43.729419+0000","last_became_active":"2024-05-14T15:16:22.909412+0000","last_became_peered":"2024-05-14T15:16:22.909412+0000","last_unstale":"2024-05-14T15:17:43.729419+0000","last_undegraded":"2024-05-14T15:17:43.729419+0000","last_fullsized":"2024-05-14T15:17:43.729419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:18:26.324189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.759862+0000","last_change":"2024-05-14T15:16:03.729846+0000","last_active":"2024-05-14T15:17:43.759862+0000","last_peered":"2024-05-14T15:17:43.759862+0000","last_clean":"2024-05-14T15:17:43.759862+0000","last_became_active":"2024-05-14T15:16:03.729385+0000","last_became_peered":"2024-05-14T15:16:03.729385+0000","last_unstale":"2024-05-14T15:17:43.759862+0000","last_undegraded":"2024-05-14T15:17:43.759862+0000","last_fullsized":"2024-05-14T15:17:43.759862+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:05:18.987237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845001+0000","last_change":"2024-05-14T15:16:08.796017+0000","last_active":"2024-05-14T15:17:43.845001+0000","last_peered":"2024-05-14T15:17:43.845001+0000","last_clean":"2024-05-14T15:17:43.845001+0000","last_became_active":"2024-05-14T15:16:08.791627+0000","last_became_peered":"2024-05-14T15:16:08.791627+0000","last_unstale":"2024-05-14T15:17:43.845001+0000","last_undegraded":"2024-05-14T15:17:43.845001+0000","last_fullsized":"2024-05-14T15:17:43.845001+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:46:27.910669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.759053+0000","last_change":"2024-05-14T15:16:23.052954+0000","last_active":"2024-05-14T15:17:43.759053+0000","last_peered":"2024-05-14T15:17:43.759053+0000","last_clean":"2024-05-14T15:17:43.759053+0000","last_became_active":"2024-05-14T15:16:23.051410+0000","last_became_peered":"2024-05-14T15:16:23.051410+0000","last_unstale":"2024-05-14T15:17:43.759053+0000","last_undegraded":"2024-05-14T15:17:43.759053+0000","last_fullsized":"2024-05-14T15:17:43.759053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:28:55.181866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.727212+0000","last_change":"2024-05-14T15:16:43.023961+0000","last_active":"2024-05-14T15:17:43.727212+0000","last_peered":"2024-05-14T15:17:43.727212+0000","last_clean":"2024-05-14T15:17:43.727212+0000","last_became_active":"2024-05-14T15:16:43.022677+0000","last_became_peered":"2024-05-14T15:16:43.022677+0000","last_unstale":"2024-05-14T15:17:43.727212+0000","last_undegraded":"2024-05-14T15:17:43.727212+0000","last_fullsized":"2024-05-14T15:17:43.727212+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:33:16.692984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.851032+0000","last_change":"2024-05-14T15:16:08.780415+0000","last_active":"2024-05-14T15:17:43.851032+0000","last_peered":"2024-05-14T15:17:43.851032+0000","last_clean":"2024-05-14T15:17:43.851032+0000","last_became_active":"2024-05-14T15:16:08.780053+0000","last_became_peered":"2024-05-14T15:16:08.780053+0000","last_unstale":"2024-05-14T15:17:43.851032+0000","last_undegraded":"2024-05-14T15:17:43.851032+0000","last_fullsized":"2024-05-14T15:17:43.851032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:18:00.964346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.853607+0000","last_change":"2024-05-14T15:16:43.066458+0000","last_active":"2024-05-14T15:17:43.853607+0000","last_peered":"2024-05-14T15:17:43.853607+0000","last_clean":"2024-05-14T15:17:43.853607+0000","last_became_active":"2024-05-14T15:16:43.064035+0000","last_became_peered":"2024-05-14T15:16:43.064035+0000","last_unstale":"2024-05-14T15:17:43.853607+0000","last_undegraded":"2024-05-14T15:17:43.853607+0000","last_fullsized":"2024-05-14T15:17:43.853607+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:38:39.895882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.735736+0000","last_change":"2024-05-14T15:16:03.731962+0000","last_active":"2024-05-14T15:17:43.735736+0000","last_peered":"2024-05-14T15:17:43.735736+0000","last_clean":"2024-05-14T15:17:43.735736+0000","last_became_active":"2024-05-14T15:16:03.726532+0000","last_became_peered":"2024-05-14T15:16:03.726532+0000","last_unstale":"2024-05-14T15:17:43.735736+0000","last_undegraded":"2024-05-14T15:17:43.735736+0000","last_fullsized":"2024-05-14T15:17:43.735736+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:47:26.809212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.848965+0000","last_change":"2024-05-14T15:16:08.798984+0000","last_active":"2024-05-14T15:17:43.848965+0000","last_peered":"2024-05-14T15:17:43.848965+0000","last_clean":"2024-05-14T15:17:43.848965+0000","last_became_active":"2024-05-14T15:16:08.798120+0000","last_became_peered":"2024-05-14T15:16:08.798120+0000","last_unstale":"2024-05-14T15:17:43.848965+0000","last_undegraded":"2024-05-14T15:17:43.848965+0000","last_fullsized":"2024-05-14T15:17:43.848965+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:58.519436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.758682+0000","last_change":"2024-05-14T15:16:22.907994+0000","last_active":"2024-05-14T15:17:43.758682+0000","last_peered":"2024-05-14T15:17:43.758682+0000","last_clean":"2024-05-14T15:17:43.758682+0000","last_became_active":"2024-05-14T15:16:22.907144+0000","last_became_peered":"2024-05-14T15:16:22.907144+0000","last_unstale":"2024-05-14T15:17:43.758682+0000","last_undegraded":"2024-05-14T15:17:43.758682+0000","last_fullsized":"2024-05-14T15:17:43.758682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:49:11.436917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.729953+0000","last_change":"2024-05-14T15:16:03.728334+0000","last_active":"2024-05-14T15:17:43.729953+0000","last_peered":"2024-05-14T15:17:43.729953+0000","last_clean":"2024-05-14T15:17:43.729953+0000","last_became_active":"2024-05-14T15:16:03.727836+0000","last_became_peered":"2024-05-14T15:16:03.727836+0000","last_unstale":"2024-05-14T15:17:43.729953+0000","last_undegraded":"2024-05-14T15:17:43.729953+0000","last_fullsized":"2024-05-14T15:17:43.729953+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:54.780821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.736399+0000","last_change":"2024-05-14T15:16:08.798340+0000","last_active":"2024-05-14T15:17:43.736399+0000","last_peered":"2024-05-14T15:17:43.736399+0000","last_clean":"2024-05-14T15:17:43.736399+0000","last_became_active":"2024-05-14T15:16:08.797981+0000","last_became_peered":"2024-05-14T15:16:08.797981+0000","last_unstale":"2024-05-14T15:17:43.736399+0000","last_undegraded":"2024-05-14T15:17:43.736399+0000","last_fullsized":"2024-05-14T15:17:43.736399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:04:08.322033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.759560+0000","last_change":"2024-05-14T15:16:23.050064+0000","last_active":"2024-05-14T15:17:43.759560+0000","last_peered":"2024-05-14T15:17:43.759560+0000","last_clean":"2024-05-14T15:17:43.759560+0000","last_became_active":"2024-05-14T15:16:23.048608+0000","last_became_peered":"2024-05-14T15:16:23.048608+0000","last_unstale":"2024-05-14T15:17:43.759560+0000","last_undegraded":"2024-05-14T15:17:43.759560+0000","last_fullsized":"2024-05-14T15:17:43.759560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:32.044226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852291+0000","last_change":"2024-05-14T15:16:03.734588+0000","last_active":"2024-05-14T15:17:43.852291+0000","last_peered":"2024-05-14T15:17:43.852291+0000","last_clean":"2024-05-14T15:17:43.852291+0000","last_became_active":"2024-05-14T15:16:03.734112+0000","last_became_peered":"2024-05-14T15:16:03.734112+0000","last_unstale":"2024-05-14T15:17:43.852291+0000","last_undegraded":"2024-05-14T15:17:43.852291+0000","last_fullsized":"2024-05-14T15:17:43.852291+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:07:56.545225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.739925+0000","last_change":"2024-05-14T15:16:08.789481+0000","last_active":"2024-05-14T15:17:43.739925+0000","last_peered":"2024-05-14T15:17:43.739925+0000","last_clean":"2024-05-14T15:17:43.739925+0000","last_became_active":"2024-05-14T15:16:08.788462+0000","last_became_peered":"2024-05-14T15:16:08.788462+0000","last_unstale":"2024-05-14T15:17:43.739925+0000","last_undegraded":"2024-05-14T15:17:43.739925+0000","last_fullsized":"2024-05-14T15:17:43.739925+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:35:06.386410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.727193+0000","last_change":"2024-05-14T15:16:22.903205+0000","last_active":"2024-05-14T15:17:43.727193+0000","last_peered":"2024-05-14T15:17:43.727193+0000","last_clean":"2024-05-14T15:17:43.727193+0000","last_became_active":"2024-05-14T15:16:22.901217+0000","last_became_peered":"2024-05-14T15:16:22.901217+0000","last_unstale":"2024-05-14T15:17:43.727193+0000","last_undegraded":"2024-05-14T15:17:43.727193+0000","last_fullsized":"2024-05-14T15:17:43.727193+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:03:59.160106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'6","reported_seq":88,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:11.479314+0000","last_change":"2024-05-14T15:16:03.840601+0000","last_active":"2024-05-14T15:18:11.479314+0000","last_peered":"2024-05-14T15:18:11.479314+0000","last_clean":"2024-05-14T15:18:11.479314+0000","last_became_active":"2024-05-14T15:16:03.839299+0000","last_became_peered":"2024-05-14T15:16:03.839299+0000","last_unstale":"2024-05-14T15:18:11.479314+0000","last_undegraded":"2024-05-14T15:18:11.479314+0000","last_fullsized":"2024-05-14T15:18:11.479314+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:35:46.773419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.739687+0000","last_change":"2024-05-14T15:16:08.782915+0000","last_active":"2024-05-14T15:17:43.739687+0000","last_peered":"2024-05-14T15:17:43.739687+0000","last_clean":"2024-05-14T15:17:43.739687+0000","last_became_active":"2024-05-14T15:16:08.782469+0000","last_became_peered":"2024-05-14T15:16:08.782469+0000","last_unstale":"2024-05-14T15:17:43.739687+0000","last_undegraded":"2024-05-14T15:17:43.739687+0000","last_fullsized":"2024-05-14T15:17:43.739687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:36:35.361723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.844607+0000","last_change":"2024-05-14T15:16:43.021276+0000","last_active":"2024-05-14T15:17:43.844607+0000","last_peered":"2024-05-14T15:17:43.844607+0000","last_clean":"2024-05-14T15:17:43.844607+0000","last_became_active":"2024-05-14T15:16:43.020534+0000","last_became_peered":"2024-05-14T15:16:43.020534+0000","last_unstale":"2024-05-14T15:17:43.844607+0000","last_undegraded":"2024-05-14T15:17:43.844607+0000","last_fullsized":"2024-05-14T15:17:43.844607+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:31:01.267429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850585+0000","last_change":"2024-05-14T15:16:03.728379+0000","last_active":"2024-05-14T15:17:43.850585+0000","last_peered":"2024-05-14T15:17:43.850585+0000","last_clean":"2024-05-14T15:17:43.850585+0000","last_became_active":"2024-05-14T15:16:03.727580+0000","last_became_peered":"2024-05-14T15:16:03.727580+0000","last_unstale":"2024-05-14T15:17:43.850585+0000","last_undegraded":"2024-05-14T15:17:43.850585+0000","last_fullsized":"2024-05-14T15:17:43.850585+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:54:20.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.854489+0000","last_change":"2024-05-14T15:17:43.854489+0000","last_active":"2024-05-14T15:17:43.854489+0000","last_peered":"2024-05-14T15:17:43.854489+0000","last_clean":"2024-05-14T15:17:43.854489+0000","last_became_active":"2024-05-14T15:17:43.853624+0000","last_became_peered":"2024-05-14T15:17:43.853624+0000","last_unstale":"2024-05-14T15:17:43.854489+0000","last_undegraded":"2024-05-14T15:17:43.854489+0000","last_fullsized":"2024-05-14T15:17:43.854489+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:59.686248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.848460+0000","last_change":"2024-05-14T15:16:22.911248+0000","last_active":"2024-05-14T15:17:43.848460+0000","last_peered":"2024-05-14T15:17:43.848460+0000","last_clean":"2024-05-14T15:17:43.848460+0000","last_became_active":"2024-05-14T15:16:22.909975+0000","last_became_peered":"2024-05-14T15:16:22.909975+0000","last_unstale":"2024-05-14T15:17:43.848460+0000","last_undegraded":"2024-05-14T15:17:43.848460+0000","last_fullsized":"2024-05-14T15:17:43.848460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:23.140008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846116+0000","last_change":"2024-05-14T15:16:03.728422+0000","last_active":"2024-05-14T15:17:43.846116+0000","last_peered":"2024-05-14T15:17:43.846116+0000","last_clean":"2024-05-14T15:17:43.846116+0000","last_became_active":"2024-05-14T15:16:03.727428+0000","last_became_peered":"2024-05-14T15:16:03.727428+0000","last_unstale":"2024-05-14T15:17:43.846116+0000","last_undegraded":"2024-05-14T15:17:43.846116+0000","last_fullsized":"2024-05-14T15:17:43.846116+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:37:15.472001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.739025+0000","last_change":"2024-05-14T15:16:08.782158+0000","last_active":"2024-05-14T15:17:43.739025+0000","last_peered":"2024-05-14T15:17:43.739025+0000","last_clean":"2024-05-14T15:17:43.739025+0000","last_became_active":"2024-05-14T15:16:08.781761+0000","last_became_peered":"2024-05-14T15:16:08.781761+0000","last_unstale":"2024-05-14T15:17:43.739025+0000","last_undegraded":"2024-05-14T15:17:43.739025+0000","last_fullsized":"2024-05-14T15:17:43.739025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:01:42.886837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849018+0000","last_change":"2024-05-14T15:16:08.789851+0000","last_active":"2024-05-14T15:17:43.849018+0000","last_peered":"2024-05-14T15:17:43.849018+0000","last_clean":"2024-05-14T15:17:43.849018+0000","last_became_active":"2024-05-14T15:16:08.787563+0000","last_became_peered":"2024-05-14T15:16:08.787563+0000","last_unstale":"2024-05-14T15:17:43.849018+0000","last_undegraded":"2024-05-14T15:17:43.849018+0000","last_fullsized":"2024-05-14T15:17:43.849018+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:02:16.592481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730526+0000","last_change":"2024-05-14T15:16:08.788989+0000","last_active":"2024-05-14T15:17:43.730526+0000","last_peered":"2024-05-14T15:17:43.730526+0000","last_clean":"2024-05-14T15:17:43.730526+0000","last_became_active":"2024-05-14T15:16:08.785064+0000","last_became_peered":"2024-05-14T15:16:08.785064+0000","last_unstale":"2024-05-14T15:17:43.730526+0000","last_undegraded":"2024-05-14T15:17:43.730526+0000","last_fullsized":"2024-05-14T15:17:43.730526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:12:30.824113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.729857+0000","last_change":"2024-05-14T15:16:08.785849+0000","last_active":"2024-05-14T15:17:43.729857+0000","last_peered":"2024-05-14T15:17:43.729857+0000","last_clean":"2024-05-14T15:17:43.729857+0000","last_became_active":"2024-05-14T15:16:08.785487+0000","last_became_peered":"2024-05-14T15:16:08.785487+0000","last_unstale":"2024-05-14T15:17:43.729857+0000","last_undegraded":"2024-05-14T15:17:43.729857+0000","last_fullsized":"2024-05-14T15:17:43.729857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:37:16.435154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.844974+0000","last_change":"2024-05-14T15:16:08.787843+0000","last_active":"2024-05-14T15:17:43.844974+0000","last_peered":"2024-05-14T15:17:43.844974+0000","last_clean":"2024-05-14T15:17:43.844974+0000","last_became_active":"2024-05-14T15:16:08.787485+0000","last_became_peered":"2024-05-14T15:16:08.787485+0000","last_unstale":"2024-05-14T15:17:43.844974+0000","last_undegraded":"2024-05-14T15:17:43.844974+0000","last_fullsized":"2024-05-14T15:17:43.844974+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:16:06.625923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846208+0000","last_change":"2024-05-14T15:16:08.784870+0000","last_active":"2024-05-14T15:17:43.846208+0000","last_peered":"2024-05-14T15:17:43.846208+0000","last_clean":"2024-05-14T15:17:43.846208+0000","last_became_active":"2024-05-14T15:16:08.782496+0000","last_became_peered":"2024-05-14T15:16:08.782496+0000","last_unstale":"2024-05-14T15:17:43.846208+0000","last_undegraded":"2024-05-14T15:17:43.846208+0000","last_fullsized":"2024-05-14T15:17:43.846208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:54:33.724823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.853777+0000","last_change":"2024-05-14T15:16:08.783203+0000","last_active":"2024-05-14T15:17:43.853777+0000","last_peered":"2024-05-14T15:17:43.853777+0000","last_clean":"2024-05-14T15:17:43.853777+0000","last_became_active":"2024-05-14T15:16:08.782758+0000","last_became_peered":"2024-05-14T15:16:08.782758+0000","last_unstale":"2024-05-14T15:17:43.853777+0000","last_undegraded":"2024-05-14T15:17:43.853777+0000","last_fullsized":"2024-05-14T15:17:43.853777+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:34:33.274511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.731492+0000","last_change":"2024-05-14T15:16:08.789727+0000","last_active":"2024-05-14T15:17:43.731492+0000","last_peered":"2024-05-14T15:17:43.731492+0000","last_clean":"2024-05-14T15:17:43.731492+0000","last_became_active":"2024-05-14T15:16:08.784434+0000","last_became_peered":"2024-05-14T15:16:08.784434+0000","last_unstale":"2024-05-14T15:17:43.731492+0000","last_undegraded":"2024-05-14T15:17:43.731492+0000","last_fullsized":"2024-05-14T15:17:43.731492+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:59:19.835381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.736631+0000","last_change":"2024-05-14T15:16:08.781887+0000","last_active":"2024-05-14T15:17:43.736631+0000","last_peered":"2024-05-14T15:17:43.736631+0000","last_clean":"2024-05-14T15:17:43.736631+0000","last_became_active":"2024-05-14T15:16:08.781332+0000","last_became_peered":"2024-05-14T15:16:08.781332+0000","last_unstale":"2024-05-14T15:17:43.736631+0000","last_undegraded":"2024-05-14T15:17:43.736631+0000","last_fullsized":"2024-05-14T15:17:43.736631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:51:36.558485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.737478+0000","last_change":"2024-05-14T15:16:43.065016+0000","last_active":"2024-05-14T15:17:43.737478+0000","last_peered":"2024-05-14T15:17:43.737478+0000","last_clean":"2024-05-14T15:17:43.737478+0000","last_became_active":"2024-05-14T15:16:43.063786+0000","last_became_peered":"2024-05-14T15:16:43.063786+0000","last_unstale":"2024-05-14T15:17:43.737478+0000","last_undegraded":"2024-05-14T15:17:43.737478+0000","last_fullsized":"2024-05-14T15:17:43.737478+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:01:54.920710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.735911+0000","last_change":"2024-05-14T15:16:08.794288+0000","last_active":"2024-05-14T15:17:43.735911+0000","last_peered":"2024-05-14T15:17:43.735911+0000","last_clean":"2024-05-14T15:17:43.735911+0000","last_became_active":"2024-05-14T15:16:08.792059+0000","last_became_peered":"2024-05-14T15:16:08.792059+0000","last_unstale":"2024-05-14T15:17:43.735911+0000","last_undegraded":"2024-05-14T15:17:43.735911+0000","last_fullsized":"2024-05-14T15:17:43.735911+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:30:55.769322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.858583+0000","last_change":"2024-05-14T15:17:43.858583+0000","last_active":"2024-05-14T15:17:43.858583+0000","last_peered":"2024-05-14T15:17:43.858583+0000","last_clean":"2024-05-14T15:17:43.858583+0000","last_became_active":"2024-05-14T15:17:43.857287+0000","last_became_peered":"2024-05-14T15:17:43.857287+0000","last_unstale":"2024-05-14T15:17:43.858583+0000","last_undegraded":"2024-05-14T15:17:43.858583+0000","last_fullsized":"2024-05-14T15:17:43.858583+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:12:31.471747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846064+0000","last_change":"2024-05-14T15:16:08.786726+0000","last_active":"2024-05-14T15:17:43.846064+0000","last_peered":"2024-05-14T15:17:43.846064+0000","last_clean":"2024-05-14T15:17:43.846064+0000","last_became_active":"2024-05-14T15:16:08.785599+0000","last_became_peered":"2024-05-14T15:16:08.785599+0000","last_unstale":"2024-05-14T15:17:43.846064+0000","last_undegraded":"2024-05-14T15:17:43.846064+0000","last_fullsized":"2024-05-14T15:17:43.846064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:33:18.055459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.851244+0000","last_change":"2024-05-14T15:16:43.022021+0000","last_active":"2024-05-14T15:17:43.851244+0000","last_peered":"2024-05-14T15:17:43.851244+0000","last_clean":"2024-05-14T15:17:43.851244+0000","last_became_active":"2024-05-14T15:16:43.021511+0000","last_became_peered":"2024-05-14T15:16:43.021511+0000","last_unstale":"2024-05-14T15:17:43.851244+0000","last_undegraded":"2024-05-14T15:17:43.851244+0000","last_fullsized":"2024-05-14T15:17:43.851244+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:59:55.083356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":70202,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":372,"num_read_kb":260,"num_write":250,"num_write_kb":143,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":585728,"data_stored":219136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":216,"ondisk_log_size":216,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645356,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1056768,"data_stored":526497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841587,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32888,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712264,"statfs":{"total":95995035648,"available":95961358336,"internally_reserved":0,"allocated":1753088,"data_stored":1175529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005115,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":530132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201347,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1077248,"data_stored":526414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430282,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32812,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712340,"statfs":{"total":95995035648,"available":95961436160,"internally_reserved":0,"allocated":1675264,"data_stored":1123693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593810,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":521931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574967,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32280,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712872,"statfs":{"total":95995035648,"available":95961980928,"internally_reserved":0,"allocated":1130496,"data_stored":589442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738495,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1081344,"data_stored":523387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411440,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1150976,"data_stored":590053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182504,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1069056,"data_stored":521248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986273,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1064960,"data_stored":526005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790042,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32820,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712332,"statfs":{"total":95995035648,"available":95961427968,"internally_reserved":0,"allocated":1683456,"data_stored":1118493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":118784,"data_stored":64343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:18:16.587 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-14T15:18:17.024 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:17.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:16 smithi069 ceph-mon[31270]: pgmap v458: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-05-14T15:18:17.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:16 smithi203 ceph-mon[34567]: pgmap v458: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-05-14T15:18:17.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:16 smithi092 ceph-mon[34729]: pgmap v458: 129 pgs: 129 active+clean; 645 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 1.5 KiB/s wr, 11 op/s 2024-05-14T15:18:19.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.421+0000 7f8a41800700 1 -- 172.21.15.69:0/2126731045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a3c110ba0 msgr2=0x7f8a3c113000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:19.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.421+0000 7f8a41800700 1 --2- 172.21.15.69:0/2126731045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a3c110ba0 0x7f8a3c113000 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8a3400b0a0 tx=0x7f8a3400b3b0 comp rx=0 tx=0).stop 2024-05-14T15:18:19.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.421+0000 7f8a41800700 1 -- 172.21.15.69:0/2126731045 shutdown_connections 2024-05-14T15:18:19.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.421+0000 7f8a41800700 1 --2- 172.21.15.69:0/2126731045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a3c110ba0 0x7f8a3c113000 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:19.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.421+0000 7f8a41800700 1 --2- 172.21.15.69:0/2126731045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a3c075d30 0x7f8a3c076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:19.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.421+0000 7f8a41800700 1 --2- 172.21.15.69:0/2126731045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a3c076680 0x7f8a3c110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:19.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.421+0000 7f8a41800700 1 -- 172.21.15.69:0/2126731045 >> 172.21.15.69:0/2126731045 conn(0x7f8a3c100040 msgr2=0x7f8a3c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:19.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.421+0000 7f8a41800700 1 -- 172.21.15.69:0/2126731045 shutdown_connections 2024-05-14T15:18:19.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.421+0000 7f8a41800700 1 -- 172.21.15.69:0/2126731045 wait complete. 2024-05-14T15:18:19.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.422+0000 7f8a41800700 1 Processor -- start 2024-05-14T15:18:19.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.423+0000 7f8a41800700 1 -- start start 2024-05-14T15:18:19.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.423+0000 7f8a41800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a3c075d30 0x7f8a3c19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:19.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.423+0000 7f8a41800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a3c076680 0x7f8a3c19d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:19.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.423+0000 7f8a41800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a3c110ba0 0x7f8a3c1a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:19.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.423+0000 7f8a41800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c116530 con 0x7f8a3c075d30 2024-05-14T15:18:19.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.423+0000 7f8a41800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c1163b0 con 0x7f8a3c076680 2024-05-14T15:18:19.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.423+0000 7f8a41800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3c1166b0 con 0x7f8a3c110ba0 2024-05-14T15:18:19.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.423+0000 7f8a3aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a3c075d30 0x7f8a3c19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:19.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.423+0000 7f8a3aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a3c075d30 0x7f8a3c19cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37580/0 (socket says 172.21.15.69:37580) 2024-05-14T15:18:19.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.423+0000 7f8a3aa00700 1 -- 172.21.15.69:0/2079180936 learned_addr learned my addr 172.21.15.69:0/2079180936 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:19.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.424+0000 7f8a3b400700 1 --2- 172.21.15.69:0/2079180936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a3c110ba0 0x7f8a3c1a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:19.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.424+0000 7f8a3a000700 1 --2- 172.21.15.69:0/2079180936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a3c076680 0x7f8a3c19d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:19.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.424+0000 7f8a3aa00700 1 -- 172.21.15.69:0/2079180936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a3c110ba0 msgr2=0x7f8a3c1a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:19.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.424+0000 7f8a3aa00700 1 --2- 172.21.15.69:0/2079180936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a3c110ba0 0x7f8a3c1a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:19.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.424+0000 7f8a3aa00700 1 -- 172.21.15.69:0/2079180936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a3c076680 msgr2=0x7f8a3c19d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:19.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.424+0000 7f8a3aa00700 1 --2- 172.21.15.69:0/2079180936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a3c076680 0x7f8a3c19d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:19.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.424+0000 7f8a3aa00700 1 -- 172.21.15.69:0/2079180936 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a3c1a1df0 con 0x7f8a3c075d30 2024-05-14T15:18:19.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.424+0000 7f8a3a000700 1 --2- 172.21.15.69:0/2079180936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a3c076680 0x7f8a3c19d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:18:19.425 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:19 smithi069 ceph-mon[31270]: pgmap v459: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-14T15:18:19.425 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:19 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:19.425 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:19 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:19.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.424+0000 7f8a3aa00700 1 --2- 172.21.15.69:0/2079180936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a3c075d30 0x7f8a3c19cf20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00d950 tx=0x7f8a2c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:19.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.425+0000 7f8a33400700 1 -- 172.21.15.69:0/2079180936 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c016070 con 0x7f8a3c075d30 2024-05-14T15:18:19.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.425+0000 7f8a33400700 1 -- 172.21.15.69:0/2079180936 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8a2c010460 con 0x7f8a3c075d30 2024-05-14T15:18:19.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.425+0000 7f8a41800700 1 -- 172.21.15.69:0/2079180936 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a3c1a20e0 con 0x7f8a3c075d30 2024-05-14T15:18:19.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.425+0000 7f8a33400700 1 -- 172.21.15.69:0/2079180936 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00f620 con 0x7f8a3c075d30 2024-05-14T15:18:19.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.425+0000 7f8a41800700 1 -- 172.21.15.69:0/2079180936 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a3c1a9a00 con 0x7f8a3c075d30 2024-05-14T15:18:19.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.427+0000 7f8a41800700 1 -- 172.21.15.69:0/2079180936 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a3c0512c0 con 0x7f8a3c075d30 2024-05-14T15:18:19.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.429+0000 7f8a33400700 1 -- 172.21.15.69:0/2079180936 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f8a2c019070 con 0x7f8a3c075d30 2024-05-14T15:18:19.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.430+0000 7f8a33400700 1 --2- 172.21.15.69:0/2079180936 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f8a200b2910 0x7f8a200b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:19.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.431+0000 7f8a33400700 1 -- 172.21.15.69:0/2079180936 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f8a2c0e2410 con 0x7f8a3c075d30 2024-05-14T15:18:19.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.431+0000 7f8a3a000700 1 --2- 172.21.15.69:0/2079180936 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f8a200b2910 0x7f8a200b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:19.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.432+0000 7f8a3a000700 1 --2- 172.21.15.69:0/2079180936 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f8a200b2910 0x7f8a200b4e20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c1034c0 tx=0x7f8a28009550 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:19.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.436+0000 7f8a33400700 1 -- 172.21.15.69:0/2079180936 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f8a2c0a9ba0 con 0x7f8a3c075d30 2024-05-14T15:18:19.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:19 smithi203 ceph-mon[34567]: pgmap v459: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-14T15:18:19.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:19 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:19.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:19 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:19.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.681+0000 7f8a41800700 1 -- 172.21.15.69:0/2079180936 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a3c19e280 con 0x7f8a200b2910 2024-05-14T15:18:19.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:19 smithi092 ceph-mon[34729]: pgmap v459: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 1.7 KiB/s wr, 11 op/s 2024-05-14T15:18:19.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:19 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:19.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:19 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:19.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.694+0000 7f8a33400700 1 -- 172.21.15.69:0/2079180936 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340425 (secure 0 0 0) 0x7f8a3c19e280 con 0x7f8a200b2910 2024-05-14T15:18:19.696 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:18:19.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.703+0000 7f8a41800700 1 -- 172.21.15.69:0/2079180936 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f8a200b2910 msgr2=0x7f8a200b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:19.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.703+0000 7f8a41800700 1 --2- 172.21.15.69:0/2079180936 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f8a200b2910 0x7f8a200b4e20 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f8a3c1034c0 tx=0x7f8a28009550 comp rx=0 tx=0).stop 2024-05-14T15:18:19.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.703+0000 7f8a41800700 1 -- 172.21.15.69:0/2079180936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a3c075d30 msgr2=0x7f8a3c19cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:19.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.703+0000 7f8a41800700 1 --2- 172.21.15.69:0/2079180936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a3c075d30 0x7f8a3c19cf20 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00d950 tx=0x7f8a2c00dd10 comp rx=0 tx=0).stop 2024-05-14T15:18:19.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.704+0000 7f8a41800700 1 -- 172.21.15.69:0/2079180936 shutdown_connections 2024-05-14T15:18:19.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.704+0000 7f8a41800700 1 --2- 172.21.15.69:0/2079180936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8a3c075d30 0x7f8a3c19cf20 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:19.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.704+0000 7f8a41800700 1 --2- 172.21.15.69:0/2079180936 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f8a200b2910 0x7f8a200b4e20 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:19.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.704+0000 7f8a41800700 1 --2- 172.21.15.69:0/2079180936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8a3c110ba0 0x7f8a3c1a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:19.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.704+0000 7f8a41800700 1 --2- 172.21.15.69:0/2079180936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8a3c076680 0x7f8a3c19d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:19.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.704+0000 7f8a41800700 1 -- 172.21.15.69:0/2079180936 >> 172.21.15.69:0/2079180936 conn(0x7f8a3c100040 msgr2=0x7f8a3c1006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:19.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.704+0000 7f8a41800700 1 -- 172.21.15.69:0/2079180936 shutdown_connections 2024-05-14T15:18:19.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:19.704+0000 7f8a41800700 1 -- 172.21.15.69:0/2079180936 wait complete. 2024-05-14T15:18:19.704 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-05-14T15:18:20.530 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:20 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:18:20.530 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:20 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:18:20.530 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:20 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:20.533 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":460,"stamp":"2024-05-14T15:18:19.658718+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665069,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":514,"num_read_kb":364,"num_write":378,"num_write_kb":2300,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":312,"ondisk_log_size":312,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384508,"kb_used_data":14540,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557316,"statfs":{"total":1151940427776,"available":1151546691584,"internally_reserved":0,"allocated":14888960,"data_stored":8277089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":9227,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":65,"num_write":8,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007168"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.855116+0000","last_change":"2024-05-14T15:16:08.799448+0000","last_active":"2024-05-14T15:17:43.855116+0000","last_peered":"2024-05-14T15:17:43.855116+0000","last_clean":"2024-05-14T15:17:43.855116+0000","last_became_active":"2024-05-14T15:16:08.799025+0000","last_became_peered":"2024-05-14T15:16:08.799025+0000","last_unstale":"2024-05-14T15:17:43.855116+0000","last_undegraded":"2024-05-14T15:17:43.855116+0000","last_fullsized":"2024-05-14T15:17:43.855116+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:25:56.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845007+0000","last_change":"2024-05-14T15:16:08.796943+0000","last_active":"2024-05-14T15:17:43.845007+0000","last_peered":"2024-05-14T15:17:43.845007+0000","last_clean":"2024-05-14T15:17:43.845007+0000","last_became_active":"2024-05-14T15:16:08.796044+0000","last_became_peered":"2024-05-14T15:16:08.796044+0000","last_unstale":"2024-05-14T15:17:43.845007+0000","last_undegraded":"2024-05-14T15:17:43.845007+0000","last_fullsized":"2024-05-14T15:17:43.845007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:26:22.103727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.844607+0000","last_change":"2024-05-14T15:16:08.794020+0000","last_active":"2024-05-14T15:17:43.844607+0000","last_peered":"2024-05-14T15:17:43.844607+0000","last_clean":"2024-05-14T15:17:43.844607+0000","last_became_active":"2024-05-14T15:16:08.793677+0000","last_became_peered":"2024-05-14T15:16:08.793677+0000","last_unstale":"2024-05-14T15:17:43.844607+0000","last_undegraded":"2024-05-14T15:17:43.844607+0000","last_fullsized":"2024-05-14T15:17:43.844607+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.615815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.759017+0000","last_change":"2024-05-14T15:16:08.787482+0000","last_active":"2024-05-14T15:17:43.759017+0000","last_peered":"2024-05-14T15:17:43.759017+0000","last_clean":"2024-05-14T15:17:43.759017+0000","last_became_active":"2024-05-14T15:16:08.787087+0000","last_became_peered":"2024-05-14T15:16:08.787087+0000","last_unstale":"2024-05-14T15:17:43.759017+0000","last_undegraded":"2024-05-14T15:17:43.759017+0000","last_fullsized":"2024-05-14T15:17:43.759017+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:18:51.433751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852674+0000","last_change":"2024-05-14T15:16:08.785982+0000","last_active":"2024-05-14T15:17:43.852674+0000","last_peered":"2024-05-14T15:17:43.852674+0000","last_clean":"2024-05-14T15:17:43.852674+0000","last_became_active":"2024-05-14T15:16:08.784980+0000","last_became_peered":"2024-05-14T15:16:08.784980+0000","last_unstale":"2024-05-14T15:17:43.852674+0000","last_undegraded":"2024-05-14T15:17:43.852674+0000","last_fullsized":"2024-05-14T15:17:43.852674+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:07:50.390637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.847832+0000","last_change":"2024-05-14T15:16:08.784622+0000","last_active":"2024-05-14T15:17:43.847832+0000","last_peered":"2024-05-14T15:17:43.847832+0000","last_clean":"2024-05-14T15:17:43.847832+0000","last_became_active":"2024-05-14T15:16:08.784206+0000","last_became_peered":"2024-05-14T15:16:08.784206+0000","last_unstale":"2024-05-14T15:17:43.847832+0000","last_undegraded":"2024-05-14T15:17:43.847832+0000","last_fullsized":"2024-05-14T15:17:43.847832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:40:56.578935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.737912+0000","last_change":"2024-05-14T15:16:08.786381+0000","last_active":"2024-05-14T15:17:43.737912+0000","last_peered":"2024-05-14T15:17:43.737912+0000","last_clean":"2024-05-14T15:17:43.737912+0000","last_became_active":"2024-05-14T15:16:08.781231+0000","last_became_peered":"2024-05-14T15:16:08.781231+0000","last_unstale":"2024-05-14T15:17:43.737912+0000","last_undegraded":"2024-05-14T15:17:43.737912+0000","last_fullsized":"2024-05-14T15:17:43.737912+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:51:16.961187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850244+0000","last_change":"2024-05-14T15:17:43.850244+0000","last_active":"2024-05-14T15:17:43.850244+0000","last_peered":"2024-05-14T15:17:43.850244+0000","last_clean":"2024-05-14T15:17:43.850244+0000","last_became_active":"2024-05-14T15:17:43.849671+0000","last_became_peered":"2024-05-14T15:17:43.849671+0000","last_unstale":"2024-05-14T15:17:43.850244+0000","last_undegraded":"2024-05-14T15:17:43.850244+0000","last_fullsized":"2024-05-14T15:17:43.850244+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:21:05.537250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,10],"acting":[3,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.728131+0000","last_change":"2024-05-14T15:16:08.785644+0000","last_active":"2024-05-14T15:17:43.728131+0000","last_peered":"2024-05-14T15:17:43.728131+0000","last_clean":"2024-05-14T15:17:43.728131+0000","last_became_active":"2024-05-14T15:16:08.785224+0000","last_became_peered":"2024-05-14T15:16:08.785224+0000","last_unstale":"2024-05-14T15:17:43.728131+0000","last_undegraded":"2024-05-14T15:17:43.728131+0000","last_fullsized":"2024-05-14T15:17:43.728131+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:05:10.868610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.848126+0000","last_change":"2024-05-14T15:16:08.784425+0000","last_active":"2024-05-14T15:17:43.848126+0000","last_peered":"2024-05-14T15:17:43.848126+0000","last_clean":"2024-05-14T15:17:43.848126+0000","last_became_active":"2024-05-14T15:16:08.782889+0000","last_became_peered":"2024-05-14T15:16:08.782889+0000","last_unstale":"2024-05-14T15:17:43.848126+0000","last_undegraded":"2024-05-14T15:17:43.848126+0000","last_fullsized":"2024-05-14T15:17:43.848126+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:40:11.043101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.739350+0000","last_change":"2024-05-14T15:16:08.782675+0000","last_active":"2024-05-14T15:17:43.739350+0000","last_peered":"2024-05-14T15:17:43.739350+0000","last_clean":"2024-05-14T15:17:43.739350+0000","last_became_active":"2024-05-14T15:16:08.781994+0000","last_became_peered":"2024-05-14T15:16:08.781994+0000","last_unstale":"2024-05-14T15:17:43.739350+0000","last_undegraded":"2024-05-14T15:17:43.739350+0000","last_fullsized":"2024-05-14T15:17:43.739350+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:00:59.625493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.758867+0000","last_change":"2024-05-14T15:16:08.785655+0000","last_active":"2024-05-14T15:17:43.758867+0000","last_peered":"2024-05-14T15:17:43.758867+0000","last_clean":"2024-05-14T15:17:43.758867+0000","last_became_active":"2024-05-14T15:16:08.785273+0000","last_became_peered":"2024-05-14T15:16:08.785273+0000","last_unstale":"2024-05-14T15:17:43.758867+0000","last_undegraded":"2024-05-14T15:17:43.758867+0000","last_fullsized":"2024-05-14T15:17:43.758867+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:11:51.971909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845952+0000","last_change":"2024-05-14T15:16:08.775558+0000","last_active":"2024-05-14T15:17:43.845952+0000","last_peered":"2024-05-14T15:17:43.845952+0000","last_clean":"2024-05-14T15:17:43.845952+0000","last_became_active":"2024-05-14T15:16:08.773465+0000","last_became_peered":"2024-05-14T15:16:08.773465+0000","last_unstale":"2024-05-14T15:17:43.845952+0000","last_undegraded":"2024-05-14T15:17:43.845952+0000","last_fullsized":"2024-05-14T15:17:43.845952+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:16:17.151374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.844538+0000","last_change":"2024-05-14T15:16:08.786160+0000","last_active":"2024-05-14T15:17:43.844538+0000","last_peered":"2024-05-14T15:17:43.844538+0000","last_clean":"2024-05-14T15:17:43.844538+0000","last_became_active":"2024-05-14T15:16:08.781257+0000","last_became_peered":"2024-05-14T15:16:08.781257+0000","last_unstale":"2024-05-14T15:17:43.844538+0000","last_undegraded":"2024-05-14T15:17:43.844538+0000","last_fullsized":"2024-05-14T15:17:43.844538+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:13:03.974692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.844650+0000","last_change":"2024-05-14T15:16:43.014673+0000","last_active":"2024-05-14T15:17:43.844650+0000","last_peered":"2024-05-14T15:17:43.844650+0000","last_clean":"2024-05-14T15:17:43.844650+0000","last_became_active":"2024-05-14T15:16:43.013718+0000","last_became_peered":"2024-05-14T15:16:43.013718+0000","last_unstale":"2024-05-14T15:17:43.844650+0000","last_undegraded":"2024-05-14T15:17:43.844650+0000","last_fullsized":"2024-05-14T15:17:43.844650+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:08:42.885151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.726759+0000","last_change":"2024-05-14T15:16:08.784437+0000","last_active":"2024-05-14T15:17:43.726759+0000","last_peered":"2024-05-14T15:17:43.726759+0000","last_clean":"2024-05-14T15:17:43.726759+0000","last_became_active":"2024-05-14T15:16:08.784030+0000","last_became_peered":"2024-05-14T15:16:08.784030+0000","last_unstale":"2024-05-14T15:17:43.726759+0000","last_undegraded":"2024-05-14T15:17:43.726759+0000","last_fullsized":"2024-05-14T15:17:43.726759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:57:43.025679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.854589+0000","last_change":"2024-05-14T15:16:08.798419+0000","last_active":"2024-05-14T15:17:43.854589+0000","last_peered":"2024-05-14T15:17:43.854589+0000","last_clean":"2024-05-14T15:17:43.854589+0000","last_became_active":"2024-05-14T15:16:08.798066+0000","last_became_peered":"2024-05-14T15:16:08.798066+0000","last_unstale":"2024-05-14T15:17:43.854589+0000","last_undegraded":"2024-05-14T15:17:43.854589+0000","last_fullsized":"2024-05-14T15:17:43.854589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:55:29.921745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.727718+0000","last_change":"2024-05-14T15:16:08.780638+0000","last_active":"2024-05-14T15:17:43.727718+0000","last_peered":"2024-05-14T15:17:43.727718+0000","last_clean":"2024-05-14T15:17:43.727718+0000","last_became_active":"2024-05-14T15:16:08.778675+0000","last_became_peered":"2024-05-14T15:16:08.778675+0000","last_unstale":"2024-05-14T15:17:43.727718+0000","last_undegraded":"2024-05-14T15:17:43.727718+0000","last_fullsized":"2024-05-14T15:17:43.727718+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:29.780036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.731256+0000","last_change":"2024-05-14T15:16:08.791729+0000","last_active":"2024-05-14T15:17:43.731256+0000","last_peered":"2024-05-14T15:17:43.731256+0000","last_clean":"2024-05-14T15:17:43.731256+0000","last_became_active":"2024-05-14T15:16:08.791367+0000","last_became_peered":"2024-05-14T15:16:08.791367+0000","last_unstale":"2024-05-14T15:17:43.731256+0000","last_undegraded":"2024-05-14T15:17:43.731256+0000","last_fullsized":"2024-05-14T15:17:43.731256+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:03:00.148744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730762+0000","last_change":"2024-05-14T15:16:22.909315+0000","last_active":"2024-05-14T15:17:43.730762+0000","last_peered":"2024-05-14T15:17:43.730762+0000","last_clean":"2024-05-14T15:17:43.730762+0000","last_became_active":"2024-05-14T15:16:22.908846+0000","last_became_peered":"2024-05-14T15:16:22.908846+0000","last_unstale":"2024-05-14T15:17:43.730762+0000","last_undegraded":"2024-05-14T15:17:43.730762+0000","last_fullsized":"2024-05-14T15:17:43.730762+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:20:50.338711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"89'13","reported_seq":100,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:17.489928+0000","last_change":"2024-05-14T15:16:03.729599+0000","last_active":"2024-05-14T15:18:17.489928+0000","last_peered":"2024-05-14T15:18:17.489928+0000","last_clean":"2024-05-14T15:18:17.489928+0000","last_became_active":"2024-05-14T15:16:03.728659+0000","last_became_peered":"2024-05-14T15:16:03.728659+0000","last_unstale":"2024-05-14T15:18:17.489928+0000","last_undegraded":"2024-05-14T15:18:17.489928+0000","last_fullsized":"2024-05-14T15:18:17.489928+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:54:18.989059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.737150+0000","last_change":"2024-05-14T15:16:08.790296+0000","last_active":"2024-05-14T15:17:43.737150+0000","last_peered":"2024-05-14T15:17:43.737150+0000","last_clean":"2024-05-14T15:17:43.737150+0000","last_became_active":"2024-05-14T15:16:08.789899+0000","last_became_peered":"2024-05-14T15:16:08.789899+0000","last_unstale":"2024-05-14T15:17:43.737150+0000","last_undegraded":"2024-05-14T15:17:43.737150+0000","last_fullsized":"2024-05-14T15:17:43.737150+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:23:15.626580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.757523+0000","last_change":"2024-05-14T15:16:22.904857+0000","last_active":"2024-05-14T15:17:43.757523+0000","last_peered":"2024-05-14T15:17:43.757523+0000","last_clean":"2024-05-14T15:17:43.757523+0000","last_became_active":"2024-05-14T15:16:22.903747+0000","last_became_peered":"2024-05-14T15:16:22.903747+0000","last_unstale":"2024-05-14T15:17:43.757523+0000","last_undegraded":"2024-05-14T15:17:43.757523+0000","last_fullsized":"2024-05-14T15:17:43.757523+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:58:27.937637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.737501+0000","last_change":"2024-05-14T15:16:03.840248+0000","last_active":"2024-05-14T15:17:43.737501+0000","last_peered":"2024-05-14T15:17:43.737501+0000","last_clean":"2024-05-14T15:17:43.737501+0000","last_became_active":"2024-05-14T15:16:03.839731+0000","last_became_peered":"2024-05-14T15:16:03.839731+0000","last_unstale":"2024-05-14T15:17:43.737501+0000","last_undegraded":"2024-05-14T15:17:43.737501+0000","last_fullsized":"2024-05-14T15:17:43.737501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:31:25.981757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845138+0000","last_change":"2024-05-14T15:16:08.791233+0000","last_active":"2024-05-14T15:17:43.845138+0000","last_peered":"2024-05-14T15:17:43.845138+0000","last_clean":"2024-05-14T15:17:43.845138+0000","last_became_active":"2024-05-14T15:16:08.790376+0000","last_became_peered":"2024-05-14T15:16:08.790376+0000","last_unstale":"2024-05-14T15:17:43.845138+0000","last_undegraded":"2024-05-14T15:17:43.845138+0000","last_fullsized":"2024-05-14T15:17:43.845138+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:35.203663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.758099+0000","last_change":"2024-05-14T15:16:22.906435+0000","last_active":"2024-05-14T15:17:43.758099+0000","last_peered":"2024-05-14T15:17:43.758099+0000","last_clean":"2024-05-14T15:17:43.758099+0000","last_became_active":"2024-05-14T15:16:22.905558+0000","last_became_peered":"2024-05-14T15:16:22.905558+0000","last_unstale":"2024-05-14T15:17:43.758099+0000","last_undegraded":"2024-05-14T15:17:43.758099+0000","last_fullsized":"2024-05-14T15:17:43.758099+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:43:15.748904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.853411+0000","last_change":"2024-05-14T15:16:43.026454+0000","last_active":"2024-05-14T15:17:43.853411+0000","last_peered":"2024-05-14T15:17:43.853411+0000","last_clean":"2024-05-14T15:17:43.853411+0000","last_became_active":"2024-05-14T15:16:43.019742+0000","last_became_peered":"2024-05-14T15:16:43.019742+0000","last_unstale":"2024-05-14T15:17:43.853411+0000","last_undegraded":"2024-05-14T15:17:43.853411+0000","last_fullsized":"2024-05-14T15:17:43.853411+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:38:38.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.727529+0000","last_change":"2024-05-14T15:16:08.774669+0000","last_active":"2024-05-14T15:17:43.727529+0000","last_peered":"2024-05-14T15:17:43.727529+0000","last_clean":"2024-05-14T15:17:43.727529+0000","last_became_active":"2024-05-14T15:16:08.773996+0000","last_became_peered":"2024-05-14T15:16:08.773996+0000","last_unstale":"2024-05-14T15:17:43.727529+0000","last_undegraded":"2024-05-14T15:17:43.727529+0000","last_fullsized":"2024-05-14T15:17:43.727529+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:21:58.199462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.757727+0000","last_change":"2024-05-14T15:16:43.065743+0000","last_active":"2024-05-14T15:17:43.757727+0000","last_peered":"2024-05-14T15:17:43.757727+0000","last_clean":"2024-05-14T15:17:43.757727+0000","last_became_active":"2024-05-14T15:16:43.064426+0000","last_became_peered":"2024-05-14T15:16:43.064426+0000","last_unstale":"2024-05-14T15:17:43.757727+0000","last_undegraded":"2024-05-14T15:17:43.757727+0000","last_fullsized":"2024-05-14T15:17:43.757727+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:15:44.230694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852419+0000","last_change":"2024-05-14T15:16:03.732142+0000","last_active":"2024-05-14T15:17:43.852419+0000","last_peered":"2024-05-14T15:17:43.852419+0000","last_clean":"2024-05-14T15:17:43.852419+0000","last_became_active":"2024-05-14T15:16:03.731590+0000","last_became_peered":"2024-05-14T15:16:03.731590+0000","last_unstale":"2024-05-14T15:17:43.852419+0000","last_undegraded":"2024-05-14T15:17:43.852419+0000","last_fullsized":"2024-05-14T15:17:43.852419+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:05:23.760541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850258+0000","last_change":"2024-05-14T15:16:08.780895+0000","last_active":"2024-05-14T15:17:43.850258+0000","last_peered":"2024-05-14T15:17:43.850258+0000","last_clean":"2024-05-14T15:17:43.850258+0000","last_became_active":"2024-05-14T15:16:08.780472+0000","last_became_peered":"2024-05-14T15:16:08.780472+0000","last_unstale":"2024-05-14T15:17:43.850258+0000","last_undegraded":"2024-05-14T15:17:43.850258+0000","last_fullsized":"2024-05-14T15:17:43.850258+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:49.508043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730798+0000","last_change":"2024-05-14T15:16:22.915997+0000","last_active":"2024-05-14T15:17:43.730798+0000","last_peered":"2024-05-14T15:17:43.730798+0000","last_clean":"2024-05-14T15:17:43.730798+0000","last_became_active":"2024-05-14T15:16:22.915466+0000","last_became_peered":"2024-05-14T15:16:22.915466+0000","last_unstale":"2024-05-14T15:17:43.730798+0000","last_undegraded":"2024-05-14T15:17:43.730798+0000","last_fullsized":"2024-05-14T15:17:43.730798+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:50:39.748860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'6","reported_seq":91,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:14.488760+0000","last_change":"2024-05-14T15:16:03.733796+0000","last_active":"2024-05-14T15:18:14.488760+0000","last_peered":"2024-05-14T15:18:14.488760+0000","last_clean":"2024-05-14T15:18:14.488760+0000","last_became_active":"2024-05-14T15:16:03.732467+0000","last_became_peered":"2024-05-14T15:16:03.732467+0000","last_unstale":"2024-05-14T15:18:14.488760+0000","last_undegraded":"2024-05-14T15:18:14.488760+0000","last_fullsized":"2024-05-14T15:18:14.488760+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:28.388120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1013,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852045+0000","last_change":"2024-05-14T15:16:08.793287+0000","last_active":"2024-05-14T15:17:43.852045+0000","last_peered":"2024-05-14T15:17:43.852045+0000","last_clean":"2024-05-14T15:17:43.852045+0000","last_became_active":"2024-05-14T15:16:08.791173+0000","last_became_peered":"2024-05-14T15:16:08.791173+0000","last_unstale":"2024-05-14T15:17:43.852045+0000","last_undegraded":"2024-05-14T15:17:43.852045+0000","last_fullsized":"2024-05-14T15:17:43.852045+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:24:49.644251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730420+0000","last_change":"2024-05-14T15:16:22.914734+0000","last_active":"2024-05-14T15:17:43.730420+0000","last_peered":"2024-05-14T15:17:43.730420+0000","last_clean":"2024-05-14T15:17:43.730420+0000","last_became_active":"2024-05-14T15:16:22.914267+0000","last_became_peered":"2024-05-14T15:16:22.914267+0000","last_unstale":"2024-05-14T15:17:43.730420+0000","last_undegraded":"2024-05-14T15:17:43.730420+0000","last_fullsized":"2024-05-14T15:17:43.730420+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:04:50.809564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.847453+0000","last_change":"2024-05-14T15:16:03.729217+0000","last_active":"2024-05-14T15:17:43.847453+0000","last_peered":"2024-05-14T15:17:43.847453+0000","last_clean":"2024-05-14T15:17:43.847453+0000","last_became_active":"2024-05-14T15:16:03.727453+0000","last_became_peered":"2024-05-14T15:16:03.727453+0000","last_unstale":"2024-05-14T15:17:43.847453+0000","last_undegraded":"2024-05-14T15:17:43.847453+0000","last_fullsized":"2024-05-14T15:17:43.847453+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:40:27.820618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.851574+0000","last_change":"2024-05-14T15:16:08.783861+0000","last_active":"2024-05-14T15:17:43.851574+0000","last_peered":"2024-05-14T15:17:43.851574+0000","last_clean":"2024-05-14T15:17:43.851574+0000","last_became_active":"2024-05-14T15:16:08.782986+0000","last_became_peered":"2024-05-14T15:16:08.782986+0000","last_unstale":"2024-05-14T15:17:43.851574+0000","last_undegraded":"2024-05-14T15:17:43.851574+0000","last_fullsized":"2024-05-14T15:17:43.851574+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:52.453137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.854720+0000","last_change":"2024-05-14T15:16:22.912295+0000","last_active":"2024-05-14T15:17:43.854720+0000","last_peered":"2024-05-14T15:17:43.854720+0000","last_clean":"2024-05-14T15:17:43.854720+0000","last_became_active":"2024-05-14T15:16:22.911779+0000","last_became_peered":"2024-05-14T15:16:22.911779+0000","last_unstale":"2024-05-14T15:17:43.854720+0000","last_undegraded":"2024-05-14T15:17:43.854720+0000","last_fullsized":"2024-05-14T15:17:43.854720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:47:45.153619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845398+0000","last_change":"2024-05-14T15:16:03.729590+0000","last_active":"2024-05-14T15:17:43.845398+0000","last_peered":"2024-05-14T15:17:43.845398+0000","last_clean":"2024-05-14T15:17:43.845398+0000","last_became_active":"2024-05-14T15:16:03.727790+0000","last_became_peered":"2024-05-14T15:16:03.727790+0000","last_unstale":"2024-05-14T15:17:43.845398+0000","last_undegraded":"2024-05-14T15:17:43.845398+0000","last_fullsized":"2024-05-14T15:17:43.845398+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:13:31.960505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.735546+0000","last_change":"2024-05-14T15:16:08.789872+0000","last_active":"2024-05-14T15:17:43.735546+0000","last_peered":"2024-05-14T15:17:43.735546+0000","last_clean":"2024-05-14T15:17:43.735546+0000","last_became_active":"2024-05-14T15:16:08.786817+0000","last_became_peered":"2024-05-14T15:16:08.786817+0000","last_unstale":"2024-05-14T15:17:43.735546+0000","last_undegraded":"2024-05-14T15:17:43.735546+0000","last_fullsized":"2024-05-14T15:17:43.735546+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:09:41.042473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.844639+0000","last_change":"2024-05-14T15:16:22.903302+0000","last_active":"2024-05-14T15:17:43.844639+0000","last_peered":"2024-05-14T15:17:43.844639+0000","last_clean":"2024-05-14T15:17:43.844639+0000","last_became_active":"2024-05-14T15:16:22.902830+0000","last_became_peered":"2024-05-14T15:16:22.902830+0000","last_unstale":"2024-05-14T15:17:43.844639+0000","last_undegraded":"2024-05-14T15:17:43.844639+0000","last_fullsized":"2024-05-14T15:17:43.844639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:18:57.467319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849106+0000","last_change":"2024-05-14T15:16:03.738372+0000","last_active":"2024-05-14T15:17:43.849106+0000","last_peered":"2024-05-14T15:17:43.849106+0000","last_clean":"2024-05-14T15:17:43.849106+0000","last_became_active":"2024-05-14T15:16:03.737815+0000","last_became_peered":"2024-05-14T15:16:03.737815+0000","last_unstale":"2024-05-14T15:17:43.849106+0000","last_undegraded":"2024-05-14T15:17:43.849106+0000","last_fullsized":"2024-05-14T15:17:43.849106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:19:19.702318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.725615+0000","last_change":"2024-05-14T15:16:08.781979+0000","last_active":"2024-05-14T15:17:43.725615+0000","last_peered":"2024-05-14T15:17:43.725615+0000","last_clean":"2024-05-14T15:17:43.725615+0000","last_became_active":"2024-05-14T15:16:08.777257+0000","last_became_peered":"2024-05-14T15:16:08.777257+0000","last_unstale":"2024-05-14T15:17:43.725615+0000","last_undegraded":"2024-05-14T15:17:43.725615+0000","last_fullsized":"2024-05-14T15:17:43.725615+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:31.154921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.735561+0000","last_change":"2024-05-14T15:16:22.901107+0000","last_active":"2024-05-14T15:17:43.735561+0000","last_peered":"2024-05-14T15:17:43.735561+0000","last_clean":"2024-05-14T15:17:43.735561+0000","last_became_active":"2024-05-14T15:16:22.900578+0000","last_became_peered":"2024-05-14T15:16:22.900578+0000","last_unstale":"2024-05-14T15:17:43.735561+0000","last_undegraded":"2024-05-14T15:17:43.735561+0000","last_fullsized":"2024-05-14T15:17:43.735561+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:11:23.019455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":124,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:15.489721+0000","last_change":"2024-05-14T15:16:03.730145+0000","last_active":"2024-05-14T15:18:15.489721+0000","last_peered":"2024-05-14T15:18:15.489721+0000","last_clean":"2024-05-14T15:18:15.489721+0000","last_became_active":"2024-05-14T15:16:03.728119+0000","last_became_peered":"2024-05-14T15:16:03.728119+0000","last_unstale":"2024-05-14T15:18:15.489721+0000","last_undegraded":"2024-05-14T15:18:15.489721+0000","last_fullsized":"2024-05-14T15:18:15.489721+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:19:57.596282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":76,"num_read_kb":76,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.728267+0000","last_change":"2024-05-14T15:16:08.781834+0000","last_active":"2024-05-14T15:17:43.728267+0000","last_peered":"2024-05-14T15:17:43.728267+0000","last_clean":"2024-05-14T15:17:43.728267+0000","last_became_active":"2024-05-14T15:16:08.781451+0000","last_became_peered":"2024-05-14T15:16:08.781451+0000","last_unstale":"2024-05-14T15:17:43.728267+0000","last_undegraded":"2024-05-14T15:17:43.728267+0000","last_fullsized":"2024-05-14T15:17:43.728267+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:17:33.147475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.725263+0000","last_change":"2024-05-14T15:16:22.910711+0000","last_active":"2024-05-14T15:17:43.725263+0000","last_peered":"2024-05-14T15:17:43.725263+0000","last_clean":"2024-05-14T15:17:43.725263+0000","last_became_active":"2024-05-14T15:16:22.910076+0000","last_became_peered":"2024-05-14T15:16:22.910076+0000","last_unstale":"2024-05-14T15:17:43.725263+0000","last_undegraded":"2024-05-14T15:17:43.725263+0000","last_fullsized":"2024-05-14T15:17:43.725263+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:11:05.867547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.739312+0000","last_change":"2024-05-14T15:16:03.736682+0000","last_active":"2024-05-14T15:17:43.739312+0000","last_peered":"2024-05-14T15:17:43.739312+0000","last_clean":"2024-05-14T15:17:43.739312+0000","last_became_active":"2024-05-14T15:16:03.733676+0000","last_became_peered":"2024-05-14T15:16:03.733676+0000","last_unstale":"2024-05-14T15:17:43.739312+0000","last_undegraded":"2024-05-14T15:17:43.739312+0000","last_fullsized":"2024-05-14T15:17:43.739312+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:12:12.814817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845105+0000","last_change":"2024-05-14T15:16:08.797256+0000","last_active":"2024-05-14T15:17:43.845105+0000","last_peered":"2024-05-14T15:17:43.845105+0000","last_clean":"2024-05-14T15:17:43.845105+0000","last_became_active":"2024-05-14T15:16:08.796675+0000","last_became_peered":"2024-05-14T15:16:08.796675+0000","last_unstale":"2024-05-14T15:17:43.845105+0000","last_undegraded":"2024-05-14T15:17:43.845105+0000","last_fullsized":"2024-05-14T15:17:43.845105+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:08.026962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.758609+0000","last_change":"2024-05-14T15:16:22.914775+0000","last_active":"2024-05-14T15:17:43.758609+0000","last_peered":"2024-05-14T15:17:43.758609+0000","last_clean":"2024-05-14T15:17:43.758609+0000","last_became_active":"2024-05-14T15:16:22.912853+0000","last_became_peered":"2024-05-14T15:16:22.912853+0000","last_unstale":"2024-05-14T15:17:43.758609+0000","last_undegraded":"2024-05-14T15:17:43.758609+0000","last_fullsized":"2024-05-14T15:17:43.758609+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:01:11.652074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849919+0000","last_change":"2024-05-14T15:16:03.845365+0000","last_active":"2024-05-14T15:17:43.849919+0000","last_peered":"2024-05-14T15:17:43.849919+0000","last_clean":"2024-05-14T15:17:43.849919+0000","last_became_active":"2024-05-14T15:16:03.842557+0000","last_became_peered":"2024-05-14T15:16:03.842557+0000","last_unstale":"2024-05-14T15:17:43.849919+0000","last_undegraded":"2024-05-14T15:17:43.849919+0000","last_fullsized":"2024-05-14T15:17:43.849919+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:26:21.515074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":11,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.855838+0000","last_change":"2024-05-14T15:17:43.855838+0000","last_active":"2024-05-14T15:17:43.855838+0000","last_peered":"2024-05-14T15:17:43.855838+0000","last_clean":"2024-05-14T15:17:43.855838+0000","last_became_active":"2024-05-14T15:17:43.855462+0000","last_became_peered":"2024-05-14T15:17:43.855462+0000","last_unstale":"2024-05-14T15:17:43.855838+0000","last_undegraded":"2024-05-14T15:17:43.855838+0000","last_fullsized":"2024-05-14T15:17:43.855838+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:56:06.442987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,4],"acting":[9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.725833+0000","last_change":"2024-05-14T15:16:22.905266+0000","last_active":"2024-05-14T15:17:43.725833+0000","last_peered":"2024-05-14T15:17:43.725833+0000","last_clean":"2024-05-14T15:17:43.725833+0000","last_became_active":"2024-05-14T15:16:22.903397+0000","last_became_peered":"2024-05-14T15:16:22.903397+0000","last_unstale":"2024-05-14T15:17:43.725833+0000","last_undegraded":"2024-05-14T15:17:43.725833+0000","last_fullsized":"2024-05-14T15:17:43.725833+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:48:37.616028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'36","reported_seq":166,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:15.503522+0000","last_change":"2024-05-14T15:16:03.735261+0000","last_active":"2024-05-14T15:18:15.503522+0000","last_peered":"2024-05-14T15:18:15.503522+0000","last_clean":"2024-05-14T15:18:15.503522+0000","last_became_active":"2024-05-14T15:16:03.732725+0000","last_became_peered":"2024-05-14T15:16:03.732725+0000","last_unstale":"2024-05-14T15:18:15.503522+0000","last_undegraded":"2024-05-14T15:18:15.503522+0000","last_fullsized":"2024-05-14T15:18:15.503522+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:44:51.777221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66481,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":86,"num_read_kb":107,"num_write":38,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.853987+0000","last_change":"2024-05-14T15:16:08.783758+0000","last_active":"2024-05-14T15:17:43.853987+0000","last_peered":"2024-05-14T15:17:43.853987+0000","last_clean":"2024-05-14T15:17:43.853987+0000","last_became_active":"2024-05-14T15:16:08.782465+0000","last_became_peered":"2024-05-14T15:16:08.782465+0000","last_unstale":"2024-05-14T15:17:43.853987+0000","last_undegraded":"2024-05-14T15:17:43.853987+0000","last_fullsized":"2024-05-14T15:17:43.853987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:37:36.921823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.851260+0000","last_change":"2024-05-14T15:16:22.899606+0000","last_active":"2024-05-14T15:17:43.851260+0000","last_peered":"2024-05-14T15:17:43.851260+0000","last_clean":"2024-05-14T15:17:43.851260+0000","last_became_active":"2024-05-14T15:16:22.898810+0000","last_became_peered":"2024-05-14T15:16:22.898810+0000","last_unstale":"2024-05-14T15:17:43.851260+0000","last_undegraded":"2024-05-14T15:17:43.851260+0000","last_fullsized":"2024-05-14T15:17:43.851260+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:49:07.068713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730324+0000","last_change":"2024-05-14T15:16:03.728561+0000","last_active":"2024-05-14T15:17:43.730324+0000","last_peered":"2024-05-14T15:17:43.730324+0000","last_clean":"2024-05-14T15:17:43.730324+0000","last_became_active":"2024-05-14T15:16:03.727273+0000","last_became_peered":"2024-05-14T15:16:03.727273+0000","last_unstale":"2024-05-14T15:17:43.730324+0000","last_undegraded":"2024-05-14T15:17:43.730324+0000","last_fullsized":"2024-05-14T15:17:43.730324+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:06.487549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845716+0000","last_change":"2024-05-14T15:16:08.788199+0000","last_active":"2024-05-14T15:17:43.845716+0000","last_peered":"2024-05-14T15:17:43.845716+0000","last_clean":"2024-05-14T15:17:43.845716+0000","last_became_active":"2024-05-14T15:16:08.786477+0000","last_became_peered":"2024-05-14T15:16:08.786477+0000","last_unstale":"2024-05-14T15:17:43.845716+0000","last_undegraded":"2024-05-14T15:17:43.845716+0000","last_fullsized":"2024-05-14T15:17:43.845716+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:40:33.441154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850727+0000","last_change":"2024-05-14T15:16:22.911265+0000","last_active":"2024-05-14T15:17:43.850727+0000","last_peered":"2024-05-14T15:17:43.850727+0000","last_clean":"2024-05-14T15:17:43.850727+0000","last_became_active":"2024-05-14T15:16:22.910297+0000","last_became_peered":"2024-05-14T15:16:22.910297+0000","last_unstale":"2024-05-14T15:17:43.850727+0000","last_undegraded":"2024-05-14T15:17:43.850727+0000","last_fullsized":"2024-05-14T15:17:43.850727+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:43:37.894409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.854048+0000","last_change":"2024-05-14T15:16:03.735122+0000","last_active":"2024-05-14T15:17:43.854048+0000","last_peered":"2024-05-14T15:17:43.854048+0000","last_clean":"2024-05-14T15:17:43.854048+0000","last_became_active":"2024-05-14T15:16:03.734746+0000","last_became_peered":"2024-05-14T15:16:03.734746+0000","last_unstale":"2024-05-14T15:17:43.854048+0000","last_undegraded":"2024-05-14T15:17:43.854048+0000","last_fullsized":"2024-05-14T15:17:43.854048+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:36:48.070577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.738567+0000","last_change":"2024-05-14T15:16:08.791427+0000","last_active":"2024-05-14T15:17:43.738567+0000","last_peered":"2024-05-14T15:17:43.738567+0000","last_clean":"2024-05-14T15:17:43.738567+0000","last_became_active":"2024-05-14T15:16:08.791070+0000","last_became_peered":"2024-05-14T15:16:08.791070+0000","last_unstale":"2024-05-14T15:17:43.738567+0000","last_undegraded":"2024-05-14T15:17:43.738567+0000","last_fullsized":"2024-05-14T15:17:43.738567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:15:13.153055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.725931+0000","last_change":"2024-05-14T15:16:22.896084+0000","last_active":"2024-05-14T15:17:43.725931+0000","last_peered":"2024-05-14T15:17:43.725931+0000","last_clean":"2024-05-14T15:17:43.725931+0000","last_became_active":"2024-05-14T15:16:22.894473+0000","last_became_peered":"2024-05-14T15:16:22.894473+0000","last_unstale":"2024-05-14T15:17:43.725931+0000","last_undegraded":"2024-05-14T15:17:43.725931+0000","last_fullsized":"2024-05-14T15:17:43.725931+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:18:18.844423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'6","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:17.517551+0000","last_change":"2024-05-14T15:16:03.728070+0000","last_active":"2024-05-14T15:18:17.517551+0000","last_peered":"2024-05-14T15:18:17.517551+0000","last_clean":"2024-05-14T15:18:17.517551+0000","last_became_active":"2024-05-14T15:16:03.726155+0000","last_became_peered":"2024-05-14T15:16:03.726155+0000","last_unstale":"2024-05-14T15:18:17.517551+0000","last_undegraded":"2024-05-14T15:18:17.517551+0000","last_fullsized":"2024-05-14T15:18:17.517551+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:50:43.447812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":45,"num_read_kb":4,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.738212+0000","last_change":"2024-05-14T15:16:08.787281+0000","last_active":"2024-05-14T15:17:43.738212+0000","last_peered":"2024-05-14T15:17:43.738212+0000","last_clean":"2024-05-14T15:17:43.738212+0000","last_became_active":"2024-05-14T15:16:08.786910+0000","last_became_peered":"2024-05-14T15:16:08.786910+0000","last_unstale":"2024-05-14T15:17:43.738212+0000","last_undegraded":"2024-05-14T15:17:43.738212+0000","last_fullsized":"2024-05-14T15:17:43.738212+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:03:35.421845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846246+0000","last_change":"2024-05-14T15:16:43.066135+0000","last_active":"2024-05-14T15:17:43.846246+0000","last_peered":"2024-05-14T15:17:43.846246+0000","last_clean":"2024-05-14T15:17:43.846246+0000","last_became_active":"2024-05-14T15:16:43.064558+0000","last_became_peered":"2024-05-14T15:16:43.064558+0000","last_unstale":"2024-05-14T15:17:43.846246+0000","last_undegraded":"2024-05-14T15:17:43.846246+0000","last_fullsized":"2024-05-14T15:17:43.846246+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:21:25.441639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":62,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850407+0000","last_change":"2024-05-14T15:16:03.841009+0000","last_active":"2024-05-14T15:17:43.850407+0000","last_peered":"2024-05-14T15:17:43.850407+0000","last_clean":"2024-05-14T15:17:43.850407+0000","last_became_active":"2024-05-14T15:16:03.839514+0000","last_became_peered":"2024-05-14T15:16:03.839514+0000","last_unstale":"2024-05-14T15:17:43.850407+0000","last_undegraded":"2024-05-14T15:17:43.850407+0000","last_fullsized":"2024-05-14T15:17:43.850407+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:34:55.588072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849973+0000","last_change":"2024-05-14T15:16:08.774343+0000","last_active":"2024-05-14T15:17:43.849973+0000","last_peered":"2024-05-14T15:17:43.849973+0000","last_clean":"2024-05-14T15:17:43.849973+0000","last_became_active":"2024-05-14T15:16:08.773826+0000","last_became_peered":"2024-05-14T15:16:08.773826+0000","last_unstale":"2024-05-14T15:17:43.849973+0000","last_undegraded":"2024-05-14T15:17:43.849973+0000","last_fullsized":"2024-05-14T15:17:43.849973+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:30:51.648019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849689+0000","last_change":"2024-05-14T15:16:22.889838+0000","last_active":"2024-05-14T15:17:43.849689+0000","last_peered":"2024-05-14T15:17:43.849689+0000","last_clean":"2024-05-14T15:17:43.849689+0000","last_became_active":"2024-05-14T15:16:22.888604+0000","last_became_peered":"2024-05-14T15:16:22.888604+0000","last_unstale":"2024-05-14T15:17:43.849689+0000","last_undegraded":"2024-05-14T15:17:43.849689+0000","last_fullsized":"2024-05-14T15:17:43.849689+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:26:53.176588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.853807+0000","last_change":"2024-05-14T15:16:03.731499+0000","last_active":"2024-05-14T15:17:43.853807+0000","last_peered":"2024-05-14T15:17:43.853807+0000","last_clean":"2024-05-14T15:17:43.853807+0000","last_became_active":"2024-05-14T15:16:03.729387+0000","last_became_peered":"2024-05-14T15:16:03.729387+0000","last_unstale":"2024-05-14T15:17:43.853807+0000","last_undegraded":"2024-05-14T15:17:43.853807+0000","last_fullsized":"2024-05-14T15:17:43.853807+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:52:24.287236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852263+0000","last_change":"2024-05-14T15:16:08.787376+0000","last_active":"2024-05-14T15:17:43.852263+0000","last_peered":"2024-05-14T15:17:43.852263+0000","last_clean":"2024-05-14T15:17:43.852263+0000","last_became_active":"2024-05-14T15:16:08.786057+0000","last_became_peered":"2024-05-14T15:16:08.786057+0000","last_unstale":"2024-05-14T15:17:43.852263+0000","last_undegraded":"2024-05-14T15:17:43.852263+0000","last_fullsized":"2024-05-14T15:17:43.852263+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:17:16.582656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852579+0000","last_change":"2024-05-14T15:16:23.049639+0000","last_active":"2024-05-14T15:17:43.852579+0000","last_peered":"2024-05-14T15:17:43.852579+0000","last_clean":"2024-05-14T15:17:43.852579+0000","last_became_active":"2024-05-14T15:16:23.047746+0000","last_became_peered":"2024-05-14T15:16:23.047746+0000","last_unstale":"2024-05-14T15:17:43.852579+0000","last_undegraded":"2024-05-14T15:17:43.852579+0000","last_fullsized":"2024-05-14T15:17:43.852579+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:22:27.129466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.726894+0000","last_change":"2024-05-14T15:16:03.842156+0000","last_active":"2024-05-14T15:17:43.726894+0000","last_peered":"2024-05-14T15:17:43.726894+0000","last_clean":"2024-05-14T15:17:43.726894+0000","last_became_active":"2024-05-14T15:16:03.841626+0000","last_became_peered":"2024-05-14T15:16:03.841626+0000","last_unstale":"2024-05-14T15:17:43.726894+0000","last_undegraded":"2024-05-14T15:17:43.726894+0000","last_fullsized":"2024-05-14T15:17:43.726894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:40.955009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.848201+0000","last_change":"2024-05-14T15:16:08.780632+0000","last_active":"2024-05-14T15:17:43.848201+0000","last_peered":"2024-05-14T15:17:43.848201+0000","last_clean":"2024-05-14T15:17:43.848201+0000","last_became_active":"2024-05-14T15:16:08.779743+0000","last_became_peered":"2024-05-14T15:16:08.779743+0000","last_unstale":"2024-05-14T15:17:43.848201+0000","last_undegraded":"2024-05-14T15:17:43.848201+0000","last_fullsized":"2024-05-14T15:17:43.848201+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:53:45.608716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846100+0000","last_change":"2024-05-14T15:16:22.894512+0000","last_active":"2024-05-14T15:17:43.846100+0000","last_peered":"2024-05-14T15:17:43.846100+0000","last_clean":"2024-05-14T15:17:43.846100+0000","last_became_active":"2024-05-14T15:16:22.893566+0000","last_became_peered":"2024-05-14T15:16:22.893566+0000","last_unstale":"2024-05-14T15:17:43.846100+0000","last_undegraded":"2024-05-14T15:17:43.846100+0000","last_fullsized":"2024-05-14T15:17:43.846100+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:45:39.571364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'6","reported_seq":93,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:16.488598+0000","last_change":"2024-05-14T15:16:03.730782+0000","last_active":"2024-05-14T15:18:16.488598+0000","last_peered":"2024-05-14T15:18:16.488598+0000","last_clean":"2024-05-14T15:18:16.488598+0000","last_became_active":"2024-05-14T15:16:03.729703+0000","last_became_peered":"2024-05-14T15:16:03.729703+0000","last_unstale":"2024-05-14T15:18:16.488598+0000","last_undegraded":"2024-05-14T15:18:16.488598+0000","last_fullsized":"2024-05-14T15:18:16.488598+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:30:30.379450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":979,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":2,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.847586+0000","last_change":"2024-05-14T15:16:08.792362+0000","last_active":"2024-05-14T15:17:43.847586+0000","last_peered":"2024-05-14T15:17:43.847586+0000","last_clean":"2024-05-14T15:17:43.847586+0000","last_became_active":"2024-05-14T15:16:08.791836+0000","last_became_peered":"2024-05-14T15:16:08.791836+0000","last_unstale":"2024-05-14T15:17:43.847586+0000","last_undegraded":"2024-05-14T15:17:43.847586+0000","last_fullsized":"2024-05-14T15:17:43.847586+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:50:07.142474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846345+0000","last_change":"2024-05-14T15:16:23.048324+0000","last_active":"2024-05-14T15:17:43.846345+0000","last_peered":"2024-05-14T15:17:43.846345+0000","last_clean":"2024-05-14T15:17:43.846345+0000","last_became_active":"2024-05-14T15:16:23.047829+0000","last_became_peered":"2024-05-14T15:16:23.047829+0000","last_unstale":"2024-05-14T15:17:43.846345+0000","last_undegraded":"2024-05-14T15:17:43.846345+0000","last_fullsized":"2024-05-14T15:17:43.846345+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:13.018847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849948+0000","last_change":"2024-05-14T15:16:43.013252+0000","last_active":"2024-05-14T15:17:43.849948+0000","last_peered":"2024-05-14T15:17:43.849948+0000","last_clean":"2024-05-14T15:17:43.849948+0000","last_became_active":"2024-05-14T15:16:43.011962+0000","last_became_peered":"2024-05-14T15:16:43.011962+0000","last_unstale":"2024-05-14T15:17:43.849948+0000","last_undegraded":"2024-05-14T15:17:43.849948+0000","last_fullsized":"2024-05-14T15:17:43.849948+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:06.204259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":88,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:13.505539+0000","last_change":"2024-05-14T15:16:03.840983+0000","last_active":"2024-05-14T15:18:13.505539+0000","last_peered":"2024-05-14T15:18:13.505539+0000","last_clean":"2024-05-14T15:18:13.505539+0000","last_became_active":"2024-05-14T15:16:03.839117+0000","last_became_peered":"2024-05-14T15:16:03.839117+0000","last_unstale":"2024-05-14T15:18:13.505539+0000","last_undegraded":"2024-05-14T15:18:13.505539+0000","last_fullsized":"2024-05-14T15:18:13.505539+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:57.163543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":38,"num_read_kb":38,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.739156+0000","last_change":"2024-05-14T15:16:22.914744+0000","last_active":"2024-05-14T15:17:43.739156+0000","last_peered":"2024-05-14T15:17:43.739156+0000","last_clean":"2024-05-14T15:17:43.739156+0000","last_became_active":"2024-05-14T15:16:22.913661+0000","last_became_peered":"2024-05-14T15:16:22.913661+0000","last_unstale":"2024-05-14T15:17:43.739156+0000","last_undegraded":"2024-05-14T15:17:43.739156+0000","last_fullsized":"2024-05-14T15:17:43.739156+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:45.957828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.735999+0000","last_change":"2024-05-14T15:16:08.791872+0000","last_active":"2024-05-14T15:17:43.735999+0000","last_peered":"2024-05-14T15:17:43.735999+0000","last_clean":"2024-05-14T15:17:43.735999+0000","last_became_active":"2024-05-14T15:16:08.791229+0000","last_became_peered":"2024-05-14T15:16:08.791229+0000","last_unstale":"2024-05-14T15:17:43.735999+0000","last_undegraded":"2024-05-14T15:17:43.735999+0000","last_fullsized":"2024-05-14T15:17:43.735999+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:36:26.391077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.758292+0000","last_change":"2024-05-14T15:16:03.732872+0000","last_active":"2024-05-14T15:17:43.758292+0000","last_peered":"2024-05-14T15:17:43.758292+0000","last_clean":"2024-05-14T15:17:43.758292+0000","last_became_active":"2024-05-14T15:16:03.732188+0000","last_became_peered":"2024-05-14T15:16:03.732188+0000","last_unstale":"2024-05-14T15:17:43.758292+0000","last_undegraded":"2024-05-14T15:17:43.758292+0000","last_fullsized":"2024-05-14T15:17:43.758292+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:20:56.776521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.737696+0000","last_change":"2024-05-14T15:14:08.407259+0000","last_active":"2024-05-14T15:17:43.737696+0000","last_peered":"2024-05-14T15:17:43.737696+0000","last_clean":"2024-05-14T15:17:43.737696+0000","last_became_active":"2024-05-14T15:14:08.398012+0000","last_became_peered":"2024-05-14T15:14:08.398012+0000","last_unstale":"2024-05-14T15:17:43.737696+0000","last_undegraded":"2024-05-14T15:17:43.737696+0000","last_fullsized":"2024-05-14T15:17:43.737696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:09:04.015044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:09:04.015044+0000","last_clean_scrub_stamp":"2024-05-14T15:09:04.015044+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:37.256490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852180+0000","last_change":"2024-05-14T15:16:23.053989+0000","last_active":"2024-05-14T15:17:43.852180+0000","last_peered":"2024-05-14T15:17:43.852180+0000","last_clean":"2024-05-14T15:17:43.852180+0000","last_became_active":"2024-05-14T15:16:23.052585+0000","last_became_peered":"2024-05-14T15:16:23.052585+0000","last_unstale":"2024-05-14T15:17:43.852180+0000","last_undegraded":"2024-05-14T15:17:43.852180+0000","last_fullsized":"2024-05-14T15:17:43.852180+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:30.104518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845221+0000","last_change":"2024-05-14T15:16:08.775447+0000","last_active":"2024-05-14T15:17:43.845221+0000","last_peered":"2024-05-14T15:17:43.845221+0000","last_clean":"2024-05-14T15:17:43.845221+0000","last_became_active":"2024-05-14T15:16:08.775055+0000","last_became_peered":"2024-05-14T15:16:08.775055+0000","last_unstale":"2024-05-14T15:17:43.845221+0000","last_undegraded":"2024-05-14T15:17:43.845221+0000","last_fullsized":"2024-05-14T15:17:43.845221+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:57:24.668939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.738150+0000","last_change":"2024-05-14T15:16:03.735221+0000","last_active":"2024-05-14T15:17:43.738150+0000","last_peered":"2024-05-14T15:17:43.738150+0000","last_clean":"2024-05-14T15:17:43.738150+0000","last_became_active":"2024-05-14T15:16:03.731910+0000","last_became_peered":"2024-05-14T15:16:03.731910+0000","last_unstale":"2024-05-14T15:17:43.738150+0000","last_undegraded":"2024-05-14T15:17:43.738150+0000","last_fullsized":"2024-05-14T15:17:43.738150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:57:18.030308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850335+0000","last_change":"2024-05-14T15:16:22.910564+0000","last_active":"2024-05-14T15:17:43.850335+0000","last_peered":"2024-05-14T15:17:43.850335+0000","last_clean":"2024-05-14T15:17:43.850335+0000","last_became_active":"2024-05-14T15:16:22.910003+0000","last_became_peered":"2024-05-14T15:16:22.910003+0000","last_unstale":"2024-05-14T15:17:43.850335+0000","last_undegraded":"2024-05-14T15:17:43.850335+0000","last_fullsized":"2024-05-14T15:17:43.850335+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:47.895767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.854379+0000","last_change":"2024-05-14T15:16:03.844236+0000","last_active":"2024-05-14T15:17:43.854379+0000","last_peered":"2024-05-14T15:17:43.854379+0000","last_clean":"2024-05-14T15:17:43.854379+0000","last_became_active":"2024-05-14T15:16:03.841253+0000","last_became_peered":"2024-05-14T15:16:03.841253+0000","last_unstale":"2024-05-14T15:17:43.854379+0000","last_undegraded":"2024-05-14T15:17:43.854379+0000","last_fullsized":"2024-05-14T15:17:43.854379+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:40:24.440707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846269+0000","last_change":"2024-05-14T15:16:08.782849+0000","last_active":"2024-05-14T15:17:43.846269+0000","last_peered":"2024-05-14T15:17:43.846269+0000","last_clean":"2024-05-14T15:17:43.846269+0000","last_became_active":"2024-05-14T15:16:08.781999+0000","last_became_peered":"2024-05-14T15:16:08.781999+0000","last_unstale":"2024-05-14T15:17:43.846269+0000","last_undegraded":"2024-05-14T15:17:43.846269+0000","last_fullsized":"2024-05-14T15:17:43.846269+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:33:03.997615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.735546+0000","last_change":"2024-05-14T15:16:23.049719+0000","last_active":"2024-05-14T15:17:43.735546+0000","last_peered":"2024-05-14T15:17:43.735546+0000","last_clean":"2024-05-14T15:17:43.735546+0000","last_became_active":"2024-05-14T15:16:23.048547+0000","last_became_peered":"2024-05-14T15:16:23.048547+0000","last_unstale":"2024-05-14T15:17:43.735546+0000","last_undegraded":"2024-05-14T15:17:43.735546+0000","last_fullsized":"2024-05-14T15:17:43.735546+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:41:49.790521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'16","reported_seq":61,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:08.843606+0000","last_change":"2024-05-14T15:16:03.729413+0000","last_active":"2024-05-14T15:18:08.843606+0000","last_peered":"2024-05-14T15:18:08.843606+0000","last_clean":"2024-05-14T15:18:08.843606+0000","last_became_active":"2024-05-14T15:16:03.728491+0000","last_became_peered":"2024-05-14T15:16:03.728491+0000","last_unstale":"2024-05-14T15:18:08.843606+0000","last_undegraded":"2024-05-14T15:18:08.843606+0000","last_fullsized":"2024-05-14T15:18:08.843606+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:34:04.811775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.736423+0000","last_change":"2024-05-14T15:16:08.784237+0000","last_active":"2024-05-14T15:17:43.736423+0000","last_peered":"2024-05-14T15:17:43.736423+0000","last_clean":"2024-05-14T15:17:43.736423+0000","last_became_active":"2024-05-14T15:16:08.783908+0000","last_became_peered":"2024-05-14T15:16:08.783908+0000","last_unstale":"2024-05-14T15:17:43.736423+0000","last_undegraded":"2024-05-14T15:17:43.736423+0000","last_fullsized":"2024-05-14T15:17:43.736423+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:43:24.621314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.729419+0000","last_change":"2024-05-14T15:16:22.909928+0000","last_active":"2024-05-14T15:17:43.729419+0000","last_peered":"2024-05-14T15:17:43.729419+0000","last_clean":"2024-05-14T15:17:43.729419+0000","last_became_active":"2024-05-14T15:16:22.909412+0000","last_became_peered":"2024-05-14T15:16:22.909412+0000","last_unstale":"2024-05-14T15:17:43.729419+0000","last_undegraded":"2024-05-14T15:17:43.729419+0000","last_fullsized":"2024-05-14T15:17:43.729419+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:18:26.324189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.759969+0000","last_change":"2024-05-14T15:16:03.729846+0000","last_active":"2024-05-14T15:17:43.759969+0000","last_peered":"2024-05-14T15:17:43.759969+0000","last_clean":"2024-05-14T15:17:43.759969+0000","last_became_active":"2024-05-14T15:16:03.729385+0000","last_became_peered":"2024-05-14T15:16:03.729385+0000","last_unstale":"2024-05-14T15:17:43.759969+0000","last_undegraded":"2024-05-14T15:17:43.759969+0000","last_fullsized":"2024-05-14T15:17:43.759969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:05:18.987237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845001+0000","last_change":"2024-05-14T15:16:08.796017+0000","last_active":"2024-05-14T15:17:43.845001+0000","last_peered":"2024-05-14T15:17:43.845001+0000","last_clean":"2024-05-14T15:17:43.845001+0000","last_became_active":"2024-05-14T15:16:08.791627+0000","last_became_peered":"2024-05-14T15:16:08.791627+0000","last_unstale":"2024-05-14T15:17:43.845001+0000","last_undegraded":"2024-05-14T15:17:43.845001+0000","last_fullsized":"2024-05-14T15:17:43.845001+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:46:27.910669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.759053+0000","last_change":"2024-05-14T15:16:23.052954+0000","last_active":"2024-05-14T15:17:43.759053+0000","last_peered":"2024-05-14T15:17:43.759053+0000","last_clean":"2024-05-14T15:17:43.759053+0000","last_became_active":"2024-05-14T15:16:23.051410+0000","last_became_peered":"2024-05-14T15:16:23.051410+0000","last_unstale":"2024-05-14T15:17:43.759053+0000","last_undegraded":"2024-05-14T15:17:43.759053+0000","last_fullsized":"2024-05-14T15:17:43.759053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:28:55.181866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.727212+0000","last_change":"2024-05-14T15:16:43.023961+0000","last_active":"2024-05-14T15:17:43.727212+0000","last_peered":"2024-05-14T15:17:43.727212+0000","last_clean":"2024-05-14T15:17:43.727212+0000","last_became_active":"2024-05-14T15:16:43.022677+0000","last_became_peered":"2024-05-14T15:16:43.022677+0000","last_unstale":"2024-05-14T15:17:43.727212+0000","last_undegraded":"2024-05-14T15:17:43.727212+0000","last_fullsized":"2024-05-14T15:17:43.727212+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:33:16.692984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.851032+0000","last_change":"2024-05-14T15:16:08.780415+0000","last_active":"2024-05-14T15:17:43.851032+0000","last_peered":"2024-05-14T15:17:43.851032+0000","last_clean":"2024-05-14T15:17:43.851032+0000","last_became_active":"2024-05-14T15:16:08.780053+0000","last_became_peered":"2024-05-14T15:16:08.780053+0000","last_unstale":"2024-05-14T15:17:43.851032+0000","last_undegraded":"2024-05-14T15:17:43.851032+0000","last_fullsized":"2024-05-14T15:17:43.851032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:18:00.964346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":16,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.853607+0000","last_change":"2024-05-14T15:16:43.066458+0000","last_active":"2024-05-14T15:17:43.853607+0000","last_peered":"2024-05-14T15:17:43.853607+0000","last_clean":"2024-05-14T15:17:43.853607+0000","last_became_active":"2024-05-14T15:16:43.064035+0000","last_became_peered":"2024-05-14T15:16:43.064035+0000","last_unstale":"2024-05-14T15:17:43.853607+0000","last_undegraded":"2024-05-14T15:17:43.853607+0000","last_fullsized":"2024-05-14T15:17:43.853607+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:38:39.895882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.735934+0000","last_change":"2024-05-14T15:16:03.731962+0000","last_active":"2024-05-14T15:17:43.735934+0000","last_peered":"2024-05-14T15:17:43.735934+0000","last_clean":"2024-05-14T15:17:43.735934+0000","last_became_active":"2024-05-14T15:16:03.726532+0000","last_became_peered":"2024-05-14T15:16:03.726532+0000","last_unstale":"2024-05-14T15:17:43.735934+0000","last_undegraded":"2024-05-14T15:17:43.735934+0000","last_fullsized":"2024-05-14T15:17:43.735934+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:47:26.809212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849178+0000","last_change":"2024-05-14T15:16:08.798984+0000","last_active":"2024-05-14T15:17:43.849178+0000","last_peered":"2024-05-14T15:17:43.849178+0000","last_clean":"2024-05-14T15:17:43.849178+0000","last_became_active":"2024-05-14T15:16:08.798120+0000","last_became_peered":"2024-05-14T15:16:08.798120+0000","last_unstale":"2024-05-14T15:17:43.849178+0000","last_undegraded":"2024-05-14T15:17:43.849178+0000","last_fullsized":"2024-05-14T15:17:43.849178+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:58.519436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.758682+0000","last_change":"2024-05-14T15:16:22.907994+0000","last_active":"2024-05-14T15:17:43.758682+0000","last_peered":"2024-05-14T15:17:43.758682+0000","last_clean":"2024-05-14T15:17:43.758682+0000","last_became_active":"2024-05-14T15:16:22.907144+0000","last_became_peered":"2024-05-14T15:16:22.907144+0000","last_unstale":"2024-05-14T15:17:43.758682+0000","last_undegraded":"2024-05-14T15:17:43.758682+0000","last_fullsized":"2024-05-14T15:17:43.758682+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:49:11.436917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.729953+0000","last_change":"2024-05-14T15:16:03.728334+0000","last_active":"2024-05-14T15:17:43.729953+0000","last_peered":"2024-05-14T15:17:43.729953+0000","last_clean":"2024-05-14T15:17:43.729953+0000","last_became_active":"2024-05-14T15:16:03.727836+0000","last_became_peered":"2024-05-14T15:16:03.727836+0000","last_unstale":"2024-05-14T15:17:43.729953+0000","last_undegraded":"2024-05-14T15:17:43.729953+0000","last_fullsized":"2024-05-14T15:17:43.729953+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:54.780821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.736399+0000","last_change":"2024-05-14T15:16:08.798340+0000","last_active":"2024-05-14T15:17:43.736399+0000","last_peered":"2024-05-14T15:17:43.736399+0000","last_clean":"2024-05-14T15:17:43.736399+0000","last_became_active":"2024-05-14T15:16:08.797981+0000","last_became_peered":"2024-05-14T15:16:08.797981+0000","last_unstale":"2024-05-14T15:17:43.736399+0000","last_undegraded":"2024-05-14T15:17:43.736399+0000","last_fullsized":"2024-05-14T15:17:43.736399+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:04:08.322033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.759560+0000","last_change":"2024-05-14T15:16:23.050064+0000","last_active":"2024-05-14T15:17:43.759560+0000","last_peered":"2024-05-14T15:17:43.759560+0000","last_clean":"2024-05-14T15:17:43.759560+0000","last_became_active":"2024-05-14T15:16:23.048608+0000","last_became_peered":"2024-05-14T15:16:23.048608+0000","last_unstale":"2024-05-14T15:17:43.759560+0000","last_undegraded":"2024-05-14T15:17:43.759560+0000","last_fullsized":"2024-05-14T15:17:43.759560+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:32.044226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852291+0000","last_change":"2024-05-14T15:16:03.734588+0000","last_active":"2024-05-14T15:17:43.852291+0000","last_peered":"2024-05-14T15:17:43.852291+0000","last_clean":"2024-05-14T15:17:43.852291+0000","last_became_active":"2024-05-14T15:16:03.734112+0000","last_became_peered":"2024-05-14T15:16:03.734112+0000","last_unstale":"2024-05-14T15:17:43.852291+0000","last_undegraded":"2024-05-14T15:17:43.852291+0000","last_fullsized":"2024-05-14T15:17:43.852291+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:07:56.545225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.740082+0000","last_change":"2024-05-14T15:16:08.789481+0000","last_active":"2024-05-14T15:17:43.740082+0000","last_peered":"2024-05-14T15:17:43.740082+0000","last_clean":"2024-05-14T15:17:43.740082+0000","last_became_active":"2024-05-14T15:16:08.788462+0000","last_became_peered":"2024-05-14T15:16:08.788462+0000","last_unstale":"2024-05-14T15:17:43.740082+0000","last_undegraded":"2024-05-14T15:17:43.740082+0000","last_fullsized":"2024-05-14T15:17:43.740082+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:35:06.386410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.727193+0000","last_change":"2024-05-14T15:16:22.903205+0000","last_active":"2024-05-14T15:17:43.727193+0000","last_peered":"2024-05-14T15:17:43.727193+0000","last_clean":"2024-05-14T15:17:43.727193+0000","last_became_active":"2024-05-14T15:16:22.901217+0000","last_became_peered":"2024-05-14T15:16:22.901217+0000","last_unstale":"2024-05-14T15:17:43.727193+0000","last_undegraded":"2024-05-14T15:17:43.727193+0000","last_fullsized":"2024-05-14T15:17:43.727193+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:03:59.160106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'6","reported_seq":94,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:17.497120+0000","last_change":"2024-05-14T15:16:03.840601+0000","last_active":"2024-05-14T15:18:17.497120+0000","last_peered":"2024-05-14T15:18:17.497120+0000","last_clean":"2024-05-14T15:18:17.497120+0000","last_became_active":"2024-05-14T15:16:03.839299+0000","last_became_peered":"2024-05-14T15:16:03.839299+0000","last_unstale":"2024-05-14T15:18:17.497120+0000","last_undegraded":"2024-05-14T15:18:17.497120+0000","last_fullsized":"2024-05-14T15:18:17.497120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:35:46.773419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1561,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":43,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.739687+0000","last_change":"2024-05-14T15:16:08.782915+0000","last_active":"2024-05-14T15:17:43.739687+0000","last_peered":"2024-05-14T15:17:43.739687+0000","last_clean":"2024-05-14T15:17:43.739687+0000","last_became_active":"2024-05-14T15:16:08.782469+0000","last_became_peered":"2024-05-14T15:16:08.782469+0000","last_unstale":"2024-05-14T15:17:43.739687+0000","last_undegraded":"2024-05-14T15:17:43.739687+0000","last_fullsized":"2024-05-14T15:17:43.739687+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:36:35.361723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":35,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.844607+0000","last_change":"2024-05-14T15:16:43.021276+0000","last_active":"2024-05-14T15:17:43.844607+0000","last_peered":"2024-05-14T15:17:43.844607+0000","last_clean":"2024-05-14T15:17:43.844607+0000","last_became_active":"2024-05-14T15:16:43.020534+0000","last_became_peered":"2024-05-14T15:16:43.020534+0000","last_unstale":"2024-05-14T15:17:43.844607+0000","last_undegraded":"2024-05-14T15:17:43.844607+0000","last_fullsized":"2024-05-14T15:17:43.844607+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:31:01.267429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850585+0000","last_change":"2024-05-14T15:16:03.728379+0000","last_active":"2024-05-14T15:17:43.850585+0000","last_peered":"2024-05-14T15:17:43.850585+0000","last_clean":"2024-05-14T15:17:43.850585+0000","last_became_active":"2024-05-14T15:16:03.727580+0000","last_became_peered":"2024-05-14T15:16:03.727580+0000","last_unstale":"2024-05-14T15:17:43.850585+0000","last_undegraded":"2024-05-14T15:17:43.850585+0000","last_fullsized":"2024-05-14T15:17:43.850585+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:54:20.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.854489+0000","last_change":"2024-05-14T15:17:43.854489+0000","last_active":"2024-05-14T15:17:43.854489+0000","last_peered":"2024-05-14T15:17:43.854489+0000","last_clean":"2024-05-14T15:17:43.854489+0000","last_became_active":"2024-05-14T15:17:43.853624+0000","last_became_peered":"2024-05-14T15:17:43.853624+0000","last_unstale":"2024-05-14T15:17:43.854489+0000","last_undegraded":"2024-05-14T15:17:43.854489+0000","last_fullsized":"2024-05-14T15:17:43.854489+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:59.686248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.848460+0000","last_change":"2024-05-14T15:16:22.911248+0000","last_active":"2024-05-14T15:17:43.848460+0000","last_peered":"2024-05-14T15:17:43.848460+0000","last_clean":"2024-05-14T15:17:43.848460+0000","last_became_active":"2024-05-14T15:16:22.909975+0000","last_became_peered":"2024-05-14T15:16:22.909975+0000","last_unstale":"2024-05-14T15:17:43.848460+0000","last_undegraded":"2024-05-14T15:17:43.848460+0000","last_fullsized":"2024-05-14T15:17:43.848460+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:23.140008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846116+0000","last_change":"2024-05-14T15:16:03.728422+0000","last_active":"2024-05-14T15:17:43.846116+0000","last_peered":"2024-05-14T15:17:43.846116+0000","last_clean":"2024-05-14T15:17:43.846116+0000","last_became_active":"2024-05-14T15:16:03.727428+0000","last_became_peered":"2024-05-14T15:16:03.727428+0000","last_unstale":"2024-05-14T15:17:43.846116+0000","last_undegraded":"2024-05-14T15:17:43.846116+0000","last_fullsized":"2024-05-14T15:17:43.846116+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:37:15.472001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.739025+0000","last_change":"2024-05-14T15:16:08.782158+0000","last_active":"2024-05-14T15:17:43.739025+0000","last_peered":"2024-05-14T15:17:43.739025+0000","last_clean":"2024-05-14T15:17:43.739025+0000","last_became_active":"2024-05-14T15:16:08.781761+0000","last_became_peered":"2024-05-14T15:16:08.781761+0000","last_unstale":"2024-05-14T15:17:43.739025+0000","last_undegraded":"2024-05-14T15:17:43.739025+0000","last_fullsized":"2024-05-14T15:17:43.739025+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:01:42.886837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849159+0000","last_change":"2024-05-14T15:16:08.789851+0000","last_active":"2024-05-14T15:17:43.849159+0000","last_peered":"2024-05-14T15:17:43.849159+0000","last_clean":"2024-05-14T15:17:43.849159+0000","last_became_active":"2024-05-14T15:16:08.787563+0000","last_became_peered":"2024-05-14T15:16:08.787563+0000","last_unstale":"2024-05-14T15:17:43.849159+0000","last_undegraded":"2024-05-14T15:17:43.849159+0000","last_fullsized":"2024-05-14T15:17:43.849159+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:02:16.592481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730526+0000","last_change":"2024-05-14T15:16:08.788989+0000","last_active":"2024-05-14T15:17:43.730526+0000","last_peered":"2024-05-14T15:17:43.730526+0000","last_clean":"2024-05-14T15:17:43.730526+0000","last_became_active":"2024-05-14T15:16:08.785064+0000","last_became_peered":"2024-05-14T15:16:08.785064+0000","last_unstale":"2024-05-14T15:17:43.730526+0000","last_undegraded":"2024-05-14T15:17:43.730526+0000","last_fullsized":"2024-05-14T15:17:43.730526+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:12:30.824113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.729857+0000","last_change":"2024-05-14T15:16:08.785849+0000","last_active":"2024-05-14T15:17:43.729857+0000","last_peered":"2024-05-14T15:17:43.729857+0000","last_clean":"2024-05-14T15:17:43.729857+0000","last_became_active":"2024-05-14T15:16:08.785487+0000","last_became_peered":"2024-05-14T15:16:08.785487+0000","last_unstale":"2024-05-14T15:17:43.729857+0000","last_undegraded":"2024-05-14T15:17:43.729857+0000","last_fullsized":"2024-05-14T15:17:43.729857+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:37:16.435154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845021+0000","last_change":"2024-05-14T15:16:08.787843+0000","last_active":"2024-05-14T15:17:43.845021+0000","last_peered":"2024-05-14T15:17:43.845021+0000","last_clean":"2024-05-14T15:17:43.845021+0000","last_became_active":"2024-05-14T15:16:08.787485+0000","last_became_peered":"2024-05-14T15:16:08.787485+0000","last_unstale":"2024-05-14T15:17:43.845021+0000","last_undegraded":"2024-05-14T15:17:43.845021+0000","last_fullsized":"2024-05-14T15:17:43.845021+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:16:06.625923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846208+0000","last_change":"2024-05-14T15:16:08.784870+0000","last_active":"2024-05-14T15:17:43.846208+0000","last_peered":"2024-05-14T15:17:43.846208+0000","last_clean":"2024-05-14T15:17:43.846208+0000","last_became_active":"2024-05-14T15:16:08.782496+0000","last_became_peered":"2024-05-14T15:16:08.782496+0000","last_unstale":"2024-05-14T15:17:43.846208+0000","last_undegraded":"2024-05-14T15:17:43.846208+0000","last_fullsized":"2024-05-14T15:17:43.846208+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:54:33.724823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.853872+0000","last_change":"2024-05-14T15:16:08.783203+0000","last_active":"2024-05-14T15:17:43.853872+0000","last_peered":"2024-05-14T15:17:43.853872+0000","last_clean":"2024-05-14T15:17:43.853872+0000","last_became_active":"2024-05-14T15:16:08.782758+0000","last_became_peered":"2024-05-14T15:16:08.782758+0000","last_unstale":"2024-05-14T15:17:43.853872+0000","last_undegraded":"2024-05-14T15:17:43.853872+0000","last_fullsized":"2024-05-14T15:17:43.853872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:34:33.274511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":39,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.731660+0000","last_change":"2024-05-14T15:16:08.789727+0000","last_active":"2024-05-14T15:17:43.731660+0000","last_peered":"2024-05-14T15:17:43.731660+0000","last_clean":"2024-05-14T15:17:43.731660+0000","last_became_active":"2024-05-14T15:16:08.784434+0000","last_became_peered":"2024-05-14T15:16:08.784434+0000","last_unstale":"2024-05-14T15:17:43.731660+0000","last_undegraded":"2024-05-14T15:17:43.731660+0000","last_fullsized":"2024-05-14T15:17:43.731660+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:59:19.835381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.736631+0000","last_change":"2024-05-14T15:16:08.781887+0000","last_active":"2024-05-14T15:17:43.736631+0000","last_peered":"2024-05-14T15:17:43.736631+0000","last_clean":"2024-05-14T15:17:43.736631+0000","last_became_active":"2024-05-14T15:16:08.781332+0000","last_became_peered":"2024-05-14T15:16:08.781332+0000","last_unstale":"2024-05-14T15:17:43.736631+0000","last_undegraded":"2024-05-14T15:17:43.736631+0000","last_fullsized":"2024-05-14T15:17:43.736631+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:51:36.558485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":15,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.737478+0000","last_change":"2024-05-14T15:16:43.065016+0000","last_active":"2024-05-14T15:17:43.737478+0000","last_peered":"2024-05-14T15:17:43.737478+0000","last_clean":"2024-05-14T15:17:43.737478+0000","last_became_active":"2024-05-14T15:16:43.063786+0000","last_became_peered":"2024-05-14T15:16:43.063786+0000","last_unstale":"2024-05-14T15:17:43.737478+0000","last_undegraded":"2024-05-14T15:17:43.737478+0000","last_fullsized":"2024-05-14T15:17:43.737478+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:01:54.920710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.735911+0000","last_change":"2024-05-14T15:16:08.794288+0000","last_active":"2024-05-14T15:17:43.735911+0000","last_peered":"2024-05-14T15:17:43.735911+0000","last_clean":"2024-05-14T15:17:43.735911+0000","last_became_active":"2024-05-14T15:16:08.792059+0000","last_became_peered":"2024-05-14T15:16:08.792059+0000","last_unstale":"2024-05-14T15:17:43.735911+0000","last_undegraded":"2024-05-14T15:17:43.735911+0000","last_fullsized":"2024-05-14T15:17:43.735911+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:30:55.769322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.858583+0000","last_change":"2024-05-14T15:17:43.858583+0000","last_active":"2024-05-14T15:17:43.858583+0000","last_peered":"2024-05-14T15:17:43.858583+0000","last_clean":"2024-05-14T15:17:43.858583+0000","last_became_active":"2024-05-14T15:17:43.857287+0000","last_became_peered":"2024-05-14T15:17:43.857287+0000","last_unstale":"2024-05-14T15:17:43.858583+0000","last_undegraded":"2024-05-14T15:17:43.858583+0000","last_fullsized":"2024-05-14T15:17:43.858583+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:12:31.471747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":38,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846064+0000","last_change":"2024-05-14T15:16:08.786726+0000","last_active":"2024-05-14T15:17:43.846064+0000","last_peered":"2024-05-14T15:17:43.846064+0000","last_clean":"2024-05-14T15:17:43.846064+0000","last_became_active":"2024-05-14T15:16:08.785599+0000","last_became_peered":"2024-05-14T15:16:08.785599+0000","last_unstale":"2024-05-14T15:17:43.846064+0000","last_undegraded":"2024-05-14T15:17:43.846064+0000","last_fullsized":"2024-05-14T15:17:43.846064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:33:18.055459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.851244+0000","last_change":"2024-05-14T15:16:43.022021+0000","last_active":"2024-05-14T15:17:43.851244+0000","last_peered":"2024-05-14T15:17:43.851244+0000","last_clean":"2024-05-14T15:17:43.851244+0000","last_became_active":"2024-05-14T15:16:43.021511+0000","last_became_peered":"2024-05-14T15:16:43.021511+0000","last_unstale":"2024-05-14T15:17:43.851244+0000","last_undegraded":"2024-05-14T15:17:43.851244+0000","last_fullsized":"2024-05-14T15:17:43.851244+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:59:55.083356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":74467,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":433,"num_read_kb":295,"num_write":253,"num_write_kb":148,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":223401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":218,"ondisk_log_size":218,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645358,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1056768,"data_stored":526497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841588,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32892,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712260,"statfs":{"total":95995035648,"available":95961354240,"internally_reserved":0,"allocated":1757184,"data_stored":1179794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005117,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":530132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201348,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1077248,"data_stored":526414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430283,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32812,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712340,"statfs":{"total":95995035648,"available":95961436160,"internally_reserved":0,"allocated":1675264,"data_stored":1123693,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593811,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32216,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712936,"statfs":{"total":95995035648,"available":95962046464,"internally_reserved":0,"allocated":1056768,"data_stored":521931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32280,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712872,"statfs":{"total":95995035648,"available":95961980928,"internally_reserved":0,"allocated":1130496,"data_stored":589442,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738496,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1081344,"data_stored":523387,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411441,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1150976,"data_stored":590053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182505,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1069056,"data_stored":521248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986275,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1064960,"data_stored":526005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790043,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32820,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712332,"statfs":{"total":95995035648,"available":95961427968,"internally_reserved":0,"allocated":1683456,"data_stored":1118493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":68624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1113,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:18:20.539 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-14T15:18:20.540 INFO:tasks.cephadm:Setting up client nodes... 2024-05-14T15:18:20.540 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-14T15:18:20.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:20 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:18:20.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:20 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:18:20.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:20 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:20.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:20 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:18:20.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:20 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:18:20.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:20 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:18:21.011 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:21.415 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:21 smithi069 ceph-mon[31270]: pgmap v460: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-14T15:18:21.415 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:21 smithi069 ceph-mon[31270]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:18:21.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:21 smithi203 ceph-mon[34567]: pgmap v460: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-14T15:18:21.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:21 smithi203 ceph-mon[34567]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:18:21.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:21 smithi092 ceph-mon[34729]: pgmap v460: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-14T15:18:21.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:21 smithi092 ceph-mon[34729]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:18:23.437 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:23 smithi069 ceph-mon[31270]: pgmap v461: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-14T15:18:23.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.482+0000 7f1ca3200700 1 -- 172.21.15.69:0/4256530997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca41072d0 msgr2=0x7f1ca4109770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:23.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.482+0000 7f1ca3200700 1 --2- 172.21.15.69:0/4256530997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca41072d0 0x7f1ca4109770 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1c90009990 tx=0x7f1c90009ca0 comp rx=0 tx=0).stop 2024-05-14T15:18:23.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.483+0000 7f1ca3200700 1 -- 172.21.15.69:0/4256530997 shutdown_connections 2024-05-14T15:18:23.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.483+0000 7f1ca3200700 1 --2- 172.21.15.69:0/4256530997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ca4109e00 0x7f1ca410c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:23.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.483+0000 7f1ca3200700 1 --2- 172.21.15.69:0/4256530997 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ca406c290 0x7f1ca4106d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:23.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.483+0000 7f1ca3200700 1 --2- 172.21.15.69:0/4256530997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca41072d0 0x7f1ca4109770 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:23.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.483+0000 7f1ca3200700 1 -- 172.21.15.69:0/4256530997 >> 172.21.15.69:0/4256530997 conn(0x7f1ca40fe690 msgr2=0x7f1ca4100b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:23.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.483+0000 7f1ca3200700 1 -- 172.21.15.69:0/4256530997 shutdown_connections 2024-05-14T15:18:23.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.483+0000 7f1ca3200700 1 -- 172.21.15.69:0/4256530997 wait complete. 2024-05-14T15:18:23.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.484+0000 7f1ca3200700 1 Processor -- start 2024-05-14T15:18:23.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.484+0000 7f1ca3200700 1 -- start start 2024-05-14T15:18:23.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.485+0000 7f1ca3200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ca406c290 0x7f1ca419a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:23.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.485+0000 7f1ca3200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ca41072d0 0x7f1ca419ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:23.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.485+0000 7f1ca3200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca4109e00 0x7f1ca41a1b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:23.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.485+0000 7f1ca3200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca410fac0 con 0x7f1ca4109e00 2024-05-14T15:18:23.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.485+0000 7f1ca3200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca410f940 con 0x7f1ca406c290 2024-05-14T15:18:23.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.485+0000 7f1ca3200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f1ca410fc40 con 0x7f1ca41072d0 2024-05-14T15:18:23.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.485+0000 7f1ca2800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca4109e00 0x7f1ca41a1b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:23.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.485+0000 7f1ca2800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca4109e00 0x7f1ca41a1b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52436/0 (socket says 172.21.15.69:52436) 2024-05-14T15:18:23.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.485+0000 7f1ca2800700 1 -- 172.21.15.69:0/1077147074 learned_addr learned my addr 172.21.15.69:0/1077147074 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:23.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.485+0000 7f1ca1e00700 1 --2- 172.21.15.69:0/1077147074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ca406c290 0x7f1ca419a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:23.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.486+0000 7f1ca1400700 1 --2- 172.21.15.69:0/1077147074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ca41072d0 0x7f1ca419ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:23.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.486+0000 7f1ca2800700 1 -- 172.21.15.69:0/1077147074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ca41072d0 msgr2=0x7f1ca419ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:23.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.486+0000 7f1ca2800700 1 --2- 172.21.15.69:0/1077147074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ca41072d0 0x7f1ca419ab80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:23.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.486+0000 7f1ca2800700 1 -- 172.21.15.69:0/1077147074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ca406c290 msgr2=0x7f1ca419a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:23.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.486+0000 7f1ca2800700 1 --2- 172.21.15.69:0/1077147074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ca406c290 0x7f1ca419a640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:23.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.486+0000 7f1ca2800700 1 -- 172.21.15.69:0/1077147074 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ca41a2110 con 0x7f1ca4109e00 2024-05-14T15:18:23.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.486+0000 7f1ca1400700 1 --2- 172.21.15.69:0/1077147074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ca41072d0 0x7f1ca419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:18:23.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.486+0000 7f1ca2800700 1 --2- 172.21.15.69:0/1077147074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca4109e00 0x7f1ca41a1b20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c007d70 tx=0x7f1c9c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:23.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.487+0000 7f1c9aa00700 1 -- 172.21.15.69:0/1077147074 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c016020 con 0x7f1ca4109e00 2024-05-14T15:18:23.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.487+0000 7f1c9aa00700 1 -- 172.21.15.69:0/1077147074 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1c9c00ad40 con 0x7f1ca4109e00 2024-05-14T15:18:23.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.487+0000 7f1ca3200700 1 -- 172.21.15.69:0/1077147074 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ca41a2400 con 0x7f1ca4109e00 2024-05-14T15:18:23.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.487+0000 7f1c9aa00700 1 -- 172.21.15.69:0/1077147074 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c9c0115e0 con 0x7f1ca4109e00 2024-05-14T15:18:23.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.487+0000 7f1ca3200700 1 -- 172.21.15.69:0/1077147074 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ca41a2940 con 0x7f1ca4109e00 2024-05-14T15:18:23.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.488+0000 7f1ca3200700 1 -- 172.21.15.69:0/1077147074 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ca40512c0 con 0x7f1ca4109e00 2024-05-14T15:18:23.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.491+0000 7f1c9aa00700 1 -- 172.21.15.69:0/1077147074 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f1c9c019020 con 0x7f1ca4109e00 2024-05-14T15:18:23.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.492+0000 7f1c9aa00700 1 --2- 172.21.15.69:0/1077147074 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1c880b2990 0x7f1c880b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:23.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.493+0000 7f1c9aa00700 1 -- 172.21.15.69:0/1077147074 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f1c9c0e2a50 con 0x7f1ca4109e00 2024-05-14T15:18:23.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.493+0000 7f1ca1e00700 1 --2- 172.21.15.69:0/1077147074 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1c880b2990 0x7f1c880b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:23.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.494+0000 7f1ca1e00700 1 --2- 172.21.15.69:0/1077147074 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1c880b2990 0x7f1c880b4ea0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1ca406bf90 tx=0x7f1c9400a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:23.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.499+0000 7f1c9aa00700 1 -- 172.21.15.69:0/1077147074 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1c9c020020 con 0x7f1ca4109e00 2024-05-14T15:18:23.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:23 smithi203 ceph-mon[34567]: pgmap v461: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-14T15:18:23.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:23 smithi092 ceph-mon[34729]: pgmap v461: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-14T15:18:23.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.828+0000 7f1ca3200700 1 -- 172.21.15.69:0/1077147074 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f1ca402e690 con 0x7f1ca4109e00 2024-05-14T15:18:23.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.835+0000 7f1c9aa00700 1 -- 172.21.15.69:0/1077147074 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v34) ==== 170+0+59 (secure 0 0 0) 0x7f1ca402e690 con 0x7f1ca4109e00 2024-05-14T15:18:23.835 INFO:teuthology.orchestra.run.smithi069.stdout:[client.0] 2024-05-14T15:18:23.835 INFO:teuthology.orchestra.run.smithi069.stdout: key = AQC/gENmSNiGMRAA2cmyCLEFcf2ZGIjeZ3S88w== 2024-05-14T15:18:23.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.840+0000 7f1ca3200700 1 -- 172.21.15.69:0/1077147074 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1c880b2990 msgr2=0x7f1c880b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:23.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.840+0000 7f1ca3200700 1 --2- 172.21.15.69:0/1077147074 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1c880b2990 0x7f1c880b4ea0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f1ca406bf90 tx=0x7f1c9400a380 comp rx=0 tx=0).stop 2024-05-14T15:18:23.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.840+0000 7f1ca3200700 1 -- 172.21.15.69:0/1077147074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca4109e00 msgr2=0x7f1ca41a1b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:23.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.840+0000 7f1ca3200700 1 --2- 172.21.15.69:0/1077147074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca4109e00 0x7f1ca41a1b20 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1c9c007d70 tx=0x7f1c9c00a340 comp rx=0 tx=0).stop 2024-05-14T15:18:23.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.840+0000 7f1ca3200700 1 -- 172.21.15.69:0/1077147074 shutdown_connections 2024-05-14T15:18:23.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.840+0000 7f1ca3200700 1 --2- 172.21.15.69:0/1077147074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1ca4109e00 0x7f1ca41a1b20 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:23.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.840+0000 7f1ca3200700 1 --2- 172.21.15.69:0/1077147074 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f1c880b2990 0x7f1c880b4ea0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:23.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.840+0000 7f1ca3200700 1 --2- 172.21.15.69:0/1077147074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1ca406c290 0x7f1ca419a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:23.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.840+0000 7f1ca3200700 1 --2- 172.21.15.69:0/1077147074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1ca41072d0 0x7f1ca419ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:23.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.840+0000 7f1ca3200700 1 -- 172.21.15.69:0/1077147074 >> 172.21.15.69:0/1077147074 conn(0x7f1ca40fe690 msgr2=0x7f1ca4105720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:23.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.841+0000 7f1ca3200700 1 -- 172.21.15.69:0/1077147074 shutdown_connections 2024-05-14T15:18:23.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:23.841+0000 7f1ca3200700 1 -- 172.21.15.69:0/1077147074 wait complete. 2024-05-14T15:18:24.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:24 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1077147074' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-14T15:18:24.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:24 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1077147074' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-14T15:18:24.617 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:24 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1077147074' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-14T15:18:24.617 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:24 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1077147074' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-14T15:18:24.680 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:18:24.680 DEBUG:teuthology.orchestra.run.smithi069:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-14T15:18:24.680 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-14T15:18:24.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:24 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1077147074' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-14T15:18:24.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:24 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1077147074' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-14T15:18:24.774 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-14T15:18:24.775 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-14T15:18:24.775 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph mgr dump --format=json 2024-05-14T15:18:25.243 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:25.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:25 smithi203 ceph-mon[34567]: pgmap v462: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-14T15:18:25.595 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:25 smithi069 ceph-mon[31270]: pgmap v462: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-14T15:18:25.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:25 smithi092 ceph-mon[34729]: pgmap v462: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-14T15:18:27.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:27 smithi203 ceph-mon[34567]: pgmap v463: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T15:18:27.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.633+0000 7fee9ce00700 1 -- 172.21.15.69:0/124398650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9810a7c0 msgr2=0x7fee9810abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:27.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.633+0000 7fee9ce00700 1 --2- 172.21.15.69:0/124398650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9810a7c0 0x7fee9810abd0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fee80009990 tx=0x7fee80009ca0 comp rx=0 tx=0).stop 2024-05-14T15:18:27.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.633+0000 7fee9ce00700 1 -- 172.21.15.69:0/124398650 shutdown_connections 2024-05-14T15:18:27.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.633+0000 7fee9ce00700 1 --2- 172.21.15.69:0/124398650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee9810b110 0x7fee98117620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:27.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.633+0000 7fee9ce00700 1 --2- 172.21.15.69:0/124398650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee9810f6c0 0x7fee9810fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:27.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.633+0000 7fee9ce00700 1 --2- 172.21.15.69:0/124398650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9810a7c0 0x7fee9810abd0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:27.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.633+0000 7fee9ce00700 1 -- 172.21.15.69:0/124398650 >> 172.21.15.69:0/124398650 conn(0x7fee98076b00 msgr2=0x7fee98076f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:27.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.633+0000 7fee9ce00700 1 -- 172.21.15.69:0/124398650 shutdown_connections 2024-05-14T15:18:27.634 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:27 smithi069 ceph-mon[31270]: pgmap v463: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T15:18:27.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.633+0000 7fee9ce00700 1 -- 172.21.15.69:0/124398650 wait complete. 2024-05-14T15:18:27.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.635+0000 7fee9ce00700 1 Processor -- start 2024-05-14T15:18:27.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.635+0000 7fee9ce00700 1 -- start start 2024-05-14T15:18:27.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.635+0000 7fee9ce00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9810a7c0 0x7fee981a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:27.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.635+0000 7fee9ce00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee9810b110 0x7fee981a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:27.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.635+0000 7fee9ce00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee9810f6c0 0x7fee981a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:27.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.635+0000 7fee9ce00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fee9811a7b0 con 0x7fee9810a7c0 2024-05-14T15:18:27.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.635+0000 7fee9ce00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fee9811a630 con 0x7fee9810f6c0 2024-05-14T15:18:27.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.635+0000 7fee9ce00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fee9811a930 con 0x7fee9810b110 2024-05-14T15:18:27.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.636+0000 7fee97400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9810a7c0 0x7fee981a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:27.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.636+0000 7fee97400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9810a7c0 0x7fee981a11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52456/0 (socket says 172.21.15.69:52456) 2024-05-14T15:18:27.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.636+0000 7fee97400700 1 -- 172.21.15.69:0/2741056776 learned_addr learned my addr 172.21.15.69:0/2741056776 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:27.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.636+0000 7fee8fe00700 1 --2- 172.21.15.69:0/2741056776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee9810b110 0x7fee981a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:27.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.636+0000 7fee97400700 1 -- 172.21.15.69:0/2741056776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee9810b110 msgr2=0x7fee981a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:27.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.636+0000 7fee97400700 1 --2- 172.21.15.69:0/2741056776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee9810b110 0x7fee981a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:27.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.636+0000 7fee97e00700 1 --2- 172.21.15.69:0/2741056776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee9810f6c0 0x7fee981a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:27.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.636+0000 7fee97400700 1 -- 172.21.15.69:0/2741056776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee9810f6c0 msgr2=0x7fee981a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:27.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.636+0000 7fee97400700 1 --2- 172.21.15.69:0/2741056776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee9810f6c0 0x7fee981a59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:27.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.636+0000 7fee97400700 1 -- 172.21.15.69:0/2741056776 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee981a5fe0 con 0x7fee9810a7c0 2024-05-14T15:18:27.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.636+0000 7fee97400700 1 --2- 172.21.15.69:0/2741056776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9810a7c0 0x7fee981a11c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fee8800d950 tx=0x7fee8800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:27.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.637+0000 7fee94c00700 1 -- 172.21.15.69:0/2741056776 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee88016070 con 0x7fee9810a7c0 2024-05-14T15:18:27.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.637+0000 7fee94c00700 1 -- 172.21.15.69:0/2741056776 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee88010460 con 0x7fee9810a7c0 2024-05-14T15:18:27.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.637+0000 7fee9ce00700 1 -- 172.21.15.69:0/2741056776 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee981a62d0 con 0x7fee9810a7c0 2024-05-14T15:18:27.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.637+0000 7fee94c00700 1 -- 172.21.15.69:0/2741056776 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee8800f620 con 0x7fee9810a7c0 2024-05-14T15:18:27.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.637+0000 7fee9ce00700 1 -- 172.21.15.69:0/2741056776 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee981adca0 con 0x7fee9810a7c0 2024-05-14T15:18:27.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.638+0000 7fee9ce00700 1 -- 172.21.15.69:0/2741056776 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee980512c0 con 0x7fee9810a7c0 2024-05-14T15:18:27.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.641+0000 7fee94c00700 1 -- 172.21.15.69:0/2741056776 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fee88019070 con 0x7fee9810a7c0 2024-05-14T15:18:27.641 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.642+0000 7fee94c00700 1 --2- 172.21.15.69:0/2741056776 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fee7c0b2990 0x7fee7c0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:27.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.642+0000 7fee94c00700 1 -- 172.21.15.69:0/2741056776 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fee880e2300 con 0x7fee9810a7c0 2024-05-14T15:18:27.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.643+0000 7fee8fe00700 1 --2- 172.21.15.69:0/2741056776 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fee7c0b2990 0x7fee7c0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:27.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.644+0000 7fee8fe00700 1 --2- 172.21.15.69:0/2741056776 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fee7c0b2990 0x7fee7c0b4ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fee8000b5c0 tx=0x7fee80005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:27.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.645+0000 7fee94c00700 1 -- 172.21.15.69:0/2741056776 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fee880a9a90 con 0x7fee9810a7c0 2024-05-14T15:18:27.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:27 smithi092 ceph-mon[34729]: pgmap v463: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T15:18:27.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.943+0000 7fee9ce00700 1 -- 172.21.15.69:0/2741056776 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fee9802e5f0 con 0x7fee9810a7c0 2024-05-14T15:18:27.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.956+0000 7fee94c00700 1 -- 172.21.15.69:0/2741056776 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+288645 (secure 0 0 0) 0x7fee880a9390 con 0x7fee9810a7c0 2024-05-14T15:18:27.961 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:18:27.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.961+0000 7fee9ce00700 1 -- 172.21.15.69:0/2741056776 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fee7c0b2990 msgr2=0x7fee7c0b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:27.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.961+0000 7fee9ce00700 1 --2- 172.21.15.69:0/2741056776 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fee7c0b2990 0x7fee7c0b4ea0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fee8000b5c0 tx=0x7fee80005fb0 comp rx=0 tx=0).stop 2024-05-14T15:18:27.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.961+0000 7fee9ce00700 1 -- 172.21.15.69:0/2741056776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9810a7c0 msgr2=0x7fee981a11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:27.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.961+0000 7fee9ce00700 1 --2- 172.21.15.69:0/2741056776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9810a7c0 0x7fee981a11c0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fee8800d950 tx=0x7fee8800dd10 comp rx=0 tx=0).stop 2024-05-14T15:18:27.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.962+0000 7fee9ce00700 1 -- 172.21.15.69:0/2741056776 shutdown_connections 2024-05-14T15:18:27.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.962+0000 7fee9ce00700 1 --2- 172.21.15.69:0/2741056776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee9810a7c0 0x7fee981a11c0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:27.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.962+0000 7fee9ce00700 1 --2- 172.21.15.69:0/2741056776 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fee7c0b2990 0x7fee7c0b4ea0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:27.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.962+0000 7fee9ce00700 1 --2- 172.21.15.69:0/2741056776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee9810f6c0 0x7fee981a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:27.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.962+0000 7fee9ce00700 1 --2- 172.21.15.69:0/2741056776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee9810b110 0x7fee981a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:27.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.962+0000 7fee9ce00700 1 -- 172.21.15.69:0/2741056776 >> 172.21.15.69:0/2741056776 conn(0x7fee98076b00 msgr2=0x7fee98108980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:27.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.962+0000 7fee9ce00700 1 -- 172.21.15.69:0/2741056776 shutdown_connections 2024-05-14T15:18:27.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:27.962+0000 7fee9ce00700 1 -- 172.21.15.69:0/2741056776 wait complete. 2024-05-14T15:18:28.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:28 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2741056776' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-14T15:18:28.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:28 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2741056776' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-14T15:18:28.722 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:28 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2741056776' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-14T15:18:28.972 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":17,"flags":0,"active_gid":14152,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6800","nonce":2537958790},{"type":"v1","addr":"172.21.15.69:6801","nonce":2537958790}]},"active_addr":"172.21.15.69:6801/2537958790","active_change":"2024-05-14T15:05:41.383725+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24115,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24121,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.69:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":3660048780}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":865506483}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":979899385}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":3403928589}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.69:0","nonce":3566397750}]}]} 2024-05-14T15:18:28.977 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-14T15:18:28.977 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-14T15:18:28.978 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T15:18:29.413 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:29.559 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:29 smithi069 ceph-mon[31270]: pgmap v464: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T15:18:29.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:29 smithi203 ceph-mon[34567]: pgmap v464: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T15:18:29.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:29 smithi092 ceph-mon[34729]: pgmap v464: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T15:18:31.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:31 smithi069 ceph-mon[31270]: pgmap v465: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:18:31.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:31 smithi203 ceph-mon[34567]: pgmap v465: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:18:31.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:31 smithi092 ceph-mon[34729]: pgmap v465: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:18:31.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.795+0000 7fb211400700 1 -- 172.21.15.69:0/2032197991 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb20c10b2e0 msgr2=0x7fb20c117810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:31.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.795+0000 7fb211400700 1 --2- 172.21.15.69:0/2032197991 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb20c10b2e0 0x7fb20c117810 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fb20400b0a0 tx=0x7fb20400b3b0 comp rx=0 tx=0).stop 2024-05-14T15:18:31.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.795+0000 7fb211400700 1 -- 172.21.15.69:0/2032197991 shutdown_connections 2024-05-14T15:18:31.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.795+0000 7fb211400700 1 --2- 172.21.15.69:0/2032197991 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb20c10b2e0 0x7fb20c117810 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:31.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.795+0000 7fb211400700 1 --2- 172.21.15.69:0/2032197991 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb20c110970 0x7fb20c110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:31.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.795+0000 7fb211400700 1 --2- 172.21.15.69:0/2032197991 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb20c10a990 0x7fb20c10ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:31.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.795+0000 7fb211400700 1 -- 172.21.15.69:0/2032197991 >> 172.21.15.69:0/2032197991 conn(0x7fb20c077c80 msgr2=0x7fb20c0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:31.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.795+0000 7fb211400700 1 -- 172.21.15.69:0/2032197991 shutdown_connections 2024-05-14T15:18:31.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.795+0000 7fb211400700 1 -- 172.21.15.69:0/2032197991 wait complete. 2024-05-14T15:18:31.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.796+0000 7fb211400700 1 Processor -- start 2024-05-14T15:18:31.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.796+0000 7fb211400700 1 -- start start 2024-05-14T15:18:31.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.797+0000 7fb211400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb20c10a990 0x7fb20c1a1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:31.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.797+0000 7fb211400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb20c10b2e0 0x7fb20c1a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:31.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.797+0000 7fb211400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb20c110970 0x7fb20c1a5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:31.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.797+0000 7fb211400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c11a990 con 0x7fb20c10a990 2024-05-14T15:18:31.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.797+0000 7fb211400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c11a810 con 0x7fb20c10b2e0 2024-05-14T15:18:31.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.797+0000 7fb211400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb20c11ab10 con 0x7fb20c110970 2024-05-14T15:18:31.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.797+0000 7fb20a800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb20c10a990 0x7fb20c1a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:31.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.797+0000 7fb20a800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb20c10a990 0x7fb20c1a1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52476/0 (socket says 172.21.15.69:52476) 2024-05-14T15:18:31.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.797+0000 7fb20a800700 1 -- 172.21.15.69:0/3192960877 learned_addr learned my addr 172.21.15.69:0/3192960877 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:31.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.798+0000 7fb203e00700 1 --2- 172.21.15.69:0/3192960877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb20c10b2e0 0x7fb20c1a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:31.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.798+0000 7fb20b200700 1 --2- 172.21.15.69:0/3192960877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb20c110970 0x7fb20c1a5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:31.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.798+0000 7fb20a800700 1 -- 172.21.15.69:0/3192960877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb20c110970 msgr2=0x7fb20c1a5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:31.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.798+0000 7fb20a800700 1 --2- 172.21.15.69:0/3192960877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb20c110970 0x7fb20c1a5b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:31.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.798+0000 7fb20a800700 1 -- 172.21.15.69:0/3192960877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb20c10b2e0 msgr2=0x7fb20c1a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:31.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.798+0000 7fb20a800700 1 --2- 172.21.15.69:0/3192960877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb20c10b2e0 0x7fb20c1a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:31.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.798+0000 7fb20a800700 1 -- 172.21.15.69:0/3192960877 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb20c1a6210 con 0x7fb20c10a990 2024-05-14T15:18:31.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.798+0000 7fb203e00700 1 --2- 172.21.15.69:0/3192960877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb20c10b2e0 0x7fb20c1a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:18:31.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.798+0000 7fb20b200700 1 --2- 172.21.15.69:0/3192960877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb20c110970 0x7fb20c1a5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:18:31.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.798+0000 7fb20a800700 1 --2- 172.21.15.69:0/3192960877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb20c10a990 0x7fb20c1a1340 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00d980 tx=0x7fb1fc00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:31.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.798+0000 7fb203400700 1 -- 172.21.15.69:0/3192960877 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc017070 con 0x7fb20c10a990 2024-05-14T15:18:31.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.798+0000 7fb203400700 1 -- 172.21.15.69:0/3192960877 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1fc010460 con 0x7fb20c10a990 2024-05-14T15:18:31.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.799+0000 7fb203400700 1 -- 172.21.15.69:0/3192960877 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1fc00de60 con 0x7fb20c10a990 2024-05-14T15:18:31.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.799+0000 7fb211400700 1 -- 172.21.15.69:0/3192960877 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb20c1a64a0 con 0x7fb20c10a990 2024-05-14T15:18:31.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.799+0000 7fb211400700 1 -- 172.21.15.69:0/3192960877 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb20c1a6990 con 0x7fb20c10a990 2024-05-14T15:18:31.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.800+0000 7fb211400700 1 -- 172.21.15.69:0/3192960877 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb20c0512c0 con 0x7fb20c10a990 2024-05-14T15:18:31.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.802+0000 7fb203400700 1 -- 172.21.15.69:0/3192960877 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb1fc010610 con 0x7fb20c10a990 2024-05-14T15:18:31.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.804+0000 7fb203400700 1 --2- 172.21.15.69:0/3192960877 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1f00b2910 0x7fb1f00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:31.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.804+0000 7fb203400700 1 -- 172.21.15.69:0/3192960877 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fb1fc0e22b0 con 0x7fb20c10a990 2024-05-14T15:18:31.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.804+0000 7fb203e00700 1 --2- 172.21.15.69:0/3192960877 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1f00b2910 0x7fb1f00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:31.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.805+0000 7fb203e00700 1 --2- 172.21.15.69:0/3192960877 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1f00b2910 0x7fb1f00b4e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4005fd0 tx=0x7fb1f4005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:31.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:31.809+0000 7fb203400700 1 -- 172.21.15.69:0/3192960877 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb1fc0a9a40 con 0x7fb20c10a990 2024-05-14T15:18:32.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:32.042+0000 7fb211400700 1 -- 172.21.15.69:0/3192960877 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb20c02e5f0 con 0x7fb20c10a990 2024-05-14T15:18:32.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:32.045+0000 7fb203400700 1 -- 172.21.15.69:0/3192960877 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24861 (secure 0 0 0) 0x7fb1fc0a9340 con 0x7fb20c10a990 2024-05-14T15:18:32.044 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:18:32.045 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":91,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","created":"2024-05-14T15:04:32.074994+0000","modified":"2024-05-14T15:17:43.708185+0000","last_up_change":"2024-05-14T15:14:44.049523+0000","last_in_change":"2024-05-14T15:14:16.752653+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:09:03.561841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:16:02.641690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:16:06.949687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:16:20.891122+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8640de99-c23a-494e-a100-aafd04fe1867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6803","nonce":301095601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6805","nonce":301095601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6809","nonce":301095601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6807","nonce":301095601}]},"public_addr":"172.21.15.69:6803/301095601","cluster_addr":"172.21.15.69:6805/301095601","heartbeat_back_addr":"172.21.15.69:6809/301095601","heartbeat_front_addr":"172.21.15.69:6807/301095601","state":["exists","up"]},{"osd":1,"uuid":"89f78a32-7afb-49f3-9287-5478a1cc8829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6801","nonce":2774122776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6803","nonce":2774122776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6807","nonce":2774122776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6805","nonce":2774122776}]},"public_addr":"172.21.15.92:6801/2774122776","cluster_addr":"172.21.15.92:6803/2774122776","heartbeat_back_addr":"172.21.15.92:6807/2774122776","heartbeat_front_addr":"172.21.15.92:6805/2774122776","state":["exists","up"]},{"osd":2,"uuid":"a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6801","nonce":2836920513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6803","nonce":2836920513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6807","nonce":2836920513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6805","nonce":2836920513}]},"public_addr":"172.21.15.203:6801/2836920513","cluster_addr":"172.21.15.203:6803/2836920513","heartbeat_back_addr":"172.21.15.203:6807/2836920513","heartbeat_front_addr":"172.21.15.203:6805/2836920513","state":["exists","up"]},{"osd":3,"uuid":"81409850-de26-4520-972c-31a716adf4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6811","nonce":680308620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6813","nonce":680308620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6817","nonce":680308620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6815","nonce":680308620}]},"public_addr":"172.21.15.69:6811/680308620","cluster_addr":"172.21.15.69:6813/680308620","heartbeat_back_addr":"172.21.15.69:6817/680308620","heartbeat_front_addr":"172.21.15.69:6815/680308620","state":["exists","up"]},{"osd":4,"uuid":"9aa3a6b0-cc63-4eae-8416-8ab630994985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6809","nonce":1071971048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6811","nonce":1071971048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6815","nonce":1071971048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6813","nonce":1071971048}]},"public_addr":"172.21.15.92:6809/1071971048","cluster_addr":"172.21.15.92:6811/1071971048","heartbeat_back_addr":"172.21.15.92:6815/1071971048","heartbeat_front_addr":"172.21.15.92:6813/1071971048","state":["exists","up"]},{"osd":5,"uuid":"f7fcde57-e280-494b-a45f-8fa007ed9ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6809","nonce":1404230851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6811","nonce":1404230851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6815","nonce":1404230851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6813","nonce":1404230851}]},"public_addr":"172.21.15.203:6809/1404230851","cluster_addr":"172.21.15.203:6811/1404230851","heartbeat_back_addr":"172.21.15.203:6815/1404230851","heartbeat_front_addr":"172.21.15.203:6813/1404230851","state":["exists","up"]},{"osd":6,"uuid":"86f1373a-3b39-4a7f-b14c-9bf8695c6b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6819","nonce":1213427819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6821","nonce":1213427819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6825","nonce":1213427819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6823","nonce":1213427819}]},"public_addr":"172.21.15.69:6819/1213427819","cluster_addr":"172.21.15.69:6821/1213427819","heartbeat_back_addr":"172.21.15.69:6825/1213427819","heartbeat_front_addr":"172.21.15.69:6823/1213427819","state":["exists","up"]},{"osd":7,"uuid":"e790fbf1-3e34-4950-bdfa-cf1adbd451c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6817","nonce":4274774582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6819","nonce":4274774582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6823","nonce":4274774582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6821","nonce":4274774582}]},"public_addr":"172.21.15.92:6817/4274774582","cluster_addr":"172.21.15.92:6819/4274774582","heartbeat_back_addr":"172.21.15.92:6823/4274774582","heartbeat_front_addr":"172.21.15.92:6821/4274774582","state":["exists","up"]},{"osd":8,"uuid":"65019fee-6b18-4d13-841a-2e3acb51f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6817","nonce":2480959249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6819","nonce":2480959249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6823","nonce":2480959249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6821","nonce":2480959249}]},"public_addr":"172.21.15.203:6817/2480959249","cluster_addr":"172.21.15.203:6819/2480959249","heartbeat_back_addr":"172.21.15.203:6823/2480959249","heartbeat_front_addr":"172.21.15.203:6821/2480959249","state":["exists","up"]},{"osd":9,"uuid":"b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6827","nonce":2649966866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6829","nonce":2649966866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6833","nonce":2649966866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6831","nonce":2649966866}]},"public_addr":"172.21.15.69:6827/2649966866","cluster_addr":"172.21.15.69:6829/2649966866","heartbeat_back_addr":"172.21.15.69:6833/2649966866","heartbeat_front_addr":"172.21.15.69:6831/2649966866","state":["exists","up"]},{"osd":10,"uuid":"45287823-f7ea-431f-ac01-a72762b01a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6825","nonce":3650822776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6827","nonce":3650822776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6831","nonce":3650822776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6829","nonce":3650822776}]},"public_addr":"172.21.15.92:6825/3650822776","cluster_addr":"172.21.15.92:6827/3650822776","heartbeat_back_addr":"172.21.15.92:6831/3650822776","heartbeat_front_addr":"172.21.15.92:6829/3650822776","state":["exists","up"]},{"osd":11,"uuid":"2f3a10f9-2414-4151-b1cf-3db68b2a66fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6825","nonce":2590258806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6827","nonce":2590258806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6831","nonce":2590258806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6829","nonce":2590258806}]},"public_addr":"172.21.15.203:6825/2590258806","cluster_addr":"172.21.15.203:6827/2590258806","heartbeat_back_addr":"172.21.15.203:6831/2590258806","heartbeat_front_addr":"172.21.15.203:6829/2590258806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:07:50.047712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:08:25.223293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:01.269713+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:38.679607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:16.161314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:53.323450+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:11:31.930106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:10.173015+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:48.056752+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:13:25.780142+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:03.705208+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:41.267371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":5,"to":6}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/151981233":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/3776172313":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/1288620257":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/2718114316":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/1655882616":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/4183332474":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/2806878946":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/2718114316":"2024-05-15T15:05:41.383453+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:18:32.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:32.048+0000 7fb211400700 1 -- 172.21.15.69:0/3192960877 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1f00b2910 msgr2=0x7fb1f00b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:32.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:32.048+0000 7fb211400700 1 --2- 172.21.15.69:0/3192960877 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1f00b2910 0x7fb1f00b4e20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1f4005fd0 tx=0x7fb1f4005ee0 comp rx=0 tx=0).stop 2024-05-14T15:18:32.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:32.048+0000 7fb211400700 1 -- 172.21.15.69:0/3192960877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb20c10a990 msgr2=0x7fb20c1a1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:32.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:32.048+0000 7fb211400700 1 --2- 172.21.15.69:0/3192960877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb20c10a990 0x7fb20c1a1340 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fb1fc00d980 tx=0x7fb1fc00dd40 comp rx=0 tx=0).stop 2024-05-14T15:18:32.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:32.048+0000 7fb211400700 1 -- 172.21.15.69:0/3192960877 shutdown_connections 2024-05-14T15:18:32.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:32.048+0000 7fb211400700 1 --2- 172.21.15.69:0/3192960877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb20c10a990 0x7fb20c1a1340 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:32.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:32.048+0000 7fb211400700 1 --2- 172.21.15.69:0/3192960877 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1f00b2910 0x7fb1f00b4e20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:32.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:32.048+0000 7fb211400700 1 --2- 172.21.15.69:0/3192960877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb20c110970 0x7fb20c1a5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:32.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:32.048+0000 7fb211400700 1 --2- 172.21.15.69:0/3192960877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb20c10b2e0 0x7fb20c1a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:32.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:32.048+0000 7fb211400700 1 -- 172.21.15.69:0/3192960877 >> 172.21.15.69:0/3192960877 conn(0x7fb20c077c80 msgr2=0x7fb20c07b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:32.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:32.048+0000 7fb211400700 1 -- 172.21.15.69:0/3192960877 shutdown_connections 2024-05-14T15:18:32.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:32.048+0000 7fb211400700 1 -- 172.21.15.69:0/3192960877 wait complete. 2024-05-14T15:18:32.444 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:32 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3192960877' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:18:32.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:32 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3192960877' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:18:32.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:32 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3192960877' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:18:32.974 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-14T15:18:32.974 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T15:18:33.410 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:33.591 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:33 smithi069 ceph-mon[31270]: pgmap v466: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:18:33.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:33 smithi203 ceph-mon[34567]: pgmap v466: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:18:33.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:33 smithi092 ceph-mon[34729]: pgmap v466: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:18:34.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:34 smithi203 ceph-mon[34567]: pgmap v467: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:18:34.603 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:34 smithi069 ceph-mon[31270]: pgmap v467: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:18:34.691 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:34 smithi092 ceph-mon[34729]: pgmap v467: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:18:35.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.735+0000 7f3174200700 1 -- 172.21.15.69:0/2355295397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f316c110970 msgr2=0x7f316c110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:35.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.735+0000 7f3174200700 1 --2- 172.21.15.69:0/2355295397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f316c110970 0x7f316c110d80 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3160009990 tx=0x7f3160009ca0 comp rx=0 tx=0).stop 2024-05-14T15:18:35.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.735+0000 7f3174200700 1 -- 172.21.15.69:0/2355295397 shutdown_connections 2024-05-14T15:18:35.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.735+0000 7f3174200700 1 --2- 172.21.15.69:0/2355295397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f316c110970 0x7f316c110d80 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:35.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.735+0000 7f3174200700 1 --2- 172.21.15.69:0/2355295397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f316c10b2e0 0x7f316c117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:35.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.735+0000 7f3174200700 1 --2- 172.21.15.69:0/2355295397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f316c10a990 0x7f316c10ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:35.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.735+0000 7f3174200700 1 -- 172.21.15.69:0/2355295397 >> 172.21.15.69:0/2355295397 conn(0x7f316c077c80 msgr2=0x7f316c0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:35.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.736+0000 7f3174200700 1 -- 172.21.15.69:0/2355295397 shutdown_connections 2024-05-14T15:18:35.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.736+0000 7f3174200700 1 -- 172.21.15.69:0/2355295397 wait complete. 2024-05-14T15:18:35.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.737+0000 7f3174200700 1 Processor -- start 2024-05-14T15:18:35.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.737+0000 7f3174200700 1 -- start start 2024-05-14T15:18:35.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.738+0000 7f3174200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f316c10a990 0x7f316c1a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:35.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.738+0000 7f3174200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f316c10b2e0 0x7f316c1a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:35.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.738+0000 7f3174200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f316c110970 0x7f316c1a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:35.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.738+0000 7f3174200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f316c11a970 con 0x7f316c110970 2024-05-14T15:18:35.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.738+0000 7f3174200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f316c11a7f0 con 0x7f316c10a990 2024-05-14T15:18:35.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.738+0000 7f3174200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f316c11aaf0 con 0x7f316c10b2e0 2024-05-14T15:18:35.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.738+0000 7f3172200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f316c110970 0x7f316c1a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:35.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.738+0000 7f3172200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f316c110970 0x7f316c1a5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34730/0 (socket says 172.21.15.69:34730) 2024-05-14T15:18:35.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.738+0000 7f3172200700 1 -- 172.21.15.69:0/4253271461 learned_addr learned my addr 172.21.15.69:0/4253271461 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:35.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.738+0000 7f3171800700 1 --2- 172.21.15.69:0/4253271461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f316c10a990 0x7f316c1a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:35.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.739+0000 7f3172200700 1 -- 172.21.15.69:0/4253271461 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f316c10b2e0 msgr2=0x7f316c1a1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:35.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.739+0000 7f3172200700 1 --2- 172.21.15.69:0/4253271461 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f316c10b2e0 0x7f316c1a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:35.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.739+0000 7f3172200700 1 -- 172.21.15.69:0/4253271461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f316c10a990 msgr2=0x7f316c1a13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:35.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.739+0000 7f3172200700 1 --2- 172.21.15.69:0/4253271461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f316c10a990 0x7f316c1a13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:35.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.739+0000 7f3172200700 1 -- 172.21.15.69:0/4253271461 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f316c1a6290 con 0x7f316c110970 2024-05-14T15:18:35.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.739+0000 7f3172200700 1 --2- 172.21.15.69:0/4253271461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f316c110970 0x7f316c1a5bf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3164007ee0 tx=0x7f316400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:35.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.739+0000 7f316a000700 1 -- 172.21.15.69:0/4253271461 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316400dbd0 con 0x7f316c110970 2024-05-14T15:18:35.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.740+0000 7f3174200700 1 -- 172.21.15.69:0/4253271461 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f316c1a6580 con 0x7f316c110970 2024-05-14T15:18:35.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.740+0000 7f316a000700 1 -- 172.21.15.69:0/4253271461 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f316400dd70 con 0x7f316c110970 2024-05-14T15:18:35.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.740+0000 7f316a000700 1 -- 172.21.15.69:0/4253271461 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31640058f0 con 0x7f316c110970 2024-05-14T15:18:35.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.740+0000 7f3174200700 1 -- 172.21.15.69:0/4253271461 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f316c1adea0 con 0x7f316c110970 2024-05-14T15:18:35.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.741+0000 7f3174200700 1 -- 172.21.15.69:0/4253271461 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f316c0512c0 con 0x7f316c110970 2024-05-14T15:18:35.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.743+0000 7f316a000700 1 -- 172.21.15.69:0/4253271461 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f316401a020 con 0x7f316c110970 2024-05-14T15:18:35.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.745+0000 7f316a000700 1 --2- 172.21.15.69:0/4253271461 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31540b2910 0x7f31540b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:35.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.745+0000 7f316a000700 1 -- 172.21.15.69:0/4253271461 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f31640e1fe0 con 0x7f316c110970 2024-05-14T15:18:35.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.745+0000 7f3171800700 1 --2- 172.21.15.69:0/4253271461 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31540b2910 0x7f31540b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:35.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.746+0000 7f3171800700 1 --2- 172.21.15.69:0/4253271461 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31540b2910 0x7f31540b4e20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f316000b5c0 tx=0x7f3160005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:35.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.750+0000 7f316a000700 1 -- 172.21.15.69:0/4253271461 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f3164010070 con 0x7f316c110970 2024-05-14T15:18:35.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:35.998+0000 7f3174200700 1 -- 172.21.15.69:0/4253271461 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f316c02e5f0 con 0x7f316c110970 2024-05-14T15:18:36.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:36.001+0000 7f316a000700 1 -- 172.21.15.69:0/4253271461 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24861 (secure 0 0 0) 0x7f31640a9770 con 0x7f316c110970 2024-05-14T15:18:36.002 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:18:36.002 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":91,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","created":"2024-05-14T15:04:32.074994+0000","modified":"2024-05-14T15:17:43.708185+0000","last_up_change":"2024-05-14T15:14:44.049523+0000","last_in_change":"2024-05-14T15:14:16.752653+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:09:03.561841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:16:02.641690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:16:06.949687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:16:20.891122+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8640de99-c23a-494e-a100-aafd04fe1867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6803","nonce":301095601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6805","nonce":301095601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6809","nonce":301095601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6807","nonce":301095601}]},"public_addr":"172.21.15.69:6803/301095601","cluster_addr":"172.21.15.69:6805/301095601","heartbeat_back_addr":"172.21.15.69:6809/301095601","heartbeat_front_addr":"172.21.15.69:6807/301095601","state":["exists","up"]},{"osd":1,"uuid":"89f78a32-7afb-49f3-9287-5478a1cc8829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6801","nonce":2774122776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6803","nonce":2774122776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6807","nonce":2774122776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6805","nonce":2774122776}]},"public_addr":"172.21.15.92:6801/2774122776","cluster_addr":"172.21.15.92:6803/2774122776","heartbeat_back_addr":"172.21.15.92:6807/2774122776","heartbeat_front_addr":"172.21.15.92:6805/2774122776","state":["exists","up"]},{"osd":2,"uuid":"a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6801","nonce":2836920513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6803","nonce":2836920513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6807","nonce":2836920513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6805","nonce":2836920513}]},"public_addr":"172.21.15.203:6801/2836920513","cluster_addr":"172.21.15.203:6803/2836920513","heartbeat_back_addr":"172.21.15.203:6807/2836920513","heartbeat_front_addr":"172.21.15.203:6805/2836920513","state":["exists","up"]},{"osd":3,"uuid":"81409850-de26-4520-972c-31a716adf4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6811","nonce":680308620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6813","nonce":680308620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6817","nonce":680308620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6815","nonce":680308620}]},"public_addr":"172.21.15.69:6811/680308620","cluster_addr":"172.21.15.69:6813/680308620","heartbeat_back_addr":"172.21.15.69:6817/680308620","heartbeat_front_addr":"172.21.15.69:6815/680308620","state":["exists","up"]},{"osd":4,"uuid":"9aa3a6b0-cc63-4eae-8416-8ab630994985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6809","nonce":1071971048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6811","nonce":1071971048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6815","nonce":1071971048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6813","nonce":1071971048}]},"public_addr":"172.21.15.92:6809/1071971048","cluster_addr":"172.21.15.92:6811/1071971048","heartbeat_back_addr":"172.21.15.92:6815/1071971048","heartbeat_front_addr":"172.21.15.92:6813/1071971048","state":["exists","up"]},{"osd":5,"uuid":"f7fcde57-e280-494b-a45f-8fa007ed9ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6809","nonce":1404230851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6811","nonce":1404230851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6815","nonce":1404230851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6813","nonce":1404230851}]},"public_addr":"172.21.15.203:6809/1404230851","cluster_addr":"172.21.15.203:6811/1404230851","heartbeat_back_addr":"172.21.15.203:6815/1404230851","heartbeat_front_addr":"172.21.15.203:6813/1404230851","state":["exists","up"]},{"osd":6,"uuid":"86f1373a-3b39-4a7f-b14c-9bf8695c6b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6819","nonce":1213427819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6821","nonce":1213427819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6825","nonce":1213427819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6823","nonce":1213427819}]},"public_addr":"172.21.15.69:6819/1213427819","cluster_addr":"172.21.15.69:6821/1213427819","heartbeat_back_addr":"172.21.15.69:6825/1213427819","heartbeat_front_addr":"172.21.15.69:6823/1213427819","state":["exists","up"]},{"osd":7,"uuid":"e790fbf1-3e34-4950-bdfa-cf1adbd451c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6817","nonce":4274774582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6819","nonce":4274774582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6823","nonce":4274774582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6821","nonce":4274774582}]},"public_addr":"172.21.15.92:6817/4274774582","cluster_addr":"172.21.15.92:6819/4274774582","heartbeat_back_addr":"172.21.15.92:6823/4274774582","heartbeat_front_addr":"172.21.15.92:6821/4274774582","state":["exists","up"]},{"osd":8,"uuid":"65019fee-6b18-4d13-841a-2e3acb51f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6817","nonce":2480959249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6819","nonce":2480959249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6823","nonce":2480959249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6821","nonce":2480959249}]},"public_addr":"172.21.15.203:6817/2480959249","cluster_addr":"172.21.15.203:6819/2480959249","heartbeat_back_addr":"172.21.15.203:6823/2480959249","heartbeat_front_addr":"172.21.15.203:6821/2480959249","state":["exists","up"]},{"osd":9,"uuid":"b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6827","nonce":2649966866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6829","nonce":2649966866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6833","nonce":2649966866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6831","nonce":2649966866}]},"public_addr":"172.21.15.69:6827/2649966866","cluster_addr":"172.21.15.69:6829/2649966866","heartbeat_back_addr":"172.21.15.69:6833/2649966866","heartbeat_front_addr":"172.21.15.69:6831/2649966866","state":["exists","up"]},{"osd":10,"uuid":"45287823-f7ea-431f-ac01-a72762b01a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6825","nonce":3650822776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6827","nonce":3650822776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6831","nonce":3650822776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6829","nonce":3650822776}]},"public_addr":"172.21.15.92:6825/3650822776","cluster_addr":"172.21.15.92:6827/3650822776","heartbeat_back_addr":"172.21.15.92:6831/3650822776","heartbeat_front_addr":"172.21.15.92:6829/3650822776","state":["exists","up"]},{"osd":11,"uuid":"2f3a10f9-2414-4151-b1cf-3db68b2a66fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6825","nonce":2590258806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6827","nonce":2590258806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6831","nonce":2590258806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6829","nonce":2590258806}]},"public_addr":"172.21.15.203:6825/2590258806","cluster_addr":"172.21.15.203:6827/2590258806","heartbeat_back_addr":"172.21.15.203:6831/2590258806","heartbeat_front_addr":"172.21.15.203:6829/2590258806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:07:50.047712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:08:25.223293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:01.269713+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:38.679607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:16.161314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:53.323450+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:11:31.930106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:10.173015+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:48.056752+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:13:25.780142+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:03.705208+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:41.267371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":5,"to":6}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/151981233":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/3776172313":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/1288620257":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/2718114316":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/1655882616":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/4183332474":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/2806878946":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/2718114316":"2024-05-15T15:05:41.383453+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:18:36.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:36.004+0000 7f3174200700 1 -- 172.21.15.69:0/4253271461 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31540b2910 msgr2=0x7f31540b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:36.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:36.004+0000 7f3174200700 1 --2- 172.21.15.69:0/4253271461 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31540b2910 0x7f31540b4e20 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f316000b5c0 tx=0x7f3160005fb0 comp rx=0 tx=0).stop 2024-05-14T15:18:36.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:36.004+0000 7f3174200700 1 -- 172.21.15.69:0/4253271461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f316c110970 msgr2=0x7f316c1a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:36.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:36.004+0000 7f3174200700 1 --2- 172.21.15.69:0/4253271461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f316c110970 0x7f316c1a5bf0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f3164007ee0 tx=0x7f316400d3b0 comp rx=0 tx=0).stop 2024-05-14T15:18:36.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:36.004+0000 7f3174200700 1 -- 172.21.15.69:0/4253271461 shutdown_connections 2024-05-14T15:18:36.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:36.004+0000 7f3174200700 1 --2- 172.21.15.69:0/4253271461 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f316c110970 0x7f316c1a5bf0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:36.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:36.004+0000 7f3174200700 1 --2- 172.21.15.69:0/4253271461 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31540b2910 0x7f31540b4e20 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:36.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:36.004+0000 7f3174200700 1 --2- 172.21.15.69:0/4253271461 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f316c10a990 0x7f316c1a13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:36.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:36.004+0000 7f3174200700 1 --2- 172.21.15.69:0/4253271461 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f316c10b2e0 0x7f316c1a1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:36.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:36.004+0000 7f3174200700 1 -- 172.21.15.69:0/4253271461 >> 172.21.15.69:0/4253271461 conn(0x7f316c077c80 msgr2=0x7f316c07bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:36.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:36.005+0000 7f3174200700 1 -- 172.21.15.69:0/4253271461 shutdown_connections 2024-05-14T15:18:36.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:36.005+0000 7f3174200700 1 -- 172.21.15.69:0/4253271461 wait complete. 2024-05-14T15:18:36.897 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-14T15:18:36.897 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-14T15:18:36.898 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-14T15:18:36.898 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-14T15:18:36.898 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-14T15:18:36.899 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-14T15:18:36.899 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-14T15:18:36.900 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-14T15:18:36.900 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-05-14T15:18:36.901 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-05-14T15:18:36.901 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-05-14T15:18:36.901 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-05-14T15:18:37.005 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:36 smithi069 ceph-mon[31270]: pgmap v468: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:18:37.005 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:36 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/4253271461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:18:37.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:36 smithi203 ceph-mon[34567]: pgmap v468: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:18:37.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:36 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/4253271461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:18:37.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:36 smithi092 ceph-mon[34729]: pgmap v468: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:18:37.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:36 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/4253271461' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:18:37.892 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:37.906 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:38.030 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:38.318 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:38.320 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:38.327 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:38.328 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:38.334 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:38.338 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:38.930 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:38 smithi069 ceph-mon[31270]: pgmap v469: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:18:39.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:38 smithi203 ceph-mon[34567]: pgmap v469: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:18:39.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:38 smithi092 ceph-mon[34729]: pgmap v469: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:18:41.068 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:40 smithi069 ceph-mon[31270]: pgmap v470: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:18:41.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:40 smithi203 ceph-mon[34567]: pgmap v470: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:18:41.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:40 smithi092 ceph-mon[34729]: pgmap v470: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:18:43.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:42 smithi203 ceph-mon[34567]: pgmap v471: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:18:43.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:42 smithi092 ceph-mon[34729]: pgmap v471: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:18:43.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:42 smithi069 ceph-mon[31270]: pgmap v471: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:18:43.967 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:44.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:44 smithi069 ceph-mon[31270]: pgmap v472: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:18:45.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:44 smithi203 ceph-mon[34567]: pgmap v472: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:18:45.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:44 smithi092 ceph-mon[34729]: pgmap v472: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:18:45.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.277+0000 7fa2c2000700 1 -- 172.21.15.69:0/1287110855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2bc10a990 msgr2=0x7fa2bc10ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:45.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.277+0000 7fa2c2000700 1 --2- 172.21.15.69:0/1287110855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2bc10a990 0x7fa2bc10ada0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fa2a8009990 tx=0x7fa2a8009ca0 comp rx=0 tx=0).stop 2024-05-14T15:18:45.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.277+0000 7fa2c2000700 1 -- 172.21.15.69:0/1287110855 shutdown_connections 2024-05-14T15:18:45.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.277+0000 7fa2c2000700 1 --2- 172.21.15.69:0/1287110855 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2bc10b2e0 0x7fa2bc117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:45.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.277+0000 7fa2c2000700 1 --2- 172.21.15.69:0/1287110855 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2bc110970 0x7fa2bc110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:45.278 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.277+0000 7fa2c2000700 1 --2- 172.21.15.69:0/1287110855 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2bc10a990 0x7fa2bc10ada0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:45.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.277+0000 7fa2c2000700 1 -- 172.21.15.69:0/1287110855 >> 172.21.15.69:0/1287110855 conn(0x7fa2bc077c80 msgr2=0x7fa2bc0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:45.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.277+0000 7fa2c2000700 1 -- 172.21.15.69:0/1287110855 shutdown_connections 2024-05-14T15:18:45.279 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.277+0000 7fa2c2000700 1 -- 172.21.15.69:0/1287110855 wait complete. 2024-05-14T15:18:45.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.279+0000 7fa2c2000700 1 Processor -- start 2024-05-14T15:18:45.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.279+0000 7fa2c2000700 1 -- start start 2024-05-14T15:18:45.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.279+0000 7fa2c2000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2bc10a990 0x7fa2bc1a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:45.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.279+0000 7fa2c2000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2bc10b2e0 0x7fa2bc1a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:45.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.279+0000 7fa2c2000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2bc110970 0x7fa2bc1a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:45.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.279+0000 7fa2c2000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc11a940 con 0x7fa2bc10a990 2024-05-14T15:18:45.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.279+0000 7fa2c2000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc11a7c0 con 0x7fa2bc110970 2024-05-14T15:18:45.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.279+0000 7fa2c2000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa2bc11aac0 con 0x7fa2bc10b2e0 2024-05-14T15:18:45.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.279+0000 7fa2bb400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2bc10a990 0x7fa2bc1a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:45.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.280+0000 7fa2bb400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2bc10a990 0x7fa2bc1a1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35804/0 (socket says 172.21.15.69:35804) 2024-05-14T15:18:45.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.280+0000 7fa2bb400700 1 -- 172.21.15.69:0/3681914808 learned_addr learned my addr 172.21.15.69:0/3681914808 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:45.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.280+0000 7fa2baa00700 1 --2- 172.21.15.69:0/3681914808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2bc10b2e0 0x7fa2bc1a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:45.281 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.280+0000 7fa2bbe00700 1 --2- 172.21.15.69:0/3681914808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2bc110970 0x7fa2bc1a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:45.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.280+0000 7fa2bb400700 1 -- 172.21.15.69:0/3681914808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2bc10b2e0 msgr2=0x7fa2bc1a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:45.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.280+0000 7fa2bb400700 1 --2- 172.21.15.69:0/3681914808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2bc10b2e0 0x7fa2bc1a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:45.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.280+0000 7fa2bb400700 1 -- 172.21.15.69:0/3681914808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2bc110970 msgr2=0x7fa2bc1a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:45.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.280+0000 7fa2bb400700 1 --2- 172.21.15.69:0/3681914808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa2bc110970 0x7fa2bc1a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:45.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.280+0000 7fa2bb400700 1 -- 172.21.15.69:0/3681914808 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2bc1a6240 con 0x7fa2bc10a990 2024-05-14T15:18:45.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.280+0000 7fa2baa00700 1 --2- 172.21.15.69:0/3681914808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa2bc10b2e0 0x7fa2bc1a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:18:45.282 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.280+0000 7fa2bb400700 1 --2- 172.21.15.69:0/3681914808 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2bc10a990 0x7fa2bc1a1370 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00c8f0 tx=0x7fa2ac00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:45.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.281+0000 7fa2b3e00700 1 -- 172.21.15.69:0/3681914808 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac007b00 con 0x7fa2bc10a990 2024-05-14T15:18:45.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.281+0000 7fa2b3e00700 1 -- 172.21.15.69:0/3681914808 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa2ac007ca0 con 0x7fa2bc10a990 2024-05-14T15:18:45.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.281+0000 7fa2c2000700 1 -- 172.21.15.69:0/3681914808 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2bc1a6530 con 0x7fa2bc10a990 2024-05-14T15:18:45.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.281+0000 7fa2b3e00700 1 -- 172.21.15.69:0/3681914808 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2ac018660 con 0x7fa2bc10a990 2024-05-14T15:18:45.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.282+0000 7fa2c2000700 1 -- 172.21.15.69:0/3681914808 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2bc1ade50 con 0x7fa2bc10a990 2024-05-14T15:18:45.283 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.282+0000 7fa2c2000700 1 -- 172.21.15.69:0/3681914808 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa2bc063f50 con 0x7fa2bc10a990 2024-05-14T15:18:45.285 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.285+0000 7fa2b3e00700 1 -- 172.21.15.69:0/3681914808 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fa2ac00f450 con 0x7fa2bc10a990 2024-05-14T15:18:45.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.287+0000 7fa2b3e00700 1 --2- 172.21.15.69:0/3681914808 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa2a00b2910 0x7fa2a00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:45.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.287+0000 7fa2b3e00700 1 -- 172.21.15.69:0/3681914808 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fa2ac0e29b0 con 0x7fa2bc10a990 2024-05-14T15:18:45.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.287+0000 7fa2baa00700 1 --2- 172.21.15.69:0/3681914808 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa2a00b2910 0x7fa2a00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:45.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.287+0000 7fa2b3e00700 1 --2- 172.21.15.69:0/3681914808 >> [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249] conn(0x7fa2a00bdcc0 0x7fa2a00c01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:45.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.287+0000 7fa2b3e00700 1 -- 172.21.15.69:0/3681914808 --> [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2ac015e70 con 0x7fa2a00bdcc0 2024-05-14T15:18:45.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.287+0000 7fa2b3e00700 1 -- 172.21.15.69:0/3681914808 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fa2ac0e2d60 con 0x7fa2bc10a990 2024-05-14T15:18:45.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.289+0000 7fa2baa00700 1 --2- 172.21.15.69:0/3681914808 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa2a00b2910 0x7fa2a00b4e20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc1099d0 tx=0x7fa2a800b580 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:45.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.289+0000 7fa2bbe00700 1 --2- 172.21.15.69:0/3681914808 >> [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249] conn(0x7fa2a00bdcc0 0x7fa2a00c01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:45.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.289+0000 7fa2bbe00700 1 --2- 172.21.15.69:0/3681914808 >> [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249] conn(0x7fa2a00bdcc0 0x7fa2a00c01b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:45.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.292+0000 7fa2b3e00700 1 -- 172.21.15.69:0/3681914808 <== osd.8 v2:172.21.15.203:6816/2480959249 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa2ac015e70 con 0x7fa2a00bdcc0 2024-05-14T15:18:45.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.311+0000 7fa2c2000700 1 -- 172.21.15.69:0/3681914808 --> [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa2bc0643d0 con 0x7fa2a00bdcc0 2024-05-14T15:18:45.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.312+0000 7fa2b3e00700 1 -- 172.21.15.69:0/3681914808 <== osd.8 v2:172.21.15.203:6816/2480959249 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa2bc0643d0 con 0x7fa2a00bdcc0 2024-05-14T15:18:45.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.313+0000 7fa2c2000700 1 -- 172.21.15.69:0/3681914808 >> [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249] conn(0x7fa2a00bdcc0 msgr2=0x7fa2a00c01b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:45.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.313+0000 7fa2c2000700 1 --2- 172.21.15.69:0/3681914808 >> [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249] conn(0x7fa2a00bdcc0 0x7fa2a00c01b0 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:45.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.313+0000 7fa2c2000700 1 -- 172.21.15.69:0/3681914808 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa2a00b2910 msgr2=0x7fa2a00b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:45.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.313+0000 7fa2c2000700 1 --2- 172.21.15.69:0/3681914808 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa2a00b2910 0x7fa2a00b4e20 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fa2bc1099d0 tx=0x7fa2a800b580 comp rx=0 tx=0).stop 2024-05-14T15:18:45.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.313+0000 7fa2c2000700 1 -- 172.21.15.69:0/3681914808 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2bc10a990 msgr2=0x7fa2bc1a1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:45.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.313+0000 7fa2c2000700 1 --2- 172.21.15.69:0/3681914808 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa2bc10a990 0x7fa2bc1a1370 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fa2ac00c8f0 tx=0x7fa2ac00ccb0 comp rx=0 tx=0).stop 2024-05-14T15:18:45.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.313+0000 7fa2bbe00700 1 -- 172.21.15.69:0/3681914808 reap_dead start 2024-05-14T15:18:45.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.313+0000 7fa2c2000700 1 -- 172.21.15.69:0/3681914808 shutdown_connections 2024-05-14T15:18:45.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.313+0000 7fa2c2000700 1 -- 172.21.15.69:0/3681914808 >> 172.21.15.69:0/3681914808 conn(0x7fa2bc077c80 msgr2=0x7fa2bc07b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:45.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.313+0000 7fa2c2000700 1 -- 172.21.15.69:0/3681914808 shutdown_connections 2024-05-14T15:18:45.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:45.313+0000 7fa2c2000700 1 -- 172.21.15.69:0/3681914808 wait complete. 2024-05-14T15:18:46.884 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:46 smithi069 ceph-mon[31270]: pgmap v473: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:18:47.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:46 smithi203 ceph-mon[34567]: pgmap v473: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:18:47.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:46 smithi092 ceph-mon[34729]: pgmap v473: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:18:48.920 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:48 smithi069 ceph-mon[31270]: pgmap v474: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:18:49.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:48 smithi203 ceph-mon[34567]: pgmap v474: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:18:49.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:48 smithi092 ceph-mon[34729]: pgmap v474: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:18:50.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.881+0000 7f461f200700 1 -- 172.21.15.69:0/2675695056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4620104400 msgr2=0x7f4620104810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:50.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.881+0000 7f461f200700 1 --2- 172.21.15.69:0/2675695056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4620104400 0x7f4620104810 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f46100099c0 tx=0x7f4610009cd0 comp rx=0 tx=0).stop 2024-05-14T15:18:50.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.881+0000 7f461f200700 1 -- 172.21.15.69:0/2675695056 shutdown_connections 2024-05-14T15:18:50.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.881+0000 7f461f200700 1 --2- 172.21.15.69:0/2675695056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4620104400 0x7f4620104810 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:50.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.881+0000 7f461f200700 1 --2- 172.21.15.69:0/2675695056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4620109680 0x7f4620110fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:50.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.881+0000 7f461f200700 1 --2- 172.21.15.69:0/2675695056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4620108d30 0x7f4620109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:50.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.881+0000 7f461f200700 1 -- 172.21.15.69:0/2675695056 >> 172.21.15.69:0/2675695056 conn(0x7f4620079d10 msgr2=0x7f462007a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:50.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.883+0000 7f461f200700 1 -- 172.21.15.69:0/2675695056 shutdown_connections 2024-05-14T15:18:50.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.883+0000 7f461f200700 1 -- 172.21.15.69:0/2675695056 wait complete. 2024-05-14T15:18:50.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.885+0000 7f461f200700 1 Processor -- start 2024-05-14T15:18:50.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.885+0000 7f461f200700 1 -- start start 2024-05-14T15:18:50.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.886+0000 7f461f200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4620104400 0x7f4620075a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:50.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.886+0000 7f461f200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4620108d30 0x7f4620075fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:50.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.886+0000 7f461f200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4620109680 0x7f4620076500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:50.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.886+0000 7f461f200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f46201141b0 con 0x7f4620108d30 2024-05-14T15:18:50.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.886+0000 7f461f200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4620114030 con 0x7f4620109680 2024-05-14T15:18:50.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.886+0000 7f461f200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4620114330 con 0x7f4620104400 2024-05-14T15:18:50.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.886+0000 7f4617e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4620108d30 0x7f4620075fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:50.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.887+0000 7f4617e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4620108d30 0x7f4620075fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35838/0 (socket says 172.21.15.69:35838) 2024-05-14T15:18:50.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.887+0000 7f4617e00700 1 -- 172.21.15.69:0/3615885924 learned_addr learned my addr 172.21.15.69:0/3615885924 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:50.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.887+0000 7f461e800700 1 --2- 172.21.15.69:0/3615885924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4620109680 0x7f4620076500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:50.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.887+0000 7f461de00700 1 --2- 172.21.15.69:0/3615885924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4620104400 0x7f4620075a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:50.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.887+0000 7f4617e00700 1 -- 172.21.15.69:0/3615885924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4620104400 msgr2=0x7f4620075a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:50.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.887+0000 7f4617e00700 1 --2- 172.21.15.69:0/3615885924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4620104400 0x7f4620075a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:50.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.887+0000 7f4617e00700 1 -- 172.21.15.69:0/3615885924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4620109680 msgr2=0x7f4620076500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:50.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.887+0000 7f4617e00700 1 --2- 172.21.15.69:0/3615885924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4620109680 0x7f4620076500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:50.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.887+0000 7f4617e00700 1 -- 172.21.15.69:0/3615885924 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46201a8fb0 con 0x7f4620108d30 2024-05-14T15:18:50.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.888+0000 7f4617e00700 1 --2- 172.21.15.69:0/3615885924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4620108d30 0x7f4620075fc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f460800d980 tx=0x7f460800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:50.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.888+0000 7f4616a00700 1 -- 172.21.15.69:0/3615885924 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4608017070 con 0x7f4620108d30 2024-05-14T15:18:50.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.888+0000 7f4616a00700 1 -- 172.21.15.69:0/3615885924 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f460800fd20 con 0x7f4620108d30 2024-05-14T15:18:50.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.888+0000 7f4616a00700 1 -- 172.21.15.69:0/3615885924 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f460800e3b0 con 0x7f4620108d30 2024-05-14T15:18:50.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.889+0000 7f461f200700 1 -- 172.21.15.69:0/3615885924 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46201a92a0 con 0x7f4620108d30 2024-05-14T15:18:50.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.889+0000 7f461f200700 1 -- 172.21.15.69:0/3615885924 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46201a9790 con 0x7f4620108d30 2024-05-14T15:18:50.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.890+0000 7f461f200700 1 -- 172.21.15.69:0/3615885924 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4620063ed0 con 0x7f4620108d30 2024-05-14T15:18:50.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.893+0000 7f4616a00700 1 -- 172.21.15.69:0/3615885924 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f460800f890 con 0x7f4620108d30 2024-05-14T15:18:50.893 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:50 smithi069 ceph-mon[31270]: pgmap v475: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:18:50.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.896+0000 7f4616a00700 1 --2- 172.21.15.69:0/3615885924 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f46040b2990 0x7f46040b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:50.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.896+0000 7f4616a00700 1 -- 172.21.15.69:0/3615885924 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f46080e25b0 con 0x7f4620108d30 2024-05-14T15:18:50.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.897+0000 7f4616a00700 1 --2- 172.21.15.69:0/3615885924 >> [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776] conn(0x7f46040bdd40 0x7f46040c0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:50.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.897+0000 7f4616a00700 1 -- 172.21.15.69:0/3615885924 --> [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4608024ea0 con 0x7f46040bdd40 2024-05-14T15:18:50.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.897+0000 7f4616a00700 1 -- 172.21.15.69:0/3615885924 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f46080e2960 con 0x7f4620108d30 2024-05-14T15:18:50.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.897+0000 7f461de00700 1 --2- 172.21.15.69:0/3615885924 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f46040b2990 0x7f46040b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:50.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.897+0000 7f461e800700 1 --2- 172.21.15.69:0/3615885924 >> [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776] conn(0x7f46040bdd40 0x7f46040c0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:50.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.898+0000 7f461de00700 1 --2- 172.21.15.69:0/3615885924 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f46040b2990 0x7f46040b4ea0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4610000c00 tx=0x7f4610005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:50.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.899+0000 7f461e800700 1 --2- 172.21.15.69:0/3615885924 >> [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776] conn(0x7f46040bdd40 0x7f46040c0230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:50.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.901+0000 7f4616a00700 1 -- 172.21.15.69:0/3615885924 <== osd.1 v2:172.21.15.92:6800/2774122776 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4608024ea0 con 0x7f46040bdd40 2024-05-14T15:18:50.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.920+0000 7f461f200700 1 -- 172.21.15.69:0/3615885924 --> [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f46200642d0 con 0x7f46040bdd40 2024-05-14T15:18:50.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.921+0000 7f4616a00700 1 -- 172.21.15.69:0/3615885924 <== osd.1 v2:172.21.15.92:6800/2774122776 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f46200642d0 con 0x7f46040bdd40 2024-05-14T15:18:50.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.921+0000 7f461f200700 1 -- 172.21.15.69:0/3615885924 >> [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776] conn(0x7f46040bdd40 msgr2=0x7f46040c0230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:50.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.921+0000 7f461f200700 1 --2- 172.21.15.69:0/3615885924 >> [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776] conn(0x7f46040bdd40 0x7f46040c0230 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:50.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.922+0000 7f461f200700 1 -- 172.21.15.69:0/3615885924 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f46040b2990 msgr2=0x7f46040b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:50.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.922+0000 7f461f200700 1 --2- 172.21.15.69:0/3615885924 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f46040b2990 0x7f46040b4ea0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4610000c00 tx=0x7f4610005fb0 comp rx=0 tx=0).stop 2024-05-14T15:18:50.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.922+0000 7f461f200700 1 -- 172.21.15.69:0/3615885924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4620108d30 msgr2=0x7f4620075fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:50.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.922+0000 7f461f200700 1 --2- 172.21.15.69:0/3615885924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4620108d30 0x7f4620075fc0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f460800d980 tx=0x7f460800dc90 comp rx=0 tx=0).stop 2024-05-14T15:18:50.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.922+0000 7f461e800700 1 -- 172.21.15.69:0/3615885924 reap_dead start 2024-05-14T15:18:50.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.922+0000 7f461f200700 1 -- 172.21.15.69:0/3615885924 shutdown_connections 2024-05-14T15:18:50.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.922+0000 7f461f200700 1 -- 172.21.15.69:0/3615885924 >> 172.21.15.69:0/3615885924 conn(0x7f4620079d10 msgr2=0x7f4620101ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:50.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.922+0000 7f461f200700 1 -- 172.21.15.69:0/3615885924 shutdown_connections 2024-05-14T15:18:50.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.922+0000 7f461f200700 1 -- 172.21.15.69:0/3615885924 wait complete. 2024-05-14T15:18:51.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:50 smithi203 ceph-mon[34567]: pgmap v475: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:18:51.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.132+0000 7f97aee00700 1 -- 172.21.15.69:0/436944515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97a8106570 msgr2=0x7f97a8106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:51.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.132+0000 7f97aee00700 1 --2- 172.21.15.69:0/436944515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97a8106570 0x7f97a8106980 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f9794009990 tx=0x7f9794009ca0 comp rx=0 tx=0).stop 2024-05-14T15:18:51.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.133+0000 7f97aee00700 1 -- 172.21.15.69:0/436944515 shutdown_connections 2024-05-14T15:18:51.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.133+0000 7f97aee00700 1 --2- 172.21.15.69:0/436944515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97a8106ec0 0x7f97a8113350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:51.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.133+0000 7f97aee00700 1 --2- 172.21.15.69:0/436944515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a810c5b0 0x7f97a810c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:51.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.133+0000 7f97aee00700 1 --2- 172.21.15.69:0/436944515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97a8106570 0x7f97a8106980 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:51.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.133+0000 7f97aee00700 1 -- 172.21.15.69:0/436944515 >> 172.21.15.69:0/436944515 conn(0x7f97a8102050 msgr2=0x7f97a81044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:51.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.133+0000 7f97aee00700 1 -- 172.21.15.69:0/436944515 shutdown_connections 2024-05-14T15:18:51.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.133+0000 7f97aee00700 1 -- 172.21.15.69:0/436944515 wait complete. 2024-05-14T15:18:51.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.134+0000 7f97aee00700 1 Processor -- start 2024-05-14T15:18:51.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.134+0000 7f97aee00700 1 -- start start 2024-05-14T15:18:51.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.134+0000 7f97aee00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97a8106570 0x7f97a819cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:51.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.134+0000 7f97aee00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97a8106ec0 0x7f97a819d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:51.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.134+0000 7f97aee00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a810c5b0 0x7f97a81a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:51.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.134+0000 7f97aee00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f97a8116590 con 0x7f97a8106570 2024-05-14T15:18:51.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.134+0000 7f97aee00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f97a8116410 con 0x7f97a810c5b0 2024-05-14T15:18:51.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.134+0000 7f97aee00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f97a8116710 con 0x7f97a8106ec0 2024-05-14T15:18:51.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.135+0000 7f97a7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97a8106570 0x7f97a819cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:51.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.135+0000 7f97a7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97a8106570 0x7f97a819cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35850/0 (socket says 172.21.15.69:35850) 2024-05-14T15:18:51.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.135+0000 7f97a7e00700 1 -- 172.21.15.69:0/1511501418 learned_addr learned my addr 172.21.15.69:0/1511501418 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.135+0000 7f97a7400700 1 --2- 172.21.15.69:0/1511501418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97a8106ec0 0x7f97a819d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.135+0000 7f97ace00700 1 --2- 172.21.15.69:0/1511501418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a810c5b0 0x7f97a81a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.135+0000 7f97a7e00700 1 -- 172.21.15.69:0/1511501418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97a8106ec0 msgr2=0x7f97a819d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.135+0000 7f97a7e00700 1 --2- 172.21.15.69:0/1511501418 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f97a8106ec0 0x7f97a819d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.135+0000 7f97a7e00700 1 -- 172.21.15.69:0/1511501418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a810c5b0 msgr2=0x7f97a81a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.135+0000 7f97a7e00700 1 --2- 172.21.15.69:0/1511501418 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f97a810c5b0 0x7f97a81a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.135+0000 7f97a7e00700 1 -- 172.21.15.69:0/1511501418 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97a81a1eb0 con 0x7f97a8106570 2024-05-14T15:18:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.136+0000 7f97a7e00700 1 --2- 172.21.15.69:0/1511501418 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97a8106570 0x7f97a819cfe0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f979800d980 tx=0x7f979800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.136+0000 7f97a4c00700 1 -- 172.21.15.69:0/1511501418 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9798017070 con 0x7f97a8106570 2024-05-14T15:18:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.136+0000 7f97a4c00700 1 -- 172.21.15.69:0/1511501418 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9798010460 con 0x7f97a8106570 2024-05-14T15:18:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.136+0000 7f97aee00700 1 -- 172.21.15.69:0/1511501418 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97a81a21a0 con 0x7f97a8106570 2024-05-14T15:18:51.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.136+0000 7f97a4c00700 1 -- 172.21.15.69:0/1511501418 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f979800de60 con 0x7f97a8106570 2024-05-14T15:18:51.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.136+0000 7f97aee00700 1 -- 172.21.15.69:0/1511501418 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97a81a9ac0 con 0x7f97a8106570 2024-05-14T15:18:51.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.137+0000 7f97aee00700 1 -- 172.21.15.69:0/1511501418 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f97a8063f50 con 0x7f97a8106570 2024-05-14T15:18:51.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.140+0000 7f97a4c00700 1 -- 172.21.15.69:0/1511501418 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9798010610 con 0x7f97a8106570 2024-05-14T15:18:51.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.141+0000 7f97a4c00700 1 --2- 172.21.15.69:0/1511501418 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f978c0b2910 0x7f978c0b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:51.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.142+0000 7f97a4c00700 1 -- 172.21.15.69:0/1511501418 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f97980e26b0 con 0x7f97a8106570 2024-05-14T15:18:51.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.142+0000 7f97a7400700 1 --2- 172.21.15.69:0/1511501418 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f978c0b2910 0x7f978c0b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:51.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.142+0000 7f97a4c00700 1 --2- 172.21.15.69:0/1511501418 >> [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601] conn(0x7f978c0bdcc0 0x7f978c0c01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:51.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.142+0000 7f97a4c00700 1 -- 172.21.15.69:0/1511501418 --> [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9798016ec0 con 0x7f978c0bdcc0 2024-05-14T15:18:51.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.142+0000 7f97a4c00700 1 -- 172.21.15.69:0/1511501418 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f97980e2a60 con 0x7f97a8106570 2024-05-14T15:18:51.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.142+0000 7f97ace00700 1 --2- 172.21.15.69:0/1511501418 >> [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601] conn(0x7f978c0bdcc0 0x7f978c0c01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:51.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.143+0000 7f97a7400700 1 --2- 172.21.15.69:0/1511501418 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f978c0b2910 0x7f978c0b4e20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f97a8105600 tx=0x7f9794005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:51.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.143+0000 7f97ace00700 1 --2- 172.21.15.69:0/1511501418 >> [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601] conn(0x7f978c0bdcc0 0x7f978c0c01b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:51.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.144+0000 7f97a4c00700 1 -- 172.21.15.69:0/1511501418 <== osd.0 v2:172.21.15.69:6802/301095601 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9798016ec0 con 0x7f978c0bdcc0 2024-05-14T15:18:51.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.163+0000 7f97aee00700 1 -- 172.21.15.69:0/1511501418 --> [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f97a8064350 con 0x7f978c0bdcc0 2024-05-14T15:18:51.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.163+0000 7f97a4c00700 1 -- 172.21.15.69:0/1511501418 <== osd.0 v2:172.21.15.69:6802/301095601 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f97a8064350 con 0x7f978c0bdcc0 2024-05-14T15:18:51.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.164+0000 7f97aee00700 1 -- 172.21.15.69:0/1511501418 >> [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601] conn(0x7f978c0bdcc0 msgr2=0x7f978c0c01b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:51.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.164+0000 7f97aee00700 1 --2- 172.21.15.69:0/1511501418 >> [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601] conn(0x7f978c0bdcc0 0x7f978c0c01b0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:51.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.164+0000 7f97aee00700 1 -- 172.21.15.69:0/1511501418 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f978c0b2910 msgr2=0x7f978c0b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:51.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.164+0000 7f97aee00700 1 --2- 172.21.15.69:0/1511501418 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f978c0b2910 0x7f978c0b4e20 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f97a8105600 tx=0x7f9794005fb0 comp rx=0 tx=0).stop 2024-05-14T15:18:51.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.164+0000 7f97aee00700 1 -- 172.21.15.69:0/1511501418 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97a8106570 msgr2=0x7f97a819cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:51.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.164+0000 7f97aee00700 1 --2- 172.21.15.69:0/1511501418 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f97a8106570 0x7f97a819cfe0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f979800d980 tx=0x7f979800dd40 comp rx=0 tx=0).stop 2024-05-14T15:18:51.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.164+0000 7f97ace00700 1 -- 172.21.15.69:0/1511501418 reap_dead start 2024-05-14T15:18:51.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.164+0000 7f97aee00700 1 -- 172.21.15.69:0/1511501418 shutdown_connections 2024-05-14T15:18:51.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.164+0000 7f97aee00700 1 -- 172.21.15.69:0/1511501418 >> 172.21.15.69:0/1511501418 conn(0x7f97a8102050 msgr2=0x7f97a8103900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:51.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.165+0000 7f97aee00700 1 -- 172.21.15.69:0/1511501418 shutdown_connections 2024-05-14T15:18:51.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:51.165+0000 7f97aee00700 1 -- 172.21.15.69:0/1511501418 wait complete. 2024-05-14T15:18:51.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:50 smithi092 ceph-mon[34729]: pgmap v475: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:18:51.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.305+0000 7fc479600700 1 -- 172.21.15.69:0/2074406259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4740764b0 msgr2=0x7fc474114e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:51.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.305+0000 7fc479600700 1 --2- 172.21.15.69:0/2074406259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4740764b0 0x7fc474114e30 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fc45c009990 tx=0x7fc45c009ca0 comp rx=0 tx=0).stop 2024-05-14T15:18:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.305+0000 7fc479600700 1 -- 172.21.15.69:0/2074406259 shutdown_connections 2024-05-14T15:18:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.305+0000 7fc479600700 1 --2- 172.21.15.69:0/2074406259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc474115370 0x7fc474117790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.305+0000 7fc479600700 1 --2- 172.21.15.69:0/2074406259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc474075b60 0x7fc474075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.305+0000 7fc479600700 1 --2- 172.21.15.69:0/2074406259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc4740764b0 0x7fc474114e30 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.305+0000 7fc479600700 1 -- 172.21.15.69:0/2074406259 >> 172.21.15.69:0/2074406259 conn(0x7fc474100040 msgr2=0x7fc474102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.305+0000 7fc479600700 1 -- 172.21.15.69:0/2074406259 shutdown_connections 2024-05-14T15:18:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.305+0000 7fc479600700 1 -- 172.21.15.69:0/2074406259 wait complete. 2024-05-14T15:18:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.306+0000 7fc479600700 1 Processor -- start 2024-05-14T15:18:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.307+0000 7fc479600700 1 -- start start 2024-05-14T15:18:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.307+0000 7fc479600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc474075b60 0x7fc4741a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:51.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.307+0000 7fc479600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4740764b0 0x7fc4741a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.307+0000 7fc479600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc474115370 0x7fc4741a5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.307+0000 7fc479600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc47411a920 con 0x7fc474075b60 2024-05-14T15:18:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.307+0000 7fc479600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc47411a7a0 con 0x7fc474115370 2024-05-14T15:18:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.307+0000 7fc479600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc47411aaa0 con 0x7fc4740764b0 2024-05-14T15:18:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.307+0000 7fc472a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc474075b60 0x7fc4741a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.308+0000 7fc472a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc474075b60 0x7fc4741a1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35824/0 (socket says 172.21.15.69:35824) 2024-05-14T15:18:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.308+0000 7fc472a00700 1 -- 172.21.15.69:0/2922743956 learned_addr learned my addr 172.21.15.69:0/2922743956 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.308+0000 7fc46a000700 1 --2- 172.21.15.69:0/2922743956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4740764b0 0x7fc4741a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:51.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.308+0000 7fc473400700 1 --2- 172.21.15.69:0/2922743956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc474115370 0x7fc4741a5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:51.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.308+0000 7fc472a00700 1 -- 172.21.15.69:0/2922743956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4740764b0 msgr2=0x7fc4741a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:51.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.308+0000 7fc472a00700 1 --2- 172.21.15.69:0/2922743956 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc4740764b0 0x7fc4741a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:51.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.308+0000 7fc472a00700 1 -- 172.21.15.69:0/2922743956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc474115370 msgr2=0x7fc4741a5ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:51.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.308+0000 7fc472a00700 1 --2- 172.21.15.69:0/2922743956 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc474115370 0x7fc4741a5ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:51.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.308+0000 7fc472a00700 1 -- 172.21.15.69:0/2922743956 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4741a6240 con 0x7fc474075b60 2024-05-14T15:18:51.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.308+0000 7fc472a00700 1 --2- 172.21.15.69:0/2922743956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc474075b60 0x7fc4741a1370 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc46400ada0 tx=0x7fc46400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:51.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.309+0000 7fc46be00700 1 -- 172.21.15.69:0/2922743956 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc464017020 con 0x7fc474075b60 2024-05-14T15:18:51.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.309+0000 7fc46be00700 1 -- 172.21.15.69:0/2922743956 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc46400ce10 con 0x7fc474075b60 2024-05-14T15:18:51.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.309+0000 7fc479600700 1 -- 172.21.15.69:0/2922743956 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4741a6530 con 0x7fc474075b60 2024-05-14T15:18:51.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.309+0000 7fc46be00700 1 -- 172.21.15.69:0/2922743956 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4640054e0 con 0x7fc474075b60 2024-05-14T15:18:51.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.309+0000 7fc479600700 1 -- 172.21.15.69:0/2922743956 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4741ade50 con 0x7fc474075b60 2024-05-14T15:18:51.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.310+0000 7fc479600700 1 -- 172.21.15.69:0/2922743956 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc474063ed0 con 0x7fc474075b60 2024-05-14T15:18:51.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.312+0000 7fc46be00700 1 -- 172.21.15.69:0/2922743956 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fc464004c40 con 0x7fc474075b60 2024-05-14T15:18:51.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.314+0000 7fc46be00700 1 --2- 172.21.15.69:0/2922743956 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc4580b2990 0x7fc4580b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:51.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.314+0000 7fc46be00700 1 -- 172.21.15.69:0/2922743956 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fc4640e2910 con 0x7fc474075b60 2024-05-14T15:18:51.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.314+0000 7fc46a000700 1 --2- 172.21.15.69:0/2922743956 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc4580b2990 0x7fc4580b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:51.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.315+0000 7fc46be00700 1 --2- 172.21.15.69:0/2922743956 >> [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819] conn(0x7fc4580bdd40 0x7fc4580c0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:51.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.315+0000 7fc46be00700 1 -- 172.21.15.69:0/2922743956 --> [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc46400de50 con 0x7fc4580bdd40 2024-05-14T15:18:51.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.315+0000 7fc46be00700 1 -- 172.21.15.69:0/2922743956 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fc4640e2cc0 con 0x7fc474075b60 2024-05-14T15:18:51.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.315+0000 7fc473400700 1 --2- 172.21.15.69:0/2922743956 >> [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819] conn(0x7fc4580bdd40 0x7fc4580c0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:51.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.315+0000 7fc46a000700 1 --2- 172.21.15.69:0/2922743956 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc4580b2990 0x7fc4580b4ea0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc45c006010 tx=0x7fc45c00b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:51.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.316+0000 7fc473400700 1 --2- 172.21.15.69:0/2922743956 >> [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819] conn(0x7fc4580bdd40 0x7fc4580c0230 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:51.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.317+0000 7fc46be00700 1 -- 172.21.15.69:0/2922743956 <== osd.6 v2:172.21.15.69:6818/1213427819 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc46400de50 con 0x7fc4580bdd40 2024-05-14T15:18:51.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.335+0000 7fc479600700 1 -- 172.21.15.69:0/2922743956 --> [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc4740642d0 con 0x7fc4580bdd40 2024-05-14T15:18:51.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.336+0000 7fc46be00700 1 -- 172.21.15.69:0/2922743956 <== osd.6 v2:172.21.15.69:6818/1213427819 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fc4740642d0 con 0x7fc4580bdd40 2024-05-14T15:18:51.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.336+0000 7fc479600700 1 -- 172.21.15.69:0/2922743956 >> [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819] conn(0x7fc4580bdd40 msgr2=0x7fc4580c0230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:51.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.336+0000 7fc479600700 1 --2- 172.21.15.69:0/2922743956 >> [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819] conn(0x7fc4580bdd40 0x7fc4580c0230 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:51.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.336+0000 7fc479600700 1 -- 172.21.15.69:0/2922743956 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc4580b2990 msgr2=0x7fc4580b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:51.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.336+0000 7fc479600700 1 --2- 172.21.15.69:0/2922743956 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc4580b2990 0x7fc4580b4ea0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fc45c006010 tx=0x7fc45c00b540 comp rx=0 tx=0).stop 2024-05-14T15:18:51.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.336+0000 7fc479600700 1 -- 172.21.15.69:0/2922743956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc474075b60 msgr2=0x7fc4741a1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:51.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.336+0000 7fc479600700 1 --2- 172.21.15.69:0/2922743956 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc474075b60 0x7fc4741a1370 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fc46400ada0 tx=0x7fc46400c330 comp rx=0 tx=0).stop 2024-05-14T15:18:51.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.337+0000 7fc473400700 1 -- 172.21.15.69:0/2922743956 reap_dead start 2024-05-14T15:18:51.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.337+0000 7fc479600700 1 -- 172.21.15.69:0/2922743956 shutdown_connections 2024-05-14T15:18:51.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.337+0000 7fc479600700 1 -- 172.21.15.69:0/2922743956 >> 172.21.15.69:0/2922743956 conn(0x7fc474100040 msgr2=0x7fc474100940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:51.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.337+0000 7fc479600700 1 -- 172.21.15.69:0/2922743956 shutdown_connections 2024-05-14T15:18:51.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:50.337+0000 7fc479600700 1 -- 172.21.15.69:0/2922743956 wait complete. 2024-05-14T15:18:52.989 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:52 smithi069 ceph-mon[31270]: pgmap v476: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:18:52.992 INFO:teuthology.orchestra.run.smithi069.stdout:236223201354 2024-05-14T15:18:52.992 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-05-14T15:18:53.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:52 smithi203 ceph-mon[34567]: pgmap v476: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:18:53.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:52 smithi092 ceph-mon[34729]: pgmap v476: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:18:54.092 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:54.731 INFO:teuthology.orchestra.run.smithi069.stdout:184683593819 2024-05-14T15:18:54.732 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-14T15:18:54.897 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:54 smithi069 ceph-mon[31270]: pgmap v477: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:18:54.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.929+0000 7f47c0200700 1 -- 172.21.15.69:0/1968734286 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b8110c20 msgr2=0x7f47b8113040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:54.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.929+0000 7f47c0200700 1 --2- 172.21.15.69:0/1968734286 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b8110c20 0x7f47b8113040 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f47b000b0a0 tx=0x7f47b000b3b0 comp rx=0 tx=0).stop 2024-05-14T15:18:54.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.929+0000 7f47c0200700 1 -- 172.21.15.69:0/1968734286 shutdown_connections 2024-05-14T15:18:54.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.929+0000 7f47c0200700 1 --2- 172.21.15.69:0/1968734286 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b8110c20 0x7f47b8113040 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:54.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.929+0000 7f47c0200700 1 --2- 172.21.15.69:0/1968734286 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b8075ae0 0x7f47b8075ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:54.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.929+0000 7f47c0200700 1 --2- 172.21.15.69:0/1968734286 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b8076430 0x7f47b81106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:54.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.929+0000 7f47c0200700 1 -- 172.21.15.69:0/1968734286 >> 172.21.15.69:0/1968734286 conn(0x7f47b8100040 msgr2=0x7f47b8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:54.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.929+0000 7f47c0200700 1 -- 172.21.15.69:0/1968734286 shutdown_connections 2024-05-14T15:18:54.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.929+0000 7f47c0200700 1 -- 172.21.15.69:0/1968734286 wait complete. 2024-05-14T15:18:54.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.930+0000 7f47c0200700 1 Processor -- start 2024-05-14T15:18:54.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.930+0000 7f47c0200700 1 -- start start 2024-05-14T15:18:54.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.931+0000 7f47c0200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b8075ae0 0x7f47b819cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:54.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.931+0000 7f47c0200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b8076430 0x7f47b819d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:54.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.931+0000 7f47c0200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b8110c20 0x7f47b81a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:54.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.931+0000 7f47c0200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8116560 con 0x7f47b8110c20 2024-05-14T15:18:54.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.931+0000 7f47c0200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81163e0 con 0x7f47b8076430 2024-05-14T15:18:54.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.931+0000 7f47c0200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81166e0 con 0x7f47b8075ae0 2024-05-14T15:18:54.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.931+0000 7f47be200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b8110c20 0x7f47b81a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:54.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.931+0000 7f47be200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b8110c20 0x7f47b81a1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39792/0 (socket says 172.21.15.69:39792) 2024-05-14T15:18:54.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.931+0000 7f47be200700 1 -- 172.21.15.69:0/4200063038 learned_addr learned my addr 172.21.15.69:0/4200063038 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:54.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.931+0000 7f47bce00700 1 --2- 172.21.15.69:0/4200063038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b8076430 0x7f47b819d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:54.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.931+0000 7f47bd800700 1 --2- 172.21.15.69:0/4200063038 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b8075ae0 0x7f47b819cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:54.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.932+0000 7f47be200700 1 -- 172.21.15.69:0/4200063038 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b8075ae0 msgr2=0x7f47b819cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:54.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.932+0000 7f47be200700 1 --2- 172.21.15.69:0/4200063038 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b8075ae0 0x7f47b819cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:54.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.932+0000 7f47be200700 1 -- 172.21.15.69:0/4200063038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b8076430 msgr2=0x7f47b819d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:54.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.932+0000 7f47be200700 1 --2- 172.21.15.69:0/4200063038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b8076430 0x7f47b819d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:54.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.932+0000 7f47be200700 1 -- 172.21.15.69:0/4200063038 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b81a1dc0 con 0x7f47b8110c20 2024-05-14T15:18:54.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.932+0000 7f47bce00700 1 --2- 172.21.15.69:0/4200063038 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b8076430 0x7f47b819d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:18:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.932+0000 7f47bd800700 1 --2- 172.21.15.69:0/4200063038 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b8075ae0 0x7f47b819cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:18:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.932+0000 7f47be200700 1 --2- 172.21.15.69:0/4200063038 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b8110c20 0x7f47b81a1720 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f47b000b830 tx=0x7f47b0004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.932+0000 7f47b6000700 1 -- 172.21.15.69:0/4200063038 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0021070 con 0x7f47b8110c20 2024-05-14T15:18:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.932+0000 7f47b6000700 1 -- 172.21.15.69:0/4200063038 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47b0007c80 con 0x7f47b8110c20 2024-05-14T15:18:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.932+0000 7f47c0200700 1 -- 172.21.15.69:0/4200063038 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b81a2050 con 0x7f47b8110c20 2024-05-14T15:18:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.932+0000 7f47b6000700 1 -- 172.21.15.69:0/4200063038 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47b0005260 con 0x7f47b8110c20 2024-05-14T15:18:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.933+0000 7f47c0200700 1 -- 172.21.15.69:0/4200063038 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b81a99d0 con 0x7f47b8110c20 2024-05-14T15:18:54.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.934+0000 7f47c0200700 1 -- 172.21.15.69:0/4200063038 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f47b8063f50 con 0x7f47b8110c20 2024-05-14T15:18:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.936+0000 7f47b6000700 1 -- 172.21.15.69:0/4200063038 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f47b0024070 con 0x7f47b8110c20 2024-05-14T15:18:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.938+0000 7f47b6000700 1 --2- 172.21.15.69:0/4200063038 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f47a00b2990 0x7f47a00b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.938+0000 7f47b6000700 1 -- 172.21.15.69:0/4200063038 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f47b000f020 con 0x7f47b8110c20 2024-05-14T15:18:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.938+0000 7f47bd800700 1 --2- 172.21.15.69:0/4200063038 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f47a00b2990 0x7f47a00b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.938+0000 7f47b6000700 1 --2- 172.21.15.69:0/4200063038 >> [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048] conn(0x7f47a00bdd40 0x7f47a00c0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.938+0000 7f47b6000700 1 -- 172.21.15.69:0/4200063038 --> [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f47b0027e50 con 0x7f47a00bdd40 2024-05-14T15:18:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.938+0000 7f47b6000700 1 -- 172.21.15.69:0/4200063038 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f47b00e4420 con 0x7f47b8110c20 2024-05-14T15:18:54.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.939+0000 7f47bd800700 1 --2- 172.21.15.69:0/4200063038 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f47a00b2990 0x7f47a00b4ea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f47ac005fd0 tx=0x7f47ac005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:54.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.950+0000 7f47bce00700 1 --2- 172.21.15.69:0/4200063038 >> [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048] conn(0x7f47a00bdd40 0x7f47a00c0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:54.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.951+0000 7f47bce00700 1 --2- 172.21.15.69:0/4200063038 >> [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048] conn(0x7f47a00bdd40 0x7f47a00c0230 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:54.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.954+0000 7f47b6000700 1 -- 172.21.15.69:0/4200063038 <== osd.4 v2:172.21.15.92:6808/1071971048 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f47b0027e50 con 0x7f47a00bdd40 2024-05-14T15:18:54.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.989+0000 7f47c0200700 1 -- 172.21.15.69:0/4200063038 --> [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f47b8064350 con 0x7f47a00bdd40 2024-05-14T15:18:54.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.990+0000 7f47b6000700 1 -- 172.21.15.69:0/4200063038 <== osd.4 v2:172.21.15.92:6808/1071971048 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f47b8064350 con 0x7f47a00bdd40 2024-05-14T15:18:54.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.991+0000 7f47c0200700 1 -- 172.21.15.69:0/4200063038 >> [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048] conn(0x7f47a00bdd40 msgr2=0x7f47a00c0230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:54.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.991+0000 7f47c0200700 1 --2- 172.21.15.69:0/4200063038 >> [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048] conn(0x7f47a00bdd40 0x7f47a00c0230 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:54.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.991+0000 7f47c0200700 1 -- 172.21.15.69:0/4200063038 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f47a00b2990 msgr2=0x7f47a00b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:54.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.991+0000 7f47c0200700 1 --2- 172.21.15.69:0/4200063038 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f47a00b2990 0x7f47a00b4ea0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f47ac005fd0 tx=0x7f47ac005ee0 comp rx=0 tx=0).stop 2024-05-14T15:18:54.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.991+0000 7f47c0200700 1 -- 172.21.15.69:0/4200063038 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b8110c20 msgr2=0x7f47b81a1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:54.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.991+0000 7f47c0200700 1 --2- 172.21.15.69:0/4200063038 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b8110c20 0x7f47b81a1720 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f47b000b830 tx=0x7f47b0004db0 comp rx=0 tx=0).stop 2024-05-14T15:18:54.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.991+0000 7f47be200700 1 -- 172.21.15.69:0/4200063038 reap_dead start 2024-05-14T15:18:54.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.992+0000 7f47c0200700 1 -- 172.21.15.69:0/4200063038 shutdown_connections 2024-05-14T15:18:54.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.992+0000 7f47c0200700 1 -- 172.21.15.69:0/4200063038 >> 172.21.15.69:0/4200063038 conn(0x7f47b8100040 msgr2=0x7f47b8101e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:54.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.992+0000 7f47c0200700 1 -- 172.21.15.69:0/4200063038 shutdown_connections 2024-05-14T15:18:54.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:54.992+0000 7f47c0200700 1 -- 172.21.15.69:0/4200063038 wait complete. 2024-05-14T15:18:55.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:54 smithi203 ceph-mon[34567]: pgmap v477: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:18:55.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:54 smithi092 ceph-mon[34729]: pgmap v477: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:18:55.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.747+0000 7fd97c200700 1 -- 172.21.15.69:0/1641735623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd974075d30 msgr2=0x7fd974076140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:55.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.747+0000 7fd97c200700 1 --2- 172.21.15.69:0/1641735623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd974075d30 0x7fd974076140 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fd968009990 tx=0x7fd968009ca0 comp rx=0 tx=0).stop 2024-05-14T15:18:55.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.747+0000 7fd97c200700 1 -- 172.21.15.69:0/1641735623 shutdown_connections 2024-05-14T15:18:55.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.747+0000 7fd97c200700 1 --2- 172.21.15.69:0/1641735623 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd974075d30 0x7fd974076140 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:55.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.747+0000 7fd97c200700 1 --2- 172.21.15.69:0/1641735623 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd974110ba0 0x7fd974113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:55.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.747+0000 7fd97c200700 1 --2- 172.21.15.69:0/1641735623 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd974076680 0x7fd974110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:55.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.747+0000 7fd97c200700 1 -- 172.21.15.69:0/1641735623 >> 172.21.15.69:0/1641735623 conn(0x7fd974100040 msgr2=0x7fd974102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:55.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.747+0000 7fd97c200700 1 -- 172.21.15.69:0/1641735623 shutdown_connections 2024-05-14T15:18:55.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.747+0000 7fd97c200700 1 -- 172.21.15.69:0/1641735623 wait complete. 2024-05-14T15:18:55.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.748+0000 7fd97c200700 1 Processor -- start 2024-05-14T15:18:55.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.749+0000 7fd97c200700 1 -- start start 2024-05-14T15:18:55.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.749+0000 7fd97c200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd974075d30 0x7fd97419cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:55.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.749+0000 7fd97c200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd974076680 0x7fd97419d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:55.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.749+0000 7fd97c200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd974110ba0 0x7fd9741a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:55.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.749+0000 7fd97c200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd9741165c0 con 0x7fd974110ba0 2024-05-14T15:18:55.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.749+0000 7fd97c200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd974116440 con 0x7fd974076680 2024-05-14T15:18:55.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.749+0000 7fd97c200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd974116740 con 0x7fd974075d30 2024-05-14T15:18:55.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.749+0000 7fd97a200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd974110ba0 0x7fd9741a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:55.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.749+0000 7fd97a200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd974110ba0 0x7fd9741a17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39808/0 (socket says 172.21.15.69:39808) 2024-05-14T15:18:55.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.749+0000 7fd97a200700 1 -- 172.21.15.69:0/3082386322 learned_addr learned my addr 172.21.15.69:0/3082386322 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:55.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.750+0000 7fd978e00700 1 --2- 172.21.15.69:0/3082386322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd974076680 0x7fd97419d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:55.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.750+0000 7fd979800700 1 --2- 172.21.15.69:0/3082386322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd974075d30 0x7fd97419cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:55.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.750+0000 7fd97a200700 1 -- 172.21.15.69:0/3082386322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd974075d30 msgr2=0x7fd97419cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:55.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.750+0000 7fd97a200700 1 --2- 172.21.15.69:0/3082386322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd974075d30 0x7fd97419cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:55.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.750+0000 7fd97a200700 1 -- 172.21.15.69:0/3082386322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd974076680 msgr2=0x7fd97419d510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:55.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.750+0000 7fd97a200700 1 --2- 172.21.15.69:0/3082386322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd974076680 0x7fd97419d510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:55.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.750+0000 7fd97a200700 1 -- 172.21.15.69:0/3082386322 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9741a1e40 con 0x7fd974110ba0 2024-05-14T15:18:55.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.750+0000 7fd97a200700 1 --2- 172.21.15.69:0/3082386322 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd974110ba0 0x7fd9741a17a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd96c00b9e0 tx=0x7fd96c00bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:55.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.751+0000 7fd972000700 1 -- 172.21.15.69:0/3082386322 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c019070 con 0x7fd974110ba0 2024-05-14T15:18:55.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.751+0000 7fd972000700 1 -- 172.21.15.69:0/3082386322 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd96c00ce40 con 0x7fd974110ba0 2024-05-14T15:18:55.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.751+0000 7fd97c200700 1 -- 172.21.15.69:0/3082386322 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9741a2130 con 0x7fd974110ba0 2024-05-14T15:18:55.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.751+0000 7fd972000700 1 -- 172.21.15.69:0/3082386322 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd96c012340 con 0x7fd974110ba0 2024-05-14T15:18:55.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.751+0000 7fd97c200700 1 -- 172.21.15.69:0/3082386322 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9741a9a50 con 0x7fd974110ba0 2024-05-14T15:18:55.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.752+0000 7fd97c200700 1 -- 172.21.15.69:0/3082386322 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd974063f50 con 0x7fd974110ba0 2024-05-14T15:18:55.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.754+0000 7fd972000700 1 -- 172.21.15.69:0/3082386322 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fd96c01c070 con 0x7fd974110ba0 2024-05-14T15:18:55.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.756+0000 7fd972000700 1 --2- 172.21.15.69:0/3082386322 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fd95c0b2990 0x7fd95c0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:55.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.756+0000 7fd972000700 1 -- 172.21.15.69:0/3082386322 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fd96c0e25a0 con 0x7fd974110ba0 2024-05-14T15:18:55.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.756+0000 7fd979800700 1 --2- 172.21.15.69:0/3082386322 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fd95c0b2990 0x7fd95c0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:55.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.756+0000 7fd972000700 1 --2- 172.21.15.69:0/3082386322 >> [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776] conn(0x7fd95c0bdd40 0x7fd95c0c0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:55.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.756+0000 7fd972000700 1 -- 172.21.15.69:0/3082386322 --> [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd96c021e50 con 0x7fd95c0bdd40 2024-05-14T15:18:55.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.756+0000 7fd972000700 1 -- 172.21.15.69:0/3082386322 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fd96c0e2950 con 0x7fd974110ba0 2024-05-14T15:18:55.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.757+0000 7fd979800700 1 --2- 172.21.15.69:0/3082386322 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fd95c0b2990 0x7fd95c0b4ea0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd968006010 tx=0x7fd96800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:55.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.757+0000 7fd978e00700 1 --2- 172.21.15.69:0/3082386322 >> [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776] conn(0x7fd95c0bdd40 0x7fd95c0c0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:55.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.758+0000 7fd978e00700 1 --2- 172.21.15.69:0/3082386322 >> [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776] conn(0x7fd95c0bdd40 0x7fd95c0c0230 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:55.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.761+0000 7fd972000700 1 -- 172.21.15.69:0/3082386322 <== osd.10 v2:172.21.15.92:6824/3650822776 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd96c021e50 con 0x7fd95c0bdd40 2024-05-14T15:18:55.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.778+0000 7fd97c200700 1 -- 172.21.15.69:0/3082386322 --> [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd9740643d0 con 0x7fd95c0bdd40 2024-05-14T15:18:55.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.779+0000 7fd972000700 1 -- 172.21.15.69:0/3082386322 <== osd.10 v2:172.21.15.92:6824/3650822776 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fd9740643d0 con 0x7fd95c0bdd40 2024-05-14T15:18:55.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.779+0000 7fd97c200700 1 -- 172.21.15.69:0/3082386322 >> [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776] conn(0x7fd95c0bdd40 msgr2=0x7fd95c0c0230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:55.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.779+0000 7fd97c200700 1 --2- 172.21.15.69:0/3082386322 >> [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776] conn(0x7fd95c0bdd40 0x7fd95c0c0230 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:55.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.780+0000 7fd97c200700 1 -- 172.21.15.69:0/3082386322 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fd95c0b2990 msgr2=0x7fd95c0b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:55.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.780+0000 7fd97c200700 1 --2- 172.21.15.69:0/3082386322 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fd95c0b2990 0x7fd95c0b4ea0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd968006010 tx=0x7fd96800b540 comp rx=0 tx=0).stop 2024-05-14T15:18:55.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.780+0000 7fd97c200700 1 -- 172.21.15.69:0/3082386322 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd974110ba0 msgr2=0x7fd9741a17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:55.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.780+0000 7fd97c200700 1 --2- 172.21.15.69:0/3082386322 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd974110ba0 0x7fd9741a17a0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fd96c00b9e0 tx=0x7fd96c00bda0 comp rx=0 tx=0).stop 2024-05-14T15:18:55.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.780+0000 7fd97a200700 1 -- 172.21.15.69:0/3082386322 reap_dead start 2024-05-14T15:18:55.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.780+0000 7fd97c200700 1 -- 172.21.15.69:0/3082386322 shutdown_connections 2024-05-14T15:18:55.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.780+0000 7fd97c200700 1 -- 172.21.15.69:0/3082386322 >> 172.21.15.69:0/3082386322 conn(0x7fd974100040 msgr2=0x7fd974100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:55.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.780+0000 7fd97c200700 1 -- 172.21.15.69:0/3082386322 shutdown_connections 2024-05-14T15:18:55.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:55.780+0000 7fd97c200700 1 -- 172.21.15.69:0/3082386322 wait complete. 2024-05-14T15:18:56.134 INFO:teuthology.orchestra.run.smithi069.stdout:133143986283 2024-05-14T15:18:56.134 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-14T15:18:56.283 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:18:56.949 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:56 smithi069 ceph-mon[31270]: pgmap v478: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:18:57.015 INFO:teuthology.orchestra.run.smithi069.stdout:55834574975 2024-05-14T15:18:57.016 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-14T15:18:57.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:56 smithi203 ceph-mon[34567]: pgmap v478: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:18:57.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:56 smithi092 ceph-mon[34729]: pgmap v478: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:18:57.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.313+0000 7f60c2000700 1 -- 172.21.15.69:0/1782300989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60bc1045f0 msgr2=0x7f60bc104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:57.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.313+0000 7f60c2000700 1 --2- 172.21.15.69:0/1782300989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60bc1045f0 0x7f60bc104a00 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0099c0 tx=0x7f60ac009cd0 comp rx=0 tx=0).stop 2024-05-14T15:18:57.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.313+0000 7f60c2000700 1 -- 172.21.15.69:0/1782300989 shutdown_connections 2024-05-14T15:18:57.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.313+0000 7f60c2000700 1 --2- 172.21.15.69:0/1782300989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60bc1045f0 0x7f60bc104a00 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:57.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.313+0000 7f60c2000700 1 --2- 172.21.15.69:0/1782300989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60bc109870 0x7f60bc1111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:57.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.313+0000 7f60c2000700 1 --2- 172.21.15.69:0/1782300989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60bc108f20 0x7f60bc109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:57.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.313+0000 7f60c2000700 1 -- 172.21.15.69:0/1782300989 >> 172.21.15.69:0/1782300989 conn(0x7f60bc100040 msgr2=0x7f60bc102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:57.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.314+0000 7f60c2000700 1 -- 172.21.15.69:0/1782300989 shutdown_connections 2024-05-14T15:18:57.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.314+0000 7f60c2000700 1 -- 172.21.15.69:0/1782300989 wait complete. 2024-05-14T15:18:57.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.315+0000 7f60c2000700 1 Processor -- start 2024-05-14T15:18:57.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.315+0000 7f60c2000700 1 -- start start 2024-05-14T15:18:57.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.315+0000 7f60c2000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60bc1045f0 0x7f60bc19cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:57.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.315+0000 7f60c2000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60bc108f20 0x7f60bc19d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:57.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.315+0000 7f60c2000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60bc109870 0x7f60bc1a17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:57.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.315+0000 7f60c2000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc1143a0 con 0x7f60bc109870 2024-05-14T15:18:57.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.315+0000 7f60c2000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc114220 con 0x7f60bc108f20 2024-05-14T15:18:57.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.315+0000 7f60c2000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f60bc114520 con 0x7f60bc1045f0 2024-05-14T15:18:57.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.316+0000 7f60bbe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60bc109870 0x7f60bc1a17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:57.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.316+0000 7f60bbe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60bc109870 0x7f60bc1a17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39826/0 (socket says 172.21.15.69:39826) 2024-05-14T15:18:57.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.316+0000 7f60bbe00700 1 -- 172.21.15.69:0/3715603764 learned_addr learned my addr 172.21.15.69:0/3715603764 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:57.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.316+0000 7f60bb400700 1 --2- 172.21.15.69:0/3715603764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60bc1045f0 0x7f60bc19cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:57.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.316+0000 7f60baa00700 1 --2- 172.21.15.69:0/3715603764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60bc108f20 0x7f60bc19d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:57.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.316+0000 7f60bbe00700 1 -- 172.21.15.69:0/3715603764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60bc1045f0 msgr2=0x7f60bc19cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:57.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.316+0000 7f60bbe00700 1 --2- 172.21.15.69:0/3715603764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f60bc1045f0 0x7f60bc19cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.316+0000 7f60bbe00700 1 -- 172.21.15.69:0/3715603764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60bc108f20 msgr2=0x7f60bc19d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.316+0000 7f60bbe00700 1 --2- 172.21.15.69:0/3715603764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f60bc108f20 0x7f60bc19d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.316+0000 7f60bbe00700 1 -- 172.21.15.69:0/3715603764 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60bc1a1db0 con 0x7f60bc109870 2024-05-14T15:18:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.317+0000 7f60bbe00700 1 --2- 172.21.15.69:0/3715603764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60bc109870 0x7f60bc1a17c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f60b4007d70 tx=0x7f60b400a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.317+0000 7f60b3e00700 1 -- 172.21.15.69:0/3715603764 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b4016020 con 0x7f60bc109870 2024-05-14T15:18:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.317+0000 7f60b3e00700 1 -- 172.21.15.69:0/3715603764 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f60b400ad40 con 0x7f60bc109870 2024-05-14T15:18:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.317+0000 7f60b3e00700 1 -- 172.21.15.69:0/3715603764 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b40115e0 con 0x7f60bc109870 2024-05-14T15:18:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.317+0000 7f60c2000700 1 -- 172.21.15.69:0/3715603764 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60bc1a20a0 con 0x7f60bc109870 2024-05-14T15:18:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.317+0000 7f60c2000700 1 -- 172.21.15.69:0/3715603764 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60bc1a2590 con 0x7f60bc109870 2024-05-14T15:18:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.318+0000 7f60c2000700 1 -- 172.21.15.69:0/3715603764 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f60bc076c90 con 0x7f60bc109870 2024-05-14T15:18:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.321+0000 7f60b3e00700 1 -- 172.21.15.69:0/3715603764 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f60b4019020 con 0x7f60bc109870 2024-05-14T15:18:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.322+0000 7f60b3e00700 1 --2- 172.21.15.69:0/3715603764 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f60a00b2910 0x7f60a00b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.322+0000 7f60b3e00700 1 -- 172.21.15.69:0/3715603764 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f60b40e2c00 con 0x7f60bc109870 2024-05-14T15:18:57.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.323+0000 7f60bb400700 1 --2- 172.21.15.69:0/3715603764 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f60a00b2910 0x7f60a00b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:57.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.323+0000 7f60b3e00700 1 --2- 172.21.15.69:0/3715603764 >> [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513] conn(0x7f60a00bdcb0 0x7f60a00c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:57.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.323+0000 7f60b3e00700 1 -- 172.21.15.69:0/3715603764 --> [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f60a00c0870 con 0x7f60a00bdcb0 2024-05-14T15:18:57.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.323+0000 7f60b3e00700 1 -- 172.21.15.69:0/3715603764 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f60b40e2fb0 con 0x7f60bc109870 2024-05-14T15:18:57.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.323+0000 7f60bb400700 1 --2- 172.21.15.69:0/3715603764 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f60a00b2910 0x7f60a00b4e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0058e0 tx=0x7f60ac005a90 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:57.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.324+0000 7f60baa00700 1 --2- 172.21.15.69:0/3715603764 >> [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513] conn(0x7f60a00bdcb0 0x7f60a00c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:57.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.325+0000 7f60baa00700 1 --2- 172.21.15.69:0/3715603764 >> [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513] conn(0x7f60a00bdcb0 0x7f60a00c01a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:57.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.327+0000 7f60b3e00700 1 -- 172.21.15.69:0/3715603764 <== osd.2 v2:172.21.15.203:6800/2836920513 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f60a00c0870 con 0x7f60a00bdcb0 2024-05-14T15:18:57.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.347+0000 7f60c2000700 1 -- 172.21.15.69:0/3715603764 --> [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f60bc105aa0 con 0x7f60a00bdcb0 2024-05-14T15:18:57.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.348+0000 7f60b3e00700 1 -- 172.21.15.69:0/3715603764 <== osd.2 v2:172.21.15.203:6800/2836920513 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f60bc105aa0 con 0x7f60a00bdcb0 2024-05-14T15:18:57.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.348+0000 7f60c2000700 1 -- 172.21.15.69:0/3715603764 >> [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513] conn(0x7f60a00bdcb0 msgr2=0x7f60a00c01a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:57.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.349+0000 7f60c2000700 1 --2- 172.21.15.69:0/3715603764 >> [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513] conn(0x7f60a00bdcb0 0x7f60a00c01a0 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:57.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.349+0000 7f60c2000700 1 -- 172.21.15.69:0/3715603764 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f60a00b2910 msgr2=0x7f60a00b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:57.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.349+0000 7f60c2000700 1 --2- 172.21.15.69:0/3715603764 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f60a00b2910 0x7f60a00b4e20 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f60ac0058e0 tx=0x7f60ac005a90 comp rx=0 tx=0).stop 2024-05-14T15:18:57.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.349+0000 7f60c2000700 1 -- 172.21.15.69:0/3715603764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60bc109870 msgr2=0x7f60bc1a17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:57.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.349+0000 7f60c2000700 1 --2- 172.21.15.69:0/3715603764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f60bc109870 0x7f60bc1a17c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f60b4007d70 tx=0x7f60b400a340 comp rx=0 tx=0).stop 2024-05-14T15:18:57.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.349+0000 7f60bbe00700 1 -- 172.21.15.69:0/3715603764 reap_dead start 2024-05-14T15:18:57.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.349+0000 7f60c2000700 1 -- 172.21.15.69:0/3715603764 shutdown_connections 2024-05-14T15:18:57.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.349+0000 7f60c2000700 1 -- 172.21.15.69:0/3715603764 >> 172.21.15.69:0/3715603764 conn(0x7f60bc100040 msgr2=0x7f60bc10a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:57.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.349+0000 7f60c2000700 1 -- 172.21.15.69:0/3715603764 shutdown_connections 2024-05-14T15:18:57.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:57.349+0000 7f60c2000700 1 -- 172.21.15.69:0/3715603764 wait complete. 2024-05-14T15:18:58.289 INFO:teuthology.orchestra.run.smithi069.stdout:34359738503 2024-05-14T15:18:58.289 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-14T15:18:58.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.683+0000 7faa2fa00700 1 -- 172.21.15.69:0/4231773395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa28108f00 msgr2=0x7faa28109310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:58.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.683+0000 7faa2fa00700 1 --2- 172.21.15.69:0/4231773395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa28108f00 0x7faa28109310 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7faa140099c0 tx=0x7faa14009cd0 comp rx=0 tx=0).stop 2024-05-14T15:18:58.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.683+0000 7faa2fa00700 1 -- 172.21.15.69:0/4231773395 shutdown_connections 2024-05-14T15:18:58.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.683+0000 7faa2fa00700 1 --2- 172.21.15.69:0/4231773395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa28109850 0x7faa281111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:58.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.683+0000 7faa2fa00700 1 --2- 172.21.15.69:0/4231773395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa281045d0 0x7faa281049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:58.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.683+0000 7faa2fa00700 1 --2- 172.21.15.69:0/4231773395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa28108f00 0x7faa28109310 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:58.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.683+0000 7faa2fa00700 1 -- 172.21.15.69:0/4231773395 >> 172.21.15.69:0/4231773395 conn(0x7faa280ffea0 msgr2=0x7faa281022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:58.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.683+0000 7faa2fa00700 1 -- 172.21.15.69:0/4231773395 shutdown_connections 2024-05-14T15:18:58.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.683+0000 7faa2fa00700 1 -- 172.21.15.69:0/4231773395 wait complete. 2024-05-14T15:18:58.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.685+0000 7faa2fa00700 1 Processor -- start 2024-05-14T15:18:58.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.685+0000 7faa2fa00700 1 -- start start 2024-05-14T15:18:58.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.685+0000 7faa2fa00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa281045d0 0x7faa2819cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:58.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.685+0000 7faa2fa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa28108f00 0x7faa2819d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:58.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.685+0000 7faa2fa00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa28109850 0x7faa281a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:58.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.685+0000 7faa2fa00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7faa28114310 con 0x7faa28108f00 2024-05-14T15:18:58.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.685+0000 7faa2fa00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa28114190 con 0x7faa28109850 2024-05-14T15:18:58.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.685+0000 7faa2fa00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faa28114490 con 0x7faa281045d0 2024-05-14T15:18:58.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.686+0000 7faa27e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa28108f00 0x7faa2819d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:58.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.686+0000 7faa27e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa28108f00 0x7faa2819d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39844/0 (socket says 172.21.15.69:39844) 2024-05-14T15:18:58.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.686+0000 7faa27e00700 1 -- 172.21.15.69:0/1064420585 learned_addr learned my addr 172.21.15.69:0/1064420585 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:18:58.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.686+0000 7faa2d000700 1 --2- 172.21.15.69:0/1064420585 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa281045d0 0x7faa2819cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:58.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.686+0000 7faa2da00700 1 --2- 172.21.15.69:0/1064420585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa28109850 0x7faa281a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:58.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.686+0000 7faa27e00700 1 -- 172.21.15.69:0/1064420585 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa281045d0 msgr2=0x7faa2819cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:58.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.686+0000 7faa27e00700 1 --2- 172.21.15.69:0/1064420585 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa281045d0 0x7faa2819cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:58.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.686+0000 7faa27e00700 1 -- 172.21.15.69:0/1064420585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa28109850 msgr2=0x7faa281a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:58.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.686+0000 7faa27e00700 1 --2- 172.21.15.69:0/1064420585 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa28109850 0x7faa281a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:58.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.686+0000 7faa27e00700 1 -- 172.21.15.69:0/1064420585 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa281a1df0 con 0x7faa28108f00 2024-05-14T15:18:58.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.687+0000 7faa27e00700 1 --2- 172.21.15.69:0/1064420585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa28108f00 0x7faa2819d4c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faa1400b580 tx=0x7faa1400f690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:58.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.687+0000 7faa25600700 1 -- 172.21.15.69:0/1064420585 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14027070 con 0x7faa28108f00 2024-05-14T15:18:58.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.687+0000 7faa2fa00700 1 -- 172.21.15.69:0/1064420585 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa281a2080 con 0x7faa28108f00 2024-05-14T15:18:58.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.687+0000 7faa25600700 1 -- 172.21.15.69:0/1064420585 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa14022470 con 0x7faa28108f00 2024-05-14T15:18:58.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.687+0000 7faa25600700 1 -- 172.21.15.69:0/1064420585 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa14017650 con 0x7faa28108f00 2024-05-14T15:18:58.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.687+0000 7faa2fa00700 1 -- 172.21.15.69:0/1064420585 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa281a9a00 con 0x7faa28108f00 2024-05-14T15:18:58.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.688+0000 7faa2fa00700 1 -- 172.21.15.69:0/1064420585 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7faa28077e20 con 0x7faa28108f00 2024-05-14T15:18:58.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.691+0000 7faa25600700 1 -- 172.21.15.69:0/1064420585 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7faa1402a070 con 0x7faa28108f00 2024-05-14T15:18:58.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.693+0000 7faa25600700 1 --2- 172.21.15.69:0/1064420585 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7faa100b2910 0x7faa100b4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:58.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.693+0000 7faa25600700 1 -- 172.21.15.69:0/1064420585 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7faa140e40b0 con 0x7faa28108f00 2024-05-14T15:18:58.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.693+0000 7faa2d000700 1 --2- 172.21.15.69:0/1064420585 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7faa100b2910 0x7faa100b4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:58.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.693+0000 7faa25600700 1 --2- 172.21.15.69:0/1064420585 >> [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582] conn(0x7faa100bdb90 0x7faa100c0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:18:58.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.693+0000 7faa25600700 1 -- 172.21.15.69:0/1064420585 --> [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faa1402be50 con 0x7faa100bdb90 2024-05-14T15:18:58.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.693+0000 7faa25600700 1 -- 172.21.15.69:0/1064420585 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7faa140e4460 con 0x7faa28108f00 2024-05-14T15:18:58.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.694+0000 7faa2d000700 1 --2- 172.21.15.69:0/1064420585 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7faa100b2910 0x7faa100b4e20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa1c005950 tx=0x7faa1c00a300 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:58.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.694+0000 7faa2da00700 1 --2- 172.21.15.69:0/1064420585 >> [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582] conn(0x7faa100bdb90 0x7faa100c0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:18:58.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.695+0000 7faa2da00700 1 --2- 172.21.15.69:0/1064420585 >> [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582] conn(0x7faa100bdb90 0x7faa100c0080 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:18:58.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.698+0000 7faa25600700 1 -- 172.21.15.69:0/1064420585 <== osd.7 v2:172.21.15.92:6816/4274774582 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faa1402be50 con 0x7faa100bdb90 2024-05-14T15:18:58.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.715+0000 7faa2fa00700 1 -- 172.21.15.69:0/1064420585 --> [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7faa28105a80 con 0x7faa100bdb90 2024-05-14T15:18:58.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.717+0000 7faa25600700 1 -- 172.21.15.69:0/1064420585 <== osd.7 v2:172.21.15.92:6816/4274774582 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7faa28105a80 con 0x7faa100bdb90 2024-05-14T15:18:58.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.717+0000 7faa2fa00700 1 -- 172.21.15.69:0/1064420585 >> [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582] conn(0x7faa100bdb90 msgr2=0x7faa100c0080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:58.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.717+0000 7faa2fa00700 1 --2- 172.21.15.69:0/1064420585 >> [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582] conn(0x7faa100bdb90 0x7faa100c0080 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:18:58.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.717+0000 7faa2fa00700 1 -- 172.21.15.69:0/1064420585 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7faa100b2910 msgr2=0x7faa100b4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:58.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.717+0000 7faa2fa00700 1 --2- 172.21.15.69:0/1064420585 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7faa100b2910 0x7faa100b4e20 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7faa1c005950 tx=0x7faa1c00a300 comp rx=0 tx=0).stop 2024-05-14T15:18:58.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.718+0000 7faa2fa00700 1 -- 172.21.15.69:0/1064420585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa28108f00 msgr2=0x7faa2819d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:18:58.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.718+0000 7faa2fa00700 1 --2- 172.21.15.69:0/1064420585 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa28108f00 0x7faa2819d4c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7faa1400b580 tx=0x7faa1400f690 comp rx=0 tx=0).stop 2024-05-14T15:18:58.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.718+0000 7faa2da00700 1 -- 172.21.15.69:0/1064420585 reap_dead start 2024-05-14T15:18:58.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.718+0000 7faa2fa00700 1 -- 172.21.15.69:0/1064420585 shutdown_connections 2024-05-14T15:18:58.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.718+0000 7faa2fa00700 1 -- 172.21.15.69:0/1064420585 >> 172.21.15.69:0/1064420585 conn(0x7faa280ffea0 msgr2=0x7faa2810a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:18:58.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.718+0000 7faa2fa00700 1 -- 172.21.15.69:0/1064420585 shutdown_connections 2024-05-14T15:18:58.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:58.718+0000 7faa2fa00700 1 -- 172.21.15.69:0/1064420585 wait complete. 2024-05-14T15:18:58.940 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:18:58 smithi069 ceph-mon[31270]: pgmap v479: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T15:18:59.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:18:58 smithi203 ceph-mon[34567]: pgmap v479: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T15:18:59.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:18:58 smithi092 ceph-mon[34729]: pgmap v479: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 10 op/s 2024-05-14T15:19:00.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.542+0000 7f0931e00700 1 -- 172.21.15.69:0/1338237041 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f092c10c5c0 msgr2=0x7f092c10c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.542+0000 7f0931e00700 1 --2- 172.21.15.69:0/1338237041 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f092c10c5c0 0x7f092c10c9d0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f091c009990 tx=0x7f091c009ca0 comp rx=0 tx=0).stop 2024-05-14T15:19:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.542+0000 7f0931e00700 1 -- 172.21.15.69:0/1338237041 shutdown_connections 2024-05-14T15:19:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.542+0000 7f0931e00700 1 --2- 172.21.15.69:0/1338237041 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f092c10c5c0 0x7f092c10c9d0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.542+0000 7f0931e00700 1 --2- 172.21.15.69:0/1338237041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f092c106ed0 0x7f092c113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.542+0000 7f0931e00700 1 --2- 172.21.15.69:0/1338237041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f092c106580 0x7f092c106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.542+0000 7f0931e00700 1 -- 172.21.15.69:0/1338237041 >> 172.21.15.69:0/1338237041 conn(0x7f092c102080 msgr2=0x7f092c1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.542+0000 7f0931e00700 1 -- 172.21.15.69:0/1338237041 shutdown_connections 2024-05-14T15:19:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.542+0000 7f0931e00700 1 -- 172.21.15.69:0/1338237041 wait complete. 2024-05-14T15:19:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.543+0000 7f0931e00700 1 Processor -- start 2024-05-14T15:19:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.544+0000 7f0931e00700 1 -- start start 2024-05-14T15:19:00.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.544+0000 7f0931e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f092c106580 0x7f092c19cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:00.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.544+0000 7f0931e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f092c106ed0 0x7f092c19d540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:00.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.544+0000 7f0931e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f092c10c5c0 0x7f092c1a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:00.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.544+0000 7f0931e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f092c1165d0 con 0x7f092c106580 2024-05-14T15:19:00.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.544+0000 7f0931e00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f092c116450 con 0x7f092c10c5c0 2024-05-14T15:19:00.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.544+0000 7f0931e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f092c116750 con 0x7f092c106ed0 2024-05-14T15:19:00.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.544+0000 7f092aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f092c106580 0x7f092c19cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:00.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.544+0000 7f092aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f092c106580 0x7f092c19cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39852/0 (socket says 172.21.15.69:39852) 2024-05-14T15:19:00.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.544+0000 7f092aa00700 1 -- 172.21.15.69:0/2633833617 learned_addr learned my addr 172.21.15.69:0/2633833617 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:00.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.545+0000 7f092a000700 1 --2- 172.21.15.69:0/2633833617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f092c106ed0 0x7f092c19d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:00.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.545+0000 7f092b400700 1 --2- 172.21.15.69:0/2633833617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f092c10c5c0 0x7f092c1a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:00.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.545+0000 7f092aa00700 1 -- 172.21.15.69:0/2633833617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f092c106ed0 msgr2=0x7f092c19d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:00.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.545+0000 7f092aa00700 1 --2- 172.21.15.69:0/2633833617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f092c106ed0 0x7f092c19d540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:00.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.545+0000 7f092aa00700 1 -- 172.21.15.69:0/2633833617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f092c10c5c0 msgr2=0x7f092c1a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:00.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.545+0000 7f092aa00700 1 --2- 172.21.15.69:0/2633833617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f092c10c5c0 0x7f092c1a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:00.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.545+0000 7f092aa00700 1 -- 172.21.15.69:0/2633833617 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f092c1a1e70 con 0x7f092c106580 2024-05-14T15:19:00.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.545+0000 7f092aa00700 1 --2- 172.21.15.69:0/2633833617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f092c106580 0x7f092c19cfa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f091c000c00 tx=0x7f091c005ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:00.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.545+0000 7f0930a00700 1 -- 172.21.15.69:0/2633833617 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c027070 con 0x7f092c106580 2024-05-14T15:19:00.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.545+0000 7f0930a00700 1 -- 172.21.15.69:0/2633833617 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f091c00fb80 con 0x7f092c106580 2024-05-14T15:19:00.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.545+0000 7f0931e00700 1 -- 172.21.15.69:0/2633833617 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f092c1a2100 con 0x7f092c106580 2024-05-14T15:19:00.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.545+0000 7f0930a00700 1 -- 172.21.15.69:0/2633833617 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f091c022c00 con 0x7f092c106580 2024-05-14T15:19:00.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.546+0000 7f0931e00700 1 -- 172.21.15.69:0/2633833617 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f092c1a9a80 con 0x7f092c106580 2024-05-14T15:19:00.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.546+0000 7f0931e00700 1 -- 172.21.15.69:0/2633833617 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f092c063f10 con 0x7f092c106580 2024-05-14T15:19:00.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.549+0000 7f0930a00700 1 -- 172.21.15.69:0/2633833617 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f091c02a070 con 0x7f092c106580 2024-05-14T15:19:00.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.551+0000 7f0930a00700 1 --2- 172.21.15.69:0/2633833617 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f09100b2990 0x7f09100b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:00.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.551+0000 7f0930a00700 1 -- 172.21.15.69:0/2633833617 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f091c0e3c00 con 0x7f092c106580 2024-05-14T15:19:00.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.551+0000 7f092a000700 1 --2- 172.21.15.69:0/2633833617 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f09100b2990 0x7f09100b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:00.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.551+0000 7f0930a00700 1 --2- 172.21.15.69:0/2633833617 >> [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866] conn(0x7f09100bdd40 0x7f09100c0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:00.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.551+0000 7f0930a00700 1 -- 172.21.15.69:0/2633833617 --> [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f091c007e80 con 0x7f09100bdd40 2024-05-14T15:19:00.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.551+0000 7f0930a00700 1 -- 172.21.15.69:0/2633833617 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f091c0e3fb0 con 0x7f092c106580 2024-05-14T15:19:00.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.552+0000 7f092b400700 1 --2- 172.21.15.69:0/2633833617 >> [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866] conn(0x7f09100bdd40 0x7f09100c0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:00.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.552+0000 7f092a000700 1 --2- 172.21.15.69:0/2633833617 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f09100b2990 0x7f09100b4ea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0918005950 tx=0x7f09180058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:00.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.553+0000 7f092b400700 1 --2- 172.21.15.69:0/2633833617 >> [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866] conn(0x7f09100bdd40 0x7f09100c0230 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:00.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.554+0000 7f0930a00700 1 -- 172.21.15.69:0/2633833617 <== osd.9 v2:172.21.15.69:6826/2649966866 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f091c007e80 con 0x7f09100bdd40 2024-05-14T15:19:00.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.572+0000 7f0931e00700 1 -- 172.21.15.69:0/2633833617 --> [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f092c064310 con 0x7f09100bdd40 2024-05-14T15:19:00.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.572+0000 7f0930a00700 1 -- 172.21.15.69:0/2633833617 <== osd.9 v2:172.21.15.69:6826/2649966866 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f092c064310 con 0x7f09100bdd40 2024-05-14T15:19:00.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.573+0000 7f0931e00700 1 -- 172.21.15.69:0/2633833617 >> [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866] conn(0x7f09100bdd40 msgr2=0x7f09100c0230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:00.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.573+0000 7f0931e00700 1 --2- 172.21.15.69:0/2633833617 >> [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866] conn(0x7f09100bdd40 0x7f09100c0230 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:00.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.573+0000 7f0931e00700 1 -- 172.21.15.69:0/2633833617 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f09100b2990 msgr2=0x7f09100b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:00.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.573+0000 7f0931e00700 1 --2- 172.21.15.69:0/2633833617 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f09100b2990 0x7f09100b4ea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f0918005950 tx=0x7f09180058e0 comp rx=0 tx=0).stop 2024-05-14T15:19:00.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.573+0000 7f0931e00700 1 -- 172.21.15.69:0/2633833617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f092c106580 msgr2=0x7f092c19cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:00.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.573+0000 7f0931e00700 1 --2- 172.21.15.69:0/2633833617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f092c106580 0x7f092c19cfa0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f091c000c00 tx=0x7f091c005ef0 comp rx=0 tx=0).stop 2024-05-14T15:19:00.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.573+0000 7f092b400700 1 -- 172.21.15.69:0/2633833617 reap_dead start 2024-05-14T15:19:00.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.573+0000 7f0931e00700 1 -- 172.21.15.69:0/2633833617 shutdown_connections 2024-05-14T15:19:00.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.573+0000 7f0931e00700 1 -- 172.21.15.69:0/2633833617 >> 172.21.15.69:0/2633833617 conn(0x7f092c102080 msgr2=0x7f092c104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:00.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.573+0000 7f0931e00700 1 -- 172.21.15.69:0/2633833617 shutdown_connections 2024-05-14T15:19:00.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:18:59.573+0000 7f0931e00700 1 -- 172.21.15.69:0/2633833617 wait complete. 2024-05-14T15:19:00.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:00 smithi069 ceph-mon[31270]: pgmap v480: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:19:01.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:00 smithi203 ceph-mon[34567]: pgmap v480: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:19:01.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:00 smithi092 ceph-mon[34729]: pgmap v480: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:19:01.447 INFO:teuthology.orchestra.run.smithi069.stdout:283467841597 2024-05-14T15:19:01.447 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-05-14T15:19:01.704 INFO:teuthology.orchestra.run.smithi069.stdout:77309411449 2024-05-14T15:19:01.704 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-14T15:19:02.166 INFO:teuthology.orchestra.run.smithi069.stdout:206158430292 2024-05-14T15:19:02.167 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-14T15:19:02.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:02 smithi069 ceph-mon[31270]: pgmap v481: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:19:03.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:02 smithi203 ceph-mon[34567]: pgmap v481: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:19:03.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:02 smithi092 ceph-mon[34729]: pgmap v481: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:19:03.938 INFO:teuthology.orchestra.run.smithi069.stdout:261993005126 2024-05-14T15:19:03.939 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-05-14T15:19:05.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.025+0000 7f08a8a00700 1 -- 172.21.15.69:0/2815793182 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08a4115370 msgr2=0x7f08a4117790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:05.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.025+0000 7f08a8a00700 1 --2- 172.21.15.69:0/2815793182 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08a4115370 0x7f08a4117790 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f089c009f90 tx=0x7f089c00b330 comp rx=0 tx=0).stop 2024-05-14T15:19:05.027 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:04 smithi069 ceph-mon[31270]: pgmap v482: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:19:05.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.026+0000 7f08a8a00700 1 -- 172.21.15.69:0/2815793182 shutdown_connections 2024-05-14T15:19:05.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.026+0000 7f08a8a00700 1 --2- 172.21.15.69:0/2815793182 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08a4115370 0x7f08a4117790 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:05.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.026+0000 7f08a8a00700 1 --2- 172.21.15.69:0/2815793182 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08a4075b60 0x7f08a4075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:05.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.026+0000 7f08a8a00700 1 --2- 172.21.15.69:0/2815793182 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08a40764b0 0x7f08a4114e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:05.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.026+0000 7f08a8a00700 1 -- 172.21.15.69:0/2815793182 >> 172.21.15.69:0/2815793182 conn(0x7f08a4100040 msgr2=0x7f08a4102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:05.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.026+0000 7f08a8a00700 1 -- 172.21.15.69:0/2815793182 shutdown_connections 2024-05-14T15:19:05.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.026+0000 7f08a8a00700 1 -- 172.21.15.69:0/2815793182 wait complete. 2024-05-14T15:19:05.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.027+0000 7f08a8a00700 1 Processor -- start 2024-05-14T15:19:05.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.028+0000 7f08a8a00700 1 -- start start 2024-05-14T15:19:05.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.029+0000 7f08a8a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08a4075b60 0x7f08a41a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:05.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.029+0000 7f08a8a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08a40764b0 0x7f08a41a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:05.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.029+0000 7f08a8a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08a4115370 0x7f08a41a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:05.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.029+0000 7f08a8a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f08a411a980 con 0x7f08a4075b60 2024-05-14T15:19:05.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.029+0000 7f08a8a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f08a411a800 con 0x7f08a40764b0 2024-05-14T15:19:05.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.029+0000 7f08a8a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f08a411ab00 con 0x7f08a4115370 2024-05-14T15:19:05.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.029+0000 7f08a1e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08a4075b60 0x7f08a41a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:05.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.029+0000 7f08a1e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08a4075b60 0x7f08a41a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33540/0 (socket says 172.21.15.69:33540) 2024-05-14T15:19:05.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.029+0000 7f08a1e00700 1 -- 172.21.15.69:0/2690521853 learned_addr learned my addr 172.21.15.69:0/2690521853 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:05.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.029+0000 7f08a1400700 1 --2- 172.21.15.69:0/2690521853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08a40764b0 0x7f08a41a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:05.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.030+0000 7f08a2800700 1 --2- 172.21.15.69:0/2690521853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08a4115370 0x7f08a41a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:05.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.031+0000 7f08a2800700 1 -- 172.21.15.69:0/2690521853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08a40764b0 msgr2=0x7f08a41a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:05.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.031+0000 7f08a2800700 1 --2- 172.21.15.69:0/2690521853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08a40764b0 0x7f08a41a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:05.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.031+0000 7f08a2800700 1 -- 172.21.15.69:0/2690521853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08a4075b60 msgr2=0x7f08a41a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:05.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.031+0000 7f08a2800700 1 --2- 172.21.15.69:0/2690521853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08a4075b60 0x7f08a41a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:05.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.031+0000 7f08a2800700 1 -- 172.21.15.69:0/2690521853 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a41a61e0 con 0x7f08a4115370 2024-05-14T15:19:05.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.032+0000 7f08a2800700 1 --2- 172.21.15.69:0/2690521853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08a4115370 0x7f08a41a5b40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f089c00b6c0 tx=0x7f089c00cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:05.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.032+0000 7f089aa00700 1 -- 172.21.15.69:0/2690521853 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c021070 con 0x7f08a4115370 2024-05-14T15:19:05.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.032+0000 7f089aa00700 1 -- 172.21.15.69:0/2690521853 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f089c007ac0 con 0x7f08a4115370 2024-05-14T15:19:05.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.033+0000 7f08a8a00700 1 -- 172.21.15.69:0/2690521853 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a41a6470 con 0x7f08a4115370 2024-05-14T15:19:05.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.033+0000 7f08a8a00700 1 -- 172.21.15.69:0/2690521853 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a406f1f0 con 0x7f08a4115370 2024-05-14T15:19:05.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.033+0000 7f089aa00700 1 -- 172.21.15.69:0/2690521853 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c005040 con 0x7f08a4115370 2024-05-14T15:19:05.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.035+0000 7f08a8a00700 1 -- 172.21.15.69:0/2690521853 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f08a4063f10 con 0x7f08a4115370 2024-05-14T15:19:05.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.040+0000 7f089aa00700 1 -- 172.21.15.69:0/2690521853 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f089c024070 con 0x7f08a4115370 2024-05-14T15:19:05.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.043+0000 7f089aa00700 1 --2- 172.21.15.69:0/2690521853 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f08880b2ae0 0x7f08880b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:05.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.043+0000 7f089aa00700 1 -- 172.21.15.69:0/2690521853 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f089c0e35b0 con 0x7f08a4115370 2024-05-14T15:19:05.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.044+0000 7f08a1e00700 1 --2- 172.21.15.69:0/2690521853 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f08880b2ae0 0x7f08880b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:05.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.044+0000 7f089aa00700 1 --2- 172.21.15.69:0/2690521853 >> [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806] conn(0x7f08880bde90 0x7f08880c0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:05.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.045+0000 7f089aa00700 1 -- 172.21.15.69:0/2690521853 --> [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f089c007500 con 0x7f08880bde90 2024-05-14T15:19:05.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.045+0000 7f089aa00700 1 -- 172.21.15.69:0/2690521853 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f089c0e39a0 con 0x7f08a4115370 2024-05-14T15:19:05.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.045+0000 7f08a1e00700 1 --2- 172.21.15.69:0/2690521853 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f08880b2ae0 0x7f08880b4ff0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f088c009750 tx=0x7f088c009310 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:05.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.045+0000 7f08a1400700 1 --2- 172.21.15.69:0/2690521853 >> [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806] conn(0x7f08880bde90 0x7f08880c0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:05.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.046+0000 7f08a1400700 1 --2- 172.21.15.69:0/2690521853 >> [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806] conn(0x7f08880bde90 0x7f08880c0380 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:05.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.049+0000 7f089aa00700 1 -- 172.21.15.69:0/2690521853 <== osd.11 v2:172.21.15.203:6824/2590258806 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f089c007500 con 0x7f08880bde90 2024-05-14T15:19:05.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.078+0000 7f08a8a00700 1 -- 172.21.15.69:0/2690521853 --> [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f08a4064390 con 0x7f08880bde90 2024-05-14T15:19:05.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.079+0000 7f089aa00700 1 -- 172.21.15.69:0/2690521853 <== osd.11 v2:172.21.15.203:6824/2590258806 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f08a4064390 con 0x7f08880bde90 2024-05-14T15:19:05.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.079+0000 7f08a8a00700 1 -- 172.21.15.69:0/2690521853 >> [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806] conn(0x7f08880bde90 msgr2=0x7f08880c0380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:05.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.079+0000 7f08a8a00700 1 --2- 172.21.15.69:0/2690521853 >> [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806] conn(0x7f08880bde90 0x7f08880c0380 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:05.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.080+0000 7f08a8a00700 1 -- 172.21.15.69:0/2690521853 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f08880b2ae0 msgr2=0x7f08880b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:05.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.080+0000 7f08a8a00700 1 --2- 172.21.15.69:0/2690521853 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f08880b2ae0 0x7f08880b4ff0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f088c009750 tx=0x7f088c009310 comp rx=0 tx=0).stop 2024-05-14T15:19:05.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.080+0000 7f08a8a00700 1 -- 172.21.15.69:0/2690521853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08a4115370 msgr2=0x7f08a41a5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:05.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.080+0000 7f08a8a00700 1 --2- 172.21.15.69:0/2690521853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08a4115370 0x7f08a41a5b40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f089c00b6c0 tx=0x7f089c00cc30 comp rx=0 tx=0).stop 2024-05-14T15:19:05.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.080+0000 7f08a2800700 1 -- 172.21.15.69:0/2690521853 reap_dead start 2024-05-14T15:19:05.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.080+0000 7f08a8a00700 1 -- 172.21.15.69:0/2690521853 shutdown_connections 2024-05-14T15:19:05.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.080+0000 7f08a8a00700 1 -- 172.21.15.69:0/2690521853 >> 172.21.15.69:0/2690521853 conn(0x7f08a4100040 msgr2=0x7f08a41006d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:05.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.081+0000 7f08a8a00700 1 -- 172.21.15.69:0/2690521853 shutdown_connections 2024-05-14T15:19:05.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:05.082+0000 7f08a8a00700 1 -- 172.21.15.69:0/2690521853 wait complete. 2024-05-14T15:19:05.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:04 smithi203 ceph-mon[34567]: pgmap v482: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:19:05.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:04 smithi092 ceph-mon[34729]: pgmap v482: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:19:05.968 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:06.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.062+0000 7fb7c6000700 1 -- 172.21.15.69:0/4030784436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7c01045f0 msgr2=0x7fb7c0104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:06.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.062+0000 7fb7c6000700 1 --2- 172.21.15.69:0/4030784436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7c01045f0 0x7fb7c0104a00 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fb7b00099c0 tx=0x7fb7b0009cd0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.062+0000 7fb7c6000700 1 -- 172.21.15.69:0/4030784436 shutdown_connections 2024-05-14T15:19:06.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.062+0000 7fb7c6000700 1 --2- 172.21.15.69:0/4030784436 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7c01045f0 0x7fb7c0104a00 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.062+0000 7fb7c6000700 1 --2- 172.21.15.69:0/4030784436 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7c0109870 0x7fb7c01111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.062+0000 7fb7c6000700 1 --2- 172.21.15.69:0/4030784436 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7c0108f20 0x7fb7c0109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.062+0000 7fb7c6000700 1 -- 172.21.15.69:0/4030784436 >> 172.21.15.69:0/4030784436 conn(0x7fb7c0100040 msgr2=0x7fb7c0102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:06.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.062+0000 7fb7c6000700 1 -- 172.21.15.69:0/4030784436 shutdown_connections 2024-05-14T15:19:06.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.062+0000 7fb7c6000700 1 -- 172.21.15.69:0/4030784436 wait complete. 2024-05-14T15:19:06.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.063+0000 7fb7c6000700 1 Processor -- start 2024-05-14T15:19:06.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.064+0000 7fb7c6000700 1 -- start start 2024-05-14T15:19:06.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.064+0000 7fb7c6000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7c01045f0 0x7fb7c019ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:06.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.064+0000 7fb7c6000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7c0108f20 0x7fb7c019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:06.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.064+0000 7fb7c6000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7c0109870 0x7fb7c019f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:06.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.064+0000 7fb7c6000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c01143a0 con 0x7fb7c0109870 2024-05-14T15:19:06.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.064+0000 7fb7c6000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c0114220 con 0x7fb7c0108f20 2024-05-14T15:19:06.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.064+0000 7fb7c6000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb7c0114520 con 0x7fb7c01045f0 2024-05-14T15:19:06.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.064+0000 7fb7bfe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7c0109870 0x7fb7c019f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:06.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.065+0000 7fb7bfe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7c0109870 0x7fb7c019f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33552/0 (socket says 172.21.15.69:33552) 2024-05-14T15:19:06.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.065+0000 7fb7bfe00700 1 -- 172.21.15.69:0/848774501 learned_addr learned my addr 172.21.15.69:0/848774501 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:06.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.065+0000 7fb7bf400700 1 --2- 172.21.15.69:0/848774501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7c01045f0 0x7fb7c019ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:06.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.065+0000 7fb7bfe00700 1 -- 172.21.15.69:0/848774501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7c01045f0 msgr2=0x7fb7c019ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:06.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.065+0000 7fb7bfe00700 1 --2- 172.21.15.69:0/848774501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb7c01045f0 0x7fb7c019ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.065+0000 7fb7bfe00700 1 -- 172.21.15.69:0/848774501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7c0108f20 msgr2=0x7fb7c019b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:06.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.065+0000 7fb7bfe00700 1 --2- 172.21.15.69:0/848774501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb7c0108f20 0x7fb7c019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.065+0000 7fb7bfe00700 1 -- 172.21.15.69:0/848774501 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7c019fb90 con 0x7fb7c0109870 2024-05-14T15:19:06.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.066+0000 7fb7bfe00700 1 --2- 172.21.15.69:0/848774501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7c0109870 0x7fb7c019f5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8007d70 tx=0x7fb7b800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:06.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.066+0000 7fb7b7e00700 1 -- 172.21.15.69:0/848774501 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b8016020 con 0x7fb7c0109870 2024-05-14T15:19:06.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.066+0000 7fb7b7e00700 1 -- 172.21.15.69:0/848774501 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb7b800ad40 con 0x7fb7c0109870 2024-05-14T15:19:06.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.066+0000 7fb7b7e00700 1 -- 172.21.15.69:0/848774501 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7b80115e0 con 0x7fb7c0109870 2024-05-14T15:19:06.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.066+0000 7fb7c6000700 1 -- 172.21.15.69:0/848774501 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7c019fe80 con 0x7fb7c0109870 2024-05-14T15:19:06.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.066+0000 7fb7c6000700 1 -- 172.21.15.69:0/848774501 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7c01a0370 con 0x7fb7c0109870 2024-05-14T15:19:06.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.067+0000 7fb7c6000700 1 -- 172.21.15.69:0/848774501 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb7c0063f10 con 0x7fb7c0109870 2024-05-14T15:19:06.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.070+0000 7fb7b7e00700 1 -- 172.21.15.69:0/848774501 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7fb7b8019020 con 0x7fb7c0109870 2024-05-14T15:19:06.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.072+0000 7fb7b7e00700 1 --2- 172.21.15.69:0/848774501 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb7a40b2990 0x7fb7a40b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:06.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.072+0000 7fb7b7e00700 1 -- 172.21.15.69:0/848774501 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fb7b80e2b70 con 0x7fb7c0109870 2024-05-14T15:19:06.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.072+0000 7fb7bf400700 1 --2- 172.21.15.69:0/848774501 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb7a40b2990 0x7fb7a40b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:06.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.072+0000 7fb7b7e00700 1 --2- 172.21.15.69:0/848774501 >> [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851] conn(0x7fb7a40bdd40 0x7fb7a40c0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:06.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.072+0000 7fb7b7e00700 1 -- 172.21.15.69:0/848774501 --> [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7a40c0900 con 0x7fb7a40bdd40 2024-05-14T15:19:06.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.072+0000 7fb7b7e00700 1 -- 172.21.15.69:0/848774501 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7fb7b80e2f20 con 0x7fb7c0109870 2024-05-14T15:19:06.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.073+0000 7fb7bf400700 1 --2- 172.21.15.69:0/848774501 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb7a40b2990 0x7fb7a40b4ea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0000c00 tx=0x7fb7b0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:06.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.073+0000 7fb7bea00700 1 --2- 172.21.15.69:0/848774501 >> [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851] conn(0x7fb7a40bdd40 0x7fb7a40c0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:06.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.074+0000 7fb7bea00700 1 --2- 172.21.15.69:0/848774501 >> [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851] conn(0x7fb7a40bdd40 0x7fb7a40c0230 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:06.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.076+0000 7fb7b7e00700 1 -- 172.21.15.69:0/848774501 <== osd.5 v2:172.21.15.203:6808/1404230851 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb7a40c0900 con 0x7fb7a40bdd40 2024-05-14T15:19:06.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.094+0000 7fb7c6000700 1 -- 172.21.15.69:0/848774501 --> [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb7c0064390 con 0x7fb7a40bdd40 2024-05-14T15:19:06.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.095+0000 7fb7b7e00700 1 -- 172.21.15.69:0/848774501 <== osd.5 v2:172.21.15.203:6808/1404230851 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fb7c0064390 con 0x7fb7a40bdd40 2024-05-14T15:19:06.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.096+0000 7fb7c6000700 1 -- 172.21.15.69:0/848774501 >> [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851] conn(0x7fb7a40bdd40 msgr2=0x7fb7a40c0230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:06.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.096+0000 7fb7c6000700 1 --2- 172.21.15.69:0/848774501 >> [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851] conn(0x7fb7a40bdd40 0x7fb7a40c0230 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.096+0000 7fb7c6000700 1 -- 172.21.15.69:0/848774501 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb7a40b2990 msgr2=0x7fb7a40b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:06.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.096+0000 7fb7c6000700 1 --2- 172.21.15.69:0/848774501 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb7a40b2990 0x7fb7a40b4ea0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fb7b0000c00 tx=0x7fb7b0005fb0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.096+0000 7fb7c6000700 1 -- 172.21.15.69:0/848774501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7c0109870 msgr2=0x7fb7c019f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:06.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.096+0000 7fb7c6000700 1 --2- 172.21.15.69:0/848774501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb7c0109870 0x7fb7c019f5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fb7b8007d70 tx=0x7fb7b800a340 comp rx=0 tx=0).stop 2024-05-14T15:19:06.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.096+0000 7fb7bfe00700 1 -- 172.21.15.69:0/848774501 reap_dead start 2024-05-14T15:19:06.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.096+0000 7fb7c6000700 1 -- 172.21.15.69:0/848774501 shutdown_connections 2024-05-14T15:19:06.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.096+0000 7fb7c6000700 1 -- 172.21.15.69:0/848774501 >> 172.21.15.69:0/848774501 conn(0x7fb7c0100040 msgr2=0x7fb7c0102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:06.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.096+0000 7fb7c6000700 1 -- 172.21.15.69:0/848774501 shutdown_connections 2024-05-14T15:19:06.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.096+0000 7fb7c6000700 1 -- 172.21.15.69:0/848774501 wait complete. 2024-05-14T15:19:06.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.633+0000 7f9ae3400700 1 -- 172.21.15.69:0/2302361130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9adc10a990 msgr2=0x7f9adc10ada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:06.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.634+0000 7f9ae3400700 1 --2- 172.21.15.69:0/2302361130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9adc10a990 0x7f9adc10ada0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9ac8009990 tx=0x7f9ac8009ca0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.634+0000 7f9ae3400700 1 -- 172.21.15.69:0/2302361130 shutdown_connections 2024-05-14T15:19:06.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.634+0000 7f9ae3400700 1 --2- 172.21.15.69:0/2302361130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9adc10b2e0 0x7f9adc117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.634+0000 7f9ae3400700 1 --2- 172.21.15.69:0/2302361130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9adc110970 0x7f9adc110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.634+0000 7f9ae3400700 1 --2- 172.21.15.69:0/2302361130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9adc10a990 0x7f9adc10ada0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.634+0000 7f9ae3400700 1 -- 172.21.15.69:0/2302361130 >> 172.21.15.69:0/2302361130 conn(0x7f9adc077c80 msgr2=0x7f9adc0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:06.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.634+0000 7f9ae3400700 1 -- 172.21.15.69:0/2302361130 shutdown_connections 2024-05-14T15:19:06.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.634+0000 7f9ae3400700 1 -- 172.21.15.69:0/2302361130 wait complete. 2024-05-14T15:19:06.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.635+0000 7f9ae3400700 1 Processor -- start 2024-05-14T15:19:06.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.635+0000 7f9ae3400700 1 -- start start 2024-05-14T15:19:06.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.636+0000 7f9ae3400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9adc10a990 0x7f9adc1a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:06.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.636+0000 7f9ae3400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9adc10b2e0 0x7f9adc1a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:06.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.636+0000 7f9ae3400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9adc110970 0x7f9adc1a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:06.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.636+0000 7f9ae3400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9adc11a9c0 con 0x7f9adc110970 2024-05-14T15:19:06.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.636+0000 7f9ae3400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9adc11a840 con 0x7f9adc10b2e0 2024-05-14T15:19:06.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.636+0000 7f9ae3400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9adc11ab40 con 0x7f9adc10a990 2024-05-14T15:19:06.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.636+0000 7f9ae1400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9adc110970 0x7f9adc1a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:06.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.636+0000 7f9ae1400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9adc110970 0x7f9adc1a5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33568/0 (socket says 172.21.15.69:33568) 2024-05-14T15:19:06.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.636+0000 7f9ae1400700 1 -- 172.21.15.69:0/1856491619 learned_addr learned my addr 172.21.15.69:0/1856491619 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:06.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.636+0000 7f9adbe00700 1 --2- 172.21.15.69:0/1856491619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9adc10b2e0 0x7f9adc1a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:06.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.636+0000 7f9ae0a00700 1 --2- 172.21.15.69:0/1856491619 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9adc10a990 0x7f9adc1a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:06.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.637+0000 7f9ae1400700 1 -- 172.21.15.69:0/1856491619 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9adc10a990 msgr2=0x7f9adc1a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:06.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.637+0000 7f9ae1400700 1 --2- 172.21.15.69:0/1856491619 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9adc10a990 0x7f9adc1a1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.637+0000 7f9ae1400700 1 -- 172.21.15.69:0/1856491619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9adc10b2e0 msgr2=0x7f9adc1a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:06.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.637+0000 7f9ae1400700 1 --2- 172.21.15.69:0/1856491619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9adc10b2e0 0x7f9adc1a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.637+0000 7f9ae1400700 1 -- 172.21.15.69:0/1856491619 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9adc1a6260 con 0x7f9adc110970 2024-05-14T15:19:06.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.637+0000 7f9ae1400700 1 --2- 172.21.15.69:0/1856491619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9adc110970 0x7f9adc1a5bc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4007ee0 tx=0x7f9ad400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:06.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.637+0000 7f9ad9600700 1 -- 172.21.15.69:0/1856491619 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad400dbd0 con 0x7f9adc110970 2024-05-14T15:19:06.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.637+0000 7f9ad9600700 1 -- 172.21.15.69:0/1856491619 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ad400dd70 con 0x7f9adc110970 2024-05-14T15:19:06.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.637+0000 7f9ae3400700 1 -- 172.21.15.69:0/1856491619 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9adc1a6550 con 0x7f9adc110970 2024-05-14T15:19:06.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.637+0000 7f9ad9600700 1 -- 172.21.15.69:0/1856491619 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ad40058d0 con 0x7f9adc110970 2024-05-14T15:19:06.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.638+0000 7f9ae3400700 1 -- 172.21.15.69:0/1856491619 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9adc1ade70 con 0x7f9adc110970 2024-05-14T15:19:06.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.638+0000 7f9ae3400700 1 -- 172.21.15.69:0/1856491619 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9adc063f50 con 0x7f9adc110970 2024-05-14T15:19:06.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.641+0000 7f9ad9600700 1 -- 172.21.15.69:0/1856491619 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 17) ==== 149703+0+0 (secure 0 0 0) 0x7f9ad401a020 con 0x7f9adc110970 2024-05-14T15:19:06.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.643+0000 7f9ad9600700 1 --2- 172.21.15.69:0/1856491619 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9ac40b2940 0x7f9ac40b4e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:06.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.643+0000 7f9ad9600700 1 -- 172.21.15.69:0/1856491619 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f9ad40e2ab0 con 0x7f9adc110970 2024-05-14T15:19:06.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.643+0000 7f9ae0a00700 1 --2- 172.21.15.69:0/1856491619 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9ac40b2940 0x7f9ac40b4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:06.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.643+0000 7f9ad9600700 1 --2- 172.21.15.69:0/1856491619 >> [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620] conn(0x7f9ac40bdcf0 0x7f9ac40c01e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:06.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.643+0000 7f9ad9600700 1 -- 172.21.15.69:0/1856491619 --> [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ad4011ec0 con 0x7f9ac40bdcf0 2024-05-14T15:19:06.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.643+0000 7f9ad9600700 1 -- 172.21.15.69:0/1856491619 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_get_version_reply(handle=1 version=91) ==== 24+0+0 (secure 0 0 0) 0x7f9ad40e2e60 con 0x7f9adc110970 2024-05-14T15:19:06.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.644+0000 7f9adbe00700 1 --2- 172.21.15.69:0/1856491619 >> [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620] conn(0x7f9ac40bdcf0 0x7f9ac40c01e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:06.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.644+0000 7f9ae0a00700 1 --2- 172.21.15.69:0/1856491619 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9ac40b2940 0x7f9ac40b4e50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0005950 tx=0x7f9ad00058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:06.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.644+0000 7f9adbe00700 1 --2- 172.21.15.69:0/1856491619 >> [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620] conn(0x7f9ac40bdcf0 0x7f9ac40c01e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:06.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.645+0000 7f9ad9600700 1 -- 172.21.15.69:0/1856491619 <== osd.3 v2:172.21.15.69:6810/680308620 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9ad4011ec0 con 0x7f9ac40bdcf0 2024-05-14T15:19:06.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.664+0000 7f9ae3400700 1 -- 172.21.15.69:0/1856491619 --> [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9adc064350 con 0x7f9ac40bdcf0 2024-05-14T15:19:06.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.664+0000 7f9ad9600700 1 -- 172.21.15.69:0/1856491619 <== osd.3 v2:172.21.15.69:6810/680308620 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9adc064350 con 0x7f9ac40bdcf0 2024-05-14T15:19:06.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.665+0000 7f9ae3400700 1 -- 172.21.15.69:0/1856491619 >> [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620] conn(0x7f9ac40bdcf0 msgr2=0x7f9ac40c01e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:06.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.665+0000 7f9ae3400700 1 --2- 172.21.15.69:0/1856491619 >> [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620] conn(0x7f9ac40bdcf0 0x7f9ac40c01e0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.665+0000 7f9ae3400700 1 -- 172.21.15.69:0/1856491619 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9ac40b2940 msgr2=0x7f9ac40b4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:06.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.665+0000 7f9ae3400700 1 --2- 172.21.15.69:0/1856491619 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9ac40b2940 0x7f9ac40b4e50 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f9ad0005950 tx=0x7f9ad00058e0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.665+0000 7f9ae3400700 1 -- 172.21.15.69:0/1856491619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9adc110970 msgr2=0x7f9adc1a5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:06.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.665+0000 7f9ae3400700 1 --2- 172.21.15.69:0/1856491619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9adc110970 0x7f9adc1a5bc0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9ad4007ee0 tx=0x7f9ad400d3b0 comp rx=0 tx=0).stop 2024-05-14T15:19:06.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.665+0000 7f9ae1400700 1 -- 172.21.15.69:0/1856491619 reap_dead start 2024-05-14T15:19:06.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.666+0000 7f9ae3400700 1 -- 172.21.15.69:0/1856491619 shutdown_connections 2024-05-14T15:19:06.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.666+0000 7f9ae3400700 1 -- 172.21.15.69:0/1856491619 >> 172.21.15.69:0/1856491619 conn(0x7f9adc077c80 msgr2=0x7f9adc07b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:06.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.666+0000 7f9ae3400700 1 -- 172.21.15.69:0/1856491619 shutdown_connections 2024-05-14T15:19:06.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:06.666+0000 7f9ae3400700 1 -- 172.21.15.69:0/1856491619 wait complete. 2024-05-14T15:19:06.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:06 smithi069 ceph-mon[31270]: pgmap v483: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:19:07.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:06 smithi203 ceph-mon[34567]: pgmap v483: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:19:07.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:06 smithi092 ceph-mon[34729]: pgmap v483: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:19:08.354 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:08.354 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:08.357 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:08.363 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:08.366 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:08.418 INFO:teuthology.orchestra.run.smithi069.stdout:107374182516 2024-05-14T15:19:08.419 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-14T15:19:08.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:08 smithi069 ceph-mon[31270]: pgmap v484: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:19:09.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:08 smithi203 ceph-mon[34567]: pgmap v484: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:19:09.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:08 smithi092 ceph-mon[34729]: pgmap v484: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:19:09.607 INFO:teuthology.orchestra.run.smithi069.stdout:309237645368 2024-05-14T15:19:09.608 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-05-14T15:19:10.007 INFO:teuthology.orchestra.run.smithi069.stdout:158913790054 2024-05-14T15:19:10.008 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-14T15:19:10.938 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:10 smithi069 ceph-mon[31270]: pgmap v485: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:19:11.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:10 smithi203 ceph-mon[34567]: pgmap v485: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:19:11.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:10 smithi092 ceph-mon[34729]: pgmap v485: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:19:11.745 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:13.160 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:12 smithi069 ceph-mon[31270]: pgmap v486: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:19:13.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:12 smithi092 ceph-mon[34729]: pgmap v486: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:19:13.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:12 smithi203 ceph-mon[34567]: pgmap v486: 129 pgs: 129 active+clean; 649 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:19:14.092 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:14.184 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:13 smithi069 ceph-mon[31270]: mgrmap e18: x(active, since 13m), standbys: z, y 2024-05-14T15:19:14.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:13 smithi092 ceph-mon[34729]: mgrmap e18: x(active, since 13m), standbys: z, y 2024-05-14T15:19:14.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:13 smithi203 ceph-mon[34567]: mgrmap e18: x(active, since 13m), standbys: z, y 2024-05-14T15:19:15.088 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:14 smithi069 ceph-mon[31270]: pgmap v487: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-14T15:19:15.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:14 smithi092 ceph-mon[34729]: pgmap v487: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-14T15:19:15.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:14 smithi203 ceph-mon[34567]: pgmap v487: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 170 B/s wr, 9 op/s 2024-05-14T15:19:17.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:16 smithi092 ceph-mon[34729]: pgmap v488: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-14T15:19:17.207 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:16 smithi069 ceph-mon[31270]: pgmap v488: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-14T15:19:17.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:16 smithi203 ceph-mon[34567]: pgmap v488: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 511 B/s wr, 10 op/s 2024-05-14T15:19:17.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.930+0000 7fe6ac200700 1 -- 172.21.15.69:0/1829050524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6a4107df0 msgr2=0x7fe6a4108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:17.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.930+0000 7fe6ac200700 1 --2- 172.21.15.69:0/1829050524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6a4107df0 0x7fe6a4108200 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe6900099c0 tx=0x7fe690009cd0 comp rx=0 tx=0).stop 2024-05-14T15:19:17.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.930+0000 7fe6ac200700 1 -- 172.21.15.69:0/1829050524 shutdown_connections 2024-05-14T15:19:17.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.930+0000 7fe6ac200700 1 --2- 172.21.15.69:0/1829050524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6a4108740 0x7fe6a41100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:17.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.930+0000 7fe6ac200700 1 --2- 172.21.15.69:0/1829050524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6a41034c0 0x7fe6a41038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:17.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.930+0000 7fe6ac200700 1 --2- 172.21.15.69:0/1829050524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6a4107df0 0x7fe6a4108200 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:17.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.930+0000 7fe6ac200700 1 -- 172.21.15.69:0/1829050524 >> 172.21.15.69:0/1829050524 conn(0x7fe6a40fedc0 msgr2=0x7fe6a41011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:17.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.931+0000 7fe6ac200700 1 -- 172.21.15.69:0/1829050524 shutdown_connections 2024-05-14T15:19:17.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.931+0000 7fe6ac200700 1 -- 172.21.15.69:0/1829050524 wait complete. 2024-05-14T15:19:17.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.932+0000 7fe6ac200700 1 Processor -- start 2024-05-14T15:19:17.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.932+0000 7fe6ac200700 1 -- start start 2024-05-14T15:19:17.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.933+0000 7fe6ac200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6a41034c0 0x7fe6a419cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:17.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.933+0000 7fe6ac200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6a4107df0 0x7fe6a419d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:17.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.933+0000 7fe6ac200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6a4108740 0x7fe6a41a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:17.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.933+0000 7fe6ac200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a4113200 con 0x7fe6a41034c0 2024-05-14T15:19:17.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.933+0000 7fe6ac200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a4113080 con 0x7fe6a4107df0 2024-05-14T15:19:17.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.933+0000 7fe6ac200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a4113380 con 0x7fe6a4108740 2024-05-14T15:19:17.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.933+0000 7fe6a9800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6a41034c0 0x7fe6a419cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:17.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.933+0000 7fe6a9800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6a41034c0 0x7fe6a419cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36910/0 (socket says 172.21.15.69:36910) 2024-05-14T15:19:17.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.933+0000 7fe6a9800700 1 -- 172.21.15.69:0/400196068 learned_addr learned my addr 172.21.15.69:0/400196068 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:17.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.933+0000 7fe6a8e00700 1 --2- 172.21.15.69:0/400196068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6a4107df0 0x7fe6a419d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:17.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.933+0000 7fe6aa200700 1 --2- 172.21.15.69:0/400196068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6a4108740 0x7fe6a41a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:17.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.934+0000 7fe6a9800700 1 -- 172.21.15.69:0/400196068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6a4108740 msgr2=0x7fe6a41a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:17.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.934+0000 7fe6a9800700 1 --2- 172.21.15.69:0/400196068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6a4108740 0x7fe6a41a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:17.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.934+0000 7fe6a9800700 1 -- 172.21.15.69:0/400196068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6a4107df0 msgr2=0x7fe6a419d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:17.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.934+0000 7fe6a9800700 1 --2- 172.21.15.69:0/400196068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6a4107df0 0x7fe6a419d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:17.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.934+0000 7fe6a9800700 1 -- 172.21.15.69:0/400196068 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a41a1da0 con 0x7fe6a41034c0 2024-05-14T15:19:17.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.934+0000 7fe6a9800700 1 --2- 172.21.15.69:0/400196068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6a41034c0 0x7fe6a419cf80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe69800d950 tx=0x7fe69800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:17.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.935+0000 7fe6a2000700 1 -- 172.21.15.69:0/400196068 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe698016070 con 0x7fe6a41034c0 2024-05-14T15:19:17.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.935+0000 7fe6ac200700 1 -- 172.21.15.69:0/400196068 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a41a2090 con 0x7fe6a41034c0 2024-05-14T15:19:17.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.935+0000 7fe6a2000700 1 -- 172.21.15.69:0/400196068 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe69800fd20 con 0x7fe6a41034c0 2024-05-14T15:19:17.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.935+0000 7fe6a2000700 1 -- 172.21.15.69:0/400196068 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe69800e3b0 con 0x7fe6a41034c0 2024-05-14T15:19:17.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.935+0000 7fe6ac200700 1 -- 172.21.15.69:0/400196068 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a41a25f0 con 0x7fe6a41034c0 2024-05-14T15:19:17.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.936+0000 7fe6ac200700 1 -- 172.21.15.69:0/400196068 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a40512c0 con 0x7fe6a41034c0 2024-05-14T15:19:17.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.939+0000 7fe6a2000700 1 -- 172.21.15.69:0/400196068 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe698019070 con 0x7fe6a41034c0 2024-05-14T15:19:17.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.940+0000 7fe6a2000700 1 --2- 172.21.15.69:0/400196068 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe68c0b2900 0x7fe68c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:17.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.941+0000 7fe6a2000700 1 -- 172.21.15.69:0/400196068 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fe6980e2060 con 0x7fe6a41034c0 2024-05-14T15:19:17.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.941+0000 7fe6a8e00700 1 --2- 172.21.15.69:0/400196068 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe68c0b2900 0x7fe68c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:17.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.942+0000 7fe6a8e00700 1 --2- 172.21.15.69:0/400196068 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe68c0b2900 0x7fe68c0b4e10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe690009990 tx=0x7fe690005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:17.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.948+0000 7fe6a2000700 1 -- 172.21.15.69:0/400196068 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe6980a9950 con 0x7fe6a41034c0 2024-05-14T15:19:18.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.193+0000 7fe6ac200700 1 -- 172.21.15.69:0/400196068 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7fe6a41a9af0 con 0x7fe6a41034c0 2024-05-14T15:19:18.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.194+0000 7fe6a2000700 1 -- 172.21.15.69:0/400196068 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe6980a9250 con 0x7fe6a41034c0 2024-05-14T15:19:18.193 INFO:teuthology.orchestra.run.smithi069.stdout:261993005129 2024-05-14T15:19:18.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.196+0000 7fe6ac200700 1 -- 172.21.15.69:0/400196068 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe68c0b2900 msgr2=0x7fe68c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:18.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.196+0000 7fe6ac200700 1 --2- 172.21.15.69:0/400196068 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe68c0b2900 0x7fe68c0b4e10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe690009990 tx=0x7fe690005fb0 comp rx=0 tx=0).stop 2024-05-14T15:19:18.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.196+0000 7fe6ac200700 1 -- 172.21.15.69:0/400196068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6a41034c0 msgr2=0x7fe6a419cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:18.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.196+0000 7fe6ac200700 1 --2- 172.21.15.69:0/400196068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6a41034c0 0x7fe6a419cf80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe69800d950 tx=0x7fe69800dc60 comp rx=0 tx=0).stop 2024-05-14T15:19:18.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.197+0000 7fe6ac200700 1 -- 172.21.15.69:0/400196068 shutdown_connections 2024-05-14T15:19:18.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.197+0000 7fe6ac200700 1 --2- 172.21.15.69:0/400196068 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe6a41034c0 0x7fe6a419cf80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:18.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.197+0000 7fe6ac200700 1 --2- 172.21.15.69:0/400196068 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe68c0b2900 0x7fe68c0b4e10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:18.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.197+0000 7fe6ac200700 1 --2- 172.21.15.69:0/400196068 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe6a4108740 0x7fe6a41a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:18.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.197+0000 7fe6ac200700 1 --2- 172.21.15.69:0/400196068 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe6a4107df0 0x7fe6a419d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:18.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.197+0000 7fe6ac200700 1 -- 172.21.15.69:0/400196068 >> 172.21.15.69:0/400196068 conn(0x7fe6a40fedc0 msgr2=0x7fe6a406b8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:18.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.197+0000 7fe6ac200700 1 -- 172.21.15.69:0/400196068 shutdown_connections 2024-05-14T15:19:18.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.197+0000 7fe6ac200700 1 -- 172.21.15.69:0/400196068 wait complete. 2024-05-14T15:19:18.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.835+0000 7f2e93c00700 1 -- 172.21.15.69:0/1138410678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e8c1045f0 msgr2=0x7f2e8c104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:18.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.835+0000 7f2e93c00700 1 --2- 172.21.15.69:0/1138410678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e8c1045f0 0x7f2e8c104a00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2e800099c0 tx=0x7f2e80009cd0 comp rx=0 tx=0).stop 2024-05-14T15:19:18.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.835+0000 7f2e93c00700 1 -- 172.21.15.69:0/1138410678 shutdown_connections 2024-05-14T15:19:18.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.835+0000 7f2e93c00700 1 --2- 172.21.15.69:0/1138410678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e8c1045f0 0x7f2e8c104a00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:18.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.835+0000 7f2e93c00700 1 --2- 172.21.15.69:0/1138410678 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e8c109870 0x7f2e8c1111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:18.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.835+0000 7f2e93c00700 1 --2- 172.21.15.69:0/1138410678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e8c108f20 0x7f2e8c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:18.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.835+0000 7f2e93c00700 1 -- 172.21.15.69:0/1138410678 >> 172.21.15.69:0/1138410678 conn(0x7f2e8c100040 msgr2=0x7f2e8c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:18.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.835+0000 7f2e93c00700 1 -- 172.21.15.69:0/1138410678 shutdown_connections 2024-05-14T15:19:18.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.836+0000 7f2e93c00700 1 -- 172.21.15.69:0/1138410678 wait complete. 2024-05-14T15:19:18.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.837+0000 7f2e93c00700 1 Processor -- start 2024-05-14T15:19:18.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.838+0000 7f2e93c00700 1 -- start start 2024-05-14T15:19:18.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.838+0000 7f2e93c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e8c1045f0 0x7f2e8c19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:18.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.838+0000 7f2e93c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e8c108f20 0x7f2e8c19d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:18.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.838+0000 7f2e93c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e8c109870 0x7f2e8c1a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:18.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.838+0000 7f2e93c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c114350 con 0x7f2e8c108f20 2024-05-14T15:19:18.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.838+0000 7f2e93c00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c1141d0 con 0x7f2e8c109870 2024-05-14T15:19:18.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.838+0000 7f2e93c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2e8c1144d0 con 0x7f2e8c1045f0 2024-05-14T15:19:18.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.838+0000 7f2e8be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e8c108f20 0x7f2e8c19d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:18.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.838+0000 7f2e8be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e8c108f20 0x7f2e8c19d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36900/0 (socket says 172.21.15.69:36900) 2024-05-14T15:19:18.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.838+0000 7f2e8be00700 1 -- 172.21.15.69:0/2076758363 learned_addr learned my addr 172.21.15.69:0/2076758363 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:18.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.839+0000 7f2e91200700 1 --2- 172.21.15.69:0/2076758363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e8c1045f0 0x7f2e8c19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:18.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.839+0000 7f2e8be00700 1 -- 172.21.15.69:0/2076758363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e8c1045f0 msgr2=0x7f2e8c19cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:18.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.839+0000 7f2e8be00700 1 --2- 172.21.15.69:0/2076758363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e8c1045f0 0x7f2e8c19cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:18.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.839+0000 7f2e8be00700 1 -- 172.21.15.69:0/2076758363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e8c109870 msgr2=0x7f2e8c1a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:18.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.839+0000 7f2e8be00700 1 --2- 172.21.15.69:0/2076758363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e8c109870 0x7f2e8c1a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:18.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.839+0000 7f2e8be00700 1 -- 172.21.15.69:0/2076758363 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e8c1a1e10 con 0x7f2e8c108f20 2024-05-14T15:19:18.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.839+0000 7f2e8be00700 1 --2- 172.21.15.69:0/2076758363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e8c108f20 0x7f2e8c19d4e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800d980 tx=0x7f2e7800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:18.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.840+0000 7f2e89600700 1 -- 172.21.15.69:0/2076758363 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e78017070 con 0x7f2e8c108f20 2024-05-14T15:19:18.621 INFO:teuthology.orchestra.run.smithi069.stdout:77309411453 2024-05-14T15:19:18.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.840+0000 7f2e89600700 1 -- 172.21.15.69:0/2076758363 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2e78010460 con 0x7f2e8c108f20 2024-05-14T15:19:18.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.840+0000 7f2e89600700 1 -- 172.21.15.69:0/2076758363 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e7800de60 con 0x7f2e8c108f20 2024-05-14T15:19:18.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.840+0000 7f2e93c00700 1 -- 172.21.15.69:0/2076758363 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e8c1a2100 con 0x7f2e8c108f20 2024-05-14T15:19:18.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.840+0000 7f2e93c00700 1 -- 172.21.15.69:0/2076758363 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e8c1a9a20 con 0x7f2e8c108f20 2024-05-14T15:19:18.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.841+0000 7f2e93c00700 1 -- 172.21.15.69:0/2076758363 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e8c0512c0 con 0x7f2e8c108f20 2024-05-14T15:19:18.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.843+0000 7f2e89600700 1 -- 172.21.15.69:0/2076758363 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f2e78010610 con 0x7f2e8c108f20 2024-05-14T15:19:18.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.846+0000 7f2e89600700 1 --2- 172.21.15.69:0/2076758363 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f2e740b2880 0x7f2e740b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:18.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.846+0000 7f2e89600700 1 -- 172.21.15.69:0/2076758363 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f2e780e21a0 con 0x7f2e8c108f20 2024-05-14T15:19:18.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.846+0000 7f2e91200700 1 --2- 172.21.15.69:0/2076758363 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f2e740b2880 0x7f2e740b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:18.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.847+0000 7f2e91200700 1 --2- 172.21.15.69:0/2076758363 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f2e740b2880 0x7f2e740b4d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2e800058e0 tx=0x7f2e80005940 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:18.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:17.851+0000 7f2e89600700 1 -- 172.21.15.69:0/2076758363 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2e780a9a90 con 0x7f2e8c108f20 2024-05-14T15:19:18.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.099+0000 7f2e93c00700 1 -- 172.21.15.69:0/2076758363 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2e8c1a9bf0 con 0x7f2e8c108f20 2024-05-14T15:19:18.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.100+0000 7f2e89600700 1 -- 172.21.15.69:0/2076758363 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2e780a9390 con 0x7f2e8c108f20 2024-05-14T15:19:18.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.103+0000 7f2e93c00700 1 -- 172.21.15.69:0/2076758363 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f2e740b2880 msgr2=0x7f2e740b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:18.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.103+0000 7f2e93c00700 1 --2- 172.21.15.69:0/2076758363 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f2e740b2880 0x7f2e740b4d90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f2e800058e0 tx=0x7f2e80005940 comp rx=0 tx=0).stop 2024-05-14T15:19:18.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.103+0000 7f2e93c00700 1 -- 172.21.15.69:0/2076758363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e8c108f20 msgr2=0x7f2e8c19d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:18.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.103+0000 7f2e93c00700 1 --2- 172.21.15.69:0/2076758363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e8c108f20 0x7f2e8c19d4e0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f2e7800d980 tx=0x7f2e7800dd40 comp rx=0 tx=0).stop 2024-05-14T15:19:18.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.103+0000 7f2e93c00700 1 -- 172.21.15.69:0/2076758363 shutdown_connections 2024-05-14T15:19:18.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.103+0000 7f2e93c00700 1 --2- 172.21.15.69:0/2076758363 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f2e740b2880 0x7f2e740b4d90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:18.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.103+0000 7f2e93c00700 1 --2- 172.21.15.69:0/2076758363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2e8c109870 0x7f2e8c1a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:18.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.103+0000 7f2e93c00700 1 --2- 172.21.15.69:0/2076758363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2e8c1045f0 0x7f2e8c19cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:18.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.103+0000 7f2e93c00700 1 --2- 172.21.15.69:0/2076758363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2e8c108f20 0x7f2e8c19d4e0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:18.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.103+0000 7f2e93c00700 1 -- 172.21.15.69:0/2076758363 >> 172.21.15.69:0/2076758363 conn(0x7f2e8c100040 msgr2=0x7f2e8c10a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:18.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.104+0000 7f2e93c00700 1 -- 172.21.15.69:0/2076758363 shutdown_connections 2024-05-14T15:19:18.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:18.104+0000 7f2e93c00700 1 -- 172.21.15.69:0/2076758363 wait complete. 2024-05-14T15:19:19.158 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:18 smithi069 ceph-mon[31270]: pgmap v489: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-14T15:19:19.159 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:18 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2076758363' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-14T15:19:19.159 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:18 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/400196068' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-14T15:19:19.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:18 smithi092 ceph-mon[34729]: pgmap v489: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-14T15:19:19.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:18 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2076758363' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-14T15:19:19.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:18 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/400196068' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-14T15:19:19.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:18 smithi203 ceph-mon[34567]: pgmap v489: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-14T15:19:19.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:18 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2076758363' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-14T15:19:19.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:18 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/400196068' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-05-14T15:19:21.157 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:20 smithi069 ceph-mon[31270]: pgmap v490: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-14T15:19:21.157 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:20 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:19:21.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:20 smithi092 ceph-mon[34729]: pgmap v490: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-14T15:19:21.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:20 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:19:21.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:20 smithi203 ceph-mon[34567]: pgmap v490: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 938 B/s wr, 11 op/s 2024-05-14T15:19:21.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:20 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:19:22.240 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:22.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.293+0000 7fc923400700 1 -- 172.21.15.69:0/3133034892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc91c076e40 msgr2=0x7fc91c077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:22.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.293+0000 7fc923400700 1 --2- 172.21.15.69:0/3133034892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc91c076e40 0x7fc91c077250 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fc910009990 tx=0x7fc910009ca0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.293+0000 7fc923400700 1 -- 172.21.15.69:0/3133034892 shutdown_connections 2024-05-14T15:19:22.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.293+0000 7fc923400700 1 --2- 172.21.15.69:0/3133034892 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc91c076e40 0x7fc91c077250 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.293+0000 7fc923400700 1 --2- 172.21.15.69:0/3133034892 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc91c110ba0 0x7fc91c113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.293+0000 7fc923400700 1 --2- 172.21.15.69:0/3133034892 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc91c077790 0x7fc91c110660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.293+0000 7fc923400700 1 -- 172.21.15.69:0/3133034892 >> 172.21.15.69:0/3133034892 conn(0x7fc91c0ffec0 msgr2=0x7fc91c102310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:22.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.293+0000 7fc923400700 1 -- 172.21.15.69:0/3133034892 shutdown_connections 2024-05-14T15:19:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.293+0000 7fc923400700 1 -- 172.21.15.69:0/3133034892 wait complete. 2024-05-14T15:19:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.294+0000 7fc923400700 1 Processor -- start 2024-05-14T15:19:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.294+0000 7fc923400700 1 -- start start 2024-05-14T15:19:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.295+0000 7fc923400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc91c076e40 0x7fc91c19cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.295+0000 7fc923400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc91c077790 0x7fc91c19d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.295+0000 7fc923400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc91c110ba0 0x7fc91c1a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.295+0000 7fc923400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c116590 con 0x7fc91c077790 2024-05-14T15:19:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.295+0000 7fc923400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c116410 con 0x7fc91c110ba0 2024-05-14T15:19:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.295+0000 7fc923400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc91c116710 con 0x7fc91c076e40 2024-05-14T15:19:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.295+0000 7fc91be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc91c077790 0x7fc91c19d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.295+0000 7fc91be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc91c077790 0x7fc91c19d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36940/0 (socket says 172.21.15.69:36940) 2024-05-14T15:19:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.295+0000 7fc91be00700 1 -- 172.21.15.69:0/1564879660 learned_addr learned my addr 172.21.15.69:0/1564879660 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:22.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.295+0000 7fc920a00700 1 --2- 172.21.15.69:0/1564879660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc91c076e40 0x7fc91c19cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:22.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.295+0000 7fc921400700 1 --2- 172.21.15.69:0/1564879660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc91c110ba0 0x7fc91c1a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:22.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.296+0000 7fc91be00700 1 -- 172.21.15.69:0/1564879660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc91c076e40 msgr2=0x7fc91c19cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:22.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.296+0000 7fc91be00700 1 --2- 172.21.15.69:0/1564879660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc91c076e40 0x7fc91c19cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.296+0000 7fc91be00700 1 -- 172.21.15.69:0/1564879660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc91c110ba0 msgr2=0x7fc91c1a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:22.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.296+0000 7fc91be00700 1 --2- 172.21.15.69:0/1564879660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc91c110ba0 0x7fc91c1a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.296+0000 7fc91be00700 1 -- 172.21.15.69:0/1564879660 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc91c1a1e50 con 0x7fc91c077790 2024-05-14T15:19:22.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.296+0000 7fc91be00700 1 --2- 172.21.15.69:0/1564879660 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc91c077790 0x7fc91c19d520 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc90800c920 tx=0x7fc90800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:22.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.296+0000 7fc919600700 1 -- 172.21.15.69:0/1564879660 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908007b00 con 0x7fc91c077790 2024-05-14T15:19:22.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.296+0000 7fc919600700 1 -- 172.21.15.69:0/1564879660 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc908004cc0 con 0x7fc91c077790 2024-05-14T15:19:22.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.296+0000 7fc923400700 1 -- 172.21.15.69:0/1564879660 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc91c1a2140 con 0x7fc91c077790 2024-05-14T15:19:22.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.296+0000 7fc919600700 1 -- 172.21.15.69:0/1564879660 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc908005440 con 0x7fc91c077790 2024-05-14T15:19:22.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.297+0000 7fc923400700 1 -- 172.21.15.69:0/1564879660 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc91c1a9a60 con 0x7fc91c077790 2024-05-14T15:19:22.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.298+0000 7fc923400700 1 -- 172.21.15.69:0/1564879660 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc91c0512c0 con 0x7fc91c077790 2024-05-14T15:19:22.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.302+0000 7fc919600700 1 -- 172.21.15.69:0/1564879660 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fc908004750 con 0x7fc91c077790 2024-05-14T15:19:22.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.304+0000 7fc919600700 1 --2- 172.21.15.69:0/1564879660 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc9040b2900 0x7fc9040b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:22.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.305+0000 7fc919600700 1 -- 172.21.15.69:0/1564879660 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fc9080e2510 con 0x7fc91c077790 2024-05-14T15:19:22.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.305+0000 7fc920a00700 1 --2- 172.21.15.69:0/1564879660 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc9040b2900 0x7fc9040b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:22.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.306+0000 7fc920a00700 1 --2- 172.21.15.69:0/1564879660 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc9040b2900 0x7fc9040b4e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc910009750 tx=0x7fc910005fd0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:22.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.307+0000 7fc919600700 1 -- 172.21.15.69:0/1564879660 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fc908014030 con 0x7fc91c077790 2024-05-14T15:19:22.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.548+0000 7fc923400700 1 -- 172.21.15.69:0/1564879660 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fc91c19e2e0 con 0x7fc91c077790 2024-05-14T15:19:22.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.549+0000 7fc919600700 1 -- 172.21.15.69:0/1564879660 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fc9080a9ee0 con 0x7fc91c077790 2024-05-14T15:19:22.549 INFO:teuthology.orchestra.run.smithi069.stdout:133143986288 2024-05-14T15:19:22.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.552+0000 7fc923400700 1 -- 172.21.15.69:0/1564879660 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc9040b2900 msgr2=0x7fc9040b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:22.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.552+0000 7fc923400700 1 --2- 172.21.15.69:0/1564879660 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc9040b2900 0x7fc9040b4e10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fc910009750 tx=0x7fc910005fd0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.552+0000 7fc923400700 1 -- 172.21.15.69:0/1564879660 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc91c077790 msgr2=0x7fc91c19d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:22.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.552+0000 7fc923400700 1 --2- 172.21.15.69:0/1564879660 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc91c077790 0x7fc91c19d520 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fc90800c920 tx=0x7fc90800cc30 comp rx=0 tx=0).stop 2024-05-14T15:19:22.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.552+0000 7fc923400700 1 -- 172.21.15.69:0/1564879660 shutdown_connections 2024-05-14T15:19:22.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.552+0000 7fc923400700 1 --2- 172.21.15.69:0/1564879660 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fc9040b2900 0x7fc9040b4e10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.552+0000 7fc923400700 1 --2- 172.21.15.69:0/1564879660 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc91c110ba0 0x7fc91c1a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.552+0000 7fc923400700 1 --2- 172.21.15.69:0/1564879660 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc91c076e40 0x7fc91c19cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.552+0000 7fc923400700 1 --2- 172.21.15.69:0/1564879660 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc91c077790 0x7fc91c19d520 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.552+0000 7fc923400700 1 -- 172.21.15.69:0/1564879660 >> 172.21.15.69:0/1564879660 conn(0x7fc91c0ffec0 msgr2=0x7fc91c100550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:22.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.552+0000 7fc923400700 1 -- 172.21.15.69:0/1564879660 shutdown_connections 2024-05-14T15:19:22.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.552+0000 7fc923400700 1 -- 172.21.15.69:0/1564879660 wait complete. 2024-05-14T15:19:22.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.688+0000 7f26f6a00700 1 -- 172.21.15.69:0/4285828347 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26f010e900 msgr2=0x7f26f0110de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:22.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.688+0000 7f26f6a00700 1 --2- 172.21.15.69:0/4285828347 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26f010e900 0x7f26f0110de0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f26e800b0a0 tx=0x7f26e800b3b0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.688+0000 7f26f6a00700 1 -- 172.21.15.69:0/4285828347 shutdown_connections 2024-05-14T15:19:22.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.688+0000 7f26f6a00700 1 --2- 172.21.15.69:0/4285828347 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26f010e900 0x7f26f0110de0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.688+0000 7f26f6a00700 1 --2- 172.21.15.69:0/4285828347 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26f0105520 0x7f26f0105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.688+0000 7f26f6a00700 1 --2- 172.21.15.69:0/4285828347 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26f0105e70 0x7f26f010e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.688+0000 7f26f6a00700 1 -- 172.21.15.69:0/4285828347 >> 172.21.15.69:0/4285828347 conn(0x7f26f00fef30 msgr2=0x7f26f0101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:22.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.688+0000 7f26f6a00700 1 -- 172.21.15.69:0/4285828347 shutdown_connections 2024-05-14T15:19:22.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.689+0000 7f26f6a00700 1 -- 172.21.15.69:0/4285828347 wait complete. 2024-05-14T15:19:22.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.690+0000 7f26f6a00700 1 Processor -- start 2024-05-14T15:19:22.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.690+0000 7f26f6a00700 1 -- start start 2024-05-14T15:19:22.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.691+0000 7f26f6a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26f0105520 0x7f26f019ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:22.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.691+0000 7f26f6a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26f0105e70 0x7f26f019d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:22.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.691+0000 7f26f6a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26f010e900 0x7f26f01a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:22.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.691+0000 7f26f6a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f26f0114310 con 0x7f26f010e900 2024-05-14T15:19:22.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.691+0000 7f26f6a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f26f0114190 con 0x7f26f0105520 2024-05-14T15:19:22.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.691+0000 7f26f6a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f26f0114490 con 0x7f26f0105e70 2024-05-14T15:19:22.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.691+0000 7f26f4a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26f010e900 0x7f26f01a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:22.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.691+0000 7f26f4a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26f010e900 0x7f26f01a1690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36960/0 (socket says 172.21.15.69:36960) 2024-05-14T15:19:22.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.691+0000 7f26f4a00700 1 -- 172.21.15.69:0/4118565509 learned_addr learned my addr 172.21.15.69:0/4118565509 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:22.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.692+0000 7f26efe00700 1 --2- 172.21.15.69:0/4118565509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26f0105520 0x7f26f019ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:22.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.692+0000 7f26ef400700 1 --2- 172.21.15.69:0/4118565509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26f0105e70 0x7f26f019d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:22.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.692+0000 7f26f4a00700 1 -- 172.21.15.69:0/4118565509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26f0105e70 msgr2=0x7f26f019d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:22.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.692+0000 7f26f4a00700 1 --2- 172.21.15.69:0/4118565509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26f0105e70 0x7f26f019d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.692+0000 7f26f4a00700 1 -- 172.21.15.69:0/4118565509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26f0105520 msgr2=0x7f26f019ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:22.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.692+0000 7f26f4a00700 1 --2- 172.21.15.69:0/4118565509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26f0105520 0x7f26f019ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.692+0000 7f26f4a00700 1 -- 172.21.15.69:0/4118565509 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f01a1c80 con 0x7f26f010e900 2024-05-14T15:19:22.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.692+0000 7f26efe00700 1 --2- 172.21.15.69:0/4118565509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26f0105520 0x7f26f019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:19:22.693 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.692+0000 7f26f4a00700 1 --2- 172.21.15.69:0/4118565509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26f010e900 0x7f26f01a1690 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f26e800b830 tx=0x7f26e8004d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:22.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.693+0000 7f26ecc00700 1 -- 172.21.15.69:0/4118565509 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e8021070 con 0x7f26f010e900 2024-05-14T15:19:22.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.693+0000 7f26ecc00700 1 -- 172.21.15.69:0/4118565509 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26e8007b80 con 0x7f26f010e900 2024-05-14T15:19:22.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.693+0000 7f26f6a00700 1 -- 172.21.15.69:0/4118565509 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f01a1f10 con 0x7f26f010e900 2024-05-14T15:19:22.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.693+0000 7f26ecc00700 1 -- 172.21.15.69:0/4118565509 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e80052a0 con 0x7f26f010e900 2024-05-14T15:19:22.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.693+0000 7f26f6a00700 1 -- 172.21.15.69:0/4118565509 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f01a2440 con 0x7f26f010e900 2024-05-14T15:19:22.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.694+0000 7f26f6a00700 1 -- 172.21.15.69:0/4118565509 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f00512c0 con 0x7f26f010e900 2024-05-14T15:19:22.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.696+0000 7f26ecc00700 1 -- 172.21.15.69:0/4118565509 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f26e8024070 con 0x7f26f010e900 2024-05-14T15:19:22.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.698+0000 7f26ecc00700 1 --2- 172.21.15.69:0/4118565509 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f26d40b2900 0x7f26d40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:22.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.698+0000 7f26ecc00700 1 -- 172.21.15.69:0/4118565509 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f26e800f020 con 0x7f26f010e900 2024-05-14T15:19:22.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.698+0000 7f26efe00700 1 --2- 172.21.15.69:0/4118565509 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f26d40b2900 0x7f26d40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:22.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.699+0000 7f26efe00700 1 --2- 172.21.15.69:0/4118565509 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f26d40b2900 0x7f26d40b4e10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f26e0005fd0 tx=0x7f26e0005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:22.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.703+0000 7f26ecc00700 1 -- 172.21.15.69:0/4118565509 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f26e802b020 con 0x7f26f010e900 2024-05-14T15:19:22.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.944+0000 7f26f6a00700 1 -- 172.21.15.69:0/4118565509 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f26f01a99d0 con 0x7f26f010e900 2024-05-14T15:19:22.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.944+0000 7f26ecc00700 1 -- 172.21.15.69:0/4118565509 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f26e80ab5d0 con 0x7f26f010e900 2024-05-14T15:19:22.946 INFO:teuthology.orchestra.run.smithi069.stdout:55834574981 2024-05-14T15:19:22.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.948+0000 7f26f6a00700 1 -- 172.21.15.69:0/4118565509 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f26d40b2900 msgr2=0x7f26d40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:22.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.948+0000 7f26f6a00700 1 --2- 172.21.15.69:0/4118565509 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f26d40b2900 0x7f26d40b4e10 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f26e0005fd0 tx=0x7f26e0005e30 comp rx=0 tx=0).stop 2024-05-14T15:19:22.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.948+0000 7f26f6a00700 1 -- 172.21.15.69:0/4118565509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26f010e900 msgr2=0x7f26f01a1690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:22.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.948+0000 7f26f6a00700 1 --2- 172.21.15.69:0/4118565509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26f010e900 0x7f26f01a1690 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f26e800b830 tx=0x7f26e8004d00 comp rx=0 tx=0).stop 2024-05-14T15:19:22.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.948+0000 7f26f6a00700 1 -- 172.21.15.69:0/4118565509 shutdown_connections 2024-05-14T15:19:22.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.948+0000 7f26f6a00700 1 --2- 172.21.15.69:0/4118565509 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26f010e900 0x7f26f01a1690 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.948+0000 7f26f6a00700 1 --2- 172.21.15.69:0/4118565509 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f26d40b2900 0x7f26d40b4e10 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.948+0000 7f26f6a00700 1 --2- 172.21.15.69:0/4118565509 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26f0105520 0x7f26f019ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.948+0000 7f26f6a00700 1 --2- 172.21.15.69:0/4118565509 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26f0105e70 0x7f26f019d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:22.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.948+0000 7f26f6a00700 1 -- 172.21.15.69:0/4118565509 >> 172.21.15.69:0/4118565509 conn(0x7f26f00fef30 msgr2=0x7f26f01031a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:22.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.949+0000 7f26f6a00700 1 -- 172.21.15.69:0/4118565509 shutdown_connections 2024-05-14T15:19:22.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.949+0000 7f26f6a00700 1 -- 172.21.15.69:0/4118565509 wait complete. 2024-05-14T15:19:23.137 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:22 smithi069 ceph-mon[31270]: pgmap v491: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-14T15:19:23.137 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:22 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:19:23.137 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:22 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:19:23.137 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:22 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:19:23.138 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:22 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2746042668' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-14T15:19:23.138 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:22 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1564879660' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-14T15:19:23.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:22 smithi092 ceph-mon[34729]: pgmap v491: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-14T15:19:23.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:22 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:19:23.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:22 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:19:23.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:22 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:19:23.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:22 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2746042668' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-14T15:19:23.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:22 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1564879660' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-14T15:19:23.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:22 smithi203 ceph-mon[34567]: pgmap v491: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 938 B/s wr, 12 op/s 2024-05-14T15:19:23.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:22 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:19:23.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:22 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:19:23.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:22 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:19:23.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:22 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2746042668' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-05-14T15:19:23.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:22 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1564879660' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-14T15:19:23.587 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411449 got 77309411453 for osd.2 2024-05-14T15:19:23.587 DEBUG:teuthology.parallel:result is None 2024-05-14T15:19:23.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.769+0000 7f01d7200700 1 -- 172.21.15.69:0/136750932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01d01045f0 msgr2=0x7f01d0104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:23.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.769+0000 7f01d7200700 1 --2- 172.21.15.69:0/136750932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01d01045f0 0x7f01d0104a00 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f01c00099c0 tx=0x7f01c0009cd0 comp rx=0 tx=0).stop 2024-05-14T15:19:23.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.769+0000 7f01d7200700 1 -- 172.21.15.69:0/136750932 shutdown_connections 2024-05-14T15:19:23.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.769+0000 7f01d7200700 1 --2- 172.21.15.69:0/136750932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01d01045f0 0x7f01d0104a00 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:23.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.769+0000 7f01d7200700 1 --2- 172.21.15.69:0/136750932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01d0109870 0x7f01d01111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:23.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.769+0000 7f01d7200700 1 --2- 172.21.15.69:0/136750932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01d0108f20 0x7f01d0109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:23.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.769+0000 7f01d7200700 1 -- 172.21.15.69:0/136750932 >> 172.21.15.69:0/136750932 conn(0x7f01d0100040 msgr2=0x7f01d0102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:23.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.769+0000 7f01d7200700 1 -- 172.21.15.69:0/136750932 shutdown_connections 2024-05-14T15:19:23.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.769+0000 7f01d7200700 1 -- 172.21.15.69:0/136750932 wait complete. 2024-05-14T15:19:23.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.770+0000 7f01d7200700 1 Processor -- start 2024-05-14T15:19:23.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.771+0000 7f01d7200700 1 -- start start 2024-05-14T15:19:23.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.771+0000 7f01d7200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01d01045f0 0x7f01d019cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:23.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.771+0000 7f01d7200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01d0108f20 0x7f01d019d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:23.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.771+0000 7f01d7200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01d0109870 0x7f01d01a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:23.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.771+0000 7f01d7200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f01d0114350 con 0x7f01d0109870 2024-05-14T15:19:23.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.771+0000 7f01d7200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f01d01141d0 con 0x7f01d0108f20 2024-05-14T15:19:23.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.771+0000 7f01d7200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f01d01144d0 con 0x7f01d01045f0 2024-05-14T15:19:23.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.771+0000 7f01d5200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01d0109870 0x7f01d01a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:23.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.772+0000 7f01d5200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01d0109870 0x7f01d01a1770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36926/0 (socket says 172.21.15.69:36926) 2024-05-14T15:19:23.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.772+0000 7f01d5200700 1 -- 172.21.15.69:0/2746042668 learned_addr learned my addr 172.21.15.69:0/2746042668 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:23.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.772+0000 7f01cfe00700 1 --2- 172.21.15.69:0/2746042668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01d01045f0 0x7f01d019cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:23.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.772+0000 7f01cf400700 1 --2- 172.21.15.69:0/2746042668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01d0108f20 0x7f01d019d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:23.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.772+0000 7f01d5200700 1 -- 172.21.15.69:0/2746042668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01d01045f0 msgr2=0x7f01d019cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:23.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.772+0000 7f01d5200700 1 --2- 172.21.15.69:0/2746042668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01d01045f0 0x7f01d019cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:23.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.772+0000 7f01d5200700 1 -- 172.21.15.69:0/2746042668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01d0108f20 msgr2=0x7f01d019d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:23.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.772+0000 7f01d5200700 1 --2- 172.21.15.69:0/2746042668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01d0108f20 0x7f01d019d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:23.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.772+0000 7f01d5200700 1 -- 172.21.15.69:0/2746042668 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01d01a1d60 con 0x7f01d0109870 2024-05-14T15:19:23.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.772+0000 7f01cf400700 1 --2- 172.21.15.69:0/2746042668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01d0108f20 0x7f01d019d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:19:23.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.773+0000 7f01d5200700 1 --2- 172.21.15.69:0/2746042668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01d0109870 0x7f01d01a1770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f01c8007d70 tx=0x7f01c800a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:23.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.773+0000 7f01ccc00700 1 -- 172.21.15.69:0/2746042668 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c8016020 con 0x7f01d0109870 2024-05-14T15:19:23.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.773+0000 7f01ccc00700 1 -- 172.21.15.69:0/2746042668 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f01c800ad40 con 0x7f01d0109870 2024-05-14T15:19:23.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.773+0000 7f01ccc00700 1 -- 172.21.15.69:0/2746042668 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01c80115e0 con 0x7f01d0109870 2024-05-14T15:19:23.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.773+0000 7f01d7200700 1 -- 172.21.15.69:0/2746042668 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01d01a2050 con 0x7f01d0109870 2024-05-14T15:19:23.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.773+0000 7f01d7200700 1 -- 172.21.15.69:0/2746042668 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01d01a2540 con 0x7f01d0109870 2024-05-14T15:19:23.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.775+0000 7f01d7200700 1 -- 172.21.15.69:0/2746042668 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01d00512c0 con 0x7f01d0109870 2024-05-14T15:19:23.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.777+0000 7f01ccc00700 1 -- 172.21.15.69:0/2746042668 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f01c8019020 con 0x7f01d0109870 2024-05-14T15:19:23.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.779+0000 7f01ccc00700 1 --2- 172.21.15.69:0/2746042668 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f01b40b2900 0x7f01b40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:23.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.779+0000 7f01ccc00700 1 -- 172.21.15.69:0/2746042668 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f01c80e24f0 con 0x7f01d0109870 2024-05-14T15:19:23.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.779+0000 7f01cfe00700 1 --2- 172.21.15.69:0/2746042668 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f01b40b2900 0x7f01b40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:23.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.780+0000 7f01cfe00700 1 --2- 172.21.15.69:0/2746042668 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f01b40b2900 0x7f01b40b4e10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f01c0000c00 tx=0x7f01c0005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:23.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:21.783+0000 7f01ccc00700 1 -- 172.21.15.69:0/2746042668 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f01c8020020 con 0x7f01d0109870 2024-05-14T15:19:23.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.037+0000 7f01d7200700 1 -- 172.21.15.69:0/2746042668 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f01d01a9ae0 con 0x7f01d0109870 2024-05-14T15:19:23.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.038+0000 7f01ccc00700 1 -- 172.21.15.69:0/2746042668 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f01c80a9de0 con 0x7f01d0109870 2024-05-14T15:19:23.794 INFO:teuthology.orchestra.run.smithi069.stdout:236223201362 2024-05-14T15:19:23.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.041+0000 7f01d7200700 1 -- 172.21.15.69:0/2746042668 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f01b40b2900 msgr2=0x7f01b40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:23.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.041+0000 7f01d7200700 1 --2- 172.21.15.69:0/2746042668 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f01b40b2900 0x7f01b40b4e10 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f01c0000c00 tx=0x7f01c0005fb0 comp rx=0 tx=0).stop 2024-05-14T15:19:23.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.041+0000 7f01d7200700 1 -- 172.21.15.69:0/2746042668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01d0109870 msgr2=0x7f01d01a1770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:23.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.041+0000 7f01d7200700 1 --2- 172.21.15.69:0/2746042668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01d0109870 0x7f01d01a1770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f01c8007d70 tx=0x7f01c800a340 comp rx=0 tx=0).stop 2024-05-14T15:19:23.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.041+0000 7f01d7200700 1 -- 172.21.15.69:0/2746042668 shutdown_connections 2024-05-14T15:19:23.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.041+0000 7f01d7200700 1 --2- 172.21.15.69:0/2746042668 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f01d0109870 0x7f01d01a1770 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:23.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.041+0000 7f01d7200700 1 --2- 172.21.15.69:0/2746042668 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f01b40b2900 0x7f01b40b4e10 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:23.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.041+0000 7f01d7200700 1 --2- 172.21.15.69:0/2746042668 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01d01045f0 0x7f01d019cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:23.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.041+0000 7f01d7200700 1 --2- 172.21.15.69:0/2746042668 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01d0108f20 0x7f01d019d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:23.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.041+0000 7f01d7200700 1 -- 172.21.15.69:0/2746042668 >> 172.21.15.69:0/2746042668 conn(0x7f01d0100040 msgr2=0x7f01d010a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:23.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.042+0000 7f01d7200700 1 -- 172.21.15.69:0/2746042668 shutdown_connections 2024-05-14T15:19:23.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:22.042+0000 7f01d7200700 1 -- 172.21.15.69:0/2746042668 wait complete. 2024-05-14T15:19:24.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:23 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/4118565509' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-14T15:19:24.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:23 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1147468449' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-14T15:19:24.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:23 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2242328796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-14T15:19:24.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:23 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/4118565509' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-14T15:19:24.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:23 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1147468449' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-14T15:19:24.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:23 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2242328796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-14T15:19:24.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:23 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/4118565509' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-14T15:19:24.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:23 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1147468449' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-05-14T15:19:24.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:23 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2242328796' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-14T15:19:24.717 INFO:tasks.cephadm.ceph_manager.ceph:need seq 261993005126 got 261993005129 for osd.9 2024-05-14T15:19:24.718 DEBUG:teuthology.parallel:result is None 2024-05-14T15:19:24.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.268+0000 7f4acfe00700 1 -- 172.21.15.69:0/3485138796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ac8105e30 msgr2=0x7f4ac810e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:24.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.268+0000 7f4acfe00700 1 --2- 172.21.15.69:0/3485138796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ac8105e30 0x7f4ac810e380 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4009990 tx=0x7f4ab4009ca0 comp rx=0 tx=0).stop 2024-05-14T15:19:24.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.268+0000 7f4acfe00700 1 -- 172.21.15.69:0/3485138796 shutdown_connections 2024-05-14T15:19:24.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.268+0000 7f4acfe00700 1 --2- 172.21.15.69:0/3485138796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac810e910 0x7f4ac8110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:24.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.269+0000 7f4acfe00700 1 --2- 172.21.15.69:0/3485138796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ac81054e0 0x7f4ac81058f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:24.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.269+0000 7f4acfe00700 1 --2- 172.21.15.69:0/3485138796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ac8105e30 0x7f4ac810e380 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:24.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.269+0000 7f4acfe00700 1 -- 172.21.15.69:0/3485138796 >> 172.21.15.69:0/3485138796 conn(0x7f4ac80fedc0 msgr2=0x7f4ac81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:24.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.269+0000 7f4acfe00700 1 -- 172.21.15.69:0/3485138796 shutdown_connections 2024-05-14T15:19:24.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.269+0000 7f4acfe00700 1 -- 172.21.15.69:0/3485138796 wait complete. 2024-05-14T15:19:24.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.270+0000 7f4acfe00700 1 Processor -- start 2024-05-14T15:19:24.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.270+0000 7f4acfe00700 1 -- start start 2024-05-14T15:19:24.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.270+0000 7f4acfe00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac81054e0 0x7f4ac819d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:24.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.270+0000 7f4acfe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ac8105e30 0x7f4ac819d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:24.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.270+0000 7f4acfe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ac810e910 0x7f4ac81a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:24.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.270+0000 7f4acfe00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac81142f0 con 0x7f4ac8105e30 2024-05-14T15:19:24.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.270+0000 7f4acfe00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac8114170 con 0x7f4ac81054e0 2024-05-14T15:19:24.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.270+0000 7f4acfe00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4ac8114470 con 0x7f4ac810e910 2024-05-14T15:19:24.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.271+0000 7f4acca00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ac8105e30 0x7f4ac819d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:24.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.271+0000 7f4acca00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ac8105e30 0x7f4ac819d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57290/0 (socket says 172.21.15.69:57290) 2024-05-14T15:19:24.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.271+0000 7f4acca00700 1 -- 172.21.15.69:0/1147468449 learned_addr learned my addr 172.21.15.69:0/1147468449 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:24.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.271+0000 7f4acd400700 1 --2- 172.21.15.69:0/1147468449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac81054e0 0x7f4ac819d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:24.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.271+0000 7f4acde00700 1 --2- 172.21.15.69:0/1147468449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ac810e910 0x7f4ac81a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:24.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.271+0000 7f4acca00700 1 -- 172.21.15.69:0/1147468449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ac810e910 msgr2=0x7f4ac81a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:24.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.271+0000 7f4acca00700 1 --2- 172.21.15.69:0/1147468449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ac810e910 0x7f4ac81a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:24.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.271+0000 7f4acca00700 1 -- 172.21.15.69:0/1147468449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac81054e0 msgr2=0x7f4ac819d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:24.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.271+0000 7f4acca00700 1 --2- 172.21.15.69:0/1147468449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac81054e0 0x7f4ac819d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:24.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.271+0000 7f4acca00700 1 -- 172.21.15.69:0/1147468449 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ac81a1ed0 con 0x7f4ac8105e30 2024-05-14T15:19:24.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.271+0000 7f4acde00700 1 --2- 172.21.15.69:0/1147468449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ac810e910 0x7f4ac81a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:19:24.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.272+0000 7f4acca00700 1 --2- 172.21.15.69:0/1147468449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ac8105e30 0x7f4ac819d5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4000c00 tx=0x7f4ab4009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:24.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.272+0000 7f4ac6000700 1 -- 172.21.15.69:0/1147468449 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4027070 con 0x7f4ac8105e30 2024-05-14T15:19:24.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.272+0000 7f4acfe00700 1 -- 172.21.15.69:0/1147468449 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ac81a2160 con 0x7f4ac8105e30 2024-05-14T15:19:24.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.272+0000 7f4ac6000700 1 -- 172.21.15.69:0/1147468449 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4ab400fc70 con 0x7f4ac8105e30 2024-05-14T15:19:24.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.272+0000 7f4ac6000700 1 -- 172.21.15.69:0/1147468449 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ab4022d40 con 0x7f4ac8105e30 2024-05-14T15:19:24.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.272+0000 7f4acfe00700 1 -- 172.21.15.69:0/1147468449 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ac81a9ae0 con 0x7f4ac8105e30 2024-05-14T15:19:24.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.273+0000 7f4acfe00700 1 -- 172.21.15.69:0/1147468449 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac806be70 con 0x7f4ac8105e30 2024-05-14T15:19:24.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.276+0000 7f4ac6000700 1 -- 172.21.15.69:0/1147468449 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4ab402a070 con 0x7f4ac8105e30 2024-05-14T15:19:24.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.277+0000 7f4ac6000700 1 --2- 172.21.15.69:0/1147468449 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4ab00b2880 0x7f4ab00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:24.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.277+0000 7f4ac6000700 1 -- 172.21.15.69:0/1147468449 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f4ab40e3a70 con 0x7f4ac8105e30 2024-05-14T15:19:24.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.278+0000 7f4acd400700 1 --2- 172.21.15.69:0/1147468449 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4ab00b2880 0x7f4ab00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:24.985 INFO:teuthology.orchestra.run.smithi069.stdout:283467841602 2024-05-14T15:19:24.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.278+0000 7f4acd400700 1 --2- 172.21.15.69:0/1147468449 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4ab00b2880 0x7f4ab00b4d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4abc005950 tx=0x7f4abc0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:24.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.284+0000 7f4ac6000700 1 -- 172.21.15.69:0/1147468449 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4ab4031020 con 0x7f4ac8105e30 2024-05-14T15:19:24.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.535+0000 7f4acfe00700 1 -- 172.21.15.69:0/1147468449 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f4ac80512c0 con 0x7f4ac8105e30 2024-05-14T15:19:24.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.535+0000 7f4ac6000700 1 -- 172.21.15.69:0/1147468449 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f4ab4013070 con 0x7f4ac8105e30 2024-05-14T15:19:24.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.539+0000 7f4acfe00700 1 -- 172.21.15.69:0/1147468449 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4ab00b2880 msgr2=0x7f4ab00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:24.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.539+0000 7f4acfe00700 1 --2- 172.21.15.69:0/1147468449 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4ab00b2880 0x7f4ab00b4d90 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4abc005950 tx=0x7f4abc0058e0 comp rx=0 tx=0).stop 2024-05-14T15:19:24.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.539+0000 7f4acfe00700 1 -- 172.21.15.69:0/1147468449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ac8105e30 msgr2=0x7f4ac819d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:24.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.539+0000 7f4acfe00700 1 --2- 172.21.15.69:0/1147468449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ac8105e30 0x7f4ac819d5a0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4000c00 tx=0x7f4ab4009f90 comp rx=0 tx=0).stop 2024-05-14T15:19:24.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.539+0000 7f4acfe00700 1 -- 172.21.15.69:0/1147468449 shutdown_connections 2024-05-14T15:19:24.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.539+0000 7f4acfe00700 1 --2- 172.21.15.69:0/1147468449 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f4ab00b2880 0x7f4ab00b4d90 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:24.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.539+0000 7f4acfe00700 1 --2- 172.21.15.69:0/1147468449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4ac810e910 0x7f4ac81a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:24.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.539+0000 7f4acfe00700 1 --2- 172.21.15.69:0/1147468449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4ac81054e0 0x7f4ac819d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:24.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.539+0000 7f4acfe00700 1 --2- 172.21.15.69:0/1147468449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4ac8105e30 0x7f4ac819d5a0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:24.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.539+0000 7f4acfe00700 1 -- 172.21.15.69:0/1147468449 >> 172.21.15.69:0/1147468449 conn(0x7f4ac80fedc0 msgr2=0x7f4ac81032e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:24.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.540+0000 7f4acfe00700 1 -- 172.21.15.69:0/1147468449 shutdown_connections 2024-05-14T15:19:24.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.540+0000 7f4acfe00700 1 -- 172.21.15.69:0/1147468449 wait complete. 2024-05-14T15:19:25.191 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:24 smithi092 ceph-mon[34729]: pgmap v492: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-14T15:19:25.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:24 smithi069 ceph-mon[31270]: pgmap v492: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-14T15:19:25.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:24 smithi203 ceph-mon[34567]: pgmap v492: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 938 B/s wr, 10 op/s 2024-05-14T15:19:25.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.374+0000 7f6b49c00700 1 -- 172.21.15.69:0/630682570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b44102ad0 msgr2=0x7f6b44102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:25.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.374+0000 7f6b49c00700 1 --2- 172.21.15.69:0/630682570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b44102ad0 0x7f6b44102ee0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f6b340099c0 tx=0x7f6b34009cd0 comp rx=0 tx=0).stop 2024-05-14T15:19:25.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.374+0000 7f6b49c00700 1 -- 172.21.15.69:0/630682570 shutdown_connections 2024-05-14T15:19:25.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.374+0000 7f6b49c00700 1 --2- 172.21.15.69:0/630682570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b44102ad0 0x7f6b44102ee0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:25.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.374+0000 7f6b49c00700 1 --2- 172.21.15.69:0/630682570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b44109840 0x7f6b441111a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:25.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.374+0000 7f6b49c00700 1 --2- 172.21.15.69:0/630682570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b44108ef0 0x7f6b44109300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:25.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.374+0000 7f6b49c00700 1 -- 172.21.15.69:0/630682570 >> 172.21.15.69:0/630682570 conn(0x7f6b440fe4d0 msgr2=0x7f6b44100920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:25.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.374+0000 7f6b49c00700 1 -- 172.21.15.69:0/630682570 shutdown_connections 2024-05-14T15:19:25.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.374+0000 7f6b49c00700 1 -- 172.21.15.69:0/630682570 wait complete. 2024-05-14T15:19:25.478 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.375+0000 7f6b49c00700 1 Processor -- start 2024-05-14T15:19:25.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.375+0000 7f6b49c00700 1 -- start start 2024-05-14T15:19:25.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.376+0000 7f6b49c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b44102ad0 0x7f6b44103a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:25.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.376+0000 7f6b49c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b44108ef0 0x7f6b44103f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:25.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.376+0000 7f6b49c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b44109840 0x7f6b441044a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:25.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.376+0000 7f6b49c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6b44114370 con 0x7f6b44102ad0 2024-05-14T15:19:25.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.376+0000 7f6b49c00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6b441141f0 con 0x7f6b44108ef0 2024-05-14T15:19:25.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.376+0000 7f6b49c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6b441144f0 con 0x7f6b44109840 2024-05-14T15:19:25.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.376+0000 7f6b42a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b44102ad0 0x7f6b44103a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:25.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.376+0000 7f6b42a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b44102ad0 0x7f6b44103a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57302/0 (socket says 172.21.15.69:57302) 2024-05-14T15:19:25.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.376+0000 7f6b42a00700 1 -- 172.21.15.69:0/2242328796 learned_addr learned my addr 172.21.15.69:0/2242328796 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:25.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.376+0000 7f6b42000700 1 --2- 172.21.15.69:0/2242328796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b44108ef0 0x7f6b44103f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:25.479 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.376+0000 7f6b42a00700 1 -- 172.21.15.69:0/2242328796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b44109840 msgr2=0x7f6b441044a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:25.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.376+0000 7f6b42a00700 1 --2- 172.21.15.69:0/2242328796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b44109840 0x7f6b441044a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:25.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.376+0000 7f6b42a00700 1 -- 172.21.15.69:0/2242328796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b44108ef0 msgr2=0x7f6b44103f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:25.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.376+0000 7f6b42a00700 1 --2- 172.21.15.69:0/2242328796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b44108ef0 0x7f6b44103f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:25.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.376+0000 7f6b42a00700 1 -- 172.21.15.69:0/2242328796 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b441a9180 con 0x7f6b44102ad0 2024-05-14T15:19:25.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.377+0000 7f6b42a00700 1 --2- 172.21.15.69:0/2242328796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b44102ad0 0x7f6b44103a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400b580 tx=0x7f6b3400f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:25.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.377+0000 7f6b3b400700 1 -- 172.21.15.69:0/2242328796 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b34027070 con 0x7f6b44102ad0 2024-05-14T15:19:25.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.377+0000 7f6b3b400700 1 -- 172.21.15.69:0/2242328796 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b3400fdd0 con 0x7f6b44102ad0 2024-05-14T15:19:25.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.377+0000 7f6b49c00700 1 -- 172.21.15.69:0/2242328796 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b441a9410 con 0x7f6b44102ad0 2024-05-14T15:19:25.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.377+0000 7f6b3b400700 1 -- 172.21.15.69:0/2242328796 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b340173f0 con 0x7f6b44102ad0 2024-05-14T15:19:25.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.377+0000 7f6b49c00700 1 -- 172.21.15.69:0/2242328796 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b441a98c0 con 0x7f6b44102ad0 2024-05-14T15:19:25.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.378+0000 7f6b49c00700 1 -- 172.21.15.69:0/2242328796 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b440512c0 con 0x7f6b44102ad0 2024-05-14T15:19:25.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.383+0000 7f6b3b400700 1 -- 172.21.15.69:0/2242328796 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6b3402a070 con 0x7f6b44102ad0 2024-05-14T15:19:25.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.384+0000 7f6b3b400700 1 --2- 172.21.15.69:0/2242328796 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b280b2900 0x7f6b280b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:25.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.385+0000 7f6b3b400700 1 -- 172.21.15.69:0/2242328796 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f6b340e3b50 con 0x7f6b44102ad0 2024-05-14T15:19:25.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.385+0000 7f6b42000700 1 --2- 172.21.15.69:0/2242328796 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b280b2900 0x7f6b280b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:25.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.385+0000 7f6b3b400700 1 -- 172.21.15.69:0/2242328796 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6b34031020 con 0x7f6b44102ad0 2024-05-14T15:19:25.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.386+0000 7f6b42000700 1 --2- 172.21.15.69:0/2242328796 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b280b2900 0x7f6b280b4e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6b30005950 tx=0x7f6b300058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:25.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.633+0000 7f6b49c00700 1 -- 172.21.15.69:0/2242328796 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6b4402e5f0 con 0x7f6b44102ad0 2024-05-14T15:19:25.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.633+0000 7f6b3b400700 1 -- 172.21.15.69:0/2242328796 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f6b34013070 con 0x7f6b44102ad0 2024-05-14T15:19:25.481 INFO:teuthology.orchestra.run.smithi069.stdout:206158430296 2024-05-14T15:19:25.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.636+0000 7f6b49c00700 1 -- 172.21.15.69:0/2242328796 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b280b2900 msgr2=0x7f6b280b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:25.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.636+0000 7f6b49c00700 1 --2- 172.21.15.69:0/2242328796 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b280b2900 0x7f6b280b4e10 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6b30005950 tx=0x7f6b300058e0 comp rx=0 tx=0).stop 2024-05-14T15:19:25.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.636+0000 7f6b49c00700 1 -- 172.21.15.69:0/2242328796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b44102ad0 msgr2=0x7f6b44103a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:25.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.636+0000 7f6b49c00700 1 --2- 172.21.15.69:0/2242328796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b44102ad0 0x7f6b44103a20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f6b3400b580 tx=0x7f6b3400f510 comp rx=0 tx=0).stop 2024-05-14T15:19:25.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.636+0000 7f6b49c00700 1 -- 172.21.15.69:0/2242328796 shutdown_connections 2024-05-14T15:19:25.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.636+0000 7f6b49c00700 1 --2- 172.21.15.69:0/2242328796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6b44102ad0 0x7f6b44103a20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:25.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.636+0000 7f6b49c00700 1 --2- 172.21.15.69:0/2242328796 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b280b2900 0x7f6b280b4e10 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:25.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.636+0000 7f6b49c00700 1 --2- 172.21.15.69:0/2242328796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6b44109840 0x7f6b441044a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:25.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.636+0000 7f6b49c00700 1 --2- 172.21.15.69:0/2242328796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6b44108ef0 0x7f6b44103f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:25.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.636+0000 7f6b49c00700 1 -- 172.21.15.69:0/2242328796 >> 172.21.15.69:0/2242328796 conn(0x7f6b440fe4d0 msgr2=0x7f6b441008f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:25.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.636+0000 7f6b49c00700 1 -- 172.21.15.69:0/2242328796 shutdown_connections 2024-05-14T15:19:25.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:23.636+0000 7f6b49c00700 1 -- 172.21.15.69:0/2242328796 wait complete. 2024-05-14T15:19:26.639 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986283 got 133143986288 for osd.4 2024-05-14T15:19:26.639 DEBUG:teuthology.parallel:result is None 2024-05-14T15:19:26.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.976+0000 7f31dd200700 1 -- 172.21.15.69:0/824337891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d81031d0 msgr2=0x7f31d8111170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:26.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.976+0000 7f31dd200700 1 --2- 172.21.15.69:0/824337891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d81031d0 0x7f31d8111170 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f31d000b0a0 tx=0x7f31d000b3b0 comp rx=0 tx=0).stop 2024-05-14T15:19:26.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.976+0000 7f31dd200700 1 -- 172.21.15.69:0/824337891 shutdown_connections 2024-05-14T15:19:26.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.976+0000 7f31dd200700 1 --2- 172.21.15.69:0/824337891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d81031d0 0x7f31d8111170 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:26.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.976+0000 7f31dd200700 1 --2- 172.21.15.69:0/824337891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d8109300 0x7f31d8109710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:26.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.976+0000 7f31dd200700 1 --2- 172.21.15.69:0/824337891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8102880 0x7f31d8102c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:26.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.976+0000 7f31dd200700 1 -- 172.21.15.69:0/824337891 >> 172.21.15.69:0/824337891 conn(0x7f31d80fe6f0 msgr2=0x7f31d8100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:26.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.976+0000 7f31dd200700 1 -- 172.21.15.69:0/824337891 shutdown_connections 2024-05-14T15:19:26.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.976+0000 7f31dd200700 1 -- 172.21.15.69:0/824337891 wait complete. 2024-05-14T15:19:26.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.977+0000 7f31dd200700 1 Processor -- start 2024-05-14T15:19:26.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.978+0000 7f31dd200700 1 -- start start 2024-05-14T15:19:26.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.978+0000 7f31dd200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d8102880 0x7f31d8103a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:26.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.978+0000 7f31dd200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d81031d0 0x7f31d8103fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:26.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.978+0000 7f31dd200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8109300 0x7f31d81044e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:26.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.978+0000 7f31dd200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f31d81144a0 con 0x7f31d81031d0 2024-05-14T15:19:26.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.978+0000 7f31dd200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8114320 con 0x7f31d8109300 2024-05-14T15:19:26.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.978+0000 7f31dd200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8114620 con 0x7f31d8102880 2024-05-14T15:19:26.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.978+0000 7f31d5400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d81031d0 0x7f31d8103fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:26.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.979+0000 7f31d5400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d81031d0 0x7f31d8103fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57348/0 (socket says 172.21.15.69:57348) 2024-05-14T15:19:26.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.979+0000 7f31d5400700 1 -- 172.21.15.69:0/414458448 learned_addr learned my addr 172.21.15.69:0/414458448 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.979+0000 7f31d5e00700 1 --2- 172.21.15.69:0/414458448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d8102880 0x7f31d8103a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.979+0000 7f31d6800700 1 --2- 172.21.15.69:0/414458448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8109300 0x7f31d81044e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.979+0000 7f31d5400700 1 -- 172.21.15.69:0/414458448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d8102880 msgr2=0x7f31d8103a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.979+0000 7f31d5400700 1 --2- 172.21.15.69:0/414458448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d8102880 0x7f31d8103a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.979+0000 7f31d5400700 1 -- 172.21.15.69:0/414458448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8109300 msgr2=0x7f31d81044e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.979+0000 7f31d5400700 1 --2- 172.21.15.69:0/414458448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8109300 0x7f31d81044e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.979+0000 7f31d5400700 1 -- 172.21.15.69:0/414458448 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d81a9100 con 0x7f31d81031d0 2024-05-14T15:19:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.979+0000 7f31d6800700 1 --2- 172.21.15.69:0/414458448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8109300 0x7f31d81044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:19:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.979+0000 7f31d5400700 1 --2- 172.21.15.69:0/414458448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d81031d0 0x7f31d8103fa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f31c400c9e0 tx=0x7f31c400cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.980+0000 7f31cea00700 1 -- 172.21.15.69:0/414458448 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c4007aa0 con 0x7f31d81031d0 2024-05-14T15:19:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.980+0000 7f31cea00700 1 -- 172.21.15.69:0/414458448 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31c4007c40 con 0x7f31d81031d0 2024-05-14T15:19:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.980+0000 7f31dd200700 1 -- 172.21.15.69:0/414458448 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d81a9390 con 0x7f31d81031d0 2024-05-14T15:19:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.980+0000 7f31cea00700 1 -- 172.21.15.69:0/414458448 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c4018660 con 0x7f31d81031d0 2024-05-14T15:19:26.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.980+0000 7f31dd200700 1 -- 172.21.15.69:0/414458448 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d81a98d0 con 0x7f31d81031d0 2024-05-14T15:19:26.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.981+0000 7f31dd200700 1 -- 172.21.15.69:0/414458448 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d80512c0 con 0x7f31d81031d0 2024-05-14T15:19:26.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.985+0000 7f31cea00700 1 -- 172.21.15.69:0/414458448 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f31c4018800 con 0x7f31d81031d0 2024-05-14T15:19:26.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.987+0000 7f31cea00700 1 --2- 172.21.15.69:0/414458448 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31bc0b2880 0x7f31bc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:26.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.987+0000 7f31cea00700 1 -- 172.21.15.69:0/414458448 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f31c40e27a0 con 0x7f31d81031d0 2024-05-14T15:19:26.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.987+0000 7f31d5e00700 1 --2- 172.21.15.69:0/414458448 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31bc0b2880 0x7f31bc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:26.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.988+0000 7f31d5e00700 1 --2- 172.21.15.69:0/414458448 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31bc0b2880 0x7f31bc0b4d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f31c8005fd0 tx=0x7f31c800a4c0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:26.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.989+0000 7f31cea00700 1 -- 172.21.15.69:0/414458448 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f31c4054df0 con 0x7f31d81031d0 2024-05-14T15:19:27.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:26 smithi069 ceph-mon[31270]: pgmap v493: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-14T15:19:27.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:26 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/114629955' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-14T15:19:27.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:27.225+0000 7f31dd200700 1 -- 172.21.15.69:0/414458448 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f31d802e5f0 con 0x7f31d81031d0 2024-05-14T15:19:27.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:27.226+0000 7f31cea00700 1 -- 172.21.15.69:0/414458448 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f31c4014030 con 0x7f31d81031d0 2024-05-14T15:19:27.226 INFO:teuthology.orchestra.run.smithi069.stdout:34359738510 2024-05-14T15:19:27.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:27.229+0000 7f31dd200700 1 -- 172.21.15.69:0/414458448 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31bc0b2880 msgr2=0x7f31bc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:27.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:27.229+0000 7f31dd200700 1 --2- 172.21.15.69:0/414458448 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31bc0b2880 0x7f31bc0b4d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f31c8005fd0 tx=0x7f31c800a4c0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:27.229+0000 7f31dd200700 1 -- 172.21.15.69:0/414458448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d81031d0 msgr2=0x7f31d8103fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:27.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:27.229+0000 7f31dd200700 1 --2- 172.21.15.69:0/414458448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d81031d0 0x7f31d8103fa0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f31c400c9e0 tx=0x7f31c400cda0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:27.229+0000 7f31dd200700 1 -- 172.21.15.69:0/414458448 shutdown_connections 2024-05-14T15:19:27.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:27.229+0000 7f31dd200700 1 --2- 172.21.15.69:0/414458448 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31bc0b2880 0x7f31bc0b4d90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:27.229+0000 7f31dd200700 1 --2- 172.21.15.69:0/414458448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8109300 0x7f31d81044e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:27.229+0000 7f31dd200700 1 --2- 172.21.15.69:0/414458448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d8102880 0x7f31d8103a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:27.229+0000 7f31dd200700 1 --2- 172.21.15.69:0/414458448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d81031d0 0x7f31d8103fa0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:27.229+0000 7f31dd200700 1 -- 172.21.15.69:0/414458448 >> 172.21.15.69:0/414458448 conn(0x7f31d80fe6f0 msgr2=0x7f31d810a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:27.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:27.229+0000 7f31dd200700 1 -- 172.21.15.69:0/414458448 shutdown_connections 2024-05-14T15:19:27.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:27.229+0000 7f31dd200700 1 -- 172.21.15.69:0/414458448 wait complete. 2024-05-14T15:19:27.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:26 smithi203 ceph-mon[34567]: pgmap v493: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-14T15:19:27.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:26 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/114629955' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-14T15:19:27.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:26 smithi092 ceph-mon[34729]: pgmap v493: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 767 B/s wr, 11 op/s 2024-05-14T15:19:27.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:26 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/114629955' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-14T15:19:27.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.356+0000 7f6734800700 1 -- 172.21.15.69:0/1706329315 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f672c108f60 msgr2=0x7f672c109370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:27.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.356+0000 7f6734800700 1 --2- 172.21.15.69:0/1706329315 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f672c108f60 0x7f672c109370 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f671c009990 tx=0x7f671c009ca0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.357+0000 7f6734800700 1 -- 172.21.15.69:0/1706329315 shutdown_connections 2024-05-14T15:19:27.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.357+0000 7f6734800700 1 --2- 172.21.15.69:0/1706329315 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f672c1098b0 0x7f672c1111f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.357+0000 7f6734800700 1 --2- 172.21.15.69:0/1706329315 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f672c102b40 0x7f672c102f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.357+0000 7f6734800700 1 --2- 172.21.15.69:0/1706329315 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f672c108f60 0x7f672c109370 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.357+0000 7f6734800700 1 -- 172.21.15.69:0/1706329315 >> 172.21.15.69:0/1706329315 conn(0x7f672c0fe4e0 msgr2=0x7f672c100930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:27.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.357+0000 7f6734800700 1 -- 172.21.15.69:0/1706329315 shutdown_connections 2024-05-14T15:19:27.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.357+0000 7f6734800700 1 -- 172.21.15.69:0/1706329315 wait complete. 2024-05-14T15:19:27.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.358+0000 7f6734800700 1 Processor -- start 2024-05-14T15:19:27.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.358+0000 7f6734800700 1 -- start start 2024-05-14T15:19:27.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.358+0000 7f6734800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f672c102b40 0x7f672c19cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:27.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.359+0000 7f6734800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f672c108f60 0x7f672c19d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:27.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.359+0000 7f6734800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f672c1098b0 0x7f672c1a17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:27.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.359+0000 7f6734800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f672c114370 con 0x7f672c108f60 2024-05-14T15:19:27.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.359+0000 7f6734800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f672c1141f0 con 0x7f672c102b40 2024-05-14T15:19:27.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.359+0000 7f6734800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f672c1144f0 con 0x7f672c1098b0 2024-05-14T15:19:27.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.359+0000 7f6731400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f672c108f60 0x7f672c19d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:27.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.359+0000 7f6731400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f672c108f60 0x7f672c19d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57326/0 (socket says 172.21.15.69:57326) 2024-05-14T15:19:27.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.359+0000 7f6731400700 1 -- 172.21.15.69:0/114629955 learned_addr learned my addr 172.21.15.69:0/114629955 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:27.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.359+0000 7f6731e00700 1 --2- 172.21.15.69:0/114629955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f672c102b40 0x7f672c19cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:27.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.359+0000 7f6732800700 1 --2- 172.21.15.69:0/114629955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f672c1098b0 0x7f672c1a17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:27.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.359+0000 7f6731400700 1 -- 172.21.15.69:0/114629955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f672c1098b0 msgr2=0x7f672c1a17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:27.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.359+0000 7f6731400700 1 --2- 172.21.15.69:0/114629955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f672c1098b0 0x7f672c1a17f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.359+0000 7f6731400700 1 -- 172.21.15.69:0/114629955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f672c102b40 msgr2=0x7f672c19cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:27.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.359+0000 7f6731400700 1 --2- 172.21.15.69:0/114629955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f672c102b40 0x7f672c19cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.359+0000 7f6731400700 1 -- 172.21.15.69:0/114629955 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f672c1a1de0 con 0x7f672c108f60 2024-05-14T15:19:27.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.360+0000 7f6731400700 1 --2- 172.21.15.69:0/114629955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f672c108f60 0x7f672c19d560 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f671c0098e0 tx=0x7f671c00bfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:27.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.360+0000 7f6726a00700 1 -- 172.21.15.69:0/114629955 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c027070 con 0x7f672c108f60 2024-05-14T15:19:27.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.360+0000 7f6726a00700 1 -- 172.21.15.69:0/114629955 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f671c00fb80 con 0x7f672c108f60 2024-05-14T15:19:27.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.360+0000 7f6734800700 1 -- 172.21.15.69:0/114629955 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f672c1a2070 con 0x7f672c108f60 2024-05-14T15:19:27.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.360+0000 7f6726a00700 1 -- 172.21.15.69:0/114629955 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f671c022ca0 con 0x7f672c108f60 2024-05-14T15:19:27.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.360+0000 7f6734800700 1 -- 172.21.15.69:0/114629955 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f672c1a2550 con 0x7f672c108f60 2024-05-14T15:19:27.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.362+0000 7f6734800700 1 -- 172.21.15.69:0/114629955 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f672c0512c0 con 0x7f672c108f60 2024-05-14T15:19:27.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.364+0000 7f6726a00700 1 -- 172.21.15.69:0/114629955 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f671c02a070 con 0x7f672c108f60 2024-05-14T15:19:27.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.365+0000 7f6726a00700 1 --2- 172.21.15.69:0/114629955 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f67140b2880 0x7f67140b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:27.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.366+0000 7f6726a00700 1 -- 172.21.15.69:0/114629955 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f671c0e3610 con 0x7f672c108f60 2024-05-14T15:19:27.472 INFO:teuthology.orchestra.run.smithi069.stdout:184683593826 2024-05-14T15:19:27.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.366+0000 7f6731e00700 1 --2- 172.21.15.69:0/114629955 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f67140b2880 0x7f67140b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:27.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.366+0000 7f6731e00700 1 --2- 172.21.15.69:0/114629955 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f67140b2880 0x7f67140b4d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6720005ea0 tx=0x7f6720005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:27.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.371+0000 7f6726a00700 1 -- 172.21.15.69:0/114629955 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f671c05fdf0 con 0x7f672c108f60 2024-05-14T15:19:27.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.640+0000 7f6734800700 1 -- 172.21.15.69:0/114629955 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f672c1a9b00 con 0x7f672c108f60 2024-05-14T15:19:27.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.641+0000 7f6726a00700 1 -- 172.21.15.69:0/114629955 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f671c013070 con 0x7f672c108f60 2024-05-14T15:19:27.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.644+0000 7f6734800700 1 -- 172.21.15.69:0/114629955 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f67140b2880 msgr2=0x7f67140b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:27.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.644+0000 7f6734800700 1 --2- 172.21.15.69:0/114629955 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f67140b2880 0x7f67140b4d90 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6720005ea0 tx=0x7f6720005e30 comp rx=0 tx=0).stop 2024-05-14T15:19:27.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.644+0000 7f6734800700 1 -- 172.21.15.69:0/114629955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f672c108f60 msgr2=0x7f672c19d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:27.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.644+0000 7f6734800700 1 --2- 172.21.15.69:0/114629955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f672c108f60 0x7f672c19d560 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f671c0098e0 tx=0x7f671c00bfa0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.644+0000 7f6734800700 1 -- 172.21.15.69:0/114629955 shutdown_connections 2024-05-14T15:19:27.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.644+0000 7f6734800700 1 --2- 172.21.15.69:0/114629955 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f67140b2880 0x7f67140b4d90 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.644+0000 7f6734800700 1 --2- 172.21.15.69:0/114629955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f672c1098b0 0x7f672c1a17f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.644+0000 7f6734800700 1 --2- 172.21.15.69:0/114629955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f672c102b40 0x7f672c19cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.644+0000 7f6734800700 1 --2- 172.21.15.69:0/114629955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f672c108f60 0x7f672c19d560 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:27.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.644+0000 7f6734800700 1 -- 172.21.15.69:0/114629955 >> 172.21.15.69:0/114629955 conn(0x7f672c0fe4e0 msgr2=0x7f672c10a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:27.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.644+0000 7f6734800700 1 -- 172.21.15.69:0/114629955 shutdown_connections 2024-05-14T15:19:27.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:26.644+0000 7f6734800700 1 -- 172.21.15.69:0/114629955 wait complete. 2024-05-14T15:19:28.157 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:27 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/414458448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-14T15:19:28.214 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430292 got 206158430296 for osd.7 2024-05-14T15:19:28.214 DEBUG:teuthology.parallel:result is None 2024-05-14T15:19:28.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:27 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/414458448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-14T15:19:28.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:27 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/414458448' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-14T15:19:29.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:28 smithi069 ceph-mon[31270]: pgmap v494: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T15:19:29.257 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738503 got 34359738510 for osd.0 2024-05-14T15:19:29.258 DEBUG:teuthology.parallel:result is None 2024-05-14T15:19:29.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:28 smithi203 ceph-mon[34567]: pgmap v494: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T15:19:29.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:28 smithi092 ceph-mon[34729]: pgmap v494: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T15:19:29.650 INFO:tasks.cephadm.ceph_manager.ceph:need seq 283467841597 got 283467841602 for osd.10 2024-05-14T15:19:29.650 DEBUG:teuthology.parallel:result is None 2024-05-14T15:19:29.759 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:29.782 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574975 got 55834574981 for osd.1 2024-05-14T15:19:29.782 DEBUG:teuthology.parallel:result is None 2024-05-14T15:19:29.921 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:29.968 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201354 got 236223201362 for osd.8 2024-05-14T15:19:29.968 DEBUG:teuthology.parallel:result is None 2024-05-14T15:19:31.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:30 smithi069 ceph-mon[31270]: pgmap v495: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:19:31.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:30 smithi203 ceph-mon[34567]: pgmap v495: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:19:31.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:30 smithi092 ceph-mon[34729]: pgmap v495: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:19:33.282 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:32 smithi069 ceph-mon[31270]: pgmap v496: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:19:33.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:32 smithi203 ceph-mon[34567]: pgmap v496: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:19:33.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:32 smithi092 ceph-mon[34729]: pgmap v496: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:19:33.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.727+0000 7f00b2000700 1 -- 172.21.15.69:0/3451103967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00ac10b2e0 msgr2=0x7f00ac117810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:33.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.727+0000 7f00b2000700 1 --2- 172.21.15.69:0/3451103967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00ac10b2e0 0x7f00ac117810 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f00a400b0a0 tx=0x7f00a400b3b0 comp rx=0 tx=0).stop 2024-05-14T15:19:33.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.728+0000 7f00b2000700 1 -- 172.21.15.69:0/3451103967 shutdown_connections 2024-05-14T15:19:33.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.728+0000 7f00b2000700 1 --2- 172.21.15.69:0/3451103967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00ac10b2e0 0x7f00ac117810 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:33.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.728+0000 7f00b2000700 1 --2- 172.21.15.69:0/3451103967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00ac110970 0x7f00ac110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:33.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.728+0000 7f00b2000700 1 --2- 172.21.15.69:0/3451103967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00ac10a990 0x7f00ac10ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:33.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.728+0000 7f00b2000700 1 -- 172.21.15.69:0/3451103967 >> 172.21.15.69:0/3451103967 conn(0x7f00ac077c80 msgr2=0x7f00ac0780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:33.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.728+0000 7f00b2000700 1 -- 172.21.15.69:0/3451103967 shutdown_connections 2024-05-14T15:19:33.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.728+0000 7f00b2000700 1 -- 172.21.15.69:0/3451103967 wait complete. 2024-05-14T15:19:33.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.729+0000 7f00b2000700 1 Processor -- start 2024-05-14T15:19:33.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.729+0000 7f00b2000700 1 -- start start 2024-05-14T15:19:33.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.730+0000 7f00b2000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00ac10a990 0x7f00ac1a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:33.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.730+0000 7f00b2000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00ac10b2e0 0x7f00ac1a18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:33.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.730+0000 7f00b2000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00ac110970 0x7f00ac1a5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:33.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.730+0000 7f00b2000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac11a940 con 0x7f00ac10b2e0 2024-05-14T15:19:33.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.730+0000 7f00b2000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac11a7c0 con 0x7f00ac110970 2024-05-14T15:19:33.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.730+0000 7f00b2000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f00ac11aac0 con 0x7f00ac10a990 2024-05-14T15:19:33.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.730+0000 7f00aaa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00ac10b2e0 0x7f00ac1a18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:33.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.730+0000 7f00aaa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00ac10b2e0 0x7f00ac1a18d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52112/0 (socket says 172.21.15.69:52112) 2024-05-14T15:19:33.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.730+0000 7f00aaa00700 1 -- 172.21.15.69:0/1244493600 learned_addr learned my addr 172.21.15.69:0/1244493600 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:33.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.730+0000 7f00ab400700 1 --2- 172.21.15.69:0/1244493600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00ac10a990 0x7f00ac1a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:33.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.730+0000 7f00abe00700 1 --2- 172.21.15.69:0/1244493600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00ac110970 0x7f00ac1a5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:33.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.731+0000 7f00aaa00700 1 -- 172.21.15.69:0/1244493600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00ac10a990 msgr2=0x7f00ac1a1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:33.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.731+0000 7f00aaa00700 1 --2- 172.21.15.69:0/1244493600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00ac10a990 0x7f00ac1a1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:33.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.731+0000 7f00aaa00700 1 -- 172.21.15.69:0/1244493600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00ac110970 msgr2=0x7f00ac1a5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:33.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.731+0000 7f00aaa00700 1 --2- 172.21.15.69:0/1244493600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00ac110970 0x7f00ac1a5b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:33.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.731+0000 7f00aaa00700 1 -- 172.21.15.69:0/1244493600 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00ac1a6200 con 0x7f00ac10b2e0 2024-05-14T15:19:33.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.731+0000 7f00ab400700 1 --2- 172.21.15.69:0/1244493600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00ac10a990 0x7f00ac1a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:19:33.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.731+0000 7f00aaa00700 1 --2- 172.21.15.69:0/1244493600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00ac10b2e0 0x7f00ac1a18d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f009400d980 tx=0x7f009400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:33.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.732+0000 7f00a3e00700 1 -- 172.21.15.69:0/1244493600 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0094017070 con 0x7f00ac10b2e0 2024-05-14T15:19:33.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.732+0000 7f00a3e00700 1 -- 172.21.15.69:0/1244493600 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0094009dc0 con 0x7f00ac10b2e0 2024-05-14T15:19:33.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.732+0000 7f00b2000700 1 -- 172.21.15.69:0/1244493600 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00ac1a6490 con 0x7f00ac10b2e0 2024-05-14T15:19:33.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.732+0000 7f00a3e00700 1 -- 172.21.15.69:0/1244493600 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009400f3c0 con 0x7f00ac10b2e0 2024-05-14T15:19:33.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.732+0000 7f00b2000700 1 -- 172.21.15.69:0/1244493600 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00ac1ade10 con 0x7f00ac10b2e0 2024-05-14T15:19:33.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.733+0000 7f00b2000700 1 -- 172.21.15.69:0/1244493600 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00ac0512c0 con 0x7f00ac10b2e0 2024-05-14T15:19:33.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.737+0000 7f00a3e00700 1 -- 172.21.15.69:0/1244493600 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0094009930 con 0x7f00ac10b2e0 2024-05-14T15:19:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.740+0000 7f00a3e00700 1 --2- 172.21.15.69:0/1244493600 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f00900b2880 0x7f00900b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.740+0000 7f00a3e00700 1 -- 172.21.15.69:0/1244493600 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f00940e2120 con 0x7f00ac10b2e0 2024-05-14T15:19:33.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.740+0000 7f00ab400700 1 --2- 172.21.15.69:0/1244493600 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f00900b2880 0x7f00900b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:33.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.741+0000 7f00ab400700 1 --2- 172.21.15.69:0/1244493600 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f00900b2880 0x7f00900b4d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f009c005e10 tx=0x7f009c005d60 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:33.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:33.742+0000 7f00a3e00700 1 -- 172.21.15.69:0/1244493600 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f00940a9a10 con 0x7f00ac10b2e0 2024-05-14T15:19:33.909 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593819 got 184683593826 for osd.6 2024-05-14T15:19:33.909 DEBUG:teuthology.parallel:result is None 2024-05-14T15:19:34.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:34.004+0000 7f00b2000700 1 -- 172.21.15.69:0/1244493600 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f00ac02e5f0 con 0x7f00ac10b2e0 2024-05-14T15:19:34.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:34.005+0000 7f00a3e00700 1 -- 172.21.15.69:0/1244493600 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f00940a9310 con 0x7f00ac10b2e0 2024-05-14T15:19:34.004 INFO:teuthology.orchestra.run.smithi069.stdout:309237645373 2024-05-14T15:19:34.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:34.008+0000 7f00b2000700 1 -- 172.21.15.69:0/1244493600 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f00900b2880 msgr2=0x7f00900b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:34.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:34.008+0000 7f00b2000700 1 --2- 172.21.15.69:0/1244493600 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f00900b2880 0x7f00900b4d90 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f009c005e10 tx=0x7f009c005d60 comp rx=0 tx=0).stop 2024-05-14T15:19:34.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:34.008+0000 7f00b2000700 1 -- 172.21.15.69:0/1244493600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00ac10b2e0 msgr2=0x7f00ac1a18d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:34.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:34.008+0000 7f00b2000700 1 --2- 172.21.15.69:0/1244493600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00ac10b2e0 0x7f00ac1a18d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f009400d980 tx=0x7f009400dc90 comp rx=0 tx=0).stop 2024-05-14T15:19:34.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:34.008+0000 7f00b2000700 1 -- 172.21.15.69:0/1244493600 shutdown_connections 2024-05-14T15:19:34.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:34.008+0000 7f00b2000700 1 --2- 172.21.15.69:0/1244493600 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f00900b2880 0x7f00900b4d90 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:34.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:34.008+0000 7f00b2000700 1 --2- 172.21.15.69:0/1244493600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f00ac110970 0x7f00ac1a5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:34.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:34.008+0000 7f00b2000700 1 --2- 172.21.15.69:0/1244493600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f00ac10a990 0x7f00ac1a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:34.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:34.008+0000 7f00b2000700 1 --2- 172.21.15.69:0/1244493600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f00ac10b2e0 0x7f00ac1a18d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:34.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:34.008+0000 7f00b2000700 1 -- 172.21.15.69:0/1244493600 >> 172.21.15.69:0/1244493600 conn(0x7f00ac077c80 msgr2=0x7f00ac07b2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:34.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:34.008+0000 7f00b2000700 1 -- 172.21.15.69:0/1244493600 shutdown_connections 2024-05-14T15:19:34.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:34.008+0000 7f00b2000700 1 -- 172.21.15.69:0/1244493600 wait complete. 2024-05-14T15:19:35.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.007+0000 7f0550800700 1 -- 172.21.15.69:0/550216329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0548109870 msgr2=0x7f05481111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.007+0000 7f0550800700 1 --2- 172.21.15.69:0/550216329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0548109870 0x7f05481111d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f054400b0d0 tx=0x7f054400b3e0 comp rx=0 tx=0).stop 2024-05-14T15:19:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.007+0000 7f0550800700 1 -- 172.21.15.69:0/550216329 shutdown_connections 2024-05-14T15:19:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.007+0000 7f0550800700 1 --2- 172.21.15.69:0/550216329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0548109870 0x7f05481111d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.007+0000 7f0550800700 1 --2- 172.21.15.69:0/550216329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f05481045f0 0x7f0548104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.007+0000 7f0550800700 1 --2- 172.21.15.69:0/550216329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0548108f20 0x7f0548109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.007+0000 7f0550800700 1 -- 172.21.15.69:0/550216329 >> 172.21.15.69:0/550216329 conn(0x7f0548100040 msgr2=0x7f0548102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.008+0000 7f0550800700 1 -- 172.21.15.69:0/550216329 shutdown_connections 2024-05-14T15:19:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.008+0000 7f0550800700 1 -- 172.21.15.69:0/550216329 wait complete. 2024-05-14T15:19:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.009+0000 7f0550800700 1 Processor -- start 2024-05-14T15:19:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.009+0000 7f0550800700 1 -- start start 2024-05-14T15:19:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.009+0000 7f0550800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05481045f0 0x7f054819ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:35.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.009+0000 7f0550800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0548108f20 0x7f054819b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.009+0000 7f0550800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0548109870 0x7f054819f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.009+0000 7f0550800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0548114350 con 0x7f0548108f20 2024-05-14T15:19:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.009+0000 7f0550800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f05481141d0 con 0x7f05481045f0 2024-05-14T15:19:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.009+0000 7f0550800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f05481144d0 con 0x7f0548109870 2024-05-14T15:19:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.010+0000 7f054d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0548108f20 0x7f054819b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.010+0000 7f054d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0548108f20 0x7f054819b300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52132/0 (socket says 172.21.15.69:52132) 2024-05-14T15:19:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.010+0000 7f054d400700 1 -- 172.21.15.69:0/2136660735 learned_addr learned my addr 172.21.15.69:0/2136660735 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.010+0000 7f054de00700 1 --2- 172.21.15.69:0/2136660735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05481045f0 0x7f054819ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.010+0000 7f054e800700 1 --2- 172.21.15.69:0/2136660735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0548109870 0x7f054819f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.010+0000 7f054d400700 1 -- 172.21.15.69:0/2136660735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0548109870 msgr2=0x7f054819f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.010+0000 7f054d400700 1 --2- 172.21.15.69:0/2136660735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0548109870 0x7f054819f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.010+0000 7f054d400700 1 -- 172.21.15.69:0/2136660735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05481045f0 msgr2=0x7f054819ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:35.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.010+0000 7f054d400700 1 --2- 172.21.15.69:0/2136660735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05481045f0 0x7f054819ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:35.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.010+0000 7f054d400700 1 -- 172.21.15.69:0/2136660735 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f054819fb80 con 0x7f0548108f20 2024-05-14T15:19:35.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.010+0000 7f054de00700 1 --2- 172.21.15.69:0/2136660735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05481045f0 0x7f054819ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:19:35.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.010+0000 7f054e800700 1 --2- 172.21.15.69:0/2136660735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0548109870 0x7f054819f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:19:35.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.010+0000 7f054d400700 1 --2- 172.21.15.69:0/2136660735 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0548108f20 0x7f054819b300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f053800c9e0 tx=0x7f053800cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:35.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.011+0000 7f0542a00700 1 -- 172.21.15.69:0/2136660735 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538007aa0 con 0x7f0548108f20 2024-05-14T15:19:35.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.011+0000 7f0542a00700 1 -- 172.21.15.69:0/2136660735 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0538007c40 con 0x7f0548108f20 2024-05-14T15:19:35.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.011+0000 7f0542a00700 1 -- 172.21.15.69:0/2136660735 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0538018660 con 0x7f0548108f20 2024-05-14T15:19:35.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.011+0000 7f0550800700 1 -- 172.21.15.69:0/2136660735 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f054819fe70 con 0x7f0548108f20 2024-05-14T15:19:35.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.011+0000 7f0550800700 1 -- 172.21.15.69:0/2136660735 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05481a0360 con 0x7f0548108f20 2024-05-14T15:19:35.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.012+0000 7f0550800700 1 -- 172.21.15.69:0/2136660735 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05480512c0 con 0x7f0548108f20 2024-05-14T15:19:35.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.015+0000 7f0542a00700 1 -- 172.21.15.69:0/2136660735 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0538018800 con 0x7f0548108f20 2024-05-14T15:19:35.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.016+0000 7f0542a00700 1 --2- 172.21.15.69:0/2136660735 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f05300b2900 0x7f05300b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:35.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.016+0000 7f0542a00700 1 -- 172.21.15.69:0/2136660735 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f05380e26b0 con 0x7f0548108f20 2024-05-14T15:19:35.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.017+0000 7f054de00700 1 --2- 172.21.15.69:0/2136660735 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f05300b2900 0x7f05300b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:35.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.017+0000 7f054de00700 1 --2- 172.21.15.69:0/2136660735 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f05300b2900 0x7f05300b4e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f053c005fd0 tx=0x7f053c005ee0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:35.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.019+0000 7f0542a00700 1 -- 172.21.15.69:0/2136660735 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0538054df0 con 0x7f0548108f20 2024-05-14T15:19:35.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.253+0000 7f0550800700 1 -- 172.21.15.69:0/2136660735 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f054802e5f0 con 0x7f0548108f20 2024-05-14T15:19:35.253 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:34 smithi069 ceph-mon[31270]: pgmap v497: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:19:35.253 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:34 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1244493600' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-14T15:19:35.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.254+0000 7f0542a00700 1 -- 172.21.15.69:0/2136660735 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f0538014030 con 0x7f0548108f20 2024-05-14T15:19:35.254 INFO:teuthology.orchestra.run.smithi069.stdout:107374182521 2024-05-14T15:19:35.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.258+0000 7f0550800700 1 -- 172.21.15.69:0/2136660735 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f05300b2900 msgr2=0x7f05300b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:35.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.258+0000 7f0550800700 1 --2- 172.21.15.69:0/2136660735 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f05300b2900 0x7f05300b4e10 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f053c005fd0 tx=0x7f053c005ee0 comp rx=0 tx=0).stop 2024-05-14T15:19:35.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.258+0000 7f0550800700 1 -- 172.21.15.69:0/2136660735 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0548108f20 msgr2=0x7f054819b300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:35.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.258+0000 7f0550800700 1 --2- 172.21.15.69:0/2136660735 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0548108f20 0x7f054819b300 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f053800c9e0 tx=0x7f053800cda0 comp rx=0 tx=0).stop 2024-05-14T15:19:35.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.258+0000 7f0550800700 1 -- 172.21.15.69:0/2136660735 shutdown_connections 2024-05-14T15:19:35.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.258+0000 7f0550800700 1 --2- 172.21.15.69:0/2136660735 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f05300b2900 0x7f05300b4e10 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:35.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.258+0000 7f0550800700 1 --2- 172.21.15.69:0/2136660735 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0548109870 0x7f054819f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:35.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.258+0000 7f0550800700 1 --2- 172.21.15.69:0/2136660735 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f05481045f0 0x7f054819ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:35.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.258+0000 7f0550800700 1 --2- 172.21.15.69:0/2136660735 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0548108f20 0x7f054819b300 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:35.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.258+0000 7f0550800700 1 -- 172.21.15.69:0/2136660735 >> 172.21.15.69:0/2136660735 conn(0x7f0548100040 msgr2=0x7f05481086c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:35.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.258+0000 7f0550800700 1 -- 172.21.15.69:0/2136660735 shutdown_connections 2024-05-14T15:19:35.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:35.258+0000 7f0550800700 1 -- 172.21.15.69:0/2136660735 wait complete. 2024-05-14T15:19:35.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:34 smithi203 ceph-mon[34567]: pgmap v497: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:19:35.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:34 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1244493600' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-14T15:19:35.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:34 smithi092 ceph-mon[34729]: pgmap v497: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:19:35.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:34 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1244493600' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-05-14T15:19:35.941 INFO:tasks.cephadm.ceph_manager.ceph:need seq 309237645368 got 309237645373 for osd.11 2024-05-14T15:19:35.942 DEBUG:teuthology.parallel:result is None 2024-05-14T15:19:36.213 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:35 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2136660735' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-14T15:19:36.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:35 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2136660735' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-14T15:19:36.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:35 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2136660735' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-14T15:19:36.738 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182516 got 107374182521 for osd.3 2024-05-14T15:19:36.739 DEBUG:teuthology.parallel:result is None 2024-05-14T15:19:36.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.556+0000 7fab59600700 1 -- 172.21.15.69:0/2044980034 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab54105e50 msgr2=0x7fab5410e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:36.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.556+0000 7fab59600700 1 --2- 172.21.15.69:0/2044980034 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab54105e50 0x7fab5410e3a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fab40009990 tx=0x7fab40009ca0 comp rx=0 tx=0).stop 2024-05-14T15:19:36.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.556+0000 7fab59600700 1 -- 172.21.15.69:0/2044980034 shutdown_connections 2024-05-14T15:19:36.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.556+0000 7fab59600700 1 --2- 172.21.15.69:0/2044980034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab5410e8e0 0x7fab54110dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:36.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.556+0000 7fab59600700 1 --2- 172.21.15.69:0/2044980034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab54105500 0x7fab54105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:36.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.556+0000 7fab59600700 1 --2- 172.21.15.69:0/2044980034 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab54105e50 0x7fab5410e3a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:36.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.556+0000 7fab59600700 1 -- 172.21.15.69:0/2044980034 >> 172.21.15.69:0/2044980034 conn(0x7fab540fedc0 msgr2=0x7fab541011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:36.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.556+0000 7fab59600700 1 -- 172.21.15.69:0/2044980034 shutdown_connections 2024-05-14T15:19:36.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.556+0000 7fab59600700 1 -- 172.21.15.69:0/2044980034 wait complete. 2024-05-14T15:19:36.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.557+0000 7fab59600700 1 Processor -- start 2024-05-14T15:19:36.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.557+0000 7fab59600700 1 -- start start 2024-05-14T15:19:36.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.558+0000 7fab59600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab54105500 0x7fab541031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:36.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.558+0000 7fab59600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab54105e50 0x7fab54103730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:36.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.558+0000 7fab59600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab5410e8e0 0x7fab54103c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:36.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.558+0000 7fab59600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fab54114340 con 0x7fab54105e50 2024-05-14T15:19:36.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.558+0000 7fab59600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fab541141c0 con 0x7fab5410e8e0 2024-05-14T15:19:36.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.558+0000 7fab59600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fab541144c0 con 0x7fab54105500 2024-05-14T15:19:36.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.558+0000 7fab52000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab54105e50 0x7fab54103730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:36.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.558+0000 7fab52000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab54105e50 0x7fab54103730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52158/0 (socket says 172.21.15.69:52158) 2024-05-14T15:19:36.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.558+0000 7fab52000700 1 -- 172.21.15.69:0/2590217552 learned_addr learned my addr 172.21.15.69:0/2590217552 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:36.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.559+0000 7fab53400700 1 --2- 172.21.15.69:0/2590217552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab5410e8e0 0x7fab54103c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:36.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.559+0000 7fab52a00700 1 --2- 172.21.15.69:0/2590217552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab54105500 0x7fab541031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:36.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.559+0000 7fab52000700 1 -- 172.21.15.69:0/2590217552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab54105500 msgr2=0x7fab541031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:36.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.559+0000 7fab52000700 1 --2- 172.21.15.69:0/2590217552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab54105500 0x7fab541031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:36.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.559+0000 7fab52000700 1 -- 172.21.15.69:0/2590217552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab5410e8e0 msgr2=0x7fab54103c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:36.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.559+0000 7fab52000700 1 --2- 172.21.15.69:0/2590217552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab5410e8e0 0x7fab54103c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:36.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.559+0000 7fab52000700 1 -- 172.21.15.69:0/2590217552 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab541a9040 con 0x7fab54105e50 2024-05-14T15:19:36.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.559+0000 7fab53400700 1 --2- 172.21.15.69:0/2590217552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab5410e8e0 0x7fab54103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:19:36.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.559+0000 7fab52000700 1 --2- 172.21.15.69:0/2590217552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab54105e50 0x7fab54103730 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fab40005910 tx=0x7fab40009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:36.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.559+0000 7fab4b400700 1 -- 172.21.15.69:0/2590217552 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab40027070 con 0x7fab54105e50 2024-05-14T15:19:36.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.559+0000 7fab4b400700 1 -- 172.21.15.69:0/2590217552 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fab4000fce0 con 0x7fab54105e50 2024-05-14T15:19:36.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.559+0000 7fab59600700 1 -- 172.21.15.69:0/2590217552 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab541a92d0 con 0x7fab54105e50 2024-05-14T15:19:36.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.560+0000 7fab4b400700 1 -- 172.21.15.69:0/2590217552 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab400173f0 con 0x7fab54105e50 2024-05-14T15:19:36.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.560+0000 7fab59600700 1 -- 172.21.15.69:0/2590217552 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab541a9800 con 0x7fab54105e50 2024-05-14T15:19:36.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.561+0000 7fab59600700 1 -- 172.21.15.69:0/2590217552 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab540512c0 con 0x7fab54105e50 2024-05-14T15:19:36.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.563+0000 7fab4b400700 1 -- 172.21.15.69:0/2590217552 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fab4002a070 con 0x7fab54105e50 2024-05-14T15:19:36.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.565+0000 7fab4b400700 1 --2- 172.21.15.69:0/2590217552 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fab380b2900 0x7fab380b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:36.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.565+0000 7fab4b400700 1 -- 172.21.15.69:0/2590217552 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fab400e3dd0 con 0x7fab54105e50 2024-05-14T15:19:36.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.565+0000 7fab52a00700 1 --2- 172.21.15.69:0/2590217552 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fab380b2900 0x7fab380b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:36.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.566+0000 7fab52a00700 1 --2- 172.21.15.69:0/2590217552 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fab380b2900 0x7fab380b4e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fab44005ea0 tx=0x7fab44005e30 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:36.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.567+0000 7fab4b400700 1 -- 172.21.15.69:0/2590217552 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fab40013070 con 0x7fab54105e50 2024-05-14T15:19:36.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.813+0000 7fab59600700 1 -- 172.21.15.69:0/2590217552 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fab54104720 con 0x7fab54105e50 2024-05-14T15:19:36.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.815+0000 7fab4b400700 1 -- 172.21.15.69:0/2590217552 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fab400ab750 con 0x7fab54105e50 2024-05-14T15:19:36.860 INFO:teuthology.orchestra.run.smithi069.stdout:158913790060 2024-05-14T15:19:36.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.818+0000 7fab59600700 1 -- 172.21.15.69:0/2590217552 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fab380b2900 msgr2=0x7fab380b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:36.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.818+0000 7fab59600700 1 --2- 172.21.15.69:0/2590217552 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fab380b2900 0x7fab380b4e10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fab44005ea0 tx=0x7fab44005e30 comp rx=0 tx=0).stop 2024-05-14T15:19:36.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.818+0000 7fab59600700 1 -- 172.21.15.69:0/2590217552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab54105e50 msgr2=0x7fab54103730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:36.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.818+0000 7fab59600700 1 --2- 172.21.15.69:0/2590217552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab54105e50 0x7fab54103730 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fab40005910 tx=0x7fab40009f90 comp rx=0 tx=0).stop 2024-05-14T15:19:36.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.818+0000 7fab59600700 1 -- 172.21.15.69:0/2590217552 shutdown_connections 2024-05-14T15:19:36.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.818+0000 7fab59600700 1 --2- 172.21.15.69:0/2590217552 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fab380b2900 0x7fab380b4e10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:36.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.818+0000 7fab59600700 1 --2- 172.21.15.69:0/2590217552 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fab5410e8e0 0x7fab54103c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:36.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.818+0000 7fab59600700 1 --2- 172.21.15.69:0/2590217552 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fab54105500 0x7fab541031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:36.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.818+0000 7fab59600700 1 --2- 172.21.15.69:0/2590217552 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fab54105e50 0x7fab54103730 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:36.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.818+0000 7fab59600700 1 -- 172.21.15.69:0/2590217552 >> 172.21.15.69:0/2590217552 conn(0x7fab540fedc0 msgr2=0x7fab540ff450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:36.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.818+0000 7fab59600700 1 -- 172.21.15.69:0/2590217552 shutdown_connections 2024-05-14T15:19:36.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:36.818+0000 7fab59600700 1 -- 172.21.15.69:0/2590217552 wait complete. 2024-05-14T15:19:37.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:36 smithi069 ceph-mon[31270]: pgmap v498: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:19:37.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:36 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2590217552' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-14T15:19:37.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:36 smithi203 ceph-mon[34567]: pgmap v498: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:19:37.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:36 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2590217552' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-14T15:19:37.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:36 smithi092 ceph-mon[34729]: pgmap v498: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:19:37.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:36 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2590217552' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-14T15:19:37.758 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913790054 got 158913790060 for osd.5 2024-05-14T15:19:37.759 DEBUG:teuthology.parallel:result is None 2024-05-14T15:19:37.759 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-14T15:19:37.759 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-14T15:19:38.210 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:39.275 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:39 smithi069 ceph-mon[31270]: pgmap v499: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:19:39.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:39 smithi203 ceph-mon[34567]: pgmap v499: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:19:39.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:39 smithi092 ceph-mon[34729]: pgmap v499: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:19:40.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.662+0000 7f0974800700 1 -- 172.21.15.69:0/1665036651 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f096c106ec0 msgr2=0x7f096c113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:40.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.662+0000 7f0974800700 1 --2- 172.21.15.69:0/1665036651 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f096c106ec0 0x7f096c113350 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f096800b0a0 tx=0x7f096800b3b0 comp rx=0 tx=0).stop 2024-05-14T15:19:40.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.662+0000 7f0974800700 1 -- 172.21.15.69:0/1665036651 shutdown_connections 2024-05-14T15:19:40.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.662+0000 7f0974800700 1 --2- 172.21.15.69:0/1665036651 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f096c106ec0 0x7f096c113350 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:40.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.662+0000 7f0974800700 1 --2- 172.21.15.69:0/1665036651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f096c10c5b0 0x7f096c10c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:40.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.662+0000 7f0974800700 1 --2- 172.21.15.69:0/1665036651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f096c106570 0x7f096c106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:40.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.662+0000 7f0974800700 1 -- 172.21.15.69:0/1665036651 >> 172.21.15.69:0/1665036651 conn(0x7f096c102050 msgr2=0x7f096c1044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:40.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.662+0000 7f0974800700 1 -- 172.21.15.69:0/1665036651 shutdown_connections 2024-05-14T15:19:40.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.662+0000 7f0974800700 1 -- 172.21.15.69:0/1665036651 wait complete. 2024-05-14T15:19:40.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.663+0000 7f0974800700 1 Processor -- start 2024-05-14T15:19:40.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.664+0000 7f0974800700 1 -- start start 2024-05-14T15:19:40.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.664+0000 7f0974800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f096c106570 0x7f096c19cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:40.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.664+0000 7f0974800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f096c106ec0 0x7f096c19d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:40.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.664+0000 7f0974800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f096c10c5b0 0x7f096c1a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:40.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.664+0000 7f0974800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f096c116600 con 0x7f096c106570 2024-05-14T15:19:40.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.664+0000 7f0974800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f096c116480 con 0x7f096c10c5b0 2024-05-14T15:19:40.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.664+0000 7f0974800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f096c116780 con 0x7f096c106ec0 2024-05-14T15:19:40.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.664+0000 7f0971e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f096c106570 0x7f096c19cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:40.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.664+0000 7f0971e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f096c106570 0x7f096c19cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52184/0 (socket says 172.21.15.69:52184) 2024-05-14T15:19:40.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.664+0000 7f0971e00700 1 -- 172.21.15.69:0/3039994547 learned_addr learned my addr 172.21.15.69:0/3039994547 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:40.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.665+0000 7f0971400700 1 --2- 172.21.15.69:0/3039994547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f096c106ec0 0x7f096c19d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:40.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.665+0000 7f0971e00700 1 -- 172.21.15.69:0/3039994547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f096c106ec0 msgr2=0x7f096c19d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:40.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.665+0000 7f0971e00700 1 --2- 172.21.15.69:0/3039994547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f096c106ec0 0x7f096c19d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:40.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.665+0000 7f0971e00700 1 -- 172.21.15.69:0/3039994547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f096c10c5b0 msgr2=0x7f096c1a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:40.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.665+0000 7f0972800700 1 --2- 172.21.15.69:0/3039994547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f096c10c5b0 0x7f096c1a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:40.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.665+0000 7f0971e00700 1 --2- 172.21.15.69:0/3039994547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f096c10c5b0 0x7f096c1a1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:40.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.665+0000 7f0971e00700 1 -- 172.21.15.69:0/3039994547 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f096c1a1d50 con 0x7f096c106570 2024-05-14T15:19:40.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.665+0000 7f0971e00700 1 --2- 172.21.15.69:0/3039994547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f096c106570 0x7f096c19cf30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f096000c9e0 tx=0x7f096000cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:40.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.665+0000 7f0966a00700 1 -- 172.21.15.69:0/3039994547 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0960007aa0 con 0x7f096c106570 2024-05-14T15:19:40.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.665+0000 7f0966a00700 1 -- 172.21.15.69:0/3039994547 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0960007c40 con 0x7f096c106570 2024-05-14T15:19:40.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.666+0000 7f0974800700 1 -- 172.21.15.69:0/3039994547 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f096c1a1fe0 con 0x7f096c106570 2024-05-14T15:19:40.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.666+0000 7f0966a00700 1 -- 172.21.15.69:0/3039994547 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0960018660 con 0x7f096c106570 2024-05-14T15:19:40.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.666+0000 7f0974800700 1 -- 172.21.15.69:0/3039994547 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f096c1a2520 con 0x7f096c106570 2024-05-14T15:19:40.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.667+0000 7f0974800700 1 -- 172.21.15.69:0/3039994547 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f096c0512c0 con 0x7f096c106570 2024-05-14T15:19:40.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.669+0000 7f0966a00700 1 -- 172.21.15.69:0/3039994547 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0960018800 con 0x7f096c106570 2024-05-14T15:19:40.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.671+0000 7f0966a00700 1 --2- 172.21.15.69:0/3039994547 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f09540b2880 0x7f09540b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:40.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.671+0000 7f0966a00700 1 -- 172.21.15.69:0/3039994547 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f09600e25c0 con 0x7f096c106570 2024-05-14T15:19:40.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.671+0000 7f0971400700 1 --2- 172.21.15.69:0/3039994547 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f09540b2880 0x7f09540b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:40.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.672+0000 7f0971400700 1 --2- 172.21.15.69:0/3039994547 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f09540b2880 0x7f09540b4d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f096c105430 tx=0x7f095c005eb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:40.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.676+0000 7f0966a00700 1 -- 172.21.15.69:0/3039994547 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0960014030 con 0x7f096c106570 2024-05-14T15:19:40.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.899+0000 7f0974800700 1 -- 172.21.15.69:0/3039994547 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f096c063c00 con 0x7f09540b2880 2024-05-14T15:19:40.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.930+0000 7f0966a00700 1 -- 172.21.15.69:0/3039994547 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340524 (secure 0 0 0) 0x7f096c063c00 con 0x7f09540b2880 2024-05-14T15:19:40.932 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:19:40.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.938+0000 7f0974800700 1 -- 172.21.15.69:0/3039994547 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f09540b2880 msgr2=0x7f09540b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:40.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.938+0000 7f0974800700 1 --2- 172.21.15.69:0/3039994547 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f09540b2880 0x7f09540b4d90 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f096c105430 tx=0x7f095c005eb0 comp rx=0 tx=0).stop 2024-05-14T15:19:40.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.938+0000 7f0974800700 1 -- 172.21.15.69:0/3039994547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f096c106570 msgr2=0x7f096c19cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:40.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.938+0000 7f0974800700 1 --2- 172.21.15.69:0/3039994547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f096c106570 0x7f096c19cf30 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f096000c9e0 tx=0x7f096000cda0 comp rx=0 tx=0).stop 2024-05-14T15:19:40.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.938+0000 7f0974800700 1 -- 172.21.15.69:0/3039994547 shutdown_connections 2024-05-14T15:19:40.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.938+0000 7f0974800700 1 --2- 172.21.15.69:0/3039994547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f096c106570 0x7f096c19cf30 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:40.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.938+0000 7f0974800700 1 --2- 172.21.15.69:0/3039994547 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f09540b2880 0x7f09540b4d90 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:40.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.938+0000 7f0974800700 1 --2- 172.21.15.69:0/3039994547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f096c10c5b0 0x7f096c1a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:40.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.938+0000 7f0974800700 1 --2- 172.21.15.69:0/3039994547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f096c106ec0 0x7f096c19d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:40.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.938+0000 7f0974800700 1 -- 172.21.15.69:0/3039994547 >> 172.21.15.69:0/3039994547 conn(0x7f096c102050 msgr2=0x7f096c1035b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:40.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.938+0000 7f0974800700 1 -- 172.21.15.69:0/3039994547 shutdown_connections 2024-05-14T15:19:40.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:40.939+0000 7f0974800700 1 -- 172.21.15.69:0/3039994547 wait complete. 2024-05-14T15:19:40.940 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-05-14T15:19:41.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:41 smithi069 ceph-mon[31270]: pgmap v500: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:19:41.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:41 smithi203 ceph-mon[34567]: pgmap v500: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:19:41.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:41 smithi092 ceph-mon[34729]: pgmap v500: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:19:41.859 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":500,"stamp":"2024-05-14T15:19:39.701350+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665882,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1318,"num_read_kb":769,"num_write":391,"num_write_kb":2311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":824,"ondisk_log_size":824,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384492,"kb_used_data":14540,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557332,"statfs":{"total":1151940427776,"available":1151546707968,"internally_reserved":0,"allocated":14888960,"data_stored":8279528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":55,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006818"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.612040+0000","last_change":"2024-05-14T15:16:08.799448+0000","last_active":"2024-05-14T15:19:11.612040+0000","last_peered":"2024-05-14T15:19:11.612040+0000","last_clean":"2024-05-14T15:19:11.612040+0000","last_became_active":"2024-05-14T15:16:08.799025+0000","last_became_peered":"2024-05-14T15:16:08.799025+0000","last_unstale":"2024-05-14T15:19:11.612040+0000","last_undegraded":"2024-05-14T15:19:11.612040+0000","last_fullsized":"2024-05-14T15:19:11.612040+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:25:56.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.600992+0000","last_change":"2024-05-14T15:16:08.796943+0000","last_active":"2024-05-14T15:19:11.600992+0000","last_peered":"2024-05-14T15:19:11.600992+0000","last_clean":"2024-05-14T15:19:11.600992+0000","last_became_active":"2024-05-14T15:16:08.796044+0000","last_became_peered":"2024-05-14T15:16:08.796044+0000","last_unstale":"2024-05-14T15:19:11.600992+0000","last_undegraded":"2024-05-14T15:19:11.600992+0000","last_fullsized":"2024-05-14T15:19:11.600992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:26:22.103727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.608891+0000","last_change":"2024-05-14T15:16:08.794020+0000","last_active":"2024-05-14T15:19:11.608891+0000","last_peered":"2024-05-14T15:19:11.608891+0000","last_clean":"2024-05-14T15:19:11.608891+0000","last_became_active":"2024-05-14T15:16:08.793677+0000","last_became_peered":"2024-05-14T15:16:08.793677+0000","last_unstale":"2024-05-14T15:19:11.608891+0000","last_undegraded":"2024-05-14T15:19:11.608891+0000","last_fullsized":"2024-05-14T15:19:11.608891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.615815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.597979+0000","last_change":"2024-05-14T15:16:08.787482+0000","last_active":"2024-05-14T15:19:11.597979+0000","last_peered":"2024-05-14T15:19:11.597979+0000","last_clean":"2024-05-14T15:19:11.597979+0000","last_became_active":"2024-05-14T15:16:08.787087+0000","last_became_peered":"2024-05-14T15:16:08.787087+0000","last_unstale":"2024-05-14T15:19:11.597979+0000","last_undegraded":"2024-05-14T15:19:11.597979+0000","last_fullsized":"2024-05-14T15:19:11.597979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:18:51.433751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.583953+0000","last_change":"2024-05-14T15:16:08.785982+0000","last_active":"2024-05-14T15:19:11.583953+0000","last_peered":"2024-05-14T15:19:11.583953+0000","last_clean":"2024-05-14T15:19:11.583953+0000","last_became_active":"2024-05-14T15:16:08.784980+0000","last_became_peered":"2024-05-14T15:16:08.784980+0000","last_unstale":"2024-05-14T15:19:11.583953+0000","last_undegraded":"2024-05-14T15:19:11.583953+0000","last_fullsized":"2024-05-14T15:19:11.583953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:07:50.390637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.586283+0000","last_change":"2024-05-14T15:16:08.784622+0000","last_active":"2024-05-14T15:19:11.586283+0000","last_peered":"2024-05-14T15:19:11.586283+0000","last_clean":"2024-05-14T15:19:11.586283+0000","last_became_active":"2024-05-14T15:16:08.784206+0000","last_became_peered":"2024-05-14T15:16:08.784206+0000","last_unstale":"2024-05-14T15:19:11.586283+0000","last_undegraded":"2024-05-14T15:19:11.586283+0000","last_fullsized":"2024-05-14T15:19:11.586283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:40:56.578935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.584759+0000","last_change":"2024-05-14T15:16:08.786381+0000","last_active":"2024-05-14T15:19:11.584759+0000","last_peered":"2024-05-14T15:19:11.584759+0000","last_clean":"2024-05-14T15:19:11.584759+0000","last_became_active":"2024-05-14T15:16:08.781231+0000","last_became_peered":"2024-05-14T15:16:08.781231+0000","last_unstale":"2024-05-14T15:19:11.584759+0000","last_undegraded":"2024-05-14T15:19:11.584759+0000","last_fullsized":"2024-05-14T15:19:11.584759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:51:16.961187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.594532+0000","last_change":"2024-05-14T15:17:43.850244+0000","last_active":"2024-05-14T15:19:11.594532+0000","last_peered":"2024-05-14T15:19:11.594532+0000","last_clean":"2024-05-14T15:19:11.594532+0000","last_became_active":"2024-05-14T15:17:43.849671+0000","last_became_peered":"2024-05-14T15:17:43.849671+0000","last_unstale":"2024-05-14T15:19:11.594532+0000","last_undegraded":"2024-05-14T15:19:11.594532+0000","last_fullsized":"2024-05-14T15:19:11.594532+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:21:05.537250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,10],"acting":[3,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.603851+0000","last_change":"2024-05-14T15:16:08.785644+0000","last_active":"2024-05-14T15:19:11.603851+0000","last_peered":"2024-05-14T15:19:11.603851+0000","last_clean":"2024-05-14T15:19:11.603851+0000","last_became_active":"2024-05-14T15:16:08.785224+0000","last_became_peered":"2024-05-14T15:16:08.785224+0000","last_unstale":"2024-05-14T15:19:11.603851+0000","last_undegraded":"2024-05-14T15:19:11.603851+0000","last_fullsized":"2024-05-14T15:19:11.603851+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:05:10.868610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.598127+0000","last_change":"2024-05-14T15:16:08.784425+0000","last_active":"2024-05-14T15:19:11.598127+0000","last_peered":"2024-05-14T15:19:11.598127+0000","last_clean":"2024-05-14T15:19:11.598127+0000","last_became_active":"2024-05-14T15:16:08.782889+0000","last_became_peered":"2024-05-14T15:16:08.782889+0000","last_unstale":"2024-05-14T15:19:11.598127+0000","last_undegraded":"2024-05-14T15:19:11.598127+0000","last_fullsized":"2024-05-14T15:19:11.598127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:40:11.043101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.608056+0000","last_change":"2024-05-14T15:16:08.782675+0000","last_active":"2024-05-14T15:19:11.608056+0000","last_peered":"2024-05-14T15:19:11.608056+0000","last_clean":"2024-05-14T15:19:11.608056+0000","last_became_active":"2024-05-14T15:16:08.781994+0000","last_became_peered":"2024-05-14T15:16:08.781994+0000","last_unstale":"2024-05-14T15:19:11.608056+0000","last_undegraded":"2024-05-14T15:19:11.608056+0000","last_fullsized":"2024-05-14T15:19:11.608056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:00:59.625493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.596001+0000","last_change":"2024-05-14T15:16:08.785655+0000","last_active":"2024-05-14T15:19:11.596001+0000","last_peered":"2024-05-14T15:19:11.596001+0000","last_clean":"2024-05-14T15:19:11.596001+0000","last_became_active":"2024-05-14T15:16:08.785273+0000","last_became_peered":"2024-05-14T15:16:08.785273+0000","last_unstale":"2024-05-14T15:19:11.596001+0000","last_undegraded":"2024-05-14T15:19:11.596001+0000","last_fullsized":"2024-05-14T15:19:11.596001+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:11:51.971909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.599991+0000","last_change":"2024-05-14T15:16:08.775558+0000","last_active":"2024-05-14T15:19:11.599991+0000","last_peered":"2024-05-14T15:19:11.599991+0000","last_clean":"2024-05-14T15:19:11.599991+0000","last_became_active":"2024-05-14T15:16:08.773465+0000","last_became_peered":"2024-05-14T15:16:08.773465+0000","last_unstale":"2024-05-14T15:19:11.599991+0000","last_undegraded":"2024-05-14T15:19:11.599991+0000","last_fullsized":"2024-05-14T15:19:11.599991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:16:17.151374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.594007+0000","last_change":"2024-05-14T15:16:08.786160+0000","last_active":"2024-05-14T15:19:11.594007+0000","last_peered":"2024-05-14T15:19:11.594007+0000","last_clean":"2024-05-14T15:19:11.594007+0000","last_became_active":"2024-05-14T15:16:08.781257+0000","last_became_peered":"2024-05-14T15:16:08.781257+0000","last_unstale":"2024-05-14T15:19:11.594007+0000","last_undegraded":"2024-05-14T15:19:11.594007+0000","last_fullsized":"2024-05-14T15:19:11.594007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:13:03.974692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.594416+0000","last_change":"2024-05-14T15:16:43.014673+0000","last_active":"2024-05-14T15:19:11.594416+0000","last_peered":"2024-05-14T15:19:11.594416+0000","last_clean":"2024-05-14T15:19:11.594416+0000","last_became_active":"2024-05-14T15:16:43.013718+0000","last_became_peered":"2024-05-14T15:16:43.013718+0000","last_unstale":"2024-05-14T15:19:11.594416+0000","last_undegraded":"2024-05-14T15:19:11.594416+0000","last_fullsized":"2024-05-14T15:19:11.594416+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:08:42.885151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.601114+0000","last_change":"2024-05-14T15:16:08.784437+0000","last_active":"2024-05-14T15:19:11.601114+0000","last_peered":"2024-05-14T15:19:11.601114+0000","last_clean":"2024-05-14T15:19:11.601114+0000","last_became_active":"2024-05-14T15:16:08.784030+0000","last_became_peered":"2024-05-14T15:16:08.784030+0000","last_unstale":"2024-05-14T15:19:11.601114+0000","last_undegraded":"2024-05-14T15:19:11.601114+0000","last_fullsized":"2024-05-14T15:19:11.601114+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:57:43.025679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.612197+0000","last_change":"2024-05-14T15:16:08.798419+0000","last_active":"2024-05-14T15:19:11.612197+0000","last_peered":"2024-05-14T15:19:11.612197+0000","last_clean":"2024-05-14T15:19:11.612197+0000","last_became_active":"2024-05-14T15:16:08.798066+0000","last_became_peered":"2024-05-14T15:16:08.798066+0000","last_unstale":"2024-05-14T15:19:11.612197+0000","last_undegraded":"2024-05-14T15:19:11.612197+0000","last_fullsized":"2024-05-14T15:19:11.612197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:55:29.921745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.609796+0000","last_change":"2024-05-14T15:16:08.780638+0000","last_active":"2024-05-14T15:19:11.609796+0000","last_peered":"2024-05-14T15:19:11.609796+0000","last_clean":"2024-05-14T15:19:11.609796+0000","last_became_active":"2024-05-14T15:16:08.778675+0000","last_became_peered":"2024-05-14T15:16:08.778675+0000","last_unstale":"2024-05-14T15:19:11.609796+0000","last_undegraded":"2024-05-14T15:19:11.609796+0000","last_fullsized":"2024-05-14T15:19:11.609796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:29.780036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.594863+0000","last_change":"2024-05-14T15:16:08.791729+0000","last_active":"2024-05-14T15:19:11.594863+0000","last_peered":"2024-05-14T15:19:11.594863+0000","last_clean":"2024-05-14T15:19:11.594863+0000","last_became_active":"2024-05-14T15:16:08.791367+0000","last_became_peered":"2024-05-14T15:16:08.791367+0000","last_unstale":"2024-05-14T15:19:11.594863+0000","last_undegraded":"2024-05-14T15:19:11.594863+0000","last_fullsized":"2024-05-14T15:19:11.594863+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:03:00.148744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730911+0000","last_change":"2024-05-14T15:16:22.909315+0000","last_active":"2024-05-14T15:17:43.730911+0000","last_peered":"2024-05-14T15:17:43.730911+0000","last_clean":"2024-05-14T15:17:43.730911+0000","last_became_active":"2024-05-14T15:16:22.908846+0000","last_became_peered":"2024-05-14T15:16:22.908846+0000","last_unstale":"2024-05-14T15:17:43.730911+0000","last_undegraded":"2024-05-14T15:17:43.730911+0000","last_fullsized":"2024-05-14T15:17:43.730911+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:20:50.338711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'14","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:37.722063+0000","last_change":"2024-05-14T15:16:03.729599+0000","last_active":"2024-05-14T15:19:37.722063+0000","last_peered":"2024-05-14T15:19:37.722063+0000","last_clean":"2024-05-14T15:19:37.722063+0000","last_became_active":"2024-05-14T15:16:03.728659+0000","last_became_peered":"2024-05-14T15:16:03.728659+0000","last_unstale":"2024-05-14T15:19:37.722063+0000","last_undegraded":"2024-05-14T15:19:37.722063+0000","last_fullsized":"2024-05-14T15:19:37.722063+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:54:18.989059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.593990+0000","last_change":"2024-05-14T15:16:08.790296+0000","last_active":"2024-05-14T15:19:11.593990+0000","last_peered":"2024-05-14T15:19:11.593990+0000","last_clean":"2024-05-14T15:19:11.593990+0000","last_became_active":"2024-05-14T15:16:08.789899+0000","last_became_peered":"2024-05-14T15:16:08.789899+0000","last_unstale":"2024-05-14T15:19:11.593990+0000","last_undegraded":"2024-05-14T15:19:11.593990+0000","last_fullsized":"2024-05-14T15:19:11.593990+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:23:15.626580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.757692+0000","last_change":"2024-05-14T15:16:22.904857+0000","last_active":"2024-05-14T15:17:43.757692+0000","last_peered":"2024-05-14T15:17:43.757692+0000","last_clean":"2024-05-14T15:17:43.757692+0000","last_became_active":"2024-05-14T15:16:22.903747+0000","last_became_peered":"2024-05-14T15:16:22.903747+0000","last_unstale":"2024-05-14T15:17:43.757692+0000","last_undegraded":"2024-05-14T15:17:43.757692+0000","last_fullsized":"2024-05-14T15:17:43.757692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:58:27.937637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.737501+0000","last_change":"2024-05-14T15:16:03.840248+0000","last_active":"2024-05-14T15:17:43.737501+0000","last_peered":"2024-05-14T15:17:43.737501+0000","last_clean":"2024-05-14T15:17:43.737501+0000","last_became_active":"2024-05-14T15:16:03.839731+0000","last_became_peered":"2024-05-14T15:16:03.839731+0000","last_unstale":"2024-05-14T15:17:43.737501+0000","last_undegraded":"2024-05-14T15:17:43.737501+0000","last_fullsized":"2024-05-14T15:17:43.737501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:31:25.981757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.609860+0000","last_change":"2024-05-14T15:16:08.791233+0000","last_active":"2024-05-14T15:19:11.609860+0000","last_peered":"2024-05-14T15:19:11.609860+0000","last_clean":"2024-05-14T15:19:11.609860+0000","last_became_active":"2024-05-14T15:16:08.790376+0000","last_became_peered":"2024-05-14T15:16:08.790376+0000","last_unstale":"2024-05-14T15:19:11.609860+0000","last_undegraded":"2024-05-14T15:19:11.609860+0000","last_fullsized":"2024-05-14T15:19:11.609860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:35.203663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.758244+0000","last_change":"2024-05-14T15:16:22.906435+0000","last_active":"2024-05-14T15:17:43.758244+0000","last_peered":"2024-05-14T15:17:43.758244+0000","last_clean":"2024-05-14T15:17:43.758244+0000","last_became_active":"2024-05-14T15:16:22.905558+0000","last_became_peered":"2024-05-14T15:16:22.905558+0000","last_unstale":"2024-05-14T15:17:43.758244+0000","last_undegraded":"2024-05-14T15:17:43.758244+0000","last_fullsized":"2024-05-14T15:17:43.758244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:43:15.748904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.853623+0000","last_change":"2024-05-14T15:16:43.026454+0000","last_active":"2024-05-14T15:17:43.853623+0000","last_peered":"2024-05-14T15:17:43.853623+0000","last_clean":"2024-05-14T15:17:43.853623+0000","last_became_active":"2024-05-14T15:16:43.019742+0000","last_became_peered":"2024-05-14T15:16:43.019742+0000","last_unstale":"2024-05-14T15:17:43.853623+0000","last_undegraded":"2024-05-14T15:17:43.853623+0000","last_fullsized":"2024-05-14T15:17:43.853623+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:38:38.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.604395+0000","last_change":"2024-05-14T15:16:08.774669+0000","last_active":"2024-05-14T15:19:11.604395+0000","last_peered":"2024-05-14T15:19:11.604395+0000","last_clean":"2024-05-14T15:19:11.604395+0000","last_became_active":"2024-05-14T15:16:08.773996+0000","last_became_peered":"2024-05-14T15:16:08.773996+0000","last_unstale":"2024-05-14T15:19:11.604395+0000","last_undegraded":"2024-05-14T15:19:11.604395+0000","last_fullsized":"2024-05-14T15:19:11.604395+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:21:58.199462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.757941+0000","last_change":"2024-05-14T15:16:43.065743+0000","last_active":"2024-05-14T15:17:43.757941+0000","last_peered":"2024-05-14T15:17:43.757941+0000","last_clean":"2024-05-14T15:17:43.757941+0000","last_became_active":"2024-05-14T15:16:43.064426+0000","last_became_peered":"2024-05-14T15:16:43.064426+0000","last_unstale":"2024-05-14T15:17:43.757941+0000","last_undegraded":"2024-05-14T15:17:43.757941+0000","last_fullsized":"2024-05-14T15:17:43.757941+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:15:44.230694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852597+0000","last_change":"2024-05-14T15:16:03.732142+0000","last_active":"2024-05-14T15:17:43.852597+0000","last_peered":"2024-05-14T15:17:43.852597+0000","last_clean":"2024-05-14T15:17:43.852597+0000","last_became_active":"2024-05-14T15:16:03.731590+0000","last_became_peered":"2024-05-14T15:16:03.731590+0000","last_unstale":"2024-05-14T15:17:43.852597+0000","last_undegraded":"2024-05-14T15:17:43.852597+0000","last_fullsized":"2024-05-14T15:17:43.852597+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:05:23.760541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.607032+0000","last_change":"2024-05-14T15:16:08.780895+0000","last_active":"2024-05-14T15:19:11.607032+0000","last_peered":"2024-05-14T15:19:11.607032+0000","last_clean":"2024-05-14T15:19:11.607032+0000","last_became_active":"2024-05-14T15:16:08.780472+0000","last_became_peered":"2024-05-14T15:16:08.780472+0000","last_unstale":"2024-05-14T15:19:11.607032+0000","last_undegraded":"2024-05-14T15:19:11.607032+0000","last_fullsized":"2024-05-14T15:19:11.607032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:49.508043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730972+0000","last_change":"2024-05-14T15:16:22.915997+0000","last_active":"2024-05-14T15:17:43.730972+0000","last_peered":"2024-05-14T15:17:43.730972+0000","last_clean":"2024-05-14T15:17:43.730972+0000","last_became_active":"2024-05-14T15:16:22.915466+0000","last_became_peered":"2024-05-14T15:16:22.915466+0000","last_unstale":"2024-05-14T15:17:43.730972+0000","last_undegraded":"2024-05-14T15:17:43.730972+0000","last_fullsized":"2024-05-14T15:17:43.730972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:50:39.748860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":173,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:33.741026+0000","last_change":"2024-05-14T15:16:03.733796+0000","last_active":"2024-05-14T15:19:33.741026+0000","last_peered":"2024-05-14T15:19:33.741026+0000","last_clean":"2024-05-14T15:19:33.741026+0000","last_became_active":"2024-05-14T15:16:03.732467+0000","last_became_peered":"2024-05-14T15:16:03.732467+0000","last_unstale":"2024-05-14T15:19:33.741026+0000","last_undegraded":"2024-05-14T15:19:33.741026+0000","last_fullsized":"2024-05-14T15:19:33.741026+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:28.388120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":121,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.594260+0000","last_change":"2024-05-14T15:16:08.793287+0000","last_active":"2024-05-14T15:19:11.594260+0000","last_peered":"2024-05-14T15:19:11.594260+0000","last_clean":"2024-05-14T15:19:11.594260+0000","last_became_active":"2024-05-14T15:16:08.791173+0000","last_became_peered":"2024-05-14T15:16:08.791173+0000","last_unstale":"2024-05-14T15:19:11.594260+0000","last_undegraded":"2024-05-14T15:19:11.594260+0000","last_fullsized":"2024-05-14T15:19:11.594260+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:24:49.644251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730675+0000","last_change":"2024-05-14T15:16:22.914734+0000","last_active":"2024-05-14T15:17:43.730675+0000","last_peered":"2024-05-14T15:17:43.730675+0000","last_clean":"2024-05-14T15:17:43.730675+0000","last_became_active":"2024-05-14T15:16:22.914267+0000","last_became_peered":"2024-05-14T15:16:22.914267+0000","last_unstale":"2024-05-14T15:17:43.730675+0000","last_undegraded":"2024-05-14T15:17:43.730675+0000","last_fullsized":"2024-05-14T15:17:43.730675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:04:50.809564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.847646+0000","last_change":"2024-05-14T15:16:03.729217+0000","last_active":"2024-05-14T15:17:43.847646+0000","last_peered":"2024-05-14T15:17:43.847646+0000","last_clean":"2024-05-14T15:17:43.847646+0000","last_became_active":"2024-05-14T15:16:03.727453+0000","last_became_peered":"2024-05-14T15:16:03.727453+0000","last_unstale":"2024-05-14T15:17:43.847646+0000","last_undegraded":"2024-05-14T15:17:43.847646+0000","last_fullsized":"2024-05-14T15:17:43.847646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:40:27.820618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.590311+0000","last_change":"2024-05-14T15:16:08.783861+0000","last_active":"2024-05-14T15:19:11.590311+0000","last_peered":"2024-05-14T15:19:11.590311+0000","last_clean":"2024-05-14T15:19:11.590311+0000","last_became_active":"2024-05-14T15:16:08.782986+0000","last_became_peered":"2024-05-14T15:16:08.782986+0000","last_unstale":"2024-05-14T15:19:11.590311+0000","last_undegraded":"2024-05-14T15:19:11.590311+0000","last_fullsized":"2024-05-14T15:19:11.590311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:52.453137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.854824+0000","last_change":"2024-05-14T15:16:22.912295+0000","last_active":"2024-05-14T15:17:43.854824+0000","last_peered":"2024-05-14T15:17:43.854824+0000","last_clean":"2024-05-14T15:17:43.854824+0000","last_became_active":"2024-05-14T15:16:22.911779+0000","last_became_peered":"2024-05-14T15:16:22.911779+0000","last_unstale":"2024-05-14T15:17:43.854824+0000","last_undegraded":"2024-05-14T15:17:43.854824+0000","last_fullsized":"2024-05-14T15:17:43.854824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:47:45.153619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845464+0000","last_change":"2024-05-14T15:16:03.729590+0000","last_active":"2024-05-14T15:17:43.845464+0000","last_peered":"2024-05-14T15:17:43.845464+0000","last_clean":"2024-05-14T15:17:43.845464+0000","last_became_active":"2024-05-14T15:16:03.727790+0000","last_became_peered":"2024-05-14T15:16:03.727790+0000","last_unstale":"2024-05-14T15:17:43.845464+0000","last_undegraded":"2024-05-14T15:17:43.845464+0000","last_fullsized":"2024-05-14T15:17:43.845464+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:13:31.960505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.590402+0000","last_change":"2024-05-14T15:16:08.789872+0000","last_active":"2024-05-14T15:19:11.590402+0000","last_peered":"2024-05-14T15:19:11.590402+0000","last_clean":"2024-05-14T15:19:11.590402+0000","last_became_active":"2024-05-14T15:16:08.786817+0000","last_became_peered":"2024-05-14T15:16:08.786817+0000","last_unstale":"2024-05-14T15:19:11.590402+0000","last_undegraded":"2024-05-14T15:19:11.590402+0000","last_fullsized":"2024-05-14T15:19:11.590402+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:09:41.042473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.844697+0000","last_change":"2024-05-14T15:16:22.903302+0000","last_active":"2024-05-14T15:17:43.844697+0000","last_peered":"2024-05-14T15:17:43.844697+0000","last_clean":"2024-05-14T15:17:43.844697+0000","last_became_active":"2024-05-14T15:16:22.902830+0000","last_became_peered":"2024-05-14T15:16:22.902830+0000","last_unstale":"2024-05-14T15:17:43.844697+0000","last_undegraded":"2024-05-14T15:17:43.844697+0000","last_fullsized":"2024-05-14T15:17:43.844697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:18:57.467319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849264+0000","last_change":"2024-05-14T15:16:03.738372+0000","last_active":"2024-05-14T15:17:43.849264+0000","last_peered":"2024-05-14T15:17:43.849264+0000","last_clean":"2024-05-14T15:17:43.849264+0000","last_became_active":"2024-05-14T15:16:03.737815+0000","last_became_peered":"2024-05-14T15:16:03.737815+0000","last_unstale":"2024-05-14T15:17:43.849264+0000","last_undegraded":"2024-05-14T15:17:43.849264+0000","last_fullsized":"2024-05-14T15:17:43.849264+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:19:19.702318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.594430+0000","last_change":"2024-05-14T15:16:08.781979+0000","last_active":"2024-05-14T15:19:11.594430+0000","last_peered":"2024-05-14T15:19:11.594430+0000","last_clean":"2024-05-14T15:19:11.594430+0000","last_became_active":"2024-05-14T15:16:08.777257+0000","last_became_peered":"2024-05-14T15:16:08.777257+0000","last_unstale":"2024-05-14T15:19:11.594430+0000","last_undegraded":"2024-05-14T15:19:11.594430+0000","last_fullsized":"2024-05-14T15:19:11.594430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:31.154921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.735719+0000","last_change":"2024-05-14T15:16:22.901107+0000","last_active":"2024-05-14T15:17:43.735719+0000","last_peered":"2024-05-14T15:17:43.735719+0000","last_clean":"2024-05-14T15:17:43.735719+0000","last_became_active":"2024-05-14T15:16:22.900578+0000","last_became_peered":"2024-05-14T15:16:22.900578+0000","last_unstale":"2024-05-14T15:17:43.735719+0000","last_undegraded":"2024-05-14T15:17:43.735719+0000","last_fullsized":"2024-05-14T15:17:43.735719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:11:23.019455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'6","reported_seq":287,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:35.746917+0000","last_change":"2024-05-14T15:16:03.730145+0000","last_active":"2024-05-14T15:19:35.746917+0000","last_peered":"2024-05-14T15:19:35.746917+0000","last_clean":"2024-05-14T15:19:35.746917+0000","last_became_active":"2024-05-14T15:16:03.728119+0000","last_became_peered":"2024-05-14T15:16:03.728119+0000","last_unstale":"2024-05-14T15:19:35.746917+0000","last_undegraded":"2024-05-14T15:19:35.746917+0000","last_fullsized":"2024-05-14T15:19:35.746917+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:19:57.596282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":236,"num_read_kb":236,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.607130+0000","last_change":"2024-05-14T15:16:08.781834+0000","last_active":"2024-05-14T15:19:11.607130+0000","last_peered":"2024-05-14T15:19:11.607130+0000","last_clean":"2024-05-14T15:19:11.607130+0000","last_became_active":"2024-05-14T15:16:08.781451+0000","last_became_peered":"2024-05-14T15:16:08.781451+0000","last_unstale":"2024-05-14T15:19:11.607130+0000","last_undegraded":"2024-05-14T15:19:11.607130+0000","last_fullsized":"2024-05-14T15:19:11.607130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:17:33.147475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.725340+0000","last_change":"2024-05-14T15:16:22.910711+0000","last_active":"2024-05-14T15:17:43.725340+0000","last_peered":"2024-05-14T15:17:43.725340+0000","last_clean":"2024-05-14T15:17:43.725340+0000","last_became_active":"2024-05-14T15:16:22.910076+0000","last_became_peered":"2024-05-14T15:16:22.910076+0000","last_unstale":"2024-05-14T15:17:43.725340+0000","last_undegraded":"2024-05-14T15:17:43.725340+0000","last_fullsized":"2024-05-14T15:17:43.725340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:11:05.867547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.739486+0000","last_change":"2024-05-14T15:16:03.736682+0000","last_active":"2024-05-14T15:17:43.739486+0000","last_peered":"2024-05-14T15:17:43.739486+0000","last_clean":"2024-05-14T15:17:43.739486+0000","last_became_active":"2024-05-14T15:16:03.733676+0000","last_became_peered":"2024-05-14T15:16:03.733676+0000","last_unstale":"2024-05-14T15:17:43.739486+0000","last_undegraded":"2024-05-14T15:17:43.739486+0000","last_fullsized":"2024-05-14T15:17:43.739486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:12:12.814817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.609442+0000","last_change":"2024-05-14T15:16:08.797256+0000","last_active":"2024-05-14T15:19:11.609442+0000","last_peered":"2024-05-14T15:19:11.609442+0000","last_clean":"2024-05-14T15:19:11.609442+0000","last_became_active":"2024-05-14T15:16:08.796675+0000","last_became_peered":"2024-05-14T15:16:08.796675+0000","last_unstale":"2024-05-14T15:19:11.609442+0000","last_undegraded":"2024-05-14T15:19:11.609442+0000","last_fullsized":"2024-05-14T15:19:11.609442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:08.026962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.758761+0000","last_change":"2024-05-14T15:16:22.914775+0000","last_active":"2024-05-14T15:17:43.758761+0000","last_peered":"2024-05-14T15:17:43.758761+0000","last_clean":"2024-05-14T15:17:43.758761+0000","last_became_active":"2024-05-14T15:16:22.912853+0000","last_became_peered":"2024-05-14T15:16:22.912853+0000","last_unstale":"2024-05-14T15:17:43.758761+0000","last_undegraded":"2024-05-14T15:17:43.758761+0000","last_fullsized":"2024-05-14T15:17:43.758761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:01:11.652074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850088+0000","last_change":"2024-05-14T15:16:03.845365+0000","last_active":"2024-05-14T15:17:43.850088+0000","last_peered":"2024-05-14T15:17:43.850088+0000","last_clean":"2024-05-14T15:17:43.850088+0000","last_became_active":"2024-05-14T15:16:03.842557+0000","last_became_peered":"2024-05-14T15:16:03.842557+0000","last_unstale":"2024-05-14T15:17:43.850088+0000","last_undegraded":"2024-05-14T15:17:43.850088+0000","last_fullsized":"2024-05-14T15:17:43.850088+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:26:21.515074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.595144+0000","last_change":"2024-05-14T15:17:43.855838+0000","last_active":"2024-05-14T15:19:11.595144+0000","last_peered":"2024-05-14T15:19:11.595144+0000","last_clean":"2024-05-14T15:19:11.595144+0000","last_became_active":"2024-05-14T15:17:43.855462+0000","last_became_peered":"2024-05-14T15:17:43.855462+0000","last_unstale":"2024-05-14T15:19:11.595144+0000","last_undegraded":"2024-05-14T15:19:11.595144+0000","last_fullsized":"2024-05-14T15:19:11.595144+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:56:06.442987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,4],"acting":[9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.725983+0000","last_change":"2024-05-14T15:16:22.905266+0000","last_active":"2024-05-14T15:17:43.725983+0000","last_peered":"2024-05-14T15:17:43.725983+0000","last_clean":"2024-05-14T15:17:43.725983+0000","last_became_active":"2024-05-14T15:16:22.903397+0000","last_became_peered":"2024-05-14T15:16:22.903397+0000","last_unstale":"2024-05-14T15:17:43.725983+0000","last_undegraded":"2024-05-14T15:17:43.725983+0000","last_fullsized":"2024-05-14T15:17:43.725983+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:48:37.616028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'39","reported_seq":331,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:35.747057+0000","last_change":"2024-05-14T15:16:03.735261+0000","last_active":"2024-05-14T15:19:35.747057+0000","last_peered":"2024-05-14T15:19:35.747057+0000","last_clean":"2024-05-14T15:19:35.747057+0000","last_became_active":"2024-05-14T15:16:03.732725+0000","last_became_peered":"2024-05-14T15:16:03.732725+0000","last_unstale":"2024-05-14T15:19:35.747057+0000","last_undegraded":"2024-05-14T15:19:35.747057+0000","last_fullsized":"2024-05-14T15:19:35.747057+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:44:51.777221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66730,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":247,"num_read_kb":188,"num_write":41,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.595786+0000","last_change":"2024-05-14T15:16:08.783758+0000","last_active":"2024-05-14T15:19:11.595786+0000","last_peered":"2024-05-14T15:19:11.595786+0000","last_clean":"2024-05-14T15:19:11.595786+0000","last_became_active":"2024-05-14T15:16:08.782465+0000","last_became_peered":"2024-05-14T15:16:08.782465+0000","last_unstale":"2024-05-14T15:19:11.595786+0000","last_undegraded":"2024-05-14T15:19:11.595786+0000","last_fullsized":"2024-05-14T15:19:11.595786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:37:36.921823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.851399+0000","last_change":"2024-05-14T15:16:22.899606+0000","last_active":"2024-05-14T15:17:43.851399+0000","last_peered":"2024-05-14T15:17:43.851399+0000","last_clean":"2024-05-14T15:17:43.851399+0000","last_became_active":"2024-05-14T15:16:22.898810+0000","last_became_peered":"2024-05-14T15:16:22.898810+0000","last_unstale":"2024-05-14T15:17:43.851399+0000","last_undegraded":"2024-05-14T15:17:43.851399+0000","last_fullsized":"2024-05-14T15:17:43.851399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:49:07.068713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":56,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730491+0000","last_change":"2024-05-14T15:16:03.728561+0000","last_active":"2024-05-14T15:17:43.730491+0000","last_peered":"2024-05-14T15:17:43.730491+0000","last_clean":"2024-05-14T15:17:43.730491+0000","last_became_active":"2024-05-14T15:16:03.727273+0000","last_became_peered":"2024-05-14T15:16:03.727273+0000","last_unstale":"2024-05-14T15:17:43.730491+0000","last_undegraded":"2024-05-14T15:17:43.730491+0000","last_fullsized":"2024-05-14T15:17:43.730491+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:06.487549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.599993+0000","last_change":"2024-05-14T15:16:08.788199+0000","last_active":"2024-05-14T15:19:11.599993+0000","last_peered":"2024-05-14T15:19:11.599993+0000","last_clean":"2024-05-14T15:19:11.599993+0000","last_became_active":"2024-05-14T15:16:08.786477+0000","last_became_peered":"2024-05-14T15:16:08.786477+0000","last_unstale":"2024-05-14T15:19:11.599993+0000","last_undegraded":"2024-05-14T15:19:11.599993+0000","last_fullsized":"2024-05-14T15:19:11.599993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:40:33.441154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850875+0000","last_change":"2024-05-14T15:16:22.911265+0000","last_active":"2024-05-14T15:17:43.850875+0000","last_peered":"2024-05-14T15:17:43.850875+0000","last_clean":"2024-05-14T15:17:43.850875+0000","last_became_active":"2024-05-14T15:16:22.910297+0000","last_became_peered":"2024-05-14T15:16:22.910297+0000","last_unstale":"2024-05-14T15:17:43.850875+0000","last_undegraded":"2024-05-14T15:17:43.850875+0000","last_fullsized":"2024-05-14T15:17:43.850875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:43:37.894409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.854164+0000","last_change":"2024-05-14T15:16:03.735122+0000","last_active":"2024-05-14T15:17:43.854164+0000","last_peered":"2024-05-14T15:17:43.854164+0000","last_clean":"2024-05-14T15:17:43.854164+0000","last_became_active":"2024-05-14T15:16:03.734746+0000","last_became_peered":"2024-05-14T15:16:03.734746+0000","last_unstale":"2024-05-14T15:17:43.854164+0000","last_undegraded":"2024-05-14T15:17:43.854164+0000","last_fullsized":"2024-05-14T15:17:43.854164+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:36:48.070577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.602725+0000","last_change":"2024-05-14T15:16:08.791427+0000","last_active":"2024-05-14T15:19:11.602725+0000","last_peered":"2024-05-14T15:19:11.602725+0000","last_clean":"2024-05-14T15:19:11.602725+0000","last_became_active":"2024-05-14T15:16:08.791070+0000","last_became_peered":"2024-05-14T15:16:08.791070+0000","last_unstale":"2024-05-14T15:19:11.602725+0000","last_undegraded":"2024-05-14T15:19:11.602725+0000","last_fullsized":"2024-05-14T15:19:11.602725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:15:13.153055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.726005+0000","last_change":"2024-05-14T15:16:22.896084+0000","last_active":"2024-05-14T15:17:43.726005+0000","last_peered":"2024-05-14T15:17:43.726005+0000","last_clean":"2024-05-14T15:17:43.726005+0000","last_became_active":"2024-05-14T15:16:22.894473+0000","last_became_peered":"2024-05-14T15:16:22.894473+0000","last_unstale":"2024-05-14T15:17:43.726005+0000","last_undegraded":"2024-05-14T15:17:43.726005+0000","last_fullsized":"2024-05-14T15:17:43.726005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:18:18.844423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'7","reported_seq":177,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:37.776741+0000","last_change":"2024-05-14T15:16:03.728070+0000","last_active":"2024-05-14T15:19:37.776741+0000","last_peered":"2024-05-14T15:19:37.776741+0000","last_clean":"2024-05-14T15:19:37.776741+0000","last_became_active":"2024-05-14T15:16:03.726155+0000","last_became_peered":"2024-05-14T15:16:03.726155+0000","last_unstale":"2024-05-14T15:19:37.776741+0000","last_undegraded":"2024-05-14T15:19:37.776741+0000","last_fullsized":"2024-05-14T15:19:37.776741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:50:43.447812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.595987+0000","last_change":"2024-05-14T15:16:08.787281+0000","last_active":"2024-05-14T15:19:11.595987+0000","last_peered":"2024-05-14T15:19:11.595987+0000","last_clean":"2024-05-14T15:19:11.595987+0000","last_became_active":"2024-05-14T15:16:08.786910+0000","last_became_peered":"2024-05-14T15:16:08.786910+0000","last_unstale":"2024-05-14T15:19:11.595987+0000","last_undegraded":"2024-05-14T15:19:11.595987+0000","last_fullsized":"2024-05-14T15:19:11.595987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:03:35.421845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846304+0000","last_change":"2024-05-14T15:16:43.066135+0000","last_active":"2024-05-14T15:17:43.846304+0000","last_peered":"2024-05-14T15:17:43.846304+0000","last_clean":"2024-05-14T15:17:43.846304+0000","last_became_active":"2024-05-14T15:16:43.064558+0000","last_became_peered":"2024-05-14T15:16:43.064558+0000","last_unstale":"2024-05-14T15:17:43.846304+0000","last_undegraded":"2024-05-14T15:17:43.846304+0000","last_fullsized":"2024-05-14T15:17:43.846304+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:21:25.441639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":63,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850619+0000","last_change":"2024-05-14T15:16:03.841009+0000","last_active":"2024-05-14T15:17:43.850619+0000","last_peered":"2024-05-14T15:17:43.850619+0000","last_clean":"2024-05-14T15:17:43.850619+0000","last_became_active":"2024-05-14T15:16:03.839514+0000","last_became_peered":"2024-05-14T15:16:03.839514+0000","last_unstale":"2024-05-14T15:17:43.850619+0000","last_undegraded":"2024-05-14T15:17:43.850619+0000","last_fullsized":"2024-05-14T15:17:43.850619+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:34:55.588072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.598735+0000","last_change":"2024-05-14T15:16:08.774343+0000","last_active":"2024-05-14T15:19:11.598735+0000","last_peered":"2024-05-14T15:19:11.598735+0000","last_clean":"2024-05-14T15:19:11.598735+0000","last_became_active":"2024-05-14T15:16:08.773826+0000","last_became_peered":"2024-05-14T15:16:08.773826+0000","last_unstale":"2024-05-14T15:19:11.598735+0000","last_undegraded":"2024-05-14T15:19:11.598735+0000","last_fullsized":"2024-05-14T15:19:11.598735+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:30:51.648019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849827+0000","last_change":"2024-05-14T15:16:22.889838+0000","last_active":"2024-05-14T15:17:43.849827+0000","last_peered":"2024-05-14T15:17:43.849827+0000","last_clean":"2024-05-14T15:17:43.849827+0000","last_became_active":"2024-05-14T15:16:22.888604+0000","last_became_peered":"2024-05-14T15:16:22.888604+0000","last_unstale":"2024-05-14T15:17:43.849827+0000","last_undegraded":"2024-05-14T15:17:43.849827+0000","last_fullsized":"2024-05-14T15:17:43.849827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:26:53.176588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.853998+0000","last_change":"2024-05-14T15:16:03.731499+0000","last_active":"2024-05-14T15:17:43.853998+0000","last_peered":"2024-05-14T15:17:43.853998+0000","last_clean":"2024-05-14T15:17:43.853998+0000","last_became_active":"2024-05-14T15:16:03.729387+0000","last_became_peered":"2024-05-14T15:16:03.729387+0000","last_unstale":"2024-05-14T15:17:43.853998+0000","last_undegraded":"2024-05-14T15:17:43.853998+0000","last_fullsized":"2024-05-14T15:17:43.853998+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:52:24.287236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.595621+0000","last_change":"2024-05-14T15:16:08.787376+0000","last_active":"2024-05-14T15:19:11.595621+0000","last_peered":"2024-05-14T15:19:11.595621+0000","last_clean":"2024-05-14T15:19:11.595621+0000","last_became_active":"2024-05-14T15:16:08.786057+0000","last_became_peered":"2024-05-14T15:16:08.786057+0000","last_unstale":"2024-05-14T15:19:11.595621+0000","last_undegraded":"2024-05-14T15:19:11.595621+0000","last_fullsized":"2024-05-14T15:19:11.595621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:17:16.582656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852720+0000","last_change":"2024-05-14T15:16:23.049639+0000","last_active":"2024-05-14T15:17:43.852720+0000","last_peered":"2024-05-14T15:17:43.852720+0000","last_clean":"2024-05-14T15:17:43.852720+0000","last_became_active":"2024-05-14T15:16:23.047746+0000","last_became_peered":"2024-05-14T15:16:23.047746+0000","last_unstale":"2024-05-14T15:17:43.852720+0000","last_undegraded":"2024-05-14T15:17:43.852720+0000","last_fullsized":"2024-05-14T15:17:43.852720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:22:27.129466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.726894+0000","last_change":"2024-05-14T15:16:03.842156+0000","last_active":"2024-05-14T15:17:43.726894+0000","last_peered":"2024-05-14T15:17:43.726894+0000","last_clean":"2024-05-14T15:17:43.726894+0000","last_became_active":"2024-05-14T15:16:03.841626+0000","last_became_peered":"2024-05-14T15:16:03.841626+0000","last_unstale":"2024-05-14T15:17:43.726894+0000","last_undegraded":"2024-05-14T15:17:43.726894+0000","last_fullsized":"2024-05-14T15:17:43.726894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:40.955009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.584567+0000","last_change":"2024-05-14T15:16:08.780632+0000","last_active":"2024-05-14T15:19:11.584567+0000","last_peered":"2024-05-14T15:19:11.584567+0000","last_clean":"2024-05-14T15:19:11.584567+0000","last_became_active":"2024-05-14T15:16:08.779743+0000","last_became_peered":"2024-05-14T15:16:08.779743+0000","last_unstale":"2024-05-14T15:19:11.584567+0000","last_undegraded":"2024-05-14T15:19:11.584567+0000","last_fullsized":"2024-05-14T15:19:11.584567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:53:45.608716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846149+0000","last_change":"2024-05-14T15:16:22.894512+0000","last_active":"2024-05-14T15:17:43.846149+0000","last_peered":"2024-05-14T15:17:43.846149+0000","last_clean":"2024-05-14T15:17:43.846149+0000","last_became_active":"2024-05-14T15:16:22.893566+0000","last_became_peered":"2024-05-14T15:16:22.893566+0000","last_unstale":"2024-05-14T15:17:43.846149+0000","last_undegraded":"2024-05-14T15:17:43.846149+0000","last_fullsized":"2024-05-14T15:17:43.846149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:45:39.571364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'7","reported_seq":175,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:36.720284+0000","last_change":"2024-05-14T15:16:03.730782+0000","last_active":"2024-05-14T15:19:36.720284+0000","last_peered":"2024-05-14T15:19:36.720284+0000","last_clean":"2024-05-14T15:19:36.720284+0000","last_became_active":"2024-05-14T15:16:03.729703+0000","last_became_peered":"2024-05-14T15:16:03.729703+0000","last_unstale":"2024-05-14T15:19:36.720284+0000","last_undegraded":"2024-05-14T15:19:36.720284+0000","last_fullsized":"2024-05-14T15:19:36.720284+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:30:30.379450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":123,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.582829+0000","last_change":"2024-05-14T15:16:08.792362+0000","last_active":"2024-05-14T15:19:11.582829+0000","last_peered":"2024-05-14T15:19:11.582829+0000","last_clean":"2024-05-14T15:19:11.582829+0000","last_became_active":"2024-05-14T15:16:08.791836+0000","last_became_peered":"2024-05-14T15:16:08.791836+0000","last_unstale":"2024-05-14T15:19:11.582829+0000","last_undegraded":"2024-05-14T15:19:11.582829+0000","last_fullsized":"2024-05-14T15:19:11.582829+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:50:07.142474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846404+0000","last_change":"2024-05-14T15:16:23.048324+0000","last_active":"2024-05-14T15:17:43.846404+0000","last_peered":"2024-05-14T15:17:43.846404+0000","last_clean":"2024-05-14T15:17:43.846404+0000","last_became_active":"2024-05-14T15:16:23.047829+0000","last_became_peered":"2024-05-14T15:16:23.047829+0000","last_unstale":"2024-05-14T15:17:43.846404+0000","last_undegraded":"2024-05-14T15:17:43.846404+0000","last_fullsized":"2024-05-14T15:17:43.846404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:13.018847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.577164+0000","last_change":"2024-05-14T15:16:43.013252+0000","last_active":"2024-05-14T15:19:11.577164+0000","last_peered":"2024-05-14T15:19:11.577164+0000","last_clean":"2024-05-14T15:19:11.577164+0000","last_became_active":"2024-05-14T15:16:43.011962+0000","last_became_peered":"2024-05-14T15:16:43.011962+0000","last_unstale":"2024-05-14T15:19:11.577164+0000","last_undegraded":"2024-05-14T15:19:11.577164+0000","last_fullsized":"2024-05-14T15:19:11.577164+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:06.204259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'6","reported_seq":169,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:33.763047+0000","last_change":"2024-05-14T15:16:03.840983+0000","last_active":"2024-05-14T15:19:33.763047+0000","last_peered":"2024-05-14T15:19:33.763047+0000","last_clean":"2024-05-14T15:19:33.763047+0000","last_became_active":"2024-05-14T15:16:03.839117+0000","last_became_peered":"2024-05-14T15:16:03.839117+0000","last_unstale":"2024-05-14T15:19:33.763047+0000","last_undegraded":"2024-05-14T15:19:33.763047+0000","last_fullsized":"2024-05-14T15:19:33.763047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:57.163543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:50.585455+0000","last_change":"2024-05-14T15:16:22.914744+0000","last_active":"2024-05-14T15:17:50.585455+0000","last_peered":"2024-05-14T15:17:50.585455+0000","last_clean":"2024-05-14T15:17:50.585455+0000","last_became_active":"2024-05-14T15:16:22.913661+0000","last_became_peered":"2024-05-14T15:16:22.913661+0000","last_unstale":"2024-05-14T15:17:50.585455+0000","last_undegraded":"2024-05-14T15:17:50.585455+0000","last_fullsized":"2024-05-14T15:17:50.585455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:45.957828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.606963+0000","last_change":"2024-05-14T15:16:08.791872+0000","last_active":"2024-05-14T15:19:11.606963+0000","last_peered":"2024-05-14T15:19:11.606963+0000","last_clean":"2024-05-14T15:19:11.606963+0000","last_became_active":"2024-05-14T15:16:08.791229+0000","last_became_peered":"2024-05-14T15:16:08.791229+0000","last_unstale":"2024-05-14T15:19:11.606963+0000","last_undegraded":"2024-05-14T15:19:11.606963+0000","last_fullsized":"2024-05-14T15:19:11.606963+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:36:26.391077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.758292+0000","last_change":"2024-05-14T15:16:03.732872+0000","last_active":"2024-05-14T15:17:43.758292+0000","last_peered":"2024-05-14T15:17:43.758292+0000","last_clean":"2024-05-14T15:17:43.758292+0000","last_became_active":"2024-05-14T15:16:03.732188+0000","last_became_peered":"2024-05-14T15:16:03.732188+0000","last_unstale":"2024-05-14T15:17:43.758292+0000","last_undegraded":"2024-05-14T15:17:43.758292+0000","last_fullsized":"2024-05-14T15:17:43.758292+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:20:56.776521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.737696+0000","last_change":"2024-05-14T15:14:08.407259+0000","last_active":"2024-05-14T15:17:43.737696+0000","last_peered":"2024-05-14T15:17:43.737696+0000","last_clean":"2024-05-14T15:17:43.737696+0000","last_became_active":"2024-05-14T15:14:08.398012+0000","last_became_peered":"2024-05-14T15:14:08.398012+0000","last_unstale":"2024-05-14T15:17:43.737696+0000","last_undegraded":"2024-05-14T15:17:43.737696+0000","last_fullsized":"2024-05-14T15:17:43.737696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:09:04.015044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:09:04.015044+0000","last_clean_scrub_stamp":"2024-05-14T15:09:04.015044+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:37.256490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852327+0000","last_change":"2024-05-14T15:16:23.053989+0000","last_active":"2024-05-14T15:17:43.852327+0000","last_peered":"2024-05-14T15:17:43.852327+0000","last_clean":"2024-05-14T15:17:43.852327+0000","last_became_active":"2024-05-14T15:16:23.052585+0000","last_became_peered":"2024-05-14T15:16:23.052585+0000","last_unstale":"2024-05-14T15:17:43.852327+0000","last_undegraded":"2024-05-14T15:17:43.852327+0000","last_fullsized":"2024-05-14T15:17:43.852327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:30.104518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.581439+0000","last_change":"2024-05-14T15:16:08.775447+0000","last_active":"2024-05-14T15:19:11.581439+0000","last_peered":"2024-05-14T15:19:11.581439+0000","last_clean":"2024-05-14T15:19:11.581439+0000","last_became_active":"2024-05-14T15:16:08.775055+0000","last_became_peered":"2024-05-14T15:16:08.775055+0000","last_unstale":"2024-05-14T15:19:11.581439+0000","last_undegraded":"2024-05-14T15:19:11.581439+0000","last_fullsized":"2024-05-14T15:19:11.581439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:57:24.668939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.738150+0000","last_change":"2024-05-14T15:16:03.735221+0000","last_active":"2024-05-14T15:17:43.738150+0000","last_peered":"2024-05-14T15:17:43.738150+0000","last_clean":"2024-05-14T15:17:43.738150+0000","last_became_active":"2024-05-14T15:16:03.731910+0000","last_became_peered":"2024-05-14T15:16:03.731910+0000","last_unstale":"2024-05-14T15:17:43.738150+0000","last_undegraded":"2024-05-14T15:17:43.738150+0000","last_fullsized":"2024-05-14T15:17:43.738150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:57:18.030308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850483+0000","last_change":"2024-05-14T15:16:22.910564+0000","last_active":"2024-05-14T15:17:43.850483+0000","last_peered":"2024-05-14T15:17:43.850483+0000","last_clean":"2024-05-14T15:17:43.850483+0000","last_became_active":"2024-05-14T15:16:22.910003+0000","last_became_peered":"2024-05-14T15:16:22.910003+0000","last_unstale":"2024-05-14T15:17:43.850483+0000","last_undegraded":"2024-05-14T15:17:43.850483+0000","last_fullsized":"2024-05-14T15:17:43.850483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:47.895767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.854379+0000","last_change":"2024-05-14T15:16:03.844236+0000","last_active":"2024-05-14T15:17:43.854379+0000","last_peered":"2024-05-14T15:17:43.854379+0000","last_clean":"2024-05-14T15:17:43.854379+0000","last_became_active":"2024-05-14T15:16:03.841253+0000","last_became_peered":"2024-05-14T15:16:03.841253+0000","last_unstale":"2024-05-14T15:17:43.854379+0000","last_undegraded":"2024-05-14T15:17:43.854379+0000","last_fullsized":"2024-05-14T15:17:43.854379+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:40:24.440707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.578789+0000","last_change":"2024-05-14T15:16:08.782849+0000","last_active":"2024-05-14T15:19:11.578789+0000","last_peered":"2024-05-14T15:19:11.578789+0000","last_clean":"2024-05-14T15:19:11.578789+0000","last_became_active":"2024-05-14T15:16:08.781999+0000","last_became_peered":"2024-05-14T15:16:08.781999+0000","last_unstale":"2024-05-14T15:19:11.578789+0000","last_undegraded":"2024-05-14T15:19:11.578789+0000","last_fullsized":"2024-05-14T15:19:11.578789+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:33:03.997615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.737012+0000","last_change":"2024-05-14T15:16:23.049719+0000","last_active":"2024-05-14T15:17:43.737012+0000","last_peered":"2024-05-14T15:17:43.737012+0000","last_clean":"2024-05-14T15:17:43.737012+0000","last_became_active":"2024-05-14T15:16:23.048547+0000","last_became_peered":"2024-05-14T15:16:23.048547+0000","last_unstale":"2024-05-14T15:17:43.737012+0000","last_undegraded":"2024-05-14T15:17:43.737012+0000","last_fullsized":"2024-05-14T15:17:43.737012+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:41:49.790521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'17","reported_seq":62,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:13.812914+0000","last_change":"2024-05-14T15:16:03.729413+0000","last_active":"2024-05-14T15:18:13.812914+0000","last_peered":"2024-05-14T15:18:13.812914+0000","last_clean":"2024-05-14T15:18:13.812914+0000","last_became_active":"2024-05-14T15:16:03.728491+0000","last_became_peered":"2024-05-14T15:16:03.728491+0000","last_unstale":"2024-05-14T15:18:13.812914+0000","last_undegraded":"2024-05-14T15:18:13.812914+0000","last_fullsized":"2024-05-14T15:18:13.812914+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:34:04.811775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.599442+0000","last_change":"2024-05-14T15:16:08.784237+0000","last_active":"2024-05-14T15:19:11.599442+0000","last_peered":"2024-05-14T15:19:11.599442+0000","last_clean":"2024-05-14T15:19:11.599442+0000","last_became_active":"2024-05-14T15:16:08.783908+0000","last_became_peered":"2024-05-14T15:16:08.783908+0000","last_unstale":"2024-05-14T15:19:11.599442+0000","last_undegraded":"2024-05-14T15:19:11.599442+0000","last_fullsized":"2024-05-14T15:19:11.599442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:43:24.621314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.729639+0000","last_change":"2024-05-14T15:16:22.909928+0000","last_active":"2024-05-14T15:17:43.729639+0000","last_peered":"2024-05-14T15:17:43.729639+0000","last_clean":"2024-05-14T15:17:43.729639+0000","last_became_active":"2024-05-14T15:16:22.909412+0000","last_became_peered":"2024-05-14T15:16:22.909412+0000","last_unstale":"2024-05-14T15:17:43.729639+0000","last_undegraded":"2024-05-14T15:17:43.729639+0000","last_fullsized":"2024-05-14T15:17:43.729639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:18:26.324189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.759969+0000","last_change":"2024-05-14T15:16:03.729846+0000","last_active":"2024-05-14T15:17:43.759969+0000","last_peered":"2024-05-14T15:17:43.759969+0000","last_clean":"2024-05-14T15:17:43.759969+0000","last_became_active":"2024-05-14T15:16:03.729385+0000","last_became_peered":"2024-05-14T15:16:03.729385+0000","last_unstale":"2024-05-14T15:17:43.759969+0000","last_undegraded":"2024-05-14T15:17:43.759969+0000","last_fullsized":"2024-05-14T15:17:43.759969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:05:18.987237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.606967+0000","last_change":"2024-05-14T15:16:08.796017+0000","last_active":"2024-05-14T15:19:11.606967+0000","last_peered":"2024-05-14T15:19:11.606967+0000","last_clean":"2024-05-14T15:19:11.606967+0000","last_became_active":"2024-05-14T15:16:08.791627+0000","last_became_peered":"2024-05-14T15:16:08.791627+0000","last_unstale":"2024-05-14T15:19:11.606967+0000","last_undegraded":"2024-05-14T15:19:11.606967+0000","last_fullsized":"2024-05-14T15:19:11.606967+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:46:27.910669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.759233+0000","last_change":"2024-05-14T15:16:23.052954+0000","last_active":"2024-05-14T15:17:43.759233+0000","last_peered":"2024-05-14T15:17:43.759233+0000","last_clean":"2024-05-14T15:17:43.759233+0000","last_became_active":"2024-05-14T15:16:23.051410+0000","last_became_peered":"2024-05-14T15:16:23.051410+0000","last_unstale":"2024-05-14T15:17:43.759233+0000","last_undegraded":"2024-05-14T15:17:43.759233+0000","last_fullsized":"2024-05-14T15:17:43.759233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:28:55.181866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.727212+0000","last_change":"2024-05-14T15:16:43.023961+0000","last_active":"2024-05-14T15:17:43.727212+0000","last_peered":"2024-05-14T15:17:43.727212+0000","last_clean":"2024-05-14T15:17:43.727212+0000","last_became_active":"2024-05-14T15:16:43.022677+0000","last_became_peered":"2024-05-14T15:16:43.022677+0000","last_unstale":"2024-05-14T15:17:43.727212+0000","last_undegraded":"2024-05-14T15:17:43.727212+0000","last_fullsized":"2024-05-14T15:17:43.727212+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:33:16.692984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.535255+0000","last_change":"2024-05-14T15:16:08.780415+0000","last_active":"2024-05-14T15:19:11.535255+0000","last_peered":"2024-05-14T15:19:11.535255+0000","last_clean":"2024-05-14T15:19:11.535255+0000","last_became_active":"2024-05-14T15:16:08.780053+0000","last_became_peered":"2024-05-14T15:16:08.780053+0000","last_unstale":"2024-05-14T15:19:11.535255+0000","last_undegraded":"2024-05-14T15:19:11.535255+0000","last_fullsized":"2024-05-14T15:19:11.535255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:18:00.964346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.853758+0000","last_change":"2024-05-14T15:16:43.066458+0000","last_active":"2024-05-14T15:17:43.853758+0000","last_peered":"2024-05-14T15:17:43.853758+0000","last_clean":"2024-05-14T15:17:43.853758+0000","last_became_active":"2024-05-14T15:16:43.064035+0000","last_became_peered":"2024-05-14T15:16:43.064035+0000","last_unstale":"2024-05-14T15:17:43.853758+0000","last_undegraded":"2024-05-14T15:17:43.853758+0000","last_fullsized":"2024-05-14T15:17:43.853758+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:38:39.895882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.735934+0000","last_change":"2024-05-14T15:16:03.731962+0000","last_active":"2024-05-14T15:17:43.735934+0000","last_peered":"2024-05-14T15:17:43.735934+0000","last_clean":"2024-05-14T15:17:43.735934+0000","last_became_active":"2024-05-14T15:16:03.726532+0000","last_became_peered":"2024-05-14T15:16:03.726532+0000","last_unstale":"2024-05-14T15:17:43.735934+0000","last_undegraded":"2024-05-14T15:17:43.735934+0000","last_fullsized":"2024-05-14T15:17:43.735934+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:47:26.809212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.611862+0000","last_change":"2024-05-14T15:16:08.798984+0000","last_active":"2024-05-14T15:19:11.611862+0000","last_peered":"2024-05-14T15:19:11.611862+0000","last_clean":"2024-05-14T15:19:11.611862+0000","last_became_active":"2024-05-14T15:16:08.798120+0000","last_became_peered":"2024-05-14T15:16:08.798120+0000","last_unstale":"2024-05-14T15:19:11.611862+0000","last_undegraded":"2024-05-14T15:19:11.611862+0000","last_fullsized":"2024-05-14T15:19:11.611862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:58.519436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:58.931592+0000","last_change":"2024-05-14T15:16:22.907994+0000","last_active":"2024-05-14T15:17:58.931592+0000","last_peered":"2024-05-14T15:17:58.931592+0000","last_clean":"2024-05-14T15:17:58.931592+0000","last_became_active":"2024-05-14T15:16:22.907144+0000","last_became_peered":"2024-05-14T15:16:22.907144+0000","last_unstale":"2024-05-14T15:17:58.931592+0000","last_undegraded":"2024-05-14T15:17:58.931592+0000","last_fullsized":"2024-05-14T15:17:58.931592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:49:11.436917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.729953+0000","last_change":"2024-05-14T15:16:03.728334+0000","last_active":"2024-05-14T15:17:43.729953+0000","last_peered":"2024-05-14T15:17:43.729953+0000","last_clean":"2024-05-14T15:17:43.729953+0000","last_became_active":"2024-05-14T15:16:03.727836+0000","last_became_peered":"2024-05-14T15:16:03.727836+0000","last_unstale":"2024-05-14T15:17:43.729953+0000","last_undegraded":"2024-05-14T15:17:43.729953+0000","last_fullsized":"2024-05-14T15:17:43.729953+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:54.780821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.607890+0000","last_change":"2024-05-14T15:16:08.798340+0000","last_active":"2024-05-14T15:19:11.607890+0000","last_peered":"2024-05-14T15:19:11.607890+0000","last_clean":"2024-05-14T15:19:11.607890+0000","last_became_active":"2024-05-14T15:16:08.797981+0000","last_became_peered":"2024-05-14T15:16:08.797981+0000","last_unstale":"2024-05-14T15:19:11.607890+0000","last_undegraded":"2024-05-14T15:19:11.607890+0000","last_fullsized":"2024-05-14T15:19:11.607890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:04:08.322033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.759737+0000","last_change":"2024-05-14T15:16:23.050064+0000","last_active":"2024-05-14T15:17:43.759737+0000","last_peered":"2024-05-14T15:17:43.759737+0000","last_clean":"2024-05-14T15:17:43.759737+0000","last_became_active":"2024-05-14T15:16:23.048608+0000","last_became_peered":"2024-05-14T15:16:23.048608+0000","last_unstale":"2024-05-14T15:17:43.759737+0000","last_undegraded":"2024-05-14T15:17:43.759737+0000","last_fullsized":"2024-05-14T15:17:43.759737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:32.044226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852461+0000","last_change":"2024-05-14T15:16:03.734588+0000","last_active":"2024-05-14T15:17:43.852461+0000","last_peered":"2024-05-14T15:17:43.852461+0000","last_clean":"2024-05-14T15:17:43.852461+0000","last_became_active":"2024-05-14T15:16:03.734112+0000","last_became_peered":"2024-05-14T15:16:03.734112+0000","last_unstale":"2024-05-14T15:17:43.852461+0000","last_undegraded":"2024-05-14T15:17:43.852461+0000","last_fullsized":"2024-05-14T15:17:43.852461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:07:56.545225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.608108+0000","last_change":"2024-05-14T15:16:08.789481+0000","last_active":"2024-05-14T15:19:11.608108+0000","last_peered":"2024-05-14T15:19:11.608108+0000","last_clean":"2024-05-14T15:19:11.608108+0000","last_became_active":"2024-05-14T15:16:08.788462+0000","last_became_peered":"2024-05-14T15:16:08.788462+0000","last_unstale":"2024-05-14T15:19:11.608108+0000","last_undegraded":"2024-05-14T15:19:11.608108+0000","last_fullsized":"2024-05-14T15:19:11.608108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:35:06.386410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.727351+0000","last_change":"2024-05-14T15:16:22.903205+0000","last_active":"2024-05-14T15:17:43.727351+0000","last_peered":"2024-05-14T15:17:43.727351+0000","last_clean":"2024-05-14T15:17:43.727351+0000","last_became_active":"2024-05-14T15:16:22.901217+0000","last_became_peered":"2024-05-14T15:16:22.901217+0000","last_unstale":"2024-05-14T15:17:43.727351+0000","last_undegraded":"2024-05-14T15:17:43.727351+0000","last_fullsized":"2024-05-14T15:17:43.727351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:03:59.160106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'7","reported_seq":176,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:36.764927+0000","last_change":"2024-05-14T15:16:03.840601+0000","last_active":"2024-05-14T15:19:36.764927+0000","last_peered":"2024-05-14T15:19:36.764927+0000","last_clean":"2024-05-14T15:19:36.764927+0000","last_became_active":"2024-05-14T15:16:03.839299+0000","last_became_peered":"2024-05-14T15:16:03.839299+0000","last_unstale":"2024-05-14T15:19:36.764927+0000","last_undegraded":"2024-05-14T15:19:36.764927+0000","last_fullsized":"2024-05-14T15:19:36.764927+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:35:46.773419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":124,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.608216+0000","last_change":"2024-05-14T15:16:08.782915+0000","last_active":"2024-05-14T15:19:11.608216+0000","last_peered":"2024-05-14T15:19:11.608216+0000","last_clean":"2024-05-14T15:19:11.608216+0000","last_became_active":"2024-05-14T15:16:08.782469+0000","last_became_peered":"2024-05-14T15:16:08.782469+0000","last_unstale":"2024-05-14T15:19:11.608216+0000","last_undegraded":"2024-05-14T15:19:11.608216+0000","last_fullsized":"2024-05-14T15:19:11.608216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:36:35.361723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.844690+0000","last_change":"2024-05-14T15:16:43.021276+0000","last_active":"2024-05-14T15:17:43.844690+0000","last_peered":"2024-05-14T15:17:43.844690+0000","last_clean":"2024-05-14T15:17:43.844690+0000","last_became_active":"2024-05-14T15:16:43.020534+0000","last_became_peered":"2024-05-14T15:16:43.020534+0000","last_unstale":"2024-05-14T15:17:43.844690+0000","last_undegraded":"2024-05-14T15:17:43.844690+0000","last_fullsized":"2024-05-14T15:17:43.844690+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:31:01.267429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850735+0000","last_change":"2024-05-14T15:16:03.728379+0000","last_active":"2024-05-14T15:17:43.850735+0000","last_peered":"2024-05-14T15:17:43.850735+0000","last_clean":"2024-05-14T15:17:43.850735+0000","last_became_active":"2024-05-14T15:16:03.727580+0000","last_became_peered":"2024-05-14T15:16:03.727580+0000","last_unstale":"2024-05-14T15:17:43.850735+0000","last_undegraded":"2024-05-14T15:17:43.850735+0000","last_fullsized":"2024-05-14T15:17:43.850735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:54:20.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.585086+0000","last_change":"2024-05-14T15:17:43.854489+0000","last_active":"2024-05-14T15:19:11.585086+0000","last_peered":"2024-05-14T15:19:11.585086+0000","last_clean":"2024-05-14T15:19:11.585086+0000","last_became_active":"2024-05-14T15:17:43.853624+0000","last_became_peered":"2024-05-14T15:17:43.853624+0000","last_unstale":"2024-05-14T15:19:11.585086+0000","last_undegraded":"2024-05-14T15:19:11.585086+0000","last_fullsized":"2024-05-14T15:19:11.585086+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:59.686248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.848677+0000","last_change":"2024-05-14T15:16:22.911248+0000","last_active":"2024-05-14T15:17:43.848677+0000","last_peered":"2024-05-14T15:17:43.848677+0000","last_clean":"2024-05-14T15:17:43.848677+0000","last_became_active":"2024-05-14T15:16:22.909975+0000","last_became_peered":"2024-05-14T15:16:22.909975+0000","last_unstale":"2024-05-14T15:17:43.848677+0000","last_undegraded":"2024-05-14T15:17:43.848677+0000","last_fullsized":"2024-05-14T15:17:43.848677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:23.140008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846178+0000","last_change":"2024-05-14T15:16:03.728422+0000","last_active":"2024-05-14T15:17:43.846178+0000","last_peered":"2024-05-14T15:17:43.846178+0000","last_clean":"2024-05-14T15:17:43.846178+0000","last_became_active":"2024-05-14T15:16:03.727428+0000","last_became_peered":"2024-05-14T15:16:03.727428+0000","last_unstale":"2024-05-14T15:17:43.846178+0000","last_undegraded":"2024-05-14T15:17:43.846178+0000","last_fullsized":"2024-05-14T15:17:43.846178+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:37:15.472001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.596510+0000","last_change":"2024-05-14T15:16:08.782158+0000","last_active":"2024-05-14T15:19:11.596510+0000","last_peered":"2024-05-14T15:19:11.596510+0000","last_clean":"2024-05-14T15:19:11.596510+0000","last_became_active":"2024-05-14T15:16:08.781761+0000","last_became_peered":"2024-05-14T15:16:08.781761+0000","last_unstale":"2024-05-14T15:19:11.596510+0000","last_undegraded":"2024-05-14T15:19:11.596510+0000","last_fullsized":"2024-05-14T15:19:11.596510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:01:42.886837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.593080+0000","last_change":"2024-05-14T15:16:08.789851+0000","last_active":"2024-05-14T15:19:11.593080+0000","last_peered":"2024-05-14T15:19:11.593080+0000","last_clean":"2024-05-14T15:19:11.593080+0000","last_became_active":"2024-05-14T15:16:08.787563+0000","last_became_peered":"2024-05-14T15:16:08.787563+0000","last_unstale":"2024-05-14T15:19:11.593080+0000","last_undegraded":"2024-05-14T15:19:11.593080+0000","last_fullsized":"2024-05-14T15:19:11.593080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:02:16.592481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.590431+0000","last_change":"2024-05-14T15:16:08.788989+0000","last_active":"2024-05-14T15:19:11.590431+0000","last_peered":"2024-05-14T15:19:11.590431+0000","last_clean":"2024-05-14T15:19:11.590431+0000","last_became_active":"2024-05-14T15:16:08.785064+0000","last_became_peered":"2024-05-14T15:16:08.785064+0000","last_unstale":"2024-05-14T15:19:11.590431+0000","last_undegraded":"2024-05-14T15:19:11.590431+0000","last_fullsized":"2024-05-14T15:19:11.590431+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:12:30.824113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.581343+0000","last_change":"2024-05-14T15:16:08.785849+0000","last_active":"2024-05-14T15:19:11.581343+0000","last_peered":"2024-05-14T15:19:11.581343+0000","last_clean":"2024-05-14T15:19:11.581343+0000","last_became_active":"2024-05-14T15:16:08.785487+0000","last_became_peered":"2024-05-14T15:16:08.785487+0000","last_unstale":"2024-05-14T15:19:11.581343+0000","last_undegraded":"2024-05-14T15:19:11.581343+0000","last_fullsized":"2024-05-14T15:19:11.581343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:37:16.435154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.606248+0000","last_change":"2024-05-14T15:16:08.787843+0000","last_active":"2024-05-14T15:19:11.606248+0000","last_peered":"2024-05-14T15:19:11.606248+0000","last_clean":"2024-05-14T15:19:11.606248+0000","last_became_active":"2024-05-14T15:16:08.787485+0000","last_became_peered":"2024-05-14T15:16:08.787485+0000","last_unstale":"2024-05-14T15:19:11.606248+0000","last_undegraded":"2024-05-14T15:19:11.606248+0000","last_fullsized":"2024-05-14T15:19:11.606248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:16:06.625923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.609397+0000","last_change":"2024-05-14T15:16:08.784870+0000","last_active":"2024-05-14T15:19:11.609397+0000","last_peered":"2024-05-14T15:19:11.609397+0000","last_clean":"2024-05-14T15:19:11.609397+0000","last_became_active":"2024-05-14T15:16:08.782496+0000","last_became_peered":"2024-05-14T15:16:08.782496+0000","last_unstale":"2024-05-14T15:19:11.609397+0000","last_undegraded":"2024-05-14T15:19:11.609397+0000","last_fullsized":"2024-05-14T15:19:11.609397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:54:33.724823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.593144+0000","last_change":"2024-05-14T15:16:08.783203+0000","last_active":"2024-05-14T15:19:11.593144+0000","last_peered":"2024-05-14T15:19:11.593144+0000","last_clean":"2024-05-14T15:19:11.593144+0000","last_became_active":"2024-05-14T15:16:08.782758+0000","last_became_peered":"2024-05-14T15:16:08.782758+0000","last_unstale":"2024-05-14T15:19:11.593144+0000","last_undegraded":"2024-05-14T15:19:11.593144+0000","last_fullsized":"2024-05-14T15:19:11.593144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:34:33.274511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.608227+0000","last_change":"2024-05-14T15:16:08.789727+0000","last_active":"2024-05-14T15:19:11.608227+0000","last_peered":"2024-05-14T15:19:11.608227+0000","last_clean":"2024-05-14T15:19:11.608227+0000","last_became_active":"2024-05-14T15:16:08.784434+0000","last_became_peered":"2024-05-14T15:16:08.784434+0000","last_unstale":"2024-05-14T15:19:11.608227+0000","last_undegraded":"2024-05-14T15:19:11.608227+0000","last_fullsized":"2024-05-14T15:19:11.608227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:59:19.835381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.586736+0000","last_change":"2024-05-14T15:16:08.781887+0000","last_active":"2024-05-14T15:19:11.586736+0000","last_peered":"2024-05-14T15:19:11.586736+0000","last_clean":"2024-05-14T15:19:11.586736+0000","last_became_active":"2024-05-14T15:16:08.781332+0000","last_became_peered":"2024-05-14T15:16:08.781332+0000","last_unstale":"2024-05-14T15:19:11.586736+0000","last_undegraded":"2024-05-14T15:19:11.586736+0000","last_fullsized":"2024-05-14T15:19:11.586736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:51:36.558485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.596755+0000","last_change":"2024-05-14T15:16:43.065016+0000","last_active":"2024-05-14T15:19:11.596755+0000","last_peered":"2024-05-14T15:19:11.596755+0000","last_clean":"2024-05-14T15:19:11.596755+0000","last_became_active":"2024-05-14T15:16:43.063786+0000","last_became_peered":"2024-05-14T15:16:43.063786+0000","last_unstale":"2024-05-14T15:19:11.596755+0000","last_undegraded":"2024-05-14T15:19:11.596755+0000","last_fullsized":"2024-05-14T15:19:11.596755+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:01:54.920710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.588889+0000","last_change":"2024-05-14T15:16:08.794288+0000","last_active":"2024-05-14T15:19:11.588889+0000","last_peered":"2024-05-14T15:19:11.588889+0000","last_clean":"2024-05-14T15:19:11.588889+0000","last_became_active":"2024-05-14T15:16:08.792059+0000","last_became_peered":"2024-05-14T15:16:08.792059+0000","last_unstale":"2024-05-14T15:19:11.588889+0000","last_undegraded":"2024-05-14T15:19:11.588889+0000","last_fullsized":"2024-05-14T15:19:11.588889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:30:55.769322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.608642+0000","last_change":"2024-05-14T15:17:43.858583+0000","last_active":"2024-05-14T15:19:11.608642+0000","last_peered":"2024-05-14T15:19:11.608642+0000","last_clean":"2024-05-14T15:19:11.608642+0000","last_became_active":"2024-05-14T15:17:43.857287+0000","last_became_peered":"2024-05-14T15:17:43.857287+0000","last_unstale":"2024-05-14T15:19:11.608642+0000","last_undegraded":"2024-05-14T15:19:11.608642+0000","last_fullsized":"2024-05-14T15:19:11.608642+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:12:31.471747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.610936+0000","last_change":"2024-05-14T15:16:08.786726+0000","last_active":"2024-05-14T15:19:11.610936+0000","last_peered":"2024-05-14T15:19:11.610936+0000","last_clean":"2024-05-14T15:19:11.610936+0000","last_became_active":"2024-05-14T15:16:08.785599+0000","last_became_peered":"2024-05-14T15:16:08.785599+0000","last_unstale":"2024-05-14T15:19:11.610936+0000","last_undegraded":"2024-05-14T15:19:11.610936+0000","last_fullsized":"2024-05-14T15:19:11.610936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:33:18.055459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.587388+0000","last_change":"2024-05-14T15:16:43.022021+0000","last_active":"2024-05-14T15:19:11.587388+0000","last_peered":"2024-05-14T15:19:11.587388+0000","last_clean":"2024-05-14T15:19:11.587388+0000","last_became_active":"2024-05-14T15:16:43.021511+0000","last_became_peered":"2024-05-14T15:16:43.021511+0000","last_unstale":"2024-05-14T15:19:11.587388+0000","last_undegraded":"2024-05-14T15:19:11.587388+0000","last_fullsized":"2024-05-14T15:19:11.587388+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:59:55.083356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75280,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1237,"num_read_kb":700,"num_write":266,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":225840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645375,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1056768,"data_stored":526638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841605,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32892,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712260,"statfs":{"total":95995035648,"available":95961354240,"internally_reserved":0,"allocated":1757184,"data_stored":1180184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005134,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":530132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201365,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1077248,"data_stored":526414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430300,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32812,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712340,"statfs":{"total":95995035648,"available":95961436160,"internally_reserved":0,"allocated":1675264,"data_stored":1124116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593828,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1056768,"data_stored":522072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32280,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712872,"statfs":{"total":95995035648,"available":95961980928,"internally_reserved":0,"allocated":1130496,"data_stored":589832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738513,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32232,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712920,"statfs":{"total":95995035648,"available":95962030080,"internally_reserved":0,"allocated":1081344,"data_stored":523528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411458,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1150976,"data_stored":590584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182522,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1069056,"data_stored":521248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986292,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1064960,"data_stored":526146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790060,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32820,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712332,"statfs":{"total":95995035648,"available":95961427968,"internally_reserved":0,"allocated":1683456,"data_stored":1118634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:19:41.865 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph pg dump --format=json 2024-05-14T15:19:42.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:42 smithi069 ceph-mon[31270]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:19:42.338 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:42.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:42 smithi203 ceph-mon[34567]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:19:42.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:42 smithi092 ceph-mon[34729]: from='client.15021 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:19:43.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:43 smithi203 ceph-mon[34567]: pgmap v501: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:19:43.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:43 smithi092 ceph-mon[34729]: pgmap v501: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:19:43.444 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:43 smithi069 ceph-mon[31270]: pgmap v501: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:19:44.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.818+0000 7fb1f4c00700 1 -- 172.21.15.69:0/579791935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1f01109b0 msgr2=0x7fb1f0112e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:44.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.818+0000 7fb1f4c00700 1 --2- 172.21.15.69:0/579791935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1f01109b0 0x7fb1f0112e10 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8009f90 tx=0x7fb1e800b330 comp rx=0 tx=0).stop 2024-05-14T15:19:44.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.818+0000 7fb1f4c00700 1 -- 172.21.15.69:0/579791935 shutdown_connections 2024-05-14T15:19:44.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.818+0000 7fb1f4c00700 1 --2- 172.21.15.69:0/579791935 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1f01109b0 0x7fb1f0112e10 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:44.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.818+0000 7fb1f4c00700 1 --2- 172.21.15.69:0/579791935 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f0075d30 0x7fb1f0076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:44.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.818+0000 7fb1f4c00700 1 --2- 172.21.15.69:0/579791935 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1f0076680 0x7fb1f0110470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:44.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.818+0000 7fb1f4c00700 1 -- 172.21.15.69:0/579791935 >> 172.21.15.69:0/579791935 conn(0x7fb1f0079d10 msgr2=0x7fb1f007a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:44.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.818+0000 7fb1f4c00700 1 -- 172.21.15.69:0/579791935 shutdown_connections 2024-05-14T15:19:44.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.818+0000 7fb1f4c00700 1 -- 172.21.15.69:0/579791935 wait complete. 2024-05-14T15:19:44.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.819+0000 7fb1f4c00700 1 Processor -- start 2024-05-14T15:19:44.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.819+0000 7fb1f4c00700 1 -- start start 2024-05-14T15:19:44.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.820+0000 7fb1f4c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f0075d30 0x7fb1f019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:44.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.820+0000 7fb1f4c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1f0076680 0x7fb1f019d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:44.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.820+0000 7fb1f4c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1f01109b0 0x7fb1f01a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:44.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.820+0000 7fb1f4c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f0116360 con 0x7fb1f0076680 2024-05-14T15:19:44.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.820+0000 7fb1f4c00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f01161e0 con 0x7fb1f01109b0 2024-05-14T15:19:44.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.820+0000 7fb1f4c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb1f01164e0 con 0x7fb1f0075d30 2024-05-14T15:19:44.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.820+0000 7fb1eea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1f0076680 0x7fb1f019d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:44.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.820+0000 7fb1eea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1f0076680 0x7fb1f019d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43830/0 (socket says 172.21.15.69:43830) 2024-05-14T15:19:44.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.820+0000 7fb1eea00700 1 -- 172.21.15.69:0/2209519246 learned_addr learned my addr 172.21.15.69:0/2209519246 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:44.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.820+0000 7fb1ef400700 1 --2- 172.21.15.69:0/2209519246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f0075d30 0x7fb1f019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:44.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.821+0000 7fb1eea00700 1 -- 172.21.15.69:0/2209519246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f0075d30 msgr2=0x7fb1f019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:44.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.821+0000 7fb1eea00700 1 --2- 172.21.15.69:0/2209519246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f0075d30 0x7fb1f019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:44.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.821+0000 7fb1eea00700 1 -- 172.21.15.69:0/2209519246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1f01109b0 msgr2=0x7fb1f01a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:44.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.821+0000 7fb1eea00700 1 --2- 172.21.15.69:0/2209519246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1f01109b0 0x7fb1f01a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:44.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.821+0000 7fb1eea00700 1 -- 172.21.15.69:0/2209519246 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1f01a1c80 con 0x7fb1f0076680 2024-05-14T15:19:44.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.821+0000 7fb1ef400700 1 --2- 172.21.15.69:0/2209519246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f0075d30 0x7fb1f019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:19:44.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.821+0000 7fb1eea00700 1 --2- 172.21.15.69:0/2209519246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1f0076680 0x7fb1f019d350 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00ec10 tx=0x7fb1dc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:44.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.821+0000 7fb1e7e00700 1 -- 172.21.15.69:0/2209519246 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc00cde0 con 0x7fb1f0076680 2024-05-14T15:19:44.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.821+0000 7fb1e7e00700 1 -- 172.21.15.69:0/2209519246 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb1dc0044b0 con 0x7fb1f0076680 2024-05-14T15:19:44.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.821+0000 7fb1f4c00700 1 -- 172.21.15.69:0/2209519246 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1f01a1f70 con 0x7fb1f0076680 2024-05-14T15:19:44.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.821+0000 7fb1e7e00700 1 -- 172.21.15.69:0/2209519246 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1dc010490 con 0x7fb1f0076680 2024-05-14T15:19:44.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.821+0000 7fb1f4c00700 1 -- 172.21.15.69:0/2209519246 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1f01a9890 con 0x7fb1f0076680 2024-05-14T15:19:44.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.823+0000 7fb1f4c00700 1 -- 172.21.15.69:0/2209519246 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f00512c0 con 0x7fb1f0076680 2024-05-14T15:19:44.825 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.825+0000 7fb1e7e00700 1 -- 172.21.15.69:0/2209519246 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb1dc004000 con 0x7fb1f0076680 2024-05-14T15:19:44.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.827+0000 7fb1e7e00700 1 --2- 172.21.15.69:0/2209519246 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1d40b2880 0x7fb1d40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:44.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.827+0000 7fb1e7e00700 1 -- 172.21.15.69:0/2209519246 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fb1dc0e2ab0 con 0x7fb1f0076680 2024-05-14T15:19:44.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.827+0000 7fb1ef400700 1 --2- 172.21.15.69:0/2209519246 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1d40b2880 0x7fb1d40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:44.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.828+0000 7fb1ef400700 1 --2- 172.21.15.69:0/2209519246 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1d40b2880 0x7fb1d40b4d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009be0 tx=0x7fb1e0009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:44.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:44.833+0000 7fb1e7e00700 1 -- 172.21.15.69:0/2209519246 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb1dc0aa3a0 con 0x7fb1f0076680 2024-05-14T15:19:45.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:45.058+0000 7fb1f4c00700 1 -- 172.21.15.69:0/2209519246 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb1f019e110 con 0x7fb1d40b2880 2024-05-14T15:19:45.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:45.074+0000 7fb1e7e00700 1 -- 172.21.15.69:0/2209519246 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340524 (secure 0 0 0) 0x7fb1f019e110 con 0x7fb1d40b2880 2024-05-14T15:19:45.075 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:19:45.076 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:45 smithi069 ceph-mon[31270]: pgmap v502: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:19:45.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:45.081+0000 7fb1f4c00700 1 -- 172.21.15.69:0/2209519246 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1d40b2880 msgr2=0x7fb1d40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:45.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:45.081+0000 7fb1f4c00700 1 --2- 172.21.15.69:0/2209519246 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1d40b2880 0x7fb1d40b4d90 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb1e0009be0 tx=0x7fb1e0009260 comp rx=0 tx=0).stop 2024-05-14T15:19:45.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:45.081+0000 7fb1f4c00700 1 -- 172.21.15.69:0/2209519246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1f0076680 msgr2=0x7fb1f019d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:45.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:45.081+0000 7fb1f4c00700 1 --2- 172.21.15.69:0/2209519246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1f0076680 0x7fb1f019d350 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fb1dc00ec10 tx=0x7fb1dc00c2d0 comp rx=0 tx=0).stop 2024-05-14T15:19:45.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:45.081+0000 7fb1f4c00700 1 -- 172.21.15.69:0/2209519246 shutdown_connections 2024-05-14T15:19:45.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:45.081+0000 7fb1f4c00700 1 --2- 172.21.15.69:0/2209519246 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb1d40b2880 0x7fb1d40b4d90 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:45.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:45.081+0000 7fb1f4c00700 1 --2- 172.21.15.69:0/2209519246 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1f01109b0 0x7fb1f01a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:45.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:45.081+0000 7fb1f4c00700 1 --2- 172.21.15.69:0/2209519246 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1f0075d30 0x7fb1f019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:45.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:45.081+0000 7fb1f4c00700 1 --2- 172.21.15.69:0/2209519246 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1f0076680 0x7fb1f019d350 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:45.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:45.081+0000 7fb1f4c00700 1 -- 172.21.15.69:0/2209519246 >> 172.21.15.69:0/2209519246 conn(0x7fb1f0079d10 msgr2=0x7fb1f0102050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:45.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:45.081+0000 7fb1f4c00700 1 -- 172.21.15.69:0/2209519246 shutdown_connections 2024-05-14T15:19:45.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:45.081+0000 7fb1f4c00700 1 -- 172.21.15.69:0/2209519246 wait complete. 2024-05-14T15:19:45.083 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-05-14T15:19:45.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:45 smithi203 ceph-mon[34567]: pgmap v502: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:19:45.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:45 smithi092 ceph-mon[34729]: pgmap v502: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:19:46.069 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":502,"stamp":"2024-05-14T15:19:43.703594+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":665882,"num_objects":102,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":102,"num_whiteouts":0,"num_read":1358,"num_read_kb":789,"num_write":391,"num_write_kb":2311,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":824,"ondisk_log_size":824,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":384492,"kb_used_data":14540,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124557332,"statfs":{"total":1151940427776,"available":1151546707968,"internally_reserved":0,"allocated":14888960,"data_stored":8279528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":50,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006656"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.612040+0000","last_change":"2024-05-14T15:16:08.799448+0000","last_active":"2024-05-14T15:19:11.612040+0000","last_peered":"2024-05-14T15:19:11.612040+0000","last_clean":"2024-05-14T15:19:11.612040+0000","last_became_active":"2024-05-14T15:16:08.799025+0000","last_became_peered":"2024-05-14T15:16:08.799025+0000","last_unstale":"2024-05-14T15:19:11.612040+0000","last_undegraded":"2024-05-14T15:19:11.612040+0000","last_fullsized":"2024-05-14T15:19:11.612040+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:25:56.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.600992+0000","last_change":"2024-05-14T15:16:08.796943+0000","last_active":"2024-05-14T15:19:11.600992+0000","last_peered":"2024-05-14T15:19:11.600992+0000","last_clean":"2024-05-14T15:19:11.600992+0000","last_became_active":"2024-05-14T15:16:08.796044+0000","last_became_peered":"2024-05-14T15:16:08.796044+0000","last_unstale":"2024-05-14T15:19:11.600992+0000","last_undegraded":"2024-05-14T15:19:11.600992+0000","last_fullsized":"2024-05-14T15:19:11.600992+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:26:22.103727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.608891+0000","last_change":"2024-05-14T15:16:08.794020+0000","last_active":"2024-05-14T15:19:11.608891+0000","last_peered":"2024-05-14T15:19:11.608891+0000","last_clean":"2024-05-14T15:19:11.608891+0000","last_became_active":"2024-05-14T15:16:08.793677+0000","last_became_peered":"2024-05-14T15:16:08.793677+0000","last_unstale":"2024-05-14T15:19:11.608891+0000","last_undegraded":"2024-05-14T15:19:11.608891+0000","last_fullsized":"2024-05-14T15:19:11.608891+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.615815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.597979+0000","last_change":"2024-05-14T15:16:08.787482+0000","last_active":"2024-05-14T15:19:11.597979+0000","last_peered":"2024-05-14T15:19:11.597979+0000","last_clean":"2024-05-14T15:19:11.597979+0000","last_became_active":"2024-05-14T15:16:08.787087+0000","last_became_peered":"2024-05-14T15:16:08.787087+0000","last_unstale":"2024-05-14T15:19:11.597979+0000","last_undegraded":"2024-05-14T15:19:11.597979+0000","last_fullsized":"2024-05-14T15:19:11.597979+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:18:51.433751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.583953+0000","last_change":"2024-05-14T15:16:08.785982+0000","last_active":"2024-05-14T15:19:11.583953+0000","last_peered":"2024-05-14T15:19:11.583953+0000","last_clean":"2024-05-14T15:19:11.583953+0000","last_became_active":"2024-05-14T15:16:08.784980+0000","last_became_peered":"2024-05-14T15:16:08.784980+0000","last_unstale":"2024-05-14T15:19:11.583953+0000","last_undegraded":"2024-05-14T15:19:11.583953+0000","last_fullsized":"2024-05-14T15:19:11.583953+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:07:50.390637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.586283+0000","last_change":"2024-05-14T15:16:08.784622+0000","last_active":"2024-05-14T15:19:11.586283+0000","last_peered":"2024-05-14T15:19:11.586283+0000","last_clean":"2024-05-14T15:19:11.586283+0000","last_became_active":"2024-05-14T15:16:08.784206+0000","last_became_peered":"2024-05-14T15:16:08.784206+0000","last_unstale":"2024-05-14T15:19:11.586283+0000","last_undegraded":"2024-05-14T15:19:11.586283+0000","last_fullsized":"2024-05-14T15:19:11.586283+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:40:56.578935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.584759+0000","last_change":"2024-05-14T15:16:08.786381+0000","last_active":"2024-05-14T15:19:11.584759+0000","last_peered":"2024-05-14T15:19:11.584759+0000","last_clean":"2024-05-14T15:19:11.584759+0000","last_became_active":"2024-05-14T15:16:08.781231+0000","last_became_peered":"2024-05-14T15:16:08.781231+0000","last_unstale":"2024-05-14T15:19:11.584759+0000","last_undegraded":"2024-05-14T15:19:11.584759+0000","last_fullsized":"2024-05-14T15:19:11.584759+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:51:16.961187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.594532+0000","last_change":"2024-05-14T15:17:43.850244+0000","last_active":"2024-05-14T15:19:11.594532+0000","last_peered":"2024-05-14T15:19:11.594532+0000","last_clean":"2024-05-14T15:19:11.594532+0000","last_became_active":"2024-05-14T15:17:43.849671+0000","last_became_peered":"2024-05-14T15:17:43.849671+0000","last_unstale":"2024-05-14T15:19:11.594532+0000","last_undegraded":"2024-05-14T15:19:11.594532+0000","last_fullsized":"2024-05-14T15:19:11.594532+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:21:05.537250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,10],"acting":[3,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.603851+0000","last_change":"2024-05-14T15:16:08.785644+0000","last_active":"2024-05-14T15:19:11.603851+0000","last_peered":"2024-05-14T15:19:11.603851+0000","last_clean":"2024-05-14T15:19:11.603851+0000","last_became_active":"2024-05-14T15:16:08.785224+0000","last_became_peered":"2024-05-14T15:16:08.785224+0000","last_unstale":"2024-05-14T15:19:11.603851+0000","last_undegraded":"2024-05-14T15:19:11.603851+0000","last_fullsized":"2024-05-14T15:19:11.603851+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:05:10.868610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.598127+0000","last_change":"2024-05-14T15:16:08.784425+0000","last_active":"2024-05-14T15:19:11.598127+0000","last_peered":"2024-05-14T15:19:11.598127+0000","last_clean":"2024-05-14T15:19:11.598127+0000","last_became_active":"2024-05-14T15:16:08.782889+0000","last_became_peered":"2024-05-14T15:16:08.782889+0000","last_unstale":"2024-05-14T15:19:11.598127+0000","last_undegraded":"2024-05-14T15:19:11.598127+0000","last_fullsized":"2024-05-14T15:19:11.598127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:40:11.043101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.608056+0000","last_change":"2024-05-14T15:16:08.782675+0000","last_active":"2024-05-14T15:19:11.608056+0000","last_peered":"2024-05-14T15:19:11.608056+0000","last_clean":"2024-05-14T15:19:11.608056+0000","last_became_active":"2024-05-14T15:16:08.781994+0000","last_became_peered":"2024-05-14T15:16:08.781994+0000","last_unstale":"2024-05-14T15:19:11.608056+0000","last_undegraded":"2024-05-14T15:19:11.608056+0000","last_fullsized":"2024-05-14T15:19:11.608056+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:00:59.625493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.596001+0000","last_change":"2024-05-14T15:16:08.785655+0000","last_active":"2024-05-14T15:19:11.596001+0000","last_peered":"2024-05-14T15:19:11.596001+0000","last_clean":"2024-05-14T15:19:11.596001+0000","last_became_active":"2024-05-14T15:16:08.785273+0000","last_became_peered":"2024-05-14T15:16:08.785273+0000","last_unstale":"2024-05-14T15:19:11.596001+0000","last_undegraded":"2024-05-14T15:19:11.596001+0000","last_fullsized":"2024-05-14T15:19:11.596001+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:11:51.971909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.599991+0000","last_change":"2024-05-14T15:16:08.775558+0000","last_active":"2024-05-14T15:19:11.599991+0000","last_peered":"2024-05-14T15:19:11.599991+0000","last_clean":"2024-05-14T15:19:11.599991+0000","last_became_active":"2024-05-14T15:16:08.773465+0000","last_became_peered":"2024-05-14T15:16:08.773465+0000","last_unstale":"2024-05-14T15:19:11.599991+0000","last_undegraded":"2024-05-14T15:19:11.599991+0000","last_fullsized":"2024-05-14T15:19:11.599991+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:16:17.151374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.594007+0000","last_change":"2024-05-14T15:16:08.786160+0000","last_active":"2024-05-14T15:19:11.594007+0000","last_peered":"2024-05-14T15:19:11.594007+0000","last_clean":"2024-05-14T15:19:11.594007+0000","last_became_active":"2024-05-14T15:16:08.781257+0000","last_became_peered":"2024-05-14T15:16:08.781257+0000","last_unstale":"2024-05-14T15:19:11.594007+0000","last_undegraded":"2024-05-14T15:19:11.594007+0000","last_fullsized":"2024-05-14T15:19:11.594007+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:13:03.974692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.594416+0000","last_change":"2024-05-14T15:16:43.014673+0000","last_active":"2024-05-14T15:19:11.594416+0000","last_peered":"2024-05-14T15:19:11.594416+0000","last_clean":"2024-05-14T15:19:11.594416+0000","last_became_active":"2024-05-14T15:16:43.013718+0000","last_became_peered":"2024-05-14T15:16:43.013718+0000","last_unstale":"2024-05-14T15:19:11.594416+0000","last_undegraded":"2024-05-14T15:19:11.594416+0000","last_fullsized":"2024-05-14T15:19:11.594416+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:08:42.885151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.601114+0000","last_change":"2024-05-14T15:16:08.784437+0000","last_active":"2024-05-14T15:19:11.601114+0000","last_peered":"2024-05-14T15:19:11.601114+0000","last_clean":"2024-05-14T15:19:11.601114+0000","last_became_active":"2024-05-14T15:16:08.784030+0000","last_became_peered":"2024-05-14T15:16:08.784030+0000","last_unstale":"2024-05-14T15:19:11.601114+0000","last_undegraded":"2024-05-14T15:19:11.601114+0000","last_fullsized":"2024-05-14T15:19:11.601114+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:57:43.025679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.612197+0000","last_change":"2024-05-14T15:16:08.798419+0000","last_active":"2024-05-14T15:19:11.612197+0000","last_peered":"2024-05-14T15:19:11.612197+0000","last_clean":"2024-05-14T15:19:11.612197+0000","last_became_active":"2024-05-14T15:16:08.798066+0000","last_became_peered":"2024-05-14T15:16:08.798066+0000","last_unstale":"2024-05-14T15:19:11.612197+0000","last_undegraded":"2024-05-14T15:19:11.612197+0000","last_fullsized":"2024-05-14T15:19:11.612197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:55:29.921745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.609796+0000","last_change":"2024-05-14T15:16:08.780638+0000","last_active":"2024-05-14T15:19:11.609796+0000","last_peered":"2024-05-14T15:19:11.609796+0000","last_clean":"2024-05-14T15:19:11.609796+0000","last_became_active":"2024-05-14T15:16:08.778675+0000","last_became_peered":"2024-05-14T15:16:08.778675+0000","last_unstale":"2024-05-14T15:19:11.609796+0000","last_undegraded":"2024-05-14T15:19:11.609796+0000","last_fullsized":"2024-05-14T15:19:11.609796+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:29.780036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.594863+0000","last_change":"2024-05-14T15:16:08.791729+0000","last_active":"2024-05-14T15:19:11.594863+0000","last_peered":"2024-05-14T15:19:11.594863+0000","last_clean":"2024-05-14T15:19:11.594863+0000","last_became_active":"2024-05-14T15:16:08.791367+0000","last_became_peered":"2024-05-14T15:16:08.791367+0000","last_unstale":"2024-05-14T15:19:11.594863+0000","last_undegraded":"2024-05-14T15:19:11.594863+0000","last_fullsized":"2024-05-14T15:19:11.594863+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:03:00.148744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730911+0000","last_change":"2024-05-14T15:16:22.909315+0000","last_active":"2024-05-14T15:17:43.730911+0000","last_peered":"2024-05-14T15:17:43.730911+0000","last_clean":"2024-05-14T15:17:43.730911+0000","last_became_active":"2024-05-14T15:16:22.908846+0000","last_became_peered":"2024-05-14T15:16:22.908846+0000","last_unstale":"2024-05-14T15:17:43.730911+0000","last_undegraded":"2024-05-14T15:17:43.730911+0000","last_fullsized":"2024-05-14T15:17:43.730911+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:20:50.338711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'14","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:37.722063+0000","last_change":"2024-05-14T15:16:03.729599+0000","last_active":"2024-05-14T15:19:37.722063+0000","last_peered":"2024-05-14T15:19:37.722063+0000","last_clean":"2024-05-14T15:19:37.722063+0000","last_became_active":"2024-05-14T15:16:03.728659+0000","last_became_peered":"2024-05-14T15:16:03.728659+0000","last_unstale":"2024-05-14T15:19:37.722063+0000","last_undegraded":"2024-05-14T15:19:37.722063+0000","last_fullsized":"2024-05-14T15:19:37.722063+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:54:18.989059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":122,"num_read_kb":122,"num_write":15,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.593990+0000","last_change":"2024-05-14T15:16:08.790296+0000","last_active":"2024-05-14T15:19:11.593990+0000","last_peered":"2024-05-14T15:19:11.593990+0000","last_clean":"2024-05-14T15:19:11.593990+0000","last_became_active":"2024-05-14T15:16:08.789899+0000","last_became_peered":"2024-05-14T15:16:08.789899+0000","last_unstale":"2024-05-14T15:19:11.593990+0000","last_undegraded":"2024-05-14T15:19:11.593990+0000","last_fullsized":"2024-05-14T15:19:11.593990+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:23:15.626580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.757692+0000","last_change":"2024-05-14T15:16:22.904857+0000","last_active":"2024-05-14T15:17:43.757692+0000","last_peered":"2024-05-14T15:17:43.757692+0000","last_clean":"2024-05-14T15:17:43.757692+0000","last_became_active":"2024-05-14T15:16:22.903747+0000","last_became_peered":"2024-05-14T15:16:22.903747+0000","last_unstale":"2024-05-14T15:17:43.757692+0000","last_undegraded":"2024-05-14T15:17:43.757692+0000","last_fullsized":"2024-05-14T15:17:43.757692+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:58:27.937637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.737501+0000","last_change":"2024-05-14T15:16:03.840248+0000","last_active":"2024-05-14T15:17:43.737501+0000","last_peered":"2024-05-14T15:17:43.737501+0000","last_clean":"2024-05-14T15:17:43.737501+0000","last_became_active":"2024-05-14T15:16:03.839731+0000","last_became_peered":"2024-05-14T15:16:03.839731+0000","last_unstale":"2024-05-14T15:17:43.737501+0000","last_undegraded":"2024-05-14T15:17:43.737501+0000","last_fullsized":"2024-05-14T15:17:43.737501+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:31:25.981757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.609860+0000","last_change":"2024-05-14T15:16:08.791233+0000","last_active":"2024-05-14T15:19:11.609860+0000","last_peered":"2024-05-14T15:19:11.609860+0000","last_clean":"2024-05-14T15:19:11.609860+0000","last_became_active":"2024-05-14T15:16:08.790376+0000","last_became_peered":"2024-05-14T15:16:08.790376+0000","last_unstale":"2024-05-14T15:19:11.609860+0000","last_undegraded":"2024-05-14T15:19:11.609860+0000","last_fullsized":"2024-05-14T15:19:11.609860+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:35.203663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.758244+0000","last_change":"2024-05-14T15:16:22.906435+0000","last_active":"2024-05-14T15:17:43.758244+0000","last_peered":"2024-05-14T15:17:43.758244+0000","last_clean":"2024-05-14T15:17:43.758244+0000","last_became_active":"2024-05-14T15:16:22.905558+0000","last_became_peered":"2024-05-14T15:16:22.905558+0000","last_unstale":"2024-05-14T15:17:43.758244+0000","last_undegraded":"2024-05-14T15:17:43.758244+0000","last_fullsized":"2024-05-14T15:17:43.758244+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:43:15.748904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":31,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.853623+0000","last_change":"2024-05-14T15:16:43.026454+0000","last_active":"2024-05-14T15:17:43.853623+0000","last_peered":"2024-05-14T15:17:43.853623+0000","last_clean":"2024-05-14T15:17:43.853623+0000","last_became_active":"2024-05-14T15:16:43.019742+0000","last_became_peered":"2024-05-14T15:16:43.019742+0000","last_unstale":"2024-05-14T15:17:43.853623+0000","last_undegraded":"2024-05-14T15:17:43.853623+0000","last_fullsized":"2024-05-14T15:17:43.853623+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:38:38.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.604395+0000","last_change":"2024-05-14T15:16:08.774669+0000","last_active":"2024-05-14T15:19:11.604395+0000","last_peered":"2024-05-14T15:19:11.604395+0000","last_clean":"2024-05-14T15:19:11.604395+0000","last_became_active":"2024-05-14T15:16:08.773996+0000","last_became_peered":"2024-05-14T15:16:08.773996+0000","last_unstale":"2024-05-14T15:19:11.604395+0000","last_undegraded":"2024-05-14T15:19:11.604395+0000","last_fullsized":"2024-05-14T15:19:11.604395+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:21:58.199462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.757941+0000","last_change":"2024-05-14T15:16:43.065743+0000","last_active":"2024-05-14T15:17:43.757941+0000","last_peered":"2024-05-14T15:17:43.757941+0000","last_clean":"2024-05-14T15:17:43.757941+0000","last_became_active":"2024-05-14T15:16:43.064426+0000","last_became_peered":"2024-05-14T15:16:43.064426+0000","last_unstale":"2024-05-14T15:17:43.757941+0000","last_undegraded":"2024-05-14T15:17:43.757941+0000","last_fullsized":"2024-05-14T15:17:43.757941+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:15:44.230694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852597+0000","last_change":"2024-05-14T15:16:03.732142+0000","last_active":"2024-05-14T15:17:43.852597+0000","last_peered":"2024-05-14T15:17:43.852597+0000","last_clean":"2024-05-14T15:17:43.852597+0000","last_became_active":"2024-05-14T15:16:03.731590+0000","last_became_peered":"2024-05-14T15:16:03.731590+0000","last_unstale":"2024-05-14T15:17:43.852597+0000","last_undegraded":"2024-05-14T15:17:43.852597+0000","last_fullsized":"2024-05-14T15:17:43.852597+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:05:23.760541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.607032+0000","last_change":"2024-05-14T15:16:08.780895+0000","last_active":"2024-05-14T15:19:11.607032+0000","last_peered":"2024-05-14T15:19:11.607032+0000","last_clean":"2024-05-14T15:19:11.607032+0000","last_became_active":"2024-05-14T15:16:08.780472+0000","last_became_peered":"2024-05-14T15:16:08.780472+0000","last_unstale":"2024-05-14T15:19:11.607032+0000","last_undegraded":"2024-05-14T15:19:11.607032+0000","last_fullsized":"2024-05-14T15:19:11.607032+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:49.508043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730972+0000","last_change":"2024-05-14T15:16:22.915997+0000","last_active":"2024-05-14T15:17:43.730972+0000","last_peered":"2024-05-14T15:17:43.730972+0000","last_clean":"2024-05-14T15:17:43.730972+0000","last_became_active":"2024-05-14T15:16:22.915466+0000","last_became_peered":"2024-05-14T15:16:22.915466+0000","last_unstale":"2024-05-14T15:17:43.730972+0000","last_undegraded":"2024-05-14T15:17:43.730972+0000","last_fullsized":"2024-05-14T15:17:43.730972+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:50:39.748860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"91'7","reported_seq":178,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:38.759109+0000","last_change":"2024-05-14T15:16:03.733796+0000","last_active":"2024-05-14T15:19:38.759109+0000","last_peered":"2024-05-14T15:19:38.759109+0000","last_clean":"2024-05-14T15:19:38.759109+0000","last_became_active":"2024-05-14T15:16:03.732467+0000","last_became_peered":"2024-05-14T15:16:03.732467+0000","last_unstale":"2024-05-14T15:19:38.759109+0000","last_undegraded":"2024-05-14T15:19:38.759109+0000","last_fullsized":"2024-05-14T15:19:38.759109+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:28.388120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1154,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.594260+0000","last_change":"2024-05-14T15:16:08.793287+0000","last_active":"2024-05-14T15:19:11.594260+0000","last_peered":"2024-05-14T15:19:11.594260+0000","last_clean":"2024-05-14T15:19:11.594260+0000","last_became_active":"2024-05-14T15:16:08.791173+0000","last_became_peered":"2024-05-14T15:16:08.791173+0000","last_unstale":"2024-05-14T15:19:11.594260+0000","last_undegraded":"2024-05-14T15:19:11.594260+0000","last_fullsized":"2024-05-14T15:19:11.594260+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:24:49.644251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730675+0000","last_change":"2024-05-14T15:16:22.914734+0000","last_active":"2024-05-14T15:17:43.730675+0000","last_peered":"2024-05-14T15:17:43.730675+0000","last_clean":"2024-05-14T15:17:43.730675+0000","last_became_active":"2024-05-14T15:16:22.914267+0000","last_became_peered":"2024-05-14T15:16:22.914267+0000","last_unstale":"2024-05-14T15:17:43.730675+0000","last_undegraded":"2024-05-14T15:17:43.730675+0000","last_fullsized":"2024-05-14T15:17:43.730675+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:04:50.809564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.847646+0000","last_change":"2024-05-14T15:16:03.729217+0000","last_active":"2024-05-14T15:17:43.847646+0000","last_peered":"2024-05-14T15:17:43.847646+0000","last_clean":"2024-05-14T15:17:43.847646+0000","last_became_active":"2024-05-14T15:16:03.727453+0000","last_became_peered":"2024-05-14T15:16:03.727453+0000","last_unstale":"2024-05-14T15:17:43.847646+0000","last_undegraded":"2024-05-14T15:17:43.847646+0000","last_fullsized":"2024-05-14T15:17:43.847646+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:40:27.820618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.590311+0000","last_change":"2024-05-14T15:16:08.783861+0000","last_active":"2024-05-14T15:19:11.590311+0000","last_peered":"2024-05-14T15:19:11.590311+0000","last_clean":"2024-05-14T15:19:11.590311+0000","last_became_active":"2024-05-14T15:16:08.782986+0000","last_became_peered":"2024-05-14T15:16:08.782986+0000","last_unstale":"2024-05-14T15:19:11.590311+0000","last_undegraded":"2024-05-14T15:19:11.590311+0000","last_fullsized":"2024-05-14T15:19:11.590311+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:52.453137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.854824+0000","last_change":"2024-05-14T15:16:22.912295+0000","last_active":"2024-05-14T15:17:43.854824+0000","last_peered":"2024-05-14T15:17:43.854824+0000","last_clean":"2024-05-14T15:17:43.854824+0000","last_became_active":"2024-05-14T15:16:22.911779+0000","last_became_peered":"2024-05-14T15:16:22.911779+0000","last_unstale":"2024-05-14T15:17:43.854824+0000","last_undegraded":"2024-05-14T15:17:43.854824+0000","last_fullsized":"2024-05-14T15:17:43.854824+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:47:45.153619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.845464+0000","last_change":"2024-05-14T15:16:03.729590+0000","last_active":"2024-05-14T15:17:43.845464+0000","last_peered":"2024-05-14T15:17:43.845464+0000","last_clean":"2024-05-14T15:17:43.845464+0000","last_became_active":"2024-05-14T15:16:03.727790+0000","last_became_peered":"2024-05-14T15:16:03.727790+0000","last_unstale":"2024-05-14T15:17:43.845464+0000","last_undegraded":"2024-05-14T15:17:43.845464+0000","last_fullsized":"2024-05-14T15:17:43.845464+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:13:31.960505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.590402+0000","last_change":"2024-05-14T15:16:08.789872+0000","last_active":"2024-05-14T15:19:11.590402+0000","last_peered":"2024-05-14T15:19:11.590402+0000","last_clean":"2024-05-14T15:19:11.590402+0000","last_became_active":"2024-05-14T15:16:08.786817+0000","last_became_peered":"2024-05-14T15:16:08.786817+0000","last_unstale":"2024-05-14T15:19:11.590402+0000","last_undegraded":"2024-05-14T15:19:11.590402+0000","last_fullsized":"2024-05-14T15:19:11.590402+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:09:41.042473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.844697+0000","last_change":"2024-05-14T15:16:22.903302+0000","last_active":"2024-05-14T15:17:43.844697+0000","last_peered":"2024-05-14T15:17:43.844697+0000","last_clean":"2024-05-14T15:17:43.844697+0000","last_became_active":"2024-05-14T15:16:22.902830+0000","last_became_peered":"2024-05-14T15:16:22.902830+0000","last_unstale":"2024-05-14T15:17:43.844697+0000","last_undegraded":"2024-05-14T15:17:43.844697+0000","last_fullsized":"2024-05-14T15:17:43.844697+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:18:57.467319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849264+0000","last_change":"2024-05-14T15:16:03.738372+0000","last_active":"2024-05-14T15:17:43.849264+0000","last_peered":"2024-05-14T15:17:43.849264+0000","last_clean":"2024-05-14T15:17:43.849264+0000","last_became_active":"2024-05-14T15:16:03.737815+0000","last_became_peered":"2024-05-14T15:16:03.737815+0000","last_unstale":"2024-05-14T15:17:43.849264+0000","last_undegraded":"2024-05-14T15:17:43.849264+0000","last_fullsized":"2024-05-14T15:17:43.849264+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:19:19.702318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.594430+0000","last_change":"2024-05-14T15:16:08.781979+0000","last_active":"2024-05-14T15:19:11.594430+0000","last_peered":"2024-05-14T15:19:11.594430+0000","last_clean":"2024-05-14T15:19:11.594430+0000","last_became_active":"2024-05-14T15:16:08.777257+0000","last_became_peered":"2024-05-14T15:16:08.777257+0000","last_unstale":"2024-05-14T15:19:11.594430+0000","last_undegraded":"2024-05-14T15:19:11.594430+0000","last_fullsized":"2024-05-14T15:19:11.594430+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:31.154921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.735719+0000","last_change":"2024-05-14T15:16:22.901107+0000","last_active":"2024-05-14T15:17:43.735719+0000","last_peered":"2024-05-14T15:17:43.735719+0000","last_clean":"2024-05-14T15:17:43.735719+0000","last_became_active":"2024-05-14T15:16:22.900578+0000","last_became_peered":"2024-05-14T15:16:22.900578+0000","last_unstale":"2024-05-14T15:17:43.735719+0000","last_undegraded":"2024-05-14T15:17:43.735719+0000","last_fullsized":"2024-05-14T15:17:43.735719+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:11:23.019455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'6","reported_seq":297,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:40.764005+0000","last_change":"2024-05-14T15:16:03.730145+0000","last_active":"2024-05-14T15:19:40.764005+0000","last_peered":"2024-05-14T15:19:40.764005+0000","last_clean":"2024-05-14T15:19:40.764005+0000","last_became_active":"2024-05-14T15:16:03.728119+0000","last_became_peered":"2024-05-14T15:16:03.728119+0000","last_unstale":"2024-05-14T15:19:40.764005+0000","last_undegraded":"2024-05-14T15:19:40.764005+0000","last_fullsized":"2024-05-14T15:19:40.764005+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:19:57.596282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":246,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.607130+0000","last_change":"2024-05-14T15:16:08.781834+0000","last_active":"2024-05-14T15:19:11.607130+0000","last_peered":"2024-05-14T15:19:11.607130+0000","last_clean":"2024-05-14T15:19:11.607130+0000","last_became_active":"2024-05-14T15:16:08.781451+0000","last_became_peered":"2024-05-14T15:16:08.781451+0000","last_unstale":"2024-05-14T15:19:11.607130+0000","last_undegraded":"2024-05-14T15:19:11.607130+0000","last_fullsized":"2024-05-14T15:19:11.607130+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:17:33.147475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.725340+0000","last_change":"2024-05-14T15:16:22.910711+0000","last_active":"2024-05-14T15:17:43.725340+0000","last_peered":"2024-05-14T15:17:43.725340+0000","last_clean":"2024-05-14T15:17:43.725340+0000","last_became_active":"2024-05-14T15:16:22.910076+0000","last_became_peered":"2024-05-14T15:16:22.910076+0000","last_unstale":"2024-05-14T15:17:43.725340+0000","last_undegraded":"2024-05-14T15:17:43.725340+0000","last_fullsized":"2024-05-14T15:17:43.725340+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:11:05.867547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.739486+0000","last_change":"2024-05-14T15:16:03.736682+0000","last_active":"2024-05-14T15:17:43.739486+0000","last_peered":"2024-05-14T15:17:43.739486+0000","last_clean":"2024-05-14T15:17:43.739486+0000","last_became_active":"2024-05-14T15:16:03.733676+0000","last_became_peered":"2024-05-14T15:16:03.733676+0000","last_unstale":"2024-05-14T15:17:43.739486+0000","last_undegraded":"2024-05-14T15:17:43.739486+0000","last_fullsized":"2024-05-14T15:17:43.739486+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:12:12.814817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.609442+0000","last_change":"2024-05-14T15:16:08.797256+0000","last_active":"2024-05-14T15:19:11.609442+0000","last_peered":"2024-05-14T15:19:11.609442+0000","last_clean":"2024-05-14T15:19:11.609442+0000","last_became_active":"2024-05-14T15:16:08.796675+0000","last_became_peered":"2024-05-14T15:16:08.796675+0000","last_unstale":"2024-05-14T15:19:11.609442+0000","last_undegraded":"2024-05-14T15:19:11.609442+0000","last_fullsized":"2024-05-14T15:19:11.609442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:08.026962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.758761+0000","last_change":"2024-05-14T15:16:22.914775+0000","last_active":"2024-05-14T15:17:43.758761+0000","last_peered":"2024-05-14T15:17:43.758761+0000","last_clean":"2024-05-14T15:17:43.758761+0000","last_became_active":"2024-05-14T15:16:22.912853+0000","last_became_peered":"2024-05-14T15:16:22.912853+0000","last_unstale":"2024-05-14T15:17:43.758761+0000","last_undegraded":"2024-05-14T15:17:43.758761+0000","last_fullsized":"2024-05-14T15:17:43.758761+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:01:11.652074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850088+0000","last_change":"2024-05-14T15:16:03.845365+0000","last_active":"2024-05-14T15:17:43.850088+0000","last_peered":"2024-05-14T15:17:43.850088+0000","last_clean":"2024-05-14T15:17:43.850088+0000","last_became_active":"2024-05-14T15:16:03.842557+0000","last_became_peered":"2024-05-14T15:16:03.842557+0000","last_unstale":"2024-05-14T15:17:43.850088+0000","last_undegraded":"2024-05-14T15:17:43.850088+0000","last_fullsized":"2024-05-14T15:17:43.850088+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:26:21.515074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.595144+0000","last_change":"2024-05-14T15:17:43.855838+0000","last_active":"2024-05-14T15:19:11.595144+0000","last_peered":"2024-05-14T15:19:11.595144+0000","last_clean":"2024-05-14T15:19:11.595144+0000","last_became_active":"2024-05-14T15:17:43.855462+0000","last_became_peered":"2024-05-14T15:17:43.855462+0000","last_unstale":"2024-05-14T15:19:11.595144+0000","last_undegraded":"2024-05-14T15:19:11.595144+0000","last_fullsized":"2024-05-14T15:19:11.595144+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:56:06.442987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,4],"acting":[9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.725983+0000","last_change":"2024-05-14T15:16:22.905266+0000","last_active":"2024-05-14T15:17:43.725983+0000","last_peered":"2024-05-14T15:17:43.725983+0000","last_clean":"2024-05-14T15:17:43.725983+0000","last_became_active":"2024-05-14T15:16:22.903397+0000","last_became_peered":"2024-05-14T15:16:22.903397+0000","last_unstale":"2024-05-14T15:17:43.725983+0000","last_undegraded":"2024-05-14T15:17:43.725983+0000","last_fullsized":"2024-05-14T15:17:43.725983+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:48:37.616028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"91'39","reported_seq":341,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:40.763122+0000","last_change":"2024-05-14T15:16:03.735261+0000","last_active":"2024-05-14T15:19:40.763122+0000","last_peered":"2024-05-14T15:19:40.763122+0000","last_clean":"2024-05-14T15:19:40.763122+0000","last_became_active":"2024-05-14T15:16:03.732725+0000","last_became_peered":"2024-05-14T15:16:03.732725+0000","last_unstale":"2024-05-14T15:19:40.763122+0000","last_undegraded":"2024-05-14T15:19:40.763122+0000","last_fullsized":"2024-05-14T15:19:40.763122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:44:51.777221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66730,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":257,"num_read_kb":193,"num_write":41,"num_write_kb":83,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.595786+0000","last_change":"2024-05-14T15:16:08.783758+0000","last_active":"2024-05-14T15:19:11.595786+0000","last_peered":"2024-05-14T15:19:11.595786+0000","last_clean":"2024-05-14T15:19:11.595786+0000","last_became_active":"2024-05-14T15:16:08.782465+0000","last_became_peered":"2024-05-14T15:16:08.782465+0000","last_unstale":"2024-05-14T15:19:11.595786+0000","last_undegraded":"2024-05-14T15:19:11.595786+0000","last_fullsized":"2024-05-14T15:19:11.595786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:37:36.921823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.851399+0000","last_change":"2024-05-14T15:16:22.899606+0000","last_active":"2024-05-14T15:17:43.851399+0000","last_peered":"2024-05-14T15:17:43.851399+0000","last_clean":"2024-05-14T15:17:43.851399+0000","last_became_active":"2024-05-14T15:16:22.898810+0000","last_became_peered":"2024-05-14T15:16:22.898810+0000","last_unstale":"2024-05-14T15:17:43.851399+0000","last_undegraded":"2024-05-14T15:17:43.851399+0000","last_fullsized":"2024-05-14T15:17:43.851399+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:49:07.068713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":56,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.730491+0000","last_change":"2024-05-14T15:16:03.728561+0000","last_active":"2024-05-14T15:17:43.730491+0000","last_peered":"2024-05-14T15:17:43.730491+0000","last_clean":"2024-05-14T15:17:43.730491+0000","last_became_active":"2024-05-14T15:16:03.727273+0000","last_became_peered":"2024-05-14T15:16:03.727273+0000","last_unstale":"2024-05-14T15:17:43.730491+0000","last_undegraded":"2024-05-14T15:17:43.730491+0000","last_fullsized":"2024-05-14T15:17:43.730491+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:06.487549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.599993+0000","last_change":"2024-05-14T15:16:08.788199+0000","last_active":"2024-05-14T15:19:11.599993+0000","last_peered":"2024-05-14T15:19:11.599993+0000","last_clean":"2024-05-14T15:19:11.599993+0000","last_became_active":"2024-05-14T15:16:08.786477+0000","last_became_peered":"2024-05-14T15:16:08.786477+0000","last_unstale":"2024-05-14T15:19:11.599993+0000","last_undegraded":"2024-05-14T15:19:11.599993+0000","last_fullsized":"2024-05-14T15:19:11.599993+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:40:33.441154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850875+0000","last_change":"2024-05-14T15:16:22.911265+0000","last_active":"2024-05-14T15:17:43.850875+0000","last_peered":"2024-05-14T15:17:43.850875+0000","last_clean":"2024-05-14T15:17:43.850875+0000","last_became_active":"2024-05-14T15:16:22.910297+0000","last_became_peered":"2024-05-14T15:16:22.910297+0000","last_unstale":"2024-05-14T15:17:43.850875+0000","last_undegraded":"2024-05-14T15:17:43.850875+0000","last_fullsized":"2024-05-14T15:17:43.850875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:43:37.894409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.854164+0000","last_change":"2024-05-14T15:16:03.735122+0000","last_active":"2024-05-14T15:17:43.854164+0000","last_peered":"2024-05-14T15:17:43.854164+0000","last_clean":"2024-05-14T15:17:43.854164+0000","last_became_active":"2024-05-14T15:16:03.734746+0000","last_became_peered":"2024-05-14T15:16:03.734746+0000","last_unstale":"2024-05-14T15:17:43.854164+0000","last_undegraded":"2024-05-14T15:17:43.854164+0000","last_fullsized":"2024-05-14T15:17:43.854164+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:36:48.070577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.602725+0000","last_change":"2024-05-14T15:16:08.791427+0000","last_active":"2024-05-14T15:19:11.602725+0000","last_peered":"2024-05-14T15:19:11.602725+0000","last_clean":"2024-05-14T15:19:11.602725+0000","last_became_active":"2024-05-14T15:16:08.791070+0000","last_became_peered":"2024-05-14T15:16:08.791070+0000","last_unstale":"2024-05-14T15:19:11.602725+0000","last_undegraded":"2024-05-14T15:19:11.602725+0000","last_fullsized":"2024-05-14T15:19:11.602725+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:15:13.153055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.726005+0000","last_change":"2024-05-14T15:16:22.896084+0000","last_active":"2024-05-14T15:17:43.726005+0000","last_peered":"2024-05-14T15:17:43.726005+0000","last_clean":"2024-05-14T15:17:43.726005+0000","last_became_active":"2024-05-14T15:16:22.894473+0000","last_became_peered":"2024-05-14T15:16:22.894473+0000","last_unstale":"2024-05-14T15:17:43.726005+0000","last_undegraded":"2024-05-14T15:17:43.726005+0000","last_fullsized":"2024-05-14T15:17:43.726005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:18:18.844423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"91'7","reported_seq":177,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:37.776741+0000","last_change":"2024-05-14T15:16:03.728070+0000","last_active":"2024-05-14T15:19:37.776741+0000","last_peered":"2024-05-14T15:19:37.776741+0000","last_clean":"2024-05-14T15:19:37.776741+0000","last_became_active":"2024-05-14T15:16:03.726155+0000","last_became_peered":"2024-05-14T15:16:03.726155+0000","last_unstale":"2024-05-14T15:19:37.776741+0000","last_undegraded":"2024-05-14T15:19:37.776741+0000","last_fullsized":"2024-05-14T15:19:37.776741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:50:43.447812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":5,"num_write":7,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.595987+0000","last_change":"2024-05-14T15:16:08.787281+0000","last_active":"2024-05-14T15:19:11.595987+0000","last_peered":"2024-05-14T15:19:11.595987+0000","last_clean":"2024-05-14T15:19:11.595987+0000","last_became_active":"2024-05-14T15:16:08.786910+0000","last_became_peered":"2024-05-14T15:16:08.786910+0000","last_unstale":"2024-05-14T15:19:11.595987+0000","last_undegraded":"2024-05-14T15:19:11.595987+0000","last_fullsized":"2024-05-14T15:19:11.595987+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:03:35.421845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846304+0000","last_change":"2024-05-14T15:16:43.066135+0000","last_active":"2024-05-14T15:17:43.846304+0000","last_peered":"2024-05-14T15:17:43.846304+0000","last_clean":"2024-05-14T15:17:43.846304+0000","last_became_active":"2024-05-14T15:16:43.064558+0000","last_became_peered":"2024-05-14T15:16:43.064558+0000","last_unstale":"2024-05-14T15:17:43.846304+0000","last_undegraded":"2024-05-14T15:17:43.846304+0000","last_fullsized":"2024-05-14T15:17:43.846304+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:21:25.441639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":63,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850619+0000","last_change":"2024-05-14T15:16:03.841009+0000","last_active":"2024-05-14T15:17:43.850619+0000","last_peered":"2024-05-14T15:17:43.850619+0000","last_clean":"2024-05-14T15:17:43.850619+0000","last_became_active":"2024-05-14T15:16:03.839514+0000","last_became_peered":"2024-05-14T15:16:03.839514+0000","last_unstale":"2024-05-14T15:17:43.850619+0000","last_undegraded":"2024-05-14T15:17:43.850619+0000","last_fullsized":"2024-05-14T15:17:43.850619+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:34:55.588072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.598735+0000","last_change":"2024-05-14T15:16:08.774343+0000","last_active":"2024-05-14T15:19:11.598735+0000","last_peered":"2024-05-14T15:19:11.598735+0000","last_clean":"2024-05-14T15:19:11.598735+0000","last_became_active":"2024-05-14T15:16:08.773826+0000","last_became_peered":"2024-05-14T15:16:08.773826+0000","last_unstale":"2024-05-14T15:19:11.598735+0000","last_undegraded":"2024-05-14T15:19:11.598735+0000","last_fullsized":"2024-05-14T15:19:11.598735+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:30:51.648019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.849827+0000","last_change":"2024-05-14T15:16:22.889838+0000","last_active":"2024-05-14T15:17:43.849827+0000","last_peered":"2024-05-14T15:17:43.849827+0000","last_clean":"2024-05-14T15:17:43.849827+0000","last_became_active":"2024-05-14T15:16:22.888604+0000","last_became_peered":"2024-05-14T15:16:22.888604+0000","last_unstale":"2024-05-14T15:17:43.849827+0000","last_undegraded":"2024-05-14T15:17:43.849827+0000","last_fullsized":"2024-05-14T15:17:43.849827+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:26:53.176588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"89'2","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.853998+0000","last_change":"2024-05-14T15:16:03.731499+0000","last_active":"2024-05-14T15:17:43.853998+0000","last_peered":"2024-05-14T15:17:43.853998+0000","last_clean":"2024-05-14T15:17:43.853998+0000","last_became_active":"2024-05-14T15:16:03.729387+0000","last_became_peered":"2024-05-14T15:16:03.729387+0000","last_unstale":"2024-05-14T15:17:43.853998+0000","last_undegraded":"2024-05-14T15:17:43.853998+0000","last_fullsized":"2024-05-14T15:17:43.853998+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:52:24.287236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.595621+0000","last_change":"2024-05-14T15:16:08.787376+0000","last_active":"2024-05-14T15:19:11.595621+0000","last_peered":"2024-05-14T15:19:11.595621+0000","last_clean":"2024-05-14T15:19:11.595621+0000","last_became_active":"2024-05-14T15:16:08.786057+0000","last_became_peered":"2024-05-14T15:16:08.786057+0000","last_unstale":"2024-05-14T15:19:11.595621+0000","last_undegraded":"2024-05-14T15:19:11.595621+0000","last_fullsized":"2024-05-14T15:19:11.595621+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:17:16.582656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852720+0000","last_change":"2024-05-14T15:16:23.049639+0000","last_active":"2024-05-14T15:17:43.852720+0000","last_peered":"2024-05-14T15:17:43.852720+0000","last_clean":"2024-05-14T15:17:43.852720+0000","last_became_active":"2024-05-14T15:16:23.047746+0000","last_became_peered":"2024-05-14T15:16:23.047746+0000","last_unstale":"2024-05-14T15:17:43.852720+0000","last_undegraded":"2024-05-14T15:17:43.852720+0000","last_fullsized":"2024-05-14T15:17:43.852720+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:22:27.129466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.726894+0000","last_change":"2024-05-14T15:16:03.842156+0000","last_active":"2024-05-14T15:17:43.726894+0000","last_peered":"2024-05-14T15:17:43.726894+0000","last_clean":"2024-05-14T15:17:43.726894+0000","last_became_active":"2024-05-14T15:16:03.841626+0000","last_became_peered":"2024-05-14T15:16:03.841626+0000","last_unstale":"2024-05-14T15:17:43.726894+0000","last_undegraded":"2024-05-14T15:17:43.726894+0000","last_fullsized":"2024-05-14T15:17:43.726894+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:40.955009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.584567+0000","last_change":"2024-05-14T15:16:08.780632+0000","last_active":"2024-05-14T15:19:11.584567+0000","last_peered":"2024-05-14T15:19:11.584567+0000","last_clean":"2024-05-14T15:19:11.584567+0000","last_became_active":"2024-05-14T15:16:08.779743+0000","last_became_peered":"2024-05-14T15:16:08.779743+0000","last_unstale":"2024-05-14T15:19:11.584567+0000","last_undegraded":"2024-05-14T15:19:11.584567+0000","last_fullsized":"2024-05-14T15:19:11.584567+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:53:45.608716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846149+0000","last_change":"2024-05-14T15:16:22.894512+0000","last_active":"2024-05-14T15:17:43.846149+0000","last_peered":"2024-05-14T15:17:43.846149+0000","last_clean":"2024-05-14T15:17:43.846149+0000","last_became_active":"2024-05-14T15:16:22.893566+0000","last_became_peered":"2024-05-14T15:16:22.893566+0000","last_unstale":"2024-05-14T15:17:43.846149+0000","last_undegraded":"2024-05-14T15:17:43.846149+0000","last_fullsized":"2024-05-14T15:17:43.846149+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:45:39.571364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"91'7","reported_seq":180,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:41.736107+0000","last_change":"2024-05-14T15:16:03.730782+0000","last_active":"2024-05-14T15:19:41.736107+0000","last_peered":"2024-05-14T15:19:41.736107+0000","last_clean":"2024-05-14T15:19:41.736107+0000","last_became_active":"2024-05-14T15:16:03.729703+0000","last_became_peered":"2024-05-14T15:16:03.729703+0000","last_unstale":"2024-05-14T15:19:41.736107+0000","last_undegraded":"2024-05-14T15:19:41.736107+0000","last_fullsized":"2024-05-14T15:19:41.736107+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:30:30.379450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1120,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":128,"num_read_kb":3,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.582829+0000","last_change":"2024-05-14T15:16:08.792362+0000","last_active":"2024-05-14T15:19:11.582829+0000","last_peered":"2024-05-14T15:19:11.582829+0000","last_clean":"2024-05-14T15:19:11.582829+0000","last_became_active":"2024-05-14T15:16:08.791836+0000","last_became_peered":"2024-05-14T15:16:08.791836+0000","last_unstale":"2024-05-14T15:19:11.582829+0000","last_undegraded":"2024-05-14T15:19:11.582829+0000","last_fullsized":"2024-05-14T15:19:11.582829+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:50:07.142474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846404+0000","last_change":"2024-05-14T15:16:23.048324+0000","last_active":"2024-05-14T15:17:43.846404+0000","last_peered":"2024-05-14T15:17:43.846404+0000","last_clean":"2024-05-14T15:17:43.846404+0000","last_became_active":"2024-05-14T15:16:23.047829+0000","last_became_peered":"2024-05-14T15:16:23.047829+0000","last_unstale":"2024-05-14T15:17:43.846404+0000","last_undegraded":"2024-05-14T15:17:43.846404+0000","last_fullsized":"2024-05-14T15:17:43.846404+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:13.018847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.577164+0000","last_change":"2024-05-14T15:16:43.013252+0000","last_active":"2024-05-14T15:19:11.577164+0000","last_peered":"2024-05-14T15:19:11.577164+0000","last_clean":"2024-05-14T15:19:11.577164+0000","last_became_active":"2024-05-14T15:16:43.011962+0000","last_became_peered":"2024-05-14T15:16:43.011962+0000","last_unstale":"2024-05-14T15:19:11.577164+0000","last_undegraded":"2024-05-14T15:19:11.577164+0000","last_fullsized":"2024-05-14T15:19:11.577164+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:06.204259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'6","reported_seq":174,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:38.778255+0000","last_change":"2024-05-14T15:16:03.840983+0000","last_active":"2024-05-14T15:19:38.778255+0000","last_peered":"2024-05-14T15:19:38.778255+0000","last_clean":"2024-05-14T15:19:38.778255+0000","last_became_active":"2024-05-14T15:16:03.839117+0000","last_became_peered":"2024-05-14T15:16:03.839117+0000","last_unstale":"2024-05-14T15:19:38.778255+0000","last_undegraded":"2024-05-14T15:19:38.778255+0000","last_fullsized":"2024-05-14T15:19:38.778255+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:57.163543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":123,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:50.585455+0000","last_change":"2024-05-14T15:16:22.914744+0000","last_active":"2024-05-14T15:17:50.585455+0000","last_peered":"2024-05-14T15:17:50.585455+0000","last_clean":"2024-05-14T15:17:50.585455+0000","last_became_active":"2024-05-14T15:16:22.913661+0000","last_became_peered":"2024-05-14T15:16:22.913661+0000","last_unstale":"2024-05-14T15:17:50.585455+0000","last_undegraded":"2024-05-14T15:17:50.585455+0000","last_fullsized":"2024-05-14T15:17:50.585455+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:45.957828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.606963+0000","last_change":"2024-05-14T15:16:08.791872+0000","last_active":"2024-05-14T15:19:11.606963+0000","last_peered":"2024-05-14T15:19:11.606963+0000","last_clean":"2024-05-14T15:19:11.606963+0000","last_became_active":"2024-05-14T15:16:08.791229+0000","last_became_peered":"2024-05-14T15:16:08.791229+0000","last_unstale":"2024-05-14T15:19:11.606963+0000","last_undegraded":"2024-05-14T15:19:11.606963+0000","last_fullsized":"2024-05-14T15:19:11.606963+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:36:26.391077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.758292+0000","last_change":"2024-05-14T15:16:03.732872+0000","last_active":"2024-05-14T15:17:43.758292+0000","last_peered":"2024-05-14T15:17:43.758292+0000","last_clean":"2024-05-14T15:17:43.758292+0000","last_became_active":"2024-05-14T15:16:03.732188+0000","last_became_peered":"2024-05-14T15:16:03.732188+0000","last_unstale":"2024-05-14T15:17:43.758292+0000","last_undegraded":"2024-05-14T15:17:43.758292+0000","last_fullsized":"2024-05-14T15:17:43.758292+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:20:56.776521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":120,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.737696+0000","last_change":"2024-05-14T15:14:08.407259+0000","last_active":"2024-05-14T15:17:43.737696+0000","last_peered":"2024-05-14T15:17:43.737696+0000","last_clean":"2024-05-14T15:17:43.737696+0000","last_became_active":"2024-05-14T15:14:08.398012+0000","last_became_peered":"2024-05-14T15:14:08.398012+0000","last_unstale":"2024-05-14T15:17:43.737696+0000","last_undegraded":"2024-05-14T15:17:43.737696+0000","last_fullsized":"2024-05-14T15:17:43.737696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:09:04.015044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:09:04.015044+0000","last_clean_scrub_stamp":"2024-05-14T15:09:04.015044+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:37.256490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852327+0000","last_change":"2024-05-14T15:16:23.053989+0000","last_active":"2024-05-14T15:17:43.852327+0000","last_peered":"2024-05-14T15:17:43.852327+0000","last_clean":"2024-05-14T15:17:43.852327+0000","last_became_active":"2024-05-14T15:16:23.052585+0000","last_became_peered":"2024-05-14T15:16:23.052585+0000","last_unstale":"2024-05-14T15:17:43.852327+0000","last_undegraded":"2024-05-14T15:17:43.852327+0000","last_fullsized":"2024-05-14T15:17:43.852327+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:30.104518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.581439+0000","last_change":"2024-05-14T15:16:08.775447+0000","last_active":"2024-05-14T15:19:11.581439+0000","last_peered":"2024-05-14T15:19:11.581439+0000","last_clean":"2024-05-14T15:19:11.581439+0000","last_became_active":"2024-05-14T15:16:08.775055+0000","last_became_peered":"2024-05-14T15:16:08.775055+0000","last_unstale":"2024-05-14T15:19:11.581439+0000","last_undegraded":"2024-05-14T15:19:11.581439+0000","last_fullsized":"2024-05-14T15:19:11.581439+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:57:24.668939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.738150+0000","last_change":"2024-05-14T15:16:03.735221+0000","last_active":"2024-05-14T15:17:43.738150+0000","last_peered":"2024-05-14T15:17:43.738150+0000","last_clean":"2024-05-14T15:17:43.738150+0000","last_became_active":"2024-05-14T15:16:03.731910+0000","last_became_peered":"2024-05-14T15:16:03.731910+0000","last_unstale":"2024-05-14T15:17:43.738150+0000","last_undegraded":"2024-05-14T15:17:43.738150+0000","last_fullsized":"2024-05-14T15:17:43.738150+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:57:18.030308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850483+0000","last_change":"2024-05-14T15:16:22.910564+0000","last_active":"2024-05-14T15:17:43.850483+0000","last_peered":"2024-05-14T15:17:43.850483+0000","last_clean":"2024-05-14T15:17:43.850483+0000","last_became_active":"2024-05-14T15:16:22.910003+0000","last_became_peered":"2024-05-14T15:16:22.910003+0000","last_unstale":"2024-05-14T15:17:43.850483+0000","last_undegraded":"2024-05-14T15:17:43.850483+0000","last_fullsized":"2024-05-14T15:17:43.850483+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:47.895767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.854379+0000","last_change":"2024-05-14T15:16:03.844236+0000","last_active":"2024-05-14T15:17:43.854379+0000","last_peered":"2024-05-14T15:17:43.854379+0000","last_clean":"2024-05-14T15:17:43.854379+0000","last_became_active":"2024-05-14T15:16:03.841253+0000","last_became_peered":"2024-05-14T15:16:03.841253+0000","last_unstale":"2024-05-14T15:17:43.854379+0000","last_undegraded":"2024-05-14T15:17:43.854379+0000","last_fullsized":"2024-05-14T15:17:43.854379+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:40:24.440707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.578789+0000","last_change":"2024-05-14T15:16:08.782849+0000","last_active":"2024-05-14T15:19:11.578789+0000","last_peered":"2024-05-14T15:19:11.578789+0000","last_clean":"2024-05-14T15:19:11.578789+0000","last_became_active":"2024-05-14T15:16:08.781999+0000","last_became_peered":"2024-05-14T15:16:08.781999+0000","last_unstale":"2024-05-14T15:19:11.578789+0000","last_undegraded":"2024-05-14T15:19:11.578789+0000","last_fullsized":"2024-05-14T15:19:11.578789+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:33:03.997615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.737012+0000","last_change":"2024-05-14T15:16:23.049719+0000","last_active":"2024-05-14T15:17:43.737012+0000","last_peered":"2024-05-14T15:17:43.737012+0000","last_clean":"2024-05-14T15:17:43.737012+0000","last_became_active":"2024-05-14T15:16:23.048547+0000","last_became_peered":"2024-05-14T15:16:23.048547+0000","last_unstale":"2024-05-14T15:17:43.737012+0000","last_undegraded":"2024-05-14T15:17:43.737012+0000","last_fullsized":"2024-05-14T15:17:43.737012+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:41:49.790521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"91'17","reported_seq":62,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:18:13.812914+0000","last_change":"2024-05-14T15:16:03.729413+0000","last_active":"2024-05-14T15:18:13.812914+0000","last_peered":"2024-05-14T15:18:13.812914+0000","last_clean":"2024-05-14T15:18:13.812914+0000","last_became_active":"2024-05-14T15:16:03.728491+0000","last_became_peered":"2024-05-14T15:16:03.728491+0000","last_unstale":"2024-05-14T15:18:13.812914+0000","last_undegraded":"2024-05-14T15:18:13.812914+0000","last_fullsized":"2024-05-14T15:18:13.812914+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:34:04.811775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.599442+0000","last_change":"2024-05-14T15:16:08.784237+0000","last_active":"2024-05-14T15:19:11.599442+0000","last_peered":"2024-05-14T15:19:11.599442+0000","last_clean":"2024-05-14T15:19:11.599442+0000","last_became_active":"2024-05-14T15:16:08.783908+0000","last_became_peered":"2024-05-14T15:16:08.783908+0000","last_unstale":"2024-05-14T15:19:11.599442+0000","last_undegraded":"2024-05-14T15:19:11.599442+0000","last_fullsized":"2024-05-14T15:19:11.599442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:43:24.621314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.729639+0000","last_change":"2024-05-14T15:16:22.909928+0000","last_active":"2024-05-14T15:17:43.729639+0000","last_peered":"2024-05-14T15:17:43.729639+0000","last_clean":"2024-05-14T15:17:43.729639+0000","last_became_active":"2024-05-14T15:16:22.909412+0000","last_became_peered":"2024-05-14T15:16:22.909412+0000","last_unstale":"2024-05-14T15:17:43.729639+0000","last_undegraded":"2024-05-14T15:17:43.729639+0000","last_fullsized":"2024-05-14T15:17:43.729639+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:18:26.324189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.759969+0000","last_change":"2024-05-14T15:16:03.729846+0000","last_active":"2024-05-14T15:17:43.759969+0000","last_peered":"2024-05-14T15:17:43.759969+0000","last_clean":"2024-05-14T15:17:43.759969+0000","last_became_active":"2024-05-14T15:16:03.729385+0000","last_became_peered":"2024-05-14T15:16:03.729385+0000","last_unstale":"2024-05-14T15:17:43.759969+0000","last_undegraded":"2024-05-14T15:17:43.759969+0000","last_fullsized":"2024-05-14T15:17:43.759969+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:05:18.987237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.606967+0000","last_change":"2024-05-14T15:16:08.796017+0000","last_active":"2024-05-14T15:19:11.606967+0000","last_peered":"2024-05-14T15:19:11.606967+0000","last_clean":"2024-05-14T15:19:11.606967+0000","last_became_active":"2024-05-14T15:16:08.791627+0000","last_became_peered":"2024-05-14T15:16:08.791627+0000","last_unstale":"2024-05-14T15:19:11.606967+0000","last_undegraded":"2024-05-14T15:19:11.606967+0000","last_fullsized":"2024-05-14T15:19:11.606967+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:46:27.910669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.759233+0000","last_change":"2024-05-14T15:16:23.052954+0000","last_active":"2024-05-14T15:17:43.759233+0000","last_peered":"2024-05-14T15:17:43.759233+0000","last_clean":"2024-05-14T15:17:43.759233+0000","last_became_active":"2024-05-14T15:16:23.051410+0000","last_became_peered":"2024-05-14T15:16:23.051410+0000","last_unstale":"2024-05-14T15:17:43.759233+0000","last_undegraded":"2024-05-14T15:17:43.759233+0000","last_fullsized":"2024-05-14T15:17:43.759233+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:28:55.181866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.727212+0000","last_change":"2024-05-14T15:16:43.023961+0000","last_active":"2024-05-14T15:17:43.727212+0000","last_peered":"2024-05-14T15:17:43.727212+0000","last_clean":"2024-05-14T15:17:43.727212+0000","last_became_active":"2024-05-14T15:16:43.022677+0000","last_became_peered":"2024-05-14T15:16:43.022677+0000","last_unstale":"2024-05-14T15:17:43.727212+0000","last_undegraded":"2024-05-14T15:17:43.727212+0000","last_fullsized":"2024-05-14T15:17:43.727212+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:33:16.692984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.535255+0000","last_change":"2024-05-14T15:16:08.780415+0000","last_active":"2024-05-14T15:19:11.535255+0000","last_peered":"2024-05-14T15:19:11.535255+0000","last_clean":"2024-05-14T15:19:11.535255+0000","last_became_active":"2024-05-14T15:16:08.780053+0000","last_became_peered":"2024-05-14T15:16:08.780053+0000","last_unstale":"2024-05-14T15:19:11.535255+0000","last_undegraded":"2024-05-14T15:19:11.535255+0000","last_fullsized":"2024-05-14T15:19:11.535255+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:18:00.964346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":17,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.853758+0000","last_change":"2024-05-14T15:16:43.066458+0000","last_active":"2024-05-14T15:17:43.853758+0000","last_peered":"2024-05-14T15:17:43.853758+0000","last_clean":"2024-05-14T15:17:43.853758+0000","last_became_active":"2024-05-14T15:16:43.064035+0000","last_became_peered":"2024-05-14T15:16:43.064035+0000","last_unstale":"2024-05-14T15:17:43.853758+0000","last_undegraded":"2024-05-14T15:17:43.853758+0000","last_fullsized":"2024-05-14T15:17:43.853758+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:38:39.895882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":52,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.735934+0000","last_change":"2024-05-14T15:16:03.731962+0000","last_active":"2024-05-14T15:17:43.735934+0000","last_peered":"2024-05-14T15:17:43.735934+0000","last_clean":"2024-05-14T15:17:43.735934+0000","last_became_active":"2024-05-14T15:16:03.726532+0000","last_became_peered":"2024-05-14T15:16:03.726532+0000","last_unstale":"2024-05-14T15:17:43.735934+0000","last_undegraded":"2024-05-14T15:17:43.735934+0000","last_fullsized":"2024-05-14T15:17:43.735934+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:47:26.809212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.611862+0000","last_change":"2024-05-14T15:16:08.798984+0000","last_active":"2024-05-14T15:19:11.611862+0000","last_peered":"2024-05-14T15:19:11.611862+0000","last_clean":"2024-05-14T15:19:11.611862+0000","last_became_active":"2024-05-14T15:16:08.798120+0000","last_became_peered":"2024-05-14T15:16:08.798120+0000","last_unstale":"2024-05-14T15:19:11.611862+0000","last_undegraded":"2024-05-14T15:19:11.611862+0000","last_fullsized":"2024-05-14T15:19:11.611862+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:58.519436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":30,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:58.931592+0000","last_change":"2024-05-14T15:16:22.907994+0000","last_active":"2024-05-14T15:17:58.931592+0000","last_peered":"2024-05-14T15:17:58.931592+0000","last_clean":"2024-05-14T15:17:58.931592+0000","last_became_active":"2024-05-14T15:16:22.907144+0000","last_became_peered":"2024-05-14T15:16:22.907144+0000","last_unstale":"2024-05-14T15:17:58.931592+0000","last_undegraded":"2024-05-14T15:17:58.931592+0000","last_fullsized":"2024-05-14T15:17:58.931592+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:49:11.436917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"89'3","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.729953+0000","last_change":"2024-05-14T15:16:03.728334+0000","last_active":"2024-05-14T15:17:43.729953+0000","last_peered":"2024-05-14T15:17:43.729953+0000","last_clean":"2024-05-14T15:17:43.729953+0000","last_became_active":"2024-05-14T15:16:03.727836+0000","last_became_peered":"2024-05-14T15:16:03.727836+0000","last_unstale":"2024-05-14T15:17:43.729953+0000","last_undegraded":"2024-05-14T15:17:43.729953+0000","last_fullsized":"2024-05-14T15:17:43.729953+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:54.780821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.607890+0000","last_change":"2024-05-14T15:16:08.798340+0000","last_active":"2024-05-14T15:19:11.607890+0000","last_peered":"2024-05-14T15:19:11.607890+0000","last_clean":"2024-05-14T15:19:11.607890+0000","last_became_active":"2024-05-14T15:16:08.797981+0000","last_became_peered":"2024-05-14T15:16:08.797981+0000","last_unstale":"2024-05-14T15:19:11.607890+0000","last_undegraded":"2024-05-14T15:19:11.607890+0000","last_fullsized":"2024-05-14T15:19:11.607890+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:04:08.322033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.759737+0000","last_change":"2024-05-14T15:16:23.050064+0000","last_active":"2024-05-14T15:17:43.759737+0000","last_peered":"2024-05-14T15:17:43.759737+0000","last_clean":"2024-05-14T15:17:43.759737+0000","last_became_active":"2024-05-14T15:16:23.048608+0000","last_became_peered":"2024-05-14T15:16:23.048608+0000","last_unstale":"2024-05-14T15:17:43.759737+0000","last_undegraded":"2024-05-14T15:17:43.759737+0000","last_fullsized":"2024-05-14T15:17:43.759737+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:32.044226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.852461+0000","last_change":"2024-05-14T15:16:03.734588+0000","last_active":"2024-05-14T15:17:43.852461+0000","last_peered":"2024-05-14T15:17:43.852461+0000","last_clean":"2024-05-14T15:17:43.852461+0000","last_became_active":"2024-05-14T15:16:03.734112+0000","last_became_peered":"2024-05-14T15:16:03.734112+0000","last_unstale":"2024-05-14T15:17:43.852461+0000","last_undegraded":"2024-05-14T15:17:43.852461+0000","last_fullsized":"2024-05-14T15:17:43.852461+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:07:56.545225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":44,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.608108+0000","last_change":"2024-05-14T15:16:08.789481+0000","last_active":"2024-05-14T15:19:11.608108+0000","last_peered":"2024-05-14T15:19:11.608108+0000","last_clean":"2024-05-14T15:19:11.608108+0000","last_became_active":"2024-05-14T15:16:08.788462+0000","last_became_peered":"2024-05-14T15:16:08.788462+0000","last_unstale":"2024-05-14T15:19:11.608108+0000","last_undegraded":"2024-05-14T15:19:11.608108+0000","last_fullsized":"2024-05-14T15:19:11.608108+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:35:06.386410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.727351+0000","last_change":"2024-05-14T15:16:22.903205+0000","last_active":"2024-05-14T15:17:43.727351+0000","last_peered":"2024-05-14T15:17:43.727351+0000","last_clean":"2024-05-14T15:17:43.727351+0000","last_became_active":"2024-05-14T15:16:22.901217+0000","last_became_peered":"2024-05-14T15:16:22.901217+0000","last_unstale":"2024-05-14T15:17:43.727351+0000","last_undegraded":"2024-05-14T15:17:43.727351+0000","last_fullsized":"2024-05-14T15:17:43.727351+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:03:59.160106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'7","reported_seq":181,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:41.780106+0000","last_change":"2024-05-14T15:16:03.840601+0000","last_active":"2024-05-14T15:19:41.780106+0000","last_peered":"2024-05-14T15:19:41.780106+0000","last_clean":"2024-05-14T15:19:41.780106+0000","last_became_active":"2024-05-14T15:16:03.839299+0000","last_became_peered":"2024-05-14T15:16:03.839299+0000","last_unstale":"2024-05-14T15:19:41.780106+0000","last_undegraded":"2024-05-14T15:19:41.780106+0000","last_fullsized":"2024-05-14T15:19:41.780106+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:35:46.773419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1702,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":129,"num_read_kb":4,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.608216+0000","last_change":"2024-05-14T15:16:08.782915+0000","last_active":"2024-05-14T15:19:11.608216+0000","last_peered":"2024-05-14T15:19:11.608216+0000","last_clean":"2024-05-14T15:19:11.608216+0000","last_became_active":"2024-05-14T15:16:08.782469+0000","last_became_peered":"2024-05-14T15:16:08.782469+0000","last_unstale":"2024-05-14T15:19:11.608216+0000","last_undegraded":"2024-05-14T15:19:11.608216+0000","last_fullsized":"2024-05-14T15:19:11.608216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:36:35.361723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":36,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.844690+0000","last_change":"2024-05-14T15:16:43.021276+0000","last_active":"2024-05-14T15:17:43.844690+0000","last_peered":"2024-05-14T15:17:43.844690+0000","last_clean":"2024-05-14T15:17:43.844690+0000","last_became_active":"2024-05-14T15:16:43.020534+0000","last_became_peered":"2024-05-14T15:16:43.020534+0000","last_unstale":"2024-05-14T15:17:43.844690+0000","last_undegraded":"2024-05-14T15:17:43.844690+0000","last_fullsized":"2024-05-14T15:17:43.844690+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:31:01.267429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"89'3","reported_seq":49,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.850735+0000","last_change":"2024-05-14T15:16:03.728379+0000","last_active":"2024-05-14T15:17:43.850735+0000","last_peered":"2024-05-14T15:17:43.850735+0000","last_clean":"2024-05-14T15:17:43.850735+0000","last_became_active":"2024-05-14T15:16:03.727580+0000","last_became_peered":"2024-05-14T15:16:03.727580+0000","last_unstale":"2024-05-14T15:17:43.850735+0000","last_undegraded":"2024-05-14T15:17:43.850735+0000","last_fullsized":"2024-05-14T15:17:43.850735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:54:20.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.585086+0000","last_change":"2024-05-14T15:17:43.854489+0000","last_active":"2024-05-14T15:19:11.585086+0000","last_peered":"2024-05-14T15:19:11.585086+0000","last_clean":"2024-05-14T15:19:11.585086+0000","last_became_active":"2024-05-14T15:17:43.853624+0000","last_became_peered":"2024-05-14T15:17:43.853624+0000","last_unstale":"2024-05-14T15:19:11.585086+0000","last_undegraded":"2024-05-14T15:19:11.585086+0000","last_fullsized":"2024-05-14T15:19:11.585086+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:59.686248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":29,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.848677+0000","last_change":"2024-05-14T15:16:22.911248+0000","last_active":"2024-05-14T15:17:43.848677+0000","last_peered":"2024-05-14T15:17:43.848677+0000","last_clean":"2024-05-14T15:17:43.848677+0000","last_became_active":"2024-05-14T15:16:22.909975+0000","last_became_peered":"2024-05-14T15:16:22.909975+0000","last_unstale":"2024-05-14T15:17:43.848677+0000","last_undegraded":"2024-05-14T15:17:43.848677+0000","last_fullsized":"2024-05-14T15:17:43.848677+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:23.140008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:17:43.846178+0000","last_change":"2024-05-14T15:16:03.728422+0000","last_active":"2024-05-14T15:17:43.846178+0000","last_peered":"2024-05-14T15:17:43.846178+0000","last_clean":"2024-05-14T15:17:43.846178+0000","last_became_active":"2024-05-14T15:16:03.727428+0000","last_became_peered":"2024-05-14T15:16:03.727428+0000","last_unstale":"2024-05-14T15:17:43.846178+0000","last_undegraded":"2024-05-14T15:17:43.846178+0000","last_fullsized":"2024-05-14T15:17:43.846178+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:37:15.472001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.596510+0000","last_change":"2024-05-14T15:16:08.782158+0000","last_active":"2024-05-14T15:19:11.596510+0000","last_peered":"2024-05-14T15:19:11.596510+0000","last_clean":"2024-05-14T15:19:11.596510+0000","last_became_active":"2024-05-14T15:16:08.781761+0000","last_became_peered":"2024-05-14T15:16:08.781761+0000","last_unstale":"2024-05-14T15:19:11.596510+0000","last_undegraded":"2024-05-14T15:19:11.596510+0000","last_fullsized":"2024-05-14T15:19:11.596510+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:01:42.886837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":48,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.593080+0000","last_change":"2024-05-14T15:16:08.789851+0000","last_active":"2024-05-14T15:19:11.593080+0000","last_peered":"2024-05-14T15:19:11.593080+0000","last_clean":"2024-05-14T15:19:11.593080+0000","last_became_active":"2024-05-14T15:16:08.787563+0000","last_became_peered":"2024-05-14T15:16:08.787563+0000","last_unstale":"2024-05-14T15:19:11.593080+0000","last_undegraded":"2024-05-14T15:19:11.593080+0000","last_fullsized":"2024-05-14T15:19:11.593080+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:02:16.592481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":51,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.590431+0000","last_change":"2024-05-14T15:16:08.788989+0000","last_active":"2024-05-14T15:19:11.590431+0000","last_peered":"2024-05-14T15:19:11.590431+0000","last_clean":"2024-05-14T15:19:11.590431+0000","last_became_active":"2024-05-14T15:16:08.785064+0000","last_became_peered":"2024-05-14T15:16:08.785064+0000","last_unstale":"2024-05-14T15:19:11.590431+0000","last_undegraded":"2024-05-14T15:19:11.590431+0000","last_fullsized":"2024-05-14T15:19:11.590431+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:12:30.824113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.581343+0000","last_change":"2024-05-14T15:16:08.785849+0000","last_active":"2024-05-14T15:19:11.581343+0000","last_peered":"2024-05-14T15:19:11.581343+0000","last_clean":"2024-05-14T15:19:11.581343+0000","last_became_active":"2024-05-14T15:16:08.785487+0000","last_became_peered":"2024-05-14T15:16:08.785487+0000","last_unstale":"2024-05-14T15:19:11.581343+0000","last_undegraded":"2024-05-14T15:19:11.581343+0000","last_fullsized":"2024-05-14T15:19:11.581343+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:37:16.435154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":46,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.606248+0000","last_change":"2024-05-14T15:16:08.787843+0000","last_active":"2024-05-14T15:19:11.606248+0000","last_peered":"2024-05-14T15:19:11.606248+0000","last_clean":"2024-05-14T15:19:11.606248+0000","last_became_active":"2024-05-14T15:16:08.787485+0000","last_became_peered":"2024-05-14T15:16:08.787485+0000","last_unstale":"2024-05-14T15:19:11.606248+0000","last_undegraded":"2024-05-14T15:19:11.606248+0000","last_fullsized":"2024-05-14T15:19:11.606248+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:16:06.625923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":43,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.609397+0000","last_change":"2024-05-14T15:16:08.784870+0000","last_active":"2024-05-14T15:19:11.609397+0000","last_peered":"2024-05-14T15:19:11.609397+0000","last_clean":"2024-05-14T15:19:11.609397+0000","last_became_active":"2024-05-14T15:16:08.782496+0000","last_became_peered":"2024-05-14T15:16:08.782496+0000","last_unstale":"2024-05-14T15:19:11.609397+0000","last_undegraded":"2024-05-14T15:19:11.609397+0000","last_fullsized":"2024-05-14T15:19:11.609397+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:54:33.724823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":45,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.593144+0000","last_change":"2024-05-14T15:16:08.783203+0000","last_active":"2024-05-14T15:19:11.593144+0000","last_peered":"2024-05-14T15:19:11.593144+0000","last_clean":"2024-05-14T15:19:11.593144+0000","last_became_active":"2024-05-14T15:16:08.782758+0000","last_became_peered":"2024-05-14T15:16:08.782758+0000","last_unstale":"2024-05-14T15:19:11.593144+0000","last_undegraded":"2024-05-14T15:19:11.593144+0000","last_fullsized":"2024-05-14T15:19:11.593144+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:34:33.274511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":54,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.608227+0000","last_change":"2024-05-14T15:16:08.789727+0000","last_active":"2024-05-14T15:19:11.608227+0000","last_peered":"2024-05-14T15:19:11.608227+0000","last_clean":"2024-05-14T15:19:11.608227+0000","last_became_active":"2024-05-14T15:16:08.784434+0000","last_became_peered":"2024-05-14T15:16:08.784434+0000","last_unstale":"2024-05-14T15:19:11.608227+0000","last_undegraded":"2024-05-14T15:19:11.608227+0000","last_fullsized":"2024-05-14T15:19:11.608227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:59:19.835381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":41,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.586736+0000","last_change":"2024-05-14T15:16:08.781887+0000","last_active":"2024-05-14T15:19:11.586736+0000","last_peered":"2024-05-14T15:19:11.586736+0000","last_clean":"2024-05-14T15:19:11.586736+0000","last_became_active":"2024-05-14T15:16:08.781332+0000","last_became_peered":"2024-05-14T15:16:08.781332+0000","last_unstale":"2024-05-14T15:19:11.586736+0000","last_undegraded":"2024-05-14T15:19:11.586736+0000","last_fullsized":"2024-05-14T15:19:11.586736+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:51:36.558485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":22,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.596755+0000","last_change":"2024-05-14T15:16:43.065016+0000","last_active":"2024-05-14T15:19:11.596755+0000","last_peered":"2024-05-14T15:19:11.596755+0000","last_clean":"2024-05-14T15:19:11.596755+0000","last_became_active":"2024-05-14T15:16:43.063786+0000","last_became_peered":"2024-05-14T15:16:43.063786+0000","last_unstale":"2024-05-14T15:19:11.596755+0000","last_undegraded":"2024-05-14T15:19:11.596755+0000","last_fullsized":"2024-05-14T15:19:11.596755+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:01:54.920710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":47,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.588889+0000","last_change":"2024-05-14T15:16:08.794288+0000","last_active":"2024-05-14T15:19:11.588889+0000","last_peered":"2024-05-14T15:19:11.588889+0000","last_clean":"2024-05-14T15:19:11.588889+0000","last_became_active":"2024-05-14T15:16:08.792059+0000","last_became_peered":"2024-05-14T15:16:08.792059+0000","last_unstale":"2024-05-14T15:19:11.588889+0000","last_undegraded":"2024-05-14T15:19:11.588889+0000","last_fullsized":"2024-05-14T15:19:11.588889+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:30:55.769322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":55,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.608642+0000","last_change":"2024-05-14T15:17:43.858583+0000","last_active":"2024-05-14T15:19:11.608642+0000","last_peered":"2024-05-14T15:19:11.608642+0000","last_clean":"2024-05-14T15:19:11.608642+0000","last_became_active":"2024-05-14T15:17:43.857287+0000","last_became_peered":"2024-05-14T15:17:43.857287+0000","last_unstale":"2024-05-14T15:19:11.608642+0000","last_undegraded":"2024-05-14T15:19:11.608642+0000","last_fullsized":"2024-05-14T15:19:11.608642+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:12:31.471747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":50,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.610936+0000","last_change":"2024-05-14T15:16:08.786726+0000","last_active":"2024-05-14T15:19:11.610936+0000","last_peered":"2024-05-14T15:19:11.610936+0000","last_clean":"2024-05-14T15:19:11.610936+0000","last_became_active":"2024-05-14T15:16:08.785599+0000","last_became_peered":"2024-05-14T15:16:08.785599+0000","last_unstale":"2024-05-14T15:19:11.610936+0000","last_undegraded":"2024-05-14T15:19:11.610936+0000","last_fullsized":"2024-05-14T15:19:11.610936+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:33:18.055459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":53,"reported_epoch":91,"state":"active+clean","last_fresh":"2024-05-14T15:19:11.587388+0000","last_change":"2024-05-14T15:16:43.022021+0000","last_active":"2024-05-14T15:19:11.587388+0000","last_peered":"2024-05-14T15:19:11.587388+0000","last_clean":"2024-05-14T15:19:11.587388+0000","last_became_active":"2024-05-14T15:16:43.021511+0000","last_became_peered":"2024-05-14T15:16:43.021511+0000","last_unstale":"2024-05-14T15:19:11.587388+0000","last_undegraded":"2024-05-14T15:19:11.587388+0000","last_fullsized":"2024-05-14T15:19:11.587388+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:59:55.083356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":75280,"num_objects":98,"num_object_clones":0,"num_object_copies":294,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":1277,"num_read_kb":720,"num_write":266,"num_write_kb":159,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":225840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645375,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1056768,"data_stored":526638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841606,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32892,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712260,"statfs":{"total":95995035648,"available":95961354240,"internally_reserved":0,"allocated":1757184,"data_stored":1180184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005134,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28076,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717076,"statfs":{"total":95995035648,"available":95966285824,"internally_reserved":0,"allocated":1085440,"data_stored":530132,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201366,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1077248,"data_stored":526414,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430301,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32812,"kb_used_data":1636,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712340,"statfs":{"total":95995035648,"available":95961436160,"internally_reserved":0,"allocated":1675264,"data_stored":1124116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593829,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32208,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712944,"statfs":{"total":95995035648,"available":95962054656,"internally_reserved":0,"allocated":1056768,"data_stored":522072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574986,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32280,"kb_used_data":1104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712872,"statfs":{"total":95995035648,"available":95961980928,"internally_reserved":0,"allocated":1130496,"data_stored":589832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738514,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32232,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712920,"statfs":{"total":95995035648,"available":95962030080,"internally_reserved":0,"allocated":1081344,"data_stored":523528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411459,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28140,"kb_used_data":1124,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717012,"statfs":{"total":95995035648,"available":95966220288,"internally_reserved":0,"allocated":1150976,"data_stored":590584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182523,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32220,"kb_used_data":1044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712932,"statfs":{"total":95995035648,"available":95962042368,"internally_reserved":0,"allocated":1069056,"data_stored":521248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986292,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36376,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708776,"statfs":{"total":95995035648,"available":95957786624,"internally_reserved":0,"allocated":1064960,"data_stored":526146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790061,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32820,"kb_used_data":1644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712332,"statfs":{"total":95995035648,"available":95961427968,"internally_reserved":0,"allocated":1683456,"data_stored":1118634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":2710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":69014,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":110592,"data_stored":69766,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":430,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":3352,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1254,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":4738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1500,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":68998,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:19:46.076 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-14T15:19:46.076 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-14T15:19:46.076 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-14T15:19:46.077 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph health --format=json 2024-05-14T15:19:46.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:46 smithi203 ceph-mon[34567]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:19:46.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:46 smithi092 ceph-mon[34729]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:19:46.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:46 smithi069 ceph-mon[31270]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:19:46.571 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:47.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:47 smithi203 ceph-mon[34567]: pgmap v503: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:19:47.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:47 smithi092 ceph-mon[34729]: pgmap v503: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:19:47.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:47 smithi069 ceph-mon[31270]: pgmap v503: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:19:49.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.113+0000 7fb967000700 1 -- 172.21.15.69:0/375509632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb96010af50 msgr2=0x7fb96010b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:49.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.113+0000 7fb967000700 1 --2- 172.21.15.69:0/375509632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb96010af50 0x7fb96010b360 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0099c0 tx=0x7fb94c009cd0 comp rx=0 tx=0).stop 2024-05-14T15:19:49.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.113+0000 7fb967000700 1 -- 172.21.15.69:0/375509632 shutdown_connections 2024-05-14T15:19:49.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.113+0000 7fb967000700 1 --2- 172.21.15.69:0/375509632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb96010b8a0 0x7fb960113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:49.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.113+0000 7fb967000700 1 --2- 172.21.15.69:0/375509632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb960106620 0x7fb960106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:49.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.113+0000 7fb967000700 1 --2- 172.21.15.69:0/375509632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb96010af50 0x7fb96010b360 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:49.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.113+0000 7fb967000700 1 -- 172.21.15.69:0/375509632 >> 172.21.15.69:0/375509632 conn(0x7fb960102030 msgr2=0x7fb960104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:49.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.113+0000 7fb967000700 1 -- 172.21.15.69:0/375509632 shutdown_connections 2024-05-14T15:19:49.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.113+0000 7fb967000700 1 -- 172.21.15.69:0/375509632 wait complete. 2024-05-14T15:19:49.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.115+0000 7fb967000700 1 Processor -- start 2024-05-14T15:19:49.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.115+0000 7fb967000700 1 -- start start 2024-05-14T15:19:49.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.115+0000 7fb967000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb960106620 0x7fb96019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:49.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.116+0000 7fb967000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb96010af50 0x7fb96019d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:49.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.116+0000 7fb967000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb96010b8a0 0x7fb9601a15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:49.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.116+0000 7fb967000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb960116360 con 0x7fb96010af50 2024-05-14T15:19:49.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.116+0000 7fb967000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb9601161e0 con 0x7fb96010b8a0 2024-05-14T15:19:49.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.116+0000 7fb967000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb9601164e0 con 0x7fb960106620 2024-05-14T15:19:49.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.116+0000 7fb965200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb96010af50 0x7fb96019d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:49.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.116+0000 7fb965200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb96010af50 0x7fb96019d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43848/0 (socket says 172.21.15.69:43848) 2024-05-14T15:19:49.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.116+0000 7fb965200700 1 -- 172.21.15.69:0/3873113412 learned_addr learned my addr 172.21.15.69:0/3873113412 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:49.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.116+0000 7fb965c00700 1 --2- 172.21.15.69:0/3873113412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb960106620 0x7fb96019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:49.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.116+0000 7fb966600700 1 --2- 172.21.15.69:0/3873113412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb96010b8a0 0x7fb9601a15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:49.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.116+0000 7fb965200700 1 -- 172.21.15.69:0/3873113412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb960106620 msgr2=0x7fb96019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:49.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.116+0000 7fb965200700 1 --2- 172.21.15.69:0/3873113412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb960106620 0x7fb96019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:49.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.116+0000 7fb965200700 1 -- 172.21.15.69:0/3873113412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb96010b8a0 msgr2=0x7fb9601a15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:49.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.116+0000 7fb965200700 1 --2- 172.21.15.69:0/3873113412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb96010b8a0 0x7fb9601a15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:49.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.117+0000 7fb965200700 1 -- 172.21.15.69:0/3873113412 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9601a1bb0 con 0x7fb96010af50 2024-05-14T15:19:49.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.117+0000 7fb965c00700 1 --2- 172.21.15.69:0/3873113412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb960106620 0x7fb96019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:19:49.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.117+0000 7fb966600700 1 --2- 172.21.15.69:0/3873113412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb96010b8a0 0x7fb9601a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:19:49.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.117+0000 7fb965200700 1 --2- 172.21.15.69:0/3873113412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb96010af50 0x7fb96019d330 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00b580 tx=0x7fb94c00f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:49.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.117+0000 7fb95e000700 1 -- 172.21.15.69:0/3873113412 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c026070 con 0x7fb96010af50 2024-05-14T15:19:49.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.117+0000 7fb95e000700 1 -- 172.21.15.69:0/3873113412 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb94c005030 con 0x7fb96010af50 2024-05-14T15:19:49.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.117+0000 7fb95e000700 1 -- 172.21.15.69:0/3873113412 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c0049f0 con 0x7fb96010af50 2024-05-14T15:19:49.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.117+0000 7fb967000700 1 -- 172.21.15.69:0/3873113412 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9601a1e40 con 0x7fb96010af50 2024-05-14T15:19:49.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.118+0000 7fb967000700 1 -- 172.21.15.69:0/3873113412 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9601a2370 con 0x7fb96010af50 2024-05-14T15:19:49.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.120+0000 7fb967000700 1 -- 172.21.15.69:0/3873113412 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9600512c0 con 0x7fb96010af50 2024-05-14T15:19:49.119 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:49 smithi069 ceph-mon[31270]: pgmap v504: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-05-14T15:19:49.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.122+0000 7fb95e000700 1 -- 172.21.15.69:0/3873113412 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb94c029070 con 0x7fb96010af50 2024-05-14T15:19:49.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.123+0000 7fb95e000700 1 --2- 172.21.15.69:0/3873113412 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb9480b2900 0x7fb9480b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:49.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.123+0000 7fb95e000700 1 -- 172.21.15.69:0/3873113412 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fb94c0e2fe0 con 0x7fb96010af50 2024-05-14T15:19:49.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.123+0000 7fb965c00700 1 --2- 172.21.15.69:0/3873113412 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb9480b2900 0x7fb9480b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:49.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.124+0000 7fb965c00700 1 --2- 172.21.15.69:0/3873113412 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb9480b2900 0x7fb9480b4e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb954005950 tx=0x7fb9540058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:49.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.128+0000 7fb95e000700 1 -- 172.21.15.69:0/3873113412 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb94c013070 con 0x7fb96010af50 2024-05-14T15:19:49.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:49 smithi203 ceph-mon[34567]: pgmap v504: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-05-14T15:19:49.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.413+0000 7fb967000700 1 -- 172.21.15.69:0/3873113412 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fb96019e0f0 con 0x7fb96010af50 2024-05-14T15:19:49.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.414+0000 7fb95e000700 1 -- 172.21.15.69:0/3873113412 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fb94c0aa9c0 con 0x7fb96010af50 2024-05-14T15:19:49.414 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:19:49.414 INFO:teuthology.orchestra.run.smithi069.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-14T15:19:49.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.417+0000 7fb967000700 1 -- 172.21.15.69:0/3873113412 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb9480b2900 msgr2=0x7fb9480b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:49.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.417+0000 7fb967000700 1 --2- 172.21.15.69:0/3873113412 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb9480b2900 0x7fb9480b4e10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb954005950 tx=0x7fb9540058e0 comp rx=0 tx=0).stop 2024-05-14T15:19:49.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.417+0000 7fb967000700 1 -- 172.21.15.69:0/3873113412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb96010af50 msgr2=0x7fb96019d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:49.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.417+0000 7fb967000700 1 --2- 172.21.15.69:0/3873113412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb96010af50 0x7fb96019d330 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb94c00b580 tx=0x7fb94c00f510 comp rx=0 tx=0).stop 2024-05-14T15:19:49.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.417+0000 7fb967000700 1 -- 172.21.15.69:0/3873113412 shutdown_connections 2024-05-14T15:19:49.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.417+0000 7fb967000700 1 --2- 172.21.15.69:0/3873113412 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb9480b2900 0x7fb9480b4e10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:49.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.417+0000 7fb967000700 1 --2- 172.21.15.69:0/3873113412 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb96010b8a0 0x7fb9601a15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:49.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.417+0000 7fb967000700 1 --2- 172.21.15.69:0/3873113412 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb960106620 0x7fb96019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:49.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.417+0000 7fb967000700 1 --2- 172.21.15.69:0/3873113412 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb96010af50 0x7fb96019d330 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:49.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.417+0000 7fb967000700 1 -- 172.21.15.69:0/3873113412 >> 172.21.15.69:0/3873113412 conn(0x7fb960102030 msgr2=0x7fb96010a6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:49.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.418+0000 7fb967000700 1 -- 172.21.15.69:0/3873113412 shutdown_connections 2024-05-14T15:19:49.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:49.418+0000 7fb967000700 1 -- 172.21.15.69:0/3873113412 wait complete. 2024-05-14T15:19:49.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:49 smithi092 ceph-mon[34729]: pgmap v504: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-05-14T15:19:50.255 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-14T15:19:50.255 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:19:50.326 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:50 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3873113412' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-14T15:19:50.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:50 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3873113412' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-14T15:19:50.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:50 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3873113412' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-14T15:19:50.697 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:51.102 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:51 smithi069 ceph-mon[31270]: pgmap v505: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-05-14T15:19:51.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:51 smithi203 ceph-mon[34567]: pgmap v505: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-05-14T15:19:51.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:51 smithi092 ceph-mon[34729]: pgmap v505: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.3 KiB/s rd, 9 op/s 2024-05-14T15:19:53.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.222+0000 7f6bac000700 1 -- 172.21.15.69:0/2967424283 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ba410e900 msgr2=0x7f6ba4110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:53.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.222+0000 7f6bac000700 1 --2- 172.21.15.69:0/2967424283 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ba410e900 0x7f6ba4110dd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c00b0a0 tx=0x7f6b9c00b3b0 comp rx=0 tx=0).stop 2024-05-14T15:19:53.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.222+0000 7f6bac000700 1 -- 172.21.15.69:0/2967424283 shutdown_connections 2024-05-14T15:19:53.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.222+0000 7f6bac000700 1 --2- 172.21.15.69:0/2967424283 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ba410e900 0x7f6ba4110dd0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:53.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.222+0000 7f6bac000700 1 --2- 172.21.15.69:0/2967424283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ba4105520 0x7f6ba4105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:53.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.222+0000 7f6bac000700 1 --2- 172.21.15.69:0/2967424283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ba4105e70 0x7f6ba410e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:53.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.222+0000 7f6bac000700 1 -- 172.21.15.69:0/2967424283 >> 172.21.15.69:0/2967424283 conn(0x7f6ba40fedf0 msgr2=0x7f6ba4101210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:53.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.222+0000 7f6bac000700 1 -- 172.21.15.69:0/2967424283 shutdown_connections 2024-05-14T15:19:53.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.222+0000 7f6bac000700 1 -- 172.21.15.69:0/2967424283 wait complete. 2024-05-14T15:19:53.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.223+0000 7f6bac000700 1 Processor -- start 2024-05-14T15:19:53.223 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.224+0000 7f6bac000700 1 -- start start 2024-05-14T15:19:53.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.224+0000 7f6bac000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ba4105520 0x7f6ba419ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:53.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.224+0000 7f6bac000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ba4105e70 0x7f6ba419b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:53.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.224+0000 7f6bac000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ba410e900 0x7f6ba419f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:53.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.224+0000 7f6bac000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba4114350 con 0x7f6ba4105520 2024-05-14T15:19:53.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.224+0000 7f6bac000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba41141d0 con 0x7f6ba4105e70 2024-05-14T15:19:53.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.224+0000 7f6bac000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba41144d0 con 0x7f6ba410e900 2024-05-14T15:19:53.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.224+0000 7f6ba9600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ba4105520 0x7f6ba419ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:53.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.225+0000 7f6ba9600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ba4105520 0x7f6ba419ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55682/0 (socket says 172.21.15.69:55682) 2024-05-14T15:19:53.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.225+0000 7f6ba9600700 1 -- 172.21.15.69:0/3836625160 learned_addr learned my addr 172.21.15.69:0/3836625160 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:53.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.225+0000 7f6ba8c00700 1 --2- 172.21.15.69:0/3836625160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ba4105e70 0x7f6ba419b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:53.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.225+0000 7f6baa000700 1 --2- 172.21.15.69:0/3836625160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ba410e900 0x7f6ba419f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:53.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.225+0000 7f6ba9600700 1 -- 172.21.15.69:0/3836625160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ba410e900 msgr2=0x7f6ba419f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:53.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.225+0000 7f6ba9600700 1 --2- 172.21.15.69:0/3836625160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ba410e900 0x7f6ba419f550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:53.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.225+0000 7f6ba9600700 1 -- 172.21.15.69:0/3836625160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ba4105e70 msgr2=0x7f6ba419b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:53.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.225+0000 7f6ba9600700 1 --2- 172.21.15.69:0/3836625160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ba4105e70 0x7f6ba419b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:53.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.225+0000 7f6ba9600700 1 -- 172.21.15.69:0/3836625160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba419fbf0 con 0x7f6ba4105520 2024-05-14T15:19:53.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.225+0000 7f6ba9600700 1 --2- 172.21.15.69:0/3836625160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ba4105520 0x7f6ba419ad20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800d980 tx=0x7f6b9800dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:53.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.226+0000 7f6ba2000700 1 -- 172.21.15.69:0/3836625160 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98017030 con 0x7f6ba4105520 2024-05-14T15:19:53.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.226+0000 7f6ba2000700 1 -- 172.21.15.69:0/3836625160 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6b980044b0 con 0x7f6ba4105520 2024-05-14T15:19:53.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.226+0000 7f6bac000700 1 -- 172.21.15.69:0/3836625160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba419fee0 con 0x7f6ba4105520 2024-05-14T15:19:53.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.226+0000 7f6ba2000700 1 -- 172.21.15.69:0/3836625160 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b98003970 con 0x7f6ba4105520 2024-05-14T15:19:53.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.226+0000 7f6bac000700 1 -- 172.21.15.69:0/3836625160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba41a7800 con 0x7f6ba4105520 2024-05-14T15:19:53.226 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.227+0000 7f6bac000700 1 -- 172.21.15.69:0/3836625160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b84005330 con 0x7f6ba4105520 2024-05-14T15:19:53.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.230+0000 7f6ba2000700 1 -- 172.21.15.69:0/3836625160 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6b9801a070 con 0x7f6ba4105520 2024-05-14T15:19:53.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.231+0000 7f6ba2000700 1 --2- 172.21.15.69:0/3836625160 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b8c0b2880 0x7f6b8c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:53.231 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:53 smithi069 ceph-mon[31270]: pgmap v506: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-14T15:19:53.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.231+0000 7f6ba2000700 1 -- 172.21.15.69:0/3836625160 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f6b980e22b0 con 0x7f6ba4105520 2024-05-14T15:19:53.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.231+0000 7f6ba8c00700 1 --2- 172.21.15.69:0/3836625160 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b8c0b2880 0x7f6b8c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:53.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.232+0000 7f6ba8c00700 1 --2- 172.21.15.69:0/3836625160 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b8c0b2880 0x7f6b8c0b4d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6b90005950 tx=0x7f6b900058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:53.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.234+0000 7f6ba2000700 1 -- 172.21.15.69:0/3836625160 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6b980a9ba0 con 0x7f6ba4105520 2024-05-14T15:19:53.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:53 smithi203 ceph-mon[34567]: pgmap v506: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-14T15:19:53.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:53 smithi092 ceph-mon[34729]: pgmap v506: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.6 KiB/s rd, 10 op/s 2024-05-14T15:19:53.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.522+0000 7f6bac000700 1 -- 172.21.15.69:0/3836625160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6b84005620 con 0x7f6ba4105520 2024-05-14T15:19:53.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.524+0000 7f6ba2000700 1 -- 172.21.15.69:0/3836625160 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11932 (secure 0 0 0) 0x7f6b980a94a0 con 0x7f6ba4105520 2024-05-14T15:19:53.524 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:19:53.524 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T15:16:11.716543+0000","modified":"2024-05-14T15:17:42.234289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34490,"mds_1":34460,"mds_2":34433,"mds_3":34409,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":31,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":35,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34490":{"gid":34490,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34490,"qdb_cluster":[24451,34433,34409,34460,34490]},"id":1}]} 2024-05-14T15:19:53.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.526+0000 7f6bac000700 1 -- 172.21.15.69:0/3836625160 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b8c0b2880 msgr2=0x7f6b8c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:53.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.526+0000 7f6bac000700 1 --2- 172.21.15.69:0/3836625160 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b8c0b2880 0x7f6b8c0b4d90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f6b90005950 tx=0x7f6b900058e0 comp rx=0 tx=0).stop 2024-05-14T15:19:53.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.526+0000 7f6bac000700 1 -- 172.21.15.69:0/3836625160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ba4105520 msgr2=0x7f6ba419ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:53.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.526+0000 7f6bac000700 1 --2- 172.21.15.69:0/3836625160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ba4105520 0x7f6ba419ad20 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f6b9800d980 tx=0x7f6b9800dd40 comp rx=0 tx=0).stop 2024-05-14T15:19:53.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.527+0000 7f6bac000700 1 -- 172.21.15.69:0/3836625160 shutdown_connections 2024-05-14T15:19:53.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.527+0000 7f6bac000700 1 --2- 172.21.15.69:0/3836625160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6ba4105520 0x7f6ba419ad20 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:53.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.527+0000 7f6bac000700 1 --2- 172.21.15.69:0/3836625160 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b8c0b2880 0x7f6b8c0b4d90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:53.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.527+0000 7f6bac000700 1 --2- 172.21.15.69:0/3836625160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6ba410e900 0x7f6ba419f550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:53.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.527+0000 7f6bac000700 1 --2- 172.21.15.69:0/3836625160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6ba4105e70 0x7f6ba419b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:53.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.527+0000 7f6bac000700 1 -- 172.21.15.69:0/3836625160 >> 172.21.15.69:0/3836625160 conn(0x7f6ba40fedf0 msgr2=0x7f6ba40ff4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:53.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.527+0000 7f6bac000700 1 -- 172.21.15.69:0/3836625160 shutdown_connections 2024-05-14T15:19:53.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:53.527+0000 7f6bac000700 1 -- 172.21.15.69:0/3836625160 wait complete. 2024-05-14T15:19:53.528 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 29 2024-05-14T15:19:54.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:54 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3836625160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:19:54.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:54 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3836625160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:19:54.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:54 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3836625160' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:19:54.503 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:19:54.936 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:55.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:55 smithi092 ceph-mon[34729]: pgmap v507: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-14T15:19:55.451 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:55 smithi069 ceph-mon[31270]: pgmap v507: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-14T15:19:55.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:55 smithi203 ceph-mon[34567]: pgmap v507: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 8 op/s 2024-05-14T15:19:57.195 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:57 smithi069 ceph-mon[31270]: pgmap v508: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-05-14T15:19:57.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.283+0000 7fb363000700 1 -- 172.21.15.69:0/1988555627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb35c10a960 msgr2=0x7fb35c10ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:57.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.283+0000 7fb363000700 1 --2- 172.21.15.69:0/1988555627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb35c10a960 0x7fb35c10ad70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fb348009990 tx=0x7fb348009ca0 comp rx=0 tx=0).stop 2024-05-14T15:19:57.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.283+0000 7fb363000700 1 -- 172.21.15.69:0/1988555627 shutdown_connections 2024-05-14T15:19:57.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.283+0000 7fb363000700 1 --2- 172.21.15.69:0/1988555627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb35c10b2b0 0x7fb35c117830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:57.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.283+0000 7fb363000700 1 --2- 172.21.15.69:0/1988555627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb35c110990 0x7fb35c110da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:57.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.283+0000 7fb363000700 1 --2- 172.21.15.69:0/1988555627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb35c10a960 0x7fb35c10ad70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:57.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.283+0000 7fb363000700 1 -- 172.21.15.69:0/1988555627 >> 172.21.15.69:0/1988555627 conn(0x7fb35c076d30 msgr2=0x7fb35c077140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:57.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.284+0000 7fb363000700 1 -- 172.21.15.69:0/1988555627 shutdown_connections 2024-05-14T15:19:57.284 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.284+0000 7fb363000700 1 -- 172.21.15.69:0/1988555627 wait complete. 2024-05-14T15:19:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.285+0000 7fb363000700 1 Processor -- start 2024-05-14T15:19:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.285+0000 7fb363000700 1 -- start start 2024-05-14T15:19:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.285+0000 7fb363000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb35c10a960 0x7fb35c1a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.285+0000 7fb363000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb35c10b2b0 0x7fb35c1a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.285+0000 7fb363000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb35c110990 0x7fb35c1a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.285+0000 7fb363000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb35c11a960 con 0x7fb35c10a960 2024-05-14T15:19:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.285+0000 7fb363000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb35c11a7e0 con 0x7fb35c110990 2024-05-14T15:19:57.286 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.285+0000 7fb363000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb35c11aae0 con 0x7fb35c10b2b0 2024-05-14T15:19:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.286+0000 7fb35be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb35c10a960 0x7fb35c1a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.286+0000 7fb35be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb35c10a960 0x7fb35c1a1390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55700/0 (socket says 172.21.15.69:55700) 2024-05-14T15:19:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.286+0000 7fb35be00700 1 -- 172.21.15.69:0/1425084763 learned_addr learned my addr 172.21.15.69:0/1425084763 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:19:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.286+0000 7fb35b400700 1 --2- 172.21.15.69:0/1425084763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb35c10b2b0 0x7fb35c1a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.286+0000 7fb361000700 1 --2- 172.21.15.69:0/1425084763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb35c110990 0x7fb35c1a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.286+0000 7fb35be00700 1 -- 172.21.15.69:0/1425084763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb35c10b2b0 msgr2=0x7fb35c1a1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.286+0000 7fb35be00700 1 --2- 172.21.15.69:0/1425084763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb35c10b2b0 0x7fb35c1a1930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.286+0000 7fb35be00700 1 -- 172.21.15.69:0/1425084763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb35c110990 msgr2=0x7fb35c1a5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.286+0000 7fb35be00700 1 --2- 172.21.15.69:0/1425084763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb35c110990 0x7fb35c1a5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.286+0000 7fb35be00700 1 -- 172.21.15.69:0/1425084763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb35c1a61b0 con 0x7fb35c10a960 2024-05-14T15:19:57.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.287+0000 7fb35be00700 1 --2- 172.21.15.69:0/1425084763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb35c10a960 0x7fb35c1a1390 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00d980 tx=0x7fb34c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:57.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.287+0000 7fb358c00700 1 -- 172.21.15.69:0/1425084763 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c017070 con 0x7fb35c10a960 2024-05-14T15:19:57.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.287+0000 7fb363000700 1 -- 172.21.15.69:0/1425084763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb35c1a64a0 con 0x7fb35c10a960 2024-05-14T15:19:57.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.287+0000 7fb358c00700 1 -- 172.21.15.69:0/1425084763 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb34c010460 con 0x7fb35c10a960 2024-05-14T15:19:57.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.287+0000 7fb358c00700 1 -- 172.21.15.69:0/1425084763 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb34c00de60 con 0x7fb35c10a960 2024-05-14T15:19:57.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.287+0000 7fb363000700 1 -- 172.21.15.69:0/1425084763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb35c1a69e0 con 0x7fb35c10a960 2024-05-14T15:19:57.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.289+0000 7fb363000700 1 -- 172.21.15.69:0/1425084763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb35c0512c0 con 0x7fb35c10a960 2024-05-14T15:19:57.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.291+0000 7fb358c00700 1 -- 172.21.15.69:0/1425084763 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb34c010610 con 0x7fb35c10a960 2024-05-14T15:19:57.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.292+0000 7fb358c00700 1 --2- 172.21.15.69:0/1425084763 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb3400b2880 0x7fb3400b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:19:57.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.293+0000 7fb358c00700 1 -- 172.21.15.69:0/1425084763 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fb34c0e2120 con 0x7fb35c10a960 2024-05-14T15:19:57.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.293+0000 7fb35b400700 1 --2- 172.21.15.69:0/1425084763 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb3400b2880 0x7fb3400b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:19:57.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.293+0000 7fb35b400700 1 --2- 172.21.15.69:0/1425084763 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb3400b2880 0x7fb3400b4d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb348006010 tx=0x7fb34800b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:19:57.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.297+0000 7fb358c00700 1 -- 172.21.15.69:0/1425084763 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb34c0a9a10 con 0x7fb35c10a960 2024-05-14T15:19:57.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:57 smithi092 ceph-mon[34729]: pgmap v508: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-05-14T15:19:57.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.577+0000 7fb363000700 1 -- 172.21.15.69:0/1425084763 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb35c02e5f0 con 0x7fb35c10a960 2024-05-14T15:19:57.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.579+0000 7fb358c00700 1 -- 172.21.15.69:0/1425084763 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11932 (secure 0 0 0) 0x7fb34c0a9310 con 0x7fb35c10a960 2024-05-14T15:19:57.579 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:19:57.579 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T15:16:11.716543+0000","modified":"2024-05-14T15:17:42.234289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34490,"mds_1":34460,"mds_2":34433,"mds_3":34409,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":31,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":35,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34490":{"gid":34490,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34490,"qdb_cluster":[24451,34433,34409,34460,34490]},"id":1}]} 2024-05-14T15:19:57.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.582+0000 7fb363000700 1 -- 172.21.15.69:0/1425084763 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb3400b2880 msgr2=0x7fb3400b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:57.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.582+0000 7fb363000700 1 --2- 172.21.15.69:0/1425084763 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb3400b2880 0x7fb3400b4d90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb348006010 tx=0x7fb34800b540 comp rx=0 tx=0).stop 2024-05-14T15:19:57.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.582+0000 7fb363000700 1 -- 172.21.15.69:0/1425084763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb35c10a960 msgr2=0x7fb35c1a1390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:19:57.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.582+0000 7fb363000700 1 --2- 172.21.15.69:0/1425084763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb35c10a960 0x7fb35c1a1390 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb34c00d980 tx=0x7fb34c00dd40 comp rx=0 tx=0).stop 2024-05-14T15:19:57.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.582+0000 7fb363000700 1 -- 172.21.15.69:0/1425084763 shutdown_connections 2024-05-14T15:19:57.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.582+0000 7fb363000700 1 --2- 172.21.15.69:0/1425084763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb35c10a960 0x7fb35c1a1390 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:57.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.582+0000 7fb363000700 1 --2- 172.21.15.69:0/1425084763 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb3400b2880 0x7fb3400b4d90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:57.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.582+0000 7fb363000700 1 --2- 172.21.15.69:0/1425084763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb35c110990 0x7fb35c1a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:57.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.582+0000 7fb363000700 1 --2- 172.21.15.69:0/1425084763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb35c10b2b0 0x7fb35c1a1930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:19:57.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.582+0000 7fb363000700 1 -- 172.21.15.69:0/1425084763 >> 172.21.15.69:0/1425084763 conn(0x7fb35c076d30 msgr2=0x7fb35c108940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:19:57.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.582+0000 7fb363000700 1 -- 172.21.15.69:0/1425084763 shutdown_connections 2024-05-14T15:19:57.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:19:57.582+0000 7fb363000700 1 -- 172.21.15.69:0/1425084763 wait complete. 2024-05-14T15:19:57.583 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 29 2024-05-14T15:19:57.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:57 smithi203 ceph-mon[34567]: pgmap v508: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 9 op/s 2024-05-14T15:19:58.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:58 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1425084763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:19:58.418 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T15:19:58.441 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:58 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1425084763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:19:58.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:58 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1425084763' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:19:58.865 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:19:59.276 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:19:59 smithi069 ceph-mon[31270]: pgmap v509: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-05-14T15:19:59.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:19:59 smithi092 ceph-mon[34729]: pgmap v509: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-05-14T15:19:59.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:19:59 smithi203 ceph-mon[34567]: pgmap v509: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 9 op/s 2024-05-14T15:20:00.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:00 smithi069 ceph-mon[31270]: overall HEALTH_OK 2024-05-14T15:20:00.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:00 smithi092 ceph-mon[34729]: overall HEALTH_OK 2024-05-14T15:20:00.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:00 smithi203 ceph-mon[34567]: overall HEALTH_OK 2024-05-14T15:20:01.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:01 smithi092 ceph-mon[34729]: pgmap v510: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:20:01.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.447+0000 7fe3d5e00700 1 -- 172.21.15.69:0/1370387753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d0105e30 msgr2=0x7fe3d010e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:01.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.447+0000 7fe3d5e00700 1 --2- 172.21.15.69:0/1370387753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d0105e30 0x7fe3d010e380 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe3bc009990 tx=0x7fe3bc009ca0 comp rx=0 tx=0).stop 2024-05-14T15:20:01.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.447+0000 7fe3d5e00700 1 -- 172.21.15.69:0/1370387753 shutdown_connections 2024-05-14T15:20:01.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.447+0000 7fe3d5e00700 1 --2- 172.21.15.69:0/1370387753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3d010e910 0x7fe3d0110df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:01.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.447+0000 7fe3d5e00700 1 --2- 172.21.15.69:0/1370387753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3d01054e0 0x7fe3d01058f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:01.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.447+0000 7fe3d5e00700 1 --2- 172.21.15.69:0/1370387753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d0105e30 0x7fe3d010e380 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:01.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.447+0000 7fe3d5e00700 1 -- 172.21.15.69:0/1370387753 >> 172.21.15.69:0/1370387753 conn(0x7fe3d00fef30 msgr2=0x7fe3d0101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:01.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.447+0000 7fe3d5e00700 1 -- 172.21.15.69:0/1370387753 shutdown_connections 2024-05-14T15:20:01.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.447+0000 7fe3d5e00700 1 -- 172.21.15.69:0/1370387753 wait complete. 2024-05-14T15:20:01.448 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:01 smithi069 ceph-mon[31270]: pgmap v510: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:20:01.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.448+0000 7fe3d5e00700 1 Processor -- start 2024-05-14T15:20:01.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.449+0000 7fe3d5e00700 1 -- start start 2024-05-14T15:20:01.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.449+0000 7fe3d5e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3d01054e0 0x7fe3d01031d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:01.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.449+0000 7fe3d5e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3d0105e30 0x7fe3d0103710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:01.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.449+0000 7fe3d5e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d010e910 0x7fe3d0103c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:01.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.449+0000 7fe3d5e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d0114320 con 0x7fe3d010e910 2024-05-14T15:20:01.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.449+0000 7fe3d5e00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01141a0 con 0x7fe3d0105e30 2024-05-14T15:20:01.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.449+0000 7fe3d5e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3d01144a0 con 0x7fe3d01054e0 2024-05-14T15:20:01.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.449+0000 7fe3cf400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d010e910 0x7fe3d0103c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:01.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.450+0000 7fe3cf400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d010e910 0x7fe3d0103c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55728/0 (socket says 172.21.15.69:55728) 2024-05-14T15:20:01.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.450+0000 7fe3cf400700 1 -- 172.21.15.69:0/748302181 learned_addr learned my addr 172.21.15.69:0/748302181 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:01.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.450+0000 7fe3cea00700 1 --2- 172.21.15.69:0/748302181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3d01054e0 0x7fe3d01031d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:01.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.450+0000 7fe3ce000700 1 --2- 172.21.15.69:0/748302181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3d0105e30 0x7fe3d0103710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:01.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.450+0000 7fe3cf400700 1 -- 172.21.15.69:0/748302181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3d01054e0 msgr2=0x7fe3d01031d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:01.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.450+0000 7fe3cf400700 1 --2- 172.21.15.69:0/748302181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3d01054e0 0x7fe3d01031d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:01.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.450+0000 7fe3cf400700 1 -- 172.21.15.69:0/748302181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3d0105e30 msgr2=0x7fe3d0103710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:01.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.450+0000 7fe3cf400700 1 --2- 172.21.15.69:0/748302181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3d0105e30 0x7fe3d0103710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:01.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.450+0000 7fe3cf400700 1 -- 172.21.15.69:0/748302181 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3d01a90f0 con 0x7fe3d010e910 2024-05-14T15:20:01.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.450+0000 7fe3cf400700 1 --2- 172.21.15.69:0/748302181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d010e910 0x7fe3d0103c50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8007ee0 tx=0x7fe3c800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:01.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.451+0000 7fe3d4a00700 1 -- 172.21.15.69:0/748302181 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c800dbd0 con 0x7fe3d010e910 2024-05-14T15:20:01.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.451+0000 7fe3d4a00700 1 -- 172.21.15.69:0/748302181 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3c800dd70 con 0x7fe3d010e910 2024-05-14T15:20:01.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.451+0000 7fe3d4a00700 1 -- 172.21.15.69:0/748302181 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3c80058d0 con 0x7fe3d010e910 2024-05-14T15:20:01.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.451+0000 7fe3d5e00700 1 -- 172.21.15.69:0/748302181 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3d01a93e0 con 0x7fe3d010e910 2024-05-14T15:20:01.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.451+0000 7fe3d5e00700 1 -- 172.21.15.69:0/748302181 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3d01a9920 con 0x7fe3d010e910 2024-05-14T15:20:01.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.453+0000 7fe3d5e00700 1 -- 172.21.15.69:0/748302181 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3d00512c0 con 0x7fe3d010e910 2024-05-14T15:20:01.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.455+0000 7fe3d4a00700 1 -- 172.21.15.69:0/748302181 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fe3c801a020 con 0x7fe3d010e910 2024-05-14T15:20:01.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.456+0000 7fe3d4a00700 1 --2- 172.21.15.69:0/748302181 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe3b40b2900 0x7fe3b40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:01.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.456+0000 7fe3d4a00700 1 -- 172.21.15.69:0/748302181 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fe3c80e1d10 con 0x7fe3d010e910 2024-05-14T15:20:01.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.457+0000 7fe3cea00700 1 --2- 172.21.15.69:0/748302181 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe3b40b2900 0x7fe3b40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:01.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.457+0000 7fe3cea00700 1 --2- 172.21.15.69:0/748302181 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe3b40b2900 0x7fe3b40b4e10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0005950 tx=0x7fe3c000b410 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:01.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.461+0000 7fe3d4a00700 1 -- 172.21.15.69:0/748302181 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fe3c80e7020 con 0x7fe3d010e910 2024-05-14T15:20:01.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:01 smithi203 ceph-mon[34567]: pgmap v510: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:20:01.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.695+0000 7fe3d5e00700 1 -- 172.21.15.69:0/748302181 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3d0104700 con 0x7fe3d010e910 2024-05-14T15:20:01.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.698+0000 7fe3d4a00700 1 -- 172.21.15.69:0/748302181 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24861 (secure 0 0 0) 0x7fe3c80cb070 con 0x7fe3d010e910 2024-05-14T15:20:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:20:01.699 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":91,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","created":"2024-05-14T15:04:32.074994+0000","modified":"2024-05-14T15:17:43.708185+0000","last_up_change":"2024-05-14T15:14:44.049523+0000","last_in_change":"2024-05-14T15:14:16.752653+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:09:03.561841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:16:02.641690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:16:06.949687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:16:20.891122+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8640de99-c23a-494e-a100-aafd04fe1867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6803","nonce":301095601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6805","nonce":301095601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6809","nonce":301095601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6807","nonce":301095601}]},"public_addr":"172.21.15.69:6803/301095601","cluster_addr":"172.21.15.69:6805/301095601","heartbeat_back_addr":"172.21.15.69:6809/301095601","heartbeat_front_addr":"172.21.15.69:6807/301095601","state":["exists","up"]},{"osd":1,"uuid":"89f78a32-7afb-49f3-9287-5478a1cc8829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6801","nonce":2774122776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6803","nonce":2774122776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6807","nonce":2774122776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6805","nonce":2774122776}]},"public_addr":"172.21.15.92:6801/2774122776","cluster_addr":"172.21.15.92:6803/2774122776","heartbeat_back_addr":"172.21.15.92:6807/2774122776","heartbeat_front_addr":"172.21.15.92:6805/2774122776","state":["exists","up"]},{"osd":2,"uuid":"a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6801","nonce":2836920513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6803","nonce":2836920513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6807","nonce":2836920513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6805","nonce":2836920513}]},"public_addr":"172.21.15.203:6801/2836920513","cluster_addr":"172.21.15.203:6803/2836920513","heartbeat_back_addr":"172.21.15.203:6807/2836920513","heartbeat_front_addr":"172.21.15.203:6805/2836920513","state":["exists","up"]},{"osd":3,"uuid":"81409850-de26-4520-972c-31a716adf4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6811","nonce":680308620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6813","nonce":680308620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6817","nonce":680308620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6815","nonce":680308620}]},"public_addr":"172.21.15.69:6811/680308620","cluster_addr":"172.21.15.69:6813/680308620","heartbeat_back_addr":"172.21.15.69:6817/680308620","heartbeat_front_addr":"172.21.15.69:6815/680308620","state":["exists","up"]},{"osd":4,"uuid":"9aa3a6b0-cc63-4eae-8416-8ab630994985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6809","nonce":1071971048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6811","nonce":1071971048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6815","nonce":1071971048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6813","nonce":1071971048}]},"public_addr":"172.21.15.92:6809/1071971048","cluster_addr":"172.21.15.92:6811/1071971048","heartbeat_back_addr":"172.21.15.92:6815/1071971048","heartbeat_front_addr":"172.21.15.92:6813/1071971048","state":["exists","up"]},{"osd":5,"uuid":"f7fcde57-e280-494b-a45f-8fa007ed9ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6809","nonce":1404230851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6811","nonce":1404230851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6815","nonce":1404230851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6813","nonce":1404230851}]},"public_addr":"172.21.15.203:6809/1404230851","cluster_addr":"172.21.15.203:6811/1404230851","heartbeat_back_addr":"172.21.15.203:6815/1404230851","heartbeat_front_addr":"172.21.15.203:6813/1404230851","state":["exists","up"]},{"osd":6,"uuid":"86f1373a-3b39-4a7f-b14c-9bf8695c6b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6819","nonce":1213427819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6821","nonce":1213427819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6825","nonce":1213427819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6823","nonce":1213427819}]},"public_addr":"172.21.15.69:6819/1213427819","cluster_addr":"172.21.15.69:6821/1213427819","heartbeat_back_addr":"172.21.15.69:6825/1213427819","heartbeat_front_addr":"172.21.15.69:6823/1213427819","state":["exists","up"]},{"osd":7,"uuid":"e790fbf1-3e34-4950-bdfa-cf1adbd451c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6817","nonce":4274774582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6819","nonce":4274774582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6823","nonce":4274774582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6821","nonce":4274774582}]},"public_addr":"172.21.15.92:6817/4274774582","cluster_addr":"172.21.15.92:6819/4274774582","heartbeat_back_addr":"172.21.15.92:6823/4274774582","heartbeat_front_addr":"172.21.15.92:6821/4274774582","state":["exists","up"]},{"osd":8,"uuid":"65019fee-6b18-4d13-841a-2e3acb51f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6817","nonce":2480959249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6819","nonce":2480959249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6823","nonce":2480959249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6821","nonce":2480959249}]},"public_addr":"172.21.15.203:6817/2480959249","cluster_addr":"172.21.15.203:6819/2480959249","heartbeat_back_addr":"172.21.15.203:6823/2480959249","heartbeat_front_addr":"172.21.15.203:6821/2480959249","state":["exists","up"]},{"osd":9,"uuid":"b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6827","nonce":2649966866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6829","nonce":2649966866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6833","nonce":2649966866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6831","nonce":2649966866}]},"public_addr":"172.21.15.69:6827/2649966866","cluster_addr":"172.21.15.69:6829/2649966866","heartbeat_back_addr":"172.21.15.69:6833/2649966866","heartbeat_front_addr":"172.21.15.69:6831/2649966866","state":["exists","up"]},{"osd":10,"uuid":"45287823-f7ea-431f-ac01-a72762b01a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6825","nonce":3650822776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6827","nonce":3650822776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6831","nonce":3650822776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6829","nonce":3650822776}]},"public_addr":"172.21.15.92:6825/3650822776","cluster_addr":"172.21.15.92:6827/3650822776","heartbeat_back_addr":"172.21.15.92:6831/3650822776","heartbeat_front_addr":"172.21.15.92:6829/3650822776","state":["exists","up"]},{"osd":11,"uuid":"2f3a10f9-2414-4151-b1cf-3db68b2a66fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6825","nonce":2590258806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6827","nonce":2590258806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6831","nonce":2590258806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6829","nonce":2590258806}]},"public_addr":"172.21.15.203:6825/2590258806","cluster_addr":"172.21.15.203:6827/2590258806","heartbeat_back_addr":"172.21.15.203:6831/2590258806","heartbeat_front_addr":"172.21.15.203:6829/2590258806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:07:50.047712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:08:25.223293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:01.269713+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:38.679607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:16.161314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:53.323450+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:11:31.930106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:10.173015+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:48.056752+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:13:25.780142+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:03.705208+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:41.267371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":5,"to":6}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/151981233":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/3776172313":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/1288620257":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/2718114316":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/1655882616":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/4183332474":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/2806878946":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/2718114316":"2024-05-15T15:05:41.383453+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:20:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.701+0000 7fe3d5e00700 1 -- 172.21.15.69:0/748302181 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe3b40b2900 msgr2=0x7fe3b40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.701+0000 7fe3d5e00700 1 --2- 172.21.15.69:0/748302181 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe3b40b2900 0x7fe3b40b4e10 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fe3c0005950 tx=0x7fe3c000b410 comp rx=0 tx=0).stop 2024-05-14T15:20:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.701+0000 7fe3d5e00700 1 -- 172.21.15.69:0/748302181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d010e910 msgr2=0x7fe3d0103c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.701+0000 7fe3d5e00700 1 --2- 172.21.15.69:0/748302181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d010e910 0x7fe3d0103c50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe3c8007ee0 tx=0x7fe3c800d3b0 comp rx=0 tx=0).stop 2024-05-14T15:20:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.702+0000 7fe3d5e00700 1 -- 172.21.15.69:0/748302181 shutdown_connections 2024-05-14T15:20:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.702+0000 7fe3d5e00700 1 --2- 172.21.15.69:0/748302181 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3d010e910 0x7fe3d0103c50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.702+0000 7fe3d5e00700 1 --2- 172.21.15.69:0/748302181 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fe3b40b2900 0x7fe3b40b4e10 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.702+0000 7fe3d5e00700 1 --2- 172.21.15.69:0/748302181 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3d01054e0 0x7fe3d01031d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.702+0000 7fe3d5e00700 1 --2- 172.21.15.69:0/748302181 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3d0105e30 0x7fe3d0103710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.702+0000 7fe3d5e00700 1 -- 172.21.15.69:0/748302181 >> 172.21.15.69:0/748302181 conn(0x7fe3d00fef30 msgr2=0x7fe3d00ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.702+0000 7fe3d5e00700 1 -- 172.21.15.69:0/748302181 shutdown_connections 2024-05-14T15:20:01.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:01.702+0000 7fe3d5e00700 1 -- 172.21.15.69:0/748302181 wait complete. 2024-05-14T15:20:02.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:02 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/748302181' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:20:02.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:02 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/748302181' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:20:02.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:02 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/748302181' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:20:02.702 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:20:03.155 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:20:03.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:03 smithi092 ceph-mon[34729]: pgmap v511: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:20:03.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:03 smithi069 ceph-mon[31270]: pgmap v511: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:20:03.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:03 smithi203 ceph-mon[34567]: pgmap v511: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:20:05.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:05 smithi092 ceph-mon[34729]: pgmap v512: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:20:05.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:05 smithi069 ceph-mon[31270]: pgmap v512: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:20:05.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.538+0000 7f58c0c00700 1 -- 172.21.15.69:0/1912490452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58bc107df0 msgr2=0x7f58bc108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:05.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.538+0000 7f58c0c00700 1 --2- 172.21.15.69:0/1912490452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58bc107df0 0x7f58bc108200 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f58a80099c0 tx=0x7f58a8009cd0 comp rx=0 tx=0).stop 2024-05-14T15:20:05.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.539+0000 7f58c0c00700 1 -- 172.21.15.69:0/1912490452 shutdown_connections 2024-05-14T15:20:05.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.539+0000 7f58c0c00700 1 --2- 172.21.15.69:0/1912490452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58bc108740 0x7f58bc1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:05.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.539+0000 7f58c0c00700 1 --2- 172.21.15.69:0/1912490452 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58bc1034c0 0x7f58bc1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:05.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.539+0000 7f58c0c00700 1 --2- 172.21.15.69:0/1912490452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58bc107df0 0x7f58bc108200 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:05.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.539+0000 7f58c0c00700 1 -- 172.21.15.69:0/1912490452 >> 172.21.15.69:0/1912490452 conn(0x7f58bc0fedc0 msgr2=0x7f58bc1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:05.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.539+0000 7f58c0c00700 1 -- 172.21.15.69:0/1912490452 shutdown_connections 2024-05-14T15:20:05.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.539+0000 7f58c0c00700 1 -- 172.21.15.69:0/1912490452 wait complete. 2024-05-14T15:20:05.542 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.540+0000 7f58c0c00700 1 Processor -- start 2024-05-14T15:20:05.542 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.540+0000 7f58c0c00700 1 -- start start 2024-05-14T15:20:05.542 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.540+0000 7f58c0c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58bc1034c0 0x7f58bc19cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:05.542 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.540+0000 7f58c0c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58bc107df0 0x7f58bc19d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:05.542 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.540+0000 7f58c0c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58bc108740 0x7f58bc1a1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:05.542 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.540+0000 7f58c0c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc113200 con 0x7f58bc108740 2024-05-14T15:20:05.542 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.540+0000 7f58c0c00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc113080 con 0x7f58bc1034c0 2024-05-14T15:20:05.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.540+0000 7f58c0c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f58bc113380 con 0x7f58bc107df0 2024-05-14T15:20:05.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.541+0000 7f58ba800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58bc108740 0x7f58bc1a1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:05.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.541+0000 7f58ba800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58bc108740 0x7f58bc1a1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60046/0 (socket says 172.21.15.69:60046) 2024-05-14T15:20:05.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.541+0000 7f58ba800700 1 -- 172.21.15.69:0/4056913318 learned_addr learned my addr 172.21.15.69:0/4056913318 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:05.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.541+0000 7f58b9e00700 1 --2- 172.21.15.69:0/4056913318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58bc1034c0 0x7f58bc19cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:05.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.541+0000 7f58b9400700 1 --2- 172.21.15.69:0/4056913318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58bc107df0 0x7f58bc19d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:05.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.541+0000 7f58ba800700 1 -- 172.21.15.69:0/4056913318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58bc107df0 msgr2=0x7f58bc19d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:05.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.541+0000 7f58ba800700 1 --2- 172.21.15.69:0/4056913318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58bc107df0 0x7f58bc19d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:05.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.541+0000 7f58ba800700 1 -- 172.21.15.69:0/4056913318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58bc1034c0 msgr2=0x7f58bc19cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:05.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.541+0000 7f58ba800700 1 --2- 172.21.15.69:0/4056913318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58bc1034c0 0x7f58bc19cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:05.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.541+0000 7f58ba800700 1 -- 172.21.15.69:0/4056913318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58bc1a1db0 con 0x7f58bc108740 2024-05-14T15:20:05.543 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.542+0000 7f58ba800700 1 --2- 172.21.15.69:0/4056913318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58bc108740 0x7f58bc1a1710 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f58b4007ee0 tx=0x7f58b400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:05.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.542+0000 7f58b2a00700 1 -- 172.21.15.69:0/4056913318 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b400dbd0 con 0x7f58bc108740 2024-05-14T15:20:05.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.542+0000 7f58b2a00700 1 -- 172.21.15.69:0/4056913318 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f58b400dd70 con 0x7f58bc108740 2024-05-14T15:20:05.544 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.542+0000 7f58c0c00700 1 -- 172.21.15.69:0/4056913318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f58bc1a20a0 con 0x7f58bc108740 2024-05-14T15:20:05.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.542+0000 7f58b2a00700 1 -- 172.21.15.69:0/4056913318 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f58b40058d0 con 0x7f58bc108740 2024-05-14T15:20:05.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.542+0000 7f58c0c00700 1 -- 172.21.15.69:0/4056913318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f58bc1a99c0 con 0x7f58bc108740 2024-05-14T15:20:05.545 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.544+0000 7f58c0c00700 1 -- 172.21.15.69:0/4056913318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f589c005330 con 0x7f58bc108740 2024-05-14T15:20:05.546 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.546+0000 7f58b2a00700 1 -- 172.21.15.69:0/4056913318 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f58b401a020 con 0x7f58bc108740 2024-05-14T15:20:05.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.547+0000 7f58b2a00700 1 --2- 172.21.15.69:0/4056913318 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f58a00b2880 0x7f58a00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:05.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.548+0000 7f58b2a00700 1 -- 172.21.15.69:0/4056913318 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f58b40e1d80 con 0x7f58bc108740 2024-05-14T15:20:05.548 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.548+0000 7f58b9e00700 1 --2- 172.21.15.69:0/4056913318 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f58a00b2880 0x7f58a00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:05.549 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.548+0000 7f58b9e00700 1 --2- 172.21.15.69:0/4056913318 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f58a00b2880 0x7f58a00b4d90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f58ac005950 tx=0x7f58ac0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:05.553 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.553+0000 7f58b2a00700 1 -- 172.21.15.69:0/4056913318 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f58b4010070 con 0x7f58bc108740 2024-05-14T15:20:05.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:05 smithi203 ceph-mon[34567]: pgmap v512: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:20:05.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.834+0000 7f58c0c00700 1 -- 172.21.15.69:0/4056913318 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f589c005620 con 0x7f58bc108740 2024-05-14T15:20:05.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.837+0000 7f58b2a00700 1 -- 172.21.15.69:0/4056913318 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11932 (secure 0 0 0) 0x7f58b40a9670 con 0x7f58bc108740 2024-05-14T15:20:05.838 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:20:05.838 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T15:16:11.716543+0000","modified":"2024-05-14T15:17:42.234289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34490,"mds_1":34460,"mds_2":34433,"mds_3":34409,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":31,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":35,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34490":{"gid":34490,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34490,"qdb_cluster":[24451,34433,34409,34460,34490]},"id":1}]} 2024-05-14T15:20:05.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.840+0000 7f58c0c00700 1 -- 172.21.15.69:0/4056913318 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f58a00b2880 msgr2=0x7f58a00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:05.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.840+0000 7f58c0c00700 1 --2- 172.21.15.69:0/4056913318 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f58a00b2880 0x7f58a00b4d90 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f58ac005950 tx=0x7f58ac0058e0 comp rx=0 tx=0).stop 2024-05-14T15:20:05.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.840+0000 7f58c0c00700 1 -- 172.21.15.69:0/4056913318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58bc108740 msgr2=0x7f58bc1a1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:05.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.840+0000 7f58c0c00700 1 --2- 172.21.15.69:0/4056913318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58bc108740 0x7f58bc1a1710 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f58b4007ee0 tx=0x7f58b400d3b0 comp rx=0 tx=0).stop 2024-05-14T15:20:05.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.840+0000 7f58c0c00700 1 -- 172.21.15.69:0/4056913318 shutdown_connections 2024-05-14T15:20:05.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.840+0000 7f58c0c00700 1 --2- 172.21.15.69:0/4056913318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f58bc108740 0x7f58bc1a1710 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:05.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.840+0000 7f58c0c00700 1 --2- 172.21.15.69:0/4056913318 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f58a00b2880 0x7f58a00b4d90 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:05.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.840+0000 7f58c0c00700 1 --2- 172.21.15.69:0/4056913318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f58bc1034c0 0x7f58bc19cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:05.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.840+0000 7f58c0c00700 1 --2- 172.21.15.69:0/4056913318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f58bc107df0 0x7f58bc19d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:05.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.840+0000 7f58c0c00700 1 -- 172.21.15.69:0/4056913318 >> 172.21.15.69:0/4056913318 conn(0x7f58bc0fedc0 msgr2=0x7f58bc1097e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:05.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.840+0000 7f58c0c00700 1 -- 172.21.15.69:0/4056913318 shutdown_connections 2024-05-14T15:20:05.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:05.841+0000 7f58c0c00700 1 -- 172.21.15.69:0/4056913318 wait complete. 2024-05-14T15:20:05.843 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 29 2024-05-14T15:20:06.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:06 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/4056913318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:20:06.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:06 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/4056913318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:20:06.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:06 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/4056913318' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:20:06.753 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-14T15:16:11.716543+0000', 'modified': '2024-05-14T15:17:42.234289+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 34490, 'mds_1': 34460, 'mds_2': 34433, 'mds_3': 34409, 'mds_4': 24451}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14607': {'gid': 14607, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.69:6839/561211426', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6838', 'nonce': 561211426}, {'type': 'v1', 'addr': '172.21.15.69:6839', 'nonce': 561211426}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14613': {'gid': 14613, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.69:6841/2134585816', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6840', 'nonce': 2134585816}, {'type': 'v1', 'addr': '172.21.15.69:6841', 'nonce': 2134585816}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24391': {'gid': 24391, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.203:6833/3479394720', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6832', 'nonce': 3479394720}, {'type': 'v1', 'addr': '172.21.15.203:6833', 'nonce': 3479394720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.203:6835/2407601401', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6834', 'nonce': 2407601401}, {'type': 'v1', 'addr': '172.21.15.203:6835', 'nonce': 2407601401}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.203:6837/3006378390', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6836', 'nonce': 3006378390}, {'type': 'v1', 'addr': '172.21.15.203:6837', 'nonce': 3006378390}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'i', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 31, 'addr': '172.21.15.203:6839/3167469844', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6838', 'nonce': 3167469844}, {'type': 'v1', 'addr': '172.21.15.203:6839', 'nonce': 3167469844}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34409': {'gid': 34409, 'name': 'k', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 39, 'addr': '172.21.15.92:6833/1997000798', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6832', 'nonce': 1997000798}, {'type': 'v1', 'addr': '172.21.15.92:6833', 'nonce': 1997000798}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34433': {'gid': 34433, 'name': 'e', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 35, 'addr': '172.21.15.92:6835/360295917', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6834', 'nonce': 360295917}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 360295917}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34460': {'gid': 34460, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 32, 'addr': '172.21.15.92:6837/1669439322', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6836', 'nonce': 1669439322}, {'type': 'v1', 'addr': '172.21.15.92:6837', 'nonce': 1669439322}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34490': {'gid': 34490, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.92:6839/2029564385', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 2029564385}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 2029564385}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34490, 'qdb_cluster': [24451, 34433, 34409, 34460, 34490]} 2024-05-14T15:20:06.754 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-14T15:20:06.754 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.i status 2024-05-14T15:20:07.225 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:20:07.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:07 smithi092 ceph-mon[34729]: pgmap v513: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:20:07.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:07 smithi069 ceph-mon[31270]: pgmap v513: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:20:07.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:07 smithi203 ceph-mon[34567]: pgmap v513: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:20:09.349 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:09 smithi069 ceph-mon[31270]: pgmap v514: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:20:09.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:09 smithi092 ceph-mon[34729]: pgmap v514: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:20:09.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:09 smithi203 ceph-mon[34567]: pgmap v514: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:20:09.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.745+0000 7fb110000700 1 -- 172.21.15.69:0/3689201336 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb108109850 msgr2=0x7fb1081111b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:09.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.745+0000 7fb110000700 1 --2- 172.21.15.69:0/3689201336 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb108109850 0x7fb1081111b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fb10000b0d0 tx=0x7fb10000b3e0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.745+0000 7fb110000700 1 -- 172.21.15.69:0/3689201336 shutdown_connections 2024-05-14T15:20:09.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.745+0000 7fb110000700 1 --2- 172.21.15.69:0/3689201336 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb108109850 0x7fb1081111b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.745+0000 7fb110000700 1 --2- 172.21.15.69:0/3689201336 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1081045d0 0x7fb1081049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.745+0000 7fb110000700 1 --2- 172.21.15.69:0/3689201336 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb108108f00 0x7fb108109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.745+0000 7fb110000700 1 -- 172.21.15.69:0/3689201336 >> 172.21.15.69:0/3689201336 conn(0x7fb1080ffea0 msgr2=0x7fb1081022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:09.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.745+0000 7fb110000700 1 -- 172.21.15.69:0/3689201336 shutdown_connections 2024-05-14T15:20:09.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.745+0000 7fb110000700 1 -- 172.21.15.69:0/3689201336 wait complete. 2024-05-14T15:20:09.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.746+0000 7fb110000700 1 Processor -- start 2024-05-14T15:20:09.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.746+0000 7fb110000700 1 -- start start 2024-05-14T15:20:09.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.747+0000 7fb110000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1081045d0 0x7fb1081a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.747+0000 7fb110000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb108108f00 0x7fb1081a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.747+0000 7fb110000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb108109850 0x7fb10819ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.747+0000 7fb110000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb108114350 con 0x7fb1081045d0 2024-05-14T15:20:09.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.747+0000 7fb110000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb1081141d0 con 0x7fb108108f00 2024-05-14T15:20:09.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.747+0000 7fb110000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb1081144d0 con 0x7fb108109850 2024-05-14T15:20:09.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.747+0000 7fb10d600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1081045d0 0x7fb1081a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.747+0000 7fb10d600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1081045d0 0x7fb1081a09a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60058/0 (socket says 172.21.15.69:60058) 2024-05-14T15:20:09.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.747+0000 7fb10d600700 1 -- 172.21.15.69:0/2235405666 learned_addr learned my addr 172.21.15.69:0/2235405666 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:09.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.747+0000 7fb10cc00700 1 --2- 172.21.15.69:0/2235405666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb108108f00 0x7fb1081a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.747+0000 7fb10e000700 1 --2- 172.21.15.69:0/2235405666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb108109850 0x7fb10819ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.748+0000 7fb10d600700 1 -- 172.21.15.69:0/2235405666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb108109850 msgr2=0x7fb10819ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:09.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.748+0000 7fb10d600700 1 --2- 172.21.15.69:0/2235405666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb108109850 0x7fb10819ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.748+0000 7fb10d600700 1 -- 172.21.15.69:0/2235405666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb108108f00 msgr2=0x7fb1081a0ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:09.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.748+0000 7fb10d600700 1 --2- 172.21.15.69:0/2235405666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb108108f00 0x7fb1081a0ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.748+0000 7fb10d600700 1 -- 172.21.15.69:0/2235405666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb10819b1d0 con 0x7fb1081045d0 2024-05-14T15:20:09.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.748+0000 7fb10e000700 1 --2- 172.21.15.69:0/2235405666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb108109850 0x7fb10819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:20:09.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.748+0000 7fb10cc00700 1 --2- 172.21.15.69:0/2235405666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb108108f00 0x7fb1081a0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:20:09.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.748+0000 7fb10d600700 1 --2- 172.21.15.69:0/2235405666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1081045d0 0x7fb1081a09a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00c9b0 tx=0x7fb0fc00cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:09.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.748+0000 7fb106000700 1 -- 172.21.15.69:0/2235405666 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc007b00 con 0x7fb1081045d0 2024-05-14T15:20:09.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.748+0000 7fb106000700 1 -- 172.21.15.69:0/2235405666 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0fc007ca0 con 0x7fb1081045d0 2024-05-14T15:20:09.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.748+0000 7fb106000700 1 -- 172.21.15.69:0/2235405666 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc018660 con 0x7fb1081045d0 2024-05-14T15:20:09.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.748+0000 7fb110000700 1 -- 172.21.15.69:0/2235405666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb10819b4c0 con 0x7fb1081045d0 2024-05-14T15:20:09.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.749+0000 7fb110000700 1 -- 172.21.15.69:0/2235405666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1081a7750 con 0x7fb1081045d0 2024-05-14T15:20:09.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.752+0000 7fb106000700 1 -- 172.21.15.69:0/2235405666 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb0fc00f450 con 0x7fb1081045d0 2024-05-14T15:20:09.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.754+0000 7fb11ebddb80 1 Processor -- start 2024-05-14T15:20:09.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.754+0000 7fb11ebddb80 1 -- start start 2024-05-14T15:20:09.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.754+0000 7fb11ebddb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bb38df0 0x55f88bcbc2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.754+0000 7fb11ebddb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcbc7e0 0x55f88bcb6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.754+0000 7fb11ebddb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bcb69a0 0x55f88bcb6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.754+0000 7fb11ebddb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55f88bbd89d0 con 0x55f88bcbc7e0 2024-05-14T15:20:09.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.754+0000 7fb11ebddb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f88bb76710 con 0x55f88bb38df0 2024-05-14T15:20:09.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.754+0000 7fb11ebddb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f88bbd4990 con 0x55f88bcb69a0 2024-05-14T15:20:09.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.755+0000 7fb10d600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcbc7e0 0x55f88bcb6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.755+0000 7fb106000700 1 --2- 172.21.15.69:0/2235405666 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb0f00b2900 0x7fb0f00b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.755+0000 7fb10d600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcbc7e0 0x55f88bcb6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60074/0 (socket says 172.21.15.69:60074) 2024-05-14T15:20:09.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.755+0000 7fb10d600700 1 -- 172.21.15.69:0/3655128807 learned_addr learned my addr 172.21.15.69:0/3655128807 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:09.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.755+0000 7fb10e000700 1 --2- 172.21.15.69:0/3655128807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bb38df0 0x55f88bcbc2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.755+0000 7fb10cc00700 1 --2- 172.21.15.69:0/3655128807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bcb69a0 0x55f88bcb6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.755+0000 7fb10e000700 1 --2- 172.21.15.69:0/2235405666 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb0f00b2900 0x7fb0f00b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.755+0000 7fb106000700 1 -- 172.21.15.69:0/2235405666 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fb0fc0e2680 con 0x7fb1081045d0 2024-05-14T15:20:09.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.756+0000 7fb10d600700 1 -- 172.21.15.69:0/3655128807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bcb69a0 msgr2=0x55f88bcb6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:09.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.756+0000 7fb10d600700 1 --2- 172.21.15.69:0/3655128807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bcb69a0 0x55f88bcb6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.756+0000 7fb10d600700 1 -- 172.21.15.69:0/3655128807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bb38df0 msgr2=0x55f88bcbc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:09.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.756+0000 7fb10d600700 1 --2- 172.21.15.69:0/3655128807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bb38df0 0x55f88bcbc2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.756+0000 7fb10d600700 1 -- 172.21.15.69:0/3655128807 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f88bb25880 con 0x55f88bcbc7e0 2024-05-14T15:20:09.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.756+0000 7fb10d600700 1 --2- 172.21.15.69:0/3655128807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcbc7e0 0x55f88bcb6460 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0a9110 tx=0x7fb0fc0a9380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5584fdd8c658ca0c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:09.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.756+0000 7fb10e000700 1 --2- 172.21.15.69:0/2235405666 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb0f00b2900 0x7fb0f00b4e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb100005bd0 tx=0x7fb100005b00 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:09.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.756+0000 7fb0faa00700 1 -- 172.21.15.69:0/3655128807 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc0a9870 con 0x55f88bcbc7e0 2024-05-14T15:20:09.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.756+0000 7fb0faa00700 1 -- 172.21.15.69:0/3655128807 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0fc0adc20 con 0x55f88bcbc7e0 2024-05-14T15:20:09.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.756+0000 7fb0faa00700 1 -- 172.21.15.69:0/3655128807 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc0a9ad0 con 0x55f88bcbc7e0 2024-05-14T15:20:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.757+0000 7fb11ebddb80 1 -- 172.21.15.69:0/3655128807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcbc7e0 msgr2=0x55f88bcb6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.757+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/3655128807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcbc7e0 0x55f88bcb6460 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0a9110 tx=0x7fb0fc0a9380 comp rx=0 tx=0).stop 2024-05-14T15:20:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.757+0000 7fb11ebddb80 1 -- 172.21.15.69:0/3655128807 shutdown_connections 2024-05-14T15:20:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.757+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/3655128807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bcb69a0 0x55f88bcb6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.757+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/3655128807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bb38df0 0x55f88bcbc2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.757+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/3655128807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcbc7e0 0x55f88bcb6460 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.758+0000 7fb11ebddb80 1 -- 172.21.15.69:0/3655128807 >> 172.21.15.69:0/3655128807 conn(0x55f88bb7df20 msgr2=0x55f88bcb1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.758+0000 7fb11ebddb80 1 -- 172.21.15.69:0/3655128807 shutdown_connections 2024-05-14T15:20:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.758+0000 7fb11ebddb80 1 -- 172.21.15.69:0/3655128807 wait complete. 2024-05-14T15:20:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.758+0000 7fb11ebddb80 1 -- start start 2024-05-14T15:20:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.758+0000 7fb11ebddb80 1 Processor -- start 2024-05-14T15:20:09.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.759+0000 7fb11ebddb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bb38df0 0x55f88bcbfed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.759+0000 7fb11ebddb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcb69a0 0x55f88bcc0410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.759+0000 7fb11ebddb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bcbc7e0 0x55f88bcc0950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.759+0000 7fb11ebddb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55f88bcc3260 con 0x55f88bcb69a0 2024-05-14T15:20:09.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.759+0000 7fb11ebddb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f88bb3ead0 con 0x55f88bcbc7e0 2024-05-14T15:20:09.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.759+0000 7fb11ebddb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f88bcc33e0 con 0x55f88bb38df0 2024-05-14T15:20:09.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.759+0000 7fb11ebddb80 10 client.0 _ll_register_callbacks cb 0x55f88bb7fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:20:09.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.759+0000 7fb10cc00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcb69a0 0x55f88bcc0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.759+0000 7fb10cc00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcb69a0 0x55f88bcc0410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60078/0 (socket says 172.21.15.69:60078) 2024-05-14T15:20:09.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.759+0000 7fb10cc00700 1 -- 172.21.15.69:0/3362795921 learned_addr learned my addr 172.21.15.69:0/3362795921 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:09.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.760+0000 7fb10d600700 1 --2- 172.21.15.69:0/3362795921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bb38df0 0x55f88bcbfed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.760+0000 7fb10e000700 1 --2- 172.21.15.69:0/3362795921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bcbc7e0 0x55f88bcc0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.760+0000 7fb10cc00700 1 -- 172.21.15.69:0/3362795921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bb38df0 msgr2=0x55f88bcbfed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:09.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.760+0000 7fb10cc00700 1 --2- 172.21.15.69:0/3362795921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bb38df0 0x55f88bcbfed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.760+0000 7fb10cc00700 1 -- 172.21.15.69:0/3362795921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bcbc7e0 msgr2=0x55f88bcc0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:09.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.760+0000 7fb10cc00700 1 --2- 172.21.15.69:0/3362795921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bcbc7e0 0x55f88bcc0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.760+0000 7fb10cc00700 1 -- 172.21.15.69:0/3362795921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f88bb9e3d0 con 0x55f88bcb69a0 2024-05-14T15:20:09.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.760+0000 7fb10cc00700 1 --2- 172.21.15.69:0/3362795921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcb69a0 0x55f88bcc0410 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400bfd0 tx=0x7fb0f40127e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9422f67036393184 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:09.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.760+0000 7fb0ef400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:20:09.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.760+0000 7fb0ef400700 1 -- 172.21.15.69:0/3362795921 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4004a30 con 0x55f88bcb69a0 2024-05-14T15:20:09.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.761+0000 7fb0ef400700 1 -- 172.21.15.69:0/3362795921 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fb0f4004bd0 con 0x55f88bcb69a0 2024-05-14T15:20:09.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.761+0000 7fb11ebddb80 1 -- 172.21.15.69:0/3362795921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0fc0adc20 con 0x55f88bcb69a0 2024-05-14T15:20:09.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.761+0000 7fb0ef400700 1 -- 172.21.15.69:0/3362795921 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb0f4004dd0 con 0x55f88bcb69a0 2024-05-14T15:20:09.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.761+0000 7fb11ebddb80 10 client.15069 fetch_fsmap learned FSMap version 29 2024-05-14T15:20:09.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.761+0000 7fb11ebddb80 1 -- 172.21.15.69:0/3362795921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f88bccddc0 con 0x55f88bcb69a0 2024-05-14T15:20:09.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.761+0000 7fb0ef400700 1 -- 172.21.15.69:0/3362795921 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0fc0adc20 con 0x55f88bcb69a0 2024-05-14T15:20:09.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.761+0000 7fb0ef400700 1 -- 172.21.15.69:0/3362795921 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb0f4019070 con 0x55f88bcb69a0 2024-05-14T15:20:09.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.761+0000 7fb11ebddb80 10 client.15069 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:20:09.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.762+0000 7fb11ebddb80 10 client.15069 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-14T15:20:09.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.762+0000 7fb11ebddb80 20 client.15069 populate_metadata read hostname 'smithi069' 2024-05-14T15:20:09.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.762+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/3362795921 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55f88bcd0600 0x55f88bcd1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.762+0000 7fb11ebddb80 4 client.15069 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:20:09.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.762+0000 7fb11ebddb80 1 -- 172.21.15.69:0/3362795921 --> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f88bc83170 con 0x55f88bcd0600 2024-05-14T15:20:09.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.762+0000 7fb10d600700 1 --2- 172.21.15.69:0/3362795921 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55f88bcd0600 0x55f88bcd1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.763+0000 7fb0ef400700 10 client.15069 ms_handle_connect on v2:172.21.15.203:6838/3167469844 2024-05-14T15:20:09.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.763+0000 7fb10d600700 1 --2- 172.21.15.69:0/3362795921 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55f88bcd0600 0x55f88bcd1a70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=7075c8a2c7b923b8 server_cookie=ce01d3707bbd13d2 in_seq=0 out_seq=0 2024-05-14T15:20:09.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.766+0000 7fb0ef400700 1 -- 172.21.15.69:0/3362795921 <== mds.4 v2:172.21.15.203:6838/3167469844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f88bc83170 con 0x55f88bcd0600 2024-05-14T15:20:09.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.766+0000 7fb0ef400700 10 client.15069 handle_command_reply: tid=0 2024-05-14T15:20:09.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.766+0000 7fb11ebddb80 1 client.15069 shutdown 2024-05-14T15:20:09.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.766+0000 7fb11ebddb80 1 -- 172.21.15.69:0/3362795921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcb69a0 msgr2=0x55f88bcc0410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:09.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.766+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/3362795921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcb69a0 0x55f88bcc0410 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fb0f400bfd0 tx=0x7fb0f40127e0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.766+0000 7fb11ebddb80 1 -- 172.21.15.69:0/3362795921 shutdown_connections 2024-05-14T15:20:09.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.766+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/3362795921 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55f88bcd0600 0x55f88bcd1a70 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.766+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/3362795921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bcbc7e0 0x55f88bcc0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.766+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/3362795921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bb38df0 0x55f88bcbfed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.766+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/3362795921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcb69a0 0x55f88bcc0410 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.766+0000 7fb11ebddb80 1 -- 172.21.15.69:0/3362795921 >> 172.21.15.69:0/3362795921 conn(0x55f88bb7df20 msgr2=0x55f88bcb5450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:09.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.766+0000 7fb0ef400700 0 client.15069 ms_handle_reset on v2:172.21.15.203:6838/3167469844 2024-05-14T15:20:09.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.766+0000 7fb11ebddb80 1 -- 172.21.15.69:0/3362795921 shutdown_connections 2024-05-14T15:20:09.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.767+0000 7fb11ebddb80 1 -- 172.21.15.69:0/3362795921 wait complete. 2024-05-14T15:20:09.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.767+0000 7fb11ebddb80 20 client.15069 trim_cache size 0 max 16384 2024-05-14T15:20:09.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.789+0000 7fb11ebddb80 1 Processor -- start 2024-05-14T15:20:09.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.789+0000 7fb11ebddb80 1 -- start start 2024-05-14T15:20:09.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.790+0000 7fb11ebddb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bb38df0 0x55f88bcb6460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.790+0000 7fb11ebddb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bcb69a0 0x55f88bccc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.790+0000 7fb11ebddb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bcbc7e0 0x55f88bccff30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.790+0000 7fb11ebddb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55f88bccfdb0 con 0x55f88bb38df0 2024-05-14T15:20:09.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.790+0000 7fb11ebddb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f88bcd0480 con 0x55f88bcb69a0 2024-05-14T15:20:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.790+0000 7fb11ebddb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f88bcd0b50 con 0x55f88bcbc7e0 2024-05-14T15:20:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.790+0000 7fb10d600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bb38df0 0x55f88bcb6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.790+0000 7fb10d600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bb38df0 0x55f88bcb6460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60090/0 (socket says 172.21.15.69:60090) 2024-05-14T15:20:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.790+0000 7fb10d600700 1 -- 172.21.15.69:0/2606571713 learned_addr learned my addr 172.21.15.69:0/2606571713 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.790+0000 7fb10cc00700 1 --2- 172.21.15.69:0/2606571713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bcb69a0 0x55f88bccc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.790+0000 7fb10e000700 1 --2- 172.21.15.69:0/2606571713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bcbc7e0 0x55f88bccff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.790+0000 7fb10d600700 1 -- 172.21.15.69:0/2606571713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bcbc7e0 msgr2=0x55f88bccff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.790+0000 7fb10d600700 1 --2- 172.21.15.69:0/2606571713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bcbc7e0 0x55f88bccff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.791+0000 7fb10d600700 1 -- 172.21.15.69:0/2606571713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bcb69a0 msgr2=0x55f88bccc6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.791+0000 7fb10d600700 1 --2- 172.21.15.69:0/2606571713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bcb69a0 0x55f88bccc6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.791+0000 7fb10d600700 1 -- 172.21.15.69:0/2606571713 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f88bcc2eb0 con 0x55f88bb38df0 2024-05-14T15:20:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.791+0000 7fb10e000700 1 --2- 172.21.15.69:0/2606571713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bcbc7e0 0x55f88bccff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:20:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.791+0000 7fb10d600700 1 --2- 172.21.15.69:0/2606571713 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bb38df0 0x55f88bcb6460 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0a50b0 tx=0x7fb0fc0a5040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf6279e756dc18a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:09.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.791+0000 7fb0fa000700 1 -- 172.21.15.69:0/2606571713 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc0b26d0 con 0x55f88bb38df0 2024-05-14T15:20:09.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.791+0000 7fb0fa000700 1 -- 172.21.15.69:0/2606571713 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0fc0a9870 con 0x55f88bb38df0 2024-05-14T15:20:09.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.791+0000 7fb0fa000700 1 -- 172.21.15.69:0/2606571713 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0fc0a9ad0 con 0x55f88bb38df0 2024-05-14T15:20:09.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.792+0000 7fb11ebddb80 1 -- 172.21.15.69:0/2606571713 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bb38df0 msgr2=0x55f88bcb6460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:09.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.792+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/2606571713 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bb38df0 0x55f88bcb6460 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc0a50b0 tx=0x7fb0fc0a5040 comp rx=0 tx=0).stop 2024-05-14T15:20:09.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.792+0000 7fb11ebddb80 1 -- 172.21.15.69:0/2606571713 shutdown_connections 2024-05-14T15:20:09.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.792+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/2606571713 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bb38df0 0x55f88bcb6460 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.792+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/2606571713 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bcbc7e0 0x55f88bccff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.792+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/2606571713 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bcb69a0 0x55f88bccc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.792+0000 7fb11ebddb80 1 -- 172.21.15.69:0/2606571713 >> 172.21.15.69:0/2606571713 conn(0x55f88bb7df20 msgr2=0x55f88bcb9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:09.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.792+0000 7fb11ebddb80 1 -- 172.21.15.69:0/2606571713 shutdown_connections 2024-05-14T15:20:09.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.792+0000 7fb11ebddb80 1 -- 172.21.15.69:0/2606571713 wait complete. 2024-05-14T15:20:09.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.793+0000 7fb11ebddb80 1 -- start start 2024-05-14T15:20:09.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.793+0000 7fb11ebddb80 1 Processor -- start 2024-05-14T15:20:09.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.794+0000 7fb11ebddb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bcb69a0 0x55f88bcdb2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.794+0000 7fb11ebddb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcbc7e0 0x55f88bcbf680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.794+0000 7fb11ebddb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bcbfbc0 0x55f88bcbffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.794+0000 7fb11ebddb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55f88bcd18f0 con 0x55f88bcbc7e0 2024-05-14T15:20:09.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.794+0000 7fb11ebddb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f88bcd1220 con 0x55f88bcbfbc0 2024-05-14T15:20:09.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.794+0000 7fb11ebddb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f88bcd1fc0 con 0x55f88bcb69a0 2024-05-14T15:20:09.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.794+0000 7fb11ebddb80 10 client.0 _ll_register_callbacks cb 0x55f88bb7fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:20:09.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.794+0000 7fb10cc00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcbc7e0 0x55f88bcbf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.794+0000 7fb10cc00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcbc7e0 0x55f88bcbf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60106/0 (socket says 172.21.15.69:60106) 2024-05-14T15:20:09.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.794+0000 7fb10cc00700 1 -- 172.21.15.69:0/114705482 learned_addr learned my addr 172.21.15.69:0/114705482 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:09.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.794+0000 7fb10d600700 1 --2- 172.21.15.69:0/114705482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bcb69a0 0x55f88bcdb2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.794+0000 7fb10e000700 1 --2- 172.21.15.69:0/114705482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bcbfbc0 0x55f88bcbffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.794+0000 7fb10cc00700 1 -- 172.21.15.69:0/114705482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bcb69a0 msgr2=0x55f88bcdb2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:09.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.794+0000 7fb10cc00700 1 --2- 172.21.15.69:0/114705482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bcb69a0 0x55f88bcdb2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.794+0000 7fb10cc00700 1 -- 172.21.15.69:0/114705482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bcbfbc0 msgr2=0x55f88bcbffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:09.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.794+0000 7fb10cc00700 1 --2- 172.21.15.69:0/114705482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bcbfbc0 0x55f88bcbffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.795+0000 7fb10cc00700 1 -- 172.21.15.69:0/114705482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f88bcda030 con 0x55f88bcbc7e0 2024-05-14T15:20:09.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.795+0000 7fb10e000700 1 --2- 172.21.15.69:0/114705482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bcbfbc0 0x55f88bcbffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:20:09.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.795+0000 7fb10cc00700 1 --2- 172.21.15.69:0/114705482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcbc7e0 0x55f88bcbf680 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55f88bcb2310 tx=0x7fb0f4012be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7680d3462d5be7ae server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:09.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.795+0000 7fb0ef400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:20:09.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.795+0000 7fb0ef400700 1 -- 172.21.15.69:0/114705482 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0f402c070 con 0x55f88bcbc7e0 2024-05-14T15:20:09.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.795+0000 7fb0ef400700 1 -- 172.21.15.69:0/114705482 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fb0f4004f70 con 0x55f88bcbc7e0 2024-05-14T15:20:09.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.795+0000 7fb11ebddb80 1 -- 172.21.15.69:0/114705482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0fc0a9870 con 0x55f88bcbc7e0 2024-05-14T15:20:09.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.796+0000 7fb0ef400700 1 -- 172.21.15.69:0/114705482 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb0f4005170 con 0x55f88bcbc7e0 2024-05-14T15:20:09.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.796+0000 7fb11ebddb80 10 client.15075 fetch_fsmap learned FSMap version 29 2024-05-14T15:20:09.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.796+0000 7fb11ebddb80 1 -- 172.21.15.69:0/114705482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f88bd3bb30 con 0x55f88bcbc7e0 2024-05-14T15:20:09.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.796+0000 7fb0ef400700 1 -- 172.21.15.69:0/114705482 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb0fc0a9870 con 0x55f88bcbc7e0 2024-05-14T15:20:09.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.796+0000 7fb0ef400700 1 -- 172.21.15.69:0/114705482 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb0f4019040 con 0x55f88bcbc7e0 2024-05-14T15:20:09.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.796+0000 7fb11ebddb80 10 client.15075 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:20:09.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.796+0000 7fb11ebddb80 10 client.15075 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-14T15:20:09.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.796+0000 7fb11ebddb80 20 client.15075 populate_metadata read hostname 'smithi069' 2024-05-14T15:20:09.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.796+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/114705482 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55f88bd3e050 0x55f88bd3f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:09.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.796+0000 7fb11ebddb80 4 client.15075 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T15:20:09.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.796+0000 7fb11ebddb80 1 -- 172.21.15.69:0/114705482 --> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] -- command(tid 0: {"prefix": "status"}) -- 0x55f88bbe63b0 con 0x55f88bd3e050 2024-05-14T15:20:09.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.797+0000 7fb10d600700 1 --2- 172.21.15.69:0/114705482 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55f88bd3e050 0x55f88bd3f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:09.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.798+0000 7fb10d600700 1 --2- 172.21.15.69:0/114705482 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55f88bd3e050 0x55f88bd3f4c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=a92731bbf3ca4f0b server_cookie=6e46abfb8a71228f in_seq=0 out_seq=0 2024-05-14T15:20:09.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.798+0000 7fb0ef400700 10 client.15075 ms_handle_connect on v2:172.21.15.203:6838/3167469844 2024-05-14T15:20:09.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.799+0000 7fb0ef400700 1 -- 172.21.15.69:0/114705482 <== mds.4 v2:172.21.15.203:6838/3167469844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55f88bbe63b0 con 0x55f88bd3e050 2024-05-14T15:20:09.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.799+0000 7fb0ef400700 10 client.15075 handle_command_reply: tid=0 2024-05-14T15:20:09.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.799+0000 7fb11ebddb80 1 client.15075 shutdown 2024-05-14T15:20:09.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.799+0000 7fb11ebddb80 1 -- 172.21.15.69:0/114705482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcbc7e0 msgr2=0x55f88bcbf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:09.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.799+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/114705482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcbc7e0 0x55f88bcbf680 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x55f88bcb2310 tx=0x7fb0f4012be0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.799+0000 7fb11ebddb80 1 -- 172.21.15.69:0/114705482 shutdown_connections 2024-05-14T15:20:09.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.799+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/114705482 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55f88bd3e050 0x55f88bd3f4c0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.799+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/114705482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f88bcbfbc0 0x55f88bcbffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.799+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/114705482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f88bcb69a0 0x55f88bcdb2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.799+0000 7fb11ebddb80 1 --2- 172.21.15.69:0/114705482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f88bcbc7e0 0x55f88bcbf680 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.799+0000 7fb0ef400700 0 client.15075 ms_handle_reset on v2:172.21.15.203:6838/3167469844 2024-05-14T15:20:09.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.799+0000 7fb11ebddb80 1 -- 172.21.15.69:0/114705482 >> 172.21.15.69:0/114705482 conn(0x55f88bb7df20 msgr2=0x55f88bcab050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:09.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.799+0000 7fb11ebddb80 1 -- 172.21.15.69:0/114705482 shutdown_connections 2024-05-14T15:20:09.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.799+0000 7fb11ebddb80 1 -- 172.21.15.69:0/114705482 wait complete. 2024-05-14T15:20:09.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.799+0000 7fb11ebddb80 20 client.15075 trim_cache size 0 max 16384 2024-05-14T15:20:09.802 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:20:09.802 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "1cc2580e-1203-11ef-bc98-c7b262605968", 2024-05-14T15:20:09.802 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 4, 2024-05-14T15:20:09.802 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24451, 2024-05-14T15:20:09.802 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-05-14T15:20:09.802 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-05-14T15:20:09.802 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-05-14T15:20:09.802 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 152.464317115, 2024-05-14T15:20:09.802 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 29, 2024-05-14T15:20:09.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 91, 2024-05-14T15:20:09.803 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 89, 2024-05-14T15:20:09.803 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 272.20325278600001 2024-05-14T15:20:09.803 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:20:09.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.800+0000 7fb110000700 1 -- 172.21.15.69:0/2235405666 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb0f00b2900 msgr2=0x7fb0f00b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:09.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.800+0000 7fb110000700 1 --2- 172.21.15.69:0/2235405666 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb0f00b2900 0x7fb0f00b4e10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb100005bd0 tx=0x7fb100005b00 comp rx=0 tx=0).stop 2024-05-14T15:20:09.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.800+0000 7fb110000700 1 -- 172.21.15.69:0/2235405666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1081045d0 msgr2=0x7fb1081a09a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:09.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.800+0000 7fb110000700 1 --2- 172.21.15.69:0/2235405666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1081045d0 0x7fb1081a09a0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fb0fc00c9b0 tx=0x7fb0fc00cd70 comp rx=0 tx=0).stop 2024-05-14T15:20:09.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.800+0000 7fb110000700 1 -- 172.21.15.69:0/2235405666 shutdown_connections 2024-05-14T15:20:09.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.800+0000 7fb110000700 1 --2- 172.21.15.69:0/2235405666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1081045d0 0x7fb1081a09a0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.800+0000 7fb110000700 1 --2- 172.21.15.69:0/2235405666 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb0f00b2900 0x7fb0f00b4e10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.800+0000 7fb110000700 1 --2- 172.21.15.69:0/2235405666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb108109850 0x7fb10819ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.800+0000 7fb110000700 1 --2- 172.21.15.69:0/2235405666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb108108f00 0x7fb1081a0ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:09.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.800+0000 7fb110000700 1 -- 172.21.15.69:0/2235405666 >> 172.21.15.69:0/2235405666 conn(0x7fb1080ffea0 msgr2=0x7fb10810a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:09.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.800+0000 7fb110000700 1 -- 172.21.15.69:0/2235405666 shutdown_connections 2024-05-14T15:20:09.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:09.800+0000 7fb110000700 1 -- 172.21.15.69:0/2235405666 wait complete. 2024-05-14T15:20:10.717 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.k status 2024-05-14T15:20:11.164 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:20:11.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:11 smithi092 ceph-mon[34729]: pgmap v515: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:20:11.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:11 smithi069 ceph-mon[31270]: pgmap v515: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:20:11.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:11 smithi203 ceph-mon[34567]: pgmap v515: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:20:13.379 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:13 smithi069 ceph-mon[31270]: pgmap v516: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:20:13.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:13 smithi203 ceph-mon[34567]: pgmap v516: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:20:13.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.619+0000 7f74de400700 1 -- 172.21.15.69:0/3254730719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74d810a7c0 msgr2=0x7f74d810abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:13.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.619+0000 7f74de400700 1 --2- 172.21.15.69:0/3254730719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74d810a7c0 0x7f74d810abd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f74c4009990 tx=0x7f74c4009ca0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.619+0000 7f74de400700 1 -- 172.21.15.69:0/3254730719 shutdown_connections 2024-05-14T15:20:13.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.619+0000 7f74de400700 1 --2- 172.21.15.69:0/3254730719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74d810b110 0x7f74d8117640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.619+0000 7f74de400700 1 --2- 172.21.15.69:0/3254730719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74d81107a0 0x7f74d8110bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.619+0000 7f74de400700 1 --2- 172.21.15.69:0/3254730719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74d810a7c0 0x7f74d810abd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.619+0000 7f74de400700 1 -- 172.21.15.69:0/3254730719 >> 172.21.15.69:0/3254730719 conn(0x7f74d8076b00 msgr2=0x7f74d8076f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:13.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.619+0000 7f74de400700 1 -- 172.21.15.69:0/3254730719 shutdown_connections 2024-05-14T15:20:13.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.620+0000 7f74de400700 1 -- 172.21.15.69:0/3254730719 wait complete. 2024-05-14T15:20:13.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.621+0000 7f74de400700 1 Processor -- start 2024-05-14T15:20:13.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.621+0000 7f74de400700 1 -- start start 2024-05-14T15:20:13.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.621+0000 7f74de400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74d810a7c0 0x7f74d81a1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.621+0000 7f74de400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74d810b110 0x7f74d81a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.621+0000 7f74de400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74d81107a0 0x7f74d81a5a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.621+0000 7f74de400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f74d811a740 con 0x7f74d810b110 2024-05-14T15:20:13.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.621+0000 7f74de400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f74d811a5c0 con 0x7f74d81107a0 2024-05-14T15:20:13.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.621+0000 7f74de400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f74d811a8c0 con 0x7f74d810a7c0 2024-05-14T15:20:13.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.622+0000 7f74d7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74d810b110 0x7f74d81a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.622+0000 7f74d7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74d810b110 0x7f74d81a17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46472/0 (socket says 172.21.15.69:46472) 2024-05-14T15:20:13.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.622+0000 7f74d7e00700 1 -- 172.21.15.69:0/641732334 learned_addr learned my addr 172.21.15.69:0/641732334 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:13.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.622+0000 7f74dd000700 1 --2- 172.21.15.69:0/641732334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74d810a7c0 0x7f74d81a1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.622+0000 7f74dda00700 1 --2- 172.21.15.69:0/641732334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74d81107a0 0x7f74d81a5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.622+0000 7f74d7e00700 1 -- 172.21.15.69:0/641732334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74d810a7c0 msgr2=0x7f74d81a1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:13.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.622+0000 7f74d7e00700 1 --2- 172.21.15.69:0/641732334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74d810a7c0 0x7f74d81a1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.622+0000 7f74d7e00700 1 -- 172.21.15.69:0/641732334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74d81107a0 msgr2=0x7f74d81a5a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:13.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.622+0000 7f74d7e00700 1 --2- 172.21.15.69:0/641732334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74d81107a0 0x7f74d81a5a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.622+0000 7f74d7e00700 1 -- 172.21.15.69:0/641732334 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74d81a6050 con 0x7f74d810b110 2024-05-14T15:20:13.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.623+0000 7f74d7e00700 1 --2- 172.21.15.69:0/641732334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74d810b110 0x7f74d81a17d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f74c4000c00 tx=0x7f74c40036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:13.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.623+0000 7f74d5600700 1 -- 172.21.15.69:0/641732334 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4027070 con 0x7f74d810b110 2024-05-14T15:20:13.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.623+0000 7f74d5600700 1 -- 172.21.15.69:0/641732334 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74c400fc40 con 0x7f74d810b110 2024-05-14T15:20:13.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.623+0000 7f74d5600700 1 -- 172.21.15.69:0/641732334 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c4022b90 con 0x7f74d810b110 2024-05-14T15:20:13.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.623+0000 7f74de400700 1 -- 172.21.15.69:0/641732334 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74d81a62e0 con 0x7f74d810b110 2024-05-14T15:20:13.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.623+0000 7f74de400700 1 -- 172.21.15.69:0/641732334 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74d81a67c0 con 0x7f74d810b110 2024-05-14T15:20:13.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.627+0000 7f74d5600700 1 -- 172.21.15.69:0/641732334 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f74c402a070 con 0x7f74d810b110 2024-05-14T15:20:13.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.628+0000 7f74ee4ddb80 1 Processor -- start 2024-05-14T15:20:13.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.629+0000 7f74ee4ddb80 1 -- start start 2024-05-14T15:20:13.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.629+0000 7f74d5600700 1 --2- 172.21.15.69:0/641732334 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f74c00b2880 0x7f74c00b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.629+0000 7f74ee4ddb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5ae2df0 0x556ab5c60cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.629+0000 7f74ee4ddb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5c61230 0x556ab5c6a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.629+0000 7f74ee4ddb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 0x556ab5c6cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.629+0000 7f74ee4ddb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x556ab5b829d0 con 0x556ab5ae2df0 2024-05-14T15:20:13.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.629+0000 7f74ee4ddb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556ab5b20710 con 0x556ab5c61230 2024-05-14T15:20:13.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.629+0000 7f74ee4ddb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556ab5b7e990 con 0x556ab5c61640 2024-05-14T15:20:13.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.629+0000 7f74d5600700 1 -- 172.21.15.69:0/641732334 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f74c40e3650 con 0x7f74d810b110 2024-05-14T15:20:13.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.630+0000 7f74dd000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5ae2df0 0x556ab5c60cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.630+0000 7f74dd000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5ae2df0 0x556ab5c60cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46482/0 (socket says 172.21.15.69:46482) 2024-05-14T15:20:13.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.630+0000 7f74dd000700 1 -- 172.21.15.69:0/3047412239 learned_addr learned my addr 172.21.15.69:0/3047412239 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:13.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.630+0000 7f74dda00700 1 --2- 172.21.15.69:0/641732334 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f74c00b2880 0x7f74c00b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.630+0000 7f74d7e00700 1 --2- 172.21.15.69:0/3047412239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5c61230 0x556ab5c6a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.630+0000 7f74dda00700 1 --2- 172.21.15.69:0/3047412239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 0x556ab5c6cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.630+0000 7f74dd000700 1 -- 172.21.15.69:0/3047412239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 msgr2=0x556ab5c6cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:13.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.630+0000 7f74dd000700 1 --2- 172.21.15.69:0/3047412239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 0x556ab5c6cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.630+0000 7f74dd000700 1 -- 172.21.15.69:0/3047412239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5c61230 msgr2=0x556ab5c6a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:13.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.630+0000 7f74dd000700 1 --2- 172.21.15.69:0/3047412239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5c61230 0x556ab5c6a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.630+0000 7f74dd000700 1 -- 172.21.15.69:0/3047412239 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab5acf880 con 0x556ab5ae2df0 2024-05-14T15:20:13.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.631+0000 7f74dd000700 1 --2- 172.21.15.69:0/3047412239 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5ae2df0 0x556ab5c60cf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00ad00 tx=0x7f74cc00f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34bc93703df5e96a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:13.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.631+0000 7f74dda00700 1 --2- 172.21.15.69:0/641732334 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f74c00b2880 0x7f74c00b4d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x556ab5c61ad0 tx=0x7f74d0007610 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:13.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.631+0000 7f74ca000700 1 -- 172.21.15.69:0/3047412239 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc00ae50 con 0x556ab5ae2df0 2024-05-14T15:20:13.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.631+0000 7f74ca000700 1 -- 172.21.15.69:0/3047412239 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74cc0044b0 con 0x556ab5ae2df0 2024-05-14T15:20:13.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.631+0000 7f74ca000700 1 -- 172.21.15.69:0/3047412239 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc018440 con 0x556ab5ae2df0 2024-05-14T15:20:13.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.633+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/3047412239 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5ae2df0 msgr2=0x556ab5c60cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:13.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.633+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/3047412239 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5ae2df0 0x556ab5c60cf0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00ad00 tx=0x7f74cc00f6a0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.633+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/3047412239 shutdown_connections 2024-05-14T15:20:13.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.633+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/3047412239 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5ae2df0 0x556ab5c60cf0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.633+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/3047412239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 0x556ab5c6cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.633+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/3047412239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5c61230 0x556ab5c6a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.633+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/3047412239 >> 172.21.15.69:0/3047412239 conn(0x556ab5b21a30 msgr2=0x556ab5c5bb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:13.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.633+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/3047412239 shutdown_connections 2024-05-14T15:20:13.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.633+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/3047412239 wait complete. 2024-05-14T15:20:13.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.634+0000 7f74ee4ddb80 1 -- start start 2024-05-14T15:20:13.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.634+0000 7f74ee4ddb80 1 Processor -- start 2024-05-14T15:20:13.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.635+0000 7f74ee4ddb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5ae2df0 0x556ab5c6a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.635+0000 7f74ee4ddb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5c61230 0x556ab5c6a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.635+0000 7f74ee4ddb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 0x556ab5c6adf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.635+0000 7f74ee4ddb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x556ab5c6d750 con 0x556ab5c61230 2024-05-14T15:20:13.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.635+0000 7f74ee4ddb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556ab5ae8ad0 con 0x556ab5ae2df0 2024-05-14T15:20:13.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.635+0000 7f74ee4ddb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556ab5c6d8d0 con 0x556ab5c61640 2024-05-14T15:20:13.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.635+0000 7f74ee4ddb80 10 client.0 _ll_register_callbacks cb 0x556ab5b16330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:20:13.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.636+0000 7f74d7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5c61230 0x556ab5c6a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.636+0000 7f74d7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5c61230 0x556ab5c6a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46498/0 (socket says 172.21.15.69:46498) 2024-05-14T15:20:13.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.636+0000 7f74d7e00700 1 -- 172.21.15.69:0/1381731223 learned_addr learned my addr 172.21.15.69:0/1381731223 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:13.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.636+0000 7f74dd000700 1 --2- 172.21.15.69:0/1381731223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5ae2df0 0x556ab5c6a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.636+0000 7f74dda00700 1 --2- 172.21.15.69:0/1381731223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 0x556ab5c6adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.636+0000 7f74d7e00700 1 -- 172.21.15.69:0/1381731223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 msgr2=0x556ab5c6adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:13.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.636+0000 7f74d7e00700 1 --2- 172.21.15.69:0/1381731223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 0x556ab5c6adf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.636+0000 7f74d7e00700 1 -- 172.21.15.69:0/1381731223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5ae2df0 msgr2=0x556ab5c6a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:13.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.636+0000 7f74d7e00700 1 --2- 172.21.15.69:0/1381731223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5ae2df0 0x556ab5c6a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.636+0000 7f74d7e00700 1 -- 172.21.15.69:0/1381731223 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ab5b483d0 con 0x556ab5c61230 2024-05-14T15:20:13.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.636+0000 7f74dda00700 1 --2- 172.21.15.69:0/1381731223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 0x556ab5c6adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:20:13.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.637+0000 7f74d7e00700 1 --2- 172.21.15.69:0/1381731223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5c61230 0x556ab5c6a8b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f74c40a6950 tx=0x7f74c4078630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6a58a5821ba552 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:13.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.637+0000 7f74bea00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:20:13.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.637+0000 7f74bea00700 1 -- 172.21.15.69:0/1381731223 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74c406e1e0 con 0x556ab5c61230 2024-05-14T15:20:13.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.637+0000 7f74bea00700 1 -- 172.21.15.69:0/1381731223 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f74c4022470 con 0x556ab5c61230 2024-05-14T15:20:13.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.637+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/1381731223 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74cc0044b0 con 0x556ab5c61230 2024-05-14T15:20:13.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.637+0000 7f74bea00700 1 -- 172.21.15.69:0/1381731223 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f74c40a6060 con 0x556ab5c61230 2024-05-14T15:20:13.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.637+0000 7f74ee4ddb80 10 client.15087 fetch_fsmap learned FSMap version 29 2024-05-14T15:20:13.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.637+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/1381731223 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556ab5c783b0 con 0x556ab5c61230 2024-05-14T15:20:13.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.638+0000 7f74bea00700 1 -- 172.21.15.69:0/1381731223 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74cc0044b0 con 0x556ab5c61230 2024-05-14T15:20:13.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.638+0000 7f74bea00700 1 -- 172.21.15.69:0/1381731223 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f74c40b3210 con 0x556ab5c61230 2024-05-14T15:20:13.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.638+0000 7f74ee4ddb80 10 client.15087 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:20:13.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.638+0000 7f74ee4ddb80 10 client.15087 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-14T15:20:13.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.638+0000 7f74ee4ddb80 20 client.15087 populate_metadata read hostname 'smithi069' 2024-05-14T15:20:13.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.638+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/1381731223 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x556ab5c7a9b0 0x556ab5c7be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.638+0000 7f74ee4ddb80 4 client.15087 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:20:13.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.638+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/1381731223 --> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ab5c2d020 con 0x556ab5c7a9b0 2024-05-14T15:20:13.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.639+0000 7f74dd000700 1 --2- 172.21.15.69:0/1381731223 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x556ab5c7a9b0 0x556ab5c7be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.640+0000 7f74dd000700 1 --2- 172.21.15.69:0/1381731223 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x556ab5c7a9b0 0x556ab5c7be20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=9d9dd8a6558040d9 server_cookie=6f61659789259ec9 in_seq=0 out_seq=0 2024-05-14T15:20:13.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.640+0000 7f74bea00700 10 client.15087 ms_handle_connect on v2:172.21.15.92:6832/1997000798 2024-05-14T15:20:13.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.641+0000 7f74bea00700 1 -- 172.21.15.69:0/1381731223 <== mds.3 v2:172.21.15.92:6832/1997000798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556ab5c2d020 con 0x556ab5c7a9b0 2024-05-14T15:20:13.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.642+0000 7f74bea00700 10 client.15087 handle_command_reply: tid=0 2024-05-14T15:20:13.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.642+0000 7f74ee4ddb80 1 client.15087 shutdown 2024-05-14T15:20:13.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.642+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/1381731223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5c61230 msgr2=0x556ab5c6a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:13.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.642+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/1381731223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5c61230 0x556ab5c6a8b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f74c40a6950 tx=0x7f74c4078630 comp rx=0 tx=0).stop 2024-05-14T15:20:13.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.642+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/1381731223 shutdown_connections 2024-05-14T15:20:13.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.642+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/1381731223 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x556ab5c7a9b0 0x556ab5c7be20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.642+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/1381731223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 0x556ab5c6adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.642+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/1381731223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5ae2df0 0x556ab5c6a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.642+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/1381731223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5c61230 0x556ab5c6a8b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.642+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/1381731223 >> 172.21.15.69:0/1381731223 conn(0x556ab5b21a30 msgr2=0x556ab5c5f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:13.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.642+0000 7f74bea00700 0 client.15087 ms_handle_reset on v2:172.21.15.92:6832/1997000798 2024-05-14T15:20:13.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.642+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/1381731223 shutdown_connections 2024-05-14T15:20:13.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.642+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/1381731223 wait complete. 2024-05-14T15:20:13.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.642+0000 7f74ee4ddb80 20 client.15087 trim_cache size 0 max 16384 2024-05-14T15:20:13.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.665+0000 7f74ee4ddb80 1 Processor -- start 2024-05-14T15:20:13.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.665+0000 7f74ee4ddb80 1 -- start start 2024-05-14T15:20:13.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.666+0000 7f74ee4ddb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5ae2df0 0x556ab5c5fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.666+0000 7f74ee4ddb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5c61230 0x556ab5c76b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.666+0000 7f74ee4ddb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 0x556ab5c65780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.666+0000 7f74ee4ddb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x556ab5c7a160 con 0x556ab5ae2df0 2024-05-14T15:20:13.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.666+0000 7f74ee4ddb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556ab5c7a830 con 0x556ab5c61230 2024-05-14T15:20:13.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.666+0000 7f74ee4ddb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556ab5c7af00 con 0x556ab5c61640 2024-05-14T15:20:13.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.666+0000 7f74dd000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5ae2df0 0x556ab5c5fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.666+0000 7f74dd000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5ae2df0 0x556ab5c5fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46508/0 (socket says 172.21.15.69:46508) 2024-05-14T15:20:13.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.666+0000 7f74dd000700 1 -- 172.21.15.69:0/3500814447 learned_addr learned my addr 172.21.15.69:0/3500814447 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:13.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.666+0000 7f74dda00700 1 --2- 172.21.15.69:0/3500814447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 0x556ab5c65780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.666+0000 7f74d7e00700 1 --2- 172.21.15.69:0/3500814447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5c61230 0x556ab5c76b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.666+0000 7f74dd000700 1 -- 172.21.15.69:0/3500814447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 msgr2=0x556ab5c65780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:13.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.666+0000 7f74dd000700 1 --2- 172.21.15.69:0/3500814447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 0x556ab5c65780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.666+0000 7f74dd000700 1 -- 172.21.15.69:0/3500814447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5c61230 msgr2=0x556ab5c76b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:13.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.666+0000 7f74dd000700 1 --2- 172.21.15.69:0/3500814447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5c61230 0x556ab5c76b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.666+0000 7f74dd000700 1 -- 172.21.15.69:0/3500814447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ab5c622b0 con 0x556ab5ae2df0 2024-05-14T15:20:13.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.667+0000 7f74dda00700 1 --2- 172.21.15.69:0/3500814447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 0x556ab5c65780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:20:13.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.667+0000 7f74dd000700 1 --2- 172.21.15.69:0/3500814447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5ae2df0 0x556ab5c5fdc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00ad00 tx=0x7f74cc0036d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6178a144e798176 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:13.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.667+0000 7f74c9600700 1 -- 172.21.15.69:0/3500814447 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc005df0 con 0x556ab5ae2df0 2024-05-14T15:20:13.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.667+0000 7f74c9600700 1 -- 172.21.15.69:0/3500814447 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74cc003d90 con 0x556ab5ae2df0 2024-05-14T15:20:13.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.667+0000 7f74c9600700 1 -- 172.21.15.69:0/3500814447 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc029250 con 0x556ab5ae2df0 2024-05-14T15:20:13.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.668+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/3500814447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5ae2df0 msgr2=0x556ab5c5fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.668+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/3500814447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5ae2df0 0x556ab5c5fdc0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00ad00 tx=0x7f74cc0036d0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.668+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/3500814447 shutdown_connections 2024-05-14T15:20:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.668+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/3500814447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5ae2df0 0x556ab5c5fdc0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.668+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/3500814447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5c61640 0x556ab5c65780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.668+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/3500814447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5c61230 0x556ab5c76b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.668+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/3500814447 >> 172.21.15.69:0/3500814447 conn(0x556ab5b21a30 msgr2=0x556ab5c5f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.668+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/3500814447 shutdown_connections 2024-05-14T15:20:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.668+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/3500814447 wait complete. 2024-05-14T15:20:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.669+0000 7f74ee4ddb80 1 -- start start 2024-05-14T15:20:13.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.669+0000 7f74ee4ddb80 1 Processor -- start 2024-05-14T15:20:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.669+0000 7f74ee4ddb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5ae2df0 0x556ab5c85890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.669+0000 7f74ee4ddb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5c61230 0x556ab5c7ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.669+0000 7f74ee4ddb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5c61640 0x556ab5c7f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.669+0000 7f74ee4ddb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x556ab5c7bca0 con 0x556ab5c61640 2024-05-14T15:20:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.669+0000 7f74ee4ddb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556ab5c7b5d0 con 0x556ab5c61230 2024-05-14T15:20:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.669+0000 7f74ee4ddb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556ab5c7c370 con 0x556ab5ae2df0 2024-05-14T15:20:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.670+0000 7f74ee4ddb80 10 client.0 _ll_register_callbacks cb 0x556ab5b16330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:20:13.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.670+0000 7f74dda00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5c61640 0x556ab5c7f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.670+0000 7f74dda00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5c61640 0x556ab5c7f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46522/0 (socket says 172.21.15.69:46522) 2024-05-14T15:20:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.670+0000 7f74dda00700 1 -- 172.21.15.69:0/4088048891 learned_addr learned my addr 172.21.15.69:0/4088048891 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.670+0000 7f74d7e00700 1 --2- 172.21.15.69:0/4088048891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5c61230 0x556ab5c7ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.670+0000 7f74dd000700 1 --2- 172.21.15.69:0/4088048891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5ae2df0 0x556ab5c85890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.670+0000 7f74dda00700 1 -- 172.21.15.69:0/4088048891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5ae2df0 msgr2=0x556ab5c85890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.670+0000 7f74dda00700 1 --2- 172.21.15.69:0/4088048891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5ae2df0 0x556ab5c85890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.670+0000 7f74dda00700 1 -- 172.21.15.69:0/4088048891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5c61230 msgr2=0x556ab5c7ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.670+0000 7f74dda00700 1 --2- 172.21.15.69:0/4088048891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5c61230 0x556ab5c7ec20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.670+0000 7f74dda00700 1 -- 172.21.15.69:0/4088048891 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ab5c7f980 con 0x556ab5c61640 2024-05-14T15:20:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.671+0000 7f74dda00700 1 --2- 172.21.15.69:0/4088048891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5c61640 0x556ab5c7f1e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f74d0016980 tx=0x7f74d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=555a52c26476d1df server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.671+0000 7f74bea00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:20:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.671+0000 7f74bea00700 1 -- 172.21.15.69:0/4088048891 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0029060 con 0x556ab5c61640 2024-05-14T15:20:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.671+0000 7f74bea00700 1 -- 172.21.15.69:0/4088048891 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f74d0019770 con 0x556ab5c61640 2024-05-14T15:20:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.671+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/4088048891 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74cc003d90 con 0x556ab5c61640 2024-05-14T15:20:13.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.671+0000 7f74bea00700 1 -- 172.21.15.69:0/4088048891 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f74d0030050 con 0x556ab5c61640 2024-05-14T15:20:13.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.672+0000 7f74ee4ddb80 10 client.15093 fetch_fsmap learned FSMap version 29 2024-05-14T15:20:13.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.672+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/4088048891 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x556ab5ce5e20 con 0x556ab5c61640 2024-05-14T15:20:13.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.672+0000 7f74bea00700 1 -- 172.21.15.69:0/4088048891 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f74cc003d90 con 0x556ab5c61640 2024-05-14T15:20:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.672+0000 7f74bea00700 1 -- 172.21.15.69:0/4088048891 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f74d0024ad0 con 0x556ab5c61640 2024-05-14T15:20:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.672+0000 7f74ee4ddb80 10 client.15093 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:20:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.672+0000 7f74ee4ddb80 10 client.15093 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-14T15:20:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.672+0000 7f74ee4ddb80 20 client.15093 populate_metadata read hostname 'smithi069' 2024-05-14T15:20:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.672+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/4088048891 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x556ab5ce81f0 0x556ab5ce9660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.672+0000 7f74ee4ddb80 4 client.15093 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T15:20:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.672+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/4088048891 --> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] -- command(tid 0: {"prefix": "status"}) -- 0x556ab5b903b0 con 0x556ab5ce81f0 2024-05-14T15:20:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.673+0000 7f74dd000700 1 --2- 172.21.15.69:0/4088048891 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x556ab5ce81f0 0x556ab5ce9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.674+0000 7f74dd000700 1 --2- 172.21.15.69:0/4088048891 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x556ab5ce81f0 0x556ab5ce9660 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f1f2ef6640be7172 server_cookie=f1177644b2541a9 in_seq=0 out_seq=0 2024-05-14T15:20:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.674+0000 7f74bea00700 10 client.15093 ms_handle_connect on v2:172.21.15.92:6832/1997000798 2024-05-14T15:20:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.674+0000 7f74bea00700 1 -- 172.21.15.69:0/4088048891 <== mds.3 v2:172.21.15.92:6832/1997000798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556ab5b903b0 con 0x556ab5ce81f0 2024-05-14T15:20:13.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.674+0000 7f74bea00700 10 client.15093 handle_command_reply: tid=0 2024-05-14T15:20:13.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.674+0000 7f74ee4ddb80 1 client.15093 shutdown 2024-05-14T15:20:13.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.675+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/4088048891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5c61640 msgr2=0x556ab5c7f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.675+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/4088048891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5c61640 0x556ab5c7f1e0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f74d0016980 tx=0x7f74d0004ad0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.675+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/4088048891 shutdown_connections 2024-05-14T15:20:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.675+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/4088048891 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x556ab5ce81f0 0x556ab5ce9660 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.675+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/4088048891 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556ab5c61640 0x556ab5c7f1e0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.675+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/4088048891 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556ab5ae2df0 0x556ab5c85890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.675+0000 7f74ee4ddb80 1 --2- 172.21.15.69:0/4088048891 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556ab5c61230 0x556ab5c7ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.675+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/4088048891 >> 172.21.15.69:0/4088048891 conn(0x556ab5b21a30 msgr2=0x556ab5c6b910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.675+0000 7f74bea00700 0 client.15093 ms_handle_reset on v2:172.21.15.92:6832/1997000798 2024-05-14T15:20:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.675+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/4088048891 shutdown_connections 2024-05-14T15:20:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.675+0000 7f74ee4ddb80 1 -- 172.21.15.69:0/4088048891 wait complete. 2024-05-14T15:20:13.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.675+0000 7f74ee4ddb80 20 client.15093 trim_cache size 0 max 16384 2024-05-14T15:20:13.678 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:20:13.678 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "1cc2580e-1203-11ef-bc98-c7b262605968", 2024-05-14T15:20:13.678 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 3, 2024-05-14T15:20:13.678 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 34409, 2024-05-14T15:20:13.678 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-05-14T15:20:13.678 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-05-14T15:20:13.678 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-05-14T15:20:13.678 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 157.35981955299999, 2024-05-14T15:20:13.678 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 29, 2024-05-14T15:20:13.678 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 91, 2024-05-14T15:20:13.678 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 89, 2024-05-14T15:20:13.678 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 307.57913875000003 2024-05-14T15:20:13.679 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:20:13.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.676+0000 7f74de400700 1 -- 172.21.15.69:0/641732334 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f74c00b2880 msgr2=0x7f74c00b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:13.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.676+0000 7f74de400700 1 --2- 172.21.15.69:0/641732334 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f74c00b2880 0x7f74c00b4d90 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x556ab5c61ad0 tx=0x7f74d0007610 comp rx=0 tx=0).stop 2024-05-14T15:20:13.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.676+0000 7f74de400700 1 -- 172.21.15.69:0/641732334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74d810b110 msgr2=0x7f74d81a17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:13.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.676+0000 7f74de400700 1 --2- 172.21.15.69:0/641732334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74d810b110 0x7f74d81a17d0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f74c4000c00 tx=0x7f74c40036f0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.676+0000 7f74de400700 1 -- 172.21.15.69:0/641732334 shutdown_connections 2024-05-14T15:20:13.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.676+0000 7f74de400700 1 --2- 172.21.15.69:0/641732334 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f74c00b2880 0x7f74c00b4d90 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.676+0000 7f74de400700 1 --2- 172.21.15.69:0/641732334 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f74d81107a0 0x7f74d81a5a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.676+0000 7f74de400700 1 --2- 172.21.15.69:0/641732334 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74d810a7c0 0x7f74d81a1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.676+0000 7f74de400700 1 --2- 172.21.15.69:0/641732334 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f74d810b110 0x7f74d81a17d0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:13.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.676+0000 7f74de400700 1 -- 172.21.15.69:0/641732334 >> 172.21.15.69:0/641732334 conn(0x7f74d8076b00 msgr2=0x7f74d8108a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:13.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.676+0000 7f74de400700 1 -- 172.21.15.69:0/641732334 shutdown_connections 2024-05-14T15:20:13.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:13.676+0000 7f74de400700 1 -- 172.21.15.69:0/641732334 wait complete. 2024-05-14T15:20:13.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:13 smithi092 ceph-mon[34729]: pgmap v516: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:20:14.683 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.e status 2024-05-14T15:20:15.141 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:20:15.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:15 smithi069 ceph-mon[31270]: pgmap v517: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:20:15.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:15 smithi203 ceph-mon[34567]: pgmap v517: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:20:15.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:15 smithi092 ceph-mon[34729]: pgmap v517: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:20:17.333 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:17 smithi069 ceph-mon[31270]: pgmap v518: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:20:17.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.575+0000 7f476e400700 1 -- 172.21.15.69:0/1753825101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f476810c5c0 msgr2=0x7f476810c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:17.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.575+0000 7f476e400700 1 --2- 172.21.15.69:0/1753825101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f476810c5c0 0x7f476810c9d0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f4758009990 tx=0x7f4758009ca0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.575+0000 7f476e400700 1 -- 172.21.15.69:0/1753825101 shutdown_connections 2024-05-14T15:20:17.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.575+0000 7f476e400700 1 --2- 172.21.15.69:0/1753825101 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f476810c5c0 0x7f476810c9d0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.575+0000 7f476e400700 1 --2- 172.21.15.69:0/1753825101 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4768106ed0 0x7f4768113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.575+0000 7f476e400700 1 --2- 172.21.15.69:0/1753825101 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4768106580 0x7f4768106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.575+0000 7f476e400700 1 -- 172.21.15.69:0/1753825101 >> 172.21.15.69:0/1753825101 conn(0x7f47681020c0 msgr2=0x7f4768104510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:17.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.575+0000 7f476e400700 1 -- 172.21.15.69:0/1753825101 shutdown_connections 2024-05-14T15:20:17.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.575+0000 7f476e400700 1 -- 172.21.15.69:0/1753825101 wait complete. 2024-05-14T15:20:17.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.576+0000 7f476e400700 1 Processor -- start 2024-05-14T15:20:17.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.577+0000 7f476e400700 1 -- start start 2024-05-14T15:20:17.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.577+0000 7f476e400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4768106580 0x7f476819cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.577+0000 7f476e400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4768106ed0 0x7f476819d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.577+0000 7f476e400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f476810c5c0 0x7f47681a17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.577+0000 7f476e400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f47681165f0 con 0x7f4768106ed0 2024-05-14T15:20:17.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.577+0000 7f476e400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4768116470 con 0x7f4768106580 2024-05-14T15:20:17.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.577+0000 7f476e400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4768116770 con 0x7f476810c5c0 2024-05-14T15:20:17.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.578+0000 7f4766a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4768106ed0 0x7f476819d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.578+0000 7f4766a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4768106ed0 0x7f476819d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46526/0 (socket says 172.21.15.69:46526) 2024-05-14T15:20:17.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.578+0000 7f4766a00700 1 -- 172.21.15.69:0/484481847 learned_addr learned my addr 172.21.15.69:0/484481847 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:17.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.578+0000 7f4767400700 1 --2- 172.21.15.69:0/484481847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4768106580 0x7f476819cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.578+0000 7f4767e00700 1 --2- 172.21.15.69:0/484481847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f476810c5c0 0x7f47681a17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.578+0000 7f4766a00700 1 -- 172.21.15.69:0/484481847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f476810c5c0 msgr2=0x7f47681a17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:17.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.578+0000 7f4766a00700 1 --2- 172.21.15.69:0/484481847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f476810c5c0 0x7f47681a17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.578+0000 7f4766a00700 1 -- 172.21.15.69:0/484481847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4768106580 msgr2=0x7f476819cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:17.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.578+0000 7f4766a00700 1 --2- 172.21.15.69:0/484481847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4768106580 0x7f476819cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.578+0000 7f4766a00700 1 -- 172.21.15.69:0/484481847 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47681a1e50 con 0x7f4768106ed0 2024-05-14T15:20:17.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.579+0000 7f4766a00700 1 --2- 172.21.15.69:0/484481847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4768106ed0 0x7f476819d520 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f475400e940 tx=0x7f475400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:17.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.579+0000 7f475fe00700 1 -- 172.21.15.69:0/484481847 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475400cbd0 con 0x7f4768106ed0 2024-05-14T15:20:17.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.579+0000 7f475fe00700 1 -- 172.21.15.69:0/484481847 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f475400cd70 con 0x7f4768106ed0 2024-05-14T15:20:17.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.579+0000 7f476e400700 1 -- 172.21.15.69:0/484481847 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47681a2140 con 0x7f4768106ed0 2024-05-14T15:20:17.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.579+0000 7f475fe00700 1 -- 172.21.15.69:0/484481847 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4754018680 con 0x7f4768106ed0 2024-05-14T15:20:17.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.579+0000 7f476e400700 1 -- 172.21.15.69:0/484481847 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47681a9a60 con 0x7f4768106ed0 2024-05-14T15:20:17.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.584+0000 7f475fe00700 1 -- 172.21.15.69:0/484481847 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4754018820 con 0x7f4768106ed0 2024-05-14T15:20:17.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.584+0000 7f477cf9cb80 1 Processor -- start 2024-05-14T15:20:17.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.584+0000 7f477cf9cb80 1 -- start start 2024-05-14T15:20:17.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.585+0000 7f477cf9cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2518d0df0 0x55d251a54660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.585+0000 7f477cf9cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a4e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.585+0000 7f477cf9cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d251a4ec00 0x55d251a4f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.585+0000 7f477cf9cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55d2519709d0 con 0x55d251a54ba0 2024-05-14T15:20:17.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.585+0000 7f477cf9cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d25190e710 con 0x55d2518d0df0 2024-05-14T15:20:17.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.585+0000 7f477cf9cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d25196c990 con 0x55d251a4ec00 2024-05-14T15:20:17.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.585+0000 7f4767400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a4e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.585+0000 7f4767e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2518d0df0 0x55d251a54660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.585+0000 7f4767400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a4e6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46528/0 (socket says 172.21.15.69:46528) 2024-05-14T15:20:17.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.585+0000 7f4767400700 1 -- 172.21.15.69:0/4219479583 learned_addr learned my addr 172.21.15.69:0/4219479583 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:17.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.586+0000 7f4766a00700 1 --2- 172.21.15.69:0/4219479583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d251a4ec00 0x55d251a4f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.586 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.586+0000 7f475fe00700 1 --2- 172.21.15.69:0/484481847 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f474c0b2880 0x7f474c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.586+0000 7f4767400700 1 -- 172.21.15.69:0/4219479583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d251a4ec00 msgr2=0x55d251a4f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.586+0000 7f475fe00700 1 -- 172.21.15.69:0/484481847 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f47540e2940 con 0x7f4768106ed0 2024-05-14T15:20:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.586+0000 7f4767400700 1 --2- 172.21.15.69:0/4219479583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d251a4ec00 0x55d251a4f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.586+0000 7f4767400700 1 -- 172.21.15.69:0/4219479583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2518d0df0 msgr2=0x55d251a54660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.586+0000 7f4767400700 1 --2- 172.21.15.69:0/4219479583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2518d0df0 0x55d251a54660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.586+0000 7f4767400700 1 -- 172.21.15.69:0/4219479583 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2518bd880 con 0x55d251a54ba0 2024-05-14T15:20:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.587+0000 7f4767e00700 1 --2- 172.21.15.69:0/4219479583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2518d0df0 0x55d251a54660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:20:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.587+0000 7f4767e00700 1 --2- 172.21.15.69:0/484481847 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f474c0b2880 0x7f474c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.587+0000 7f4767400700 1 --2- 172.21.15.69:0/4219479583 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a4e6c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4758015000 tx=0x7f47580096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13c645532cc9d8ed server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.587+0000 7f475cc00700 1 -- 172.21.15.69:0/4219479583 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4758026070 con 0x55d251a54ba0 2024-05-14T15:20:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.587+0000 7f475cc00700 1 -- 172.21.15.69:0/4219479583 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47580054d0 con 0x55d251a54ba0 2024-05-14T15:20:17.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.587+0000 7f475cc00700 1 -- 172.21.15.69:0/4219479583 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475800b9a0 con 0x55d251a54ba0 2024-05-14T15:20:17.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.588+0000 7f4767e00700 1 --2- 172.21.15.69:0/484481847 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f474c0b2880 0x7f474c0b4d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55d251a4f9e0 tx=0x7f4760004ad0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:17.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.588+0000 7f477cf9cb80 1 -- 172.21.15.69:0/4219479583 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 msgr2=0x55d251a4e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:17.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.588+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/4219479583 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a4e6c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4758015000 tx=0x7f47580096a0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.589+0000 7f477cf9cb80 1 -- 172.21.15.69:0/4219479583 shutdown_connections 2024-05-14T15:20:17.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.589+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/4219479583 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d251a4ec00 0x55d251a4f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.589+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/4219479583 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2518d0df0 0x55d251a54660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.589+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/4219479583 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a4e6c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.589+0000 7f477cf9cb80 1 -- 172.21.15.69:0/4219479583 >> 172.21.15.69:0/4219479583 conn(0x55d25190fa30 msgr2=0x55d251a49740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:17.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.589+0000 7f477cf9cb80 1 -- 172.21.15.69:0/4219479583 shutdown_connections 2024-05-14T15:20:17.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.589+0000 7f477cf9cb80 1 -- 172.21.15.69:0/4219479583 wait complete. 2024-05-14T15:20:17.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.590+0000 7f477cf9cb80 1 -- start start 2024-05-14T15:20:17.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.590+0000 7f477cf9cb80 1 Processor -- start 2024-05-14T15:20:17.590 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.590+0000 7f477cf9cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2518d0df0 0x55d251a58340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.590+0000 7f477cf9cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a4ec00 0x55d251a58880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.590+0000 7f477cf9cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d251a54ba0 0x55d251a58dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.590+0000 7f477cf9cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55d251a5b610 con 0x55d251a4ec00 2024-05-14T15:20:17.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.590+0000 7f477cf9cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d2518d6ad0 con 0x55d251a54ba0 2024-05-14T15:20:17.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.590+0000 7f477cf9cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d251a5b790 con 0x55d2518d0df0 2024-05-14T15:20:17.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.591+0000 7f477cf9cb80 10 client.0 _ll_register_callbacks cb 0x55d251904330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:20:17.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.591+0000 7f4766a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a4ec00 0x55d251a58880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.591+0000 7f4766a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a4ec00 0x55d251a58880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46536/0 (socket says 172.21.15.69:46536) 2024-05-14T15:20:17.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.591+0000 7f4766a00700 1 -- 172.21.15.69:0/1017906428 learned_addr learned my addr 172.21.15.69:0/1017906428 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:17.591 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.591+0000 7f4767400700 1 --2- 172.21.15.69:0/1017906428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2518d0df0 0x55d251a58340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.592 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.591+0000 7f4767e00700 1 --2- 172.21.15.69:0/1017906428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d251a54ba0 0x55d251a58dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.591+0000 7f4766a00700 1 -- 172.21.15.69:0/1017906428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2518d0df0 msgr2=0x55d251a58340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:17.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.591+0000 7f4766a00700 1 --2- 172.21.15.69:0/1017906428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2518d0df0 0x55d251a58340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.591+0000 7f4766a00700 1 -- 172.21.15.69:0/1017906428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d251a54ba0 msgr2=0x55d251a58dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:17.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.591+0000 7f4766a00700 1 --2- 172.21.15.69:0/1017906428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d251a54ba0 0x55d251a58dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.591+0000 7f4766a00700 1 -- 172.21.15.69:0/1017906428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2519363d0 con 0x55d251a4ec00 2024-05-14T15:20:17.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.592+0000 7f4766a00700 1 --2- 172.21.15.69:0/1017906428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a4ec00 0x55d251a58880 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f47540a9830 tx=0x7f4754010af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c82e9f2338ec46f1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:17.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.592+0000 7f4751600700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:20:17.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.592+0000 7f4751600700 1 -- 172.21.15.69:0/1017906428 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47540a92a0 con 0x55d251a4ec00 2024-05-14T15:20:17.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.592+0000 7f4751600700 1 -- 172.21.15.69:0/1017906428 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f47540b2710 con 0x55d251a4ec00 2024-05-14T15:20:17.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.592+0000 7f477cf9cb80 1 -- 172.21.15.69:0/1017906428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47580054d0 con 0x55d251a4ec00 2024-05-14T15:20:17.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.592+0000 7f4751600700 1 -- 172.21.15.69:0/1017906428 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f47540b22d0 con 0x55d251a4ec00 2024-05-14T15:20:17.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.592+0000 7f477cf9cb80 10 client.15105 fetch_fsmap learned FSMap version 29 2024-05-14T15:20:17.593 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.592+0000 7f477cf9cb80 1 -- 172.21.15.69:0/1017906428 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d251a66240 con 0x55d251a4ec00 2024-05-14T15:20:17.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.593+0000 7f4751600700 1 -- 172.21.15.69:0/1017906428 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47580054d0 con 0x55d251a4ec00 2024-05-14T15:20:17.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.593+0000 7f4751600700 1 -- 172.21.15.69:0/1017906428 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f4754018b10 con 0x55d251a4ec00 2024-05-14T15:20:17.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.593+0000 7f477cf9cb80 10 client.15105 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:20:17.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.593+0000 7f477cf9cb80 10 client.15105 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-14T15:20:17.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.593+0000 7f477cf9cb80 20 client.15105 populate_metadata read hostname 'smithi069' 2024-05-14T15:20:17.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.593+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/1017906428 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55d251a68820 0x55d251a69c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.593+0000 7f477cf9cb80 4 client.15105 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:20:17.594 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.593+0000 7f477cf9cb80 1 -- 172.21.15.69:0/1017906428 --> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d251a1b020 con 0x55d251a68820 2024-05-14T15:20:17.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:17 smithi203 ceph-mon[34567]: pgmap v518: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:20:17.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.594+0000 7f4767400700 1 --2- 172.21.15.69:0/1017906428 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55d251a68820 0x55d251a69c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.595+0000 7f4767400700 1 --2- 172.21.15.69:0/1017906428 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55d251a68820 0x55d251a69c90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3c267fb1167c510 server_cookie=ce50e69709675e0 in_seq=0 out_seq=0 2024-05-14T15:20:17.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.595+0000 7f4751600700 10 client.15105 ms_handle_connect on v2:172.21.15.92:6834/360295917 2024-05-14T15:20:17.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.597+0000 7f4751600700 1 -- 172.21.15.69:0/1017906428 <== mds.2 v2:172.21.15.92:6834/360295917 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d251a1b020 con 0x55d251a68820 2024-05-14T15:20:17.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.597+0000 7f4751600700 10 client.15105 handle_command_reply: tid=0 2024-05-14T15:20:17.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.597+0000 7f477cf9cb80 1 client.15105 shutdown 2024-05-14T15:20:17.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.597+0000 7f477cf9cb80 1 -- 172.21.15.69:0/1017906428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a4ec00 msgr2=0x55d251a58880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:17.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.597+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/1017906428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a4ec00 0x55d251a58880 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f47540a9830 tx=0x7f4754010af0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.598+0000 7f477cf9cb80 1 -- 172.21.15.69:0/1017906428 shutdown_connections 2024-05-14T15:20:17.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.598+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/1017906428 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55d251a68820 0x55d251a69c90 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.598+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/1017906428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d251a54ba0 0x55d251a58dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.598+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/1017906428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2518d0df0 0x55d251a58340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.598+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/1017906428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a4ec00 0x55d251a58880 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.598+0000 7f477cf9cb80 1 -- 172.21.15.69:0/1017906428 >> 172.21.15.69:0/1017906428 conn(0x55d25190fa30 msgr2=0x55d251a4d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:17.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.598+0000 7f4751600700 0 client.15105 ms_handle_reset on v2:172.21.15.92:6834/360295917 2024-05-14T15:20:17.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.598+0000 7f477cf9cb80 1 -- 172.21.15.69:0/1017906428 shutdown_connections 2024-05-14T15:20:17.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.598+0000 7f477cf9cb80 1 -- 172.21.15.69:0/1017906428 wait complete. 2024-05-14T15:20:17.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.598+0000 7f477cf9cb80 20 client.15105 trim_cache size 0 max 16384 2024-05-14T15:20:17.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.620+0000 7f477cf9cb80 1 Processor -- start 2024-05-14T15:20:17.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.621+0000 7f477cf9cb80 1 -- start start 2024-05-14T15:20:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.621+0000 7f477cf9cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2518d0df0 0x55d251a4e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.621+0000 7f477cf9cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d251a4ec00 0x55d251a64a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.621+0000 7f477cf9cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a53bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.621+0000 7f477cf9cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55d251a67fd0 con 0x55d251a54ba0 2024-05-14T15:20:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.621+0000 7f477cf9cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d251a686a0 con 0x55d251a4ec00 2024-05-14T15:20:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.621+0000 7f477cf9cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d251a68d70 con 0x55d2518d0df0 2024-05-14T15:20:17.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.621+0000 7f4767e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a53bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.622+0000 7f4767e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a53bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46540/0 (socket says 172.21.15.69:46540) 2024-05-14T15:20:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.622+0000 7f4767e00700 1 -- 172.21.15.69:0/4160281783 learned_addr learned my addr 172.21.15.69:0/4160281783 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:17.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.622+0000 7f4766a00700 1 --2- 172.21.15.69:0/4160281783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d251a4ec00 0x55d251a64a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.622+0000 7f4767400700 1 --2- 172.21.15.69:0/4160281783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2518d0df0 0x55d251a4e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.622+0000 7f4767e00700 1 -- 172.21.15.69:0/4160281783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2518d0df0 msgr2=0x55d251a4e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.622+0000 7f4767e00700 1 --2- 172.21.15.69:0/4160281783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2518d0df0 0x55d251a4e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.622+0000 7f4767e00700 1 -- 172.21.15.69:0/4160281783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d251a4ec00 msgr2=0x55d251a64a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.622+0000 7f4767e00700 1 --2- 172.21.15.69:0/4160281783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d251a4ec00 0x55d251a64a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.622+0000 7f4767e00700 1 -- 172.21.15.69:0/4160281783 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d251a44090 con 0x55d251a54ba0 2024-05-14T15:20:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.622+0000 7f4766a00700 1 --2- 172.21.15.69:0/4160281783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d251a4ec00 0x55d251a64a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:20:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.623+0000 7f4767e00700 1 --2- 172.21.15.69:0/4160281783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a53bd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4760017610 tx=0x7f4760016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e95117cdf0ac8a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.623+0000 7f4753e00700 1 -- 172.21.15.69:0/4160281783 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4760024430 con 0x55d251a54ba0 2024-05-14T15:20:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.623+0000 7f4753e00700 1 -- 172.21.15.69:0/4160281783 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4760029070 con 0x55d251a54ba0 2024-05-14T15:20:17.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.623+0000 7f4753e00700 1 -- 172.21.15.69:0/4160281783 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4760016810 con 0x55d251a54ba0 2024-05-14T15:20:17.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.624+0000 7f477cf9cb80 1 -- 172.21.15.69:0/4160281783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 msgr2=0x55d251a53bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:17.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.625+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/4160281783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a53bd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f4760017610 tx=0x7f4760016000 comp rx=0 tx=0).stop 2024-05-14T15:20:17.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.625+0000 7f477cf9cb80 1 -- 172.21.15.69:0/4160281783 shutdown_connections 2024-05-14T15:20:17.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.625+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/4160281783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a53bd0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.625+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/4160281783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2518d0df0 0x55d251a4e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.625+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/4160281783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d251a4ec00 0x55d251a64a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.625+0000 7f477cf9cb80 1 -- 172.21.15.69:0/4160281783 >> 172.21.15.69:0/4160281783 conn(0x55d25190fa30 msgr2=0x55d251a534c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:17.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.625+0000 7f477cf9cb80 1 -- 172.21.15.69:0/4160281783 shutdown_connections 2024-05-14T15:20:17.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.625+0000 7f477cf9cb80 1 -- 172.21.15.69:0/4160281783 wait complete. 2024-05-14T15:20:17.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.625+0000 7f477cf9cb80 1 -- start start 2024-05-14T15:20:17.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.626+0000 7f477cf9cb80 1 Processor -- start 2024-05-14T15:20:17.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.626+0000 7f477cf9cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2518d0df0 0x55d251a737f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.626+0000 7f477cf9cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d251a4ec00 0x55d251a57e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.626+0000 7f477cf9cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a584d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.626+0000 7f477cf9cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55d251a69b10 con 0x55d251a54ba0 2024-05-14T15:20:17.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.626+0000 7f477cf9cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d251a69440 con 0x55d2518d0df0 2024-05-14T15:20:17.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.626+0000 7f477cf9cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d251a6a1e0 con 0x55d251a4ec00 2024-05-14T15:20:17.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.626+0000 7f477cf9cb80 10 client.0 _ll_register_callbacks cb 0x55d251904330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:20:17.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.626+0000 7f4767e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.626+0000 7f4767e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46550/0 (socket says 172.21.15.69:46550) 2024-05-14T15:20:17.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.626+0000 7f4767e00700 1 -- 172.21.15.69:0/93245938 learned_addr learned my addr 172.21.15.69:0/93245938 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:17.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.627+0000 7f4767400700 1 --2- 172.21.15.69:0/93245938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2518d0df0 0x55d251a737f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.627+0000 7f4766a00700 1 --2- 172.21.15.69:0/93245938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d251a4ec00 0x55d251a57e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.627+0000 7f4767e00700 1 -- 172.21.15.69:0/93245938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d251a4ec00 msgr2=0x55d251a57e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:17.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.627+0000 7f4767e00700 1 --2- 172.21.15.69:0/93245938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d251a4ec00 0x55d251a57e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.627+0000 7f4767e00700 1 -- 172.21.15.69:0/93245938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2518d0df0 msgr2=0x55d251a737f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:17.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.627+0000 7f4767e00700 1 --2- 172.21.15.69:0/93245938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2518d0df0 0x55d251a737f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.627+0000 7f4767e00700 1 -- 172.21.15.69:0/93245938 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d251a58c50 con 0x55d251a54ba0 2024-05-14T15:20:17.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.627+0000 7f4767e00700 1 --2- 172.21.15.69:0/93245938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a584d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4760004d70 tx=0x7f4760004e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39b6ec5749d1d64b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:17.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.627+0000 7f4751600700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:20:17.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.628+0000 7f4751600700 1 -- 172.21.15.69:0/93245938 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4760024940 con 0x55d251a54ba0 2024-05-14T15:20:17.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.628+0000 7f4751600700 1 -- 172.21.15.69:0/93245938 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f4760024ae0 con 0x55d251a54ba0 2024-05-14T15:20:17.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.628+0000 7f477cf9cb80 1 -- 172.21.15.69:0/93245938 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4760029070 con 0x55d251a54ba0 2024-05-14T15:20:17.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.628+0000 7f4751600700 1 -- 172.21.15.69:0/93245938 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4760041050 con 0x55d251a54ba0 2024-05-14T15:20:17.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.628+0000 7f477cf9cb80 10 client.15111 fetch_fsmap learned FSMap version 29 2024-05-14T15:20:17.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.628+0000 7f477cf9cb80 1 -- 172.21.15.69:0/93245938 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d251ad3c90 con 0x55d251a54ba0 2024-05-14T15:20:17.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.628+0000 7f4751600700 1 -- 172.21.15.69:0/93245938 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4760029070 con 0x55d251a54ba0 2024-05-14T15:20:17.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.628+0000 7f4751600700 1 -- 172.21.15.69:0/93245938 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f476003b4e0 con 0x55d251a54ba0 2024-05-14T15:20:17.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.629+0000 7f477cf9cb80 10 client.15111 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:20:17.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.629+0000 7f477cf9cb80 10 client.15111 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-14T15:20:17.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.629+0000 7f477cf9cb80 20 client.15111 populate_metadata read hostname 'smithi069' 2024-05-14T15:20:17.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.629+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/93245938 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55d251ad5dc0 0x55d251ad7230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:17.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.629+0000 7f477cf9cb80 4 client.15111 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T15:20:17.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.629+0000 7f477cf9cb80 1 -- 172.21.15.69:0/93245938 --> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] -- command(tid 0: {"prefix": "status"}) -- 0x55d25197e3b0 con 0x55d251ad5dc0 2024-05-14T15:20:17.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.629+0000 7f4767400700 1 --2- 172.21.15.69:0/93245938 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55d251ad5dc0 0x55d251ad7230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:17.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.630+0000 7f4767400700 1 --2- 172.21.15.69:0/93245938 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55d251ad5dc0 0x55d251ad7230 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b43ac281aa8743fe server_cookie=7ac7c9a4b9f17ee2 in_seq=0 out_seq=0 2024-05-14T15:20:17.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.630+0000 7f4751600700 10 client.15111 ms_handle_connect on v2:172.21.15.92:6834/360295917 2024-05-14T15:20:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.631+0000 7f4751600700 1 -- 172.21.15.69:0/93245938 <== mds.2 v2:172.21.15.92:6834/360295917 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55d25197e3b0 con 0x55d251ad5dc0 2024-05-14T15:20:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.631+0000 7f4751600700 10 client.15111 handle_command_reply: tid=0 2024-05-14T15:20:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.631+0000 7f477cf9cb80 1 client.15111 shutdown 2024-05-14T15:20:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.631+0000 7f477cf9cb80 1 -- 172.21.15.69:0/93245938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 msgr2=0x55d251a584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.631+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/93245938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a584d0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f4760004d70 tx=0x7f4760004e50 comp rx=0 tx=0).stop 2024-05-14T15:20:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.631+0000 7f477cf9cb80 1 -- 172.21.15.69:0/93245938 shutdown_connections 2024-05-14T15:20:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.631+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/93245938 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d251a54ba0 0x55d251a584d0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.631+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/93245938 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55d251ad5dc0 0x55d251ad7230 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.631+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/93245938 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2518d0df0 0x55d251a737f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.631+0000 7f477cf9cb80 1 --2- 172.21.15.69:0/93245938 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d251a4ec00 0x55d251a57e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.631+0000 7f477cf9cb80 1 -- 172.21.15.69:0/93245938 >> 172.21.15.69:0/93245938 conn(0x55d25190fa30 msgr2=0x55d251a53c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.631+0000 7f4751600700 0 client.15111 ms_handle_reset on v2:172.21.15.92:6834/360295917 2024-05-14T15:20:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.632+0000 7f477cf9cb80 1 -- 172.21.15.69:0/93245938 shutdown_connections 2024-05-14T15:20:17.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.632+0000 7f477cf9cb80 1 -- 172.21.15.69:0/93245938 wait complete. 2024-05-14T15:20:17.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.632+0000 7f477cf9cb80 20 client.15111 trim_cache size 0 max 16384 2024-05-14T15:20:17.633 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:20:17.633 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "1cc2580e-1203-11ef-bc98-c7b262605968", 2024-05-14T15:20:17.633 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 2, 2024-05-14T15:20:17.633 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 34433, 2024-05-14T15:20:17.633 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-05-14T15:20:17.633 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-05-14T15:20:17.633 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-05-14T15:20:17.633 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 162.338909831, 2024-05-14T15:20:17.633 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 29, 2024-05-14T15:20:17.633 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 91, 2024-05-14T15:20:17.634 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 89, 2024-05-14T15:20:17.634 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 297.18736465400002 2024-05-14T15:20:17.634 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:20:17.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.633+0000 7f476e400700 1 -- 172.21.15.69:0/484481847 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f474c0b2880 msgr2=0x7f474c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.633+0000 7f476e400700 1 --2- 172.21.15.69:0/484481847 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f474c0b2880 0x7f474c0b4d90 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x55d251a4f9e0 tx=0x7f4760004ad0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.633+0000 7f476e400700 1 -- 172.21.15.69:0/484481847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4768106ed0 msgr2=0x7f476819d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.633+0000 7f476e400700 1 --2- 172.21.15.69:0/484481847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4768106ed0 0x7f476819d520 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f475400e940 tx=0x7f475400ed00 comp rx=0 tx=0).stop 2024-05-14T15:20:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.633+0000 7f476e400700 1 -- 172.21.15.69:0/484481847 shutdown_connections 2024-05-14T15:20:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.633+0000 7f476e400700 1 --2- 172.21.15.69:0/484481847 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f474c0b2880 0x7f474c0b4d90 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.633+0000 7f476e400700 1 --2- 172.21.15.69:0/484481847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f476810c5c0 0x7f47681a17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.633+0000 7f476e400700 1 --2- 172.21.15.69:0/484481847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4768106580 0x7f476819cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.633+0000 7f476e400700 1 --2- 172.21.15.69:0/484481847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4768106ed0 0x7f476819d520 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.633+0000 7f476e400700 1 -- 172.21.15.69:0/484481847 >> 172.21.15.69:0/484481847 conn(0x7f47681020c0 msgr2=0x7f47681049a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.633+0000 7f476e400700 1 -- 172.21.15.69:0/484481847 shutdown_connections 2024-05-14T15:20:17.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:17.633+0000 7f476e400700 1 -- 172.21.15.69:0/484481847 wait complete. 2024-05-14T15:20:17.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:17 smithi092 ceph-mon[34729]: pgmap v518: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:20:18.484 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.h status 2024-05-14T15:20:18.919 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:20:19.327 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:19 smithi069 ceph-mon[31270]: pgmap v519: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:20:19.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:19 smithi203 ceph-mon[34567]: pgmap v519: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:20:19.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:19 smithi092 ceph-mon[34729]: pgmap v519: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:20:21.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.409+0000 7f8cb1600700 1 -- 172.21.15.69:0/2677702235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac10f6c0 msgr2=0x7f8cac10fad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:21.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.409+0000 7f8cb1600700 1 --2- 172.21.15.69:0/2677702235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac10f6c0 0x7f8cac10fad0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c009990 tx=0x7f8c9c009ca0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.410 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:21 smithi069 ceph-mon[31270]: pgmap v520: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T15:20:21.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.410+0000 7f8cb1600700 1 -- 172.21.15.69:0/2677702235 shutdown_connections 2024-05-14T15:20:21.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.410+0000 7f8cb1600700 1 --2- 172.21.15.69:0/2677702235 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac10f6c0 0x7f8cac10fad0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.410+0000 7f8cb1600700 1 --2- 172.21.15.69:0/2677702235 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cac10b110 0x7f8cac117620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.410+0000 7f8cb1600700 1 --2- 172.21.15.69:0/2677702235 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8cac10a7c0 0x7f8cac10abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.410+0000 7f8cb1600700 1 -- 172.21.15.69:0/2677702235 >> 172.21.15.69:0/2677702235 conn(0x7f8cac076b00 msgr2=0x7f8cac076f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:21.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.410+0000 7f8cb1600700 1 -- 172.21.15.69:0/2677702235 shutdown_connections 2024-05-14T15:20:21.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.410+0000 7f8cb1600700 1 -- 172.21.15.69:0/2677702235 wait complete. 2024-05-14T15:20:21.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.411+0000 7f8cb1600700 1 Processor -- start 2024-05-14T15:20:21.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.411+0000 7f8cb1600700 1 -- start start 2024-05-14T15:20:21.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.412+0000 7f8cb1600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cac10a7c0 0x7f8cac1a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.412+0000 7f8cb1600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8cac10b110 0x7f8cac1a16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.412+0000 7f8cb1600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac10f6c0 0x7f8cac1a5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.412+0000 7f8cb1600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac11a750 con 0x7f8cac10f6c0 2024-05-14T15:20:21.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.412+0000 7f8cb1600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac11a5d0 con 0x7f8cac10a7c0 2024-05-14T15:20:21.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.412+0000 7f8cb1600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8cac11a8d0 con 0x7f8cac10b110 2024-05-14T15:20:21.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.412+0000 7f8cb0c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac10f6c0 0x7f8cac1a5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.412+0000 7f8cb0c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac10f6c0 0x7f8cac1a5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46566/0 (socket says 172.21.15.69:46566) 2024-05-14T15:20:21.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.412+0000 7f8cb0c00700 1 -- 172.21.15.69:0/1043470135 learned_addr learned my addr 172.21.15.69:0/1043470135 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:21.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.412+0000 7f8cab400700 1 --2- 172.21.15.69:0/1043470135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8cac10b110 0x7f8cac1a16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.412+0000 7f8cabe00700 1 --2- 172.21.15.69:0/1043470135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cac10a7c0 0x7f8cac1a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.413+0000 7f8cb0c00700 1 -- 172.21.15.69:0/1043470135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8cac10b110 msgr2=0x7f8cac1a16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:21.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.413+0000 7f8cb0c00700 1 --2- 172.21.15.69:0/1043470135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8cac10b110 0x7f8cac1a16c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.413+0000 7f8cb0c00700 1 -- 172.21.15.69:0/1043470135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cac10a7c0 msgr2=0x7f8cac1a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:21.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.413+0000 7f8cb0c00700 1 --2- 172.21.15.69:0/1043470135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cac10a7c0 0x7f8cac1a1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.413+0000 7f8cb0c00700 1 -- 172.21.15.69:0/1043470135 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cac1a5f40 con 0x7f8cac10f6c0 2024-05-14T15:20:21.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.413+0000 7f8cabe00700 1 --2- 172.21.15.69:0/1043470135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cac10a7c0 0x7f8cac1a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:20:21.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.413+0000 7f8cb0c00700 1 --2- 172.21.15.69:0/1043470135 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac10f6c0 0x7f8cac1a5950 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400ada0 tx=0x7f8ca400c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:21.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.413+0000 7f8ca8c00700 1 -- 172.21.15.69:0/1043470135 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4017020 con 0x7f8cac10f6c0 2024-05-14T15:20:21.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.413+0000 7f8ca8c00700 1 -- 172.21.15.69:0/1043470135 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8ca400ce10 con 0x7f8cac10f6c0 2024-05-14T15:20:21.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.413+0000 7f8ca8c00700 1 -- 172.21.15.69:0/1043470135 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ca4005280 con 0x7f8cac10f6c0 2024-05-14T15:20:21.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.413+0000 7f8cb1600700 1 -- 172.21.15.69:0/1043470135 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cac1a6230 con 0x7f8cac10f6c0 2024-05-14T15:20:21.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.414+0000 7f8cb1600700 1 -- 172.21.15.69:0/1043470135 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cac1a6770 con 0x7f8cac10f6c0 2024-05-14T15:20:21.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.419+0000 7f8ca8c00700 1 -- 172.21.15.69:0/1043470135 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f8ca400c980 con 0x7f8cac10f6c0 2024-05-14T15:20:21.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.420+0000 7f8cc170fb80 1 Processor -- start 2024-05-14T15:20:21.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.420+0000 7f8cc170fb80 1 -- start start 2024-05-14T15:20:21.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.420+0000 7f8cc170fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647230cdf0 0x55647248acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.420+0000 7f8cc170fb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b230 0x556472494890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.420+0000 7f8cc170fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b640 0x556472496de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.420+0000 7f8cc170fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5564723ac9d0 con 0x55647248b640 2024-05-14T15:20:21.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.420+0000 7f8cc170fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55647234a710 con 0x55647230cdf0 2024-05-14T15:20:21.420 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.420+0000 7f8cc170fb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5564723a8990 con 0x55647248b230 2024-05-14T15:20:21.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.421+0000 7f8ca8c00700 1 --2- 172.21.15.69:0/1043470135 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f8c900b2900 0x7f8c900b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.421+0000 7f8cab400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b640 0x556472496de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.421+0000 7f8cab400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b640 0x556472496de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46582/0 (socket says 172.21.15.69:46582) 2024-05-14T15:20:21.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.421+0000 7f8cab400700 1 -- 172.21.15.69:0/3058567821 learned_addr learned my addr 172.21.15.69:0/3058567821 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:21.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.421+0000 7f8cabe00700 1 --2- 172.21.15.69:0/3058567821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b230 0x556472494890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.421+0000 7f8cab400700 1 --2- 172.21.15.69:0/3058567821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647230cdf0 0x55647248acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.421+0000 7f8cb0c00700 1 --2- 172.21.15.69:0/1043470135 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f8c900b2900 0x7f8c900b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.421+0000 7f8ca8c00700 1 -- 172.21.15.69:0/1043470135 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f8ca40e1c90 con 0x7f8cac10f6c0 2024-05-14T15:20:21.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.422+0000 7f8cabe00700 1 -- 172.21.15.69:0/3058567821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647230cdf0 msgr2=0x55647248acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:21.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.422+0000 7f8cabe00700 1 --2- 172.21.15.69:0/3058567821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647230cdf0 0x55647248acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.422+0000 7f8cabe00700 1 -- 172.21.15.69:0/3058567821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b640 msgr2=0x556472496de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:21.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.422+0000 7f8cabe00700 1 --2- 172.21.15.69:0/3058567821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b640 0x556472496de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.422+0000 7f8cabe00700 1 -- 172.21.15.69:0/3058567821 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5564722f9880 con 0x55647248b230 2024-05-14T15:20:21.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.422+0000 7f8cab400700 1 --2- 172.21.15.69:0/3058567821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b640 0x556472496de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:20:21.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.422+0000 7f8cb0c00700 1 --2- 172.21.15.69:0/1043470135 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f8c900b2900 0x7f8c900b4e10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40df360 tx=0x7f8ca409d7e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:21.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.422+0000 7f8cabe00700 1 --2- 172.21.15.69:0/3058567821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b230 0x556472494890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c006010 tx=0x7f8c9c009f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2ebd742375327001 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:21.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.423+0000 7f8ca1600700 1 -- 172.21.15.69:0/3058567821 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c027070 con 0x55647248b230 2024-05-14T15:20:21.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.423+0000 7f8ca1600700 1 -- 172.21.15.69:0/3058567821 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c9c005040 con 0x55647248b230 2024-05-14T15:20:21.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.423+0000 7f8ca1600700 1 -- 172.21.15.69:0/3058567821 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c00ba10 con 0x55647248b230 2024-05-14T15:20:21.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.424+0000 7f8cc170fb80 1 -- 172.21.15.69:0/3058567821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b230 msgr2=0x556472494890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:21.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.424+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/3058567821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b230 0x556472494890 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c006010 tx=0x7f8c9c009f60 comp rx=0 tx=0).stop 2024-05-14T15:20:21.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.424+0000 7f8cc170fb80 1 -- 172.21.15.69:0/3058567821 shutdown_connections 2024-05-14T15:20:21.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.424+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/3058567821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b640 0x556472496de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.424+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/3058567821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647230cdf0 0x55647248acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.424+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/3058567821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b230 0x556472494890 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.424+0000 7f8cc170fb80 1 -- 172.21.15.69:0/3058567821 >> 172.21.15.69:0/3058567821 conn(0x55647234ba30 msgr2=0x556472485b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:21.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.424+0000 7f8cc170fb80 1 -- 172.21.15.69:0/3058567821 shutdown_connections 2024-05-14T15:20:21.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.424+0000 7f8cc170fb80 1 -- 172.21.15.69:0/3058567821 wait complete. 2024-05-14T15:20:21.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.425+0000 7f8cc170fb80 1 -- start start 2024-05-14T15:20:21.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.425+0000 7f8cc170fb80 1 Processor -- start 2024-05-14T15:20:21.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.425+0000 7f8cc170fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647230cdf0 0x556472494370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.425+0000 7f8cc170fb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b230 0x5564724948b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.426+0000 7f8cc170fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b640 0x556472494df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.426+0000 7f8cc170fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5564724976f0 con 0x55647248b640 2024-05-14T15:20:21.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.426+0000 7f8cc170fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556472312ad0 con 0x55647230cdf0 2024-05-14T15:20:21.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.426+0000 7f8cc170fb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556472497870 con 0x55647248b230 2024-05-14T15:20:21.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.426+0000 7f8cc170fb80 10 client.0 _ll_register_callbacks cb 0x556472340330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:20:21.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.426+0000 7f8cab400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b640 0x556472494df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.426+0000 7f8cab400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b640 0x556472494df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46586/0 (socket says 172.21.15.69:46586) 2024-05-14T15:20:21.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.426+0000 7f8cab400700 1 -- 172.21.15.69:0/1139040740 learned_addr learned my addr 172.21.15.69:0/1139040740 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:21.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.426+0000 7f8cab400700 1 --2- 172.21.15.69:0/1139040740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647230cdf0 0x556472494370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.426+0000 7f8cabe00700 1 --2- 172.21.15.69:0/1139040740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b230 0x5564724948b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.426+0000 7f8cab400700 1 -- 172.21.15.69:0/1139040740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b230 msgr2=0x5564724948b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:21.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.426+0000 7f8cab400700 1 --2- 172.21.15.69:0/1139040740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b230 0x5564724948b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.426+0000 7f8cab400700 1 -- 172.21.15.69:0/1139040740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647230cdf0 msgr2=0x556472494370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:21.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.426+0000 7f8cab400700 1 --2- 172.21.15.69:0/1139040740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647230cdf0 0x556472494370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.426+0000 7f8cab400700 1 -- 172.21.15.69:0/1139040740 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564723723d0 con 0x55647248b640 2024-05-14T15:20:21.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.426+0000 7f8cabe00700 1 --2- 172.21.15.69:0/1139040740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b230 0x5564724948b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:20:21.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.427+0000 7f8cab400700 1 --2- 172.21.15.69:0/1139040740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b640 0x556472494df0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x556472493bf0 tx=0x7f8c9800a380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9da768d1bd0a2ff6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:21.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.427+0000 7f8c96000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:20:21.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.427+0000 7f8c96000700 1 -- 172.21.15.69:0/1139040740 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98004230 con 0x55647248b640 2024-05-14T15:20:21.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.427+0000 7f8c96000700 1 -- 172.21.15.69:0/1139040740 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f8c980043d0 con 0x55647248b640 2024-05-14T15:20:21.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.427+0000 7f8cc170fb80 1 -- 172.21.15.69:0/1139040740 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c9c005040 con 0x55647248b640 2024-05-14T15:20:21.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.427+0000 7f8c96000700 1 -- 172.21.15.69:0/1139040740 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8c98004830 con 0x55647248b640 2024-05-14T15:20:21.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.427+0000 7f8cc170fb80 10 client.15123 fetch_fsmap learned FSMap version 29 2024-05-14T15:20:21.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.427+0000 7f8cc170fb80 1 -- 172.21.15.69:0/1139040740 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564724a2480 con 0x55647248b640 2024-05-14T15:20:21.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.428+0000 7f8c96000700 1 -- 172.21.15.69:0/1139040740 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c9c005040 con 0x55647248b640 2024-05-14T15:20:21.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.428+0000 7f8c96000700 1 -- 172.21.15.69:0/1139040740 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8c980054e0 con 0x55647248b640 2024-05-14T15:20:21.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.428+0000 7f8cc170fb80 10 client.15123 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:20:21.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.428+0000 7f8cc170fb80 10 client.15123 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-14T15:20:21.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.428+0000 7f8cc170fb80 20 client.15123 populate_metadata read hostname 'smithi069' 2024-05-14T15:20:21.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.428+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/1139040740 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x5564724a4ab0 0x5564724a5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.428+0000 7f8cc170fb80 4 client.15123 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:20:21.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.428+0000 7f8cc170fb80 1 -- 172.21.15.69:0/1139040740 --> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556472457020 con 0x5564724a4ab0 2024-05-14T15:20:21.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.429+0000 7f8cabe00700 1 --2- 172.21.15.69:0/1139040740 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x5564724a4ab0 0x5564724a5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.430+0000 7f8cabe00700 1 --2- 172.21.15.69:0/1139040740 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x5564724a4ab0 0x5564724a5f20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4208a2038167e9d8 server_cookie=2abf5ebcc8cc8722 in_seq=0 out_seq=0 2024-05-14T15:20:21.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.430+0000 7f8c96000700 10 client.15123 ms_handle_connect on v2:172.21.15.92:6836/1669439322 2024-05-14T15:20:21.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.432+0000 7f8c96000700 1 -- 172.21.15.69:0/1139040740 <== mds.1 v2:172.21.15.92:6836/1669439322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556472457020 con 0x5564724a4ab0 2024-05-14T15:20:21.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.432+0000 7f8c96000700 10 client.15123 handle_command_reply: tid=0 2024-05-14T15:20:21.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.432+0000 7f8cc170fb80 1 client.15123 shutdown 2024-05-14T15:20:21.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.432+0000 7f8cc170fb80 1 -- 172.21.15.69:0/1139040740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b640 msgr2=0x556472494df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:21.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.432+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/1139040740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b640 0x556472494df0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x556472493bf0 tx=0x7f8c9800a380 comp rx=0 tx=0).stop 2024-05-14T15:20:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.432+0000 7f8cc170fb80 1 -- 172.21.15.69:0/1139040740 shutdown_connections 2024-05-14T15:20:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.432+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/1139040740 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x5564724a4ab0 0x5564724a5f20 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.432+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/1139040740 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b640 0x556472494df0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.432+0000 7f8c96000700 0 client.15123 ms_handle_reset on v2:172.21.15.92:6836/1669439322 2024-05-14T15:20:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.432+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/1139040740 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647230cdf0 0x556472494370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.432+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/1139040740 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b230 0x5564724948b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.432+0000 7f8cc170fb80 1 -- 172.21.15.69:0/1139040740 >> 172.21.15.69:0/1139040740 conn(0x55647234ba30 msgr2=0x5564724896b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.432+0000 7f8cc170fb80 1 -- 172.21.15.69:0/1139040740 shutdown_connections 2024-05-14T15:20:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.433+0000 7f8cc170fb80 1 -- 172.21.15.69:0/1139040740 wait complete. 2024-05-14T15:20:21.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.433+0000 7f8cc170fb80 20 client.15123 trim_cache size 0 max 16384 2024-05-14T15:20:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.456+0000 7f8cc170fb80 1 Processor -- start 2024-05-14T15:20:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.456+0000 7f8cc170fb80 1 -- start start 2024-05-14T15:20:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.456+0000 7f8cc170fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647230cdf0 0x5564724932d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.456+0000 7f8cc170fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b230 0x5564724a0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.456+0000 7f8cc170fb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b640 0x556472496130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.456+0000 7f8cc170fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5564724a4260 con 0x55647248b230 2024-05-14T15:20:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.456+0000 7f8cc170fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5564724a4930 con 0x55647230cdf0 2024-05-14T15:20:21.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.456+0000 7f8cc170fb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5564724a5000 con 0x55647248b640 2024-05-14T15:20:21.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.457+0000 7f8cabe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b230 0x5564724a0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.457+0000 7f8cabe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b230 0x5564724a0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46588/0 (socket says 172.21.15.69:46588) 2024-05-14T15:20:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.457+0000 7f8cabe00700 1 -- 172.21.15.69:0/14794532 learned_addr learned my addr 172.21.15.69:0/14794532 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.457+0000 7f8cab400700 1 --2- 172.21.15.69:0/14794532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647230cdf0 0x5564724932d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.457+0000 7f8cab400700 1 --2- 172.21.15.69:0/14794532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b640 0x556472496130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.457+0000 7f8cabe00700 1 -- 172.21.15.69:0/14794532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b640 msgr2=0x556472496130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.457+0000 7f8cabe00700 1 --2- 172.21.15.69:0/14794532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b640 0x556472496130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.457+0000 7f8cabe00700 1 -- 172.21.15.69:0/14794532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647230cdf0 msgr2=0x5564724932d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.457+0000 7f8cabe00700 1 --2- 172.21.15.69:0/14794532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647230cdf0 0x5564724932d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.457+0000 7f8cabe00700 1 -- 172.21.15.69:0/14794532 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55647248c2b0 con 0x55647248b230 2024-05-14T15:20:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.457+0000 7f8cab400700 1 --2- 172.21.15.69:0/14794532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b640 0x556472496130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:20:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.457+0000 7f8cabe00700 1 --2- 172.21.15.69:0/14794532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b230 0x5564724a0b70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x5564724871d0 tx=0x7f8c9c009d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=654dafff89864e83 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:21.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.458+0000 7f8ca0c00700 1 -- 172.21.15.69:0/14794532 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c027040 con 0x55647248b230 2024-05-14T15:20:21.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.458+0000 7f8ca0c00700 1 -- 172.21.15.69:0/14794532 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c9c033030 con 0x55647248b230 2024-05-14T15:20:21.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.458+0000 7f8ca0c00700 1 -- 172.21.15.69:0/14794532 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c00bda0 con 0x55647248b230 2024-05-14T15:20:21.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.459+0000 7f8cc170fb80 1 -- 172.21.15.69:0/14794532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b230 msgr2=0x5564724a0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:21.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.459+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/14794532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b230 0x5564724a0b70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x5564724871d0 tx=0x7f8c9c009d10 comp rx=0 tx=0).stop 2024-05-14T15:20:21.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.459+0000 7f8cc170fb80 1 -- 172.21.15.69:0/14794532 shutdown_connections 2024-05-14T15:20:21.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.459+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/14794532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b640 0x556472496130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.459+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/14794532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647230cdf0 0x5564724932d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.459+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/14794532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647248b230 0x5564724a0b70 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.459+0000 7f8cc170fb80 1 -- 172.21.15.69:0/14794532 >> 172.21.15.69:0/14794532 conn(0x55647234ba30 msgr2=0x556472495a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:21.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.459+0000 7f8cc170fb80 1 -- 172.21.15.69:0/14794532 shutdown_connections 2024-05-14T15:20:21.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.459+0000 7f8cc170fb80 1 -- 172.21.15.69:0/14794532 wait complete. 2024-05-14T15:20:21.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.459+0000 7f8cc170fb80 1 -- start start 2024-05-14T15:20:21.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.460+0000 7f8cc170fb80 1 Processor -- start 2024-05-14T15:20:21.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.460+0000 7f8cc170fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647230cdf0 0x5564724afa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.460+0000 7f8cc170fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647248b230 0x5564724a8e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.460+0000 7f8cc170fb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b640 0x5564724a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.460+0000 7f8cc170fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5564724a5da0 con 0x55647230cdf0 2024-05-14T15:20:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.460+0000 7f8cc170fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5564724a56d0 con 0x55647248b230 2024-05-14T15:20:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.460+0000 7f8cc170fb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5564724a6470 con 0x55647248b640 2024-05-14T15:20:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.460+0000 7f8cc170fb80 10 client.0 _ll_register_callbacks cb 0x556472340330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:20:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.460+0000 7f8cab400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647230cdf0 0x5564724afa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.461+0000 7f8cab400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647230cdf0 0x5564724afa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46592/0 (socket says 172.21.15.69:46592) 2024-05-14T15:20:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.461+0000 7f8cab400700 1 -- 172.21.15.69:0/598309890 learned_addr learned my addr 172.21.15.69:0/598309890 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.461+0000 7f8cabe00700 1 --2- 172.21.15.69:0/598309890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647248b230 0x5564724a8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.461+0000 7f8cab400700 1 -- 172.21.15.69:0/598309890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b640 msgr2=0x5564724a94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.461+0000 7f8cab400700 1 --2- 172.21.15.69:0/598309890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b640 0x5564724a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.461+0000 7f8cab400700 1 -- 172.21.15.69:0/598309890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647248b230 msgr2=0x5564724a8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.461+0000 7f8cab400700 1 --2- 172.21.15.69:0/598309890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647248b230 0x5564724a8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.461+0000 7f8cab400700 1 -- 172.21.15.69:0/598309890 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5564724a10b0 con 0x55647230cdf0 2024-05-14T15:20:21.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.461+0000 7f8cab400700 1 --2- 172.21.15.69:0/598309890 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647230cdf0 0x5564724afa70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8c98012960 tx=0x7f8c98005ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b95c6083da30ce9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:21.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.461+0000 7f8c96000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:20:21.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.462+0000 7f8c96000700 1 -- 172.21.15.69:0/598309890 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c98036060 con 0x55647230cdf0 2024-05-14T15:20:21.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.462+0000 7f8c96000700 1 -- 172.21.15.69:0/598309890 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f8c98011230 con 0x55647230cdf0 2024-05-14T15:20:21.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.462+0000 7f8cc170fb80 1 -- 172.21.15.69:0/598309890 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c9c033030 con 0x55647230cdf0 2024-05-14T15:20:21.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.462+0000 7f8c96000700 1 -- 172.21.15.69:0/598309890 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f8c980040b0 con 0x55647230cdf0 2024-05-14T15:20:21.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.462+0000 7f8cc170fb80 10 client.15129 fetch_fsmap learned FSMap version 29 2024-05-14T15:20:21.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.462+0000 7f8cc170fb80 1 -- 172.21.15.69:0/598309890 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5564724ae3a0 con 0x55647230cdf0 2024-05-14T15:20:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.462+0000 7f8c96000700 1 -- 172.21.15.69:0/598309890 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8c9c033030 con 0x55647230cdf0 2024-05-14T15:20:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.462+0000 7f8c96000700 1 -- 172.21.15.69:0/598309890 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f8c9802dab0 con 0x55647230cdf0 2024-05-14T15:20:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.463+0000 7f8cc170fb80 10 client.15129 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:20:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.463+0000 7f8cc170fb80 10 client.15129 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-14T15:20:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.463+0000 7f8cc170fb80 20 client.15129 populate_metadata read hostname 'smithi069' 2024-05-14T15:20:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.463+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/598309890 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x556472512190 0x556472513600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.463+0000 7f8cc170fb80 4 client.15129 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T15:20:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.463+0000 7f8cc170fb80 1 -- 172.21.15.69:0/598309890 --> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] -- command(tid 0: {"prefix": "status"}) -- 0x5564723ba3b0 con 0x556472512190 2024-05-14T15:20:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.463+0000 7f8cabe00700 1 --2- 172.21.15.69:0/598309890 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x556472512190 0x556472513600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.464+0000 7f8cabe00700 1 --2- 172.21.15.69:0/598309890 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x556472512190 0x556472513600 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2f152b90716a3cdd server_cookie=f9a1fefb8e523965 in_seq=0 out_seq=0 2024-05-14T15:20:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.464+0000 7f8c96000700 10 client.15129 ms_handle_connect on v2:172.21.15.92:6836/1669439322 2024-05-14T15:20:21.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.465+0000 7f8c96000700 1 -- 172.21.15.69:0/598309890 <== mds.1 v2:172.21.15.92:6836/1669439322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5564723ba3b0 con 0x556472512190 2024-05-14T15:20:21.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.465+0000 7f8c96000700 10 client.15129 handle_command_reply: tid=0 2024-05-14T15:20:21.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.465+0000 7f8cc170fb80 1 client.15129 shutdown 2024-05-14T15:20:21.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.465+0000 7f8cc170fb80 1 -- 172.21.15.69:0/598309890 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647230cdf0 msgr2=0x5564724afa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:21.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.465+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/598309890 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647230cdf0 0x5564724afa70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8c98012960 tx=0x7f8c98005ba0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.465+0000 7f8cc170fb80 1 -- 172.21.15.69:0/598309890 shutdown_connections 2024-05-14T15:20:21.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.465+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/598309890 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x556472512190 0x556472513600 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.465+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/598309890 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55647230cdf0 0x5564724afa70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.465+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/598309890 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55647248b640 0x5564724a94a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.465+0000 7f8cc170fb80 1 --2- 172.21.15.69:0/598309890 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55647248b230 0x5564724a8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.465+0000 7f8c96000700 0 client.15129 ms_handle_reset on v2:172.21.15.92:6836/1669439322 2024-05-14T15:20:21.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.465+0000 7f8cc170fb80 1 -- 172.21.15.69:0/598309890 >> 172.21.15.69:0/598309890 conn(0x55647234ba30 msgr2=0x556472485870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:21.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.466+0000 7f8cc170fb80 1 -- 172.21.15.69:0/598309890 shutdown_connections 2024-05-14T15:20:21.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.466+0000 7f8cc170fb80 1 -- 172.21.15.69:0/598309890 wait complete. 2024-05-14T15:20:21.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.466+0000 7f8cc170fb80 20 client.15129 trim_cache size 0 max 16384 2024-05-14T15:20:21.468 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:20:21.468 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "1cc2580e-1203-11ef-bc98-c7b262605968", 2024-05-14T15:20:21.468 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 1, 2024-05-14T15:20:21.468 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 34460, 2024-05-14T15:20:21.468 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-05-14T15:20:21.468 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-05-14T15:20:21.468 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-05-14T15:20:21.468 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 167.187327834, 2024-05-14T15:20:21.468 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 29, 2024-05-14T15:20:21.468 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 91, 2024-05-14T15:20:21.468 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 89, 2024-05-14T15:20:21.468 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 288.14635626699999 2024-05-14T15:20:21.468 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:20:21.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.467+0000 7f8cb1600700 1 -- 172.21.15.69:0/1043470135 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f8c900b2900 msgr2=0x7f8c900b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:21.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.467+0000 7f8cb1600700 1 --2- 172.21.15.69:0/1043470135 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f8c900b2900 0x7f8c900b4e10 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f8ca40df360 tx=0x7f8ca409d7e0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.467+0000 7f8cb1600700 1 -- 172.21.15.69:0/1043470135 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac10f6c0 msgr2=0x7f8cac1a5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:21.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.467+0000 7f8cb1600700 1 --2- 172.21.15.69:0/1043470135 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac10f6c0 0x7f8cac1a5950 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f8ca400ada0 tx=0x7f8ca400c330 comp rx=0 tx=0).stop 2024-05-14T15:20:21.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.467+0000 7f8cb1600700 1 -- 172.21.15.69:0/1043470135 shutdown_connections 2024-05-14T15:20:21.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.467+0000 7f8cb1600700 1 --2- 172.21.15.69:0/1043470135 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8cac10f6c0 0x7f8cac1a5950 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.467+0000 7f8cb1600700 1 --2- 172.21.15.69:0/1043470135 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f8c900b2900 0x7f8c900b4e10 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.467+0000 7f8cb1600700 1 --2- 172.21.15.69:0/1043470135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8cac10a7c0 0x7f8cac1a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.467+0000 7f8cb1600700 1 --2- 172.21.15.69:0/1043470135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8cac10b110 0x7f8cac1a16c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:21.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.467+0000 7f8cb1600700 1 -- 172.21.15.69:0/1043470135 >> 172.21.15.69:0/1043470135 conn(0x7f8cac076b00 msgr2=0x7f8cac1088c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:21.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.467+0000 7f8cb1600700 1 -- 172.21.15.69:0/1043470135 shutdown_connections 2024-05-14T15:20:21.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:21.467+0000 7f8cb1600700 1 -- 172.21.15.69:0/1043470135 wait complete. 2024-05-14T15:20:21.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:21 smithi203 ceph-mon[34567]: pgmap v520: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T15:20:21.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:21 smithi092 ceph-mon[34729]: pgmap v520: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T15:20:22.517 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.b status 2024-05-14T15:20:22.946 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:20:23.427 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:23 smithi069 ceph-mon[31270]: pgmap v521: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T15:20:23.427 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:23 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:20:23.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:23 smithi203 ceph-mon[34567]: pgmap v521: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T15:20:23.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:23 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:20:23.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:23 smithi092 ceph-mon[34729]: pgmap v521: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T15:20:23.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:23 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:20:24.463 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:20:24.463 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:20:24.463 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:20:24.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:20:24.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:20:24.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:20:24.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:20:24.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:20:24.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:20:25.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.083+0000 7f0f0f200700 1 -- 172.21.15.69:0/3757754448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f10106620 msgr2=0x7f0f10106a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:25.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.083+0000 7f0f0f200700 1 --2- 172.21.15.69:0/3757754448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f10106620 0x7f0f10106a30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f0f000099c0 tx=0x7f0f00009cd0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.083+0000 7f0f0f200700 1 -- 172.21.15.69:0/3757754448 shutdown_connections 2024-05-14T15:20:25.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.083+0000 7f0f0f200700 1 --2- 172.21.15.69:0/3757754448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f10106620 0x7f0f10106a30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.083+0000 7f0f0f200700 1 --2- 172.21.15.69:0/3757754448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f1010b8a0 0x7f0f10113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.083+0000 7f0f0f200700 1 --2- 172.21.15.69:0/3757754448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f1010af50 0x7f0f1010b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.083+0000 7f0f0f200700 1 -- 172.21.15.69:0/3757754448 >> 172.21.15.69:0/3757754448 conn(0x7f0f10102030 msgr2=0x7f0f10104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:25.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.084+0000 7f0f0f200700 1 -- 172.21.15.69:0/3757754448 shutdown_connections 2024-05-14T15:20:25.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.084+0000 7f0f0f200700 1 -- 172.21.15.69:0/3757754448 wait complete. 2024-05-14T15:20:25.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.085+0000 7f0f0f200700 1 Processor -- start 2024-05-14T15:20:25.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.085+0000 7f0f0f200700 1 -- start start 2024-05-14T15:20:25.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.085+0000 7f0f0f200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f10106620 0x7f0f1019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.085+0000 7f0f0f200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f1010af50 0x7f0f1019d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.085+0000 7f0f0f200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f1010b8a0 0x7f0f101a1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.085+0000 7f0f0f200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0f10116380 con 0x7f0f10106620 2024-05-14T15:20:25.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.085+0000 7f0f0f200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f10116200 con 0x7f0f1010af50 2024-05-14T15:20:25.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.085+0000 7f0f0f200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0f10116500 con 0x7f0f1010b8a0 2024-05-14T15:20:25.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.086+0000 7f0f0de00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f10106620 0x7f0f1019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.086+0000 7f0f0de00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f10106620 0x7f0f1019ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32786/0 (socket says 172.21.15.69:32786) 2024-05-14T15:20:25.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.086+0000 7f0f0de00700 1 -- 172.21.15.69:0/2312366156 learned_addr learned my addr 172.21.15.69:0/2312366156 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:25.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.086+0000 7f0f0e800700 1 --2- 172.21.15.69:0/2312366156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f1010b8a0 0x7f0f101a1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.086+0000 7f0f0d400700 1 --2- 172.21.15.69:0/2312366156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f1010af50 0x7f0f1019d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.086+0000 7f0f0de00700 1 -- 172.21.15.69:0/2312366156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f1010b8a0 msgr2=0x7f0f101a1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:25.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.086+0000 7f0f0de00700 1 --2- 172.21.15.69:0/2312366156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f1010b8a0 0x7f0f101a1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.086+0000 7f0f0de00700 1 -- 172.21.15.69:0/2312366156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f1010af50 msgr2=0x7f0f1019d3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:25.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.086+0000 7f0f0de00700 1 --2- 172.21.15.69:0/2312366156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f1010af50 0x7f0f1019d3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.086+0000 7f0f0de00700 1 -- 172.21.15.69:0/2312366156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f101a1c30 con 0x7f0f10106620 2024-05-14T15:20:25.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.087+0000 7f0f0de00700 1 --2- 172.21.15.69:0/2312366156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f10106620 0x7f0f1019ce10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0f00000c00 tx=0x7f0f0000f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:25.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.087+0000 7f0f06a00700 1 -- 172.21.15.69:0/2312366156 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0000f940 con 0x7f0f10106620 2024-05-14T15:20:25.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.087+0000 7f0f06a00700 1 -- 172.21.15.69:0/2312366156 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f00004830 con 0x7f0f10106620 2024-05-14T15:20:25.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.087+0000 7f0f0f200700 1 -- 172.21.15.69:0/2312366156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f101a1ec0 con 0x7f0f10106620 2024-05-14T15:20:25.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.087+0000 7f0f06a00700 1 -- 172.21.15.69:0/2312366156 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f000054b0 con 0x7f0f10106620 2024-05-14T15:20:25.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.087+0000 7f0f0f200700 1 -- 172.21.15.69:0/2312366156 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f101a2340 con 0x7f0f10106620 2024-05-14T15:20:25.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.091+0000 7f0f06a00700 1 -- 172.21.15.69:0/2312366156 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f0f00029060 con 0x7f0f10106620 2024-05-14T15:20:25.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.092+0000 7f0f23653b80 1 Processor -- start 2024-05-14T15:20:25.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.092+0000 7f0f23653b80 1 -- start start 2024-05-14T15:20:25.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.092+0000 7f0f06a00700 1 --2- 172.21.15.69:0/2312366156 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0ef40b2880 0x7f0ef40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.092+0000 7f0f23653b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd7544edf0 0x55dd755d24f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.092+0000 7f0f23653b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd755d2a30 0x55dd755cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.092+0000 7f0f23653b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd755ccbf0 0x55dd755cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.092+0000 7f0f23653b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55dd754ee9d0 con 0x55dd7544edf0 2024-05-14T15:20:25.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.092+0000 7f0f23653b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dd7548c710 con 0x55dd755ccbf0 2024-05-14T15:20:25.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.092+0000 7f0f23653b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dd754ea990 con 0x55dd755d2a30 2024-05-14T15:20:25.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.093+0000 7f0f06a00700 1 -- 172.21.15.69:0/2312366156 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f0f000e3460 con 0x7f0f10106620 2024-05-14T15:20:25.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.093+0000 7f0f0e800700 1 --2- 172.21.15.69:0/2312366156 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0ef40b2880 0x7f0ef40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.093+0000 7f0f0de00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd7544edf0 0x55dd755d24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.093+0000 7f0f0de00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd7544edf0 0x55dd755d24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32792/0 (socket says 172.21.15.69:32792) 2024-05-14T15:20:25.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.093+0000 7f0f0de00700 1 -- 172.21.15.69:0/3978421335 learned_addr learned my addr 172.21.15.69:0/3978421335 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:25.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.093+0000 7f0f0d400700 1 --2- 172.21.15.69:0/3978421335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd755d2a30 0x55dd755cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.093+0000 7f0f0e800700 1 --2- 172.21.15.69:0/3978421335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd755ccbf0 0x55dd755cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.093+0000 7f0f0de00700 1 -- 172.21.15.69:0/3978421335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd755d2a30 msgr2=0x55dd755cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:25.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.093+0000 7f0f0de00700 1 --2- 172.21.15.69:0/3978421335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd755d2a30 0x55dd755cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.093+0000 7f0f0de00700 1 -- 172.21.15.69:0/3978421335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd755ccbf0 msgr2=0x55dd755cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:25.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.093+0000 7f0f0de00700 1 --2- 172.21.15.69:0/3978421335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd755ccbf0 0x55dd755cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.093+0000 7f0f0de00700 1 -- 172.21.15.69:0/3978421335 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd7543b880 con 0x55dd7544edf0 2024-05-14T15:20:25.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.094+0000 7f0f0e800700 1 --2- 172.21.15.69:0/2312366156 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0ef40b2880 0x7f0ef40b4d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0f080126b0 tx=0x7f0f08012a70 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:25.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.094+0000 7f0f0de00700 1 --2- 172.21.15.69:0/3978421335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd7544edf0 0x55dd755d24f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0f000a7950 tx=0x7f0f000aa160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a7a47b93a109c1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:25.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.094+0000 7f0efb400700 1 -- 172.21.15.69:0/3978421335 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f000703c0 con 0x55dd7544edf0 2024-05-14T15:20:25.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.094+0000 7f0efb400700 1 -- 172.21.15.69:0/3978421335 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f00070f90 con 0x55dd7544edf0 2024-05-14T15:20:25.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.094+0000 7f0efb400700 1 -- 172.21.15.69:0/3978421335 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f00004ce0 con 0x55dd7544edf0 2024-05-14T15:20:25.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.095+0000 7f0f23653b80 1 -- 172.21.15.69:0/3978421335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd7544edf0 msgr2=0x55dd755d24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:25.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.095+0000 7f0f23653b80 1 --2- 172.21.15.69:0/3978421335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd7544edf0 0x55dd755d24f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0f000a7950 tx=0x7f0f000aa160 comp rx=0 tx=0).stop 2024-05-14T15:20:25.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.095+0000 7f0f23653b80 1 -- 172.21.15.69:0/3978421335 shutdown_connections 2024-05-14T15:20:25.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.095+0000 7f0f23653b80 1 --2- 172.21.15.69:0/3978421335 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd7544edf0 0x55dd755d24f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.095+0000 7f0f23653b80 1 --2- 172.21.15.69:0/3978421335 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd755ccbf0 0x55dd755cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.095+0000 7f0f23653b80 1 --2- 172.21.15.69:0/3978421335 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd755d2a30 0x55dd755cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.095+0000 7f0f23653b80 1 -- 172.21.15.69:0/3978421335 >> 172.21.15.69:0/3978421335 conn(0x55dd75493f20 msgr2=0x55dd755c73b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:25.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.095+0000 7f0f23653b80 1 -- 172.21.15.69:0/3978421335 shutdown_connections 2024-05-14T15:20:25.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.095+0000 7f0f23653b80 1 -- 172.21.15.69:0/3978421335 wait complete. 2024-05-14T15:20:25.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.096+0000 7f0f23653b80 1 -- start start 2024-05-14T15:20:25.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.096+0000 7f0f23653b80 1 Processor -- start 2024-05-14T15:20:25.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.097+0000 7f0f23653b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7544edf0 0x55dd755d60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.097+0000 7f0f23653b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd755ccbf0 0x55dd755d6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.097+0000 7f0f23653b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755d2a30 0x55dd755d6b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.097+0000 7f0f23653b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55dd755d9200 con 0x55dd755d2a30 2024-05-14T15:20:25.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.097+0000 7f0f23653b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dd75454ad0 con 0x55dd7544edf0 2024-05-14T15:20:25.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.097+0000 7f0f23653b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dd755d9380 con 0x55dd755ccbf0 2024-05-14T15:20:25.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.097+0000 7f0f23653b80 10 client.0 _ll_register_callbacks cb 0x55dd75495c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:20:25.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.097+0000 7f0f0e800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755d2a30 0x55dd755d6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.097+0000 7f0f0e800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755d2a30 0x55dd755d6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32798/0 (socket says 172.21.15.69:32798) 2024-05-14T15:20:25.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.097+0000 7f0f0e800700 1 -- 172.21.15.69:0/796785094 learned_addr learned my addr 172.21.15.69:0/796785094 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:25.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.097+0000 7f0f0de00700 1 --2- 172.21.15.69:0/796785094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7544edf0 0x55dd755d60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.097+0000 7f0f0d400700 1 --2- 172.21.15.69:0/796785094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd755ccbf0 0x55dd755d6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.098+0000 7f0f0e800700 1 -- 172.21.15.69:0/796785094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd755ccbf0 msgr2=0x55dd755d6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:25.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.098+0000 7f0f0e800700 1 --2- 172.21.15.69:0/796785094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd755ccbf0 0x55dd755d6600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.098+0000 7f0f0e800700 1 -- 172.21.15.69:0/796785094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7544edf0 msgr2=0x55dd755d60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:25.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.098+0000 7f0f0e800700 1 --2- 172.21.15.69:0/796785094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7544edf0 0x55dd755d60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.098+0000 7f0f0e800700 1 -- 172.21.15.69:0/796785094 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd754b43d0 con 0x55dd755d2a30 2024-05-14T15:20:25.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.098+0000 7f0f0d400700 1 --2- 172.21.15.69:0/796785094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd755ccbf0 0x55dd755d6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:20:25.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.098+0000 7f0f0e800700 1 --2- 172.21.15.69:0/796785094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755d2a30 0x55dd755d6b40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0f08018d60 tx=0x7f0f08018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ca57f5c3804ee57 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:25.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.098+0000 7f0eefe00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:20:25.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.098+0000 7f0eefe00700 1 -- 172.21.15.69:0/796785094 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f08018e40 con 0x55dd755d2a30 2024-05-14T15:20:25.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.098+0000 7f0eefe00700 1 -- 172.21.15.69:0/796785094 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f0f08004bb0 con 0x55dd755d2a30 2024-05-14T15:20:25.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.098+0000 7f0f23653b80 1 -- 172.21.15.69:0/796785094 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f00070f90 con 0x55dd755d2a30 2024-05-14T15:20:25.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.099+0000 7f0eefe00700 1 -- 172.21.15.69:0/796785094 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0f08030050 con 0x55dd755d2a30 2024-05-14T15:20:25.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.099+0000 7f0f23653b80 10 client.15141 fetch_fsmap learned FSMap version 29 2024-05-14T15:20:25.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.099+0000 7f0f23653b80 1 -- 172.21.15.69:0/796785094 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dd755dac40 con 0x55dd755d2a30 2024-05-14T15:20:25.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.099+0000 7f0eefe00700 1 -- 172.21.15.69:0/796785094 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f00070f90 con 0x55dd755d2a30 2024-05-14T15:20:25.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.099+0000 7f0eefe00700 1 -- 172.21.15.69:0/796785094 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0f08005020 con 0x55dd755d2a30 2024-05-14T15:20:25.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.099+0000 7f0f23653b80 10 client.15141 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:20:25.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.099+0000 7f0f23653b80 10 client.15141 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T15:20:25.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.099+0000 7f0f23653b80 20 client.15141 populate_metadata read hostname 'smithi069' 2024-05-14T15:20:25.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.100+0000 7f0f23653b80 1 --2- 172.21.15.69:0/796785094 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55dd755dd340 0x55dd755de7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.100+0000 7f0f23653b80 4 client.15141 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:20:25.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.100+0000 7f0f23653b80 1 -- 172.21.15.69:0/796785094 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd75599170 con 0x55dd755dd340 2024-05-14T15:20:25.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.101+0000 7f0f0de00700 1 --2- 172.21.15.69:0/796785094 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55dd755dd340 0x55dd755de7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.102+0000 7f0eefe00700 10 client.15141 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:20:25.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.102+0000 7f0f0de00700 1 --2- 172.21.15.69:0/796785094 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55dd755dd340 0x55dd755de7b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6d8d532c7c6b88fb server_cookie=4b43230e1c599fd8 in_seq=0 out_seq=0 2024-05-14T15:20:25.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.104+0000 7f0eefe00700 1 -- 172.21.15.69:0/796785094 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55dd75599170 con 0x55dd755dd340 2024-05-14T15:20:25.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.104+0000 7f0eefe00700 10 client.15141 handle_command_reply: tid=0 2024-05-14T15:20:25.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.104+0000 7f0f23653b80 1 client.15141 shutdown 2024-05-14T15:20:25.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.104+0000 7f0f23653b80 1 -- 172.21.15.69:0/796785094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755d2a30 msgr2=0x55dd755d6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:25.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.104+0000 7f0f23653b80 1 --2- 172.21.15.69:0/796785094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755d2a30 0x55dd755d6b40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f0f08018d60 tx=0x7f0f08018000 comp rx=0 tx=0).stop 2024-05-14T15:20:25.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.104+0000 7f0f23653b80 1 -- 172.21.15.69:0/796785094 shutdown_connections 2024-05-14T15:20:25.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.104+0000 7f0f23653b80 1 --2- 172.21.15.69:0/796785094 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55dd755dd340 0x55dd755de7b0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.104+0000 7f0f23653b80 1 --2- 172.21.15.69:0/796785094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755d2a30 0x55dd755d6b40 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.104+0000 7f0f23653b80 1 --2- 172.21.15.69:0/796785094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7544edf0 0x55dd755d60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.104+0000 7f0f23653b80 1 --2- 172.21.15.69:0/796785094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd755ccbf0 0x55dd755d6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.104+0000 7f0f23653b80 1 -- 172.21.15.69:0/796785094 >> 172.21.15.69:0/796785094 conn(0x55dd75493f20 msgr2=0x55dd755cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:25.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.104+0000 7f0eefe00700 0 client.15141 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:20:25.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.105+0000 7f0f23653b80 1 -- 172.21.15.69:0/796785094 shutdown_connections 2024-05-14T15:20:25.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.105+0000 7f0f23653b80 1 -- 172.21.15.69:0/796785094 wait complete. 2024-05-14T15:20:25.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.105+0000 7f0f23653b80 20 client.15141 trim_cache size 0 max 16384 2024-05-14T15:20:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.127+0000 7f0f23653b80 1 Processor -- start 2024-05-14T15:20:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.127+0000 7f0f23653b80 1 -- start start 2024-05-14T15:20:25.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.127+0000 7f0f23653b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd7544edf0 0x55dd755cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.127+0000 7f0f23653b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd755ccbf0 0x55dd755c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.127+0000 7f0f23653b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755d2a30 0x55dd755d6980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.127+0000 7f0f23653b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55dd755dcaf0 con 0x55dd755d2a30 2024-05-14T15:20:25.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.127+0000 7f0f23653b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dd755dd1c0 con 0x55dd755ccbf0 2024-05-14T15:20:25.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.127+0000 7f0f23653b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dd755dd890 con 0x55dd7544edf0 2024-05-14T15:20:25.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.128+0000 7f0f0e800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755d2a30 0x55dd755d6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.128+0000 7f0f0e800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755d2a30 0x55dd755d6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32812/0 (socket says 172.21.15.69:32812) 2024-05-14T15:20:25.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.128+0000 7f0f0e800700 1 -- 172.21.15.69:0/3971128162 learned_addr learned my addr 172.21.15.69:0/3971128162 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:25.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.128+0000 7f0f0de00700 1 --2- 172.21.15.69:0/3971128162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd7544edf0 0x55dd755cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.128+0000 7f0f0d400700 1 --2- 172.21.15.69:0/3971128162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd755ccbf0 0x55dd755c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.129+0000 7f0f0e800700 1 -- 172.21.15.69:0/3971128162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd7544edf0 msgr2=0x55dd755cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:25.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.129+0000 7f0f0e800700 1 --2- 172.21.15.69:0/3971128162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd7544edf0 0x55dd755cc6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.129+0000 7f0f0e800700 1 -- 172.21.15.69:0/3971128162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd755ccbf0 msgr2=0x55dd755c74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:25.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.129+0000 7f0f0e800700 1 --2- 172.21.15.69:0/3971128162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd755ccbf0 0x55dd755c74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.129+0000 7f0f0e800700 1 -- 172.21.15.69:0/3971128162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd755c3bf0 con 0x55dd755d2a30 2024-05-14T15:20:25.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.129+0000 7f0f0e800700 1 --2- 172.21.15.69:0/3971128162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755d2a30 0x55dd755d6980 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0f080053c0 tx=0x7f0f08007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca226033052d4792 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:25.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.130+0000 7f0efaa00700 1 -- 172.21.15.69:0/3971128162 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f08018070 con 0x55dd755d2a30 2024-05-14T15:20:25.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.130+0000 7f0efaa00700 1 -- 172.21.15.69:0/3971128162 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f08011040 con 0x55dd755d2a30 2024-05-14T15:20:25.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.130+0000 7f0efaa00700 1 -- 172.21.15.69:0/3971128162 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f08025450 con 0x55dd755d2a30 2024-05-14T15:20:25.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.130+0000 7f0f23653b80 1 -- 172.21.15.69:0/3971128162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755d2a30 msgr2=0x55dd755d6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:25.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.130+0000 7f0f23653b80 1 --2- 172.21.15.69:0/3971128162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755d2a30 0x55dd755d6980 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0f080053c0 tx=0x7f0f08007750 comp rx=0 tx=0).stop 2024-05-14T15:20:25.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.131+0000 7f0f23653b80 1 -- 172.21.15.69:0/3971128162 shutdown_connections 2024-05-14T15:20:25.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.131+0000 7f0f23653b80 1 --2- 172.21.15.69:0/3971128162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755d2a30 0x55dd755d6980 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.131+0000 7f0f23653b80 1 --2- 172.21.15.69:0/3971128162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd7544edf0 0x55dd755cc6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.131+0000 7f0f23653b80 1 --2- 172.21.15.69:0/3971128162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd755ccbf0 0x55dd755c74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.131+0000 7f0f23653b80 1 -- 172.21.15.69:0/3971128162 >> 172.21.15.69:0/3971128162 conn(0x55dd75493f20 msgr2=0x55dd755d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:25.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.131+0000 7f0f23653b80 1 -- 172.21.15.69:0/3971128162 shutdown_connections 2024-05-14T15:20:25.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.131+0000 7f0f23653b80 1 -- 172.21.15.69:0/3971128162 wait complete. 2024-05-14T15:20:25.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.131+0000 7f0f23653b80 1 -- start start 2024-05-14T15:20:25.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.131+0000 7f0f23653b80 1 Processor -- start 2024-05-14T15:20:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.132+0000 7f0f23653b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7544edf0 0x55dd75603190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.132+0000 7f0f23653b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755ccbf0 0x55dd755fde60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.132+0000 7f0f23653b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd755d2a30 0x55dd755fe3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.132+0000 7f0f23653b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55dd755de630 con 0x55dd755ccbf0 2024-05-14T15:20:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.132+0000 7f0f23653b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dd755ddf60 con 0x55dd7544edf0 2024-05-14T15:20:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.132+0000 7f0f23653b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dd755ded00 con 0x55dd755d2a30 2024-05-14T15:20:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.132+0000 7f0f23653b80 10 client.0 _ll_register_callbacks cb 0x55dd75495c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:20:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.132+0000 7f0f0d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755ccbf0 0x55dd755fde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.132+0000 7f0f0d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755ccbf0 0x55dd755fde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32816/0 (socket says 172.21.15.69:32816) 2024-05-14T15:20:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.132+0000 7f0f0d400700 1 -- 172.21.15.69:0/2177809483 learned_addr learned my addr 172.21.15.69:0/2177809483 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:25.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.133+0000 7f0f0de00700 1 --2- 172.21.15.69:0/2177809483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7544edf0 0x55dd75603190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.133+0000 7f0f0e800700 1 --2- 172.21.15.69:0/2177809483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd755d2a30 0x55dd755fe3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.133+0000 7f0f0d400700 1 -- 172.21.15.69:0/2177809483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd755d2a30 msgr2=0x55dd755fe3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:25.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.133+0000 7f0f0d400700 1 --2- 172.21.15.69:0/2177809483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd755d2a30 0x55dd755fe3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.133+0000 7f0f0d400700 1 -- 172.21.15.69:0/2177809483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7544edf0 msgr2=0x55dd75603190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:20:25.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.133+0000 7f0f0d400700 1 --2- 172.21.15.69:0/2177809483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7544edf0 0x55dd75603190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.133+0000 7f0f0d400700 1 -- 172.21.15.69:0/2177809483 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd755c8cf0 con 0x55dd755ccbf0 2024-05-14T15:20:25.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.133+0000 7f0f0de00700 1 --2- 172.21.15.69:0/2177809483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7544edf0 0x55dd75603190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:20:25.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.133+0000 7f0f0d400700 1 --2- 172.21.15.69:0/2177809483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755ccbf0 0x55dd755fde60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0f1006ceb0 tx=0x7f0efc0126d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f81c41e82dff687 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:25.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.133+0000 7f0eefe00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:20:25.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.134+0000 7f0eefe00700 1 -- 172.21.15.69:0/2177809483 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0efc004240 con 0x55dd755ccbf0 2024-05-14T15:20:25.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.134+0000 7f0eefe00700 1 -- 172.21.15.69:0/2177809483 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f0efc0043e0 con 0x55dd755ccbf0 2024-05-14T15:20:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.134+0000 7f0f23653b80 1 -- 172.21.15.69:0/2177809483 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f08011040 con 0x55dd755ccbf0 2024-05-14T15:20:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.134+0000 7f0eefe00700 1 -- 172.21.15.69:0/2177809483 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f0efc003680 con 0x55dd755ccbf0 2024-05-14T15:20:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.134+0000 7f0f23653b80 10 client.15147 fetch_fsmap learned FSMap version 29 2024-05-14T15:20:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.134+0000 7f0f23653b80 1 -- 172.21.15.69:0/2177809483 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55dd75662500 con 0x55dd755ccbf0 2024-05-14T15:20:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.134+0000 7f0eefe00700 1 -- 172.21.15.69:0/2177809483 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f08011040 con 0x55dd755ccbf0 2024-05-14T15:20:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.134+0000 7f0eefe00700 1 -- 172.21.15.69:0/2177809483 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f0efc010940 con 0x55dd755ccbf0 2024-05-14T15:20:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.134+0000 7f0f23653b80 10 client.15147 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:20:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.135+0000 7f0f23653b80 10 client.15147 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T15:20:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.135+0000 7f0f23653b80 20 client.15147 populate_metadata read hostname 'smithi069' 2024-05-14T15:20:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.135+0000 7f0f23653b80 1 --2- 172.21.15.69:0/2177809483 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55dd75664a50 0x55dd75665ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.135+0000 7f0f23653b80 4 client.15147 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T15:20:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.135+0000 7f0f23653b80 1 -- 172.21.15.69:0/2177809483 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "status"}) -- 0x55dd754fc3b0 con 0x55dd75664a50 2024-05-14T15:20:25.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.135+0000 7f0f0de00700 1 --2- 172.21.15.69:0/2177809483 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55dd75664a50 0x55dd75665ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.136+0000 7f0eefe00700 10 client.15147 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:20:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.136+0000 7f0f0de00700 1 --2- 172.21.15.69:0/2177809483 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55dd75664a50 0x55dd75665ec0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e55cac92b921b84 server_cookie=f0c5d272d3e3775a in_seq=0 out_seq=0 2024-05-14T15:20:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.137+0000 7f0eefe00700 1 -- 172.21.15.69:0/2177809483 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55dd754fc3b0 con 0x55dd75664a50 2024-05-14T15:20:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.137+0000 7f0eefe00700 10 client.15147 handle_command_reply: tid=0 2024-05-14T15:20:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.137+0000 7f0f23653b80 1 client.15147 shutdown 2024-05-14T15:20:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.137+0000 7f0f23653b80 1 -- 172.21.15.69:0/2177809483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755ccbf0 msgr2=0x55dd755fde60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.137+0000 7f0f23653b80 1 --2- 172.21.15.69:0/2177809483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755ccbf0 0x55dd755fde60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f0f1006ceb0 tx=0x7f0efc0126d0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.137+0000 7f0f23653b80 1 -- 172.21.15.69:0/2177809483 shutdown_connections 2024-05-14T15:20:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.137+0000 7f0f23653b80 1 --2- 172.21.15.69:0/2177809483 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55dd75664a50 0x55dd75665ec0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.137+0000 7f0f23653b80 1 --2- 172.21.15.69:0/2177809483 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dd755d2a30 0x55dd755fe3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.137+0000 7f0f23653b80 1 --2- 172.21.15.69:0/2177809483 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dd7544edf0 0x55dd75603190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.137+0000 7f0f23653b80 1 --2- 172.21.15.69:0/2177809483 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dd755ccbf0 0x55dd755fde60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.137+0000 7f0eefe00700 0 client.15147 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:20:25.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.137+0000 7f0f23653b80 1 -- 172.21.15.69:0/2177809483 >> 172.21.15.69:0/2177809483 conn(0x55dd75493f20 msgr2=0x55dd755d49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:25.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.137+0000 7f0f23653b80 1 -- 172.21.15.69:0/2177809483 shutdown_connections 2024-05-14T15:20:25.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.137+0000 7f0f23653b80 1 -- 172.21.15.69:0/2177809483 wait complete. 2024-05-14T15:20:25.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.137+0000 7f0f23653b80 20 client.15147 trim_cache size 0 max 16384 2024-05-14T15:20:25.139 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:20:25.139 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "1cc2580e-1203-11ef-bc98-c7b262605968", 2024-05-14T15:20:25.139 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2024-05-14T15:20:25.139 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 34490, 2024-05-14T15:20:25.139 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-05-14T15:20:25.139 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-05-14T15:20:25.140 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-05-14T15:20:25.140 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 253.32854710199999, 2024-05-14T15:20:25.140 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 29, 2024-05-14T15:20:25.140 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 91, 2024-05-14T15:20:25.140 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 89, 2024-05-14T15:20:25.140 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 273.14862055499998 2024-05-14T15:20:25.140 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:20:25.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.138+0000 7f0f0f200700 1 -- 172.21.15.69:0/2312366156 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0ef40b2880 msgr2=0x7f0ef40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:25.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.138+0000 7f0f0f200700 1 --2- 172.21.15.69:0/2312366156 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0ef40b2880 0x7f0ef40b4d90 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f0f080126b0 tx=0x7f0f08012a70 comp rx=0 tx=0).stop 2024-05-14T15:20:25.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.138+0000 7f0f0f200700 1 -- 172.21.15.69:0/2312366156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f10106620 msgr2=0x7f0f1019ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:25.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.138+0000 7f0f0f200700 1 --2- 172.21.15.69:0/2312366156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f10106620 0x7f0f1019ce10 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f0f00000c00 tx=0x7f0f0000f510 comp rx=0 tx=0).stop 2024-05-14T15:20:25.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.138+0000 7f0f0f200700 1 -- 172.21.15.69:0/2312366156 shutdown_connections 2024-05-14T15:20:25.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.138+0000 7f0f0f200700 1 --2- 172.21.15.69:0/2312366156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f10106620 0x7f0f1019ce10 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.138+0000 7f0f0f200700 1 --2- 172.21.15.69:0/2312366156 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0ef40b2880 0x7f0ef40b4d90 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.138+0000 7f0f0f200700 1 --2- 172.21.15.69:0/2312366156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f1010b8a0 0x7f0f101a1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.138+0000 7f0f0f200700 1 --2- 172.21.15.69:0/2312366156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f1010af50 0x7f0f1019d3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:25.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.138+0000 7f0f0f200700 1 -- 172.21.15.69:0/2312366156 >> 172.21.15.69:0/2312366156 conn(0x7f0f10102030 msgr2=0x7f0f1010a730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:25.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.139+0000 7f0f0f200700 1 -- 172.21.15.69:0/2312366156 shutdown_connections 2024-05-14T15:20:25.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:25.139+0000 7f0f0f200700 1 -- 172.21.15.69:0/2312366156 wait complete. 2024-05-14T15:20:25.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:25 smithi069 ceph-mon[31270]: pgmap v522: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-14T15:20:25.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:25 smithi203 ceph-mon[34567]: pgmap v522: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-14T15:20:25.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:25 smithi092 ceph-mon[34729]: pgmap v522: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-14T15:20:26.070 INFO:tasks.cephadm:Setup complete, yielding 2024-05-14T15:20:26.071 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-14T15:20:26.081 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2024-05-14T15:20:26.081 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- bash -c 'ceph orch status' 2024-05-14T15:20:26.527 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:20:27.591 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:27 smithi069 ceph-mon[31270]: pgmap v523: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T15:20:27.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:27 smithi203 ceph-mon[34567]: pgmap v523: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T15:20:27.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:27 smithi092 ceph-mon[34729]: pgmap v523: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T15:20:29.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.021+0000 7f3805e00700 1 -- 172.21.15.69:0/3922966989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38001107a0 msgr2=0x7f3800112bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:29.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.021+0000 7f3805e00700 1 --2- 172.21.15.69:0/3922966989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38001107a0 0x7f3800112bc0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f37f80099c0 tx=0x7f37f8009cd0 comp rx=0 tx=0).stop 2024-05-14T15:20:29.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.022+0000 7f3805e00700 1 -- 172.21.15.69:0/3922966989 shutdown_connections 2024-05-14T15:20:29.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.022+0000 7f3805e00700 1 --2- 172.21.15.69:0/3922966989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38001107a0 0x7f3800112bc0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:29.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.022+0000 7f3805e00700 1 --2- 172.21.15.69:0/3922966989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38000776e0 0x7f3800075bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:29.022 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.022+0000 7f3805e00700 1 --2- 172.21.15.69:0/3922966989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38000760f0 0x7f3800076580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:29.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.022+0000 7f3805e00700 1 -- 172.21.15.69:0/3922966989 >> 172.21.15.69:0/3922966989 conn(0x7f38000ff7b0 msgr2=0x7f3800101c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:29.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.022+0000 7f3805e00700 1 -- 172.21.15.69:0/3922966989 shutdown_connections 2024-05-14T15:20:29.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.022+0000 7f3805e00700 1 -- 172.21.15.69:0/3922966989 wait complete. 2024-05-14T15:20:29.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.023+0000 7f3805e00700 1 Processor -- start 2024-05-14T15:20:29.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.023+0000 7f3805e00700 1 -- start start 2024-05-14T15:20:29.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.024+0000 7f3805e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38000760f0 0x7f38001a0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:29.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.024+0000 7f3805e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38000776e0 0x7f38001a1120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:29.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.024+0000 7f3805e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38001107a0 0x7f38001a80c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:29.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.024+0000 7f3805e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3800116070 con 0x7f38000760f0 2024-05-14T15:20:29.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.024+0000 7f3805e00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3800115ef0 con 0x7f38001107a0 2024-05-14T15:20:29.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.024+0000 7f3805e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f38001161f0 con 0x7f38000776e0 2024-05-14T15:20:29.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.024+0000 7f3804a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38000760f0 0x7f38001a0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:29.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.024+0000 7f3804a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38000760f0 0x7f38001a0be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32842/0 (socket says 172.21.15.69:32842) 2024-05-14T15:20:29.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.024+0000 7f3804a00700 1 -- 172.21.15.69:0/3471537261 learned_addr learned my addr 172.21.15.69:0/3471537261 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:29.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.024+0000 7f3805400700 1 --2- 172.21.15.69:0/3471537261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38001107a0 0x7f38001a80c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:29.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.024+0000 7f37ffe00700 1 --2- 172.21.15.69:0/3471537261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38000776e0 0x7f38001a1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:29.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.025+0000 7f3804a00700 1 -- 172.21.15.69:0/3471537261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38000776e0 msgr2=0x7f38001a1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:29.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.025+0000 7f3804a00700 1 --2- 172.21.15.69:0/3471537261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38000776e0 0x7f38001a1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:29.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.025+0000 7f3804a00700 1 -- 172.21.15.69:0/3471537261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38001107a0 msgr2=0x7f38001a80c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:29.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.025+0000 7f3804a00700 1 --2- 172.21.15.69:0/3471537261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38001107a0 0x7f38001a80c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:29.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.025+0000 7f3804a00700 1 -- 172.21.15.69:0/3471537261 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38001a8740 con 0x7f38000760f0 2024-05-14T15:20:29.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.025+0000 7f3804a00700 1 --2- 172.21.15.69:0/3471537261 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38000760f0 0x7f38001a0be0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f37f400efc0 tx=0x7f37f400c3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:29.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.025+0000 7f37fd600700 1 -- 172.21.15.69:0/3471537261 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f400cad0 con 0x7f38000760f0 2024-05-14T15:20:29.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.025+0000 7f37fd600700 1 -- 172.21.15.69:0/3471537261 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37f4019070 con 0x7f38000760f0 2024-05-14T15:20:29.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.025+0000 7f3805e00700 1 -- 172.21.15.69:0/3471537261 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38001a89d0 con 0x7f38000760f0 2024-05-14T15:20:29.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.025+0000 7f37fd600700 1 -- 172.21.15.69:0/3471537261 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37f4014480 con 0x7f38000760f0 2024-05-14T15:20:29.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.026+0000 7f3805e00700 1 -- 172.21.15.69:0/3471537261 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38001a8f10 con 0x7f38000760f0 2024-05-14T15:20:29.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.027+0000 7f3805e00700 1 -- 172.21.15.69:0/3471537261 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38000512c0 con 0x7f38000760f0 2024-05-14T15:20:29.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.030+0000 7f37fd600700 1 -- 172.21.15.69:0/3471537261 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f37f4012050 con 0x7f38000760f0 2024-05-14T15:20:29.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.032+0000 7f37fd600700 1 --2- 172.21.15.69:0/3471537261 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f37e80b2880 0x7f37e80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:29.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.033+0000 7f37fd600700 1 -- 172.21.15.69:0/3471537261 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f37f40e2c20 con 0x7f38000760f0 2024-05-14T15:20:29.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.033+0000 7f37ffe00700 1 --2- 172.21.15.69:0/3471537261 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f37e80b2880 0x7f37e80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:29.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.034+0000 7f37ffe00700 1 --2- 172.21.15.69:0/3471537261 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f37e80b2880 0x7f37e80b4d90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f38001a1c90 tx=0x7f37ec009260 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:29.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.035+0000 7f37fd600700 1 -- 172.21.15.69:0/3471537261 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f37f4010040 con 0x7f38000760f0 2024-05-14T15:20:29.287 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.286+0000 7f3805e00700 1 -- 172.21.15.69:0/3471537261 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f3800063cc0 con 0x7f37e80b2880 2024-05-14T15:20:29.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.290+0000 7f37fd600700 1 -- 172.21.15.69:0/3471537261 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f3800063cc0 con 0x7f37e80b2880 2024-05-14T15:20:29.290 INFO:teuthology.orchestra.run.smithi069.stdout:Backend: cephadm 2024-05-14T15:20:29.290 INFO:teuthology.orchestra.run.smithi069.stdout:Available: Yes 2024-05-14T15:20:29.290 INFO:teuthology.orchestra.run.smithi069.stdout:Paused: No 2024-05-14T15:20:29.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.292+0000 7f3805e00700 1 -- 172.21.15.69:0/3471537261 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f37e80b2880 msgr2=0x7f37e80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:29.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.293+0000 7f3805e00700 1 --2- 172.21.15.69:0/3471537261 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f37e80b2880 0x7f37e80b4d90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f38001a1c90 tx=0x7f37ec009260 comp rx=0 tx=0).stop 2024-05-14T15:20:29.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.293+0000 7f3805e00700 1 -- 172.21.15.69:0/3471537261 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38000760f0 msgr2=0x7f38001a0be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:29.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.293+0000 7f3805e00700 1 --2- 172.21.15.69:0/3471537261 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38000760f0 0x7f38001a0be0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f37f400efc0 tx=0x7f37f400c3a0 comp rx=0 tx=0).stop 2024-05-14T15:20:29.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.293+0000 7f3805e00700 1 -- 172.21.15.69:0/3471537261 shutdown_connections 2024-05-14T15:20:29.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.293+0000 7f3805e00700 1 --2- 172.21.15.69:0/3471537261 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f38000760f0 0x7f38001a0be0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:29.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.293+0000 7f3805e00700 1 --2- 172.21.15.69:0/3471537261 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f37e80b2880 0x7f37e80b4d90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:29.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.293+0000 7f3805e00700 1 --2- 172.21.15.69:0/3471537261 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f38001107a0 0x7f38001a80c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:29.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.293+0000 7f3805e00700 1 --2- 172.21.15.69:0/3471537261 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f38000776e0 0x7f38001a1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:29.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.293+0000 7f3805e00700 1 -- 172.21.15.69:0/3471537261 >> 172.21.15.69:0/3471537261 conn(0x7f38000ff7b0 msgr2=0x7f3800103b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:29.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.293+0000 7f3805e00700 1 -- 172.21.15.69:0/3471537261 shutdown_connections 2024-05-14T15:20:29.294 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:29.293+0000 7f3805e00700 1 -- 172.21.15.69:0/3471537261 wait complete. 2024-05-14T15:20:29.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:29 smithi203 ceph-mon[34567]: pgmap v524: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-05-14T15:20:29.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:29 smithi092 ceph-mon[34729]: pgmap v524: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-05-14T15:20:29.722 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:29 smithi069 ceph-mon[31270]: pgmap v524: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-05-14T15:20:30.296 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- bash -c 'ceph orch ps' 2024-05-14T15:20:30.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:30 smithi203 ceph-mon[34567]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:20:30.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:30 smithi092 ceph-mon[34729]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:20:30.722 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:30 smithi069 ceph-mon[31270]: from='client.15153 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:20:30.744 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:20:31.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:31 smithi203 ceph-mon[34567]: pgmap v525: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T15:20:31.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:31 smithi092 ceph-mon[34729]: pgmap v525: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T15:20:31.704 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:31 smithi069 ceph-mon[31270]: pgmap v525: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T15:20:33.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.055+0000 7f99d2200700 1 -- 172.21.15.69:0/1388886077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99cc10a790 msgr2=0x7f99cc10aba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:33.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.055+0000 7f99d2200700 1 --2- 172.21.15.69:0/1388886077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99cc10a790 0x7f99cc10aba0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f99c0009990 tx=0x7f99c0009ca0 comp rx=0 tx=0).stop 2024-05-14T15:20:33.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.055+0000 7f99d2200700 1 -- 172.21.15.69:0/1388886077 shutdown_connections 2024-05-14T15:20:33.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.055+0000 7f99d2200700 1 --2- 172.21.15.69:0/1388886077 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99cc10a790 0x7f99cc10aba0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:33.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.055+0000 7f99d2200700 1 --2- 172.21.15.69:0/1388886077 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99cc10c260 0x7f99cc112b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:33.056 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.055+0000 7f99d2200700 1 --2- 172.21.15.69:0/1388886077 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99cc10b8c0 0x7f99cc10bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:33.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.055+0000 7f99d2200700 1 -- 172.21.15.69:0/1388886077 >> 172.21.15.69:0/1388886077 conn(0x7f99cc079840 msgr2=0x7f99cc1085e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:33.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.055+0000 7f99d2200700 1 -- 172.21.15.69:0/1388886077 shutdown_connections 2024-05-14T15:20:33.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.055+0000 7f99d2200700 1 -- 172.21.15.69:0/1388886077 wait complete. 2024-05-14T15:20:33.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.056+0000 7f99d2200700 1 Processor -- start 2024-05-14T15:20:33.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.057+0000 7f99d2200700 1 -- start start 2024-05-14T15:20:33.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.057+0000 7f99d2200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99cc10a790 0x7f99cc1a0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:33.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.057+0000 7f99d2200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99cc10b8c0 0x7f99cc1a11f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:33.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.057+0000 7f99d2200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99cc10c260 0x7f99cc1a8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:33.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.057+0000 7f99d2200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f99cc116080 con 0x7f99cc10c260 2024-05-14T15:20:33.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.057+0000 7f99d2200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f99cc115f00 con 0x7f99cc10b8c0 2024-05-14T15:20:33.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.057+0000 7f99d2200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f99cc116200 con 0x7f99cc10a790 2024-05-14T15:20:33.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.057+0000 7f99d1800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99cc10c260 0x7f99cc1a8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:33.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.057+0000 7f99d1800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99cc10c260 0x7f99cc1a8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33878/0 (socket says 172.21.15.69:33878) 2024-05-14T15:20:33.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.057+0000 7f99d1800700 1 -- 172.21.15.69:0/890225331 learned_addr learned my addr 172.21.15.69:0/890225331 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:33.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.058+0000 7f99d0e00700 1 --2- 172.21.15.69:0/890225331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99cc10a790 0x7f99cc1a0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:33.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.058+0000 7f99cbe00700 1 --2- 172.21.15.69:0/890225331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99cc10b8c0 0x7f99cc1a11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:33.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.058+0000 7f99d1800700 1 -- 172.21.15.69:0/890225331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99cc10a790 msgr2=0x7f99cc1a0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:33.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.058+0000 7f99d1800700 1 --2- 172.21.15.69:0/890225331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99cc10a790 0x7f99cc1a0cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:33.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.058+0000 7f99d1800700 1 -- 172.21.15.69:0/890225331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99cc10b8c0 msgr2=0x7f99cc1a11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:33.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.058+0000 7f99d1800700 1 --2- 172.21.15.69:0/890225331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99cc10b8c0 0x7f99cc1a11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:33.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.058+0000 7f99d1800700 1 -- 172.21.15.69:0/890225331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99cc1a8820 con 0x7f99cc10c260 2024-05-14T15:20:33.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.058+0000 7f99d1800700 1 --2- 172.21.15.69:0/890225331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99cc10c260 0x7f99cc1a8150 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f99c4007ee0 tx=0x7f99c400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:33.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.059+0000 7f99c9600700 1 -- 172.21.15.69:0/890225331 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c400dbd0 con 0x7f99cc10c260 2024-05-14T15:20:33.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.059+0000 7f99c9600700 1 -- 172.21.15.69:0/890225331 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c400dd70 con 0x7f99cc10c260 2024-05-14T15:20:33.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.059+0000 7f99c9600700 1 -- 172.21.15.69:0/890225331 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c40058d0 con 0x7f99cc10c260 2024-05-14T15:20:33.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.059+0000 7f99d2200700 1 -- 172.21.15.69:0/890225331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99cc1a8b10 con 0x7f99cc10c260 2024-05-14T15:20:33.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.059+0000 7f99d2200700 1 -- 172.21.15.69:0/890225331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99cc1a8fd0 con 0x7f99cc10c260 2024-05-14T15:20:33.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.060+0000 7f99d2200700 1 -- 172.21.15.69:0/890225331 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99cc0512c0 con 0x7f99cc10c260 2024-05-14T15:20:33.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.063+0000 7f99c9600700 1 -- 172.21.15.69:0/890225331 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f99c401a020 con 0x7f99cc10c260 2024-05-14T15:20:33.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.064+0000 7f99c9600700 1 --2- 172.21.15.69:0/890225331 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f99b40b2880 0x7f99b40b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:33.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.064+0000 7f99c9600700 1 -- 172.21.15.69:0/890225331 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f99c40e2440 con 0x7f99cc10c260 2024-05-14T15:20:33.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.064+0000 7f99d0e00700 1 --2- 172.21.15.69:0/890225331 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f99b40b2880 0x7f99b40b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:33.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.065+0000 7f99d0e00700 1 --2- 172.21.15.69:0/890225331 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f99b40b2880 0x7f99b40b4d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f99c0006010 tx=0x7f99c001a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:33.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.067+0000 7f99c9600700 1 -- 172.21.15.69:0/890225331 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f99c4010070 con 0x7f99cc10c260 2024-05-14T15:20:33.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.318+0000 7f99d2200700 1 -- 172.21.15.69:0/890225331 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f99cc063c00 con 0x7f99b40b2880 2024-05-14T15:20:33.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.349+0000 7f99c9600700 1 -- 172.21.15.69:0/890225331 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4123 (secure 0 0 0) 0x7f99cc063c00 con 0x7f99b40b2880 2024-05-14T15:20:33.350 INFO:teuthology.orchestra.run.smithi069.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-14T15:20:33.350 INFO:teuthology.orchestra.run.smithi069.stdout:mds.a smithi069 running (4m) 2m ago 4m 82.4M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 1ec93ab2325d 2024-05-14T15:20:33.350 INFO:teuthology.orchestra.run.smithi069.stdout:mds.b smithi092 running (4m) 2m ago 4m 92.5M - 19.0.0-3588-ge2b755a6 bc14c6192b1a bc41471641ae 2024-05-14T15:20:33.350 INFO:teuthology.orchestra.run.smithi069.stdout:mds.c smithi203 running (5m) 2m ago 5m 83.7M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 9b8e97558b07 2024-05-14T15:20:33.350 INFO:teuthology.orchestra.run.smithi069.stdout:mds.d smithi069 running (5m) 2m ago 5m 80.5M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 2638599ce9a6 2024-05-14T15:20:33.350 INFO:teuthology.orchestra.run.smithi069.stdout:mds.e smithi092 running (5m) 2m ago 5m 84.2M - 19.0.0-3588-ge2b755a6 bc14c6192b1a fcffe07313c6 2024-05-14T15:20:33.350 INFO:teuthology.orchestra.run.smithi069.stdout:mds.f smithi203 running (5m) 2m ago 5m 82.6M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 0b60258cc0f9 2024-05-14T15:20:33.350 INFO:teuthology.orchestra.run.smithi069.stdout:mds.g smithi069 running (4m) 2m ago 4m 82.5M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 17f68fe0585d 2024-05-14T15:20:33.350 INFO:teuthology.orchestra.run.smithi069.stdout:mds.h smithi092 running (5m) 2m ago 5m 84.2M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 8fc665051fca 2024-05-14T15:20:33.351 INFO:teuthology.orchestra.run.smithi069.stdout:mds.i smithi203 running (4m) 2m ago 4m 83.9M - 19.0.0-3588-ge2b755a6 bc14c6192b1a d9cb71fb793d 2024-05-14T15:20:33.351 INFO:teuthology.orchestra.run.smithi069.stdout:mds.j smithi069 running (5m) 2m ago 5m 82.7M - 19.0.0-3588-ge2b755a6 bc14c6192b1a e71b1e048153 2024-05-14T15:20:33.351 INFO:teuthology.orchestra.run.smithi069.stdout:mds.k smithi092 running (5m) 2m ago 5m 84.4M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 0e121ec7b39a 2024-05-14T15:20:33.351 INFO:teuthology.orchestra.run.smithi069.stdout:mds.l smithi203 running (5m) 2m ago 5m 82.7M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 0daa61d8b7f7 2024-05-14T15:20:33.351 INFO:teuthology.orchestra.run.smithi069.stdout:mgr.x smithi069 *:9283,8765 running (15m) 2m ago 15m 598M - 19.0.0-3588-ge2b755a6 bc14c6192b1a fad87f236ca8 2024-05-14T15:20:33.351 INFO:teuthology.orchestra.run.smithi069.stdout:mgr.y smithi092 *:8443,8765 running (13m) 2m ago 13m 535M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 408ee8c8735f 2024-05-14T15:20:33.351 INFO:teuthology.orchestra.run.smithi069.stdout:mgr.z smithi203 *:8443,8765 running (13m) 2m ago 13m 534M - 19.0.0-3588-ge2b755a6 bc14c6192b1a 2f68526f6c2f 2024-05-14T15:20:33.351 INFO:teuthology.orchestra.run.smithi069.stdout:mon.a smithi069 running (15m) 2m ago 16m 119M 2048M 19.0.0-3588-ge2b755a6 bc14c6192b1a bc76d6ff7912 2024-05-14T15:20:33.351 INFO:teuthology.orchestra.run.smithi069.stdout:mon.b smithi092 running (13m) 2m ago 13m 106M 2048M 19.0.0-3588-ge2b755a6 bc14c6192b1a 34b43213dadf 2024-05-14T15:20:33.351 INFO:teuthology.orchestra.run.smithi069.stdout:mon.c smithi203 running (13m) 2m ago 13m 108M 2048M 19.0.0-3588-ge2b755a6 bc14c6192b1a d39800e8b6ba 2024-05-14T15:20:33.351 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0 smithi069 running (12m) 2m ago 12m 119M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 6ea50f17bd09 2024-05-14T15:20:33.351 INFO:teuthology.orchestra.run.smithi069.stdout:osd.1 smithi092 running (12m) 2m ago 12m 121M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a c65ecdf8e7ab 2024-05-14T15:20:33.351 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2 smithi203 running (11m) 2m ago 11m 114M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a fd1c22becc09 2024-05-14T15:20:33.351 INFO:teuthology.orchestra.run.smithi069.stdout:osd.3 smithi069 running (11m) 2m ago 10m 119M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 7bca7e4af62b 2024-05-14T15:20:33.352 INFO:teuthology.orchestra.run.smithi069.stdout:osd.4 smithi092 running (10m) 2m ago 10m 118M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a c9616c7744fb 2024-05-14T15:20:33.352 INFO:teuthology.orchestra.run.smithi069.stdout:osd.5 smithi203 running (9m) 2m ago 9m 118M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 47c6a8b0a4ac 2024-05-14T15:20:33.352 INFO:teuthology.orchestra.run.smithi069.stdout:osd.6 smithi069 running (9m) 2m ago 9m 117M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 9e42bc8c5571 2024-05-14T15:20:33.352 INFO:teuthology.orchestra.run.smithi069.stdout:osd.7 smithi092 running (8m) 2m ago 8m 119M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a ef028671244d 2024-05-14T15:20:33.352 INFO:teuthology.orchestra.run.smithi069.stdout:osd.8 smithi203 running (7m) 2m ago 7m 120M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 3c441321632f 2024-05-14T15:20:33.352 INFO:teuthology.orchestra.run.smithi069.stdout:osd.9 smithi069 running (7m) 2m ago 7m 109M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a dc7321948c11 2024-05-14T15:20:33.352 INFO:teuthology.orchestra.run.smithi069.stdout:osd.10 smithi092 running (6m) 2m ago 6m 119M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a c3919f97a3f2 2024-05-14T15:20:33.352 INFO:teuthology.orchestra.run.smithi069.stdout:osd.11 smithi203 running (5m) 2m ago 5m 116M 4272M 19.0.0-3588-ge2b755a6 bc14c6192b1a 3a584047d77f 2024-05-14T15:20:33.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.353+0000 7f99d2200700 1 -- 172.21.15.69:0/890225331 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f99b40b2880 msgr2=0x7f99b40b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:33.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.353+0000 7f99d2200700 1 --2- 172.21.15.69:0/890225331 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f99b40b2880 0x7f99b40b4d90 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f99c0006010 tx=0x7f99c001a040 comp rx=0 tx=0).stop 2024-05-14T15:20:33.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.353+0000 7f99d2200700 1 -- 172.21.15.69:0/890225331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99cc10c260 msgr2=0x7f99cc1a8150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:33.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.353+0000 7f99d2200700 1 --2- 172.21.15.69:0/890225331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99cc10c260 0x7f99cc1a8150 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f99c4007ee0 tx=0x7f99c400d3b0 comp rx=0 tx=0).stop 2024-05-14T15:20:33.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.354+0000 7f99d2200700 1 -- 172.21.15.69:0/890225331 shutdown_connections 2024-05-14T15:20:33.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.354+0000 7f99d2200700 1 --2- 172.21.15.69:0/890225331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99cc10c260 0x7f99cc1a8150 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:33.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.354+0000 7f99d2200700 1 --2- 172.21.15.69:0/890225331 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f99b40b2880 0x7f99b40b4d90 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:33.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.354+0000 7f99d2200700 1 --2- 172.21.15.69:0/890225331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99cc10a790 0x7f99cc1a0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:33.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.354+0000 7f99d2200700 1 --2- 172.21.15.69:0/890225331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99cc10b8c0 0x7f99cc1a11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:33.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.354+0000 7f99d2200700 1 -- 172.21.15.69:0/890225331 >> 172.21.15.69:0/890225331 conn(0x7f99cc079840 msgr2=0x7f99cc10eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:33.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.354+0000 7f99d2200700 1 -- 172.21.15.69:0/890225331 shutdown_connections 2024-05-14T15:20:33.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:33.354+0000 7f99d2200700 1 -- 172.21.15.69:0/890225331 wait complete. 2024-05-14T15:20:33.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:33 smithi203 ceph-mon[34567]: pgmap v526: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:20:33.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:33 smithi092 ceph-mon[34729]: pgmap v526: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:20:33.722 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:33 smithi069 ceph-mon[31270]: pgmap v526: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:20:34.281 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- bash -c 'ceph orch ls' 2024-05-14T15:20:34.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:34 smithi069 ceph-mon[31270]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:20:34.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:34 smithi203 ceph-mon[34567]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:20:34.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:34 smithi092 ceph-mon[34729]: from='client.15159 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:20:34.750 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:20:35.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:35 smithi069 ceph-mon[31270]: pgmap v527: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:20:35.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:35 smithi203 ceph-mon[34567]: pgmap v527: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:20:35.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:35 smithi092 ceph-mon[34729]: pgmap v527: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:20:37.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.215+0000 7fabd6400700 1 -- 172.21.15.69:0/2520632631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabd010ba80 msgr2=0x7fabd010be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:37.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.215+0000 7fabd6400700 1 --2- 172.21.15.69:0/2520632631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabd010ba80 0x7fabd010be90 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fabb8009990 tx=0x7fabb8009ca0 comp rx=0 tx=0).stop 2024-05-14T15:20:37.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.216+0000 7fabd6400700 1 -- 172.21.15.69:0/2520632631 shutdown_connections 2024-05-14T15:20:37.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.216+0000 7fabd6400700 1 --2- 172.21.15.69:0/2520632631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabd010c420 0x7fabd0112cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:37.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.216+0000 7fabd6400700 1 --2- 172.21.15.69:0/2520632631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabd010ab10 0x7fabd010af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:37.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.216+0000 7fabd6400700 1 --2- 172.21.15.69:0/2520632631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabd010ba80 0x7fabd010be90 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:37.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.216+0000 7fabd6400700 1 -- 172.21.15.69:0/2520632631 >> 172.21.15.69:0/2520632631 conn(0x7fabd00799c0 msgr2=0x7fabd007be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:37.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.216+0000 7fabd6400700 1 -- 172.21.15.69:0/2520632631 shutdown_connections 2024-05-14T15:20:37.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.216+0000 7fabd6400700 1 -- 172.21.15.69:0/2520632631 wait complete. 2024-05-14T15:20:37.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.217+0000 7fabd6400700 1 Processor -- start 2024-05-14T15:20:37.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.217+0000 7fabd6400700 1 -- start start 2024-05-14T15:20:37.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.217+0000 7fabd6400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabd010ab10 0x7fabd01a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:37.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.217+0000 7fabd6400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabd010ba80 0x7fabd01a1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:37.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.217+0000 7fabd6400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabd010c420 0x7fabd01a82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:37.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.217+0000 7fabd6400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fabd0116270 con 0x7fabd010ab10 2024-05-14T15:20:37.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.217+0000 7fabd6400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fabd01160f0 con 0x7fabd010ba80 2024-05-14T15:20:37.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.217+0000 7fabd6400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fabd01163f0 con 0x7fabd010c420 2024-05-14T15:20:37.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.218+0000 7fabcf400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabd010ab10 0x7fabd01a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:37.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.218+0000 7fabcf400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabd010ab10 0x7fabd01a0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33894/0 (socket says 172.21.15.69:33894) 2024-05-14T15:20:37.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.218+0000 7fabcf400700 1 -- 172.21.15.69:0/1510958307 learned_addr learned my addr 172.21.15.69:0/1510958307 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:37.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.218+0000 7fabcfe00700 1 --2- 172.21.15.69:0/1510958307 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabd010c420 0x7fabd01a82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:37.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.218+0000 7fabc7e00700 1 --2- 172.21.15.69:0/1510958307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabd010ba80 0x7fabd01a1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:37.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.218+0000 7fabcf400700 1 -- 172.21.15.69:0/1510958307 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabd010c420 msgr2=0x7fabd01a82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:37.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.218+0000 7fabcf400700 1 --2- 172.21.15.69:0/1510958307 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabd010c420 0x7fabd01a82f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:37.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.218+0000 7fabcf400700 1 -- 172.21.15.69:0/1510958307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabd010ba80 msgr2=0x7fabd01a1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:37.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.218+0000 7fabcf400700 1 --2- 172.21.15.69:0/1510958307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabd010ba80 0x7fabd01a1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:37.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.218+0000 7fabcf400700 1 -- 172.21.15.69:0/1510958307 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabd01a8970 con 0x7fabd010ab10 2024-05-14T15:20:37.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.219+0000 7fabcf400700 1 --2- 172.21.15.69:0/1510958307 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabd010ab10 0x7fabd01a0e10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fabc000d950 tx=0x7fabc000dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:37.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.219+0000 7fabccc00700 1 -- 172.21.15.69:0/1510958307 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0017070 con 0x7fabd010ab10 2024-05-14T15:20:37.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.219+0000 7fabccc00700 1 -- 172.21.15.69:0/1510958307 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fabc000de30 con 0x7fabd010ab10 2024-05-14T15:20:37.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.219+0000 7fabd6400700 1 -- 172.21.15.69:0/1510958307 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabd01a8c60 con 0x7fabd010ab10 2024-05-14T15:20:37.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.219+0000 7fabccc00700 1 -- 172.21.15.69:0/1510958307 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabc0003aa0 con 0x7fabd010ab10 2024-05-14T15:20:37.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.219+0000 7fabd6400700 1 -- 172.21.15.69:0/1510958307 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabd01a91a0 con 0x7fabd010ab10 2024-05-14T15:20:37.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.220+0000 7fabd6400700 1 -- 172.21.15.69:0/1510958307 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabd00512c0 con 0x7fabd010ab10 2024-05-14T15:20:37.222 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.223+0000 7fabccc00700 1 -- 172.21.15.69:0/1510958307 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fabc0003c40 con 0x7fabd010ab10 2024-05-14T15:20:37.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.224+0000 7fabccc00700 1 --2- 172.21.15.69:0/1510958307 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fabb40b2900 0x7fabb40b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:37.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.224+0000 7fabccc00700 1 -- 172.21.15.69:0/1510958307 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fabc00e2960 con 0x7fabd010ab10 2024-05-14T15:20:37.224 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.225+0000 7fabc7e00700 1 --2- 172.21.15.69:0/1510958307 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fabb40b2900 0x7fabb40b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:37.225 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.225+0000 7fabc7e00700 1 --2- 172.21.15.69:0/1510958307 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fabb40b2900 0x7fabb40b4e10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fabb8006010 tx=0x7fabb801a040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:37.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.227+0000 7fabccc00700 1 -- 172.21.15.69:0/1510958307 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fabc0020030 con 0x7fabd010ab10 2024-05-14T15:20:37.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.469+0000 7fabd6400700 1 -- 172.21.15.69:0/1510958307 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fabd0063cc0 con 0x7fabb40b2900 2024-05-14T15:20:37.470 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:37 smithi069 ceph-mon[31270]: pgmap v528: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:20:37.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.487+0000 7fabccc00700 1 -- 172.21.15.69:0/1510958307 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fabd0063cc0 con 0x7fabb40b2900 2024-05-14T15:20:37.487 INFO:teuthology.orchestra.run.smithi069.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-14T15:20:37.487 INFO:teuthology.orchestra.run.smithi069.stdout:mds.all 12/12 2m ago 5m smithi069=a;smithi069=d;smithi069=g;smithi069=j;smithi092=b;smithi092=e;smithi092=h;smithi092=k;smithi203=c;smithi203=f;smithi203=i;smithi203=l;count:12 2024-05-14T15:20:37.487 INFO:teuthology.orchestra.run.smithi069.stdout:mgr 3/3 2m ago 13m smithi069=x;smithi092=y;smithi203=z;count:3 2024-05-14T15:20:37.487 INFO:teuthology.orchestra.run.smithi069.stdout:mon 3/3 2m ago 13m smithi069:172.21.15.69=a;smithi092:172.21.15.92=b;smithi203:172.21.15.203=c;count:3 2024-05-14T15:20:37.487 INFO:teuthology.orchestra.run.smithi069.stdout:osd 12 2m ago - 2024-05-14T15:20:37.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.490+0000 7fabd6400700 1 -- 172.21.15.69:0/1510958307 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fabb40b2900 msgr2=0x7fabb40b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:37.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.490+0000 7fabd6400700 1 --2- 172.21.15.69:0/1510958307 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fabb40b2900 0x7fabb40b4e10 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fabb8006010 tx=0x7fabb801a040 comp rx=0 tx=0).stop 2024-05-14T15:20:37.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.490+0000 7fabd6400700 1 -- 172.21.15.69:0/1510958307 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabd010ab10 msgr2=0x7fabd01a0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:37.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.490+0000 7fabd6400700 1 --2- 172.21.15.69:0/1510958307 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabd010ab10 0x7fabd01a0e10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fabc000d950 tx=0x7fabc000dd10 comp rx=0 tx=0).stop 2024-05-14T15:20:37.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.490+0000 7fabd6400700 1 -- 172.21.15.69:0/1510958307 shutdown_connections 2024-05-14T15:20:37.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.490+0000 7fabd6400700 1 --2- 172.21.15.69:0/1510958307 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabd010ab10 0x7fabd01a0e10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:37.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.490+0000 7fabd6400700 1 --2- 172.21.15.69:0/1510958307 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fabb40b2900 0x7fabb40b4e10 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:37.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.490+0000 7fabd6400700 1 --2- 172.21.15.69:0/1510958307 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabd010c420 0x7fabd01a82f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:37.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.490+0000 7fabd6400700 1 --2- 172.21.15.69:0/1510958307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabd010ba80 0x7fabd01a1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:37.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.490+0000 7fabd6400700 1 -- 172.21.15.69:0/1510958307 >> 172.21.15.69:0/1510958307 conn(0x7fabd00799c0 msgr2=0x7fabd010ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:37.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.490+0000 7fabd6400700 1 -- 172.21.15.69:0/1510958307 shutdown_connections 2024-05-14T15:20:37.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:37.490+0000 7fabd6400700 1 -- 172.21.15.69:0/1510958307 wait complete. 2024-05-14T15:20:37.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:37 smithi203 ceph-mon[34567]: pgmap v528: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:20:37.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:37 smithi092 ceph-mon[34729]: pgmap v528: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:20:38.422 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- bash -c 'ceph orch host ls' 2024-05-14T15:20:38.875 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:20:39.545 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:39 smithi069 ceph-mon[31270]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:20:39.546 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:39 smithi069 ceph-mon[31270]: pgmap v529: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:20:39.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:39 smithi203 ceph-mon[34567]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:20:39.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:39 smithi203 ceph-mon[34567]: pgmap v529: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:20:39.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:39 smithi092 ceph-mon[34729]: from='client.15165 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:20:39.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:39 smithi092 ceph-mon[34729]: pgmap v529: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:20:41.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.392+0000 7f6bb9400700 1 -- 172.21.15.69:0/3610943672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb41054a0 msgr2=0x7f6bb41058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:41.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.392+0000 7f6bb9400700 1 --2- 172.21.15.69:0/3610943672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb41054a0 0x7f6bb41058b0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0009990 tx=0x7f6ba0009ca0 comp rx=0 tx=0).stop 2024-05-14T15:20:41.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.392+0000 7f6bb9400700 1 -- 172.21.15.69:0/3610943672 shutdown_connections 2024-05-14T15:20:41.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.392+0000 7f6bb9400700 1 --2- 172.21.15.69:0/3610943672 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bb4105e40 0x7f6bb410c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:41.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.393+0000 7f6bb9400700 1 --2- 172.21.15.69:0/3610943672 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bb4104370 0x7f6bb4104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:41.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.393+0000 7f6bb9400700 1 --2- 172.21.15.69:0/3610943672 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb41054a0 0x7f6bb41058b0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:41.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.393+0000 7f6bb9400700 1 -- 172.21.15.69:0/3610943672 >> 172.21.15.69:0/3610943672 conn(0x7f6bb40ff9d0 msgr2=0x7f6bb4101e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:41.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.393+0000 7f6bb9400700 1 -- 172.21.15.69:0/3610943672 shutdown_connections 2024-05-14T15:20:41.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.393+0000 7f6bb9400700 1 -- 172.21.15.69:0/3610943672 wait complete. 2024-05-14T15:20:41.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.394+0000 7f6bb9400700 1 Processor -- start 2024-05-14T15:20:41.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.395+0000 7f6bb9400700 1 -- start start 2024-05-14T15:20:41.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.395+0000 7f6bb9400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bb4104370 0x7f6bb419a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:41.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.395+0000 7f6bb9400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb41054a0 0x7f6bb419ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:41.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.395+0000 7f6bb9400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bb4105e40 0x7f6bb41a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:41.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.395+0000 7f6bb9400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb410fc90 con 0x7f6bb41054a0 2024-05-14T15:20:41.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.395+0000 7f6bb9400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb410fb10 con 0x7f6bb4105e40 2024-05-14T15:20:41.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.395+0000 7f6bb9400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6bb410fe10 con 0x7f6bb4104370 2024-05-14T15:20:41.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.396+0000 7f6bb1e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb41054a0 0x7f6bb419ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:41.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.396+0000 7f6bb1e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb41054a0 0x7f6bb419ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33906/0 (socket says 172.21.15.69:33906) 2024-05-14T15:20:41.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.396+0000 7f6bb1e00700 1 -- 172.21.15.69:0/806587447 learned_addr learned my addr 172.21.15.69:0/806587447 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:41.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.396+0000 7f6bb2800700 1 --2- 172.21.15.69:0/806587447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bb4104370 0x7f6bb419a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:41.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.396+0000 7f6bb3200700 1 --2- 172.21.15.69:0/806587447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bb4105e40 0x7f6bb41a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:41.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.396+0000 7f6bb1e00700 1 -- 172.21.15.69:0/806587447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bb4104370 msgr2=0x7f6bb419a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:41.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.396+0000 7f6bb1e00700 1 --2- 172.21.15.69:0/806587447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bb4104370 0x7f6bb419a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:41.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.396+0000 7f6bb1e00700 1 -- 172.21.15.69:0/806587447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bb4105e40 msgr2=0x7f6bb41a1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:41.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.396+0000 7f6bb1e00700 1 --2- 172.21.15.69:0/806587447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bb4105e40 0x7f6bb41a1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:41.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.396+0000 7f6bb1e00700 1 -- 172.21.15.69:0/806587447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb41a2300 con 0x7f6bb41054a0 2024-05-14T15:20:41.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.396+0000 7f6bb2800700 1 --2- 172.21.15.69:0/806587447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bb4104370 0x7f6bb419a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:20:41.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.397+0000 7f6bb1e00700 1 --2- 172.21.15.69:0/806587447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb41054a0 0x7f6bb419ad70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000b5c0 tx=0x7f6ba0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:41.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.397+0000 7f6bab400700 1 -- 172.21.15.69:0/806587447 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba0027070 con 0x7f6bb41054a0 2024-05-14T15:20:41.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.397+0000 7f6bab400700 1 -- 172.21.15.69:0/806587447 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6ba0004210 con 0x7f6bb41054a0 2024-05-14T15:20:41.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.397+0000 7f6bab400700 1 -- 172.21.15.69:0/806587447 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ba000f460 con 0x7f6bb41054a0 2024-05-14T15:20:41.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.397+0000 7f6bb9400700 1 -- 172.21.15.69:0/806587447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb41a2590 con 0x7f6bb41054a0 2024-05-14T15:20:41.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.397+0000 7f6bb9400700 1 -- 172.21.15.69:0/806587447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bb41a2990 con 0x7f6bb41054a0 2024-05-14T15:20:41.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.399+0000 7f6bb9400700 1 -- 172.21.15.69:0/806587447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bb40512c0 con 0x7f6bb41054a0 2024-05-14T15:20:41.400 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.401+0000 7f6bab400700 1 -- 172.21.15.69:0/806587447 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f6ba002a070 con 0x7f6bb41054a0 2024-05-14T15:20:41.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.404+0000 7f6bab400700 1 --2- 172.21.15.69:0/806587447 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b980b2900 0x7f6b980b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:41.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.404+0000 7f6bab400700 1 -- 172.21.15.69:0/806587447 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f6ba00e3e40 con 0x7f6bb41054a0 2024-05-14T15:20:41.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.404+0000 7f6bb2800700 1 --2- 172.21.15.69:0/806587447 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b980b2900 0x7f6b980b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:41.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.405+0000 7f6bb2800700 1 --2- 172.21.15.69:0/806587447 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b980b2900 0x7f6b980b4e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6bb41053a0 tx=0x7f6ba400a680 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:41.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.407+0000 7f6bab400700 1 -- 172.21.15.69:0/806587447 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f6ba0031020 con 0x7f6bb41054a0 2024-05-14T15:20:41.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:41 smithi092 ceph-mon[34729]: pgmap v530: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:20:41.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:41 smithi203 ceph-mon[34567]: pgmap v530: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:20:41.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.650+0000 7f6bb9400700 1 -- 172.21.15.69:0/806587447 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f6bb4063cc0 con 0x7f6b980b2900 2024-05-14T15:20:41.650 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:41 smithi069 ceph-mon[31270]: pgmap v530: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:20:41.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.659+0000 7f6bab400700 1 -- 172.21.15.69:0/806587447 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f6bb4063cc0 con 0x7f6b980b2900 2024-05-14T15:20:41.659 INFO:teuthology.orchestra.run.smithi069.stdout:HOST ADDR LABELS STATUS 2024-05-14T15:20:41.659 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069 172.21.15.69 2024-05-14T15:20:41.659 INFO:teuthology.orchestra.run.smithi069.stdout:smithi092 172.21.15.92 2024-05-14T15:20:41.659 INFO:teuthology.orchestra.run.smithi069.stdout:smithi203 172.21.15.203 2024-05-14T15:20:41.659 INFO:teuthology.orchestra.run.smithi069.stdout:3 hosts in cluster 2024-05-14T15:20:41.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.662+0000 7f6bb9400700 1 -- 172.21.15.69:0/806587447 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b980b2900 msgr2=0x7f6b980b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:41.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.662+0000 7f6bb9400700 1 --2- 172.21.15.69:0/806587447 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b980b2900 0x7f6b980b4e10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f6bb41053a0 tx=0x7f6ba400a680 comp rx=0 tx=0).stop 2024-05-14T15:20:41.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.662+0000 7f6bb9400700 1 -- 172.21.15.69:0/806587447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb41054a0 msgr2=0x7f6bb419ad70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:41.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.662+0000 7f6bb9400700 1 --2- 172.21.15.69:0/806587447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb41054a0 0x7f6bb419ad70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f6ba000b5c0 tx=0x7f6ba0009f90 comp rx=0 tx=0).stop 2024-05-14T15:20:41.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.662+0000 7f6bb9400700 1 -- 172.21.15.69:0/806587447 shutdown_connections 2024-05-14T15:20:41.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.662+0000 7f6bb9400700 1 --2- 172.21.15.69:0/806587447 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f6b980b2900 0x7f6b980b4e10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:41.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.662+0000 7f6bb9400700 1 --2- 172.21.15.69:0/806587447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6bb4105e40 0x7f6bb41a1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:41.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.662+0000 7f6bb9400700 1 --2- 172.21.15.69:0/806587447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6bb4104370 0x7f6bb419a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:41.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.662+0000 7f6bb9400700 1 --2- 172.21.15.69:0/806587447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6bb41054a0 0x7f6bb419ad70 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:41.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.663+0000 7f6bb9400700 1 -- 172.21.15.69:0/806587447 >> 172.21.15.69:0/806587447 conn(0x7f6bb40ff9d0 msgr2=0x7f6bb41086d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:41.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.663+0000 7f6bb9400700 1 -- 172.21.15.69:0/806587447 shutdown_connections 2024-05-14T15:20:41.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:41.663+0000 7f6bb9400700 1 -- 172.21.15.69:0/806587447 wait complete. 2024-05-14T15:20:42.495 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- bash -c 'ceph orch device ls' 2024-05-14T15:20:42.943 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:20:43.345 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:43 smithi069 ceph-mon[31270]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:20:43.345 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:43 smithi069 ceph-mon[31270]: pgmap v531: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:20:43.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:43 smithi203 ceph-mon[34567]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:20:43.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:43 smithi203 ceph-mon[34567]: pgmap v531: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:20:43.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:43 smithi092 ceph-mon[34729]: from='client.15171 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:20:43.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:43 smithi092 ceph-mon[34729]: pgmap v531: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:20:45.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.464+0000 7fb19f800700 1 -- 172.21.15.69:0/3440301958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1980760f0 msgr2=0x7fb198076580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:45.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.464+0000 7fb19f800700 1 --2- 172.21.15.69:0/3440301958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1980760f0 0x7fb198076580 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fb180009990 tx=0x7fb180009ca0 comp rx=0 tx=0).stop 2024-05-14T15:20:45.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.464+0000 7fb19f800700 1 -- 172.21.15.69:0/3440301958 shutdown_connections 2024-05-14T15:20:45.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.464+0000 7fb19f800700 1 --2- 172.21.15.69:0/3440301958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb19810c1f0 0x7fb19810e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:45.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.464+0000 7fb19f800700 1 --2- 172.21.15.69:0/3440301958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1980776e0 0x7fb198075bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:45.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.464+0000 7fb19f800700 1 --2- 172.21.15.69:0/3440301958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb1980760f0 0x7fb198076580 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:45.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.464+0000 7fb19f800700 1 -- 172.21.15.69:0/3440301958 >> 172.21.15.69:0/3440301958 conn(0x7fb1980ff9c0 msgr2=0x7fb198101e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:45.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.464+0000 7fb19f800700 1 -- 172.21.15.69:0/3440301958 shutdown_connections 2024-05-14T15:20:45.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.465+0000 7fb19f800700 1 -- 172.21.15.69:0/3440301958 wait complete. 2024-05-14T15:20:45.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:45 smithi069 ceph-mon[31270]: pgmap v532: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:20:45.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.466+0000 7fb19f800700 1 Processor -- start 2024-05-14T15:20:45.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.466+0000 7fb19f800700 1 -- start start 2024-05-14T15:20:45.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.467+0000 7fb19f800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1980760f0 0x7fb19819cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:45.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.467+0000 7fb19f800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1980776e0 0x7fb19819d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:45.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.467+0000 7fb19f800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb19810c1f0 0x7fb1981a3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:45.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.467+0000 7fb19f800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb198111e50 con 0x7fb19810c1f0 2024-05-14T15:20:45.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.467+0000 7fb19f800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb198111cd0 con 0x7fb1980776e0 2024-05-14T15:20:45.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.467+0000 7fb19f800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb198111fd0 con 0x7fb1980760f0 2024-05-14T15:20:45.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.467+0000 7fb19d800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb19810c1f0 0x7fb1981a3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:45.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.468+0000 7fb19d800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb19810c1f0 0x7fb1981a3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56608/0 (socket says 172.21.15.69:56608) 2024-05-14T15:20:45.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.468+0000 7fb19d800700 1 -- 172.21.15.69:0/286810224 learned_addr learned my addr 172.21.15.69:0/286810224 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:45.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.468+0000 7fb19ce00700 1 --2- 172.21.15.69:0/286810224 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1980760f0 0x7fb19819cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:45.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.468+0000 7fb18fe00700 1 --2- 172.21.15.69:0/286810224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1980776e0 0x7fb19819d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:45.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.468+0000 7fb19d800700 1 -- 172.21.15.69:0/286810224 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1980760f0 msgr2=0x7fb19819cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:45.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.468+0000 7fb19d800700 1 --2- 172.21.15.69:0/286810224 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1980760f0 0x7fb19819cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:45.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.468+0000 7fb19d800700 1 -- 172.21.15.69:0/286810224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1980776e0 msgr2=0x7fb19819d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:45.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.468+0000 7fb19d800700 1 --2- 172.21.15.69:0/286810224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1980776e0 0x7fb19819d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:45.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.468+0000 7fb19d800700 1 -- 172.21.15.69:0/286810224 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1981a4520 con 0x7fb19810c1f0 2024-05-14T15:20:45.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.469+0000 7fb19d800700 1 --2- 172.21.15.69:0/286810224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb19810c1f0 0x7fb1981a3f30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb19000ada0 tx=0x7fb19000c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:45.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.469+0000 7fb196000700 1 -- 172.21.15.69:0/286810224 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb190017020 con 0x7fb19810c1f0 2024-05-14T15:20:45.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.469+0000 7fb196000700 1 -- 172.21.15.69:0/286810224 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb19000cd60 con 0x7fb19810c1f0 2024-05-14T15:20:45.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.469+0000 7fb196000700 1 -- 172.21.15.69:0/286810224 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb190005280 con 0x7fb19810c1f0 2024-05-14T15:20:45.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.469+0000 7fb19f800700 1 -- 172.21.15.69:0/286810224 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1981a4810 con 0x7fb19810c1f0 2024-05-14T15:20:45.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.469+0000 7fb19f800700 1 -- 172.21.15.69:0/286810224 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1981a4d00 con 0x7fb19810c1f0 2024-05-14T15:20:45.470 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.470+0000 7fb19f800700 1 -- 172.21.15.69:0/286810224 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1980512c0 con 0x7fb19810c1f0 2024-05-14T15:20:45.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.473+0000 7fb196000700 1 -- 172.21.15.69:0/286810224 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb19000c8d0 con 0x7fb19810c1f0 2024-05-14T15:20:45.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.474+0000 7fb196000700 1 --2- 172.21.15.69:0/286810224 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb17c0b2880 0x7fb17c0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:45.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.474+0000 7fb196000700 1 -- 172.21.15.69:0/286810224 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fb1900e23c0 con 0x7fb19810c1f0 2024-05-14T15:20:45.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.475+0000 7fb19ce00700 1 --2- 172.21.15.69:0/286810224 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb17c0b2880 0x7fb17c0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:45.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.475+0000 7fb19ce00700 1 --2- 172.21.15.69:0/286810224 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb17c0b2880 0x7fb17c0b4d90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb1980773e0 tx=0x7fb18800a380 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:45.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.477+0000 7fb196000700 1 -- 172.21.15.69:0/286810224 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb190021020 con 0x7fb19810c1f0 2024-05-14T15:20:45.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:45 smithi203 ceph-mon[34567]: pgmap v532: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:20:45.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:45 smithi092 ceph-mon[34729]: pgmap v532: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:20:45.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.718+0000 7fb19f800700 1 -- 172.21.15.69:0/286810224 --> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7fb198063c00 con 0x7fb17c0b2880 2024-05-14T15:20:45.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.721+0000 7fb196000700 1 -- 172.21.15.69:0/286810224 <== mgr.14152 v2:172.21.15.69:6800/2537958790 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7fb198063c00 con 0x7fb17c0b2880 2024-05-14T15:20:45.720 INFO:teuthology.orchestra.run.smithi069.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-05-14T15:20:45.721 INFO:teuthology.orchestra.run.smithi069.stdout:smithi069 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400Y0400BGN 372G No 7m ago Has a FileSystem, LVM detected 2024-05-14T15:20:45.721 INFO:teuthology.orchestra.run.smithi069.stdout:smithi092 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400QM400BGN 372G No 6m ago Has a FileSystem, LVM detected 2024-05-14T15:20:45.721 INFO:teuthology.orchestra.run.smithi069.stdout:smithi203 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300GK400BGN 372G No 5m ago Has a FileSystem, LVM detected 2024-05-14T15:20:45.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.723+0000 7fb19f800700 1 -- 172.21.15.69:0/286810224 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb17c0b2880 msgr2=0x7fb17c0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:45.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.723+0000 7fb19f800700 1 --2- 172.21.15.69:0/286810224 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb17c0b2880 0x7fb17c0b4d90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fb1980773e0 tx=0x7fb18800a380 comp rx=0 tx=0).stop 2024-05-14T15:20:45.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.723+0000 7fb19f800700 1 -- 172.21.15.69:0/286810224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb19810c1f0 msgr2=0x7fb1981a3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:45.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.723+0000 7fb19f800700 1 --2- 172.21.15.69:0/286810224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb19810c1f0 0x7fb1981a3f30 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fb19000ada0 tx=0x7fb19000c330 comp rx=0 tx=0).stop 2024-05-14T15:20:45.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.723+0000 7fb19f800700 1 -- 172.21.15.69:0/286810224 shutdown_connections 2024-05-14T15:20:45.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.724+0000 7fb19f800700 1 --2- 172.21.15.69:0/286810224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb19810c1f0 0x7fb1981a3f30 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:45.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.724+0000 7fb19f800700 1 --2- 172.21.15.69:0/286810224 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb17c0b2880 0x7fb17c0b4d90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:45.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.724+0000 7fb19f800700 1 --2- 172.21.15.69:0/286810224 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb1980760f0 0x7fb19819cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:45.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.724+0000 7fb19f800700 1 --2- 172.21.15.69:0/286810224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb1980776e0 0x7fb19819d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:45.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.724+0000 7fb19f800700 1 -- 172.21.15.69:0/286810224 >> 172.21.15.69:0/286810224 conn(0x7fb1980ff9c0 msgr2=0x7fb198108180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:45.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.724+0000 7fb19f800700 1 -- 172.21.15.69:0/286810224 shutdown_connections 2024-05-14T15:20:45.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:45.724+0000 7fb19f800700 1 -- 172.21.15.69:0/286810224 wait complete. 2024-05-14T15:20:46.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:46 smithi069 ceph-mon[31270]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:20:46.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:46 smithi069 ceph-mon[31270]: pgmap v533: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:20:46.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:46 smithi092 ceph-mon[34729]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:20:46.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:46 smithi092 ceph-mon[34729]: pgmap v533: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:20:46.702 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-14T15:20:46.711 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2024-05-14T15:20:46.711 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- bash -c 'ceph fs dump' 2024-05-14T15:20:46.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:46 smithi203 ceph-mon[34567]: from='client.15177 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:20:46.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:46 smithi203 ceph-mon[34567]: pgmap v533: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:20:47.155 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:20:48.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:48 smithi069 ceph-mon[31270]: pgmap v534: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:20:49.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:48 smithi203 ceph-mon[34567]: pgmap v534: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:20:49.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:48 smithi092 ceph-mon[34729]: pgmap v534: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:20:49.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.664+0000 7fa43aa00700 1 -- 172.21.15.69:0/3455498324 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa43410c420 msgr2=0x7fa434112cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:49.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.664+0000 7fa43aa00700 1 --2- 172.21.15.69:0/3455498324 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa43410c420 0x7fa434112cd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00b0a0 tx=0x7fa42c00b3b0 comp rx=0 tx=0).stop 2024-05-14T15:20:49.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.665+0000 7fa43aa00700 1 -- 172.21.15.69:0/3455498324 shutdown_connections 2024-05-14T15:20:49.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.665+0000 7fa43aa00700 1 --2- 172.21.15.69:0/3455498324 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa43410c420 0x7fa434112cd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:49.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.665+0000 7fa43aa00700 1 --2- 172.21.15.69:0/3455498324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa43410ab10 0x7fa43410af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:49.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.665+0000 7fa43aa00700 1 --2- 172.21.15.69:0/3455498324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa43410ba80 0x7fa43410be90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:49.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.665+0000 7fa43aa00700 1 -- 172.21.15.69:0/3455498324 >> 172.21.15.69:0/3455498324 conn(0x7fa4340799c0 msgr2=0x7fa43407be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:49.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.665+0000 7fa43aa00700 1 -- 172.21.15.69:0/3455498324 shutdown_connections 2024-05-14T15:20:49.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.665+0000 7fa43aa00700 1 -- 172.21.15.69:0/3455498324 wait complete. 2024-05-14T15:20:49.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.666+0000 7fa43aa00700 1 Processor -- start 2024-05-14T15:20:49.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.666+0000 7fa43aa00700 1 -- start start 2024-05-14T15:20:49.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.666+0000 7fa43aa00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa43410ab10 0x7fa4341a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:49.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.666+0000 7fa43aa00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa43410ba80 0x7fa4341a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:49.667 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.666+0000 7fa43aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa43410c420 0x7fa4341a8290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:49.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.666+0000 7fa43aa00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa4341162c0 con 0x7fa43410c420 2024-05-14T15:20:49.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.666+0000 7fa43aa00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa434116140 con 0x7fa43410ba80 2024-05-14T15:20:49.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.666+0000 7fa43aa00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa434116440 con 0x7fa43410ab10 2024-05-14T15:20:49.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.667+0000 7fa438a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa43410c420 0x7fa4341a8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:49.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.667+0000 7fa438a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa43410c420 0x7fa4341a8290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56628/0 (socket says 172.21.15.69:56628) 2024-05-14T15:20:49.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.667+0000 7fa438a00700 1 -- 172.21.15.69:0/822815772 learned_addr learned my addr 172.21.15.69:0/822815772 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.667+0000 7fa433400700 1 --2- 172.21.15.69:0/822815772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa43410ba80 0x7fa4341a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.667+0000 7fa433e00700 1 --2- 172.21.15.69:0/822815772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa43410ab10 0x7fa4341a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.667+0000 7fa438a00700 1 -- 172.21.15.69:0/822815772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa43410ab10 msgr2=0x7fa4341a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.667+0000 7fa438a00700 1 --2- 172.21.15.69:0/822815772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa43410ab10 0x7fa4341a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.667+0000 7fa438a00700 1 -- 172.21.15.69:0/822815772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa43410ba80 msgr2=0x7fa4341a1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.667+0000 7fa438a00700 1 --2- 172.21.15.69:0/822815772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa43410ba80 0x7fa4341a1330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.667+0000 7fa438a00700 1 -- 172.21.15.69:0/822815772 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4341a8960 con 0x7fa43410c420 2024-05-14T15:20:49.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.667+0000 7fa433400700 1 --2- 172.21.15.69:0/822815772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa43410ba80 0x7fa4341a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:20:49.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.668+0000 7fa438a00700 1 --2- 172.21.15.69:0/822815772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa43410c420 0x7fa4341a8290 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00b830 tx=0x7fa42c00bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:49.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.668+0000 7fa430c00700 1 -- 172.21.15.69:0/822815772 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42c021070 con 0x7fa43410c420 2024-05-14T15:20:49.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.668+0000 7fa430c00700 1 -- 172.21.15.69:0/822815772 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa42c007c80 con 0x7fa43410c420 2024-05-14T15:20:49.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.668+0000 7fa43aa00700 1 -- 172.21.15.69:0/822815772 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4341a8bf0 con 0x7fa43410c420 2024-05-14T15:20:49.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.668+0000 7fa430c00700 1 -- 172.21.15.69:0/822815772 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa42c01b7b0 con 0x7fa43410c420 2024-05-14T15:20:49.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.668+0000 7fa43aa00700 1 -- 172.21.15.69:0/822815772 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4341a90a0 con 0x7fa43410c420 2024-05-14T15:20:49.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.670+0000 7fa43aa00700 1 -- 172.21.15.69:0/822815772 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4340512c0 con 0x7fa43410c420 2024-05-14T15:20:49.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.672+0000 7fa430c00700 1 -- 172.21.15.69:0/822815772 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fa42c024070 con 0x7fa43410c420 2024-05-14T15:20:49.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.675+0000 7fa430c00700 1 --2- 172.21.15.69:0/822815772 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa4180b2900 0x7fa4180b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.675+0000 7fa430c00700 1 -- 172.21.15.69:0/822815772 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fa42c00f020 con 0x7fa43410c420 2024-05-14T15:20:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.675+0000 7fa433e00700 1 --2- 172.21.15.69:0/822815772 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa4180b2900 0x7fa4180b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:49.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.676+0000 7fa433e00700 1 --2- 172.21.15.69:0/822815772 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa4180b2900 0x7fa4180b4e10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa424005950 tx=0x7fa4240058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:49.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.678+0000 7fa430c00700 1 -- 172.21.15.69:0/822815772 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa42c02b020 con 0x7fa43410c420 2024-05-14T15:20:49.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.955+0000 7fa43aa00700 1 -- 172.21.15.69:0/822815772 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7fa43402e690 con 0x7fa43410c420 2024-05-14T15:20:49.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.957+0000 7fa430c00700 1 -- 172.21.15.69:0/822815772 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 29 v29) ==== 76+0+3092 (secure 0 0 0) 0x7fa43402e690 con 0x7fa43410c420 2024-05-14T15:20:49.959 INFO:teuthology.orchestra.run.smithi069.stdout:e29 2024-05-14T15:20:49.959 INFO:teuthology.orchestra.run.smithi069.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-05-14T15:20:49.959 INFO:teuthology.orchestra.run.smithi069.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-14T15:20:49.959 INFO:teuthology.orchestra.run.smithi069.stdout:legacy client fscid: 1 2024-05-14T15:20:49.959 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:20:49.959 INFO:teuthology.orchestra.run.smithi069.stdout:Filesystem 'cephfs' (1) 2024-05-14T15:20:49.960 INFO:teuthology.orchestra.run.smithi069.stdout:fs_name cephfs 2024-05-14T15:20:49.960 INFO:teuthology.orchestra.run.smithi069.stdout:epoch 29 2024-05-14T15:20:49.960 INFO:teuthology.orchestra.run.smithi069.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-05-14T15:20:49.960 INFO:teuthology.orchestra.run.smithi069.stdout:created 2024-05-14T15:16:11.716543+0000 2024-05-14T15:20:49.960 INFO:teuthology.orchestra.run.smithi069.stdout:modified 2024-05-14T15:17:42.234289+0000 2024-05-14T15:20:49.960 INFO:teuthology.orchestra.run.smithi069.stdout:tableserver 0 2024-05-14T15:20:49.960 INFO:teuthology.orchestra.run.smithi069.stdout:root 0 2024-05-14T15:20:49.960 INFO:teuthology.orchestra.run.smithi069.stdout:session_timeout 300 2024-05-14T15:20:49.961 INFO:teuthology.orchestra.run.smithi069.stdout:session_autoclose 300 2024-05-14T15:20:49.961 INFO:teuthology.orchestra.run.smithi069.stdout:max_file_size 1099511627776 2024-05-14T15:20:49.961 INFO:teuthology.orchestra.run.smithi069.stdout:max_xattr_size 65536 2024-05-14T15:20:49.961 INFO:teuthology.orchestra.run.smithi069.stdout:required_client_features {} 2024-05-14T15:20:49.961 INFO:teuthology.orchestra.run.smithi069.stdout:last_failure 0 2024-05-14T15:20:49.961 INFO:teuthology.orchestra.run.smithi069.stdout:last_failure_osd_epoch 0 2024-05-14T15:20:49.961 INFO:teuthology.orchestra.run.smithi069.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-05-14T15:20:49.961 INFO:teuthology.orchestra.run.smithi069.stdout:max_mds 5 2024-05-14T15:20:49.962 INFO:teuthology.orchestra.run.smithi069.stdout:in 0,1,2,3,4 2024-05-14T15:20:49.962 INFO:teuthology.orchestra.run.smithi069.stdout:up {0=34490,1=34460,2=34433,3=34409,4=24451} 2024-05-14T15:20:49.962 INFO:teuthology.orchestra.run.smithi069.stdout:failed 2024-05-14T15:20:49.962 INFO:teuthology.orchestra.run.smithi069.stdout:damaged 2024-05-14T15:20:49.962 INFO:teuthology.orchestra.run.smithi069.stdout:stopped 2024-05-14T15:20:49.962 INFO:teuthology.orchestra.run.smithi069.stdout:data_pools [3,4] 2024-05-14T15:20:49.962 INFO:teuthology.orchestra.run.smithi069.stdout:metadata_pool 2 2024-05-14T15:20:49.962 INFO:teuthology.orchestra.run.smithi069.stdout:inline_data disabled 2024-05-14T15:20:49.962 INFO:teuthology.orchestra.run.smithi069.stdout:balancer 2024-05-14T15:20:49.963 INFO:teuthology.orchestra.run.smithi069.stdout:bal_rank_mask -1 2024-05-14T15:20:49.963 INFO:teuthology.orchestra.run.smithi069.stdout:standby_count_wanted 0 2024-05-14T15:20:49.963 INFO:teuthology.orchestra.run.smithi069.stdout:qdb_cluster leader: 34490 members: 24451,34433,34409,34460,34490 2024-05-14T15:20:49.963 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.b{0:34490} state up:active seq 6 addr [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T15:20:49.963 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.c{0:24442} state up:standby-replay seq 1 addr [v2:172.21.15.203:6836/3006378390,v1:172.21.15.203:6837/3006378390] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T15:20:49.963 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.h{1:34460} state up:active seq 32 addr [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T15:20:49.963 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.f{1:24430} state up:standby-replay seq 1 addr [v2:172.21.15.203:6834/2407601401,v1:172.21.15.203:6835/2407601401] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T15:20:49.963 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.e{2:34433} state up:active seq 35 addr [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T15:20:49.964 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.l{2:24391} state up:standby-replay seq 1 addr [v2:172.21.15.203:6832/3479394720,v1:172.21.15.203:6833/3479394720] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T15:20:49.964 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.k{3:34409} state up:active seq 39 addr [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T15:20:49.964 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.a{3:14613} state up:standby-replay seq 1 addr [v2:172.21.15.69:6840/2134585816,v1:172.21.15.69:6841/2134585816] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T15:20:49.964 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.i{4:24451} state up:active seq 31 addr [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T15:20:49.964 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.g{4:14607} state up:standby-replay seq 1 addr [v2:172.21.15.69:6838/561211426,v1:172.21.15.69:6839/561211426] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T15:20:49.964 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:20:49.964 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:20:49.965 INFO:teuthology.orchestra.run.smithi069.stdout:Standby daemons: 2024-05-14T15:20:49.965 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:20:49.965 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.j{-1:14541} state up:standby seq 1 addr [v2:172.21.15.69:6834/2193159926,v1:172.21.15.69:6835/2193159926] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T15:20:49.965 INFO:teuthology.orchestra.run.smithi069.stdout:[mds.d{-1:14547} state up:standby seq 1 addr [v2:172.21.15.69:6836/2968592361,v1:172.21.15.69:6837/2968592361] compat {c=[1],r=[1],i=[1fff]}] 2024-05-14T15:20:49.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.961+0000 7fa43aa00700 1 -- 172.21.15.69:0/822815772 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa4180b2900 msgr2=0x7fa4180b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:49.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.961+0000 7fa43aa00700 1 --2- 172.21.15.69:0/822815772 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa4180b2900 0x7fa4180b4e10 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fa424005950 tx=0x7fa4240058e0 comp rx=0 tx=0).stop 2024-05-14T15:20:49.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.961+0000 7fa43aa00700 1 -- 172.21.15.69:0/822815772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa43410c420 msgr2=0x7fa4341a8290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:49.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.961+0000 7fa43aa00700 1 --2- 172.21.15.69:0/822815772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa43410c420 0x7fa4341a8290 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fa42c00b830 tx=0x7fa42c00bd70 comp rx=0 tx=0).stop 2024-05-14T15:20:49.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.961+0000 7fa43aa00700 1 -- 172.21.15.69:0/822815772 shutdown_connections 2024-05-14T15:20:49.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.961+0000 7fa43aa00700 1 --2- 172.21.15.69:0/822815772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa43410c420 0x7fa4341a8290 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:49.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.961+0000 7fa43aa00700 1 --2- 172.21.15.69:0/822815772 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fa4180b2900 0x7fa4180b4e10 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:49.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.961+0000 7fa43aa00700 1 --2- 172.21.15.69:0/822815772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa43410ab10 0x7fa4341a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:49.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.961+0000 7fa43aa00700 1 --2- 172.21.15.69:0/822815772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa43410ba80 0x7fa4341a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:49.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.961+0000 7fa43aa00700 1 -- 172.21.15.69:0/822815772 >> 172.21.15.69:0/822815772 conn(0x7fa4340799c0 msgr2=0x7fa43410ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:49.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.961+0000 7fa43aa00700 1 -- 172.21.15.69:0/822815772 shutdown_connections 2024-05-14T15:20:49.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:49.961+0000 7fa43aa00700 1 -- 172.21.15.69:0/822815772 wait complete. 2024-05-14T15:20:49.966 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 29 2024-05-14T15:20:50.783 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- bash -c 'ceph osd dump' 2024-05-14T15:20:50.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:50 smithi092 ceph-mon[34729]: pgmap v535: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:20:50.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:50 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/822815772' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-14T15:20:51.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:50 smithi203 ceph-mon[34567]: pgmap v535: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:20:51.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:50 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/822815772' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-14T15:20:51.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:50 smithi069 ceph-mon[31270]: pgmap v535: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:20:51.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:50 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/822815772' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-05-14T15:20:51.224 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:20:53.092 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:52 smithi069 ceph-mon[31270]: pgmap v536: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T15:20:53.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:52 smithi203 ceph-mon[34567]: pgmap v536: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T15:20:53.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:52 smithi092 ceph-mon[34729]: pgmap v536: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T15:20:53.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.717+0000 7f2594e00700 1 -- 172.21.15.69:0/925301808 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25900776e0 msgr2=0x7f2590075bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:53.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.717+0000 7f2594e00700 1 --2- 172.21.15.69:0/925301808 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25900776e0 0x7f2590075bb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f25800099c0 tx=0x7f2580009cd0 comp rx=0 tx=0).stop 2024-05-14T15:20:53.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.717+0000 7f2594e00700 1 -- 172.21.15.69:0/925301808 shutdown_connections 2024-05-14T15:20:53.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.717+0000 7f2594e00700 1 --2- 172.21.15.69:0/925301808 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f25900776e0 0x7f2590075bb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:53.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.717+0000 7f2594e00700 1 --2- 172.21.15.69:0/925301808 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2590110990 0x7f2590112db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:53.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.717+0000 7f2594e00700 1 --2- 172.21.15.69:0/925301808 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25900760f0 0x7f2590076580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:53.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.717+0000 7f2594e00700 1 -- 172.21.15.69:0/925301808 >> 172.21.15.69:0/925301808 conn(0x7f25900ff9c0 msgr2=0x7f2590101e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:53.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.717+0000 7f2594e00700 1 -- 172.21.15.69:0/925301808 shutdown_connections 2024-05-14T15:20:53.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.717+0000 7f2594e00700 1 -- 172.21.15.69:0/925301808 wait complete. 2024-05-14T15:20:53.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.718+0000 7f2594e00700 1 Processor -- start 2024-05-14T15:20:53.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.718+0000 7f2594e00700 1 -- start start 2024-05-14T15:20:53.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.718+0000 7f2594e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25900760f0 0x7f25901a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:53.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.718+0000 7f2594e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25900776e0 0x7f25901a1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:53.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.718+0000 7f2594e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2590110990 0x7f25901a82f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:53.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.718+0000 7f2594e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2590116230 con 0x7f2590110990 2024-05-14T15:20:53.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.718+0000 7f2594e00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f25901160b0 con 0x7f25900760f0 2024-05-14T15:20:53.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.718+0000 7f2594e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f25901163b0 con 0x7f25900776e0 2024-05-14T15:20:53.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.719+0000 7f258e800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2590110990 0x7f25901a82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:53.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.719+0000 7f258e800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2590110990 0x7f25901a82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46632/0 (socket says 172.21.15.69:46632) 2024-05-14T15:20:53.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.719+0000 7f258e800700 1 -- 172.21.15.69:0/2540499499 learned_addr learned my addr 172.21.15.69:0/2540499499 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:53.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.719+0000 7f258de00700 1 --2- 172.21.15.69:0/2540499499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25900760f0 0x7f25901a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:53.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.719+0000 7f258d400700 1 --2- 172.21.15.69:0/2540499499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25900776e0 0x7f25901a1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:53.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.719+0000 7f258e800700 1 -- 172.21.15.69:0/2540499499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25900776e0 msgr2=0x7f25901a1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:53.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.719+0000 7f258e800700 1 --2- 172.21.15.69:0/2540499499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25900776e0 0x7f25901a1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:53.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.719+0000 7f258e800700 1 -- 172.21.15.69:0/2540499499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25900760f0 msgr2=0x7f25901a0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:53.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.719+0000 7f258e800700 1 --2- 172.21.15.69:0/2540499499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25900760f0 0x7f25901a0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:53.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.719+0000 7f258e800700 1 -- 172.21.15.69:0/2540499499 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25901a8970 con 0x7f2590110990 2024-05-14T15:20:53.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.719+0000 7f258de00700 1 --2- 172.21.15.69:0/2540499499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25900760f0 0x7f25901a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:20:53.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.720+0000 7f258e800700 1 --2- 172.21.15.69:0/2540499499 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2590110990 0x7f25901a82f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2588007ee0 tx=0x7f258800d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:53.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.720+0000 7f2586a00700 1 -- 172.21.15.69:0/2540499499 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258800dbd0 con 0x7f2590110990 2024-05-14T15:20:53.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.720+0000 7f2594e00700 1 -- 172.21.15.69:0/2540499499 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25901a8c60 con 0x7f2590110990 2024-05-14T15:20:53.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.720+0000 7f2586a00700 1 -- 172.21.15.69:0/2540499499 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f258800dd70 con 0x7f2590110990 2024-05-14T15:20:53.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.720+0000 7f2586a00700 1 -- 172.21.15.69:0/2540499499 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25880058d0 con 0x7f2590110990 2024-05-14T15:20:53.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.720+0000 7f2594e00700 1 -- 172.21.15.69:0/2540499499 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25901a91a0 con 0x7f2590110990 2024-05-14T15:20:53.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.721+0000 7f2594e00700 1 -- 172.21.15.69:0/2540499499 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25900512c0 con 0x7f2590110990 2024-05-14T15:20:53.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.724+0000 7f2586a00700 1 -- 172.21.15.69:0/2540499499 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f258801a020 con 0x7f2590110990 2024-05-14T15:20:53.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.726+0000 7f2586a00700 1 --2- 172.21.15.69:0/2540499499 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f25740b2880 0x7f25740b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:53.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.726+0000 7f2586a00700 1 -- 172.21.15.69:0/2540499499 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f25880e2540 con 0x7f2590110990 2024-05-14T15:20:53.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.726+0000 7f258de00700 1 --2- 172.21.15.69:0/2540499499 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f25740b2880 0x7f25740b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:53.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.727+0000 7f258de00700 1 --2- 172.21.15.69:0/2540499499 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f25740b2880 0x7f25740b4d90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2580009990 tx=0x7f2580005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:53.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:53.733+0000 7f2586a00700 1 -- 172.21.15.69:0/2540499499 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f2588010070 con 0x7f2590110990 2024-05-14T15:20:54.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:54.003+0000 7f2594e00700 1 -- 172.21.15.69:0/2540499499 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f25900643d0 con 0x7f2590110990 2024-05-14T15:20:54.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:54.005+0000 7f2586a00700 1 -- 172.21.15.69:0/2540499499 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v91) ==== 56+0+5692 (secure 0 0 0) 0x7f25880a9e30 con 0x7f2590110990 2024-05-14T15:20:54.006 INFO:teuthology.orchestra.run.smithi069.stdout:epoch 91 2024-05-14T15:20:54.006 INFO:teuthology.orchestra.run.smithi069.stdout:fsid 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:20:54.007 INFO:teuthology.orchestra.run.smithi069.stdout:created 2024-05-14T15:04:32.074994+0000 2024-05-14T15:20:54.007 INFO:teuthology.orchestra.run.smithi069.stdout:modified 2024-05-14T15:17:43.708185+0000 2024-05-14T15:20:54.007 INFO:teuthology.orchestra.run.smithi069.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-05-14T15:20:54.007 INFO:teuthology.orchestra.run.smithi069.stdout:crush_version 27 2024-05-14T15:20:54.007 INFO:teuthology.orchestra.run.smithi069.stdout:full_ratio 0.95 2024-05-14T15:20:54.007 INFO:teuthology.orchestra.run.smithi069.stdout:backfillfull_ratio 0.9 2024-05-14T15:20:54.007 INFO:teuthology.orchestra.run.smithi069.stdout:nearfull_ratio 0.85 2024-05-14T15:20:54.007 INFO:teuthology.orchestra.run.smithi069.stdout:require_min_compat_client luminous 2024-05-14T15:20:54.007 INFO:teuthology.orchestra.run.smithi069.stdout:min_compat_client luminous 2024-05-14T15:20:54.007 INFO:teuthology.orchestra.run.smithi069.stdout:require_osd_release squid 2024-05-14T15:20:54.007 INFO:teuthology.orchestra.run.smithi069.stdout:stretch_mode_enabled false 2024-05-14T15:20:54.007 INFO:teuthology.orchestra.run.smithi069.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-05-14T15:20:54.007 INFO:teuthology.orchestra.run.smithi069.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-05-14T15:20:54.008 INFO:teuthology.orchestra.run.smithi069.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 80 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.69 2024-05-14T15:20:54.008 INFO:teuthology.orchestra.run.smithi069.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 87 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-05-14T15:20:54.008 INFO:teuthology.orchestra.run.smithi069.stdout:max_osd 12 2024-05-14T15:20:54.008 INFO:teuthology.orchestra.run.smithi069.stdout:osd.0 up in weight 1 up_from 8 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.69:6802/301095601,v1:172.21.15.69:6803/301095601] [v2:172.21.15.69:6804/301095601,v1:172.21.15.69:6805/301095601] exists,up 8640de99-c23a-494e-a100-aafd04fe1867 2024-05-14T15:20:54.008 INFO:teuthology.orchestra.run.smithi069.stdout:osd.1 up in weight 1 up_from 13 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6800/2774122776,v1:172.21.15.92:6801/2774122776] [v2:172.21.15.92:6802/2774122776,v1:172.21.15.92:6803/2774122776] exists,up 89f78a32-7afb-49f3-9287-5478a1cc8829 2024-05-14T15:20:54.008 INFO:teuthology.orchestra.run.smithi069.stdout:osd.2 up in weight 1 up_from 18 up_thru 83 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6800/2836920513,v1:172.21.15.203:6801/2836920513] [v2:172.21.15.203:6802/2836920513,v1:172.21.15.203:6803/2836920513] exists,up a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151 2024-05-14T15:20:54.008 INFO:teuthology.orchestra.run.smithi069.stdout:osd.3 up in weight 1 up_from 25 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.69:6810/680308620,v1:172.21.15.69:6811/680308620] [v2:172.21.15.69:6812/680308620,v1:172.21.15.69:6813/680308620] exists,up 81409850-de26-4520-972c-31a716adf4cf 2024-05-14T15:20:54.008 INFO:teuthology.orchestra.run.smithi069.stdout:osd.4 up in weight 1 up_from 31 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6808/1071971048,v1:172.21.15.92:6809/1071971048] [v2:172.21.15.92:6810/1071971048,v1:172.21.15.92:6811/1071971048] exists,up 9aa3a6b0-cc63-4eae-8416-8ab630994985 2024-05-14T15:20:54.008 INFO:teuthology.orchestra.run.smithi069.stdout:osd.5 up in weight 1 up_from 37 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6808/1404230851,v1:172.21.15.203:6809/1404230851] [v2:172.21.15.203:6810/1404230851,v1:172.21.15.203:6811/1404230851] exists,up f7fcde57-e280-494b-a45f-8fa007ed9ee9 2024-05-14T15:20:54.008 INFO:teuthology.orchestra.run.smithi069.stdout:osd.6 up in weight 1 up_from 43 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.69:6818/1213427819,v1:172.21.15.69:6819/1213427819] [v2:172.21.15.69:6820/1213427819,v1:172.21.15.69:6821/1213427819] exists,up 86f1373a-3b39-4a7f-b14c-9bf8695c6b91 2024-05-14T15:20:54.008 INFO:teuthology.orchestra.run.smithi069.stdout:osd.7 up in weight 1 up_from 48 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6816/4274774582,v1:172.21.15.92:6817/4274774582] [v2:172.21.15.92:6818/4274774582,v1:172.21.15.92:6819/4274774582] exists,up e790fbf1-3e34-4950-bdfa-cf1adbd451c0 2024-05-14T15:20:54.008 INFO:teuthology.orchestra.run.smithi069.stdout:osd.8 up in weight 1 up_from 55 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6816/2480959249,v1:172.21.15.203:6817/2480959249] [v2:172.21.15.203:6818/2480959249,v1:172.21.15.203:6819/2480959249] exists,up 65019fee-6b18-4d13-841a-2e3acb51f180 2024-05-14T15:20:54.008 INFO:teuthology.orchestra.run.smithi069.stdout:osd.9 up in weight 1 up_from 61 up_thru 90 down_at 0 last_clean_interval [0,0) [v2:172.21.15.69:6826/2649966866,v1:172.21.15.69:6827/2649966866] [v2:172.21.15.69:6828/2649966866,v1:172.21.15.69:6829/2649966866] exists,up b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa 2024-05-14T15:20:54.008 INFO:teuthology.orchestra.run.smithi069.stdout:osd.10 up in weight 1 up_from 66 up_thru 77 down_at 0 last_clean_interval [0,0) [v2:172.21.15.92:6824/3650822776,v1:172.21.15.92:6825/3650822776] [v2:172.21.15.92:6826/3650822776,v1:172.21.15.92:6827/3650822776] exists,up 45287823-f7ea-431f-ac01-a72762b01a9f 2024-05-14T15:20:54.009 INFO:teuthology.orchestra.run.smithi069.stdout:osd.11 up in weight 1 up_from 72 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.203:6824/2590258806,v1:172.21.15.203:6825/2590258806] [v2:172.21.15.203:6826/2590258806,v1:172.21.15.203:6827/2590258806] exists,up 2f3a10f9-2414-4151-b1cf-3db68b2a66fb 2024-05-14T15:20:54.009 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 2.8 [2,11] 2024-05-14T15:20:54.009 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 2.1d [8,11] 2024-05-14T15:20:54.009 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.0 [4,6] 2024-05-14T15:20:54.009 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.c [3,9] 2024-05-14T15:20:54.009 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.14 [1,9] 2024-05-14T15:20:54.009 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.28 [5,7] 2024-05-14T15:20:54.009 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.2a [3,8] 2024-05-14T15:20:54.009 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.2c [4,9] 2024-05-14T15:20:54.009 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.31 [4,8] 2024-05-14T15:20:54.009 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 3.38 [5,6] 2024-05-14T15:20:54.009 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 4.b [9,8] 2024-05-14T15:20:54.009 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 4.f [9,8] 2024-05-14T15:20:54.009 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 4.16 [9,10] 2024-05-14T15:20:54.009 INFO:teuthology.orchestra.run.smithi069.stdout:pg_upmap_items 4.1a [5,8] 2024-05-14T15:20:54.009 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/151981233 expires 2024-05-15T15:05:41.383453+0000 2024-05-14T15:20:54.010 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/3776172313 expires 2024-05-15T15:05:41.383453+0000 2024-05-14T15:20:54.010 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/1288620257 expires 2024-05-15T15:05:41.383453+0000 2024-05-14T15:20:54.010 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:6801/2718114316 expires 2024-05-15T15:05:41.383453+0000 2024-05-14T15:20:54.010 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:6801/586229880 expires 2024-05-15T15:05:06.373096+0000 2024-05-14T15:20:54.010 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/1655882616 expires 2024-05-15T15:05:06.373096+0000 2024-05-14T15:20:54.010 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/4183332474 expires 2024-05-15T15:05:06.373096+0000 2024-05-14T15:20:54.010 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:6800/586229880 expires 2024-05-15T15:05:06.373096+0000 2024-05-14T15:20:54.010 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:0/2806878946 expires 2024-05-15T15:05:06.373096+0000 2024-05-14T15:20:54.010 INFO:teuthology.orchestra.run.smithi069.stdout:blocklist 172.21.15.69:6800/2718114316 expires 2024-05-15T15:05:41.383453+0000 2024-05-14T15:20:54.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:54.008+0000 7f2594e00700 1 -- 172.21.15.69:0/2540499499 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f25740b2880 msgr2=0x7f25740b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:54.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:54.008+0000 7f2594e00700 1 --2- 172.21.15.69:0/2540499499 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f25740b2880 0x7f25740b4d90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2580009990 tx=0x7f2580005fb0 comp rx=0 tx=0).stop 2024-05-14T15:20:54.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:54.008+0000 7f2594e00700 1 -- 172.21.15.69:0/2540499499 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2590110990 msgr2=0x7f25901a82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:54.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:54.008+0000 7f2594e00700 1 --2- 172.21.15.69:0/2540499499 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2590110990 0x7f25901a82f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f2588007ee0 tx=0x7f258800d3b0 comp rx=0 tx=0).stop 2024-05-14T15:20:54.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:54.008+0000 7f2594e00700 1 -- 172.21.15.69:0/2540499499 shutdown_connections 2024-05-14T15:20:54.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:54.008+0000 7f2594e00700 1 --2- 172.21.15.69:0/2540499499 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2590110990 0x7f25901a82f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:54.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:54.008+0000 7f2594e00700 1 --2- 172.21.15.69:0/2540499499 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f25740b2880 0x7f25740b4d90 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:54.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:54.008+0000 7f2594e00700 1 --2- 172.21.15.69:0/2540499499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25900760f0 0x7f25901a0e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:54.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:54.008+0000 7f2594e00700 1 --2- 172.21.15.69:0/2540499499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f25900776e0 0x7f25901a1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:54.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:54.008+0000 7f2594e00700 1 -- 172.21.15.69:0/2540499499 >> 172.21.15.69:0/2540499499 conn(0x7f25900ff9c0 msgr2=0x7f2590103d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:54.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:54.009+0000 7f2594e00700 1 -- 172.21.15.69:0/2540499499 shutdown_connections 2024-05-14T15:20:54.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:54.009+0000 7f2594e00700 1 -- 172.21.15.69:0/2540499499 wait complete. 2024-05-14T15:20:54.926 INFO:teuthology.run_tasks:Running task fs.ready... 2024-05-14T15:20:54.937 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:20:55.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:54 smithi203 ceph-mon[34567]: pgmap v537: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-14T15:20:55.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:54 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2540499499' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-14T15:20:55.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:54 smithi092 ceph-mon[34729]: pgmap v537: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-14T15:20:55.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:54 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2540499499' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-14T15:20:55.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:54 smithi069 ceph-mon[31270]: pgmap v537: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 9 op/s 2024-05-14T15:20:55.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:54 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2540499499' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-05-14T15:20:55.356 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:20:57.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:56 smithi203 ceph-mon[34567]: pgmap v538: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T15:20:57.171 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:56 smithi069 ceph-mon[31270]: pgmap v538: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T15:20:57.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:56 smithi092 ceph-mon[34729]: pgmap v538: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 9 op/s 2024-05-14T15:20:57.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.821+0000 7f5e08e00700 1 -- 172.21.15.69:0/4183179560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e04105500 msgr2=0x7f5e04105910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:57.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.821+0000 7f5e08e00700 1 --2- 172.21.15.69:0/4183179560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e04105500 0x7f5e04105910 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009990 tx=0x7f5df4009ca0 comp rx=0 tx=0).stop 2024-05-14T15:20:57.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.821+0000 7f5e08e00700 1 -- 172.21.15.69:0/4183179560 shutdown_connections 2024-05-14T15:20:57.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.821+0000 7f5e08e00700 1 --2- 172.21.15.69:0/4183179560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e04105500 0x7f5e04105910 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:57.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.821+0000 7f5e08e00700 1 --2- 172.21.15.69:0/4183179560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e0410e8e0 0x7f5e04110dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:57.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.821+0000 7f5e08e00700 1 --2- 172.21.15.69:0/4183179560 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e04105e50 0x7f5e0410e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:57.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.821+0000 7f5e08e00700 1 -- 172.21.15.69:0/4183179560 >> 172.21.15.69:0/4183179560 conn(0x7f5e040fedc0 msgr2=0x7f5e041011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:57.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.821+0000 7f5e08e00700 1 -- 172.21.15.69:0/4183179560 shutdown_connections 2024-05-14T15:20:57.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.821+0000 7f5e08e00700 1 -- 172.21.15.69:0/4183179560 wait complete. 2024-05-14T15:20:57.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.822+0000 7f5e08e00700 1 Processor -- start 2024-05-14T15:20:57.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.823+0000 7f5e08e00700 1 -- start start 2024-05-14T15:20:57.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.823+0000 7f5e08e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e04105500 0x7f5e041031f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:57.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.823+0000 7f5e08e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e04105e50 0x7f5e04103730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:57.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.823+0000 7f5e08e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e0410e8e0 0x7f5e04103c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:57.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.823+0000 7f5e08e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5e04114330 con 0x7f5e0410e8e0 2024-05-14T15:20:57.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.823+0000 7f5e08e00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5e041141b0 con 0x7f5e04105500 2024-05-14T15:20:57.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.823+0000 7f5e08e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5e041144b0 con 0x7f5e04105e50 2024-05-14T15:20:57.825 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.823+0000 7f5e02800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e0410e8e0 0x7f5e04103c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:57.825 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.824+0000 7f5e02800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e0410e8e0 0x7f5e04103c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46640/0 (socket says 172.21.15.69:46640) 2024-05-14T15:20:57.825 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.824+0000 7f5e02800700 1 -- 172.21.15.69:0/2697191750 learned_addr learned my addr 172.21.15.69:0/2697191750 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:20:57.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.824+0000 7f5e01400700 1 --2- 172.21.15.69:0/2697191750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e04105e50 0x7f5e04103730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:57.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.824+0000 7f5e01e00700 1 --2- 172.21.15.69:0/2697191750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e04105500 0x7f5e041031f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:57.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.824+0000 7f5e02800700 1 -- 172.21.15.69:0/2697191750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e04105e50 msgr2=0x7f5e04103730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:57.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.824+0000 7f5e02800700 1 --2- 172.21.15.69:0/2697191750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e04105e50 0x7f5e04103730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:57.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.824+0000 7f5e02800700 1 -- 172.21.15.69:0/2697191750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e04105500 msgr2=0x7f5e041031f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:57.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.824+0000 7f5e02800700 1 --2- 172.21.15.69:0/2697191750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e04105500 0x7f5e041031f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:57.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.824+0000 7f5e02800700 1 -- 172.21.15.69:0/2697191750 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e041a9030 con 0x7f5e0410e8e0 2024-05-14T15:20:57.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.825+0000 7f5e02800700 1 --2- 172.21.15.69:0/2697191750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e0410e8e0 0x7f5e04103c70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc007d70 tx=0x7f5dfc00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:57.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.827+0000 7f5dfaa00700 1 -- 172.21.15.69:0/2697191750 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc016020 con 0x7f5e0410e8e0 2024-05-14T15:20:57.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.827+0000 7f5dfaa00700 1 -- 172.21.15.69:0/2697191750 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5dfc00ad40 con 0x7f5e0410e8e0 2024-05-14T15:20:57.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.827+0000 7f5e08e00700 1 -- 172.21.15.69:0/2697191750 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e041a9320 con 0x7f5e0410e8e0 2024-05-14T15:20:57.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.827+0000 7f5dfaa00700 1 -- 172.21.15.69:0/2697191750 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dfc0115e0 con 0x7f5e0410e8e0 2024-05-14T15:20:57.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.827+0000 7f5e08e00700 1 -- 172.21.15.69:0/2697191750 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e041a9810 con 0x7f5e0410e8e0 2024-05-14T15:20:57.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.829+0000 7f5e08e00700 1 -- 172.21.15.69:0/2697191750 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e040512c0 con 0x7f5e0410e8e0 2024-05-14T15:20:57.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.831+0000 7f5dfaa00700 1 -- 172.21.15.69:0/2697191750 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f5dfc019020 con 0x7f5e0410e8e0 2024-05-14T15:20:57.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.833+0000 7f5dfaa00700 1 --2- 172.21.15.69:0/2697191750 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5de80b2880 0x7f5de80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:20:57.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.833+0000 7f5dfaa00700 1 -- 172.21.15.69:0/2697191750 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f5dfc0e2a50 con 0x7f5e0410e8e0 2024-05-14T15:20:57.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.833+0000 7f5e01e00700 1 --2- 172.21.15.69:0/2697191750 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5de80b2880 0x7f5de80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:20:57.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.834+0000 7f5e01e00700 1 --2- 172.21.15.69:0/2697191750 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5de80b2880 0x7f5de80b4d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5df4006010 tx=0x7f5df400b540 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:20:57.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:57.838+0000 7f5dfaa00700 1 -- 172.21.15.69:0/2697191750 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5dfc020020 con 0x7f5e0410e8e0 2024-05-14T15:20:58.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:58.117+0000 7f5e08e00700 1 -- 172.21.15.69:0/2697191750 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5e0402e5f0 con 0x7f5e0410e8e0 2024-05-14T15:20:58.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:58.120+0000 7f5dfaa00700 1 -- 172.21.15.69:0/2697191750 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11932 (secure 0 0 0) 0x7f5dfc0aa340 con 0x7f5e0410e8e0 2024-05-14T15:20:58.121 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:20:58.122 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T15:16:11.716543+0000","modified":"2024-05-14T15:17:42.234289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34490,"mds_1":34460,"mds_2":34433,"mds_3":34409,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":31,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":35,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34490":{"gid":34490,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34490,"qdb_cluster":[24451,34433,34409,34460,34490]},"id":1}]} 2024-05-14T15:20:58.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:58.124+0000 7f5e08e00700 1 -- 172.21.15.69:0/2697191750 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5de80b2880 msgr2=0x7f5de80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:58.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:58.124+0000 7f5e08e00700 1 --2- 172.21.15.69:0/2697191750 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5de80b2880 0x7f5de80b4d90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f5df4006010 tx=0x7f5df400b540 comp rx=0 tx=0).stop 2024-05-14T15:20:58.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:58.124+0000 7f5e08e00700 1 -- 172.21.15.69:0/2697191750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e0410e8e0 msgr2=0x7f5e04103c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:20:58.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:58.124+0000 7f5e08e00700 1 --2- 172.21.15.69:0/2697191750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e0410e8e0 0x7f5e04103c70 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f5dfc007d70 tx=0x7f5dfc00a340 comp rx=0 tx=0).stop 2024-05-14T15:20:58.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:58.124+0000 7f5e08e00700 1 -- 172.21.15.69:0/2697191750 shutdown_connections 2024-05-14T15:20:58.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:58.124+0000 7f5e08e00700 1 --2- 172.21.15.69:0/2697191750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e0410e8e0 0x7f5e04103c70 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:58.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:58.124+0000 7f5e08e00700 1 --2- 172.21.15.69:0/2697191750 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f5de80b2880 0x7f5de80b4d90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:58.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:58.124+0000 7f5e08e00700 1 --2- 172.21.15.69:0/2697191750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e04105500 0x7f5e041031f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:58.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:58.124+0000 7f5e08e00700 1 --2- 172.21.15.69:0/2697191750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e04105e50 0x7f5e04103730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:20:58.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:58.124+0000 7f5e08e00700 1 -- 172.21.15.69:0/2697191750 >> 172.21.15.69:0/2697191750 conn(0x7f5e040fedc0 msgr2=0x7f5e040ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:20:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:58.124+0000 7f5e08e00700 1 -- 172.21.15.69:0/2697191750 shutdown_connections 2024-05-14T15:20:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:20:58.124+0000 7f5e08e00700 1 -- 172.21.15.69:0/2697191750 wait complete. 2024-05-14T15:20:58.126 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 29 2024-05-14T15:20:59.081 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:20:59.093 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:58 smithi203 ceph-mon[34567]: pgmap v539: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-05-14T15:20:59.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:20:58 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2697191750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:20:59.152 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:58 smithi069 ceph-mon[31270]: pgmap v539: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-05-14T15:20:59.152 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:20:58 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2697191750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:20:59.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:58 smithi092 ceph-mon[34729]: pgmap v539: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.3 KiB/s rd, 9 op/s 2024-05-14T15:20:59.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:20:58 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2697191750' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:20:59.535 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:21:00.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:00 smithi069 ceph-mon[31270]: pgmap v540: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T15:21:01.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:00 smithi203 ceph-mon[34567]: pgmap v540: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T15:21:01.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:00 smithi092 ceph-mon[34729]: pgmap v540: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 9 op/s 2024-05-14T15:21:02.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.057+0000 7f4069c00700 1 -- 172.21.15.69:0/230856497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4064077cf0 msgr2=0x7f4064078100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:02.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.057+0000 7f4069c00700 1 --2- 172.21.15.69:0/230856497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4064077cf0 0x7f4064078100 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4054009990 tx=0x7f4054009ca0 comp rx=0 tx=0).stop 2024-05-14T15:21:02.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.057+0000 7f4069c00700 1 -- 172.21.15.69:0/230856497 shutdown_connections 2024-05-14T15:21:02.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.057+0000 7f4069c00700 1 --2- 172.21.15.69:0/230856497 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4064077cf0 0x7f4064078100 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:02.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.057+0000 7f4069c00700 1 --2- 172.21.15.69:0/230856497 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4064115030 0x7f4064117450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:02.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.057+0000 7f4069c00700 1 --2- 172.21.15.69:0/230856497 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4064078640 0x7f4064114af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:02.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.057+0000 7f4069c00700 1 -- 172.21.15.69:0/230856497 >> 172.21.15.69:0/230856497 conn(0x7f4064102030 msgr2=0x7f4064104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:02.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.057+0000 7f4069c00700 1 -- 172.21.15.69:0/230856497 shutdown_connections 2024-05-14T15:21:02.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.057+0000 7f4069c00700 1 -- 172.21.15.69:0/230856497 wait complete. 2024-05-14T15:21:02.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.058+0000 7f4069c00700 1 Processor -- start 2024-05-14T15:21:02.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.058+0000 7f4069c00700 1 -- start start 2024-05-14T15:21:02.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.059+0000 7f4069c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4064078640 0x7f40641a1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:02.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.059+0000 7f4069c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4064115030 0x7f40641a18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:02.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.059+0000 7f4069c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40641a5ab0 0x7f40641a5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:02.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.059+0000 7f4069c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f406411a770 con 0x7f40641a5ab0 2024-05-14T15:21:02.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.059+0000 7f4069c00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f406411a5f0 con 0x7f4064078640 2024-05-14T15:21:02.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.059+0000 7f4069c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f406411a8f0 con 0x7f4064115030 2024-05-14T15:21:02.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.059+0000 7f4069200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40641a5ab0 0x7f40641a5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:02.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.059+0000 7f4069200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40641a5ab0 0x7f40641a5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:46656/0 (socket says 172.21.15.69:46656) 2024-05-14T15:21:02.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.059+0000 7f4069200700 1 -- 172.21.15.69:0/612657929 learned_addr learned my addr 172.21.15.69:0/612657929 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:02.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.059+0000 7f4063e00700 1 --2- 172.21.15.69:0/612657929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4064078640 0x7f40641a1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:02.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.060+0000 7f4063400700 1 --2- 172.21.15.69:0/612657929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4064115030 0x7f40641a18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:02.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.060+0000 7f4069200700 1 -- 172.21.15.69:0/612657929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4064115030 msgr2=0x7f40641a18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:02.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.060+0000 7f4069200700 1 --2- 172.21.15.69:0/612657929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4064115030 0x7f40641a18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:02.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.060+0000 7f4069200700 1 -- 172.21.15.69:0/612657929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4064078640 msgr2=0x7f40641a1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:02.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.060+0000 7f4069200700 1 --2- 172.21.15.69:0/612657929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4064078640 0x7f40641a1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:02.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.060+0000 7f4069200700 1 -- 172.21.15.69:0/612657929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40641a6600 con 0x7f40641a5ab0 2024-05-14T15:21:02.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.060+0000 7f4069200700 1 --2- 172.21.15.69:0/612657929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40641a5ab0 0x7f40641a5ec0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f405c007ee0 tx=0x7f405c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:02.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.061+0000 7f4060c00700 1 -- 172.21.15.69:0/612657929 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c00dbd0 con 0x7f40641a5ab0 2024-05-14T15:21:02.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.061+0000 7f4069c00700 1 -- 172.21.15.69:0/612657929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40641a68f0 con 0x7f40641a5ab0 2024-05-14T15:21:02.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.061+0000 7f4060c00700 1 -- 172.21.15.69:0/612657929 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f405c00dd70 con 0x7f40641a5ab0 2024-05-14T15:21:02.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.061+0000 7f4060c00700 1 -- 172.21.15.69:0/612657929 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c0058d0 con 0x7f40641a5ab0 2024-05-14T15:21:02.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.061+0000 7f4069c00700 1 -- 172.21.15.69:0/612657929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40641ae080 con 0x7f40641a5ab0 2024-05-14T15:21:02.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.062+0000 7f4069c00700 1 -- 172.21.15.69:0/612657929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40640512c0 con 0x7f40641a5ab0 2024-05-14T15:21:02.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.065+0000 7f4060c00700 1 -- 172.21.15.69:0/612657929 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f405c01a020 con 0x7f40641a5ab0 2024-05-14T15:21:02.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.067+0000 7f4060c00700 1 --2- 172.21.15.69:0/612657929 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f40480b2880 0x7f40480b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:02.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.067+0000 7f4060c00700 1 -- 172.21.15.69:0/612657929 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f405c0e2470 con 0x7f40641a5ab0 2024-05-14T15:21:02.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.067+0000 7f4063e00700 1 --2- 172.21.15.69:0/612657929 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f40480b2880 0x7f40480b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:02.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.068+0000 7f4063e00700 1 --2- 172.21.15.69:0/612657929 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f40480b2880 0x7f40480b4d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f40540098e0 tx=0x7f4054005fb0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:02.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.070+0000 7f4060c00700 1 -- 172.21.15.69:0/612657929 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f405c010070 con 0x7f40641a5ab0 2024-05-14T15:21:02.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.352+0000 7f4069c00700 1 -- 172.21.15.69:0/612657929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f406402e5f0 con 0x7f40641a5ab0 2024-05-14T15:21:02.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.353+0000 7f4060c00700 1 -- 172.21.15.69:0/612657929 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11932 (secure 0 0 0) 0x7f405c0a9d60 con 0x7f40641a5ab0 2024-05-14T15:21:02.354 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:21:02.354 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T15:16:11.716543+0000","modified":"2024-05-14T15:17:42.234289+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34490,"mds_1":34460,"mds_2":34433,"mds_3":34409,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":31,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":35,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34490":{"gid":34490,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34490,"qdb_cluster":[24451,34433,34409,34460,34490]},"id":1}]} 2024-05-14T15:21:02.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.357+0000 7f4069c00700 1 -- 172.21.15.69:0/612657929 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f40480b2880 msgr2=0x7f40480b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:02.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.357+0000 7f4069c00700 1 --2- 172.21.15.69:0/612657929 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f40480b2880 0x7f40480b4d90 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f40540098e0 tx=0x7f4054005fb0 comp rx=0 tx=0).stop 2024-05-14T15:21:02.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.357+0000 7f4069c00700 1 -- 172.21.15.69:0/612657929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40641a5ab0 msgr2=0x7f40641a5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:02.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.357+0000 7f4069c00700 1 --2- 172.21.15.69:0/612657929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40641a5ab0 0x7f40641a5ec0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f405c007ee0 tx=0x7f405c00d3b0 comp rx=0 tx=0).stop 2024-05-14T15:21:02.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.357+0000 7f4069c00700 1 -- 172.21.15.69:0/612657929 shutdown_connections 2024-05-14T15:21:02.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.357+0000 7f4069c00700 1 --2- 172.21.15.69:0/612657929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40641a5ab0 0x7f40641a5ec0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:02.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.357+0000 7f4069c00700 1 --2- 172.21.15.69:0/612657929 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f40480b2880 0x7f40480b4d90 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:02.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.357+0000 7f4069c00700 1 --2- 172.21.15.69:0/612657929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4064078640 0x7f40641a1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:02.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.357+0000 7f4069c00700 1 --2- 172.21.15.69:0/612657929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4064115030 0x7f40641a18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:02.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.357+0000 7f4069c00700 1 -- 172.21.15.69:0/612657929 >> 172.21.15.69:0/612657929 conn(0x7f4064102030 msgr2=0x7f406407b070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:02.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.357+0000 7f4069c00700 1 -- 172.21.15.69:0/612657929 shutdown_connections 2024-05-14T15:21:02.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:02.357+0000 7f4069c00700 1 -- 172.21.15.69:0/612657929 wait complete. 2024-05-14T15:21:02.358 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 29 2024-05-14T15:21:03.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:02 smithi203 ceph-mon[34567]: pgmap v541: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T15:21:03.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:02 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/612657929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:21:03.115 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:02 smithi069 ceph-mon[31270]: pgmap v541: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T15:21:03.115 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:02 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/612657929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:21:03.187 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T15:21:03.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:02 smithi092 ceph-mon[34729]: pgmap v541: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 10 op/s 2024-05-14T15:21:03.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:02 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/612657929' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:21:03.632 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:21:05.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:04 smithi092 ceph-mon[34729]: pgmap v542: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:21:05.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:04 smithi069 ceph-mon[31270]: pgmap v542: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:21:05.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:04 smithi203 ceph-mon[34567]: pgmap v542: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:21:06.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.171+0000 7f40a5000700 1 -- 172.21.15.69:0/2899718590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a01045d0 msgr2=0x7f40a01049e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.171+0000 7f40a5000700 1 --2- 172.21.15.69:0/2899718590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a01045d0 0x7f40a01049e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f40900099c0 tx=0x7f4090009cd0 comp rx=0 tx=0).stop 2024-05-14T15:21:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.171+0000 7f40a5000700 1 -- 172.21.15.69:0/2899718590 shutdown_connections 2024-05-14T15:21:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.171+0000 7f40a5000700 1 --2- 172.21.15.69:0/2899718590 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a01045d0 0x7f40a01049e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.171+0000 7f40a5000700 1 --2- 172.21.15.69:0/2899718590 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40a0109850 0x7f40a01111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.171+0000 7f40a5000700 1 --2- 172.21.15.69:0/2899718590 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40a0108f00 0x7f40a0109310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.171+0000 7f40a5000700 1 -- 172.21.15.69:0/2899718590 >> 172.21.15.69:0/2899718590 conn(0x7f40a00ffea0 msgr2=0x7f40a01022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.171+0000 7f40a5000700 1 -- 172.21.15.69:0/2899718590 shutdown_connections 2024-05-14T15:21:06.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.171+0000 7f40a5000700 1 -- 172.21.15.69:0/2899718590 wait complete. 2024-05-14T15:21:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.172+0000 7f40a5000700 1 Processor -- start 2024-05-14T15:21:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.173+0000 7f40a5000700 1 -- start start 2024-05-14T15:21:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.173+0000 7f40a5000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a01045d0 0x7f40a019ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.173+0000 7f40a5000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40a0108f00 0x7f40a019b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.173+0000 7f40a5000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40a0109850 0x7f40a019f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:06.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.173+0000 7f40a5000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f40a0114330 con 0x7f40a01045d0 2024-05-14T15:21:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.173+0000 7f40a5000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f40a01141b0 con 0x7f40a0108f00 2024-05-14T15:21:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.173+0000 7f40a5000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f40a01144b0 con 0x7f40a0109850 2024-05-14T15:21:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.173+0000 7f409de00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a01045d0 0x7f40a019ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.174+0000 7f409de00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a01045d0 0x7f40a019ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53260/0 (socket says 172.21.15.69:53260) 2024-05-14T15:21:06.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.174+0000 7f409de00700 1 -- 172.21.15.69:0/3016384726 learned_addr learned my addr 172.21.15.69:0/3016384726 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:06.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.174+0000 7f409d400700 1 --2- 172.21.15.69:0/3016384726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40a0108f00 0x7f40a019b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:06.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.174+0000 7f409e800700 1 --2- 172.21.15.69:0/3016384726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40a0109850 0x7f40a019f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:06.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.174+0000 7f409de00700 1 -- 172.21.15.69:0/3016384726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40a0109850 msgr2=0x7f40a019f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:06.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.174+0000 7f409de00700 1 --2- 172.21.15.69:0/3016384726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40a0109850 0x7f40a019f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:06.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.174+0000 7f409de00700 1 -- 172.21.15.69:0/3016384726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40a0108f00 msgr2=0x7f40a019b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:06.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.174+0000 7f409de00700 1 --2- 172.21.15.69:0/3016384726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40a0108f00 0x7f40a019b380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:06.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.174+0000 7f409de00700 1 -- 172.21.15.69:0/3016384726 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a019fcb0 con 0x7f40a01045d0 2024-05-14T15:21:06.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.175+0000 7f409de00700 1 --2- 172.21.15.69:0/3016384726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a01045d0 0x7f40a019ade0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4090000c00 tx=0x7f409000f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:06.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.175+0000 7f4096a00700 1 -- 172.21.15.69:0/3016384726 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f409000f940 con 0x7f40a01045d0 2024-05-14T15:21:06.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.175+0000 7f4096a00700 1 -- 172.21.15.69:0/3016384726 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4090004830 con 0x7f40a01045d0 2024-05-14T15:21:06.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.175+0000 7f40a5000700 1 -- 172.21.15.69:0/3016384726 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40a019ff40 con 0x7f40a01045d0 2024-05-14T15:21:06.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.175+0000 7f4096a00700 1 -- 172.21.15.69:0/3016384726 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40900054b0 con 0x7f40a01045d0 2024-05-14T15:21:06.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.175+0000 7f40a5000700 1 -- 172.21.15.69:0/3016384726 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40a01a0410 con 0x7f40a01045d0 2024-05-14T15:21:06.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.177+0000 7f40a5000700 1 -- 172.21.15.69:0/3016384726 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40a00512c0 con 0x7f40a01045d0 2024-05-14T15:21:06.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.179+0000 7f4096a00700 1 -- 172.21.15.69:0/3016384726 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f4090029060 con 0x7f40a01045d0 2024-05-14T15:21:06.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.181+0000 7f4096a00700 1 --2- 172.21.15.69:0/3016384726 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f40840b2900 0x7f40840b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:06.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.181+0000 7f4096a00700 1 -- 172.21.15.69:0/3016384726 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f40900e3420 con 0x7f40a01045d0 2024-05-14T15:21:06.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.181+0000 7f409d400700 1 --2- 172.21.15.69:0/3016384726 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f40840b2900 0x7f40840b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:06.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.182+0000 7f409d400700 1 --2- 172.21.15.69:0/3016384726 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f40840b2900 0x7f40840b4e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f408c005950 tx=0x7f408c0058e0 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:06.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.184+0000 7f4096a00700 1 -- 172.21.15.69:0/3016384726 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f4090013070 con 0x7f40a01045d0 2024-05-14T15:21:06.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.416+0000 7f40a5000700 1 -- 172.21.15.69:0/3016384726 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f40a002e5f0 con 0x7f40a01045d0 2024-05-14T15:21:06.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.418+0000 7f4096a00700 1 -- 172.21.15.69:0/3016384726 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24861 (secure 0 0 0) 0x7f40900aada0 con 0x7f40a01045d0 2024-05-14T15:21:06.419 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:21:06.419 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":91,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","created":"2024-05-14T15:04:32.074994+0000","modified":"2024-05-14T15:17:43.708185+0000","last_up_change":"2024-05-14T15:14:44.049523+0000","last_in_change":"2024-05-14T15:14:16.752653+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:09:03.561841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:16:02.641690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:16:06.949687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:16:20.891122+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8640de99-c23a-494e-a100-aafd04fe1867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6803","nonce":301095601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6805","nonce":301095601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6809","nonce":301095601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6807","nonce":301095601}]},"public_addr":"172.21.15.69:6803/301095601","cluster_addr":"172.21.15.69:6805/301095601","heartbeat_back_addr":"172.21.15.69:6809/301095601","heartbeat_front_addr":"172.21.15.69:6807/301095601","state":["exists","up"]},{"osd":1,"uuid":"89f78a32-7afb-49f3-9287-5478a1cc8829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6801","nonce":2774122776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6803","nonce":2774122776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6807","nonce":2774122776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6805","nonce":2774122776}]},"public_addr":"172.21.15.92:6801/2774122776","cluster_addr":"172.21.15.92:6803/2774122776","heartbeat_back_addr":"172.21.15.92:6807/2774122776","heartbeat_front_addr":"172.21.15.92:6805/2774122776","state":["exists","up"]},{"osd":2,"uuid":"a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6801","nonce":2836920513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6803","nonce":2836920513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6807","nonce":2836920513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6805","nonce":2836920513}]},"public_addr":"172.21.15.203:6801/2836920513","cluster_addr":"172.21.15.203:6803/2836920513","heartbeat_back_addr":"172.21.15.203:6807/2836920513","heartbeat_front_addr":"172.21.15.203:6805/2836920513","state":["exists","up"]},{"osd":3,"uuid":"81409850-de26-4520-972c-31a716adf4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6811","nonce":680308620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6813","nonce":680308620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6817","nonce":680308620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6815","nonce":680308620}]},"public_addr":"172.21.15.69:6811/680308620","cluster_addr":"172.21.15.69:6813/680308620","heartbeat_back_addr":"172.21.15.69:6817/680308620","heartbeat_front_addr":"172.21.15.69:6815/680308620","state":["exists","up"]},{"osd":4,"uuid":"9aa3a6b0-cc63-4eae-8416-8ab630994985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6809","nonce":1071971048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6811","nonce":1071971048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6815","nonce":1071971048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6813","nonce":1071971048}]},"public_addr":"172.21.15.92:6809/1071971048","cluster_addr":"172.21.15.92:6811/1071971048","heartbeat_back_addr":"172.21.15.92:6815/1071971048","heartbeat_front_addr":"172.21.15.92:6813/1071971048","state":["exists","up"]},{"osd":5,"uuid":"f7fcde57-e280-494b-a45f-8fa007ed9ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6809","nonce":1404230851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6811","nonce":1404230851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6815","nonce":1404230851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6813","nonce":1404230851}]},"public_addr":"172.21.15.203:6809/1404230851","cluster_addr":"172.21.15.203:6811/1404230851","heartbeat_back_addr":"172.21.15.203:6815/1404230851","heartbeat_front_addr":"172.21.15.203:6813/1404230851","state":["exists","up"]},{"osd":6,"uuid":"86f1373a-3b39-4a7f-b14c-9bf8695c6b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6819","nonce":1213427819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6821","nonce":1213427819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6825","nonce":1213427819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6823","nonce":1213427819}]},"public_addr":"172.21.15.69:6819/1213427819","cluster_addr":"172.21.15.69:6821/1213427819","heartbeat_back_addr":"172.21.15.69:6825/1213427819","heartbeat_front_addr":"172.21.15.69:6823/1213427819","state":["exists","up"]},{"osd":7,"uuid":"e790fbf1-3e34-4950-bdfa-cf1adbd451c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6817","nonce":4274774582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6819","nonce":4274774582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6823","nonce":4274774582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6821","nonce":4274774582}]},"public_addr":"172.21.15.92:6817/4274774582","cluster_addr":"172.21.15.92:6819/4274774582","heartbeat_back_addr":"172.21.15.92:6823/4274774582","heartbeat_front_addr":"172.21.15.92:6821/4274774582","state":["exists","up"]},{"osd":8,"uuid":"65019fee-6b18-4d13-841a-2e3acb51f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6817","nonce":2480959249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6819","nonce":2480959249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6823","nonce":2480959249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6821","nonce":2480959249}]},"public_addr":"172.21.15.203:6817/2480959249","cluster_addr":"172.21.15.203:6819/2480959249","heartbeat_back_addr":"172.21.15.203:6823/2480959249","heartbeat_front_addr":"172.21.15.203:6821/2480959249","state":["exists","up"]},{"osd":9,"uuid":"b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6827","nonce":2649966866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6829","nonce":2649966866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6833","nonce":2649966866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6831","nonce":2649966866}]},"public_addr":"172.21.15.69:6827/2649966866","cluster_addr":"172.21.15.69:6829/2649966866","heartbeat_back_addr":"172.21.15.69:6833/2649966866","heartbeat_front_addr":"172.21.15.69:6831/2649966866","state":["exists","up"]},{"osd":10,"uuid":"45287823-f7ea-431f-ac01-a72762b01a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6825","nonce":3650822776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6827","nonce":3650822776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6831","nonce":3650822776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6829","nonce":3650822776}]},"public_addr":"172.21.15.92:6825/3650822776","cluster_addr":"172.21.15.92:6827/3650822776","heartbeat_back_addr":"172.21.15.92:6831/3650822776","heartbeat_front_addr":"172.21.15.92:6829/3650822776","state":["exists","up"]},{"osd":11,"uuid":"2f3a10f9-2414-4151-b1cf-3db68b2a66fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6825","nonce":2590258806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6827","nonce":2590258806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6831","nonce":2590258806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6829","nonce":2590258806}]},"public_addr":"172.21.15.203:6825/2590258806","cluster_addr":"172.21.15.203:6827/2590258806","heartbeat_back_addr":"172.21.15.203:6831/2590258806","heartbeat_front_addr":"172.21.15.203:6829/2590258806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:07:50.047712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:08:25.223293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:01.269713+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:38.679607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:16.161314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:53.323450+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:11:31.930106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:10.173015+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:48.056752+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:13:25.780142+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:03.705208+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:41.267371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":5,"to":6}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/151981233":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/3776172313":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/1288620257":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/2718114316":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/1655882616":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/4183332474":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/2806878946":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/2718114316":"2024-05-15T15:05:41.383453+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:21:06.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.421+0000 7f40a5000700 1 -- 172.21.15.69:0/3016384726 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f40840b2900 msgr2=0x7f40840b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.421+0000 7f40a5000700 1 --2- 172.21.15.69:0/3016384726 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f40840b2900 0x7f40840b4e10 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f408c005950 tx=0x7f408c0058e0 comp rx=0 tx=0).stop 2024-05-14T15:21:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.422+0000 7f40a5000700 1 -- 172.21.15.69:0/3016384726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a01045d0 msgr2=0x7f40a019ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.422+0000 7f40a5000700 1 --2- 172.21.15.69:0/3016384726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a01045d0 0x7f40a019ade0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4090000c00 tx=0x7f409000f510 comp rx=0 tx=0).stop 2024-05-14T15:21:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.422+0000 7f40a5000700 1 -- 172.21.15.69:0/3016384726 shutdown_connections 2024-05-14T15:21:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.422+0000 7f40a5000700 1 --2- 172.21.15.69:0/3016384726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f40a01045d0 0x7f40a019ade0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.422+0000 7f40a5000700 1 --2- 172.21.15.69:0/3016384726 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f40840b2900 0x7f40840b4e10 secure :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f408c005950 tx=0x7f408c0058e0 comp rx=0 tx=0).stop 2024-05-14T15:21:06.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.422+0000 7f40a5000700 1 --2- 172.21.15.69:0/3016384726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f40a0109850 0x7f40a019f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:06.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.422+0000 7f40a5000700 1 --2- 172.21.15.69:0/3016384726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f40a0108f00 0x7f40a019b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:06.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.422+0000 7f40a5000700 1 -- 172.21.15.69:0/3016384726 >> 172.21.15.69:0/3016384726 conn(0x7f40a00ffea0 msgr2=0x7f40a01022c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:06.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.422+0000 7f40a5000700 1 -- 172.21.15.69:0/3016384726 shutdown_connections 2024-05-14T15:21:06.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:06.422+0000 7f40a5000700 1 -- 172.21.15.69:0/3016384726 wait complete. 2024-05-14T15:21:07.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:06 smithi092 ceph-mon[34729]: pgmap v543: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:21:07.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:06 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3016384726' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:21:07.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:06 smithi069 ceph-mon[31270]: pgmap v543: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:21:07.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:06 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3016384726' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:21:07.301 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 29, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-05-14T15:16:11.716543+0000', 'modified': '2024-05-14T15:17:42.234289+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 34490, 'mds_1': 34460, 'mds_2': 34433, 'mds_3': 34409, 'mds_4': 24451}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_14607': {'gid': 14607, 'name': 'g', 'rank': 4, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.69:6839/561211426', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6838', 'nonce': 561211426}, {'type': 'v1', 'addr': '172.21.15.69:6839', 'nonce': 561211426}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_14613': {'gid': 14613, 'name': 'a', 'rank': 3, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.69:6841/2134585816', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.69:6840', 'nonce': 2134585816}, {'type': 'v1', 'addr': '172.21.15.69:6841', 'nonce': 2134585816}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24391': {'gid': 24391, 'name': 'l', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.203:6833/3479394720', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6832', 'nonce': 3479394720}, {'type': 'v1', 'addr': '172.21.15.203:6833', 'nonce': 3479394720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24430': {'gid': 24430, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.203:6835/2407601401', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6834', 'nonce': 2407601401}, {'type': 'v1', 'addr': '172.21.15.203:6835', 'nonce': 2407601401}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'c', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.203:6837/3006378390', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6836', 'nonce': 3006378390}, {'type': 'v1', 'addr': '172.21.15.203:6837', 'nonce': 3006378390}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24451': {'gid': 24451, 'name': 'i', 'rank': 4, 'incarnation': 26, 'state': 'up:active', 'state_seq': 31, 'addr': '172.21.15.203:6839/3167469844', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.203:6838', 'nonce': 3167469844}, {'type': 'v1', 'addr': '172.21.15.203:6839', 'nonce': 3167469844}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34409': {'gid': 34409, 'name': 'k', 'rank': 3, 'incarnation': 24, 'state': 'up:active', 'state_seq': 39, 'addr': '172.21.15.92:6833/1997000798', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6832', 'nonce': 1997000798}, {'type': 'v1', 'addr': '172.21.15.92:6833', 'nonce': 1997000798}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34433': {'gid': 34433, 'name': 'e', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 35, 'addr': '172.21.15.92:6835/360295917', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6834', 'nonce': 360295917}, {'type': 'v1', 'addr': '172.21.15.92:6835', 'nonce': 360295917}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34460': {'gid': 34460, 'name': 'h', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 32, 'addr': '172.21.15.92:6837/1669439322', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6836', 'nonce': 1669439322}, {'type': 'v1', 'addr': '172.21.15.92:6837', 'nonce': 1669439322}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_34490': {'gid': 34490, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 6, 'addr': '172.21.15.92:6839/2029564385', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.92:6838', 'nonce': 2029564385}, {'type': 'v1', 'addr': '172.21.15.92:6839', 'nonce': 2029564385}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 34490, 'qdb_cluster': [24451, 34433, 34409, 34460, 34490]} 2024-05-14T15:21:07.301 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-05-14T15:21:07.301 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.i status 2024-05-14T15:21:07.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:06 smithi203 ceph-mon[34567]: pgmap v543: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:21:07.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:06 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3016384726' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:21:07.753 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:21:09.147 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:08 smithi203 ceph-mon[34567]: pgmap v544: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:21:09.172 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:08 smithi069 ceph-mon[31270]: pgmap v544: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:21:09.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:08 smithi092 ceph-mon[34729]: pgmap v544: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:21:10.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.149+0000 7fb77be00700 1 -- 172.21.15.69:0/2237209896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb774110970 msgr2=0x7fb774110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:10.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.149+0000 7fb77be00700 1 --2- 172.21.15.69:0/2237209896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb774110970 0x7fb774110d80 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fb768009990 tx=0x7fb768009ca0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.149+0000 7fb77be00700 1 -- 172.21.15.69:0/2237209896 shutdown_connections 2024-05-14T15:21:10.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.149+0000 7fb77be00700 1 --2- 172.21.15.69:0/2237209896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb774110970 0x7fb774110d80 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.149+0000 7fb77be00700 1 --2- 172.21.15.69:0/2237209896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77410b2e0 0x7fb774117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.149+0000 7fb77be00700 1 --2- 172.21.15.69:0/2237209896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77410a990 0x7fb77410ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.149+0000 7fb77be00700 1 -- 172.21.15.69:0/2237209896 >> 172.21.15.69:0/2237209896 conn(0x7fb774077c80 msgr2=0x7fb7740780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:10.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.149+0000 7fb77be00700 1 -- 172.21.15.69:0/2237209896 shutdown_connections 2024-05-14T15:21:10.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.149+0000 7fb77be00700 1 -- 172.21.15.69:0/2237209896 wait complete. 2024-05-14T15:21:10.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.151+0000 7fb77be00700 1 Processor -- start 2024-05-14T15:21:10.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.151+0000 7fb77be00700 1 -- start start 2024-05-14T15:21:10.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.151+0000 7fb77be00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77410a990 0x7fb7741a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.151+0000 7fb77be00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77410b2e0 0x7fb7741a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.151+0000 7fb77be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb774110970 0x7fb7741a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.151+0000 7fb77be00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb77411a920 con 0x7fb774110970 2024-05-14T15:21:10.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.151+0000 7fb77be00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb77411a7a0 con 0x7fb77410b2e0 2024-05-14T15:21:10.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.151+0000 7fb77be00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb77411aaa0 con 0x7fb77410a990 2024-05-14T15:21:10.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.152+0000 7fb779e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb774110970 0x7fb7741a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.152+0000 7fb779e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb774110970 0x7fb7741a5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53272/0 (socket says 172.21.15.69:53272) 2024-05-14T15:21:10.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.152+0000 7fb779e00700 1 -- 172.21.15.69:0/39043001 learned_addr learned my addr 172.21.15.69:0/39043001 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:10.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.152+0000 7fb779400700 1 --2- 172.21.15.69:0/39043001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77410a990 0x7fb7741a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.152+0000 7fb778a00700 1 --2- 172.21.15.69:0/39043001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77410b2e0 0x7fb7741a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.152+0000 7fb779e00700 1 -- 172.21.15.69:0/39043001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77410a990 msgr2=0x7fb7741a1310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:10.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.152+0000 7fb779e00700 1 --2- 172.21.15.69:0/39043001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77410a990 0x7fb7741a1310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.152+0000 7fb779e00700 1 -- 172.21.15.69:0/39043001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77410b2e0 msgr2=0x7fb7741a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:10.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.152+0000 7fb779e00700 1 --2- 172.21.15.69:0/39043001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77410b2e0 0x7fb7741a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.152+0000 7fb779e00700 1 -- 172.21.15.69:0/39043001 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7741a6130 con 0x7fb774110970 2024-05-14T15:21:10.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.153+0000 7fb779e00700 1 --2- 172.21.15.69:0/39043001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb774110970 0x7fb7741a5b40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb76c007d70 tx=0x7fb76c00a340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:10.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.153+0000 7fb772000700 1 -- 172.21.15.69:0/39043001 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c016020 con 0x7fb774110970 2024-05-14T15:21:10.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.153+0000 7fb772000700 1 -- 172.21.15.69:0/39043001 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb76c00ac90 con 0x7fb774110970 2024-05-14T15:21:10.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.153+0000 7fb772000700 1 -- 172.21.15.69:0/39043001 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0115e0 con 0x7fb774110970 2024-05-14T15:21:10.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.153+0000 7fb77be00700 1 -- 172.21.15.69:0/39043001 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7741a6420 con 0x7fb774110970 2024-05-14T15:21:10.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.153+0000 7fb77be00700 1 -- 172.21.15.69:0/39043001 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7741a6960 con 0x7fb774110970 2024-05-14T15:21:10.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.157+0000 7fb772000700 1 -- 172.21.15.69:0/39043001 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fb76c019020 con 0x7fb774110970 2024-05-14T15:21:10.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.158+0000 7fb78aa3fb80 1 Processor -- start 2024-05-14T15:21:10.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.158+0000 7fb78aa3fb80 1 -- start start 2024-05-14T15:21:10.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.158+0000 7fb772000700 1 --2- 172.21.15.69:0/39043001 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb75c0b2900 0x7fb75c0b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.159+0000 7fb78aa3fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0581adf0 0x55bb0599e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.159+0000 7fb78aa3fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb0599eba0 0x55bb059986c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.159+0000 7fb78aa3fb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb05998c00 0x55bb05999010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.159+0000 7fb78aa3fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55bb058ba9d0 con 0x55bb0581adf0 2024-05-14T15:21:10.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.159+0000 7fb78aa3fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bb05858710 con 0x55bb0599eba0 2024-05-14T15:21:10.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.159+0000 7fb78aa3fb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bb058b6990 con 0x55bb05998c00 2024-05-14T15:21:10.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.159+0000 7fb772000700 1 -- 172.21.15.69:0/39043001 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fb76c0e24a0 con 0x7fb774110970 2024-05-14T15:21:10.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.159+0000 7fb778a00700 1 --2- 172.21.15.69:0/39043001 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb75c0b2900 0x7fb75c0b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.159+0000 7fb779400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0581adf0 0x55bb0599e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.159+0000 7fb779400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0581adf0 0x55bb0599e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53274/0 (socket says 172.21.15.69:53274) 2024-05-14T15:21:10.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.159+0000 7fb779400700 1 -- 172.21.15.69:0/2550503934 learned_addr learned my addr 172.21.15.69:0/2550503934 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:10.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.159+0000 7fb778a00700 1 --2- 172.21.15.69:0/2550503934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb0599eba0 0x55bb059986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.160+0000 7fb779e00700 1 --2- 172.21.15.69:0/2550503934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb05998c00 0x55bb05999010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.160+0000 7fb779400700 1 -- 172.21.15.69:0/2550503934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb05998c00 msgr2=0x55bb05999010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:10.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.160+0000 7fb779400700 1 --2- 172.21.15.69:0/2550503934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb05998c00 0x55bb05999010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.160+0000 7fb779400700 1 -- 172.21.15.69:0/2550503934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb0599eba0 msgr2=0x55bb059986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:10.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.160+0000 7fb779400700 1 --2- 172.21.15.69:0/2550503934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb0599eba0 0x55bb059986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.160+0000 7fb779400700 1 -- 172.21.15.69:0/2550503934 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb05807880 con 0x55bb0581adf0 2024-05-14T15:21:10.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.160+0000 7fb779400700 1 --2- 172.21.15.69:0/2550503934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0581adf0 0x55bb0599e660 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb77407d0f0 tx=0x7fb768009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bb82147fc433df6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:10.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.160+0000 7fb778a00700 1 --2- 172.21.15.69:0/39043001 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb75c0b2900 0x7fb75c0b4e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb760005950 tx=0x7fb760013920 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:10.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.161+0000 7fb766a00700 1 -- 172.21.15.69:0/2550503934 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb768027070 con 0x55bb0581adf0 2024-05-14T15:21:10.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.161+0000 7fb766a00700 1 -- 172.21.15.69:0/2550503934 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb768005540 con 0x55bb0581adf0 2024-05-14T15:21:10.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.161+0000 7fb766a00700 1 -- 172.21.15.69:0/2550503934 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76800bbd0 con 0x55bb0581adf0 2024-05-14T15:21:10.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.162+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/2550503934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0581adf0 msgr2=0x55bb0599e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:10.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.162+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/2550503934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0581adf0 0x55bb0599e660 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb77407d0f0 tx=0x7fb768009f90 comp rx=0 tx=0).stop 2024-05-14T15:21:10.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.162+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/2550503934 shutdown_connections 2024-05-14T15:21:10.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.162+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/2550503934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0581adf0 0x55bb0599e660 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.162+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/2550503934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb05998c00 0x55bb05999010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.162+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/2550503934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb0599eba0 0x55bb059986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.162+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/2550503934 >> 172.21.15.69:0/2550503934 conn(0x55bb05859a30 msgr2=0x55bb05993740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:10.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.162+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/2550503934 shutdown_connections 2024-05-14T15:21:10.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.162+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/2550503934 wait complete. 2024-05-14T15:21:10.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.162+0000 7fb78aa3fb80 1 -- start start 2024-05-14T15:21:10.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.163+0000 7fb78aa3fb80 1 Processor -- start 2024-05-14T15:21:10.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.163+0000 7fb78aa3fb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb0581adf0 0x55bb059a2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.163+0000 7fb78aa3fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb05998c00 0x55bb059a28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.163+0000 7fb78aa3fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb059a2de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.163+0000 7fb78aa3fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55bb059a5610 con 0x55bb0599eba0 2024-05-14T15:21:10.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.163+0000 7fb78aa3fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bb05820ad0 con 0x55bb05998c00 2024-05-14T15:21:10.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.163+0000 7fb78aa3fb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bb059a5790 con 0x55bb0581adf0 2024-05-14T15:21:10.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.163+0000 7fb78aa3fb80 10 client.0 _ll_register_callbacks cb 0x55bb0584e330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:21:10.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.164+0000 7fb779e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb059a2de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.164+0000 7fb779e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb059a2de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53284/0 (socket says 172.21.15.69:53284) 2024-05-14T15:21:10.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.164+0000 7fb779e00700 1 -- 172.21.15.69:0/2692335773 learned_addr learned my addr 172.21.15.69:0/2692335773 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:10.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.164+0000 7fb778a00700 1 --2- 172.21.15.69:0/2692335773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb05998c00 0x55bb059a28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.164+0000 7fb779400700 1 --2- 172.21.15.69:0/2692335773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb0581adf0 0x55bb059a2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.164+0000 7fb779e00700 1 -- 172.21.15.69:0/2692335773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb0581adf0 msgr2=0x55bb059a2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:10.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.164+0000 7fb779e00700 1 --2- 172.21.15.69:0/2692335773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb0581adf0 0x55bb059a2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.164+0000 7fb779e00700 1 -- 172.21.15.69:0/2692335773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb05998c00 msgr2=0x55bb059a28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:10.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.164+0000 7fb779e00700 1 --2- 172.21.15.69:0/2692335773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb05998c00 0x55bb059a28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.164+0000 7fb779e00700 1 -- 172.21.15.69:0/2692335773 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb058803d0 con 0x55bb0599eba0 2024-05-14T15:21:10.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.164+0000 7fb778a00700 1 --2- 172.21.15.69:0/2692335773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb05998c00 0x55bb059a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:21:10.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.165+0000 7fb779e00700 1 --2- 172.21.15.69:0/2692335773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb059a2de0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb76c007d40 tx=0x7fb76c0a9bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b4033febb2fc1b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:10.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.165+0000 7fb75b400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:21:10.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.165+0000 7fb75b400700 1 -- 172.21.15.69:0/2692335773 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0c3060 con 0x55bb0599eba0 2024-05-14T15:21:10.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.165+0000 7fb75b400700 1 -- 172.21.15.69:0/2692335773 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fb76c0910b0 con 0x55bb0599eba0 2024-05-14T15:21:10.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.165+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/2692335773 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb768005540 con 0x55bb0599eba0 2024-05-14T15:21:10.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.165+0000 7fb75b400700 1 -- 172.21.15.69:0/2692335773 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb76c0912b0 con 0x55bb0599eba0 2024-05-14T15:21:10.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.165+0000 7fb78aa3fb80 10 client.15219 fetch_fsmap learned FSMap version 29 2024-05-14T15:21:10.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.165+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/2692335773 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bb059b02f0 con 0x55bb0599eba0 2024-05-14T15:21:10.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.165+0000 7fb75b400700 1 -- 172.21.15.69:0/2692335773 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb768005540 con 0x55bb0599eba0 2024-05-14T15:21:10.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.166+0000 7fb75b400700 1 -- 172.21.15.69:0/2692335773 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb76c0beae0 con 0x55bb0599eba0 2024-05-14T15:21:10.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.166+0000 7fb78aa3fb80 10 client.15219 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:21:10.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.166+0000 7fb78aa3fb80 10 client.15219 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-14T15:21:10.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.166+0000 7fb78aa3fb80 20 client.15219 populate_metadata read hostname 'smithi069' 2024-05-14T15:21:10.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.166+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/2692335773 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55bb059b2990 0x55bb059b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.166+0000 7fb78aa3fb80 4 client.15219 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:21:10.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.166+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/2692335773 --> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb05965020 con 0x55bb059b2990 2024-05-14T15:21:10.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.167+0000 7fb779400700 1 --2- 172.21.15.69:0/2692335773 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55bb059b2990 0x55bb059b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.168+0000 7fb779400700 1 --2- 172.21.15.69:0/2692335773 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55bb059b2990 0x55bb059b3e00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=5e7988de002c91ad server_cookie=3b5bb13f14357b0b in_seq=0 out_seq=0 2024-05-14T15:21:10.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.168+0000 7fb75b400700 10 client.15219 ms_handle_connect on v2:172.21.15.203:6838/3167469844 2024-05-14T15:21:10.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.170+0000 7fb75b400700 1 -- 172.21.15.69:0/2692335773 <== mds.4 v2:172.21.15.203:6838/3167469844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bb05965020 con 0x55bb059b2990 2024-05-14T15:21:10.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.170+0000 7fb75b400700 10 client.15219 handle_command_reply: tid=0 2024-05-14T15:21:10.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.170+0000 7fb78aa3fb80 1 client.15219 shutdown 2024-05-14T15:21:10.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.170+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/2692335773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 msgr2=0x55bb059a2de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:10.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.170+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/2692335773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb059a2de0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fb76c007d40 tx=0x7fb76c0a9bd0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.170+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/2692335773 shutdown_connections 2024-05-14T15:21:10.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.170+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/2692335773 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55bb059b2990 0x55bb059b3e00 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.170+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/2692335773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb059a2de0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.170+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/2692335773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb0581adf0 0x55bb059a2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.170+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/2692335773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb05998c00 0x55bb059a28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.170+0000 7fb75b400700 0 client.15219 ms_handle_reset on v2:172.21.15.203:6838/3167469844 2024-05-14T15:21:10.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.170+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/2692335773 >> 172.21.15.69:0/2692335773 conn(0x55bb05859a30 msgr2=0x55bb059976b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:10.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.170+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/2692335773 shutdown_connections 2024-05-14T15:21:10.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.170+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/2692335773 wait complete. 2024-05-14T15:21:10.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.170+0000 7fb78aa3fb80 20 client.15219 trim_cache size 0 max 16384 2024-05-14T15:21:10.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.193+0000 7fb78aa3fb80 1 Processor -- start 2024-05-14T15:21:10.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.193+0000 7fb78aa3fb80 1 -- start start 2024-05-14T15:21:10.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.194+0000 7fb78aa3fb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb0581adf0 0x55bb059986c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.194+0000 7fb78aa3fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb05998c00 0x55bb059aea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.194+0000 7fb78aa3fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb0599dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.194+0000 7fb78aa3fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55bb059b2140 con 0x55bb0599eba0 2024-05-14T15:21:10.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.194+0000 7fb78aa3fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bb059b2810 con 0x55bb05998c00 2024-05-14T15:21:10.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.194+0000 7fb78aa3fb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bb059b2ee0 con 0x55bb0581adf0 2024-05-14T15:21:10.194 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.194+0000 7fb779e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb0599dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.194+0000 7fb779e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb0599dc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53290/0 (socket says 172.21.15.69:53290) 2024-05-14T15:21:10.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.194+0000 7fb779e00700 1 -- 172.21.15.69:0/1987800177 learned_addr learned my addr 172.21.15.69:0/1987800177 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:10.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.195+0000 7fb778a00700 1 --2- 172.21.15.69:0/1987800177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb05998c00 0x55bb059aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.195+0000 7fb779400700 1 --2- 172.21.15.69:0/1987800177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb0581adf0 0x55bb059986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.195+0000 7fb779e00700 1 -- 172.21.15.69:0/1987800177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb0581adf0 msgr2=0x55bb059986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:10.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.195+0000 7fb779e00700 1 --2- 172.21.15.69:0/1987800177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb0581adf0 0x55bb059986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.195+0000 7fb779e00700 1 -- 172.21.15.69:0/1987800177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb05998c00 msgr2=0x55bb059aea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:10.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.195+0000 7fb779e00700 1 --2- 172.21.15.69:0/1987800177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb05998c00 0x55bb059aea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.195+0000 7fb779e00700 1 -- 172.21.15.69:0/1987800177 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb059a57a0 con 0x55bb0599eba0 2024-05-14T15:21:10.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.195+0000 7fb779400700 1 --2- 172.21.15.69:0/1987800177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb0581adf0 0x55bb059986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:21:10.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.195+0000 7fb779e00700 1 --2- 172.21.15.69:0/1987800177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb0599dc40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb76c012a10 tx=0x7fb76c012a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830a5d1baea64e68 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:10.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.195+0000 7fb766000700 1 -- 172.21.15.69:0/1987800177 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0a9d90 con 0x55bb0599eba0 2024-05-14T15:21:10.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.195+0000 7fb766000700 1 -- 172.21.15.69:0/1987800177 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb76c088020 con 0x55bb0599eba0 2024-05-14T15:21:10.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.195+0000 7fb766000700 1 -- 172.21.15.69:0/1987800177 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0a9690 con 0x55bb0599eba0 2024-05-14T15:21:10.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.196+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/1987800177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 msgr2=0x55bb0599dc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:10.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.196+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/1987800177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb0599dc40 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fb76c012a10 tx=0x7fb76c012a70 comp rx=0 tx=0).stop 2024-05-14T15:21:10.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.196+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/1987800177 shutdown_connections 2024-05-14T15:21:10.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.196+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/1987800177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb0599dc40 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.196+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/1987800177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb0581adf0 0x55bb059986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.196+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/1987800177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb05998c00 0x55bb059aea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.197+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/1987800177 >> 172.21.15.69:0/1987800177 conn(0x55bb05859a30 msgr2=0x55bb0599d530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:10.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.197+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/1987800177 shutdown_connections 2024-05-14T15:21:10.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.197+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/1987800177 wait complete. 2024-05-14T15:21:10.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.197+0000 7fb78aa3fb80 1 -- start start 2024-05-14T15:21:10.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.197+0000 7fb78aa3fb80 1 Processor -- start 2024-05-14T15:21:10.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.198+0000 7fb78aa3fb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb0581adf0 0x55bb059981b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.198+0000 7fb78aa3fb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb05998c00 0x55bb059ada50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.198+0000 7fb78aa3fb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb059adf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.198+0000 7fb78aa3fb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55bb059b3c80 con 0x55bb0599eba0 2024-05-14T15:21:10.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.198+0000 7fb78aa3fb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bb059b35b0 con 0x55bb05998c00 2024-05-14T15:21:10.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.198+0000 7fb78aa3fb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bb059b4350 con 0x55bb0581adf0 2024-05-14T15:21:10.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.198+0000 7fb78aa3fb80 10 client.0 _ll_register_callbacks cb 0x55bb0584e330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:21:10.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.198+0000 7fb779e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb059adf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.198+0000 7fb779e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb059adf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53300/0 (socket says 172.21.15.69:53300) 2024-05-14T15:21:10.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.198+0000 7fb779e00700 1 -- 172.21.15.69:0/1385934098 learned_addr learned my addr 172.21.15.69:0/1385934098 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:10.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.198+0000 7fb779400700 1 --2- 172.21.15.69:0/1385934098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb0581adf0 0x55bb059981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.198+0000 7fb778a00700 1 --2- 172.21.15.69:0/1385934098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb05998c00 0x55bb059ada50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.199+0000 7fb779e00700 1 -- 172.21.15.69:0/1385934098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb0581adf0 msgr2=0x55bb059981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:10.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.199+0000 7fb779e00700 1 --2- 172.21.15.69:0/1385934098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb0581adf0 0x55bb059981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.199+0000 7fb779e00700 1 -- 172.21.15.69:0/1385934098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb05998c00 msgr2=0x55bb059ada50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:10.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.199+0000 7fb779e00700 1 --2- 172.21.15.69:0/1385934098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb05998c00 0x55bb059ada50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.199+0000 7fb779e00700 1 -- 172.21.15.69:0/1385934098 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb059988e0 con 0x55bb0599eba0 2024-05-14T15:21:10.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.199+0000 7fb779e00700 1 --2- 172.21.15.69:0/1385934098 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb059adf90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb76c007c90 tx=0x7fb76c0a5460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d06f0cb914261f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:10.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.199+0000 7fb75b400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:21:10.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.199+0000 7fb75b400700 1 -- 172.21.15.69:0/1385934098 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb76c0b24f0 con 0x55bb0599eba0 2024-05-14T15:21:10.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.199+0000 7fb75b400700 1 -- 172.21.15.69:0/1385934098 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fb76c0910b0 con 0x55bb0599eba0 2024-05-14T15:21:10.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.199+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/1385934098 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb76c088020 con 0x55bb0599eba0 2024-05-14T15:21:10.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.199+0000 7fb75b400700 1 -- 172.21.15.69:0/1385934098 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fb76c0b9050 con 0x55bb0599eba0 2024-05-14T15:21:10.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.199+0000 7fb78aa3fb80 10 client.15225 fetch_fsmap learned FSMap version 29 2024-05-14T15:21:10.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.199+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/1385934098 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bb05a1e7c0 con 0x55bb0599eba0 2024-05-14T15:21:10.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.200+0000 7fb75b400700 1 -- 172.21.15.69:0/1385934098 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb76c088020 con 0x55bb0599eba0 2024-05-14T15:21:10.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.200+0000 7fb75b400700 1 -- 172.21.15.69:0/1385934098 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fb76c0a8360 con 0x55bb0599eba0 2024-05-14T15:21:10.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.200+0000 7fb78aa3fb80 10 client.15225 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:21:10.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.200+0000 7fb78aa3fb80 10 client.15225 resolve_mds: resolved name 'i' to daemon mds.i 2024-05-14T15:21:10.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.200+0000 7fb78aa3fb80 20 client.15225 populate_metadata read hostname 'smithi069' 2024-05-14T15:21:10.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.200+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/1385934098 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55bb05a207b0 0x55bb05a21c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:10.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.200+0000 7fb78aa3fb80 4 client.15225 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T15:21:10.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.200+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/1385934098 --> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] -- command(tid 0: {"prefix": "status"}) -- 0x55bb058c83b0 con 0x55bb05a207b0 2024-05-14T15:21:10.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.201+0000 7fb779400700 1 --2- 172.21.15.69:0/1385934098 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55bb05a207b0 0x55bb05a21c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.202+0000 7fb779400700 1 --2- 172.21.15.69:0/1385934098 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55bb05a207b0 0x55bb05a21c20 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=dc7e3dd6d62657cf server_cookie=bdc607d6b1441900 in_seq=0 out_seq=0 2024-05-14T15:21:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.202+0000 7fb75b400700 10 client.15225 ms_handle_connect on v2:172.21.15.203:6838/3167469844 2024-05-14T15:21:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.203+0000 7fb75b400700 1 -- 172.21.15.69:0/1385934098 <== mds.4 v2:172.21.15.203:6838/3167469844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55bb058c83b0 con 0x55bb05a207b0 2024-05-14T15:21:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.203+0000 7fb75b400700 10 client.15225 handle_command_reply: tid=0 2024-05-14T15:21:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.203+0000 7fb78aa3fb80 1 client.15225 shutdown 2024-05-14T15:21:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.203+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/1385934098 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 msgr2=0x55bb059adf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.203+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/1385934098 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb059adf90 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb76c007c90 tx=0x7fb76c0a5460 comp rx=0 tx=0).stop 2024-05-14T15:21:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.203+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/1385934098 shutdown_connections 2024-05-14T15:21:10.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.203+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/1385934098 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55bb05a207b0 0x55bb05a21c20 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.203+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/1385934098 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb0599eba0 0x55bb059adf90 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.203+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/1385934098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb0581adf0 0x55bb059981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.203+0000 7fb78aa3fb80 1 --2- 172.21.15.69:0/1385934098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb05998c00 0x55bb059ada50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.203+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/1385934098 >> 172.21.15.69:0/1385934098 conn(0x55bb05859a30 msgr2=0x55bb05992e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:10.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.203+0000 7fb75b400700 0 client.15225 ms_handle_reset on v2:172.21.15.203:6838/3167469844 2024-05-14T15:21:10.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.203+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/1385934098 shutdown_connections 2024-05-14T15:21:10.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.203+0000 7fb78aa3fb80 1 -- 172.21.15.69:0/1385934098 wait complete. 2024-05-14T15:21:10.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.203+0000 7fb78aa3fb80 20 client.15225 trim_cache size 0 max 16384 2024-05-14T15:21:10.205 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:21:10.205 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "1cc2580e-1203-11ef-bc98-c7b262605968", 2024-05-14T15:21:10.205 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 4, 2024-05-14T15:21:10.206 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 24451, 2024-05-14T15:21:10.206 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-05-14T15:21:10.206 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-05-14T15:21:10.206 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-05-14T15:21:10.206 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 212.86719758699999, 2024-05-14T15:21:10.206 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 29, 2024-05-14T15:21:10.206 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 91, 2024-05-14T15:21:10.206 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 89, 2024-05-14T15:21:10.206 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 332.60617310100002 2024-05-14T15:21:10.206 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:21:10.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.204+0000 7fb77be00700 1 -- 172.21.15.69:0/39043001 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb75c0b2900 msgr2=0x7fb75c0b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:10.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.204+0000 7fb77be00700 1 --2- 172.21.15.69:0/39043001 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb75c0b2900 0x7fb75c0b4e10 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fb760005950 tx=0x7fb760013920 comp rx=0 tx=0).stop 2024-05-14T15:21:10.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.204+0000 7fb77be00700 1 -- 172.21.15.69:0/39043001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb774110970 msgr2=0x7fb7741a5b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:10.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.204+0000 7fb77be00700 1 --2- 172.21.15.69:0/39043001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb774110970 0x7fb7741a5b40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fb76c007d70 tx=0x7fb76c00a340 comp rx=0 tx=0).stop 2024-05-14T15:21:10.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.204+0000 7fb77be00700 1 -- 172.21.15.69:0/39043001 shutdown_connections 2024-05-14T15:21:10.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.204+0000 7fb77be00700 1 --2- 172.21.15.69:0/39043001 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb774110970 0x7fb7741a5b40 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.204+0000 7fb77be00700 1 --2- 172.21.15.69:0/39043001 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fb75c0b2900 0x7fb75c0b4e10 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.204+0000 7fb77be00700 1 --2- 172.21.15.69:0/39043001 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77410a990 0x7fb7741a1310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.204+0000 7fb77be00700 1 --2- 172.21.15.69:0/39043001 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77410b2e0 0x7fb7741a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:10.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.204+0000 7fb77be00700 1 -- 172.21.15.69:0/39043001 >> 172.21.15.69:0/39043001 conn(0x7fb774077c80 msgr2=0x7fb77407bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:10.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.204+0000 7fb77be00700 1 -- 172.21.15.69:0/39043001 shutdown_connections 2024-05-14T15:21:10.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:10.204+0000 7fb77be00700 1 -- 172.21.15.69:0/39043001 wait complete. 2024-05-14T15:21:10.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:10 smithi069 ceph-mon[31270]: pgmap v545: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:21:11.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:10 smithi203 ceph-mon[34567]: pgmap v545: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:21:11.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:10 smithi092 ceph-mon[34729]: pgmap v545: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:21:11.221 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.k status 2024-05-14T15:21:11.659 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:21:12.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:12 smithi069 ceph-mon[31270]: pgmap v546: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:21:13.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:12 smithi092 ceph-mon[34729]: pgmap v546: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:21:13.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:12 smithi203 ceph-mon[34567]: pgmap v546: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:21:14.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.060+0000 7ff755a00700 1 -- 172.21.15.69:0/2474290048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff75010c5c0 msgr2=0x7ff75010c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:14.061 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.060+0000 7ff755a00700 1 --2- 172.21.15.69:0/2474290048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff75010c5c0 0x7ff75010c9d0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7ff740009990 tx=0x7ff740009ca0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.061+0000 7ff755a00700 1 -- 172.21.15.69:0/2474290048 shutdown_connections 2024-05-14T15:21:14.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.061+0000 7ff755a00700 1 --2- 172.21.15.69:0/2474290048 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff75010c5c0 0x7ff75010c9d0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.061+0000 7ff755a00700 1 --2- 172.21.15.69:0/2474290048 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff750106ed0 0x7ff750113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.061+0000 7ff755a00700 1 --2- 172.21.15.69:0/2474290048 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff750106580 0x7ff750106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.061+0000 7ff755a00700 1 -- 172.21.15.69:0/2474290048 >> 172.21.15.69:0/2474290048 conn(0x7ff750102080 msgr2=0x7ff7501044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:14.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.061+0000 7ff755a00700 1 -- 172.21.15.69:0/2474290048 shutdown_connections 2024-05-14T15:21:14.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.061+0000 7ff755a00700 1 -- 172.21.15.69:0/2474290048 wait complete. 2024-05-14T15:21:14.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.062+0000 7ff755a00700 1 Processor -- start 2024-05-14T15:21:14.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.062+0000 7ff755a00700 1 -- start start 2024-05-14T15:21:14.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff755a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff750106580 0x7ff75019cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff755a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff750106ed0 0x7ff75019d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff755a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff75010c5c0 0x7ff7501a1810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff755a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff7501165f0 con 0x7ff750106580 2024-05-14T15:21:14.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff755a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff750116470 con 0x7ff75010c5c0 2024-05-14T15:21:14.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff755a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff750116770 con 0x7ff750106ed0 2024-05-14T15:21:14.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff74ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff750106580 0x7ff75019cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff74ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff750106580 0x7ff75019cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58776/0 (socket says 172.21.15.69:58776) 2024-05-14T15:21:14.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff74ea00700 1 -- 172.21.15.69:0/884320002 learned_addr learned my addr 172.21.15.69:0/884320002 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:14.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff74e000700 1 --2- 172.21.15.69:0/884320002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff750106ed0 0x7ff75019d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff74ea00700 1 -- 172.21.15.69:0/884320002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff750106ed0 msgr2=0x7ff75019d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:14.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff74ea00700 1 --2- 172.21.15.69:0/884320002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff750106ed0 0x7ff75019d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff74f400700 1 --2- 172.21.15.69:0/884320002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff75010c5c0 0x7ff7501a1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff74ea00700 1 -- 172.21.15.69:0/884320002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff75010c5c0 msgr2=0x7ff7501a1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:14.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff74ea00700 1 --2- 172.21.15.69:0/884320002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff75010c5c0 0x7ff7501a1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff74ea00700 1 -- 172.21.15.69:0/884320002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7501a1e00 con 0x7ff750106580 2024-05-14T15:21:14.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.063+0000 7ff74e000700 1 --2- 172.21.15.69:0/884320002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff750106ed0 0x7ff75019d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:14.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.064+0000 7ff74f400700 1 --2- 172.21.15.69:0/884320002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff75010c5c0 0x7ff7501a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:14.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.064+0000 7ff74ea00700 1 --2- 172.21.15.69:0/884320002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff750106580 0x7ff75019cfe0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff74000b5c0 tx=0x7ff7400047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:14.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.064+0000 7ff747400700 1 -- 172.21.15.69:0/884320002 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740004830 con 0x7ff750106580 2024-05-14T15:21:14.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.064+0000 7ff755a00700 1 -- 172.21.15.69:0/884320002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7501a2090 con 0x7ff750106580 2024-05-14T15:21:14.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.064+0000 7ff747400700 1 -- 172.21.15.69:0/884320002 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff740005020 con 0x7ff750106580 2024-05-14T15:21:14.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.064+0000 7ff747400700 1 -- 172.21.15.69:0/884320002 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff74000f950 con 0x7ff750106580 2024-05-14T15:21:14.066 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.064+0000 7ff755a00700 1 -- 172.21.15.69:0/884320002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7501a2510 con 0x7ff750106580 2024-05-14T15:21:14.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.068+0000 7ff747400700 1 -- 172.21.15.69:0/884320002 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7ff7400049d0 con 0x7ff750106580 2024-05-14T15:21:14.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.069+0000 7ff7645b0b80 1 Processor -- start 2024-05-14T15:21:14.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.069+0000 7ff7645b0b80 1 -- start start 2024-05-14T15:21:14.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.070+0000 7ff747400700 1 --2- 172.21.15.69:0/884320002 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff7340b2880 0x7ff7340b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.070+0000 7ff7645b0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 0x55805fb31660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.070+0000 7ff7645b0b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb2b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.070+0000 7ff7645b0b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb2c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.070+0000 7ff7645b0b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55805fa4d9d0 con 0x55805fb31ba0 2024-05-14T15:21:14.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.070+0000 7ff7645b0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55805f9eb710 con 0x55805f9addf0 2024-05-14T15:21:14.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.070+0000 7ff7645b0b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55805fa49990 con 0x55805fb2bc00 2024-05-14T15:21:14.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.070+0000 7ff747400700 1 -- 172.21.15.69:0/884320002 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7ff7400e3460 con 0x7ff750106580 2024-05-14T15:21:14.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.070+0000 7ff74f400700 1 --2- 172.21.15.69:0/884320002 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff7340b2880 0x7ff7340b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.070+0000 7ff74e000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb2b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.070+0000 7ff74e000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb2b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58784/0 (socket says 172.21.15.69:58784) 2024-05-14T15:21:14.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.071+0000 7ff74e000700 1 -- 172.21.15.69:0/1232291458 learned_addr learned my addr 172.21.15.69:0/1232291458 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:14.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.071+0000 7ff74ea00700 1 --2- 172.21.15.69:0/1232291458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 0x55805fb31660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.071+0000 7ff74f400700 1 --2- 172.21.15.69:0/1232291458 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb2c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.071+0000 7ff74e000700 1 -- 172.21.15.69:0/1232291458 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 msgr2=0x55805fb2c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:14.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.071+0000 7ff74e000700 1 --2- 172.21.15.69:0/1232291458 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb2c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.071+0000 7ff74e000700 1 -- 172.21.15.69:0/1232291458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 msgr2=0x55805fb31660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:14.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.071+0000 7ff74e000700 1 --2- 172.21.15.69:0/1232291458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 0x55805fb31660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.071+0000 7ff74e000700 1 -- 172.21.15.69:0/1232291458 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55805f99a880 con 0x55805fb31ba0 2024-05-14T15:21:14.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.071+0000 7ff74ea00700 1 --2- 172.21.15.69:0/1232291458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 0x55805fb31660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:21:14.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.072+0000 7ff74f400700 1 --2- 172.21.15.69:0/884320002 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff7340b2880 0x7ff7340b4d90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff748011750 tx=0x7ff748011b10 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:14.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.072+0000 7ff74e000700 1 --2- 172.21.15.69:0/1232291458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb2b6c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009c40 tx=0x7ff73c009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d321fcfa6c4ab8f8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:14.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.072+0000 7ff73be00700 1 -- 172.21.15.69:0/1232291458 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c016070 con 0x55805fb31ba0 2024-05-14T15:21:14.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.072+0000 7ff73be00700 1 -- 172.21.15.69:0/1232291458 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff73c011470 con 0x55805fb31ba0 2024-05-14T15:21:14.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.072+0000 7ff73be00700 1 -- 172.21.15.69:0/1232291458 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff73c0105d0 con 0x55805fb31ba0 2024-05-14T15:21:14.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.073+0000 7ff7645b0b80 1 -- 172.21.15.69:0/1232291458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 msgr2=0x55805fb2b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:14.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.073+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/1232291458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb2b6c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7ff73c009c40 tx=0x7ff73c009f50 comp rx=0 tx=0).stop 2024-05-14T15:21:14.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.073+0000 7ff7645b0b80 1 -- 172.21.15.69:0/1232291458 shutdown_connections 2024-05-14T15:21:14.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.073+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/1232291458 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb2c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.073+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/1232291458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 0x55805fb31660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.073+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/1232291458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb2b6c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.073+0000 7ff7645b0b80 1 -- 172.21.15.69:0/1232291458 >> 172.21.15.69:0/1232291458 conn(0x55805f9eca30 msgr2=0x55805fb26740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:14.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.073+0000 7ff7645b0b80 1 -- 172.21.15.69:0/1232291458 shutdown_connections 2024-05-14T15:21:14.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.073+0000 7ff7645b0b80 1 -- 172.21.15.69:0/1232291458 wait complete. 2024-05-14T15:21:14.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.074+0000 7ff7645b0b80 1 -- start start 2024-05-14T15:21:14.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.074+0000 7ff7645b0b80 1 Processor -- start 2024-05-14T15:21:14.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.075+0000 7ff7645b0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 0x55805fb352b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.075+0000 7ff7645b0b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb357f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.075+0000 7ff7645b0b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb35d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.075+0000 7ff7645b0b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55805fb38670 con 0x55805fb31ba0 2024-05-14T15:21:14.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.075+0000 7ff7645b0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55805f9b3ad0 con 0x55805f9addf0 2024-05-14T15:21:14.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.075+0000 7ff7645b0b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55805fb387f0 con 0x55805fb2bc00 2024-05-14T15:21:14.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.075+0000 7ff7645b0b80 10 client.0 _ll_register_callbacks cb 0x55805f9e1330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:21:14.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.075+0000 7ff74f400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb35d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.075+0000 7ff74f400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb35d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58798/0 (socket says 172.21.15.69:58798) 2024-05-14T15:21:14.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.075+0000 7ff74f400700 1 -- 172.21.15.69:0/1221211103 learned_addr learned my addr 172.21.15.69:0/1221211103 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:14.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.076+0000 7ff74ea00700 1 --2- 172.21.15.69:0/1221211103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 0x55805fb352b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.076+0000 7ff74e000700 1 --2- 172.21.15.69:0/1221211103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb357f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.076+0000 7ff74f400700 1 -- 172.21.15.69:0/1221211103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 msgr2=0x55805fb357f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:14.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.076+0000 7ff74f400700 1 --2- 172.21.15.69:0/1221211103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb357f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.076+0000 7ff74f400700 1 -- 172.21.15.69:0/1221211103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 msgr2=0x55805fb352b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:14.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.076+0000 7ff74f400700 1 --2- 172.21.15.69:0/1221211103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 0x55805fb352b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.076+0000 7ff74f400700 1 -- 172.21.15.69:0/1221211103 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55805fa133d0 con 0x55805fb31ba0 2024-05-14T15:21:14.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.076+0000 7ff74e000700 1 --2- 172.21.15.69:0/1221211103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb357f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:21:14.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.076+0000 7ff74f400700 1 --2- 172.21.15.69:0/1221211103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb35d30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff748014e80 tx=0x7ff748004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b515d286830f478 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:14.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.076+0000 7ff738c00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:21:14.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.076+0000 7ff738c00700 1 -- 172.21.15.69:0/1221211103 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff748025070 con 0x55805fb31ba0 2024-05-14T15:21:14.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.077+0000 7ff7645b0b80 1 -- 172.21.15.69:0/1221211103 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff73c011470 con 0x55805fb31ba0 2024-05-14T15:21:14.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.077+0000 7ff738c00700 1 -- 172.21.15.69:0/1221211103 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7ff7480215f0 con 0x55805fb31ba0 2024-05-14T15:21:14.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.077+0000 7ff738c00700 1 -- 172.21.15.69:0/1221211103 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff748031050 con 0x55805fb31ba0 2024-05-14T15:21:14.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.077+0000 7ff7645b0b80 10 client.15237 fetch_fsmap learned FSMap version 29 2024-05-14T15:21:14.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.077+0000 7ff7645b0b80 1 -- 172.21.15.69:0/1221211103 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55805fb431e0 con 0x55805fb31ba0 2024-05-14T15:21:14.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.077+0000 7ff738c00700 1 -- 172.21.15.69:0/1221211103 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff73c011470 con 0x55805fb31ba0 2024-05-14T15:21:14.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.077+0000 7ff738c00700 1 -- 172.21.15.69:0/1221211103 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff748020070 con 0x55805fb31ba0 2024-05-14T15:21:14.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.077+0000 7ff7645b0b80 10 client.15237 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:21:14.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.078+0000 7ff7645b0b80 10 client.15237 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-14T15:21:14.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.078+0000 7ff7645b0b80 20 client.15237 populate_metadata read hostname 'smithi069' 2024-05-14T15:21:14.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.078+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/1221211103 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55805fb458e0 0x55805fb46d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.078+0000 7ff7645b0b80 4 client.15237 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:21:14.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.078+0000 7ff7645b0b80 1 -- 172.21.15.69:0/1221211103 --> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55805faf8020 con 0x55805fb458e0 2024-05-14T15:21:14.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.078+0000 7ff74ea00700 1 --2- 172.21.15.69:0/1221211103 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55805fb458e0 0x55805fb46d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.079+0000 7ff738c00700 10 client.15237 ms_handle_connect on v2:172.21.15.92:6832/1997000798 2024-05-14T15:21:14.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.079+0000 7ff74ea00700 1 --2- 172.21.15.69:0/1221211103 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55805fb458e0 0x55805fb46d50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=41b5e70313ce23d server_cookie=69bc97a2121f3b2 in_seq=0 out_seq=0 2024-05-14T15:21:14.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.081+0000 7ff738c00700 1 -- 172.21.15.69:0/1221211103 <== mds.3 v2:172.21.15.92:6832/1997000798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55805faf8020 con 0x55805fb458e0 2024-05-14T15:21:14.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.081+0000 7ff738c00700 10 client.15237 handle_command_reply: tid=0 2024-05-14T15:21:14.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.081+0000 7ff7645b0b80 1 client.15237 shutdown 2024-05-14T15:21:14.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.081+0000 7ff7645b0b80 1 -- 172.21.15.69:0/1221211103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 msgr2=0x55805fb35d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:14.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.081+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/1221211103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb35d30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7ff748014e80 tx=0x7ff748004b40 comp rx=0 tx=0).stop 2024-05-14T15:21:14.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.082+0000 7ff7645b0b80 1 -- 172.21.15.69:0/1221211103 shutdown_connections 2024-05-14T15:21:14.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.082+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/1221211103 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55805fb458e0 0x55805fb46d50 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.082+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/1221211103 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb35d30 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.082+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/1221211103 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 0x55805fb352b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.082+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/1221211103 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb357f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.082+0000 7ff738c00700 0 client.15237 ms_handle_reset on v2:172.21.15.92:6832/1997000798 2024-05-14T15:21:14.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.082+0000 7ff7645b0b80 1 -- 172.21.15.69:0/1221211103 >> 172.21.15.69:0/1221211103 conn(0x55805f9eca30 msgr2=0x55805fb2a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:14.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.082+0000 7ff7645b0b80 1 -- 172.21.15.69:0/1221211103 shutdown_connections 2024-05-14T15:21:14.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.082+0000 7ff7645b0b80 1 -- 172.21.15.69:0/1221211103 wait complete. 2024-05-14T15:21:14.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.082+0000 7ff7645b0b80 20 client.15237 trim_cache size 0 max 16384 2024-05-14T15:21:14.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.105+0000 7ff7645b0b80 1 Processor -- start 2024-05-14T15:21:14.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.105+0000 7ff7645b0b80 1 -- start start 2024-05-14T15:21:14.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.105+0000 7ff7645b0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 0x55805fb2b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.105+0000 7ff7645b0b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb41ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.105+0000 7ff7645b0b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb35b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.105+0000 7ff7645b0b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55805fb45090 con 0x55805fb31ba0 2024-05-14T15:21:14.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.105+0000 7ff7645b0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55805fb45760 con 0x55805f9addf0 2024-05-14T15:21:14.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.105+0000 7ff7645b0b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55805fb45e30 con 0x55805fb2bc00 2024-05-14T15:21:14.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.106+0000 7ff74f400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb35b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.106+0000 7ff74f400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb35b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58808/0 (socket says 172.21.15.69:58808) 2024-05-14T15:21:14.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.106+0000 7ff74f400700 1 -- 172.21.15.69:0/4108152071 learned_addr learned my addr 172.21.15.69:0/4108152071 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:14.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.106+0000 7ff74ea00700 1 --2- 172.21.15.69:0/4108152071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 0x55805fb2b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.106+0000 7ff74e000700 1 --2- 172.21.15.69:0/4108152071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb41ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.106+0000 7ff74f400700 1 -- 172.21.15.69:0/4108152071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 msgr2=0x55805fb41ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:14.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.106+0000 7ff74f400700 1 --2- 172.21.15.69:0/4108152071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb41ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.106+0000 7ff74f400700 1 -- 172.21.15.69:0/4108152071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 msgr2=0x55805fb2b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:14.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.106+0000 7ff74f400700 1 --2- 172.21.15.69:0/4108152071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 0x55805fb2b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.106+0000 7ff74f400700 1 -- 172.21.15.69:0/4108152071 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55805fb1e5f0 con 0x55805fb31ba0 2024-05-14T15:21:14.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.106+0000 7ff74ea00700 1 --2- 172.21.15.69:0/4108152071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 0x55805fb2b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:14.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.106+0000 7ff74e000700 1 --2- 172.21.15.69:0/4108152071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb41ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:14.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.106+0000 7ff74f400700 1 --2- 172.21.15.69:0/4108152071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb35b70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff748000f80 tx=0x7ff748007a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce56198b33f8e751 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:14.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.107+0000 7ff73b400700 1 -- 172.21.15.69:0/4108152071 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff748025070 con 0x55805fb31ba0 2024-05-14T15:21:14.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.107+0000 7ff73b400700 1 -- 172.21.15.69:0/4108152071 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff74801b070 con 0x55805fb31ba0 2024-05-14T15:21:14.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.107+0000 7ff73b400700 1 -- 172.21.15.69:0/4108152071 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff748010040 con 0x55805fb31ba0 2024-05-14T15:21:14.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.108+0000 7ff7645b0b80 1 -- 172.21.15.69:0/4108152071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 msgr2=0x55805fb35b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:14.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.108+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/4108152071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb35b70 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff748000f80 tx=0x7ff748007a20 comp rx=0 tx=0).stop 2024-05-14T15:21:14.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.108+0000 7ff7645b0b80 1 -- 172.21.15.69:0/4108152071 shutdown_connections 2024-05-14T15:21:14.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.108+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/4108152071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805fb31ba0 0x55805fb35b70 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.108+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/4108152071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805f9addf0 0x55805fb2b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.108+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/4108152071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb41ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.108+0000 7ff7645b0b80 1 -- 172.21.15.69:0/4108152071 >> 172.21.15.69:0/4108152071 conn(0x55805f9eca30 msgr2=0x55805fb30a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:14.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.108+0000 7ff7645b0b80 1 -- 172.21.15.69:0/4108152071 shutdown_connections 2024-05-14T15:21:14.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.108+0000 7ff7645b0b80 1 -- 172.21.15.69:0/4108152071 wait complete. 2024-05-14T15:21:14.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.108+0000 7ff7645b0b80 1 -- start start 2024-05-14T15:21:14.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.109+0000 7ff7645b0b80 1 Processor -- start 2024-05-14T15:21:14.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.109+0000 7ff7645b0b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805f9addf0 0x55805fb503c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.109+0000 7ff7645b0b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb49750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.109+0000 7ff7645b0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805fb31ba0 0x55805fb49c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.109+0000 7ff7645b0b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55805fb46bd0 con 0x55805f9addf0 2024-05-14T15:21:14.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.109+0000 7ff7645b0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55805fb46500 con 0x55805fb31ba0 2024-05-14T15:21:14.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.109+0000 7ff7645b0b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55805fb472a0 con 0x55805fb2bc00 2024-05-14T15:21:14.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.109+0000 7ff7645b0b80 10 client.0 _ll_register_callbacks cb 0x55805f9e1330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:21:14.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.109+0000 7ff74ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805f9addf0 0x55805fb503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.109+0000 7ff74ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805f9addf0 0x55805fb503c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58810/0 (socket says 172.21.15.69:58810) 2024-05-14T15:21:14.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.109+0000 7ff74ea00700 1 -- 172.21.15.69:0/4027201974 learned_addr learned my addr 172.21.15.69:0/4027201974 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:14.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.110+0000 7ff74e000700 1 --2- 172.21.15.69:0/4027201974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb49750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.110+0000 7ff74ea00700 1 -- 172.21.15.69:0/4027201974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 msgr2=0x55805fb49750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:14.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.110+0000 7ff74ea00700 1 --2- 172.21.15.69:0/4027201974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb49750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.110+0000 7ff74ea00700 1 -- 172.21.15.69:0/4027201974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805fb31ba0 msgr2=0x55805fb49c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:14.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.110+0000 7ff74ea00700 1 --2- 172.21.15.69:0/4027201974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805fb31ba0 0x55805fb49c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.110+0000 7ff74ea00700 1 -- 172.21.15.69:0/4027201974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55805fb4a1d0 con 0x55805f9addf0 2024-05-14T15:21:14.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.110+0000 7ff74ea00700 1 --2- 172.21.15.69:0/4027201974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805f9addf0 0x55805fb503c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff7400aa440 tx=0x7ff7400b1040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8956c9d59c60f0a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:14.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.110+0000 7ff738c00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:21:14.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.110+0000 7ff738c00700 1 -- 172.21.15.69:0/4027201974 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7400a4e60 con 0x55805f9addf0 2024-05-14T15:21:14.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.110+0000 7ff738c00700 1 -- 172.21.15.69:0/4027201974 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7ff7400054d0 con 0x55805f9addf0 2024-05-14T15:21:14.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.110+0000 7ff7645b0b80 1 -- 172.21.15.69:0/4027201974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff74801b070 con 0x55805f9addf0 2024-05-14T15:21:14.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.110+0000 7ff738c00700 1 -- 172.21.15.69:0/4027201974 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7ff7400095c0 con 0x55805f9addf0 2024-05-14T15:21:14.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.111+0000 7ff7645b0b80 10 client.15243 fetch_fsmap learned FSMap version 29 2024-05-14T15:21:14.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.111+0000 7ff7645b0b80 1 -- 172.21.15.69:0/4027201974 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55805fb4ea10 con 0x55805f9addf0 2024-05-14T15:21:14.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.111+0000 7ff738c00700 1 -- 172.21.15.69:0/4027201974 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff74801b070 con 0x55805f9addf0 2024-05-14T15:21:14.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.111+0000 7ff738c00700 1 -- 172.21.15.69:0/4027201974 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7ff7400aa9a0 con 0x55805f9addf0 2024-05-14T15:21:14.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.111+0000 7ff7645b0b80 10 client.15243 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:21:14.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.111+0000 7ff7645b0b80 10 client.15243 resolve_mds: resolved name 'k' to daemon mds.k 2024-05-14T15:21:14.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.111+0000 7ff7645b0b80 20 client.15243 populate_metadata read hostname 'smithi069' 2024-05-14T15:21:14.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.111+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/4027201974 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55805fbb2e20 0x55805fbb4290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:14.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.111+0000 7ff7645b0b80 4 client.15243 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T15:21:14.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.111+0000 7ff7645b0b80 1 -- 172.21.15.69:0/4027201974 --> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] -- command(tid 0: {"prefix": "status"}) -- 0x55805fa5b3b0 con 0x55805fbb2e20 2024-05-14T15:21:14.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.112+0000 7ff74e000700 1 --2- 172.21.15.69:0/4027201974 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55805fbb2e20 0x55805fbb4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:14.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.113+0000 7ff74e000700 1 --2- 172.21.15.69:0/4027201974 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55805fbb2e20 0x55805fbb4290 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=17f81406dff5b943 server_cookie=40fbe996b15ad242 in_seq=0 out_seq=0 2024-05-14T15:21:14.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.113+0000 7ff738c00700 10 client.15243 ms_handle_connect on v2:172.21.15.92:6832/1997000798 2024-05-14T15:21:14.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.113+0000 7ff738c00700 1 -- 172.21.15.69:0/4027201974 <== mds.3 v2:172.21.15.92:6832/1997000798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55805fa5b3b0 con 0x55805fbb2e20 2024-05-14T15:21:14.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.113+0000 7ff738c00700 10 client.15243 handle_command_reply: tid=0 2024-05-14T15:21:14.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.113+0000 7ff7645b0b80 1 client.15243 shutdown 2024-05-14T15:21:14.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.114+0000 7ff7645b0b80 1 -- 172.21.15.69:0/4027201974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805f9addf0 msgr2=0x55805fb503c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:14.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.114+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/4027201974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805f9addf0 0x55805fb503c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff7400aa440 tx=0x7ff7400b1040 comp rx=0 tx=0).stop 2024-05-14T15:21:14.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.114+0000 7ff7645b0b80 1 -- 172.21.15.69:0/4027201974 shutdown_connections 2024-05-14T15:21:14.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.114+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/4027201974 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55805fbb2e20 0x55805fbb4290 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.114+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/4027201974 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55805f9addf0 0x55805fb503c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.114+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/4027201974 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55805fb31ba0 0x55805fb49c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.114+0000 7ff7645b0b80 1 --2- 172.21.15.69:0/4027201974 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55805fb2bc00 0x55805fb49750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.114+0000 7ff738c00700 0 client.15243 ms_handle_reset on v2:172.21.15.92:6832/1997000798 2024-05-14T15:21:14.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.114+0000 7ff7645b0b80 1 -- 172.21.15.69:0/4027201974 >> 172.21.15.69:0/4027201974 conn(0x55805f9eca30 msgr2=0x55805fb35bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:14.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.114+0000 7ff7645b0b80 1 -- 172.21.15.69:0/4027201974 shutdown_connections 2024-05-14T15:21:14.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.114+0000 7ff7645b0b80 1 -- 172.21.15.69:0/4027201974 wait complete. 2024-05-14T15:21:14.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.114+0000 7ff7645b0b80 20 client.15243 trim_cache size 0 max 16384 2024-05-14T15:21:14.116 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:21:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "1cc2580e-1203-11ef-bc98-c7b262605968", 2024-05-14T15:21:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 3, 2024-05-14T15:21:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 34409, 2024-05-14T15:21:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-05-14T15:21:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-05-14T15:21:14.116 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-05-14T15:21:14.117 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 217.79792742399999, 2024-05-14T15:21:14.117 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 29, 2024-05-14T15:21:14.117 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 91, 2024-05-14T15:21:14.117 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 89, 2024-05-14T15:21:14.117 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 368.01725267400002 2024-05-14T15:21:14.117 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:21:14.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.115+0000 7ff755a00700 1 -- 172.21.15.69:0/884320002 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff7340b2880 msgr2=0x7ff7340b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:14.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.115+0000 7ff755a00700 1 --2- 172.21.15.69:0/884320002 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff7340b2880 0x7ff7340b4d90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7ff748011750 tx=0x7ff748011b10 comp rx=0 tx=0).stop 2024-05-14T15:21:14.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.115+0000 7ff755a00700 1 -- 172.21.15.69:0/884320002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff750106580 msgr2=0x7ff75019cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:14.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.115+0000 7ff755a00700 1 --2- 172.21.15.69:0/884320002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff750106580 0x7ff75019cfe0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7ff74000b5c0 tx=0x7ff7400047b0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.115+0000 7ff755a00700 1 -- 172.21.15.69:0/884320002 shutdown_connections 2024-05-14T15:21:14.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.115+0000 7ff755a00700 1 --2- 172.21.15.69:0/884320002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff750106580 0x7ff75019cfe0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.115+0000 7ff755a00700 1 --2- 172.21.15.69:0/884320002 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7ff7340b2880 0x7ff7340b4d90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.115+0000 7ff755a00700 1 --2- 172.21.15.69:0/884320002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff75010c5c0 0x7ff7501a1810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.115+0000 7ff755a00700 1 --2- 172.21.15.69:0/884320002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff750106ed0 0x7ff75019d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:14.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.115+0000 7ff755a00700 1 -- 172.21.15.69:0/884320002 >> 172.21.15.69:0/884320002 conn(0x7ff750102080 msgr2=0x7ff750104940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:14.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.115+0000 7ff755a00700 1 -- 172.21.15.69:0/884320002 shutdown_connections 2024-05-14T15:21:14.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:14.115+0000 7ff755a00700 1 -- 172.21.15.69:0/884320002 wait complete. 2024-05-14T15:21:14.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:14 smithi069 ceph-mon[31270]: pgmap v547: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:21:15.184 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.e status 2024-05-14T15:21:15.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:14 smithi092 ceph-mon[34729]: pgmap v547: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:21:15.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:14 smithi203 ceph-mon[34567]: pgmap v547: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:21:15.618 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:21:16.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:16 smithi069 ceph-mon[31270]: pgmap v548: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:21:17.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:16 smithi092 ceph-mon[34729]: pgmap v548: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:21:17.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:16 smithi203 ceph-mon[34567]: pgmap v548: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:21:18.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.154+0000 7fbe46200700 1 -- 172.21.15.69:0/1856896750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe40110970 msgr2=0x7fbe40110d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.154+0000 7fbe46200700 1 --2- 172.21.15.69:0/1856896750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe40110970 0x7fbe40110d80 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fbe30009990 tx=0x7fbe30009ca0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.154+0000 7fbe46200700 1 -- 172.21.15.69:0/1856896750 shutdown_connections 2024-05-14T15:21:18.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.154+0000 7fbe46200700 1 --2- 172.21.15.69:0/1856896750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe40110970 0x7fbe40110d80 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.154+0000 7fbe46200700 1 --2- 172.21.15.69:0/1856896750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe4010b2e0 0x7fbe40117810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.154+0000 7fbe46200700 1 --2- 172.21.15.69:0/1856896750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe4010a990 0x7fbe4010ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.154+0000 7fbe46200700 1 -- 172.21.15.69:0/1856896750 >> 172.21.15.69:0/1856896750 conn(0x7fbe40077c80 msgr2=0x7fbe400780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:18.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.154+0000 7fbe46200700 1 -- 172.21.15.69:0/1856896750 shutdown_connections 2024-05-14T15:21:18.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.154+0000 7fbe46200700 1 -- 172.21.15.69:0/1856896750 wait complete. 2024-05-14T15:21:18.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.155+0000 7fbe46200700 1 Processor -- start 2024-05-14T15:21:18.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.156+0000 7fbe46200700 1 -- start start 2024-05-14T15:21:18.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.156+0000 7fbe46200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe4010a990 0x7fbe401a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.156+0000 7fbe46200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe4010b2e0 0x7fbe401a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.156+0000 7fbe46200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe40110970 0x7fbe401a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.156+0000 7fbe46200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4011a920 con 0x7fbe4010a990 2024-05-14T15:21:18.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.156+0000 7fbe46200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4011a7a0 con 0x7fbe40110970 2024-05-14T15:21:18.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.156+0000 7fbe46200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbe4011aaa0 con 0x7fbe4010b2e0 2024-05-14T15:21:18.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.157+0000 7fbe3f400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe4010a990 0x7fbe401a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.157+0000 7fbe3f400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe4010a990 0x7fbe401a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58824/0 (socket says 172.21.15.69:58824) 2024-05-14T15:21:18.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.157+0000 7fbe3f400700 1 -- 172.21.15.69:0/3195854146 learned_addr learned my addr 172.21.15.69:0/3195854146 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:18.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.157+0000 7fbe36a00700 1 --2- 172.21.15.69:0/3195854146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe4010b2e0 0x7fbe401a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.157+0000 7fbe3fe00700 1 --2- 172.21.15.69:0/3195854146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe40110970 0x7fbe401a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.157+0000 7fbe3f400700 1 -- 172.21.15.69:0/3195854146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe4010b2e0 msgr2=0x7fbe401a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.157+0000 7fbe3f400700 1 --2- 172.21.15.69:0/3195854146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe4010b2e0 0x7fbe401a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.157+0000 7fbe3f400700 1 -- 172.21.15.69:0/3195854146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe40110970 msgr2=0x7fbe401a5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.157+0000 7fbe3f400700 1 --2- 172.21.15.69:0/3195854146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe40110970 0x7fbe401a5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.157+0000 7fbe3f400700 1 -- 172.21.15.69:0/3195854146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe401a6130 con 0x7fbe4010a990 2024-05-14T15:21:18.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.158+0000 7fbe3f400700 1 --2- 172.21.15.69:0/3195854146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe4010a990 0x7fbe401a1310 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbe30000c00 tx=0x7fbe30009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:18.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.158+0000 7fbe3cc00700 1 -- 172.21.15.69:0/3195854146 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe30027070 con 0x7fbe4010a990 2024-05-14T15:21:18.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.158+0000 7fbe3cc00700 1 -- 172.21.15.69:0/3195854146 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe3000fe20 con 0x7fbe4010a990 2024-05-14T15:21:18.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.158+0000 7fbe3cc00700 1 -- 172.21.15.69:0/3195854146 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe30022d00 con 0x7fbe4010a990 2024-05-14T15:21:18.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.158+0000 7fbe46200700 1 -- 172.21.15.69:0/3195854146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe401a63c0 con 0x7fbe4010a990 2024-05-14T15:21:18.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.158+0000 7fbe46200700 1 -- 172.21.15.69:0/3195854146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe401a6850 con 0x7fbe4010a990 2024-05-14T15:21:18.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.162+0000 7fbe3cc00700 1 -- 172.21.15.69:0/3195854146 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7fbe3002a070 con 0x7fbe4010a990 2024-05-14T15:21:18.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.164+0000 7fbe54dc5b80 1 Processor -- start 2024-05-14T15:21:18.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.164+0000 7fbe3cc00700 1 --2- 172.21.15.69:0/3195854146 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbe240b2900 0x7fbe240b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.164+0000 7fbe54dc5b80 1 -- start start 2024-05-14T15:21:18.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.164+0000 7fbe3cc00700 1 -- 172.21.15.69:0/3195854146 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fbe300e35a0 con 0x7fbe4010a990 2024-05-14T15:21:18.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.164+0000 7fbe3fe00700 1 --2- 172.21.15.69:0/3195854146 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbe240b2900 0x7fbe240b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.164+0000 7fbe54dc5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70ac2df0 0x560e70c462a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.164+0000 7fbe54dc5b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c40460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.164+0000 7fbe54dc5b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c40db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.164+0000 7fbe54dc5b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560e70b629d0 con 0x560e70c467e0 2024-05-14T15:21:18.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.164+0000 7fbe54dc5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e70b00710 con 0x560e70ac2df0 2024-05-14T15:21:18.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.164+0000 7fbe54dc5b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560e70b5e990 con 0x560e70c409a0 2024-05-14T15:21:18.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.165+0000 7fbe36a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c40460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.165+0000 7fbe3f400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70ac2df0 0x560e70c462a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.165+0000 7fbe36a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c40460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58836/0 (socket says 172.21.15.69:58836) 2024-05-14T15:21:18.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.165+0000 7fbe36a00700 1 -- 172.21.15.69:0/1965449805 learned_addr learned my addr 172.21.15.69:0/1965449805 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:18.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.165+0000 7fbe3fe00700 1 --2- 172.21.15.69:0/3195854146 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbe240b2900 0x7fbe240b4e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800e1b0 tx=0x7fbe38009040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:18.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.165+0000 7fbe3fe00700 1 --2- 172.21.15.69:0/1965449805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c40db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.166+0000 7fbe36a00700 1 -- 172.21.15.69:0/1965449805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 msgr2=0x560e70c40db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:18.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.166+0000 7fbe36a00700 1 --2- 172.21.15.69:0/1965449805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c40db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.166+0000 7fbe36a00700 1 -- 172.21.15.69:0/1965449805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70ac2df0 msgr2=0x560e70c462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.166+0000 7fbe36a00700 1 --2- 172.21.15.69:0/1965449805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70ac2df0 0x560e70c462a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.166+0000 7fbe36a00700 1 -- 172.21.15.69:0/1965449805 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e70aaf880 con 0x560e70c467e0 2024-05-14T15:21:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.166+0000 7fbe3fe00700 1 --2- 172.21.15.69:0/1965449805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c40db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:21:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.166+0000 7fbe36a00700 1 --2- 172.21.15.69:0/1965449805 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c40460 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbe28008c00 tx=0x7fbe28008f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496ad2386274ffbd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.166+0000 7fbe34c00700 1 -- 172.21.15.69:0/1965449805 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe28014070 con 0x560e70c467e0 2024-05-14T15:21:18.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.166+0000 7fbe34c00700 1 -- 172.21.15.69:0/1965449805 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe28004cc0 con 0x560e70c467e0 2024-05-14T15:21:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.167+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1965449805 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 msgr2=0x560e70c40460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.167+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/1965449805 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c40460 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbe28008c00 tx=0x7fbe28008f10 comp rx=0 tx=0).stop 2024-05-14T15:21:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.168+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1965449805 shutdown_connections 2024-05-14T15:21:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.168+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/1965449805 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c40db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.168+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/1965449805 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70ac2df0 0x560e70c462a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.168+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/1965449805 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c40460 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.168+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1965449805 >> 172.21.15.69:0/1965449805 conn(0x560e70b07f20 msgr2=0x560e70c3b280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.168+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1965449805 shutdown_connections 2024-05-14T15:21:18.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.168+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1965449805 wait complete. 2024-05-14T15:21:18.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.168+0000 7fbe54dc5b80 1 -- start start 2024-05-14T15:21:18.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.169+0000 7fbe54dc5b80 1 Processor -- start 2024-05-14T15:21:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.169+0000 7fbe54dc5b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70ac2df0 0x560e70c4cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.169+0000 7fbe54dc5b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c49e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.169+0000 7fbe54dc5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70c467e0 0x560e70c4a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.169+0000 7fbe54dc5b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560e70c4d310 con 0x560e70ac2df0 2024-05-14T15:21:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.169+0000 7fbe54dc5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e70ac8ad0 con 0x560e70c467e0 2024-05-14T15:21:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.170+0000 7fbe54dc5b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560e70c4d490 con 0x560e70c409a0 2024-05-14T15:21:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.170+0000 7fbe54dc5b80 10 client.0 _ll_register_callbacks cb 0x560e70b09c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:21:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.170+0000 7fbe3f400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70ac2df0 0x560e70c4cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.170+0000 7fbe3f400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70ac2df0 0x560e70c4cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58838/0 (socket says 172.21.15.69:58838) 2024-05-14T15:21:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.170+0000 7fbe3f400700 1 -- 172.21.15.69:0/1912609365 learned_addr learned my addr 172.21.15.69:0/1912609365 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:18.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.170+0000 7fbe36a00700 1 --2- 172.21.15.69:0/1912609365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c49e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.170+0000 7fbe3f400700 1 -- 172.21.15.69:0/1912609365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 msgr2=0x560e70c49e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:18.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.170+0000 7fbe3f400700 1 --2- 172.21.15.69:0/1912609365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c49e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.170+0000 7fbe3fe00700 1 --2- 172.21.15.69:0/1912609365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70c467e0 0x560e70c4a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.170+0000 7fbe3f400700 1 -- 172.21.15.69:0/1912609365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70c467e0 msgr2=0x560e70c4a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:18.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.170+0000 7fbe3f400700 1 --2- 172.21.15.69:0/1912609365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70c467e0 0x560e70c4a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.170+0000 7fbe3f400700 1 -- 172.21.15.69:0/1912609365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e70b283d0 con 0x560e70ac2df0 2024-05-14T15:21:18.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.171+0000 7fbe3f400700 1 --2- 172.21.15.69:0/1912609365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70ac2df0 0x560e70c4cae0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbe300e0be0 tx=0x7fbe3000b540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b3214551d0f315 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:18.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.171+0000 7fbe2d600700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:21:18.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.171+0000 7fbe2d600700 1 -- 172.21.15.69:0/1912609365 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe300aa820 con 0x560e70ac2df0 2024-05-14T15:21:18.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.171+0000 7fbe2d600700 1 -- 172.21.15.69:0/1912609365 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fbe300aac90 con 0x560e70ac2df0 2024-05-14T15:21:18.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.171+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1912609365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe28004cc0 con 0x560e70ac2df0 2024-05-14T15:21:18.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.171+0000 7fbe2d600700 1 -- 172.21.15.69:0/1912609365 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbe300aebd0 con 0x560e70ac2df0 2024-05-14T15:21:18.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.171+0000 7fbe54dc5b80 10 client.15255 fetch_fsmap learned FSMap version 29 2024-05-14T15:21:18.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.171+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1912609365 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560e70c57db0 con 0x560e70ac2df0 2024-05-14T15:21:18.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.172+0000 7fbe2d600700 1 -- 172.21.15.69:0/1912609365 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe28004cc0 con 0x560e70ac2df0 2024-05-14T15:21:18.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.172+0000 7fbe2d600700 1 -- 172.21.15.69:0/1912609365 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbe300b3160 con 0x560e70ac2df0 2024-05-14T15:21:18.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.172+0000 7fbe54dc5b80 10 client.15255 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:21:18.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.172+0000 7fbe54dc5b80 10 client.15255 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-14T15:21:18.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.172+0000 7fbe54dc5b80 20 client.15255 populate_metadata read hostname 'smithi069' 2024-05-14T15:21:18.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.172+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/1912609365 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x560e70c5a450 0x560e70c5b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.172+0000 7fbe54dc5b80 4 client.15255 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:21:18.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.172+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1912609365 --> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e70c0d170 con 0x560e70c5a450 2024-05-14T15:21:18.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.173+0000 7fbe36a00700 1 --2- 172.21.15.69:0/1912609365 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x560e70c5a450 0x560e70c5b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.174+0000 7fbe36a00700 1 --2- 172.21.15.69:0/1912609365 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x560e70c5a450 0x560e70c5b8c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=52d65707a07f5a3c server_cookie=3147731dce90d9e in_seq=0 out_seq=0 2024-05-14T15:21:18.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.174+0000 7fbe2d600700 10 client.15255 ms_handle_connect on v2:172.21.15.92:6834/360295917 2024-05-14T15:21:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.176+0000 7fbe2d600700 1 -- 172.21.15.69:0/1912609365 <== mds.2 v2:172.21.15.92:6834/360295917 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560e70c0d170 con 0x560e70c5a450 2024-05-14T15:21:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.176+0000 7fbe2d600700 10 client.15255 handle_command_reply: tid=0 2024-05-14T15:21:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.176+0000 7fbe54dc5b80 1 client.15255 shutdown 2024-05-14T15:21:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.176+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1912609365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70ac2df0 msgr2=0x560e70c4cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.176+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/1912609365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70ac2df0 0x560e70c4cae0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fbe300e0be0 tx=0x7fbe3000b540 comp rx=0 tx=0).stop 2024-05-14T15:21:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.177+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1912609365 shutdown_connections 2024-05-14T15:21:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.177+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/1912609365 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70ac2df0 0x560e70c4cae0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.177+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/1912609365 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x560e70c5a450 0x560e70c5b8c0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.177+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/1912609365 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70c467e0 0x560e70c4a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.177+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/1912609365 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c49e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.177+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1912609365 >> 172.21.15.69:0/1912609365 conn(0x560e70b07f20 msgr2=0x560e70c3f450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.177+0000 7fbe2d600700 0 client.15255 ms_handle_reset on v2:172.21.15.92:6834/360295917 2024-05-14T15:21:18.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.177+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1912609365 shutdown_connections 2024-05-14T15:21:18.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.177+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1912609365 wait complete. 2024-05-14T15:21:18.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.177+0000 7fbe54dc5b80 20 client.15255 trim_cache size 0 max 16384 2024-05-14T15:21:18.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.200+0000 7fbe54dc5b80 1 Processor -- start 2024-05-14T15:21:18.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.200+0000 7fbe54dc5b80 1 -- start start 2024-05-14T15:21:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.201+0000 7fbe54dc5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70ac2df0 0x560e70c40460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.201+0000 7fbe54dc5b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c3ac80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.201+0000 7fbe54dc5b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c3b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.201+0000 7fbe54dc5b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560e70c59c00 con 0x560e70c467e0 2024-05-14T15:21:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.201+0000 7fbe54dc5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e70c5a2d0 con 0x560e70ac2df0 2024-05-14T15:21:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.201+0000 7fbe54dc5b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560e70c5a9a0 con 0x560e70c409a0 2024-05-14T15:21:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.201+0000 7fbe3fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c3b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.201+0000 7fbe3fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c3b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58846/0 (socket says 172.21.15.69:58846) 2024-05-14T15:21:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.201+0000 7fbe3fe00700 1 -- 172.21.15.69:0/445059416 learned_addr learned my addr 172.21.15.69:0/445059416 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.201+0000 7fbe3f400700 1 --2- 172.21.15.69:0/445059416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70ac2df0 0x560e70c40460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.202+0000 7fbe36a00700 1 --2- 172.21.15.69:0/445059416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c3ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.202+0000 7fbe3fe00700 1 -- 172.21.15.69:0/445059416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 msgr2=0x560e70c3ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.202+0000 7fbe3fe00700 1 --2- 172.21.15.69:0/445059416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c3ac80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.202+0000 7fbe3fe00700 1 -- 172.21.15.69:0/445059416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70ac2df0 msgr2=0x560e70c40460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.202+0000 7fbe3fe00700 1 --2- 172.21.15.69:0/445059416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70ac2df0 0x560e70c40460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.202+0000 7fbe3fe00700 1 -- 172.21.15.69:0/445059416 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e70c4c700 con 0x560e70c467e0 2024-05-14T15:21:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.202+0000 7fbe3fe00700 1 --2- 172.21.15.69:0/445059416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c3b1c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800eef0 tx=0x7fbe38013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca2ee8cb72b2cd34 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.202+0000 7fbe2fe00700 1 -- 172.21.15.69:0/445059416 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe38015db0 con 0x560e70c467e0 2024-05-14T15:21:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.202+0000 7fbe2fe00700 1 -- 172.21.15.69:0/445059416 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe38026070 con 0x560e70c467e0 2024-05-14T15:21:18.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.203+0000 7fbe2fe00700 1 -- 172.21.15.69:0/445059416 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe380133e0 con 0x560e70c467e0 2024-05-14T15:21:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.203+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/445059416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 msgr2=0x560e70c3b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.203+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/445059416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c3b1c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800eef0 tx=0x7fbe38013000 comp rx=0 tx=0).stop 2024-05-14T15:21:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.203+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/445059416 shutdown_connections 2024-05-14T15:21:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.203+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/445059416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c3b1c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.203+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/445059416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70ac2df0 0x560e70c40460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.203+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/445059416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c3ac80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.203+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/445059416 >> 172.21.15.69:0/445059416 conn(0x560e70b07f20 msgr2=0x560e70c48750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.204+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/445059416 shutdown_connections 2024-05-14T15:21:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.204+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/445059416 wait complete. 2024-05-14T15:21:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.204+0000 7fbe54dc5b80 1 -- start start 2024-05-14T15:21:18.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.204+0000 7fbe54dc5b80 1 Processor -- start 2024-05-14T15:21:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.205+0000 7fbe54dc5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70ac2df0 0x560e70c48540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.205+0000 7fbe54dc5b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c48a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.205+0000 7fbe54dc5b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c64300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.205+0000 7fbe54dc5b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560e70c5b740 con 0x560e70c467e0 2024-05-14T15:21:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.205+0000 7fbe54dc5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e70c5b070 con 0x560e70ac2df0 2024-05-14T15:21:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.205+0000 7fbe54dc5b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560e70c5be10 con 0x560e70c409a0 2024-05-14T15:21:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.205+0000 7fbe54dc5b80 10 client.0 _ll_register_callbacks cb 0x560e70b09c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:21:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.205+0000 7fbe3fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c64300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.205+0000 7fbe3fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c64300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58848/0 (socket says 172.21.15.69:58848) 2024-05-14T15:21:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.205+0000 7fbe3fe00700 1 -- 172.21.15.69:0/1432388783 learned_addr learned my addr 172.21.15.69:0/1432388783 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.206+0000 7fbe3f400700 1 --2- 172.21.15.69:0/1432388783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70ac2df0 0x560e70c48540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.206+0000 7fbe36a00700 1 --2- 172.21.15.69:0/1432388783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c48a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.206+0000 7fbe3fe00700 1 -- 172.21.15.69:0/1432388783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 msgr2=0x560e70c48a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.206+0000 7fbe3fe00700 1 --2- 172.21.15.69:0/1432388783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c48a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.206+0000 7fbe3fe00700 1 -- 172.21.15.69:0/1432388783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70ac2df0 msgr2=0x560e70c48540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:18.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.206+0000 7fbe3fe00700 1 --2- 172.21.15.69:0/1432388783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70ac2df0 0x560e70c48540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.206+0000 7fbe3fe00700 1 -- 172.21.15.69:0/1432388783 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e70c64840 con 0x560e70c467e0 2024-05-14T15:21:18.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.206+0000 7fbe3f400700 1 --2- 172.21.15.69:0/1432388783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70ac2df0 0x560e70c48540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:18.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.206+0000 7fbe36a00700 1 --2- 172.21.15.69:0/1432388783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c48a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:18.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.206+0000 7fbe3fe00700 1 --2- 172.21.15.69:0/1432388783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c64300 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800e940 tx=0x7fbe38022f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=577e1f7e54943669 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:18.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.206+0000 7fbe2d600700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:21:18.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.206+0000 7fbe2d600700 1 -- 172.21.15.69:0/1432388783 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe38030070 con 0x560e70c467e0 2024-05-14T15:21:18.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.206+0000 7fbe2d600700 1 -- 172.21.15.69:0/1432388783 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7fbe38010040 con 0x560e70c467e0 2024-05-14T15:21:18.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.206+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1432388783 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe38026070 con 0x560e70c467e0 2024-05-14T15:21:18.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.207+0000 7fbe2d600700 1 -- 172.21.15.69:0/1432388783 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fbe3803c050 con 0x560e70c467e0 2024-05-14T15:21:18.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.207+0000 7fbe54dc5b80 10 client.15261 fetch_fsmap learned FSMap version 29 2024-05-14T15:21:18.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.207+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1432388783 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x560e70cc5920 con 0x560e70c467e0 2024-05-14T15:21:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.207+0000 7fbe2d600700 1 -- 172.21.15.69:0/1432388783 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe38026070 con 0x560e70c467e0 2024-05-14T15:21:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.207+0000 7fbe2d600700 1 -- 172.21.15.69:0/1432388783 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fbe38014070 con 0x560e70c467e0 2024-05-14T15:21:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.207+0000 7fbe54dc5b80 10 client.15261 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:21:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.207+0000 7fbe54dc5b80 10 client.15261 resolve_mds: resolved name 'e' to daemon mds.e 2024-05-14T15:21:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.207+0000 7fbe54dc5b80 20 client.15261 populate_metadata read hostname 'smithi069' 2024-05-14T15:21:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.207+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/1432388783 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x560e70cc7b90 0x560e70cc9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.207+0000 7fbe54dc5b80 4 client.15261 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T15:21:18.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.207+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1432388783 --> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] -- command(tid 0: {"prefix": "status"}) -- 0x560e70b703b0 con 0x560e70cc7b90 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.208+0000 7fbe3f400700 1 --2- 172.21.15.69:0/1432388783 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x560e70cc7b90 0x560e70cc9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.209+0000 7fbe3f400700 1 --2- 172.21.15.69:0/1432388783 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x560e70cc7b90 0x560e70cc9000 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5f2459871a539fdc server_cookie=5380662fd7697620 in_seq=0 out_seq=0 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.209+0000 7fbe2d600700 10 client.15261 ms_handle_connect on v2:172.21.15.92:6834/360295917 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.209+0000 7fbe2d600700 1 -- 172.21.15.69:0/1432388783 <== mds.2 v2:172.21.15.92:6834/360295917 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x560e70b703b0 con 0x560e70cc7b90 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.209+0000 7fbe2d600700 10 client.15261 handle_command_reply: tid=0 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.209+0000 7fbe54dc5b80 1 client.15261 shutdown 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.210+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1432388783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 msgr2=0x560e70c64300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.210+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/1432388783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c64300 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800e940 tx=0x7fbe38022f10 comp rx=0 tx=0).stop 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.210+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1432388783 shutdown_connections 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.210+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/1432388783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e70c467e0 0x560e70c64300 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.210+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/1432388783 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x560e70cc7b90 0x560e70cc9000 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.210+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/1432388783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e70ac2df0 0x560e70c48540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.210+0000 7fbe54dc5b80 1 --2- 172.21.15.69:0/1432388783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e70c409a0 0x560e70c48a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.210+0000 7fbe2d600700 0 client.15261 ms_handle_reset on v2:172.21.15.92:6834/360295917 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.210+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1432388783 >> 172.21.15.69:0/1432388783 conn(0x560e70b07f20 msgr2=0x560e70c43c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.210+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1432388783 shutdown_connections 2024-05-14T15:21:18.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.210+0000 7fbe54dc5b80 1 -- 172.21.15.69:0/1432388783 wait complete. 2024-05-14T15:21:18.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.210+0000 7fbe54dc5b80 20 client.15261 trim_cache size 0 max 16384 2024-05-14T15:21:18.212 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:21:18.212 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "1cc2580e-1203-11ef-bc98-c7b262605968", 2024-05-14T15:21:18.212 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 2, 2024-05-14T15:21:18.212 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 34433, 2024-05-14T15:21:18.212 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-05-14T15:21:18.212 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-05-14T15:21:18.212 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-05-14T15:21:18.212 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 222.91754718999999, 2024-05-14T15:21:18.213 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 29, 2024-05-14T15:21:18.213 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 91, 2024-05-14T15:21:18.213 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 89, 2024-05-14T15:21:18.213 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 357.76599944600002 2024-05-14T15:21:18.213 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:21:18.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.211+0000 7fbe46200700 1 -- 172.21.15.69:0/3195854146 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbe240b2900 msgr2=0x7fbe240b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.211+0000 7fbe46200700 1 --2- 172.21.15.69:0/3195854146 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbe240b2900 0x7fbe240b4e10 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800e1b0 tx=0x7fbe38009040 comp rx=0 tx=0).stop 2024-05-14T15:21:18.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.211+0000 7fbe46200700 1 -- 172.21.15.69:0/3195854146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe4010a990 msgr2=0x7fbe401a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:18.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.211+0000 7fbe46200700 1 --2- 172.21.15.69:0/3195854146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe4010a990 0x7fbe401a1310 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbe30000c00 tx=0x7fbe30009f90 comp rx=0 tx=0).stop 2024-05-14T15:21:18.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.211+0000 7fbe46200700 1 -- 172.21.15.69:0/3195854146 shutdown_connections 2024-05-14T15:21:18.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.211+0000 7fbe46200700 1 --2- 172.21.15.69:0/3195854146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe4010a990 0x7fbe401a1310 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.211+0000 7fbe46200700 1 --2- 172.21.15.69:0/3195854146 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7fbe240b2900 0x7fbe240b4e10 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.211+0000 7fbe46200700 1 --2- 172.21.15.69:0/3195854146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe40110970 0x7fbe401a5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.211+0000 7fbe46200700 1 --2- 172.21.15.69:0/3195854146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe4010b2e0 0x7fbe401a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:18.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.211+0000 7fbe46200700 1 -- 172.21.15.69:0/3195854146 >> 172.21.15.69:0/3195854146 conn(0x7fbe40077c80 msgr2=0x7fbe4007bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:18.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.211+0000 7fbe46200700 1 -- 172.21.15.69:0/3195854146 shutdown_connections 2024-05-14T15:21:18.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:18.211+0000 7fbe46200700 1 -- 172.21.15.69:0/3195854146 wait complete. 2024-05-14T15:21:18.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:18 smithi069 ceph-mon[31270]: pgmap v549: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:21:19.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:18 smithi092 ceph-mon[34729]: pgmap v549: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:21:19.289 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.h status 2024-05-14T15:21:19.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:18 smithi203 ceph-mon[34567]: pgmap v549: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:21:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:21:21.184 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:20 smithi069 ceph-mon[31270]: pgmap v550: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:21:21.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:20 smithi092 ceph-mon[34729]: pgmap v550: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:21:21.219 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:20 smithi203 ceph-mon[34567]: pgmap v550: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 9 op/s 2024-05-14T15:21:22.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.124+0000 7f99de800700 1 -- 172.21.15.69:0/310035450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99d8105480 msgr2=0x7f99d8105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:22.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.124+0000 7f99de800700 1 --2- 172.21.15.69:0/310035450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99d8105480 0x7f99d8105890 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f99c8009990 tx=0x7f99c8009ca0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.124+0000 7f99de800700 1 -- 172.21.15.69:0/310035450 shutdown_connections 2024-05-14T15:21:22.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.124+0000 7f99de800700 1 --2- 172.21.15.69:0/310035450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99d8105480 0x7f99d8105890 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.124+0000 7f99de800700 1 --2- 172.21.15.69:0/310035450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99d810e8f0 0x7f99d8110dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.124+0000 7f99de800700 1 --2- 172.21.15.69:0/310035450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99d8105dd0 0x7f99d810e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.124+0000 7f99de800700 1 -- 172.21.15.69:0/310035450 >> 172.21.15.69:0/310035450 conn(0x7f99d80fef30 msgr2=0x7f99d8101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:22.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.124+0000 7f99de800700 1 -- 172.21.15.69:0/310035450 shutdown_connections 2024-05-14T15:21:22.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.124+0000 7f99de800700 1 -- 172.21.15.69:0/310035450 wait complete. 2024-05-14T15:21:22.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.126+0000 7f99de800700 1 Processor -- start 2024-05-14T15:21:22.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.126+0000 7f99de800700 1 -- start start 2024-05-14T15:21:22.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.126+0000 7f99de800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99d8105480 0x7f99d819d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.126+0000 7f99de800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99d8105dd0 0x7f99d819d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.126+0000 7f99de800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99d810e8f0 0x7f99d81a18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.126+0000 7f99de800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f99d8114340 con 0x7f99d8105480 2024-05-14T15:21:22.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.126+0000 7f99de800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f99d81141c0 con 0x7f99d8105dd0 2024-05-14T15:21:22.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.126+0000 7f99de800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f99d81144c0 con 0x7f99d810e8f0 2024-05-14T15:21:22.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.127+0000 7f99d7400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99d8105480 0x7f99d819d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.127+0000 7f99d7400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99d8105480 0x7f99d819d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58866/0 (socket says 172.21.15.69:58866) 2024-05-14T15:21:22.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.127+0000 7f99d7400700 1 -- 172.21.15.69:0/2863726994 learned_addr learned my addr 172.21.15.69:0/2863726994 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:22.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.127+0000 7f99d6a00700 1 --2- 172.21.15.69:0/2863726994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99d8105dd0 0x7f99d819d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.127+0000 7f99d7e00700 1 --2- 172.21.15.69:0/2863726994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99d810e8f0 0x7f99d81a18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.127+0000 7f99d7400700 1 -- 172.21.15.69:0/2863726994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99d810e8f0 msgr2=0x7f99d81a18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:22.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.127+0000 7f99d7400700 1 --2- 172.21.15.69:0/2863726994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99d810e8f0 0x7f99d81a18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.127+0000 7f99d7400700 1 -- 172.21.15.69:0/2863726994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99d8105dd0 msgr2=0x7f99d819d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:22.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.127+0000 7f99d7400700 1 --2- 172.21.15.69:0/2863726994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99d8105dd0 0x7f99d819d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.127+0000 7f99d7400700 1 -- 172.21.15.69:0/2863726994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99d81a1f40 con 0x7f99d8105480 2024-05-14T15:21:22.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.127+0000 7f99d6a00700 1 --2- 172.21.15.69:0/2863726994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99d8105dd0 0x7f99d819d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:21:22.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.128+0000 7f99d7400700 1 --2- 172.21.15.69:0/2863726994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99d8105480 0x7f99d819d070 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f99c800b650 tx=0x7f99c800bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:22.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.128+0000 7f99cfe00700 1 -- 172.21.15.69:0/2863726994 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8027070 con 0x7f99d8105480 2024-05-14T15:21:22.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.128+0000 7f99cfe00700 1 -- 172.21.15.69:0/2863726994 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c8022470 con 0x7f99d8105480 2024-05-14T15:21:22.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.128+0000 7f99de800700 1 -- 172.21.15.69:0/2863726994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99d81a21d0 con 0x7f99d8105480 2024-05-14T15:21:22.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.128+0000 7f99cfe00700 1 -- 172.21.15.69:0/2863726994 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c8017650 con 0x7f99d8105480 2024-05-14T15:21:22.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.128+0000 7f99de800700 1 -- 172.21.15.69:0/2863726994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99d81a26b0 con 0x7f99d8105480 2024-05-14T15:21:22.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.132+0000 7f99cfe00700 1 -- 172.21.15.69:0/2863726994 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f99c8009d10 con 0x7f99d8105480 2024-05-14T15:21:22.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.133+0000 7f99ed421b80 1 Processor -- start 2024-05-14T15:21:22.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.133+0000 7f99ed421b80 1 -- start start 2024-05-14T15:21:22.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.134+0000 7f99ed421b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19201ddf0 0x55e1921a12a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.134+0000 7f99ed421b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1921a17e0 0x55e19219b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.134+0000 7f99ed421b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19219b9a0 0x55e19219bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.134+0000 7f99ed421b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55e1920bd9d0 con 0x55e19219b9a0 2024-05-14T15:21:22.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.134+0000 7f99ed421b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e19205b710 con 0x55e19201ddf0 2024-05-14T15:21:22.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.134+0000 7f99ed421b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e1920b9990 con 0x55e1921a17e0 2024-05-14T15:21:22.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.135+0000 7f99d6a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19219b9a0 0x55e19219bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.135+0000 7f99d6a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19219b9a0 0x55e19219bdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58876/0 (socket says 172.21.15.69:58876) 2024-05-14T15:21:22.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.135+0000 7f99d6a00700 1 -- 172.21.15.69:0/1751472597 learned_addr learned my addr 172.21.15.69:0/1751472597 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:22.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.135+0000 7f99cfe00700 1 --2- 172.21.15.69:0/2863726994 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f99bc0b2880 0x7f99bc0b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.135+0000 7f99d7400700 1 --2- 172.21.15.69:0/1751472597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1921a17e0 0x55e19219b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.135+0000 7f99d7e00700 1 --2- 172.21.15.69:0/1751472597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19201ddf0 0x55e1921a12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.135+0000 7f99cfe00700 1 -- 172.21.15.69:0/2863726994 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f99c80e3370 con 0x7f99d8105480 2024-05-14T15:21:22.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.135+0000 7f99d7e00700 1 --2- 172.21.15.69:0/2863726994 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f99bc0b2880 0x7f99bc0b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.135+0000 7f99d6a00700 1 -- 172.21.15.69:0/1751472597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1921a17e0 msgr2=0x55e19219b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:22.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.135+0000 7f99d6a00700 1 --2- 172.21.15.69:0/1751472597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1921a17e0 0x55e19219b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.135+0000 7f99d6a00700 1 -- 172.21.15.69:0/1751472597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19201ddf0 msgr2=0x55e1921a12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:22.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.135+0000 7f99d6a00700 1 --2- 172.21.15.69:0/1751472597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19201ddf0 0x55e1921a12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.135+0000 7f99d6a00700 1 -- 172.21.15.69:0/1751472597 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e19200a880 con 0x55e19219b9a0 2024-05-14T15:21:22.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.136+0000 7f99d6a00700 1 --2- 172.21.15.69:0/1751472597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19219b9a0 0x55e19219bdb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009d80 tx=0x7f99c40116c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ac6ffcc326c0425 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:22.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.136+0000 7f99ccc00700 1 -- 172.21.15.69:0/1751472597 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4011e20 con 0x55e19219b9a0 2024-05-14T15:21:22.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.136+0000 7f99ccc00700 1 -- 172.21.15.69:0/1751472597 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c40128e0 con 0x55e19219b9a0 2024-05-14T15:21:22.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.136+0000 7f99ccc00700 1 -- 172.21.15.69:0/1751472597 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c400f730 con 0x55e19219b9a0 2024-05-14T15:21:22.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.136+0000 7f99d7e00700 1 --2- 172.21.15.69:0/2863726994 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f99bc0b2880 0x7f99bc0b4d90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009fa0 tx=0x7f99d000b040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:22.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.137+0000 7f99ed421b80 1 -- 172.21.15.69:0/1751472597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19219b9a0 msgr2=0x55e19219bdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:22.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.137+0000 7f99ed421b80 1 --2- 172.21.15.69:0/1751472597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19219b9a0 0x55e19219bdb0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009d80 tx=0x7f99c40116c0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.137+0000 7f99ed421b80 1 -- 172.21.15.69:0/1751472597 shutdown_connections 2024-05-14T15:21:22.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.137+0000 7f99ed421b80 1 --2- 172.21.15.69:0/1751472597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19219b9a0 0x55e19219bdb0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.137+0000 7f99ed421b80 1 --2- 172.21.15.69:0/1751472597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19201ddf0 0x55e1921a12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.137+0000 7f99ed421b80 1 --2- 172.21.15.69:0/1751472597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1921a17e0 0x55e19219b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.137+0000 7f99ed421b80 1 -- 172.21.15.69:0/1751472597 >> 172.21.15.69:0/1751472597 conn(0x55e192062f20 msgr2=0x55e192196280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:22.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.138+0000 7f99ed421b80 1 -- 172.21.15.69:0/1751472597 shutdown_connections 2024-05-14T15:21:22.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.138+0000 7f99ed421b80 1 -- 172.21.15.69:0/1751472597 wait complete. 2024-05-14T15:21:22.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.138+0000 7f99ed421b80 1 -- start start 2024-05-14T15:21:22.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.138+0000 7f99ed421b80 1 Processor -- start 2024-05-14T15:21:22.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.139+0000 7f99ed421b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19201ddf0 0x55e1921a4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.139+0000 7f99ed421b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19219b9a0 0x55e1921a5470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.139+0000 7f99ed421b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1921a17e0 0x55e1921a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.139+0000 7f99ed421b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55e1921a82c0 con 0x55e19201ddf0 2024-05-14T15:21:22.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.139+0000 7f99ed421b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e192023ad0 con 0x55e19219b9a0 2024-05-14T15:21:22.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.139+0000 7f99ed421b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e1921a8440 con 0x55e1921a17e0 2024-05-14T15:21:22.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.139+0000 7f99ed421b80 10 client.0 _ll_register_callbacks cb 0x55e192064c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:21:22.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.139+0000 7f99d7400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19201ddf0 0x55e1921a4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.139+0000 7f99d7400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19201ddf0 0x55e1921a4f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58886/0 (socket says 172.21.15.69:58886) 2024-05-14T15:21:22.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.139+0000 7f99d7400700 1 -- 172.21.15.69:0/99574465 learned_addr learned my addr 172.21.15.69:0/99574465 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:22.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.140+0000 7f99d6a00700 1 --2- 172.21.15.69:0/99574465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19219b9a0 0x55e1921a5470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.140+0000 7f99d7e00700 1 --2- 172.21.15.69:0/99574465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1921a17e0 0x55e1921a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.140+0000 7f99d7400700 1 -- 172.21.15.69:0/99574465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1921a17e0 msgr2=0x55e1921a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:22.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.140+0000 7f99d7400700 1 --2- 172.21.15.69:0/99574465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1921a17e0 0x55e1921a59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.140+0000 7f99d7400700 1 -- 172.21.15.69:0/99574465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19219b9a0 msgr2=0x55e1921a5470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:22.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.140+0000 7f99d7400700 1 --2- 172.21.15.69:0/99574465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19219b9a0 0x55e1921a5470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.140+0000 7f99d7400700 1 -- 172.21.15.69:0/99574465 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e1920833d0 con 0x55e19201ddf0 2024-05-14T15:21:22.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.140+0000 7f99d7400700 1 --2- 172.21.15.69:0/99574465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19201ddf0 0x55e1921a4f30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f99c80aa2f0 tx=0x7f99c80229f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35dc9083efb60cb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:22.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.140+0000 7f99c1600700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:21:22.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.140+0000 7f99c1600700 1 -- 172.21.15.69:0/99574465 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c80aacf0 con 0x55e19201ddf0 2024-05-14T15:21:22.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.141+0000 7f99c1600700 1 -- 172.21.15.69:0/99574465 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f99c80b2f30 con 0x55e19201ddf0 2024-05-14T15:21:22.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.141+0000 7f99ed421b80 1 -- 172.21.15.69:0/99574465 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99c40128e0 con 0x55e19201ddf0 2024-05-14T15:21:22.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.141+0000 7f99c1600700 1 -- 172.21.15.69:0/99574465 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f99c80aa5f0 con 0x55e19201ddf0 2024-05-14T15:21:22.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.141+0000 7f99ed421b80 10 client.15273 fetch_fsmap learned FSMap version 29 2024-05-14T15:21:22.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.141+0000 7f99ed421b80 1 -- 172.21.15.69:0/99574465 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e1921b2d90 con 0x55e19201ddf0 2024-05-14T15:21:22.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.141+0000 7f99c1600700 1 -- 172.21.15.69:0/99574465 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c40128e0 con 0x55e19201ddf0 2024-05-14T15:21:22.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.141+0000 7f99c1600700 1 -- 172.21.15.69:0/99574465 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f99c80afb30 con 0x55e19201ddf0 2024-05-14T15:21:22.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.141+0000 7f99ed421b80 10 client.15273 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:21:22.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.141+0000 7f99ed421b80 10 client.15273 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-14T15:21:22.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.142+0000 7f99ed421b80 20 client.15273 populate_metadata read hostname 'smithi069' 2024-05-14T15:21:22.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.142+0000 7f99ed421b80 1 --2- 172.21.15.69:0/99574465 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55e1921b53e0 0x55e1921b6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.142+0000 7f99ed421b80 4 client.15273 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:21:22.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.142+0000 7f99ed421b80 1 -- 172.21.15.69:0/99574465 --> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e192168170 con 0x55e1921b53e0 2024-05-14T15:21:22.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.142+0000 7f99d6a00700 1 --2- 172.21.15.69:0/99574465 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55e1921b53e0 0x55e1921b6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.143+0000 7f99d6a00700 1 --2- 172.21.15.69:0/99574465 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55e1921b53e0 0x55e1921b6850 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=126a32e42abdb672 server_cookie=57fc89cba98499d2 in_seq=0 out_seq=0 2024-05-14T15:21:22.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.143+0000 7f99c1600700 10 client.15273 ms_handle_connect on v2:172.21.15.92:6836/1669439322 2024-05-14T15:21:22.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.146+0000 7f99c1600700 1 -- 172.21.15.69:0/99574465 <== mds.1 v2:172.21.15.92:6836/1669439322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e192168170 con 0x55e1921b53e0 2024-05-14T15:21:22.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.146+0000 7f99c1600700 10 client.15273 handle_command_reply: tid=0 2024-05-14T15:21:22.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.146+0000 7f99ed421b80 1 client.15273 shutdown 2024-05-14T15:21:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.146+0000 7f99ed421b80 1 -- 172.21.15.69:0/99574465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19201ddf0 msgr2=0x55e1921a4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.146+0000 7f99ed421b80 1 --2- 172.21.15.69:0/99574465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19201ddf0 0x55e1921a4f30 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f99c80aa2f0 tx=0x7f99c80229f0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.146+0000 7f99ed421b80 1 -- 172.21.15.69:0/99574465 shutdown_connections 2024-05-14T15:21:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.146+0000 7f99ed421b80 1 --2- 172.21.15.69:0/99574465 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55e1921b53e0 0x55e1921b6850 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.146+0000 7f99ed421b80 1 --2- 172.21.15.69:0/99574465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19201ddf0 0x55e1921a4f30 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.146+0000 7f99ed421b80 1 --2- 172.21.15.69:0/99574465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1921a17e0 0x55e1921a59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.146+0000 7f99ed421b80 1 --2- 172.21.15.69:0/99574465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19219b9a0 0x55e1921a5470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.146+0000 7f99ed421b80 1 -- 172.21.15.69:0/99574465 >> 172.21.15.69:0/99574465 conn(0x55e192062f20 msgr2=0x55e19219a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.146+0000 7f99c1600700 0 client.15273 ms_handle_reset on v2:172.21.15.92:6836/1669439322 2024-05-14T15:21:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.147+0000 7f99ed421b80 1 -- 172.21.15.69:0/99574465 shutdown_connections 2024-05-14T15:21:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.147+0000 7f99ed421b80 1 -- 172.21.15.69:0/99574465 wait complete. 2024-05-14T15:21:22.147 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.147+0000 7f99ed421b80 20 client.15273 trim_cache size 0 max 16384 2024-05-14T15:21:22.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.169+0000 7f99ed421b80 1 Processor -- start 2024-05-14T15:21:22.169 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.169+0000 7f99ed421b80 1 -- start start 2024-05-14T15:21:22.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.170+0000 7f99ed421b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19201ddf0 0x55e19219b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.170+0000 7f99ed421b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19219b9a0 0x55e1921978d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.170+0000 7f99ed421b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1921a17e0 0x55e1921a0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.170+0000 7f99ed421b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55e1921b4b90 con 0x55e19219b9a0 2024-05-14T15:21:22.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.170+0000 7f99ed421b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e1921b5260 con 0x55e19201ddf0 2024-05-14T15:21:22.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.170+0000 7f99ed421b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e1921b5930 con 0x55e1921a17e0 2024-05-14T15:21:22.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.170+0000 7f99d6a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19219b9a0 0x55e1921978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.170+0000 7f99d6a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19219b9a0 0x55e1921978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58900/0 (socket says 172.21.15.69:58900) 2024-05-14T15:21:22.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.170+0000 7f99d6a00700 1 -- 172.21.15.69:0/424154684 learned_addr learned my addr 172.21.15.69:0/424154684 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:22.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.170+0000 7f99d7400700 1 --2- 172.21.15.69:0/424154684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19201ddf0 0x55e19219b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.170+0000 7f99d6a00700 1 -- 172.21.15.69:0/424154684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1921a17e0 msgr2=0x55e1921a0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:22.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.170+0000 7f99d7e00700 1 --2- 172.21.15.69:0/424154684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1921a17e0 0x55e1921a0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.171+0000 7f99d6a00700 1 --2- 172.21.15.69:0/424154684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1921a17e0 0x55e1921a0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.171+0000 7f99d6a00700 1 -- 172.21.15.69:0/424154684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19201ddf0 msgr2=0x55e19219b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:22.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.171+0000 7f99d6a00700 1 --2- 172.21.15.69:0/424154684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19201ddf0 0x55e19219b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.171+0000 7f99d6a00700 1 -- 172.21.15.69:0/424154684 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e1921a34a0 con 0x55e19219b9a0 2024-05-14T15:21:22.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.171+0000 7f99d7400700 1 --2- 172.21.15.69:0/424154684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19201ddf0 0x55e19219b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:22.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.171+0000 7f99d7e00700 1 --2- 172.21.15.69:0/424154684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1921a17e0 0x55e1921a0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:22.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.171+0000 7f99d6a00700 1 --2- 172.21.15.69:0/424154684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19219b9a0 0x55e1921978d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f99c40092a0 tx=0x7f99c4005940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=170f54d702d8e474 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:22.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.171+0000 7f99c3e00700 1 -- 172.21.15.69:0/424154684 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c40050c0 con 0x55e19219b9a0 2024-05-14T15:21:22.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.171+0000 7f99c3e00700 1 -- 172.21.15.69:0/424154684 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c402a030 con 0x55e19219b9a0 2024-05-14T15:21:22.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.171+0000 7f99c3e00700 1 -- 172.21.15.69:0/424154684 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99c4003da0 con 0x55e19219b9a0 2024-05-14T15:21:22.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.172+0000 7f99ed421b80 1 -- 172.21.15.69:0/424154684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19219b9a0 msgr2=0x55e1921978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:22.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.172+0000 7f99ed421b80 1 --2- 172.21.15.69:0/424154684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19219b9a0 0x55e1921978d0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f99c40092a0 tx=0x7f99c4005940 comp rx=0 tx=0).stop 2024-05-14T15:21:22.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.172+0000 7f99ed421b80 1 -- 172.21.15.69:0/424154684 shutdown_connections 2024-05-14T15:21:22.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.172+0000 7f99ed421b80 1 --2- 172.21.15.69:0/424154684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e1921a17e0 0x55e1921a0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.172+0000 7f99ed421b80 1 --2- 172.21.15.69:0/424154684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19201ddf0 0x55e19219b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.172+0000 7f99ed421b80 1 --2- 172.21.15.69:0/424154684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e19219b9a0 0x55e1921978d0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.172+0000 7f99ed421b80 1 -- 172.21.15.69:0/424154684 >> 172.21.15.69:0/424154684 conn(0x55e192062f20 msgr2=0x55e19219bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:22.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.172+0000 7f99ed421b80 1 -- 172.21.15.69:0/424154684 shutdown_connections 2024-05-14T15:21:22.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.172+0000 7f99ed421b80 1 -- 172.21.15.69:0/424154684 wait complete. 2024-05-14T15:21:22.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.173+0000 7f99ed421b80 1 -- start start 2024-05-14T15:21:22.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.173+0000 7f99ed421b80 1 Processor -- start 2024-05-14T15:21:22.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.174+0000 7f99ed421b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e19201ddf0 0x55e1921c01a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.174+0000 7f99ed421b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19219b9a0 0x55e19219a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.174+0000 7f99ed421b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1921a17e0 0x55e19219a990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.174+0000 7f99ed421b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55e1921b66d0 con 0x55e1921a17e0 2024-05-14T15:21:22.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.174+0000 7f99ed421b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e1921b6000 con 0x55e19219b9a0 2024-05-14T15:21:22.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.174+0000 7f99ed421b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e1921b6da0 con 0x55e19201ddf0 2024-05-14T15:21:22.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.174+0000 7f99ed421b80 10 client.0 _ll_register_callbacks cb 0x55e192064c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:21:22.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.174+0000 7f99d7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1921a17e0 0x55e19219a990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.174+0000 7f99d7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1921a17e0 0x55e19219a990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58916/0 (socket says 172.21.15.69:58916) 2024-05-14T15:21:22.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.174+0000 7f99d7e00700 1 -- 172.21.15.69:0/2540951599 learned_addr learned my addr 172.21.15.69:0/2540951599 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:22.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.174+0000 7f99d7400700 1 --2- 172.21.15.69:0/2540951599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e19201ddf0 0x55e1921c01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.175+0000 7f99d6a00700 1 --2- 172.21.15.69:0/2540951599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19219b9a0 0x55e19219a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.175+0000 7f99d7e00700 1 -- 172.21.15.69:0/2540951599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e19201ddf0 msgr2=0x55e1921c01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:22.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.175+0000 7f99d7e00700 1 --2- 172.21.15.69:0/2540951599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e19201ddf0 0x55e1921c01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.175+0000 7f99d7e00700 1 -- 172.21.15.69:0/2540951599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19219b9a0 msgr2=0x55e19219a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:22.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.175+0000 7f99d7e00700 1 --2- 172.21.15.69:0/2540951599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19219b9a0 0x55e19219a450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.175+0000 7f99d7e00700 1 -- 172.21.15.69:0/2540951599 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e19219b040 con 0x55e1921a17e0 2024-05-14T15:21:22.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.175+0000 7f99d7e00700 1 --2- 172.21.15.69:0/2540951599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1921a17e0 0x55e19219a990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f99d0018e60 tx=0x7f99d0004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b2ce65af4dcdd7c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:22.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.175+0000 7f99c1600700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:21:22.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.175+0000 7f99c1600700 1 -- 172.21.15.69:0/2540951599 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d002a060 con 0x55e1921a17e0 2024-05-14T15:21:22.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.175+0000 7f99c1600700 1 -- 172.21.15.69:0/2540951599 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f99d0017bf0 con 0x55e1921a17e0 2024-05-14T15:21:22.177 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.175+0000 7f99ed421b80 1 -- 172.21.15.69:0/2540951599 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99c402a030 con 0x55e1921a17e0 2024-05-14T15:21:22.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.176+0000 7f99c1600700 1 -- 172.21.15.69:0/2540951599 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f99d0031050 con 0x55e1921a17e0 2024-05-14T15:21:22.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.176+0000 7f99ed421b80 10 client.15279 fetch_fsmap learned FSMap version 29 2024-05-14T15:21:22.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.176+0000 7f99ed421b80 1 -- 172.21.15.69:0/2540951599 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55e1921bea50 con 0x55e1921a17e0 2024-05-14T15:21:22.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.176+0000 7f99c1600700 1 -- 172.21.15.69:0/2540951599 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99c402a030 con 0x55e1921a17e0 2024-05-14T15:21:22.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.176+0000 7f99c1600700 1 -- 172.21.15.69:0/2540951599 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f99d0024070 con 0x55e1921a17e0 2024-05-14T15:21:22.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.176+0000 7f99ed421b80 10 client.15279 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:21:22.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.176+0000 7f99ed421b80 10 client.15279 resolve_mds: resolved name 'h' to daemon mds.h 2024-05-14T15:21:22.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.176+0000 7f99ed421b80 20 client.15279 populate_metadata read hostname 'smithi069' 2024-05-14T15:21:22.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.176+0000 7f99ed421b80 1 --2- 172.21.15.69:0/2540951599 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55e192222af0 0x55e192223f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:22.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.176+0000 7f99ed421b80 4 client.15279 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T15:21:22.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.176+0000 7f99ed421b80 1 -- 172.21.15.69:0/2540951599 --> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] -- command(tid 0: {"prefix": "status"}) -- 0x55e1920cb3b0 con 0x55e192222af0 2024-05-14T15:21:22.178 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.177+0000 7f99d7400700 1 --2- 172.21.15.69:0/2540951599 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55e192222af0 0x55e192223f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:22.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.178+0000 7f99d7400700 1 --2- 172.21.15.69:0/2540951599 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55e192222af0 0x55e192223f60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=70d5932fe80fd7dc server_cookie=c664e0cff836c81e in_seq=0 out_seq=0 2024-05-14T15:21:22.179 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.178+0000 7f99c1600700 10 client.15279 ms_handle_connect on v2:172.21.15.92:6836/1669439322 2024-05-14T15:21:22.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.179+0000 7f99c1600700 1 -- 172.21.15.69:0/2540951599 <== mds.1 v2:172.21.15.92:6836/1669439322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55e1920cb3b0 con 0x55e192222af0 2024-05-14T15:21:22.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.179+0000 7f99c1600700 10 client.15279 handle_command_reply: tid=0 2024-05-14T15:21:22.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.179+0000 7f99ed421b80 1 client.15279 shutdown 2024-05-14T15:21:22.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.179+0000 7f99ed421b80 1 -- 172.21.15.69:0/2540951599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1921a17e0 msgr2=0x55e19219a990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:22.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.179+0000 7f99ed421b80 1 --2- 172.21.15.69:0/2540951599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1921a17e0 0x55e19219a990 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f99d0018e60 tx=0x7f99d0004ad0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.179+0000 7f99ed421b80 1 -- 172.21.15.69:0/2540951599 shutdown_connections 2024-05-14T15:21:22.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.179+0000 7f99ed421b80 1 --2- 172.21.15.69:0/2540951599 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55e192222af0 0x55e192223f60 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.179+0000 7f99ed421b80 1 --2- 172.21.15.69:0/2540951599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e1921a17e0 0x55e19219a990 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.179+0000 7f99ed421b80 1 --2- 172.21.15.69:0/2540951599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e19201ddf0 0x55e1921c01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.179+0000 7f99ed421b80 1 --2- 172.21.15.69:0/2540951599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e19219b9a0 0x55e19219a450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.179+0000 7f99ed421b80 1 -- 172.21.15.69:0/2540951599 >> 172.21.15.69:0/2540951599 conn(0x55e192062f20 msgr2=0x55e19219ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:22.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.179+0000 7f99c1600700 0 client.15279 ms_handle_reset on v2:172.21.15.92:6836/1669439322 2024-05-14T15:21:22.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.179+0000 7f99ed421b80 1 -- 172.21.15.69:0/2540951599 shutdown_connections 2024-05-14T15:21:22.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.179+0000 7f99ed421b80 1 -- 172.21.15.69:0/2540951599 wait complete. 2024-05-14T15:21:22.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.179+0000 7f99ed421b80 20 client.15279 trim_cache size 0 max 16384 2024-05-14T15:21:22.181 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:21:22.181 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "1cc2580e-1203-11ef-bc98-c7b262605968", 2024-05-14T15:21:22.181 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 1, 2024-05-14T15:21:22.181 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 34460, 2024-05-14T15:21:22.181 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-05-14T15:21:22.181 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-05-14T15:21:22.182 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-05-14T15:21:22.182 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 227.90102221199999, 2024-05-14T15:21:22.182 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 29, 2024-05-14T15:21:22.182 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 91, 2024-05-14T15:21:22.182 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 89, 2024-05-14T15:21:22.182 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 348.860058982 2024-05-14T15:21:22.182 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:21:22.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.180+0000 7f99de800700 1 -- 172.21.15.69:0/2863726994 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f99bc0b2880 msgr2=0x7f99bc0b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:22.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.180+0000 7f99de800700 1 --2- 172.21.15.69:0/2863726994 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f99bc0b2880 0x7f99bc0b4d90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f99d0009fa0 tx=0x7f99d000b040 comp rx=0 tx=0).stop 2024-05-14T15:21:22.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.180+0000 7f99de800700 1 -- 172.21.15.69:0/2863726994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99d8105480 msgr2=0x7f99d819d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:22.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.180+0000 7f99de800700 1 --2- 172.21.15.69:0/2863726994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99d8105480 0x7f99d819d070 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f99c800b650 tx=0x7f99c800bfc0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.180+0000 7f99de800700 1 -- 172.21.15.69:0/2863726994 shutdown_connections 2024-05-14T15:21:22.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.180+0000 7f99de800700 1 --2- 172.21.15.69:0/2863726994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99d8105480 0x7f99d819d070 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.180+0000 7f99de800700 1 --2- 172.21.15.69:0/2863726994 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f99bc0b2880 0x7f99bc0b4d90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.180+0000 7f99de800700 1 --2- 172.21.15.69:0/2863726994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99d810e8f0 0x7f99d81a18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.180+0000 7f99de800700 1 --2- 172.21.15.69:0/2863726994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99d8105dd0 0x7f99d819d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:22.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.180+0000 7f99de800700 1 -- 172.21.15.69:0/2863726994 >> 172.21.15.69:0/2863726994 conn(0x7f99d80fef30 msgr2=0x7f99d8103240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:22.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.180+0000 7f99de800700 1 -- 172.21.15.69:0/2863726994 shutdown_connections 2024-05-14T15:21:22.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:22.180+0000 7f99de800700 1 -- 172.21.15.69:0/2863726994 wait complete. 2024-05-14T15:21:23.177 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:22 smithi069 ceph-mon[31270]: pgmap v551: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:21:23.183 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.b status 2024-05-14T15:21:23.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:22 smithi092 ceph-mon[34729]: pgmap v551: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:21:23.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:22 smithi203 ceph-mon[34567]: pgmap v551: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 10 op/s 2024-05-14T15:21:23.635 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:21:24.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:24 smithi069 ceph-mon[31270]: pgmap v552: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:21:24.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:24 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:25.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:24 smithi092 ceph-mon[34729]: pgmap v552: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:21:25.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:24 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:25.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:24 smithi203 ceph-mon[34567]: pgmap v552: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 9 op/s 2024-05-14T15:21:25.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:24 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.029+0000 7f9beb200700 1 -- 172.21.15.69:0/1790787135 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9be410c5c0 msgr2=0x7f9be410c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.029+0000 7f9beb200700 1 --2- 172.21.15.69:0/1790787135 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9be410c5c0 0x7f9be410c9d0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4009990 tx=0x7f9bd4009ca0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.029+0000 7f9beb200700 1 -- 172.21.15.69:0/1790787135 shutdown_connections 2024-05-14T15:21:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.029+0000 7f9beb200700 1 --2- 172.21.15.69:0/1790787135 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9be410c5c0 0x7f9be410c9d0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.029+0000 7f9beb200700 1 --2- 172.21.15.69:0/1790787135 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9be4106ed0 0x7f9be4113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.029+0000 7f9beb200700 1 --2- 172.21.15.69:0/1790787135 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9be4106580 0x7f9be4106990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.029+0000 7f9beb200700 1 -- 172.21.15.69:0/1790787135 >> 172.21.15.69:0/1790787135 conn(0x7f9be4102080 msgr2=0x7f9be41044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.029+0000 7f9beb200700 1 -- 172.21.15.69:0/1790787135 shutdown_connections 2024-05-14T15:21:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.029+0000 7f9beb200700 1 -- 172.21.15.69:0/1790787135 wait complete. 2024-05-14T15:21:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.031+0000 7f9beb200700 1 Processor -- start 2024-05-14T15:21:26.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.031+0000 7f9beb200700 1 -- start start 2024-05-14T15:21:26.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.031+0000 7f9beb200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9be4106580 0x7f9be419cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.031+0000 7f9beb200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9be4106ed0 0x7f9be419d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.032+0000 7f9beb200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9be410c5c0 0x7f9be41a1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.032+0000 7f9beb200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9be4116580 con 0x7f9be4106ed0 2024-05-14T15:21:26.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.032+0000 7f9beb200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9be4116400 con 0x7f9be410c5c0 2024-05-14T15:21:26.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.032+0000 7f9beb200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9be4116700 con 0x7f9be4106580 2024-05-14T15:21:26.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.032+0000 7f9be3400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9be4106ed0 0x7f9be419d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.032+0000 7f9be3400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9be4106ed0 0x7f9be419d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35248/0 (socket says 172.21.15.69:35248) 2024-05-14T15:21:26.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.032+0000 7f9be3400700 1 -- 172.21.15.69:0/3319839982 learned_addr learned my addr 172.21.15.69:0/3319839982 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:26.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.032+0000 7f9be9200700 1 --2- 172.21.15.69:0/3319839982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9be410c5c0 0x7f9be41a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.032+0000 7f9be3e00700 1 --2- 172.21.15.69:0/3319839982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9be4106580 0x7f9be419cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.032+0000 7f9be3400700 1 -- 172.21.15.69:0/3319839982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9be4106580 msgr2=0x7f9be419cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:26.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.032+0000 7f9be3400700 1 --2- 172.21.15.69:0/3319839982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9be4106580 0x7f9be419cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.032+0000 7f9be3400700 1 -- 172.21.15.69:0/3319839982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9be410c5c0 msgr2=0x7f9be41a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:26.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.032+0000 7f9be3400700 1 --2- 172.21.15.69:0/3319839982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9be410c5c0 0x7f9be41a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.033+0000 7f9be3400700 1 -- 172.21.15.69:0/3319839982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be41a1ec0 con 0x7f9be4106ed0 2024-05-14T15:21:26.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.033+0000 7f9be3400700 1 --2- 172.21.15.69:0/3319839982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9be4106ed0 0x7f9be419d590 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000d950 tx=0x7f9bd000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:26.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.033+0000 7f9be0c00700 1 -- 172.21.15.69:0/3319839982 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0017070 con 0x7f9be4106ed0 2024-05-14T15:21:26.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.033+0000 7f9beb200700 1 -- 172.21.15.69:0/3319839982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9be41a21b0 con 0x7f9be4106ed0 2024-05-14T15:21:26.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.033+0000 7f9be0c00700 1 -- 172.21.15.69:0/3319839982 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bd000fd20 con 0x7f9be4106ed0 2024-05-14T15:21:26.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.033+0000 7f9be0c00700 1 -- 172.21.15.69:0/3319839982 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd000e3b0 con 0x7f9be4106ed0 2024-05-14T15:21:26.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.033+0000 7f9beb200700 1 -- 172.21.15.69:0/3319839982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9be41a9ad0 con 0x7f9be4106ed0 2024-05-14T15:21:26.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.038+0000 7f9bf9c96b80 1 Processor -- start 2024-05-14T15:21:26.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.038+0000 7f9bf9c96b80 1 -- start start 2024-05-14T15:21:26.038 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:25 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:26.038 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:25 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:26.038 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:25 smithi069 ceph-mon[31270]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:21:26.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.038+0000 7f9be0c00700 1 -- 172.21.15.69:0/3319839982 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f9bd001a070 con 0x7f9be4106ed0 2024-05-14T15:21:26.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.039+0000 7f9bf9c96b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5712f0df0 0x55d571474660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.039+0000 7f9bf9c96b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d571474ba0 0x55d57146e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.039+0000 7f9bf9c96b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d57146ec00 0x55d57146f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.039+0000 7f9bf9c96b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55d5713909d0 con 0x55d5712f0df0 2024-05-14T15:21:26.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.039+0000 7f9bf9c96b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d57132e710 con 0x55d571474ba0 2024-05-14T15:21:26.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.039+0000 7f9bf9c96b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d57138c990 con 0x55d57146ec00 2024-05-14T15:21:26.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.039+0000 7f9be9200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5712f0df0 0x55d571474660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.039+0000 7f9be9200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5712f0df0 0x55d571474660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35254/0 (socket says 172.21.15.69:35254) 2024-05-14T15:21:26.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.039+0000 7f9be9200700 1 -- 172.21.15.69:0/3849760527 learned_addr learned my addr 172.21.15.69:0/3849760527 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:26.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.039+0000 7f9be3e00700 1 --2- 172.21.15.69:0/3849760527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d571474ba0 0x55d57146e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.040+0000 7f9be9200700 1 -- 172.21.15.69:0/3849760527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d57146ec00 msgr2=0x55d57146f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:26.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.040+0000 7f9be9200700 1 --2- 172.21.15.69:0/3849760527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d57146ec00 0x55d57146f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.040+0000 7f9be9200700 1 -- 172.21.15.69:0/3849760527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d571474ba0 msgr2=0x55d57146e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:26.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.040+0000 7f9be9200700 1 --2- 172.21.15.69:0/3849760527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d571474ba0 0x55d57146e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.040+0000 7f9be9200700 1 -- 172.21.15.69:0/3849760527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5712dd880 con 0x55d5712f0df0 2024-05-14T15:21:26.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.040+0000 7f9be9200700 1 --2- 172.21.15.69:0/3849760527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5712f0df0 0x55d571474660 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc003f30 tx=0x7f9bdc009c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985fb07982f99776 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:26.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.040+0000 7f9bd9600700 1 -- 172.21.15.69:0/3849760527 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc004670 con 0x55d5712f0df0 2024-05-14T15:21:26.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.041+0000 7f9bd9600700 1 -- 172.21.15.69:0/3849760527 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bdc01a070 con 0x55d5712f0df0 2024-05-14T15:21:26.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.041+0000 7f9bd9600700 1 -- 172.21.15.69:0/3849760527 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bdc0156e0 con 0x55d5712f0df0 2024-05-14T15:21:26.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.041+0000 7f9be0c00700 1 --2- 172.21.15.69:0/3319839982 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9bc80b2880 0x7f9bc80b4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.041+0000 7f9be0c00700 1 -- 172.21.15.69:0/3319839982 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f9bd00e1df0 con 0x7f9be4106ed0 2024-05-14T15:21:26.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.041+0000 7f9be3e00700 1 --2- 172.21.15.69:0/3319839982 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9bc80b2880 0x7f9bc80b4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.042+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/3849760527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5712f0df0 msgr2=0x55d571474660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:26.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.042+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/3849760527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5712f0df0 0x55d571474660 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc003f30 tx=0x7f9bdc009c20 comp rx=0 tx=0).stop 2024-05-14T15:21:26.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.042+0000 7f9be3e00700 1 --2- 172.21.15.69:0/3319839982 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9bc80b2880 0x7f9bc80b4d90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4006010 tx=0x7f9bd4005040 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:26.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.042+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/3849760527 shutdown_connections 2024-05-14T15:21:26.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.042+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/3849760527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d5712f0df0 0x55d571474660 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.042+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/3849760527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d57146ec00 0x55d57146f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.042+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/3849760527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d571474ba0 0x55d57146e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.042+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/3849760527 >> 172.21.15.69:0/3849760527 conn(0x55d57132fa30 msgr2=0x55d571469740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:26.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.042+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/3849760527 shutdown_connections 2024-05-14T15:21:26.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.042+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/3849760527 wait complete. 2024-05-14T15:21:26.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.043+0000 7f9bf9c96b80 1 -- start start 2024-05-14T15:21:26.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.043+0000 7f9bf9c96b80 1 Processor -- start 2024-05-14T15:21:26.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.044+0000 7f9bf9c96b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5712f0df0 0x55d571478440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.044+0000 7f9bf9c96b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571478980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.044+0000 7f9bf9c96b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 0x55d571478ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.044+0000 7f9bf9c96b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55d57147b670 con 0x55d57146ec00 2024-05-14T15:21:26.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.044+0000 7f9bf9c96b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d5712f6ad0 con 0x55d5712f0df0 2024-05-14T15:21:26.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.044+0000 7f9bf9c96b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d57147b7f0 con 0x55d571474ba0 2024-05-14T15:21:26.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.044+0000 7f9bf9c96b80 10 client.0 _ll_register_callbacks cb 0x55d571324330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:21:26.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.044+0000 7f9be3400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571478980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.044+0000 7f9be3400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571478980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35264/0 (socket says 172.21.15.69:35264) 2024-05-14T15:21:26.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.044+0000 7f9be3400700 1 -- 172.21.15.69:0/2288997177 learned_addr learned my addr 172.21.15.69:0/2288997177 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:26.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.044+0000 7f9be3e00700 1 --2- 172.21.15.69:0/2288997177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5712f0df0 0x55d571478440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.045+0000 7f9be9200700 1 --2- 172.21.15.69:0/2288997177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 0x55d571478ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.045+0000 7f9be3400700 1 -- 172.21.15.69:0/2288997177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 msgr2=0x55d571478ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:26.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.045+0000 7f9be3400700 1 --2- 172.21.15.69:0/2288997177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 0x55d571478ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.045+0000 7f9be3400700 1 -- 172.21.15.69:0/2288997177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5712f0df0 msgr2=0x55d571478440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:26.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.045+0000 7f9be3400700 1 --2- 172.21.15.69:0/2288997177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5712f0df0 0x55d571478440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.045+0000 7f9be3400700 1 -- 172.21.15.69:0/2288997177 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5713563d0 con 0x55d57146ec00 2024-05-14T15:21:26.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.045+0000 7f9be9200700 1 --2- 172.21.15.69:0/2288997177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 0x55d571478ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:26.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.045+0000 7f9be3400700 1 --2- 172.21.15.69:0/2288997177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571478980 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0010040 tx=0x7f9bd00108f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78c8de55b3d80b00 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:26.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.045+0000 7f9bce000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:21:26.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.045+0000 7f9bce000700 1 -- 172.21.15.69:0/2288997177 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0021070 con 0x55d57146ec00 2024-05-14T15:21:26.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.045+0000 7f9bce000700 1 -- 172.21.15.69:0/2288997177 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f9bd00b19b0 con 0x55d57146ec00 2024-05-14T15:21:26.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.045+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/2288997177 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bdc01a070 con 0x55d57146ec00 2024-05-14T15:21:26.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.046+0000 7f9bce000700 1 -- 172.21.15.69:0/2288997177 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9bd00a8af0 con 0x55d57146ec00 2024-05-14T15:21:26.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.046+0000 7f9bf9c96b80 10 client.15291 fetch_fsmap learned FSMap version 29 2024-05-14T15:21:26.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.046+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/2288997177 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d5714863a0 con 0x55d57146ec00 2024-05-14T15:21:26.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.046+0000 7f9bce000700 1 -- 172.21.15.69:0/2288997177 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bdc01a070 con 0x55d57146ec00 2024-05-14T15:21:26.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.046+0000 7f9bce000700 1 -- 172.21.15.69:0/2288997177 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9bd00a8240 con 0x55d57146ec00 2024-05-14T15:21:26.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.046+0000 7f9bf9c96b80 10 client.15291 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:21:26.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.046+0000 7f9bf9c96b80 10 client.15291 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T15:21:26.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.046+0000 7f9bf9c96b80 20 client.15291 populate_metadata read hostname 'smithi069' 2024-05-14T15:21:26.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.046+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/2288997177 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d571488940 0x55d571489db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.046+0000 7f9bf9c96b80 4 client.15291 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:21:26.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.046+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/2288997177 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d57143b020 con 0x55d571488940 2024-05-14T15:21:26.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.047+0000 7f9be3e00700 1 --2- 172.21.15.69:0/2288997177 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d571488940 0x55d571489db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.048+0000 7f9bce000700 10 client.15291 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:21:26.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.048+0000 7f9be3e00700 1 --2- 172.21.15.69:0/2288997177 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d571488940 0x55d571489db0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e172dcc5f2309afa server_cookie=5b29bbf2353ecfb5 in_seq=0 out_seq=0 2024-05-14T15:21:26.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.049+0000 7f9bce000700 1 -- 172.21.15.69:0/2288997177 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d57143b020 con 0x55d571488940 2024-05-14T15:21:26.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.049+0000 7f9bce000700 10 client.15291 handle_command_reply: tid=0 2024-05-14T15:21:26.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.049+0000 7f9bf9c96b80 1 client.15291 shutdown 2024-05-14T15:21:26.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.050+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/2288997177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 msgr2=0x55d571478980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:26.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.050+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/2288997177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571478980 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0010040 tx=0x7f9bd00108f0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.050+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/2288997177 shutdown_connections 2024-05-14T15:21:26.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.050+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/2288997177 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d571488940 0x55d571489db0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.050+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/2288997177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 0x55d571478ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.050+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/2288997177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5712f0df0 0x55d571478440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.050+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/2288997177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571478980 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.050+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/2288997177 >> 172.21.15.69:0/2288997177 conn(0x55d57132fa30 msgr2=0x55d57146d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:26.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.050+0000 7f9bce000700 0 client.15291 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:21:26.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.050+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/2288997177 shutdown_connections 2024-05-14T15:21:26.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.050+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/2288997177 wait complete. 2024-05-14T15:21:26.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.050+0000 7f9bf9c96b80 20 client.15291 trim_cache size 0 max 16384 2024-05-14T15:21:26.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.072+0000 7f9bf9c96b80 1 Processor -- start 2024-05-14T15:21:26.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.073+0000 7f9bf9c96b80 1 -- start start 2024-05-14T15:21:26.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.073+0000 7f9bf9c96b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5712f0df0 0x55d57146e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.073+0000 7f9bf9c96b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571484af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.073+0000 7f9bf9c96b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 0x55d571479af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.073+0000 7f9bf9c96b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55d5714880f0 con 0x55d57146ec00 2024-05-14T15:21:26.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.073+0000 7f9bf9c96b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d5714887c0 con 0x55d5712f0df0 2024-05-14T15:21:26.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.073+0000 7f9bf9c96b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d571488e90 con 0x55d571474ba0 2024-05-14T15:21:26.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.073+0000 7f9be3400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571484af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.073+0000 7f9be3400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571484af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35278/0 (socket says 172.21.15.69:35278) 2024-05-14T15:21:26.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.073+0000 7f9be3400700 1 -- 172.21.15.69:0/2451071803 learned_addr learned my addr 172.21.15.69:0/2451071803 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:26.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.074+0000 7f9be3e00700 1 --2- 172.21.15.69:0/2451071803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5712f0df0 0x55d57146e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.074+0000 7f9be9200700 1 --2- 172.21.15.69:0/2451071803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 0x55d571479af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.074+0000 7f9be3400700 1 -- 172.21.15.69:0/2451071803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 msgr2=0x55d571479af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:26.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.074+0000 7f9be3400700 1 --2- 172.21.15.69:0/2451071803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 0x55d571479af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.074+0000 7f9be3400700 1 -- 172.21.15.69:0/2451071803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5712f0df0 msgr2=0x55d57146e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:26.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.074+0000 7f9be3400700 1 --2- 172.21.15.69:0/2451071803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5712f0df0 0x55d57146e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.074+0000 7f9be3400700 1 -- 172.21.15.69:0/2451071803 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5714769b0 con 0x55d57146ec00 2024-05-14T15:21:26.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.074+0000 7f9be9200700 1 --2- 172.21.15.69:0/2451071803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 0x55d571479af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:26.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.074+0000 7f9be3400700 1 --2- 172.21.15.69:0/2451071803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571484af0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00a8c90 tx=0x7f9bd0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19474e7dcbc78601 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:26.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.074+0000 7f9bd8c00700 1 -- 172.21.15.69:0/2451071803 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0021070 con 0x55d57146ec00 2024-05-14T15:21:26.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.074+0000 7f9bd8c00700 1 -- 172.21.15.69:0/2451071803 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bd00a96e0 con 0x55d57146ec00 2024-05-14T15:21:26.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.074+0000 7f9bd8c00700 1 -- 172.21.15.69:0/2451071803 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd00b19b0 con 0x55d57146ec00 2024-05-14T15:21:26.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.075+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/2451071803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 msgr2=0x55d571484af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:26.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.075+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/2451071803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571484af0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f9bd00a8c90 tx=0x7f9bd0000bc0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.075+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/2451071803 shutdown_connections 2024-05-14T15:21:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.075+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/2451071803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 0x55d571479af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.075+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/2451071803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5712f0df0 0x55d57146e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.075+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/2451071803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571484af0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.075+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/2451071803 >> 172.21.15.69:0/2451071803 conn(0x55d57132fa30 msgr2=0x55d5714633e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.076+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/2451071803 shutdown_connections 2024-05-14T15:21:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.076+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/2451071803 wait complete. 2024-05-14T15:21:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.076+0000 7f9bf9c96b80 1 -- start start 2024-05-14T15:21:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.076+0000 7f9bf9c96b80 1 Processor -- start 2024-05-14T15:21:26.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.077+0000 7f9bf9c96b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5712f0df0 0x55d571484100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.077+0000 7f9bf9c96b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571484640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.077+0000 7f9bf9c96b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 0x55d571484b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.077+0000 7f9bf9c96b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55d571489c30 con 0x55d57146ec00 2024-05-14T15:21:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.077+0000 7f9bf9c96b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d571489560 con 0x55d5712f0df0 2024-05-14T15:21:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.077+0000 7f9bf9c96b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d57148a300 con 0x55d571474ba0 2024-05-14T15:21:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.077+0000 7f9bf9c96b80 10 client.0 _ll_register_callbacks cb 0x55d571324330 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:21:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.077+0000 7f9be3400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571484640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.077+0000 7f9be3400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571484640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35284/0 (socket says 172.21.15.69:35284) 2024-05-14T15:21:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.077+0000 7f9be3400700 1 -- 172.21.15.69:0/1826438075 learned_addr learned my addr 172.21.15.69:0/1826438075 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.077+0000 7f9be3e00700 1 --2- 172.21.15.69:0/1826438075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5712f0df0 0x55d571484100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.078+0000 7f9be9200700 1 --2- 172.21.15.69:0/1826438075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 0x55d571484b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.078+0000 7f9be3400700 1 -- 172.21.15.69:0/1826438075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 msgr2=0x55d571484b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.078+0000 7f9be3400700 1 --2- 172.21.15.69:0/1826438075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 0x55d571484b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.078+0000 7f9be3400700 1 -- 172.21.15.69:0/1826438075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5712f0df0 msgr2=0x55d571484100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.078+0000 7f9be3400700 1 --2- 172.21.15.69:0/1826438075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5712f0df0 0x55d571484100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.078+0000 7f9be3400700 1 -- 172.21.15.69:0/1826438075 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d571491960 con 0x55d57146ec00 2024-05-14T15:21:26.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.078+0000 7f9be3400700 1 --2- 172.21.15.69:0/1826438075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571484640 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0012040 tx=0x7f9bd00b1c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd3f846975486f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:26.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.078+0000 7f9bce000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:21:26.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.078+0000 7f9bce000700 1 -- 172.21.15.69:0/1826438075 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd0021070 con 0x55d57146ec00 2024-05-14T15:21:26.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.078+0000 7f9bce000700 1 -- 172.21.15.69:0/1826438075 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f9bd000faa0 con 0x55d57146ec00 2024-05-14T15:21:26.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.078+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/1826438075 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bd00a96e0 con 0x55d57146ec00 2024-05-14T15:21:26.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.079+0000 7f9bce000700 1 -- 172.21.15.69:0/1826438075 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f9bd008b050 con 0x55d57146ec00 2024-05-14T15:21:26.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.079+0000 7f9bf9c96b80 10 client.15297 fetch_fsmap learned FSMap version 29 2024-05-14T15:21:26.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.079+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/1826438075 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55d5714f40f0 con 0x55d57146ec00 2024-05-14T15:21:26.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.079+0000 7f9bce000700 1 -- 172.21.15.69:0/1826438075 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bd00a96e0 con 0x55d57146ec00 2024-05-14T15:21:26.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.079+0000 7f9bce000700 1 -- 172.21.15.69:0/1826438075 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f9bd0068a50 con 0x55d57146ec00 2024-05-14T15:21:26.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.079+0000 7f9bf9c96b80 10 client.15297 fetch_fsmap finished waiting for FSMap version 29 2024-05-14T15:21:26.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.079+0000 7f9bf9c96b80 10 client.15297 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-14T15:21:26.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.079+0000 7f9bf9c96b80 20 client.15297 populate_metadata read hostname 'smithi069' 2024-05-14T15:21:26.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.079+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/1826438075 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d5714f5ff0 0x55d5714f7460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:26.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.079+0000 7f9bf9c96b80 4 client.15297 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-14T15:21:26.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.079+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/1826438075 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "status"}) -- 0x55d57139e3b0 con 0x55d5714f5ff0 2024-05-14T15:21:26.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.080+0000 7f9be3e00700 1 --2- 172.21.15.69:0/1826438075 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d5714f5ff0 0x55d5714f7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:26.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.081+0000 7f9be3e00700 1 --2- 172.21.15.69:0/1826438075 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d5714f5ff0 0x55d5714f7460 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a62c344fa78e851f server_cookie=bceb4e2a0506e51d in_seq=0 out_seq=0 2024-05-14T15:21:26.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.081+0000 7f9bce000700 10 client.15297 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:21:26.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.081+0000 7f9bce000700 1 -- 172.21.15.69:0/1826438075 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55d57139e3b0 con 0x55d5714f5ff0 2024-05-14T15:21:26.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.081+0000 7f9bce000700 10 client.15297 handle_command_reply: tid=0 2024-05-14T15:21:26.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.081+0000 7f9bf9c96b80 1 client.15297 shutdown 2024-05-14T15:21:26.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.082+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/1826438075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 msgr2=0x55d571484640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:26.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.082+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/1826438075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571484640 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f9bd0012040 tx=0x7f9bd00b1c90 comp rx=0 tx=0).stop 2024-05-14T15:21:26.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.082+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/1826438075 shutdown_connections 2024-05-14T15:21:26.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.082+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/1826438075 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d5714f5ff0 0x55d5714f7460 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.082+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/1826438075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d571474ba0 0x55d571484b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.082+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/1826438075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d5712f0df0 0x55d571484100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.082+0000 7f9bf9c96b80 1 --2- 172.21.15.69:0/1826438075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d57146ec00 0x55d571484640 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.082+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/1826438075 >> 172.21.15.69:0/1826438075 conn(0x55d57132fa30 msgr2=0x55d571468e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:26.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.082+0000 7f9bce000700 0 client.15297 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:21:26.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.082+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/1826438075 shutdown_connections 2024-05-14T15:21:26.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.082+0000 7f9bf9c96b80 1 -- 172.21.15.69:0/1826438075 wait complete. 2024-05-14T15:21:26.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.082+0000 7f9bf9c96b80 20 client.15297 trim_cache size 0 max 16384 2024-05-14T15:21:26.084 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:21:26.085 INFO:teuthology.orchestra.run.smithi069.stdout: "cluster_fsid": "1cc2580e-1203-11ef-bc98-c7b262605968", 2024-05-14T15:21:26.085 INFO:teuthology.orchestra.run.smithi069.stdout: "whoami": 0, 2024-05-14T15:21:26.085 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 34490, 2024-05-14T15:21:26.085 INFO:teuthology.orchestra.run.smithi069.stdout: "want_state": "up:active", 2024-05-14T15:21:26.085 INFO:teuthology.orchestra.run.smithi069.stdout: "state": "up:active", 2024-05-14T15:21:26.085 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs", 2024-05-14T15:21:26.085 INFO:teuthology.orchestra.run.smithi069.stdout: "rank_uptime": 314.27316383499999, 2024-05-14T15:21:26.085 INFO:teuthology.orchestra.run.smithi069.stdout: "mdsmap_epoch": 29, 2024-05-14T15:21:26.085 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch": 91, 2024-05-14T15:21:26.085 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_epoch_barrier": 89, 2024-05-14T15:21:26.085 INFO:teuthology.orchestra.run.smithi069.stdout: "uptime": 334.09323778499999 2024-05-14T15:21:26.085 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:21:26.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.083+0000 7f9beb200700 1 -- 172.21.15.69:0/3319839982 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9bc80b2880 msgr2=0x7f9bc80b4d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:26.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.083+0000 7f9beb200700 1 --2- 172.21.15.69:0/3319839982 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9bc80b2880 0x7f9bc80b4d90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f9bd4006010 tx=0x7f9bd4005040 comp rx=0 tx=0).stop 2024-05-14T15:21:26.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.083+0000 7f9beb200700 1 -- 172.21.15.69:0/3319839982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9be4106ed0 msgr2=0x7f9be419d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:26.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.083+0000 7f9beb200700 1 --2- 172.21.15.69:0/3319839982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9be4106ed0 0x7f9be419d590 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9bd000d950 tx=0x7f9bd000dc60 comp rx=0 tx=0).stop 2024-05-14T15:21:26.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.083+0000 7f9beb200700 1 -- 172.21.15.69:0/3319839982 shutdown_connections 2024-05-14T15:21:26.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.083+0000 7f9beb200700 1 --2- 172.21.15.69:0/3319839982 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f9bc80b2880 0x7f9bc80b4d90 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.083+0000 7f9beb200700 1 --2- 172.21.15.69:0/3319839982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9be410c5c0 0x7f9be41a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.083+0000 7f9beb200700 1 --2- 172.21.15.69:0/3319839982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9be4106580 0x7f9be419cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.083+0000 7f9beb200700 1 --2- 172.21.15.69:0/3319839982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9be4106ed0 0x7f9be419d590 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:26.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.083+0000 7f9beb200700 1 -- 172.21.15.69:0/3319839982 >> 172.21.15.69:0/3319839982 conn(0x7f9be4102080 msgr2=0x7f9be41049d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:26.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.083+0000 7f9beb200700 1 -- 172.21.15.69:0/3319839982 shutdown_connections 2024-05-14T15:21:26.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:26.083+0000 7f9beb200700 1 -- 172.21.15.69:0/3319839982 wait complete. 2024-05-14T15:21:26.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:25 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:26.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:25 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:26.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:25 smithi092 ceph-mon[34729]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:21:26.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:25 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:26.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:25 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:26.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:25 smithi203 ceph-mon[34567]: from='mgr.14152 172.21.15.69:0/3059518182' entity='mgr.x' 2024-05-14T15:21:27.033 INFO:teuthology.run_tasks:Running task sequential... 2024-05-14T15:21:27.042 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-14T15:21:27.042 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-14T15:21:27.043 INFO:teuthology.task.print:Enabling mgr modules 2024-05-14T15:21:27.043 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-05-14T15:21:27.044 INFO:teuthology.task.exec:Executing custom commands... 2024-05-14T15:21:27.044 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2024-05-14T15:21:27.044 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-05-14T15:21:27.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:26 smithi092 ceph-mon[34729]: pgmap v553: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:21:27.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:26 smithi069 ceph-mon[31270]: pgmap v553: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:21:27.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.316+0000 7f158fe00640 1 -- 172.21.15.69:0/3934970519 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1590104cd0 msgr2=0x7f15901050e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:27.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.316+0000 7f158fe00640 1 --2- 172.21.15.69:0/3934970519 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1590104cd0 0x7f15901050e0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f1578009900 tx=0x7f157802a410 comp rx=0 tx=0).stop 2024-05-14T15:21:27.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.316+0000 7f158fe00640 1 -- 172.21.15.69:0/3934970519 shutdown_connections 2024-05-14T15:21:27.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.316+0000 7f158fe00640 1 --2- 172.21.15.69:0/3934970519 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f15901099d0 0x7f159010bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.316+0000 7f158fe00640 1 --2- 172.21.15.69:0/3934970519 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1590104cd0 0x7f15901050e0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.316+0000 7f158fe00640 1 --2- 172.21.15.69:0/3934970519 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1590103a90 0x7f1590104790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.316+0000 7f158fe00640 1 -- 172.21.15.69:0/3934970519 >> 172.21.15.69:0/3934970519 conn(0x7f15900fec80 msgr2=0x7f1590101130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:27.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.316+0000 7f158fe00640 1 -- 172.21.15.69:0/3934970519 shutdown_connections 2024-05-14T15:21:27.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.316+0000 7f158fe00640 1 -- 172.21.15.69:0/3934970519 wait complete. 2024-05-14T15:21:27.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.317+0000 7f158fe00640 1 Processor -- start 2024-05-14T15:21:27.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.317+0000 7f158fe00640 1 -- start start 2024-05-14T15:21:27.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.317+0000 7f158fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1590103a90 0x7f159019c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:27.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.317+0000 7f158fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1590104cd0 0x7f159019c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:27.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.317+0000 7f158fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15901099d0 0x7f15901a37d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:27.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.317+0000 7f158fe00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f159010f470 con 0x7f15901099d0 2024-05-14T15:21:27.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.318+0000 7f158fe00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f159010f2f0 con 0x7f1590103a90 2024-05-14T15:21:27.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.318+0000 7f158fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f159010f5f0 con 0x7f1590104cd0 2024-05-14T15:21:27.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.318+0000 7f158f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15901099d0 0x7f15901a37d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:27.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.318+0000 7f158f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15901099d0 0x7f15901a37d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35312/0 (socket says 172.21.15.69:35312) 2024-05-14T15:21:27.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.318+0000 7f158f400640 1 -- 172.21.15.69:0/3800376591 learned_addr learned my addr 172.21.15.69:0/3800376591 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:27.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.318+0000 7f158ea00640 1 --2- 172.21.15.69:0/3800376591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1590103a90 0x7f159019c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:27.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.318+0000 7f1586000640 1 --2- 172.21.15.69:0/3800376591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1590104cd0 0x7f159019c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:27.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.318+0000 7f158f400640 1 -- 172.21.15.69:0/3800376591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1590104cd0 msgr2=0x7f159019c840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:27.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.318+0000 7f158f400640 1 --2- 172.21.15.69:0/3800376591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1590104cd0 0x7f159019c840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.318+0000 7f158f400640 1 -- 172.21.15.69:0/3800376591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1590103a90 msgr2=0x7f159019c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:27.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.318+0000 7f158f400640 1 --2- 172.21.15.69:0/3800376591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1590103a90 0x7f159019c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.318+0000 7f158f400640 1 -- 172.21.15.69:0/3800376591 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15901a3e40 con 0x7f15901099d0 2024-05-14T15:21:27.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.318+0000 7f1586000640 1 --2- 172.21.15.69:0/3800376591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1590104cd0 0x7f159019c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:27.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.319+0000 7f158f400640 1 --2- 172.21.15.69:0/3800376591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15901099d0 0x7f15901a37d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f158800eaa0 tx=0x7f158800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:27.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.319+0000 7f1587e00640 1 -- 172.21.15.69:0/3800376591 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f158800cdb0 con 0x7f15901099d0 2024-05-14T15:21:27.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.319+0000 7f1587e00640 1 -- 172.21.15.69:0/3800376591 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1588005020 con 0x7f15901099d0 2024-05-14T15:21:27.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.319+0000 7f158fe00640 1 -- 172.21.15.69:0/3800376591 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15901a4130 con 0x7f15901099d0 2024-05-14T15:21:27.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.319+0000 7f1587e00640 1 -- 172.21.15.69:0/3800376591 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15880116d0 con 0x7f15901099d0 2024-05-14T15:21:27.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.319+0000 7f158fe00640 1 -- 172.21.15.69:0/3800376591 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15901a4680 con 0x7f15901099d0 2024-05-14T15:21:27.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.320+0000 7f158fe00640 1 -- 172.21.15.69:0/3800376591 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15901a4940 con 0x7f15901099d0 2024-05-14T15:21:27.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.324+0000 7f1587e00640 1 -- 172.21.15.69:0/3800376591 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 18) ==== 149652+0+0 (secure 0 0 0) 0x7f15880051d0 con 0x7f15901099d0 2024-05-14T15:21:27.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.326+0000 7f1587e00640 1 --2- 172.21.15.69:0/3800376591 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f15740b27e0 0x7f15740b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:27.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.326+0000 7f1587e00640 1 -- 172.21.15.69:0/3800376591 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f15880e2c70 con 0x7f15901099d0 2024-05-14T15:21:27.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.326+0000 7f158ea00640 1 --2- 172.21.15.69:0/3800376591 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f15740b27e0 0x7f15740b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:27.326 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.327+0000 7f158ea00640 1 --2- 172.21.15.69:0/3800376591 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f15740b27e0 0x7f15740b4cf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1580005fd0 tx=0x7f1580005850 comp rx=0 tx=0).ready entity=mgr.14152 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:27.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.329+0000 7f1587e00640 1 -- 172.21.15.69:0/3800376591 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f1588016030 con 0x7f15901099d0 2024-05-14T15:21:27.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:26 smithi203 ceph-mon[34567]: pgmap v553: 129 pgs: 129 active+clean; 650 KiB data, 375 MiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:21:27.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.596+0000 7f158fe00640 1 -- 172.21.15.69:0/3800376591 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f15901a4b10 con 0x7f15901099d0 2024-05-14T15:21:27.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.953+0000 7f1587e00640 1 -- 172.21.15.69:0/3800376591 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f15880aa560 con 0x7f15901099d0 2024-05-14T15:21:27.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.957+0000 7f158fe00640 1 -- 172.21.15.69:0/3800376591 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f15740b27e0 msgr2=0x7f15740b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:27.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.957+0000 7f158fe00640 1 --2- 172.21.15.69:0/3800376591 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f15740b27e0 0x7f15740b4cf0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f1580005fd0 tx=0x7f1580005850 comp rx=0 tx=0).stop 2024-05-14T15:21:27.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.957+0000 7f158fe00640 1 -- 172.21.15.69:0/3800376591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15901099d0 msgr2=0x7f15901a37d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:27.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.957+0000 7f158fe00640 1 --2- 172.21.15.69:0/3800376591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15901099d0 0x7f15901a37d0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f158800eaa0 tx=0x7f158800ef60 comp rx=0 tx=0).stop 2024-05-14T15:21:27.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.957+0000 7f158fe00640 1 -- 172.21.15.69:0/3800376591 shutdown_connections 2024-05-14T15:21:27.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.957+0000 7f158fe00640 1 --2- 172.21.15.69:0/3800376591 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f15740b27e0 0x7f15740b4cf0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.957+0000 7f158fe00640 1 --2- 172.21.15.69:0/3800376591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f15901099d0 0x7f15901a37d0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.957+0000 7f158fe00640 1 --2- 172.21.15.69:0/3800376591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1590104cd0 0x7f159019c840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.957+0000 7f158fe00640 1 --2- 172.21.15.69:0/3800376591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1590103a90 0x7f159019c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:27.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.957+0000 7f158fe00640 1 -- 172.21.15.69:0/3800376591 >> 172.21.15.69:0/3800376591 conn(0x7f15900fec80 msgr2=0x7f15901010a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:27.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.957+0000 7f158fe00640 1 -- 172.21.15.69:0/3800376591 shutdown_connections 2024-05-14T15:21:27.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:27.957+0000 7f158fe00640 1 -- 172.21.15.69:0/3800376591 wait complete. 2024-05-14T15:21:27.993 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-14T15:21:28.003 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-14T15:21:28.003 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-14T15:21:28.003 INFO:tasks.ceph_fuse:client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2024-05-14T15:21:28.004 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-14T15:21:28.004 INFO:tasks.cephfs.mount:using client_config["hostfs_mntpt"] = /tmp/cephfs 2024-05-14T15:21:28.004 INFO:tasks.cephfs.mount:hostfs_mntpt = /tmp/cephfs 2024-05-14T15:21:28.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:28.004 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2024-05-14T15:21:28.043 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-14T15:21:28.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:28.043 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-14T15:21:28.157 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:28.158 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2024-05-14T15:21:28.191 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:27 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3800376591' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-14T15:21:28.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:27 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3800376591' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-14T15:21:28.192 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:28 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: ignoring --setuser ceph since I am not root 2024-05-14T15:21:28.192 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:28 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: ignoring --setgroup ceph since I am not root 2024-05-14T15:21:28.192 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:28 smithi092 ceph-mgr[36107]: -- 172.21.15.92:0/3878575755 <== mon.0 v2:172.21.15.69:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55c5f73245a0 con 0x55c5fc0ae000 2024-05-14T15:21:28.215 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:27 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3800376591' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-05-14T15:21:28.215 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:28 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: ignoring --setuser ceph since I am not root 2024-05-14T15:21:28.215 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:28 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: ignoring --setgroup ceph since I am not root 2024-05-14T15:21:28.262 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-14T15:21:28.263 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs ls 2024-05-14T15:21:28.473 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:28 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:28.362+0000 7f0449b0d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T15:21:28.594 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:28 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: ignoring --setuser ceph since I am not root 2024-05-14T15:21:28.594 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:28 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: ignoring --setgroup ceph since I am not root 2024-05-14T15:21:28.595 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:28 smithi203 ceph-mgr[36564]: -- 172.21.15.203:0/3931160781 <== mon.2 v2:172.21.15.92:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5580b472e5a0 con 0x5580b94b8480 2024-05-14T15:21:28.595 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:28 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:28.375+0000 7fd494b51200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T15:21:28.672 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:21:28.692 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:28 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:28.351+0000 7f8464c08200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-14T15:21:28.692 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:28 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:28.592+0000 7f8464c08200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:21:28.918 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:28 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:28.613+0000 7f0449b0d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:21:28.918 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:28 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:28.760+0000 7f0449b0d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T15:21:28.956 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:28 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:28.632+0000 7fd494b51200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:21:28.956 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:28 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:28.766+0000 7fd494b51200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T15:21:29.145 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:28 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:28.724+0000 7f8464c08200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-14T15:21:29.145 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:28 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3800376591' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-14T15:21:29.145 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:28 smithi092 ceph-mon[34729]: mgrmap e19: x(active, since 15m), standbys: z, y 2024-05-14T15:21:29.174 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:28 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3800376591' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-14T15:21:29.174 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:28 smithi069 ceph-mon[31270]: mgrmap e19: x(active, since 15m), standbys: z, y 2024-05-14T15:21:29.285 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:29 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:29.170+0000 7fd494b51200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T15:21:29.286 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:28 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3800376591' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-05-14T15:21:29.286 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:28 smithi203 ceph-mon[34567]: mgrmap e19: x(active, since 15m), standbys: z, y 2024-05-14T15:21:29.442 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:29 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:29.144+0000 7f8464c08200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T15:21:29.442 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:29 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:29.259+0000 7f8464c08200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T15:21:29.473 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:29 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:29.173+0000 7f0449b0d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-14T15:21:29.473 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:29 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:29.299+0000 7f0449b0d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T15:21:29.594 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:29 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:29.285+0000 7fd494b51200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-14T15:21:31.094 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:30 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:30.834+0000 7fd494b51200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T15:21:31.094 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:31 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:31.067+0000 7fd494b51200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T15:21:31.160 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:30 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:30.914+0000 7f0449b0d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T15:21:31.160 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:31 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:31.158+0000 7f0449b0d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T15:21:31.192 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:30 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:30.793+0000 7f8464c08200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-14T15:21:31.192 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:31 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:31.023+0000 7f8464c08200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-14T15:21:31.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.209+0000 7f1162a00700 1 -- 172.21.15.69:0/861946258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c075b60 msgr2=0x7f115c075f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.209+0000 7f1162a00700 1 --2- 172.21.15.69:0/861946258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c075b60 0x7f115c075f70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f114c009990 tx=0x7f114c009ca0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.209+0000 7f1162a00700 1 -- 172.21.15.69:0/861946258 shutdown_connections 2024-05-14T15:21:31.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.209+0000 7f1162a00700 1 --2- 172.21.15.69:0/861946258 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c075b60 0x7f115c075f70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.209+0000 7f1162a00700 1 --2- 172.21.15.69:0/861946258 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f115c115370 0x7f115c117790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.209+0000 7f1162a00700 1 --2- 172.21.15.69:0/861946258 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f115c0764b0 0x7f115c114e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.209+0000 7f1162a00700 1 -- 172.21.15.69:0/861946258 >> 172.21.15.69:0/861946258 conn(0x7f115c100040 msgr2=0x7f115c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:31.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.209+0000 7f1162a00700 1 -- 172.21.15.69:0/861946258 shutdown_connections 2024-05-14T15:21:31.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.209+0000 7f1162a00700 1 -- 172.21.15.69:0/861946258 wait complete. 2024-05-14T15:21:31.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.210+0000 7f1162a00700 1 Processor -- start 2024-05-14T15:21:31.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.211+0000 7f1162a00700 1 -- start start 2024-05-14T15:21:31.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.211+0000 7f1162a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c075b60 0x7f115c1a1310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.211+0000 7f1162a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f115c0764b0 0x7f115c1a18b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.211+0000 7f1162a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f115c115370 0x7f115c1a5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.211+0000 7f1162a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f115c11a920 con 0x7f115c075b60 2024-05-14T15:21:31.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.211+0000 7f1162a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f115c11a7a0 con 0x7f115c0764b0 2024-05-14T15:21:31.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.211+0000 7f1162a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f115c11aaa0 con 0x7f115c115370 2024-05-14T15:21:31.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.211+0000 7f115be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c075b60 0x7f115c1a1310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.211+0000 7f115be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c075b60 0x7f115c1a1310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35344/0 (socket says 172.21.15.69:35344) 2024-05-14T15:21:31.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.211+0000 7f115be00700 1 -- 172.21.15.69:0/3702427753 learned_addr learned my addr 172.21.15.69:0/3702427753 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:31.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.211+0000 7f115b400700 1 --2- 172.21.15.69:0/3702427753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f115c0764b0 0x7f115c1a18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.212+0000 7f1160a00700 1 --2- 172.21.15.69:0/3702427753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f115c115370 0x7f115c1a5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:31.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.212+0000 7f115be00700 1 -- 172.21.15.69:0/3702427753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f115c115370 msgr2=0x7f115c1a5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.212+0000 7f115be00700 1 --2- 172.21.15.69:0/3702427753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f115c115370 0x7f115c1a5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.212+0000 7f115be00700 1 -- 172.21.15.69:0/3702427753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f115c0764b0 msgr2=0x7f115c1a18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.212+0000 7f115be00700 1 --2- 172.21.15.69:0/3702427753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f115c0764b0 0x7f115c1a18b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.212+0000 7f115be00700 1 -- 172.21.15.69:0/3702427753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f115c1a61e0 con 0x7f115c075b60 2024-05-14T15:21:31.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.212+0000 7f115b400700 1 --2- 172.21.15.69:0/3702427753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f115c0764b0 0x7f115c1a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:21:31.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.212+0000 7f115be00700 1 --2- 172.21.15.69:0/3702427753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c075b60 0x7f115c1a1310 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f114c000c00 tx=0x7f114c0047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:31.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.213+0000 7f1158c00700 1 -- 172.21.15.69:0/3702427753 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c027070 con 0x7f115c075b60 2024-05-14T15:21:31.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.213+0000 7f1158c00700 1 -- 172.21.15.69:0/3702427753 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f114c00fb80 con 0x7f115c075b60 2024-05-14T15:21:31.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.213+0000 7f1162a00700 1 -- 172.21.15.69:0/3702427753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f115c1a6470 con 0x7f115c075b60 2024-05-14T15:21:31.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.213+0000 7f1158c00700 1 -- 172.21.15.69:0/3702427753 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114c022d00 con 0x7f115c075b60 2024-05-14T15:21:31.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.213+0000 7f1162a00700 1 -- 172.21.15.69:0/3702427753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f115c1addf0 con 0x7f115c075b60 2024-05-14T15:21:31.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.214+0000 7f1162a00700 1 -- 172.21.15.69:0/3702427753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f115c0512c0 con 0x7f115c075b60 2024-05-14T15:21:31.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.216+0000 7f1158c00700 1 -- 172.21.15.69:0/3702427753 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 19) ==== 149669+0+0 (secure 0 0 0) 0x7f114c02a070 con 0x7f115c075b60 2024-05-14T15:21:31.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.218+0000 7f1158c00700 1 --2- 172.21.15.69:0/3702427753 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11400b2950 0x7f11400b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:31.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.218+0000 7f115b400700 1 -- 172.21.15.69:0/3702427753 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11400b2950 msgr2=0x7f11400b4e60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2537958790 2024-05-14T15:21:31.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.218+0000 7f1158c00700 1 -- 172.21.15.69:0/3702427753 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f114c0e3840 con 0x7f115c075b60 2024-05-14T15:21:31.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.218+0000 7f115b400700 1 --2- 172.21.15.69:0/3702427753 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11400b2950 0x7f11400b4e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T15:21:31.221 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.221+0000 7f1158c00700 1 -- 172.21.15.69:0/3702427753 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f114c031080 con 0x7f115c075b60 2024-05-14T15:21:31.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.419+0000 7f115b400700 1 -- 172.21.15.69:0/3702427753 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11400b2950 msgr2=0x7f11400b4e60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2537958790 2024-05-14T15:21:31.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.419+0000 7f115b400700 1 --2- 172.21.15.69:0/3702427753 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11400b2950 0x7f11400b4e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T15:21:31.419 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:31 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:31.385+0000 7f0449b0d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T15:21:31.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.504+0000 7f1162a00700 1 -- 172.21.15.69:0/3702427753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f115c1a2670 con 0x7f115c075b60 2024-05-14T15:21:31.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.505+0000 7f1158c00700 1 -- 172.21.15.69:0/3702427753 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v29) ==== 53+0+88 (secure 0 0 0) 0x7f114c013070 con 0x7f115c075b60 2024-05-14T15:21:31.505 INFO:teuthology.orchestra.run.smithi069.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-14T15:21:31.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.507+0000 7f1162a00700 1 -- 172.21.15.69:0/3702427753 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11400b2950 msgr2=0x7f11400b4e60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T15:21:31.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.507+0000 7f1162a00700 1 --2- 172.21.15.69:0/3702427753 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11400b2950 0x7f11400b4e60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.507+0000 7f1162a00700 1 -- 172.21.15.69:0/3702427753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c075b60 msgr2=0x7f115c1a1310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:31.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.507+0000 7f1162a00700 1 --2- 172.21.15.69:0/3702427753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c075b60 0x7f115c1a1310 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f114c000c00 tx=0x7f114c0047b0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.508+0000 7f1162a00700 1 -- 172.21.15.69:0/3702427753 shutdown_connections 2024-05-14T15:21:31.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.508+0000 7f1162a00700 1 --2- 172.21.15.69:0/3702427753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f115c075b60 0x7f115c1a1310 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.508+0000 7f1162a00700 1 --2- 172.21.15.69:0/3702427753 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f11400b2950 0x7f11400b4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.508+0000 7f1162a00700 1 --2- 172.21.15.69:0/3702427753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f115c115370 0x7f115c1a5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.508+0000 7f1162a00700 1 --2- 172.21.15.69:0/3702427753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f115c0764b0 0x7f115c1a18b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:31.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.508+0000 7f1162a00700 1 -- 172.21.15.69:0/3702427753 >> 172.21.15.69:0/3702427753 conn(0x7f115c100040 msgr2=0x7f115c102060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:31.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.508+0000 7f1162a00700 1 -- 172.21.15.69:0/3702427753 shutdown_connections 2024-05-14T15:21:31.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:31.508+0000 7f1162a00700 1 -- 172.21.15.69:0/3702427753 wait complete. 2024-05-14T15:21:31.558 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:31 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:31.241+0000 7f8464c08200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T15:21:31.558 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:31 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:31.290+0000 7fd494b51200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-14T15:21:31.722 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:31 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3702427753' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-14T15:21:31.815 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:31 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3702427753' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-14T15:21:31.815 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:31 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:31.686+0000 7fd494b51200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T15:21:31.816 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:31 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:31.815+0000 7fd494b51200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T15:21:31.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:31 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3702427753' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-05-14T15:21:31.942 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:31 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:31.630+0000 7f8464c08200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T15:21:31.942 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:31 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:31.758+0000 7f8464c08200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T15:21:32.050 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:31 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:31.783+0000 7f0449b0d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-14T15:21:32.050 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:31 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:31.913+0000 7f0449b0d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-14T15:21:32.271 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:32 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:32.010+0000 7f8464c08200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T15:21:32.329 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:32 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:32.070+0000 7fd494b51200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T15:21:32.438 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:32 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:32.172+0000 7f0449b0d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-14T15:21:32.578 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-14T15:21:32.578 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-14T15:21:32.578 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi069.front.sepia.ceph.com 2024-05-14T15:21:32.578 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-14T15:21:32.579 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /tmp/cephfs 2024-05-14T15:21:32.579 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-14T15:21:32.579 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-14T15:21:32.579 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-14T15:21:32.579 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/tmp/cephfs' 2024-05-14T15:21:32.579 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:32.579 DEBUG:teuthology.orchestra.run.smithi069:> ip addr 2024-05-14T15:21:32.593 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:32 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:32.328+0000 7fd494b51200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:21:32.631 INFO:teuthology.orchestra.run.smithi069.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-14T15:21:32.631 INFO:teuthology.orchestra.run.smithi069.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-14T15:21:32.631 INFO:teuthology.orchestra.run.smithi069.stdout: inet 127.0.0.1/8 scope host lo 2024-05-14T15:21:32.631 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:21:32.631 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 ::1/128 scope host 2024-05-14T15:21:32.631 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:21:32.631 INFO:teuthology.orchestra.run.smithi069.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:21:32.632 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c2 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:21:32.632 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f0 2024-05-14T15:21:32.632 INFO:teuthology.orchestra.run.smithi069.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:21:32.632 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:d8:d9:c3 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:21:32.632 INFO:teuthology.orchestra.run.smithi069.stdout: altname enp7s0f1 2024-05-14T15:21:32.632 INFO:teuthology.orchestra.run.smithi069.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-05-14T15:21:32.632 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:36 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:21:32.632 INFO:teuthology.orchestra.run.smithi069.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-14T15:21:32.632 INFO:teuthology.orchestra.run.smithi069.stdout: link/ether 0c:c4:7a:8f:d7:37 brd ff:ff:ff:ff:ff:ff 2024-05-14T15:21:32.632 INFO:teuthology.orchestra.run.smithi069.stdout: inet 172.21.15.69/20 brd 172.21.15.255 scope global dynamic enp3s0f1 2024-05-14T15:21:32.632 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft 41551sec preferred_lft 41551sec 2024-05-14T15:21:32.632 INFO:teuthology.orchestra.run.smithi069.stdout: inet6 fe80::ec4:7aff:fe8f:d737/64 scope link 2024-05-14T15:21:32.632 INFO:teuthology.orchestra.run.smithi069.stdout: valid_lft forever preferred_lft forever 2024-05-14T15:21:32.633 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-14T15:21:32.633 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:21:32.634 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-05-14T15:21:32.634 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add name ceph-brx type bridge 2024-05-14T15:21:32.634 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr flush dev ceph-brx 2024-05-14T15:21:32.634 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set ceph-brx up 2024-05-14T15:21:32.634 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-14T15:21:32.634 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-05-14T15:21:32.692 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:32 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:32.271+0000 7f8464c08200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:21:32.722 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:32 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:32.437+0000 7f0449b0d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-14T15:21:32.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:32 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:21:32.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:32 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:21:32.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:32.859 DEBUG:teuthology.orchestra.run.smithi069:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-14T15:21:32.916 INFO:teuthology.orchestra.run.smithi069.stdout:1 2024-05-14T15:21:32.920 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:32.920 DEBUG:teuthology.orchestra.run.smithi069:> route 2024-05-14T15:21:32.961 INFO:teuthology.orchestra.run.smithi069.stdout:Kernel IP routing table 2024-05-14T15:21:32.961 INFO:teuthology.orchestra.run.smithi069.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-14T15:21:32.961 INFO:teuthology.orchestra.run.smithi069.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-05-14T15:21:32.961 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-05-14T15:21:32.961 INFO:teuthology.orchestra.run.smithi069.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-14T15:21:32.961 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:21:32.961 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-05-14T15:21:32.961 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-05-14T15:21:32.961 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-05-14T15:21:32.962 DEBUG:teuthology.orchestra.run.smithi069:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-05-14T15:21:32.962 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-05-14T15:21:33.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:21:33.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:21:33.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:33.205 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2024-05-14T15:21:33.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:33.244 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list-id 2024-05-14T15:21:33.331 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:21:33.331 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-05-14T15:21:33.331 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns add ceph-ns--tmp-cephfs 2024-05-14T15:21:33.331 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns set ceph-ns--tmp-cephfs 0 2024-05-14T15:21:33.331 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-05-14T15:21:33.372 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:33 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:33.068+0000 7f8464c08200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T15:21:33.421 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:33 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:33.129+0000 7fd494b51200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T15:21:33.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:21:33.447 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:33 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:33.295+0000 7f0449b0d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-14T15:21:33.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:21:33.495 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--tmp-cephfs' with 192.168.0.1/16 2024-05-14T15:21:33.495 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:21:33.495 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-05-14T15:21:33.495 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link add veth0 netns ceph-ns--tmp-cephfs type veth peer name brx.0 2024-05-14T15:21:33.495 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--tmp-cephfs ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-14T15:21:33.495 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set veth0 up 2024-05-14T15:21:33.496 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--tmp-cephfs ip link set lo up 2024-05-14T15:21:33.496 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns exec ceph-ns--tmp-cephfs ip route add default via 192.168.255.254 2024-05-14T15:21:33.496 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-05-14T15:21:33.587 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:21:33.692 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:33 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:33.372+0000 7f8464c08200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T15:21:33.702 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:33 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:33.600+0000 7f0449b0d200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T15:21:33.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:21:33.752 DEBUG:teuthology.orchestra.run.smithi069:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-14T15:21:33.752 DEBUG:teuthology.orchestra.run.smithi069:> set -e 2024-05-14T15:21:33.752 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set brx.0 up 2024-05-14T15:21:33.752 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link set dev brx.0 master ceph-brx 2024-05-14T15:21:33.752 DEBUG:teuthology.orchestra.run.smithi069:> ') 2024-05-14T15:21:33.844 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:33 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:33.420+0000 7fd494b51200 -1 mgr[py] Module smb has missing NOTIFY_TYPES member 2024-05-14T15:21:33.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-14T15:21:33.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:21:33.946 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mntopts': ['context=system_u:object_r:postgresql_db_t:s0'], 'mount_subvol_num': 0, 'mountpoint': '/tmp/cephfs'} 2024-05-14T15:21:33.946 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T15:21:33.946 DEBUG:teuthology.orchestra.run.smithi069:> mkdir -p -v /tmp/cephfs 2024-05-14T15:21:33.984 INFO:teuthology.orchestra.run.smithi069.stdout:mkdir: created directory '/tmp/cephfs' 2024-05-14T15:21:33.985 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-14T15:21:33.985 DEBUG:teuthology.orchestra.run.smithi069:> chmod 0000 /tmp/cephfs 2024-05-14T15:21:34.075 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2024-05-14T15:21:34.144 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:21:34.189 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2024-05-14T15:21:34.189 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2024-05-14T15:21:34.189 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2024-05-14T15:21:34.189 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2024-05-14T15:21:34.190 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2024-05-14T15:21:34.190 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2024-05-14T15:21:34.190 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2024-05-14T15:21:34.190 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2024-05-14T15:21:34.190 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2024-05-14T15:21:34.190 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2024-05-14T15:21:34.190 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2024-05-14T15:21:34.190 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/selinux 2024-05-14T15:21:34.190 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:21:34.190 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2024-05-14T15:21:34.190 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2024-05-14T15:21:34.190 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2024-05-14T15:21:34.190 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2024-05-14T15:21:34.190 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2024-05-14T15:21:34.191 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2024-05-14T15:21:34.191 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:21:34.191 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:21:34.191 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:21:34.191 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:21:34.191 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2024-05-14T15:21:34.191 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2024-05-14T15:21:34.191 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay 2024-05-14T15:21:34.191 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/5e40dcee2d34a7c73312d2a62b71b273d7836197c328f2cd1e28f2747834d977/merged 2024-05-14T15:21:34.191 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/42a44ff852989d71ff9a897904d6b347f51d25b6a57af244156c764075ff3af4/merged 2024-05-14T15:21:34.191 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/0 2024-05-14T15:21:34.191 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:21:34.191 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/b8624fa2e7b18aecb475451084832d73f5d668c63b5da4a1fbfe8b742561717a/merged 2024-05-14T15:21:34.191 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/b67af23fe014f7a3b108526f9a0c8a2894d29db7b285ec99143475cac7dacb5f/merged 2024-05-14T15:21:34.191 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/81eb344721fe12b43e9c2a86db05cb2de131cc235bef4301e1eeedaa8388cbd0/merged 2024-05-14T15:21:34.192 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/0ca3d4e915c5e200ec9d2c97b5327557927f34b22e7b181f51a17e2aae97e635/merged 2024-05-14T15:21:34.192 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/bdacda6ce5aaf45c1476023ef9d3f231de86b4f2deeef927301aff2e4707e393/merged 2024-05-14T15:21:34.192 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/156f4db5c94684f70faa9684e7fc8c64f9155ad03c356113bb75f0c85aaa3e68/merged 2024-05-14T15:21:34.192 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/108b890c31e910e20019fffa3abeebced11a3c4b53e2ea2a411560bbabc9d3d6/merged 2024-05-14T15:21:34.192 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/d30df3a851fc743e5fd93c9c6b69fceae321ee98ed59178c5cdc8543b4bf743d/merged 2024-05-14T15:21:34.192 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2024-05-14T15:21:34.192 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-05-14T15:21:34.192 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-05-14T15:21:34.192 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:33 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:33.932+0000 7f8464c08200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T15:21:34.193 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:34 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:34.062+0000 7f8464c08200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T15:21:34.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:34.193 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2024-05-14T15:21:34.237 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-14T15:21:34.237 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--tmp-cephfs sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /tmp/cephfs --id 0 --client_mountpoint=/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66 --client_fs=cephfs -o context=system_u:object_r:postgresql_db_t:s0) 2024-05-14T15:21:34.282 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2024-05-14T15:21:34.344 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:33 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:33.984+0000 7fd494b51200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T15:21:34.344 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:34 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:34.114+0000 7fd494b51200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T15:21:34.345 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:21:34.387 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2024-05-14T15:21:34.387 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2024-05-14T15:21:34.387 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2024-05-14T15:21:34.387 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2024-05-14T15:21:34.387 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2024-05-14T15:21:34.387 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2024-05-14T15:21:34.387 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2024-05-14T15:21:34.387 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2024-05-14T15:21:34.387 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2024-05-14T15:21:34.387 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2024-05-14T15:21:34.387 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2024-05-14T15:21:34.387 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/selinux 2024-05-14T15:21:34.387 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:21:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2024-05-14T15:21:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2024-05-14T15:21:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2024-05-14T15:21:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2024-05-14T15:21:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2024-05-14T15:21:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2024-05-14T15:21:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:21:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:21:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:21:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:21:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2024-05-14T15:21:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2024-05-14T15:21:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay 2024-05-14T15:21:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/5e40dcee2d34a7c73312d2a62b71b273d7836197c328f2cd1e28f2747834d977/merged 2024-05-14T15:21:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/42a44ff852989d71ff9a897904d6b347f51d25b6a57af244156c764075ff3af4/merged 2024-05-14T15:21:34.388 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/0 2024-05-14T15:21:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:21:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/b8624fa2e7b18aecb475451084832d73f5d668c63b5da4a1fbfe8b742561717a/merged 2024-05-14T15:21:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/b67af23fe014f7a3b108526f9a0c8a2894d29db7b285ec99143475cac7dacb5f/merged 2024-05-14T15:21:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/81eb344721fe12b43e9c2a86db05cb2de131cc235bef4301e1eeedaa8388cbd0/merged 2024-05-14T15:21:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/0ca3d4e915c5e200ec9d2c97b5327557927f34b22e7b181f51a17e2aae97e635/merged 2024-05-14T15:21:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/bdacda6ce5aaf45c1476023ef9d3f231de86b4f2deeef927301aff2e4707e393/merged 2024-05-14T15:21:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/156f4db5c94684f70faa9684e7fc8c64f9155ad03c356113bb75f0c85aaa3e68/merged 2024-05-14T15:21:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/108b890c31e910e20019fffa3abeebced11a3c4b53e2ea2a411560bbabc9d3d6/merged 2024-05-14T15:21:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/d30df3a851fc743e5fd93c9c6b69fceae321ee98ed59178c5cdc8543b4bf743d/merged 2024-05-14T15:21:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2024-05-14T15:21:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-05-14T15:21:34.389 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-05-14T15:21:34.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:34.390 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2024-05-14T15:21:34.472 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:34 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:34.196+0000 7f0449b0d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-14T15:21:34.472 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:34 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:34.337+0000 7f0449b0d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-14T15:21:34.524 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:2024-05-14T15:21:34.523+0000 7fa05751f480 -1 init, newargv = 0x7fa0380047e0 newargc=17 2024-05-14T15:21:34.524 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[88593]: starting ceph client 2024-05-14T15:21:34.579 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[88593]: starting fuse 2024-05-14T15:21:34.844 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:34 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:34.592+0000 7fd494b51200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T15:21:34.942 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:34 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:34.533+0000 7f8464c08200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T15:21:35.223 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:34 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:34.827+0000 7f0449b0d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-14T15:21:35.344 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:35 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:35.051+0000 7fd494b51200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T15:21:35.344 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:35 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:35.180+0000 7fd494b51200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T15:21:35.442 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:35 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:35.004+0000 7f8464c08200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T15:21:35.442 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:35 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:35.131+0000 7f8464c08200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T15:21:35.576 DEBUG:teuthology.orchestra.run.smithi069:> sudo modprobe fuse 2024-05-14T15:21:35.639 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:35 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:35.294+0000 7f0449b0d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-14T15:21:35.639 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:35 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:35.423+0000 7f0449b0d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-14T15:21:35.649 DEBUG:teuthology.orchestra.run.smithi069:> cat /proc/self/mounts | awk '{print $2}' 2024-05-14T15:21:35.694 INFO:teuthology.orchestra.run.smithi069.stdout:/proc 2024-05-14T15:21:35.694 INFO:teuthology.orchestra.run.smithi069.stdout:/sys 2024-05-14T15:21:35.694 INFO:teuthology.orchestra.run.smithi069.stdout:/dev 2024-05-14T15:21:35.695 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/security 2024-05-14T15:21:35.695 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/shm 2024-05-14T15:21:35.695 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/pts 2024-05-14T15:21:35.695 INFO:teuthology.orchestra.run.smithi069.stdout:/run 2024-05-14T15:21:35.695 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/cgroup 2024-05-14T15:21:35.695 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/pstore 2024-05-14T15:21:35.695 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/bpf 2024-05-14T15:21:35.695 INFO:teuthology.orchestra.run.smithi069.stdout:/ 2024-05-14T15:21:35.695 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/selinux 2024-05-14T15:21:35.695 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:21:35.695 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/mqueue 2024-05-14T15:21:35.695 INFO:teuthology.orchestra.run.smithi069.stdout:/dev/hugepages 2024-05-14T15:21:35.695 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/debug 2024-05-14T15:21:35.695 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/tracing 2024-05-14T15:21:35.695 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/fs/fuse/connections 2024-05-14T15:21:35.695 INFO:teuthology.orchestra.run.smithi069.stdout:/sys/kernel/config 2024-05-14T15:21:35.696 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-sysctl.service 2024-05-14T15:21:35.696 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-05-14T15:21:35.696 INFO:teuthology.orchestra.run.smithi069.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-05-14T15:21:35.696 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/nfs/rpc_pipefs 2024-05-14T15:21:35.696 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/1000 2024-05-14T15:21:35.696 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/ceph 2024-05-14T15:21:35.696 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay 2024-05-14T15:21:35.696 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/5e40dcee2d34a7c73312d2a62b71b273d7836197c328f2cd1e28f2747834d977/merged 2024-05-14T15:21:35.696 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/42a44ff852989d71ff9a897904d6b347f51d25b6a57af244156c764075ff3af4/merged 2024-05-14T15:21:35.696 INFO:teuthology.orchestra.run.smithi069.stdout:/run/user/0 2024-05-14T15:21:35.696 INFO:teuthology.orchestra.run.smithi069.stdout:/proc/sys/fs/binfmt_misc 2024-05-14T15:21:35.696 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/b8624fa2e7b18aecb475451084832d73f5d668c63b5da4a1fbfe8b742561717a/merged 2024-05-14T15:21:35.696 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/b67af23fe014f7a3b108526f9a0c8a2894d29db7b285ec99143475cac7dacb5f/merged 2024-05-14T15:21:35.696 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/81eb344721fe12b43e9c2a86db05cb2de131cc235bef4301e1eeedaa8388cbd0/merged 2024-05-14T15:21:35.696 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/0ca3d4e915c5e200ec9d2c97b5327557927f34b22e7b181f51a17e2aae97e635/merged 2024-05-14T15:21:35.696 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/bdacda6ce5aaf45c1476023ef9d3f231de86b4f2deeef927301aff2e4707e393/merged 2024-05-14T15:21:35.697 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/156f4db5c94684f70faa9684e7fc8c64f9155ad03c356113bb75f0c85aaa3e68/merged 2024-05-14T15:21:35.697 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/108b890c31e910e20019fffa3abeebced11a3c4b53e2ea2a411560bbabc9d3d6/merged 2024-05-14T15:21:35.697 INFO:teuthology.orchestra.run.smithi069.stdout:/var/lib/containers/storage/overlay/d30df3a851fc743e5fd93c9c6b69fceae321ee98ed59178c5cdc8543b4bf743d/merged 2024-05-14T15:21:35.697 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns 2024-05-14T15:21:35.697 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-05-14T15:21:35.697 INFO:teuthology.orchestra.run.smithi069.stdout:/run/netns/ceph-ns--tmp-cephfs 2024-05-14T15:21:35.697 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs 2024-05-14T15:21:35.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:35.698 DEBUG:teuthology.orchestra.run.smithi069:> ls /sys/fs/fuse/connections 2024-05-14T15:21:35.772 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:35 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:35.462+0000 7f8464c08200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T15:21:35.772 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:35 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:35.644+0000 7f8464c08200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T15:21:35.785 INFO:teuthology.orchestra.run.smithi069.stdout:119 2024-05-14T15:21:35.785 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-05-14T15:21:35.785 DEBUG:teuthology.orchestra.run.smithi069:> sudo stdin-killer -- python3 -c ' 2024-05-14T15:21:35.785 DEBUG:teuthology.orchestra.run.smithi069:> import glob 2024-05-14T15:21:35.785 DEBUG:teuthology.orchestra.run.smithi069:> import re 2024-05-14T15:21:35.785 DEBUG:teuthology.orchestra.run.smithi069:> import os 2024-05-14T15:21:35.785 DEBUG:teuthology.orchestra.run.smithi069:> import subprocess 2024-05-14T15:21:35.786 DEBUG:teuthology.orchestra.run.smithi069:> 2024-05-14T15:21:35.786 DEBUG:teuthology.orchestra.run.smithi069:> def _find_admin_socket(client_name): 2024-05-14T15:21:35.786 DEBUG:teuthology.orchestra.run.smithi069:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-14T15:21:35.786 DEBUG:teuthology.orchestra.run.smithi069:> files = glob.glob(asok_path) 2024-05-14T15:21:35.786 DEBUG:teuthology.orchestra.run.smithi069:> mountpoint = "/tmp/cephfs" 2024-05-14T15:21:35.786 DEBUG:teuthology.orchestra.run.smithi069:> 2024-05-14T15:21:35.786 DEBUG:teuthology.orchestra.run.smithi069:> # Given a non-glob path, it better be there 2024-05-14T15:21:35.786 DEBUG:teuthology.orchestra.run.smithi069:> if "*" not in asok_path: 2024-05-14T15:21:35.786 DEBUG:teuthology.orchestra.run.smithi069:> assert(len(files) == 1) 2024-05-14T15:21:35.786 DEBUG:teuthology.orchestra.run.smithi069:> return files[0] 2024-05-14T15:21:35.786 DEBUG:teuthology.orchestra.run.smithi069:> 2024-05-14T15:21:35.786 DEBUG:teuthology.orchestra.run.smithi069:> for f in files: 2024-05-14T15:21:35.786 DEBUG:teuthology.orchestra.run.smithi069:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-14T15:21:35.786 DEBUG:teuthology.orchestra.run.smithi069:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-14T15:21:35.786 DEBUG:teuthology.orchestra.run.smithi069:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-14T15:21:35.787 DEBUG:teuthology.orchestra.run.smithi069:> contents = proc_f.read() 2024-05-14T15:21:35.787 DEBUG:teuthology.orchestra.run.smithi069:> if mountpoint in contents: 2024-05-14T15:21:35.787 DEBUG:teuthology.orchestra.run.smithi069:> return f 2024-05-14T15:21:35.787 DEBUG:teuthology.orchestra.run.smithi069:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-14T15:21:35.787 DEBUG:teuthology.orchestra.run.smithi069:> 2024-05-14T15:21:35.787 DEBUG:teuthology.orchestra.run.smithi069:> print(_find_admin_socket("client.0")) 2024-05-14T15:21:35.787 DEBUG:teuthology.orchestra.run.smithi069:> ' 2024-05-14T15:21:35.821 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:35 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:35.507+0000 7fd494b51200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T15:21:35.821 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:35 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:35.689+0000 7fd494b51200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T15:21:35.821 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:35 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:35.821+0000 7fd494b51200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T15:21:35.940 INFO:teuthology.orchestra.run.smithi069.stdout:/var/run/ceph/ceph-client.0.88593.asok 2024-05-14T15:21:35.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-14T15:21:35.954 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:35 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:35.762+0000 7f0449b0d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-14T15:21:35.957 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.88593.asok 2024-05-14T15:21:35.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:35.957 DEBUG:teuthology.orchestra.run.smithi069:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.88593.asok status 2024-05-14T15:21:36.172 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:35 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:35.771+0000 7f8464c08200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T15:21:36.223 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:35 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:35.955+0000 7f0449b0d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-14T15:21:36.223 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:36 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:36.092+0000 7f0449b0d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-14T15:21:36.240 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:21:36.240 INFO:teuthology.orchestra.run.smithi069.stdout: "metadata": { 2024-05-14T15:21:36.240 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_sha1": "e2b755a64f0d72176b57299d02e880cf0620d780", 2024-05-14T15:21:36.240 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_version": "ceph version 19.0.0-3588-ge2b755a6 (e2b755a64f0d72176b57299d02e880cf0620d780) squid (dev)", 2024-05-14T15:21:36.240 INFO:teuthology.orchestra.run.smithi069.stdout: "entity_id": "0", 2024-05-14T15:21:36.240 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": "smithi069", 2024-05-14T15:21:36.240 INFO:teuthology.orchestra.run.smithi069.stdout: "mount_point": "/tmp/cephfs", 2024-05-14T15:21:36.241 INFO:teuthology.orchestra.run.smithi069.stdout: "pid": "88593", 2024-05-14T15:21:36.241 INFO:teuthology.orchestra.run.smithi069.stdout: "root": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66" 2024-05-14T15:21:36.241 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:21:36.241 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_count": 0, 2024-05-14T15:21:36.241 INFO:teuthology.orchestra.run.smithi069.stdout: "dentry_pinned_count": 0, 2024-05-14T15:21:36.241 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 25000, 2024-05-14T15:21:36.241 INFO:teuthology.orchestra.run.smithi069.stdout: "inst": { 2024-05-14T15:21:36.241 INFO:teuthology.orchestra.run.smithi069.stdout: "name": { 2024-05-14T15:21:36.241 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "client", 2024-05-14T15:21:36.241 INFO:teuthology.orchestra.run.smithi069.stdout: "num": 25000 2024-05-14T15:21:36.241 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:21:36.241 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2024-05-14T15:21:36.241 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2024-05-14T15:21:36.241 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2024-05-14T15:21:36.241 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 493016034 2024-05-14T15:21:36.242 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:21:36.242 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:21:36.242 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": { 2024-05-14T15:21:36.242 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2024-05-14T15:21:36.242 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2024-05-14T15:21:36.242 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 493016034 2024-05-14T15:21:36.242 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:21:36.242 INFO:teuthology.orchestra.run.smithi069.stdout: "inst_str": "client.25000 172.21.15.69:0/493016034", 2024-05-14T15:21:36.242 INFO:teuthology.orchestra.run.smithi069.stdout: "addr_str": "172.21.15.69:0/493016034", 2024-05-14T15:21:36.242 INFO:teuthology.orchestra.run.smithi069.stdout: "inode_count": 5, 2024-05-14T15:21:36.242 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_epoch": 29, 2024-05-14T15:21:36.242 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch": 91, 2024-05-14T15:21:36.242 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_epoch_barrier": 0, 2024-05-14T15:21:36.242 INFO:teuthology.orchestra.run.smithi069.stdout: "blocklisted": false, 2024-05-14T15:21:36.243 INFO:teuthology.orchestra.run.smithi069.stdout: "fs_name": "cephfs" 2024-05-14T15:21:36.243 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:21:36.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:36.264 DEBUG:teuthology.orchestra.run.smithi069:> stat --file-system '--printf=%T 2024-05-14T15:21:36.264 DEBUG:teuthology.orchestra.run.smithi069:> ' -- /tmp/cephfs 2024-05-14T15:21:36.315 INFO:teuthology.orchestra.run.smithi069.stdout:fuseblk 2024-05-14T15:21:36.315 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /tmp/cephfs 2024-05-14T15:21:36.315 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:21:36.315 DEBUG:teuthology.orchestra.run.smithi069:> sudo chmod 1777 /tmp/cephfs 2024-05-14T15:21:36.395 INFO:teuthology.run_tasks:Running task exec... 2024-05-14T15:21:36.404 INFO:teuthology.task.exec:Executing custom commands... 2024-05-14T15:21:36.404 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2024-05-14T15:21:36.404 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-05-14T15:21:36.442 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:36 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:36.171+0000 7f8464c08200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T15:21:36.442 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:36 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:36.299+0000 7f8464c08200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T15:21:36.594 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:36 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:36.232+0000 7fd494b51200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T15:21:36.594 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:36 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:36.359+0000 7fd494b51200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T15:21:36.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.659+0000 7f31dd000640 1 -- 172.21.15.69:0/2971280776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8075a10 msgr2=0x7f31d810b690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.659+0000 7f31dd000640 1 --2- 172.21.15.69:0/2971280776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8075a10 0x7f31d810b690 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f31c0009900 tx=0x7f31c002a3f0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.659+0000 7f31dd000640 1 -- 172.21.15.69:0/2971280776 shutdown_connections 2024-05-14T15:21:36.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.659+0000 7f31dd000640 1 --2- 172.21.15.69:0/2971280776 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d810bbd0 0x7f31d810e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.659+0000 7f31dd000640 1 --2- 172.21.15.69:0/2971280776 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d8075a10 0x7f31d810b690 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.659+0000 7f31dd000640 1 --2- 172.21.15.69:0/2971280776 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d80750c0 0x7f31d80754d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.659+0000 7f31dd000640 1 -- 172.21.15.69:0/2971280776 >> 172.21.15.69:0/2971280776 conn(0x7f31d80fee30 msgr2=0x7f31d8101300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:36.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.659+0000 7f31dd000640 1 -- 172.21.15.69:0/2971280776 shutdown_connections 2024-05-14T15:21:36.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.660+0000 7f31dd000640 1 -- 172.21.15.69:0/2971280776 wait complete. 2024-05-14T15:21:36.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.661+0000 7f31dd000640 1 Processor -- start 2024-05-14T15:21:36.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.661+0000 7f31dd000640 1 -- start start 2024-05-14T15:21:36.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.661+0000 7f31dd000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d80750c0 0x7f31d819c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.661+0000 7f31dd000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d8075a10 0x7f31d819ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.661+0000 7f31dd000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d810bbd0 0x7f31d81a3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.661+0000 7f31dd000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f31d8111860 con 0x7f31d8075a10 2024-05-14T15:21:36.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.661+0000 7f31dd000640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f31d81116e0 con 0x7f31d80750c0 2024-05-14T15:21:36.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.661+0000 7f31dd000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f31d81119e0 con 0x7f31d810bbd0 2024-05-14T15:21:36.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.662+0000 7f31cfe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d8075a10 0x7f31d819ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:36.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.662+0000 7f31d5e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d80750c0 0x7f31d819c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:36.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.662+0000 7f31d5e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d80750c0 0x7f31d819c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:45232/0 (socket says 172.21.15.69:45232) 2024-05-14T15:21:36.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.662+0000 7f31d5e00640 1 -- 172.21.15.69:0/3800465822 learned_addr learned my addr 172.21.15.69:0/3800465822 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:36.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.662+0000 7f31d6800640 1 --2- 172.21.15.69:0/3800465822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d810bbd0 0x7f31d81a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:36.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.662+0000 7f31d5e00640 1 -- 172.21.15.69:0/3800465822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d810bbd0 msgr2=0x7f31d81a3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.662+0000 7f31d5e00640 1 --2- 172.21.15.69:0/3800465822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d810bbd0 0x7f31d81a3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.662+0000 7f31d5e00640 1 -- 172.21.15.69:0/3800465822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d8075a10 msgr2=0x7f31d819ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.662+0000 7f31d5e00640 1 --2- 172.21.15.69:0/3800465822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d8075a10 0x7f31d819ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.662+0000 7f31d5e00640 1 -- 172.21.15.69:0/3800465822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31d81a4000 con 0x7f31d80750c0 2024-05-14T15:21:36.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.662+0000 7f31cfe00640 1 --2- 172.21.15.69:0/3800465822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d8075a10 0x7f31d819ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:21:36.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.663+0000 7f31d5e00640 1 --2- 172.21.15.69:0/3800465822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d80750c0 0x7f31d819c4c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f31c800e9a0 tx=0x7f31c800ee60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:36.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.663+0000 7f31cea00640 1 -- 172.21.15.69:0/3800465822 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c800cd80 con 0x7f31d80750c0 2024-05-14T15:21:36.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.663+0000 7f31cea00640 1 -- 172.21.15.69:0/3800465822 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f31c80035f0 con 0x7f31d80750c0 2024-05-14T15:21:36.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.663+0000 7f31dd000640 1 -- 172.21.15.69:0/3800465822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31d81a42f0 con 0x7f31d80750c0 2024-05-14T15:21:36.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.663+0000 7f31cea00640 1 -- 172.21.15.69:0/3800465822 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31c8010690 con 0x7f31d80750c0 2024-05-14T15:21:36.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.663+0000 7f31dd000640 1 -- 172.21.15.69:0/3800465822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31d81a4840 con 0x7f31d80750c0 2024-05-14T15:21:36.666 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.664+0000 7f31dd000640 1 -- 172.21.15.69:0/3800465822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31d810a4a0 con 0x7f31d80750c0 2024-05-14T15:21:36.668 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.667+0000 7f31cea00640 1 -- 172.21.15.69:0/3800465822 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 19) ==== 149669+0+0 (secure 0 0 0) 0x7f31c8004000 con 0x7f31d80750c0 2024-05-14T15:21:36.669 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.669+0000 7f31cea00640 1 --2- 172.21.15.69:0/3800465822 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31bc0b2830 0x7f31bc0b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:36.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.669+0000 7f31cfe00640 1 -- 172.21.15.69:0/3800465822 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31bc0b2830 msgr2=0x7f31bc0b4d40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2537958790 2024-05-14T15:21:36.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.669+0000 7f31cea00640 1 -- 172.21.15.69:0/3800465822 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f31c80e29f0 con 0x7f31d80750c0 2024-05-14T15:21:36.670 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.669+0000 7f31cfe00640 1 --2- 172.21.15.69:0/3800465822 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31bc0b2830 0x7f31bc0b4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T15:21:36.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.678+0000 7f31cea00640 1 -- 172.21.15.69:0/3800465822 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f31c80aa370 con 0x7f31d80750c0 2024-05-14T15:21:36.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.870+0000 7f31cfe00640 1 -- 172.21.15.69:0/3800465822 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31bc0b2830 msgr2=0x7f31bc0b4d40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2537958790 2024-05-14T15:21:36.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.870+0000 7f31cfe00640 1 --2- 172.21.15.69:0/3800465822 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31bc0b2830 0x7f31bc0b4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T15:21:36.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.932+0000 7f31dd000640 1 -- 172.21.15.69:0/3800465822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7f31d802dc30 con 0x7f31d80750c0 2024-05-14T15:21:36.972 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:36 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:36.516+0000 7f0449b0d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-14T15:21:36.972 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:36 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:36.650+0000 7f0449b0d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-14T15:21:36.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.993+0000 7f31cea00640 1 -- 172.21.15.69:0/3800465822 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v30) ==== 117+0+0 (secure 0 0 0) 0x7f31c80b0020 con 0x7f31d80750c0 2024-05-14T15:21:36.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.996+0000 7f31dd000640 1 -- 172.21.15.69:0/3800465822 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31bc0b2830 msgr2=0x7f31bc0b4d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T15:21:36.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.996+0000 7f31dd000640 1 --2- 172.21.15.69:0/3800465822 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31bc0b2830 0x7f31bc0b4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.996+0000 7f31dd000640 1 -- 172.21.15.69:0/3800465822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d80750c0 msgr2=0x7f31d819c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:36.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.996+0000 7f31dd000640 1 --2- 172.21.15.69:0/3800465822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d80750c0 0x7f31d819c4c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f31c800e9a0 tx=0x7f31c800ee60 comp rx=0 tx=0).stop 2024-05-14T15:21:36.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.996+0000 7f31dd000640 1 -- 172.21.15.69:0/3800465822 shutdown_connections 2024-05-14T15:21:36.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.996+0000 7f31dd000640 1 --2- 172.21.15.69:0/3800465822 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f31bc0b2830 0x7f31bc0b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.996+0000 7f31dd000640 1 --2- 172.21.15.69:0/3800465822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f31d810bbd0 0x7f31d81a3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.996+0000 7f31dd000640 1 --2- 172.21.15.69:0/3800465822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f31d8075a10 0x7f31d819ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.996+0000 7f31dd000640 1 --2- 172.21.15.69:0/3800465822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f31d80750c0 0x7f31d819c4c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:36.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.996+0000 7f31dd000640 1 -- 172.21.15.69:0/3800465822 >> 172.21.15.69:0/3800465822 conn(0x7f31d80fee30 msgr2=0x7f31d8107670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:36.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.996+0000 7f31dd000640 1 -- 172.21.15.69:0/3800465822 shutdown_connections 2024-05-14T15:21:36.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:36.996+0000 7f31dd000640 1 -- 172.21.15.69:0/3800465822 wait complete. 2024-05-14T15:21:37.022 INFO:teuthology.run_tasks:Running task check-counter... 2024-05-14T15:21:37.033 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-05-14T15:21:37.043 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:21:37.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.300+0000 7f0da3e00640 1 -- 172.21.15.69:0/1486513679 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0da4103a40 msgr2=0x7f0da4104740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.300+0000 7f0da3e00640 1 --2- 172.21.15.69:0/1486513679 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0da4103a40 0x7f0da4104740 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0d94009900 tx=0x7f0d9402a410 comp rx=0 tx=0).stop 2024-05-14T15:21:37.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.300+0000 7f0da3e00640 1 -- 172.21.15.69:0/1486513679 shutdown_connections 2024-05-14T15:21:37.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.300+0000 7f0da3e00640 1 --2- 172.21.15.69:0/1486513679 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0da4109980 0x7f0da410bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.300+0000 7f0da3e00640 1 --2- 172.21.15.69:0/1486513679 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da4104c80 0x7f0da4105090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.300+0000 7f0da3e00640 1 --2- 172.21.15.69:0/1486513679 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0da4103a40 0x7f0da4104740 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.300+0000 7f0da3e00640 1 -- 172.21.15.69:0/1486513679 >> 172.21.15.69:0/1486513679 conn(0x7f0da40fec50 msgr2=0x7f0da41010e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:37.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.300+0000 7f0da3e00640 1 -- 172.21.15.69:0/1486513679 shutdown_connections 2024-05-14T15:21:37.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.300+0000 7f0da3e00640 1 -- 172.21.15.69:0/1486513679 wait complete. 2024-05-14T15:21:37.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.301+0000 7f0da3e00640 1 Processor -- start 2024-05-14T15:21:37.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.301+0000 7f0da3e00640 1 -- start start 2024-05-14T15:21:37.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.301+0000 7f0da3e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0da4103a40 0x7f0da419c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.301+0000 7f0da3e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da4104c80 0x7f0da419c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.301+0000 7f0da3e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0da4109980 0x7f0da41a37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.301+0000 7f0da3e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0da410f3f0 con 0x7f0da4103a40 2024-05-14T15:21:37.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.301+0000 7f0da3e00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0da410f270 con 0x7f0da4104c80 2024-05-14T15:21:37.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.301+0000 7f0da3e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0da410f570 con 0x7f0da4109980 2024-05-14T15:21:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.302+0000 7f0da2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0da4103a40 0x7f0da419c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.302+0000 7f0da2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0da4103a40 0x7f0da419c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37746/0 (socket says 172.21.15.69:37746) 2024-05-14T15:21:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.302+0000 7f0da2a00640 1 -- 172.21.15.69:0/3987680764 learned_addr learned my addr 172.21.15.69:0/3987680764 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.302+0000 7f0da3400640 1 --2- 172.21.15.69:0/3987680764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0da4109980 0x7f0da41a37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.302+0000 7f0da2000640 1 --2- 172.21.15.69:0/3987680764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da4104c80 0x7f0da419c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.302+0000 7f0da2a00640 1 -- 172.21.15.69:0/3987680764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0da4109980 msgr2=0x7f0da41a37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.302+0000 7f0da2a00640 1 --2- 172.21.15.69:0/3987680764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0da4109980 0x7f0da41a37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.302+0000 7f0da2a00640 1 -- 172.21.15.69:0/3987680764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da4104c80 msgr2=0x7f0da419c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.302+0000 7f0da2a00640 1 --2- 172.21.15.69:0/3987680764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da4104c80 0x7f0da419c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.302+0000 7f0da2a00640 1 -- 172.21.15.69:0/3987680764 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da41a3e10 con 0x7f0da4103a40 2024-05-14T15:21:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.302+0000 7f0da2000640 1 --2- 172.21.15.69:0/3987680764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da4104c80 0x7f0da419c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:21:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.303+0000 7f0da2a00640 1 --2- 172.21.15.69:0/3987680764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0da4103a40 0x7f0da419c340 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0d94005760 tx=0x7f0d94004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.303+0000 7f0d9b400640 1 -- 172.21.15.69:0/3987680764 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d9403f030 con 0x7f0da4103a40 2024-05-14T15:21:37.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.303+0000 7f0da3e00640 1 -- 172.21.15.69:0/3987680764 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da41a40a0 con 0x7f0da4103a40 2024-05-14T15:21:37.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.303+0000 7f0d9b400640 1 -- 172.21.15.69:0/3987680764 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0d94003a80 con 0x7f0da4103a40 2024-05-14T15:21:37.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.303+0000 7f0d9b400640 1 -- 172.21.15.69:0/3987680764 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d94035070 con 0x7f0da4103a40 2024-05-14T15:21:37.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.303+0000 7f0da3e00640 1 -- 172.21.15.69:0/3987680764 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da41a4590 con 0x7f0da4103a40 2024-05-14T15:21:37.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.304+0000 7f0da3e00640 1 -- 172.21.15.69:0/3987680764 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0da41a47f0 con 0x7f0da4103a40 2024-05-14T15:21:37.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.307+0000 7f0d9b400640 1 -- 172.21.15.69:0/3987680764 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 19) ==== 149669+0+0 (secure 0 0 0) 0x7f0d94042030 con 0x7f0da4103a40 2024-05-14T15:21:37.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.308+0000 7f0d9b400640 1 --2- 172.21.15.69:0/3987680764 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0d880b2830 0x7f0d880b4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.308+0000 7f0da2000640 1 -- 172.21.15.69:0/3987680764 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0d880b2830 msgr2=0x7f0d880b4d40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2537958790 2024-05-14T15:21:37.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.308+0000 7f0d9b400640 1 -- 172.21.15.69:0/3987680764 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 9208+0+0 (secure 0 0 0) 0x7f0d941031c0 con 0x7f0da4103a40 2024-05-14T15:21:37.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.309+0000 7f0da2000640 1 --2- 172.21.15.69:0/3987680764 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0d880b2830 0x7f0d880b4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-14T15:21:37.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.316+0000 7f0d9b400640 1 -- 172.21.15.69:0/3987680764 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0d940caab0 con 0x7f0da4103a40 2024-05-14T15:21:37.343 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:37 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:37.129+0000 7fd494b51200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T15:21:37.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:37 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3800465822' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-14T15:21:37.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:37 smithi203 ceph-mon[34567]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-14T15:21:37.384 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:37 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:37.093+0000 7f8464c08200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T15:21:37.384 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:37 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3800465822' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-14T15:21:37.384 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:37 smithi092 ceph-mon[34729]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-14T15:21:37.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:37 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3800465822' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-14T15:21:37.471 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:37 smithi069 ceph-mon[31270]: from='client.? ' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-05-14T15:21:37.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.510+0000 7f0da2000640 1 -- 172.21.15.69:0/3987680764 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0d880b2830 msgr2=0x7f0d880b4d40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.69:6800/2537958790 2024-05-14T15:21:37.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.510+0000 7f0da2000640 1 --2- 172.21.15.69:0/3987680764 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0d880b2830 0x7f0d880b4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-14T15:21:37.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.525+0000 7f0da3e00640 1 -- 172.21.15.69:0/3987680764 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0da41a49c0 con 0x7f0da4103a40 2024-05-14T15:21:37.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.528+0000 7f0d9b400640 1 -- 172.21.15.69:0/3987680764 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v91) ==== 74+0+24861 (secure 0 0 0) 0x7f0d940ca3b0 con 0x7f0da4103a40 2024-05-14T15:21:37.529 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:21:37.530 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":91,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","created":"2024-05-14T15:04:32.074994+0000","modified":"2024-05-14T15:17:43.708185+0000","last_up_change":"2024-05-14T15:14:44.049523+0000","last_in_change":"2024-05-14T15:14:16.752653+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:09:03.561841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:16:02.641690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:16:06.949687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:16:20.891122+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8640de99-c23a-494e-a100-aafd04fe1867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6803","nonce":301095601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6805","nonce":301095601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6809","nonce":301095601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6807","nonce":301095601}]},"public_addr":"172.21.15.69:6803/301095601","cluster_addr":"172.21.15.69:6805/301095601","heartbeat_back_addr":"172.21.15.69:6809/301095601","heartbeat_front_addr":"172.21.15.69:6807/301095601","state":["exists","up"]},{"osd":1,"uuid":"89f78a32-7afb-49f3-9287-5478a1cc8829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6801","nonce":2774122776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6803","nonce":2774122776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6807","nonce":2774122776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6805","nonce":2774122776}]},"public_addr":"172.21.15.92:6801/2774122776","cluster_addr":"172.21.15.92:6803/2774122776","heartbeat_back_addr":"172.21.15.92:6807/2774122776","heartbeat_front_addr":"172.21.15.92:6805/2774122776","state":["exists","up"]},{"osd":2,"uuid":"a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6801","nonce":2836920513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6803","nonce":2836920513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6807","nonce":2836920513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6805","nonce":2836920513}]},"public_addr":"172.21.15.203:6801/2836920513","cluster_addr":"172.21.15.203:6803/2836920513","heartbeat_back_addr":"172.21.15.203:6807/2836920513","heartbeat_front_addr":"172.21.15.203:6805/2836920513","state":["exists","up"]},{"osd":3,"uuid":"81409850-de26-4520-972c-31a716adf4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6811","nonce":680308620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6813","nonce":680308620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6817","nonce":680308620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6815","nonce":680308620}]},"public_addr":"172.21.15.69:6811/680308620","cluster_addr":"172.21.15.69:6813/680308620","heartbeat_back_addr":"172.21.15.69:6817/680308620","heartbeat_front_addr":"172.21.15.69:6815/680308620","state":["exists","up"]},{"osd":4,"uuid":"9aa3a6b0-cc63-4eae-8416-8ab630994985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6809","nonce":1071971048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6811","nonce":1071971048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6815","nonce":1071971048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6813","nonce":1071971048}]},"public_addr":"172.21.15.92:6809/1071971048","cluster_addr":"172.21.15.92:6811/1071971048","heartbeat_back_addr":"172.21.15.92:6815/1071971048","heartbeat_front_addr":"172.21.15.92:6813/1071971048","state":["exists","up"]},{"osd":5,"uuid":"f7fcde57-e280-494b-a45f-8fa007ed9ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6809","nonce":1404230851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6811","nonce":1404230851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6815","nonce":1404230851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6813","nonce":1404230851}]},"public_addr":"172.21.15.203:6809/1404230851","cluster_addr":"172.21.15.203:6811/1404230851","heartbeat_back_addr":"172.21.15.203:6815/1404230851","heartbeat_front_addr":"172.21.15.203:6813/1404230851","state":["exists","up"]},{"osd":6,"uuid":"86f1373a-3b39-4a7f-b14c-9bf8695c6b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6819","nonce":1213427819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6821","nonce":1213427819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6825","nonce":1213427819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6823","nonce":1213427819}]},"public_addr":"172.21.15.69:6819/1213427819","cluster_addr":"172.21.15.69:6821/1213427819","heartbeat_back_addr":"172.21.15.69:6825/1213427819","heartbeat_front_addr":"172.21.15.69:6823/1213427819","state":["exists","up"]},{"osd":7,"uuid":"e790fbf1-3e34-4950-bdfa-cf1adbd451c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6817","nonce":4274774582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6819","nonce":4274774582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6823","nonce":4274774582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6821","nonce":4274774582}]},"public_addr":"172.21.15.92:6817/4274774582","cluster_addr":"172.21.15.92:6819/4274774582","heartbeat_back_addr":"172.21.15.92:6823/4274774582","heartbeat_front_addr":"172.21.15.92:6821/4274774582","state":["exists","up"]},{"osd":8,"uuid":"65019fee-6b18-4d13-841a-2e3acb51f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6817","nonce":2480959249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6819","nonce":2480959249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6823","nonce":2480959249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6821","nonce":2480959249}]},"public_addr":"172.21.15.203:6817/2480959249","cluster_addr":"172.21.15.203:6819/2480959249","heartbeat_back_addr":"172.21.15.203:6823/2480959249","heartbeat_front_addr":"172.21.15.203:6821/2480959249","state":["exists","up"]},{"osd":9,"uuid":"b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6827","nonce":2649966866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6829","nonce":2649966866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6833","nonce":2649966866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6831","nonce":2649966866}]},"public_addr":"172.21.15.69:6827/2649966866","cluster_addr":"172.21.15.69:6829/2649966866","heartbeat_back_addr":"172.21.15.69:6833/2649966866","heartbeat_front_addr":"172.21.15.69:6831/2649966866","state":["exists","up"]},{"osd":10,"uuid":"45287823-f7ea-431f-ac01-a72762b01a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6825","nonce":3650822776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6827","nonce":3650822776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6831","nonce":3650822776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6829","nonce":3650822776}]},"public_addr":"172.21.15.92:6825/3650822776","cluster_addr":"172.21.15.92:6827/3650822776","heartbeat_back_addr":"172.21.15.92:6831/3650822776","heartbeat_front_addr":"172.21.15.92:6829/3650822776","state":["exists","up"]},{"osd":11,"uuid":"2f3a10f9-2414-4151-b1cf-3db68b2a66fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6825","nonce":2590258806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6827","nonce":2590258806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6831","nonce":2590258806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6829","nonce":2590258806}]},"public_addr":"172.21.15.203:6825/2590258806","cluster_addr":"172.21.15.203:6827/2590258806","heartbeat_back_addr":"172.21.15.203:6831/2590258806","heartbeat_front_addr":"172.21.15.203:6829/2590258806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:07:50.047712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:08:25.223293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:01.269713+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:38.679607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:16.161314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:53.323450+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:11:31.930106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:10.173015+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:48.056752+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:13:25.780142+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:03.705208+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:41.267371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":5,"to":6}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/151981233":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/3776172313":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/1288620257":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/2718114316":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/1655882616":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/4183332474":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/2806878946":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/2718114316":"2024-05-15T15:05:41.383453+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:21:37.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.531+0000 7f0da3e00640 1 -- 172.21.15.69:0/3987680764 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0d880b2830 msgr2=0x7f0d880b4d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T15:21:37.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.531+0000 7f0da3e00640 1 --2- 172.21.15.69:0/3987680764 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0d880b2830 0x7f0d880b4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.531+0000 7f0da3e00640 1 -- 172.21.15.69:0/3987680764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0da4103a40 msgr2=0x7f0da419c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.531+0000 7f0da3e00640 1 --2- 172.21.15.69:0/3987680764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0da4103a40 0x7f0da419c340 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0d94005760 tx=0x7f0d94004270 comp rx=0 tx=0).stop 2024-05-14T15:21:37.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.531+0000 7f0da3e00640 1 -- 172.21.15.69:0/3987680764 shutdown_connections 2024-05-14T15:21:37.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.531+0000 7f0da3e00640 1 --2- 172.21.15.69:0/3987680764 >> [v2:172.21.15.69:6800/2537958790,v1:172.21.15.69:6801/2537958790] conn(0x7f0d880b2830 0x7f0d880b4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.531+0000 7f0da3e00640 1 --2- 172.21.15.69:0/3987680764 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0da4109980 0x7f0da41a37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.531+0000 7f0da3e00640 1 --2- 172.21.15.69:0/3987680764 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0da4104c80 0x7f0da419c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.531+0000 7f0da3e00640 1 --2- 172.21.15.69:0/3987680764 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0da4103a40 0x7f0da419c340 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.531+0000 7f0da3e00640 1 -- 172.21.15.69:0/3987680764 >> 172.21.15.69:0/3987680764 conn(0x7f0da40fec50 msgr2=0x7f0da4101070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:37.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.531+0000 7f0da3e00640 1 -- 172.21.15.69:0/3987680764 shutdown_connections 2024-05-14T15:21:37.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.531+0000 7f0da3e00640 1 -- 172.21.15.69:0/3987680764 wait complete. 2024-05-14T15:21:37.556 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T15:09:03.561841+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T15:16:02.641690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T15:16:06.949687+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-14T15:16:20.891122+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-14T15:21:37.557 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T15:21:37.692 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:21:37 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y[36103]: 2024-05-14T15:21:37.383+0000 7f8464c08200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T15:21:37.722 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:37 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:37.470+0000 7f0449b0d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-14T15:21:37.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.810+0000 7ff107a00640 1 -- 172.21.15.69:0/861839759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff100109b50 msgr2=0x7ff10010bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.810+0000 7ff107a00640 1 --2- 172.21.15.69:0/861839759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff100109b50 0x7ff10010bf70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7ff0f8009ca0 tx=0x7ff0f802a8c0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.811+0000 7ff107a00640 1 -- 172.21.15.69:0/861839759 shutdown_connections 2024-05-14T15:21:37.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.811+0000 7ff107a00640 1 --2- 172.21.15.69:0/861839759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff100109b50 0x7ff10010bf70 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.811+0000 7ff107a00640 1 --2- 172.21.15.69:0/861839759 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff100104e50 0x7ff100105260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.811+0000 7ff107a00640 1 --2- 172.21.15.69:0/861839759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff100103c10 0x7ff100104910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.811+0000 7ff107a00640 1 -- 172.21.15.69:0/861839759 >> 172.21.15.69:0/861839759 conn(0x7ff1000fee00 msgr2=0x7ff1001012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:37.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.811+0000 7ff107a00640 1 -- 172.21.15.69:0/861839759 shutdown_connections 2024-05-14T15:21:37.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.811+0000 7ff107a00640 1 -- 172.21.15.69:0/861839759 wait complete. 2024-05-14T15:21:37.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.812+0000 7ff107a00640 1 Processor -- start 2024-05-14T15:21:37.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.812+0000 7ff107a00640 1 -- start start 2024-05-14T15:21:37.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.812+0000 7ff107a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff100103c10 0x7ff100076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.812+0000 7ff107a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff100104e50 0x7ff100075020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.812+0000 7ff107a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff100109b50 0x7ff100075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:37.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.812+0000 7ff107a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff10010f620 con 0x7ff100103c10 2024-05-14T15:21:37.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.812+0000 7ff107a00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff10010f4a0 con 0x7ff100109b50 2024-05-14T15:21:37.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.812+0000 7ff107a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff10010f7a0 con 0x7ff100104e50 2024-05-14T15:21:37.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.812+0000 7ff105000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff100103c10 0x7ff100076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:37.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.813+0000 7ff105000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff100103c10 0x7ff100076980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37754/0 (socket says 172.21.15.69:37754) 2024-05-14T15:21:37.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.813+0000 7ff105000640 1 -- 172.21.15.69:0/1101377413 learned_addr learned my addr 172.21.15.69:0/1101377413 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:37.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.813+0000 7ff105000640 1 -- 172.21.15.69:0/1101377413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff100104e50 msgr2=0x7ff100075020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.813+0000 7ff105000640 1 --2- 172.21.15.69:0/1101377413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff100104e50 0x7ff100075020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.813+0000 7ff105000640 1 -- 172.21.15.69:0/1101377413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff100109b50 msgr2=0x7ff100075560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:37.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.813+0000 7ff105000640 1 --2- 172.21.15.69:0/1101377413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff100109b50 0x7ff100075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:37.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.813+0000 7ff105000640 1 -- 172.21.15.69:0/1101377413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff100075c90 con 0x7ff100103c10 2024-05-14T15:21:37.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.813+0000 7ff105000640 1 --2- 172.21.15.69:0/1101377413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff100103c10 0x7ff100076980 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400d740 tx=0x7ff0f400dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:37.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.813+0000 7ff0fd600640 1 -- 172.21.15.69:0/1101377413 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4017070 con 0x7ff100103c10 2024-05-14T15:21:37.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.813+0000 7ff0fd600640 1 -- 172.21.15.69:0/1101377413 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff0f400de50 con 0x7ff100103c10 2024-05-14T15:21:37.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.813+0000 7ff107a00640 1 -- 172.21.15.69:0/1101377413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1001a42c0 con 0x7ff100103c10 2024-05-14T15:21:37.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.814+0000 7ff0fd600640 1 -- 172.21.15.69:0/1101377413 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4003bb0 con 0x7ff100103c10 2024-05-14T15:21:37.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.814+0000 7ff107a00640 1 -- 172.21.15.69:0/1101377413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1001a47b0 con 0x7ff100103c10 2024-05-14T15:21:37.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.815+0000 7ff107a00640 1 -- 172.21.15.69:0/1101377413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff100108960 con 0x7ff100103c10 2024-05-14T15:21:37.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.817+0000 7ff0fd600640 1 -- 172.21.15.69:0/1101377413 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 20) ==== 149337+0+0 (secure 0 0 0) 0x7ff0f4003d50 con 0x7ff100103c10 2024-05-14T15:21:37.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.819+0000 7ff0fd600640 1 -- 172.21.15.69:0/1101377413 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7ff0f40e1f90 con 0x7ff100103c10 2024-05-14T15:21:37.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:37.822+0000 7ff0fd600640 1 -- 172.21.15.69:0/1101377413 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff0f40a9c00 con 0x7ff100103c10 2024-05-14T15:21:37.844 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:21:37 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z[36560]: 2024-05-14T15:21:37.422+0000 7fd494b51200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T15:21:38.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.066+0000 7ff107a00640 1 -- 172.21.15.69:0/1101377413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7ff10002dde0 con 0x7ff100103c10 2024-05-14T15:21:38.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.067+0000 7ff0fd600640 1 -- 172.21.15.69:0/1101377413 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v92) ==== 93+0+10 (secure 0 0 0) 0x7ff0f40a9500 con 0x7ff100103c10 2024-05-14T15:21:38.068 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-05-14T15:21:38.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.069+0000 7ff107a00640 1 -- 172.21.15.69:0/1101377413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff100103c10 msgr2=0x7ff100076980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.070+0000 7ff107a00640 1 --2- 172.21.15.69:0/1101377413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff100103c10 0x7ff100076980 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400d740 tx=0x7ff0f400dc00 comp rx=0 tx=0).stop 2024-05-14T15:21:38.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.070+0000 7ff107a00640 1 -- 172.21.15.69:0/1101377413 shutdown_connections 2024-05-14T15:21:38.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.070+0000 7ff107a00640 1 --2- 172.21.15.69:0/1101377413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff100109b50 0x7ff100075560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.070+0000 7ff107a00640 1 --2- 172.21.15.69:0/1101377413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff100104e50 0x7ff100075020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.070+0000 7ff107a00640 1 --2- 172.21.15.69:0/1101377413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff100103c10 0x7ff100076980 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.070+0000 7ff107a00640 1 -- 172.21.15.69:0/1101377413 >> 172.21.15.69:0/1101377413 conn(0x7ff1000fee00 msgr2=0x7ff100105b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:38.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.071+0000 7ff107a00640 1 -- 172.21.15.69:0/1101377413 shutdown_connections 2024-05-14T15:21:38.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.071+0000 7ff107a00640 1 -- 172.21.15.69:0/1101377413 wait complete. 2024-05-14T15:21:38.098 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-14T15:21:38.098 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:21:38.098 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: Standby manager daemon y restarted 2024-05-14T15:21:38.098 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: Standby manager daemon y started 2024-05-14T15:21:38.098 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.? 172.21.15.92:0/4230063221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-14T15:21:38.098 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.? 172.21.15.92:0/4230063221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T15:21:38.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.? 172.21.15.92:0/4230063221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-14T15:21:38.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.? 172.21.15.92:0/4230063221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T15:21:38.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: Standby manager daemon z restarted 2024-05-14T15:21:38.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: Standby manager daemon z started 2024-05-14T15:21:38.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.? 172.21.15.203:0/3136871434' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-14T15:21:38.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.? 172.21.15.203:0/3136871434' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T15:21:38.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.? 172.21.15.203:0/3136871434' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-14T15:21:38.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.? 172.21.15.203:0/3136871434' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T15:21:38.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3987680764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:21:38.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: Active manager daemon x restarted 2024-05-14T15:21:38.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: Activating manager daemon x 2024-05-14T15:21:38.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: osdmap e92: 12 total, 12 up, 12 in 2024-05-14T15:21:38.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: mgrmap e20: x(active, starting, since 0.0235238s), standbys: z, y 2024-05-14T15:21:38.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:21:38.099 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:21:38.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:21:38.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-14T15:21:38.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-14T15:21:38.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-14T15:21:38.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-14T15:21:38.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-14T15:21:38.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-14T15:21:38.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-14T15:21:38.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-14T15:21:38.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-14T15:21:38.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-14T15:21:38.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-14T15:21:38.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-14T15:21:38.100 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-14T15:21:38.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-14T15:21:38.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-14T15:21:38.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:21:38.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:21:38.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:21:38.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:21:38.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:21:38.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:21:38.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:21:38.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:21:38.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:21:38.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:21:38.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:21:38.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:21:38.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-14T15:21:38.101 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-14T15:21:38.102 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-14T15:21:38.102 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: Manager daemon x is now available 2024-05-14T15:21:38.102 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:38.102 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-14T15:21:38.102 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:38 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-14T15:21:38.102 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:37 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:37.777+0000 7f0449b0d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-14T15:21:38.103 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T15:21:38.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-14T15:21:38.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:21:38.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: Standby manager daemon y restarted 2024-05-14T15:21:38.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: Standby manager daemon y started 2024-05-14T15:21:38.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.? 172.21.15.92:0/4230063221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-14T15:21:38.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.? 172.21.15.92:0/4230063221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T15:21:38.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.? 172.21.15.92:0/4230063221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-14T15:21:38.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.? 172.21.15.92:0/4230063221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T15:21:38.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: Standby manager daemon z restarted 2024-05-14T15:21:38.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: Standby manager daemon z started 2024-05-14T15:21:38.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.? 172.21.15.203:0/3136871434' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-14T15:21:38.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.? 172.21.15.203:0/3136871434' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T15:21:38.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.? 172.21.15.203:0/3136871434' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-14T15:21:38.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.? 172.21.15.203:0/3136871434' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T15:21:38.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3987680764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:21:38.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: Active manager daemon x restarted 2024-05-14T15:21:38.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: Activating manager daemon x 2024-05-14T15:21:38.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: osdmap e92: 12 total, 12 up, 12 in 2024-05-14T15:21:38.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: mgrmap e20: x(active, starting, since 0.0235238s), standbys: z, y 2024-05-14T15:21:38.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:21:38.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:21:38.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:21:38.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-14T15:21:38.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-14T15:21:38.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-14T15:21:38.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-14T15:21:38.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-14T15:21:38.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-14T15:21:38.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-14T15:21:38.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-14T15:21:38.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-14T15:21:38.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-14T15:21:38.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-14T15:21:38.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-14T15:21:38.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-14T15:21:38.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-14T15:21:38.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-14T15:21:38.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:21:38.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:21:38.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:21:38.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:21:38.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:21:38.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:21:38.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:21:38.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:21:38.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:21:38.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:21:38.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:21:38.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:21:38.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-14T15:21:38.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-14T15:21:38.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-14T15:21:38.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: Manager daemon x is now available 2024-05-14T15:21:38.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:38.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-14T15:21:38.350 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:38 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-14T15:21:38.398 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:38.396+0000 7f0399a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:21:38.398 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:38.396+0000 7f0399a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:21:38.398 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:38.396+0000 7f0399a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:21:38.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.404+0000 7ff28ca00640 1 -- 172.21.15.69:0/3697077113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff288103c10 msgr2=0x7ff288104910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.404+0000 7ff28ca00640 1 --2- 172.21.15.69:0/3697077113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff288103c10 0x7ff288104910 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff27800dc90 tx=0x7ff278029f50 comp rx=0 tx=0).stop 2024-05-14T15:21:38.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.404+0000 7ff28ca00640 1 -- 172.21.15.69:0/3697077113 shutdown_connections 2024-05-14T15:21:38.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.404+0000 7ff28ca00640 1 --2- 172.21.15.69:0/3697077113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff288109b50 0x7ff28810bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.404+0000 7ff28ca00640 1 --2- 172.21.15.69:0/3697077113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff288104e50 0x7ff288105260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.404+0000 7ff28ca00640 1 --2- 172.21.15.69:0/3697077113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff288103c10 0x7ff288104910 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.404+0000 7ff28ca00640 1 -- 172.21.15.69:0/3697077113 >> 172.21.15.69:0/3697077113 conn(0x7ff2880fee00 msgr2=0x7ff2881012b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:38.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.404+0000 7ff28ca00640 1 -- 172.21.15.69:0/3697077113 shutdown_connections 2024-05-14T15:21:38.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.404+0000 7ff28ca00640 1 -- 172.21.15.69:0/3697077113 wait complete. 2024-05-14T15:21:38.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.405+0000 7ff28ca00640 1 Processor -- start 2024-05-14T15:21:38.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.406+0000 7ff28ca00640 1 -- start start 2024-05-14T15:21:38.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.406+0000 7ff28ca00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff288103c10 0x7ff288198060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.406+0000 7ff28ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff288104e50 0x7ff2881985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.406+0000 7ff28ca00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff288109b50 0x7ff28819f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.406+0000 7ff28ca00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff28810d440 con 0x7ff288104e50 2024-05-14T15:21:38.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.406+0000 7ff28ca00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff28810d2c0 con 0x7ff288103c10 2024-05-14T15:21:38.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.406+0000 7ff28ca00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff28810d5c0 con 0x7ff288109b50 2024-05-14T15:21:38.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.406+0000 7ff285400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff288104e50 0x7ff2881985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.407+0000 7ff285400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff288104e50 0x7ff2881985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37912/0 (socket says 172.21.15.69:37912) 2024-05-14T15:21:38.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.407+0000 7ff285400640 1 -- 172.21.15.69:0/1892861456 learned_addr learned my addr 172.21.15.69:0/1892861456 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:38.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.407+0000 7ff285e00640 1 --2- 172.21.15.69:0/1892861456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff288103c10 0x7ff288198060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.407+0000 7ff286800640 1 --2- 172.21.15.69:0/1892861456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff288109b50 0x7ff28819f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.407+0000 7ff285400640 1 -- 172.21.15.69:0/1892861456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff288109b50 msgr2=0x7ff28819f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.407+0000 7ff285400640 1 --2- 172.21.15.69:0/1892861456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff288109b50 0x7ff28819f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.407+0000 7ff285400640 1 -- 172.21.15.69:0/1892861456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff288103c10 msgr2=0x7ff288198060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.407+0000 7ff285400640 1 --2- 172.21.15.69:0/1892861456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff288103c10 0x7ff288198060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.407+0000 7ff285400640 1 -- 172.21.15.69:0/1892861456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff28819fba0 con 0x7ff288104e50 2024-05-14T15:21:38.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.407+0000 7ff286800640 1 --2- 172.21.15.69:0/1892861456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff288109b50 0x7ff28819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:38.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.407+0000 7ff285400640 1 --2- 172.21.15.69:0/1892861456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff288104e50 0x7ff2881985a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff27400e9f0 tx=0x7ff27400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:38.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.408+0000 7ff27ea00640 1 -- 172.21.15.69:0/1892861456 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff27400cd80 con 0x7ff288104e50 2024-05-14T15:21:38.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.408+0000 7ff27ea00640 1 -- 172.21.15.69:0/1892861456 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2740054b0 con 0x7ff288104e50 2024-05-14T15:21:38.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.408+0000 7ff27ea00640 1 -- 172.21.15.69:0/1892861456 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274010430 con 0x7ff288104e50 2024-05-14T15:21:38.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.408+0000 7ff28ca00640 1 -- 172.21.15.69:0/1892861456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff28819fe90 con 0x7ff288104e50 2024-05-14T15:21:38.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.408+0000 7ff28ca00640 1 -- 172.21.15.69:0/1892861456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2881a02a0 con 0x7ff288104e50 2024-05-14T15:21:38.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.410+0000 7ff28ca00640 1 -- 172.21.15.69:0/1892861456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff288108960 con 0x7ff288104e50 2024-05-14T15:21:38.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.413+0000 7ff27ea00640 1 -- 172.21.15.69:0/1892861456 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 20) ==== 149337+0+0 (secure 0 0 0) 0x7ff2740046c0 con 0x7ff288104e50 2024-05-14T15:21:38.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.414+0000 7ff27ea00640 1 -- 172.21.15.69:0/1892861456 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7ff2740e2730 con 0x7ff288104e50 2024-05-14T15:21:38.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.416+0000 7ff27ea00640 1 -- 172.21.15.69:0/1892861456 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff274054df0 con 0x7ff288104e50 2024-05-14T15:21:38.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='client.? ' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-05-14T15:21:38.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:21:38.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: Standby manager daemon y restarted 2024-05-14T15:21:38.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: Standby manager daemon y started 2024-05-14T15:21:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.? 172.21.15.92:0/4230063221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-14T15:21:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.? 172.21.15.92:0/4230063221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T15:21:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.? 172.21.15.92:0/4230063221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-14T15:21:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.? 172.21.15.92:0/4230063221' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T15:21:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: Standby manager daemon z restarted 2024-05-14T15:21:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: Standby manager daemon z started 2024-05-14T15:21:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.? 172.21.15.203:0/3136871434' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-05-14T15:21:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.? 172.21.15.203:0/3136871434' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-14T15:21:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.? 172.21.15.203:0/3136871434' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-05-14T15:21:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.? 172.21.15.203:0/3136871434' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-14T15:21:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3987680764' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:21:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: Active manager daemon x restarted 2024-05-14T15:21:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: Activating manager daemon x 2024-05-14T15:21:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: osdmap e92: 12 total, 12 up, 12 in 2024-05-14T15:21:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: mgrmap e20: x(active, starting, since 0.0235238s), standbys: z, y 2024-05-14T15:21:38.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:21:38.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:21:38.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:21:38.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-05-14T15:21:38.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-05-14T15:21:38.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-05-14T15:21:38.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-05-14T15:21:38.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-05-14T15:21:38.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-05-14T15:21:38.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-05-14T15:21:38.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-05-14T15:21:38.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-05-14T15:21:38.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-05-14T15:21:38.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-05-14T15:21:38.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-05-14T15:21:38.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-14T15:21:38.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-05-14T15:21:38.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-14T15:21:38.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-14T15:21:38.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-14T15:21:38.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-14T15:21:38.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-14T15:21:38.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-14T15:21:38.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-14T15:21:38.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-14T15:21:38.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-14T15:21:38.446 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-05-14T15:21:38.446 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-05-14T15:21:38.446 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-05-14T15:21:38.446 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-05-14T15:21:38.446 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-14T15:21:38.446 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-14T15:21:38.446 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-14T15:21:38.446 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: Manager daemon x is now available 2024-05-14T15:21:38.446 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:38.446 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-14T15:21:38.446 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:38 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-14T15:21:38.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.623+0000 7ff28ca00640 1 -- 172.21.15.69:0/1892861456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff28802de80 con 0x7ff288104e50 2024-05-14T15:21:38.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.624+0000 7ff27ea00640 1 -- 172.21.15.69:0/1892861456 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v92) ==== 104+0+11 (secure 0 0 0) 0x7ff2740aa380 con 0x7ff288104e50 2024-05-14T15:21:38.625 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-05-14T15:21:38.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.626+0000 7ff28ca00640 1 -- 172.21.15.69:0/1892861456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff288104e50 msgr2=0x7ff2881985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.626+0000 7ff28ca00640 1 --2- 172.21.15.69:0/1892861456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff288104e50 0x7ff2881985a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7ff27400e9f0 tx=0x7ff27400edf0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.627+0000 7ff28ca00640 1 -- 172.21.15.69:0/1892861456 shutdown_connections 2024-05-14T15:21:38.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.627+0000 7ff28ca00640 1 --2- 172.21.15.69:0/1892861456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff288109b50 0x7ff28819f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.627+0000 7ff28ca00640 1 --2- 172.21.15.69:0/1892861456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff288104e50 0x7ff2881985a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.627+0000 7ff28ca00640 1 --2- 172.21.15.69:0/1892861456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff288103c10 0x7ff288198060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.627+0000 7ff28ca00640 1 -- 172.21.15.69:0/1892861456 >> 172.21.15.69:0/1892861456 conn(0x7ff2880fee00 msgr2=0x7ff288105b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:38.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.627+0000 7ff28ca00640 1 -- 172.21.15.69:0/1892861456 shutdown_connections 2024-05-14T15:21:38.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.627+0000 7ff28ca00640 1 -- 172.21.15.69:0/1892861456 wait complete. 2024-05-14T15:21:38.649 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:38.396+0000 7f0399a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:21:38.649 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:38.396+0000 7f0399a00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:21:38.649 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:38.396+0000 7f039cc00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:21:38.649 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:38.396+0000 7f039cc00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:21:38.649 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:38.396+0000 7f039cc00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:21:38.649 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:38.396+0000 7f039cc00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:21:38.650 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:21:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:21:38.396+0000 7f039cc00700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:21:38.651 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T15:21:38.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.911+0000 7f644de00640 1 -- 172.21.15.69:0/1915282531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64481099a0 msgr2=0x7f644810bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.911+0000 7f644de00640 1 --2- 172.21.15.69:0/1915282531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64481099a0 0x7f644810bdc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f6440009ca0 tx=0x7f644002a8c0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.912+0000 7f644de00640 1 -- 172.21.15.69:0/1915282531 shutdown_connections 2024-05-14T15:21:38.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.912+0000 7f644de00640 1 --2- 172.21.15.69:0/1915282531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f64481099a0 0x7f644810bdc0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.912+0000 7f644de00640 1 --2- 172.21.15.69:0/1915282531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6448104ca0 0x7f64481050b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.912+0000 7f644de00640 1 --2- 172.21.15.69:0/1915282531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6448103a60 0x7f6448104760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.912+0000 7f644de00640 1 -- 172.21.15.69:0/1915282531 >> 172.21.15.69:0/1915282531 conn(0x7f64480fec50 msgr2=0x7f6448101100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:38.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.912+0000 7f644de00640 1 -- 172.21.15.69:0/1915282531 shutdown_connections 2024-05-14T15:21:38.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.912+0000 7f644de00640 1 -- 172.21.15.69:0/1915282531 wait complete. 2024-05-14T15:21:38.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.913+0000 7f644de00640 1 Processor -- start 2024-05-14T15:21:38.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.913+0000 7f644de00640 1 -- start start 2024-05-14T15:21:38.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.913+0000 7f644de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6448103a60 0x7f6448076980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.913+0000 7f644de00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6448104ca0 0x7f6448075020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.913+0000 7f644de00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64481099a0 0x7f6448075560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.913+0000 7f644de00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f644810f490 con 0x7f6448103a60 2024-05-14T15:21:38.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.913+0000 7f644de00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f644810f310 con 0x7f6448104ca0 2024-05-14T15:21:38.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.913+0000 7f644de00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f644810f610 con 0x7f64481099a0 2024-05-14T15:21:38.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.913+0000 7f644ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6448103a60 0x7f6448076980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.914+0000 7f644ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6448103a60 0x7f6448076980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37928/0 (socket says 172.21.15.69:37928) 2024-05-14T15:21:38.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.914+0000 7f644ca00640 1 -- 172.21.15.69:0/3048488494 learned_addr learned my addr 172.21.15.69:0/3048488494 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:38.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.914+0000 7f644d400640 1 --2- 172.21.15.69:0/3048488494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64481099a0 0x7f6448075560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.914+0000 7f6447e00640 1 --2- 172.21.15.69:0/3048488494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6448104ca0 0x7f6448075020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.914+0000 7f644ca00640 1 -- 172.21.15.69:0/3048488494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64481099a0 msgr2=0x7f6448075560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.914+0000 7f644ca00640 1 --2- 172.21.15.69:0/3048488494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64481099a0 0x7f6448075560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.914+0000 7f644ca00640 1 -- 172.21.15.69:0/3048488494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6448104ca0 msgr2=0x7f6448075020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:38.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.914+0000 7f644ca00640 1 --2- 172.21.15.69:0/3048488494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6448104ca0 0x7f6448075020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:38.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.914+0000 7f644ca00640 1 -- 172.21.15.69:0/3048488494 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6448075c90 con 0x7f6448103a60 2024-05-14T15:21:38.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.914+0000 7f644ca00640 1 --2- 172.21.15.69:0/3048488494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6448103a60 0x7f6448076980 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f643c00d740 tx=0x7f643c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:38.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.915+0000 7f6445600640 1 -- 172.21.15.69:0/3048488494 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c017070 con 0x7f6448103a60 2024-05-14T15:21:38.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.915+0000 7f6445600640 1 -- 172.21.15.69:0/3048488494 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f643c00de50 con 0x7f6448103a60 2024-05-14T15:21:38.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.915+0000 7f6445600640 1 -- 172.21.15.69:0/3048488494 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c003bb0 con 0x7f6448103a60 2024-05-14T15:21:38.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.915+0000 7f644de00640 1 -- 172.21.15.69:0/3048488494 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64481a4100 con 0x7f6448103a60 2024-05-14T15:21:38.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.915+0000 7f644de00640 1 -- 172.21.15.69:0/3048488494 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64481a4570 con 0x7f6448103a60 2024-05-14T15:21:38.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.916+0000 7f644de00640 1 -- 172.21.15.69:0/3048488494 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64481087b0 con 0x7f6448103a60 2024-05-14T15:21:38.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.919+0000 7f6445600640 1 -- 172.21.15.69:0/3048488494 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 21) ==== 149464+0+0 (secure 0 0 0) 0x7f643c003d50 con 0x7f6448103a60 2024-05-14T15:21:38.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.921+0000 7f6445600640 1 --2- 172.21.15.69:0/3048488494 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f64300b2660 0x7f64300b4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:38.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.921+0000 7f6445600640 1 -- 172.21.15.69:0/3048488494 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f643c0e2130 con 0x7f6448103a60 2024-05-14T15:21:38.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.921+0000 7f6447e00640 1 --2- 172.21.15.69:0/3048488494 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f64300b2660 0x7f64300b4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:38.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.922+0000 7f6447e00640 1 --2- 172.21.15.69:0/3048488494 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f64300b2660 0x7f64300b4b70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6434005fd0 tx=0x7f6434005850 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:38.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:38.922+0000 7f6445600640 1 -- 172.21.15.69:0/3048488494 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f643c0a9cb0 con 0x7f6448103a60 2024-05-14T15:21:39.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.124+0000 7f644de00640 1 -- 172.21.15.69:0/3048488494 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f644802dde0 con 0x7f6448103a60 2024-05-14T15:21:39.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.125+0000 7f6445600640 1 -- 172.21.15.69:0/3048488494 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v92) ==== 100+0+11 (secure 0 0 0) 0x7f643c0a95b0 con 0x7f6448103a60 2024-05-14T15:21:39.126 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-05-14T15:21:39.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.127+0000 7f644de00640 1 -- 172.21.15.69:0/3048488494 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f64300b2660 msgr2=0x7f64300b4b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:39.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.127+0000 7f644de00640 1 --2- 172.21.15.69:0/3048488494 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f64300b2660 0x7f64300b4b70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6434005fd0 tx=0x7f6434005850 comp rx=0 tx=0).stop 2024-05-14T15:21:39.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.127+0000 7f644de00640 1 -- 172.21.15.69:0/3048488494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6448103a60 msgr2=0x7f6448076980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:39.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.127+0000 7f644de00640 1 --2- 172.21.15.69:0/3048488494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6448103a60 0x7f6448076980 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f643c00d740 tx=0x7f643c00dc00 comp rx=0 tx=0).stop 2024-05-14T15:21:39.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.128+0000 7f644de00640 1 -- 172.21.15.69:0/3048488494 shutdown_connections 2024-05-14T15:21:39.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.128+0000 7f644de00640 1 --2- 172.21.15.69:0/3048488494 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f64300b2660 0x7f64300b4b70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.128+0000 7f644de00640 1 --2- 172.21.15.69:0/3048488494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f64481099a0 0x7f6448075560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.128+0000 7f644de00640 1 --2- 172.21.15.69:0/3048488494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6448104ca0 0x7f6448075020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.128+0000 7f644de00640 1 --2- 172.21.15.69:0/3048488494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6448103a60 0x7f6448076980 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.128+0000 7f644de00640 1 -- 172.21.15.69:0/3048488494 >> 172.21.15.69:0/3048488494 conn(0x7f64480fec50 msgr2=0x7f6448105980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:39.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.128+0000 7f644de00640 1 -- 172.21.15.69:0/3048488494 shutdown_connections 2024-05-14T15:21:39.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.128+0000 7f644de00640 1 -- 172.21.15.69:0/3048488494 wait complete. 2024-05-14T15:21:39.156 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-14T15:21:39.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:39 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1101377413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T15:21:39.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:39 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1892861456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-14T15:21:39.343 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:39 smithi203 ceph-mon[34567]: mgrmap e21: x(active, since 1.03681s), standbys: z, y 2024-05-14T15:21:39.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.401+0000 7fee34e00640 1 -- 172.21.15.69:0/902221075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee30104e70 msgr2=0x7fee30105280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:39.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.401+0000 7fee34e00640 1 --2- 172.21.15.69:0/902221075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee30104e70 0x7fee30105280 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fee1c009900 tx=0x7fee1c02a3f0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.401+0000 7fee34e00640 1 -- 172.21.15.69:0/902221075 shutdown_connections 2024-05-14T15:21:39.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.401+0000 7fee34e00640 1 --2- 172.21.15.69:0/902221075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee30109b70 0x7fee3010bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.401+0000 7fee34e00640 1 --2- 172.21.15.69:0/902221075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee30104e70 0x7fee30105280 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.401+0000 7fee34e00640 1 --2- 172.21.15.69:0/902221075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee30103c30 0x7fee30104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.401+0000 7fee34e00640 1 -- 172.21.15.69:0/902221075 >> 172.21.15.69:0/902221075 conn(0x7fee300fee40 msgr2=0x7fee301012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:39.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.401+0000 7fee34e00640 1 -- 172.21.15.69:0/902221075 shutdown_connections 2024-05-14T15:21:39.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.401+0000 7fee34e00640 1 -- 172.21.15.69:0/902221075 wait complete. 2024-05-14T15:21:39.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.402+0000 7fee34e00640 1 Processor -- start 2024-05-14T15:21:39.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.402+0000 7fee34e00640 1 -- start start 2024-05-14T15:21:39.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.403+0000 7fee34e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee30103c30 0x7fee3019a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:39.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.403+0000 7fee34e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee30104e70 0x7fee3019a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:39.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.403+0000 7fee34e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee30109b70 0x7fee301a17a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:39.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.403+0000 7fee34e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fee3010f660 con 0x7fee30104e70 2024-05-14T15:21:39.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.403+0000 7fee34e00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fee3010f4e0 con 0x7fee30103c30 2024-05-14T15:21:39.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.403+0000 7fee34e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fee3010f7e0 con 0x7fee30109b70 2024-05-14T15:21:39.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.403+0000 7fee2d400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee30104e70 0x7fee3019a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:39.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.403+0000 7fee2d400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee30104e70 0x7fee3019a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37944/0 (socket says 172.21.15.69:37944) 2024-05-14T15:21:39.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.403+0000 7fee2de00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee30103c30 0x7fee3019a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:39.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.403+0000 7fee2d400640 1 -- 172.21.15.69:0/3291861171 learned_addr learned my addr 172.21.15.69:0/3291861171 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:39.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.403+0000 7fee2e800640 1 --2- 172.21.15.69:0/3291861171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee30109b70 0x7fee301a17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:39.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.403+0000 7fee2de00640 1 -- 172.21.15.69:0/3291861171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee30109b70 msgr2=0x7fee301a17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:39.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.403+0000 7fee2de00640 1 --2- 172.21.15.69:0/3291861171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee30109b70 0x7fee301a17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.403+0000 7fee2de00640 1 -- 172.21.15.69:0/3291861171 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee30104e70 msgr2=0x7fee3019a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:39.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.403+0000 7fee2de00640 1 --2- 172.21.15.69:0/3291861171 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee30104e70 0x7fee3019a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.404+0000 7fee2de00640 1 -- 172.21.15.69:0/3291861171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee301a1e10 con 0x7fee30103c30 2024-05-14T15:21:39.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.404+0000 7fee2de00640 1 --2- 172.21.15.69:0/3291861171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee30103c30 0x7fee3019a320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee30103500 tx=0x7fee2000ee50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:39.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.404+0000 7fee26a00640 1 -- 172.21.15.69:0/3291861171 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2000cc40 con 0x7fee30103c30 2024-05-14T15:21:39.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.404+0000 7fee34e00640 1 -- 172.21.15.69:0/3291861171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee301a2100 con 0x7fee30103c30 2024-05-14T15:21:39.408 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.404+0000 7fee26a00640 1 -- 172.21.15.69:0/3291861171 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee200044b0 con 0x7fee30103c30 2024-05-14T15:21:39.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.404+0000 7fee26a00640 1 -- 172.21.15.69:0/3291861171 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee20003e10 con 0x7fee30103c30 2024-05-14T15:21:39.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.404+0000 7fee34e00640 1 -- 172.21.15.69:0/3291861171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee301a26a0 con 0x7fee30103c30 2024-05-14T15:21:39.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.405+0000 7fee34e00640 1 -- 172.21.15.69:0/3291861171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee3006a290 con 0x7fee30103c30 2024-05-14T15:21:39.409 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.408+0000 7fee26a00640 1 -- 172.21.15.69:0/3291861171 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 21) ==== 149464+0+0 (secure 0 0 0) 0x7fee20003fb0 con 0x7fee30103c30 2024-05-14T15:21:39.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.410+0000 7fee26a00640 1 --2- 172.21.15.69:0/3291861171 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fee140b25e0 0x7fee140b4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:39.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.410+0000 7fee26a00640 1 -- 172.21.15.69:0/3291861171 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fee200e27e0 con 0x7fee30103c30 2024-05-14T15:21:39.410 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.410+0000 7fee2d400640 1 --2- 172.21.15.69:0/3291861171 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fee140b25e0 0x7fee140b4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:39.411 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.411+0000 7fee2d400640 1 --2- 172.21.15.69:0/3291861171 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fee140b25e0 0x7fee140b4af0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fee1c006010 tx=0x7fee1c005a20 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:39.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.414+0000 7fee26a00640 1 -- 172.21.15.69:0/3291861171 <== mon.2 v2:172.21.15.92:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fee200aa370 con 0x7fee30103c30 2024-05-14T15:21:39.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:39 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1101377413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T15:21:39.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:39 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1892861456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-14T15:21:39.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:39 smithi092 ceph-mon[34729]: mgrmap e21: x(active, since 1.03681s), standbys: z, y 2024-05-14T15:21:39.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:39 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1101377413' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T15:21:39.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:39 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1892861456' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-14T15:21:39.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:39 smithi069 ceph-mon[31270]: mgrmap e21: x(active, since 1.03681s), standbys: z, y 2024-05-14T15:21:39.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.615+0000 7fee34e00640 1 -- 172.21.15.69:0/3291861171 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fee3002dc30 con 0x7fee30103c30 2024-05-14T15:21:39.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.616+0000 7fee26a00640 1 -- 172.21.15.69:0/3291861171 <== mon.2 v2:172.21.15.92:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v92) ==== 103+0+11 (secure 0 0 0) 0x7fee200b0070 con 0x7fee30103c30 2024-05-14T15:21:39.617 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-05-14T15:21:39.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.619+0000 7fee34e00640 1 -- 172.21.15.69:0/3291861171 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fee140b25e0 msgr2=0x7fee140b4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:39.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.619+0000 7fee34e00640 1 --2- 172.21.15.69:0/3291861171 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fee140b25e0 0x7fee140b4af0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fee1c006010 tx=0x7fee1c005a20 comp rx=0 tx=0).stop 2024-05-14T15:21:39.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.619+0000 7fee34e00640 1 -- 172.21.15.69:0/3291861171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee30103c30 msgr2=0x7fee3019a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:39.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.619+0000 7fee34e00640 1 --2- 172.21.15.69:0/3291861171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee30103c30 0x7fee3019a320 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fee30103500 tx=0x7fee2000ee50 comp rx=0 tx=0).stop 2024-05-14T15:21:39.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.619+0000 7fee34e00640 1 -- 172.21.15.69:0/3291861171 shutdown_connections 2024-05-14T15:21:39.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.619+0000 7fee34e00640 1 --2- 172.21.15.69:0/3291861171 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fee140b25e0 0x7fee140b4af0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.619+0000 7fee34e00640 1 --2- 172.21.15.69:0/3291861171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee30109b70 0x7fee301a17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.619+0000 7fee34e00640 1 --2- 172.21.15.69:0/3291861171 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee30104e70 0x7fee3019a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.619+0000 7fee34e00640 1 --2- 172.21.15.69:0/3291861171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee30103c30 0x7fee3019a320 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:39.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.619+0000 7fee34e00640 1 -- 172.21.15.69:0/3291861171 >> 172.21.15.69:0/3291861171 conn(0x7fee300fee40 msgr2=0x7fee30105b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:39.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.619+0000 7fee34e00640 1 -- 172.21.15.69:0/3291861171 shutdown_connections 2024-05-14T15:21:39.621 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:39.619+0000 7fee34e00640 1 -- 172.21.15.69:0/3291861171 wait complete. 2024-05-14T15:21:39.645 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-05-14T15:21:39.645 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:21:40.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:40 smithi069 ceph-mon[31270]: [14/May/2024:15:21:38] ENGINE Bus STARTING 2024-05-14T15:21:40.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:40 smithi069 ceph-mon[31270]: [14/May/2024:15:21:38] ENGINE Serving on https://172.21.15.69:7150 2024-05-14T15:21:40.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:40 smithi069 ceph-mon[31270]: [14/May/2024:15:21:38] ENGINE Serving on http://172.21.15.69:8765 2024-05-14T15:21:40.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:40 smithi069 ceph-mon[31270]: [14/May/2024:15:21:38] ENGINE Bus STARTED 2024-05-14T15:21:40.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:40 smithi069 ceph-mon[31270]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:21:40.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:40 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3048488494' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-14T15:21:40.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:40 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3291861171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-14T15:21:40.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:40 smithi203 ceph-mon[34567]: [14/May/2024:15:21:38] ENGINE Bus STARTING 2024-05-14T15:21:40.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:40 smithi203 ceph-mon[34567]: [14/May/2024:15:21:38] ENGINE Serving on https://172.21.15.69:7150 2024-05-14T15:21:40.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:40 smithi203 ceph-mon[34567]: [14/May/2024:15:21:38] ENGINE Serving on http://172.21.15.69:8765 2024-05-14T15:21:40.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:40 smithi203 ceph-mon[34567]: [14/May/2024:15:21:38] ENGINE Bus STARTED 2024-05-14T15:21:40.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:40 smithi203 ceph-mon[34567]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:21:40.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:40 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3048488494' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-14T15:21:40.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:40 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3291861171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-14T15:21:40.416 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:21:40.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:40 smithi092 ceph-mon[34729]: [14/May/2024:15:21:38] ENGINE Bus STARTING 2024-05-14T15:21:40.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:40 smithi092 ceph-mon[34729]: [14/May/2024:15:21:38] ENGINE Serving on https://172.21.15.69:7150 2024-05-14T15:21:40.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:40 smithi092 ceph-mon[34729]: [14/May/2024:15:21:38] ENGINE Serving on http://172.21.15.69:8765 2024-05-14T15:21:40.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:40 smithi092 ceph-mon[34729]: [14/May/2024:15:21:38] ENGINE Bus STARTED 2024-05-14T15:21:40.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:40 smithi092 ceph-mon[34729]: pgmap v3: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:21:40.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:40 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3048488494' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-14T15:21:40.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:40 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3291861171' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-14T15:21:41.104 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:41 smithi092 ceph-mon[34729]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:21:41.104 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:41 smithi092 ceph-mon[34729]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-05-14T15:21:41.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:41 smithi069 ceph-mon[31270]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:21:41.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:41 smithi069 ceph-mon[31270]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-05-14T15:21:41.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:41 smithi203 ceph-mon[34567]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:21:41.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:41 smithi203 ceph-mon[34567]: mgrmap e22: x(active, since 2s), standbys: z, y 2024-05-14T15:21:42.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:42 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:42.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:42 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:42.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:42 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:42.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:42 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:42.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:42 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:42.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:42 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:42.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:42 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:42.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:42 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:42.593 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:42 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:42.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:42 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:42.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:42 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:42.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:42 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:42.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.775+0000 7f7461600700 1 -- 172.21.15.69:0/2465030489 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c012650 con 0x7f7464109870 2024-05-14T15:21:42.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.776+0000 7f7469a00700 1 -- 172.21.15.69:0/2465030489 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7464109870 msgr2=0x7f74641111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:42.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.776+0000 7f7469a00700 1 --2- 172.21.15.69:0/2465030489 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7464109870 0x7f74641111d0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f745c00b0d0 tx=0x7f745c00b3e0 comp rx=0 tx=0).stop 2024-05-14T15:21:42.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.776+0000 7f7469a00700 1 -- 172.21.15.69:0/2465030489 shutdown_connections 2024-05-14T15:21:42.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.776+0000 7f7469a00700 1 --2- 172.21.15.69:0/2465030489 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7464109870 0x7f74641111d0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:42.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.776+0000 7f7469a00700 1 --2- 172.21.15.69:0/2465030489 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74641045f0 0x7f7464104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:42.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.776+0000 7f7469a00700 1 --2- 172.21.15.69:0/2465030489 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7464108f20 0x7f7464109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:42.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.776+0000 7f7469a00700 1 -- 172.21.15.69:0/2465030489 >> 172.21.15.69:0/2465030489 conn(0x7f7464100040 msgr2=0x7f7464102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:42.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.776+0000 7f7469a00700 1 -- 172.21.15.69:0/2465030489 shutdown_connections 2024-05-14T15:21:42.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.776+0000 7f7469a00700 1 -- 172.21.15.69:0/2465030489 wait complete. 2024-05-14T15:21:42.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.777+0000 7f7469a00700 1 Processor -- start 2024-05-14T15:21:42.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.778+0000 7f7469a00700 1 -- start start 2024-05-14T15:21:42.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.778+0000 7f7469a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74641045f0 0x7f74641a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:42.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.778+0000 7f7469a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7464108f20 0x7f74641a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:42.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.778+0000 7f7469a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7464109870 0x7f746419ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:42.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.778+0000 7f7469a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f74641143f0 con 0x7f7464108f20 2024-05-14T15:21:42.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.778+0000 7f7469a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7464114270 con 0x7f7464109870 2024-05-14T15:21:42.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.778+0000 7f7469a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7464114570 con 0x7f74641045f0 2024-05-14T15:21:42.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.779+0000 7f7462000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7464108f20 0x7f74641a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:42.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.779+0000 7f7462a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74641045f0 0x7f74641a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:42.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.779+0000 7f7462000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7464108f20 0x7f74641a0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37984/0 (socket says 172.21.15.69:37984) 2024-05-14T15:21:42.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.779+0000 7f7462000700 1 -- 172.21.15.69:0/1132465789 learned_addr learned my addr 172.21.15.69:0/1132465789 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:42.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.779+0000 7f7463400700 1 --2- 172.21.15.69:0/1132465789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7464109870 0x7f746419ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:42.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.779+0000 7f7462000700 1 -- 172.21.15.69:0/1132465789 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74641045f0 msgr2=0x7f74641a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:42.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.779+0000 7f7462000700 1 --2- 172.21.15.69:0/1132465789 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74641045f0 0x7f74641a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:42.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.779+0000 7f7462000700 1 -- 172.21.15.69:0/1132465789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7464109870 msgr2=0x7f746419ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:42.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.779+0000 7f7462000700 1 --2- 172.21.15.69:0/1132465789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7464109870 0x7f746419ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:42.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.779+0000 7f7462000700 1 -- 172.21.15.69:0/1132465789 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746419b260 con 0x7f7464108f20 2024-05-14T15:21:42.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.779+0000 7f7463400700 1 --2- 172.21.15.69:0/1132465789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7464109870 0x7f746419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:21:42.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.780+0000 7f7462000700 1 --2- 172.21.15.69:0/1132465789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7464108f20 0x7f74641a0ee0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f745000d980 tx=0x7f745000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:42.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.780+0000 7f745b400700 1 -- 172.21.15.69:0/1132465789 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7450017070 con 0x7f7464108f20 2024-05-14T15:21:42.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.780+0000 7f745b400700 1 -- 172.21.15.69:0/1132465789 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7450009dc0 con 0x7f7464108f20 2024-05-14T15:21:42.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.780+0000 7f745b400700 1 -- 172.21.15.69:0/1132465789 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745000f3c0 con 0x7f7464108f20 2024-05-14T15:21:42.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.780+0000 7f7469a00700 1 -- 172.21.15.69:0/1132465789 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746419b550 con 0x7f7464108f20 2024-05-14T15:21:42.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.780+0000 7f7469a00700 1 -- 172.21.15.69:0/1132465789 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74641a7750 con 0x7f7464108f20 2024-05-14T15:21:42.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.782+0000 7f7469a00700 1 -- 172.21.15.69:0/1132465789 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7464105aa0 con 0x7f7464108f20 2024-05-14T15:21:42.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.784+0000 7f745b400700 1 -- 172.21.15.69:0/1132465789 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 149828+0+0 (secure 0 0 0) 0x7f7450009930 con 0x7f7464108f20 2024-05-14T15:21:42.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.785+0000 7f745b400700 1 --2- 172.21.15.69:0/1132465789 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f74480b2a80 0x7f74480b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:42.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.786+0000 7f745b400700 1 -- 172.21.15.69:0/1132465789 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f74500e26e0 con 0x7f7464108f20 2024-05-14T15:21:42.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.786+0000 7f7462a00700 1 --2- 172.21.15.69:0/1132465789 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f74480b2a80 0x7f74480b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:42.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.787+0000 7f7462a00700 1 --2- 172.21.15.69:0/1132465789 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f74480b2a80 0x7f74480b4f90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7454005950 tx=0x7f745400b410 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:42.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:42.794+0000 7f745b400700 1 -- 172.21.15.69:0/1132465789 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f74500a9b40 con 0x7f7464108f20 2024-05-14T15:21:43.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:43.111+0000 7f7469a00700 1 -- 172.21.15.69:0/1132465789 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f746402e5f0 con 0x7f7464108f20 2024-05-14T15:21:43.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:43.113+0000 7f745b400700 1 -- 172.21.15.69:0/1132465789 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11932 (secure 0 0 0) 0x7f74500a9440 con 0x7f7464108f20 2024-05-14T15:21:43.114 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:21:43.114 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T15:16:11.716543+0000","modified":"2024-05-14T15:21:36.935970+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34490,"mds_1":34460,"mds_2":34433,"mds_3":34409,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":31,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":35,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34490":{"gid":34490,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34490,"qdb_cluster":[34490,34460,34409,24451,34433]},"id":1}]} 2024-05-14T15:21:43.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:43.116+0000 7f7469a00700 1 -- 172.21.15.69:0/1132465789 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f74480b2a80 msgr2=0x7f74480b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:43.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:43.116+0000 7f7469a00700 1 --2- 172.21.15.69:0/1132465789 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f74480b2a80 0x7f74480b4f90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7454005950 tx=0x7f745400b410 comp rx=0 tx=0).stop 2024-05-14T15:21:43.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:43.116+0000 7f7469a00700 1 -- 172.21.15.69:0/1132465789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7464108f20 msgr2=0x7f74641a0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:43.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:43.116+0000 7f7469a00700 1 --2- 172.21.15.69:0/1132465789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7464108f20 0x7f74641a0ee0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f745000d980 tx=0x7f745000dc90 comp rx=0 tx=0).stop 2024-05-14T15:21:43.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:43.116+0000 7f7469a00700 1 -- 172.21.15.69:0/1132465789 shutdown_connections 2024-05-14T15:21:43.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:43.116+0000 7f7469a00700 1 --2- 172.21.15.69:0/1132465789 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f74480b2a80 0x7f74480b4f90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:43.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:43.116+0000 7f7469a00700 1 --2- 172.21.15.69:0/1132465789 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7464109870 0x7f746419ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:43.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:43.116+0000 7f7469a00700 1 --2- 172.21.15.69:0/1132465789 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f74641045f0 0x7f74641a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:43.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:43.116+0000 7f7469a00700 1 --2- 172.21.15.69:0/1132465789 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7464108f20 0x7f74641a0ee0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:43.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:43.116+0000 7f7469a00700 1 -- 172.21.15.69:0/1132465789 >> 172.21.15.69:0/1132465789 conn(0x7f7464100040 msgr2=0x7f7464108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:43.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:43.116+0000 7f7469a00700 1 -- 172.21.15.69:0/1132465789 shutdown_connections 2024-05-14T15:21:43.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:43.116+0000 7f7469a00700 1 -- 172.21.15.69:0/1132465789 wait complete. 2024-05-14T15:21:43.119 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 30 2024-05-14T15:21:43.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:43 smithi092 ceph-mon[34729]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:21:43.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:43 smithi092 ceph-mon[34729]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-05-14T15:21:43.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:43 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:43.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:43 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:43.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:43 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1132465789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:21:43.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:43 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:43.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:43 smithi069 ceph-mon[31270]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:21:43.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:43 smithi069 ceph-mon[31270]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-05-14T15:21:43.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:43 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:43.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:43 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:43.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:43 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1132465789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:21:43.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:43 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:43.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:43 smithi203 ceph-mon[34567]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:21:43.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:43 smithi203 ceph-mon[34567]: mgrmap e23: x(active, since 4s), standbys: z, y 2024-05-14T15:21:43.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:43 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:43.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:43 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:43.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:43 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1132465789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:21:43.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:43 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:44.092 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-05-14T15:21:44.093 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-05-14T15:21:44.093 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T15:21:44.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.366+0000 7fee28a00640 1 -- 172.21.15.69:0/29744345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee24103d50 msgr2=0x7fee24104160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:44.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.366+0000 7fee28a00640 1 --2- 172.21.15.69:0/29744345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee24103d50 0x7fee24104160 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fee10009900 tx=0x7fee1002a3f0 comp rx=0 tx=0).stop 2024-05-14T15:21:44.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.366+0000 7fee28a00640 1 -- 172.21.15.69:0/29744345 shutdown_connections 2024-05-14T15:21:44.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.366+0000 7fee28a00640 1 --2- 172.21.15.69:0/29744345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee24108a50 0x7fee2410ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:44.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.366+0000 7fee28a00640 1 --2- 172.21.15.69:0/29744345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee24103d50 0x7fee24104160 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:44.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.366+0000 7fee28a00640 1 --2- 172.21.15.69:0/29744345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee24102b10 0x7fee24103810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:44.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.367+0000 7fee28a00640 1 -- 172.21.15.69:0/29744345 >> 172.21.15.69:0/29744345 conn(0x7fee240fdd00 msgr2=0x7fee241001b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:44.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.367+0000 7fee28a00640 1 -- 172.21.15.69:0/29744345 shutdown_connections 2024-05-14T15:21:44.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.367+0000 7fee28a00640 1 -- 172.21.15.69:0/29744345 wait complete. 2024-05-14T15:21:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.368+0000 7fee28a00640 1 Processor -- start 2024-05-14T15:21:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.368+0000 7fee28a00640 1 -- start start 2024-05-14T15:21:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.368+0000 7fee28a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee24102b10 0x7fee2419a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.368+0000 7fee28a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee24103d50 0x7fee2419aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.368+0000 7fee28a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee24108a50 0x7fee241a1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.368+0000 7fee28a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fee2410e4c0 con 0x7fee24108a50 2024-05-14T15:21:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.368+0000 7fee28a00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fee2410e340 con 0x7fee24102b10 2024-05-14T15:21:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.368+0000 7fee28a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fee2410e640 con 0x7fee24103d50 2024-05-14T15:21:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.368+0000 7fee22800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee24108a50 0x7fee241a1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:44.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.369+0000 7fee22800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee24108a50 0x7fee241a1a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52648/0 (socket says 172.21.15.69:52648) 2024-05-14T15:21:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.369+0000 7fee22800640 1 -- 172.21.15.69:0/1736735990 learned_addr learned my addr 172.21.15.69:0/1736735990 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.369+0000 7fee21400640 1 --2- 172.21.15.69:0/1736735990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee24103d50 0x7fee2419aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.369+0000 7fee21e00640 1 --2- 172.21.15.69:0/1736735990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee24102b10 0x7fee2419a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.369+0000 7fee22800640 1 -- 172.21.15.69:0/1736735990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee24103d50 msgr2=0x7fee2419aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.369+0000 7fee22800640 1 --2- 172.21.15.69:0/1736735990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee24103d50 0x7fee2419aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.369+0000 7fee22800640 1 -- 172.21.15.69:0/1736735990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee24102b10 msgr2=0x7fee2419a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.369+0000 7fee22800640 1 --2- 172.21.15.69:0/1736735990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee24102b10 0x7fee2419a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.369+0000 7fee22800640 1 -- 172.21.15.69:0/1736735990 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee241a1ff0 con 0x7fee24108a50 2024-05-14T15:21:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.369+0000 7fee22800640 1 --2- 172.21.15.69:0/1736735990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee24108a50 0x7fee241a1a30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00cce0 tx=0x7fee1c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.370+0000 7fee1aa00640 1 -- 172.21.15.69:0/1736735990 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c00f450 con 0x7fee24108a50 2024-05-14T15:21:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.370+0000 7fee1aa00640 1 -- 172.21.15.69:0/1736735990 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fee1c00fa80 con 0x7fee24108a50 2024-05-14T15:21:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.370+0000 7fee28a00640 1 -- 172.21.15.69:0/1736735990 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee241a22e0 con 0x7fee24108a50 2024-05-14T15:21:44.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.370+0000 7fee1aa00640 1 -- 172.21.15.69:0/1736735990 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c018ad0 con 0x7fee24108a50 2024-05-14T15:21:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.370+0000 7fee28a00640 1 -- 172.21.15.69:0/1736735990 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee241a27e0 con 0x7fee24108a50 2024-05-14T15:21:44.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.371+0000 7fee28a00640 1 -- 172.21.15.69:0/1736735990 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee24069ca0 con 0x7fee24108a50 2024-05-14T15:21:44.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.374+0000 7fee1aa00640 1 -- 172.21.15.69:0/1736735990 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 149828+0+0 (secure 0 0 0) 0x7fee1c00f5f0 con 0x7fee24108a50 2024-05-14T15:21:44.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.375+0000 7fee1aa00640 1 --2- 172.21.15.69:0/1736735990 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fee080b29f0 0x7fee080b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:44.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.376+0000 7fee1aa00640 1 -- 172.21.15.69:0/1736735990 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fee1c0e3540 con 0x7fee24108a50 2024-05-14T15:21:44.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.376+0000 7fee21e00640 1 --2- 172.21.15.69:0/1736735990 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fee080b29f0 0x7fee080b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:44.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.377+0000 7fee21e00640 1 --2- 172.21.15.69:0/1736735990 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fee080b29f0 0x7fee080b4f00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fee14005fd0 tx=0x7fee14005850 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:44.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.378+0000 7fee1aa00640 1 -- 172.21.15.69:0/1736735990 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fee1c014030 con 0x7fee24108a50 2024-05-14T15:21:44.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:44 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:44.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:44 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:44 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:44 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:44 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:44 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:44.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:44 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:44.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:44 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:44 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:44 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:44 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:44 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:44 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:44 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:44 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:44 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:44 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:44 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:44.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:44 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:44 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:44 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:44 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.584+0000 7fee28a00640 1 -- 172.21.15.69:0/1736735990 --> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee2410a820 con 0x7fee080b29f0 2024-05-14T15:21:44.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:44 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:44.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:44 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:44 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:44 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:44 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:44 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:44.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:44 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:44.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:44 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:44 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:44 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:44 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:44.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.598+0000 7fee1aa00640 1 -- 172.21.15.69:0/1736735990 <== mgr.34991 v2:172.21.15.69:6800/1271399048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339517 (secure 0 0 0) 0x7fee2410a820 con 0x7fee080b29f0 2024-05-14T15:21:44.604 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:21:44.606 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-05-14T15:21:44.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.605+0000 7fee28a00640 1 -- 172.21.15.69:0/1736735990 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fee080b29f0 msgr2=0x7fee080b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:44.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.605+0000 7fee28a00640 1 --2- 172.21.15.69:0/1736735990 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fee080b29f0 0x7fee080b4f00 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fee14005fd0 tx=0x7fee14005850 comp rx=0 tx=0).stop 2024-05-14T15:21:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.605+0000 7fee28a00640 1 -- 172.21.15.69:0/1736735990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee24108a50 msgr2=0x7fee241a1a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.605+0000 7fee28a00640 1 --2- 172.21.15.69:0/1736735990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee24108a50 0x7fee241a1a30 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fee1c00cce0 tx=0x7fee1c00a620 comp rx=0 tx=0).stop 2024-05-14T15:21:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.605+0000 7fee28a00640 1 -- 172.21.15.69:0/1736735990 shutdown_connections 2024-05-14T15:21:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.605+0000 7fee28a00640 1 --2- 172.21.15.69:0/1736735990 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fee080b29f0 0x7fee080b4f00 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.605+0000 7fee28a00640 1 --2- 172.21.15.69:0/1736735990 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fee24108a50 0x7fee241a1a30 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.605+0000 7fee28a00640 1 --2- 172.21.15.69:0/1736735990 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fee24103d50 0x7fee2419aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.605+0000 7fee28a00640 1 --2- 172.21.15.69:0/1736735990 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fee24102b10 0x7fee2419a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.605+0000 7fee28a00640 1 -- 172.21.15.69:0/1736735990 >> 172.21.15.69:0/1736735990 conn(0x7fee240fdd00 msgr2=0x7fee2410a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.605+0000 7fee28a00640 1 -- 172.21.15.69:0/1736735990 shutdown_connections 2024-05-14T15:21:44.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.605+0000 7fee28a00640 1 -- 172.21.15.69:0/1736735990 wait complete. 2024-05-14T15:21:44.632 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-05-14T15:21:43.833225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1199743,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":2628,"num_read_kb":1466,"num_write":522,"num_write_kb":3641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":916,"ondisk_log_size":916,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385624,"kb_used_data":15632,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124556200,"statfs":{"total":1151940427776,"available":1151545548800,"internally_reserved":0,"allocated":16007168,"data_stored":9330852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.984569"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.157290+0000","last_change":"2024-05-14T15:16:08.799448+0000","last_active":"2024-05-14T15:21:38.157290+0000","last_peered":"2024-05-14T15:21:38.157290+0000","last_clean":"2024-05-14T15:21:38.157290+0000","last_became_active":"2024-05-14T15:16:08.799025+0000","last_became_peered":"2024-05-14T15:16:08.799025+0000","last_unstale":"2024-05-14T15:21:38.157290+0000","last_undegraded":"2024-05-14T15:21:38.157290+0000","last_fullsized":"2024-05-14T15:21:38.157290+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:25:56.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154838+0000","last_change":"2024-05-14T15:16:08.796943+0000","last_active":"2024-05-14T15:21:38.154838+0000","last_peered":"2024-05-14T15:21:38.154838+0000","last_clean":"2024-05-14T15:21:38.154838+0000","last_became_active":"2024-05-14T15:16:08.796044+0000","last_became_peered":"2024-05-14T15:16:08.796044+0000","last_unstale":"2024-05-14T15:21:38.154838+0000","last_undegraded":"2024-05-14T15:21:38.154838+0000","last_fullsized":"2024-05-14T15:21:38.154838+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:26:22.103727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153707+0000","last_change":"2024-05-14T15:16:08.794020+0000","last_active":"2024-05-14T15:21:38.153707+0000","last_peered":"2024-05-14T15:21:38.153707+0000","last_clean":"2024-05-14T15:21:38.153707+0000","last_became_active":"2024-05-14T15:16:08.793677+0000","last_became_peered":"2024-05-14T15:16:08.793677+0000","last_unstale":"2024-05-14T15:21:38.153707+0000","last_undegraded":"2024-05-14T15:21:38.153707+0000","last_fullsized":"2024-05-14T15:21:38.153707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.615815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.805580+0000","last_change":"2024-05-14T15:16:08.787482+0000","last_active":"2024-05-14T15:21:37.805580+0000","last_peered":"2024-05-14T15:21:37.805580+0000","last_clean":"2024-05-14T15:21:37.805580+0000","last_became_active":"2024-05-14T15:16:08.787087+0000","last_became_peered":"2024-05-14T15:16:08.787087+0000","last_unstale":"2024-05-14T15:21:37.805580+0000","last_undegraded":"2024-05-14T15:21:37.805580+0000","last_fullsized":"2024-05-14T15:21:37.805580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:18:51.433751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804789+0000","last_change":"2024-05-14T15:16:08.785982+0000","last_active":"2024-05-14T15:21:37.804789+0000","last_peered":"2024-05-14T15:21:37.804789+0000","last_clean":"2024-05-14T15:21:37.804789+0000","last_became_active":"2024-05-14T15:16:08.784980+0000","last_became_peered":"2024-05-14T15:16:08.784980+0000","last_unstale":"2024-05-14T15:21:37.804789+0000","last_undegraded":"2024-05-14T15:21:37.804789+0000","last_fullsized":"2024-05-14T15:21:37.804789+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:07:50.390637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.983083+0000","last_change":"2024-05-14T15:16:08.784622+0000","last_active":"2024-05-14T15:21:37.983083+0000","last_peered":"2024-05-14T15:21:37.983083+0000","last_clean":"2024-05-14T15:21:37.983083+0000","last_became_active":"2024-05-14T15:16:08.784206+0000","last_became_peered":"2024-05-14T15:16:08.784206+0000","last_unstale":"2024-05-14T15:21:37.983083+0000","last_undegraded":"2024-05-14T15:21:37.983083+0000","last_fullsized":"2024-05-14T15:21:37.983083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:40:56.578935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.080463+0000","last_change":"2024-05-14T15:16:08.786381+0000","last_active":"2024-05-14T15:21:38.080463+0000","last_peered":"2024-05-14T15:21:38.080463+0000","last_clean":"2024-05-14T15:21:38.080463+0000","last_became_active":"2024-05-14T15:16:08.781231+0000","last_became_peered":"2024-05-14T15:16:08.781231+0000","last_unstale":"2024-05-14T15:21:38.080463+0000","last_undegraded":"2024-05-14T15:21:38.080463+0000","last_fullsized":"2024-05-14T15:21:38.080463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:51:16.961187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.960967+0000","last_change":"2024-05-14T15:17:43.850244+0000","last_active":"2024-05-14T15:21:37.960967+0000","last_peered":"2024-05-14T15:21:37.960967+0000","last_clean":"2024-05-14T15:21:37.960967+0000","last_became_active":"2024-05-14T15:17:43.849671+0000","last_became_peered":"2024-05-14T15:17:43.849671+0000","last_unstale":"2024-05-14T15:21:37.960967+0000","last_undegraded":"2024-05-14T15:21:37.960967+0000","last_fullsized":"2024-05-14T15:21:37.960967+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:21:05.537250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,10],"acting":[3,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155626+0000","last_change":"2024-05-14T15:16:08.785644+0000","last_active":"2024-05-14T15:21:38.155626+0000","last_peered":"2024-05-14T15:21:38.155626+0000","last_clean":"2024-05-14T15:21:38.155626+0000","last_became_active":"2024-05-14T15:16:08.785224+0000","last_became_peered":"2024-05-14T15:16:08.785224+0000","last_unstale":"2024-05-14T15:21:38.155626+0000","last_undegraded":"2024-05-14T15:21:38.155626+0000","last_fullsized":"2024-05-14T15:21:38.155626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:05:10.868610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":58,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.984158+0000","last_change":"2024-05-14T15:16:08.784425+0000","last_active":"2024-05-14T15:21:37.984158+0000","last_peered":"2024-05-14T15:21:37.984158+0000","last_clean":"2024-05-14T15:21:37.984158+0000","last_became_active":"2024-05-14T15:16:08.782889+0000","last_became_peered":"2024-05-14T15:16:08.782889+0000","last_unstale":"2024-05-14T15:21:37.984158+0000","last_undegraded":"2024-05-14T15:21:37.984158+0000","last_fullsized":"2024-05-14T15:21:37.984158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:40:11.043101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082375+0000","last_change":"2024-05-14T15:16:08.782675+0000","last_active":"2024-05-14T15:21:38.082375+0000","last_peered":"2024-05-14T15:21:38.082375+0000","last_clean":"2024-05-14T15:21:38.082375+0000","last_became_active":"2024-05-14T15:16:08.781994+0000","last_became_peered":"2024-05-14T15:16:08.781994+0000","last_unstale":"2024-05-14T15:21:38.082375+0000","last_undegraded":"2024-05-14T15:21:38.082375+0000","last_fullsized":"2024-05-14T15:21:38.082375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:00:59.625493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.805442+0000","last_change":"2024-05-14T15:16:08.785655+0000","last_active":"2024-05-14T15:21:37.805442+0000","last_peered":"2024-05-14T15:21:37.805442+0000","last_clean":"2024-05-14T15:21:37.805442+0000","last_became_active":"2024-05-14T15:16:08.785273+0000","last_became_peered":"2024-05-14T15:16:08.785273+0000","last_unstale":"2024-05-14T15:21:37.805442+0000","last_undegraded":"2024-05-14T15:21:37.805442+0000","last_fullsized":"2024-05-14T15:21:37.805442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:11:51.971909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145068+0000","last_change":"2024-05-14T15:16:08.775558+0000","last_active":"2024-05-14T15:21:38.145068+0000","last_peered":"2024-05-14T15:21:38.145068+0000","last_clean":"2024-05-14T15:21:38.145068+0000","last_became_active":"2024-05-14T15:16:08.773465+0000","last_became_peered":"2024-05-14T15:16:08.773465+0000","last_unstale":"2024-05-14T15:21:38.145068+0000","last_undegraded":"2024-05-14T15:21:38.145068+0000","last_fullsized":"2024-05-14T15:21:38.145068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:16:17.151374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153837+0000","last_change":"2024-05-14T15:16:08.786160+0000","last_active":"2024-05-14T15:21:38.153837+0000","last_peered":"2024-05-14T15:21:38.153837+0000","last_clean":"2024-05-14T15:21:38.153837+0000","last_became_active":"2024-05-14T15:16:08.781257+0000","last_became_peered":"2024-05-14T15:16:08.781257+0000","last_unstale":"2024-05-14T15:21:38.153837+0000","last_undegraded":"2024-05-14T15:21:38.153837+0000","last_fullsized":"2024-05-14T15:21:38.153837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:13:03.974692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153600+0000","last_change":"2024-05-14T15:16:43.014673+0000","last_active":"2024-05-14T15:21:38.153600+0000","last_peered":"2024-05-14T15:21:38.153600+0000","last_clean":"2024-05-14T15:21:38.153600+0000","last_became_active":"2024-05-14T15:16:43.013718+0000","last_became_peered":"2024-05-14T15:16:43.013718+0000","last_unstale":"2024-05-14T15:21:38.153600+0000","last_undegraded":"2024-05-14T15:21:38.153600+0000","last_fullsized":"2024-05-14T15:21:38.153600+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:08:42.885151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153490+0000","last_change":"2024-05-14T15:16:08.784437+0000","last_active":"2024-05-14T15:21:38.153490+0000","last_peered":"2024-05-14T15:21:38.153490+0000","last_clean":"2024-05-14T15:21:38.153490+0000","last_became_active":"2024-05-14T15:16:08.784030+0000","last_became_peered":"2024-05-14T15:16:08.784030+0000","last_unstale":"2024-05-14T15:21:38.153490+0000","last_undegraded":"2024-05-14T15:21:38.153490+0000","last_fullsized":"2024-05-14T15:21:38.153490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:57:43.025679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.156811+0000","last_change":"2024-05-14T15:16:08.798419+0000","last_active":"2024-05-14T15:21:38.156811+0000","last_peered":"2024-05-14T15:21:38.156811+0000","last_clean":"2024-05-14T15:21:38.156811+0000","last_became_active":"2024-05-14T15:16:08.798066+0000","last_became_peered":"2024-05-14T15:16:08.798066+0000","last_unstale":"2024-05-14T15:21:38.156811+0000","last_undegraded":"2024-05-14T15:21:38.156811+0000","last_fullsized":"2024-05-14T15:21:38.156811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:55:29.921745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.798694+0000","last_change":"2024-05-14T15:16:08.780638+0000","last_active":"2024-05-14T15:21:37.798694+0000","last_peered":"2024-05-14T15:21:37.798694+0000","last_clean":"2024-05-14T15:21:37.798694+0000","last_became_active":"2024-05-14T15:16:08.778675+0000","last_became_peered":"2024-05-14T15:16:08.778675+0000","last_unstale":"2024-05-14T15:21:37.798694+0000","last_undegraded":"2024-05-14T15:21:37.798694+0000","last_fullsized":"2024-05-14T15:21:37.798694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:29.780036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146810+0000","last_change":"2024-05-14T15:16:08.791729+0000","last_active":"2024-05-14T15:21:38.146810+0000","last_peered":"2024-05-14T15:21:38.146810+0000","last_clean":"2024-05-14T15:21:38.146810+0000","last_became_active":"2024-05-14T15:16:08.791367+0000","last_became_peered":"2024-05-14T15:16:08.791367+0000","last_unstale":"2024-05-14T15:21:38.146810+0000","last_undegraded":"2024-05-14T15:21:38.146810+0000","last_fullsized":"2024-05-14T15:21:38.146810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:03:00.148744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145875+0000","last_change":"2024-05-14T15:16:22.909315+0000","last_active":"2024-05-14T15:21:38.145875+0000","last_peered":"2024-05-14T15:21:38.145875+0000","last_clean":"2024-05-14T15:21:38.145875+0000","last_became_active":"2024-05-14T15:16:22.908846+0000","last_became_peered":"2024-05-14T15:16:22.908846+0000","last_unstale":"2024-05-14T15:21:38.145875+0000","last_undegraded":"2024-05-14T15:21:38.145875+0000","last_fullsized":"2024-05-14T15:21:38.145875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:20:50.338711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'15","reported_seq":304,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.797488+0000","last_change":"2024-05-14T15:16:03.729599+0000","last_active":"2024-05-14T15:21:37.797488+0000","last_peered":"2024-05-14T15:21:37.797488+0000","last_clean":"2024-05-14T15:21:37.797488+0000","last_became_active":"2024-05-14T15:16:03.728659+0000","last_became_peered":"2024-05-14T15:16:03.728659+0000","last_unstale":"2024-05-14T15:21:37.797488+0000","last_undegraded":"2024-05-14T15:21:37.797488+0000","last_fullsized":"2024-05-14T15:21:37.797488+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:54:18.989059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961610+0000","last_change":"2024-05-14T15:16:08.790296+0000","last_active":"2024-05-14T15:21:37.961610+0000","last_peered":"2024-05-14T15:21:37.961610+0000","last_clean":"2024-05-14T15:21:37.961610+0000","last_became_active":"2024-05-14T15:16:08.789899+0000","last_became_peered":"2024-05-14T15:16:08.789899+0000","last_unstale":"2024-05-14T15:21:37.961610+0000","last_undegraded":"2024-05-14T15:21:37.961610+0000","last_fullsized":"2024-05-14T15:21:37.961610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:23:15.626580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.803102+0000","last_change":"2024-05-14T15:16:22.904857+0000","last_active":"2024-05-14T15:21:37.803102+0000","last_peered":"2024-05-14T15:21:37.803102+0000","last_clean":"2024-05-14T15:21:37.803102+0000","last_became_active":"2024-05-14T15:16:22.903747+0000","last_became_peered":"2024-05-14T15:16:22.903747+0000","last_unstale":"2024-05-14T15:21:37.803102+0000","last_undegraded":"2024-05-14T15:21:37.803102+0000","last_fullsized":"2024-05-14T15:21:37.803102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:58:27.937637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.962192+0000","last_change":"2024-05-14T15:16:03.840248+0000","last_active":"2024-05-14T15:21:37.962192+0000","last_peered":"2024-05-14T15:21:37.962192+0000","last_clean":"2024-05-14T15:21:37.962192+0000","last_became_active":"2024-05-14T15:16:03.839731+0000","last_became_peered":"2024-05-14T15:16:03.839731+0000","last_unstale":"2024-05-14T15:21:37.962192+0000","last_undegraded":"2024-05-14T15:21:37.962192+0000","last_fullsized":"2024-05-14T15:21:37.962192+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:31:25.981757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.156094+0000","last_change":"2024-05-14T15:16:08.791233+0000","last_active":"2024-05-14T15:21:38.156094+0000","last_peered":"2024-05-14T15:21:38.156094+0000","last_clean":"2024-05-14T15:21:38.156094+0000","last_became_active":"2024-05-14T15:16:08.790376+0000","last_became_peered":"2024-05-14T15:16:08.790376+0000","last_unstale":"2024-05-14T15:21:38.156094+0000","last_undegraded":"2024-05-14T15:21:38.156094+0000","last_fullsized":"2024-05-14T15:21:38.156094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:35.203663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804053+0000","last_change":"2024-05-14T15:16:22.906435+0000","last_active":"2024-05-14T15:21:37.804053+0000","last_peered":"2024-05-14T15:21:37.804053+0000","last_clean":"2024-05-14T15:21:37.804053+0000","last_became_active":"2024-05-14T15:16:22.905558+0000","last_became_peered":"2024-05-14T15:16:22.905558+0000","last_unstale":"2024-05-14T15:21:37.804053+0000","last_undegraded":"2024-05-14T15:21:37.804053+0000","last_fullsized":"2024-05-14T15:21:37.804053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:43:15.748904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155943+0000","last_change":"2024-05-14T15:16:43.026454+0000","last_active":"2024-05-14T15:21:38.155943+0000","last_peered":"2024-05-14T15:21:38.155943+0000","last_clean":"2024-05-14T15:21:38.155943+0000","last_became_active":"2024-05-14T15:16:43.019742+0000","last_became_peered":"2024-05-14T15:16:43.019742+0000","last_unstale":"2024-05-14T15:21:38.155943+0000","last_undegraded":"2024-05-14T15:21:38.155943+0000","last_fullsized":"2024-05-14T15:21:38.155943+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:38:38.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154348+0000","last_change":"2024-05-14T15:16:08.774669+0000","last_active":"2024-05-14T15:21:38.154348+0000","last_peered":"2024-05-14T15:21:38.154348+0000","last_clean":"2024-05-14T15:21:38.154348+0000","last_became_active":"2024-05-14T15:16:08.773996+0000","last_became_peered":"2024-05-14T15:16:08.773996+0000","last_unstale":"2024-05-14T15:21:38.154348+0000","last_undegraded":"2024-05-14T15:21:38.154348+0000","last_fullsized":"2024-05-14T15:21:38.154348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:21:58.199462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.803377+0000","last_change":"2024-05-14T15:16:43.065743+0000","last_active":"2024-05-14T15:21:37.803377+0000","last_peered":"2024-05-14T15:21:37.803377+0000","last_clean":"2024-05-14T15:21:37.803377+0000","last_became_active":"2024-05-14T15:16:43.064426+0000","last_became_peered":"2024-05-14T15:16:43.064426+0000","last_unstale":"2024-05-14T15:21:37.803377+0000","last_undegraded":"2024-05-14T15:21:37.803377+0000","last_fullsized":"2024-05-14T15:21:37.803377+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:15:44.230694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804621+0000","last_change":"2024-05-14T15:16:03.732142+0000","last_active":"2024-05-14T15:21:37.804621+0000","last_peered":"2024-05-14T15:21:37.804621+0000","last_clean":"2024-05-14T15:21:37.804621+0000","last_became_active":"2024-05-14T15:16:03.731590+0000","last_became_peered":"2024-05-14T15:16:03.731590+0000","last_unstale":"2024-05-14T15:21:37.804621+0000","last_undegraded":"2024-05-14T15:21:37.804621+0000","last_fullsized":"2024-05-14T15:21:37.804621+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:05:23.760541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.975058+0000","last_change":"2024-05-14T15:16:08.780895+0000","last_active":"2024-05-14T15:21:37.975058+0000","last_peered":"2024-05-14T15:21:37.975058+0000","last_clean":"2024-05-14T15:21:37.975058+0000","last_became_active":"2024-05-14T15:16:08.780472+0000","last_became_peered":"2024-05-14T15:16:08.780472+0000","last_unstale":"2024-05-14T15:21:37.975058+0000","last_undegraded":"2024-05-14T15:21:37.975058+0000","last_fullsized":"2024-05-14T15:21:37.975058+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:49.508043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146184+0000","last_change":"2024-05-14T15:16:22.915997+0000","last_active":"2024-05-14T15:21:38.146184+0000","last_peered":"2024-05-14T15:21:38.146184+0000","last_clean":"2024-05-14T15:21:38.146184+0000","last_became_active":"2024-05-14T15:16:22.915466+0000","last_became_peered":"2024-05-14T15:16:22.915466+0000","last_unstale":"2024-05-14T15:21:38.146184+0000","last_undegraded":"2024-05-14T15:21:38.146184+0000","last_fullsized":"2024-05-14T15:21:38.146184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:50:39.748860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"92'10","reported_seq":303,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.409493+0000","last_change":"2024-05-14T15:16:03.733796+0000","last_active":"2024-05-14T15:21:38.409493+0000","last_peered":"2024-05-14T15:21:38.409493+0000","last_clean":"2024-05-14T15:21:38.409493+0000","last_became_active":"2024-05-14T15:16:03.732467+0000","last_became_peered":"2024-05-14T15:16:03.732467+0000","last_unstale":"2024-05-14T15:21:38.409493+0000","last_undegraded":"2024-05-14T15:21:38.409493+0000","last_fullsized":"2024-05-14T15:21:38.409493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:28.388120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2413,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":245,"num_read_kb":5,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804145+0000","last_change":"2024-05-14T15:16:08.793287+0000","last_active":"2024-05-14T15:21:37.804145+0000","last_peered":"2024-05-14T15:21:37.804145+0000","last_clean":"2024-05-14T15:21:37.804145+0000","last_became_active":"2024-05-14T15:16:08.791173+0000","last_became_peered":"2024-05-14T15:16:08.791173+0000","last_unstale":"2024-05-14T15:21:37.804145+0000","last_undegraded":"2024-05-14T15:21:37.804145+0000","last_fullsized":"2024-05-14T15:21:37.804145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:24:49.644251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145909+0000","last_change":"2024-05-14T15:16:22.914734+0000","last_active":"2024-05-14T15:21:38.145909+0000","last_peered":"2024-05-14T15:21:38.145909+0000","last_clean":"2024-05-14T15:21:38.145909+0000","last_became_active":"2024-05-14T15:16:22.914267+0000","last_became_peered":"2024-05-14T15:16:22.914267+0000","last_unstale":"2024-05-14T15:21:38.145909+0000","last_undegraded":"2024-05-14T15:21:38.145909+0000","last_fullsized":"2024-05-14T15:21:38.145909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:04:50.809564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.983167+0000","last_change":"2024-05-14T15:16:03.729217+0000","last_active":"2024-05-14T15:21:37.983167+0000","last_peered":"2024-05-14T15:21:37.983167+0000","last_clean":"2024-05-14T15:21:37.983167+0000","last_became_active":"2024-05-14T15:16:03.727453+0000","last_became_peered":"2024-05-14T15:16:03.727453+0000","last_unstale":"2024-05-14T15:21:37.983167+0000","last_undegraded":"2024-05-14T15:21:37.983167+0000","last_fullsized":"2024-05-14T15:21:37.983167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:40:27.820618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974866+0000","last_change":"2024-05-14T15:16:08.783861+0000","last_active":"2024-05-14T15:21:37.974866+0000","last_peered":"2024-05-14T15:21:37.974866+0000","last_clean":"2024-05-14T15:21:37.974866+0000","last_became_active":"2024-05-14T15:16:08.782986+0000","last_became_peered":"2024-05-14T15:16:08.782986+0000","last_unstale":"2024-05-14T15:21:37.974866+0000","last_undegraded":"2024-05-14T15:21:37.974866+0000","last_fullsized":"2024-05-14T15:21:37.974866+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:52.453137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.156781+0000","last_change":"2024-05-14T15:16:22.912295+0000","last_active":"2024-05-14T15:21:38.156781+0000","last_peered":"2024-05-14T15:21:38.156781+0000","last_clean":"2024-05-14T15:21:38.156781+0000","last_became_active":"2024-05-14T15:16:22.911779+0000","last_became_peered":"2024-05-14T15:16:22.911779+0000","last_unstale":"2024-05-14T15:21:38.156781+0000","last_undegraded":"2024-05-14T15:21:38.156781+0000","last_fullsized":"2024-05-14T15:21:38.156781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:47:45.153619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.144215+0000","last_change":"2024-05-14T15:16:03.729590+0000","last_active":"2024-05-14T15:21:38.144215+0000","last_peered":"2024-05-14T15:21:38.144215+0000","last_clean":"2024-05-14T15:21:38.144215+0000","last_became_active":"2024-05-14T15:16:03.727790+0000","last_became_peered":"2024-05-14T15:16:03.727790+0000","last_unstale":"2024-05-14T15:21:38.144215+0000","last_undegraded":"2024-05-14T15:21:38.144215+0000","last_fullsized":"2024-05-14T15:21:38.144215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:13:31.960505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.960865+0000","last_change":"2024-05-14T15:16:08.789872+0000","last_active":"2024-05-14T15:21:37.960865+0000","last_peered":"2024-05-14T15:21:37.960865+0000","last_clean":"2024-05-14T15:21:37.960865+0000","last_became_active":"2024-05-14T15:16:08.786817+0000","last_became_peered":"2024-05-14T15:16:08.786817+0000","last_unstale":"2024-05-14T15:21:37.960865+0000","last_undegraded":"2024-05-14T15:21:37.960865+0000","last_fullsized":"2024-05-14T15:21:37.960865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:09:41.042473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153854+0000","last_change":"2024-05-14T15:16:22.903302+0000","last_active":"2024-05-14T15:21:38.153854+0000","last_peered":"2024-05-14T15:21:38.153854+0000","last_clean":"2024-05-14T15:21:38.153854+0000","last_became_active":"2024-05-14T15:16:22.902830+0000","last_became_peered":"2024-05-14T15:16:22.902830+0000","last_unstale":"2024-05-14T15:21:38.153854+0000","last_undegraded":"2024-05-14T15:21:38.153854+0000","last_fullsized":"2024-05-14T15:21:38.153854+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:18:57.467319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974037+0000","last_change":"2024-05-14T15:16:03.738372+0000","last_active":"2024-05-14T15:21:37.974037+0000","last_peered":"2024-05-14T15:21:37.974037+0000","last_clean":"2024-05-14T15:21:37.974037+0000","last_became_active":"2024-05-14T15:16:03.737815+0000","last_became_peered":"2024-05-14T15:16:03.737815+0000","last_unstale":"2024-05-14T15:21:37.974037+0000","last_undegraded":"2024-05-14T15:21:37.974037+0000","last_fullsized":"2024-05-14T15:21:37.974037+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:19:19.702318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.796832+0000","last_change":"2024-05-14T15:16:08.781979+0000","last_active":"2024-05-14T15:21:37.796832+0000","last_peered":"2024-05-14T15:21:37.796832+0000","last_clean":"2024-05-14T15:21:37.796832+0000","last_became_active":"2024-05-14T15:16:08.777257+0000","last_became_peered":"2024-05-14T15:16:08.777257+0000","last_unstale":"2024-05-14T15:21:37.796832+0000","last_undegraded":"2024-05-14T15:21:37.796832+0000","last_fullsized":"2024-05-14T15:21:37.796832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:31.154921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961089+0000","last_change":"2024-05-14T15:16:22.901107+0000","last_active":"2024-05-14T15:21:37.961089+0000","last_peered":"2024-05-14T15:21:37.961089+0000","last_clean":"2024-05-14T15:21:37.961089+0000","last_became_active":"2024-05-14T15:16:22.900578+0000","last_became_peered":"2024-05-14T15:16:22.900578+0000","last_unstale":"2024-05-14T15:21:37.961089+0000","last_undegraded":"2024-05-14T15:21:37.961089+0000","last_fullsized":"2024-05-14T15:21:37.961089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:11:23.019455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'8","reported_seq":536,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.140068+0000","last_change":"2024-05-14T15:16:03.730145+0000","last_active":"2024-05-14T15:21:38.140068+0000","last_peered":"2024-05-14T15:21:38.140068+0000","last_clean":"2024-05-14T15:21:38.140068+0000","last_became_active":"2024-05-14T15:16:03.728119+0000","last_became_peered":"2024-05-14T15:16:03.728119+0000","last_unstale":"2024-05-14T15:21:38.140068+0000","last_undegraded":"2024-05-14T15:21:38.140068+0000","last_fullsized":"2024-05-14T15:21:38.140068+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:19:57.596282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":480,"num_read_kb":480,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155528+0000","last_change":"2024-05-14T15:16:08.781834+0000","last_active":"2024-05-14T15:21:38.155528+0000","last_peered":"2024-05-14T15:21:38.155528+0000","last_clean":"2024-05-14T15:21:38.155528+0000","last_became_active":"2024-05-14T15:16:08.781451+0000","last_became_peered":"2024-05-14T15:16:08.781451+0000","last_unstale":"2024-05-14T15:21:38.155528+0000","last_undegraded":"2024-05-14T15:21:38.155528+0000","last_fullsized":"2024-05-14T15:21:38.155528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:17:33.147475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.796785+0000","last_change":"2024-05-14T15:16:22.910711+0000","last_active":"2024-05-14T15:21:37.796785+0000","last_peered":"2024-05-14T15:21:37.796785+0000","last_clean":"2024-05-14T15:21:37.796785+0000","last_became_active":"2024-05-14T15:16:22.910076+0000","last_became_peered":"2024-05-14T15:16:22.910076+0000","last_unstale":"2024-05-14T15:21:37.796785+0000","last_undegraded":"2024-05-14T15:21:37.796785+0000","last_fullsized":"2024-05-14T15:21:37.796785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:11:05.867547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082905+0000","last_change":"2024-05-14T15:16:03.736682+0000","last_active":"2024-05-14T15:21:38.082905+0000","last_peered":"2024-05-14T15:21:38.082905+0000","last_clean":"2024-05-14T15:21:38.082905+0000","last_became_active":"2024-05-14T15:16:03.733676+0000","last_became_peered":"2024-05-14T15:16:03.733676+0000","last_unstale":"2024-05-14T15:21:38.082905+0000","last_undegraded":"2024-05-14T15:21:38.082905+0000","last_fullsized":"2024-05-14T15:21:38.082905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:12:12.814817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.156249+0000","last_change":"2024-05-14T15:16:08.797256+0000","last_active":"2024-05-14T15:21:38.156249+0000","last_peered":"2024-05-14T15:21:38.156249+0000","last_clean":"2024-05-14T15:21:38.156249+0000","last_became_active":"2024-05-14T15:16:08.796675+0000","last_became_peered":"2024-05-14T15:16:08.796675+0000","last_unstale":"2024-05-14T15:21:38.156249+0000","last_undegraded":"2024-05-14T15:21:38.156249+0000","last_fullsized":"2024-05-14T15:21:38.156249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:08.026962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804368+0000","last_change":"2024-05-14T15:16:22.914775+0000","last_active":"2024-05-14T15:21:37.804368+0000","last_peered":"2024-05-14T15:21:37.804368+0000","last_clean":"2024-05-14T15:21:37.804368+0000","last_became_active":"2024-05-14T15:16:22.912853+0000","last_became_peered":"2024-05-14T15:16:22.912853+0000","last_unstale":"2024-05-14T15:21:37.804368+0000","last_undegraded":"2024-05-14T15:21:37.804368+0000","last_fullsized":"2024-05-14T15:21:37.804368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:01:11.652074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974947+0000","last_change":"2024-05-14T15:16:03.845365+0000","last_active":"2024-05-14T15:21:37.974947+0000","last_peered":"2024-05-14T15:21:37.974947+0000","last_clean":"2024-05-14T15:21:37.974947+0000","last_became_active":"2024-05-14T15:16:03.842557+0000","last_became_peered":"2024-05-14T15:16:03.842557+0000","last_unstale":"2024-05-14T15:21:37.974947+0000","last_undegraded":"2024-05-14T15:21:37.974947+0000","last_fullsized":"2024-05-14T15:21:37.974947+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:26:21.515074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.798709+0000","last_change":"2024-05-14T15:17:43.855838+0000","last_active":"2024-05-14T15:21:37.798709+0000","last_peered":"2024-05-14T15:21:37.798709+0000","last_clean":"2024-05-14T15:21:37.798709+0000","last_became_active":"2024-05-14T15:17:43.855462+0000","last_became_peered":"2024-05-14T15:17:43.855462+0000","last_unstale":"2024-05-14T15:21:37.798709+0000","last_undegraded":"2024-05-14T15:21:37.798709+0000","last_fullsized":"2024-05-14T15:21:37.798709+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:56:06.442987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,4],"acting":[9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.797106+0000","last_change":"2024-05-14T15:16:22.905266+0000","last_active":"2024-05-14T15:21:37.797106+0000","last_peered":"2024-05-14T15:21:37.797106+0000","last_clean":"2024-05-14T15:21:37.797106+0000","last_became_active":"2024-05-14T15:16:22.903397+0000","last_became_peered":"2024-05-14T15:16:22.903397+0000","last_unstale":"2024-05-14T15:21:37.797106+0000","last_undegraded":"2024-05-14T15:21:37.797106+0000","last_fullsized":"2024-05-14T15:21:37.797106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:48:37.616028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"92'44","reported_seq":585,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.418698+0000","last_change":"2024-05-14T15:16:03.735261+0000","last_active":"2024-05-14T15:21:38.418698+0000","last_peered":"2024-05-14T15:21:38.418698+0000","last_clean":"2024-05-14T15:21:38.418698+0000","last_became_active":"2024-05-14T15:16:03.732725+0000","last_became_peered":"2024-05-14T15:16:03.732725+0000","last_unstale":"2024-05-14T15:21:38.418698+0000","last_undegraded":"2024-05-14T15:21:38.418698+0000","last_fullsized":"2024-05-14T15:21:38.418698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:44:51.777221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72303,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":493,"num_read_kb":316,"num_write":46,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804203+0000","last_change":"2024-05-14T15:16:08.783758+0000","last_active":"2024-05-14T15:21:37.804203+0000","last_peered":"2024-05-14T15:21:37.804203+0000","last_clean":"2024-05-14T15:21:37.804203+0000","last_became_active":"2024-05-14T15:16:08.782465+0000","last_became_peered":"2024-05-14T15:16:08.782465+0000","last_unstale":"2024-05-14T15:21:37.804203+0000","last_undegraded":"2024-05-14T15:21:37.804203+0000","last_fullsized":"2024-05-14T15:21:37.804203+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:37:36.921823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.975918+0000","last_change":"2024-05-14T15:16:22.899606+0000","last_active":"2024-05-14T15:21:37.975918+0000","last_peered":"2024-05-14T15:21:37.975918+0000","last_clean":"2024-05-14T15:21:37.975918+0000","last_became_active":"2024-05-14T15:16:22.898810+0000","last_became_peered":"2024-05-14T15:16:22.898810+0000","last_unstale":"2024-05-14T15:21:37.975918+0000","last_undegraded":"2024-05-14T15:21:37.975918+0000","last_fullsized":"2024-05-14T15:21:37.975918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:49:07.068713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":59,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146824+0000","last_change":"2024-05-14T15:16:03.728561+0000","last_active":"2024-05-14T15:21:38.146824+0000","last_peered":"2024-05-14T15:21:38.146824+0000","last_clean":"2024-05-14T15:21:38.146824+0000","last_became_active":"2024-05-14T15:16:03.727273+0000","last_became_peered":"2024-05-14T15:16:03.727273+0000","last_unstale":"2024-05-14T15:21:38.146824+0000","last_undegraded":"2024-05-14T15:21:38.146824+0000","last_fullsized":"2024-05-14T15:21:38.146824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:06.487549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.144601+0000","last_change":"2024-05-14T15:16:08.788199+0000","last_active":"2024-05-14T15:21:38.144601+0000","last_peered":"2024-05-14T15:21:38.144601+0000","last_clean":"2024-05-14T15:21:38.144601+0000","last_became_active":"2024-05-14T15:16:08.786477+0000","last_became_peered":"2024-05-14T15:16:08.786477+0000","last_unstale":"2024-05-14T15:21:38.144601+0000","last_undegraded":"2024-05-14T15:21:38.144601+0000","last_fullsized":"2024-05-14T15:21:38.144601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:40:33.441154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155160+0000","last_change":"2024-05-14T15:16:22.911265+0000","last_active":"2024-05-14T15:21:38.155160+0000","last_peered":"2024-05-14T15:21:38.155160+0000","last_clean":"2024-05-14T15:21:38.155160+0000","last_became_active":"2024-05-14T15:16:22.910297+0000","last_became_peered":"2024-05-14T15:16:22.910297+0000","last_unstale":"2024-05-14T15:21:38.155160+0000","last_undegraded":"2024-05-14T15:21:38.155160+0000","last_fullsized":"2024-05-14T15:21:38.155160+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:43:37.894409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974437+0000","last_change":"2024-05-14T15:16:03.735122+0000","last_active":"2024-05-14T15:21:37.974437+0000","last_peered":"2024-05-14T15:21:37.974437+0000","last_clean":"2024-05-14T15:21:37.974437+0000","last_became_active":"2024-05-14T15:16:03.734746+0000","last_became_peered":"2024-05-14T15:16:03.734746+0000","last_unstale":"2024-05-14T15:21:37.974437+0000","last_undegraded":"2024-05-14T15:21:37.974437+0000","last_fullsized":"2024-05-14T15:21:37.974437+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:36:48.070577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.081278+0000","last_change":"2024-05-14T15:16:08.791427+0000","last_active":"2024-05-14T15:21:38.081278+0000","last_peered":"2024-05-14T15:21:38.081278+0000","last_clean":"2024-05-14T15:21:38.081278+0000","last_became_active":"2024-05-14T15:16:08.791070+0000","last_became_peered":"2024-05-14T15:16:08.791070+0000","last_unstale":"2024-05-14T15:21:38.081278+0000","last_undegraded":"2024-05-14T15:21:38.081278+0000","last_fullsized":"2024-05-14T15:21:38.081278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:15:13.153055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.796785+0000","last_change":"2024-05-14T15:16:22.896084+0000","last_active":"2024-05-14T15:21:37.796785+0000","last_peered":"2024-05-14T15:21:37.796785+0000","last_clean":"2024-05-14T15:21:37.796785+0000","last_became_active":"2024-05-14T15:16:22.894473+0000","last_became_peered":"2024-05-14T15:16:22.894473+0000","last_unstale":"2024-05-14T15:21:37.796785+0000","last_undegraded":"2024-05-14T15:21:37.796785+0000","last_fullsized":"2024-05-14T15:21:37.796785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:18:18.844423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"92'9","reported_seq":302,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.147663+0000","last_change":"2024-05-14T15:16:03.728070+0000","last_active":"2024-05-14T15:21:38.147663+0000","last_peered":"2024-05-14T15:21:38.147663+0000","last_clean":"2024-05-14T15:21:38.147663+0000","last_became_active":"2024-05-14T15:16:03.726155+0000","last_became_peered":"2024-05-14T15:16:03.726155+0000","last_unstale":"2024-05-14T15:21:38.147663+0000","last_undegraded":"2024-05-14T15:21:38.147663+0000","last_fullsized":"2024-05-14T15:21:38.147663+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:50:43.447812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1988,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":6,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.081106+0000","last_change":"2024-05-14T15:16:08.787281+0000","last_active":"2024-05-14T15:21:38.081106+0000","last_peered":"2024-05-14T15:21:38.081106+0000","last_clean":"2024-05-14T15:21:38.081106+0000","last_became_active":"2024-05-14T15:16:08.786910+0000","last_became_peered":"2024-05-14T15:16:08.786910+0000","last_unstale":"2024-05-14T15:21:38.081106+0000","last_undegraded":"2024-05-14T15:21:38.081106+0000","last_fullsized":"2024-05-14T15:21:38.081106+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:03:35.421845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146088+0000","last_change":"2024-05-14T15:16:43.066135+0000","last_active":"2024-05-14T15:21:38.146088+0000","last_peered":"2024-05-14T15:21:38.146088+0000","last_clean":"2024-05-14T15:21:38.146088+0000","last_became_active":"2024-05-14T15:16:43.064558+0000","last_became_peered":"2024-05-14T15:16:43.064558+0000","last_unstale":"2024-05-14T15:21:38.146088+0000","last_undegraded":"2024-05-14T15:21:38.146088+0000","last_fullsized":"2024-05-14T15:21:38.146088+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:21:25.441639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":66,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.803274+0000","last_change":"2024-05-14T15:16:03.841009+0000","last_active":"2024-05-14T15:21:37.803274+0000","last_peered":"2024-05-14T15:21:37.803274+0000","last_clean":"2024-05-14T15:21:37.803274+0000","last_became_active":"2024-05-14T15:16:03.839514+0000","last_became_peered":"2024-05-14T15:16:03.839514+0000","last_unstale":"2024-05-14T15:21:37.803274+0000","last_undegraded":"2024-05-14T15:21:37.803274+0000","last_fullsized":"2024-05-14T15:21:37.803274+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:34:55.588072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974110+0000","last_change":"2024-05-14T15:16:08.774343+0000","last_active":"2024-05-14T15:21:37.974110+0000","last_peered":"2024-05-14T15:21:37.974110+0000","last_clean":"2024-05-14T15:21:37.974110+0000","last_became_active":"2024-05-14T15:16:08.773826+0000","last_became_peered":"2024-05-14T15:16:08.773826+0000","last_unstale":"2024-05-14T15:21:37.974110+0000","last_undegraded":"2024-05-14T15:21:37.974110+0000","last_fullsized":"2024-05-14T15:21:37.974110+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:30:51.648019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.973948+0000","last_change":"2024-05-14T15:16:22.889838+0000","last_active":"2024-05-14T15:21:37.973948+0000","last_peered":"2024-05-14T15:21:37.973948+0000","last_clean":"2024-05-14T15:21:37.973948+0000","last_became_active":"2024-05-14T15:16:22.888604+0000","last_became_peered":"2024-05-14T15:16:22.888604+0000","last_unstale":"2024-05-14T15:21:37.973948+0000","last_undegraded":"2024-05-14T15:21:37.973948+0000","last_fullsized":"2024-05-14T15:21:37.973948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:26:53.176588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"91'3","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.805462+0000","last_change":"2024-05-14T15:16:03.731499+0000","last_active":"2024-05-14T15:21:37.805462+0000","last_peered":"2024-05-14T15:21:37.805462+0000","last_clean":"2024-05-14T15:21:37.805462+0000","last_became_active":"2024-05-14T15:16:03.729387+0000","last_became_peered":"2024-05-14T15:16:03.729387+0000","last_unstale":"2024-05-14T15:21:37.805462+0000","last_undegraded":"2024-05-14T15:21:37.805462+0000","last_fullsized":"2024-05-14T15:21:37.805462+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:52:24.287236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155956+0000","last_change":"2024-05-14T15:16:08.787376+0000","last_active":"2024-05-14T15:21:38.155956+0000","last_peered":"2024-05-14T15:21:38.155956+0000","last_clean":"2024-05-14T15:21:38.155956+0000","last_became_active":"2024-05-14T15:16:08.786057+0000","last_became_peered":"2024-05-14T15:16:08.786057+0000","last_unstale":"2024-05-14T15:21:38.155956+0000","last_undegraded":"2024-05-14T15:21:38.155956+0000","last_fullsized":"2024-05-14T15:21:38.155956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:17:16.582656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804810+0000","last_change":"2024-05-14T15:16:23.049639+0000","last_active":"2024-05-14T15:21:37.804810+0000","last_peered":"2024-05-14T15:21:37.804810+0000","last_clean":"2024-05-14T15:21:37.804810+0000","last_became_active":"2024-05-14T15:16:23.047746+0000","last_became_peered":"2024-05-14T15:16:23.047746+0000","last_unstale":"2024-05-14T15:21:37.804810+0000","last_undegraded":"2024-05-14T15:21:37.804810+0000","last_fullsized":"2024-05-14T15:21:37.804810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:22:27.129466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.797819+0000","last_change":"2024-05-14T15:16:03.842156+0000","last_active":"2024-05-14T15:21:37.797819+0000","last_peered":"2024-05-14T15:21:37.797819+0000","last_clean":"2024-05-14T15:21:37.797819+0000","last_became_active":"2024-05-14T15:16:03.841626+0000","last_became_peered":"2024-05-14T15:16:03.841626+0000","last_unstale":"2024-05-14T15:21:37.797819+0000","last_undegraded":"2024-05-14T15:21:37.797819+0000","last_fullsized":"2024-05-14T15:21:37.797819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:40.955009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.983882+0000","last_change":"2024-05-14T15:16:08.780632+0000","last_active":"2024-05-14T15:21:37.983882+0000","last_peered":"2024-05-14T15:21:37.983882+0000","last_clean":"2024-05-14T15:21:37.983882+0000","last_became_active":"2024-05-14T15:16:08.779743+0000","last_became_peered":"2024-05-14T15:16:08.779743+0000","last_unstale":"2024-05-14T15:21:37.983882+0000","last_undegraded":"2024-05-14T15:21:37.983882+0000","last_fullsized":"2024-05-14T15:21:37.983882+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:53:45.608716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145495+0000","last_change":"2024-05-14T15:16:22.894512+0000","last_active":"2024-05-14T15:21:38.145495+0000","last_peered":"2024-05-14T15:21:38.145495+0000","last_clean":"2024-05-14T15:21:38.145495+0000","last_became_active":"2024-05-14T15:16:22.893566+0000","last_became_peered":"2024-05-14T15:16:22.893566+0000","last_unstale":"2024-05-14T15:21:38.145495+0000","last_undegraded":"2024-05-14T15:21:38.145495+0000","last_fullsized":"2024-05-14T15:21:38.145495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:45:39.571364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"92'9","reported_seq":301,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082594+0000","last_change":"2024-05-14T15:16:03.730782+0000","last_active":"2024-05-14T15:21:38.082594+0000","last_peered":"2024-05-14T15:21:38.082594+0000","last_clean":"2024-05-14T15:21:38.082594+0000","last_became_active":"2024-05-14T15:16:03.729703+0000","last_became_peered":"2024-05-14T15:16:03.729703+0000","last_unstale":"2024-05-14T15:21:38.082594+0000","last_undegraded":"2024-05-14T15:21:38.082594+0000","last_fullsized":"2024-05-14T15:21:38.082594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:30:30.379450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1988,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":244,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.983945+0000","last_change":"2024-05-14T15:16:08.792362+0000","last_active":"2024-05-14T15:21:37.983945+0000","last_peered":"2024-05-14T15:21:37.983945+0000","last_clean":"2024-05-14T15:21:37.983945+0000","last_became_active":"2024-05-14T15:16:08.791836+0000","last_became_peered":"2024-05-14T15:16:08.791836+0000","last_unstale":"2024-05-14T15:21:37.983945+0000","last_undegraded":"2024-05-14T15:21:37.983945+0000","last_fullsized":"2024-05-14T15:21:37.983945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:50:07.142474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145947+0000","last_change":"2024-05-14T15:16:23.048324+0000","last_active":"2024-05-14T15:21:38.145947+0000","last_peered":"2024-05-14T15:21:38.145947+0000","last_clean":"2024-05-14T15:21:38.145947+0000","last_became_active":"2024-05-14T15:16:23.047829+0000","last_became_peered":"2024-05-14T15:16:23.047829+0000","last_unstale":"2024-05-14T15:21:38.145947+0000","last_undegraded":"2024-05-14T15:21:38.145947+0000","last_fullsized":"2024-05-14T15:21:38.145947+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:13.018847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974489+0000","last_change":"2024-05-14T15:16:43.013252+0000","last_active":"2024-05-14T15:21:37.974489+0000","last_peered":"2024-05-14T15:21:37.974489+0000","last_clean":"2024-05-14T15:21:37.974489+0000","last_became_active":"2024-05-14T15:16:43.011962+0000","last_became_peered":"2024-05-14T15:16:43.011962+0000","last_unstale":"2024-05-14T15:21:37.974489+0000","last_undegraded":"2024-05-14T15:21:37.974489+0000","last_fullsized":"2024-05-14T15:21:37.974489+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:06.204259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'7","reported_seq":296,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.144120+0000","last_change":"2024-05-14T15:16:03.840983+0000","last_active":"2024-05-14T15:21:38.144120+0000","last_peered":"2024-05-14T15:21:38.144120+0000","last_clean":"2024-05-14T15:21:38.144120+0000","last_became_active":"2024-05-14T15:16:03.839117+0000","last_became_peered":"2024-05-14T15:16:03.839117+0000","last_unstale":"2024-05-14T15:21:38.144120+0000","last_undegraded":"2024-05-14T15:21:38.144120+0000","last_fullsized":"2024-05-14T15:21:38.144120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:57.163543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082005+0000","last_change":"2024-05-14T15:16:22.914744+0000","last_active":"2024-05-14T15:21:38.082005+0000","last_peered":"2024-05-14T15:21:38.082005+0000","last_clean":"2024-05-14T15:21:38.082005+0000","last_became_active":"2024-05-14T15:16:22.913661+0000","last_became_peered":"2024-05-14T15:16:22.913661+0000","last_unstale":"2024-05-14T15:21:38.082005+0000","last_undegraded":"2024-05-14T15:21:38.082005+0000","last_fullsized":"2024-05-14T15:21:38.082005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:45.957828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961391+0000","last_change":"2024-05-14T15:16:08.791872+0000","last_active":"2024-05-14T15:21:37.961391+0000","last_peered":"2024-05-14T15:21:37.961391+0000","last_clean":"2024-05-14T15:21:37.961391+0000","last_became_active":"2024-05-14T15:16:08.791229+0000","last_became_peered":"2024-05-14T15:16:08.791229+0000","last_unstale":"2024-05-14T15:21:37.961391+0000","last_undegraded":"2024-05-14T15:21:37.961391+0000","last_fullsized":"2024-05-14T15:21:37.961391+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:36:26.391077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804146+0000","last_change":"2024-05-14T15:16:03.732872+0000","last_active":"2024-05-14T15:21:37.804146+0000","last_peered":"2024-05-14T15:21:37.804146+0000","last_clean":"2024-05-14T15:21:37.804146+0000","last_became_active":"2024-05-14T15:16:03.732188+0000","last_became_peered":"2024-05-14T15:16:03.732188+0000","last_unstale":"2024-05-14T15:21:37.804146+0000","last_undegraded":"2024-05-14T15:21:37.804146+0000","last_fullsized":"2024-05-14T15:21:37.804146+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:20:56.776521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":123,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.080063+0000","last_change":"2024-05-14T15:14:08.407259+0000","last_active":"2024-05-14T15:21:38.080063+0000","last_peered":"2024-05-14T15:21:38.080063+0000","last_clean":"2024-05-14T15:21:38.080063+0000","last_became_active":"2024-05-14T15:14:08.398012+0000","last_became_peered":"2024-05-14T15:14:08.398012+0000","last_unstale":"2024-05-14T15:21:38.080063+0000","last_undegraded":"2024-05-14T15:21:38.080063+0000","last_fullsized":"2024-05-14T15:21:38.080063+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:09:04.015044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:09:04.015044+0000","last_clean_scrub_stamp":"2024-05-14T15:09:04.015044+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:37.256490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974363+0000","last_change":"2024-05-14T15:16:23.053989+0000","last_active":"2024-05-14T15:21:37.974363+0000","last_peered":"2024-05-14T15:21:37.974363+0000","last_clean":"2024-05-14T15:21:37.974363+0000","last_became_active":"2024-05-14T15:16:23.052585+0000","last_became_peered":"2024-05-14T15:16:23.052585+0000","last_unstale":"2024-05-14T15:21:37.974363+0000","last_undegraded":"2024-05-14T15:21:37.974363+0000","last_fullsized":"2024-05-14T15:21:37.974363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:30.104518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.143910+0000","last_change":"2024-05-14T15:16:08.775447+0000","last_active":"2024-05-14T15:21:38.143910+0000","last_peered":"2024-05-14T15:21:38.143910+0000","last_clean":"2024-05-14T15:21:38.143910+0000","last_became_active":"2024-05-14T15:16:08.775055+0000","last_became_peered":"2024-05-14T15:16:08.775055+0000","last_unstale":"2024-05-14T15:21:38.143910+0000","last_undegraded":"2024-05-14T15:21:38.143910+0000","last_fullsized":"2024-05-14T15:21:38.143910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:57:24.668939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.081025+0000","last_change":"2024-05-14T15:16:03.735221+0000","last_active":"2024-05-14T15:21:38.081025+0000","last_peered":"2024-05-14T15:21:38.081025+0000","last_clean":"2024-05-14T15:21:38.081025+0000","last_became_active":"2024-05-14T15:16:03.731910+0000","last_became_peered":"2024-05-14T15:16:03.731910+0000","last_unstale":"2024-05-14T15:21:38.081025+0000","last_undegraded":"2024-05-14T15:21:38.081025+0000","last_fullsized":"2024-05-14T15:21:38.081025+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:57:18.030308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155107+0000","last_change":"2024-05-14T15:16:22.910564+0000","last_active":"2024-05-14T15:21:38.155107+0000","last_peered":"2024-05-14T15:21:38.155107+0000","last_clean":"2024-05-14T15:21:38.155107+0000","last_became_active":"2024-05-14T15:16:22.910003+0000","last_became_peered":"2024-05-14T15:16:22.910003+0000","last_unstale":"2024-05-14T15:21:38.155107+0000","last_undegraded":"2024-05-14T15:21:38.155107+0000","last_fullsized":"2024-05-14T15:21:38.155107+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:47.895767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804685+0000","last_change":"2024-05-14T15:16:03.844236+0000","last_active":"2024-05-14T15:21:37.804685+0000","last_peered":"2024-05-14T15:21:37.804685+0000","last_clean":"2024-05-14T15:21:37.804685+0000","last_became_active":"2024-05-14T15:16:03.841253+0000","last_became_peered":"2024-05-14T15:16:03.841253+0000","last_unstale":"2024-05-14T15:21:37.804685+0000","last_undegraded":"2024-05-14T15:21:37.804685+0000","last_fullsized":"2024-05-14T15:21:37.804685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:40:24.440707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145591+0000","last_change":"2024-05-14T15:16:08.782849+0000","last_active":"2024-05-14T15:21:38.145591+0000","last_peered":"2024-05-14T15:21:38.145591+0000","last_clean":"2024-05-14T15:21:38.145591+0000","last_became_active":"2024-05-14T15:16:08.781999+0000","last_became_peered":"2024-05-14T15:16:08.781999+0000","last_unstale":"2024-05-14T15:21:38.145591+0000","last_undegraded":"2024-05-14T15:21:38.145591+0000","last_fullsized":"2024-05-14T15:21:38.145591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:33:03.997615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.960839+0000","last_change":"2024-05-14T15:16:23.049719+0000","last_active":"2024-05-14T15:21:37.960839+0000","last_peered":"2024-05-14T15:21:37.960839+0000","last_clean":"2024-05-14T15:21:37.960839+0000","last_became_active":"2024-05-14T15:16:23.048547+0000","last_became_peered":"2024-05-14T15:16:23.048547+0000","last_unstale":"2024-05-14T15:21:37.960839+0000","last_undegraded":"2024-05-14T15:21:37.960839+0000","last_fullsized":"2024-05-14T15:21:37.960839+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:41:49.790521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'52","reported_seq":123,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.309815+0000","last_change":"2024-05-14T15:16:03.729413+0000","last_active":"2024-05-14T15:21:38.309815+0000","last_peered":"2024-05-14T15:21:38.309815+0000","last_clean":"2024-05-14T15:21:38.309815+0000","last_became_active":"2024-05-14T15:16:03.728491+0000","last_became_peered":"2024-05-14T15:16:03.728491+0000","last_unstale":"2024-05-14T15:21:38.309815+0000","last_undegraded":"2024-05-14T15:21:38.309815+0000","last_fullsized":"2024-05-14T15:21:38.309815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:34:04.811775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":92,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.962137+0000","last_change":"2024-05-14T15:16:08.784237+0000","last_active":"2024-05-14T15:21:37.962137+0000","last_peered":"2024-05-14T15:21:37.962137+0000","last_clean":"2024-05-14T15:21:37.962137+0000","last_became_active":"2024-05-14T15:16:08.783908+0000","last_became_peered":"2024-05-14T15:16:08.783908+0000","last_unstale":"2024-05-14T15:21:37.962137+0000","last_undegraded":"2024-05-14T15:21:37.962137+0000","last_fullsized":"2024-05-14T15:21:37.962137+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:43:24.621314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145323+0000","last_change":"2024-05-14T15:16:22.909928+0000","last_active":"2024-05-14T15:21:38.145323+0000","last_peered":"2024-05-14T15:21:38.145323+0000","last_clean":"2024-05-14T15:21:38.145323+0000","last_became_active":"2024-05-14T15:16:22.909412+0000","last_became_peered":"2024-05-14T15:16:22.909412+0000","last_unstale":"2024-05-14T15:21:38.145323+0000","last_undegraded":"2024-05-14T15:21:38.145323+0000","last_fullsized":"2024-05-14T15:21:38.145323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:18:26.324189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804565+0000","last_change":"2024-05-14T15:16:03.729846+0000","last_active":"2024-05-14T15:21:37.804565+0000","last_peered":"2024-05-14T15:21:37.804565+0000","last_clean":"2024-05-14T15:21:37.804565+0000","last_became_active":"2024-05-14T15:16:03.729385+0000","last_became_peered":"2024-05-14T15:16:03.729385+0000","last_unstale":"2024-05-14T15:21:37.804565+0000","last_undegraded":"2024-05-14T15:21:37.804565+0000","last_fullsized":"2024-05-14T15:21:37.804565+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:05:18.987237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155368+0000","last_change":"2024-05-14T15:16:08.796017+0000","last_active":"2024-05-14T15:21:38.155368+0000","last_peered":"2024-05-14T15:21:38.155368+0000","last_clean":"2024-05-14T15:21:38.155368+0000","last_became_active":"2024-05-14T15:16:08.791627+0000","last_became_peered":"2024-05-14T15:16:08.791627+0000","last_unstale":"2024-05-14T15:21:38.155368+0000","last_undegraded":"2024-05-14T15:21:38.155368+0000","last_fullsized":"2024-05-14T15:21:38.155368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:46:27.910669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804084+0000","last_change":"2024-05-14T15:16:23.052954+0000","last_active":"2024-05-14T15:21:37.804084+0000","last_peered":"2024-05-14T15:21:37.804084+0000","last_clean":"2024-05-14T15:21:37.804084+0000","last_became_active":"2024-05-14T15:16:23.051410+0000","last_became_peered":"2024-05-14T15:16:23.051410+0000","last_unstale":"2024-05-14T15:21:37.804084+0000","last_undegraded":"2024-05-14T15:21:37.804084+0000","last_fullsized":"2024-05-14T15:21:37.804084+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:28:55.181866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153689+0000","last_change":"2024-05-14T15:16:43.023961+0000","last_active":"2024-05-14T15:21:38.153689+0000","last_peered":"2024-05-14T15:21:38.153689+0000","last_clean":"2024-05-14T15:21:38.153689+0000","last_became_active":"2024-05-14T15:16:43.022677+0000","last_became_peered":"2024-05-14T15:16:43.022677+0000","last_unstale":"2024-05-14T15:21:38.153689+0000","last_undegraded":"2024-05-14T15:21:38.153689+0000","last_fullsized":"2024-05-14T15:21:38.153689+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:33:16.692984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.803304+0000","last_change":"2024-05-14T15:16:08.780415+0000","last_active":"2024-05-14T15:21:37.803304+0000","last_peered":"2024-05-14T15:21:37.803304+0000","last_clean":"2024-05-14T15:21:37.803304+0000","last_became_active":"2024-05-14T15:16:08.780053+0000","last_became_peered":"2024-05-14T15:16:08.780053+0000","last_unstale":"2024-05-14T15:21:37.803304+0000","last_undegraded":"2024-05-14T15:21:37.803304+0000","last_fullsized":"2024-05-14T15:21:37.803304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:18:00.964346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.805308+0000","last_change":"2024-05-14T15:16:43.066458+0000","last_active":"2024-05-14T15:21:37.805308+0000","last_peered":"2024-05-14T15:21:37.805308+0000","last_clean":"2024-05-14T15:21:37.805308+0000","last_became_active":"2024-05-14T15:16:43.064035+0000","last_became_peered":"2024-05-14T15:16:43.064035+0000","last_unstale":"2024-05-14T15:21:37.805308+0000","last_undegraded":"2024-05-14T15:21:37.805308+0000","last_fullsized":"2024-05-14T15:21:37.805308+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:38:39.895882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961153+0000","last_change":"2024-05-14T15:16:03.731962+0000","last_active":"2024-05-14T15:21:37.961153+0000","last_peered":"2024-05-14T15:21:37.961153+0000","last_clean":"2024-05-14T15:21:37.961153+0000","last_became_active":"2024-05-14T15:16:03.726532+0000","last_became_peered":"2024-05-14T15:16:03.726532+0000","last_unstale":"2024-05-14T15:21:37.961153+0000","last_undegraded":"2024-05-14T15:21:37.961153+0000","last_fullsized":"2024-05-14T15:21:37.961153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:47:26.809212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154807+0000","last_change":"2024-05-14T15:16:08.798984+0000","last_active":"2024-05-14T15:21:38.154807+0000","last_peered":"2024-05-14T15:21:38.154807+0000","last_clean":"2024-05-14T15:21:38.154807+0000","last_became_active":"2024-05-14T15:16:08.798120+0000","last_became_peered":"2024-05-14T15:16:08.798120+0000","last_unstale":"2024-05-14T15:21:38.154807+0000","last_undegraded":"2024-05-14T15:21:38.154807+0000","last_fullsized":"2024-05-14T15:21:38.154807+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:58.519436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804997+0000","last_change":"2024-05-14T15:16:22.907994+0000","last_active":"2024-05-14T15:21:37.804997+0000","last_peered":"2024-05-14T15:21:37.804997+0000","last_clean":"2024-05-14T15:21:37.804997+0000","last_became_active":"2024-05-14T15:16:22.907144+0000","last_became_peered":"2024-05-14T15:16:22.907144+0000","last_unstale":"2024-05-14T15:21:37.804997+0000","last_undegraded":"2024-05-14T15:21:37.804997+0000","last_fullsized":"2024-05-14T15:21:37.804997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:49:11.436917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"91'4","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145631+0000","last_change":"2024-05-14T15:16:03.728334+0000","last_active":"2024-05-14T15:21:38.145631+0000","last_peered":"2024-05-14T15:21:38.145631+0000","last_clean":"2024-05-14T15:21:38.145631+0000","last_became_active":"2024-05-14T15:16:03.727836+0000","last_became_peered":"2024-05-14T15:16:03.727836+0000","last_unstale":"2024-05-14T15:21:38.145631+0000","last_undegraded":"2024-05-14T15:21:38.145631+0000","last_fullsized":"2024-05-14T15:21:38.145631+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:54.780821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961656+0000","last_change":"2024-05-14T15:16:08.798340+0000","last_active":"2024-05-14T15:21:37.961656+0000","last_peered":"2024-05-14T15:21:37.961656+0000","last_clean":"2024-05-14T15:21:37.961656+0000","last_became_active":"2024-05-14T15:16:08.797981+0000","last_became_peered":"2024-05-14T15:16:08.797981+0000","last_unstale":"2024-05-14T15:21:37.961656+0000","last_undegraded":"2024-05-14T15:21:37.961656+0000","last_fullsized":"2024-05-14T15:21:37.961656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:04:08.322033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.803678+0000","last_change":"2024-05-14T15:16:23.050064+0000","last_active":"2024-05-14T15:21:37.803678+0000","last_peered":"2024-05-14T15:21:37.803678+0000","last_clean":"2024-05-14T15:21:37.803678+0000","last_became_active":"2024-05-14T15:16:23.048608+0000","last_became_peered":"2024-05-14T15:16:23.048608+0000","last_unstale":"2024-05-14T15:21:37.803678+0000","last_undegraded":"2024-05-14T15:21:37.803678+0000","last_fullsized":"2024-05-14T15:21:37.803678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:32.044226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804332+0000","last_change":"2024-05-14T15:16:03.734588+0000","last_active":"2024-05-14T15:21:37.804332+0000","last_peered":"2024-05-14T15:21:37.804332+0000","last_clean":"2024-05-14T15:21:37.804332+0000","last_became_active":"2024-05-14T15:16:03.734112+0000","last_became_peered":"2024-05-14T15:16:03.734112+0000","last_unstale":"2024-05-14T15:21:37.804332+0000","last_undegraded":"2024-05-14T15:21:37.804332+0000","last_fullsized":"2024-05-14T15:21:37.804332+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:07:56.545225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.080873+0000","last_change":"2024-05-14T15:16:08.789481+0000","last_active":"2024-05-14T15:21:38.080873+0000","last_peered":"2024-05-14T15:21:38.080873+0000","last_clean":"2024-05-14T15:21:38.080873+0000","last_became_active":"2024-05-14T15:16:08.788462+0000","last_became_peered":"2024-05-14T15:16:08.788462+0000","last_unstale":"2024-05-14T15:21:38.080873+0000","last_undegraded":"2024-05-14T15:21:38.080873+0000","last_fullsized":"2024-05-14T15:21:38.080873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:35:06.386410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153851+0000","last_change":"2024-05-14T15:16:22.903205+0000","last_active":"2024-05-14T15:21:38.153851+0000","last_peered":"2024-05-14T15:21:38.153851+0000","last_clean":"2024-05-14T15:21:38.153851+0000","last_became_active":"2024-05-14T15:16:22.901217+0000","last_became_peered":"2024-05-14T15:16:22.901217+0000","last_unstale":"2024-05-14T15:21:38.153851+0000","last_undegraded":"2024-05-14T15:21:38.153851+0000","last_fullsized":"2024-05-14T15:21:38.153851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:03:59.160106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'8","reported_seq":301,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146311+0000","last_change":"2024-05-14T15:16:03.840601+0000","last_active":"2024-05-14T15:21:38.146311+0000","last_peered":"2024-05-14T15:21:38.146311+0000","last_clean":"2024-05-14T15:21:38.146311+0000","last_became_active":"2024-05-14T15:16:03.839299+0000","last_became_peered":"2024-05-14T15:16:03.839299+0000","last_unstale":"2024-05-14T15:21:38.146311+0000","last_undegraded":"2024-05-14T15:21:38.146311+0000","last_fullsized":"2024-05-14T15:21:38.146311+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:35:46.773419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2179,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":245,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082686+0000","last_change":"2024-05-14T15:16:08.782915+0000","last_active":"2024-05-14T15:21:38.082686+0000","last_peered":"2024-05-14T15:21:38.082686+0000","last_clean":"2024-05-14T15:21:38.082686+0000","last_became_active":"2024-05-14T15:16:08.782469+0000","last_became_peered":"2024-05-14T15:16:08.782469+0000","last_unstale":"2024-05-14T15:21:38.082686+0000","last_undegraded":"2024-05-14T15:21:38.082686+0000","last_fullsized":"2024-05-14T15:21:38.082686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:36:35.361723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154025+0000","last_change":"2024-05-14T15:16:43.021276+0000","last_active":"2024-05-14T15:21:38.154025+0000","last_peered":"2024-05-14T15:21:38.154025+0000","last_clean":"2024-05-14T15:21:38.154025+0000","last_became_active":"2024-05-14T15:16:43.020534+0000","last_became_peered":"2024-05-14T15:16:43.020534+0000","last_unstale":"2024-05-14T15:21:38.154025+0000","last_undegraded":"2024-05-14T15:21:38.154025+0000","last_fullsized":"2024-05-14T15:21:38.154025+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:31:01.267429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"92'41","reported_seq":97,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.304866+0000","last_change":"2024-05-14T15:16:03.728379+0000","last_active":"2024-05-14T15:21:38.304866+0000","last_peered":"2024-05-14T15:21:38.304866+0000","last_clean":"2024-05-14T15:21:38.304866+0000","last_became_active":"2024-05-14T15:16:03.727580+0000","last_became_peered":"2024-05-14T15:16:03.727580+0000","last_unstale":"2024-05-14T15:21:38.304866+0000","last_undegraded":"2024-05-14T15:21:38.304866+0000","last_fullsized":"2024-05-14T15:21:38.304866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:54:20.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082068+0000","last_change":"2024-05-14T15:17:43.854489+0000","last_active":"2024-05-14T15:21:38.082068+0000","last_peered":"2024-05-14T15:21:38.082068+0000","last_clean":"2024-05-14T15:21:38.082068+0000","last_became_active":"2024-05-14T15:17:43.853624+0000","last_became_peered":"2024-05-14T15:17:43.853624+0000","last_unstale":"2024-05-14T15:21:38.082068+0000","last_undegraded":"2024-05-14T15:21:38.082068+0000","last_fullsized":"2024-05-14T15:21:38.082068+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:59.686248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.973657+0000","last_change":"2024-05-14T15:16:22.911248+0000","last_active":"2024-05-14T15:21:37.973657+0000","last_peered":"2024-05-14T15:21:37.973657+0000","last_clean":"2024-05-14T15:21:37.973657+0000","last_became_active":"2024-05-14T15:16:22.909975+0000","last_became_peered":"2024-05-14T15:16:22.909975+0000","last_unstale":"2024-05-14T15:21:37.973657+0000","last_undegraded":"2024-05-14T15:21:37.973657+0000","last_fullsized":"2024-05-14T15:21:37.973657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:23.140008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145947+0000","last_change":"2024-05-14T15:16:03.728422+0000","last_active":"2024-05-14T15:21:38.145947+0000","last_peered":"2024-05-14T15:21:38.145947+0000","last_clean":"2024-05-14T15:21:38.145947+0000","last_became_active":"2024-05-14T15:16:03.727428+0000","last_became_peered":"2024-05-14T15:16:03.727428+0000","last_unstale":"2024-05-14T15:21:38.145947+0000","last_undegraded":"2024-05-14T15:21:38.145947+0000","last_fullsized":"2024-05-14T15:21:38.145947+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:37:15.472001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.083392+0000","last_change":"2024-05-14T15:16:08.782158+0000","last_active":"2024-05-14T15:21:38.083392+0000","last_peered":"2024-05-14T15:21:38.083392+0000","last_clean":"2024-05-14T15:21:38.083392+0000","last_became_active":"2024-05-14T15:16:08.781761+0000","last_became_peered":"2024-05-14T15:16:08.781761+0000","last_unstale":"2024-05-14T15:21:38.083392+0000","last_undegraded":"2024-05-14T15:21:38.083392+0000","last_fullsized":"2024-05-14T15:21:38.083392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:01:42.886837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154932+0000","last_change":"2024-05-14T15:16:08.789851+0000","last_active":"2024-05-14T15:21:38.154932+0000","last_peered":"2024-05-14T15:21:38.154932+0000","last_clean":"2024-05-14T15:21:38.154932+0000","last_became_active":"2024-05-14T15:16:08.787563+0000","last_became_peered":"2024-05-14T15:16:08.787563+0000","last_unstale":"2024-05-14T15:21:38.154932+0000","last_undegraded":"2024-05-14T15:21:38.154932+0000","last_fullsized":"2024-05-14T15:21:38.154932+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:02:16.592481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145748+0000","last_change":"2024-05-14T15:16:08.788989+0000","last_active":"2024-05-14T15:21:38.145748+0000","last_peered":"2024-05-14T15:21:38.145748+0000","last_clean":"2024-05-14T15:21:38.145748+0000","last_became_active":"2024-05-14T15:16:08.785064+0000","last_became_peered":"2024-05-14T15:16:08.785064+0000","last_unstale":"2024-05-14T15:21:38.145748+0000","last_undegraded":"2024-05-14T15:21:38.145748+0000","last_fullsized":"2024-05-14T15:21:38.145748+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:12:30.824113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145443+0000","last_change":"2024-05-14T15:16:08.785849+0000","last_active":"2024-05-14T15:21:38.145443+0000","last_peered":"2024-05-14T15:21:38.145443+0000","last_clean":"2024-05-14T15:21:38.145443+0000","last_became_active":"2024-05-14T15:16:08.785487+0000","last_became_peered":"2024-05-14T15:16:08.785487+0000","last_unstale":"2024-05-14T15:21:38.145443+0000","last_undegraded":"2024-05-14T15:21:38.145443+0000","last_fullsized":"2024-05-14T15:21:38.145443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:37:16.435154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154327+0000","last_change":"2024-05-14T15:16:08.787843+0000","last_active":"2024-05-14T15:21:38.154327+0000","last_peered":"2024-05-14T15:21:38.154327+0000","last_clean":"2024-05-14T15:21:38.154327+0000","last_became_active":"2024-05-14T15:16:08.787485+0000","last_became_peered":"2024-05-14T15:16:08.787485+0000","last_unstale":"2024-05-14T15:21:38.154327+0000","last_undegraded":"2024-05-14T15:21:38.154327+0000","last_fullsized":"2024-05-14T15:21:38.154327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:16:06.625923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145685+0000","last_change":"2024-05-14T15:16:08.784870+0000","last_active":"2024-05-14T15:21:38.145685+0000","last_peered":"2024-05-14T15:21:38.145685+0000","last_clean":"2024-05-14T15:21:38.145685+0000","last_became_active":"2024-05-14T15:16:08.782496+0000","last_became_peered":"2024-05-14T15:16:08.782496+0000","last_unstale":"2024-05-14T15:21:38.145685+0000","last_undegraded":"2024-05-14T15:21:38.145685+0000","last_fullsized":"2024-05-14T15:21:38.145685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:54:33.724823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.156019+0000","last_change":"2024-05-14T15:16:08.783203+0000","last_active":"2024-05-14T15:21:38.156019+0000","last_peered":"2024-05-14T15:21:38.156019+0000","last_clean":"2024-05-14T15:21:38.156019+0000","last_became_active":"2024-05-14T15:16:08.782758+0000","last_became_peered":"2024-05-14T15:16:08.782758+0000","last_unstale":"2024-05-14T15:21:38.156019+0000","last_undegraded":"2024-05-14T15:21:38.156019+0000","last_fullsized":"2024-05-14T15:21:38.156019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:34:33.274511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146429+0000","last_change":"2024-05-14T15:16:08.789727+0000","last_active":"2024-05-14T15:21:38.146429+0000","last_peered":"2024-05-14T15:21:38.146429+0000","last_clean":"2024-05-14T15:21:38.146429+0000","last_became_active":"2024-05-14T15:16:08.784434+0000","last_became_peered":"2024-05-14T15:16:08.784434+0000","last_unstale":"2024-05-14T15:21:38.146429+0000","last_undegraded":"2024-05-14T15:21:38.146429+0000","last_fullsized":"2024-05-14T15:21:38.146429+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:59:19.835381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.962277+0000","last_change":"2024-05-14T15:16:08.781887+0000","last_active":"2024-05-14T15:21:37.962277+0000","last_peered":"2024-05-14T15:21:37.962277+0000","last_clean":"2024-05-14T15:21:37.962277+0000","last_became_active":"2024-05-14T15:16:08.781332+0000","last_became_peered":"2024-05-14T15:16:08.781332+0000","last_unstale":"2024-05-14T15:21:37.962277+0000","last_undegraded":"2024-05-14T15:21:37.962277+0000","last_fullsized":"2024-05-14T15:21:37.962277+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:51:36.558485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.080467+0000","last_change":"2024-05-14T15:16:43.065016+0000","last_active":"2024-05-14T15:21:38.080467+0000","last_peered":"2024-05-14T15:21:38.080467+0000","last_clean":"2024-05-14T15:21:38.080467+0000","last_became_active":"2024-05-14T15:16:43.063786+0000","last_became_peered":"2024-05-14T15:16:43.063786+0000","last_unstale":"2024-05-14T15:21:38.080467+0000","last_undegraded":"2024-05-14T15:21:38.080467+0000","last_fullsized":"2024-05-14T15:21:38.080467+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:01:54.920710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961198+0000","last_change":"2024-05-14T15:16:08.794288+0000","last_active":"2024-05-14T15:21:37.961198+0000","last_peered":"2024-05-14T15:21:37.961198+0000","last_clean":"2024-05-14T15:21:37.961198+0000","last_became_active":"2024-05-14T15:16:08.792059+0000","last_became_peered":"2024-05-14T15:16:08.792059+0000","last_unstale":"2024-05-14T15:21:37.961198+0000","last_undegraded":"2024-05-14T15:21:37.961198+0000","last_fullsized":"2024-05-14T15:21:37.961198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:30:55.769322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":58,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154428+0000","last_change":"2024-05-14T15:17:43.858583+0000","last_active":"2024-05-14T15:21:38.154428+0000","last_peered":"2024-05-14T15:21:38.154428+0000","last_clean":"2024-05-14T15:21:38.154428+0000","last_became_active":"2024-05-14T15:17:43.857287+0000","last_became_peered":"2024-05-14T15:17:43.857287+0000","last_unstale":"2024-05-14T15:21:38.154428+0000","last_undegraded":"2024-05-14T15:21:38.154428+0000","last_fullsized":"2024-05-14T15:21:38.154428+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:12:31.471747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145193+0000","last_change":"2024-05-14T15:16:08.786726+0000","last_active":"2024-05-14T15:21:38.145193+0000","last_peered":"2024-05-14T15:21:38.145193+0000","last_clean":"2024-05-14T15:21:38.145193+0000","last_became_active":"2024-05-14T15:16:08.785599+0000","last_became_peered":"2024-05-14T15:16:08.785599+0000","last_unstale":"2024-05-14T15:21:38.145193+0000","last_undegraded":"2024-05-14T15:21:38.145193+0000","last_fullsized":"2024-05-14T15:21:38.145193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:33:18.055459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155743+0000","last_change":"2024-05-14T15:16:43.022021+0000","last_active":"2024-05-14T15:21:38.155743+0000","last_peered":"2024-05-14T15:21:38.155743+0000","last_clean":"2024-05-14T15:21:38.155743+0000","last_became_active":"2024-05-14T15:16:43.021511+0000","last_became_peered":"2024-05-14T15:16:43.021511+0000","last_unstale":"2024-05-14T15:21:38.155743+0000","last_undegraded":"2024-05-14T15:21:38.155743+0000","last_fullsized":"2024-05-14T15:21:38.155743+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:59:55.083356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":609141,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":2547,"num_read_kb":1397,"num_write":397,"num_write_kb":1489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2187264,"data_stored":1827423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":322,"ondisk_log_size":322,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645397,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1073152,"data_stored":537039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841628,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":33044,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712108,"statfs":{"total":95995035648,"available":95961198592,"internally_reserved":0,"allocated":1912832,"data_stored":1328149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005156,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28480,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716672,"statfs":{"total":95995035648,"available":95965872128,"internally_reserved":0,"allocated":1495040,"data_stored":933272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201388,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32632,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712520,"statfs":{"total":95995035648,"available":95961620480,"internally_reserved":0,"allocated":1486848,"data_stored":929554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430322,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32832,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712320,"statfs":{"total":95995035648,"available":95961415680,"internally_reserved":0,"allocated":1691648,"data_stored":1135471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593851,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1073152,"data_stored":532864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575007,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32284,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712868,"statfs":{"total":95995035648,"available":95961976832,"internally_reserved":0,"allocated":1134592,"data_stored":595100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738536,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1097728,"data_stored":533929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411480,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1171456,"data_stored":607817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182545,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1085440,"data_stored":531172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986314,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1081344,"data_stored":536938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790083,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32844,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712308,"statfs":{"total":95995035648,"available":95961403392,"internally_reserved":0,"allocated":1703936,"data_stored":1129547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":75455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":77075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":136211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":7733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":207039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:21:44.638 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T15:21:44.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.946+0000 7ff221600640 1 -- 172.21.15.69:0/952690838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff21c104e70 msgr2=0x7ff21c105280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:44.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.946+0000 7ff221600640 1 --2- 172.21.15.69:0/952690838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff21c104e70 0x7ff21c105280 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7ff208009900 tx=0x7ff20802a410 comp rx=0 tx=0).stop 2024-05-14T15:21:44.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.946+0000 7ff221600640 1 -- 172.21.15.69:0/952690838 shutdown_connections 2024-05-14T15:21:44.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.946+0000 7ff221600640 1 --2- 172.21.15.69:0/952690838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff21c109b70 0x7ff21c10bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:44.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.946+0000 7ff221600640 1 --2- 172.21.15.69:0/952690838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff21c104e70 0x7ff21c105280 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:44.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.946+0000 7ff221600640 1 --2- 172.21.15.69:0/952690838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff21c103c30 0x7ff21c104930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:44.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.946+0000 7ff221600640 1 -- 172.21.15.69:0/952690838 >> 172.21.15.69:0/952690838 conn(0x7ff21c0fee40 msgr2=0x7ff21c1012d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:44.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.946+0000 7ff221600640 1 -- 172.21.15.69:0/952690838 shutdown_connections 2024-05-14T15:21:44.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.946+0000 7ff221600640 1 -- 172.21.15.69:0/952690838 wait complete. 2024-05-14T15:21:44.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.947+0000 7ff221600640 1 Processor -- start 2024-05-14T15:21:44.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.947+0000 7ff221600640 1 -- start start 2024-05-14T15:21:44.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.948+0000 7ff221600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff21c103c30 0x7ff21c077a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:44.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.948+0000 7ff221600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff21c104e70 0x7ff21c076130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:44.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.948+0000 7ff221600640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff21c109b70 0x7ff21c076670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:44.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.948+0000 7ff221600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff21c10f5e0 con 0x7ff21c104e70 2024-05-14T15:21:44.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.948+0000 7ff221600640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff21c10f460 con 0x7ff21c109b70 2024-05-14T15:21:44.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.948+0000 7ff221600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff21c10f760 con 0x7ff21c103c30 2024-05-14T15:21:44.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.948+0000 7ff21a000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff21c104e70 0x7ff21c076130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:44.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.948+0000 7ff21a000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff21c104e70 0x7ff21c076130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52668/0 (socket says 172.21.15.69:52668) 2024-05-14T15:21:44.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.948+0000 7ff21a000640 1 -- 172.21.15.69:0/617589812 learned_addr learned my addr 172.21.15.69:0/617589812 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:44.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.948+0000 7ff21aa00640 1 --2- 172.21.15.69:0/617589812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff21c103c30 0x7ff21c077a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:44.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.948+0000 7ff21b400640 1 --2- 172.21.15.69:0/617589812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff21c109b70 0x7ff21c076670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:44.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.949+0000 7ff21a000640 1 -- 172.21.15.69:0/617589812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff21c103c30 msgr2=0x7ff21c077a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:44.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.949+0000 7ff21a000640 1 --2- 172.21.15.69:0/617589812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff21c103c30 0x7ff21c077a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:44.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.949+0000 7ff21a000640 1 -- 172.21.15.69:0/617589812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff21c109b70 msgr2=0x7ff21c076670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:44.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.949+0000 7ff21a000640 1 --2- 172.21.15.69:0/617589812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff21c109b70 0x7ff21c076670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:44.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.949+0000 7ff21a000640 1 -- 172.21.15.69:0/617589812 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff21c076da0 con 0x7ff21c104e70 2024-05-14T15:21:44.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.949+0000 7ff21b400640 1 --2- 172.21.15.69:0/617589812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff21c109b70 0x7ff21c076670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:21:44.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.949+0000 7ff21a000640 1 --2- 172.21.15.69:0/617589812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff21c104e70 0x7ff21c076130 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff208009230 tx=0x7ff2080040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:44.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.949+0000 7ff213400640 1 -- 172.21.15.69:0/617589812 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff20803f030 con 0x7ff21c104e70 2024-05-14T15:21:44.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.949+0000 7ff221600640 1 -- 172.21.15.69:0/617589812 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff21c1a4330 con 0x7ff21c104e70 2024-05-14T15:21:44.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.949+0000 7ff213400640 1 -- 172.21.15.69:0/617589812 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2080044c0 con 0x7ff21c104e70 2024-05-14T15:21:44.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.949+0000 7ff213400640 1 -- 172.21.15.69:0/617589812 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff208035070 con 0x7ff21c104e70 2024-05-14T15:21:44.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.949+0000 7ff221600640 1 -- 172.21.15.69:0/617589812 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff21c1a4790 con 0x7ff21c104e70 2024-05-14T15:21:44.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.951+0000 7ff221600640 1 -- 172.21.15.69:0/617589812 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff21c108980 con 0x7ff21c104e70 2024-05-14T15:21:44.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.956+0000 7ff213400640 1 -- 172.21.15.69:0/617589812 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 149828+0+0 (secure 0 0 0) 0x7ff208042030 con 0x7ff21c104e70 2024-05-14T15:21:44.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.958+0000 7ff213400640 1 --2- 172.21.15.69:0/617589812 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff2000b29f0 0x7ff2000b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:44.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.959+0000 7ff213400640 1 -- 172.21.15.69:0/617589812 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7ff208103530 con 0x7ff21c104e70 2024-05-14T15:21:44.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.959+0000 7ff21aa00640 1 --2- 172.21.15.69:0/617589812 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff2000b29f0 0x7ff2000b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:44.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.959+0000 7ff213400640 1 -- 172.21.15.69:0/617589812 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7ff2080ca9f0 con 0x7ff21c104e70 2024-05-14T15:21:44.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:44.960+0000 7ff21aa00640 1 --2- 172.21.15.69:0/617589812 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff2000b29f0 0x7ff2000b4f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff21c104830 tx=0x7ff20c005f90 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:45.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.170+0000 7ff221600640 1 -- 172.21.15.69:0/617589812 --> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff21c063110 con 0x7ff2000b29f0 2024-05-14T15:21:45.181 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.181+0000 7ff213400640 1 -- 172.21.15.69:0/617589812 <== mgr.34991 v2:172.21.15.69:6800/1271399048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339517 (secure 0 0 0) 0x7ff21c063110 con 0x7ff2000b29f0 2024-05-14T15:21:45.186 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:21:45.188 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-05-14T15:21:45.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.186+0000 7ff221600640 1 -- 172.21.15.69:0/617589812 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff2000b29f0 msgr2=0x7ff2000b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.186+0000 7ff221600640 1 --2- 172.21.15.69:0/617589812 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff2000b29f0 0x7ff2000b4f00 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff21c104830 tx=0x7ff20c005f90 comp rx=0 tx=0).stop 2024-05-14T15:21:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.186+0000 7ff221600640 1 -- 172.21.15.69:0/617589812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff21c104e70 msgr2=0x7ff21c076130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.186+0000 7ff221600640 1 --2- 172.21.15.69:0/617589812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff21c104e70 0x7ff21c076130 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7ff208009230 tx=0x7ff2080040c0 comp rx=0 tx=0).stop 2024-05-14T15:21:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.186+0000 7ff221600640 1 -- 172.21.15.69:0/617589812 shutdown_connections 2024-05-14T15:21:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.186+0000 7ff221600640 1 --2- 172.21.15.69:0/617589812 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff2000b29f0 0x7ff2000b4f00 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.186+0000 7ff221600640 1 --2- 172.21.15.69:0/617589812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff21c109b70 0x7ff21c076670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.186+0000 7ff221600640 1 --2- 172.21.15.69:0/617589812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff21c104e70 0x7ff21c076130 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.186+0000 7ff221600640 1 --2- 172.21.15.69:0/617589812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff21c103c30 0x7ff21c077a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.186+0000 7ff221600640 1 -- 172.21.15.69:0/617589812 >> 172.21.15.69:0/617589812 conn(0x7ff21c0fee40 msgr2=0x7ff21c105b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.186+0000 7ff221600640 1 -- 172.21.15.69:0/617589812 shutdown_connections 2024-05-14T15:21:45.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.186+0000 7ff221600640 1 -- 172.21.15.69:0/617589812 wait complete. 2024-05-14T15:21:45.214 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-05-14T15:21:43.833225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1199743,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":2628,"num_read_kb":1466,"num_write":522,"num_write_kb":3641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":916,"ondisk_log_size":916,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385624,"kb_used_data":15632,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124556200,"statfs":{"total":1151940427776,"available":1151545548800,"internally_reserved":0,"allocated":16007168,"data_stored":9330852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.984569"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.157290+0000","last_change":"2024-05-14T15:16:08.799448+0000","last_active":"2024-05-14T15:21:38.157290+0000","last_peered":"2024-05-14T15:21:38.157290+0000","last_clean":"2024-05-14T15:21:38.157290+0000","last_became_active":"2024-05-14T15:16:08.799025+0000","last_became_peered":"2024-05-14T15:16:08.799025+0000","last_unstale":"2024-05-14T15:21:38.157290+0000","last_undegraded":"2024-05-14T15:21:38.157290+0000","last_fullsized":"2024-05-14T15:21:38.157290+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:25:56.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154838+0000","last_change":"2024-05-14T15:16:08.796943+0000","last_active":"2024-05-14T15:21:38.154838+0000","last_peered":"2024-05-14T15:21:38.154838+0000","last_clean":"2024-05-14T15:21:38.154838+0000","last_became_active":"2024-05-14T15:16:08.796044+0000","last_became_peered":"2024-05-14T15:16:08.796044+0000","last_unstale":"2024-05-14T15:21:38.154838+0000","last_undegraded":"2024-05-14T15:21:38.154838+0000","last_fullsized":"2024-05-14T15:21:38.154838+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:26:22.103727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153707+0000","last_change":"2024-05-14T15:16:08.794020+0000","last_active":"2024-05-14T15:21:38.153707+0000","last_peered":"2024-05-14T15:21:38.153707+0000","last_clean":"2024-05-14T15:21:38.153707+0000","last_became_active":"2024-05-14T15:16:08.793677+0000","last_became_peered":"2024-05-14T15:16:08.793677+0000","last_unstale":"2024-05-14T15:21:38.153707+0000","last_undegraded":"2024-05-14T15:21:38.153707+0000","last_fullsized":"2024-05-14T15:21:38.153707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.615815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.805580+0000","last_change":"2024-05-14T15:16:08.787482+0000","last_active":"2024-05-14T15:21:37.805580+0000","last_peered":"2024-05-14T15:21:37.805580+0000","last_clean":"2024-05-14T15:21:37.805580+0000","last_became_active":"2024-05-14T15:16:08.787087+0000","last_became_peered":"2024-05-14T15:16:08.787087+0000","last_unstale":"2024-05-14T15:21:37.805580+0000","last_undegraded":"2024-05-14T15:21:37.805580+0000","last_fullsized":"2024-05-14T15:21:37.805580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:18:51.433751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804789+0000","last_change":"2024-05-14T15:16:08.785982+0000","last_active":"2024-05-14T15:21:37.804789+0000","last_peered":"2024-05-14T15:21:37.804789+0000","last_clean":"2024-05-14T15:21:37.804789+0000","last_became_active":"2024-05-14T15:16:08.784980+0000","last_became_peered":"2024-05-14T15:16:08.784980+0000","last_unstale":"2024-05-14T15:21:37.804789+0000","last_undegraded":"2024-05-14T15:21:37.804789+0000","last_fullsized":"2024-05-14T15:21:37.804789+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:07:50.390637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.983083+0000","last_change":"2024-05-14T15:16:08.784622+0000","last_active":"2024-05-14T15:21:37.983083+0000","last_peered":"2024-05-14T15:21:37.983083+0000","last_clean":"2024-05-14T15:21:37.983083+0000","last_became_active":"2024-05-14T15:16:08.784206+0000","last_became_peered":"2024-05-14T15:16:08.784206+0000","last_unstale":"2024-05-14T15:21:37.983083+0000","last_undegraded":"2024-05-14T15:21:37.983083+0000","last_fullsized":"2024-05-14T15:21:37.983083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:40:56.578935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.080463+0000","last_change":"2024-05-14T15:16:08.786381+0000","last_active":"2024-05-14T15:21:38.080463+0000","last_peered":"2024-05-14T15:21:38.080463+0000","last_clean":"2024-05-14T15:21:38.080463+0000","last_became_active":"2024-05-14T15:16:08.781231+0000","last_became_peered":"2024-05-14T15:16:08.781231+0000","last_unstale":"2024-05-14T15:21:38.080463+0000","last_undegraded":"2024-05-14T15:21:38.080463+0000","last_fullsized":"2024-05-14T15:21:38.080463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:51:16.961187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.960967+0000","last_change":"2024-05-14T15:17:43.850244+0000","last_active":"2024-05-14T15:21:37.960967+0000","last_peered":"2024-05-14T15:21:37.960967+0000","last_clean":"2024-05-14T15:21:37.960967+0000","last_became_active":"2024-05-14T15:17:43.849671+0000","last_became_peered":"2024-05-14T15:17:43.849671+0000","last_unstale":"2024-05-14T15:21:37.960967+0000","last_undegraded":"2024-05-14T15:21:37.960967+0000","last_fullsized":"2024-05-14T15:21:37.960967+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:21:05.537250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,10],"acting":[3,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155626+0000","last_change":"2024-05-14T15:16:08.785644+0000","last_active":"2024-05-14T15:21:38.155626+0000","last_peered":"2024-05-14T15:21:38.155626+0000","last_clean":"2024-05-14T15:21:38.155626+0000","last_became_active":"2024-05-14T15:16:08.785224+0000","last_became_peered":"2024-05-14T15:16:08.785224+0000","last_unstale":"2024-05-14T15:21:38.155626+0000","last_undegraded":"2024-05-14T15:21:38.155626+0000","last_fullsized":"2024-05-14T15:21:38.155626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:05:10.868610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":58,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.984158+0000","last_change":"2024-05-14T15:16:08.784425+0000","last_active":"2024-05-14T15:21:37.984158+0000","last_peered":"2024-05-14T15:21:37.984158+0000","last_clean":"2024-05-14T15:21:37.984158+0000","last_became_active":"2024-05-14T15:16:08.782889+0000","last_became_peered":"2024-05-14T15:16:08.782889+0000","last_unstale":"2024-05-14T15:21:37.984158+0000","last_undegraded":"2024-05-14T15:21:37.984158+0000","last_fullsized":"2024-05-14T15:21:37.984158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:40:11.043101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082375+0000","last_change":"2024-05-14T15:16:08.782675+0000","last_active":"2024-05-14T15:21:38.082375+0000","last_peered":"2024-05-14T15:21:38.082375+0000","last_clean":"2024-05-14T15:21:38.082375+0000","last_became_active":"2024-05-14T15:16:08.781994+0000","last_became_peered":"2024-05-14T15:16:08.781994+0000","last_unstale":"2024-05-14T15:21:38.082375+0000","last_undegraded":"2024-05-14T15:21:38.082375+0000","last_fullsized":"2024-05-14T15:21:38.082375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:00:59.625493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.805442+0000","last_change":"2024-05-14T15:16:08.785655+0000","last_active":"2024-05-14T15:21:37.805442+0000","last_peered":"2024-05-14T15:21:37.805442+0000","last_clean":"2024-05-14T15:21:37.805442+0000","last_became_active":"2024-05-14T15:16:08.785273+0000","last_became_peered":"2024-05-14T15:16:08.785273+0000","last_unstale":"2024-05-14T15:21:37.805442+0000","last_undegraded":"2024-05-14T15:21:37.805442+0000","last_fullsized":"2024-05-14T15:21:37.805442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:11:51.971909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145068+0000","last_change":"2024-05-14T15:16:08.775558+0000","last_active":"2024-05-14T15:21:38.145068+0000","last_peered":"2024-05-14T15:21:38.145068+0000","last_clean":"2024-05-14T15:21:38.145068+0000","last_became_active":"2024-05-14T15:16:08.773465+0000","last_became_peered":"2024-05-14T15:16:08.773465+0000","last_unstale":"2024-05-14T15:21:38.145068+0000","last_undegraded":"2024-05-14T15:21:38.145068+0000","last_fullsized":"2024-05-14T15:21:38.145068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:16:17.151374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153837+0000","last_change":"2024-05-14T15:16:08.786160+0000","last_active":"2024-05-14T15:21:38.153837+0000","last_peered":"2024-05-14T15:21:38.153837+0000","last_clean":"2024-05-14T15:21:38.153837+0000","last_became_active":"2024-05-14T15:16:08.781257+0000","last_became_peered":"2024-05-14T15:16:08.781257+0000","last_unstale":"2024-05-14T15:21:38.153837+0000","last_undegraded":"2024-05-14T15:21:38.153837+0000","last_fullsized":"2024-05-14T15:21:38.153837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:13:03.974692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153600+0000","last_change":"2024-05-14T15:16:43.014673+0000","last_active":"2024-05-14T15:21:38.153600+0000","last_peered":"2024-05-14T15:21:38.153600+0000","last_clean":"2024-05-14T15:21:38.153600+0000","last_became_active":"2024-05-14T15:16:43.013718+0000","last_became_peered":"2024-05-14T15:16:43.013718+0000","last_unstale":"2024-05-14T15:21:38.153600+0000","last_undegraded":"2024-05-14T15:21:38.153600+0000","last_fullsized":"2024-05-14T15:21:38.153600+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:08:42.885151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153490+0000","last_change":"2024-05-14T15:16:08.784437+0000","last_active":"2024-05-14T15:21:38.153490+0000","last_peered":"2024-05-14T15:21:38.153490+0000","last_clean":"2024-05-14T15:21:38.153490+0000","last_became_active":"2024-05-14T15:16:08.784030+0000","last_became_peered":"2024-05-14T15:16:08.784030+0000","last_unstale":"2024-05-14T15:21:38.153490+0000","last_undegraded":"2024-05-14T15:21:38.153490+0000","last_fullsized":"2024-05-14T15:21:38.153490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:57:43.025679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.156811+0000","last_change":"2024-05-14T15:16:08.798419+0000","last_active":"2024-05-14T15:21:38.156811+0000","last_peered":"2024-05-14T15:21:38.156811+0000","last_clean":"2024-05-14T15:21:38.156811+0000","last_became_active":"2024-05-14T15:16:08.798066+0000","last_became_peered":"2024-05-14T15:16:08.798066+0000","last_unstale":"2024-05-14T15:21:38.156811+0000","last_undegraded":"2024-05-14T15:21:38.156811+0000","last_fullsized":"2024-05-14T15:21:38.156811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:55:29.921745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.798694+0000","last_change":"2024-05-14T15:16:08.780638+0000","last_active":"2024-05-14T15:21:37.798694+0000","last_peered":"2024-05-14T15:21:37.798694+0000","last_clean":"2024-05-14T15:21:37.798694+0000","last_became_active":"2024-05-14T15:16:08.778675+0000","last_became_peered":"2024-05-14T15:16:08.778675+0000","last_unstale":"2024-05-14T15:21:37.798694+0000","last_undegraded":"2024-05-14T15:21:37.798694+0000","last_fullsized":"2024-05-14T15:21:37.798694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:29.780036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146810+0000","last_change":"2024-05-14T15:16:08.791729+0000","last_active":"2024-05-14T15:21:38.146810+0000","last_peered":"2024-05-14T15:21:38.146810+0000","last_clean":"2024-05-14T15:21:38.146810+0000","last_became_active":"2024-05-14T15:16:08.791367+0000","last_became_peered":"2024-05-14T15:16:08.791367+0000","last_unstale":"2024-05-14T15:21:38.146810+0000","last_undegraded":"2024-05-14T15:21:38.146810+0000","last_fullsized":"2024-05-14T15:21:38.146810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:03:00.148744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145875+0000","last_change":"2024-05-14T15:16:22.909315+0000","last_active":"2024-05-14T15:21:38.145875+0000","last_peered":"2024-05-14T15:21:38.145875+0000","last_clean":"2024-05-14T15:21:38.145875+0000","last_became_active":"2024-05-14T15:16:22.908846+0000","last_became_peered":"2024-05-14T15:16:22.908846+0000","last_unstale":"2024-05-14T15:21:38.145875+0000","last_undegraded":"2024-05-14T15:21:38.145875+0000","last_fullsized":"2024-05-14T15:21:38.145875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:20:50.338711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'15","reported_seq":304,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.797488+0000","last_change":"2024-05-14T15:16:03.729599+0000","last_active":"2024-05-14T15:21:37.797488+0000","last_peered":"2024-05-14T15:21:37.797488+0000","last_clean":"2024-05-14T15:21:37.797488+0000","last_became_active":"2024-05-14T15:16:03.728659+0000","last_became_peered":"2024-05-14T15:16:03.728659+0000","last_unstale":"2024-05-14T15:21:37.797488+0000","last_undegraded":"2024-05-14T15:21:37.797488+0000","last_fullsized":"2024-05-14T15:21:37.797488+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:54:18.989059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961610+0000","last_change":"2024-05-14T15:16:08.790296+0000","last_active":"2024-05-14T15:21:37.961610+0000","last_peered":"2024-05-14T15:21:37.961610+0000","last_clean":"2024-05-14T15:21:37.961610+0000","last_became_active":"2024-05-14T15:16:08.789899+0000","last_became_peered":"2024-05-14T15:16:08.789899+0000","last_unstale":"2024-05-14T15:21:37.961610+0000","last_undegraded":"2024-05-14T15:21:37.961610+0000","last_fullsized":"2024-05-14T15:21:37.961610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:23:15.626580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.803102+0000","last_change":"2024-05-14T15:16:22.904857+0000","last_active":"2024-05-14T15:21:37.803102+0000","last_peered":"2024-05-14T15:21:37.803102+0000","last_clean":"2024-05-14T15:21:37.803102+0000","last_became_active":"2024-05-14T15:16:22.903747+0000","last_became_peered":"2024-05-14T15:16:22.903747+0000","last_unstale":"2024-05-14T15:21:37.803102+0000","last_undegraded":"2024-05-14T15:21:37.803102+0000","last_fullsized":"2024-05-14T15:21:37.803102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:58:27.937637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.962192+0000","last_change":"2024-05-14T15:16:03.840248+0000","last_active":"2024-05-14T15:21:37.962192+0000","last_peered":"2024-05-14T15:21:37.962192+0000","last_clean":"2024-05-14T15:21:37.962192+0000","last_became_active":"2024-05-14T15:16:03.839731+0000","last_became_peered":"2024-05-14T15:16:03.839731+0000","last_unstale":"2024-05-14T15:21:37.962192+0000","last_undegraded":"2024-05-14T15:21:37.962192+0000","last_fullsized":"2024-05-14T15:21:37.962192+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:31:25.981757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.156094+0000","last_change":"2024-05-14T15:16:08.791233+0000","last_active":"2024-05-14T15:21:38.156094+0000","last_peered":"2024-05-14T15:21:38.156094+0000","last_clean":"2024-05-14T15:21:38.156094+0000","last_became_active":"2024-05-14T15:16:08.790376+0000","last_became_peered":"2024-05-14T15:16:08.790376+0000","last_unstale":"2024-05-14T15:21:38.156094+0000","last_undegraded":"2024-05-14T15:21:38.156094+0000","last_fullsized":"2024-05-14T15:21:38.156094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:35.203663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804053+0000","last_change":"2024-05-14T15:16:22.906435+0000","last_active":"2024-05-14T15:21:37.804053+0000","last_peered":"2024-05-14T15:21:37.804053+0000","last_clean":"2024-05-14T15:21:37.804053+0000","last_became_active":"2024-05-14T15:16:22.905558+0000","last_became_peered":"2024-05-14T15:16:22.905558+0000","last_unstale":"2024-05-14T15:21:37.804053+0000","last_undegraded":"2024-05-14T15:21:37.804053+0000","last_fullsized":"2024-05-14T15:21:37.804053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:43:15.748904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155943+0000","last_change":"2024-05-14T15:16:43.026454+0000","last_active":"2024-05-14T15:21:38.155943+0000","last_peered":"2024-05-14T15:21:38.155943+0000","last_clean":"2024-05-14T15:21:38.155943+0000","last_became_active":"2024-05-14T15:16:43.019742+0000","last_became_peered":"2024-05-14T15:16:43.019742+0000","last_unstale":"2024-05-14T15:21:38.155943+0000","last_undegraded":"2024-05-14T15:21:38.155943+0000","last_fullsized":"2024-05-14T15:21:38.155943+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:38:38.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154348+0000","last_change":"2024-05-14T15:16:08.774669+0000","last_active":"2024-05-14T15:21:38.154348+0000","last_peered":"2024-05-14T15:21:38.154348+0000","last_clean":"2024-05-14T15:21:38.154348+0000","last_became_active":"2024-05-14T15:16:08.773996+0000","last_became_peered":"2024-05-14T15:16:08.773996+0000","last_unstale":"2024-05-14T15:21:38.154348+0000","last_undegraded":"2024-05-14T15:21:38.154348+0000","last_fullsized":"2024-05-14T15:21:38.154348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:21:58.199462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.803377+0000","last_change":"2024-05-14T15:16:43.065743+0000","last_active":"2024-05-14T15:21:37.803377+0000","last_peered":"2024-05-14T15:21:37.803377+0000","last_clean":"2024-05-14T15:21:37.803377+0000","last_became_active":"2024-05-14T15:16:43.064426+0000","last_became_peered":"2024-05-14T15:16:43.064426+0000","last_unstale":"2024-05-14T15:21:37.803377+0000","last_undegraded":"2024-05-14T15:21:37.803377+0000","last_fullsized":"2024-05-14T15:21:37.803377+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:15:44.230694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804621+0000","last_change":"2024-05-14T15:16:03.732142+0000","last_active":"2024-05-14T15:21:37.804621+0000","last_peered":"2024-05-14T15:21:37.804621+0000","last_clean":"2024-05-14T15:21:37.804621+0000","last_became_active":"2024-05-14T15:16:03.731590+0000","last_became_peered":"2024-05-14T15:16:03.731590+0000","last_unstale":"2024-05-14T15:21:37.804621+0000","last_undegraded":"2024-05-14T15:21:37.804621+0000","last_fullsized":"2024-05-14T15:21:37.804621+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:05:23.760541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.975058+0000","last_change":"2024-05-14T15:16:08.780895+0000","last_active":"2024-05-14T15:21:37.975058+0000","last_peered":"2024-05-14T15:21:37.975058+0000","last_clean":"2024-05-14T15:21:37.975058+0000","last_became_active":"2024-05-14T15:16:08.780472+0000","last_became_peered":"2024-05-14T15:16:08.780472+0000","last_unstale":"2024-05-14T15:21:37.975058+0000","last_undegraded":"2024-05-14T15:21:37.975058+0000","last_fullsized":"2024-05-14T15:21:37.975058+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:49.508043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146184+0000","last_change":"2024-05-14T15:16:22.915997+0000","last_active":"2024-05-14T15:21:38.146184+0000","last_peered":"2024-05-14T15:21:38.146184+0000","last_clean":"2024-05-14T15:21:38.146184+0000","last_became_active":"2024-05-14T15:16:22.915466+0000","last_became_peered":"2024-05-14T15:16:22.915466+0000","last_unstale":"2024-05-14T15:21:38.146184+0000","last_undegraded":"2024-05-14T15:21:38.146184+0000","last_fullsized":"2024-05-14T15:21:38.146184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:50:39.748860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"92'10","reported_seq":303,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.409493+0000","last_change":"2024-05-14T15:16:03.733796+0000","last_active":"2024-05-14T15:21:38.409493+0000","last_peered":"2024-05-14T15:21:38.409493+0000","last_clean":"2024-05-14T15:21:38.409493+0000","last_became_active":"2024-05-14T15:16:03.732467+0000","last_became_peered":"2024-05-14T15:16:03.732467+0000","last_unstale":"2024-05-14T15:21:38.409493+0000","last_undegraded":"2024-05-14T15:21:38.409493+0000","last_fullsized":"2024-05-14T15:21:38.409493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:28.388120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2413,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":245,"num_read_kb":5,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804145+0000","last_change":"2024-05-14T15:16:08.793287+0000","last_active":"2024-05-14T15:21:37.804145+0000","last_peered":"2024-05-14T15:21:37.804145+0000","last_clean":"2024-05-14T15:21:37.804145+0000","last_became_active":"2024-05-14T15:16:08.791173+0000","last_became_peered":"2024-05-14T15:16:08.791173+0000","last_unstale":"2024-05-14T15:21:37.804145+0000","last_undegraded":"2024-05-14T15:21:37.804145+0000","last_fullsized":"2024-05-14T15:21:37.804145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:24:49.644251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145909+0000","last_change":"2024-05-14T15:16:22.914734+0000","last_active":"2024-05-14T15:21:38.145909+0000","last_peered":"2024-05-14T15:21:38.145909+0000","last_clean":"2024-05-14T15:21:38.145909+0000","last_became_active":"2024-05-14T15:16:22.914267+0000","last_became_peered":"2024-05-14T15:16:22.914267+0000","last_unstale":"2024-05-14T15:21:38.145909+0000","last_undegraded":"2024-05-14T15:21:38.145909+0000","last_fullsized":"2024-05-14T15:21:38.145909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:04:50.809564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.983167+0000","last_change":"2024-05-14T15:16:03.729217+0000","last_active":"2024-05-14T15:21:37.983167+0000","last_peered":"2024-05-14T15:21:37.983167+0000","last_clean":"2024-05-14T15:21:37.983167+0000","last_became_active":"2024-05-14T15:16:03.727453+0000","last_became_peered":"2024-05-14T15:16:03.727453+0000","last_unstale":"2024-05-14T15:21:37.983167+0000","last_undegraded":"2024-05-14T15:21:37.983167+0000","last_fullsized":"2024-05-14T15:21:37.983167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:40:27.820618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974866+0000","last_change":"2024-05-14T15:16:08.783861+0000","last_active":"2024-05-14T15:21:37.974866+0000","last_peered":"2024-05-14T15:21:37.974866+0000","last_clean":"2024-05-14T15:21:37.974866+0000","last_became_active":"2024-05-14T15:16:08.782986+0000","last_became_peered":"2024-05-14T15:16:08.782986+0000","last_unstale":"2024-05-14T15:21:37.974866+0000","last_undegraded":"2024-05-14T15:21:37.974866+0000","last_fullsized":"2024-05-14T15:21:37.974866+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:52.453137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.156781+0000","last_change":"2024-05-14T15:16:22.912295+0000","last_active":"2024-05-14T15:21:38.156781+0000","last_peered":"2024-05-14T15:21:38.156781+0000","last_clean":"2024-05-14T15:21:38.156781+0000","last_became_active":"2024-05-14T15:16:22.911779+0000","last_became_peered":"2024-05-14T15:16:22.911779+0000","last_unstale":"2024-05-14T15:21:38.156781+0000","last_undegraded":"2024-05-14T15:21:38.156781+0000","last_fullsized":"2024-05-14T15:21:38.156781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:47:45.153619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.144215+0000","last_change":"2024-05-14T15:16:03.729590+0000","last_active":"2024-05-14T15:21:38.144215+0000","last_peered":"2024-05-14T15:21:38.144215+0000","last_clean":"2024-05-14T15:21:38.144215+0000","last_became_active":"2024-05-14T15:16:03.727790+0000","last_became_peered":"2024-05-14T15:16:03.727790+0000","last_unstale":"2024-05-14T15:21:38.144215+0000","last_undegraded":"2024-05-14T15:21:38.144215+0000","last_fullsized":"2024-05-14T15:21:38.144215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:13:31.960505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.960865+0000","last_change":"2024-05-14T15:16:08.789872+0000","last_active":"2024-05-14T15:21:37.960865+0000","last_peered":"2024-05-14T15:21:37.960865+0000","last_clean":"2024-05-14T15:21:37.960865+0000","last_became_active":"2024-05-14T15:16:08.786817+0000","last_became_peered":"2024-05-14T15:16:08.786817+0000","last_unstale":"2024-05-14T15:21:37.960865+0000","last_undegraded":"2024-05-14T15:21:37.960865+0000","last_fullsized":"2024-05-14T15:21:37.960865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:09:41.042473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153854+0000","last_change":"2024-05-14T15:16:22.903302+0000","last_active":"2024-05-14T15:21:38.153854+0000","last_peered":"2024-05-14T15:21:38.153854+0000","last_clean":"2024-05-14T15:21:38.153854+0000","last_became_active":"2024-05-14T15:16:22.902830+0000","last_became_peered":"2024-05-14T15:16:22.902830+0000","last_unstale":"2024-05-14T15:21:38.153854+0000","last_undegraded":"2024-05-14T15:21:38.153854+0000","last_fullsized":"2024-05-14T15:21:38.153854+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:18:57.467319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974037+0000","last_change":"2024-05-14T15:16:03.738372+0000","last_active":"2024-05-14T15:21:37.974037+0000","last_peered":"2024-05-14T15:21:37.974037+0000","last_clean":"2024-05-14T15:21:37.974037+0000","last_became_active":"2024-05-14T15:16:03.737815+0000","last_became_peered":"2024-05-14T15:16:03.737815+0000","last_unstale":"2024-05-14T15:21:37.974037+0000","last_undegraded":"2024-05-14T15:21:37.974037+0000","last_fullsized":"2024-05-14T15:21:37.974037+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:19:19.702318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.796832+0000","last_change":"2024-05-14T15:16:08.781979+0000","last_active":"2024-05-14T15:21:37.796832+0000","last_peered":"2024-05-14T15:21:37.796832+0000","last_clean":"2024-05-14T15:21:37.796832+0000","last_became_active":"2024-05-14T15:16:08.777257+0000","last_became_peered":"2024-05-14T15:16:08.777257+0000","last_unstale":"2024-05-14T15:21:37.796832+0000","last_undegraded":"2024-05-14T15:21:37.796832+0000","last_fullsized":"2024-05-14T15:21:37.796832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:31.154921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961089+0000","last_change":"2024-05-14T15:16:22.901107+0000","last_active":"2024-05-14T15:21:37.961089+0000","last_peered":"2024-05-14T15:21:37.961089+0000","last_clean":"2024-05-14T15:21:37.961089+0000","last_became_active":"2024-05-14T15:16:22.900578+0000","last_became_peered":"2024-05-14T15:16:22.900578+0000","last_unstale":"2024-05-14T15:21:37.961089+0000","last_undegraded":"2024-05-14T15:21:37.961089+0000","last_fullsized":"2024-05-14T15:21:37.961089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:11:23.019455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'8","reported_seq":536,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.140068+0000","last_change":"2024-05-14T15:16:03.730145+0000","last_active":"2024-05-14T15:21:38.140068+0000","last_peered":"2024-05-14T15:21:38.140068+0000","last_clean":"2024-05-14T15:21:38.140068+0000","last_became_active":"2024-05-14T15:16:03.728119+0000","last_became_peered":"2024-05-14T15:16:03.728119+0000","last_unstale":"2024-05-14T15:21:38.140068+0000","last_undegraded":"2024-05-14T15:21:38.140068+0000","last_fullsized":"2024-05-14T15:21:38.140068+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:19:57.596282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":480,"num_read_kb":480,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155528+0000","last_change":"2024-05-14T15:16:08.781834+0000","last_active":"2024-05-14T15:21:38.155528+0000","last_peered":"2024-05-14T15:21:38.155528+0000","last_clean":"2024-05-14T15:21:38.155528+0000","last_became_active":"2024-05-14T15:16:08.781451+0000","last_became_peered":"2024-05-14T15:16:08.781451+0000","last_unstale":"2024-05-14T15:21:38.155528+0000","last_undegraded":"2024-05-14T15:21:38.155528+0000","last_fullsized":"2024-05-14T15:21:38.155528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:17:33.147475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.796785+0000","last_change":"2024-05-14T15:16:22.910711+0000","last_active":"2024-05-14T15:21:37.796785+0000","last_peered":"2024-05-14T15:21:37.796785+0000","last_clean":"2024-05-14T15:21:37.796785+0000","last_became_active":"2024-05-14T15:16:22.910076+0000","last_became_peered":"2024-05-14T15:16:22.910076+0000","last_unstale":"2024-05-14T15:21:37.796785+0000","last_undegraded":"2024-05-14T15:21:37.796785+0000","last_fullsized":"2024-05-14T15:21:37.796785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:11:05.867547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082905+0000","last_change":"2024-05-14T15:16:03.736682+0000","last_active":"2024-05-14T15:21:38.082905+0000","last_peered":"2024-05-14T15:21:38.082905+0000","last_clean":"2024-05-14T15:21:38.082905+0000","last_became_active":"2024-05-14T15:16:03.733676+0000","last_became_peered":"2024-05-14T15:16:03.733676+0000","last_unstale":"2024-05-14T15:21:38.082905+0000","last_undegraded":"2024-05-14T15:21:38.082905+0000","last_fullsized":"2024-05-14T15:21:38.082905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:12:12.814817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.156249+0000","last_change":"2024-05-14T15:16:08.797256+0000","last_active":"2024-05-14T15:21:38.156249+0000","last_peered":"2024-05-14T15:21:38.156249+0000","last_clean":"2024-05-14T15:21:38.156249+0000","last_became_active":"2024-05-14T15:16:08.796675+0000","last_became_peered":"2024-05-14T15:16:08.796675+0000","last_unstale":"2024-05-14T15:21:38.156249+0000","last_undegraded":"2024-05-14T15:21:38.156249+0000","last_fullsized":"2024-05-14T15:21:38.156249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:08.026962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804368+0000","last_change":"2024-05-14T15:16:22.914775+0000","last_active":"2024-05-14T15:21:37.804368+0000","last_peered":"2024-05-14T15:21:37.804368+0000","last_clean":"2024-05-14T15:21:37.804368+0000","last_became_active":"2024-05-14T15:16:22.912853+0000","last_became_peered":"2024-05-14T15:16:22.912853+0000","last_unstale":"2024-05-14T15:21:37.804368+0000","last_undegraded":"2024-05-14T15:21:37.804368+0000","last_fullsized":"2024-05-14T15:21:37.804368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:01:11.652074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974947+0000","last_change":"2024-05-14T15:16:03.845365+0000","last_active":"2024-05-14T15:21:37.974947+0000","last_peered":"2024-05-14T15:21:37.974947+0000","last_clean":"2024-05-14T15:21:37.974947+0000","last_became_active":"2024-05-14T15:16:03.842557+0000","last_became_peered":"2024-05-14T15:16:03.842557+0000","last_unstale":"2024-05-14T15:21:37.974947+0000","last_undegraded":"2024-05-14T15:21:37.974947+0000","last_fullsized":"2024-05-14T15:21:37.974947+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:26:21.515074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.798709+0000","last_change":"2024-05-14T15:17:43.855838+0000","last_active":"2024-05-14T15:21:37.798709+0000","last_peered":"2024-05-14T15:21:37.798709+0000","last_clean":"2024-05-14T15:21:37.798709+0000","last_became_active":"2024-05-14T15:17:43.855462+0000","last_became_peered":"2024-05-14T15:17:43.855462+0000","last_unstale":"2024-05-14T15:21:37.798709+0000","last_undegraded":"2024-05-14T15:21:37.798709+0000","last_fullsized":"2024-05-14T15:21:37.798709+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:56:06.442987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,4],"acting":[9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.797106+0000","last_change":"2024-05-14T15:16:22.905266+0000","last_active":"2024-05-14T15:21:37.797106+0000","last_peered":"2024-05-14T15:21:37.797106+0000","last_clean":"2024-05-14T15:21:37.797106+0000","last_became_active":"2024-05-14T15:16:22.903397+0000","last_became_peered":"2024-05-14T15:16:22.903397+0000","last_unstale":"2024-05-14T15:21:37.797106+0000","last_undegraded":"2024-05-14T15:21:37.797106+0000","last_fullsized":"2024-05-14T15:21:37.797106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:48:37.616028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"92'44","reported_seq":585,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.418698+0000","last_change":"2024-05-14T15:16:03.735261+0000","last_active":"2024-05-14T15:21:38.418698+0000","last_peered":"2024-05-14T15:21:38.418698+0000","last_clean":"2024-05-14T15:21:38.418698+0000","last_became_active":"2024-05-14T15:16:03.732725+0000","last_became_peered":"2024-05-14T15:16:03.732725+0000","last_unstale":"2024-05-14T15:21:38.418698+0000","last_undegraded":"2024-05-14T15:21:38.418698+0000","last_fullsized":"2024-05-14T15:21:38.418698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:44:51.777221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72303,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":493,"num_read_kb":316,"num_write":46,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804203+0000","last_change":"2024-05-14T15:16:08.783758+0000","last_active":"2024-05-14T15:21:37.804203+0000","last_peered":"2024-05-14T15:21:37.804203+0000","last_clean":"2024-05-14T15:21:37.804203+0000","last_became_active":"2024-05-14T15:16:08.782465+0000","last_became_peered":"2024-05-14T15:16:08.782465+0000","last_unstale":"2024-05-14T15:21:37.804203+0000","last_undegraded":"2024-05-14T15:21:37.804203+0000","last_fullsized":"2024-05-14T15:21:37.804203+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:37:36.921823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.975918+0000","last_change":"2024-05-14T15:16:22.899606+0000","last_active":"2024-05-14T15:21:37.975918+0000","last_peered":"2024-05-14T15:21:37.975918+0000","last_clean":"2024-05-14T15:21:37.975918+0000","last_became_active":"2024-05-14T15:16:22.898810+0000","last_became_peered":"2024-05-14T15:16:22.898810+0000","last_unstale":"2024-05-14T15:21:37.975918+0000","last_undegraded":"2024-05-14T15:21:37.975918+0000","last_fullsized":"2024-05-14T15:21:37.975918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:49:07.068713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":59,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146824+0000","last_change":"2024-05-14T15:16:03.728561+0000","last_active":"2024-05-14T15:21:38.146824+0000","last_peered":"2024-05-14T15:21:38.146824+0000","last_clean":"2024-05-14T15:21:38.146824+0000","last_became_active":"2024-05-14T15:16:03.727273+0000","last_became_peered":"2024-05-14T15:16:03.727273+0000","last_unstale":"2024-05-14T15:21:38.146824+0000","last_undegraded":"2024-05-14T15:21:38.146824+0000","last_fullsized":"2024-05-14T15:21:38.146824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:06.487549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.144601+0000","last_change":"2024-05-14T15:16:08.788199+0000","last_active":"2024-05-14T15:21:38.144601+0000","last_peered":"2024-05-14T15:21:38.144601+0000","last_clean":"2024-05-14T15:21:38.144601+0000","last_became_active":"2024-05-14T15:16:08.786477+0000","last_became_peered":"2024-05-14T15:16:08.786477+0000","last_unstale":"2024-05-14T15:21:38.144601+0000","last_undegraded":"2024-05-14T15:21:38.144601+0000","last_fullsized":"2024-05-14T15:21:38.144601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:40:33.441154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155160+0000","last_change":"2024-05-14T15:16:22.911265+0000","last_active":"2024-05-14T15:21:38.155160+0000","last_peered":"2024-05-14T15:21:38.155160+0000","last_clean":"2024-05-14T15:21:38.155160+0000","last_became_active":"2024-05-14T15:16:22.910297+0000","last_became_peered":"2024-05-14T15:16:22.910297+0000","last_unstale":"2024-05-14T15:21:38.155160+0000","last_undegraded":"2024-05-14T15:21:38.155160+0000","last_fullsized":"2024-05-14T15:21:38.155160+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:43:37.894409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974437+0000","last_change":"2024-05-14T15:16:03.735122+0000","last_active":"2024-05-14T15:21:37.974437+0000","last_peered":"2024-05-14T15:21:37.974437+0000","last_clean":"2024-05-14T15:21:37.974437+0000","last_became_active":"2024-05-14T15:16:03.734746+0000","last_became_peered":"2024-05-14T15:16:03.734746+0000","last_unstale":"2024-05-14T15:21:37.974437+0000","last_undegraded":"2024-05-14T15:21:37.974437+0000","last_fullsized":"2024-05-14T15:21:37.974437+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:36:48.070577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.081278+0000","last_change":"2024-05-14T15:16:08.791427+0000","last_active":"2024-05-14T15:21:38.081278+0000","last_peered":"2024-05-14T15:21:38.081278+0000","last_clean":"2024-05-14T15:21:38.081278+0000","last_became_active":"2024-05-14T15:16:08.791070+0000","last_became_peered":"2024-05-14T15:16:08.791070+0000","last_unstale":"2024-05-14T15:21:38.081278+0000","last_undegraded":"2024-05-14T15:21:38.081278+0000","last_fullsized":"2024-05-14T15:21:38.081278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:15:13.153055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.796785+0000","last_change":"2024-05-14T15:16:22.896084+0000","last_active":"2024-05-14T15:21:37.796785+0000","last_peered":"2024-05-14T15:21:37.796785+0000","last_clean":"2024-05-14T15:21:37.796785+0000","last_became_active":"2024-05-14T15:16:22.894473+0000","last_became_peered":"2024-05-14T15:16:22.894473+0000","last_unstale":"2024-05-14T15:21:37.796785+0000","last_undegraded":"2024-05-14T15:21:37.796785+0000","last_fullsized":"2024-05-14T15:21:37.796785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:18:18.844423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"92'9","reported_seq":302,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.147663+0000","last_change":"2024-05-14T15:16:03.728070+0000","last_active":"2024-05-14T15:21:38.147663+0000","last_peered":"2024-05-14T15:21:38.147663+0000","last_clean":"2024-05-14T15:21:38.147663+0000","last_became_active":"2024-05-14T15:16:03.726155+0000","last_became_peered":"2024-05-14T15:16:03.726155+0000","last_unstale":"2024-05-14T15:21:38.147663+0000","last_undegraded":"2024-05-14T15:21:38.147663+0000","last_fullsized":"2024-05-14T15:21:38.147663+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:50:43.447812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1988,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":6,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.081106+0000","last_change":"2024-05-14T15:16:08.787281+0000","last_active":"2024-05-14T15:21:38.081106+0000","last_peered":"2024-05-14T15:21:38.081106+0000","last_clean":"2024-05-14T15:21:38.081106+0000","last_became_active":"2024-05-14T15:16:08.786910+0000","last_became_peered":"2024-05-14T15:16:08.786910+0000","last_unstale":"2024-05-14T15:21:38.081106+0000","last_undegraded":"2024-05-14T15:21:38.081106+0000","last_fullsized":"2024-05-14T15:21:38.081106+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:03:35.421845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146088+0000","last_change":"2024-05-14T15:16:43.066135+0000","last_active":"2024-05-14T15:21:38.146088+0000","last_peered":"2024-05-14T15:21:38.146088+0000","last_clean":"2024-05-14T15:21:38.146088+0000","last_became_active":"2024-05-14T15:16:43.064558+0000","last_became_peered":"2024-05-14T15:16:43.064558+0000","last_unstale":"2024-05-14T15:21:38.146088+0000","last_undegraded":"2024-05-14T15:21:38.146088+0000","last_fullsized":"2024-05-14T15:21:38.146088+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:21:25.441639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":66,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.803274+0000","last_change":"2024-05-14T15:16:03.841009+0000","last_active":"2024-05-14T15:21:37.803274+0000","last_peered":"2024-05-14T15:21:37.803274+0000","last_clean":"2024-05-14T15:21:37.803274+0000","last_became_active":"2024-05-14T15:16:03.839514+0000","last_became_peered":"2024-05-14T15:16:03.839514+0000","last_unstale":"2024-05-14T15:21:37.803274+0000","last_undegraded":"2024-05-14T15:21:37.803274+0000","last_fullsized":"2024-05-14T15:21:37.803274+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:34:55.588072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974110+0000","last_change":"2024-05-14T15:16:08.774343+0000","last_active":"2024-05-14T15:21:37.974110+0000","last_peered":"2024-05-14T15:21:37.974110+0000","last_clean":"2024-05-14T15:21:37.974110+0000","last_became_active":"2024-05-14T15:16:08.773826+0000","last_became_peered":"2024-05-14T15:16:08.773826+0000","last_unstale":"2024-05-14T15:21:37.974110+0000","last_undegraded":"2024-05-14T15:21:37.974110+0000","last_fullsized":"2024-05-14T15:21:37.974110+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:30:51.648019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.973948+0000","last_change":"2024-05-14T15:16:22.889838+0000","last_active":"2024-05-14T15:21:37.973948+0000","last_peered":"2024-05-14T15:21:37.973948+0000","last_clean":"2024-05-14T15:21:37.973948+0000","last_became_active":"2024-05-14T15:16:22.888604+0000","last_became_peered":"2024-05-14T15:16:22.888604+0000","last_unstale":"2024-05-14T15:21:37.973948+0000","last_undegraded":"2024-05-14T15:21:37.973948+0000","last_fullsized":"2024-05-14T15:21:37.973948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:26:53.176588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"91'3","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.805462+0000","last_change":"2024-05-14T15:16:03.731499+0000","last_active":"2024-05-14T15:21:37.805462+0000","last_peered":"2024-05-14T15:21:37.805462+0000","last_clean":"2024-05-14T15:21:37.805462+0000","last_became_active":"2024-05-14T15:16:03.729387+0000","last_became_peered":"2024-05-14T15:16:03.729387+0000","last_unstale":"2024-05-14T15:21:37.805462+0000","last_undegraded":"2024-05-14T15:21:37.805462+0000","last_fullsized":"2024-05-14T15:21:37.805462+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:52:24.287236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155956+0000","last_change":"2024-05-14T15:16:08.787376+0000","last_active":"2024-05-14T15:21:38.155956+0000","last_peered":"2024-05-14T15:21:38.155956+0000","last_clean":"2024-05-14T15:21:38.155956+0000","last_became_active":"2024-05-14T15:16:08.786057+0000","last_became_peered":"2024-05-14T15:16:08.786057+0000","last_unstale":"2024-05-14T15:21:38.155956+0000","last_undegraded":"2024-05-14T15:21:38.155956+0000","last_fullsized":"2024-05-14T15:21:38.155956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:17:16.582656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804810+0000","last_change":"2024-05-14T15:16:23.049639+0000","last_active":"2024-05-14T15:21:37.804810+0000","last_peered":"2024-05-14T15:21:37.804810+0000","last_clean":"2024-05-14T15:21:37.804810+0000","last_became_active":"2024-05-14T15:16:23.047746+0000","last_became_peered":"2024-05-14T15:16:23.047746+0000","last_unstale":"2024-05-14T15:21:37.804810+0000","last_undegraded":"2024-05-14T15:21:37.804810+0000","last_fullsized":"2024-05-14T15:21:37.804810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:22:27.129466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.797819+0000","last_change":"2024-05-14T15:16:03.842156+0000","last_active":"2024-05-14T15:21:37.797819+0000","last_peered":"2024-05-14T15:21:37.797819+0000","last_clean":"2024-05-14T15:21:37.797819+0000","last_became_active":"2024-05-14T15:16:03.841626+0000","last_became_peered":"2024-05-14T15:16:03.841626+0000","last_unstale":"2024-05-14T15:21:37.797819+0000","last_undegraded":"2024-05-14T15:21:37.797819+0000","last_fullsized":"2024-05-14T15:21:37.797819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:40.955009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.983882+0000","last_change":"2024-05-14T15:16:08.780632+0000","last_active":"2024-05-14T15:21:37.983882+0000","last_peered":"2024-05-14T15:21:37.983882+0000","last_clean":"2024-05-14T15:21:37.983882+0000","last_became_active":"2024-05-14T15:16:08.779743+0000","last_became_peered":"2024-05-14T15:16:08.779743+0000","last_unstale":"2024-05-14T15:21:37.983882+0000","last_undegraded":"2024-05-14T15:21:37.983882+0000","last_fullsized":"2024-05-14T15:21:37.983882+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:53:45.608716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145495+0000","last_change":"2024-05-14T15:16:22.894512+0000","last_active":"2024-05-14T15:21:38.145495+0000","last_peered":"2024-05-14T15:21:38.145495+0000","last_clean":"2024-05-14T15:21:38.145495+0000","last_became_active":"2024-05-14T15:16:22.893566+0000","last_became_peered":"2024-05-14T15:16:22.893566+0000","last_unstale":"2024-05-14T15:21:38.145495+0000","last_undegraded":"2024-05-14T15:21:38.145495+0000","last_fullsized":"2024-05-14T15:21:38.145495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:45:39.571364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"92'9","reported_seq":301,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082594+0000","last_change":"2024-05-14T15:16:03.730782+0000","last_active":"2024-05-14T15:21:38.082594+0000","last_peered":"2024-05-14T15:21:38.082594+0000","last_clean":"2024-05-14T15:21:38.082594+0000","last_became_active":"2024-05-14T15:16:03.729703+0000","last_became_peered":"2024-05-14T15:16:03.729703+0000","last_unstale":"2024-05-14T15:21:38.082594+0000","last_undegraded":"2024-05-14T15:21:38.082594+0000","last_fullsized":"2024-05-14T15:21:38.082594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:30:30.379450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1988,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":244,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.983945+0000","last_change":"2024-05-14T15:16:08.792362+0000","last_active":"2024-05-14T15:21:37.983945+0000","last_peered":"2024-05-14T15:21:37.983945+0000","last_clean":"2024-05-14T15:21:37.983945+0000","last_became_active":"2024-05-14T15:16:08.791836+0000","last_became_peered":"2024-05-14T15:16:08.791836+0000","last_unstale":"2024-05-14T15:21:37.983945+0000","last_undegraded":"2024-05-14T15:21:37.983945+0000","last_fullsized":"2024-05-14T15:21:37.983945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:50:07.142474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145947+0000","last_change":"2024-05-14T15:16:23.048324+0000","last_active":"2024-05-14T15:21:38.145947+0000","last_peered":"2024-05-14T15:21:38.145947+0000","last_clean":"2024-05-14T15:21:38.145947+0000","last_became_active":"2024-05-14T15:16:23.047829+0000","last_became_peered":"2024-05-14T15:16:23.047829+0000","last_unstale":"2024-05-14T15:21:38.145947+0000","last_undegraded":"2024-05-14T15:21:38.145947+0000","last_fullsized":"2024-05-14T15:21:38.145947+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:13.018847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974489+0000","last_change":"2024-05-14T15:16:43.013252+0000","last_active":"2024-05-14T15:21:37.974489+0000","last_peered":"2024-05-14T15:21:37.974489+0000","last_clean":"2024-05-14T15:21:37.974489+0000","last_became_active":"2024-05-14T15:16:43.011962+0000","last_became_peered":"2024-05-14T15:16:43.011962+0000","last_unstale":"2024-05-14T15:21:37.974489+0000","last_undegraded":"2024-05-14T15:21:37.974489+0000","last_fullsized":"2024-05-14T15:21:37.974489+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:06.204259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'7","reported_seq":296,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.144120+0000","last_change":"2024-05-14T15:16:03.840983+0000","last_active":"2024-05-14T15:21:38.144120+0000","last_peered":"2024-05-14T15:21:38.144120+0000","last_clean":"2024-05-14T15:21:38.144120+0000","last_became_active":"2024-05-14T15:16:03.839117+0000","last_became_peered":"2024-05-14T15:16:03.839117+0000","last_unstale":"2024-05-14T15:21:38.144120+0000","last_undegraded":"2024-05-14T15:21:38.144120+0000","last_fullsized":"2024-05-14T15:21:38.144120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:57.163543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082005+0000","last_change":"2024-05-14T15:16:22.914744+0000","last_active":"2024-05-14T15:21:38.082005+0000","last_peered":"2024-05-14T15:21:38.082005+0000","last_clean":"2024-05-14T15:21:38.082005+0000","last_became_active":"2024-05-14T15:16:22.913661+0000","last_became_peered":"2024-05-14T15:16:22.913661+0000","last_unstale":"2024-05-14T15:21:38.082005+0000","last_undegraded":"2024-05-14T15:21:38.082005+0000","last_fullsized":"2024-05-14T15:21:38.082005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:45.957828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961391+0000","last_change":"2024-05-14T15:16:08.791872+0000","last_active":"2024-05-14T15:21:37.961391+0000","last_peered":"2024-05-14T15:21:37.961391+0000","last_clean":"2024-05-14T15:21:37.961391+0000","last_became_active":"2024-05-14T15:16:08.791229+0000","last_became_peered":"2024-05-14T15:16:08.791229+0000","last_unstale":"2024-05-14T15:21:37.961391+0000","last_undegraded":"2024-05-14T15:21:37.961391+0000","last_fullsized":"2024-05-14T15:21:37.961391+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:36:26.391077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804146+0000","last_change":"2024-05-14T15:16:03.732872+0000","last_active":"2024-05-14T15:21:37.804146+0000","last_peered":"2024-05-14T15:21:37.804146+0000","last_clean":"2024-05-14T15:21:37.804146+0000","last_became_active":"2024-05-14T15:16:03.732188+0000","last_became_peered":"2024-05-14T15:16:03.732188+0000","last_unstale":"2024-05-14T15:21:37.804146+0000","last_undegraded":"2024-05-14T15:21:37.804146+0000","last_fullsized":"2024-05-14T15:21:37.804146+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:20:56.776521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":123,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.080063+0000","last_change":"2024-05-14T15:14:08.407259+0000","last_active":"2024-05-14T15:21:38.080063+0000","last_peered":"2024-05-14T15:21:38.080063+0000","last_clean":"2024-05-14T15:21:38.080063+0000","last_became_active":"2024-05-14T15:14:08.398012+0000","last_became_peered":"2024-05-14T15:14:08.398012+0000","last_unstale":"2024-05-14T15:21:38.080063+0000","last_undegraded":"2024-05-14T15:21:38.080063+0000","last_fullsized":"2024-05-14T15:21:38.080063+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:09:04.015044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:09:04.015044+0000","last_clean_scrub_stamp":"2024-05-14T15:09:04.015044+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:37.256490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974363+0000","last_change":"2024-05-14T15:16:23.053989+0000","last_active":"2024-05-14T15:21:37.974363+0000","last_peered":"2024-05-14T15:21:37.974363+0000","last_clean":"2024-05-14T15:21:37.974363+0000","last_became_active":"2024-05-14T15:16:23.052585+0000","last_became_peered":"2024-05-14T15:16:23.052585+0000","last_unstale":"2024-05-14T15:21:37.974363+0000","last_undegraded":"2024-05-14T15:21:37.974363+0000","last_fullsized":"2024-05-14T15:21:37.974363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:30.104518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.143910+0000","last_change":"2024-05-14T15:16:08.775447+0000","last_active":"2024-05-14T15:21:38.143910+0000","last_peered":"2024-05-14T15:21:38.143910+0000","last_clean":"2024-05-14T15:21:38.143910+0000","last_became_active":"2024-05-14T15:16:08.775055+0000","last_became_peered":"2024-05-14T15:16:08.775055+0000","last_unstale":"2024-05-14T15:21:38.143910+0000","last_undegraded":"2024-05-14T15:21:38.143910+0000","last_fullsized":"2024-05-14T15:21:38.143910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:57:24.668939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.081025+0000","last_change":"2024-05-14T15:16:03.735221+0000","last_active":"2024-05-14T15:21:38.081025+0000","last_peered":"2024-05-14T15:21:38.081025+0000","last_clean":"2024-05-14T15:21:38.081025+0000","last_became_active":"2024-05-14T15:16:03.731910+0000","last_became_peered":"2024-05-14T15:16:03.731910+0000","last_unstale":"2024-05-14T15:21:38.081025+0000","last_undegraded":"2024-05-14T15:21:38.081025+0000","last_fullsized":"2024-05-14T15:21:38.081025+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:57:18.030308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155107+0000","last_change":"2024-05-14T15:16:22.910564+0000","last_active":"2024-05-14T15:21:38.155107+0000","last_peered":"2024-05-14T15:21:38.155107+0000","last_clean":"2024-05-14T15:21:38.155107+0000","last_became_active":"2024-05-14T15:16:22.910003+0000","last_became_peered":"2024-05-14T15:16:22.910003+0000","last_unstale":"2024-05-14T15:21:38.155107+0000","last_undegraded":"2024-05-14T15:21:38.155107+0000","last_fullsized":"2024-05-14T15:21:38.155107+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:47.895767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804685+0000","last_change":"2024-05-14T15:16:03.844236+0000","last_active":"2024-05-14T15:21:37.804685+0000","last_peered":"2024-05-14T15:21:37.804685+0000","last_clean":"2024-05-14T15:21:37.804685+0000","last_became_active":"2024-05-14T15:16:03.841253+0000","last_became_peered":"2024-05-14T15:16:03.841253+0000","last_unstale":"2024-05-14T15:21:37.804685+0000","last_undegraded":"2024-05-14T15:21:37.804685+0000","last_fullsized":"2024-05-14T15:21:37.804685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:40:24.440707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145591+0000","last_change":"2024-05-14T15:16:08.782849+0000","last_active":"2024-05-14T15:21:38.145591+0000","last_peered":"2024-05-14T15:21:38.145591+0000","last_clean":"2024-05-14T15:21:38.145591+0000","last_became_active":"2024-05-14T15:16:08.781999+0000","last_became_peered":"2024-05-14T15:16:08.781999+0000","last_unstale":"2024-05-14T15:21:38.145591+0000","last_undegraded":"2024-05-14T15:21:38.145591+0000","last_fullsized":"2024-05-14T15:21:38.145591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:33:03.997615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.960839+0000","last_change":"2024-05-14T15:16:23.049719+0000","last_active":"2024-05-14T15:21:37.960839+0000","last_peered":"2024-05-14T15:21:37.960839+0000","last_clean":"2024-05-14T15:21:37.960839+0000","last_became_active":"2024-05-14T15:16:23.048547+0000","last_became_peered":"2024-05-14T15:16:23.048547+0000","last_unstale":"2024-05-14T15:21:37.960839+0000","last_undegraded":"2024-05-14T15:21:37.960839+0000","last_fullsized":"2024-05-14T15:21:37.960839+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:41:49.790521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'52","reported_seq":123,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.309815+0000","last_change":"2024-05-14T15:16:03.729413+0000","last_active":"2024-05-14T15:21:38.309815+0000","last_peered":"2024-05-14T15:21:38.309815+0000","last_clean":"2024-05-14T15:21:38.309815+0000","last_became_active":"2024-05-14T15:16:03.728491+0000","last_became_peered":"2024-05-14T15:16:03.728491+0000","last_unstale":"2024-05-14T15:21:38.309815+0000","last_undegraded":"2024-05-14T15:21:38.309815+0000","last_fullsized":"2024-05-14T15:21:38.309815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:34:04.811775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":92,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.962137+0000","last_change":"2024-05-14T15:16:08.784237+0000","last_active":"2024-05-14T15:21:37.962137+0000","last_peered":"2024-05-14T15:21:37.962137+0000","last_clean":"2024-05-14T15:21:37.962137+0000","last_became_active":"2024-05-14T15:16:08.783908+0000","last_became_peered":"2024-05-14T15:16:08.783908+0000","last_unstale":"2024-05-14T15:21:37.962137+0000","last_undegraded":"2024-05-14T15:21:37.962137+0000","last_fullsized":"2024-05-14T15:21:37.962137+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:43:24.621314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145323+0000","last_change":"2024-05-14T15:16:22.909928+0000","last_active":"2024-05-14T15:21:38.145323+0000","last_peered":"2024-05-14T15:21:38.145323+0000","last_clean":"2024-05-14T15:21:38.145323+0000","last_became_active":"2024-05-14T15:16:22.909412+0000","last_became_peered":"2024-05-14T15:16:22.909412+0000","last_unstale":"2024-05-14T15:21:38.145323+0000","last_undegraded":"2024-05-14T15:21:38.145323+0000","last_fullsized":"2024-05-14T15:21:38.145323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:18:26.324189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804565+0000","last_change":"2024-05-14T15:16:03.729846+0000","last_active":"2024-05-14T15:21:37.804565+0000","last_peered":"2024-05-14T15:21:37.804565+0000","last_clean":"2024-05-14T15:21:37.804565+0000","last_became_active":"2024-05-14T15:16:03.729385+0000","last_became_peered":"2024-05-14T15:16:03.729385+0000","last_unstale":"2024-05-14T15:21:37.804565+0000","last_undegraded":"2024-05-14T15:21:37.804565+0000","last_fullsized":"2024-05-14T15:21:37.804565+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:05:18.987237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155368+0000","last_change":"2024-05-14T15:16:08.796017+0000","last_active":"2024-05-14T15:21:38.155368+0000","last_peered":"2024-05-14T15:21:38.155368+0000","last_clean":"2024-05-14T15:21:38.155368+0000","last_became_active":"2024-05-14T15:16:08.791627+0000","last_became_peered":"2024-05-14T15:16:08.791627+0000","last_unstale":"2024-05-14T15:21:38.155368+0000","last_undegraded":"2024-05-14T15:21:38.155368+0000","last_fullsized":"2024-05-14T15:21:38.155368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:46:27.910669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804084+0000","last_change":"2024-05-14T15:16:23.052954+0000","last_active":"2024-05-14T15:21:37.804084+0000","last_peered":"2024-05-14T15:21:37.804084+0000","last_clean":"2024-05-14T15:21:37.804084+0000","last_became_active":"2024-05-14T15:16:23.051410+0000","last_became_peered":"2024-05-14T15:16:23.051410+0000","last_unstale":"2024-05-14T15:21:37.804084+0000","last_undegraded":"2024-05-14T15:21:37.804084+0000","last_fullsized":"2024-05-14T15:21:37.804084+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:28:55.181866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153689+0000","last_change":"2024-05-14T15:16:43.023961+0000","last_active":"2024-05-14T15:21:38.153689+0000","last_peered":"2024-05-14T15:21:38.153689+0000","last_clean":"2024-05-14T15:21:38.153689+0000","last_became_active":"2024-05-14T15:16:43.022677+0000","last_became_peered":"2024-05-14T15:16:43.022677+0000","last_unstale":"2024-05-14T15:21:38.153689+0000","last_undegraded":"2024-05-14T15:21:38.153689+0000","last_fullsized":"2024-05-14T15:21:38.153689+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:33:16.692984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.803304+0000","last_change":"2024-05-14T15:16:08.780415+0000","last_active":"2024-05-14T15:21:37.803304+0000","last_peered":"2024-05-14T15:21:37.803304+0000","last_clean":"2024-05-14T15:21:37.803304+0000","last_became_active":"2024-05-14T15:16:08.780053+0000","last_became_peered":"2024-05-14T15:16:08.780053+0000","last_unstale":"2024-05-14T15:21:37.803304+0000","last_undegraded":"2024-05-14T15:21:37.803304+0000","last_fullsized":"2024-05-14T15:21:37.803304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:18:00.964346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.805308+0000","last_change":"2024-05-14T15:16:43.066458+0000","last_active":"2024-05-14T15:21:37.805308+0000","last_peered":"2024-05-14T15:21:37.805308+0000","last_clean":"2024-05-14T15:21:37.805308+0000","last_became_active":"2024-05-14T15:16:43.064035+0000","last_became_peered":"2024-05-14T15:16:43.064035+0000","last_unstale":"2024-05-14T15:21:37.805308+0000","last_undegraded":"2024-05-14T15:21:37.805308+0000","last_fullsized":"2024-05-14T15:21:37.805308+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:38:39.895882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961153+0000","last_change":"2024-05-14T15:16:03.731962+0000","last_active":"2024-05-14T15:21:37.961153+0000","last_peered":"2024-05-14T15:21:37.961153+0000","last_clean":"2024-05-14T15:21:37.961153+0000","last_became_active":"2024-05-14T15:16:03.726532+0000","last_became_peered":"2024-05-14T15:16:03.726532+0000","last_unstale":"2024-05-14T15:21:37.961153+0000","last_undegraded":"2024-05-14T15:21:37.961153+0000","last_fullsized":"2024-05-14T15:21:37.961153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:47:26.809212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154807+0000","last_change":"2024-05-14T15:16:08.798984+0000","last_active":"2024-05-14T15:21:38.154807+0000","last_peered":"2024-05-14T15:21:38.154807+0000","last_clean":"2024-05-14T15:21:38.154807+0000","last_became_active":"2024-05-14T15:16:08.798120+0000","last_became_peered":"2024-05-14T15:16:08.798120+0000","last_unstale":"2024-05-14T15:21:38.154807+0000","last_undegraded":"2024-05-14T15:21:38.154807+0000","last_fullsized":"2024-05-14T15:21:38.154807+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:58.519436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804997+0000","last_change":"2024-05-14T15:16:22.907994+0000","last_active":"2024-05-14T15:21:37.804997+0000","last_peered":"2024-05-14T15:21:37.804997+0000","last_clean":"2024-05-14T15:21:37.804997+0000","last_became_active":"2024-05-14T15:16:22.907144+0000","last_became_peered":"2024-05-14T15:16:22.907144+0000","last_unstale":"2024-05-14T15:21:37.804997+0000","last_undegraded":"2024-05-14T15:21:37.804997+0000","last_fullsized":"2024-05-14T15:21:37.804997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:49:11.436917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"91'4","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145631+0000","last_change":"2024-05-14T15:16:03.728334+0000","last_active":"2024-05-14T15:21:38.145631+0000","last_peered":"2024-05-14T15:21:38.145631+0000","last_clean":"2024-05-14T15:21:38.145631+0000","last_became_active":"2024-05-14T15:16:03.727836+0000","last_became_peered":"2024-05-14T15:16:03.727836+0000","last_unstale":"2024-05-14T15:21:38.145631+0000","last_undegraded":"2024-05-14T15:21:38.145631+0000","last_fullsized":"2024-05-14T15:21:38.145631+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:54.780821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961656+0000","last_change":"2024-05-14T15:16:08.798340+0000","last_active":"2024-05-14T15:21:37.961656+0000","last_peered":"2024-05-14T15:21:37.961656+0000","last_clean":"2024-05-14T15:21:37.961656+0000","last_became_active":"2024-05-14T15:16:08.797981+0000","last_became_peered":"2024-05-14T15:16:08.797981+0000","last_unstale":"2024-05-14T15:21:37.961656+0000","last_undegraded":"2024-05-14T15:21:37.961656+0000","last_fullsized":"2024-05-14T15:21:37.961656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:04:08.322033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.803678+0000","last_change":"2024-05-14T15:16:23.050064+0000","last_active":"2024-05-14T15:21:37.803678+0000","last_peered":"2024-05-14T15:21:37.803678+0000","last_clean":"2024-05-14T15:21:37.803678+0000","last_became_active":"2024-05-14T15:16:23.048608+0000","last_became_peered":"2024-05-14T15:16:23.048608+0000","last_unstale":"2024-05-14T15:21:37.803678+0000","last_undegraded":"2024-05-14T15:21:37.803678+0000","last_fullsized":"2024-05-14T15:21:37.803678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:32.044226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804332+0000","last_change":"2024-05-14T15:16:03.734588+0000","last_active":"2024-05-14T15:21:37.804332+0000","last_peered":"2024-05-14T15:21:37.804332+0000","last_clean":"2024-05-14T15:21:37.804332+0000","last_became_active":"2024-05-14T15:16:03.734112+0000","last_became_peered":"2024-05-14T15:16:03.734112+0000","last_unstale":"2024-05-14T15:21:37.804332+0000","last_undegraded":"2024-05-14T15:21:37.804332+0000","last_fullsized":"2024-05-14T15:21:37.804332+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:07:56.545225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.080873+0000","last_change":"2024-05-14T15:16:08.789481+0000","last_active":"2024-05-14T15:21:38.080873+0000","last_peered":"2024-05-14T15:21:38.080873+0000","last_clean":"2024-05-14T15:21:38.080873+0000","last_became_active":"2024-05-14T15:16:08.788462+0000","last_became_peered":"2024-05-14T15:16:08.788462+0000","last_unstale":"2024-05-14T15:21:38.080873+0000","last_undegraded":"2024-05-14T15:21:38.080873+0000","last_fullsized":"2024-05-14T15:21:38.080873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:35:06.386410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153851+0000","last_change":"2024-05-14T15:16:22.903205+0000","last_active":"2024-05-14T15:21:38.153851+0000","last_peered":"2024-05-14T15:21:38.153851+0000","last_clean":"2024-05-14T15:21:38.153851+0000","last_became_active":"2024-05-14T15:16:22.901217+0000","last_became_peered":"2024-05-14T15:16:22.901217+0000","last_unstale":"2024-05-14T15:21:38.153851+0000","last_undegraded":"2024-05-14T15:21:38.153851+0000","last_fullsized":"2024-05-14T15:21:38.153851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:03:59.160106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'8","reported_seq":301,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146311+0000","last_change":"2024-05-14T15:16:03.840601+0000","last_active":"2024-05-14T15:21:38.146311+0000","last_peered":"2024-05-14T15:21:38.146311+0000","last_clean":"2024-05-14T15:21:38.146311+0000","last_became_active":"2024-05-14T15:16:03.839299+0000","last_became_peered":"2024-05-14T15:16:03.839299+0000","last_unstale":"2024-05-14T15:21:38.146311+0000","last_undegraded":"2024-05-14T15:21:38.146311+0000","last_fullsized":"2024-05-14T15:21:38.146311+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:35:46.773419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2179,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":245,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082686+0000","last_change":"2024-05-14T15:16:08.782915+0000","last_active":"2024-05-14T15:21:38.082686+0000","last_peered":"2024-05-14T15:21:38.082686+0000","last_clean":"2024-05-14T15:21:38.082686+0000","last_became_active":"2024-05-14T15:16:08.782469+0000","last_became_peered":"2024-05-14T15:16:08.782469+0000","last_unstale":"2024-05-14T15:21:38.082686+0000","last_undegraded":"2024-05-14T15:21:38.082686+0000","last_fullsized":"2024-05-14T15:21:38.082686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:36:35.361723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154025+0000","last_change":"2024-05-14T15:16:43.021276+0000","last_active":"2024-05-14T15:21:38.154025+0000","last_peered":"2024-05-14T15:21:38.154025+0000","last_clean":"2024-05-14T15:21:38.154025+0000","last_became_active":"2024-05-14T15:16:43.020534+0000","last_became_peered":"2024-05-14T15:16:43.020534+0000","last_unstale":"2024-05-14T15:21:38.154025+0000","last_undegraded":"2024-05-14T15:21:38.154025+0000","last_fullsized":"2024-05-14T15:21:38.154025+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:31:01.267429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"92'41","reported_seq":97,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.304866+0000","last_change":"2024-05-14T15:16:03.728379+0000","last_active":"2024-05-14T15:21:38.304866+0000","last_peered":"2024-05-14T15:21:38.304866+0000","last_clean":"2024-05-14T15:21:38.304866+0000","last_became_active":"2024-05-14T15:16:03.727580+0000","last_became_peered":"2024-05-14T15:16:03.727580+0000","last_unstale":"2024-05-14T15:21:38.304866+0000","last_undegraded":"2024-05-14T15:21:38.304866+0000","last_fullsized":"2024-05-14T15:21:38.304866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:54:20.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082068+0000","last_change":"2024-05-14T15:17:43.854489+0000","last_active":"2024-05-14T15:21:38.082068+0000","last_peered":"2024-05-14T15:21:38.082068+0000","last_clean":"2024-05-14T15:21:38.082068+0000","last_became_active":"2024-05-14T15:17:43.853624+0000","last_became_peered":"2024-05-14T15:17:43.853624+0000","last_unstale":"2024-05-14T15:21:38.082068+0000","last_undegraded":"2024-05-14T15:21:38.082068+0000","last_fullsized":"2024-05-14T15:21:38.082068+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:59.686248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.973657+0000","last_change":"2024-05-14T15:16:22.911248+0000","last_active":"2024-05-14T15:21:37.973657+0000","last_peered":"2024-05-14T15:21:37.973657+0000","last_clean":"2024-05-14T15:21:37.973657+0000","last_became_active":"2024-05-14T15:16:22.909975+0000","last_became_peered":"2024-05-14T15:16:22.909975+0000","last_unstale":"2024-05-14T15:21:37.973657+0000","last_undegraded":"2024-05-14T15:21:37.973657+0000","last_fullsized":"2024-05-14T15:21:37.973657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:23.140008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145947+0000","last_change":"2024-05-14T15:16:03.728422+0000","last_active":"2024-05-14T15:21:38.145947+0000","last_peered":"2024-05-14T15:21:38.145947+0000","last_clean":"2024-05-14T15:21:38.145947+0000","last_became_active":"2024-05-14T15:16:03.727428+0000","last_became_peered":"2024-05-14T15:16:03.727428+0000","last_unstale":"2024-05-14T15:21:38.145947+0000","last_undegraded":"2024-05-14T15:21:38.145947+0000","last_fullsized":"2024-05-14T15:21:38.145947+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:37:15.472001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.083392+0000","last_change":"2024-05-14T15:16:08.782158+0000","last_active":"2024-05-14T15:21:38.083392+0000","last_peered":"2024-05-14T15:21:38.083392+0000","last_clean":"2024-05-14T15:21:38.083392+0000","last_became_active":"2024-05-14T15:16:08.781761+0000","last_became_peered":"2024-05-14T15:16:08.781761+0000","last_unstale":"2024-05-14T15:21:38.083392+0000","last_undegraded":"2024-05-14T15:21:38.083392+0000","last_fullsized":"2024-05-14T15:21:38.083392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:01:42.886837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154932+0000","last_change":"2024-05-14T15:16:08.789851+0000","last_active":"2024-05-14T15:21:38.154932+0000","last_peered":"2024-05-14T15:21:38.154932+0000","last_clean":"2024-05-14T15:21:38.154932+0000","last_became_active":"2024-05-14T15:16:08.787563+0000","last_became_peered":"2024-05-14T15:16:08.787563+0000","last_unstale":"2024-05-14T15:21:38.154932+0000","last_undegraded":"2024-05-14T15:21:38.154932+0000","last_fullsized":"2024-05-14T15:21:38.154932+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:02:16.592481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145748+0000","last_change":"2024-05-14T15:16:08.788989+0000","last_active":"2024-05-14T15:21:38.145748+0000","last_peered":"2024-05-14T15:21:38.145748+0000","last_clean":"2024-05-14T15:21:38.145748+0000","last_became_active":"2024-05-14T15:16:08.785064+0000","last_became_peered":"2024-05-14T15:16:08.785064+0000","last_unstale":"2024-05-14T15:21:38.145748+0000","last_undegraded":"2024-05-14T15:21:38.145748+0000","last_fullsized":"2024-05-14T15:21:38.145748+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:12:30.824113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145443+0000","last_change":"2024-05-14T15:16:08.785849+0000","last_active":"2024-05-14T15:21:38.145443+0000","last_peered":"2024-05-14T15:21:38.145443+0000","last_clean":"2024-05-14T15:21:38.145443+0000","last_became_active":"2024-05-14T15:16:08.785487+0000","last_became_peered":"2024-05-14T15:16:08.785487+0000","last_unstale":"2024-05-14T15:21:38.145443+0000","last_undegraded":"2024-05-14T15:21:38.145443+0000","last_fullsized":"2024-05-14T15:21:38.145443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:37:16.435154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154327+0000","last_change":"2024-05-14T15:16:08.787843+0000","last_active":"2024-05-14T15:21:38.154327+0000","last_peered":"2024-05-14T15:21:38.154327+0000","last_clean":"2024-05-14T15:21:38.154327+0000","last_became_active":"2024-05-14T15:16:08.787485+0000","last_became_peered":"2024-05-14T15:16:08.787485+0000","last_unstale":"2024-05-14T15:21:38.154327+0000","last_undegraded":"2024-05-14T15:21:38.154327+0000","last_fullsized":"2024-05-14T15:21:38.154327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:16:06.625923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145685+0000","last_change":"2024-05-14T15:16:08.784870+0000","last_active":"2024-05-14T15:21:38.145685+0000","last_peered":"2024-05-14T15:21:38.145685+0000","last_clean":"2024-05-14T15:21:38.145685+0000","last_became_active":"2024-05-14T15:16:08.782496+0000","last_became_peered":"2024-05-14T15:16:08.782496+0000","last_unstale":"2024-05-14T15:21:38.145685+0000","last_undegraded":"2024-05-14T15:21:38.145685+0000","last_fullsized":"2024-05-14T15:21:38.145685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:54:33.724823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.156019+0000","last_change":"2024-05-14T15:16:08.783203+0000","last_active":"2024-05-14T15:21:38.156019+0000","last_peered":"2024-05-14T15:21:38.156019+0000","last_clean":"2024-05-14T15:21:38.156019+0000","last_became_active":"2024-05-14T15:16:08.782758+0000","last_became_peered":"2024-05-14T15:16:08.782758+0000","last_unstale":"2024-05-14T15:21:38.156019+0000","last_undegraded":"2024-05-14T15:21:38.156019+0000","last_fullsized":"2024-05-14T15:21:38.156019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:34:33.274511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146429+0000","last_change":"2024-05-14T15:16:08.789727+0000","last_active":"2024-05-14T15:21:38.146429+0000","last_peered":"2024-05-14T15:21:38.146429+0000","last_clean":"2024-05-14T15:21:38.146429+0000","last_became_active":"2024-05-14T15:16:08.784434+0000","last_became_peered":"2024-05-14T15:16:08.784434+0000","last_unstale":"2024-05-14T15:21:38.146429+0000","last_undegraded":"2024-05-14T15:21:38.146429+0000","last_fullsized":"2024-05-14T15:21:38.146429+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:59:19.835381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.962277+0000","last_change":"2024-05-14T15:16:08.781887+0000","last_active":"2024-05-14T15:21:37.962277+0000","last_peered":"2024-05-14T15:21:37.962277+0000","last_clean":"2024-05-14T15:21:37.962277+0000","last_became_active":"2024-05-14T15:16:08.781332+0000","last_became_peered":"2024-05-14T15:16:08.781332+0000","last_unstale":"2024-05-14T15:21:37.962277+0000","last_undegraded":"2024-05-14T15:21:37.962277+0000","last_fullsized":"2024-05-14T15:21:37.962277+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:51:36.558485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.080467+0000","last_change":"2024-05-14T15:16:43.065016+0000","last_active":"2024-05-14T15:21:38.080467+0000","last_peered":"2024-05-14T15:21:38.080467+0000","last_clean":"2024-05-14T15:21:38.080467+0000","last_became_active":"2024-05-14T15:16:43.063786+0000","last_became_peered":"2024-05-14T15:16:43.063786+0000","last_unstale":"2024-05-14T15:21:38.080467+0000","last_undegraded":"2024-05-14T15:21:38.080467+0000","last_fullsized":"2024-05-14T15:21:38.080467+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:01:54.920710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961198+0000","last_change":"2024-05-14T15:16:08.794288+0000","last_active":"2024-05-14T15:21:37.961198+0000","last_peered":"2024-05-14T15:21:37.961198+0000","last_clean":"2024-05-14T15:21:37.961198+0000","last_became_active":"2024-05-14T15:16:08.792059+0000","last_became_peered":"2024-05-14T15:16:08.792059+0000","last_unstale":"2024-05-14T15:21:37.961198+0000","last_undegraded":"2024-05-14T15:21:37.961198+0000","last_fullsized":"2024-05-14T15:21:37.961198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:30:55.769322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":58,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154428+0000","last_change":"2024-05-14T15:17:43.858583+0000","last_active":"2024-05-14T15:21:38.154428+0000","last_peered":"2024-05-14T15:21:38.154428+0000","last_clean":"2024-05-14T15:21:38.154428+0000","last_became_active":"2024-05-14T15:17:43.857287+0000","last_became_peered":"2024-05-14T15:17:43.857287+0000","last_unstale":"2024-05-14T15:21:38.154428+0000","last_undegraded":"2024-05-14T15:21:38.154428+0000","last_fullsized":"2024-05-14T15:21:38.154428+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:12:31.471747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145193+0000","last_change":"2024-05-14T15:16:08.786726+0000","last_active":"2024-05-14T15:21:38.145193+0000","last_peered":"2024-05-14T15:21:38.145193+0000","last_clean":"2024-05-14T15:21:38.145193+0000","last_became_active":"2024-05-14T15:16:08.785599+0000","last_became_peered":"2024-05-14T15:16:08.785599+0000","last_unstale":"2024-05-14T15:21:38.145193+0000","last_undegraded":"2024-05-14T15:21:38.145193+0000","last_fullsized":"2024-05-14T15:21:38.145193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:33:18.055459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155743+0000","last_change":"2024-05-14T15:16:43.022021+0000","last_active":"2024-05-14T15:21:38.155743+0000","last_peered":"2024-05-14T15:21:38.155743+0000","last_clean":"2024-05-14T15:21:38.155743+0000","last_became_active":"2024-05-14T15:16:43.021511+0000","last_became_peered":"2024-05-14T15:16:43.021511+0000","last_unstale":"2024-05-14T15:21:38.155743+0000","last_undegraded":"2024-05-14T15:21:38.155743+0000","last_fullsized":"2024-05-14T15:21:38.155743+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:59:55.083356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":609141,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":2547,"num_read_kb":1397,"num_write":397,"num_write_kb":1489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2187264,"data_stored":1827423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":322,"ondisk_log_size":322,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645397,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1073152,"data_stored":537039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841628,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":33044,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712108,"statfs":{"total":95995035648,"available":95961198592,"internally_reserved":0,"allocated":1912832,"data_stored":1328149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005156,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28480,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716672,"statfs":{"total":95995035648,"available":95965872128,"internally_reserved":0,"allocated":1495040,"data_stored":933272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201388,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32632,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712520,"statfs":{"total":95995035648,"available":95961620480,"internally_reserved":0,"allocated":1486848,"data_stored":929554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430322,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32832,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712320,"statfs":{"total":95995035648,"available":95961415680,"internally_reserved":0,"allocated":1691648,"data_stored":1135471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593851,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1073152,"data_stored":532864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575007,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32284,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712868,"statfs":{"total":95995035648,"available":95961976832,"internally_reserved":0,"allocated":1134592,"data_stored":595100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738536,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1097728,"data_stored":533929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411480,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1171456,"data_stored":607817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182545,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1085440,"data_stored":531172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986314,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1081344,"data_stored":536938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790083,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32844,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712308,"statfs":{"total":95995035648,"available":95961403392,"internally_reserved":0,"allocated":1703936,"data_stored":1129547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":75455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":77075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":136211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":7733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":207039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:21:45.218 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-05-14T15:21:45.219 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-14T15:21:45.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:45 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi092 to 176.4M 2024-05-14T15:21:45.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:45 smithi069 ceph-mon[31270]: Unable to set osd_memory_target on smithi092 to 185061273: error parsing value: Value '185061273' is below minimum 939524096 2024-05-14T15:21:45.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:45 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi203 to 176.4M 2024-05-14T15:21:45.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:45 smithi069 ceph-mon[31270]: Unable to set osd_memory_target on smithi203 to 185036185: error parsing value: Value '185036185' is below minimum 939524096 2024-05-14T15:21:45.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:45 smithi069 ceph-mon[31270]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:21:45.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:45 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:45.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:45 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:45.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:45 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:45.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:45 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:45.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:45 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:45.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:45 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:45.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:45 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:45.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:45 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:45.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.497+0000 7fbf0ea00640 1 -- 172.21.15.69:0/2506745788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf08106e80 msgr2=0x7fbf081092a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:45.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.497+0000 7fbf0ea00640 1 --2- 172.21.15.69:0/2506745788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf08106e80 0x7fbf081092a0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fbef4009900 tx=0x7fbef402a410 comp rx=0 tx=0).stop 2024-05-14T15:21:45.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.497+0000 7fbf0ea00640 1 -- 172.21.15.69:0/2506745788 shutdown_connections 2024-05-14T15:21:45.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.497+0000 7fbf0ea00640 1 --2- 172.21.15.69:0/2506745788 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf081097e0 0x7fbf0810bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:45.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.497+0000 7fbf0ea00640 1 --2- 172.21.15.69:0/2506745788 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf08106e80 0x7fbf081092a0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:45.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.497+0000 7fbf0ea00640 1 --2- 172.21.15.69:0/2506745788 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf08104520 0x7fbf08106940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:45.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.497+0000 7fbf0ea00640 1 -- 172.21.15.69:0/2506745788 >> 172.21.15.69:0/2506745788 conn(0x7fbf080fdb20 msgr2=0x7fbf080fffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:45.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.497+0000 7fbf0ea00640 1 -- 172.21.15.69:0/2506745788 shutdown_connections 2024-05-14T15:21:45.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.497+0000 7fbf0ea00640 1 -- 172.21.15.69:0/2506745788 wait complete. 2024-05-14T15:21:45.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.498+0000 7fbf0ea00640 1 Processor -- start 2024-05-14T15:21:45.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.498+0000 7fbf0ea00640 1 -- start start 2024-05-14T15:21:45.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.499+0000 7fbf0ea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf08104520 0x7fbf0819c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:45.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.499+0000 7fbf0ea00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf08106e80 0x7fbf0819c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:45.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.499+0000 7fbf0ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf081097e0 0x7fbf081a37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:45.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.499+0000 7fbf0ea00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0810f410 con 0x7fbf081097e0 2024-05-14T15:21:45.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.499+0000 7fbf0ea00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0810f290 con 0x7fbf08106e80 2024-05-14T15:21:45.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.499+0000 7fbf0ea00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbf0810f590 con 0x7fbf08104520 2024-05-14T15:21:45.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.499+0000 7fbf0e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf081097e0 0x7fbf081a37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:45.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.499+0000 7fbf0cc00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf08106e80 0x7fbf0819c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:45.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.499+0000 7fbf0e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf081097e0 0x7fbf081a37b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52686/0 (socket says 172.21.15.69:52686) 2024-05-14T15:21:45.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.499+0000 7fbf0e000640 1 -- 172.21.15.69:0/3298462927 learned_addr learned my addr 172.21.15.69:0/3298462927 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:45.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.499+0000 7fbf0d600640 1 --2- 172.21.15.69:0/3298462927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf08104520 0x7fbf0819c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:45.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.500+0000 7fbf0e000640 1 -- 172.21.15.69:0/3298462927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf08104520 msgr2=0x7fbf0819c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:45.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.500+0000 7fbf0e000640 1 --2- 172.21.15.69:0/3298462927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf08104520 0x7fbf0819c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:45.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.500+0000 7fbf0e000640 1 -- 172.21.15.69:0/3298462927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf08106e80 msgr2=0x7fbf0819c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:45.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.500+0000 7fbf0e000640 1 --2- 172.21.15.69:0/3298462927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf08106e80 0x7fbf0819c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:45.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.500+0000 7fbf0e000640 1 -- 172.21.15.69:0/3298462927 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf081a3e20 con 0x7fbf081097e0 2024-05-14T15:21:45.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.500+0000 7fbf0cc00640 1 --2- 172.21.15.69:0/3298462927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf08106e80 0x7fbf0819c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:21:45.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.500+0000 7fbf0e000640 1 --2- 172.21.15.69:0/3298462927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf081097e0 0x7fbf081a37b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000eb40 tx=0x7fbf0000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:45.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.500+0000 7fbf06000640 1 -- 172.21.15.69:0/3298462927 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00004b20 con 0x7fbf081097e0 2024-05-14T15:21:45.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.501+0000 7fbf06000640 1 -- 172.21.15.69:0/3298462927 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf00004cc0 con 0x7fbf081097e0 2024-05-14T15:21:45.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.501+0000 7fbf06000640 1 -- 172.21.15.69:0/3298462927 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf00010690 con 0x7fbf081097e0 2024-05-14T15:21:45.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.501+0000 7fbf0ea00640 1 -- 172.21.15.69:0/3298462927 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf081a4110 con 0x7fbf081097e0 2024-05-14T15:21:45.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.501+0000 7fbf0ea00640 1 -- 172.21.15.69:0/3298462927 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf081a4610 con 0x7fbf081097e0 2024-05-14T15:21:45.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.502+0000 7fbf0ea00640 1 -- 172.21.15.69:0/3298462927 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf081a48d0 con 0x7fbf081097e0 2024-05-14T15:21:45.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.505+0000 7fbf06000640 1 -- 172.21.15.69:0/3298462927 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 149828+0+0 (secure 0 0 0) 0x7fbf00005540 con 0x7fbf081097e0 2024-05-14T15:21:45.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.506+0000 7fbf06000640 1 --2- 172.21.15.69:0/3298462927 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbef00b2a60 0x7fbef00b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:45.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.507+0000 7fbf06000640 1 -- 172.21.15.69:0/3298462927 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fbf000e3310 con 0x7fbf081097e0 2024-05-14T15:21:45.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.507+0000 7fbf0d600640 1 --2- 172.21.15.69:0/3298462927 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbef00b2a60 0x7fbef00b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:45.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.508+0000 7fbf0d600640 1 --2- 172.21.15.69:0/3298462927 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbef00b2a60 0x7fbef00b4f70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbf0806a9e0 tx=0x7fbefc005f90 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:45.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.511+0000 7fbf06000640 1 -- 172.21.15.69:0/3298462927 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fbf000aa770 con 0x7fbf081097e0 2024-05-14T15:21:45.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:45 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi092 to 176.4M 2024-05-14T15:21:45.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:45 smithi203 ceph-mon[34567]: Unable to set osd_memory_target on smithi092 to 185061273: error parsing value: Value '185061273' is below minimum 939524096 2024-05-14T15:21:45.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:45 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi203 to 176.4M 2024-05-14T15:21:45.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:45 smithi203 ceph-mon[34567]: Unable to set osd_memory_target on smithi203 to 185036185: error parsing value: Value '185036185' is below minimum 939524096 2024-05-14T15:21:45.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:45 smithi203 ceph-mon[34567]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:21:45.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:45 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:45.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:45 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:45.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:45 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:45.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:45 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:45.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:45 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:45.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:45 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:45.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:45 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:45.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:45 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:45.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:45 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi092 to 176.4M 2024-05-14T15:21:45.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:45 smithi092 ceph-mon[34729]: Unable to set osd_memory_target on smithi092 to 185061273: error parsing value: Value '185061273' is below minimum 939524096 2024-05-14T15:21:45.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:45 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi203 to 176.4M 2024-05-14T15:21:45.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:45 smithi092 ceph-mon[34729]: Unable to set osd_memory_target on smithi203 to 185036185: error parsing value: Value '185036185' is below minimum 939524096 2024-05-14T15:21:45.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:45 smithi092 ceph-mon[34729]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail 2024-05-14T15:21:45.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:45 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:45.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:45 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:45.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:45 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:45.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:45 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:45.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:45 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:45.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:45 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:21:45.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:45 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:45.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:45 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:45.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.721+0000 7fbf0ea00640 1 -- 172.21.15.69:0/3298462927 --> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbf08102740 con 0x7fbef00b2a60 2024-05-14T15:21:45.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.732+0000 7fbf06000640 1 -- 172.21.15.69:0/3298462927 <== mgr.34991 v2:172.21.15.69:6800/1271399048 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339517 (secure 0 0 0) 0x7fbf08102740 con 0x7fbef00b2a60 2024-05-14T15:21:45.739 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:21:45.741 INFO:teuthology.orchestra.run.smithi069.stderr:dumped all 2024-05-14T15:21:45.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.736+0000 7fbf0ea00640 1 -- 172.21.15.69:0/3298462927 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbef00b2a60 msgr2=0x7fbef00b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:45.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.736+0000 7fbf0ea00640 1 --2- 172.21.15.69:0/3298462927 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbef00b2a60 0x7fbef00b4f70 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fbf0806a9e0 tx=0x7fbefc005f90 comp rx=0 tx=0).stop 2024-05-14T15:21:45.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.736+0000 7fbf0ea00640 1 -- 172.21.15.69:0/3298462927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf081097e0 msgr2=0x7fbf081a37b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:45.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.736+0000 7fbf0ea00640 1 --2- 172.21.15.69:0/3298462927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf081097e0 0x7fbf081a37b0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fbf0000eb40 tx=0x7fbf0000c2d0 comp rx=0 tx=0).stop 2024-05-14T15:21:45.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.736+0000 7fbf0ea00640 1 -- 172.21.15.69:0/3298462927 shutdown_connections 2024-05-14T15:21:45.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.736+0000 7fbf0ea00640 1 --2- 172.21.15.69:0/3298462927 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbef00b2a60 0x7fbef00b4f70 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:45.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.736+0000 7fbf0ea00640 1 --2- 172.21.15.69:0/3298462927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf081097e0 0x7fbf081a37b0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:45.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.736+0000 7fbf0ea00640 1 --2- 172.21.15.69:0/3298462927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf08106e80 0x7fbf0819c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:45.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.736+0000 7fbf0ea00640 1 --2- 172.21.15.69:0/3298462927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf08104520 0x7fbf0819c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:45.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.736+0000 7fbf0ea00640 1 -- 172.21.15.69:0/3298462927 >> 172.21.15.69:0/3298462927 conn(0x7fbf080fdb20 msgr2=0x7fbf08102030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:45.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.737+0000 7fbf0ea00640 1 -- 172.21.15.69:0/3298462927 shutdown_connections 2024-05-14T15:21:45.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:45.737+0000 7fbf0ea00640 1 -- 172.21.15.69:0/3298462927 wait complete. 2024-05-14T15:21:45.760 INFO:teuthology.orchestra.run.smithi069.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-05-14T15:21:43.833225+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1199743,"num_objects":104,"num_object_clones":0,"num_object_copies":314,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":2628,"num_read_kb":1466,"num_write":522,"num_write_kb":3641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":916,"ondisk_log_size":916,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":385624,"kb_used_data":15632,"kb_used_omap":18,"kb_used_meta":369837,"kb_avail":1124556200,"statfs":{"total":1151940427776,"available":1151545548800,"internally_reserved":0,"allocated":16007168,"data_stored":9330852,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":378713401},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.984569"},"pg_stats":[{"pgid":"3.3f","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.157290+0000","last_change":"2024-05-14T15:16:08.799448+0000","last_active":"2024-05-14T15:21:38.157290+0000","last_peered":"2024-05-14T15:21:38.157290+0000","last_clean":"2024-05-14T15:21:38.157290+0000","last_became_active":"2024-05-14T15:16:08.799025+0000","last_became_peered":"2024-05-14T15:16:08.799025+0000","last_unstale":"2024-05-14T15:21:38.157290+0000","last_undegraded":"2024-05-14T15:21:38.157290+0000","last_fullsized":"2024-05-14T15:21:38.157290+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:25:56.645123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"91'4","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154838+0000","last_change":"2024-05-14T15:16:08.796943+0000","last_active":"2024-05-14T15:21:38.154838+0000","last_peered":"2024-05-14T15:21:38.154838+0000","last_clean":"2024-05-14T15:21:38.154838+0000","last_became_active":"2024-05-14T15:16:08.796044+0000","last_became_peered":"2024-05-14T15:16:08.796044+0000","last_unstale":"2024-05-14T15:21:38.154838+0000","last_undegraded":"2024-05-14T15:21:38.154838+0000","last_fullsized":"2024-05-14T15:21:38.154838+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:26:22.103727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153707+0000","last_change":"2024-05-14T15:16:08.794020+0000","last_active":"2024-05-14T15:21:38.153707+0000","last_peered":"2024-05-14T15:21:38.153707+0000","last_clean":"2024-05-14T15:21:38.153707+0000","last_became_active":"2024-05-14T15:16:08.793677+0000","last_became_peered":"2024-05-14T15:16:08.793677+0000","last_unstale":"2024-05-14T15:21:38.153707+0000","last_undegraded":"2024-05-14T15:21:38.153707+0000","last_fullsized":"2024-05-14T15:21:38.153707+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:41.615815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.805580+0000","last_change":"2024-05-14T15:16:08.787482+0000","last_active":"2024-05-14T15:21:37.805580+0000","last_peered":"2024-05-14T15:21:37.805580+0000","last_clean":"2024-05-14T15:21:37.805580+0000","last_became_active":"2024-05-14T15:16:08.787087+0000","last_became_peered":"2024-05-14T15:16:08.787087+0000","last_unstale":"2024-05-14T15:21:37.805580+0000","last_undegraded":"2024-05-14T15:21:37.805580+0000","last_fullsized":"2024-05-14T15:21:37.805580+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:18:51.433751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"91'4","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804789+0000","last_change":"2024-05-14T15:16:08.785982+0000","last_active":"2024-05-14T15:21:37.804789+0000","last_peered":"2024-05-14T15:21:37.804789+0000","last_clean":"2024-05-14T15:21:37.804789+0000","last_became_active":"2024-05-14T15:16:08.784980+0000","last_became_peered":"2024-05-14T15:16:08.784980+0000","last_unstale":"2024-05-14T15:21:37.804789+0000","last_undegraded":"2024-05-14T15:21:37.804789+0000","last_fullsized":"2024-05-14T15:21:37.804789+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:07:50.390637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.983083+0000","last_change":"2024-05-14T15:16:08.784622+0000","last_active":"2024-05-14T15:21:37.983083+0000","last_peered":"2024-05-14T15:21:37.983083+0000","last_clean":"2024-05-14T15:21:37.983083+0000","last_became_active":"2024-05-14T15:16:08.784206+0000","last_became_peered":"2024-05-14T15:16:08.784206+0000","last_unstale":"2024-05-14T15:21:37.983083+0000","last_undegraded":"2024-05-14T15:21:37.983083+0000","last_fullsized":"2024-05-14T15:21:37.983083+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:40:56.578935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.080463+0000","last_change":"2024-05-14T15:16:08.786381+0000","last_active":"2024-05-14T15:21:38.080463+0000","last_peered":"2024-05-14T15:21:38.080463+0000","last_clean":"2024-05-14T15:21:38.080463+0000","last_became_active":"2024-05-14T15:16:08.781231+0000","last_became_peered":"2024-05-14T15:16:08.781231+0000","last_unstale":"2024-05-14T15:21:38.080463+0000","last_undegraded":"2024-05-14T15:21:38.080463+0000","last_fullsized":"2024-05-14T15:21:38.080463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:51:16.961187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"91'9","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.960967+0000","last_change":"2024-05-14T15:17:43.850244+0000","last_active":"2024-05-14T15:21:37.960967+0000","last_peered":"2024-05-14T15:21:37.960967+0000","last_clean":"2024-05-14T15:21:37.960967+0000","last_became_active":"2024-05-14T15:17:43.849671+0000","last_became_peered":"2024-05-14T15:17:43.849671+0000","last_unstale":"2024-05-14T15:21:37.960967+0000","last_undegraded":"2024-05-14T15:21:37.960967+0000","last_fullsized":"2024-05-14T15:21:37.960967+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:21:05.537250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,10],"acting":[3,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"91'11","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155626+0000","last_change":"2024-05-14T15:16:08.785644+0000","last_active":"2024-05-14T15:21:38.155626+0000","last_peered":"2024-05-14T15:21:38.155626+0000","last_clean":"2024-05-14T15:21:38.155626+0000","last_became_active":"2024-05-14T15:16:08.785224+0000","last_became_peered":"2024-05-14T15:16:08.785224+0000","last_unstale":"2024-05-14T15:21:38.155626+0000","last_undegraded":"2024-05-14T15:21:38.155626+0000","last_fullsized":"2024-05-14T15:21:38.155626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:05:10.868610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"91'16","reported_seq":58,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.984158+0000","last_change":"2024-05-14T15:16:08.784425+0000","last_active":"2024-05-14T15:21:37.984158+0000","last_peered":"2024-05-14T15:21:37.984158+0000","last_clean":"2024-05-14T15:21:37.984158+0000","last_became_active":"2024-05-14T15:16:08.782889+0000","last_became_peered":"2024-05-14T15:16:08.782889+0000","last_unstale":"2024-05-14T15:21:37.984158+0000","last_undegraded":"2024-05-14T15:21:37.984158+0000","last_fullsized":"2024-05-14T15:21:37.984158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:40:11.043101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082375+0000","last_change":"2024-05-14T15:16:08.782675+0000","last_active":"2024-05-14T15:21:38.082375+0000","last_peered":"2024-05-14T15:21:38.082375+0000","last_clean":"2024-05-14T15:21:38.082375+0000","last_became_active":"2024-05-14T15:16:08.781994+0000","last_became_peered":"2024-05-14T15:16:08.781994+0000","last_unstale":"2024-05-14T15:21:38.082375+0000","last_undegraded":"2024-05-14T15:21:38.082375+0000","last_fullsized":"2024-05-14T15:21:38.082375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:00:59.625493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.805442+0000","last_change":"2024-05-14T15:16:08.785655+0000","last_active":"2024-05-14T15:21:37.805442+0000","last_peered":"2024-05-14T15:21:37.805442+0000","last_clean":"2024-05-14T15:21:37.805442+0000","last_became_active":"2024-05-14T15:16:08.785273+0000","last_became_peered":"2024-05-14T15:16:08.785273+0000","last_unstale":"2024-05-14T15:21:37.805442+0000","last_undegraded":"2024-05-14T15:21:37.805442+0000","last_fullsized":"2024-05-14T15:21:37.805442+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:11:51.971909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"91'10","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145068+0000","last_change":"2024-05-14T15:16:08.775558+0000","last_active":"2024-05-14T15:21:38.145068+0000","last_peered":"2024-05-14T15:21:38.145068+0000","last_clean":"2024-05-14T15:21:38.145068+0000","last_became_active":"2024-05-14T15:16:08.773465+0000","last_became_peered":"2024-05-14T15:16:08.773465+0000","last_unstale":"2024-05-14T15:21:38.145068+0000","last_undegraded":"2024-05-14T15:21:38.145068+0000","last_fullsized":"2024-05-14T15:21:38.145068+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:16:17.151374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153837+0000","last_change":"2024-05-14T15:16:08.786160+0000","last_active":"2024-05-14T15:21:38.153837+0000","last_peered":"2024-05-14T15:21:38.153837+0000","last_clean":"2024-05-14T15:21:38.153837+0000","last_became_active":"2024-05-14T15:16:08.781257+0000","last_became_peered":"2024-05-14T15:16:08.781257+0000","last_unstale":"2024-05-14T15:21:38.153837+0000","last_undegraded":"2024-05-14T15:21:38.153837+0000","last_fullsized":"2024-05-14T15:21:38.153837+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:13:03.974692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"91'7","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153600+0000","last_change":"2024-05-14T15:16:43.014673+0000","last_active":"2024-05-14T15:21:38.153600+0000","last_peered":"2024-05-14T15:21:38.153600+0000","last_clean":"2024-05-14T15:21:38.153600+0000","last_became_active":"2024-05-14T15:16:43.013718+0000","last_became_peered":"2024-05-14T15:16:43.013718+0000","last_unstale":"2024-05-14T15:21:38.153600+0000","last_undegraded":"2024-05-14T15:21:38.153600+0000","last_fullsized":"2024-05-14T15:21:38.153600+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:08:42.885151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,2],"acting":[0,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153490+0000","last_change":"2024-05-14T15:16:08.784437+0000","last_active":"2024-05-14T15:21:38.153490+0000","last_peered":"2024-05-14T15:21:38.153490+0000","last_clean":"2024-05-14T15:21:38.153490+0000","last_became_active":"2024-05-14T15:16:08.784030+0000","last_became_peered":"2024-05-14T15:16:08.784030+0000","last_unstale":"2024-05-14T15:21:38.153490+0000","last_undegraded":"2024-05-14T15:21:38.153490+0000","last_fullsized":"2024-05-14T15:21:38.153490+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:57:43.025679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.156811+0000","last_change":"2024-05-14T15:16:08.798419+0000","last_active":"2024-05-14T15:21:38.156811+0000","last_peered":"2024-05-14T15:21:38.156811+0000","last_clean":"2024-05-14T15:21:38.156811+0000","last_became_active":"2024-05-14T15:16:08.798066+0000","last_became_peered":"2024-05-14T15:16:08.798066+0000","last_unstale":"2024-05-14T15:21:38.156811+0000","last_undegraded":"2024-05-14T15:21:38.156811+0000","last_fullsized":"2024-05-14T15:21:38.156811+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:55:29.921745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"91'10","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.798694+0000","last_change":"2024-05-14T15:16:08.780638+0000","last_active":"2024-05-14T15:21:37.798694+0000","last_peered":"2024-05-14T15:21:37.798694+0000","last_clean":"2024-05-14T15:21:37.798694+0000","last_became_active":"2024-05-14T15:16:08.778675+0000","last_became_peered":"2024-05-14T15:16:08.778675+0000","last_unstale":"2024-05-14T15:21:37.798694+0000","last_undegraded":"2024-05-14T15:21:37.798694+0000","last_fullsized":"2024-05-14T15:21:37.798694+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:01:29.780036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146810+0000","last_change":"2024-05-14T15:16:08.791729+0000","last_active":"2024-05-14T15:21:38.146810+0000","last_peered":"2024-05-14T15:21:38.146810+0000","last_clean":"2024-05-14T15:21:38.146810+0000","last_became_active":"2024-05-14T15:16:08.791367+0000","last_became_peered":"2024-05-14T15:16:08.791367+0000","last_unstale":"2024-05-14T15:21:38.146810+0000","last_undegraded":"2024-05-14T15:21:38.146810+0000","last_fullsized":"2024-05-14T15:21:38.146810+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:03:00.148744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145875+0000","last_change":"2024-05-14T15:16:22.909315+0000","last_active":"2024-05-14T15:21:38.145875+0000","last_peered":"2024-05-14T15:21:38.145875+0000","last_clean":"2024-05-14T15:21:38.145875+0000","last_became_active":"2024-05-14T15:16:22.908846+0000","last_became_peered":"2024-05-14T15:16:22.908846+0000","last_unstale":"2024-05-14T15:21:38.145875+0000","last_undegraded":"2024-05-14T15:21:38.145875+0000","last_fullsized":"2024-05-14T15:21:38.145875+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:20:50.338711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1f","version":"91'15","reported_seq":304,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.797488+0000","last_change":"2024-05-14T15:16:03.729599+0000","last_active":"2024-05-14T15:21:37.797488+0000","last_peered":"2024-05-14T15:21:37.797488+0000","last_clean":"2024-05-14T15:21:37.797488+0000","last_became_active":"2024-05-14T15:16:03.728659+0000","last_became_peered":"2024-05-14T15:16:03.728659+0000","last_unstale":"2024-05-14T15:21:37.797488+0000","last_undegraded":"2024-05-14T15:21:37.797488+0000","last_fullsized":"2024-05-14T15:21:37.797488+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:54:18.989059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":16,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961610+0000","last_change":"2024-05-14T15:16:08.790296+0000","last_active":"2024-05-14T15:21:37.961610+0000","last_peered":"2024-05-14T15:21:37.961610+0000","last_clean":"2024-05-14T15:21:37.961610+0000","last_became_active":"2024-05-14T15:16:08.789899+0000","last_became_peered":"2024-05-14T15:16:08.789899+0000","last_unstale":"2024-05-14T15:21:37.961610+0000","last_undegraded":"2024-05-14T15:21:37.961610+0000","last_fullsized":"2024-05-14T15:21:37.961610+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:23:15.626580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.803102+0000","last_change":"2024-05-14T15:16:22.904857+0000","last_active":"2024-05-14T15:21:37.803102+0000","last_peered":"2024-05-14T15:21:37.803102+0000","last_clean":"2024-05-14T15:21:37.803102+0000","last_became_active":"2024-05-14T15:16:22.903747+0000","last_became_peered":"2024-05-14T15:16:22.903747+0000","last_unstale":"2024-05-14T15:21:37.803102+0000","last_undegraded":"2024-05-14T15:21:37.803102+0000","last_fullsized":"2024-05-14T15:21:37.803102+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:58:27.937637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1e","version":"89'2","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.962192+0000","last_change":"2024-05-14T15:16:03.840248+0000","last_active":"2024-05-14T15:21:37.962192+0000","last_peered":"2024-05-14T15:21:37.962192+0000","last_clean":"2024-05-14T15:21:37.962192+0000","last_became_active":"2024-05-14T15:16:03.839731+0000","last_became_peered":"2024-05-14T15:16:03.839731+0000","last_unstale":"2024-05-14T15:21:37.962192+0000","last_undegraded":"2024-05-14T15:21:37.962192+0000","last_fullsized":"2024-05-14T15:21:37.962192+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:31:25.981757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.156094+0000","last_change":"2024-05-14T15:16:08.791233+0000","last_active":"2024-05-14T15:21:38.156094+0000","last_peered":"2024-05-14T15:21:38.156094+0000","last_clean":"2024-05-14T15:21:38.156094+0000","last_became_active":"2024-05-14T15:16:08.790376+0000","last_became_peered":"2024-05-14T15:16:08.790376+0000","last_unstale":"2024-05-14T15:21:38.156094+0000","last_undegraded":"2024-05-14T15:21:38.156094+0000","last_fullsized":"2024-05-14T15:21:38.156094+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:17:35.203663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804053+0000","last_change":"2024-05-14T15:16:22.906435+0000","last_active":"2024-05-14T15:21:37.804053+0000","last_peered":"2024-05-14T15:21:37.804053+0000","last_clean":"2024-05-14T15:21:37.804053+0000","last_became_active":"2024-05-14T15:16:22.905558+0000","last_became_peered":"2024-05-14T15:16:22.905558+0000","last_unstale":"2024-05-14T15:21:37.804053+0000","last_undegraded":"2024-05-14T15:21:37.804053+0000","last_fullsized":"2024-05-14T15:21:37.804053+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:43:15.748904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"89'12","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155943+0000","last_change":"2024-05-14T15:16:43.026454+0000","last_active":"2024-05-14T15:21:38.155943+0000","last_peered":"2024-05-14T15:21:38.155943+0000","last_clean":"2024-05-14T15:21:38.155943+0000","last_became_active":"2024-05-14T15:16:43.019742+0000","last_became_peered":"2024-05-14T15:16:43.019742+0000","last_unstale":"2024-05-14T15:21:38.155943+0000","last_undegraded":"2024-05-14T15:21:38.155943+0000","last_fullsized":"2024-05-14T15:21:38.155943+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:38:38.323233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154348+0000","last_change":"2024-05-14T15:16:08.774669+0000","last_active":"2024-05-14T15:21:38.154348+0000","last_peered":"2024-05-14T15:21:38.154348+0000","last_clean":"2024-05-14T15:21:38.154348+0000","last_became_active":"2024-05-14T15:16:08.773996+0000","last_became_peered":"2024-05-14T15:16:08.773996+0000","last_unstale":"2024-05-14T15:21:38.154348+0000","last_undegraded":"2024-05-14T15:21:38.154348+0000","last_fullsized":"2024-05-14T15:21:38.154348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:21:58.199462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.803377+0000","last_change":"2024-05-14T15:16:43.065743+0000","last_active":"2024-05-14T15:21:37.803377+0000","last_peered":"2024-05-14T15:21:37.803377+0000","last_clean":"2024-05-14T15:21:37.803377+0000","last_became_active":"2024-05-14T15:16:43.064426+0000","last_became_peered":"2024-05-14T15:16:43.064426+0000","last_unstale":"2024-05-14T15:21:37.803377+0000","last_undegraded":"2024-05-14T15:21:37.803377+0000","last_fullsized":"2024-05-14T15:21:37.803377+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:15:44.230694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,8,3],"acting":[4,6,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"89'5","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804621+0000","last_change":"2024-05-14T15:16:03.732142+0000","last_active":"2024-05-14T15:21:37.804621+0000","last_peered":"2024-05-14T15:21:37.804621+0000","last_clean":"2024-05-14T15:21:37.804621+0000","last_became_active":"2024-05-14T15:16:03.731590+0000","last_became_peered":"2024-05-14T15:16:03.731590+0000","last_unstale":"2024-05-14T15:21:37.804621+0000","last_undegraded":"2024-05-14T15:21:37.804621+0000","last_fullsized":"2024-05-14T15:21:37.804621+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:05:23.760541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"91'15","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.975058+0000","last_change":"2024-05-14T15:16:08.780895+0000","last_active":"2024-05-14T15:21:37.975058+0000","last_peered":"2024-05-14T15:21:37.975058+0000","last_clean":"2024-05-14T15:21:37.975058+0000","last_became_active":"2024-05-14T15:16:08.780472+0000","last_became_peered":"2024-05-14T15:16:08.780472+0000","last_unstale":"2024-05-14T15:21:37.975058+0000","last_undegraded":"2024-05-14T15:21:37.975058+0000","last_fullsized":"2024-05-14T15:21:37.975058+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:49.508043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146184+0000","last_change":"2024-05-14T15:16:22.915997+0000","last_active":"2024-05-14T15:21:38.146184+0000","last_peered":"2024-05-14T15:21:38.146184+0000","last_clean":"2024-05-14T15:21:38.146184+0000","last_became_active":"2024-05-14T15:16:22.915466+0000","last_became_peered":"2024-05-14T15:16:22.915466+0000","last_unstale":"2024-05-14T15:21:38.146184+0000","last_undegraded":"2024-05-14T15:21:38.146184+0000","last_fullsized":"2024-05-14T15:21:38.146184+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:50:39.748860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"92'10","reported_seq":303,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.409493+0000","last_change":"2024-05-14T15:16:03.733796+0000","last_active":"2024-05-14T15:21:38.409493+0000","last_peered":"2024-05-14T15:21:38.409493+0000","last_clean":"2024-05-14T15:21:38.409493+0000","last_became_active":"2024-05-14T15:16:03.732467+0000","last_became_peered":"2024-05-14T15:16:03.732467+0000","last_unstale":"2024-05-14T15:21:38.409493+0000","last_undegraded":"2024-05-14T15:21:38.409493+0000","last_fullsized":"2024-05-14T15:21:38.409493+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:02:28.388120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2413,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":245,"num_read_kb":5,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804145+0000","last_change":"2024-05-14T15:16:08.793287+0000","last_active":"2024-05-14T15:21:37.804145+0000","last_peered":"2024-05-14T15:21:37.804145+0000","last_clean":"2024-05-14T15:21:37.804145+0000","last_became_active":"2024-05-14T15:16:08.791173+0000","last_became_peered":"2024-05-14T15:16:08.791173+0000","last_unstale":"2024-05-14T15:21:37.804145+0000","last_undegraded":"2024-05-14T15:21:37.804145+0000","last_fullsized":"2024-05-14T15:21:37.804145+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:24:49.644251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145909+0000","last_change":"2024-05-14T15:16:22.914734+0000","last_active":"2024-05-14T15:21:38.145909+0000","last_peered":"2024-05-14T15:21:38.145909+0000","last_clean":"2024-05-14T15:21:38.145909+0000","last_became_active":"2024-05-14T15:16:22.914267+0000","last_became_peered":"2024-05-14T15:16:22.914267+0000","last_unstale":"2024-05-14T15:21:38.145909+0000","last_undegraded":"2024-05-14T15:21:38.145909+0000","last_fullsized":"2024-05-14T15:21:38.145909+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:04:50.809564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,9,5],"acting":[2,6,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1a","version":"89'7","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.983167+0000","last_change":"2024-05-14T15:16:03.729217+0000","last_active":"2024-05-14T15:21:37.983167+0000","last_peered":"2024-05-14T15:21:37.983167+0000","last_clean":"2024-05-14T15:21:37.983167+0000","last_became_active":"2024-05-14T15:16:03.727453+0000","last_became_peered":"2024-05-14T15:16:03.727453+0000","last_unstale":"2024-05-14T15:21:37.983167+0000","last_undegraded":"2024-05-14T15:21:37.983167+0000","last_fullsized":"2024-05-14T15:21:37.983167+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:40:27.820618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974866+0000","last_change":"2024-05-14T15:16:08.783861+0000","last_active":"2024-05-14T15:21:37.974866+0000","last_peered":"2024-05-14T15:21:37.974866+0000","last_clean":"2024-05-14T15:21:37.974866+0000","last_became_active":"2024-05-14T15:16:08.782986+0000","last_became_peered":"2024-05-14T15:16:08.782986+0000","last_unstale":"2024-05-14T15:21:37.974866+0000","last_undegraded":"2024-05-14T15:21:37.974866+0000","last_fullsized":"2024-05-14T15:21:37.974866+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:58:52.453137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.156781+0000","last_change":"2024-05-14T15:16:22.912295+0000","last_active":"2024-05-14T15:21:38.156781+0000","last_peered":"2024-05-14T15:21:38.156781+0000","last_clean":"2024-05-14T15:21:38.156781+0000","last_became_active":"2024-05-14T15:16:22.911779+0000","last_became_peered":"2024-05-14T15:16:22.911779+0000","last_unstale":"2024-05-14T15:21:38.156781+0000","last_undegraded":"2024-05-14T15:21:38.156781+0000","last_fullsized":"2024-05-14T15:21:38.156781+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:47:45.153619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,9,0],"acting":[11,4,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.19","version":"89'3","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.144215+0000","last_change":"2024-05-14T15:16:03.729590+0000","last_active":"2024-05-14T15:21:38.144215+0000","last_peered":"2024-05-14T15:21:38.144215+0000","last_clean":"2024-05-14T15:21:38.144215+0000","last_became_active":"2024-05-14T15:16:03.727790+0000","last_became_peered":"2024-05-14T15:16:03.727790+0000","last_unstale":"2024-05-14T15:21:38.144215+0000","last_undegraded":"2024-05-14T15:21:38.144215+0000","last_fullsized":"2024-05-14T15:21:38.144215+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:13:31.960505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.960865+0000","last_change":"2024-05-14T15:16:08.789872+0000","last_active":"2024-05-14T15:21:37.960865+0000","last_peered":"2024-05-14T15:21:37.960865+0000","last_clean":"2024-05-14T15:21:37.960865+0000","last_became_active":"2024-05-14T15:16:08.786817+0000","last_became_peered":"2024-05-14T15:16:08.786817+0000","last_unstale":"2024-05-14T15:21:37.960865+0000","last_undegraded":"2024-05-14T15:21:37.960865+0000","last_fullsized":"2024-05-14T15:21:37.960865+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:09:41.042473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153854+0000","last_change":"2024-05-14T15:16:22.903302+0000","last_active":"2024-05-14T15:21:38.153854+0000","last_peered":"2024-05-14T15:21:38.153854+0000","last_clean":"2024-05-14T15:21:38.153854+0000","last_became_active":"2024-05-14T15:16:22.902830+0000","last_became_peered":"2024-05-14T15:16:22.902830+0000","last_unstale":"2024-05-14T15:21:38.153854+0000","last_undegraded":"2024-05-14T15:21:38.153854+0000","last_fullsized":"2024-05-14T15:21:38.153854+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:18:57.467319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.18","version":"89'3","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974037+0000","last_change":"2024-05-14T15:16:03.738372+0000","last_active":"2024-05-14T15:21:37.974037+0000","last_peered":"2024-05-14T15:21:37.974037+0000","last_clean":"2024-05-14T15:21:37.974037+0000","last_became_active":"2024-05-14T15:16:03.737815+0000","last_became_peered":"2024-05-14T15:16:03.737815+0000","last_unstale":"2024-05-14T15:21:37.974037+0000","last_undegraded":"2024-05-14T15:21:37.974037+0000","last_fullsized":"2024-05-14T15:21:37.974037+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:19:19.702318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"91'11","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.796832+0000","last_change":"2024-05-14T15:16:08.781979+0000","last_active":"2024-05-14T15:21:37.796832+0000","last_peered":"2024-05-14T15:21:37.796832+0000","last_clean":"2024-05-14T15:21:37.796832+0000","last_became_active":"2024-05-14T15:16:08.777257+0000","last_became_peered":"2024-05-14T15:16:08.777257+0000","last_unstale":"2024-05-14T15:21:37.796832+0000","last_undegraded":"2024-05-14T15:21:37.796832+0000","last_fullsized":"2024-05-14T15:21:37.796832+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:54:31.154921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961089+0000","last_change":"2024-05-14T15:16:22.901107+0000","last_active":"2024-05-14T15:21:37.961089+0000","last_peered":"2024-05-14T15:21:37.961089+0000","last_clean":"2024-05-14T15:21:37.961089+0000","last_became_active":"2024-05-14T15:16:22.900578+0000","last_became_peered":"2024-05-14T15:16:22.900578+0000","last_unstale":"2024-05-14T15:21:37.961089+0000","last_undegraded":"2024-05-14T15:21:37.961089+0000","last_fullsized":"2024-05-14T15:21:37.961089+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:11:23.019455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.17","version":"91'8","reported_seq":536,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.140068+0000","last_change":"2024-05-14T15:16:03.730145+0000","last_active":"2024-05-14T15:21:38.140068+0000","last_peered":"2024-05-14T15:21:38.140068+0000","last_clean":"2024-05-14T15:21:38.140068+0000","last_became_active":"2024-05-14T15:16:03.728119+0000","last_became_peered":"2024-05-14T15:16:03.728119+0000","last_unstale":"2024-05-14T15:21:38.140068+0000","last_undegraded":"2024-05-14T15:21:38.140068+0000","last_fullsized":"2024-05-14T15:21:38.140068+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:19:57.596282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":480,"num_read_kb":480,"num_write":9,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"91'10","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155528+0000","last_change":"2024-05-14T15:16:08.781834+0000","last_active":"2024-05-14T15:21:38.155528+0000","last_peered":"2024-05-14T15:21:38.155528+0000","last_clean":"2024-05-14T15:21:38.155528+0000","last_became_active":"2024-05-14T15:16:08.781451+0000","last_became_peered":"2024-05-14T15:16:08.781451+0000","last_unstale":"2024-05-14T15:21:38.155528+0000","last_undegraded":"2024-05-14T15:21:38.155528+0000","last_fullsized":"2024-05-14T15:21:38.155528+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:17:33.147475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.796785+0000","last_change":"2024-05-14T15:16:22.910711+0000","last_active":"2024-05-14T15:21:37.796785+0000","last_peered":"2024-05-14T15:21:37.796785+0000","last_clean":"2024-05-14T15:21:37.796785+0000","last_became_active":"2024-05-14T15:16:22.910076+0000","last_became_peered":"2024-05-14T15:16:22.910076+0000","last_unstale":"2024-05-14T15:21:37.796785+0000","last_undegraded":"2024-05-14T15:21:37.796785+0000","last_fullsized":"2024-05-14T15:21:37.796785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:11:05.867547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.16","version":"89'4","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082905+0000","last_change":"2024-05-14T15:16:03.736682+0000","last_active":"2024-05-14T15:21:38.082905+0000","last_peered":"2024-05-14T15:21:38.082905+0000","last_clean":"2024-05-14T15:21:38.082905+0000","last_became_active":"2024-05-14T15:16:03.733676+0000","last_became_peered":"2024-05-14T15:16:03.733676+0000","last_unstale":"2024-05-14T15:21:38.082905+0000","last_undegraded":"2024-05-14T15:21:38.082905+0000","last_fullsized":"2024-05-14T15:21:38.082905+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:12:12.814817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.156249+0000","last_change":"2024-05-14T15:16:08.797256+0000","last_active":"2024-05-14T15:21:38.156249+0000","last_peered":"2024-05-14T15:21:38.156249+0000","last_clean":"2024-05-14T15:21:38.156249+0000","last_became_active":"2024-05-14T15:16:08.796675+0000","last_became_peered":"2024-05-14T15:16:08.796675+0000","last_unstale":"2024-05-14T15:21:38.156249+0000","last_undegraded":"2024-05-14T15:21:38.156249+0000","last_fullsized":"2024-05-14T15:21:38.156249+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:36:08.026962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804368+0000","last_change":"2024-05-14T15:16:22.914775+0000","last_active":"2024-05-14T15:21:37.804368+0000","last_peered":"2024-05-14T15:21:37.804368+0000","last_clean":"2024-05-14T15:21:37.804368+0000","last_became_active":"2024-05-14T15:16:22.912853+0000","last_became_peered":"2024-05-14T15:16:22.912853+0000","last_unstale":"2024-05-14T15:21:37.804368+0000","last_undegraded":"2024-05-14T15:21:37.804368+0000","last_fullsized":"2024-05-14T15:21:37.804368+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:01:11.652074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"89'5","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974947+0000","last_change":"2024-05-14T15:16:03.845365+0000","last_active":"2024-05-14T15:21:37.974947+0000","last_peered":"2024-05-14T15:21:37.974947+0000","last_clean":"2024-05-14T15:21:37.974947+0000","last_became_active":"2024-05-14T15:16:03.842557+0000","last_became_peered":"2024-05-14T15:16:03.842557+0000","last_unstale":"2024-05-14T15:21:37.974947+0000","last_undegraded":"2024-05-14T15:21:37.974947+0000","last_fullsized":"2024-05-14T15:21:37.974947+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:26:21.515074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"91'11","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.798709+0000","last_change":"2024-05-14T15:17:43.855838+0000","last_active":"2024-05-14T15:21:37.798709+0000","last_peered":"2024-05-14T15:21:37.798709+0000","last_clean":"2024-05-14T15:21:37.798709+0000","last_became_active":"2024-05-14T15:17:43.855462+0000","last_became_peered":"2024-05-14T15:17:43.855462+0000","last_unstale":"2024-05-14T15:21:37.798709+0000","last_undegraded":"2024-05-14T15:21:37.798709+0000","last_fullsized":"2024-05-14T15:21:37.798709+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:56:06.442987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,4],"acting":[9,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.797106+0000","last_change":"2024-05-14T15:16:22.905266+0000","last_active":"2024-05-14T15:21:37.797106+0000","last_peered":"2024-05-14T15:21:37.797106+0000","last_clean":"2024-05-14T15:21:37.797106+0000","last_became_active":"2024-05-14T15:16:22.903397+0000","last_became_peered":"2024-05-14T15:16:22.903397+0000","last_unstale":"2024-05-14T15:21:37.797106+0000","last_undegraded":"2024-05-14T15:21:37.797106+0000","last_fullsized":"2024-05-14T15:21:37.797106+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:48:37.616028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.14","version":"92'44","reported_seq":585,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.418698+0000","last_change":"2024-05-14T15:16:03.735261+0000","last_active":"2024-05-14T15:21:38.418698+0000","last_peered":"2024-05-14T15:21:38.418698+0000","last_clean":"2024-05-14T15:21:38.418698+0000","last_became_active":"2024-05-14T15:16:03.732725+0000","last_became_peered":"2024-05-14T15:16:03.732725+0000","last_unstale":"2024-05-14T15:21:38.418698+0000","last_undegraded":"2024-05-14T15:21:38.418698+0000","last_fullsized":"2024-05-14T15:21:38.418698+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:44:51.777221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72303,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":493,"num_read_kb":316,"num_write":46,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804203+0000","last_change":"2024-05-14T15:16:08.783758+0000","last_active":"2024-05-14T15:21:37.804203+0000","last_peered":"2024-05-14T15:21:37.804203+0000","last_clean":"2024-05-14T15:21:37.804203+0000","last_became_active":"2024-05-14T15:16:08.782465+0000","last_became_peered":"2024-05-14T15:16:08.782465+0000","last_unstale":"2024-05-14T15:21:37.804203+0000","last_undegraded":"2024-05-14T15:21:37.804203+0000","last_fullsized":"2024-05-14T15:21:37.804203+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:37:36.921823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.975918+0000","last_change":"2024-05-14T15:16:22.899606+0000","last_active":"2024-05-14T15:21:37.975918+0000","last_peered":"2024-05-14T15:21:37.975918+0000","last_clean":"2024-05-14T15:21:37.975918+0000","last_became_active":"2024-05-14T15:16:22.898810+0000","last_became_peered":"2024-05-14T15:16:22.898810+0000","last_unstale":"2024-05-14T15:21:37.975918+0000","last_undegraded":"2024-05-14T15:21:37.975918+0000","last_fullsized":"2024-05-14T15:21:37.975918+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:49:07.068713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,8,3,6],"acting":[5,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.13","version":"89'9","reported_seq":59,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146824+0000","last_change":"2024-05-14T15:16:03.728561+0000","last_active":"2024-05-14T15:21:38.146824+0000","last_peered":"2024-05-14T15:21:38.146824+0000","last_clean":"2024-05-14T15:21:38.146824+0000","last_became_active":"2024-05-14T15:16:03.727273+0000","last_became_peered":"2024-05-14T15:16:03.727273+0000","last_unstale":"2024-05-14T15:21:38.146824+0000","last_undegraded":"2024-05-14T15:21:38.146824+0000","last_fullsized":"2024-05-14T15:21:38.146824+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:56:06.487549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.144601+0000","last_change":"2024-05-14T15:16:08.788199+0000","last_active":"2024-05-14T15:21:38.144601+0000","last_peered":"2024-05-14T15:21:38.144601+0000","last_clean":"2024-05-14T15:21:38.144601+0000","last_became_active":"2024-05-14T15:16:08.786477+0000","last_became_peered":"2024-05-14T15:16:08.786477+0000","last_unstale":"2024-05-14T15:21:38.144601+0000","last_undegraded":"2024-05-14T15:21:38.144601+0000","last_fullsized":"2024-05-14T15:21:38.144601+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:40:33.441154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155160+0000","last_change":"2024-05-14T15:16:22.911265+0000","last_active":"2024-05-14T15:21:38.155160+0000","last_peered":"2024-05-14T15:21:38.155160+0000","last_clean":"2024-05-14T15:21:38.155160+0000","last_became_active":"2024-05-14T15:16:22.910297+0000","last_became_peered":"2024-05-14T15:16:22.910297+0000","last_unstale":"2024-05-14T15:21:38.155160+0000","last_undegraded":"2024-05-14T15:21:38.155160+0000","last_fullsized":"2024-05-14T15:21:38.155160+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:43:37.894409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.12","version":"89'5","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974437+0000","last_change":"2024-05-14T15:16:03.735122+0000","last_active":"2024-05-14T15:21:37.974437+0000","last_peered":"2024-05-14T15:21:37.974437+0000","last_clean":"2024-05-14T15:21:37.974437+0000","last_became_active":"2024-05-14T15:16:03.734746+0000","last_became_peered":"2024-05-14T15:16:03.734746+0000","last_unstale":"2024-05-14T15:21:37.974437+0000","last_undegraded":"2024-05-14T15:21:37.974437+0000","last_fullsized":"2024-05-14T15:21:37.974437+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:36:48.070577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"91'15","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.081278+0000","last_change":"2024-05-14T15:16:08.791427+0000","last_active":"2024-05-14T15:21:38.081278+0000","last_peered":"2024-05-14T15:21:38.081278+0000","last_clean":"2024-05-14T15:21:38.081278+0000","last_became_active":"2024-05-14T15:16:08.791070+0000","last_became_peered":"2024-05-14T15:16:08.791070+0000","last_unstale":"2024-05-14T15:21:38.081278+0000","last_undegraded":"2024-05-14T15:21:38.081278+0000","last_fullsized":"2024-05-14T15:21:38.081278+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:15:13.153055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.796785+0000","last_change":"2024-05-14T15:16:22.896084+0000","last_active":"2024-05-14T15:21:37.796785+0000","last_peered":"2024-05-14T15:21:37.796785+0000","last_clean":"2024-05-14T15:21:37.796785+0000","last_became_active":"2024-05-14T15:16:22.894473+0000","last_became_peered":"2024-05-14T15:16:22.894473+0000","last_unstale":"2024-05-14T15:21:37.796785+0000","last_undegraded":"2024-05-14T15:21:37.796785+0000","last_fullsized":"2024-05-14T15:21:37.796785+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:18:18.844423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.11","version":"92'9","reported_seq":302,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.147663+0000","last_change":"2024-05-14T15:16:03.728070+0000","last_active":"2024-05-14T15:21:38.147663+0000","last_peered":"2024-05-14T15:21:38.147663+0000","last_clean":"2024-05-14T15:21:38.147663+0000","last_became_active":"2024-05-14T15:16:03.726155+0000","last_became_peered":"2024-05-14T15:16:03.726155+0000","last_unstale":"2024-05-14T15:21:38.147663+0000","last_undegraded":"2024-05-14T15:21:38.147663+0000","last_fullsized":"2024-05-14T15:21:38.147663+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:50:43.447812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1988,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":246,"num_read_kb":6,"num_write":9,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.081106+0000","last_change":"2024-05-14T15:16:08.787281+0000","last_active":"2024-05-14T15:21:38.081106+0000","last_peered":"2024-05-14T15:21:38.081106+0000","last_clean":"2024-05-14T15:21:38.081106+0000","last_became_active":"2024-05-14T15:16:08.786910+0000","last_became_peered":"2024-05-14T15:16:08.786910+0000","last_unstale":"2024-05-14T15:21:38.081106+0000","last_undegraded":"2024-05-14T15:21:38.081106+0000","last_fullsized":"2024-05-14T15:21:38.081106+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:03:35.421845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146088+0000","last_change":"2024-05-14T15:16:43.066135+0000","last_active":"2024-05-14T15:21:38.146088+0000","last_peered":"2024-05-14T15:21:38.146088+0000","last_clean":"2024-05-14T15:21:38.146088+0000","last_became_active":"2024-05-14T15:16:43.064558+0000","last_became_peered":"2024-05-14T15:16:43.064558+0000","last_unstale":"2024-05-14T15:21:38.146088+0000","last_undegraded":"2024-05-14T15:21:38.146088+0000","last_fullsized":"2024-05-14T15:21:38.146088+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:21:25.441639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,10,11],"acting":[6,3,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"89'17","reported_seq":66,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.803274+0000","last_change":"2024-05-14T15:16:03.841009+0000","last_active":"2024-05-14T15:21:37.803274+0000","last_peered":"2024-05-14T15:21:37.803274+0000","last_clean":"2024-05-14T15:21:37.803274+0000","last_became_active":"2024-05-14T15:16:03.839514+0000","last_became_peered":"2024-05-14T15:16:03.839514+0000","last_unstale":"2024-05-14T15:21:37.803274+0000","last_undegraded":"2024-05-14T15:21:37.803274+0000","last_fullsized":"2024-05-14T15:21:37.803274+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:34:55.588072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974110+0000","last_change":"2024-05-14T15:16:08.774343+0000","last_active":"2024-05-14T15:21:37.974110+0000","last_peered":"2024-05-14T15:21:37.974110+0000","last_clean":"2024-05-14T15:21:37.974110+0000","last_became_active":"2024-05-14T15:16:08.773826+0000","last_became_peered":"2024-05-14T15:16:08.773826+0000","last_unstale":"2024-05-14T15:21:37.974110+0000","last_undegraded":"2024-05-14T15:21:37.974110+0000","last_fullsized":"2024-05-14T15:21:37.974110+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:30:51.648019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.973948+0000","last_change":"2024-05-14T15:16:22.889838+0000","last_active":"2024-05-14T15:21:37.973948+0000","last_peered":"2024-05-14T15:21:37.973948+0000","last_clean":"2024-05-14T15:21:37.973948+0000","last_became_active":"2024-05-14T15:16:22.888604+0000","last_became_peered":"2024-05-14T15:16:22.888604+0000","last_unstale":"2024-05-14T15:21:37.973948+0000","last_undegraded":"2024-05-14T15:21:37.973948+0000","last_fullsized":"2024-05-14T15:21:37.973948+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:26:53.176588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"91'3","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.805462+0000","last_change":"2024-05-14T15:16:03.731499+0000","last_active":"2024-05-14T15:21:37.805462+0000","last_peered":"2024-05-14T15:21:37.805462+0000","last_clean":"2024-05-14T15:21:37.805462+0000","last_became_active":"2024-05-14T15:16:03.729387+0000","last_became_peered":"2024-05-14T15:16:03.729387+0000","last_unstale":"2024-05-14T15:21:37.805462+0000","last_undegraded":"2024-05-14T15:21:37.805462+0000","last_fullsized":"2024-05-14T15:21:37.805462+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:52:24.287236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155956+0000","last_change":"2024-05-14T15:16:08.787376+0000","last_active":"2024-05-14T15:21:38.155956+0000","last_peered":"2024-05-14T15:21:38.155956+0000","last_clean":"2024-05-14T15:21:38.155956+0000","last_became_active":"2024-05-14T15:16:08.786057+0000","last_became_peered":"2024-05-14T15:16:08.786057+0000","last_unstale":"2024-05-14T15:21:38.155956+0000","last_undegraded":"2024-05-14T15:21:38.155956+0000","last_fullsized":"2024-05-14T15:21:38.155956+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:17:16.582656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804810+0000","last_change":"2024-05-14T15:16:23.049639+0000","last_active":"2024-05-14T15:21:37.804810+0000","last_peered":"2024-05-14T15:21:37.804810+0000","last_clean":"2024-05-14T15:21:37.804810+0000","last_became_active":"2024-05-14T15:16:23.047746+0000","last_became_peered":"2024-05-14T15:16:23.047746+0000","last_unstale":"2024-05-14T15:21:37.804810+0000","last_undegraded":"2024-05-14T15:21:37.804810+0000","last_fullsized":"2024-05-14T15:21:37.804810+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:22:27.129466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"89'1","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.797819+0000","last_change":"2024-05-14T15:16:03.842156+0000","last_active":"2024-05-14T15:21:37.797819+0000","last_peered":"2024-05-14T15:21:37.797819+0000","last_clean":"2024-05-14T15:21:37.797819+0000","last_became_active":"2024-05-14T15:16:03.841626+0000","last_became_peered":"2024-05-14T15:16:03.841626+0000","last_unstale":"2024-05-14T15:21:37.797819+0000","last_undegraded":"2024-05-14T15:21:37.797819+0000","last_fullsized":"2024-05-14T15:21:37.797819+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:23:40.955009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"91'4","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.983882+0000","last_change":"2024-05-14T15:16:08.780632+0000","last_active":"2024-05-14T15:21:37.983882+0000","last_peered":"2024-05-14T15:21:37.983882+0000","last_clean":"2024-05-14T15:21:37.983882+0000","last_became_active":"2024-05-14T15:16:08.779743+0000","last_became_peered":"2024-05-14T15:16:08.779743+0000","last_unstale":"2024-05-14T15:21:37.983882+0000","last_undegraded":"2024-05-14T15:21:37.983882+0000","last_fullsized":"2024-05-14T15:21:37.983882+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:53:45.608716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145495+0000","last_change":"2024-05-14T15:16:22.894512+0000","last_active":"2024-05-14T15:21:38.145495+0000","last_peered":"2024-05-14T15:21:38.145495+0000","last_clean":"2024-05-14T15:21:38.145495+0000","last_became_active":"2024-05-14T15:16:22.893566+0000","last_became_peered":"2024-05-14T15:16:22.893566+0000","last_unstale":"2024-05-14T15:21:38.145495+0000","last_undegraded":"2024-05-14T15:21:38.145495+0000","last_fullsized":"2024-05-14T15:21:38.145495+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:45:39.571364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"92'9","reported_seq":301,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082594+0000","last_change":"2024-05-14T15:16:03.730782+0000","last_active":"2024-05-14T15:21:38.082594+0000","last_peered":"2024-05-14T15:21:38.082594+0000","last_clean":"2024-05-14T15:21:38.082594+0000","last_became_active":"2024-05-14T15:16:03.729703+0000","last_became_peered":"2024-05-14T15:16:03.729703+0000","last_unstale":"2024-05-14T15:21:38.082594+0000","last_undegraded":"2024-05-14T15:21:38.082594+0000","last_fullsized":"2024-05-14T15:21:38.082594+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:30:30.379450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1988,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":244,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.983945+0000","last_change":"2024-05-14T15:16:08.792362+0000","last_active":"2024-05-14T15:21:37.983945+0000","last_peered":"2024-05-14T15:21:37.983945+0000","last_clean":"2024-05-14T15:21:37.983945+0000","last_became_active":"2024-05-14T15:16:08.791836+0000","last_became_peered":"2024-05-14T15:16:08.791836+0000","last_unstale":"2024-05-14T15:21:37.983945+0000","last_undegraded":"2024-05-14T15:21:37.983945+0000","last_fullsized":"2024-05-14T15:21:37.983945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:50:07.142474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145947+0000","last_change":"2024-05-14T15:16:23.048324+0000","last_active":"2024-05-14T15:21:38.145947+0000","last_peered":"2024-05-14T15:21:38.145947+0000","last_clean":"2024-05-14T15:21:38.145947+0000","last_became_active":"2024-05-14T15:16:23.047829+0000","last_became_peered":"2024-05-14T15:16:23.047829+0000","last_unstale":"2024-05-14T15:21:38.145947+0000","last_undegraded":"2024-05-14T15:21:38.145947+0000","last_fullsized":"2024-05-14T15:21:38.145947+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:49:13.018847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"91'8","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974489+0000","last_change":"2024-05-14T15:16:43.013252+0000","last_active":"2024-05-14T15:21:37.974489+0000","last_peered":"2024-05-14T15:21:37.974489+0000","last_clean":"2024-05-14T15:21:37.974489+0000","last_became_active":"2024-05-14T15:16:43.011962+0000","last_became_peered":"2024-05-14T15:16:43.011962+0000","last_unstale":"2024-05-14T15:21:37.974489+0000","last_undegraded":"2024-05-14T15:21:37.974489+0000","last_fullsized":"2024-05-14T15:21:37.974489+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:28:06.204259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,6],"acting":[5,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"91'7","reported_seq":296,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.144120+0000","last_change":"2024-05-14T15:16:03.840983+0000","last_active":"2024-05-14T15:21:38.144120+0000","last_peered":"2024-05-14T15:21:38.144120+0000","last_clean":"2024-05-14T15:21:38.144120+0000","last_became_active":"2024-05-14T15:16:03.839117+0000","last_became_peered":"2024-05-14T15:16:03.839117+0000","last_unstale":"2024-05-14T15:21:38.144120+0000","last_undegraded":"2024-05-14T15:21:38.144120+0000","last_fullsized":"2024-05-14T15:21:38.144120+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:01:57.163543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":241,"num_read_kb":241,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.5","version":"91'1","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082005+0000","last_change":"2024-05-14T15:16:22.914744+0000","last_active":"2024-05-14T15:21:38.082005+0000","last_peered":"2024-05-14T15:21:38.082005+0000","last_clean":"2024-05-14T15:21:38.082005+0000","last_became_active":"2024-05-14T15:16:22.913661+0000","last_became_peered":"2024-05-14T15:16:22.913661+0000","last_unstale":"2024-05-14T15:21:38.082005+0000","last_undegraded":"2024-05-14T15:21:38.082005+0000","last_fullsized":"2024-05-14T15:21:38.082005+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:36:45.957828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961391+0000","last_change":"2024-05-14T15:16:08.791872+0000","last_active":"2024-05-14T15:21:37.961391+0000","last_peered":"2024-05-14T15:21:37.961391+0000","last_clean":"2024-05-14T15:21:37.961391+0000","last_became_active":"2024-05-14T15:16:08.791229+0000","last_became_peered":"2024-05-14T15:16:08.791229+0000","last_unstale":"2024-05-14T15:21:37.961391+0000","last_undegraded":"2024-05-14T15:21:37.961391+0000","last_fullsized":"2024-05-14T15:21:37.961391+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:36:26.391077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"89'6","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804146+0000","last_change":"2024-05-14T15:16:03.732872+0000","last_active":"2024-05-14T15:21:37.804146+0000","last_peered":"2024-05-14T15:21:37.804146+0000","last_clean":"2024-05-14T15:21:37.804146+0000","last_became_active":"2024-05-14T15:16:03.732188+0000","last_became_peered":"2024-05-14T15:16:03.732188+0000","last_unstale":"2024-05-14T15:21:37.804146+0000","last_undegraded":"2024-05-14T15:21:37.804146+0000","last_fullsized":"2024-05-14T15:21:37.804146+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:20:56.776521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"20'92","reported_seq":123,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.080063+0000","last_change":"2024-05-14T15:14:08.407259+0000","last_active":"2024-05-14T15:21:38.080063+0000","last_peered":"2024-05-14T15:21:38.080063+0000","last_clean":"2024-05-14T15:21:38.080063+0000","last_became_active":"2024-05-14T15:14:08.398012+0000","last_became_peered":"2024-05-14T15:14:08.398012+0000","last_unstale":"2024-05-14T15:21:38.080063+0000","last_undegraded":"2024-05-14T15:21:38.080063+0000","last_fullsized":"2024-05-14T15:21:38.080063+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:09:04.015044+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:09:04.015044+0000","last_clean_scrub_stamp":"2024-05-14T15:09:04.015044+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":0,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:37.256490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.974363+0000","last_change":"2024-05-14T15:16:23.053989+0000","last_active":"2024-05-14T15:21:37.974363+0000","last_peered":"2024-05-14T15:21:37.974363+0000","last_clean":"2024-05-14T15:21:37.974363+0000","last_became_active":"2024-05-14T15:16:23.052585+0000","last_became_peered":"2024-05-14T15:16:23.052585+0000","last_unstale":"2024-05-14T15:21:37.974363+0000","last_undegraded":"2024-05-14T15:21:37.974363+0000","last_fullsized":"2024-05-14T15:21:37.974363+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:04:30.104518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.143910+0000","last_change":"2024-05-14T15:16:08.775447+0000","last_active":"2024-05-14T15:21:38.143910+0000","last_peered":"2024-05-14T15:21:38.143910+0000","last_clean":"2024-05-14T15:21:38.143910+0000","last_became_active":"2024-05-14T15:16:08.775055+0000","last_became_peered":"2024-05-14T15:16:08.775055+0000","last_unstale":"2024-05-14T15:21:38.143910+0000","last_undegraded":"2024-05-14T15:21:38.143910+0000","last_fullsized":"2024-05-14T15:21:38.143910+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:57:24.668939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"89'4","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.081025+0000","last_change":"2024-05-14T15:16:03.735221+0000","last_active":"2024-05-14T15:21:38.081025+0000","last_peered":"2024-05-14T15:21:38.081025+0000","last_clean":"2024-05-14T15:21:38.081025+0000","last_became_active":"2024-05-14T15:16:03.731910+0000","last_became_peered":"2024-05-14T15:16:03.731910+0000","last_unstale":"2024-05-14T15:21:38.081025+0000","last_undegraded":"2024-05-14T15:21:38.081025+0000","last_fullsized":"2024-05-14T15:21:38.081025+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:57:18.030308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155107+0000","last_change":"2024-05-14T15:16:22.910564+0000","last_active":"2024-05-14T15:21:38.155107+0000","last_peered":"2024-05-14T15:21:38.155107+0000","last_clean":"2024-05-14T15:21:38.155107+0000","last_became_active":"2024-05-14T15:16:22.910003+0000","last_became_peered":"2024-05-14T15:16:22.910003+0000","last_unstale":"2024-05-14T15:21:38.155107+0000","last_undegraded":"2024-05-14T15:21:38.155107+0000","last_fullsized":"2024-05-14T15:21:38.155107+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:19:47.895767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"89'4","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804685+0000","last_change":"2024-05-14T15:16:03.844236+0000","last_active":"2024-05-14T15:21:37.804685+0000","last_peered":"2024-05-14T15:21:37.804685+0000","last_clean":"2024-05-14T15:21:37.804685+0000","last_became_active":"2024-05-14T15:16:03.841253+0000","last_became_peered":"2024-05-14T15:16:03.841253+0000","last_unstale":"2024-05-14T15:21:37.804685+0000","last_undegraded":"2024-05-14T15:21:37.804685+0000","last_fullsized":"2024-05-14T15:21:37.804685+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:40:24.440707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145591+0000","last_change":"2024-05-14T15:16:08.782849+0000","last_active":"2024-05-14T15:21:38.145591+0000","last_peered":"2024-05-14T15:21:38.145591+0000","last_clean":"2024-05-14T15:21:38.145591+0000","last_became_active":"2024-05-14T15:16:08.781999+0000","last_became_peered":"2024-05-14T15:16:08.781999+0000","last_unstale":"2024-05-14T15:21:38.145591+0000","last_undegraded":"2024-05-14T15:21:38.145591+0000","last_fullsized":"2024-05-14T15:21:38.145591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:33:03.997615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.960839+0000","last_change":"2024-05-14T15:16:23.049719+0000","last_active":"2024-05-14T15:21:37.960839+0000","last_peered":"2024-05-14T15:21:37.960839+0000","last_clean":"2024-05-14T15:21:37.960839+0000","last_became_active":"2024-05-14T15:16:23.048547+0000","last_became_peered":"2024-05-14T15:16:23.048547+0000","last_unstale":"2024-05-14T15:21:37.960839+0000","last_undegraded":"2024-05-14T15:21:37.960839+0000","last_fullsized":"2024-05-14T15:21:37.960839+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:41:49.790521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"92'52","reported_seq":123,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.309815+0000","last_change":"2024-05-14T15:16:03.729413+0000","last_active":"2024-05-14T15:21:38.309815+0000","last_peered":"2024-05-14T15:21:38.309815+0000","last_clean":"2024-05-14T15:21:38.309815+0000","last_became_active":"2024-05-14T15:16:03.728491+0000","last_became_peered":"2024-05-14T15:16:03.728491+0000","last_unstale":"2024-05-14T15:21:38.309815+0000","last_undegraded":"2024-05-14T15:21:38.309815+0000","last_fullsized":"2024-05-14T15:21:38.309815+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:34:04.811775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":92,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.962137+0000","last_change":"2024-05-14T15:16:08.784237+0000","last_active":"2024-05-14T15:21:37.962137+0000","last_peered":"2024-05-14T15:21:37.962137+0000","last_clean":"2024-05-14T15:21:37.962137+0000","last_became_active":"2024-05-14T15:16:08.783908+0000","last_became_peered":"2024-05-14T15:16:08.783908+0000","last_unstale":"2024-05-14T15:21:37.962137+0000","last_undegraded":"2024-05-14T15:21:37.962137+0000","last_fullsized":"2024-05-14T15:21:37.962137+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T00:43:24.621314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145323+0000","last_change":"2024-05-14T15:16:22.909928+0000","last_active":"2024-05-14T15:21:38.145323+0000","last_peered":"2024-05-14T15:21:38.145323+0000","last_clean":"2024-05-14T15:21:38.145323+0000","last_became_active":"2024-05-14T15:16:22.909412+0000","last_became_peered":"2024-05-14T15:16:22.909412+0000","last_unstale":"2024-05-14T15:21:38.145323+0000","last_undegraded":"2024-05-14T15:21:38.145323+0000","last_fullsized":"2024-05-14T15:21:38.145323+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:18:26.324189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"89'7","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804565+0000","last_change":"2024-05-14T15:16:03.729846+0000","last_active":"2024-05-14T15:21:37.804565+0000","last_peered":"2024-05-14T15:21:37.804565+0000","last_clean":"2024-05-14T15:21:37.804565+0000","last_became_active":"2024-05-14T15:16:03.729385+0000","last_became_peered":"2024-05-14T15:16:03.729385+0000","last_unstale":"2024-05-14T15:21:37.804565+0000","last_undegraded":"2024-05-14T15:21:37.804565+0000","last_fullsized":"2024-05-14T15:21:37.804565+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:05:18.987237+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155368+0000","last_change":"2024-05-14T15:16:08.796017+0000","last_active":"2024-05-14T15:21:38.155368+0000","last_peered":"2024-05-14T15:21:38.155368+0000","last_clean":"2024-05-14T15:21:38.155368+0000","last_became_active":"2024-05-14T15:16:08.791627+0000","last_became_peered":"2024-05-14T15:16:08.791627+0000","last_unstale":"2024-05-14T15:21:38.155368+0000","last_undegraded":"2024-05-14T15:21:38.155368+0000","last_fullsized":"2024-05-14T15:21:38.155368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:46:27.910669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804084+0000","last_change":"2024-05-14T15:16:23.052954+0000","last_active":"2024-05-14T15:21:37.804084+0000","last_peered":"2024-05-14T15:21:37.804084+0000","last_clean":"2024-05-14T15:21:37.804084+0000","last_became_active":"2024-05-14T15:16:23.051410+0000","last_became_peered":"2024-05-14T15:16:23.051410+0000","last_unstale":"2024-05-14T15:21:37.804084+0000","last_undegraded":"2024-05-14T15:21:37.804084+0000","last_fullsized":"2024-05-14T15:21:37.804084+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T15:28:55.181866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,9],"acting":[4,5,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"89'2","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153689+0000","last_change":"2024-05-14T15:16:43.023961+0000","last_active":"2024-05-14T15:21:38.153689+0000","last_peered":"2024-05-14T15:21:38.153689+0000","last_clean":"2024-05-14T15:21:38.153689+0000","last_became_active":"2024-05-14T15:16:43.022677+0000","last_became_peered":"2024-05-14T15:16:43.022677+0000","last_unstale":"2024-05-14T15:21:38.153689+0000","last_undegraded":"2024-05-14T15:21:38.153689+0000","last_fullsized":"2024-05-14T15:21:38.153689+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:33:16.692984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,11,0],"acting":[1,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"91'2","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.803304+0000","last_change":"2024-05-14T15:16:08.780415+0000","last_active":"2024-05-14T15:21:37.803304+0000","last_peered":"2024-05-14T15:21:37.803304+0000","last_clean":"2024-05-14T15:21:37.803304+0000","last_became_active":"2024-05-14T15:16:08.780053+0000","last_became_peered":"2024-05-14T15:16:08.780053+0000","last_unstale":"2024-05-14T15:21:37.803304+0000","last_undegraded":"2024-05-14T15:21:37.803304+0000","last_fullsized":"2024-05-14T15:21:37.803304+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:18:00.964346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":20,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.805308+0000","last_change":"2024-05-14T15:16:43.066458+0000","last_active":"2024-05-14T15:21:37.805308+0000","last_peered":"2024-05-14T15:21:37.805308+0000","last_clean":"2024-05-14T15:21:37.805308+0000","last_became_active":"2024-05-14T15:16:43.064035+0000","last_became_peered":"2024-05-14T15:16:43.064035+0000","last_unstale":"2024-05-14T15:21:37.805308+0000","last_undegraded":"2024-05-14T15:21:37.805308+0000","last_fullsized":"2024-05-14T15:21:37.805308+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:38:39.895882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,2,5],"acting":[8,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"89'7","reported_seq":55,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961153+0000","last_change":"2024-05-14T15:16:03.731962+0000","last_active":"2024-05-14T15:21:37.961153+0000","last_peered":"2024-05-14T15:21:37.961153+0000","last_clean":"2024-05-14T15:21:37.961153+0000","last_became_active":"2024-05-14T15:16:03.726532+0000","last_became_peered":"2024-05-14T15:16:03.726532+0000","last_unstale":"2024-05-14T15:21:37.961153+0000","last_undegraded":"2024-05-14T15:21:37.961153+0000","last_fullsized":"2024-05-14T15:21:37.961153+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:47:26.809212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154807+0000","last_change":"2024-05-14T15:16:08.798984+0000","last_active":"2024-05-14T15:21:38.154807+0000","last_peered":"2024-05-14T15:21:38.154807+0000","last_clean":"2024-05-14T15:21:38.154807+0000","last_became_active":"2024-05-14T15:16:08.798120+0000","last_became_peered":"2024-05-14T15:16:08.798120+0000","last_unstale":"2024-05-14T15:21:38.154807+0000","last_undegraded":"2024-05-14T15:21:38.154807+0000","last_fullsized":"2024-05-14T15:21:38.154807+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:54:58.519436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.c","version":"91'1","reported_seq":33,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804997+0000","last_change":"2024-05-14T15:16:22.907994+0000","last_active":"2024-05-14T15:21:37.804997+0000","last_peered":"2024-05-14T15:21:37.804997+0000","last_clean":"2024-05-14T15:21:37.804997+0000","last_became_active":"2024-05-14T15:16:22.907144+0000","last_became_peered":"2024-05-14T15:16:22.907144+0000","last_unstale":"2024-05-14T15:21:37.804997+0000","last_undegraded":"2024-05-14T15:21:37.804997+0000","last_fullsized":"2024-05-14T15:21:37.804997+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:49:11.436917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"91'4","reported_seq":52,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145631+0000","last_change":"2024-05-14T15:16:03.728334+0000","last_active":"2024-05-14T15:21:38.145631+0000","last_peered":"2024-05-14T15:21:38.145631+0000","last_clean":"2024-05-14T15:21:38.145631+0000","last_became_active":"2024-05-14T15:16:03.727836+0000","last_became_peered":"2024-05-14T15:16:03.727836+0000","last_unstale":"2024-05-14T15:21:38.145631+0000","last_undegraded":"2024-05-14T15:21:38.145631+0000","last_fullsized":"2024-05-14T15:21:38.145631+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:49:54.780821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961656+0000","last_change":"2024-05-14T15:16:08.798340+0000","last_active":"2024-05-14T15:21:37.961656+0000","last_peered":"2024-05-14T15:21:37.961656+0000","last_clean":"2024-05-14T15:21:37.961656+0000","last_became_active":"2024-05-14T15:16:08.797981+0000","last_became_peered":"2024-05-14T15:16:08.797981+0000","last_unstale":"2024-05-14T15:21:37.961656+0000","last_undegraded":"2024-05-14T15:21:37.961656+0000","last_fullsized":"2024-05-14T15:21:37.961656+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:04:08.322033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.803678+0000","last_change":"2024-05-14T15:16:23.050064+0000","last_active":"2024-05-14T15:21:37.803678+0000","last_peered":"2024-05-14T15:21:37.803678+0000","last_clean":"2024-05-14T15:21:37.803678+0000","last_became_active":"2024-05-14T15:16:23.048608+0000","last_became_peered":"2024-05-14T15:16:23.048608+0000","last_unstale":"2024-05-14T15:21:37.803678+0000","last_undegraded":"2024-05-14T15:21:37.803678+0000","last_fullsized":"2024-05-14T15:21:37.803678+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:32:32.044226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.b","version":"89'4","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.804332+0000","last_change":"2024-05-14T15:16:03.734588+0000","last_active":"2024-05-14T15:21:37.804332+0000","last_peered":"2024-05-14T15:21:37.804332+0000","last_clean":"2024-05-14T15:21:37.804332+0000","last_became_active":"2024-05-14T15:16:03.734112+0000","last_became_peered":"2024-05-14T15:16:03.734112+0000","last_unstale":"2024-05-14T15:21:37.804332+0000","last_undegraded":"2024-05-14T15:21:37.804332+0000","last_fullsized":"2024-05-14T15:21:37.804332+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:07:56.545225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"91'5","reported_seq":47,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.080873+0000","last_change":"2024-05-14T15:16:08.789481+0000","last_active":"2024-05-14T15:21:38.080873+0000","last_peered":"2024-05-14T15:21:38.080873+0000","last_clean":"2024-05-14T15:21:38.080873+0000","last_became_active":"2024-05-14T15:16:08.788462+0000","last_became_peered":"2024-05-14T15:16:08.788462+0000","last_unstale":"2024-05-14T15:21:38.080873+0000","last_undegraded":"2024-05-14T15:21:38.080873+0000","last_fullsized":"2024-05-14T15:21:38.080873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:35:06.386410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.153851+0000","last_change":"2024-05-14T15:16:22.903205+0000","last_active":"2024-05-14T15:21:38.153851+0000","last_peered":"2024-05-14T15:21:38.153851+0000","last_clean":"2024-05-14T15:21:38.153851+0000","last_became_active":"2024-05-14T15:16:22.901217+0000","last_became_peered":"2024-05-14T15:16:22.901217+0000","last_unstale":"2024-05-14T15:21:38.153851+0000","last_undegraded":"2024-05-14T15:21:38.153851+0000","last_fullsized":"2024-05-14T15:21:38.153851+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T03:03:59.160106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.c","version":"91'8","reported_seq":301,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146311+0000","last_change":"2024-05-14T15:16:03.840601+0000","last_active":"2024-05-14T15:21:38.146311+0000","last_peered":"2024-05-14T15:21:38.146311+0000","last_clean":"2024-05-14T15:21:38.146311+0000","last_became_active":"2024-05-14T15:16:03.839299+0000","last_became_peered":"2024-05-14T15:16:03.839299+0000","last_unstale":"2024-05-14T15:21:38.146311+0000","last_undegraded":"2024-05-14T15:21:38.146311+0000","last_fullsized":"2024-05-14T15:21:38.146311+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:35:46.773419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2179,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":245,"num_read_kb":5,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082686+0000","last_change":"2024-05-14T15:16:08.782915+0000","last_active":"2024-05-14T15:21:38.082686+0000","last_peered":"2024-05-14T15:21:38.082686+0000","last_clean":"2024-05-14T15:21:38.082686+0000","last_became_active":"2024-05-14T15:16:08.782469+0000","last_became_peered":"2024-05-14T15:16:08.782469+0000","last_unstale":"2024-05-14T15:21:38.082686+0000","last_undegraded":"2024-05-14T15:21:38.082686+0000","last_fullsized":"2024-05-14T15:21:38.082686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:36:35.361723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":39,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154025+0000","last_change":"2024-05-14T15:16:43.021276+0000","last_active":"2024-05-14T15:21:38.154025+0000","last_peered":"2024-05-14T15:21:38.154025+0000","last_clean":"2024-05-14T15:21:38.154025+0000","last_became_active":"2024-05-14T15:16:43.020534+0000","last_became_peered":"2024-05-14T15:16:43.020534+0000","last_unstale":"2024-05-14T15:21:38.154025+0000","last_undegraded":"2024-05-14T15:21:38.154025+0000","last_fullsized":"2024-05-14T15:21:38.154025+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:31:01.267429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,1,4],"acting":[0,8,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"92'41","reported_seq":97,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.304866+0000","last_change":"2024-05-14T15:16:03.728379+0000","last_active":"2024-05-14T15:21:38.304866+0000","last_peered":"2024-05-14T15:21:38.304866+0000","last_clean":"2024-05-14T15:21:38.304866+0000","last_became_active":"2024-05-14T15:16:03.727580+0000","last_became_peered":"2024-05-14T15:16:03.727580+0000","last_unstale":"2024-05-14T15:21:38.304866+0000","last_undegraded":"2024-05-14T15:21:38.304866+0000","last_fullsized":"2024-05-14T15:21:38.304866+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:54:20.607980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"91'6","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.082068+0000","last_change":"2024-05-14T15:17:43.854489+0000","last_active":"2024-05-14T15:21:38.082068+0000","last_peered":"2024-05-14T15:21:38.082068+0000","last_clean":"2024-05-14T15:21:38.082068+0000","last_became_active":"2024-05-14T15:17:43.853624+0000","last_became_peered":"2024-05-14T15:17:43.853624+0000","last_unstale":"2024-05-14T15:21:38.082068+0000","last_undegraded":"2024-05-14T15:21:38.082068+0000","last_fullsized":"2024-05-14T15:21:38.082068+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T17:19:59.686248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":32,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.973657+0000","last_change":"2024-05-14T15:16:22.911248+0000","last_active":"2024-05-14T15:21:37.973657+0000","last_peered":"2024-05-14T15:21:37.973657+0000","last_clean":"2024-05-14T15:21:37.973657+0000","last_became_active":"2024-05-14T15:16:22.909975+0000","last_became_peered":"2024-05-14T15:16:22.909975+0000","last_unstale":"2024-05-14T15:21:37.973657+0000","last_undegraded":"2024-05-14T15:21:37.973657+0000","last_fullsized":"2024-05-14T15:21:37.973657+0000","mapping_epoch":83,"log_start":"0'0","ondisk_log_start":"0'0","created":83,"last_epoch_clean":84,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:21.859055+0000","last_clean_scrub_stamp":"2024-05-14T15:16:21.859055+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T19:34:23.140008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"89'5","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145947+0000","last_change":"2024-05-14T15:16:03.728422+0000","last_active":"2024-05-14T15:21:38.145947+0000","last_peered":"2024-05-14T15:21:38.145947+0000","last_clean":"2024-05-14T15:21:38.145947+0000","last_became_active":"2024-05-14T15:16:03.727428+0000","last_became_peered":"2024-05-14T15:16:03.727428+0000","last_unstale":"2024-05-14T15:21:38.145947+0000","last_undegraded":"2024-05-14T15:21:38.145947+0000","last_fullsized":"2024-05-14T15:21:38.145947+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:02.691894+0000","last_clean_scrub_stamp":"2024-05-14T15:16:02.691894+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:37:15.472001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.083392+0000","last_change":"2024-05-14T15:16:08.782158+0000","last_active":"2024-05-14T15:21:38.083392+0000","last_peered":"2024-05-14T15:21:38.083392+0000","last_clean":"2024-05-14T15:21:38.083392+0000","last_became_active":"2024-05-14T15:16:08.781761+0000","last_became_peered":"2024-05-14T15:16:08.781761+0000","last_unstale":"2024-05-14T15:21:38.083392+0000","last_undegraded":"2024-05-14T15:21:38.083392+0000","last_fullsized":"2024-05-14T15:21:38.083392+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T16:01:42.886837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"91'9","reported_seq":51,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154932+0000","last_change":"2024-05-14T15:16:08.789851+0000","last_active":"2024-05-14T15:21:38.154932+0000","last_peered":"2024-05-14T15:21:38.154932+0000","last_clean":"2024-05-14T15:21:38.154932+0000","last_became_active":"2024-05-14T15:16:08.787563+0000","last_became_peered":"2024-05-14T15:16:08.787563+0000","last_unstale":"2024-05-14T15:21:38.154932+0000","last_undegraded":"2024-05-14T15:21:38.154932+0000","last_fullsized":"2024-05-14T15:21:38.154932+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:02:16.592481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"91'12","reported_seq":54,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145748+0000","last_change":"2024-05-14T15:16:08.788989+0000","last_active":"2024-05-14T15:21:38.145748+0000","last_peered":"2024-05-14T15:21:38.145748+0000","last_clean":"2024-05-14T15:21:38.145748+0000","last_became_active":"2024-05-14T15:16:08.785064+0000","last_became_peered":"2024-05-14T15:16:08.785064+0000","last_unstale":"2024-05-14T15:21:38.145748+0000","last_undegraded":"2024-05-14T15:21:38.145748+0000","last_fullsized":"2024-05-14T15:21:38.145748+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T20:12:30.824113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145443+0000","last_change":"2024-05-14T15:16:08.785849+0000","last_active":"2024-05-14T15:21:38.145443+0000","last_peered":"2024-05-14T15:21:38.145443+0000","last_clean":"2024-05-14T15:21:38.145443+0000","last_became_active":"2024-05-14T15:16:08.785487+0000","last_became_peered":"2024-05-14T15:16:08.785487+0000","last_unstale":"2024-05-14T15:21:38.145443+0000","last_undegraded":"2024-05-14T15:21:38.145443+0000","last_fullsized":"2024-05-14T15:21:38.145443+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:37:16.435154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"91'7","reported_seq":49,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154327+0000","last_change":"2024-05-14T15:16:08.787843+0000","last_active":"2024-05-14T15:21:38.154327+0000","last_peered":"2024-05-14T15:21:38.154327+0000","last_clean":"2024-05-14T15:21:38.154327+0000","last_became_active":"2024-05-14T15:16:08.787485+0000","last_became_peered":"2024-05-14T15:16:08.787485+0000","last_unstale":"2024-05-14T15:21:38.154327+0000","last_undegraded":"2024-05-14T15:21:38.154327+0000","last_fullsized":"2024-05-14T15:21:38.154327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T18:16:06.625923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"91'4","reported_seq":46,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145685+0000","last_change":"2024-05-14T15:16:08.784870+0000","last_active":"2024-05-14T15:21:38.145685+0000","last_peered":"2024-05-14T15:21:38.145685+0000","last_clean":"2024-05-14T15:21:38.145685+0000","last_became_active":"2024-05-14T15:16:08.782496+0000","last_became_peered":"2024-05-14T15:16:08.782496+0000","last_unstale":"2024-05-14T15:21:38.145685+0000","last_undegraded":"2024-05-14T15:21:38.145685+0000","last_fullsized":"2024-05-14T15:21:38.145685+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:54:33.724823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"91'6","reported_seq":48,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.156019+0000","last_change":"2024-05-14T15:16:08.783203+0000","last_active":"2024-05-14T15:21:38.156019+0000","last_peered":"2024-05-14T15:21:38.156019+0000","last_clean":"2024-05-14T15:21:38.156019+0000","last_became_active":"2024-05-14T15:16:08.782758+0000","last_became_peered":"2024-05-14T15:16:08.782758+0000","last_unstale":"2024-05-14T15:21:38.156019+0000","last_undegraded":"2024-05-14T15:21:38.156019+0000","last_fullsized":"2024-05-14T15:21:38.156019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:34:33.274511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"91'15","reported_seq":57,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.146429+0000","last_change":"2024-05-14T15:16:08.789727+0000","last_active":"2024-05-14T15:21:38.146429+0000","last_peered":"2024-05-14T15:21:38.146429+0000","last_clean":"2024-05-14T15:21:38.146429+0000","last_became_active":"2024-05-14T15:16:08.784434+0000","last_became_peered":"2024-05-14T15:16:08.784434+0000","last_unstale":"2024-05-14T15:21:38.146429+0000","last_undegraded":"2024-05-14T15:21:38.146429+0000","last_fullsized":"2024-05-14T15:21:38.146429+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:59:19.835381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"91'2","reported_seq":44,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.962277+0000","last_change":"2024-05-14T15:16:08.781887+0000","last_active":"2024-05-14T15:21:37.962277+0000","last_peered":"2024-05-14T15:21:37.962277+0000","last_clean":"2024-05-14T15:21:37.962277+0000","last_became_active":"2024-05-14T15:16:08.781332+0000","last_became_peered":"2024-05-14T15:16:08.781332+0000","last_unstale":"2024-05-14T15:21:37.962277+0000","last_undegraded":"2024-05-14T15:21:37.962277+0000","last_fullsized":"2024-05-14T15:21:37.962277+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:51:36.558485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"91'6","reported_seq":25,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.080467+0000","last_change":"2024-05-14T15:16:43.065016+0000","last_active":"2024-05-14T15:21:38.080467+0000","last_peered":"2024-05-14T15:21:38.080467+0000","last_clean":"2024-05-14T15:21:38.080467+0000","last_became_active":"2024-05-14T15:16:43.063786+0000","last_became_peered":"2024-05-14T15:16:43.063786+0000","last_unstale":"2024-05-14T15:21:38.080467+0000","last_undegraded":"2024-05-14T15:21:38.080467+0000","last_fullsized":"2024-05-14T15:21:38.080467+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T21:01:54.920710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,3],"acting":[7,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.29","version":"91'8","reported_seq":50,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:37.961198+0000","last_change":"2024-05-14T15:16:08.794288+0000","last_active":"2024-05-14T15:21:37.961198+0000","last_peered":"2024-05-14T15:21:37.961198+0000","last_clean":"2024-05-14T15:21:37.961198+0000","last_became_active":"2024-05-14T15:16:08.792059+0000","last_became_peered":"2024-05-14T15:16:08.792059+0000","last_unstale":"2024-05-14T15:21:37.961198+0000","last_undegraded":"2024-05-14T15:21:37.961198+0000","last_fullsized":"2024-05-14T15:21:37.961198+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T23:30:55.769322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"91'10","reported_seq":58,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.154428+0000","last_change":"2024-05-14T15:17:43.858583+0000","last_active":"2024-05-14T15:21:38.154428+0000","last_peered":"2024-05-14T15:21:38.154428+0000","last_clean":"2024-05-14T15:21:38.154428+0000","last_became_active":"2024-05-14T15:17:43.857287+0000","last_became_peered":"2024-05-14T15:17:43.857287+0000","last_unstale":"2024-05-14T15:21:38.154428+0000","last_undegraded":"2024-05-14T15:21:38.154428+0000","last_fullsized":"2024-05-14T15:21:38.154428+0000","mapping_epoch":90,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":91,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T01:12:31.471747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,8],"acting":[1,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"91'11","reported_seq":53,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.145193+0000","last_change":"2024-05-14T15:16:08.786726+0000","last_active":"2024-05-14T15:21:38.145193+0000","last_peered":"2024-05-14T15:21:38.145193+0000","last_clean":"2024-05-14T15:21:38.145193+0000","last_became_active":"2024-05-14T15:16:08.785599+0000","last_became_peered":"2024-05-14T15:16:08.785599+0000","last_unstale":"2024-05-14T15:21:38.145193+0000","last_undegraded":"2024-05-14T15:21:38.145193+0000","last_fullsized":"2024-05-14T15:21:38.145193+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-16T02:33:18.055459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"91'8","reported_seq":56,"reported_epoch":92,"state":"active+clean","last_fresh":"2024-05-14T15:21:38.155743+0000","last_change":"2024-05-14T15:16:43.022021+0000","last_active":"2024-05-14T15:21:38.155743+0000","last_peered":"2024-05-14T15:21:38.155743+0000","last_clean":"2024-05-14T15:21:38.155743+0000","last_became_active":"2024-05-14T15:16:43.021511+0000","last_became_peered":"2024-05-14T15:16:43.021511+0000","last_unstale":"2024-05-14T15:21:38.155743+0000","last_undegraded":"2024-05-14T15:21:38.155743+0000","last_fullsized":"2024-05-14T15:21:38.155743+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-14T15:16:07.719314+0000","last_clean_scrub_stamp":"2024-05-14T15:16:07.719314+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-15T22:59:55.083356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,8],"acting":[11,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":81,"num_read_kb":69,"num_write":123,"num_write_kb":2150,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":2951840,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":92,"ondisk_log_size":92,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":609141,"num_objects":100,"num_object_clones":0,"num_object_copies":300,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":2547,"num_read_kb":1397,"num_write":397,"num_write_kb":1489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2187264,"data_stored":1827423,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":322,"ondisk_log_size":322,"up":96,"acting":96,"num_store_stats":12}],"osd_stats":[{"osd":11,"up_from":72,"seq":309237645397,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1073152,"data_stored":537039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":10,"up_from":66,"seq":283467841628,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":33044,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712108,"statfs":{"total":95995035648,"available":95961198592,"internally_reserved":0,"allocated":1912832,"data_stored":1328149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":61,"seq":261993005156,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28480,"kb_used_data":1460,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716672,"statfs":{"total":95995035648,"available":95965872128,"internally_reserved":0,"allocated":1495040,"data_stored":933272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201388,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32632,"kb_used_data":1452,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712520,"statfs":{"total":95995035648,"available":95961620480,"internally_reserved":0,"allocated":1486848,"data_stored":929554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430322,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32832,"kb_used_data":1652,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712320,"statfs":{"total":95995035648,"available":95961415680,"internally_reserved":0,"allocated":1691648,"data_stored":1135471,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593851,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32228,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712924,"statfs":{"total":95995035648,"available":95962034176,"internally_reserved":0,"allocated":1073152,"data_stored":532864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575007,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32284,"kb_used_data":1108,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712868,"statfs":{"total":95995035648,"available":95961976832,"internally_reserved":0,"allocated":1134592,"data_stored":595100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738536,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32252,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712900,"statfs":{"total":95995035648,"available":95962009600,"internally_reserved":0,"allocated":1097728,"data_stored":533929,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411480,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28164,"kb_used_data":1144,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716988,"statfs":{"total":95995035648,"available":95966195712,"internally_reserved":0,"allocated":1171456,"data_stored":607817,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182545,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32240,"kb_used_data":1060,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712912,"statfs":{"total":95995035648,"available":95962021888,"internally_reserved":0,"allocated":1085440,"data_stored":531172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986314,"num_pgs":34,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36396,"kb_used_data":1056,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708756,"statfs":{"total":95995035648,"available":95957766144,"internally_reserved":0,"allocated":1081344,"data_stored":536938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":37,"seq":158913790083,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32844,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712308,"statfs":{"total":95995035648,"available":95961403392,"internally_reserved":0,"allocated":1703936,"data_stored":1129547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":3187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":75455,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":77075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":557056,"data_stored":525246,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":180224,"data_stored":136211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2122,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":7733,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":425984,"data_stored":394716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":394338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":207039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2201,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-14T15:21:45.765 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:21:46.234 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:21:46.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:46 smithi069 ceph-mon[31270]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:21:46.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:46 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi069 to 176.4M 2024-05-14T15:21:46.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:46 smithi069 ceph-mon[31270]: Unable to set osd_memory_target on smithi069 to 185003929: error parsing value: Value '185003929' is below minimum 939524096 2024-05-14T15:21:46.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:46 smithi069 ceph-mon[31270]: Updating smithi069:/etc/ceph/ceph.conf 2024-05-14T15:21:46.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:46 smithi069 ceph-mon[31270]: Updating smithi092:/etc/ceph/ceph.conf 2024-05-14T15:21:46.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:46 smithi069 ceph-mon[31270]: Updating smithi203:/etc/ceph/ceph.conf 2024-05-14T15:21:46.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:46 smithi069 ceph-mon[31270]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:21:46.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:46 smithi069 ceph-mon[31270]: Updating smithi069:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:21:46.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:46 smithi069 ceph-mon[31270]: Updating smithi203:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:21:46.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:46 smithi069 ceph-mon[31270]: Updating smithi092:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:21:46.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:46 smithi069 ceph-mon[31270]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:21:46.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:46 smithi069 ceph-mon[31270]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 146 B/s wr, 18 op/s 2024-05-14T15:21:46.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:46 smithi069 ceph-mon[31270]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:21:46.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:46 smithi203 ceph-mon[34567]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:21:46.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:46 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi069 to 176.4M 2024-05-14T15:21:46.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:46 smithi203 ceph-mon[34567]: Unable to set osd_memory_target on smithi069 to 185003929: error parsing value: Value '185003929' is below minimum 939524096 2024-05-14T15:21:46.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:46 smithi203 ceph-mon[34567]: Updating smithi069:/etc/ceph/ceph.conf 2024-05-14T15:21:46.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:46 smithi203 ceph-mon[34567]: Updating smithi092:/etc/ceph/ceph.conf 2024-05-14T15:21:46.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:46 smithi203 ceph-mon[34567]: Updating smithi203:/etc/ceph/ceph.conf 2024-05-14T15:21:46.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:46 smithi203 ceph-mon[34567]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:21:46.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:46 smithi203 ceph-mon[34567]: Updating smithi069:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:21:46.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:46 smithi203 ceph-mon[34567]: Updating smithi203:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:21:46.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:46 smithi203 ceph-mon[34567]: Updating smithi092:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:21:46.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:46 smithi203 ceph-mon[34567]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:21:46.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:46 smithi203 ceph-mon[34567]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 146 B/s wr, 18 op/s 2024-05-14T15:21:46.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:46 smithi203 ceph-mon[34567]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:21:46.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:46 smithi092 ceph-mon[34729]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:21:46.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:46 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi069 to 176.4M 2024-05-14T15:21:46.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:46 smithi092 ceph-mon[34729]: Unable to set osd_memory_target on smithi069 to 185003929: error parsing value: Value '185003929' is below minimum 939524096 2024-05-14T15:21:46.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:46 smithi092 ceph-mon[34729]: Updating smithi069:/etc/ceph/ceph.conf 2024-05-14T15:21:46.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:46 smithi092 ceph-mon[34729]: Updating smithi092:/etc/ceph/ceph.conf 2024-05-14T15:21:46.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:46 smithi092 ceph-mon[34729]: Updating smithi203:/etc/ceph/ceph.conf 2024-05-14T15:21:46.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:46 smithi092 ceph-mon[34729]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:21:46.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:46 smithi092 ceph-mon[34729]: Updating smithi069:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:21:46.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:46 smithi092 ceph-mon[34729]: Updating smithi203:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:21:46.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:46 smithi092 ceph-mon[34729]: Updating smithi092:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.conf 2024-05-14T15:21:46.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:46 smithi092 ceph-mon[34729]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-14T15:21:46.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:46 smithi092 ceph-mon[34729]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 146 B/s wr, 18 op/s 2024-05-14T15:21:46.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:46 smithi092 ceph-mon[34729]: Updating smithi069:/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:21:47.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:47 smithi069 ceph-mon[31270]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:21:47.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:47 smithi069 ceph-mon[31270]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:21:47.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:47 smithi069 ceph-mon[31270]: Updating smithi069:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T15:21:47.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:47 smithi069 ceph-mon[31270]: Updating smithi203:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T15:21:47.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:47 smithi203 ceph-mon[34567]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:21:47.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:47 smithi203 ceph-mon[34567]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:21:47.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:47 smithi203 ceph-mon[34567]: Updating smithi069:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T15:21:47.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:47 smithi203 ceph-mon[34567]: Updating smithi203:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T15:21:47.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:47 smithi092 ceph-mon[34729]: Updating smithi203:/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:21:47.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:47 smithi092 ceph-mon[34729]: Updating smithi092:/etc/ceph/ceph.client.admin.keyring 2024-05-14T15:21:47.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:47 smithi092 ceph-mon[34729]: Updating smithi069:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T15:21:47.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:47 smithi092 ceph-mon[34729]: Updating smithi203:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T15:21:48.431 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:48 smithi069 ceph-mon[31270]: Updating smithi092:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T15:21:48.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:48 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:48 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:48 smithi069 ceph-mon[31270]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 113 B/s wr, 14 op/s 2024-05-14T15:21:48.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:48 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:48 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:48 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:48 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:48 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:48 smithi203 ceph-mon[34567]: Updating smithi092:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T15:21:48.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:48 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:48 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:48 smithi203 ceph-mon[34567]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 113 B/s wr, 14 op/s 2024-05-14T15:21:48.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:48 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:48 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:48 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:48 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:48 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.672+0000 7f2483400700 1 -- 172.21.15.69:0/3320085709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f247c106ec0 msgr2=0x7f247c113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:48.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.672+0000 7f2483400700 1 --2- 172.21.15.69:0/3320085709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f247c106ec0 0x7f247c113350 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f247400b0a0 tx=0x7f247400b3b0 comp rx=0 tx=0).stop 2024-05-14T15:21:48.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.672+0000 7f2483400700 1 -- 172.21.15.69:0/3320085709 shutdown_connections 2024-05-14T15:21:48.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.672+0000 7f2483400700 1 --2- 172.21.15.69:0/3320085709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f247c106ec0 0x7f247c113350 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:48.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.672+0000 7f2483400700 1 --2- 172.21.15.69:0/3320085709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f247c10c5b0 0x7f247c10c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:48.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.672+0000 7f2483400700 1 --2- 172.21.15.69:0/3320085709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f247c106570 0x7f247c106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:48.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.672+0000 7f2483400700 1 -- 172.21.15.69:0/3320085709 >> 172.21.15.69:0/3320085709 conn(0x7f247c102050 msgr2=0x7f247c1044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:48.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.672+0000 7f2483400700 1 -- 172.21.15.69:0/3320085709 shutdown_connections 2024-05-14T15:21:48.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.672+0000 7f2483400700 1 -- 172.21.15.69:0/3320085709 wait complete. 2024-05-14T15:21:48.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.674+0000 7f2483400700 1 Processor -- start 2024-05-14T15:21:48.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.674+0000 7f2483400700 1 -- start start 2024-05-14T15:21:48.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.675+0000 7f2483400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f247c106570 0x7f247c19cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:48.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.675+0000 7f2483400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f247c106ec0 0x7f247c19d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:48.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.675+0000 7f2483400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f247c10c5b0 0x7f247c1a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:48.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.675+0000 7f2483400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f247c116590 con 0x7f247c106ec0 2024-05-14T15:21:48.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.675+0000 7f2483400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f247c116410 con 0x7f247c10c5b0 2024-05-14T15:21:48.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.675+0000 7f2483400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f247c116710 con 0x7f247c106570 2024-05-14T15:21:48.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.675+0000 7f247be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f247c106ec0 0x7f247c19d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:48.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.676+0000 7f247be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f247c106ec0 0x7f247c19d4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52704/0 (socket says 172.21.15.69:52704) 2024-05-14T15:21:48.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.676+0000 7f247be00700 1 -- 172.21.15.69:0/1711128853 learned_addr learned my addr 172.21.15.69:0/1711128853 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:48.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.676+0000 7f2481400700 1 --2- 172.21.15.69:0/1711128853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f247c10c5b0 0x7f247c1a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:48.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.676+0000 7f2480a00700 1 --2- 172.21.15.69:0/1711128853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f247c106570 0x7f247c19cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:48.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.676+0000 7f247be00700 1 -- 172.21.15.69:0/1711128853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f247c106570 msgr2=0x7f247c19cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:48.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.676+0000 7f247be00700 1 --2- 172.21.15.69:0/1711128853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f247c106570 0x7f247c19cf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:48.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.676+0000 7f247be00700 1 -- 172.21.15.69:0/1711128853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f247c10c5b0 msgr2=0x7f247c1a1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:48.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.676+0000 7f247be00700 1 --2- 172.21.15.69:0/1711128853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f247c10c5b0 0x7f247c1a1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:48.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.676+0000 7f247be00700 1 -- 172.21.15.69:0/1711128853 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247c1a1da0 con 0x7f247c106ec0 2024-05-14T15:21:48.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.676+0000 7f2480a00700 1 --2- 172.21.15.69:0/1711128853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f247c106570 0x7f247c19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:21:48.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.677+0000 7f247be00700 1 --2- 172.21.15.69:0/1711128853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f247c106ec0 0x7f247c19d4c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f246800e940 tx=0x7f246800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:48.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.677+0000 7f2479600700 1 -- 172.21.15.69:0/1711128853 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246800cbd0 con 0x7f247c106ec0 2024-05-14T15:21:48.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.677+0000 7f2479600700 1 -- 172.21.15.69:0/1711128853 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f246800ee90 con 0x7f247c106ec0 2024-05-14T15:21:48.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.677+0000 7f2479600700 1 -- 172.21.15.69:0/1711128853 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2468018680 con 0x7f247c106ec0 2024-05-14T15:21:48.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.677+0000 7f2483400700 1 -- 172.21.15.69:0/1711128853 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247c1a2030 con 0x7f247c106ec0 2024-05-14T15:21:48.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.677+0000 7f2483400700 1 -- 172.21.15.69:0/1711128853 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f247c1a2520 con 0x7f247c106ec0 2024-05-14T15:21:48.679 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.678+0000 7f2483400700 1 -- 172.21.15.69:0/1711128853 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f247c0512c0 con 0x7f247c106ec0 2024-05-14T15:21:48.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.681+0000 7f2479600700 1 -- 172.21.15.69:0/1711128853 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 149828+0+0 (secure 0 0 0) 0x7f2468010430 con 0x7f247c106ec0 2024-05-14T15:21:48.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.683+0000 7f2479600700 1 --2- 172.21.15.69:0/1711128853 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f24640b2b00 0x7f24640b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:48.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.683+0000 7f2479600700 1 -- 172.21.15.69:0/1711128853 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f24680e3190 con 0x7f247c106ec0 2024-05-14T15:21:48.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.683+0000 7f2480a00700 1 --2- 172.21.15.69:0/1711128853 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f24640b2b00 0x7f24640b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:48.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.684+0000 7f2480a00700 1 --2- 172.21.15.69:0/1711128853 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f24640b2b00 0x7f24640b5010 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2470005950 tx=0x7f24700058e0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:48.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.685+0000 7f2479600700 1 -- 172.21.15.69:0/1711128853 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f24680aa5f0 con 0x7f247c106ec0 2024-05-14T15:21:48.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:48 smithi092 ceph-mon[34729]: Updating smithi092:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/config/ceph.client.admin.keyring 2024-05-14T15:21:48.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:48 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:48 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:48 smithi092 ceph-mon[34729]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 113 B/s wr, 14 op/s 2024-05-14T15:21:48.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:48 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:48 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:48 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:48 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:48 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:48.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.969+0000 7f2483400700 1 -- 172.21.15.69:0/1711128853 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f247c02e5f0 con 0x7f247c106ec0 2024-05-14T15:21:48.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.971+0000 7f2479600700 1 -- 172.21.15.69:0/1711128853 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) ==== 94+0+11932 (secure 0 0 0) 0x7f24680a9ef0 con 0x7f247c106ec0 2024-05-14T15:21:48.971 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:21:48.972 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":30,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T15:16:11.716543+0000","modified":"2024-05-14T15:21:36.935970+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34490,"mds_1":34460,"mds_2":34433,"mds_3":34409,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":31,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":35,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34490":{"gid":34490,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34490,"qdb_cluster":[34490,34460,34409,24451,34433]},"id":1}]} 2024-05-14T15:21:48.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.974+0000 7f2483400700 1 -- 172.21.15.69:0/1711128853 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f24640b2b00 msgr2=0x7f24640b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:48.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.974+0000 7f2483400700 1 --2- 172.21.15.69:0/1711128853 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f24640b2b00 0x7f24640b5010 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2470005950 tx=0x7f24700058e0 comp rx=0 tx=0).stop 2024-05-14T15:21:48.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.974+0000 7f2483400700 1 -- 172.21.15.69:0/1711128853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f247c106ec0 msgr2=0x7f247c19d4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:48.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.974+0000 7f2483400700 1 --2- 172.21.15.69:0/1711128853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f247c106ec0 0x7f247c19d4c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f246800e940 tx=0x7f246800ec50 comp rx=0 tx=0).stop 2024-05-14T15:21:48.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.974+0000 7f2483400700 1 -- 172.21.15.69:0/1711128853 shutdown_connections 2024-05-14T15:21:48.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.974+0000 7f2483400700 1 --2- 172.21.15.69:0/1711128853 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f24640b2b00 0x7f24640b5010 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:48.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.974+0000 7f2483400700 1 --2- 172.21.15.69:0/1711128853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f247c10c5b0 0x7f247c1a1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:48.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.974+0000 7f2483400700 1 --2- 172.21.15.69:0/1711128853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f247c106570 0x7f247c19cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:48.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.974+0000 7f2483400700 1 --2- 172.21.15.69:0/1711128853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f247c106ec0 0x7f247c19d4c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:48.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.974+0000 7f2483400700 1 -- 172.21.15.69:0/1711128853 >> 172.21.15.69:0/1711128853 conn(0x7f247c102050 msgr2=0x7f247c1037f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:48.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.974+0000 7f2483400700 1 -- 172.21.15.69:0/1711128853 shutdown_connections 2024-05-14T15:21:48.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:48.975+0000 7f2483400700 1 -- 172.21.15.69:0/1711128853 wait complete. 2024-05-14T15:21:48.976 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 30 2024-05-14T15:21:49.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:49 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:49.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:49 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:49.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:49 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:49.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:49 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:49.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:49 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1711128853' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:21:49.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:49 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:49.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:49 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:49.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:49 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:49.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:49 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:49.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:49 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1711128853' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:21:49.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:49 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:49.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:49 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:49.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:49 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:49.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:49 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:49.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:49 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1711128853' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:21:49.946 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd dump --format=json 2024-05-14T15:21:50.389 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:21:50.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:50 smithi203 ceph-mon[34567]: pgmap v9: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 93 B/s wr, 16 op/s 2024-05-14T15:21:50.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:50 smithi092 ceph-mon[34729]: pgmap v9: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 93 B/s wr, 16 op/s 2024-05-14T15:21:50.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:50 smithi069 ceph-mon[31270]: pgmap v9: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 93 B/s wr, 16 op/s 2024-05-14T15:21:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.905+0000 7f7dd3800700 1 -- 172.21.15.69:0/4216045615 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dcc1045f0 msgr2=0x7f7dcc104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.905+0000 7f7dd3800700 1 --2- 172.21.15.69:0/4216045615 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dcc1045f0 0x7f7dcc104a00 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f7dc00099c0 tx=0x7f7dc0009cd0 comp rx=0 tx=0).stop 2024-05-14T15:21:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.905+0000 7f7dd3800700 1 -- 172.21.15.69:0/4216045615 shutdown_connections 2024-05-14T15:21:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.905+0000 7f7dd3800700 1 --2- 172.21.15.69:0/4216045615 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dcc1045f0 0x7f7dcc104a00 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:52.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.905+0000 7f7dd3800700 1 --2- 172.21.15.69:0/4216045615 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7dcc109870 0x7f7dcc1111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:52.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.905+0000 7f7dd3800700 1 --2- 172.21.15.69:0/4216045615 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7dcc108f20 0x7f7dcc109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:52.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.905+0000 7f7dd3800700 1 -- 172.21.15.69:0/4216045615 >> 172.21.15.69:0/4216045615 conn(0x7f7dcc100040 msgr2=0x7f7dcc102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:52.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.905+0000 7f7dd3800700 1 -- 172.21.15.69:0/4216045615 shutdown_connections 2024-05-14T15:21:52.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.905+0000 7f7dd3800700 1 -- 172.21.15.69:0/4216045615 wait complete. 2024-05-14T15:21:52.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.906+0000 7f7dd3800700 1 Processor -- start 2024-05-14T15:21:52.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.907+0000 7f7dd3800700 1 -- start start 2024-05-14T15:21:52.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.907+0000 7f7dd3800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7dcc1045f0 0x7f7dcc075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.907+0000 7f7dd3800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7dcc108f20 0x7f7dcc076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.907+0000 7f7dd3800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dcc109870 0x7f7dcc076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.907+0000 7f7dd3800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc1143a0 con 0x7f7dcc109870 2024-05-14T15:21:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.907+0000 7f7dd3800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc114220 con 0x7f7dcc108f20 2024-05-14T15:21:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.907+0000 7f7dd3800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7dcc114520 con 0x7f7dcc1045f0 2024-05-14T15:21:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.907+0000 7f7dd1800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dcc109870 0x7f7dcc076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.907+0000 7f7dd1800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dcc109870 0x7f7dcc076540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56818/0 (socket says 172.21.15.69:56818) 2024-05-14T15:21:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.908+0000 7f7dd1800700 1 -- 172.21.15.69:0/2670971769 learned_addr learned my addr 172.21.15.69:0/2670971769 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.908+0000 7f7dd0e00700 1 --2- 172.21.15.69:0/2670971769 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7dcc1045f0 0x7f7dcc075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.908+0000 7f7dcbe00700 1 --2- 172.21.15.69:0/2670971769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7dcc108f20 0x7f7dcc076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.908+0000 7f7dd1800700 1 -- 172.21.15.69:0/2670971769 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7dcc1045f0 msgr2=0x7f7dcc075ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.908+0000 7f7dd1800700 1 --2- 172.21.15.69:0/2670971769 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7dcc1045f0 0x7f7dcc075ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.908+0000 7f7dd1800700 1 -- 172.21.15.69:0/2670971769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7dcc108f20 msgr2=0x7f7dcc076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.908+0000 7f7dd1800700 1 --2- 172.21.15.69:0/2670971769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7dcc108f20 0x7f7dcc076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.908+0000 7f7dd1800700 1 -- 172.21.15.69:0/2670971769 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc1a90c0 con 0x7f7dcc109870 2024-05-14T15:21:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.908+0000 7f7dd1800700 1 --2- 172.21.15.69:0/2670971769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dcc109870 0x7f7dcc076540 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4007ee0 tx=0x7f7dc400d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.909+0000 7f7dc9600700 1 -- 172.21.15.69:0/2670971769 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc400dbd0 con 0x7f7dcc109870 2024-05-14T15:21:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.909+0000 7f7dc9600700 1 -- 172.21.15.69:0/2670971769 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7dc400dd70 con 0x7f7dcc109870 2024-05-14T15:21:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.909+0000 7f7dd3800700 1 -- 172.21.15.69:0/2670971769 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc1a93b0 con 0x7f7dcc109870 2024-05-14T15:21:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.909+0000 7f7dc9600700 1 -- 172.21.15.69:0/2670971769 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40058d0 con 0x7f7dcc109870 2024-05-14T15:21:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.909+0000 7f7dd3800700 1 -- 172.21.15.69:0/2670971769 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dcc1a98a0 con 0x7f7dcc109870 2024-05-14T15:21:52.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.910+0000 7f7dd3800700 1 -- 172.21.15.69:0/2670971769 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dcc0512c0 con 0x7f7dcc109870 2024-05-14T15:21:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.912+0000 7f7dc9600700 1 -- 172.21.15.69:0/2670971769 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 149828+0+0 (secure 0 0 0) 0x7f7dc401a020 con 0x7f7dcc109870 2024-05-14T15:21:52.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.914+0000 7f7dc9600700 1 --2- 172.21.15.69:0/2670971769 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7db40b2a80 0x7f7db40b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:52.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.914+0000 7f7dc9600700 1 -- 172.21.15.69:0/2670971769 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f7dc40e2320 con 0x7f7dcc109870 2024-05-14T15:21:52.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.914+0000 7f7dd0e00700 1 --2- 172.21.15.69:0/2670971769 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7db40b2a80 0x7f7db40b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:52.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.915+0000 7f7dd0e00700 1 --2- 172.21.15.69:0/2670971769 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7db40b2a80 0x7f7db40b4f90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0000c00 tx=0x7f7dc0005fb0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:52.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:52.919+0000 7f7dc9600700 1 -- 172.21.15.69:0/2670971769 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f7dc4010070 con 0x7f7dcc109870 2024-05-14T15:21:53.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:53.153+0000 7f7dd3800700 1 -- 172.21.15.69:0/2670971769 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7dcc02e5f0 con 0x7f7dcc109870 2024-05-14T15:21:53.154 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:52 smithi069 ceph-mon[31270]: pgmap v10: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 85 B/s wr, 15 op/s 2024-05-14T15:21:53.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:53.156+0000 7f7dc9600700 1 -- 172.21.15.69:0/2670971769 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v92) ==== 74+0+25237 (secure 0 0 0) 0x7f7dc40a9780 con 0x7f7dcc109870 2024-05-14T15:21:53.156 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:21:53.156 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":92,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","created":"2024-05-14T15:04:32.074994+0000","modified":"2024-05-14T15:21:37.785065+0000","last_up_change":"2024-05-14T15:14:44.049523+0000","last_in_change":"2024-05-14T15:14:16.752653+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:09:03.561841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:16:02.641690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:16:06.949687+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:16:20.891122+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8640de99-c23a-494e-a100-aafd04fe1867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6803","nonce":301095601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6805","nonce":301095601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6809","nonce":301095601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6807","nonce":301095601}]},"public_addr":"172.21.15.69:6803/301095601","cluster_addr":"172.21.15.69:6805/301095601","heartbeat_back_addr":"172.21.15.69:6809/301095601","heartbeat_front_addr":"172.21.15.69:6807/301095601","state":["exists","up"]},{"osd":1,"uuid":"89f78a32-7afb-49f3-9287-5478a1cc8829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6801","nonce":2774122776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6803","nonce":2774122776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6807","nonce":2774122776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6805","nonce":2774122776}]},"public_addr":"172.21.15.92:6801/2774122776","cluster_addr":"172.21.15.92:6803/2774122776","heartbeat_back_addr":"172.21.15.92:6807/2774122776","heartbeat_front_addr":"172.21.15.92:6805/2774122776","state":["exists","up"]},{"osd":2,"uuid":"a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6801","nonce":2836920513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6803","nonce":2836920513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6807","nonce":2836920513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6805","nonce":2836920513}]},"public_addr":"172.21.15.203:6801/2836920513","cluster_addr":"172.21.15.203:6803/2836920513","heartbeat_back_addr":"172.21.15.203:6807/2836920513","heartbeat_front_addr":"172.21.15.203:6805/2836920513","state":["exists","up"]},{"osd":3,"uuid":"81409850-de26-4520-972c-31a716adf4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6811","nonce":680308620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6813","nonce":680308620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6817","nonce":680308620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6815","nonce":680308620}]},"public_addr":"172.21.15.69:6811/680308620","cluster_addr":"172.21.15.69:6813/680308620","heartbeat_back_addr":"172.21.15.69:6817/680308620","heartbeat_front_addr":"172.21.15.69:6815/680308620","state":["exists","up"]},{"osd":4,"uuid":"9aa3a6b0-cc63-4eae-8416-8ab630994985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6809","nonce":1071971048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6811","nonce":1071971048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6815","nonce":1071971048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6813","nonce":1071971048}]},"public_addr":"172.21.15.92:6809/1071971048","cluster_addr":"172.21.15.92:6811/1071971048","heartbeat_back_addr":"172.21.15.92:6815/1071971048","heartbeat_front_addr":"172.21.15.92:6813/1071971048","state":["exists","up"]},{"osd":5,"uuid":"f7fcde57-e280-494b-a45f-8fa007ed9ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6809","nonce":1404230851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6811","nonce":1404230851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6815","nonce":1404230851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6813","nonce":1404230851}]},"public_addr":"172.21.15.203:6809/1404230851","cluster_addr":"172.21.15.203:6811/1404230851","heartbeat_back_addr":"172.21.15.203:6815/1404230851","heartbeat_front_addr":"172.21.15.203:6813/1404230851","state":["exists","up"]},{"osd":6,"uuid":"86f1373a-3b39-4a7f-b14c-9bf8695c6b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6819","nonce":1213427819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6821","nonce":1213427819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6825","nonce":1213427819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6823","nonce":1213427819}]},"public_addr":"172.21.15.69:6819/1213427819","cluster_addr":"172.21.15.69:6821/1213427819","heartbeat_back_addr":"172.21.15.69:6825/1213427819","heartbeat_front_addr":"172.21.15.69:6823/1213427819","state":["exists","up"]},{"osd":7,"uuid":"e790fbf1-3e34-4950-bdfa-cf1adbd451c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6817","nonce":4274774582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6819","nonce":4274774582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6823","nonce":4274774582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6821","nonce":4274774582}]},"public_addr":"172.21.15.92:6817/4274774582","cluster_addr":"172.21.15.92:6819/4274774582","heartbeat_back_addr":"172.21.15.92:6823/4274774582","heartbeat_front_addr":"172.21.15.92:6821/4274774582","state":["exists","up"]},{"osd":8,"uuid":"65019fee-6b18-4d13-841a-2e3acb51f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6817","nonce":2480959249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6819","nonce":2480959249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6823","nonce":2480959249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6821","nonce":2480959249}]},"public_addr":"172.21.15.203:6817/2480959249","cluster_addr":"172.21.15.203:6819/2480959249","heartbeat_back_addr":"172.21.15.203:6823/2480959249","heartbeat_front_addr":"172.21.15.203:6821/2480959249","state":["exists","up"]},{"osd":9,"uuid":"b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6827","nonce":2649966866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6829","nonce":2649966866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6833","nonce":2649966866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6831","nonce":2649966866}]},"public_addr":"172.21.15.69:6827/2649966866","cluster_addr":"172.21.15.69:6829/2649966866","heartbeat_back_addr":"172.21.15.69:6833/2649966866","heartbeat_front_addr":"172.21.15.69:6831/2649966866","state":["exists","up"]},{"osd":10,"uuid":"45287823-f7ea-431f-ac01-a72762b01a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6825","nonce":3650822776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6827","nonce":3650822776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6831","nonce":3650822776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6829","nonce":3650822776}]},"public_addr":"172.21.15.92:6825/3650822776","cluster_addr":"172.21.15.92:6827/3650822776","heartbeat_back_addr":"172.21.15.92:6831/3650822776","heartbeat_front_addr":"172.21.15.92:6829/3650822776","state":["exists","up"]},{"osd":11,"uuid":"2f3a10f9-2414-4151-b1cf-3db68b2a66fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6825","nonce":2590258806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6827","nonce":2590258806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6831","nonce":2590258806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6829","nonce":2590258806}]},"public_addr":"172.21.15.203:6825/2590258806","cluster_addr":"172.21.15.203:6827/2590258806","heartbeat_back_addr":"172.21.15.203:6831/2590258806","heartbeat_front_addr":"172.21.15.203:6829/2590258806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:07:50.047712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:08:25.223293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:01.269713+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:38.679607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:16.161314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:53.323450+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:11:31.930106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:10.173015+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:48.056752+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:13:25.780142+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:03.705208+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:41.267371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":5,"to":6}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/979899385":"2024-05-15T15:21:37.785013+0000","172.21.15.69:0/3660048780":"2024-05-15T15:21:37.785013+0000","172.21.15.69:0/151981233":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/3776172313":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/2537958790":"2024-05-15T15:21:37.785013+0000","172.21.15.69:0/3403928589":"2024-05-15T15:21:37.785013+0000","172.21.15.69:0/1288620257":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/2718114316":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/865506483":"2024-05-15T15:21:37.785013+0000","172.21.15.69:0/1655882616":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/4183332474":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/2806878946":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/2537958790":"2024-05-15T15:21:37.785013+0000","172.21.15.69:6800/2718114316":"2024-05-15T15:05:41.383453+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:21:53.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:53.159+0000 7f7dd3800700 1 -- 172.21.15.69:0/2670971769 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7db40b2a80 msgr2=0x7f7db40b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:53.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:53.159+0000 7f7dd3800700 1 --2- 172.21.15.69:0/2670971769 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7db40b2a80 0x7f7db40b4f90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f7dc0000c00 tx=0x7f7dc0005fb0 comp rx=0 tx=0).stop 2024-05-14T15:21:53.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:53.159+0000 7f7dd3800700 1 -- 172.21.15.69:0/2670971769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dcc109870 msgr2=0x7f7dcc076540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:53.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:53.159+0000 7f7dd3800700 1 --2- 172.21.15.69:0/2670971769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dcc109870 0x7f7dcc076540 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4007ee0 tx=0x7f7dc400d3b0 comp rx=0 tx=0).stop 2024-05-14T15:21:53.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:53.159+0000 7f7dd3800700 1 -- 172.21.15.69:0/2670971769 shutdown_connections 2024-05-14T15:21:53.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:53.159+0000 7f7dd3800700 1 --2- 172.21.15.69:0/2670971769 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7db40b2a80 0x7f7db40b4f90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:53.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:53.159+0000 7f7dd3800700 1 --2- 172.21.15.69:0/2670971769 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7dcc109870 0x7f7dcc076540 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:53.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:53.159+0000 7f7dd3800700 1 --2- 172.21.15.69:0/2670971769 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7dcc1045f0 0x7f7dcc075ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:53.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:53.159+0000 7f7dd3800700 1 --2- 172.21.15.69:0/2670971769 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7dcc108f20 0x7f7dcc076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:53.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:53.159+0000 7f7dd3800700 1 -- 172.21.15.69:0/2670971769 >> 172.21.15.69:0/2670971769 conn(0x7f7dcc100040 msgr2=0x7f7dcc102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:53.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:53.159+0000 7f7dd3800700 1 -- 172.21.15.69:0/2670971769 shutdown_connections 2024-05-14T15:21:53.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:53.159+0000 7f7dd3800700 1 -- 172.21.15.69:0/2670971769 wait complete. 2024-05-14T15:21:53.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:52 smithi092 ceph-mon[34729]: pgmap v10: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 85 B/s wr, 15 op/s 2024-05-14T15:21:53.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:52 smithi203 ceph-mon[34567]: pgmap v10: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 85 B/s wr, 15 op/s 2024-05-14T15:21:54.155 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:53 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2670971769' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:21:54.159 DEBUG:tasks.fwd_scrub:Yielding 2024-05-14T15:21:54.159 INFO:teuthology.run_tasks:Running task exec... 2024-05-14T15:21:54.171 INFO:teuthology.task.exec:Executing custom commands... 2024-05-14T15:21:54.171 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2024-05-14T15:21:54.172 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-05-14T15:21:54.172 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-05-14T15:21:54.172 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-14T15:21:54.172 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-14T15:21:54.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:53 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2670971769' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:21:54.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:53 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2670971769' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:21:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.434+0000 7f5f77e00640 1 -- 172.21.15.69:0/702512465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f7810b680 msgr2=0x7f5f7810daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:54.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.434+0000 7f5f77e00640 1 --2- 172.21.15.69:0/702512465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f7810b680 0x7f5f7810daa0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5f64009900 tx=0x7f5f6402a510 comp rx=0 tx=0).stop 2024-05-14T15:21:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.434+0000 7f5f77e00640 1 -- 172.21.15.69:0/702512465 shutdown_connections 2024-05-14T15:21:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.434+0000 7f5f77e00640 1 --2- 172.21.15.69:0/702512465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f7810e030 0x7f5f78110520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.434+0000 7f5f77e00640 1 --2- 172.21.15.69:0/702512465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f7810b680 0x7f5f7810daa0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.434+0000 7f5f77e00640 1 --2- 172.21.15.69:0/702512465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f78104c20 0x7f5f78105030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.434+0000 7f5f77e00640 1 -- 172.21.15.69:0/702512465 >> 172.21.15.69:0/702512465 conn(0x7f5f780fe220 msgr2=0x7f5f78100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.434+0000 7f5f77e00640 1 -- 172.21.15.69:0/702512465 shutdown_connections 2024-05-14T15:21:54.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.434+0000 7f5f77e00640 1 -- 172.21.15.69:0/702512465 wait complete. 2024-05-14T15:21:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.436+0000 7f5f77e00640 1 Processor -- start 2024-05-14T15:21:54.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.436+0000 7f5f77e00640 1 -- start start 2024-05-14T15:21:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.437+0000 7f5f77e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f78104c20 0x7f5f781a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.437+0000 7f5f77e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f7810b680 0x7f5f781a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.437+0000 7f5f77e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f7810e030 0x7f5f7819c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.437+0000 7f5f77e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5f78113b90 con 0x7f5f7810e030 2024-05-14T15:21:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.437+0000 7f5f77e00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5f78113a10 con 0x7f5f78104c20 2024-05-14T15:21:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.437+0000 7f5f77e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5f78113d10 con 0x7f5f7810b680 2024-05-14T15:21:54.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.437+0000 7f5f77400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f7810e030 0x7f5f7819c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:54.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.437+0000 7f5f77400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f7810e030 0x7f5f7819c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56830/0 (socket says 172.21.15.69:56830) 2024-05-14T15:21:54.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.437+0000 7f5f77400640 1 -- 172.21.15.69:0/3635466450 learned_addr learned my addr 172.21.15.69:0/3635466450 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:54.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.437+0000 7f5f76a00640 1 --2- 172.21.15.69:0/3635466450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f78104c20 0x7f5f781a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:54.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.437+0000 7f5f76000640 1 --2- 172.21.15.69:0/3635466450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f7810b680 0x7f5f781a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:54.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.438+0000 7f5f77400640 1 -- 172.21.15.69:0/3635466450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f7810b680 msgr2=0x7f5f781a2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:54.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.438+0000 7f5f77400640 1 --2- 172.21.15.69:0/3635466450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f7810b680 0x7f5f781a2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:54.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.438+0000 7f5f77400640 1 -- 172.21.15.69:0/3635466450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f78104c20 msgr2=0x7f5f781a24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:54.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.438+0000 7f5f77400640 1 --2- 172.21.15.69:0/3635466450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f78104c20 0x7f5f781a24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:54.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.438+0000 7f5f77400640 1 -- 172.21.15.69:0/3635466450 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f7819ccb0 con 0x7f5f7810e030 2024-05-14T15:21:54.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.438+0000 7f5f77400640 1 --2- 172.21.15.69:0/3635466450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f7810e030 0x7f5f7819c670 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000cce0 tx=0x7f5f7000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:54.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.438+0000 7f5f6f400640 1 -- 172.21.15.69:0/3635466450 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f7000f450 con 0x7f5f7810e030 2024-05-14T15:21:54.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.439+0000 7f5f77e00640 1 -- 172.21.15.69:0/3635466450 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f7819cfa0 con 0x7f5f7810e030 2024-05-14T15:21:54.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.439+0000 7f5f6f400640 1 -- 172.21.15.69:0/3635466450 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5f7000fa80 con 0x7f5f7810e030 2024-05-14T15:21:54.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.439+0000 7f5f6f400640 1 -- 172.21.15.69:0/3635466450 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f70018ad0 con 0x7f5f7810e030 2024-05-14T15:21:54.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.439+0000 7f5f77e00640 1 -- 172.21.15.69:0/3635466450 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f781a9290 con 0x7f5f7810e030 2024-05-14T15:21:54.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.440+0000 7f5f77e00640 1 -- 172.21.15.69:0/3635466450 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f7806ad70 con 0x7f5f7810e030 2024-05-14T15:21:54.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.442+0000 7f5f6f400640 1 -- 172.21.15.69:0/3635466450 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 149828+0+0 (secure 0 0 0) 0x7f5f7000f5f0 con 0x7f5f7810e030 2024-05-14T15:21:54.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.444+0000 7f5f6f400640 1 --2- 172.21.15.69:0/3635466450 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5f5c0b2a60 0x7f5f5c0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:54.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.444+0000 7f5f6f400640 1 -- 172.21.15.69:0/3635466450 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5f700e3340 con 0x7f5f7810e030 2024-05-14T15:21:54.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.444+0000 7f5f76a00640 1 --2- 172.21.15.69:0/3635466450 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5f5c0b2a60 0x7f5f5c0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:54.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.445+0000 7f5f76a00640 1 --2- 172.21.15.69:0/3635466450 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5f5c0b2a60 0x7f5f5c0b4f70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5f68005fd0 tx=0x7f5f6800b390 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:54.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.446+0000 7f5f6f400640 1 -- 172.21.15.69:0/3635466450 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f5f70014030 con 0x7f5f7810e030 2024-05-14T15:21:54.623 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:21:54.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.683+0000 7f5f77e00640 1 -- 172.21.15.69:0/3635466450 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f5f781a94d0 con 0x7f5f7810e030 2024-05-14T15:21:54.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.689+0000 7f5f6f400640 1 -- 172.21.15.69:0/3635466450 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v33)=0 v33) ==== 129+0+0 (secure 0 0 0) 0x7f5f700aa910 con 0x7f5f7810e030 2024-05-14T15:21:54.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.693+0000 7f5f77e00640 1 -- 172.21.15.69:0/3635466450 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5f5c0b2a60 msgr2=0x7f5f5c0b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:54.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.693+0000 7f5f77e00640 1 --2- 172.21.15.69:0/3635466450 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5f5c0b2a60 0x7f5f5c0b4f70 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f5f68005fd0 tx=0x7f5f6800b390 comp rx=0 tx=0).stop 2024-05-14T15:21:54.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.693+0000 7f5f77e00640 1 -- 172.21.15.69:0/3635466450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f7810e030 msgr2=0x7f5f7819c670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:54.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.693+0000 7f5f77e00640 1 --2- 172.21.15.69:0/3635466450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f7810e030 0x7f5f7819c670 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5f7000cce0 tx=0x7f5f7000a620 comp rx=0 tx=0).stop 2024-05-14T15:21:54.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.693+0000 7f5f77e00640 1 -- 172.21.15.69:0/3635466450 shutdown_connections 2024-05-14T15:21:54.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.693+0000 7f5f77e00640 1 --2- 172.21.15.69:0/3635466450 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5f5c0b2a60 0x7f5f5c0b4f70 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:54.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.693+0000 7f5f77e00640 1 --2- 172.21.15.69:0/3635466450 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f7810e030 0x7f5f7819c670 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:54.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.693+0000 7f5f77e00640 1 --2- 172.21.15.69:0/3635466450 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f7810b680 0x7f5f781a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:54.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.693+0000 7f5f77e00640 1 --2- 172.21.15.69:0/3635466450 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f78104c20 0x7f5f781a24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:54.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.693+0000 7f5f77e00640 1 -- 172.21.15.69:0/3635466450 >> 172.21.15.69:0/3635466450 conn(0x7f5f780fe220 msgr2=0x7f5f78109e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:54.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.693+0000 7f5f77e00640 1 -- 172.21.15.69:0/3635466450 shutdown_connections 2024-05-14T15:21:54.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.693+0000 7f5f77e00640 1 -- 172.21.15.69:0/3635466450 wait complete. 2024-05-14T15:21:54.724 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-05-14T15:21:54.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:54 smithi069 ceph-mon[31270]: pgmap v11: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 85 B/s wr, 15 op/s 2024-05-14T15:21:54.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:54 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3635466450' entity='client.admin' 2024-05-14T15:21:54.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:54 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:54.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:54 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:54.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:54 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:54.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:54 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:54.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.976+0000 7f92e1a00640 1 -- 172.21.15.69:0/3935999600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc109f80 msgr2=0x7f92dc103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:54.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.976+0000 7f92e1a00640 1 --2- 172.21.15.69:0/3935999600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc109f80 0x7f92dc103bc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f92c8009900 tx=0x7f92c802a410 comp rx=0 tx=0).stop 2024-05-14T15:21:54.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.976+0000 7f92e1a00640 1 -- 172.21.15.69:0/3935999600 shutdown_connections 2024-05-14T15:21:54.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.976+0000 7f92e1a00640 1 --2- 172.21.15.69:0/3935999600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92dc104230 0x7f92dc110600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:54.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.976+0000 7f92e1a00640 1 --2- 172.21.15.69:0/3935999600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc109f80 0x7f92dc103bc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:54.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.976+0000 7f92e1a00640 1 --2- 172.21.15.69:0/3935999600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92dc109ae0 0x7f92dc103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:54.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.976+0000 7f92e1a00640 1 -- 172.21.15.69:0/3935999600 >> 172.21.15.69:0/3935999600 conn(0x7f92dc079110 msgr2=0x7f92dc079550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:54.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.976+0000 7f92e1a00640 1 -- 172.21.15.69:0/3935999600 shutdown_connections 2024-05-14T15:21:54.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.976+0000 7f92e1a00640 1 -- 172.21.15.69:0/3935999600 wait complete. 2024-05-14T15:21:54.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.977+0000 7f92e1a00640 1 Processor -- start 2024-05-14T15:21:54.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.977+0000 7f92e1a00640 1 -- start start 2024-05-14T15:21:54.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92e1a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92dc104230 0x7f92dc19d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:54.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92e1a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc109ae0 0x7f92dc19db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:54.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92e1a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92dc109f80 0x7f92dc1a84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:54.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92e1a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f92dc113b80 con 0x7f92dc109ae0 2024-05-14T15:21:54.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92e1a00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f92dc113a00 con 0x7f92dc104230 2024-05-14T15:21:54.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92e1a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f92dc113d00 con 0x7f92dc109f80 2024-05-14T15:21:54.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92db400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc109ae0 0x7f92dc19db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:54.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92dbe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92dc104230 0x7f92dc19d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:54.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92db400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc109ae0 0x7f92dc19db60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56848/0 (socket says 172.21.15.69:56848) 2024-05-14T15:21:54.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92db400640 1 -- 172.21.15.69:0/3036955151 learned_addr learned my addr 172.21.15.69:0/3036955151 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:54.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92dbe00640 1 --2- 172.21.15.69:0/3036955151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92dc104230 0x7f92dc19d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:49406/0 (socket says 172.21.15.69:49406) 2024-05-14T15:21:54.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92e1000640 1 --2- 172.21.15.69:0/3036955151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92dc109f80 0x7f92dc1a84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:54.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92db400640 1 -- 172.21.15.69:0/3036955151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92dc109f80 msgr2=0x7f92dc1a84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:54.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92db400640 1 --2- 172.21.15.69:0/3036955151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92dc109f80 0x7f92dc1a84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:54.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92db400640 1 -- 172.21.15.69:0/3036955151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92dc104230 msgr2=0x7f92dc19d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:54.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92db400640 1 --2- 172.21.15.69:0/3036955151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92dc104230 0x7f92dc19d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:54.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.978+0000 7f92db400640 1 -- 172.21.15.69:0/3036955151 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92dc1a8a00 con 0x7f92dc109ae0 2024-05-14T15:21:54.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.979+0000 7f92db400640 1 --2- 172.21.15.69:0/3036955151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc109ae0 0x7f92dc19db60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f92c8005940 tx=0x7f92c80040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:54.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.979+0000 7f92d8c00640 1 -- 172.21.15.69:0/3036955151 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c803f030 con 0x7f92dc109ae0 2024-05-14T15:21:54.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.979+0000 7f92d8c00640 1 -- 172.21.15.69:0/3036955151 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f92c8003a80 con 0x7f92dc109ae0 2024-05-14T15:21:54.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.979+0000 7f92e1a00640 1 -- 172.21.15.69:0/3036955151 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92dc1a8c30 con 0x7f92dc109ae0 2024-05-14T15:21:54.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.979+0000 7f92d8c00640 1 -- 172.21.15.69:0/3036955151 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f92c8035070 con 0x7f92dc109ae0 2024-05-14T15:21:54.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.979+0000 7f92e1a00640 1 -- 172.21.15.69:0/3036955151 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92dc1a9140 con 0x7f92dc109ae0 2024-05-14T15:21:54.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.980+0000 7f92e1a00640 1 -- 172.21.15.69:0/3036955151 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92dc06a240 con 0x7f92dc109ae0 2024-05-14T15:21:54.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.983+0000 7f92d8c00640 1 -- 172.21.15.69:0/3036955151 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 149828+0+0 (secure 0 0 0) 0x7f92c8042030 con 0x7f92dc109ae0 2024-05-14T15:21:54.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.985+0000 7f92d8c00640 1 --2- 172.21.15.69:0/3036955151 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f92c00b2a60 0x7f92c00b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:54.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.985+0000 7f92d8c00640 1 -- 172.21.15.69:0/3036955151 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f92c8103460 con 0x7f92dc109ae0 2024-05-14T15:21:54.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.985+0000 7f92dbe00640 1 --2- 172.21.15.69:0/3036955151 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f92c00b2a60 0x7f92c00b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:54.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.986+0000 7f92dbe00640 1 --2- 172.21.15.69:0/3036955151 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f92c00b2a60 0x7f92c00b4f70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f92dc1047c0 tx=0x7f92cc00b390 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:54.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:54.988+0000 7f92d8c00640 1 -- 172.21.15.69:0/3036955151 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f92c80ca8c0 con 0x7f92dc109ae0 2024-05-14T15:21:55.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:54 smithi092 ceph-mon[34729]: pgmap v11: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 85 B/s wr, 15 op/s 2024-05-14T15:21:55.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:54 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3635466450' entity='client.admin' 2024-05-14T15:21:55.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:54 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:55.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:54 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:55.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:54 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:55.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:54 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:55.203 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.203+0000 7f92e1a00640 1 -- 172.21.15.69:0/3036955151 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f92dc1a9310 con 0x7f92dc109ae0 2024-05-14T15:21:55.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.210+0000 7f92d8c00640 1 -- 172.21.15.69:0/3036955151 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v34)=0 v34) ==== 138+0+0 (secure 0 0 0) 0x7f92c80ca1c0 con 0x7f92dc109ae0 2024-05-14T15:21:55.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.213+0000 7f92e1a00640 1 -- 172.21.15.69:0/3036955151 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f92c00b2a60 msgr2=0x7f92c00b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:55.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.213+0000 7f92e1a00640 1 --2- 172.21.15.69:0/3036955151 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f92c00b2a60 0x7f92c00b4f70 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f92dc1047c0 tx=0x7f92cc00b390 comp rx=0 tx=0).stop 2024-05-14T15:21:55.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.213+0000 7f92e1a00640 1 -- 172.21.15.69:0/3036955151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc109ae0 msgr2=0x7f92dc19db60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:55.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.213+0000 7f92e1a00640 1 --2- 172.21.15.69:0/3036955151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc109ae0 0x7f92dc19db60 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f92c8005940 tx=0x7f92c80040e0 comp rx=0 tx=0).stop 2024-05-14T15:21:55.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.213+0000 7f92e1a00640 1 -- 172.21.15.69:0/3036955151 shutdown_connections 2024-05-14T15:21:55.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.213+0000 7f92e1a00640 1 --2- 172.21.15.69:0/3036955151 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f92c00b2a60 0x7f92c00b4f70 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:55.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.213+0000 7f92e1a00640 1 --2- 172.21.15.69:0/3036955151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f92dc109f80 0x7f92dc1a84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:55.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.213+0000 7f92e1a00640 1 --2- 172.21.15.69:0/3036955151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f92dc109ae0 0x7f92dc19db60 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:55.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.213+0000 7f92e1a00640 1 --2- 172.21.15.69:0/3036955151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f92dc104230 0x7f92dc19d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:55.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.213+0000 7f92e1a00640 1 -- 172.21.15.69:0/3036955151 >> 172.21.15.69:0/3036955151 conn(0x7f92dc079110 msgr2=0x7f92dc1002d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:55.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.213+0000 7f92e1a00640 1 -- 172.21.15.69:0/3036955151 shutdown_connections 2024-05-14T15:21:55.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.213+0000 7f92e1a00640 1 -- 172.21.15.69:0/3036955151 wait complete. 2024-05-14T15:21:55.242 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-05-14T15:21:55.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:54 smithi203 ceph-mon[34567]: pgmap v11: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 85 B/s wr, 15 op/s 2024-05-14T15:21:55.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:54 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3635466450' entity='client.admin' 2024-05-14T15:21:55.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:54 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:55.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:54 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:55.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:54 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:55.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:54 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:55.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.497+0000 7fb69ea00640 1 -- 172.21.15.69:0/3304385157 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb698109ac0 msgr2=0x7fb698103660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:55.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.497+0000 7fb69ea00640 1 --2- 172.21.15.69:0/3304385157 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb698109ac0 0x7fb698103660 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb68c009900 tx=0x7fb68c02a410 comp rx=0 tx=0).stop 2024-05-14T15:21:55.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.497+0000 7fb69ea00640 1 -- 172.21.15.69:0/3304385157 shutdown_connections 2024-05-14T15:21:55.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.497+0000 7fb69ea00640 1 --2- 172.21.15.69:0/3304385157 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb698104210 0x7fb6981105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:55.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.497+0000 7fb69ea00640 1 --2- 172.21.15.69:0/3304385157 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb698109f60 0x7fb698103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:55.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.497+0000 7fb69ea00640 1 --2- 172.21.15.69:0/3304385157 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb698109ac0 0x7fb698103660 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:55.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.497+0000 7fb69ea00640 1 -- 172.21.15.69:0/3304385157 >> 172.21.15.69:0/3304385157 conn(0x7fb698079150 msgr2=0x7fb698079590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:55.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.497+0000 7fb69ea00640 1 -- 172.21.15.69:0/3304385157 shutdown_connections 2024-05-14T15:21:55.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.497+0000 7fb69ea00640 1 -- 172.21.15.69:0/3304385157 wait complete. 2024-05-14T15:21:55.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.498+0000 7fb69ea00640 1 Processor -- start 2024-05-14T15:21:55.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.498+0000 7fb69ea00640 1 -- start start 2024-05-14T15:21:55.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.499+0000 7fb69ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb698104210 0x7fb69819d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:55.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.499+0000 7fb69ea00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb698109ac0 0x7fb69819dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:55.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.499+0000 7fb69ea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb698109f60 0x7fb6981a8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:55.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.499+0000 7fb69ea00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb698113bc0 con 0x7fb698104210 2024-05-14T15:21:55.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.499+0000 7fb69ea00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb698113a40 con 0x7fb698109ac0 2024-05-14T15:21:55.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.499+0000 7fb69ea00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb698113d40 con 0x7fb698109f60 2024-05-14T15:21:55.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.499+0000 7fb69d600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb698104210 0x7fb69819d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:55.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.499+0000 7fb69d600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb698104210 0x7fb69819d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56874/0 (socket says 172.21.15.69:56874) 2024-05-14T15:21:55.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.499+0000 7fb69d600640 1 -- 172.21.15.69:0/1921728575 learned_addr learned my addr 172.21.15.69:0/1921728575 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:55.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.499+0000 7fb69cc00640 1 --2- 172.21.15.69:0/1921728575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb698109ac0 0x7fb69819dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:55.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.499+0000 7fb69e000640 1 --2- 172.21.15.69:0/1921728575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb698109f60 0x7fb6981a8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:55.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.499+0000 7fb69d600640 1 -- 172.21.15.69:0/1921728575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb698109f60 msgr2=0x7fb6981a8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:55.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.499+0000 7fb69d600640 1 --2- 172.21.15.69:0/1921728575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb698109f60 0x7fb6981a8520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:55.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.500+0000 7fb69d600640 1 -- 172.21.15.69:0/1921728575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb698109ac0 msgr2=0x7fb69819dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:55.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.500+0000 7fb69d600640 1 --2- 172.21.15.69:0/1921728575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb698109ac0 0x7fb69819dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:55.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.500+0000 7fb69d600640 1 -- 172.21.15.69:0/1921728575 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6981a8a60 con 0x7fb698104210 2024-05-14T15:21:55.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.500+0000 7fb69d600640 1 --2- 172.21.15.69:0/1921728575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb698104210 0x7fb69819d680 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb68c005940 tx=0x7fb68c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:55.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.500+0000 7fb696000640 1 -- 172.21.15.69:0/1921728575 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c03f030 con 0x7fb698104210 2024-05-14T15:21:55.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.500+0000 7fb696000640 1 -- 172.21.15.69:0/1921728575 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb68c003c90 con 0x7fb698104210 2024-05-14T15:21:55.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.500+0000 7fb69ea00640 1 -- 172.21.15.69:0/1921728575 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6981a8c90 con 0x7fb698104210 2024-05-14T15:21:55.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.500+0000 7fb696000640 1 -- 172.21.15.69:0/1921728575 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb68c035070 con 0x7fb698104210 2024-05-14T15:21:55.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.500+0000 7fb69ea00640 1 -- 172.21.15.69:0/1921728575 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6981a9150 con 0x7fb698104210 2024-05-14T15:21:55.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.502+0000 7fb69ea00640 1 -- 172.21.15.69:0/1921728575 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb69806a240 con 0x7fb698104210 2024-05-14T15:21:55.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.505+0000 7fb696000640 1 -- 172.21.15.69:0/1921728575 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 149828+0+0 (secure 0 0 0) 0x7fb68c042030 con 0x7fb698104210 2024-05-14T15:21:55.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.507+0000 7fb696000640 1 --2- 172.21.15.69:0/1921728575 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb6800b29e0 0x7fb6800b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:55.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.508+0000 7fb696000640 1 -- 172.21.15.69:0/1921728575 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fb68c103550 con 0x7fb698104210 2024-05-14T15:21:55.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.508+0000 7fb69cc00640 1 --2- 172.21.15.69:0/1921728575 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb6800b29e0 0x7fb6800b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:55.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.508+0000 7fb696000640 1 -- 172.21.15.69:0/1921728575 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb68c0ca9b0 con 0x7fb698104210 2024-05-14T15:21:55.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.509+0000 7fb69cc00640 1 --2- 172.21.15.69:0/1921728575 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb6800b29e0 0x7fb6800b4ef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb698076dd0 tx=0x7fb684008040 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:55.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.726+0000 7fb69ea00640 1 -- 172.21.15.69:0/1921728575 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fb6981a9490 con 0x7fb698104210 2024-05-14T15:21:55.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.735+0000 7fb696000640 1 -- 172.21.15.69:0/1921728575 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v35)=0 v35) ==== 133+0+0 (secure 0 0 0) 0x7fb68c0ca2b0 con 0x7fb698104210 2024-05-14T15:21:55.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.739+0000 7fb69ea00640 1 -- 172.21.15.69:0/1921728575 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb6800b29e0 msgr2=0x7fb6800b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:55.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.739+0000 7fb69ea00640 1 --2- 172.21.15.69:0/1921728575 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb6800b29e0 0x7fb6800b4ef0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb698076dd0 tx=0x7fb684008040 comp rx=0 tx=0).stop 2024-05-14T15:21:55.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.739+0000 7fb69ea00640 1 -- 172.21.15.69:0/1921728575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb698104210 msgr2=0x7fb69819d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:55.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.739+0000 7fb69ea00640 1 --2- 172.21.15.69:0/1921728575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb698104210 0x7fb69819d680 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb68c005940 tx=0x7fb68c0042f0 comp rx=0 tx=0).stop 2024-05-14T15:21:55.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.740+0000 7fb69ea00640 1 -- 172.21.15.69:0/1921728575 shutdown_connections 2024-05-14T15:21:55.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.740+0000 7fb69ea00640 1 --2- 172.21.15.69:0/1921728575 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb6800b29e0 0x7fb6800b4ef0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:55.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.740+0000 7fb69ea00640 1 --2- 172.21.15.69:0/1921728575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb698109f60 0x7fb6981a8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:55.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.740+0000 7fb69ea00640 1 --2- 172.21.15.69:0/1921728575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb698109ac0 0x7fb69819dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:55.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.740+0000 7fb69ea00640 1 --2- 172.21.15.69:0/1921728575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb698104210 0x7fb69819d680 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:55.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.740+0000 7fb69ea00640 1 -- 172.21.15.69:0/1921728575 >> 172.21.15.69:0/1921728575 conn(0x7fb698079150 msgr2=0x7fb698102280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:55.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.740+0000 7fb69ea00640 1 -- 172.21.15.69:0/1921728575 shutdown_connections 2024-05-14T15:21:55.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:55.741+0000 7fb69ea00640 1 -- 172.21.15.69:0/1921728575 wait complete. 2024-05-14T15:21:55.776 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-05-14T15:21:56.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.028+0000 7fdbf3600640 1 -- 172.21.15.69:0/2569800845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec104da0 msgr2=0x7fdbec1051b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:56.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.028+0000 7fdbf3600640 1 --2- 172.21.15.69:0/2569800845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec104da0 0x7fdbec1051b0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009900 tx=0x7fdbe002a3f0 comp rx=0 tx=0).stop 2024-05-14T15:21:56.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.029+0000 7fdbf3600640 1 -- 172.21.15.69:0/2569800845 shutdown_connections 2024-05-14T15:21:56.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.029+0000 7fdbf3600640 1 --2- 172.21.15.69:0/2569800845 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbec10e1f0 0x7fdbec1106e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:56.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.029+0000 7fdbf3600640 1 --2- 172.21.15.69:0/2569800845 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbec10b800 0x7fdbec10dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:56.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.029+0000 7fdbf3600640 1 --2- 172.21.15.69:0/2569800845 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec104da0 0x7fdbec1051b0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:56.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.029+0000 7fdbf3600640 1 -- 172.21.15.69:0/2569800845 >> 172.21.15.69:0/2569800845 conn(0x7fdbec0782e0 msgr2=0x7fdbec078720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:56.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.029+0000 7fdbf3600640 1 -- 172.21.15.69:0/2569800845 shutdown_connections 2024-05-14T15:21:56.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.029+0000 7fdbf3600640 1 -- 172.21.15.69:0/2569800845 wait complete. 2024-05-14T15:21:56.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.030+0000 7fdbf3600640 1 Processor -- start 2024-05-14T15:21:56.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.030+0000 7fdbf3600640 1 -- start start 2024-05-14T15:21:56.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.030+0000 7fdbf3600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec104da0 0x7fdbec1a25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:56.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.030+0000 7fdbf3600640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbec10b800 0x7fdbec1a2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:56.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.030+0000 7fdbf3600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbec10e1f0 0x7fdbec19c810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:56.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.030+0000 7fdbf3600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fdbec113d50 con 0x7fdbec104da0 2024-05-14T15:21:56.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.030+0000 7fdbf3600640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdbec113bd0 con 0x7fdbec10b800 2024-05-14T15:21:56.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.030+0000 7fdbf3600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdbec113ed0 con 0x7fdbec10e1f0 2024-05-14T15:21:56.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.031+0000 7fdbf0c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec104da0 0x7fdbec1a25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:56.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.031+0000 7fdbf0c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec104da0 0x7fdbec1a25e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56890/0 (socket says 172.21.15.69:56890) 2024-05-14T15:21:56.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.031+0000 7fdbf0c00640 1 -- 172.21.15.69:0/3073836709 learned_addr learned my addr 172.21.15.69:0/3073836709 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:56.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.031+0000 7fdbebe00640 1 --2- 172.21.15.69:0/3073836709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbec10b800 0x7fdbec1a2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:56.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.031+0000 7fdbf1600640 1 --2- 172.21.15.69:0/3073836709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbec10e1f0 0x7fdbec19c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:56.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.031+0000 7fdbf0c00640 1 -- 172.21.15.69:0/3073836709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbec10e1f0 msgr2=0x7fdbec19c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:56.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.031+0000 7fdbf0c00640 1 --2- 172.21.15.69:0/3073836709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbec10e1f0 0x7fdbec19c810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:56.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.031+0000 7fdbf0c00640 1 -- 172.21.15.69:0/3073836709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbec10b800 msgr2=0x7fdbec1a2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:56.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.031+0000 7fdbf0c00640 1 --2- 172.21.15.69:0/3073836709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbec10b800 0x7fdbec1a2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:56.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.031+0000 7fdbf0c00640 1 -- 172.21.15.69:0/3073836709 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbec19ce80 con 0x7fdbec104da0 2024-05-14T15:21:56.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.031+0000 7fdbf1600640 1 --2- 172.21.15.69:0/3073836709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbec10e1f0 0x7fdbec19c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:56.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.032+0000 7fdbf0c00640 1 --2- 172.21.15.69:0/3073836709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec104da0 0x7fdbec1a25e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdbe002a910 tx=0x7fdbe0003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:56.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.032+0000 7fdbe9600640 1 -- 172.21.15.69:0/3073836709 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe003f070 con 0x7fdbec104da0 2024-05-14T15:21:56.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.032+0000 7fdbe9600640 1 -- 172.21.15.69:0/3073836709 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdbe003bdc0 con 0x7fdbec104da0 2024-05-14T15:21:56.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.032+0000 7fdbf3600640 1 -- 172.21.15.69:0/3073836709 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbec19d110 con 0x7fdbec104da0 2024-05-14T15:21:56.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.032+0000 7fdbe9600640 1 -- 172.21.15.69:0/3073836709 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0035030 con 0x7fdbec104da0 2024-05-14T15:21:56.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.032+0000 7fdbf3600640 1 -- 172.21.15.69:0/3073836709 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbec19d600 con 0x7fdbec104da0 2024-05-14T15:21:56.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.033+0000 7fdbf3600640 1 -- 172.21.15.69:0/3073836709 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbec06add0 con 0x7fdbec104da0 2024-05-14T15:21:56.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.036+0000 7fdbe9600640 1 -- 172.21.15.69:0/3073836709 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 149828+0+0 (secure 0 0 0) 0x7fdbe0042070 con 0x7fdbec104da0 2024-05-14T15:21:56.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.038+0000 7fdbe9600640 1 --2- 172.21.15.69:0/3073836709 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdbd40b29e0 0x7fdbd40b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:56.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.038+0000 7fdbe9600640 1 -- 172.21.15.69:0/3073836709 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fdbe0103b20 con 0x7fdbec104da0 2024-05-14T15:21:56.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.038+0000 7fdbebe00640 1 --2- 172.21.15.69:0/3073836709 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdbd40b29e0 0x7fdbd40b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:56.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.039+0000 7fdbebe00640 1 --2- 172.21.15.69:0/3073836709 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdbd40b29e0 0x7fdbd40b4ef0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8005fd0 tx=0x7fdbd8005e20 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:56.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.041+0000 7fdbe9600640 1 -- 172.21.15.69:0/3073836709 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fdbe00cb010 con 0x7fdbec104da0 2024-05-14T15:21:56.280 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.280+0000 7fdbf3600640 1 -- 172.21.15.69:0/3073836709 --> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fdbec10f6e0 con 0x7fdbd40b29e0 2024-05-14T15:21:56.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:56 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3036955151' entity='client.admin' 2024-05-14T15:21:56.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:56 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:56.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:56 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:56.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:56 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:56.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:56 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:56.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:56 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1921728575' entity='client.admin' 2024-05-14T15:21:56.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:56 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:56.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:56 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:56.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:56 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:56.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:56 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:56.425 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:56 smithi069 ceph-mon[31270]: pgmap v12: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 85 B/s wr, 19 op/s 2024-05-14T15:21:56.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.442+0000 7fdbe9600640 1 -- 172.21.15.69:0/3073836709 <== mgr.34991 v2:172.21.15.69:6800/1271399048 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fdbec10f6e0 con 0x7fdbd40b29e0 2024-05-14T15:21:56.442 INFO:teuthology.orchestra.run.smithi069.stdout:Schedule set for path / 2024-05-14T15:21:56.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.444+0000 7fdbf3600640 1 -- 172.21.15.69:0/3073836709 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdbd40b29e0 msgr2=0x7fdbd40b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:56.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.444+0000 7fdbf3600640 1 --2- 172.21.15.69:0/3073836709 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdbd40b29e0 0x7fdbd40b4ef0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdbd8005fd0 tx=0x7fdbd8005e20 comp rx=0 tx=0).stop 2024-05-14T15:21:56.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.444+0000 7fdbf3600640 1 -- 172.21.15.69:0/3073836709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec104da0 msgr2=0x7fdbec1a25e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:56.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.444+0000 7fdbf3600640 1 --2- 172.21.15.69:0/3073836709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec104da0 0x7fdbec1a25e0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fdbe002a910 tx=0x7fdbe0003d60 comp rx=0 tx=0).stop 2024-05-14T15:21:56.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.444+0000 7fdbf3600640 1 -- 172.21.15.69:0/3073836709 shutdown_connections 2024-05-14T15:21:56.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.444+0000 7fdbf3600640 1 --2- 172.21.15.69:0/3073836709 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdbd40b29e0 0x7fdbd40b4ef0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:56.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.444+0000 7fdbf3600640 1 --2- 172.21.15.69:0/3073836709 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdbec10e1f0 0x7fdbec19c810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:56.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.444+0000 7fdbf3600640 1 --2- 172.21.15.69:0/3073836709 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdbec10b800 0x7fdbec1a2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:56.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.444+0000 7fdbf3600640 1 --2- 172.21.15.69:0/3073836709 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdbec104da0 0x7fdbec1a25e0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:56.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.444+0000 7fdbf3600640 1 -- 172.21.15.69:0/3073836709 >> 172.21.15.69:0/3073836709 conn(0x7fdbec0782e0 msgr2=0x7fdbec10a0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:56.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.445+0000 7fdbf3600640 1 -- 172.21.15.69:0/3073836709 shutdown_connections 2024-05-14T15:21:56.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.445+0000 7fdbf3600640 1 -- 172.21.15.69:0/3073836709 wait complete. 2024-05-14T15:21:56.468 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-05-14T15:21:56.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:56 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3036955151' entity='client.admin' 2024-05-14T15:21:56.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:56 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:56.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:56 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:56.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:56 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:56.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:56 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:56.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:56 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1921728575' entity='client.admin' 2024-05-14T15:21:56.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:56 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:56.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:56 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:56.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:56 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:56.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:56 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:56.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:56 smithi203 ceph-mon[34567]: pgmap v12: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 85 B/s wr, 19 op/s 2024-05-14T15:21:56.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:56 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3036955151' entity='client.admin' 2024-05-14T15:21:56.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:56 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:56.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:56 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:56.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:56 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:56.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:56 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:56.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:56 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1921728575' entity='client.admin' 2024-05-14T15:21:56.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:56 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:21:56.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:56 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:21:56.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:56 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:21:56.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:56 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:21:56.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:56 smithi092 ceph-mon[34729]: pgmap v12: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 85 B/s wr, 19 op/s 2024-05-14T15:21:56.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.722+0000 7fa843e00640 1 -- 172.21.15.69:0/485312381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa84410a8a0 msgr2=0x7fa844116b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:56.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.722+0000 7fa843e00640 1 --2- 172.21.15.69:0/485312381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa84410a8a0 0x7fa844116b60 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa83c009ca0 tx=0x7fa83c02a950 comp rx=0 tx=0).stop 2024-05-14T15:21:56.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.722+0000 7fa843e00640 1 -- 172.21.15.69:0/485312381 shutdown_connections 2024-05-14T15:21:56.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.722+0000 7fa843e00640 1 --2- 172.21.15.69:0/485312381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa84410a8a0 0x7fa844116b60 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:56.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.722+0000 7fa843e00640 1 --2- 172.21.15.69:0/485312381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa844110530 0x7fa84410a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:56.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.722+0000 7fa843e00640 1 --2- 172.21.15.69:0/485312381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa844110120 0x7fa844109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:56.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.722+0000 7fa843e00640 1 -- 172.21.15.69:0/485312381 >> 172.21.15.69:0/485312381 conn(0x7fa844076080 msgr2=0x7fa8440784a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:56.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.722+0000 7fa843e00640 1 -- 172.21.15.69:0/485312381 shutdown_connections 2024-05-14T15:21:56.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.722+0000 7fa843e00640 1 -- 172.21.15.69:0/485312381 wait complete. 2024-05-14T15:21:56.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.723+0000 7fa843e00640 1 Processor -- start 2024-05-14T15:21:56.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.723+0000 7fa843e00640 1 -- start start 2024-05-14T15:21:56.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.724+0000 7fa843e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa844110120 0x7fa8441a6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:56.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.724+0000 7fa843e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa844110530 0x7fa8441a6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:56.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.724+0000 7fa843e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8441a06f0 0x7fa8441a0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:56.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.724+0000 7fa843e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa84411a2d0 con 0x7fa844110120 2024-05-14T15:21:56.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.724+0000 7fa843e00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa84411a150 con 0x7fa8441a06f0 2024-05-14T15:21:56.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.724+0000 7fa843e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa84411a450 con 0x7fa844110530 2024-05-14T15:21:56.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.724+0000 7fa842a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa844110120 0x7fa8441a6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:56.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.724+0000 7fa842a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa844110120 0x7fa8441a6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56906/0 (socket says 172.21.15.69:56906) 2024-05-14T15:21:56.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.724+0000 7fa842a00640 1 -- 172.21.15.69:0/547905542 learned_addr learned my addr 172.21.15.69:0/547905542 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:56.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.724+0000 7fa842000640 1 --2- 172.21.15.69:0/547905542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa844110530 0x7fa8441a6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:56.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.724+0000 7fa842a00640 1 -- 172.21.15.69:0/547905542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa844110530 msgr2=0x7fa8441a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:56.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.724+0000 7fa843400640 1 --2- 172.21.15.69:0/547905542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8441a06f0 0x7fa8441a0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:56.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.724+0000 7fa842a00640 1 --2- 172.21.15.69:0/547905542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa844110530 0x7fa8441a6ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:56.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.724+0000 7fa842a00640 1 -- 172.21.15.69:0/547905542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8441a06f0 msgr2=0x7fa8441a0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:56.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.724+0000 7fa842a00640 1 --2- 172.21.15.69:0/547905542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8441a06f0 0x7fa8441a0b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:56.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.724+0000 7fa842a00640 1 -- 172.21.15.69:0/547905542 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8441a11e0 con 0x7fa844110120 2024-05-14T15:21:56.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.725+0000 7fa842a00640 1 --2- 172.21.15.69:0/547905542 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa844110120 0x7fa8441a6570 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa83400b450 tx=0x7fa83400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:56.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.725+0000 7fa83b400640 1 -- 172.21.15.69:0/547905542 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834015020 con 0x7fa844110120 2024-05-14T15:21:56.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.725+0000 7fa83b400640 1 -- 172.21.15.69:0/547905542 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa834011d20 con 0x7fa844110120 2024-05-14T15:21:56.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.725+0000 7fa83b400640 1 -- 172.21.15.69:0/547905542 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa834010e10 con 0x7fa844110120 2024-05-14T15:21:56.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.725+0000 7fa843e00640 1 -- 172.21.15.69:0/547905542 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8441a14d0 con 0x7fa844110120 2024-05-14T15:21:56.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.725+0000 7fa843e00640 1 -- 172.21.15.69:0/547905542 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8441ad630 con 0x7fa844110120 2024-05-14T15:21:56.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.726+0000 7fa843e00640 1 -- 172.21.15.69:0/547905542 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa84410b3a0 con 0x7fa844110120 2024-05-14T15:21:56.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.729+0000 7fa83b400640 1 -- 172.21.15.69:0/547905542 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 149828+0+0 (secure 0 0 0) 0x7fa834018020 con 0x7fa844110120 2024-05-14T15:21:56.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.730+0000 7fa83b400640 1 --2- 172.21.15.69:0/547905542 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa8280b29e0 0x7fa8280b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:56.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.730+0000 7fa83b400640 1 -- 172.21.15.69:0/547905542 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fa8340e2b70 con 0x7fa844110120 2024-05-14T15:21:56.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.731+0000 7fa842000640 1 --2- 172.21.15.69:0/547905542 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa8280b29e0 0x7fa8280b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:56.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.731+0000 7fa842000640 1 --2- 172.21.15.69:0/547905542 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa8280b29e0 0x7fa8280b4ef0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa8441a1e90 tx=0x7fa82c008040 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:56.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.733+0000 7fa83b400640 1 -- 172.21.15.69:0/547905542 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa83401f020 con 0x7fa844110120 2024-05-14T15:21:56.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:56.970+0000 7fa843e00640 1 -- 172.21.15.69:0/547905542 --> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fa844111070 con 0x7fa8280b29e0 2024-05-14T15:21:57.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.081+0000 7ff6dda00700 1 -- 172.21.15.69:0/255186076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff6d810b2b0 msgr2=0x7ff6d8117830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.081+0000 7ff6dda00700 1 --2- 172.21.15.69:0/255186076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff6d810b2b0 0x7ff6d8117830 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7ff6d000b0a0 tx=0x7ff6d000b3b0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.081+0000 7ff6dda00700 1 -- 172.21.15.69:0/255186076 shutdown_connections 2024-05-14T15:21:57.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.081+0000 7ff6dda00700 1 --2- 172.21.15.69:0/255186076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff6d810b2b0 0x7ff6d8117830 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.081+0000 7ff6dda00700 1 --2- 172.21.15.69:0/255186076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6d8110990 0x7ff6d8110da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.081+0000 7ff6dda00700 1 --2- 172.21.15.69:0/255186076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d810a960 0x7ff6d810ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.081+0000 7ff6dda00700 1 -- 172.21.15.69:0/255186076 >> 172.21.15.69:0/255186076 conn(0x7ff6d8076d30 msgr2=0x7ff6d8077140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:57.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.081+0000 7ff6dda00700 1 -- 172.21.15.69:0/255186076 shutdown_connections 2024-05-14T15:21:57.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.081+0000 7ff6dda00700 1 -- 172.21.15.69:0/255186076 wait complete. 2024-05-14T15:21:57.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.082+0000 7ff6dda00700 1 Processor -- start 2024-05-14T15:21:57.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.083+0000 7ff6dda00700 1 -- start start 2024-05-14T15:21:57.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.083+0000 7ff6dda00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d810a960 0x7ff6d81a13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.083+0000 7ff6dda00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff6d810b2b0 0x7ff6d81a1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.083+0000 7ff6dda00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6d8110990 0x7ff6d81a5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.083+0000 7ff6dda00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d811a9c0 con 0x7ff6d810b2b0 2024-05-14T15:21:57.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.083+0000 7ff6dda00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d811a840 con 0x7ff6d8110990 2024-05-14T15:21:57.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.083+0000 7ff6dda00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d811ab40 con 0x7ff6d810a960 2024-05-14T15:21:57.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.084+0000 7ff6d6000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff6d810b2b0 0x7ff6d81a1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.084+0000 7ff6d6000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff6d810b2b0 0x7ff6d81a1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56926/0 (socket says 172.21.15.69:56926) 2024-05-14T15:21:57.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.084+0000 7ff6d6000700 1 -- 172.21.15.69:0/3049557604 learned_addr learned my addr 172.21.15.69:0/3049557604 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:57.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.084+0000 7ff6d6a00700 1 --2- 172.21.15.69:0/3049557604 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d810a960 0x7ff6d81a13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.084+0000 7ff6d7400700 1 --2- 172.21.15.69:0/3049557604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6d8110990 0x7ff6d81a5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.084+0000 7ff6d6000700 1 -- 172.21.15.69:0/3049557604 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d810a960 msgr2=0x7ff6d81a13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.084+0000 7ff6d6000700 1 --2- 172.21.15.69:0/3049557604 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d810a960 0x7ff6d81a13f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.084+0000 7ff6d6000700 1 -- 172.21.15.69:0/3049557604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6d8110990 msgr2=0x7ff6d81a5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.084+0000 7ff6d6000700 1 --2- 172.21.15.69:0/3049557604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6d8110990 0x7ff6d81a5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.084+0000 7ff6d6000700 1 -- 172.21.15.69:0/3049557604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d81a62c0 con 0x7ff6d810b2b0 2024-05-14T15:21:57.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.085+0000 7ff6d6000700 1 --2- 172.21.15.69:0/3049557604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff6d810b2b0 0x7ff6d81a1990 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000d980 tx=0x7ff6c000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:57.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.085+0000 7ff6cf400700 1 -- 172.21.15.69:0/3049557604 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c0017070 con 0x7ff6d810b2b0 2024-05-14T15:21:57.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.085+0000 7ff6cf400700 1 -- 172.21.15.69:0/3049557604 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6c000fd20 con 0x7ff6d810b2b0 2024-05-14T15:21:57.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.085+0000 7ff6cf400700 1 -- 172.21.15.69:0/3049557604 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c000e3b0 con 0x7ff6d810b2b0 2024-05-14T15:21:57.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.085+0000 7ff6dda00700 1 -- 172.21.15.69:0/3049557604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6d81a6550 con 0x7ff6d810b2b0 2024-05-14T15:21:57.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.085+0000 7ff6dda00700 1 -- 172.21.15.69:0/3049557604 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6d81a6a40 con 0x7ff6d810b2b0 2024-05-14T15:21:57.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.091+0000 7ff6cf400700 1 -- 172.21.15.69:0/3049557604 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 149828+0+0 (secure 0 0 0) 0x7ff6c000f890 con 0x7ff6d810b2b0 2024-05-14T15:21:57.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.092+0000 7ff6ec505b80 1 Processor -- start 2024-05-14T15:21:57.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.092+0000 7ff6ec505b80 1 -- start start 2024-05-14T15:21:57.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.092+0000 7ff6ec505b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bbbeec0 0x56393bd42370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.092+0000 7ff6ec505b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bd428b0 0x56393bd3c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.092+0000 7ff6ec505b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd3ca70 0x56393bd3ce80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.092+0000 7ff6ec505b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56393bc5eaa0 con 0x56393bd3ca70 2024-05-14T15:21:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.092+0000 7ff6ec505b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56393bbfc7e0 con 0x56393bd428b0 2024-05-14T15:21:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.092+0000 7ff6ec505b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56393bc5aa60 con 0x56393bbbeec0 2024-05-14T15:21:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.093+0000 7ff6cf400700 1 --2- 172.21.15.69:0/3049557604 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff6bc0b2a80 0x7ff6bc0b4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.093+0000 7ff6d6a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bd428b0 0x56393bd3c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.093+0000 7ff6d6a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bd428b0 0x56393bd3c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:49496/0 (socket says 172.21.15.69:49496) 2024-05-14T15:21:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.093+0000 7ff6d6a00700 1 -- 172.21.15.69:0/2988828525 learned_addr learned my addr 172.21.15.69:0/2988828525 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.093+0000 7ff6d7400700 1 --2- 172.21.15.69:0/2988828525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bbbeec0 0x56393bd42370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.093+0000 7ff6cf400700 1 -- 172.21.15.69:0/3049557604 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7ff6c00e25f0 con 0x7ff6d810b2b0 2024-05-14T15:21:57.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.093+0000 7ff6d6000700 1 --2- 172.21.15.69:0/2988828525 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd3ca70 0x56393bd3ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.093+0000 7ff6d7400700 1 --2- 172.21.15.69:0/3049557604 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff6bc0b2a80 0x7ff6bc0b4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.094+0000 7ff6d6000700 1 -- 172.21.15.69:0/2988828525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bbbeec0 msgr2=0x56393bd42370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:57.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.094+0000 7ff6d6000700 1 --2- 172.21.15.69:0/2988828525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bbbeec0 0x56393bd42370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.094+0000 7ff6d6000700 1 -- 172.21.15.69:0/2988828525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bd428b0 msgr2=0x56393bd3c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:57.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.094+0000 7ff6d6000700 1 --2- 172.21.15.69:0/2988828525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bd428b0 0x56393bd3c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.094+0000 7ff6d6000700 1 -- 172.21.15.69:0/2988828525 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56393bbab950 con 0x56393bd3ca70 2024-05-14T15:21:57.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.094+0000 7ff6d6000700 1 --2- 172.21.15.69:0/2988828525 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd3ca70 0x56393bd3ce80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff6c00df8d0 tx=0x7ff6c00077b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adef5bbfc3264375 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:57.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.094+0000 7ff6d7400700 1 --2- 172.21.15.69:0/3049557604 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff6bc0b2a80 0x7ff6bc0b4f90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009900 tx=0x7ff6d0009d50 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:57.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.094+0000 7ff6c7e00700 1 -- 172.21.15.69:0/2988828525 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c00c3e80 con 0x56393bd3ca70 2024-05-14T15:21:57.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.094+0000 7ff6c7e00700 1 -- 172.21.15.69:0/2988828525 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6c00a8ec0 con 0x56393bd3ca70 2024-05-14T15:21:57.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.094+0000 7ff6c7e00700 1 -- 172.21.15.69:0/2988828525 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6c000fed0 con 0x56393bd3ca70 2024-05-14T15:21:57.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.096+0000 7ff6ec505b80 1 -- 172.21.15.69:0/2988828525 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd3ca70 msgr2=0x56393bd3ce80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.096+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/2988828525 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd3ca70 0x56393bd3ce80 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7ff6c00df8d0 tx=0x7ff6c00077b0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.096+0000 7ff6ec505b80 1 -- 172.21.15.69:0/2988828525 shutdown_connections 2024-05-14T15:21:57.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.096+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/2988828525 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd3ca70 0x56393bd3ce80 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.096+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/2988828525 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bbbeec0 0x56393bd42370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.096+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/2988828525 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bd428b0 0x56393bd3c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.096+0000 7ff6ec505b80 1 -- 172.21.15.69:0/2988828525 >> 172.21.15.69:0/2988828525 conn(0x56393bc03ff0 msgr2=0x56393bd37350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:57.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.096+0000 7ff6ec505b80 1 -- 172.21.15.69:0/2988828525 shutdown_connections 2024-05-14T15:21:57.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.096+0000 7ff6ec505b80 1 -- 172.21.15.69:0/2988828525 wait complete. 2024-05-14T15:21:57.097 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.097+0000 7ff6ec505b80 1 -- start start 2024-05-14T15:21:57.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.097+0000 7ff6ec505b80 1 Processor -- start 2024-05-14T15:21:57.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.097+0000 7ff6ec505b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 0x56393bd460c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.097+0000 7ff6ec505b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bd3ca70 0x56393bd46600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.097+0000 7ff6ec505b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bd46b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.097+0000 7ff6ec505b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56393bd49330 con 0x56393bd428b0 2024-05-14T15:21:57.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.097+0000 7ff6ec505b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56393bbc4ba0 con 0x56393bbbeec0 2024-05-14T15:21:57.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.097+0000 7ff6ec505b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56393bd494b0 con 0x56393bd3ca70 2024-05-14T15:21:57.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.098+0000 7ff6ec505b80 10 client.0 _ll_register_callbacks cb 0x56393bc05cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:21:57.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.098+0000 7ff6d7400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bd46b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.098+0000 7ff6d7400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bd46b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56930/0 (socket says 172.21.15.69:56930) 2024-05-14T15:21:57.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.098+0000 7ff6d7400700 1 -- 172.21.15.69:0/230039055 learned_addr learned my addr 172.21.15.69:0/230039055 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:57.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.098+0000 7ff6d6a00700 1 --2- 172.21.15.69:0/230039055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 0x56393bd460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.098+0000 7ff6d6000700 1 --2- 172.21.15.69:0/230039055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bd3ca70 0x56393bd46600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.099+0000 7ff6d7400700 1 -- 172.21.15.69:0/230039055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bd3ca70 msgr2=0x56393bd46600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:57.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.099+0000 7ff6d7400700 1 --2- 172.21.15.69:0/230039055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bd3ca70 0x56393bd46600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.099+0000 7ff6d7400700 1 -- 172.21.15.69:0/230039055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 msgr2=0x56393bd460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:57.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.099+0000 7ff6d7400700 1 --2- 172.21.15.69:0/230039055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 0x56393bd460c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.099+0000 7ff6d7400700 1 -- 172.21.15.69:0/230039055 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56393bc244a0 con 0x56393bd428b0 2024-05-14T15:21:57.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.099+0000 7ff6d7400700 1 --2- 172.21.15.69:0/230039055 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bd46b40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009610 tx=0x7ff6d0009c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db731712d416d615 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:57.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.099+0000 7ff6c4c00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:21:57.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.099+0000 7ff6c4c00700 1 -- 172.21.15.69:0/230039055 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d001f830 con 0x56393bd428b0 2024-05-14T15:21:57.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.099+0000 7ff6c4c00700 1 -- 172.21.15.69:0/230039055 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7ff6d0027040 con 0x56393bd428b0 2024-05-14T15:21:57.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.099+0000 7ff6ec505b80 1 -- 172.21.15.69:0/230039055 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6c00a8ec0 con 0x56393bd428b0 2024-05-14T15:21:57.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.099+0000 7ff6c4c00700 1 -- 172.21.15.69:0/230039055 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff6d001f9d0 con 0x56393bd428b0 2024-05-14T15:21:57.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.100+0000 7ff6ec505b80 10 client.15486 fetch_fsmap learned FSMap version 30 2024-05-14T15:21:57.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.100+0000 7ff6ec505b80 1 -- 172.21.15.69:0/230039055 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56393bd53ec0 con 0x56393bd428b0 2024-05-14T15:21:57.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.100+0000 7ff6c4c00700 1 -- 172.21.15.69:0/230039055 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6c00a8ec0 con 0x56393bd428b0 2024-05-14T15:21:57.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.100+0000 7ff6c4c00700 1 -- 172.21.15.69:0/230039055 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ff6d0011070 con 0x56393bd428b0 2024-05-14T15:21:57.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.100+0000 7ff6ec505b80 10 client.15486 fetch_fsmap finished waiting for FSMap version 30 2024-05-14T15:21:57.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.100+0000 7ff6ec505b80 10 client.15486 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:21:57.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.100+0000 7ff6ec505b80 20 client.15486 populate_metadata read hostname 'smithi069' 2024-05-14T15:21:57.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.100+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/230039055 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56393bd56500 0x56393bd58960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.100+0000 7ff6ec505b80 4 client.15486 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:21:57.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.100+0000 7ff6ec505b80 1 -- 172.21.15.69:0/230039055 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56393bd09240 con 0x56393bd56500 2024-05-14T15:21:57.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.101+0000 7ff6d6a00700 1 --2- 172.21.15.69:0/230039055 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56393bd56500 0x56393bd58960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.102+0000 7ff6d6a00700 1 --2- 172.21.15.69:0/230039055 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56393bd56500 0x56393bd58960 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18f7cfbc06ef9b9b server_cookie=801a4ce27cf42e45 in_seq=0 out_seq=0 2024-05-14T15:21:57.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.102+0000 7ff6c4c00700 10 client.15486 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:21:57.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.104+0000 7ff6c4c00700 1 -- 172.21.15.69:0/230039055 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56393bd09240 con 0x56393bd56500 2024-05-14T15:21:57.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.104+0000 7ff6c4c00700 10 client.15486 handle_command_reply: tid=0 2024-05-14T15:21:57.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.104+0000 7ff6ec505b80 1 client.15486 shutdown 2024-05-14T15:21:57.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.104+0000 7ff6ec505b80 1 -- 172.21.15.69:0/230039055 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 msgr2=0x56393bd46b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.104+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/230039055 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bd46b40 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009610 tx=0x7ff6d0009c00 comp rx=0 tx=0).stop 2024-05-14T15:21:57.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.104+0000 7ff6ec505b80 1 -- 172.21.15.69:0/230039055 shutdown_connections 2024-05-14T15:21:57.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.104+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/230039055 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56393bd56500 0x56393bd58960 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.104+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/230039055 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bd46b40 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.104+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/230039055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 0x56393bd460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.104+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/230039055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bd3ca70 0x56393bd46600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.104+0000 7ff6ec505b80 1 -- 172.21.15.69:0/230039055 >> 172.21.15.69:0/230039055 conn(0x56393bc03ff0 msgr2=0x56393bd3b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:57.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.105+0000 7ff6c4c00700 0 client.15486 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:21:57.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.105+0000 7ff6ec505b80 1 -- 172.21.15.69:0/230039055 shutdown_connections 2024-05-14T15:21:57.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.105+0000 7ff6ec505b80 1 -- 172.21.15.69:0/230039055 wait complete. 2024-05-14T15:21:57.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.105+0000 7ff6ec505b80 20 client.15486 trim_cache size 0 max 16384 2024-05-14T15:21:57.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.115+0000 7fa83b400640 1 -- 172.21.15.69:0/547905542 <== mgr.34991 v2:172.21.15.69:6800/1271399048 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fa844111070 con 0x7fa8280b29e0 2024-05-14T15:21:57.115 INFO:teuthology.orchestra.run.smithi069.stdout:Retention added to path / 2024-05-14T15:21:57.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.117+0000 7fa843e00640 1 -- 172.21.15.69:0/547905542 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa8280b29e0 msgr2=0x7fa8280b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.117+0000 7fa843e00640 1 --2- 172.21.15.69:0/547905542 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa8280b29e0 0x7fa8280b4ef0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa8441a1e90 tx=0x7fa82c008040 comp rx=0 tx=0).stop 2024-05-14T15:21:57.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.117+0000 7fa843e00640 1 -- 172.21.15.69:0/547905542 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa844110120 msgr2=0x7fa8441a6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.117+0000 7fa843e00640 1 --2- 172.21.15.69:0/547905542 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa844110120 0x7fa8441a6570 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fa83400b450 tx=0x7fa83400b910 comp rx=0 tx=0).stop 2024-05-14T15:21:57.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.117+0000 7fa843e00640 1 -- 172.21.15.69:0/547905542 shutdown_connections 2024-05-14T15:21:57.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.117+0000 7fa843e00640 1 --2- 172.21.15.69:0/547905542 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa8280b29e0 0x7fa8280b4ef0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.117+0000 7fa843e00640 1 --2- 172.21.15.69:0/547905542 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa8441a06f0 0x7fa8441a0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.117+0000 7fa843e00640 1 --2- 172.21.15.69:0/547905542 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa844110530 0x7fa8441a6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.117+0000 7fa843e00640 1 --2- 172.21.15.69:0/547905542 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa844110120 0x7fa8441a6570 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.117+0000 7fa843e00640 1 -- 172.21.15.69:0/547905542 >> 172.21.15.69:0/547905542 conn(0x7fa844076080 msgr2=0x7fa844110960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:57.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.117+0000 7fa843e00640 1 -- 172.21.15.69:0/547905542 shutdown_connections 2024-05-14T15:21:57.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.117+0000 7fa843e00640 1 -- 172.21.15.69:0/547905542 wait complete. 2024-05-14T15:21:57.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.128+0000 7ff6ec505b80 1 Processor -- start 2024-05-14T15:21:57.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.128+0000 7ff6ec505b80 1 -- start start 2024-05-14T15:21:57.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.128+0000 7ff6ec505b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 0x56393bd3c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.128+0000 7ff6ec505b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bd3ca70 0x56393bd40760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.128+0000 7ff6ec505b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bd31b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.128+0000 7ff6ec505b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81b6bf0 con 0x56393bd428b0 2024-05-14T15:21:57.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.128+0000 7ff6ec505b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81b8730 con 0x56393bbbeec0 2024-05-14T15:21:57.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.128+0000 7ff6ec505b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81b72c0 con 0x56393bd3ca70 2024-05-14T15:21:57.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.129+0000 7ff6d7400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bd31b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.129+0000 7ff6d7400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bd31b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56936/0 (socket says 172.21.15.69:56936) 2024-05-14T15:21:57.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.129+0000 7ff6d7400700 1 -- 172.21.15.69:0/3157376639 learned_addr learned my addr 172.21.15.69:0/3157376639 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:57.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.129+0000 7ff6d6000700 1 --2- 172.21.15.69:0/3157376639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bd3ca70 0x56393bd40760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.129+0000 7ff6d6a00700 1 --2- 172.21.15.69:0/3157376639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 0x56393bd3c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.129+0000 7ff6d7400700 1 -- 172.21.15.69:0/3157376639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bd3ca70 msgr2=0x56393bd40760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:57.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.129+0000 7ff6d7400700 1 --2- 172.21.15.69:0/3157376639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bd3ca70 0x56393bd40760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.129+0000 7ff6d7400700 1 -- 172.21.15.69:0/3157376639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 msgr2=0x56393bd3c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:57.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.129+0000 7ff6d7400700 1 --2- 172.21.15.69:0/3157376639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 0x56393bd3c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.129+0000 7ff6d7400700 1 -- 172.21.15.69:0/3157376639 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56393bd38bd0 con 0x56393bd428b0 2024-05-14T15:21:57.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.129+0000 7ff6d6a00700 1 --2- 172.21.15.69:0/3157376639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 0x56393bd3c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:57.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.130+0000 7ff6d7400700 1 --2- 172.21.15.69:0/3157376639 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bd31b00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0007f40 tx=0x7ff6d000b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5572c25b6ca25f32 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:57.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.130+0000 7ff6c7400700 1 -- 172.21.15.69:0/3157376639 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d001f730 con 0x56393bd428b0 2024-05-14T15:21:57.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.130+0000 7ff6c7400700 1 -- 172.21.15.69:0/3157376639 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6d00059f0 con 0x56393bd428b0 2024-05-14T15:21:57.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.130+0000 7ff6c7400700 1 -- 172.21.15.69:0/3157376639 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d0005480 con 0x56393bd428b0 2024-05-14T15:21:57.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.131+0000 7ff6ec505b80 1 -- 172.21.15.69:0/3157376639 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 msgr2=0x56393bd31b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.131+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/3157376639 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bd31b00 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0007f40 tx=0x7ff6d000b7b0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.131+0000 7ff6ec505b80 1 -- 172.21.15.69:0/3157376639 shutdown_connections 2024-05-14T15:21:57.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.131+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/3157376639 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bd31b00 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.131+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/3157376639 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 0x56393bd3c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.131+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/3157376639 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bd3ca70 0x56393bd40760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.131+0000 7ff6ec505b80 1 -- 172.21.15.69:0/3157376639 >> 172.21.15.69:0/3157376639 conn(0x56393bc03ff0 msgr2=0x56393bd46080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:57.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.131+0000 7ff6ec505b80 1 -- 172.21.15.69:0/3157376639 shutdown_connections 2024-05-14T15:21:57.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.131+0000 7ff6ec505b80 1 -- 172.21.15.69:0/3157376639 wait complete. 2024-05-14T15:21:57.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.132+0000 7ff6ec505b80 1 -- start start 2024-05-14T15:21:57.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.132+0000 7ff6ec505b80 1 Processor -- start 2024-05-14T15:21:57.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.132+0000 7ff6ec505b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 0x56393bd4a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.132+0000 7ff6ec505b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bd3ca70 0x56393bd4aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.132+0000 7ff6ec505b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bdbfcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.132+0000 7ff6ec505b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81b8060 con 0x56393bd428b0 2024-05-14T15:21:57.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.132+0000 7ff6ec505b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81b7990 con 0x56393bbbeec0 2024-05-14T15:21:57.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.132+0000 7ff6ec505b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d81b4b90 con 0x56393bd3ca70 2024-05-14T15:21:57.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.132+0000 7ff6ec505b80 10 client.0 _ll_register_callbacks cb 0x56393bc05cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:21:57.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.133+0000 7ff6d7400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bdbfcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.133+0000 7ff6d7400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bdbfcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56938/0 (socket says 172.21.15.69:56938) 2024-05-14T15:21:57.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.133+0000 7ff6d7400700 1 -- 172.21.15.69:0/721232712 learned_addr learned my addr 172.21.15.69:0/721232712 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:57.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.133+0000 7ff6d6a00700 1 --2- 172.21.15.69:0/721232712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 0x56393bd4a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.133+0000 7ff6d6000700 1 --2- 172.21.15.69:0/721232712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bd3ca70 0x56393bd4aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.133+0000 7ff6d7400700 1 -- 172.21.15.69:0/721232712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bd3ca70 msgr2=0x56393bd4aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:57.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.133+0000 7ff6d7400700 1 --2- 172.21.15.69:0/721232712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bd3ca70 0x56393bd4aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.133+0000 7ff6d7400700 1 -- 172.21.15.69:0/721232712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 msgr2=0x56393bd4a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:21:57.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.133+0000 7ff6d7400700 1 --2- 172.21.15.69:0/721232712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 0x56393bd4a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.133+0000 7ff6d7400700 1 -- 172.21.15.69:0/721232712 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56393bd4b2d0 con 0x56393bd428b0 2024-05-14T15:21:57.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.133+0000 7ff6d6a00700 1 --2- 172.21.15.69:0/721232712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 0x56393bd4a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:57.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.134+0000 7ff6d7400700 1 --2- 172.21.15.69:0/721232712 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bdbfcd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00058a0 tx=0x7ff6d0005f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=961225f9aab04dbf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:57.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.134+0000 7ff6c4c00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:21:57.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.134+0000 7ff6c4c00700 1 -- 172.21.15.69:0/721232712 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d00050d0 con 0x56393bd428b0 2024-05-14T15:21:57.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.134+0000 7ff6ec505b80 1 -- 172.21.15.69:0/721232712 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff6d00059f0 con 0x56393bd428b0 2024-05-14T15:21:57.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.134+0000 7ff6c4c00700 1 -- 172.21.15.69:0/721232712 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7ff6d0027040 con 0x56393bd428b0 2024-05-14T15:21:57.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.134+0000 7ff6c4c00700 1 -- 172.21.15.69:0/721232712 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7ff6d004c050 con 0x56393bd428b0 2024-05-14T15:21:57.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.134+0000 7ff6ec505b80 10 client.15492 fetch_fsmap learned FSMap version 30 2024-05-14T15:21:57.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.134+0000 7ff6ec505b80 1 -- 172.21.15.69:0/721232712 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x56393bdc1150 con 0x56393bd428b0 2024-05-14T15:21:57.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.134+0000 7ff6c4c00700 1 -- 172.21.15.69:0/721232712 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff6d00059f0 con 0x56393bd428b0 2024-05-14T15:21:57.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.135+0000 7ff6c4c00700 1 -- 172.21.15.69:0/721232712 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7ff6d0011040 con 0x56393bd428b0 2024-05-14T15:21:57.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.135+0000 7ff6ec505b80 10 client.15492 fetch_fsmap finished waiting for FSMap version 30 2024-05-14T15:21:57.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.135+0000 7ff6ec505b80 10 client.15492 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:21:57.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.135+0000 7ff6ec505b80 20 client.15492 populate_metadata read hostname 'smithi069' 2024-05-14T15:21:57.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.135+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/721232712 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56393bdc1710 0x56393bdc3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.135+0000 7ff6ec505b80 4 client.15492 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-14T15:21:57.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.135+0000 7ff6ec505b80 1 -- 172.21.15.69:0/721232712 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56393bc6c480 con 0x56393bdc1710 2024-05-14T15:21:57.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.136+0000 7ff6d6a00700 1 --2- 172.21.15.69:0/721232712 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56393bdc1710 0x56393bdc3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.136+0000 7ff6d6a00700 1 --2- 172.21.15.69:0/721232712 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56393bdc1710 0x56393bdc3b30 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6c3eec94fd425959 server_cookie=4c80559c48e8e829 in_seq=0 out_seq=0 2024-05-14T15:21:57.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.136+0000 7ff6c4c00700 10 client.15492 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:21:57.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.139+0000 7ff6c4c00700 1 -- 172.21.15.69:0/721232712 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56393bc6c480 con 0x56393bdc1710 2024-05-14T15:21:57.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.139+0000 7ff6c4c00700 10 client.15492 handle_command_reply: tid=0 2024-05-14T15:21:57.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.139+0000 7ff6ec505b80 1 client.15492 shutdown 2024-05-14T15:21:57.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.140+0000 7ff6ec505b80 1 -- 172.21.15.69:0/721232712 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 msgr2=0x56393bdbfcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.140+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/721232712 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bdbfcd0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7ff6d00058a0 tx=0x7ff6d0005f00 comp rx=0 tx=0).stop 2024-05-14T15:21:57.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.140+0000 7ff6ec505b80 1 -- 172.21.15.69:0/721232712 shutdown_connections 2024-05-14T15:21:57.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.140+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/721232712 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56393bdc1710 0x56393bdc3b30 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.140+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/721232712 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56393bd428b0 0x56393bdbfcd0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.140+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/721232712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56393bbbeec0 0x56393bd4a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.140+0000 7ff6ec505b80 1 --2- 172.21.15.69:0/721232712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56393bd3ca70 0x56393bd4aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.140+0000 7ff6ec505b80 1 -- 172.21.15.69:0/721232712 >> 172.21.15.69:0/721232712 conn(0x56393bc03ff0 msgr2=0x56393bd404c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:57.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.140+0000 7ff6c4c00700 0 client.15492 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:21:57.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.140+0000 7ff6ec505b80 1 -- 172.21.15.69:0/721232712 shutdown_connections 2024-05-14T15:21:57.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.140+0000 7ff6ec505b80 1 -- 172.21.15.69:0/721232712 wait complete. 2024-05-14T15:21:57.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.140+0000 7ff6ec505b80 20 client.15492 trim_cache size 0 max 16384 2024-05-14T15:21:57.142 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:21:57.142 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2024-05-14T15:21:57.142 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "1da191e0-0de8-465f-b85e-566bec8fa9f5", 2024-05-14T15:21:57.142 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2024-05-14T15:21:57.142 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:21:57.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.141+0000 7ff6dda00700 1 -- 172.21.15.69:0/3049557604 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff6bc0b2a80 msgr2=0x7ff6bc0b4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.141+0000 7ff6dda00700 1 --2- 172.21.15.69:0/3049557604 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff6bc0b2a80 0x7ff6bc0b4f90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff6d0009900 tx=0x7ff6d0009d50 comp rx=0 tx=0).stop 2024-05-14T15:21:57.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.141+0000 7ff6dda00700 1 -- 172.21.15.69:0/3049557604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff6d810b2b0 msgr2=0x7ff6d81a1990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.141+0000 7ff6dda00700 1 --2- 172.21.15.69:0/3049557604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff6d810b2b0 0x7ff6d81a1990 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff6c000d980 tx=0x7ff6c000dc90 comp rx=0 tx=0).stop 2024-05-14T15:21:57.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.141+0000 7ff6dda00700 1 -- 172.21.15.69:0/3049557604 shutdown_connections 2024-05-14T15:21:57.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.141+0000 7ff6dda00700 1 --2- 172.21.15.69:0/3049557604 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff6bc0b2a80 0x7ff6bc0b4f90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.141+0000 7ff6dda00700 1 --2- 172.21.15.69:0/3049557604 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff6d8110990 0x7ff6d81a5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.141+0000 7ff6dda00700 1 --2- 172.21.15.69:0/3049557604 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff6d810a960 0x7ff6d81a13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.141+0000 7ff6dda00700 1 --2- 172.21.15.69:0/3049557604 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff6d810b2b0 0x7ff6d81a1990 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.141+0000 7ff6dda00700 1 -- 172.21.15.69:0/3049557604 >> 172.21.15.69:0/3049557604 conn(0x7ff6d8076d30 msgr2=0x7ff6d8108920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:57.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.141+0000 7ff6dda00700 1 -- 172.21.15.69:0/3049557604 shutdown_connections 2024-05-14T15:21:57.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.141+0000 7ff6dda00700 1 -- 172.21.15.69:0/3049557604 wait complete. 2024-05-14T15:21:57.146 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-05-14T15:21:57.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.384+0000 7fabed200640 1 -- 172.21.15.69:0/1097875726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabe8102830 msgr2=0x7fabe8102c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.384+0000 7fabed200640 1 --2- 172.21.15.69:0/1097875726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabe8102830 0x7fabe8102c40 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009ca0 tx=0x7fabd802a8c0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.385+0000 7fabed200640 1 -- 172.21.15.69:0/1097875726 shutdown_connections 2024-05-14T15:21:57.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.385+0000 7fabed200640 1 --2- 172.21.15.69:0/1097875726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabe81103d0 0x7fabe81127f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.385+0000 7fabed200640 1 --2- 172.21.15.69:0/1097875726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabe810da70 0x7fabe810fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.385+0000 7fabed200640 1 --2- 172.21.15.69:0/1097875726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabe8102830 0x7fabe8102c40 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.385+0000 7fabed200640 1 -- 172.21.15.69:0/1097875726 >> 172.21.15.69:0/1097875726 conn(0x7fabe80fe220 msgr2=0x7fabe8100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:57.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.385+0000 7fabed200640 1 -- 172.21.15.69:0/1097875726 shutdown_connections 2024-05-14T15:21:57.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.385+0000 7fabed200640 1 -- 172.21.15.69:0/1097875726 wait complete. 2024-05-14T15:21:57.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.386+0000 7fabed200640 1 Processor -- start 2024-05-14T15:21:57.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.386+0000 7fabed200640 1 -- start start 2024-05-14T15:21:57.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.386+0000 7fabed200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabe8102830 0x7fabe81a2530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.386+0000 7fabed200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabe810da70 0x7fabe81a2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.386+0000 7fabed200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabe81103d0 0x7fabe819c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.386+0000 7fabed200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fabe8115d70 con 0x7fabe810da70 2024-05-14T15:21:57.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.386+0000 7fabed200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fabe8115bf0 con 0x7fabe81103d0 2024-05-14T15:21:57.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.386+0000 7fabed200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fabe8115ef0 con 0x7fabe8102830 2024-05-14T15:21:57.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.387+0000 7fabdea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabe810da70 0x7fabe81a2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.387+0000 7fabdea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabe810da70 0x7fabe81a2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56960/0 (socket says 172.21.15.69:56960) 2024-05-14T15:21:57.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.387+0000 7fabdea00640 1 -- 172.21.15.69:0/3022626303 learned_addr learned my addr 172.21.15.69:0/3022626303 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:57.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.387+0000 7fabe7400640 1 --2- 172.21.15.69:0/3022626303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabe8102830 0x7fabe81a2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.387+0000 7fabe7e00640 1 --2- 172.21.15.69:0/3022626303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabe81103d0 0x7fabe819c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.387+0000 7fabdea00640 1 -- 172.21.15.69:0/3022626303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabe8102830 msgr2=0x7fabe81a2530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.387+0000 7fabdea00640 1 --2- 172.21.15.69:0/3022626303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabe8102830 0x7fabe81a2530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.387+0000 7fabdea00640 1 -- 172.21.15.69:0/3022626303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabe81103d0 msgr2=0x7fabe819c6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.387+0000 7fabdea00640 1 --2- 172.21.15.69:0/3022626303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabe81103d0 0x7fabe819c6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.387+0000 7fabdea00640 1 -- 172.21.15.69:0/3022626303 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabe819cde0 con 0x7fabe810da70 2024-05-14T15:21:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.387+0000 7fabdea00640 1 --2- 172.21.15.69:0/3022626303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabe810da70 0x7fabe81a2a70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fabd000b450 tx=0x7fabd000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.388+0000 7fabe4c00640 1 -- 172.21.15.69:0/3022626303 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd0015020 con 0x7fabe810da70 2024-05-14T15:21:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.388+0000 7fabe4c00640 1 -- 172.21.15.69:0/3022626303 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fabd0011d20 con 0x7fabe810da70 2024-05-14T15:21:57.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.388+0000 7fabed200640 1 -- 172.21.15.69:0/3022626303 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabe819d070 con 0x7fabe810da70 2024-05-14T15:21:57.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.388+0000 7fabe4c00640 1 -- 172.21.15.69:0/3022626303 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabd0010e10 con 0x7fabe810da70 2024-05-14T15:21:57.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.388+0000 7fabed200640 1 -- 172.21.15.69:0/3022626303 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabe81a92d0 con 0x7fabe810da70 2024-05-14T15:21:57.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.389+0000 7fabed200640 1 -- 172.21.15.69:0/3022626303 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabe806ad70 con 0x7fabe810da70 2024-05-14T15:21:57.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.392+0000 7fabe4c00640 1 -- 172.21.15.69:0/3022626303 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 149828+0+0 (secure 0 0 0) 0x7fabd0018020 con 0x7fabe810da70 2024-05-14T15:21:57.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.394+0000 7fabe4c00640 1 --2- 172.21.15.69:0/3022626303 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fabcc0b2a60 0x7fabcc0b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.394+0000 7fabe4c00640 1 -- 172.21.15.69:0/3022626303 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fabd00e29e0 con 0x7fabe810da70 2024-05-14T15:21:57.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.394+0000 7fabe7400640 1 --2- 172.21.15.69:0/3022626303 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fabcc0b2a60 0x7fabcc0b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.395+0000 7fabe7400640 1 --2- 172.21.15.69:0/3022626303 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fabcc0b2a60 0x7fabcc0b4f70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009a60 tx=0x7fabd8009890 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:57.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.395+0000 7fabe4c00640 1 -- 172.21.15.69:0/3022626303 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fabd001f020 con 0x7fabe810da70 2024-05-14T15:21:57.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.613+0000 7fabed200640 1 -- 172.21.15.69:0/3022626303 --> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fabe8111920 con 0x7fabcc0b2a60 2024-05-14T15:21:57.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.630+0000 7fabe4c00640 1 -- 172.21.15.69:0/3022626303 <== mgr.34991 v2:172.21.15.69:6800/1271399048 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fabe8111920 con 0x7fabcc0b2a60 2024-05-14T15:21:57.630 INFO:teuthology.orchestra.run.smithi069.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-05-14T00:00:00", "created": "2024-05-14T15:21:56", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-05-14T15:21:57.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.632+0000 7fabed200640 1 -- 172.21.15.69:0/3022626303 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fabcc0b2a60 msgr2=0x7fabcc0b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.632+0000 7fabed200640 1 --2- 172.21.15.69:0/3022626303 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fabcc0b2a60 0x7fabcc0b4f70 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fabd8009a60 tx=0x7fabd8009890 comp rx=0 tx=0).stop 2024-05-14T15:21:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.632+0000 7fabed200640 1 -- 172.21.15.69:0/3022626303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabe810da70 msgr2=0x7fabe81a2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.632+0000 7fabed200640 1 --2- 172.21.15.69:0/3022626303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabe810da70 0x7fabe81a2a70 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fabd000b450 tx=0x7fabd000b910 comp rx=0 tx=0).stop 2024-05-14T15:21:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.632+0000 7fabed200640 1 -- 172.21.15.69:0/3022626303 shutdown_connections 2024-05-14T15:21:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.632+0000 7fabed200640 1 --2- 172.21.15.69:0/3022626303 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fabcc0b2a60 0x7fabcc0b4f70 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.632+0000 7fabed200640 1 --2- 172.21.15.69:0/3022626303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fabe81103d0 0x7fabe819c6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.632+0000 7fabed200640 1 --2- 172.21.15.69:0/3022626303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fabe810da70 0x7fabe81a2a70 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.632+0000 7fabed200640 1 --2- 172.21.15.69:0/3022626303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fabe8102830 0x7fabe81a2530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.632+0000 7fabed200640 1 -- 172.21.15.69:0/3022626303 >> 172.21.15.69:0/3022626303 conn(0x7fabe80fe220 msgr2=0x7fabe8111210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:57.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.632+0000 7fabed200640 1 -- 172.21.15.69:0/3022626303 shutdown_connections 2024-05-14T15:21:57.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.633+0000 7fabed200640 1 -- 172.21.15.69:0/3022626303 wait complete. 2024-05-14T15:21:57.655 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-05-14T15:21:57.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.911+0000 7f77f6400640 1 -- 172.21.15.69:0/457258762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77f0109f60 msgr2=0x7f77f0103ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.911+0000 7f77f6400640 1 --2- 172.21.15.69:0/457258762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77f0109f60 0x7f77f0103ba0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f77dc009ca0 tx=0x7f77dc02a8c0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.912+0000 7f77f6400640 1 -- 172.21.15.69:0/457258762 shutdown_connections 2024-05-14T15:21:57.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.912+0000 7f77f6400640 1 --2- 172.21.15.69:0/457258762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77f0104210 0x7f77f01105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.912+0000 7f77f6400640 1 --2- 172.21.15.69:0/457258762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77f0109f60 0x7f77f0103ba0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.912+0000 7f77f6400640 1 --2- 172.21.15.69:0/457258762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f0109ac0 0x7f77f0103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.912+0000 7f77f6400640 1 -- 172.21.15.69:0/457258762 >> 172.21.15.69:0/457258762 conn(0x7f77f00ff340 msgr2=0x7f77f0101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:57.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.912+0000 7f77f6400640 1 -- 172.21.15.69:0/457258762 shutdown_connections 2024-05-14T15:21:57.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.912+0000 7f77f6400640 1 -- 172.21.15.69:0/457258762 wait complete. 2024-05-14T15:21:57.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.913+0000 7f77f6400640 1 Processor -- start 2024-05-14T15:21:57.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.913+0000 7f77f6400640 1 -- start start 2024-05-14T15:21:57.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.913+0000 7f77f6400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77f0104210 0x7f77f019d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.913+0000 7f77f6400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f0109ac0 0x7f77f019d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.913+0000 7f77f6400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77f0109f60 0x7f77f01a8510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.913+0000 7f77f6400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f77f0113bb0 con 0x7f77f0104210 2024-05-14T15:21:57.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.913+0000 7f77f6400640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f77f0113a30 con 0x7f77f0109ac0 2024-05-14T15:21:57.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.913+0000 7f77f6400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f77f0113d30 con 0x7f77f0109f60 2024-05-14T15:21:57.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.914+0000 7f77f5000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77f0104210 0x7f77f019d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.914+0000 7f77f5000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77f0104210 0x7f77f019d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56982/0 (socket says 172.21.15.69:56982) 2024-05-14T15:21:57.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.914+0000 7f77f5000640 1 -- 172.21.15.69:0/3074996216 learned_addr learned my addr 172.21.15.69:0/3074996216 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:21:57.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.914+0000 7f77efe00640 1 --2- 172.21.15.69:0/3074996216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f0109ac0 0x7f77f019d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.914+0000 7f77f5000640 1 -- 172.21.15.69:0/3074996216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77f0109f60 msgr2=0x7f77f01a8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.914+0000 7f77f5a00640 1 --2- 172.21.15.69:0/3074996216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77f0109f60 0x7f77f01a8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.914+0000 7f77f5000640 1 --2- 172.21.15.69:0/3074996216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77f0109f60 0x7f77f01a8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.914+0000 7f77f5000640 1 -- 172.21.15.69:0/3074996216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f0109ac0 msgr2=0x7f77f019d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:57.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.914+0000 7f77f5000640 1 --2- 172.21.15.69:0/3074996216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f0109ac0 0x7f77f019d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:57.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.914+0000 7f77f5000640 1 -- 172.21.15.69:0/3074996216 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77f01a8a50 con 0x7f77f0104210 2024-05-14T15:21:57.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.914+0000 7f77f5a00640 1 --2- 172.21.15.69:0/3074996216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77f0109f60 0x7f77f01a8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:57.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.914+0000 7f77efe00640 1 --2- 172.21.15.69:0/3074996216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f0109ac0 0x7f77f019d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:21:57.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.914+0000 7f77f5000640 1 --2- 172.21.15.69:0/3074996216 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77f0104210 0x7f77f019d490 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f77e000d770 tx=0x7f77e000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:57.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.915+0000 7f77ed600640 1 -- 172.21.15.69:0/3074996216 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e0017070 con 0x7f77f0104210 2024-05-14T15:21:57.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.915+0000 7f77ed600640 1 -- 172.21.15.69:0/3074996216 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f77e0009c30 con 0x7f77f0104210 2024-05-14T15:21:57.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.915+0000 7f77ed600640 1 -- 172.21.15.69:0/3074996216 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77e000f620 con 0x7f77f0104210 2024-05-14T15:21:57.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.915+0000 7f77f6400640 1 -- 172.21.15.69:0/3074996216 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77f01a8c80 con 0x7f77f0104210 2024-05-14T15:21:57.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.915+0000 7f77f6400640 1 -- 172.21.15.69:0/3074996216 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77f01a91d0 con 0x7f77f0104210 2024-05-14T15:21:57.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.916+0000 7f77f6400640 1 -- 172.21.15.69:0/3074996216 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77f0050870 con 0x7f77f0104210 2024-05-14T15:21:57.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.918+0000 7f77ed600640 1 -- 172.21.15.69:0/3074996216 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 149828+0+0 (secure 0 0 0) 0x7f77e001a070 con 0x7f77f0104210 2024-05-14T15:21:57.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.920+0000 7f77ed600640 1 --2- 172.21.15.69:0/3074996216 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f77d40b29e0 0x7f77d40b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:21:57.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.920+0000 7f77ed600640 1 -- 172.21.15.69:0/3074996216 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f77e00e26e0 con 0x7f77f0104210 2024-05-14T15:21:57.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.920+0000 7f77efe00640 1 --2- 172.21.15.69:0/3074996216 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f77d40b29e0 0x7f77d40b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:21:57.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.921+0000 7f77efe00640 1 --2- 172.21.15.69:0/3074996216 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f77d40b29e0 0x7f77d40b4ef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f77dc006010 tx=0x7f77dc000f40 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:21:57.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:57.924+0000 7f77ed600640 1 -- 172.21.15.69:0/3074996216 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f77e0009de0 con 0x7f77f0104210 2024-05-14T15:21:57.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:57 smithi069 ceph-mon[31270]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:21:57.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:57 smithi069 ceph-mon[31270]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:21:58.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:57 smithi203 ceph-mon[34567]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:21:58.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:57 smithi203 ceph-mon[34567]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:21:58.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:58.163+0000 7f77f6400640 1 -- 172.21.15.69:0/3074996216 --> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f77f0107170 con 0x7f77d40b29e0 2024-05-14T15:21:58.180 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:58.180+0000 7f77ed600640 1 -- 172.21.15.69:0/3074996216 <== mgr.34991 v2:172.21.15.69:6800/1271399048 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f77f0107170 con 0x7f77d40b29e0 2024-05-14T15:21:58.180 INFO:teuthology.orchestra.run.smithi069.stdout:/ 1m 6m3h 2024-05-14T15:21:58.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:58.183+0000 7f77f6400640 1 -- 172.21.15.69:0/3074996216 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f77d40b29e0 msgr2=0x7f77d40b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:58.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:58.183+0000 7f77f6400640 1 --2- 172.21.15.69:0/3074996216 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f77d40b29e0 0x7f77d40b4ef0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f77dc006010 tx=0x7f77dc000f40 comp rx=0 tx=0).stop 2024-05-14T15:21:58.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:58.183+0000 7f77f6400640 1 -- 172.21.15.69:0/3074996216 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77f0104210 msgr2=0x7f77f019d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:21:58.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:58.183+0000 7f77f6400640 1 --2- 172.21.15.69:0/3074996216 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77f0104210 0x7f77f019d490 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f77e000d770 tx=0x7f77e000dc30 comp rx=0 tx=0).stop 2024-05-14T15:21:58.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:58.183+0000 7f77f6400640 1 -- 172.21.15.69:0/3074996216 shutdown_connections 2024-05-14T15:21:58.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:58.183+0000 7f77f6400640 1 --2- 172.21.15.69:0/3074996216 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f77d40b29e0 0x7f77d40b4ef0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:58.183 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:58.183+0000 7f77f6400640 1 --2- 172.21.15.69:0/3074996216 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f77f0109f60 0x7f77f01a8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:58.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:58.183+0000 7f77f6400640 1 --2- 172.21.15.69:0/3074996216 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f77f0109ac0 0x7f77f019d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:58.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:58.183+0000 7f77f6400640 1 --2- 172.21.15.69:0/3074996216 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f77f0104210 0x7f77f019d490 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:21:58.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:58.183+0000 7f77f6400640 1 -- 172.21.15.69:0/3074996216 >> 172.21.15.69:0/3074996216 conn(0x7f77f00ff340 msgr2=0x7f77f00754e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:21:58.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:58.183+0000 7f77f6400640 1 -- 172.21.15.69:0/3074996216 shutdown_connections 2024-05-14T15:21:58.184 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:21:58.183+0000 7f77f6400640 1 -- 172.21.15.69:0/3074996216 wait complete. 2024-05-14T15:21:58.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:57 smithi092 ceph-mon[34729]: from='client.15468 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:21:58.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:57 smithi092 ceph-mon[34729]: from='client.15474 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:21:58.203 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T15:21:58.208 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-05-14T15:21:58.320 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-05-14T15:21:58.331 INFO:teuthology.run_tasks:Running task background_exec... 2024-05-14T15:21:58.342 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2024-05-14T15:21:58.342 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-05-14T15:21:58.348 INFO:teuthology.run_tasks:Running task exec... 2024-05-14T15:21:58.357 INFO:teuthology.task.exec:Executing custom commands... 2024-05-14T15:21:58.357 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi069.front.sepia.ceph.com 2024-05-14T15:21:58.357 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -l /tmp/cephfs/ && sudo df -h /tmp/cephfs/' 2024-05-14T15:21:58.449 INFO:teuthology.orchestra.run.smithi069.stdout:total 0 2024-05-14T15:21:58.476 INFO:teuthology.orchestra.run.smithi069.stdout:Filesystem Size Used Avail Use% Mounted on 2024-05-14T15:21:58.476 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-fuse 1.1T 380M 1.1T 1% /tmp/cephfs 2024-05-14T15:21:58.483 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -m 755 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres && sudo chown postgres:postgres /tmp/cephfs/postgres' 2024-05-14T15:21:58.607 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- mkdir -m 700 --context=system_u:system_r:postgresql_t:s0 /tmp/cephfs/postgres/data' 2024-05-14T15:21:58.617 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:21:58.707 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo semanage fcontext -a -t postgresql_db_t "/tmp/cephfs/postgres(/.*)?"' 2024-05-14T15:21:58.950 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:58 smithi069 ceph-mon[31270]: scrub queued for path: / 2024-05-14T15:21:58.951 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:58 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:21:58.951 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:58 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:21:58.951 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:58 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:21:58.951 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:58 smithi069 ceph-mon[31270]: from='client.15498 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:21:58.951 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:58 smithi069 ceph-mon[31270]: pgmap v13: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-14T15:21:58.951 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:21:58 smithi069 ceph-mon[31270]: from='client.15504 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:21:59.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:58 smithi203 ceph-mon[34567]: scrub queued for path: / 2024-05-14T15:21:59.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:58 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:21:59.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:58 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:21:59.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:58 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:21:59.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:58 smithi203 ceph-mon[34567]: from='client.15498 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:21:59.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:58 smithi203 ceph-mon[34567]: pgmap v13: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-14T15:21:59.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:21:58 smithi203 ceph-mon[34567]: from='client.15504 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:21:59.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:58 smithi092 ceph-mon[34729]: scrub queued for path: / 2024-05-14T15:21:59.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:58 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:21:59.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:58 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:21:59.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:58 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:21:59.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:58 smithi092 ceph-mon[34729]: from='client.15498 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:21:59.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:58 smithi092 ceph-mon[34729]: pgmap v13: 129 pgs: 129 active+clean; 1.1 MiB data, 377 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 8 op/s 2024-05-14T15:21:59.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:21:58 smithi092 ceph-mon[34729]: from='client.15504 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:22:00.473 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:22:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:22:00.144+0000 7f036f200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:22:00.474 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:22:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:22:00.144+0000 7f036f200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:22:00.474 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:22:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:22:00.144+0000 7f036f200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:22:00.474 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:22:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:22:00.144+0000 7f036f200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:22:00.474 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:22:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:22:00.144+0000 7f036f200700 -1 client.0 error registering admin socket command: (17) File exists 2024-05-14T15:22:01.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:00 smithi092 ceph-mon[34729]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-05-14T15:22:01.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:00 smithi069 ceph-mon[31270]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-05-14T15:22:01.304 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo grep -i postgresql /etc/selinux/targeted/contexts/files/file_contexts.local' 2024-05-14T15:22:01.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:00 smithi203 ceph-mon[34567]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 77 KiB/s wr, 44 op/s 2024-05-14T15:22:01.416 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres(/.*)? system_u:object_r:postgresql_db_t:s0 2024-05-14T15:22:01.423 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo restorecon -R -v /tmp/cephfs/postgres' 2024-05-14T15:22:01.544 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-05-14T15:22:01.658 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/: 2024-05-14T15:22:01.658 INFO:teuthology.orchestra.run.smithi069.stdout:total 2 2024-05-14T15:22:01.658 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:21 . 2024-05-14T15:22:01.658 INFO:teuthology.orchestra.run.smithi069.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 0 May 14 15:21 .. 2024-05-14T15:22:01.658 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:21 data 2024-05-14T15:22:01.658 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:01.658 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data: 2024-05-14T15:22:01.658 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:22:01.658 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:21 . 2024-05-14T15:22:01.658 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:21 .. 2024-05-14T15:22:01.665 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo mkdir -p /etc/systemd/system/postgresql.service.d/ && printf '"'"'[Service]\nEnvironment=PGDATA=/tmp/cephfs/postgres/data\nEnvironment=PGLOG=/tmp/cephfs/postgres/pgstartup.log\n'"'"' | sudo tee /etc/systemd/system/postgresql.service.d/env.conf' 2024-05-14T15:22:01.785 INFO:teuthology.orchestra.run.smithi069.stdout:[Service] 2024-05-14T15:22:01.785 INFO:teuthology.orchestra.run.smithi069.stdout:Environment=PGDATA=/tmp/cephfs/postgres/data 2024-05-14T15:22:01.785 INFO:teuthology.orchestra.run.smithi069.stdout:Environment=PGLOG=/tmp/cephfs/postgres/pgstartup.log 2024-05-14T15:22:01.793 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- postgresql-setup --initdb' 2024-05-14T15:22:01.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.888+0000 7f6020a00700 1 -- 172.21.15.69:0/93138594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f601c106580 msgr2=0x7f601c106990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.888+0000 7f6020a00700 1 --2- 172.21.15.69:0/93138594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f601c106580 0x7f601c106990 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f6008009990 tx=0x7f6008009ca0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.888+0000 7f6020a00700 1 -- 172.21.15.69:0/93138594 shutdown_connections 2024-05-14T15:22:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.888+0000 7f6020a00700 1 --2- 172.21.15.69:0/93138594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c106ed0 0x7f601c113360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.889+0000 7f6020a00700 1 --2- 172.21.15.69:0/93138594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f601c10c5c0 0x7f601c10c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.889+0000 7f6020a00700 1 --2- 172.21.15.69:0/93138594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f601c106580 0x7f601c106990 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.889+0000 7f6020a00700 1 -- 172.21.15.69:0/93138594 >> 172.21.15.69:0/93138594 conn(0x7f601c102080 msgr2=0x7f601c1044d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.889+0000 7f6020a00700 1 -- 172.21.15.69:0/93138594 shutdown_connections 2024-05-14T15:22:01.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.889+0000 7f6020a00700 1 -- 172.21.15.69:0/93138594 wait complete. 2024-05-14T15:22:01.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.890+0000 7f6020a00700 1 Processor -- start 2024-05-14T15:22:01.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.890+0000 7f6020a00700 1 -- start start 2024-05-14T15:22:01.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.891+0000 7f6020a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c106580 0x7f601c19cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.891+0000 7f6020a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f601c106ed0 0x7f601c19d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.891+0000 7f6020a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f601c10c5c0 0x7f601c1a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.891+0000 7f6020a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f601c116550 con 0x7f601c106ed0 2024-05-14T15:22:01.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.891+0000 7f6020a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f601c1163d0 con 0x7f601c106580 2024-05-14T15:22:01.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.891+0000 7f6020a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f601c1166d0 con 0x7f601c10c5c0 2024-05-14T15:22:01.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.891+0000 7f6019400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f601c106ed0 0x7f601c19d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.891+0000 7f6019400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f601c106ed0 0x7f601c19d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57012/0 (socket says 172.21.15.69:57012) 2024-05-14T15:22:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.891+0000 7f6019400700 1 -- 172.21.15.69:0/3328891240 learned_addr learned my addr 172.21.15.69:0/3328891240 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.892+0000 7f6019e00700 1 --2- 172.21.15.69:0/3328891240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c106580 0x7f601c19cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.892+0000 7f601a800700 1 --2- 172.21.15.69:0/3328891240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f601c10c5c0 0x7f601c1a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.892+0000 7f6019400700 1 -- 172.21.15.69:0/3328891240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f601c10c5c0 msgr2=0x7f601c1a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.892+0000 7f6019400700 1 --2- 172.21.15.69:0/3328891240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f601c10c5c0 0x7f601c1a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.892+0000 7f6019400700 1 -- 172.21.15.69:0/3328891240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c106580 msgr2=0x7f601c19cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.892+0000 7f6019400700 1 --2- 172.21.15.69:0/3328891240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c106580 0x7f601c19cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.892+0000 7f6019400700 1 -- 172.21.15.69:0/3328891240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f601c1a1d80 con 0x7f601c106ed0 2024-05-14T15:22:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.892+0000 7f601a800700 1 --2- 172.21.15.69:0/3328891240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f601c10c5c0 0x7f601c1a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:22:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.892+0000 7f6019400700 1 --2- 172.21.15.69:0/3328891240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f601c106ed0 0x7f601c19d500 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6008006010 tx=0x7f60080036f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.893+0000 7f6012a00700 1 -- 172.21.15.69:0/3328891240 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6008027070 con 0x7f601c106ed0 2024-05-14T15:22:01.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.893+0000 7f6012a00700 1 -- 172.21.15.69:0/3328891240 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f600800fd40 con 0x7f601c106ed0 2024-05-14T15:22:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.893+0000 7f6020a00700 1 -- 172.21.15.69:0/3328891240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f601c1a2010 con 0x7f601c106ed0 2024-05-14T15:22:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.893+0000 7f6012a00700 1 -- 172.21.15.69:0/3328891240 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6008022ca0 con 0x7f601c106ed0 2024-05-14T15:22:01.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.893+0000 7f6020a00700 1 -- 172.21.15.69:0/3328891240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f601c1a2540 con 0x7f601c106ed0 2024-05-14T15:22:01.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.899+0000 7f6012a00700 1 -- 172.21.15.69:0/3328891240 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 23) ==== 149828+0+0 (secure 0 0 0) 0x7f600802a070 con 0x7f601c106ed0 2024-05-14T15:22:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.899+0000 7f602f512b80 1 Processor -- start 2024-05-14T15:22:01.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.899+0000 7f602f512b80 1 -- start start 2024-05-14T15:22:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.900+0000 7f602f512b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61bc1e40 0x559a61d452f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.900+0000 7f602f512b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d45830 0x559a61d3f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.900+0000 7f602f512b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d3f9f0 0x559a61d3fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.900+0000 7f602f512b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x559a61c61a20 con 0x559a61d45830 2024-05-14T15:22:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.900+0000 7f602f512b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559a61bff760 con 0x559a61bc1e40 2024-05-14T15:22:01.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.900+0000 7f602f512b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559a61c5d9e0 con 0x559a61d3f9f0 2024-05-14T15:22:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.900+0000 7f6019e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d45830 0x559a61d3f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.901+0000 7f6019e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d45830 0x559a61d3f4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57024/0 (socket says 172.21.15.69:57024) 2024-05-14T15:22:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.901+0000 7f601a800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61bc1e40 0x559a61d452f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.901+0000 7f6019e00700 1 -- 172.21.15.69:0/3742103125 learned_addr learned my addr 172.21.15.69:0/3742103125 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.901+0000 7f6019400700 1 --2- 172.21.15.69:0/3742103125 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d3f9f0 0x559a61d3fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.901+0000 7f6012a00700 1 --2- 172.21.15.69:0/3328891240 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f60000b2b00 0x7f60000b5010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.901+0000 7f6019e00700 1 -- 172.21.15.69:0/3742103125 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d3f9f0 msgr2=0x559a61d3fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.901+0000 7f6019e00700 1 --2- 172.21.15.69:0/3742103125 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d3f9f0 0x559a61d3fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.901+0000 7f6019e00700 1 -- 172.21.15.69:0/3742103125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61bc1e40 msgr2=0x559a61d452f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.901+0000 7f6019e00700 1 --2- 172.21.15.69:0/3742103125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61bc1e40 0x559a61d452f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.901+0000 7f6019e00700 1 -- 172.21.15.69:0/3742103125 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a61bae8d0 con 0x559a61d45830 2024-05-14T15:22:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.901+0000 7f6012a00700 1 -- 172.21.15.69:0/3328891240 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f60080e3b20 con 0x7f601c106ed0 2024-05-14T15:22:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.902+0000 7f601a800700 1 --2- 172.21.15.69:0/3328891240 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f60000b2b00 0x7f60000b5010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.902+0000 7f6019e00700 1 --2- 172.21.15.69:0/3742103125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d45830 0x559a61d3f4b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f600c00cc50 tx=0x7f600c00cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6977402e82520d5e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:01.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.902+0000 7f6007400700 1 -- 172.21.15.69:0/3742103125 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c014070 con 0x559a61d45830 2024-05-14T15:22:01.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.902+0000 7f6007400700 1 -- 172.21.15.69:0/3742103125 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f600c00ed40 con 0x559a61d45830 2024-05-14T15:22:01.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.902+0000 7f6007400700 1 -- 172.21.15.69:0/3742103125 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c010760 con 0x559a61d45830 2024-05-14T15:22:01.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.903+0000 7f602f512b80 1 -- 172.21.15.69:0/3742103125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d45830 msgr2=0x559a61d3f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:01.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.903+0000 7f601a800700 1 --2- 172.21.15.69:0/3328891240 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f60000b2b00 0x7f60000b5010 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6014011510 tx=0x7f6014004ad0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:01.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.903+0000 7f602f512b80 1 --2- 172.21.15.69:0/3742103125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d45830 0x559a61d3f4b0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f600c00cc50 tx=0x7f600c00cf60 comp rx=0 tx=0).stop 2024-05-14T15:22:01.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.904+0000 7f602f512b80 1 -- 172.21.15.69:0/3742103125 shutdown_connections 2024-05-14T15:22:01.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.904+0000 7f602f512b80 1 --2- 172.21.15.69:0/3742103125 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d3f9f0 0x559a61d3fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.904+0000 7f602f512b80 1 --2- 172.21.15.69:0/3742103125 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61bc1e40 0x559a61d452f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.904+0000 7f602f512b80 1 --2- 172.21.15.69:0/3742103125 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d45830 0x559a61d3f4b0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.904+0000 7f602f512b80 1 -- 172.21.15.69:0/3742103125 >> 172.21.15.69:0/3742103125 conn(0x559a61c06f70 msgr2=0x559a61d3a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.904+0000 7f602f512b80 1 -- 172.21.15.69:0/3742103125 shutdown_connections 2024-05-14T15:22:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.904+0000 7f602f512b80 1 -- 172.21.15.69:0/3742103125 wait complete. 2024-05-14T15:22:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.905+0000 7f602f512b80 1 -- start start 2024-05-14T15:22:01.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.905+0000 7f602f512b80 1 Processor -- start 2024-05-14T15:22:01.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.906+0000 7f602f512b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61bc1e40 0x559a61d48f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.906+0000 7f602f512b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61d3f9f0 0x559a61d494d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.906+0000 7f602f512b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d45830 0x559a61d49a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.906+0000 7f602f512b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x559a61d4c310 con 0x559a61bc1e40 2024-05-14T15:22:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.906+0000 7f602f512b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559a61bc7b20 con 0x559a61d3f9f0 2024-05-14T15:22:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.906+0000 7f602f512b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559a61d4c490 con 0x559a61d45830 2024-05-14T15:22:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.906+0000 7f602f512b80 10 client.0 _ll_register_callbacks cb 0x559a61c08c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.906+0000 7f6019e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61bc1e40 0x559a61d48f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.906+0000 7f6019e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61bc1e40 0x559a61d48f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57036/0 (socket says 172.21.15.69:57036) 2024-05-14T15:22:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.906+0000 7f6019e00700 1 -- 172.21.15.69:0/399109274 learned_addr learned my addr 172.21.15.69:0/399109274 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.906+0000 7f6019400700 1 --2- 172.21.15.69:0/399109274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61d3f9f0 0x559a61d494d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.907+0000 7f601a800700 1 --2- 172.21.15.69:0/399109274 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d45830 0x559a61d49a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.907+0000 7f6019e00700 1 -- 172.21.15.69:0/399109274 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d45830 msgr2=0x559a61d49a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:01.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.907+0000 7f6019e00700 1 --2- 172.21.15.69:0/399109274 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d45830 0x559a61d49a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.907+0000 7f6019e00700 1 -- 172.21.15.69:0/399109274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61d3f9f0 msgr2=0x559a61d494d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.907+0000 7f6019e00700 1 --2- 172.21.15.69:0/399109274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61d3f9f0 0x559a61d494d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.907+0000 7f6019e00700 1 -- 172.21.15.69:0/399109274 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a61c27420 con 0x559a61bc1e40 2024-05-14T15:22:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.907+0000 7f601a800700 1 --2- 172.21.15.69:0/399109274 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d45830 0x559a61d49a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:22:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.907+0000 7f6019e00700 1 --2- 172.21.15.69:0/399109274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61bc1e40 0x559a61d48f90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f600c019be0 tx=0x7f600c019c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66119c2a840294ba server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.907+0000 7f5ffbe00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.908+0000 7f5ffbe00700 1 -- 172.21.15.69:0/399109274 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f600c014070 con 0x559a61bc1e40 2024-05-14T15:22:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.908+0000 7f5ffbe00700 1 -- 172.21.15.69:0/399109274 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f600c005240 con 0x559a61bc1e40 2024-05-14T15:22:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.908+0000 7f602f512b80 1 -- 172.21.15.69:0/399109274 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f600c00ed40 con 0x559a61bc1e40 2024-05-14T15:22:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.908+0000 7f5ffbe00700 1 -- 172.21.15.69:0/399109274 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f600c005440 con 0x559a61bc1e40 2024-05-14T15:22:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.908+0000 7f602f512b80 10 client.15522 fetch_fsmap learned FSMap version 30 2024-05-14T15:22:01.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.908+0000 7f602f512b80 1 -- 172.21.15.69:0/399109274 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559a61d5f600 con 0x559a61bc1e40 2024-05-14T15:22:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.909+0000 7f5ffbe00700 1 -- 172.21.15.69:0/399109274 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f600c00ed40 con 0x559a61bc1e40 2024-05-14T15:22:01.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.909+0000 7f5ffbe00700 1 -- 172.21.15.69:0/399109274 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f600c022430 con 0x559a61bc1e40 2024-05-14T15:22:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.909+0000 7f602f512b80 10 client.15522 fetch_fsmap finished waiting for FSMap version 30 2024-05-14T15:22:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.909+0000 7f602f512b80 10 client.15522 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:22:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.909+0000 7f602f512b80 20 client.15522 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.909+0000 7f602f512b80 1 --2- 172.21.15.69:0/399109274 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559a61d61b80 0x559a61d63fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.909+0000 7f602f512b80 4 client.15522 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:22:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.909+0000 7f602f512b80 1 -- 172.21.15.69:0/399109274 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559a61d0c1c0 con 0x559a61d61b80 2024-05-14T15:22:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.910+0000 7f6019400700 1 --2- 172.21.15.69:0/399109274 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559a61d61b80 0x559a61d63fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.911+0000 7f6019400700 1 --2- 172.21.15.69:0/399109274 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559a61d61b80 0x559a61d63fa0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7d49c0e7750a022d server_cookie=f08928e03794399d in_seq=0 out_seq=0 2024-05-14T15:22:01.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.911+0000 7f5ffbe00700 10 client.15522 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.914+0000 7f5ffbe00700 1 -- 172.21.15.69:0/399109274 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559a61d0c1c0 con 0x559a61d61b80 2024-05-14T15:22:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.914+0000 7f5ffbe00700 10 client.15522 handle_command_reply: tid=0 2024-05-14T15:22:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.914+0000 7f602f512b80 1 client.15522 shutdown 2024-05-14T15:22:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.914+0000 7f602f512b80 1 -- 172.21.15.69:0/399109274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61bc1e40 msgr2=0x559a61d48f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.914+0000 7f602f512b80 1 --2- 172.21.15.69:0/399109274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61bc1e40 0x559a61d48f90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f600c019be0 tx=0x7f600c019c10 comp rx=0 tx=0).stop 2024-05-14T15:22:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.914+0000 7f602f512b80 1 -- 172.21.15.69:0/399109274 shutdown_connections 2024-05-14T15:22:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.914+0000 7f602f512b80 1 --2- 172.21.15.69:0/399109274 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559a61d61b80 0x559a61d63fa0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.914+0000 7f602f512b80 1 --2- 172.21.15.69:0/399109274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61bc1e40 0x559a61d48f90 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.914+0000 7f602f512b80 1 --2- 172.21.15.69:0/399109274 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d45830 0x559a61d49a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.914+0000 7f602f512b80 1 --2- 172.21.15.69:0/399109274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61d3f9f0 0x559a61d494d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.914+0000 7f5ffbe00700 0 client.15522 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:01.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.914+0000 7f602f512b80 1 -- 172.21.15.69:0/399109274 >> 172.21.15.69:0/399109274 conn(0x559a61c06f70 msgr2=0x559a61d3e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:01.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.915+0000 7f602f512b80 1 -- 172.21.15.69:0/399109274 shutdown_connections 2024-05-14T15:22:01.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.915+0000 7f602f512b80 1 -- 172.21.15.69:0/399109274 wait complete. 2024-05-14T15:22:01.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.915+0000 7f602f512b80 20 client.15522 trim_cache size 0 max 16384 2024-05-14T15:22:01.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.930+0000 7f6012a00700 1 -- 172.21.15.69:0/3328891240 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mgrmap(e 24) ==== 149885+0+0 (secure 0 0 0) 0x7f60080a6c00 con 0x7f601c106ed0 2024-05-14T15:22:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.946+0000 7f602f512b80 1 Processor -- start 2024-05-14T15:22:01.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.946+0000 7f602f512b80 1 -- start start 2024-05-14T15:22:01.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.947+0000 7f602f512b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61bc1e40 0x559a61d3f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.947+0000 7f602f512b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61d3f9f0 0x559a61d49850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.947+0000 7f602f512b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d45830 0x559a61d47fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.947+0000 7f602f512b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f601c1ae360 con 0x559a61d45830 2024-05-14T15:22:01.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.947+0000 7f602f512b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f601c1afea0 con 0x559a61d3f9f0 2024-05-14T15:22:01.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.947+0000 7f602f512b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f601c1aea30 con 0x559a61bc1e40 2024-05-14T15:22:01.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.947+0000 7f601a800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d45830 0x559a61d47fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.947+0000 7f601a800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d45830 0x559a61d47fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57040/0 (socket says 172.21.15.69:57040) 2024-05-14T15:22:01.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.947+0000 7f601a800700 1 -- 172.21.15.69:0/877424054 learned_addr learned my addr 172.21.15.69:0/877424054 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:01.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.948+0000 7f6019e00700 1 --2- 172.21.15.69:0/877424054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61bc1e40 0x559a61d3f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.948+0000 7f6019400700 1 --2- 172.21.15.69:0/877424054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61d3f9f0 0x559a61d49850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.948+0000 7f601a800700 1 -- 172.21.15.69:0/877424054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61bc1e40 msgr2=0x559a61d3f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:01.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.948+0000 7f601a800700 1 --2- 172.21.15.69:0/877424054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61bc1e40 0x559a61d3f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.948+0000 7f601a800700 1 -- 172.21.15.69:0/877424054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61d3f9f0 msgr2=0x559a61d49850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:01.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.948+0000 7f601a800700 1 --2- 172.21.15.69:0/877424054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61d3f9f0 0x559a61d49850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.948+0000 7f601a800700 1 -- 172.21.15.69:0/877424054 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559a61d406b0 con 0x559a61d45830 2024-05-14T15:22:01.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.948+0000 7f601a800700 1 --2- 172.21.15.69:0/877424054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d45830 0x559a61d47fb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6014007d40 tx=0x7f6014014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a6ac3cac5168e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:01.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.949+0000 7f6006a00700 1 -- 172.21.15.69:0/877424054 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6014024070 con 0x559a61d45830 2024-05-14T15:22:01.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.949+0000 7f6006a00700 1 -- 172.21.15.69:0/877424054 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6014019040 con 0x559a61d45830 2024-05-14T15:22:01.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.949+0000 7f6006a00700 1 -- 172.21.15.69:0/877424054 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f601401f6e0 con 0x559a61d45830 2024-05-14T15:22:01.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.950+0000 7f602f512b80 1 -- 172.21.15.69:0/877424054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d45830 msgr2=0x559a61d47fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:01.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.950+0000 7f602f512b80 1 --2- 172.21.15.69:0/877424054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d45830 0x559a61d47fb0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f6014007d40 tx=0x7f6014014000 comp rx=0 tx=0).stop 2024-05-14T15:22:01.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.950+0000 7f602f512b80 1 -- 172.21.15.69:0/877424054 shutdown_connections 2024-05-14T15:22:01.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.950+0000 7f602f512b80 1 --2- 172.21.15.69:0/877424054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d45830 0x559a61d47fb0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.950+0000 7f602f512b80 1 --2- 172.21.15.69:0/877424054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61bc1e40 0x559a61d3f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.950+0000 7f602f512b80 1 --2- 172.21.15.69:0/877424054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61d3f9f0 0x559a61d49850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.950+0000 7f602f512b80 1 -- 172.21.15.69:0/877424054 >> 172.21.15.69:0/877424054 conn(0x559a61c06f70 msgr2=0x559a61d478a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:01.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.950+0000 7f602f512b80 1 -- 172.21.15.69:0/877424054 shutdown_connections 2024-05-14T15:22:01.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.950+0000 7f602f512b80 1 -- 172.21.15.69:0/877424054 wait complete. 2024-05-14T15:22:01.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.951+0000 7f602f512b80 1 -- start start 2024-05-14T15:22:01.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.951+0000 7f602f512b80 1 Processor -- start 2024-05-14T15:22:01.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.952+0000 7f602f512b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61bc1e40 0x559a61d68ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.952+0000 7f602f512b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d3f9f0 0x559a61d69530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.952+0000 7f602f512b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d45830 0x559a61d69a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.952+0000 7f602f512b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f601c1af7d0 con 0x559a61d3f9f0 2024-05-14T15:22:01.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.952+0000 7f602f512b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f601c1af100 con 0x559a61bc1e40 2024-05-14T15:22:01.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.952+0000 7f602f512b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f601c1ac320 con 0x559a61d45830 2024-05-14T15:22:01.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.952+0000 7f602f512b80 10 client.0 _ll_register_callbacks cb 0x559a61c08c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:01.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.952+0000 7f6019400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d3f9f0 0x559a61d69530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.952+0000 7f6019e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61bc1e40 0x559a61d68ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.952+0000 7f6019400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d3f9f0 0x559a61d69530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57046/0 (socket says 172.21.15.69:57046) 2024-05-14T15:22:01.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.952+0000 7f6019400700 1 -- 172.21.15.69:0/1005642999 learned_addr learned my addr 172.21.15.69:0/1005642999 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:01.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.953+0000 7f601a800700 1 --2- 172.21.15.69:0/1005642999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d45830 0x559a61d69a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.953+0000 7f6019400700 1 -- 172.21.15.69:0/1005642999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d45830 msgr2=0x559a61d69a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:01.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.953+0000 7f6019400700 1 --2- 172.21.15.69:0/1005642999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d45830 0x559a61d69a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.953+0000 7f6019400700 1 -- 172.21.15.69:0/1005642999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61bc1e40 msgr2=0x559a61d68ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:01.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.953+0000 7f6019400700 1 --2- 172.21.15.69:0/1005642999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61bc1e40 0x559a61d68ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.953+0000 7f6019400700 1 -- 172.21.15.69:0/1005642999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559a61dcb310 con 0x559a61d3f9f0 2024-05-14T15:22:01.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.953+0000 7f601a800700 1 --2- 172.21.15.69:0/1005642999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d45830 0x559a61d69a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:22:01.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.953+0000 7f6019400700 1 --2- 172.21.15.69:0/1005642999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d3f9f0 0x559a61d69530 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f60080d53a0 tx=0x7f60080cd330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8d0d296a823a3f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:01.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.953+0000 7f5ffbe00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:01.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.954+0000 7f5ffbe00700 1 -- 172.21.15.69:0/1005642999 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60080aa2c0 con 0x559a61d3f9f0 2024-05-14T15:22:01.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.954+0000 7f5ffbe00700 1 -- 172.21.15.69:0/1005642999 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f60080d4af0 con 0x559a61d3f9f0 2024-05-14T15:22:01.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.954+0000 7f602f512b80 1 -- 172.21.15.69:0/1005642999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6014019040 con 0x559a61d3f9f0 2024-05-14T15:22:01.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.954+0000 7f5ffbe00700 1 -- 172.21.15.69:0/1005642999 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6008022470 con 0x559a61d3f9f0 2024-05-14T15:22:01.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.954+0000 7f602f512b80 10 client.15528 fetch_fsmap learned FSMap version 30 2024-05-14T15:22:01.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.954+0000 7f602f512b80 1 -- 172.21.15.69:0/1005642999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x559a61dcc580 con 0x559a61d3f9f0 2024-05-14T15:22:01.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.954+0000 7f5ffbe00700 1 -- 172.21.15.69:0/1005642999 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6014019040 con 0x559a61d3f9f0 2024-05-14T15:22:01.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.954+0000 7f5ffbe00700 1 -- 172.21.15.69:0/1005642999 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f60080d7ee0 con 0x559a61d3f9f0 2024-05-14T15:22:01.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.955+0000 7f602f512b80 10 client.15528 fetch_fsmap finished waiting for FSMap version 30 2024-05-14T15:22:01.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.955+0000 7f602f512b80 10 client.15528 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:22:01.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.955+0000 7f602f512b80 20 client.15528 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:01.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.955+0000 7f602f512b80 1 --2- 172.21.15.69:0/1005642999 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559a61dcccb0 0x559a61dcf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:01.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.955+0000 7f602f512b80 4 client.15528 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T15:22:01.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.955+0000 7f602f512b80 1 -- 172.21.15.69:0/1005642999 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559a61c6f400 con 0x559a61dcccb0 2024-05-14T15:22:01.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.955+0000 7f6019e00700 1 --2- 172.21.15.69:0/1005642999 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559a61dcccb0 0x559a61dcf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:01.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.956+0000 7f6019e00700 1 --2- 172.21.15.69:0/1005642999 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559a61dcccb0 0x559a61dcf0d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f323532f5be4475 server_cookie=cd8c641941d11d8e in_seq=0 out_seq=0 2024-05-14T15:22:01.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.956+0000 7f5ffbe00700 10 client.15528 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:01.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.957+0000 7f5ffbe00700 1 -- 172.21.15.69:0/1005642999 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559a61c6f400 con 0x559a61dcccb0 2024-05-14T15:22:01.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.957+0000 7f5ffbe00700 10 client.15528 handle_command_reply: tid=0 2024-05-14T15:22:01.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.957+0000 7f602f512b80 1 client.15528 shutdown 2024-05-14T15:22:01.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.957+0000 7f602f512b80 1 -- 172.21.15.69:0/1005642999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d3f9f0 msgr2=0x559a61d69530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:01.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.957+0000 7f602f512b80 1 --2- 172.21.15.69:0/1005642999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d3f9f0 0x559a61d69530 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f60080d53a0 tx=0x7f60080cd330 comp rx=0 tx=0).stop 2024-05-14T15:22:01.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.957+0000 7f602f512b80 1 -- 172.21.15.69:0/1005642999 shutdown_connections 2024-05-14T15:22:01.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.957+0000 7f602f512b80 1 --2- 172.21.15.69:0/1005642999 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559a61dcccb0 0x559a61dcf0d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.957+0000 7f602f512b80 1 --2- 172.21.15.69:0/1005642999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559a61d45830 0x559a61d69a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.957+0000 7f602f512b80 1 --2- 172.21.15.69:0/1005642999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559a61bc1e40 0x559a61d68ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.957+0000 7f602f512b80 1 --2- 172.21.15.69:0/1005642999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559a61d3f9f0 0x559a61d69530 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.957+0000 7f602f512b80 1 -- 172.21.15.69:0/1005642999 >> 172.21.15.69:0/1005642999 conn(0x559a61c06f70 msgr2=0x559a61d340a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.957+0000 7f5ffbe00700 0 client.15528 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.958+0000 7f602f512b80 1 -- 172.21.15.69:0/1005642999 shutdown_connections 2024-05-14T15:22:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.958+0000 7f602f512b80 1 -- 172.21.15.69:0/1005642999 wait complete. 2024-05-14T15:22:01.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.958+0000 7f602f512b80 20 client.15528 trim_cache size 0 max 16384 2024-05-14T15:22:01.959 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:22:01.959 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-14T15:22:01.959 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2024-05-14T15:22:01.959 INFO:teuthology.orchestra.run.smithi069.stdout: "1da191e0-0de8-465f-b85e-566bec8fa9f5": { 2024-05-14T15:22:01.959 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2024-05-14T15:22:01.960 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "1da191e0-0de8-465f-b85e-566bec8fa9f5", 2024-05-14T15:22:01.960 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2024-05-14T15:22:01.960 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:22:01.960 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:22:01.960 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:22:01.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.959+0000 7f6020a00700 1 -- 172.21.15.69:0/3328891240 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f60000b2b00 msgr2=0x7f60000b5010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.959+0000 7f6020a00700 1 --2- 172.21.15.69:0/3328891240 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f60000b2b00 0x7f60000b5010 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6014011510 tx=0x7f6014004ad0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.959+0000 7f6020a00700 1 -- 172.21.15.69:0/3328891240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f601c106ed0 msgr2=0x7f601c19d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.959+0000 7f6020a00700 1 --2- 172.21.15.69:0/3328891240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f601c106ed0 0x7f601c19d500 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f6008006010 tx=0x7f60080036f0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.959+0000 7f6020a00700 1 -- 172.21.15.69:0/3328891240 shutdown_connections 2024-05-14T15:22:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.959+0000 7f6020a00700 1 --2- 172.21.15.69:0/3328891240 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f60000b2b00 0x7f60000b5010 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.959+0000 7f6020a00700 1 --2- 172.21.15.69:0/3328891240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f601c10c5c0 0x7f601c1a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.959+0000 7f6020a00700 1 --2- 172.21.15.69:0/3328891240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f601c106580 0x7f601c19cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.959+0000 7f6020a00700 1 --2- 172.21.15.69:0/3328891240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f601c106ed0 0x7f601c19d500 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.959+0000 7f6020a00700 1 -- 172.21.15.69:0/3328891240 >> 172.21.15.69:0/3328891240 conn(0x7f601c102080 msgr2=0x7f601c104960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.959+0000 7f6020a00700 1 -- 172.21.15.69:0/3328891240 shutdown_connections 2024-05-14T15:22:01.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:01.959+0000 7f6020a00700 1 -- 172.21.15.69:0/3328891240 wait complete. 2024-05-14T15:22:02.031 INFO:teuthology.orchestra.run.smithi069.stderr: * Initializing database in '/tmp/cephfs/postgres/data' 2024-05-14T15:22:02.975 INFO:tasks.cephfs.filesystem:scrub status for tag:1da191e0-0de8-465f-b85e-566bec8fa9f5 - {'path': '/', 'tag': '1da191e0-0de8-465f-b85e-566bec8fa9f5', 'options': 'recursive,force'} 2024-05-14T15:22:03.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:02 smithi092 ceph-mon[34729]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-05-14T15:22:03.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:02 smithi092 ceph-mon[34729]: mgrmap e24: x(active, since 24s), standbys: z, y 2024-05-14T15:22:03.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:02 smithi069 ceph-mon[31270]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-05-14T15:22:03.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:02 smithi069 ceph-mon[31270]: mgrmap e24: x(active, since 24s), standbys: z, y 2024-05-14T15:22:03.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:02 smithi203 ceph-mon[34567]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-05-14T15:22:03.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:02 smithi203 ceph-mon[34567]: mgrmap e24: x(active, since 24s), standbys: z, y 2024-05-14T15:22:05.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:04 smithi092 ceph-mon[34729]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-05-14T15:22:05.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:04 smithi069 ceph-mon[31270]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-05-14T15:22:05.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:04 smithi203 ceph-mon[34567]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 382 MiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 77 KiB/s wr, 40 op/s 2024-05-14T15:22:07.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:06 smithi092 ceph-mon[34729]: pgmap v17: 129 pgs: 129 active+clean; 1.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 115 KiB/s wr, 62 op/s 2024-05-14T15:22:07.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:06 smithi069 ceph-mon[31270]: pgmap v17: 129 pgs: 129 active+clean; 1.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 115 KiB/s wr, 62 op/s 2024-05-14T15:22:07.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:06 smithi203 ceph-mon[34567]: pgmap v17: 129 pgs: 129 active+clean; 1.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 115 KiB/s wr, 62 op/s 2024-05-14T15:22:09.209 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:08 smithi069 ceph-mon[31270]: pgmap v18: 129 pgs: 129 active+clean; 1.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 115 KiB/s wr, 58 op/s 2024-05-14T15:22:09.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:08 smithi203 ceph-mon[34567]: pgmap v18: 129 pgs: 129 active+clean; 1.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 115 KiB/s wr, 58 op/s 2024-05-14T15:22:09.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:08 smithi092 ceph-mon[34729]: pgmap v18: 129 pgs: 129 active+clean; 1.5 MiB data, 387 MiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 115 KiB/s wr, 58 op/s 2024-05-14T15:22:11.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:10 smithi203 ceph-mon[34567]: pgmap v19: 129 pgs: 129 active+clean; 20 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 1.7 MiB/s wr, 71 op/s 2024-05-14T15:22:11.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:10 smithi069 ceph-mon[31270]: pgmap v19: 129 pgs: 129 active+clean; 20 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 1.7 MiB/s wr, 71 op/s 2024-05-14T15:22:11.245 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:10 smithi092 ceph-mon[34729]: pgmap v19: 129 pgs: 129 active+clean; 20 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 1.7 MiB/s wr, 71 op/s 2024-05-14T15:22:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.668+0000 7fad2fe00640 1 -- 172.21.15.69:0/2569818952 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad30104210 msgr2=0x7fad301105e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:11.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.668+0000 7fad2fe00640 1 --2- 172.21.15.69:0/2569818952 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad30104210 0x7fad301105e0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fad28009900 tx=0x7fad2802a410 comp rx=0 tx=0).stop 2024-05-14T15:22:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.668+0000 7fad2fe00640 1 -- 172.21.15.69:0/2569818952 shutdown_connections 2024-05-14T15:22:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.668+0000 7fad2fe00640 1 --2- 172.21.15.69:0/2569818952 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad30104210 0x7fad301105e0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.668+0000 7fad2fe00640 1 --2- 172.21.15.69:0/2569818952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad30109f60 0x7fad30103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.668+0000 7fad2fe00640 1 --2- 172.21.15.69:0/2569818952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad30109ac0 0x7fad30103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.668+0000 7fad2fe00640 1 -- 172.21.15.69:0/2569818952 >> 172.21.15.69:0/2569818952 conn(0x7fad30079150 msgr2=0x7fad30079590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.668+0000 7fad2fe00640 1 -- 172.21.15.69:0/2569818952 shutdown_connections 2024-05-14T15:22:11.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.668+0000 7fad2fe00640 1 -- 172.21.15.69:0/2569818952 wait complete. 2024-05-14T15:22:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.669+0000 7fad2fe00640 1 Processor -- start 2024-05-14T15:22:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.669+0000 7fad2fe00640 1 -- start start 2024-05-14T15:22:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.670+0000 7fad2fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad30104210 0x7fad3019a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.670+0000 7fad2fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad30109ac0 0x7fad3019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.670+0000 7fad2fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad30109f60 0x7fad3019ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.670+0000 7fad2fe00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fad30113bb0 con 0x7fad30109f60 2024-05-14T15:22:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.670+0000 7fad2fe00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fad30113a30 con 0x7fad30109ac0 2024-05-14T15:22:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.670+0000 7fad2fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fad30113d30 con 0x7fad30104210 2024-05-14T15:22:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.670+0000 7fad2f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad30109f60 0x7fad3019ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.670+0000 7fad2f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad30109f60 0x7fad3019ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54828/0 (socket says 172.21.15.69:54828) 2024-05-14T15:22:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.670+0000 7fad2f400640 1 -- 172.21.15.69:0/3597530533 learned_addr learned my addr 172.21.15.69:0/3597530533 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.671+0000 7fad2ea00640 1 --2- 172.21.15.69:0/3597530533 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad30104210 0x7fad3019a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.671+0000 7fad26000640 1 --2- 172.21.15.69:0/3597530533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad30109ac0 0x7fad3019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.671+0000 7fad2f400640 1 -- 172.21.15.69:0/3597530533 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad30104210 msgr2=0x7fad3019a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.671+0000 7fad2f400640 1 --2- 172.21.15.69:0/3597530533 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad30104210 0x7fad3019a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.671+0000 7fad2f400640 1 -- 172.21.15.69:0/3597530533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad30109ac0 msgr2=0x7fad3019ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.671+0000 7fad2f400640 1 --2- 172.21.15.69:0/3597530533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad30109ac0 0x7fad3019ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.671+0000 7fad2f400640 1 -- 172.21.15.69:0/3597530533 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad3019f450 con 0x7fad30109f60 2024-05-14T15:22:11.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.671+0000 7fad2f400640 1 --2- 172.21.15.69:0/3597530533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad30109f60 0x7fad3019ee10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fad28004770 tx=0x7fad28003cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:11.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.671+0000 7fad27e00640 1 -- 172.21.15.69:0/3597530533 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2803f070 con 0x7fad30109f60 2024-05-14T15:22:11.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.671+0000 7fad27e00640 1 -- 172.21.15.69:0/3597530533 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad2803bd00 con 0x7fad30109f60 2024-05-14T15:22:11.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.672+0000 7fad2fe00640 1 -- 172.21.15.69:0/3597530533 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad3019f6e0 con 0x7fad30109f60 2024-05-14T15:22:11.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.672+0000 7fad27e00640 1 -- 172.21.15.69:0/3597530533 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad28035030 con 0x7fad30109f60 2024-05-14T15:22:11.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.672+0000 7fad2fe00640 1 -- 172.21.15.69:0/3597530533 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad3019fc20 con 0x7fad30109f60 2024-05-14T15:22:11.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.675+0000 7fad27e00640 1 -- 172.21.15.69:0/3597530533 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 149885+0+0 (secure 0 0 0) 0x7fad28042070 con 0x7fad30109f60 2024-05-14T15:22:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.676+0000 7fad3c9d9740 1 Processor -- start 2024-05-14T15:22:11.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.676+0000 7fad3c9d9740 1 -- start start 2024-05-14T15:22:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.677+0000 7fad3c9d9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570971b0 0x55fc57438480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.677+0000 7fad3c9d9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc5706e2f0 0x55fc574389c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.677+0000 7fad3c9d9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc570764d0 0x55fc57438f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.677+0000 7fad3c9d9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55fc5739d550 con 0x55fc570764d0 2024-05-14T15:22:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.677+0000 7fad3c9d9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fc57342bc0 con 0x55fc5706e2f0 2024-05-14T15:22:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.677+0000 7fad3c9d9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fc57399510 con 0x55fc570971b0 2024-05-14T15:22:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.677+0000 7fad26000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc570764d0 0x55fc57438f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.677+0000 7fad26000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc570764d0 0x55fc57438f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54842/0 (socket says 172.21.15.69:54842) 2024-05-14T15:22:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.677+0000 7fad26000640 1 -- 172.21.15.69:0/2551219314 learned_addr learned my addr 172.21.15.69:0/2551219314 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.677+0000 7fad26000640 1 --2- 172.21.15.69:0/2551219314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570971b0 0x55fc57438480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.677+0000 7fad2ea00640 1 --2- 172.21.15.69:0/2551219314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc5706e2f0 0x55fc574389c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.678+0000 7fad27e00640 1 --2- 172.21.15.69:0/3597530533 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fad140b2af0 0x7fad140b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.678+0000 7fad26000640 1 -- 172.21.15.69:0/2551219314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570971b0 msgr2=0x55fc57438480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.678+0000 7fad26000640 1 --2- 172.21.15.69:0/2551219314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570971b0 0x55fc57438480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.678+0000 7fad26000640 1 -- 172.21.15.69:0/2551219314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc5706e2f0 msgr2=0x55fc574389c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.678+0000 7fad26000640 1 --2- 172.21.15.69:0/2551219314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc5706e2f0 0x55fc574389c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.678+0000 7fad26000640 1 -- 172.21.15.69:0/2551219314 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc570af210 con 0x55fc570764d0 2024-05-14T15:22:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.678+0000 7fad27e00640 1 -- 172.21.15.69:0/3597530533 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fad281033f0 con 0x7fad30109f60 2024-05-14T15:22:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.678+0000 7fad2f400640 1 --2- 172.21.15.69:0/3597530533 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fad140b2af0 0x7fad140b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.678+0000 7fad26000640 1 --2- 172.21.15.69:0/2551219314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc570764d0 0x55fc57438f00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fad1800cfd0 tx=0x7fad1800c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dd100f411e9d19a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:11.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.678+0000 7fad1fe00640 1 -- 172.21.15.69:0/2551219314 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad18019030 con 0x55fc570764d0 2024-05-14T15:22:11.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.679+0000 7fad1fe00640 1 -- 172.21.15.69:0/2551219314 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad180054b0 con 0x55fc570764d0 2024-05-14T15:22:11.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.679+0000 7fad1fe00640 1 -- 172.21.15.69:0/2551219314 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad18011500 con 0x55fc570764d0 2024-05-14T15:22:11.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.679+0000 7fad3c9d9740 1 -- 172.21.15.69:0/2551219314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc570764d0 msgr2=0x55fc57438f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:11.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.679+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/2551219314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc570764d0 0x55fc57438f00 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fad1800cfd0 tx=0x7fad1800c410 comp rx=0 tx=0).stop 2024-05-14T15:22:11.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.679+0000 7fad2f400640 1 --2- 172.21.15.69:0/3597530533 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fad140b2af0 0x7fad140b5000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fad28100670 tx=0x7fad28047000 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:11.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.680+0000 7fad3c9d9740 1 -- 172.21.15.69:0/2551219314 shutdown_connections 2024-05-14T15:22:11.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.680+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/2551219314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc570764d0 0x55fc57438f00 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.680+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/2551219314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc5706e2f0 0x55fc574389c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.680+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/2551219314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570971b0 0x55fc57438480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.680+0000 7fad3c9d9740 1 -- 172.21.15.69:0/2551219314 >> 172.21.15.69:0/2551219314 conn(0x55fc5708b300 msgr2=0x55fc57434c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:11.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.680+0000 7fad3c9d9740 1 -- 172.21.15.69:0/2551219314 shutdown_connections 2024-05-14T15:22:11.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.680+0000 7fad3c9d9740 1 -- 172.21.15.69:0/2551219314 wait complete. 2024-05-14T15:22:11.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.680+0000 7fad3c9d9740 1 -- start start 2024-05-14T15:22:11.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.681+0000 7fad3c9d9740 1 Processor -- start 2024-05-14T15:22:11.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.681+0000 7fad3c9d9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc5706e2f0 0x55fc57442990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.681+0000 7fad3c9d9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570764d0 0x55fc57442ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.681+0000 7fad3c9d9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc570971b0 0x55fc57452e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.681+0000 7fad3c9d9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55fc574455b0 con 0x55fc5706e2f0 2024-05-14T15:22:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.681+0000 7fad3c9d9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55fc57356660 con 0x55fc570971b0 2024-05-14T15:22:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.681+0000 7fad3c9d9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55fc57445730 con 0x55fc570764d0 2024-05-14T15:22:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.681+0000 7fad3c9d9740 10 client.0 _ll_register_callbacks cb 0x55fc57320400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.681+0000 7fad26000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc5706e2f0 0x55fc57442990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.682+0000 7fad26000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc5706e2f0 0x55fc57442990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54856/0 (socket says 172.21.15.69:54856) 2024-05-14T15:22:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.682+0000 7fad26000640 1 -- 172.21.15.69:0/357957906 learned_addr learned my addr 172.21.15.69:0/357957906 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.682+0000 7fad2ea00640 1 --2- 172.21.15.69:0/357957906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570764d0 0x55fc57442ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.682+0000 7fad26000640 1 -- 172.21.15.69:0/357957906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570764d0 msgr2=0x55fc57442ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.682+0000 7fad26000640 1 --2- 172.21.15.69:0/357957906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570764d0 0x55fc57442ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.682+0000 7fad26000640 1 -- 172.21.15.69:0/357957906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc570971b0 msgr2=0x55fc57452e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:11.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.682+0000 7fad26000640 1 --2- 172.21.15.69:0/357957906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc570971b0 0x55fc57452e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.682+0000 7fad26000640 1 -- 172.21.15.69:0/357957906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc5717b620 con 0x55fc5706e2f0 2024-05-14T15:22:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.682+0000 7fad26000640 1 --2- 172.21.15.69:0/357957906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc5706e2f0 0x55fc57442990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fad18004d10 tx=0x7fad1800cd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce7a1d7aac659931 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.682+0000 7fad1cc00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.683+0000 7fad1cc00640 1 -- 172.21.15.69:0/357957906 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad18011700 con 0x55fc5706e2f0 2024-05-14T15:22:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.683+0000 7fad1cc00640 1 -- 172.21.15.69:0/357957906 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fad180118a0 con 0x55fc5706e2f0 2024-05-14T15:22:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.683+0000 7fad3c9d9740 1 -- 172.21.15.69:0/357957906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad180054b0 con 0x55fc5706e2f0 2024-05-14T15:22:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.683+0000 7fad1cc00640 1 -- 172.21.15.69:0/357957906 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fad18011aa0 con 0x55fc5706e2f0 2024-05-14T15:22:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.683+0000 7fad3c9d9740 10 client.15540 fetch_fsmap learned FSMap version 30 2024-05-14T15:22:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.683+0000 7fad3c9d9740 1 -- 172.21.15.69:0/357957906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fc57455c30 con 0x55fc5706e2f0 2024-05-14T15:22:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.684+0000 7fad1cc00640 1 -- 172.21.15.69:0/357957906 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad180054b0 con 0x55fc5706e2f0 2024-05-14T15:22:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.684+0000 7fad1cc00640 1 -- 172.21.15.69:0/357957906 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fad1801fb10 con 0x55fc5706e2f0 2024-05-14T15:22:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.684+0000 7fad3c9d9740 10 client.15540 fetch_fsmap finished waiting for FSMap version 30 2024-05-14T15:22:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.684+0000 7fad3c9d9740 10 client.15540 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:22:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.684+0000 7fad3c9d9740 20 client.15540 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:11.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.684+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/357957906 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55fc57055d80 0x55fc57458f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.684+0000 7fad3c9d9740 4 client.15540 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:22:11.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.684+0000 7fad3c9d9740 1 -- 172.21.15.69:0/357957906 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fc573ab160 con 0x55fc57055d80 2024-05-14T15:22:11.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.685+0000 7fad2ea00640 1 --2- 172.21.15.69:0/357957906 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55fc57055d80 0x55fc57458f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.686+0000 7fad2ea00640 1 --2- 172.21.15.69:0/357957906 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55fc57055d80 0x55fc57458f90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=693bd6a78a25771b server_cookie=c1cb4da30d82317 in_seq=0 out_seq=0 2024-05-14T15:22:11.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.686+0000 7fad1cc00640 10 client.15540 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:11.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.688+0000 7fad1cc00640 1 -- 172.21.15.69:0/357957906 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55fc573ab160 con 0x55fc57055d80 2024-05-14T15:22:11.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.688+0000 7fad1cc00640 10 client.15540 handle_command_reply: tid=0 2024-05-14T15:22:11.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.688+0000 7fad3c9d9740 1 client.15540 shutdown 2024-05-14T15:22:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.688+0000 7fad3c9d9740 1 -- 172.21.15.69:0/357957906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc5706e2f0 msgr2=0x55fc57442990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.688+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/357957906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc5706e2f0 0x55fc57442990 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fad18004d10 tx=0x7fad1800cd70 comp rx=0 tx=0).stop 2024-05-14T15:22:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.688+0000 7fad3c9d9740 1 -- 172.21.15.69:0/357957906 shutdown_connections 2024-05-14T15:22:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.688+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/357957906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc570971b0 0x55fc57452e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.688+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/357957906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570764d0 0x55fc57442ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.688+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/357957906 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55fc57055d80 0x55fc57458f90 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.688+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/357957906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc5706e2f0 0x55fc57442990 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.688+0000 7fad3c9d9740 1 -- 172.21.15.69:0/357957906 >> 172.21.15.69:0/357957906 conn(0x55fc5708b300 msgr2=0x55fc5743a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.688+0000 7fad1cc00640 0 client.15540 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.688+0000 7fad3c9d9740 1 -- 172.21.15.69:0/357957906 shutdown_connections 2024-05-14T15:22:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.688+0000 7fad3c9d9740 1 -- 172.21.15.69:0/357957906 wait complete. 2024-05-14T15:22:11.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.689+0000 7fad3c9d9740 20 client.15540 trim_cache size 0 max 16384 2024-05-14T15:22:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.708+0000 7fad3c9d9740 1 Processor -- start 2024-05-14T15:22:11.708 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.708+0000 7fad3c9d9740 1 -- start start 2024-05-14T15:22:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.709+0000 7fad3c9d9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc5706e2f0 0x55fc5743d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.709+0000 7fad3c9d9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570764d0 0x55fc57438c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.709+0000 7fad3c9d9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc570971b0 0x55fc57452e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.709+0000 7fad3c9d9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fad301aef00 con 0x55fc5706e2f0 2024-05-14T15:22:11.710 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.709+0000 7fad3c9d9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fad301b0a40 con 0x55fc570971b0 2024-05-14T15:22:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.709+0000 7fad3c9d9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fad301af5d0 con 0x55fc570764d0 2024-05-14T15:22:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.709+0000 7fad26000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc5706e2f0 0x55fc5743d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.709+0000 7fad26000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc5706e2f0 0x55fc5743d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54858/0 (socket says 172.21.15.69:54858) 2024-05-14T15:22:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.709+0000 7fad26000640 1 -- 172.21.15.69:0/155736008 learned_addr learned my addr 172.21.15.69:0/155736008 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.709+0000 7fad2ea00640 1 --2- 172.21.15.69:0/155736008 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570764d0 0x55fc57438c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.710+0000 7fad26000640 1 --2- 172.21.15.69:0/155736008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc570971b0 0x55fc57452e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.710+0000 7fad26000640 1 -- 172.21.15.69:0/155736008 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570764d0 msgr2=0x55fc57438c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.710+0000 7fad26000640 1 --2- 172.21.15.69:0/155736008 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570764d0 0x55fc57438c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.710+0000 7fad26000640 1 -- 172.21.15.69:0/155736008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc570971b0 msgr2=0x55fc57452e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.710+0000 7fad26000640 1 --2- 172.21.15.69:0/155736008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc570971b0 0x55fc57452e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.710+0000 7fad26000640 1 -- 172.21.15.69:0/155736008 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc57445600 con 0x55fc5706e2f0 2024-05-14T15:22:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.710+0000 7fad26000640 1 --2- 172.21.15.69:0/155736008 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc5706e2f0 0x55fc5743d0e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fad1800c450 tx=0x7fad18004d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cb863b128520b84 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.711+0000 7fad1f400640 1 -- 172.21.15.69:0/155736008 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad18019070 con 0x55fc5706e2f0 2024-05-14T15:22:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.711+0000 7fad1f400640 1 -- 172.21.15.69:0/155736008 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad1800cde0 con 0x55fc5706e2f0 2024-05-14T15:22:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.711+0000 7fad1f400640 1 -- 172.21.15.69:0/155736008 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad180055d0 con 0x55fc5706e2f0 2024-05-14T15:22:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.712+0000 7fad3c9d9740 1 -- 172.21.15.69:0/155736008 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc5706e2f0 msgr2=0x55fc5743d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.712+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/155736008 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc5706e2f0 0x55fc5743d0e0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fad1800c450 tx=0x7fad18004d40 comp rx=0 tx=0).stop 2024-05-14T15:22:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.712+0000 7fad3c9d9740 1 -- 172.21.15.69:0/155736008 shutdown_connections 2024-05-14T15:22:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.712+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/155736008 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc570971b0 0x55fc57452e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.712+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/155736008 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570764d0 0x55fc57438c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.712+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/155736008 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc5706e2f0 0x55fc5743d0e0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.712+0000 7fad3c9d9740 1 -- 172.21.15.69:0/155736008 >> 172.21.15.69:0/155736008 conn(0x55fc5708b300 msgr2=0x55fc57433d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.713+0000 7fad3c9d9740 1 -- 172.21.15.69:0/155736008 shutdown_connections 2024-05-14T15:22:11.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.713+0000 7fad3c9d9740 1 -- 172.21.15.69:0/155736008 wait complete. 2024-05-14T15:22:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.713+0000 7fad3c9d9740 1 -- start start 2024-05-14T15:22:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.714+0000 7fad3c9d9740 1 Processor -- start 2024-05-14T15:22:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.714+0000 7fad3c9d9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc5706e2f0 0x55fc57459410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.714+0000 7fad3c9d9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc570764d0 0x55fc57459950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.714+0000 7fad3c9d9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570971b0 0x55fc574b9080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.714+0000 7fad3c9d9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fad301b0370 con 0x55fc570764d0 2024-05-14T15:22:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.714+0000 7fad3c9d9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fad301afca0 con 0x55fc5706e2f0 2024-05-14T15:22:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.714+0000 7fad3c9d9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fad301acee0 con 0x55fc570971b0 2024-05-14T15:22:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.714+0000 7fad3c9d9740 10 client.0 _ll_register_callbacks cb 0x7fad18013f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.714+0000 7fad2ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc570764d0 0x55fc57459950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.715+0000 7fad2ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc570764d0 0x55fc57459950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54864/0 (socket says 172.21.15.69:54864) 2024-05-14T15:22:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.715+0000 7fad2ea00640 1 -- 172.21.15.69:0/4275634862 learned_addr learned my addr 172.21.15.69:0/4275634862 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.715+0000 7fad26000640 1 --2- 172.21.15.69:0/4275634862 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570971b0 0x55fc574b9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.715+0000 7fad26000640 1 --2- 172.21.15.69:0/4275634862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc5706e2f0 0x55fc57459410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.715+0000 7fad2ea00640 1 -- 172.21.15.69:0/4275634862 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570971b0 msgr2=0x55fc574b9080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.715+0000 7fad2ea00640 1 --2- 172.21.15.69:0/4275634862 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570971b0 0x55fc574b9080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.715+0000 7fad2ea00640 1 -- 172.21.15.69:0/4275634862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc5706e2f0 msgr2=0x55fc57459410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.715+0000 7fad2ea00640 1 --2- 172.21.15.69:0/4275634862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc5706e2f0 0x55fc57459410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.715+0000 7fad2ea00640 1 -- 172.21.15.69:0/4275634862 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc574b95f0 con 0x55fc570764d0 2024-05-14T15:22:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.715+0000 7fad26000640 1 --2- 172.21.15.69:0/4275634862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc5706e2f0 0x55fc57459410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:22:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.715+0000 7fad1cc00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:11.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.715+0000 7fad2ea00640 1 --2- 172.21.15.69:0/4275634862 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc570764d0 0x55fc57459950 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fad20009840 tx=0x7fad20004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27f3e0d9588eb601 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.716+0000 7fad1cc00640 1 -- 172.21.15.69:0/4275634862 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad20004cb0 con 0x55fc570764d0 2024-05-14T15:22:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.716+0000 7fad3c9d9740 1 -- 172.21.15.69:0/4275634862 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad1800cde0 con 0x55fc570764d0 2024-05-14T15:22:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.716+0000 7fad1cc00640 1 -- 172.21.15.69:0/4275634862 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fad2001b4a0 con 0x55fc570764d0 2024-05-14T15:22:11.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.716+0000 7fad1cc00640 1 -- 172.21.15.69:0/4275634862 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7fad20004e50 con 0x55fc570764d0 2024-05-14T15:22:11.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.716+0000 7fad3c9d9740 10 client.15546 fetch_fsmap learned FSMap version 30 2024-05-14T15:22:11.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.716+0000 7fad3c9d9740 1 -- 172.21.15.69:0/4275634862 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55fc574c0960 con 0x55fc570764d0 2024-05-14T15:22:11.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.717+0000 7fad1cc00640 1 -- 172.21.15.69:0/4275634862 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad1800cde0 con 0x55fc570764d0 2024-05-14T15:22:11.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.717+0000 7fad1cc00640 1 -- 172.21.15.69:0/4275634862 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7fad20022070 con 0x55fc570764d0 2024-05-14T15:22:11.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.717+0000 7fad3c9d9740 10 client.15546 fetch_fsmap finished waiting for FSMap version 30 2024-05-14T15:22:11.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.717+0000 7fad3c9d9740 10 client.15546 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:22:11.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.717+0000 7fad3c9d9740 20 client.15546 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:11.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.717+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/4275634862 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55fc5702b1c0 0x55fc574c3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:11.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.717+0000 7fad3c9d9740 4 client.15546 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:22:11.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.717+0000 7fad3c9d9740 1 -- 172.21.15.69:0/4275634862 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fc573a4fd0 con 0x55fc5702b1c0 2024-05-14T15:22:11.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.718+0000 7fad26000640 1 --2- 172.21.15.69:0/4275634862 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55fc5702b1c0 0x55fc574c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:11.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.719+0000 7fad1cc00640 10 client.15546 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:11.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.719+0000 7fad26000640 1 --2- 172.21.15.69:0/4275634862 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55fc5702b1c0 0x55fc574c3120 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6a8f4bb82161d60 server_cookie=f30843fb7b30a16 in_seq=0 out_seq=0 2024-05-14T15:22:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.932+0000 7fad1cc00640 1 -- 172.21.15.69:0/4275634862 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fc573a4fd0 con 0x55fc5702b1c0 2024-05-14T15:22:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.932+0000 7fad1cc00640 10 client.15546 handle_command_reply: tid=0 2024-05-14T15:22:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.932+0000 7fad3c9d9740 1 client.15546 shutdown 2024-05-14T15:22:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.932+0000 7fad3c9d9740 1 -- 172.21.15.69:0/4275634862 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc570764d0 msgr2=0x55fc57459950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.932+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/4275634862 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc570764d0 0x55fc57459950 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fad20009840 tx=0x7fad20004040 comp rx=0 tx=0).stop 2024-05-14T15:22:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.932+0000 7fad3c9d9740 1 -- 172.21.15.69:0/4275634862 shutdown_connections 2024-05-14T15:22:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.932+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/4275634862 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55fc570971b0 0x55fc574b9080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.932+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/4275634862 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55fc5702b1c0 0x55fc574c3120 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.932+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/4275634862 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55fc570764d0 0x55fc57459950 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.932+0000 7fad3c9d9740 1 --2- 172.21.15.69:0/4275634862 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55fc5706e2f0 0x55fc57459410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.932+0000 7fad3c9d9740 1 -- 172.21.15.69:0/4275634862 >> 172.21.15.69:0/4275634862 conn(0x55fc5708b300 msgr2=0x55fc57433d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.933+0000 7fad1cc00640 0 client.15546 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.933+0000 7fad3c9d9740 1 -- 172.21.15.69:0/4275634862 shutdown_connections 2024-05-14T15:22:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.933+0000 7fad3c9d9740 1 -- 172.21.15.69:0/4275634862 wait complete. 2024-05-14T15:22:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.933+0000 7fad3c9d9740 20 client.15546 trim_cache size 0 max 16384 2024-05-14T15:22:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:22:11.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:22:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:22:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:22:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.934+0000 7fad2fe00640 1 -- 172.21.15.69:0/3597530533 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fad140b2af0 msgr2=0x7fad140b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.934+0000 7fad2fe00640 1 --2- 172.21.15.69:0/3597530533 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fad140b2af0 0x7fad140b5000 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fad28100670 tx=0x7fad28047000 comp rx=0 tx=0).stop 2024-05-14T15:22:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.934+0000 7fad2fe00640 1 -- 172.21.15.69:0/3597530533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad30109f60 msgr2=0x7fad3019ee10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:11.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.934+0000 7fad2fe00640 1 --2- 172.21.15.69:0/3597530533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad30109f60 0x7fad3019ee10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fad28004770 tx=0x7fad28003cd0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.934+0000 7fad2fe00640 1 -- 172.21.15.69:0/3597530533 shutdown_connections 2024-05-14T15:22:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.934+0000 7fad2fe00640 1 --2- 172.21.15.69:0/3597530533 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fad140b2af0 0x7fad140b5000 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.934+0000 7fad2fe00640 1 --2- 172.21.15.69:0/3597530533 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad30109f60 0x7fad3019ee10 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.934+0000 7fad2fe00640 1 --2- 172.21.15.69:0/3597530533 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad30109ac0 0x7fad3019ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.934+0000 7fad2fe00640 1 --2- 172.21.15.69:0/3597530533 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad30104210 0x7fad3019a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.934+0000 7fad2fe00640 1 -- 172.21.15.69:0/3597530533 >> 172.21.15.69:0/3597530533 conn(0x7fad30079150 msgr2=0x7fad30100dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.934+0000 7fad2fe00640 1 -- 172.21.15.69:0/3597530533 shutdown_connections 2024-05-14T15:22:11.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:11.934+0000 7fad2fe00640 1 -- 172.21.15.69:0/3597530533 wait complete. 2024-05-14T15:22:13.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:12 smithi069 ceph-mon[31270]: pgmap v20: 129 pgs: 129 active+clean; 20 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 1.6 MiB/s wr, 35 op/s 2024-05-14T15:22:13.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:12 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:22:13.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:12 smithi203 ceph-mon[34567]: pgmap v20: 129 pgs: 129 active+clean; 20 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 1.6 MiB/s wr, 35 op/s 2024-05-14T15:22:13.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:12 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:22:13.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:12 smithi092 ceph-mon[34729]: pgmap v20: 129 pgs: 129 active+clean; 20 MiB data, 427 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 1.6 MiB/s wr, 35 op/s 2024-05-14T15:22:13.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:12 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:22:15.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:14 smithi069 ceph-mon[31270]: pgmap v21: 129 pgs: 129 active+clean; 21 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 1.7 MiB/s wr, 93 op/s 2024-05-14T15:22:15.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:14 smithi203 ceph-mon[34567]: pgmap v21: 129 pgs: 129 active+clean; 21 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 1.7 MiB/s wr, 93 op/s 2024-05-14T15:22:15.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:14 smithi092 ceph-mon[34729]: pgmap v21: 129 pgs: 129 active+clean; 21 MiB data, 439 MiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 1.7 MiB/s wr, 93 op/s 2024-05-14T15:22:17.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:16 smithi069 ceph-mon[31270]: pgmap v22: 129 pgs: 129 active+clean; 23 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 1.8 MiB/s wr, 143 op/s 2024-05-14T15:22:17.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:16 smithi203 ceph-mon[34567]: pgmap v22: 129 pgs: 129 active+clean; 23 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 1.8 MiB/s wr, 143 op/s 2024-05-14T15:22:17.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:16 smithi092 ceph-mon[34729]: pgmap v22: 129 pgs: 129 active+clean; 23 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 1.8 MiB/s wr, 143 op/s 2024-05-14T15:22:19.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:18 smithi203 ceph-mon[34567]: pgmap v23: 129 pgs: 129 active+clean; 23 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 1.8 MiB/s wr, 121 op/s 2024-05-14T15:22:19.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:18 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:22:19.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:18 smithi092 ceph-mon[34729]: pgmap v23: 129 pgs: 129 active+clean; 23 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 1.8 MiB/s wr, 121 op/s 2024-05-14T15:22:19.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:18 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:22:19.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:18 smithi069 ceph-mon[31270]: pgmap v23: 129 pgs: 129 active+clean; 23 MiB data, 446 MiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 1.8 MiB/s wr, 121 op/s 2024-05-14T15:22:19.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:18 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:22:21.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:20 smithi203 ceph-mon[34567]: pgmap v24: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 2.3 MiB/s wr, 144 op/s 2024-05-14T15:22:21.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:20 smithi092 ceph-mon[34729]: pgmap v24: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 2.3 MiB/s wr, 144 op/s 2024-05-14T15:22:21.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:20 smithi069 ceph-mon[31270]: pgmap v24: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 156 KiB/s rd, 2.3 MiB/s wr, 144 op/s 2024-05-14T15:22:23.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:23 smithi203 ceph-mon[34567]: pgmap v25: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 807 KiB/s wr, 131 op/s 2024-05-14T15:22:23.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:23 smithi092 ceph-mon[34729]: pgmap v25: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 807 KiB/s wr, 131 op/s 2024-05-14T15:22:23.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:23 smithi069 ceph-mon[31270]: pgmap v25: 129 pgs: 129 active+clean; 27 MiB data, 466 MiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 807 KiB/s wr, 131 op/s 2024-05-14T15:22:24.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:24 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:22:24.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:24 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:22:24.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:24 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:22:25.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.168+0000 7f99bd000640 1 -- 172.21.15.69:0/2445658960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b810a8a0 msgr2=0x7f99b8116b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.168+0000 7f99bd000640 1 --2- 172.21.15.69:0/2445658960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b810a8a0 0x7f99b8116b60 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009900 tx=0x7f99b002a480 comp rx=0 tx=0).stop 2024-05-14T15:22:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.168+0000 7f99bd000640 1 -- 172.21.15.69:0/2445658960 shutdown_connections 2024-05-14T15:22:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.168+0000 7f99bd000640 1 --2- 172.21.15.69:0/2445658960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b810a8a0 0x7f99b8116b60 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.168+0000 7f99bd000640 1 --2- 172.21.15.69:0/2445658960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99b8110530 0x7f99b810a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.168+0000 7f99bd000640 1 --2- 172.21.15.69:0/2445658960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99b8110120 0x7f99b8109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.170 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.168+0000 7f99bd000640 1 -- 172.21.15.69:0/2445658960 >> 172.21.15.69:0/2445658960 conn(0x7f99b8076080 msgr2=0x7f99b80784a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.168+0000 7f99bd000640 1 -- 172.21.15.69:0/2445658960 shutdown_connections 2024-05-14T15:22:25.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.168+0000 7f99bd000640 1 -- 172.21.15.69:0/2445658960 wait complete. 2024-05-14T15:22:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.169+0000 7f99bd000640 1 Processor -- start 2024-05-14T15:22:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.169+0000 7f99bd000640 1 -- start start 2024-05-14T15:22:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.170+0000 7f99bd000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b8110120 0x7f99b81a64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.170+0000 7f99bd000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99b8110530 0x7f99b81a6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.170+0000 7f99bd000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99b81a0650 0x7f99b81a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.170+0000 7f99bd000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f99b811a210 con 0x7f99b8110120 2024-05-14T15:22:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.170+0000 7f99bd000640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f99b811a090 con 0x7f99b81a0650 2024-05-14T15:22:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.170+0000 7f99bd000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f99b811a390 con 0x7f99b8110530 2024-05-14T15:22:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.170+0000 7f99b7400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b8110120 0x7f99b81a64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.170+0000 7f99b7400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b8110120 0x7f99b81a64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56304/0 (socket says 172.21.15.69:56304) 2024-05-14T15:22:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.170+0000 7f99b7400640 1 -- 172.21.15.69:0/4067155054 learned_addr learned my addr 172.21.15.69:0/4067155054 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.171+0000 7f99b6a00640 1 --2- 172.21.15.69:0/4067155054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99b8110530 0x7f99b81a6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.171+0000 7f99b7e00640 1 --2- 172.21.15.69:0/4067155054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99b81a0650 0x7f99b81a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.171+0000 7f99b7400640 1 -- 172.21.15.69:0/4067155054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99b8110530 msgr2=0x7f99b81a6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.171+0000 7f99b7400640 1 --2- 172.21.15.69:0/4067155054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99b8110530 0x7f99b81a6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.171+0000 7f99b7400640 1 -- 172.21.15.69:0/4067155054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99b81a0650 msgr2=0x7f99b81a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:25.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.171+0000 7f99b7400640 1 --2- 172.21.15.69:0/4067155054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99b81a0650 0x7f99b81a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.171+0000 7f99b7400640 1 -- 172.21.15.69:0/4067155054 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b81a1140 con 0x7f99b8110120 2024-05-14T15:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.171+0000 7f99b7e00640 1 --2- 172.21.15.69:0/4067155054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99b81a0650 0x7f99b81a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.171+0000 7f99b7400640 1 --2- 172.21.15.69:0/4067155054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b8110120 0x7f99b81a64d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f99a800ccb0 tx=0x7f99a800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.171+0000 7f99afe00640 1 -- 172.21.15.69:0/4067155054 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a8004b20 con 0x7f99b8110120 2024-05-14T15:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.171+0000 7f99afe00640 1 -- 172.21.15.69:0/4067155054 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99a8003e20 con 0x7f99b8110120 2024-05-14T15:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.172+0000 7f99bd000640 1 -- 172.21.15.69:0/4067155054 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99b81a1430 con 0x7f99b8110120 2024-05-14T15:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.172+0000 7f99afe00640 1 -- 172.21.15.69:0/4067155054 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a8004710 con 0x7f99b8110120 2024-05-14T15:22:25.175 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.172+0000 7f99bd000640 1 -- 172.21.15.69:0/4067155054 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99b81ad510 con 0x7f99b8110120 2024-05-14T15:22:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.175+0000 7f99c55f4740 1 Processor -- start 2024-05-14T15:22:25.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.176+0000 7f99c55f4740 1 -- start start 2024-05-14T15:22:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.176+0000 7f99c55f4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbff081b0 0x55ebc02a9480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.176+0000 7f99c55f4740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfedf2f0 0x55ebc02a99c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.176+0000 7f99c55f4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbfee74d0 0x55ebc02a9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.176+0000 7f99c55f4740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ebc020e550 con 0x55ebbfedf2f0 2024-05-14T15:22:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.176+0000 7f99c55f4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ebc01b3bc0 con 0x55ebbfee74d0 2024-05-14T15:22:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.176+0000 7f99c55f4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ebc020a510 con 0x55ebbff081b0 2024-05-14T15:22:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.176+0000 7f99afe00640 1 -- 172.21.15.69:0/4067155054 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 149885+0+0 (secure 0 0 0) 0x7f99a8003990 con 0x7f99b8110120 2024-05-14T15:22:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.177+0000 7f99b7e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbff081b0 0x55ebc02a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.177+0000 7f99b7e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbff081b0 0x55ebc02a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:50938/0 (socket says 172.21.15.69:50938) 2024-05-14T15:22:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.177+0000 7f99b7e00640 1 -- 172.21.15.69:0/2088710737 learned_addr learned my addr 172.21.15.69:0/2088710737 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.177+0000 7f99b7400640 1 --2- 172.21.15.69:0/2088710737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfedf2f0 0x55ebc02a99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.177+0000 7f99b6a00640 1 --2- 172.21.15.69:0/2088710737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbfee74d0 0x55ebc02a9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.177+0000 7f99b7400640 1 -- 172.21.15.69:0/2088710737 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbff081b0 msgr2=0x55ebc02a9480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.177+0000 7f99b7400640 1 --2- 172.21.15.69:0/2088710737 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbff081b0 0x55ebc02a9480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.177+0000 7f99b7400640 1 -- 172.21.15.69:0/2088710737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbfee74d0 msgr2=0x55ebc02a9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:25.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.177+0000 7f99b7400640 1 --2- 172.21.15.69:0/2088710737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbfee74d0 0x55ebc02a9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.177+0000 7f99b7400640 1 -- 172.21.15.69:0/2088710737 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebbff20210 con 0x55ebbfedf2f0 2024-05-14T15:22:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.178+0000 7f99b6a00640 1 --2- 172.21.15.69:0/2088710737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbfee74d0 0x55ebc02a9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:22:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.178+0000 7f99b7400640 1 --2- 172.21.15.69:0/2088710737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfedf2f0 0x55ebc02a99c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f99a80e0070 tx=0x7f99a80eb570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593dc746e8d651a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.178+0000 7f99acc00640 1 -- 172.21.15.69:0/2088710737 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a80f6070 con 0x55ebbfedf2f0 2024-05-14T15:22:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.178+0000 7f99acc00640 1 -- 172.21.15.69:0/2088710737 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99a80f1a90 con 0x55ebbfedf2f0 2024-05-14T15:22:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.178+0000 7f99acc00640 1 -- 172.21.15.69:0/2088710737 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a80f0a00 con 0x55ebbfedf2f0 2024-05-14T15:22:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.178+0000 7f99afe00640 1 --2- 172.21.15.69:0/4067155054 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f999c0b2a70 0x7f999c0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.179+0000 7f99afe00640 1 -- 172.21.15.69:0/4067155054 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f99a80e2e50 con 0x7f99b8110120 2024-05-14T15:22:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.179+0000 7f99b7e00640 1 --2- 172.21.15.69:0/4067155054 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f999c0b2a70 0x7f999c0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.179+0000 7f99c55f4740 1 -- 172.21.15.69:0/2088710737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfedf2f0 msgr2=0x55ebc02a99c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.179+0000 7f99c55f4740 1 --2- 172.21.15.69:0/2088710737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfedf2f0 0x55ebc02a99c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f99a80e0070 tx=0x7f99a80eb570 comp rx=0 tx=0).stop 2024-05-14T15:22:25.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.179+0000 7f99c55f4740 1 -- 172.21.15.69:0/2088710737 shutdown_connections 2024-05-14T15:22:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.179+0000 7f99c55f4740 1 --2- 172.21.15.69:0/2088710737 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbfee74d0 0x55ebc02a9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.179+0000 7f99c55f4740 1 --2- 172.21.15.69:0/2088710737 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfedf2f0 0x55ebc02a99c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.179+0000 7f99c55f4740 1 --2- 172.21.15.69:0/2088710737 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbff081b0 0x55ebc02a9480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.179+0000 7f99c55f4740 1 -- 172.21.15.69:0/2088710737 >> 172.21.15.69:0/2088710737 conn(0x55ebbfefc300 msgr2=0x55ebc02a5c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.180+0000 7f99b7e00640 1 --2- 172.21.15.69:0/4067155054 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f999c0b2a70 0x7f999c0b4f80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f99b00096c0 tx=0x7f99b0005a20 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.180+0000 7f99c55f4740 1 -- 172.21.15.69:0/2088710737 shutdown_connections 2024-05-14T15:22:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.180+0000 7f99c55f4740 1 -- 172.21.15.69:0/2088710737 wait complete. 2024-05-14T15:22:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.180+0000 7f99c55f4740 1 -- start start 2024-05-14T15:22:25.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.180+0000 7f99c55f4740 1 Processor -- start 2024-05-14T15:22:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.181+0000 7f99c55f4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbfedf2f0 0x55ebc02b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.181+0000 7f99c55f4740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.181+0000 7f99c55f4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbff081b0 0x55ebc02bfa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.181+0000 7f99c55f4740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ebc02b65b0 con 0x55ebbfee74d0 2024-05-14T15:22:25.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.181+0000 7f99c55f4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ebc01c7660 con 0x55ebbfedf2f0 2024-05-14T15:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.181+0000 7f99c55f4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ebc02b6730 con 0x55ebbff081b0 2024-05-14T15:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.181+0000 7f99c55f4740 10 client.0 _ll_register_callbacks cb 0x55ebc0191400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.181+0000 7f99b6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.181+0000 7f99b6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56314/0 (socket says 172.21.15.69:56314) 2024-05-14T15:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.181+0000 7f99b6a00640 1 -- 172.21.15.69:0/4062823596 learned_addr learned my addr 172.21.15.69:0/4062823596 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.182+0000 7f99b7400640 1 --2- 172.21.15.69:0/4062823596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbfedf2f0 0x55ebc02b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.182+0000 7f99b7e00640 1 --2- 172.21.15.69:0/4062823596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbff081b0 0x55ebc02bfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.182+0000 7f99b6a00640 1 -- 172.21.15.69:0/4062823596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbff081b0 msgr2=0x55ebc02bfa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.182+0000 7f99b6a00640 1 --2- 172.21.15.69:0/4062823596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbff081b0 0x55ebc02bfa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.182+0000 7f99b6a00640 1 -- 172.21.15.69:0/4062823596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbfedf2f0 msgr2=0x55ebc02b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.182+0000 7f99b6a00640 1 --2- 172.21.15.69:0/4062823596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbfedf2f0 0x55ebc02b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.182+0000 7f99b6a00640 1 -- 172.21.15.69:0/4062823596 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebbffec620 con 0x55ebbfee74d0 2024-05-14T15:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.182+0000 7f99b6a00640 1 --2- 172.21.15.69:0/4062823596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02b3f30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f99a400bf70 tx=0x7f99a400f670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52490cb92acc452 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.182+0000 7f99a1600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.183+0000 7f99a1600640 1 -- 172.21.15.69:0/4062823596 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4018020 con 0x55ebbfee74d0 2024-05-14T15:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.183+0000 7f99a1600640 1 -- 172.21.15.69:0/4062823596 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f99a4014670 con 0x55ebbfee74d0 2024-05-14T15:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.183+0000 7f99c55f4740 1 -- 172.21.15.69:0/4062823596 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99a80f1a90 con 0x55ebbfee74d0 2024-05-14T15:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.183+0000 7f99a1600640 1 -- 172.21.15.69:0/4062823596 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f99a4023050 con 0x55ebbfee74d0 2024-05-14T15:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.183+0000 7f99c55f4740 10 client.15558 fetch_fsmap learned FSMap version 32 2024-05-14T15:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.183+0000 7f99c55f4740 1 -- 172.21.15.69:0/4062823596 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ebc02c28c0 con 0x55ebbfee74d0 2024-05-14T15:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.184+0000 7f99a1600640 1 -- 172.21.15.69:0/4062823596 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99a80f1a90 con 0x55ebbfee74d0 2024-05-14T15:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.184+0000 7f99a1600640 1 -- 172.21.15.69:0/4062823596 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f99a40139a0 con 0x55ebbfee74d0 2024-05-14T15:22:25.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.184+0000 7f99c55f4740 10 client.15558 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T15:22:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.184+0000 7f99c55f4740 10 client.15558 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:22:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.184+0000 7f99c55f4740 20 client.15558 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.184+0000 7f99c55f4740 1 --2- 172.21.15.69:0/4062823596 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ebbfec6d80 0x55ebc02c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.184+0000 7f99c55f4740 4 client.15558 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:22:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.184+0000 7f99c55f4740 1 -- 172.21.15.69:0/4062823596 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ebc021c160 con 0x55ebbfec6d80 2024-05-14T15:22:25.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.185+0000 7f99b7400640 1 --2- 172.21.15.69:0/4062823596 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ebbfec6d80 0x55ebc02c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.186+0000 7f99b7400640 1 --2- 172.21.15.69:0/4062823596 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ebbfec6d80 0x55ebc02c5eb0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b358dd82d10cd606 server_cookie=8e35494b5feb2fbd in_seq=0 out_seq=0 2024-05-14T15:22:25.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.186+0000 7f99a1600640 10 client.15558 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.191+0000 7f99a1600640 1 -- 172.21.15.69:0/4062823596 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ebc021c160 con 0x55ebbfec6d80 2024-05-14T15:22:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.191+0000 7f99a1600640 10 client.15558 handle_command_reply: tid=0 2024-05-14T15:22:25.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.191+0000 7f99c55f4740 1 client.15558 shutdown 2024-05-14T15:22:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.191+0000 7f99c55f4740 1 -- 172.21.15.69:0/4062823596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 msgr2=0x55ebc02b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.191+0000 7f99c55f4740 1 --2- 172.21.15.69:0/4062823596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02b3f30 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f99a400bf70 tx=0x7f99a400f670 comp rx=0 tx=0).stop 2024-05-14T15:22:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.192+0000 7f99c55f4740 1 -- 172.21.15.69:0/4062823596 shutdown_connections 2024-05-14T15:22:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.192+0000 7f99c55f4740 1 --2- 172.21.15.69:0/4062823596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbff081b0 0x55ebc02bfa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.192+0000 7f99c55f4740 1 --2- 172.21.15.69:0/4062823596 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ebbfec6d80 0x55ebc02c5eb0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.192+0000 7f99c55f4740 1 --2- 172.21.15.69:0/4062823596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02b3f30 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.192+0000 7f99c55f4740 1 --2- 172.21.15.69:0/4062823596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbfedf2f0 0x55ebc02b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.192+0000 7f99a1600640 0 client.15558 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:25.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.192+0000 7f99c55f4740 1 -- 172.21.15.69:0/4062823596 >> 172.21.15.69:0/4062823596 conn(0x55ebbfefc300 msgr2=0x55ebc02a92b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:25.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.192+0000 7f99c55f4740 1 -- 172.21.15.69:0/4062823596 shutdown_connections 2024-05-14T15:22:25.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.192+0000 7f99c55f4740 1 -- 172.21.15.69:0/4062823596 wait complete. 2024-05-14T15:22:25.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.192+0000 7f99c55f4740 20 client.15558 trim_cache size 0 max 16384 2024-05-14T15:22:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.211+0000 7f99c55f4740 1 Processor -- start 2024-05-14T15:22:25.212 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.211+0000 7f99c55f4740 1 -- start start 2024-05-14T15:22:25.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.211+0000 7f99c55f4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbfedf2f0 0x55ebc02b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.211+0000 7f99c55f4740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02a4960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.211+0000 7f99c55f4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbff081b0 0x55ebc02a4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.211+0000 7f99c55f4740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f99b81b7750 con 0x55ebbfee74d0 2024-05-14T15:22:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.211+0000 7f99c55f4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f99b81b9350 con 0x55ebbff081b0 2024-05-14T15:22:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.211+0000 7f99c55f4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f99b81b7e20 con 0x55ebbfedf2f0 2024-05-14T15:22:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.212+0000 7f99b6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02a4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.212+0000 7f99b6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02a4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56316/0 (socket says 172.21.15.69:56316) 2024-05-14T15:22:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.212+0000 7f99b6a00640 1 -- 172.21.15.69:0/22221192 learned_addr learned my addr 172.21.15.69:0/22221192 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.212+0000 7f99b7400640 1 --2- 172.21.15.69:0/22221192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbfedf2f0 0x55ebc02b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.212+0000 7f99b6a00640 1 -- 172.21.15.69:0/22221192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbfedf2f0 msgr2=0x55ebc02b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:25.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.212+0000 7f99b7e00640 1 --2- 172.21.15.69:0/22221192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbff081b0 0x55ebc02a4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.212+0000 7f99b6a00640 1 --2- 172.21.15.69:0/22221192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbfedf2f0 0x55ebc02b2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.212+0000 7f99b6a00640 1 -- 172.21.15.69:0/22221192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbff081b0 msgr2=0x55ebc02a4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.212+0000 7f99b6a00640 1 --2- 172.21.15.69:0/22221192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbff081b0 0x55ebc02a4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.212+0000 7f99b6a00640 1 -- 172.21.15.69:0/22221192 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebc02b42c0 con 0x55ebbfee74d0 2024-05-14T15:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.212+0000 7f99b7400640 1 --2- 172.21.15.69:0/22221192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbfedf2f0 0x55ebc02b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.212+0000 7f99b6a00640 1 --2- 172.21.15.69:0/22221192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02a4960 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f99a4006aa0 tx=0x7f99a400bbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6668881a97de9873 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.212+0000 7f99a3e00640 1 -- 172.21.15.69:0/22221192 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4018040 con 0x55ebbfee74d0 2024-05-14T15:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.213+0000 7f99a3e00640 1 -- 172.21.15.69:0/22221192 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99a4013850 con 0x55ebbfee74d0 2024-05-14T15:22:25.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.213+0000 7f99a3e00640 1 -- 172.21.15.69:0/22221192 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a401dbc0 con 0x55ebbfee74d0 2024-05-14T15:22:25.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.213+0000 7f99c55f4740 1 -- 172.21.15.69:0/22221192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 msgr2=0x55ebc02a4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.214+0000 7f99c55f4740 1 --2- 172.21.15.69:0/22221192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02a4960 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f99a4006aa0 tx=0x7f99a400bbb0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.214+0000 7f99c55f4740 1 -- 172.21.15.69:0/22221192 shutdown_connections 2024-05-14T15:22:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.214+0000 7f99c55f4740 1 --2- 172.21.15.69:0/22221192 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbff081b0 0x55ebc02a4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.214+0000 7f99c55f4740 1 --2- 172.21.15.69:0/22221192 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02a4960 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.214+0000 7f99c55f4740 1 --2- 172.21.15.69:0/22221192 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbfedf2f0 0x55ebc02b2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.214+0000 7f99c55f4740 1 -- 172.21.15.69:0/22221192 >> 172.21.15.69:0/22221192 conn(0x55ebbfefc300 msgr2=0x55ebc02a4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.214+0000 7f99c55f4740 1 -- 172.21.15.69:0/22221192 shutdown_connections 2024-05-14T15:22:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.214+0000 7f99c55f4740 1 -- 172.21.15.69:0/22221192 wait complete. 2024-05-14T15:22:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.214+0000 7f99c55f4740 1 -- start start 2024-05-14T15:22:25.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.214+0000 7f99c55f4740 1 Processor -- start 2024-05-14T15:22:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.215+0000 7f99c55f4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbfedf2f0 0x55ebc02bbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.215+0000 7f99c55f4740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02b6f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.215+0000 7f99c55f4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbff081b0 0x55ebc02b74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.215+0000 7f99c55f4740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f99b81b8bc0 con 0x55ebbfee74d0 2024-05-14T15:22:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.215+0000 7f99c55f4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f99b81b84f0 con 0x55ebbfedf2f0 2024-05-14T15:22:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.215+0000 7f99c55f4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f99b81b5730 con 0x55ebbff081b0 2024-05-14T15:22:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.215+0000 7f99c55f4740 10 client.0 _ll_register_callbacks cb 0x7f99a400b260 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.215+0000 7f99b6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02b6f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.215+0000 7f99b6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02b6f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56318/0 (socket says 172.21.15.69:56318) 2024-05-14T15:22:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.215+0000 7f99b6a00640 1 -- 172.21.15.69:0/253077753 learned_addr learned my addr 172.21.15.69:0/253077753 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.216+0000 7f99b7e00640 1 --2- 172.21.15.69:0/253077753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbff081b0 0x55ebc02b74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.216+0000 7f99b7400640 1 --2- 172.21.15.69:0/253077753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbfedf2f0 0x55ebc02bbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.216+0000 7f99b6a00640 1 -- 172.21.15.69:0/253077753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbff081b0 msgr2=0x55ebc02b74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.216+0000 7f99b6a00640 1 --2- 172.21.15.69:0/253077753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbff081b0 0x55ebc02b74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.216+0000 7f99b6a00640 1 -- 172.21.15.69:0/253077753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbfedf2f0 msgr2=0x55ebc02bbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.216+0000 7f99b6a00640 1 --2- 172.21.15.69:0/253077753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbfedf2f0 0x55ebc02bbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.216+0000 7f99b6a00640 1 -- 172.21.15.69:0/253077753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebc02b7a00 con 0x55ebbfee74d0 2024-05-14T15:22:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.216+0000 7f99b6a00640 1 --2- 172.21.15.69:0/253077753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02b6f80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f99a4004810 tx=0x7f99a4013cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dd949585157dd5a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.216+0000 7f99a1600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.217+0000 7f99a1600640 1 -- 172.21.15.69:0/253077753 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99a4034060 con 0x55ebbfee74d0 2024-05-14T15:22:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.217+0000 7f99a1600640 1 -- 172.21.15.69:0/253077753 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f99a4014670 con 0x55ebbfee74d0 2024-05-14T15:22:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.217+0000 7f99c55f4740 1 -- 172.21.15.69:0/253077753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f99a4013850 con 0x55ebbfee74d0 2024-05-14T15:22:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.217+0000 7f99a1600640 1 -- 172.21.15.69:0/253077753 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f99a403b050 con 0x55ebbfee74d0 2024-05-14T15:22:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.217+0000 7f99c55f4740 10 client.15564 fetch_fsmap learned FSMap version 32 2024-05-14T15:22:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.217+0000 7f99c55f4740 1 -- 172.21.15.69:0/253077753 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55ebc032dd60 con 0x55ebbfee74d0 2024-05-14T15:22:25.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.217+0000 7f99a1600640 1 -- 172.21.15.69:0/253077753 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f99a4013850 con 0x55ebbfee74d0 2024-05-14T15:22:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.218+0000 7f99a1600640 1 -- 172.21.15.69:0/253077753 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 32) ==== 8378+0+0 (secure 0 0 0) 0x7f99a40277a0 con 0x55ebbfee74d0 2024-05-14T15:22:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.218+0000 7f99c55f4740 10 client.15564 fetch_fsmap finished waiting for FSMap version 32 2024-05-14T15:22:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.218+0000 7f99c55f4740 10 client.15564 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:22:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.218+0000 7f99c55f4740 20 client.15564 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.218+0000 7f99c55f4740 1 --2- 172.21.15.69:0/253077753 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ebbfe9c1c0 0x55ebc03304c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.218+0000 7f99c55f4740 4 client.15564 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:22:25.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.218+0000 7f99c55f4740 1 -- 172.21.15.69:0/253077753 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ebc0215fd0 con 0x55ebbfe9c1c0 2024-05-14T15:22:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.218+0000 7f99b7400640 1 --2- 172.21.15.69:0/253077753 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ebbfe9c1c0 0x55ebc03304c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.219+0000 7f99b7400640 1 --2- 172.21.15.69:0/253077753 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ebbfe9c1c0 0x55ebc03304c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe2f7cc9c6994742 server_cookie=5e593e5470b2a94d in_seq=0 out_seq=0 2024-05-14T15:22:25.223 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.219+0000 7f99a1600640 10 client.15564 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:25.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:25 smithi203 ceph-mon[34567]: pgmap v26: 129 pgs: 129 active+clean; 29 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 1.5 MiB/s wr, 163 op/s 2024-05-14T15:22:25.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:25 smithi092 ceph-mon[34729]: pgmap v26: 129 pgs: 129 active+clean; 29 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 1.5 MiB/s wr, 163 op/s 2024-05-14T15:22:25.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:25 smithi069 ceph-mon[31270]: pgmap v26: 129 pgs: 129 active+clean; 29 MiB data, 475 MiB used, 1.0 TiB / 1.0 TiB avail; 147 KiB/s rd, 1.5 MiB/s wr, 163 op/s 2024-05-14T15:22:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.602+0000 7f99a1600640 1 -- 172.21.15.69:0/253077753 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ebc0215fd0 con 0x55ebbfe9c1c0 2024-05-14T15:22:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.602+0000 7f99a1600640 10 client.15564 handle_command_reply: tid=0 2024-05-14T15:22:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.602+0000 7f99c55f4740 1 client.15564 shutdown 2024-05-14T15:22:25.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.602+0000 7f99c55f4740 1 -- 172.21.15.69:0/253077753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 msgr2=0x55ebc02b6f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.602+0000 7f99c55f4740 1 --2- 172.21.15.69:0/253077753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02b6f80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f99a4004810 tx=0x7f99a4013cb0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.602+0000 7f99c55f4740 1 -- 172.21.15.69:0/253077753 shutdown_connections 2024-05-14T15:22:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.602+0000 7f99c55f4740 1 --2- 172.21.15.69:0/253077753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ebbff081b0 0x55ebc02b74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.602+0000 7f99c55f4740 1 --2- 172.21.15.69:0/253077753 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ebbfe9c1c0 0x55ebc03304c0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.602+0000 7f99c55f4740 1 --2- 172.21.15.69:0/253077753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ebbfee74d0 0x55ebc02b6f80 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.602+0000 7f99c55f4740 1 --2- 172.21.15.69:0/253077753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ebbfedf2f0 0x55ebc02bbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.602+0000 7f99c55f4740 1 -- 172.21.15.69:0/253077753 >> 172.21.15.69:0/253077753 conn(0x55ebbfefc300 msgr2=0x55ebc02a4c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.602+0000 7f99a1600640 0 client.15564 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.602+0000 7f99c55f4740 1 -- 172.21.15.69:0/253077753 shutdown_connections 2024-05-14T15:22:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.602+0000 7f99c55f4740 1 -- 172.21.15.69:0/253077753 wait complete. 2024-05-14T15:22:25.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.603+0000 7f99c55f4740 20 client.15564 trim_cache size 0 max 16384 2024-05-14T15:22:25.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:22:25.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:22:25.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:22:25.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:22:25.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.603+0000 7f99bd000640 1 -- 172.21.15.69:0/4067155054 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f999c0b2a70 msgr2=0x7f999c0b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:25.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.603+0000 7f99bd000640 1 --2- 172.21.15.69:0/4067155054 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f999c0b2a70 0x7f999c0b4f80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f99b00096c0 tx=0x7f99b0005a20 comp rx=0 tx=0).stop 2024-05-14T15:22:25.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.603+0000 7f99bd000640 1 -- 172.21.15.69:0/4067155054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b8110120 msgr2=0x7f99b81a64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:25.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.603+0000 7f99bd000640 1 --2- 172.21.15.69:0/4067155054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b8110120 0x7f99b81a64d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f99a800ccb0 tx=0x7f99a800a620 comp rx=0 tx=0).stop 2024-05-14T15:22:25.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.604+0000 7f99bd000640 1 -- 172.21.15.69:0/4067155054 shutdown_connections 2024-05-14T15:22:25.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.604+0000 7f99bd000640 1 --2- 172.21.15.69:0/4067155054 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f999c0b2a70 0x7f999c0b4f80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.604+0000 7f99bd000640 1 --2- 172.21.15.69:0/4067155054 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f99b81a0650 0x7f99b81a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.604+0000 7f99bd000640 1 --2- 172.21.15.69:0/4067155054 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f99b8110530 0x7f99b81a6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.604+0000 7f99bd000640 1 --2- 172.21.15.69:0/4067155054 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f99b8110120 0x7f99b81a64d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:25.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.604+0000 7f99bd000640 1 -- 172.21.15.69:0/4067155054 >> 172.21.15.69:0/4067155054 conn(0x7f99b8076080 msgr2=0x7f99b810d8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:25.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.604+0000 7f99bd000640 1 -- 172.21.15.69:0/4067155054 shutdown_connections 2024-05-14T15:22:25.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:25.604+0000 7f99bd000640 1 -- 172.21.15.69:0/4067155054 wait complete. 2024-05-14T15:22:27.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:27 smithi203 ceph-mon[34567]: pgmap v27: 129 pgs: 129 active+clean; 29 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 1.7 MiB/s wr, 119 op/s 2024-05-14T15:22:27.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:27 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:22:27.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:27 smithi092 ceph-mon[34729]: pgmap v27: 129 pgs: 129 active+clean; 29 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 1.7 MiB/s wr, 119 op/s 2024-05-14T15:22:27.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:27 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:22:27.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:27 smithi069 ceph-mon[31270]: pgmap v27: 129 pgs: 129 active+clean; 29 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 225 KiB/s rd, 1.7 MiB/s wr, 119 op/s 2024-05-14T15:22:27.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:27 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:22:29.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:29 smithi203 ceph-mon[34567]: pgmap v28: 129 pgs: 129 active+clean; 29 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 1.6 MiB/s wr, 70 op/s 2024-05-14T15:22:29.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:29 smithi092 ceph-mon[34729]: pgmap v28: 129 pgs: 129 active+clean; 29 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 1.6 MiB/s wr, 70 op/s 2024-05-14T15:22:29.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:29 smithi069 ceph-mon[31270]: pgmap v28: 129 pgs: 129 active+clean; 29 MiB data, 480 MiB used, 1.0 TiB / 1.0 TiB avail; 174 KiB/s rd, 1.6 MiB/s wr, 70 op/s 2024-05-14T15:22:31.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:31 smithi203 ceph-mon[34567]: pgmap v29: 129 pgs: 129 active+clean; 38 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 2.4 MiB/s wr, 154 op/s 2024-05-14T15:22:31.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:31 smithi092 ceph-mon[34729]: pgmap v29: 129 pgs: 129 active+clean; 38 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 2.4 MiB/s wr, 154 op/s 2024-05-14T15:22:31.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:31 smithi069 ceph-mon[31270]: pgmap v29: 129 pgs: 129 active+clean; 38 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 263 KiB/s rd, 2.4 MiB/s wr, 154 op/s 2024-05-14T15:22:32.976 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T15:22:33.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:33 smithi203 ceph-mon[34567]: pgmap v30: 129 pgs: 129 active+clean; 38 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 1.9 MiB/s wr, 131 op/s 2024-05-14T15:22:33.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:33 smithi092 ceph-mon[34729]: pgmap v30: 129 pgs: 129 active+clean; 38 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 1.9 MiB/s wr, 131 op/s 2024-05-14T15:22:33.458 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:22:33.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:33 smithi069 ceph-mon[31270]: pgmap v30: 129 pgs: 129 active+clean; 38 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 1.9 MiB/s wr, 131 op/s 2024-05-14T15:22:35.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:35 smithi069 ceph-mon[31270]: pgmap v31: 129 pgs: 129 active+clean; 46 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 2.7 MiB/s wr, 158 op/s 2024-05-14T15:22:35.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:35 smithi203 ceph-mon[34567]: pgmap v31: 129 pgs: 129 active+clean; 46 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 2.7 MiB/s wr, 158 op/s 2024-05-14T15:22:35.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:35 smithi092 ceph-mon[34729]: pgmap v31: 129 pgs: 129 active+clean; 46 MiB data, 524 MiB used, 1.0 TiB / 1.0 TiB avail; 308 KiB/s rd, 2.7 MiB/s wr, 158 op/s 2024-05-14T15:22:35.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.979+0000 7f5f08200700 1 -- 172.21.15.69:0/1132590522 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f001031b0 msgr2=0x7f5f00111110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:35.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.979+0000 7f5f08200700 1 --2- 172.21.15.69:0/1132590522 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f001031b0 0x7f5f00111110 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f5ef800b0a0 tx=0x7f5ef800b3b0 comp rx=0 tx=0).stop 2024-05-14T15:22:35.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.979+0000 7f5f08200700 1 -- 172.21.15.69:0/1132590522 shutdown_connections 2024-05-14T15:22:35.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.979+0000 7f5f08200700 1 --2- 172.21.15.69:0/1132590522 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f001031b0 0x7f5f00111110 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:35.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.979+0000 7f5f08200700 1 --2- 172.21.15.69:0/1132590522 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f0010a3d0 0x7f5f0010a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:35.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.979+0000 7f5f08200700 1 --2- 172.21.15.69:0/1132590522 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f00102860 0x7f5f00102c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:35.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.979+0000 7f5f08200700 1 -- 172.21.15.69:0/1132590522 >> 172.21.15.69:0/1132590522 conn(0x7f5f000fe6f0 msgr2=0x7f5f00100b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:35.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.979+0000 7f5f08200700 1 -- 172.21.15.69:0/1132590522 shutdown_connections 2024-05-14T15:22:35.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.980+0000 7f5f08200700 1 -- 172.21.15.69:0/1132590522 wait complete. 2024-05-14T15:22:35.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.981+0000 7f5f08200700 1 Processor -- start 2024-05-14T15:22:35.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.981+0000 7f5f08200700 1 -- start start 2024-05-14T15:22:35.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.982+0000 7f5f08200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f00102860 0x7f5f00103a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:35.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.982+0000 7f5f08200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f001031b0 0x7f5f00103f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:35.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.982+0000 7f5f08200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f0010a3d0 0x7f5f001044c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:35.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.982+0000 7f5f08200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5f00114340 con 0x7f5f00102860 2024-05-14T15:22:35.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.982+0000 7f5f08200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001141c0 con 0x7f5f001031b0 2024-05-14T15:22:35.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.982+0000 7f5f08200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001144c0 con 0x7f5f0010a3d0 2024-05-14T15:22:35.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.982+0000 7f5f05800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f00102860 0x7f5f00103a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:35.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.982+0000 7f5f05800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f00102860 0x7f5f00103a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49058/0 (socket says 172.21.15.69:49058) 2024-05-14T15:22:35.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.982+0000 7f5f05800700 1 -- 172.21.15.69:0/2054650164 learned_addr learned my addr 172.21.15.69:0/2054650164 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:35.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.982+0000 7f5f04e00700 1 --2- 172.21.15.69:0/2054650164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f001031b0 0x7f5f00103f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:35.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.983+0000 7f5f06200700 1 --2- 172.21.15.69:0/2054650164 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f0010a3d0 0x7f5f001044c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:35.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.983+0000 7f5f05800700 1 -- 172.21.15.69:0/2054650164 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f0010a3d0 msgr2=0x7f5f001044c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:35.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.983+0000 7f5f05800700 1 --2- 172.21.15.69:0/2054650164 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f0010a3d0 0x7f5f001044c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:35.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.983+0000 7f5f05800700 1 -- 172.21.15.69:0/2054650164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f001031b0 msgr2=0x7f5f00103f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:35.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.983+0000 7f5f05800700 1 --2- 172.21.15.69:0/2054650164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f001031b0 0x7f5f00103f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:35.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.983+0000 7f5f05800700 1 -- 172.21.15.69:0/2054650164 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f001a9020 con 0x7f5f00102860 2024-05-14T15:22:35.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.983+0000 7f5f05800700 1 --2- 172.21.15.69:0/2054650164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f00102860 0x7f5f00103a40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400c9b0 tx=0x7f5ef400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:35.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.984+0000 7f5efe000700 1 -- 172.21.15.69:0/2054650164 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4007b00 con 0x7f5f00102860 2024-05-14T15:22:35.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.984+0000 7f5efe000700 1 -- 172.21.15.69:0/2054650164 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5ef400ce50 con 0x7f5f00102860 2024-05-14T15:22:35.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.984+0000 7f5efe000700 1 -- 172.21.15.69:0/2054650164 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef4018660 con 0x7f5f00102860 2024-05-14T15:22:35.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.984+0000 7f5f08200700 1 -- 172.21.15.69:0/2054650164 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f001a92b0 con 0x7f5f00102860 2024-05-14T15:22:35.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.984+0000 7f5f08200700 1 -- 172.21.15.69:0/2054650164 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f001a97a0 con 0x7f5f00102860 2024-05-14T15:22:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.989+0000 7f5f16c9bb80 1 Processor -- start 2024-05-14T15:22:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.989+0000 7f5f16c9bb80 1 -- start start 2024-05-14T15:22:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.989+0000 7f5efe000700 1 -- 172.21.15.69:0/2054650164 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 149885+0+0 (secure 0 0 0) 0x7f5ef400f450 con 0x7f5f00102860 2024-05-14T15:22:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.990+0000 7f5f16c9bb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a721e40 0x55ac3a8a56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.990+0000 7f5f16c9bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a89f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.990+0000 7f5f16c9bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a89fc50 0x55ac3a8a0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.990+0000 7f5f16c9bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ac3a7c1a20 con 0x55ac3a89fc50 2024-05-14T15:22:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.990+0000 7f5f16c9bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ac3a75f760 con 0x55ac3a8a5bf0 2024-05-14T15:22:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.990+0000 7f5f16c9bb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ac3a7bd9e0 con 0x55ac3a721e40 2024-05-14T15:22:35.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.990+0000 7f5f04e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a89fc50 0x55ac3a8a0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.990+0000 7f5f04e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a89fc50 0x55ac3a8a0060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49060/0 (socket says 172.21.15.69:49060) 2024-05-14T15:22:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.990+0000 7f5f04e00700 1 -- 172.21.15.69:0/1383205677 learned_addr learned my addr 172.21.15.69:0/1383205677 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.990+0000 7f5f05800700 1 --2- 172.21.15.69:0/1383205677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a89f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.990+0000 7f5f06200700 1 --2- 172.21.15.69:0/1383205677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a721e40 0x55ac3a8a56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.991+0000 7f5f04e00700 1 -- 172.21.15.69:0/1383205677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a721e40 msgr2=0x55ac3a8a56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.991+0000 7f5f04e00700 1 --2- 172.21.15.69:0/1383205677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a721e40 0x55ac3a8a56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.991+0000 7f5f04e00700 1 -- 172.21.15.69:0/1383205677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 msgr2=0x55ac3a89f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.991+0000 7f5f04e00700 1 --2- 172.21.15.69:0/1383205677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a89f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.991+0000 7f5f04e00700 1 -- 172.21.15.69:0/1383205677 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac3a70e8d0 con 0x55ac3a89fc50 2024-05-14T15:22:35.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.991+0000 7f5f05800700 1 --2- 172.21.15.69:0/1383205677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a89f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:22:35.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.991+0000 7f5efe000700 1 --2- 172.21.15.69:0/2054650164 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5ee80b2b90 0x7f5ee80b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:35.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.991+0000 7f5f04e00700 1 --2- 172.21.15.69:0/1383205677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a89fc50 0x55ac3a8a0060 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00ac40 tx=0x7f5eec00af50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f70a3128a01dbebe server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:35.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.991+0000 7f5efe000700 1 -- 172.21.15.69:0/2054650164 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5ef40e2b10 con 0x7f5f00102860 2024-05-14T15:22:35.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.992+0000 7f5ef2a00700 1 -- 172.21.15.69:0/1383205677 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec01d070 con 0x55ac3a89fc50 2024-05-14T15:22:35.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.992+0000 7f5f06200700 1 --2- 172.21.15.69:0/2054650164 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5ee80b2b90 0x7f5ee80b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:35.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.992+0000 7f5ef2a00700 1 -- 172.21.15.69:0/1383205677 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5eec00fde0 con 0x55ac3a89fc50 2024-05-14T15:22:35.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.992+0000 7f5ef2a00700 1 -- 172.21.15.69:0/1383205677 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec0107b0 con 0x55ac3a89fc50 2024-05-14T15:22:35.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.993+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/1383205677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a89fc50 msgr2=0x55ac3a8a0060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:35.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.993+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/1383205677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a89fc50 0x55ac3a8a0060 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f5eec00ac40 tx=0x7f5eec00af50 comp rx=0 tx=0).stop 2024-05-14T15:22:35.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.993+0000 7f5f06200700 1 --2- 172.21.15.69:0/2054650164 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5ee80b2b90 0x7f5ee80b50a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55ac3a8a0a30 tx=0x7f5ef800b7b0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:35.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.993+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/1383205677 shutdown_connections 2024-05-14T15:22:35.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.993+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/1383205677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a89fc50 0x55ac3a8a0060 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:35.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.993+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/1383205677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a721e40 0x55ac3a8a56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:35.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.993+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/1383205677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a89f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:35.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.993+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/1383205677 >> 172.21.15.69:0/1383205677 conn(0x55ac3a760a80 msgr2=0x55ac3a89a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:35.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.993+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/1383205677 shutdown_connections 2024-05-14T15:22:35.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.993+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/1383205677 wait complete. 2024-05-14T15:22:35.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.994+0000 7f5f16c9bb80 1 -- start start 2024-05-14T15:22:35.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.994+0000 7f5f16c9bb80 1 Processor -- start 2024-05-14T15:22:35.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.995+0000 7f5f16c9bb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a721e40 0x55ac3a8a9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:35.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.995+0000 7f5f16c9bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a89fc50 0x55ac3a8a9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:35.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.995+0000 7f5f16c9bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a8a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:35.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.995+0000 7f5f16c9bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ac3a8ac6c0 con 0x55ac3a89fc50 2024-05-14T15:22:35.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.995+0000 7f5f16c9bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ac3a727b20 con 0x55ac3a8a5bf0 2024-05-14T15:22:35.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.995+0000 7f5f16c9bb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ac3a8ac840 con 0x55ac3a721e40 2024-05-14T15:22:35.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.995+0000 7f5f16c9bb80 10 client.0 _ll_register_callbacks cb 0x55ac3a755380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:35.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.995+0000 7f5f04e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a89fc50 0x55ac3a8a9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:35.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.995+0000 7f5f04e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a89fc50 0x55ac3a8a9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49076/0 (socket says 172.21.15.69:49076) 2024-05-14T15:22:35.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.995+0000 7f5f04e00700 1 -- 172.21.15.69:0/3646324434 learned_addr learned my addr 172.21.15.69:0/3646324434 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:35.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.996+0000 7f5f06200700 1 --2- 172.21.15.69:0/3646324434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a8a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:35.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.996+0000 7f5f05800700 1 --2- 172.21.15.69:0/3646324434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a721e40 0x55ac3a8a9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:35.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.996+0000 7f5f04e00700 1 -- 172.21.15.69:0/3646324434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a721e40 msgr2=0x55ac3a8a9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:35.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.996+0000 7f5f04e00700 1 --2- 172.21.15.69:0/3646324434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a721e40 0x55ac3a8a9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:35.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.996+0000 7f5f04e00700 1 -- 172.21.15.69:0/3646324434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 msgr2=0x55ac3a8a9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:35.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.996+0000 7f5f04e00700 1 --2- 172.21.15.69:0/3646324434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a8a9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:35.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.996+0000 7f5f04e00700 1 -- 172.21.15.69:0/3646324434 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac3a787420 con 0x55ac3a89fc50 2024-05-14T15:22:35.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.996+0000 7f5f04e00700 1 --2- 172.21.15.69:0/3646324434 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a89fc50 0x55ac3a8a9960 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5eec018aa0 tx=0x7f5eec018b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1b24e2e5b8fcc87 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:35.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.996+0000 7f5ee7400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:35.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.997+0000 7f5ee7400700 1 -- 172.21.15.69:0/3646324434 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5eec01d040 con 0x55ac3a89fc50 2024-05-14T15:22:35.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.997+0000 7f5ee7400700 1 -- 172.21.15.69:0/3646324434 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5eec005030 con 0x55ac3a89fc50 2024-05-14T15:22:35.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.997+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/3646324434 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5eec00fde0 con 0x55ac3a89fc50 2024-05-14T15:22:35.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.997+0000 7f5ee7400700 1 -- 172.21.15.69:0/3646324434 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5eec02f050 con 0x55ac3a89fc50 2024-05-14T15:22:35.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.997+0000 7f5f16c9bb80 10 client.15576 fetch_fsmap learned FSMap version 33 2024-05-14T15:22:35.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.997+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/3646324434 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ac3a8b7320 con 0x55ac3a89fc50 2024-05-14T15:22:35.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.998+0000 7f5ee7400700 1 -- 172.21.15.69:0/3646324434 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5eec00fde0 con 0x55ac3a89fc50 2024-05-14T15:22:35.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.998+0000 7f5ee7400700 1 -- 172.21.15.69:0/3646324434 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f5eec020070 con 0x55ac3a89fc50 2024-05-14T15:22:35.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.998+0000 7f5f16c9bb80 10 client.15576 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:22:35.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.998+0000 7f5f16c9bb80 10 client.15576 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:22:35.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.998+0000 7f5f16c9bb80 20 client.15576 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:35.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.998+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/3646324434 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ac3a8b97f0 0x55ac3a8bbc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:35.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.998+0000 7f5f16c9bb80 4 client.15576 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:22:36.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.998+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/3646324434 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ac3a86c070 con 0x55ac3a8b97f0 2024-05-14T15:22:36.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:35.999+0000 7f5f05800700 1 --2- 172.21.15.69:0/3646324434 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ac3a8b97f0 0x55ac3a8bbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:36.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.000+0000 7f5f05800700 1 --2- 172.21.15.69:0/3646324434 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ac3a8b97f0 0x55ac3a8bbc10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d26e1191a6d1f0e5 server_cookie=b6a7c70d275e3af4 in_seq=0 out_seq=0 2024-05-14T15:22:36.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.000+0000 7f5ee7400700 10 client.15576 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:36.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.005+0000 7f5ee7400700 1 -- 172.21.15.69:0/3646324434 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f5ef4083e50 con 0x55ac3a8b97f0 2024-05-14T15:22:36.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.005+0000 7f5ee7400700 10 client.15576 handle_command_reply: tid=0 2024-05-14T15:22:36.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.005+0000 7f5f16c9bb80 1 client.15576 shutdown 2024-05-14T15:22:36.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.006+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/3646324434 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a89fc50 msgr2=0x55ac3a8a9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:36.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.006+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/3646324434 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a89fc50 0x55ac3a8a9960 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f5eec018aa0 tx=0x7f5eec018b80 comp rx=0 tx=0).stop 2024-05-14T15:22:36.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.006+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/3646324434 shutdown_connections 2024-05-14T15:22:36.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.006+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/3646324434 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ac3a8b97f0 0x55ac3a8bbc10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.006+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/3646324434 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a8a9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.006+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/3646324434 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a721e40 0x55ac3a8a9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.006+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/3646324434 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a89fc50 0x55ac3a8a9960 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.006+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/3646324434 >> 172.21.15.69:0/3646324434 conn(0x55ac3a760a80 msgr2=0x55ac3a89e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:36.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.006+0000 7f5ee7400700 0 client.15576 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:36.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.006+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/3646324434 shutdown_connections 2024-05-14T15:22:36.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.006+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/3646324434 wait complete. 2024-05-14T15:22:36.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.006+0000 7f5f16c9bb80 20 client.15576 trim_cache size 0 max 16384 2024-05-14T15:22:36.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.030+0000 7f5f16c9bb80 1 Processor -- start 2024-05-14T15:22:36.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.030+0000 7f5f16c9bb80 1 -- start start 2024-05-14T15:22:36.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.030+0000 7f5f16c9bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a721e40 0x55ac3a89f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:36.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.030+0000 7f5f16c9bb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a89fc50 0x55ac3a8a3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:36.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.030+0000 7f5f16c9bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a8a8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:36.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.030+0000 7f5f16c9bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001b26b0 con 0x55ac3a721e40 2024-05-14T15:22:36.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.030+0000 7f5f16c9bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001b42e0 con 0x55ac3a8a5bf0 2024-05-14T15:22:36.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.030+0000 7f5f16c9bb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001b2d80 con 0x55ac3a89fc50 2024-05-14T15:22:36.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.030+0000 7f5f05800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a721e40 0x55ac3a89f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:36.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.031+0000 7f5f05800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a721e40 0x55ac3a89f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49078/0 (socket says 172.21.15.69:49078) 2024-05-14T15:22:36.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.031+0000 7f5f05800700 1 -- 172.21.15.69:0/529484082 learned_addr learned my addr 172.21.15.69:0/529484082 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:36.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.031+0000 7f5f04e00700 1 --2- 172.21.15.69:0/529484082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a89fc50 0x55ac3a8a3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:36.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.031+0000 7f5f06200700 1 --2- 172.21.15.69:0/529484082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a8a8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:36.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.031+0000 7f5f05800700 1 -- 172.21.15.69:0/529484082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a89fc50 msgr2=0x55ac3a8a3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:36.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.031+0000 7f5f05800700 1 --2- 172.21.15.69:0/529484082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a89fc50 0x55ac3a8a3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.031+0000 7f5f05800700 1 -- 172.21.15.69:0/529484082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 msgr2=0x55ac3a8a8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:36.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.031+0000 7f5f05800700 1 --2- 172.21.15.69:0/529484082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a8a8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.031+0000 7f5f05800700 1 -- 172.21.15.69:0/529484082 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ac3a8a7990 con 0x55ac3a721e40 2024-05-14T15:22:36.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.031+0000 7f5f06200700 1 --2- 172.21.15.69:0/529484082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a8a8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:22:36.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.031+0000 7f5f05800700 1 --2- 172.21.15.69:0/529484082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a721e40 0x55ac3a89f710 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40a9490 tx=0x7f5ef4091040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e923f3ecca53ee0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:36.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.032+0000 7f5ef2000700 1 -- 172.21.15.69:0/529484082 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef40a92a0 con 0x55ac3a721e40 2024-05-14T15:22:36.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.032+0000 7f5ef2000700 1 -- 172.21.15.69:0/529484082 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ac3a86c070 con 0x55ac3a721e40 2024-05-14T15:22:36.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.032+0000 7f5ef2000700 1 -- 172.21.15.69:0/529484082 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef40b25f0 con 0x55ac3a721e40 2024-05-14T15:22:36.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.033+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/529484082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a721e40 msgr2=0x55ac3a89f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:36.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.033+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/529484082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a721e40 0x55ac3a89f710 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40a9490 tx=0x7f5ef4091040 comp rx=0 tx=0).stop 2024-05-14T15:22:36.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.033+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/529484082 shutdown_connections 2024-05-14T15:22:36.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.033+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/529484082 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a721e40 0x55ac3a89f710 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.033+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/529484082 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a8a8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.033+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/529484082 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a89fc50 0x55ac3a8a3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.033+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/529484082 >> 172.21.15.69:0/529484082 conn(0x55ac3a760a80 msgr2=0x55ac3a8aaad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:36.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.033+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/529484082 shutdown_connections 2024-05-14T15:22:36.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.033+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/529484082 wait complete. 2024-05-14T15:22:36.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.034+0000 7f5f16c9bb80 1 -- start start 2024-05-14T15:22:36.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.034+0000 7f5f16c9bb80 1 Processor -- start 2024-05-14T15:22:36.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.034+0000 7f5f16c9bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a721e40 0x55ac3a8bc730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:36.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.034+0000 7f5f16c9bb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a89fc50 0x55ac3a8bcc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:36.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.034+0000 7f5f16c9bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a922d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:36.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.034+0000 7f5f16c9bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001b3b50 con 0x55ac3a721e40 2024-05-14T15:22:36.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.034+0000 7f5f16c9bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001b3480 con 0x55ac3a8a5bf0 2024-05-14T15:22:36.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.034+0000 7f5f16c9bb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5f001b0650 con 0x55ac3a89fc50 2024-05-14T15:22:36.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.034+0000 7f5f16c9bb80 10 client.0 _ll_register_callbacks cb 0x55ac3a755380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:36.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.035+0000 7f5f05800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a721e40 0x55ac3a8bc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:36.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.035+0000 7f5f05800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a721e40 0x55ac3a8bc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49086/0 (socket says 172.21.15.69:49086) 2024-05-14T15:22:36.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.035+0000 7f5f05800700 1 -- 172.21.15.69:0/1810585268 learned_addr learned my addr 172.21.15.69:0/1810585268 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:36.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.035+0000 7f5f06200700 1 --2- 172.21.15.69:0/1810585268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a922d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:36.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.035+0000 7f5f05800700 1 -- 172.21.15.69:0/1810585268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a89fc50 msgr2=0x55ac3a8bcc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:36.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.035+0000 7f5f04e00700 1 --2- 172.21.15.69:0/1810585268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a89fc50 0x55ac3a8bcc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:36.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.035+0000 7f5f05800700 1 --2- 172.21.15.69:0/1810585268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a89fc50 0x55ac3a8bcc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.035+0000 7f5f05800700 1 -- 172.21.15.69:0/1810585268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 msgr2=0x55ac3a922d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:36.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.035+0000 7f5f05800700 1 --2- 172.21.15.69:0/1810585268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a922d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.035+0000 7f5f05800700 1 -- 172.21.15.69:0/1810585268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ac3a8bd470 con 0x55ac3a721e40 2024-05-14T15:22:36.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.035+0000 7f5f05800700 1 --2- 172.21.15.69:0/1810585268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a721e40 0x55ac3a8bc730 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40a5810 tx=0x7f5ef400fa20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9de1bd44275494e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:36.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.035+0000 7f5ee7400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:36.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.036+0000 7f5ee7400700 1 -- 172.21.15.69:0/1810585268 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ef40a9e90 con 0x55ac3a721e40 2024-05-14T15:22:36.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.036+0000 7f5ee7400700 1 -- 172.21.15.69:0/1810585268 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5ef40a5d80 con 0x55ac3a721e40 2024-05-14T15:22:36.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.036+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/1810585268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ac3a86c070 con 0x55ac3a721e40 2024-05-14T15:22:36.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.036+0000 7f5ee7400700 1 -- 172.21.15.69:0/1810585268 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5ef40cc0b0 con 0x55ac3a721e40 2024-05-14T15:22:36.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.036+0000 7f5f16c9bb80 10 client.15582 fetch_fsmap learned FSMap version 33 2024-05-14T15:22:36.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.036+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/1810585268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ac3a924190 con 0x55ac3a721e40 2024-05-14T15:22:36.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.036+0000 7f5ee7400700 1 -- 172.21.15.69:0/1810585268 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55ac3a86c070 con 0x55ac3a721e40 2024-05-14T15:22:36.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.037+0000 7f5ee7400700 1 -- 172.21.15.69:0/1810585268 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f5ef40b2160 con 0x55ac3a721e40 2024-05-14T15:22:36.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.037+0000 7f5f16c9bb80 10 client.15582 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:22:36.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.037+0000 7f5f16c9bb80 10 client.15582 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:22:36.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.037+0000 7f5f16c9bb80 20 client.15582 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:36.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.037+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/1810585268 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ac3a924840 0x55ac3a926c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:36.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.037+0000 7f5f16c9bb80 4 client.15582 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T15:22:36.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.037+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/1810585268 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ac3a8a50a0 con 0x55ac3a924840 2024-05-14T15:22:36.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.037+0000 7f5f04e00700 1 --2- 172.21.15.69:0/1810585268 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ac3a924840 0x55ac3a926c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:36.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.038+0000 7f5ee7400700 10 client.15582 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:36.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.038+0000 7f5f04e00700 1 --2- 172.21.15.69:0/1810585268 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ac3a924840 0x55ac3a926c60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=21f20665293c2e50 server_cookie=757defa5e80af8bf in_seq=0 out_seq=0 2024-05-14T15:22:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.045+0000 7f5ee7400700 1 -- 172.21.15.69:0/1810585268 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ac3a8a50a0 con 0x55ac3a924840 2024-05-14T15:22:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.045+0000 7f5ee7400700 10 client.15582 handle_command_reply: tid=0 2024-05-14T15:22:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.045+0000 7f5f16c9bb80 1 client.15582 shutdown 2024-05-14T15:22:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.045+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/1810585268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a721e40 msgr2=0x55ac3a8bc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:36.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.045+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/1810585268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a721e40 0x55ac3a8bc730 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f5ef40a5810 tx=0x7f5ef400fa20 comp rx=0 tx=0).stop 2024-05-14T15:22:36.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.045+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/1810585268 shutdown_connections 2024-05-14T15:22:36.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.045+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/1810585268 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ac3a924840 0x55ac3a926c60 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.045+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/1810585268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ac3a721e40 0x55ac3a8bc730 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.045+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/1810585268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ac3a8a5bf0 0x55ac3a922d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.045+0000 7f5ee7400700 0 client.15582 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:36.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.045+0000 7f5f16c9bb80 1 --2- 172.21.15.69:0/1810585268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ac3a89fc50 0x55ac3a8bcc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.045+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/1810585268 >> 172.21.15.69:0/1810585268 conn(0x55ac3a760a80 msgr2=0x55ac3a8a3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:36.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.045+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/1810585268 shutdown_connections 2024-05-14T15:22:36.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.045+0000 7f5f16c9bb80 1 -- 172.21.15.69:0/1810585268 wait complete. 2024-05-14T15:22:36.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.046+0000 7f5f16c9bb80 20 client.15582 trim_cache size 0 max 16384 2024-05-14T15:22:36.047 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:22:36.047 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2024-05-14T15:22:36.047 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2024-05-14T15:22:36.047 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:22:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.046+0000 7f5f08200700 1 -- 172.21.15.69:0/2054650164 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5ee80b2b90 msgr2=0x7f5ee80b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.046+0000 7f5f08200700 1 --2- 172.21.15.69:0/2054650164 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5ee80b2b90 0x7f5ee80b50a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x55ac3a8a0a30 tx=0x7f5ef800b7b0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.046+0000 7f5f08200700 1 -- 172.21.15.69:0/2054650164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f00102860 msgr2=0x7f5f00103a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.046+0000 7f5f08200700 1 --2- 172.21.15.69:0/2054650164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f00102860 0x7f5f00103a40 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5ef400c9b0 tx=0x7f5ef400ccc0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.046+0000 7f5f08200700 1 -- 172.21.15.69:0/2054650164 shutdown_connections 2024-05-14T15:22:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.046+0000 7f5f08200700 1 --2- 172.21.15.69:0/2054650164 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5ee80b2b90 0x7f5ee80b50a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.046+0000 7f5f08200700 1 --2- 172.21.15.69:0/2054650164 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f00102860 0x7f5f00103a40 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.046+0000 7f5f08200700 1 --2- 172.21.15.69:0/2054650164 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f0010a3d0 0x7f5f001044c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.046+0000 7f5f08200700 1 --2- 172.21.15.69:0/2054650164 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f001031b0 0x7f5f00103f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.046+0000 7f5f08200700 1 -- 172.21.15.69:0/2054650164 >> 172.21.15.69:0/2054650164 conn(0x7f5f000fe6f0 msgr2=0x7f5f00100c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.047+0000 7f5f08200700 1 -- 172.21.15.69:0/2054650164 shutdown_connections 2024-05-14T15:22:36.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:36.047+0000 7f5f08200700 1 -- 172.21.15.69:0/2054650164 wait complete. 2024-05-14T15:22:37.026 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-14T15:22:37.027 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:22:37.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:37 smithi092 ceph-mon[34729]: pgmap v32: 129 pgs: 129 active+clean; 46 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 2.0 MiB/s wr, 127 op/s 2024-05-14T15:22:37.472 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:37 smithi069 ceph-mon[31270]: pgmap v32: 129 pgs: 129 active+clean; 46 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 2.0 MiB/s wr, 127 op/s 2024-05-14T15:22:37.513 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:22:37.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:37 smithi203 ceph-mon[34567]: pgmap v32: 129 pgs: 129 active+clean; 46 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 277 KiB/s rd, 2.0 MiB/s wr, 127 op/s 2024-05-14T15:22:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.854+0000 7f37e6e00640 1 -- 172.21.15.69:0/785103787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37e010a120 msgr2=0x7f37e0103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.854+0000 7f37e6e00640 1 --2- 172.21.15.69:0/785103787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37e010a120 0x7f37e0103d60 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f37cc009900 tx=0x7f37cc02a410 comp rx=0 tx=0).stop 2024-05-14T15:22:38.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.854+0000 7f37e6e00640 1 -- 172.21.15.69:0/785103787 shutdown_connections 2024-05-14T15:22:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.854+0000 7f37e6e00640 1 --2- 172.21.15.69:0/785103787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37e01043d0 0x7f37e01107a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.854+0000 7f37e6e00640 1 --2- 172.21.15.69:0/785103787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37e010a120 0x7f37e0103d60 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.854+0000 7f37e6e00640 1 --2- 172.21.15.69:0/785103787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37e0109c80 0x7f37e0103820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.854+0000 7f37e6e00640 1 -- 172.21.15.69:0/785103787 >> 172.21.15.69:0/785103787 conn(0x7f37e00ff360 msgr2=0x7f37e01017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.854+0000 7f37e6e00640 1 -- 172.21.15.69:0/785103787 shutdown_connections 2024-05-14T15:22:38.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.854+0000 7f37e6e00640 1 -- 172.21.15.69:0/785103787 wait complete. 2024-05-14T15:22:38.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.856+0000 7f37e6e00640 1 Processor -- start 2024-05-14T15:22:38.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.856+0000 7f37e6e00640 1 -- start start 2024-05-14T15:22:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.857+0000 7f37e6e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37e01043d0 0x7f37e019d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.857+0000 7f37e6e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37e0109c80 0x7f37e019dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.857+0000 7f37e6e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37e010a120 0x7f37e01a8680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.857+0000 7f37e6e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f37e0113d20 con 0x7f37e0109c80 2024-05-14T15:22:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.857+0000 7f37e6e00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f37e0113ba0 con 0x7f37e010a120 2024-05-14T15:22:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.857+0000 7f37e6e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f37e0113ea0 con 0x7f37e01043d0 2024-05-14T15:22:38.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.857+0000 7f37df400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37e0109c80 0x7f37e019dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.857+0000 7f37df400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37e0109c80 0x7f37e019dd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49116/0 (socket says 172.21.15.69:49116) 2024-05-14T15:22:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.857+0000 7f37df400640 1 -- 172.21.15.69:0/2527739478 learned_addr learned my addr 172.21.15.69:0/2527739478 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.857+0000 7f37e4e00640 1 --2- 172.21.15.69:0/2527739478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37e010a120 0x7f37e01a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.857+0000 7f37dfe00640 1 --2- 172.21.15.69:0/2527739478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37e01043d0 0x7f37e019d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.857+0000 7f37df400640 1 -- 172.21.15.69:0/2527739478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37e01043d0 msgr2=0x7f37e019d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.857+0000 7f37df400640 1 --2- 172.21.15.69:0/2527739478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37e01043d0 0x7f37e019d7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.857+0000 7f37df400640 1 -- 172.21.15.69:0/2527739478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37e010a120 msgr2=0x7f37e01a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.857+0000 7f37df400640 1 --2- 172.21.15.69:0/2527739478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37e010a120 0x7f37e01a8680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.858+0000 7f37df400640 1 -- 172.21.15.69:0/2527739478 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e01a8c40 con 0x7f37e0109c80 2024-05-14T15:22:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.858+0000 7f37df400640 1 --2- 172.21.15.69:0/2527739478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37e0109c80 0x7f37e019dd20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f37cc005940 tx=0x7f37cc004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.858+0000 7f37dcc00640 1 -- 172.21.15.69:0/2527739478 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc03f030 con 0x7f37e0109c80 2024-05-14T15:22:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.858+0000 7f37dcc00640 1 -- 172.21.15.69:0/2527739478 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37cc004440 con 0x7f37e0109c80 2024-05-14T15:22:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.858+0000 7f37dcc00640 1 -- 172.21.15.69:0/2527739478 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc035070 con 0x7f37e0109c80 2024-05-14T15:22:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.858+0000 7f37e6e00640 1 -- 172.21.15.69:0/2527739478 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e01a8ed0 con 0x7f37e0109c80 2024-05-14T15:22:38.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.858+0000 7f37e6e00640 1 -- 172.21.15.69:0/2527739478 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e01a92d0 con 0x7f37e0109c80 2024-05-14T15:22:38.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.863+0000 7f37dcc00640 1 -- 172.21.15.69:0/2527739478 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 149885+0+0 (secure 0 0 0) 0x7f37cc042030 con 0x7f37e0109c80 2024-05-14T15:22:38.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.863+0000 7f37eddd0740 1 Processor -- start 2024-05-14T15:22:38.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.864+0000 7f37eddd0740 1 -- start start 2024-05-14T15:22:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.864+0000 7f37eddd0740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a48f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.864+0000 7f37eddd0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0c52f0 0x55bd4a48f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.864+0000 7f37eddd0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a48fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.864+0000 7f37eddd0740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55bd4a3f4550 con 0x55bd4a0ee1b0 2024-05-14T15:22:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.864+0000 7f37eddd0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bd4a399bc0 con 0x55bd4a0cd4d0 2024-05-14T15:22:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.864+0000 7f37eddd0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bd4a3f0510 con 0x55bd4a0c52f0 2024-05-14T15:22:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.864+0000 7f37e4e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a48f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.865+0000 7f37e4e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a48f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49128/0 (socket says 172.21.15.69:49128) 2024-05-14T15:22:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.865+0000 7f37e4e00640 1 -- 172.21.15.69:0/3235560912 learned_addr learned my addr 172.21.15.69:0/3235560912 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.865+0000 7f37dcc00640 1 --2- 172.21.15.69:0/2527739478 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f37c40b2a70 0x7f37c40b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.865+0000 7f37dfe00640 1 --2- 172.21.15.69:0/3235560912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0c52f0 0x55bd4a48f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.865+0000 7f37df400640 1 --2- 172.21.15.69:0/3235560912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a48fd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.865+0000 7f37dcc00640 1 -- 172.21.15.69:0/2527739478 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f37cc103050 con 0x7f37e0109c80 2024-05-14T15:22:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.865+0000 7f37e4e00640 1 --2- 172.21.15.69:0/2527739478 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f37c40b2a70 0x7f37c40b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.865+0000 7f37e4e00640 1 -- 172.21.15.69:0/3235560912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0c52f0 msgr2=0x55bd4a48f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.865+0000 7f37e4e00640 1 --2- 172.21.15.69:0/3235560912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0c52f0 0x55bd4a48f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.865+0000 7f37e4e00640 1 -- 172.21.15.69:0/3235560912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0cd4d0 msgr2=0x55bd4a48fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.865+0000 7f37e4e00640 1 --2- 172.21.15.69:0/3235560912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a48fd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.865+0000 7f37e4e00640 1 -- 172.21.15.69:0/3235560912 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd4a106210 con 0x55bd4a0ee1b0 2024-05-14T15:22:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.866+0000 7f37e4e00640 1 --2- 172.21.15.69:0/3235560912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a48f280 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f37d8013790 tx=0x7f37d8013c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d3b62d476bf0737 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.866+0000 7f37d5600640 1 -- 172.21.15.69:0/3235560912 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d801d9c0 con 0x55bd4a0ee1b0 2024-05-14T15:22:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.866+0000 7f37d5600640 1 -- 172.21.15.69:0/3235560912 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37d8022070 con 0x55bd4a0ee1b0 2024-05-14T15:22:38.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.866+0000 7f37d5600640 1 -- 172.21.15.69:0/3235560912 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d801c920 con 0x55bd4a0ee1b0 2024-05-14T15:22:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.867+0000 7f37eddd0740 1 -- 172.21.15.69:0/3235560912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0ee1b0 msgr2=0x55bd4a48f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.867+0000 7f37e4e00640 1 --2- 172.21.15.69:0/2527739478 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f37c40b2a70 0x7f37c40b4f80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f37d8021000 tx=0x7f37d801f000 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.867+0000 7f37eddd0740 1 --2- 172.21.15.69:0/3235560912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a48f280 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f37d8013790 tx=0x7f37d8013c50 comp rx=0 tx=0).stop 2024-05-14T15:22:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.868+0000 7f37eddd0740 1 -- 172.21.15.69:0/3235560912 shutdown_connections 2024-05-14T15:22:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.868+0000 7f37eddd0740 1 --2- 172.21.15.69:0/3235560912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a48fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.868+0000 7f37eddd0740 1 --2- 172.21.15.69:0/3235560912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0c52f0 0x55bd4a48f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.868+0000 7f37eddd0740 1 --2- 172.21.15.69:0/3235560912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a48f280 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.868+0000 7f37eddd0740 1 -- 172.21.15.69:0/3235560912 >> 172.21.15.69:0/3235560912 conn(0x55bd4a0e2300 msgr2=0x55bd4a48ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.868+0000 7f37eddd0740 1 -- 172.21.15.69:0/3235560912 shutdown_connections 2024-05-14T15:22:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.868+0000 7f37eddd0740 1 -- 172.21.15.69:0/3235560912 wait complete. 2024-05-14T15:22:38.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.868+0000 7f37eddd0740 1 -- start start 2024-05-14T15:22:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.868+0000 7f37eddd0740 1 Processor -- start 2024-05-14T15:22:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.869+0000 7f37eddd0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0c52f0 0x55bd4a499760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.869+0000 7f37eddd0740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a499ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.869+0000 7f37eddd0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a4a5890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.869+0000 7f37eddd0740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55bd4a49c3b0 con 0x55bd4a0cd4d0 2024-05-14T15:22:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.869+0000 7f37eddd0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bd4a3ad660 con 0x55bd4a0c52f0 2024-05-14T15:22:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.869+0000 7f37eddd0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bd4a49c530 con 0x55bd4a0ee1b0 2024-05-14T15:22:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.869+0000 7f37eddd0740 10 client.0 _ll_register_callbacks cb 0x55bd4a377400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.869+0000 7f37df400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a499ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.869+0000 7f37df400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a499ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49132/0 (socket says 172.21.15.69:49132) 2024-05-14T15:22:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.869+0000 7f37df400640 1 -- 172.21.15.69:0/1846371268 learned_addr learned my addr 172.21.15.69:0/1846371268 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:38.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.870+0000 7f37dfe00640 1 --2- 172.21.15.69:0/1846371268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0c52f0 0x55bd4a499760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.870+0000 7f37e4e00640 1 --2- 172.21.15.69:0/1846371268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a4a5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.870+0000 7f37df400640 1 -- 172.21.15.69:0/1846371268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0ee1b0 msgr2=0x55bd4a4a5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:38.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.870+0000 7f37df400640 1 --2- 172.21.15.69:0/1846371268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a4a5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.870+0000 7f37df400640 1 -- 172.21.15.69:0/1846371268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0c52f0 msgr2=0x55bd4a499760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:38.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.870+0000 7f37df400640 1 --2- 172.21.15.69:0/1846371268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0c52f0 0x55bd4a499760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.870+0000 7f37df400640 1 -- 172.21.15.69:0/1846371268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd4a1d2620 con 0x55bd4a0cd4d0 2024-05-14T15:22:38.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.870+0000 7f37dfe00640 1 --2- 172.21.15.69:0/1846371268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0c52f0 0x55bd4a499760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:22:38.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.870+0000 7f37df400640 1 --2- 172.21.15.69:0/1846371268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a499ca0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f37cc02a450 tx=0x7f37cc04cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1744c2b4e98340d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:38.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.870+0000 7f37ca000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:38.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.871+0000 7f37ca000640 1 -- 172.21.15.69:0/1846371268 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc049040 con 0x55bd4a0cd4d0 2024-05-14T15:22:38.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.871+0000 7f37eddd0740 1 -- 172.21.15.69:0/1846371268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37d8022070 con 0x55bd4a0cd4d0 2024-05-14T15:22:38.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.871+0000 7f37ca000640 1 -- 172.21.15.69:0/1846371268 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f37cc0c63f0 con 0x55bd4a0cd4d0 2024-05-14T15:22:38.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.871+0000 7f37ca000640 1 -- 172.21.15.69:0/1846371268 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f37cc0c9910 con 0x55bd4a0cd4d0 2024-05-14T15:22:38.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.871+0000 7f37eddd0740 10 client.15594 fetch_fsmap learned FSMap version 33 2024-05-14T15:22:38.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.871+0000 7f37eddd0740 1 -- 172.21.15.69:0/1846371268 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55bd4a4a8580 con 0x55bd4a0cd4d0 2024-05-14T15:22:38.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.871+0000 7f37ca000640 1 -- 172.21.15.69:0/1846371268 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37d8022070 con 0x55bd4a0cd4d0 2024-05-14T15:22:38.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.872+0000 7f37ca000640 1 -- 172.21.15.69:0/1846371268 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f37cc1050e0 con 0x55bd4a0cd4d0 2024-05-14T15:22:38.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.872+0000 7f37eddd0740 10 client.15594 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:22:38.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.872+0000 7f37eddd0740 10 client.15594 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:22:38.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.872+0000 7f37eddd0740 20 client.15594 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:38.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.872+0000 7f37eddd0740 1 --2- 172.21.15.69:0/1846371268 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55bd4a0acd80 0x55bd4a4abb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.872+0000 7f37eddd0740 4 client.15594 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:22:38.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.872+0000 7f37eddd0740 1 -- 172.21.15.69:0/1846371268 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd4a402160 con 0x55bd4a0acd80 2024-05-14T15:22:38.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.872+0000 7f37dfe00640 1 --2- 172.21.15.69:0/1846371268 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55bd4a0acd80 0x55bd4a4abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.873+0000 7f37ca000640 10 client.15594 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:38.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.873+0000 7f37dfe00640 1 --2- 172.21.15.69:0/1846371268 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55bd4a0acd80 0x55bd4a4abb80 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89718b1d550465e8 server_cookie=4effe845c9d64dde in_seq=0 out_seq=0 2024-05-14T15:22:38.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.875+0000 7f37ca000640 1 -- 172.21.15.69:0/1846371268 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bd4a402160 con 0x55bd4a0acd80 2024-05-14T15:22:38.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.875+0000 7f37ca000640 10 client.15594 handle_command_reply: tid=0 2024-05-14T15:22:38.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.876+0000 7f37eddd0740 1 client.15594 shutdown 2024-05-14T15:22:38.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.876+0000 7f37eddd0740 1 -- 172.21.15.69:0/1846371268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0cd4d0 msgr2=0x55bd4a499ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:38.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.876+0000 7f37eddd0740 1 --2- 172.21.15.69:0/1846371268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a499ca0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f37cc02a450 tx=0x7f37cc04cf90 comp rx=0 tx=0).stop 2024-05-14T15:22:38.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.876+0000 7f37eddd0740 1 -- 172.21.15.69:0/1846371268 shutdown_connections 2024-05-14T15:22:38.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.876+0000 7f37eddd0740 1 --2- 172.21.15.69:0/1846371268 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a4a5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.876+0000 7f37eddd0740 1 --2- 172.21.15.69:0/1846371268 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55bd4a0acd80 0x55bd4a4abb80 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.876+0000 7f37eddd0740 1 --2- 172.21.15.69:0/1846371268 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a499ca0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.876+0000 7f37eddd0740 1 --2- 172.21.15.69:0/1846371268 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0c52f0 0x55bd4a499760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.876+0000 7f37eddd0740 1 -- 172.21.15.69:0/1846371268 >> 172.21.15.69:0/1846371268 conn(0x55bd4a0e2300 msgr2=0x55bd4a48f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.876+0000 7f37ca000640 0 client.15594 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.876+0000 7f37eddd0740 1 -- 172.21.15.69:0/1846371268 shutdown_connections 2024-05-14T15:22:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.876+0000 7f37eddd0740 1 -- 172.21.15.69:0/1846371268 wait complete. 2024-05-14T15:22:38.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.876+0000 7f37eddd0740 20 client.15594 trim_cache size 0 max 16384 2024-05-14T15:22:38.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.897+0000 7f37eddd0740 1 Processor -- start 2024-05-14T15:22:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.898+0000 7f37eddd0740 1 -- start start 2024-05-14T15:22:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.898+0000 7f37eddd0740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0c52f0 0x55bd4a48b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.898+0000 7f37eddd0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a4b1380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.898+0000 7f37eddd0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a4b18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.898+0000 7f37eddd0740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01b3510 con 0x55bd4a0c52f0 2024-05-14T15:22:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.898+0000 7f37eddd0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01b5140 con 0x55bd4a0cd4d0 2024-05-14T15:22:38.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.898+0000 7f37eddd0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01b3be0 con 0x55bd4a0ee1b0 2024-05-14T15:22:38.899 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.898+0000 7f37dfe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0c52f0 0x55bd4a48b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.899 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.898+0000 7f37df400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a4b1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.899+0000 7f37dfe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0c52f0 0x55bd4a48b960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49140/0 (socket says 172.21.15.69:49140) 2024-05-14T15:22:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.899+0000 7f37dfe00640 1 -- 172.21.15.69:0/2924639836 learned_addr learned my addr 172.21.15.69:0/2924639836 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.899+0000 7f37e4e00640 1 --2- 172.21.15.69:0/2924639836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a4b18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.899+0000 7f37df400640 1 -- 172.21.15.69:0/2924639836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0ee1b0 msgr2=0x55bd4a4b18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.899+0000 7f37df400640 1 --2- 172.21.15.69:0/2924639836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a4b18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.899+0000 7f37df400640 1 -- 172.21.15.69:0/2924639836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0c52f0 msgr2=0x55bd4a48b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.899+0000 7f37df400640 1 --2- 172.21.15.69:0/2924639836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0c52f0 0x55bd4a48b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.899+0000 7f37df400640 1 -- 172.21.15.69:0/2924639836 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd4a497aa0 con 0x55bd4a0cd4d0 2024-05-14T15:22:38.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.899+0000 7f37dfe00640 1 --2- 172.21.15.69:0/2924639836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0c52f0 0x55bd4a48b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:22:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.900+0000 7f37df400640 1 --2- 172.21.15.69:0/2924639836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a4b1380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0c9d90 tx=0x7f37cc009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7638e738cac6c2fd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.900+0000 7f37d4c00640 1 -- 172.21.15.69:0/2924639836 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc0c5cc0 con 0x55bd4a0cd4d0 2024-05-14T15:22:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.900+0000 7f37d4c00640 1 -- 172.21.15.69:0/2924639836 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37cc0c2020 con 0x55bd4a0cd4d0 2024-05-14T15:22:38.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.900+0000 7f37d4c00640 1 -- 172.21.15.69:0/2924639836 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37cc0c9570 con 0x55bd4a0cd4d0 2024-05-14T15:22:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.901+0000 7f37eddd0740 1 -- 172.21.15.69:0/2924639836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0cd4d0 msgr2=0x55bd4a4b1380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.901+0000 7f37eddd0740 1 --2- 172.21.15.69:0/2924639836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a4b1380 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0c9d90 tx=0x7f37cc009260 comp rx=0 tx=0).stop 2024-05-14T15:22:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.901+0000 7f37eddd0740 1 -- 172.21.15.69:0/2924639836 shutdown_connections 2024-05-14T15:22:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.901+0000 7f37eddd0740 1 --2- 172.21.15.69:0/2924639836 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a4b18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.901+0000 7f37eddd0740 1 --2- 172.21.15.69:0/2924639836 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a4b1380 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.901+0000 7f37eddd0740 1 --2- 172.21.15.69:0/2924639836 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0c52f0 0x55bd4a48b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.901+0000 7f37eddd0740 1 -- 172.21.15.69:0/2924639836 >> 172.21.15.69:0/2924639836 conn(0x55bd4a0e2300 msgr2=0x55bd4a48b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.902+0000 7f37eddd0740 1 -- 172.21.15.69:0/2924639836 shutdown_connections 2024-05-14T15:22:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.902+0000 7f37eddd0740 1 -- 172.21.15.69:0/2924639836 wait complete. 2024-05-14T15:22:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.902+0000 7f37eddd0740 1 -- start start 2024-05-14T15:22:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.902+0000 7f37eddd0740 1 Processor -- start 2024-05-14T15:22:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.903+0000 7f37eddd0740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0c52f0 0x55bd4a49e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.903+0000 7f37eddd0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a49eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.903+0000 7f37eddd0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a511f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.903+0000 7f37eddd0740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01b49b0 con 0x55bd4a0c52f0 2024-05-14T15:22:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.903+0000 7f37eddd0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01b42e0 con 0x55bd4a0ee1b0 2024-05-14T15:22:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.903+0000 7f37eddd0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f37e01b14f0 con 0x55bd4a0cd4d0 2024-05-14T15:22:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.903+0000 7f37eddd0740 10 client.0 _ll_register_callbacks cb 0x7f37cc009560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.903+0000 7f37dfe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0c52f0 0x55bd4a49e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.903+0000 7f37dfe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0c52f0 0x55bd4a49e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49144/0 (socket says 172.21.15.69:49144) 2024-05-14T15:22:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.903+0000 7f37dfe00640 1 -- 172.21.15.69:0/2783078431 learned_addr learned my addr 172.21.15.69:0/2783078431 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.904+0000 7f37e4e00640 1 --2- 172.21.15.69:0/2783078431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a511f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.904+0000 7f37df400640 1 --2- 172.21.15.69:0/2783078431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a49eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.904+0000 7f37dfe00640 1 -- 172.21.15.69:0/2783078431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0cd4d0 msgr2=0x55bd4a49eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.904+0000 7f37dfe00640 1 --2- 172.21.15.69:0/2783078431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a49eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.904+0000 7f37dfe00640 1 -- 172.21.15.69:0/2783078431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0ee1b0 msgr2=0x55bd4a511f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.904+0000 7f37dfe00640 1 --2- 172.21.15.69:0/2783078431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a511f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.904+0000 7f37dfe00640 1 -- 172.21.15.69:0/2783078431 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd4a49f520 con 0x55bd4a0c52f0 2024-05-14T15:22:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.904+0000 7f37e4e00640 1 --2- 172.21.15.69:0/2783078431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a511f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:22:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.904+0000 7f37dfe00640 1 --2- 172.21.15.69:0/2783078431 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0c52f0 0x55bd4a49e760 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f37e0104960 tx=0x7f37d0003df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69794ac68e54e550 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.904+0000 7f37ca000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.904+0000 7f37ca000640 1 -- 172.21.15.69:0/2783078431 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0023020 con 0x55bd4a0c52f0 2024-05-14T15:22:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.904+0000 7f37ca000640 1 -- 172.21.15.69:0/2783078431 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f37d0011960 con 0x55bd4a0c52f0 2024-05-14T15:22:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.904+0000 7f37eddd0740 1 -- 172.21.15.69:0/2783078431 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f37cc0c2020 con 0x55bd4a0c52f0 2024-05-14T15:22:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.905+0000 7f37ca000640 1 -- 172.21.15.69:0/2783078431 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f37d002e050 con 0x55bd4a0c52f0 2024-05-14T15:22:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.905+0000 7f37eddd0740 10 client.15600 fetch_fsmap learned FSMap version 33 2024-05-14T15:22:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.905+0000 7f37eddd0740 1 -- 172.21.15.69:0/2783078431 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55bd4a513520 con 0x55bd4a0c52f0 2024-05-14T15:22:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.905+0000 7f37ca000640 1 -- 172.21.15.69:0/2783078431 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f37cc0c2020 con 0x55bd4a0c52f0 2024-05-14T15:22:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.905+0000 7f37ca000640 1 -- 172.21.15.69:0/2783078431 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f37d0010430 con 0x55bd4a0c52f0 2024-05-14T15:22:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.905+0000 7f37eddd0740 10 client.15600 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:22:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.905+0000 7f37eddd0740 10 client.15600 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:22:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.905+0000 7f37eddd0740 20 client.15600 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.905+0000 7f37eddd0740 1 --2- 172.21.15.69:0/2783078431 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55bd4a0821c0 0x55bd4a515e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.905+0000 7f37eddd0740 4 client.15600 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:22:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.905+0000 7f37eddd0740 1 -- 172.21.15.69:0/2783078431 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55bd4a3fbfd0 con 0x55bd4a0821c0 2024-05-14T15:22:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.906+0000 7f37df400640 1 --2- 172.21.15.69:0/2783078431 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55bd4a0821c0 0x55bd4a515e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.907+0000 7f37df400640 1 --2- 172.21.15.69:0/2783078431 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55bd4a0821c0 0x55bd4a515e00 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2674cddb631b3d0c server_cookie=6e258fc70f701dc0 in_seq=0 out_seq=0 2024-05-14T15:22:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:38.907+0000 7f37ca000640 10 client.15600 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.149+0000 7f37ca000640 1 -- 172.21.15.69:0/2783078431 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55bd4a3fbfd0 con 0x55bd4a0821c0 2024-05-14T15:22:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.149+0000 7f37ca000640 10 client.15600 handle_command_reply: tid=0 2024-05-14T15:22:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.149+0000 7f37eddd0740 1 client.15600 shutdown 2024-05-14T15:22:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.150+0000 7f37eddd0740 1 -- 172.21.15.69:0/2783078431 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0c52f0 msgr2=0x55bd4a49e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:39.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.150+0000 7f37eddd0740 1 --2- 172.21.15.69:0/2783078431 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0c52f0 0x55bd4a49e760 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f37e0104960 tx=0x7f37d0003df0 comp rx=0 tx=0).stop 2024-05-14T15:22:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.152+0000 7f37eddd0740 1 -- 172.21.15.69:0/2783078431 shutdown_connections 2024-05-14T15:22:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.152+0000 7f37eddd0740 1 --2- 172.21.15.69:0/2783078431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd4a0ee1b0 0x55bd4a511f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.152+0000 7f37eddd0740 1 --2- 172.21.15.69:0/2783078431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd4a0cd4d0 0x55bd4a49eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.152+0000 7f37eddd0740 1 --2- 172.21.15.69:0/2783078431 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55bd4a0821c0 0x55bd4a515e00 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.152+0000 7f37eddd0740 1 --2- 172.21.15.69:0/2783078431 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd4a0c52f0 0x55bd4a49e760 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.152+0000 7f37ca000640 0 client.15600 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:39.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.152+0000 7f37eddd0740 1 -- 172.21.15.69:0/2783078431 >> 172.21.15.69:0/2783078431 conn(0x55bd4a0e2300 msgr2=0x55bd4a48a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.152+0000 7f37eddd0740 1 -- 172.21.15.69:0/2783078431 shutdown_connections 2024-05-14T15:22:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.152+0000 7f37eddd0740 1 -- 172.21.15.69:0/2783078431 wait complete. 2024-05-14T15:22:39.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.152+0000 7f37eddd0740 20 client.15600 trim_cache size 0 max 16384 2024-05-14T15:22:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:22:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:22:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:22:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:22:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.155+0000 7f37e6e00640 1 -- 172.21.15.69:0/2527739478 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f37c40b2a70 msgr2=0x7f37c40b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:39.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.155+0000 7f37e6e00640 1 --2- 172.21.15.69:0/2527739478 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f37c40b2a70 0x7f37c40b4f80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f37d8021000 tx=0x7f37d801f000 comp rx=0 tx=0).stop 2024-05-14T15:22:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.155+0000 7f37e6e00640 1 -- 172.21.15.69:0/2527739478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37e0109c80 msgr2=0x7f37e019dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.155+0000 7f37e6e00640 1 --2- 172.21.15.69:0/2527739478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37e0109c80 0x7f37e019dd20 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f37cc005940 tx=0x7f37cc004040 comp rx=0 tx=0).stop 2024-05-14T15:22:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.155+0000 7f37e6e00640 1 -- 172.21.15.69:0/2527739478 shutdown_connections 2024-05-14T15:22:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.155+0000 7f37e6e00640 1 --2- 172.21.15.69:0/2527739478 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f37c40b2a70 0x7f37c40b4f80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.155+0000 7f37e6e00640 1 --2- 172.21.15.69:0/2527739478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f37e010a120 0x7f37e01a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.155+0000 7f37e6e00640 1 --2- 172.21.15.69:0/2527739478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f37e0109c80 0x7f37e019dd20 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.155+0000 7f37e6e00640 1 --2- 172.21.15.69:0/2527739478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f37e01043d0 0x7f37e019d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.155+0000 7f37e6e00640 1 -- 172.21.15.69:0/2527739478 >> 172.21.15.69:0/2527739478 conn(0x7f37e00ff360 msgr2=0x7f37e0076010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:39.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.156+0000 7f37e6e00640 1 -- 172.21.15.69:0/2527739478 shutdown_connections 2024-05-14T15:22:39.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:39.156+0000 7f37e6e00640 1 -- 172.21.15.69:0/2527739478 wait complete. 2024-05-14T15:22:39.397 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:39 smithi203 ceph-mon[34567]: pgmap v33: 129 pgs: 129 active+clean; 46 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 1.6 MiB/s wr, 112 op/s 2024-05-14T15:22:39.429 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:39 smithi069 ceph-mon[31270]: pgmap v33: 129 pgs: 129 active+clean; 46 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 1.6 MiB/s wr, 112 op/s 2024-05-14T15:22:39.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:39 smithi092 ceph-mon[34729]: pgmap v33: 129 pgs: 129 active+clean; 46 MiB data, 525 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 1.6 MiB/s wr, 112 op/s 2024-05-14T15:22:40.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.104+0000 7f7311800700 1 -- 172.21.15.69:0/3092716515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f730c1032e0 msgr2=0x7f730c1036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:40.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.104+0000 7f7311800700 1 --2- 172.21.15.69:0/3092716515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f730c1032e0 0x7f730c1036f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f72fc0099c0 tx=0x7f72fc009cd0 comp rx=0 tx=0).stop 2024-05-14T15:22:40.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.104+0000 7f7311800700 1 -- 172.21.15.69:0/3092716515 shutdown_connections 2024-05-14T15:22:40.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.104+0000 7f7311800700 1 --2- 172.21.15.69:0/3092716515 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f730c1032e0 0x7f730c1036f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:40.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.104+0000 7f7311800700 1 --2- 172.21.15.69:0/3092716515 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f730c108560 0x7f730c10fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:40.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.104+0000 7f7311800700 1 --2- 172.21.15.69:0/3092716515 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c107c10 0x7f730c108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:40.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.104+0000 7f7311800700 1 -- 172.21.15.69:0/3092716515 >> 172.21.15.69:0/3092716515 conn(0x7f730c078ac0 msgr2=0x7f730c078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:40.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.106+0000 7f7311800700 1 -- 172.21.15.69:0/3092716515 shutdown_connections 2024-05-14T15:22:40.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.106+0000 7f7311800700 1 -- 172.21.15.69:0/3092716515 wait complete. 2024-05-14T15:22:40.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.107+0000 7f7311800700 1 Processor -- start 2024-05-14T15:22:40.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.108+0000 7f7311800700 1 -- start start 2024-05-14T15:22:40.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.108+0000 7f7311800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f730c1032e0 0x7f730c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:40.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.108+0000 7f7311800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f730c107c10 0x7f730c19d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:40.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.108+0000 7f7311800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c108560 0x7f730c1a1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:40.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.108+0000 7f7311800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f730c1141b0 con 0x7f730c107c10 2024-05-14T15:22:40.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.108+0000 7f7311800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f730c114030 con 0x7f730c1032e0 2024-05-14T15:22:40.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.108+0000 7f7311800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f730c114330 con 0x7f730c108560 2024-05-14T15:22:40.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.108+0000 7f730b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f730c107c10 0x7f730c19d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:40.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.109+0000 7f730b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f730c107c10 0x7f730c19d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49160/0 (socket says 172.21.15.69:49160) 2024-05-14T15:22:40.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.109+0000 7f730b400700 1 -- 172.21.15.69:0/1566874377 learned_addr learned my addr 172.21.15.69:0/1566874377 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:40.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.109+0000 7f7310e00700 1 --2- 172.21.15.69:0/1566874377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c108560 0x7f730c1a1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:40.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.109+0000 7f730be00700 1 --2- 172.21.15.69:0/1566874377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f730c1032e0 0x7f730c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:40.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.109+0000 7f730b400700 1 -- 172.21.15.69:0/1566874377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c108560 msgr2=0x7f730c1a1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:40.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.109+0000 7f730b400700 1 --2- 172.21.15.69:0/1566874377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c108560 0x7f730c1a1630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:40.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.109+0000 7f730b400700 1 -- 172.21.15.69:0/1566874377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f730c1032e0 msgr2=0x7f730c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:40.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.109+0000 7f730b400700 1 --2- 172.21.15.69:0/1566874377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f730c1032e0 0x7f730c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:40.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.109+0000 7f730b400700 1 -- 172.21.15.69:0/1566874377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f730c1a1c20 con 0x7f730c107c10 2024-05-14T15:22:40.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.110+0000 7f730b400700 1 --2- 172.21.15.69:0/1566874377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f730c107c10 0x7f730c19d3a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c9e0 tx=0x7f72f800ccf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:40.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.110+0000 7f7308c00700 1 -- 172.21.15.69:0/1566874377 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f8007aa0 con 0x7f730c107c10 2024-05-14T15:22:40.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.110+0000 7f7308c00700 1 -- 172.21.15.69:0/1566874377 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72f8007c40 con 0x7f730c107c10 2024-05-14T15:22:40.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.110+0000 7f7311800700 1 -- 172.21.15.69:0/1566874377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f730c1a1f10 con 0x7f730c107c10 2024-05-14T15:22:40.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.110+0000 7f7308c00700 1 -- 172.21.15.69:0/1566874377 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72f800fe60 con 0x7f730c107c10 2024-05-14T15:22:40.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.110+0000 7f7311800700 1 -- 172.21.15.69:0/1566874377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f730c1a2450 con 0x7f730c107c10 2024-05-14T15:22:40.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.111+0000 7f7311800700 1 -- 172.21.15.69:0/1566874377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f730c0512c0 con 0x7f730c107c10 2024-05-14T15:22:40.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.114+0000 7f7308c00700 1 -- 172.21.15.69:0/1566874377 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 149885+0+0 (secure 0 0 0) 0x7f72f800f450 con 0x7f730c107c10 2024-05-14T15:22:40.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.116+0000 7f7308c00700 1 --2- 172.21.15.69:0/1566874377 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f72f00b2b10 0x7f72f00b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:40.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.116+0000 7f7308c00700 1 -- 172.21.15.69:0/1566874377 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f72f80e2f00 con 0x7f730c107c10 2024-05-14T15:22:40.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.116+0000 7f730be00700 1 --2- 172.21.15.69:0/1566874377 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f72f00b2b10 0x7f72f00b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:40.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.117+0000 7f730be00700 1 --2- 172.21.15.69:0/1566874377 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f72f00b2b10 0x7f72f00b5020 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f72fc000c00 tx=0x7f72fc005940 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:40.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.119+0000 7f7308c00700 1 -- 172.21.15.69:0/1566874377 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f72f8014030 con 0x7f730c107c10 2024-05-14T15:22:40.422 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.422+0000 7f7311800700 1 -- 172.21.15.69:0/1566874377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f730c19e160 con 0x7f730c107c10 2024-05-14T15:22:40.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.424+0000 7f7308c00700 1 -- 172.21.15.69:0/1566874377 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11940 (secure 0 0 0) 0x7f72f80aa3e0 con 0x7f730c107c10 2024-05-14T15:22:40.425 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:40.425 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T15:16:11.716543+0000","modified":"2024-05-14T15:22:25.459823+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34490,"mds_1":34460,"mds_2":34433,"mds_3":34409,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":31,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":35,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34490":{"gid":34490,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34490,"qdb_cluster":[24451,34433,34409,34460,34490]},"id":1}]} 2024-05-14T15:22:40.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.428+0000 7f7311800700 1 -- 172.21.15.69:0/1566874377 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f72f00b2b10 msgr2=0x7f72f00b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:40.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.428+0000 7f7311800700 1 --2- 172.21.15.69:0/1566874377 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f72f00b2b10 0x7f72f00b5020 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f72fc000c00 tx=0x7f72fc005940 comp rx=0 tx=0).stop 2024-05-14T15:22:40.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.429+0000 7f7311800700 1 -- 172.21.15.69:0/1566874377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f730c107c10 msgr2=0x7f730c19d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:40.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.429+0000 7f7311800700 1 --2- 172.21.15.69:0/1566874377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f730c107c10 0x7f730c19d3a0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f72f800c9e0 tx=0x7f72f800ccf0 comp rx=0 tx=0).stop 2024-05-14T15:22:40.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.429+0000 7f7311800700 1 -- 172.21.15.69:0/1566874377 shutdown_connections 2024-05-14T15:22:40.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.429+0000 7f7311800700 1 --2- 172.21.15.69:0/1566874377 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f72f00b2b10 0x7f72f00b5020 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:40.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.429+0000 7f7311800700 1 --2- 172.21.15.69:0/1566874377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f730c108560 0x7f730c1a1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:40.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.429+0000 7f7311800700 1 --2- 172.21.15.69:0/1566874377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f730c1032e0 0x7f730c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:40.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.429+0000 7f7311800700 1 --2- 172.21.15.69:0/1566874377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f730c107c10 0x7f730c19d3a0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:40.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.429+0000 7f7311800700 1 -- 172.21.15.69:0/1566874377 >> 172.21.15.69:0/1566874377 conn(0x7f730c078ac0 msgr2=0x7f730c101740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:40.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.429+0000 7f7311800700 1 -- 172.21.15.69:0/1566874377 shutdown_connections 2024-05-14T15:22:40.430 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:40.429+0000 7f7311800700 1 -- 172.21.15.69:0/1566874377 wait complete. 2024-05-14T15:22:40.431 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 33 2024-05-14T15:22:41.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:41 smithi069 ceph-mon[31270]: pgmap v34: 129 pgs: 129 active+clean; 48 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 1.7 MiB/s wr, 135 op/s 2024-05-14T15:22:41.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:41 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1566874377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:22:41.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:41 smithi092 ceph-mon[34729]: pgmap v34: 129 pgs: 129 active+clean; 48 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 1.7 MiB/s wr, 135 op/s 2024-05-14T15:22:41.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:41 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1566874377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:22:41.574 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-14T15:22:41.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:41 smithi203 ceph-mon[34567]: pgmap v34: 129 pgs: 129 active+clean; 48 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 347 KiB/s rd, 1.7 MiB/s wr, 135 op/s 2024-05-14T15:22:41.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:41 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1566874377' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:22:42.052 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:22:43.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:43 smithi092 ceph-mon[34729]: pgmap v35: 129 pgs: 129 active+clean; 48 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 989 KiB/s wr, 51 op/s 2024-05-14T15:22:43.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:43 smithi069 ceph-mon[31270]: pgmap v35: 129 pgs: 129 active+clean; 48 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 989 KiB/s wr, 51 op/s 2024-05-14T15:22:43.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:43 smithi203 ceph-mon[34567]: pgmap v35: 129 pgs: 129 active+clean; 48 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 989 KiB/s wr, 51 op/s 2024-05-14T15:22:44.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.594+0000 7f2f9f200700 1 -- 172.21.15.69:0/427516595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa010a7c0 msgr2=0x7f2fa010abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:44.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.594+0000 7f2f9f200700 1 --2- 172.21.15.69:0/427516595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa010a7c0 0x7f2fa010abd0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009990 tx=0x7f2f8c009ca0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.594+0000 7f2f9f200700 1 -- 172.21.15.69:0/427516595 shutdown_connections 2024-05-14T15:22:44.595 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.594+0000 7f2f9f200700 1 --2- 172.21.15.69:0/427516595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fa010b110 0x7f2fa0117620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.594+0000 7f2f9f200700 1 --2- 172.21.15.69:0/427516595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fa010f6c0 0x7f2fa010fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.594+0000 7f2f9f200700 1 --2- 172.21.15.69:0/427516595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa010a7c0 0x7f2fa010abd0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.594+0000 7f2f9f200700 1 -- 172.21.15.69:0/427516595 >> 172.21.15.69:0/427516595 conn(0x7f2fa0076b00 msgr2=0x7f2fa0076f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:44.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.595+0000 7f2f9f200700 1 -- 172.21.15.69:0/427516595 shutdown_connections 2024-05-14T15:22:44.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.595+0000 7f2f9f200700 1 -- 172.21.15.69:0/427516595 wait complete. 2024-05-14T15:22:44.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.596+0000 7f2f9f200700 1 Processor -- start 2024-05-14T15:22:44.596 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.596+0000 7f2f9f200700 1 -- start start 2024-05-14T15:22:44.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.597+0000 7f2f9f200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fa010a7c0 0x7f2fa01a1240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.597+0000 7f2f9f200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa010b110 0x7f2fa01a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.597+0000 7f2f9f200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fa010f6c0 0x7f2fa01a5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.597+0000 7f2f9f200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa011a830 con 0x7f2fa010b110 2024-05-14T15:22:44.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.597+0000 7f2f9f200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa011a6b0 con 0x7f2fa010f6c0 2024-05-14T15:22:44.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.597+0000 7f2f9f200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa011a9b0 con 0x7f2fa010a7c0 2024-05-14T15:22:44.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.597+0000 7f2f9d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa010b110 0x7f2fa01a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.597 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.597+0000 7f2f9d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa010b110 0x7f2fa01a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34688/0 (socket says 172.21.15.69:34688) 2024-05-14T15:22:44.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.597+0000 7f2f9d400700 1 -- 172.21.15.69:0/2877699202 learned_addr learned my addr 172.21.15.69:0/2877699202 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:44.598 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.597+0000 7f2f9de00700 1 --2- 172.21.15.69:0/2877699202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fa010a7c0 0x7f2fa01a1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.597+0000 7f2f9e800700 1 --2- 172.21.15.69:0/2877699202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fa010f6c0 0x7f2fa01a5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.597+0000 7f2f9d400700 1 -- 172.21.15.69:0/2877699202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fa010a7c0 msgr2=0x7f2fa01a1240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.597+0000 7f2f9d400700 1 --2- 172.21.15.69:0/2877699202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fa010a7c0 0x7f2fa01a1240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.597+0000 7f2f9d400700 1 -- 172.21.15.69:0/2877699202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fa010f6c0 msgr2=0x7f2fa01a5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.597+0000 7f2f9d400700 1 --2- 172.21.15.69:0/2877699202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fa010f6c0 0x7f2fa01a5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.598+0000 7f2f9d400700 1 -- 172.21.15.69:0/2877699202 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa01a6110 con 0x7f2fa010b110 2024-05-14T15:22:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.598+0000 7f2f9d400700 1 --2- 172.21.15.69:0/2877699202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa010b110 0x7f2fa01a17e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c005910 tx=0x7f2f8c009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.598+0000 7f2f96a00700 1 -- 172.21.15.69:0/2877699202 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c027070 con 0x7f2fa010b110 2024-05-14T15:22:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.598+0000 7f2f96a00700 1 -- 172.21.15.69:0/2877699202 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f8c00fce0 con 0x7f2fa010b110 2024-05-14T15:22:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.598+0000 7f2f9f200700 1 -- 172.21.15.69:0/2877699202 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa01a63a0 con 0x7f2fa010b110 2024-05-14T15:22:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.598+0000 7f2f96a00700 1 -- 172.21.15.69:0/2877699202 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c0173f0 con 0x7f2fa010b110 2024-05-14T15:22:44.599 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.598+0000 7f2f9f200700 1 -- 172.21.15.69:0/2877699202 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa01add20 con 0x7f2fa010b110 2024-05-14T15:22:44.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.603+0000 7f2f96a00700 1 -- 172.21.15.69:0/2877699202 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 149885+0+0 (secure 0 0 0) 0x7f2f8c017590 con 0x7f2fa010b110 2024-05-14T15:22:44.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.604+0000 7f2fb3c5ab80 1 Processor -- start 2024-05-14T15:22:44.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.604+0000 7f2fb3c5ab80 1 -- start start 2024-05-14T15:22:44.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.604+0000 7f2fb3c5ab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56453594de40 0x564535ad1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.604+0000 7f2fb3c5ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535ad1a80 0x564535acb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.604+0000 7f2fb3c5ab80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564535acbc40 0x564535acc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.604+0000 7f2fb3c5ab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5645359eda20 con 0x56453594de40 2024-05-14T15:22:44.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.604+0000 7f2fb3c5ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56453598b760 con 0x564535ad1a80 2024-05-14T15:22:44.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.604+0000 7f2fb3c5ab80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5645359e99e0 con 0x564535acbc40 2024-05-14T15:22:44.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.605+0000 7f2f9e800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56453594de40 0x564535ad1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.605+0000 7f2f96a00700 1 --2- 172.21.15.69:0/2877699202 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2f840b2b90 0x7f2f840b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.605+0000 7f2f9e800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56453594de40 0x564535ad1540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34704/0 (socket says 172.21.15.69:34704) 2024-05-14T15:22:44.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.605+0000 7f2f9e800700 1 -- 172.21.15.69:0/2414788957 learned_addr learned my addr 172.21.15.69:0/2414788957 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:44.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.605+0000 7f2f9de00700 1 --2- 172.21.15.69:0/2414788957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535ad1a80 0x564535acb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.605+0000 7f2f96a00700 1 -- 172.21.15.69:0/2877699202 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f2f8c0e3f00 con 0x7f2fa010b110 2024-05-14T15:22:44.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.605+0000 7f2f9d400700 1 --2- 172.21.15.69:0/2414788957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564535acbc40 0x564535acc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.605+0000 7f2f9e800700 1 --2- 172.21.15.69:0/2877699202 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2f840b2b90 0x7f2f840b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.606+0000 7f2f9e800700 1 -- 172.21.15.69:0/2414788957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564535acbc40 msgr2=0x564535acc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:44.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.606+0000 7f2f9e800700 1 --2- 172.21.15.69:0/2414788957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564535acbc40 0x564535acc050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.606+0000 7f2f9e800700 1 -- 172.21.15.69:0/2414788957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535ad1a80 msgr2=0x564535acb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:44.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.606+0000 7f2f9e800700 1 --2- 172.21.15.69:0/2414788957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535ad1a80 0x564535acb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.606+0000 7f2f9e800700 1 -- 172.21.15.69:0/2414788957 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56453593a8d0 con 0x56453594de40 2024-05-14T15:22:44.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.606+0000 7f2f9e800700 1 --2- 172.21.15.69:0/2414788957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56453594de40 0x564535ad1540 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2f98008cb0 tx=0x7f2f98015200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d43cfbb28f0167 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:44.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.607+0000 7f2f8b400700 1 -- 172.21.15.69:0/2414788957 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98013040 con 0x56453594de40 2024-05-14T15:22:44.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.607+0000 7f2f8b400700 1 -- 172.21.15.69:0/2414788957 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f98008600 con 0x56453594de40 2024-05-14T15:22:44.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.607+0000 7f2f8b400700 1 -- 172.21.15.69:0/2414788957 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9801a480 con 0x56453594de40 2024-05-14T15:22:44.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.608+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/2414788957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56453594de40 msgr2=0x564535ad1540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.608+0000 7f2f9e800700 1 --2- 172.21.15.69:0/2877699202 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2f840b2b90 0x7f2f840b50a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2f9801d000 tx=0x7f2f9801a000 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.608+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/2414788957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56453594de40 0x564535ad1540 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f2f98008cb0 tx=0x7f2f98015200 comp rx=0 tx=0).stop 2024-05-14T15:22:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.608+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/2414788957 shutdown_connections 2024-05-14T15:22:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.608+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/2414788957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56453594de40 0x564535ad1540 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.608+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/2414788957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564535acbc40 0x564535acc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.608+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/2414788957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535ad1a80 0x564535acb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.608+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/2414788957 >> 172.21.15.69:0/2414788957 conn(0x564535992f70 msgr2=0x564535ac6400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.608+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/2414788957 shutdown_connections 2024-05-14T15:22:44.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.608+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/2414788957 wait complete. 2024-05-14T15:22:44.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.609+0000 7f2fb3c5ab80 1 -- start start 2024-05-14T15:22:44.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.609+0000 7f2fb3c5ab80 1 Processor -- start 2024-05-14T15:22:44.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2fb3c5ab80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56453594de40 0x564535ad52b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2fb3c5ab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564535acbc40 0x564535ad57f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2fb3c5ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535ad1a80 0x564535ad5d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2fb3c5ab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564535ad8490 con 0x564535acbc40 2024-05-14T15:22:44.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2fb3c5ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564535953b20 con 0x564535ad1a80 2024-05-14T15:22:44.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2fb3c5ab80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564535ad8610 con 0x56453594de40 2024-05-14T15:22:44.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2fb3c5ab80 10 client.0 _ll_register_callbacks cb 0x564535994c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:44.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2f9d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564535acbc40 0x564535ad57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2f9d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564535acbc40 0x564535ad57f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34716/0 (socket says 172.21.15.69:34716) 2024-05-14T15:22:44.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2f9d400700 1 -- 172.21.15.69:0/4200481838 learned_addr learned my addr 172.21.15.69:0/4200481838 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:44.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2f9de00700 1 --2- 172.21.15.69:0/4200481838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56453594de40 0x564535ad52b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2f9e800700 1 --2- 172.21.15.69:0/4200481838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535ad1a80 0x564535ad5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2f9d400700 1 -- 172.21.15.69:0/4200481838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56453594de40 msgr2=0x564535ad52b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:44.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2f9d400700 1 --2- 172.21.15.69:0/4200481838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56453594de40 0x564535ad52b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2f9d400700 1 -- 172.21.15.69:0/4200481838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535ad1a80 msgr2=0x564535ad5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:44.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2f9d400700 1 --2- 172.21.15.69:0/4200481838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535ad1a80 0x564535ad5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.610+0000 7f2f9d400700 1 -- 172.21.15.69:0/4200481838 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5645359b3420 con 0x564535acbc40 2024-05-14T15:22:44.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.611+0000 7f2f9d400700 1 --2- 172.21.15.69:0/4200481838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564535acbc40 0x564535ad57f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0a7e80 tx=0x7f2f8c0ab220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed3e1673d9739f05 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:44.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.611+0000 7f2f7fe00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:44.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.611+0000 7f2f7fe00700 1 -- 172.21.15.69:0/4200481838 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c0a63a0 con 0x564535acbc40 2024-05-14T15:22:44.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.611+0000 7f2f7fe00700 1 -- 172.21.15.69:0/4200481838 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f2f8c00fa60 con 0x564535acbc40 2024-05-14T15:22:44.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.611+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/4200481838 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f98008600 con 0x564535acbc40 2024-05-14T15:22:44.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.611+0000 7f2f7fe00700 1 -- 172.21.15.69:0/4200481838 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2f8c0b3320 con 0x564535acbc40 2024-05-14T15:22:44.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.611+0000 7f2fb3c5ab80 10 client.15618 fetch_fsmap learned FSMap version 33 2024-05-14T15:22:44.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.611+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/4200481838 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564535ad8490 con 0x564535acbc40 2024-05-14T15:22:44.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.612+0000 7f2f7fe00700 1 -- 172.21.15.69:0/4200481838 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f98008600 con 0x564535acbc40 2024-05-14T15:22:44.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.612+0000 7f2f7fe00700 1 -- 172.21.15.69:0/4200481838 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f2f8c0e5040 con 0x564535acbc40 2024-05-14T15:22:44.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.612+0000 7f2fb3c5ab80 10 client.15618 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:22:44.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.612+0000 7f2fb3c5ab80 10 client.15618 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.i 2024-05-14T15:22:44.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.612+0000 7f2fb3c5ab80 20 client.15618 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:44.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.612+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/4200481838 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x564535ae56c0 0x564535ae7b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.612+0000 7f2fb3c5ab80 4 client.15618 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:22:44.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.612+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/4200481838 --> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564535a981c0 con 0x564535ae56c0 2024-05-14T15:22:44.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.613+0000 7f2f9de00700 1 --2- 172.21.15.69:0/4200481838 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x564535ae56c0 0x564535ae7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.614+0000 7f2f9de00700 1 --2- 172.21.15.69:0/4200481838 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x564535ae56c0 0x564535ae7b10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=861bcdf07e6dee20 server_cookie=9a5afb2eacd81276 in_seq=0 out_seq=0 2024-05-14T15:22:44.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.614+0000 7f2f7fe00700 10 client.15618 ms_handle_connect on v2:172.21.15.203:6838/3167469844 2024-05-14T15:22:44.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.617+0000 7f2f7fe00700 1 -- 172.21.15.69:0/4200481838 <== mds.4 v2:172.21.15.203:6838/3167469844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564535a981c0 con 0x564535ae56c0 2024-05-14T15:22:44.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.617+0000 7f2f7fe00700 10 client.15618 handle_command_reply: tid=0 2024-05-14T15:22:44.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.618+0000 7f2fb3c5ab80 1 client.15618 shutdown 2024-05-14T15:22:44.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.618+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/4200481838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564535acbc40 msgr2=0x564535ad57f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:44.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.618+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/4200481838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564535acbc40 0x564535ad57f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0a7e80 tx=0x7f2f8c0ab220 comp rx=0 tx=0).stop 2024-05-14T15:22:44.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.618+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/4200481838 shutdown_connections 2024-05-14T15:22:44.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.618+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/4200481838 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x564535ae56c0 0x564535ae7b10 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.618+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/4200481838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535ad1a80 0x564535ad5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.618+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/4200481838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56453594de40 0x564535ad52b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.618+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/4200481838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564535acbc40 0x564535ad57f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.618+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/4200481838 >> 172.21.15.69:0/4200481838 conn(0x564535992f70 msgr2=0x564535aca6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:44.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.618+0000 7f2f7fe00700 0 client.15618 ms_handle_reset on v2:172.21.15.203:6838/3167469844 2024-05-14T15:22:44.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.618+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/4200481838 shutdown_connections 2024-05-14T15:22:44.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.618+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/4200481838 wait complete. 2024-05-14T15:22:44.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.618+0000 7f2fb3c5ab80 20 client.15618 trim_cache size 0 max 16384 2024-05-14T15:22:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.635+0000 7f2fb3c5ab80 1 Processor -- start 2024-05-14T15:22:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.635+0000 7f2fb3c5ab80 1 -- start start 2024-05-14T15:22:44.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.636+0000 7f2fb3c5ab80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56453594de40 0x564535acb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.636+0000 7f2fb3c5ab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564535acbc40 0x564535ac09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.636+0000 7f2fb3c5ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535ad1a80 0x564535ad5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.636+0000 7f2fb3c5ab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa01b6a20 con 0x564535acbc40 2024-05-14T15:22:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.636+0000 7f2fb3c5ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa01b8650 con 0x564535ad1a80 2024-05-14T15:22:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.636+0000 7f2fb3c5ab80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa01b70f0 con 0x56453594de40 2024-05-14T15:22:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.636+0000 7f2f9d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564535acbc40 0x564535ac09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.636+0000 7f2f9d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564535acbc40 0x564535ac09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34728/0 (socket says 172.21.15.69:34728) 2024-05-14T15:22:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.636+0000 7f2f9d400700 1 -- 172.21.15.69:0/1189607329 learned_addr learned my addr 172.21.15.69:0/1189607329 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:44.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.637+0000 7f2f9de00700 1 --2- 172.21.15.69:0/1189607329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56453594de40 0x564535acb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.637+0000 7f2f9d400700 1 -- 172.21.15.69:0/1189607329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56453594de40 msgr2=0x564535acb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.637+0000 7f2f9d400700 1 --2- 172.21.15.69:0/1189607329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56453594de40 0x564535acb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.637+0000 7f2f9d400700 1 -- 172.21.15.69:0/1189607329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535ad1a80 msgr2=0x564535ad5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:44.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.637+0000 7f2f9e800700 1 --2- 172.21.15.69:0/1189607329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535ad1a80 0x564535ad5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.637+0000 7f2f9d400700 1 --2- 172.21.15.69:0/1189607329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535ad1a80 0x564535ad5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.637+0000 7f2f9d400700 1 -- 172.21.15.69:0/1189607329 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564535ac2c40 con 0x564535acbc40 2024-05-14T15:22:44.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.637+0000 7f2f9d400700 1 --2- 172.21.15.69:0/1189607329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564535acbc40 0x564535ac09b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0bffd0 tx=0x7f2f8c0095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc704f38f104e68d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:44.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.637+0000 7f2f8aa00700 1 -- 172.21.15.69:0/1189607329 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c0a63a0 con 0x564535acbc40 2024-05-14T15:22:44.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.638+0000 7f2f8aa00700 1 -- 172.21.15.69:0/1189607329 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f8c0e1000 con 0x564535acbc40 2024-05-14T15:22:44.639 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.638+0000 7f2f8aa00700 1 -- 172.21.15.69:0/1189607329 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f8c0b3a30 con 0x564535acbc40 2024-05-14T15:22:44.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.638+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/1189607329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564535acbc40 msgr2=0x564535ac09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:44.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.638+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/1189607329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564535acbc40 0x564535ac09b0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c0bffd0 tx=0x7f2f8c0095f0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.639+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/1189607329 shutdown_connections 2024-05-14T15:22:44.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.639+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/1189607329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535ad1a80 0x564535ad5820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.639+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/1189607329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56453594de40 0x564535acb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.639+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/1189607329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564535acbc40 0x564535ac09b0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.639+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/1189607329 >> 172.21.15.69:0/1189607329 conn(0x564535992f70 msgr2=0x564535ac02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:44.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.639+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/1189607329 shutdown_connections 2024-05-14T15:22:44.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.639+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/1189607329 wait complete. 2024-05-14T15:22:44.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.639+0000 7f2fb3c5ab80 1 -- start start 2024-05-14T15:22:44.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.640+0000 7f2fb3c5ab80 1 Processor -- start 2024-05-14T15:22:44.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.640+0000 7f2fb3c5ab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56453594de40 0x564535add8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.640+0000 7f2fb3c5ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535acbc40 0x564535adde10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.642 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.640+0000 7f2fb3c5ab80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564535ad1a80 0x564535aec2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.640+0000 7f2fb3c5ab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa01b7ec0 con 0x56453594de40 2024-05-14T15:22:44.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.640+0000 7f2fb3c5ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa01b77f0 con 0x564535acbc40 2024-05-14T15:22:44.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.640+0000 7f2fb3c5ab80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa01b49c0 con 0x564535ad1a80 2024-05-14T15:22:44.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.640+0000 7f2fb3c5ab80 10 client.0 _ll_register_callbacks cb 0x564535994c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:44.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.641+0000 7f2f9de00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56453594de40 0x564535add8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.641+0000 7f2f9de00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56453594de40 0x564535add8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34734/0 (socket says 172.21.15.69:34734) 2024-05-14T15:22:44.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.641+0000 7f2f9de00700 1 -- 172.21.15.69:0/3346992151 learned_addr learned my addr 172.21.15.69:0/3346992151 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:44.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.641+0000 7f2f9d400700 1 --2- 172.21.15.69:0/3346992151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535acbc40 0x564535adde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.641+0000 7f2f9e800700 1 --2- 172.21.15.69:0/3346992151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564535ad1a80 0x564535aec2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.641+0000 7f2f9de00700 1 -- 172.21.15.69:0/3346992151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564535ad1a80 msgr2=0x564535aec2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:44.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.641+0000 7f2f9de00700 1 --2- 172.21.15.69:0/3346992151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564535ad1a80 0x564535aec2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.641+0000 7f2f9de00700 1 -- 172.21.15.69:0/3346992151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535acbc40 msgr2=0x564535adde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:44.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.641+0000 7f2f9de00700 1 --2- 172.21.15.69:0/3346992151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535acbc40 0x564535adde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.643 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.641+0000 7f2f9de00700 1 -- 172.21.15.69:0/3346992151 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564535aec7e0 con 0x56453594de40 2024-05-14T15:22:44.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.641+0000 7f2f9e800700 1 --2- 172.21.15.69:0/3346992151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564535ad1a80 0x564535aec2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:22:44.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.642+0000 7f2f9d400700 1 --2- 172.21.15.69:0/3346992151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535acbc40 0x564535adde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:22:44.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.642+0000 7f2f9de00700 1 --2- 172.21.15.69:0/3346992151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56453594de40 0x564535add8d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2f90006fd0 tx=0x7f2f9001b140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=582292ac2b0e0c5e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:44.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.642+0000 7f2f7fe00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:44.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.642+0000 7f2f7fe00700 1 -- 172.21.15.69:0/3346992151 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f9001ba10 con 0x56453594de40 2024-05-14T15:22:44.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.642+0000 7f2f7fe00700 1 -- 172.21.15.69:0/3346992151 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f2f90024480 con 0x56453594de40 2024-05-14T15:22:44.644 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.642+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/3346992151 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f8c0e1000 con 0x56453594de40 2024-05-14T15:22:44.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.643+0000 7f2f7fe00700 1 -- 172.21.15.69:0/3346992151 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2f90024680 con 0x56453594de40 2024-05-14T15:22:44.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.643+0000 7f2fb3c5ab80 10 client.15624 fetch_fsmap learned FSMap version 33 2024-05-14T15:22:44.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.643+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/3346992151 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564535b4f4b0 con 0x56453594de40 2024-05-14T15:22:44.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.643+0000 7f2f7fe00700 1 -- 172.21.15.69:0/3346992151 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2f8c0e1000 con 0x56453594de40 2024-05-14T15:22:44.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.644+0000 7f2f7fe00700 1 -- 172.21.15.69:0/3346992151 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f2f9002e8b0 con 0x56453594de40 2024-05-14T15:22:44.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.644+0000 7f2fb3c5ab80 10 client.15624 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:22:44.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.644+0000 7f2fb3c5ab80 10 client.15624 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.i 2024-05-14T15:22:44.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.644+0000 7f2fb3c5ab80 20 client.15624 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:44.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.644+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/3346992151 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x564535b4fba0 0x564535b51fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:44.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.644+0000 7f2fb3c5ab80 4 client.15624 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:22:44.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.644+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/3346992151 --> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5645359fb400 con 0x564535b4fba0 2024-05-14T15:22:44.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.645+0000 7f2f9d400700 1 --2- 172.21.15.69:0/3346992151 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x564535b4fba0 0x564535b51fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:44.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.646+0000 7f2f9d400700 1 --2- 172.21.15.69:0/3346992151 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x564535b4fba0 0x564535b51fc0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=84dd22da90c4367d server_cookie=ada016b31be6e807 in_seq=0 out_seq=0 2024-05-14T15:22:44.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.646+0000 7f2f7fe00700 10 client.15624 ms_handle_connect on v2:172.21.15.203:6838/3167469844 2024-05-14T15:22:44.646 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.647+0000 7f2f7fe00700 1 -- 172.21.15.69:0/3346992151 <== mds.4 v2:172.21.15.203:6838/3167469844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5645359fb400 con 0x564535b4fba0 2024-05-14T15:22:44.647 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.647+0000 7f2f7fe00700 10 client.15624 handle_command_reply: tid=0 2024-05-14T15:22:44.647 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.647+0000 7f2fb3c5ab80 1 client.15624 shutdown 2024-05-14T15:22:44.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.647+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/3346992151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56453594de40 msgr2=0x564535add8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:44.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.647+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/3346992151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56453594de40 0x564535add8d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f2f90006fd0 tx=0x7f2f9001b140 comp rx=0 tx=0).stop 2024-05-14T15:22:44.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.647+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/3346992151 shutdown_connections 2024-05-14T15:22:44.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.647+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/3346992151 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x564535b4fba0 0x564535b51fc0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.647+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/3346992151 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56453594de40 0x564535add8d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.647+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/3346992151 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564535ad1a80 0x564535aec2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.647+0000 7f2fb3c5ab80 1 --2- 172.21.15.69:0/3346992151 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564535acbc40 0x564535adde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.647+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/3346992151 >> 172.21.15.69:0/3346992151 conn(0x564535992f70 msgr2=0x564535acee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:44.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.647+0000 7f2f7fe00700 0 client.15624 ms_handle_reset on v2:172.21.15.203:6838/3167469844 2024-05-14T15:22:44.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.647+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/3346992151 shutdown_connections 2024-05-14T15:22:44.649 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.647+0000 7f2fb3c5ab80 1 -- 172.21.15.69:0/3346992151 wait complete. 2024-05-14T15:22:44.649 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.647+0000 7f2fb3c5ab80 20 client.15624 trim_cache size 0 max 16384 2024-05-14T15:22:44.649 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:22:44.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.648+0000 7f2f9f200700 1 -- 172.21.15.69:0/2877699202 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2f840b2b90 msgr2=0x7f2f840b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:44.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.648+0000 7f2f9f200700 1 --2- 172.21.15.69:0/2877699202 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2f840b2b90 0x7f2f840b50a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2f9801d000 tx=0x7f2f9801a000 comp rx=0 tx=0).stop 2024-05-14T15:22:44.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.648+0000 7f2f9f200700 1 -- 172.21.15.69:0/2877699202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa010b110 msgr2=0x7f2fa01a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:44.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.648+0000 7f2f9f200700 1 --2- 172.21.15.69:0/2877699202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa010b110 0x7f2fa01a17e0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c005910 tx=0x7f2f8c009f90 comp rx=0 tx=0).stop 2024-05-14T15:22:44.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.648+0000 7f2f9f200700 1 -- 172.21.15.69:0/2877699202 shutdown_connections 2024-05-14T15:22:44.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.648+0000 7f2f9f200700 1 --2- 172.21.15.69:0/2877699202 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2f840b2b90 0x7f2f840b50a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.648+0000 7f2f9f200700 1 --2- 172.21.15.69:0/2877699202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2fa010f6c0 0x7f2fa01a5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.648+0000 7f2f9f200700 1 --2- 172.21.15.69:0/2877699202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2fa010a7c0 0x7f2fa01a1240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.648+0000 7f2f9f200700 1 --2- 172.21.15.69:0/2877699202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2fa010b110 0x7f2fa01a17e0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:44.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.648+0000 7f2f9f200700 1 -- 172.21.15.69:0/2877699202 >> 172.21.15.69:0/2877699202 conn(0x7f2fa0076b00 msgr2=0x7f2fa0108980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:44.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.649+0000 7f2f9f200700 1 -- 172.21.15.69:0/2877699202 shutdown_connections 2024-05-14T15:22:44.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:44.649+0000 7f2f9f200700 1 -- 172.21.15.69:0/2877699202 wait complete. 2024-05-14T15:22:45.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:45 smithi092 ceph-mon[34729]: pgmap v36: 129 pgs: 129 active+clean; 46 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2024-05-14T15:22:45.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:45 smithi069 ceph-mon[31270]: pgmap v36: 129 pgs: 129 active+clean; 46 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2024-05-14T15:22:45.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:45 smithi203 ceph-mon[34567]: pgmap v36: 129 pgs: 129 active+clean; 46 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 400 KiB/s rd, 1.2 MiB/s wr, 180 op/s 2024-05-14T15:22:45.694 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-14T15:22:46.168 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:22:47.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:47 smithi092 ceph-mon[34729]: pgmap v37: 129 pgs: 129 active+clean; 46 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 391 KiB/s wr, 160 op/s 2024-05-14T15:22:47.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:47 smithi069 ceph-mon[31270]: pgmap v37: 129 pgs: 129 active+clean; 46 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 391 KiB/s wr, 160 op/s 2024-05-14T15:22:47.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:47 smithi203 ceph-mon[34567]: pgmap v37: 129 pgs: 129 active+clean; 46 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 391 KiB/s wr, 160 op/s 2024-05-14T15:22:48.063 INFO:teuthology.orchestra.run.smithi069.stderr: * Initialized, logs are in /var/lib/pgsql/initdb_postgresql.log 2024-05-14T15:22:48.071 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-05-14T15:22:48.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.743+0000 7f95e6a00700 1 -- 172.21.15.69:0/616502236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e0108740 msgr2=0x7f95e01100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:48.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.743+0000 7f95e6a00700 1 --2- 172.21.15.69:0/616502236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e0108740 0x7f95e01100a0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f95d800b0d0 tx=0x7f95d800b3e0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.744+0000 7f95e6a00700 1 -- 172.21.15.69:0/616502236 shutdown_connections 2024-05-14T15:22:48.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.744+0000 7f95e6a00700 1 --2- 172.21.15.69:0/616502236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e0108740 0x7f95e01100a0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.744+0000 7f95e6a00700 1 --2- 172.21.15.69:0/616502236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95e01034c0 0x7f95e01038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.744+0000 7f95e6a00700 1 --2- 172.21.15.69:0/616502236 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e0107df0 0x7f95e0108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.744+0000 7f95e6a00700 1 -- 172.21.15.69:0/616502236 >> 172.21.15.69:0/616502236 conn(0x7f95e00fedc0 msgr2=0x7f95e01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:48.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.744+0000 7f95e6a00700 1 -- 172.21.15.69:0/616502236 shutdown_connections 2024-05-14T15:22:48.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.744+0000 7f95e6a00700 1 -- 172.21.15.69:0/616502236 wait complete. 2024-05-14T15:22:48.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.745+0000 7f95e6a00700 1 Processor -- start 2024-05-14T15:22:48.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.745+0000 7f95e6a00700 1 -- start start 2024-05-14T15:22:48.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.746+0000 7f95e6a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e01034c0 0x7f95e019ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.746+0000 7f95e6a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e0107df0 0x7f95e019b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.746+0000 7f95e6a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95e0108740 0x7f95e019f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.746+0000 7f95e6a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f95e0113270 con 0x7f95e0107df0 2024-05-14T15:22:48.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.746+0000 7f95e6a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95e01130f0 con 0x7f95e0108740 2024-05-14T15:22:48.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.746+0000 7f95e6a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f95e01133f0 con 0x7f95e01034c0 2024-05-14T15:22:48.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.746+0000 7f95dfe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e01034c0 0x7f95e019ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.746+0000 7f95e4a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95e0108740 0x7f95e019f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.746+0000 7f95df400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e0107df0 0x7f95e019b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.746+0000 7f95dfe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e01034c0 0x7f95e019ad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:55128/0 (socket says 172.21.15.69:55128) 2024-05-14T15:22:48.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.746+0000 7f95dfe00700 1 -- 172.21.15.69:0/3006310563 learned_addr learned my addr 172.21.15.69:0/3006310563 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:48.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.747+0000 7f95df400700 1 -- 172.21.15.69:0/3006310563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e01034c0 msgr2=0x7f95e019ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:48.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.747+0000 7f95df400700 1 --2- 172.21.15.69:0/3006310563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e01034c0 0x7f95e019ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.747+0000 7f95df400700 1 -- 172.21.15.69:0/3006310563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95e0108740 msgr2=0x7f95e019f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:48.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.747+0000 7f95df400700 1 --2- 172.21.15.69:0/3006310563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95e0108740 0x7f95e019f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.747+0000 7f95df400700 1 -- 172.21.15.69:0/3006310563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95e019fb90 con 0x7f95e0107df0 2024-05-14T15:22:48.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.748+0000 7f95df400700 1 --2- 172.21.15.69:0/3006310563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e0107df0 0x7f95e019b310 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c940 tx=0x7f95cc00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:48.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.748+0000 7f95dcc00700 1 -- 172.21.15.69:0/3006310563 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc014070 con 0x7f95e0107df0 2024-05-14T15:22:48.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.748+0000 7f95e6a00700 1 -- 172.21.15.69:0/3006310563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95e019fe80 con 0x7f95e0107df0 2024-05-14T15:22:48.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.748+0000 7f95dcc00700 1 -- 172.21.15.69:0/3006310563 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95cc004440 con 0x7f95e0107df0 2024-05-14T15:22:48.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.748+0000 7f95dcc00700 1 -- 172.21.15.69:0/3006310563 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc0079e0 con 0x7f95e0107df0 2024-05-14T15:22:48.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.748+0000 7f95e6a00700 1 -- 172.21.15.69:0/3006310563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95e01a7850 con 0x7f95e0107df0 2024-05-14T15:22:48.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.753+0000 7f95dcc00700 1 -- 172.21.15.69:0/3006310563 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 149885+0+0 (secure 0 0 0) 0x7f95cc017070 con 0x7f95e0107df0 2024-05-14T15:22:48.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.754+0000 7f95f555bb80 1 Processor -- start 2024-05-14T15:22:48.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.754+0000 7f95f555bb80 1 -- start start 2024-05-14T15:22:48.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.754+0000 7f95f555bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be942d9e40 0x55be9445bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.754+0000 7f95f555bb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be9445c0a0 0x55be94460260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.754+0000 7f95f555bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be944607a0 0x55be94460bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.754+0000 7f95f555bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55be94379a20 con 0x55be944607a0 2024-05-14T15:22:48.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.754+0000 7f95f555bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55be94317760 con 0x55be942d9e40 2024-05-14T15:22:48.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.754+0000 7f95f555bb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55be943759e0 con 0x55be9445c0a0 2024-05-14T15:22:48.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.755+0000 7f95dcc00700 1 --2- 172.21.15.69:0/3006310563 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f95c40b2b90 0x7f95c40b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.755+0000 7f95df400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be944607a0 0x55be94460bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.755+0000 7f95dcc00700 1 -- 172.21.15.69:0/3006310563 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f95cc0e2790 con 0x7f95e0107df0 2024-05-14T15:22:48.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.755+0000 7f95e4a00700 1 --2- 172.21.15.69:0/3006310563 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f95c40b2b90 0x7f95c40b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.755+0000 7f95dfe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be9445c0a0 0x55be94460260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.755+0000 7f95e4a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be942d9e40 0x55be9445bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.755+0000 7f95dfe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be9445c0a0 0x55be94460260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:55136/0 (socket says 172.21.15.69:55136) 2024-05-14T15:22:48.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.755+0000 7f95dfe00700 1 -- 172.21.15.69:0/3206644201 learned_addr learned my addr 172.21.15.69:0/3206644201 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:48.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.756+0000 7f95dfe00700 1 -- 172.21.15.69:0/3206644201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be942d9e40 msgr2=0x55be9445bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:48.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.756+0000 7f95dfe00700 1 --2- 172.21.15.69:0/3206644201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be942d9e40 0x55be9445bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.756+0000 7f95dfe00700 1 -- 172.21.15.69:0/3206644201 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be944607a0 msgr2=0x55be94460bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:48.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.756+0000 7f95dfe00700 1 --2- 172.21.15.69:0/3206644201 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be944607a0 0x55be94460bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.756+0000 7f95dfe00700 1 -- 172.21.15.69:0/3206644201 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be942c68d0 con 0x55be9445c0a0 2024-05-14T15:22:48.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.756+0000 7f95df400700 1 --2- 172.21.15.69:0/3206644201 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be944607a0 0x55be94460bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:22:48.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.756+0000 7f95e4a00700 1 --2- 172.21.15.69:0/3006310563 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f95c40b2b90 0x7f95c40b50a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009900 tx=0x7f95d80090d0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:48.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.756+0000 7f95dfe00700 1 --2- 172.21.15.69:0/3206644201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be9445c0a0 0x55be94460260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f95d000be20 tx=0x7f95d00106b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=84a7ccdb36579beb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:48.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.757+0000 7f95d5600700 1 -- 172.21.15.69:0/3206644201 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d0010d90 con 0x55be9445c0a0 2024-05-14T15:22:48.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.757+0000 7f95d5600700 1 -- 172.21.15.69:0/3206644201 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95d00118d0 con 0x55be9445c0a0 2024-05-14T15:22:48.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.758+0000 7f95d5600700 1 -- 172.21.15.69:0/3206644201 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d0019770 con 0x55be9445c0a0 2024-05-14T15:22:48.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.759+0000 7f95f555bb80 1 -- 172.21.15.69:0/3206644201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be9445c0a0 msgr2=0x55be94460260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:48.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.759+0000 7f95f555bb80 1 --2- 172.21.15.69:0/3206644201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be9445c0a0 0x55be94460260 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f95d000be20 tx=0x7f95d00106b0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.759+0000 7f95f555bb80 1 -- 172.21.15.69:0/3206644201 shutdown_connections 2024-05-14T15:22:48.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.759+0000 7f95f555bb80 1 --2- 172.21.15.69:0/3206644201 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be944607a0 0x55be94460bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.759+0000 7f95f555bb80 1 --2- 172.21.15.69:0/3206644201 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be942d9e40 0x55be9445bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.759+0000 7f95f555bb80 1 --2- 172.21.15.69:0/3206644201 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be9445c0a0 0x55be94460260 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.759+0000 7f95f555bb80 1 -- 172.21.15.69:0/3206644201 >> 172.21.15.69:0/3206644201 conn(0x55be9431ef70 msgr2=0x55be944522d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:48.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.759+0000 7f95f555bb80 1 -- 172.21.15.69:0/3206644201 shutdown_connections 2024-05-14T15:22:48.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.759+0000 7f95f555bb80 1 -- 172.21.15.69:0/3206644201 wait complete. 2024-05-14T15:22:48.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.760+0000 7f95f555bb80 1 -- start start 2024-05-14T15:22:48.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.760+0000 7f95f555bb80 1 Processor -- start 2024-05-14T15:22:48.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.761+0000 7f95f555bb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be942d9e40 0x55be94465420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.761+0000 7f95f555bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be9445c0a0 0x55be94465960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.761+0000 7f95f555bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be944607a0 0x55be94465ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.761+0000 7f95f555bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55be944686f0 con 0x55be9445c0a0 2024-05-14T15:22:48.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.761+0000 7f95f555bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55be942dfb20 con 0x55be944607a0 2024-05-14T15:22:48.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.761+0000 7f95f555bb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55be94468870 con 0x55be942d9e40 2024-05-14T15:22:48.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.761+0000 7f95f555bb80 10 client.0 _ll_register_callbacks cb 0x55be94320c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:48.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.761+0000 7f95df400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be9445c0a0 0x55be94465960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.761+0000 7f95df400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be9445c0a0 0x55be94465960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34768/0 (socket says 172.21.15.69:34768) 2024-05-14T15:22:48.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.761+0000 7f95df400700 1 -- 172.21.15.69:0/2153604635 learned_addr learned my addr 172.21.15.69:0/2153604635 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:48.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.761+0000 7f95dfe00700 1 --2- 172.21.15.69:0/2153604635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be942d9e40 0x55be94465420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.761+0000 7f95e4a00700 1 --2- 172.21.15.69:0/2153604635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be944607a0 0x55be94465ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.762+0000 7f95df400700 1 -- 172.21.15.69:0/2153604635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be942d9e40 msgr2=0x55be94465420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:48.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.762+0000 7f95df400700 1 --2- 172.21.15.69:0/2153604635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be942d9e40 0x55be94465420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.762+0000 7f95df400700 1 -- 172.21.15.69:0/2153604635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be944607a0 msgr2=0x55be94465ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:48.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.762+0000 7f95df400700 1 --2- 172.21.15.69:0/2153604635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be944607a0 0x55be94465ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.762+0000 7f95df400700 1 -- 172.21.15.69:0/2153604635 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be9433f420 con 0x55be9445c0a0 2024-05-14T15:22:48.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.762+0000 7f95dfe00700 1 --2- 172.21.15.69:0/2153604635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be942d9e40 0x55be94465420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:22:48.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.762+0000 7f95df400700 1 --2- 172.21.15.69:0/2153604635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be9445c0a0 0x55be94465960 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f95cc000c00 tx=0x7f95cc015620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5374780f391bff2f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:48.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.762+0000 7f95ca000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:48.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.762+0000 7f95ca000700 1 -- 172.21.15.69:0/2153604635 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc0a9b10 con 0x55be9445c0a0 2024-05-14T15:22:48.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.763+0000 7f95ca000700 1 -- 172.21.15.69:0/2153604635 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f95cc0943f0 con 0x55be9445c0a0 2024-05-14T15:22:48.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.763+0000 7f95f555bb80 1 -- 172.21.15.69:0/2153604635 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95d00118d0 con 0x55be9445c0a0 2024-05-14T15:22:48.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.763+0000 7f95ca000700 1 -- 172.21.15.69:0/2153604635 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f95cc0a9410 con 0x55be9445c0a0 2024-05-14T15:22:48.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.763+0000 7f95f555bb80 10 client.15636 fetch_fsmap learned FSMap version 33 2024-05-14T15:22:48.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.763+0000 7f95f555bb80 1 -- 172.21.15.69:0/2153604635 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55be944732c0 con 0x55be9445c0a0 2024-05-14T15:22:48.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.764+0000 7f95ca000700 1 -- 172.21.15.69:0/2153604635 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95d00118d0 con 0x55be9445c0a0 2024-05-14T15:22:48.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.764+0000 7f95ca000700 1 -- 172.21.15.69:0/2153604635 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f95cc0e2300 con 0x55be9445c0a0 2024-05-14T15:22:48.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.764+0000 7f95f555bb80 10 client.15636 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:22:48.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.764+0000 7f95f555bb80 10 client.15636 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-05-14T15:22:48.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.764+0000 7f95f555bb80 20 client.15636 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:48.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.764+0000 7f95f555bb80 1 --2- 172.21.15.69:0/2153604635 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55be944758f0 0x55be94477d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.764+0000 7f95f555bb80 4 client.15636 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:22:48.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.764+0000 7f95f555bb80 1 -- 172.21.15.69:0/2153604635 --> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55be944241c0 con 0x55be944758f0 2024-05-14T15:22:48.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.765+0000 7f95dfe00700 1 --2- 172.21.15.69:0/2153604635 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55be944758f0 0x55be94477d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.766+0000 7f95dfe00700 1 --2- 172.21.15.69:0/2153604635 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55be944758f0 0x55be94477d10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=b72bdb45e3e4fd50 server_cookie=72b4b17f9f114b42 in_seq=0 out_seq=0 2024-05-14T15:22:48.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.766+0000 7f95ca000700 10 client.15636 ms_handle_connect on v2:172.21.15.92:6832/1997000798 2024-05-14T15:22:48.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.768+0000 7f95ca000700 1 -- 172.21.15.69:0/2153604635 <== mds.3 v2:172.21.15.92:6832/1997000798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55be944241c0 con 0x55be944758f0 2024-05-14T15:22:48.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.768+0000 7f95ca000700 10 client.15636 handle_command_reply: tid=0 2024-05-14T15:22:48.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.768+0000 7f95f555bb80 1 client.15636 shutdown 2024-05-14T15:22:48.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.768+0000 7f95f555bb80 1 -- 172.21.15.69:0/2153604635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be9445c0a0 msgr2=0x55be94465960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:48.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.768+0000 7f95f555bb80 1 --2- 172.21.15.69:0/2153604635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be9445c0a0 0x55be94465960 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f95cc000c00 tx=0x7f95cc015620 comp rx=0 tx=0).stop 2024-05-14T15:22:48.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.768+0000 7f95f555bb80 1 -- 172.21.15.69:0/2153604635 shutdown_connections 2024-05-14T15:22:48.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.768+0000 7f95f555bb80 1 --2- 172.21.15.69:0/2153604635 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55be944758f0 0x55be94477d10 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.768+0000 7f95f555bb80 1 --2- 172.21.15.69:0/2153604635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be944607a0 0x55be94465ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.768+0000 7f95f555bb80 1 --2- 172.21.15.69:0/2153604635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be942d9e40 0x55be94465420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.768+0000 7f95f555bb80 1 --2- 172.21.15.69:0/2153604635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be9445c0a0 0x55be94465960 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.768+0000 7f95f555bb80 1 -- 172.21.15.69:0/2153604635 >> 172.21.15.69:0/2153604635 conn(0x55be9431ef70 msgr2=0x55be944564a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:48.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.768+0000 7f95ca000700 0 client.15636 ms_handle_reset on v2:172.21.15.92:6832/1997000798 2024-05-14T15:22:48.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.768+0000 7f95f555bb80 1 -- 172.21.15.69:0/2153604635 shutdown_connections 2024-05-14T15:22:48.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.768+0000 7f95f555bb80 1 -- 172.21.15.69:0/2153604635 wait complete. 2024-05-14T15:22:48.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.769+0000 7f95f555bb80 20 client.15636 trim_cache size 0 max 16384 2024-05-14T15:22:48.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.785+0000 7f95f555bb80 1 Processor -- start 2024-05-14T15:22:48.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.785+0000 7f95f555bb80 1 -- start start 2024-05-14T15:22:48.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.786+0000 7f95f555bb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be942d9e40 0x55be94464740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.786+0000 7f95f555bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be9445c0a0 0x55be94465ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.786+0000 7f95f555bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be944607a0 0x55be94461bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.786+0000 7f95f555bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f95e01ae470 con 0x55be9445c0a0 2024-05-14T15:22:48.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.786+0000 7f95f555bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95e01b00a0 con 0x55be944607a0 2024-05-14T15:22:48.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.786+0000 7f95f555bb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f95e01aeb40 con 0x55be942d9e40 2024-05-14T15:22:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.786+0000 7f95df400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be9445c0a0 0x55be94465ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.786+0000 7f95df400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be9445c0a0 0x55be94465ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34772/0 (socket says 172.21.15.69:34772) 2024-05-14T15:22:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.786+0000 7f95df400700 1 -- 172.21.15.69:0/2443025465 learned_addr learned my addr 172.21.15.69:0/2443025465 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:48.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.786+0000 7f95dfe00700 1 --2- 172.21.15.69:0/2443025465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be942d9e40 0x55be94464740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.786+0000 7f95e4a00700 1 --2- 172.21.15.69:0/2443025465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be944607a0 0x55be94461bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.787+0000 7f95df400700 1 -- 172.21.15.69:0/2443025465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be942d9e40 msgr2=0x55be94464740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.787+0000 7f95df400700 1 --2- 172.21.15.69:0/2443025465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be942d9e40 0x55be94464740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.787+0000 7f95df400700 1 -- 172.21.15.69:0/2443025465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be944607a0 msgr2=0x55be94461bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.787+0000 7f95df400700 1 --2- 172.21.15.69:0/2443025465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be944607a0 0x55be94461bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.787+0000 7f95df400700 1 -- 172.21.15.69:0/2443025465 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55be9445c850 con 0x55be9445c0a0 2024-05-14T15:22:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.787+0000 7f95e4a00700 1 --2- 172.21.15.69:0/2443025465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be944607a0 0x55be94461bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:22:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.787+0000 7f95df400700 1 --2- 172.21.15.69:0/2443025465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be9445c0a0 0x55be94465ce0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0046c0 tx=0x7f95cc007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2716d46a7b4c91ae server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.787+0000 7f95d4c00700 1 -- 172.21.15.69:0/2443025465 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc0ad7c0 con 0x55be9445c0a0 2024-05-14T15:22:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.787+0000 7f95d4c00700 1 -- 172.21.15.69:0/2443025465 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95cc0b2270 con 0x55be9445c0a0 2024-05-14T15:22:48.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.787+0000 7f95d4c00700 1 -- 172.21.15.69:0/2443025465 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95cc0a98d0 con 0x55be9445c0a0 2024-05-14T15:22:48.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.788+0000 7f95f555bb80 1 -- 172.21.15.69:0/2443025465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be9445c0a0 msgr2=0x55be94465ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:48.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.788+0000 7f95f555bb80 1 --2- 172.21.15.69:0/2443025465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be9445c0a0 0x55be94465ce0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0046c0 tx=0x7f95cc007340 comp rx=0 tx=0).stop 2024-05-14T15:22:48.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.788+0000 7f95f555bb80 1 -- 172.21.15.69:0/2443025465 shutdown_connections 2024-05-14T15:22:48.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.788+0000 7f95f555bb80 1 --2- 172.21.15.69:0/2443025465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be944607a0 0x55be94461bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.788+0000 7f95f555bb80 1 --2- 172.21.15.69:0/2443025465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be942d9e40 0x55be94464740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.788+0000 7f95f555bb80 1 --2- 172.21.15.69:0/2443025465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be9445c0a0 0x55be94465ce0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.788+0000 7f95f555bb80 1 -- 172.21.15.69:0/2443025465 >> 172.21.15.69:0/2443025465 conn(0x55be9431ef70 msgr2=0x55be94460030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:48.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.788+0000 7f95f555bb80 1 -- 172.21.15.69:0/2443025465 shutdown_connections 2024-05-14T15:22:48.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.788+0000 7f95f555bb80 1 -- 172.21.15.69:0/2443025465 wait complete. 2024-05-14T15:22:48.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.789+0000 7f95f555bb80 1 -- start start 2024-05-14T15:22:48.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.789+0000 7f95f555bb80 1 Processor -- start 2024-05-14T15:22:48.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.790+0000 7f95f555bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be942d9e40 0x55be9447da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.790+0000 7f95f555bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be9445c0a0 0x55be9446db00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.790+0000 7f95f555bb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be944607a0 0x55be9446e040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.790+0000 7f95f555bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f95e01af910 con 0x55be942d9e40 2024-05-14T15:22:48.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.790+0000 7f95f555bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95e01af240 con 0x55be9445c0a0 2024-05-14T15:22:48.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.790+0000 7f95f555bb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f95e01ac410 con 0x55be944607a0 2024-05-14T15:22:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.790+0000 7f95dfe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be942d9e40 0x55be9447da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.790+0000 7f95f555bb80 10 client.0 _ll_register_callbacks cb 0x55be94320c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.790+0000 7f95dfe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be942d9e40 0x55be9447da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34788/0 (socket says 172.21.15.69:34788) 2024-05-14T15:22:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.790+0000 7f95dfe00700 1 -- 172.21.15.69:0/71986573 learned_addr learned my addr 172.21.15.69:0/71986573 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.791+0000 7f95df400700 1 --2- 172.21.15.69:0/71986573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be9445c0a0 0x55be9446db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.791+0000 7f95dfe00700 1 -- 172.21.15.69:0/71986573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be944607a0 msgr2=0x55be9446e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.791+0000 7f95dfe00700 1 --2- 172.21.15.69:0/71986573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be944607a0 0x55be9446e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.791+0000 7f95dfe00700 1 -- 172.21.15.69:0/71986573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be9445c0a0 msgr2=0x55be9446db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.791+0000 7f95dfe00700 1 --2- 172.21.15.69:0/71986573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be9445c0a0 0x55be9446db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.791+0000 7f95dfe00700 1 -- 172.21.15.69:0/71986573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55be9447c490 con 0x55be942d9e40 2024-05-14T15:22:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.791+0000 7f95dfe00700 1 --2- 172.21.15.69:0/71986573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be942d9e40 0x55be9447da40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f95d0000c00 tx=0x7f95d0005e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96d7bce70009360b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:48.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.791+0000 7f95ca000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.791+0000 7f95ca000700 1 -- 172.21.15.69:0/71986573 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95d0005390 con 0x55be942d9e40 2024-05-14T15:22:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.791+0000 7f95ca000700 1 -- 172.21.15.69:0/71986573 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f95d0005530 con 0x55be942d9e40 2024-05-14T15:22:48.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.791+0000 7f95f555bb80 1 -- 172.21.15.69:0/71986573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95cc0b2270 con 0x55be942d9e40 2024-05-14T15:22:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.792+0000 7f95ca000700 1 -- 172.21.15.69:0/71986573 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f95d0037050 con 0x55be942d9e40 2024-05-14T15:22:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.792+0000 7f95f555bb80 10 client.15642 fetch_fsmap learned FSMap version 33 2024-05-14T15:22:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.792+0000 7f95f555bb80 1 -- 172.21.15.69:0/71986573 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55be944df230 con 0x55be942d9e40 2024-05-14T15:22:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.792+0000 7f95ca000700 1 -- 172.21.15.69:0/71986573 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95cc0b2270 con 0x55be942d9e40 2024-05-14T15:22:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.792+0000 7f95ca000700 1 -- 172.21.15.69:0/71986573 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f95d00115c0 con 0x55be942d9e40 2024-05-14T15:22:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.792+0000 7f95f555bb80 10 client.15642 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:22:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.792+0000 7f95f555bb80 10 client.15642 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-05-14T15:22:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.792+0000 7f95f555bb80 20 client.15642 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.793+0000 7f95f555bb80 1 --2- 172.21.15.69:0/71986573 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55be944df7a0 0x55be944e1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.793+0000 7f95f555bb80 4 client.15642 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:22:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.793+0000 7f95f555bb80 1 -- 172.21.15.69:0/71986573 --> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55be94387400 con 0x55be944df7a0 2024-05-14T15:22:48.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.793+0000 7f95df400700 1 --2- 172.21.15.69:0/71986573 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55be944df7a0 0x55be944e1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:48.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.794+0000 7f95df400700 1 --2- 172.21.15.69:0/71986573 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55be944df7a0 0x55be944e1bc0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=3f73ffdb33760c56 server_cookie=ea32a7a61e722a59 in_seq=0 out_seq=0 2024-05-14T15:22:48.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.794+0000 7f95ca000700 10 client.15642 ms_handle_connect on v2:172.21.15.92:6832/1997000798 2024-05-14T15:22:48.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.795+0000 7f95ca000700 1 -- 172.21.15.69:0/71986573 <== mds.3 v2:172.21.15.92:6832/1997000798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55be94387400 con 0x55be944df7a0 2024-05-14T15:22:48.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.795+0000 7f95ca000700 10 client.15642 handle_command_reply: tid=0 2024-05-14T15:22:48.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.795+0000 7f95f555bb80 1 client.15642 shutdown 2024-05-14T15:22:48.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.795+0000 7f95f555bb80 1 -- 172.21.15.69:0/71986573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be942d9e40 msgr2=0x55be9447da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:48.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.795+0000 7f95f555bb80 1 --2- 172.21.15.69:0/71986573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be942d9e40 0x55be9447da40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f95d0000c00 tx=0x7f95d0005e70 comp rx=0 tx=0).stop 2024-05-14T15:22:48.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.795+0000 7f95f555bb80 1 -- 172.21.15.69:0/71986573 shutdown_connections 2024-05-14T15:22:48.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.795+0000 7f95f555bb80 1 --2- 172.21.15.69:0/71986573 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55be944df7a0 0x55be944e1bc0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.795+0000 7f95f555bb80 1 --2- 172.21.15.69:0/71986573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55be942d9e40 0x55be9447da40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.795+0000 7f95f555bb80 1 --2- 172.21.15.69:0/71986573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55be944607a0 0x55be9446e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.795+0000 7f95f555bb80 1 --2- 172.21.15.69:0/71986573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55be9445c0a0 0x55be9446db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.795+0000 7f95ca000700 0 client.15642 ms_handle_reset on v2:172.21.15.92:6832/1997000798 2024-05-14T15:22:48.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.795+0000 7f95f555bb80 1 -- 172.21.15.69:0/71986573 >> 172.21.15.69:0/71986573 conn(0x55be9431ef70 msgr2=0x55be94460030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:48.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.796+0000 7f95f555bb80 1 -- 172.21.15.69:0/71986573 shutdown_connections 2024-05-14T15:22:48.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.796+0000 7f95f555bb80 1 -- 172.21.15.69:0/71986573 wait complete. 2024-05-14T15:22:48.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.796+0000 7f95f555bb80 20 client.15642 trim_cache size 0 max 16384 2024-05-14T15:22:48.797 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:22:48.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.797+0000 7f95e6a00700 1 -- 172.21.15.69:0/3006310563 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f95c40b2b90 msgr2=0x7f95c40b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:48.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.797+0000 7f95e6a00700 1 --2- 172.21.15.69:0/3006310563 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f95c40b2b90 0x7f95c40b50a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f95d8009900 tx=0x7f95d80090d0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.797+0000 7f95e6a00700 1 -- 172.21.15.69:0/3006310563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e0107df0 msgr2=0x7f95e019b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:48.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.797+0000 7f95e6a00700 1 --2- 172.21.15.69:0/3006310563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e0107df0 0x7f95e019b310 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f95cc00c940 tx=0x7f95cc00cc50 comp rx=0 tx=0).stop 2024-05-14T15:22:48.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.797+0000 7f95e6a00700 1 -- 172.21.15.69:0/3006310563 shutdown_connections 2024-05-14T15:22:48.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.797+0000 7f95e6a00700 1 --2- 172.21.15.69:0/3006310563 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f95c40b2b90 0x7f95c40b50a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.797+0000 7f95e6a00700 1 --2- 172.21.15.69:0/3006310563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95e0108740 0x7f95e019f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.797+0000 7f95e6a00700 1 --2- 172.21.15.69:0/3006310563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95e01034c0 0x7f95e019ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.797+0000 7f95e6a00700 1 --2- 172.21.15.69:0/3006310563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95e0107df0 0x7f95e019b310 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:48.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.797+0000 7f95e6a00700 1 -- 172.21.15.69:0/3006310563 >> 172.21.15.69:0/3006310563 conn(0x7f95e00fedc0 msgr2=0x7f95e006b9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:48.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.798+0000 7f95e6a00700 1 -- 172.21.15.69:0/3006310563 shutdown_connections 2024-05-14T15:22:48.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:48.798+0000 7f95e6a00700 1 -- 172.21.15.69:0/3006310563 wait complete. 2024-05-14T15:22:49.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:49 smithi092 ceph-mon[34729]: pgmap v38: 129 pgs: 129 active+clean; 46 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 375 KiB/s wr, 159 op/s 2024-05-14T15:22:49.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:49 smithi069 ceph-mon[31270]: pgmap v38: 129 pgs: 129 active+clean; 46 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 375 KiB/s wr, 159 op/s 2024-05-14T15:22:49.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:49 smithi203 ceph-mon[34567]: pgmap v38: 129 pgs: 129 active+clean; 46 MiB data, 537 MiB used, 1.0 TiB / 1.0 TiB avail; 291 KiB/s rd, 375 KiB/s wr, 159 op/s 2024-05-14T15:22:49.768 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/: 2024-05-14T15:22:49.768 INFO:teuthology.orchestra.run.smithi069.stdout:total 2 2024-05-14T15:22:49.768 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:21 . 2024-05-14T15:22:49.768 INFO:teuthology.orchestra.run.smithi069.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:21 .. 2024-05-14T15:22:49.768 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 data 2024-05-14T15:22:49.768 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:49.768 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data: 2024-05-14T15:22:49.768 INFO:teuthology.orchestra.run.smithi069.stdout:total 45 2024-05-14T15:22:49.768 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 . 2024-05-14T15:22:49.769 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:21 .. 2024-05-14T15:22:49.769 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 May 14 15:22 base 2024-05-14T15:22:49.769 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 549376 May 14 15:22 global 2024-05-14T15:22:49.769 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 log 2024-05-14T15:22:49.769 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_commit_ts 2024-05-14T15:22:49.769 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_dynshmem 2024-05-14T15:22:49.769 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 May 14 15:22 pg_hba.conf 2024-05-14T15:22:49.769 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 May 14 15:22 pg_ident.conf 2024-05-14T15:22:49.769 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 15:22 pg_logical 2024-05-14T15:22:49.769 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 pg_multixact 2024-05-14T15:22:49.769 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_notify 2024-05-14T15:22:49.769 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_replslot 2024-05-14T15:22:49.769 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_serial 2024-05-14T15:22:49.770 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_snapshots 2024-05-14T15:22:49.770 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_stat 2024-05-14T15:22:49.770 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_stat_tmp 2024-05-14T15:22:49.770 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 pg_subtrans 2024-05-14T15:22:49.770 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_tblspc 2024-05-14T15:22:49.770 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_twophase 2024-05-14T15:22:49.770 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 14 15:22 PG_VERSION 2024-05-14T15:22:49.770 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:22 pg_wal 2024-05-14T15:22:49.770 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 pg_xact 2024-05-14T15:22:49.770 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 May 14 15:22 postgresql.auto.conf 2024-05-14T15:22:49.770 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28082 May 14 15:22 postgresql.conf 2024-05-14T15:22:49.770 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:49.770 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/base: 2024-05-14T15:22:49.771 INFO:teuthology.orchestra.run.smithi069.stdout:total 3 2024-05-14T15:22:49.771 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 May 14 15:22 . 2024-05-14T15:22:49.771 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:49.771 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 15:22 1 2024-05-14T15:22:49.771 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 15:22 13493 2024-05-14T15:22:49.771 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 15:22 13494 2024-05-14T15:22:49.771 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:49.771 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/base/1: 2024-05-14T15:22:49.771 INFO:teuthology.orchestra.run.smithi069.stdout:total 7778 2024-05-14T15:22:49.771 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 15:22 . 2024-05-14T15:22:49.771 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 May 14 15:22 .. 2024-05-14T15:22:49.771 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 112 2024-05-14T15:22:49.771 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 113 2024-05-14T15:22:49.772 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 15:22 1247 2024-05-14T15:22:49.772 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1247_fsm 2024-05-14T15:22:49.772 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1247_vm 2024-05-14T15:22:49.772 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 14 15:22 1249 2024-05-14T15:22:49.772 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1249_fsm 2024-05-14T15:22:49.772 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1249_vm 2024-05-14T15:22:49.772 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 14 15:22 1255 2024-05-14T15:22:49.772 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1255_fsm 2024-05-14T15:22:49.772 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1255_vm 2024-05-14T15:22:49.772 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 14 15:22 1259 2024-05-14T15:22:49.772 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1259_fsm 2024-05-14T15:22:49.772 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1259_vm 2024-05-14T15:22:49.772 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 14 15:22 13344 2024-05-14T15:22:49.772 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13344_fsm 2024-05-14T15:22:49.773 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13344_vm 2024-05-14T15:22:49.773 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13346 2024-05-14T15:22:49.773 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13348 2024-05-14T15:22:49.773 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13349 2024-05-14T15:22:49.773 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13349_fsm 2024-05-14T15:22:49.773 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13349_vm 2024-05-14T15:22:49.773 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13351 2024-05-14T15:22:49.773 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13353 2024-05-14T15:22:49.773 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13354 2024-05-14T15:22:49.773 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13354_fsm 2024-05-14T15:22:49.773 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13354_vm 2024-05-14T15:22:49.773 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13356 2024-05-14T15:22:49.773 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13358 2024-05-14T15:22:49.773 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13359 2024-05-14T15:22:49.773 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13359_fsm 2024-05-14T15:22:49.773 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13359_vm 2024-05-14T15:22:49.774 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13361 2024-05-14T15:22:49.774 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13363 2024-05-14T15:22:49.774 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 1417 2024-05-14T15:22:49.774 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 1418 2024-05-14T15:22:49.774 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 174 2024-05-14T15:22:49.774 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 175 2024-05-14T15:22:49.774 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2187 2024-05-14T15:22:49.774 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2224 2024-05-14T15:22:49.774 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2328 2024-05-14T15:22:49.774 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2336 2024-05-14T15:22:49.774 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2337 2024-05-14T15:22:49.774 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2579 2024-05-14T15:22:49.774 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2600 2024-05-14T15:22:49.774 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2600_fsm 2024-05-14T15:22:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2600_vm 2024-05-14T15:22:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2601 2024-05-14T15:22:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2601_fsm 2024-05-14T15:22:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2601_vm 2024-05-14T15:22:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2602 2024-05-14T15:22:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2602_fsm 2024-05-14T15:22:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2602_vm 2024-05-14T15:22:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2603 2024-05-14T15:22:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2603_fsm 2024-05-14T15:22:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2603_vm 2024-05-14T15:22:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2604 2024-05-14T15:22:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2605 2024-05-14T15:22:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2605_fsm 2024-05-14T15:22:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2605_vm 2024-05-14T15:22:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2606 2024-05-14T15:22:49.775 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2606_fsm 2024-05-14T15:22:49.776 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2606_vm 2024-05-14T15:22:49.776 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2607 2024-05-14T15:22:49.776 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2607_fsm 2024-05-14T15:22:49.776 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2607_vm 2024-05-14T15:22:49.776 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 14 15:22 2608 2024-05-14T15:22:49.776 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2608_fsm 2024-05-14T15:22:49.776 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2608_vm 2024-05-14T15:22:49.776 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 14 15:22 2609 2024-05-14T15:22:49.776 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2609_fsm 2024-05-14T15:22:49.776 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2609_vm 2024-05-14T15:22:49.776 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2610 2024-05-14T15:22:49.776 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2610_fsm 2024-05-14T15:22:49.776 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2610_vm 2024-05-14T15:22:49.776 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2611 2024-05-14T15:22:49.776 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2612 2024-05-14T15:22:49.777 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2612_fsm 2024-05-14T15:22:49.777 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2612_vm 2024-05-14T15:22:49.777 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2613 2024-05-14T15:22:49.777 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2615 2024-05-14T15:22:49.777 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2615_fsm 2024-05-14T15:22:49.777 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2615_vm 2024-05-14T15:22:49.777 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2616 2024-05-14T15:22:49.777 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2616_fsm 2024-05-14T15:22:49.777 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2616_vm 2024-05-14T15:22:49.777 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 14 15:22 2617 2024-05-14T15:22:49.777 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2617_fsm 2024-05-14T15:22:49.777 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2617_vm 2024-05-14T15:22:49.777 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 14 15:22 2618 2024-05-14T15:22:49.777 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2618_fsm 2024-05-14T15:22:49.777 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2618_vm 2024-05-14T15:22:49.778 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 14 15:22 2619 2024-05-14T15:22:49.778 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2619_fsm 2024-05-14T15:22:49.778 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2619_vm 2024-05-14T15:22:49.778 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2620 2024-05-14T15:22:49.778 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2650 2024-05-14T15:22:49.778 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2651 2024-05-14T15:22:49.778 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2652 2024-05-14T15:22:49.778 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2653 2024-05-14T15:22:49.778 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2654 2024-05-14T15:22:49.778 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2655 2024-05-14T15:22:49.778 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2656 2024-05-14T15:22:49.778 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2657 2024-05-14T15:22:49.778 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 14 15:22 2658 2024-05-14T15:22:49.778 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 15:22 2659 2024-05-14T15:22:49.779 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2660 2024-05-14T15:22:49.779 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2661 2024-05-14T15:22:49.779 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2662 2024-05-14T15:22:49.779 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2663 2024-05-14T15:22:49.779 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2664 2024-05-14T15:22:49.779 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2665 2024-05-14T15:22:49.779 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2666 2024-05-14T15:22:49.779 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2667 2024-05-14T15:22:49.779 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2668 2024-05-14T15:22:49.779 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2669 2024-05-14T15:22:49.779 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2670 2024-05-14T15:22:49.779 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 14 15:22 2673 2024-05-14T15:22:49.779 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 14 15:22 2674 2024-05-14T15:22:49.779 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 14 15:22 2675 2024-05-14T15:22:49.779 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2678 2024-05-14T15:22:49.780 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2679 2024-05-14T15:22:49.780 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2680 2024-05-14T15:22:49.780 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2681 2024-05-14T15:22:49.780 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2682 2024-05-14T15:22:49.780 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2683 2024-05-14T15:22:49.780 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2684 2024-05-14T15:22:49.780 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2685 2024-05-14T15:22:49.780 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2686 2024-05-14T15:22:49.780 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2687 2024-05-14T15:22:49.780 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2688 2024-05-14T15:22:49.780 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2689 2024-05-14T15:22:49.780 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 14 15:22 2690 2024-05-14T15:22:49.780 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 14 15:22 2691 2024-05-14T15:22:49.780 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2692 2024-05-14T15:22:49.780 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2693 2024-05-14T15:22:49.781 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2696 2024-05-14T15:22:49.781 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2699 2024-05-14T15:22:49.781 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2701 2024-05-14T15:22:49.781 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2702 2024-05-14T15:22:49.781 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2703 2024-05-14T15:22:49.781 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2704 2024-05-14T15:22:49.781 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2753 2024-05-14T15:22:49.781 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2753_fsm 2024-05-14T15:22:49.781 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2753_vm 2024-05-14T15:22:49.781 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2754 2024-05-14T15:22:49.781 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2755 2024-05-14T15:22:49.781 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2756 2024-05-14T15:22:49.781 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2757 2024-05-14T15:22:49.781 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2830 2024-05-14T15:22:49.781 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2831 2024-05-14T15:22:49.782 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2832 2024-05-14T15:22:49.782 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2833 2024-05-14T15:22:49.782 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2834 2024-05-14T15:22:49.782 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2835 2024-05-14T15:22:49.782 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2836 2024-05-14T15:22:49.782 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2837 2024-05-14T15:22:49.782 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 14 15:22 2838 2024-05-14T15:22:49.782 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2838_fsm 2024-05-14T15:22:49.782 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2838_vm 2024-05-14T15:22:49.782 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2839 2024-05-14T15:22:49.782 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2840 2024-05-14T15:22:49.782 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2840_fsm 2024-05-14T15:22:49.782 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2840_vm 2024-05-14T15:22:49.782 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2841 2024-05-14T15:22:49.782 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2995 2024-05-14T15:22:49.783 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2996 2024-05-14T15:22:49.783 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3079 2024-05-14T15:22:49.783 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3079_fsm 2024-05-14T15:22:49.783 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3079_vm 2024-05-14T15:22:49.783 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3080 2024-05-14T15:22:49.783 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3081 2024-05-14T15:22:49.783 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 3085 2024-05-14T15:22:49.783 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3118 2024-05-14T15:22:49.783 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3119 2024-05-14T15:22:49.783 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 14 15:22 3164 2024-05-14T15:22:49.783 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3256 2024-05-14T15:22:49.783 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3257 2024-05-14T15:22:49.783 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3258 2024-05-14T15:22:49.783 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3350 2024-05-14T15:22:49.783 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3351 2024-05-14T15:22:49.783 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3379 2024-05-14T15:22:49.784 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3380 2024-05-14T15:22:49.784 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3381 2024-05-14T15:22:49.784 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3394 2024-05-14T15:22:49.784 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3394_fsm 2024-05-14T15:22:49.784 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3394_vm 2024-05-14T15:22:49.784 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3395 2024-05-14T15:22:49.784 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3429 2024-05-14T15:22:49.784 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3430 2024-05-14T15:22:49.784 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3431 2024-05-14T15:22:49.784 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3433 2024-05-14T15:22:49.784 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3439 2024-05-14T15:22:49.784 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3440 2024-05-14T15:22:49.784 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 3455 2024-05-14T15:22:49.784 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 14 15:22 3456 2024-05-14T15:22:49.785 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3456_fsm 2024-05-14T15:22:49.785 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3456_vm 2024-05-14T15:22:49.785 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3466 2024-05-14T15:22:49.785 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3467 2024-05-14T15:22:49.785 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3468 2024-05-14T15:22:49.785 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3501 2024-05-14T15:22:49.785 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3502 2024-05-14T15:22:49.785 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3503 2024-05-14T15:22:49.785 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3534 2024-05-14T15:22:49.785 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3541 2024-05-14T15:22:49.785 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3541_fsm 2024-05-14T15:22:49.785 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3541_vm 2024-05-14T15:22:49.785 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3542 2024-05-14T15:22:49.785 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3574 2024-05-14T15:22:49.785 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3575 2024-05-14T15:22:49.785 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3576 2024-05-14T15:22:49.786 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3596 2024-05-14T15:22:49.786 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3597 2024-05-14T15:22:49.786 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3598 2024-05-14T15:22:49.786 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3599 2024-05-14T15:22:49.786 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3600 2024-05-14T15:22:49.786 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3600_fsm 2024-05-14T15:22:49.786 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3600_vm 2024-05-14T15:22:49.786 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3601 2024-05-14T15:22:49.786 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3601_fsm 2024-05-14T15:22:49.786 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3601_vm 2024-05-14T15:22:49.786 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3602 2024-05-14T15:22:49.786 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3602_fsm 2024-05-14T15:22:49.786 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3602_vm 2024-05-14T15:22:49.786 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3603 2024-05-14T15:22:49.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3603_fsm 2024-05-14T15:22:49.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3603_vm 2024-05-14T15:22:49.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3604 2024-05-14T15:22:49.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3605 2024-05-14T15:22:49.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3606 2024-05-14T15:22:49.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3607 2024-05-14T15:22:49.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3608 2024-05-14T15:22:49.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 3609 2024-05-14T15:22:49.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3712 2024-05-14T15:22:49.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3764 2024-05-14T15:22:49.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3764_fsm 2024-05-14T15:22:49.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3764_vm 2024-05-14T15:22:49.787 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3766 2024-05-14T15:22:49.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3767 2024-05-14T15:22:49.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3997 2024-05-14T15:22:49.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4143 2024-05-14T15:22:49.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4144 2024-05-14T15:22:49.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4145 2024-05-14T15:22:49.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4146 2024-05-14T15:22:49.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4147 2024-05-14T15:22:49.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4148 2024-05-14T15:22:49.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4149 2024-05-14T15:22:49.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4150 2024-05-14T15:22:49.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4151 2024-05-14T15:22:49.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4152 2024-05-14T15:22:49.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4153 2024-05-14T15:22:49.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4154 2024-05-14T15:22:49.788 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4155 2024-05-14T15:22:49.789 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4156 2024-05-14T15:22:49.789 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4157 2024-05-14T15:22:49.789 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4158 2024-05-14T15:22:49.873 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-14T15:22:50.375 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:22:50.927 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4159 2024-05-14T15:22:50.928 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4160 2024-05-14T15:22:50.928 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4161 2024-05-14T15:22:50.928 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4162 2024-05-14T15:22:50.928 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4163 2024-05-14T15:22:50.928 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4164 2024-05-14T15:22:50.928 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4165 2024-05-14T15:22:50.928 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4166 2024-05-14T15:22:50.928 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4167 2024-05-14T15:22:50.928 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4168 2024-05-14T15:22:50.928 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4169 2024-05-14T15:22:50.928 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4170 2024-05-14T15:22:50.928 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4171 2024-05-14T15:22:50.929 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4172 2024-05-14T15:22:50.929 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4173 2024-05-14T15:22:50.929 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4174 2024-05-14T15:22:50.929 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 5002 2024-05-14T15:22:50.929 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 548 2024-05-14T15:22:50.929 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 549 2024-05-14T15:22:50.929 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6102 2024-05-14T15:22:50.929 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6104 2024-05-14T15:22:50.929 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6106 2024-05-14T15:22:50.929 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6110 2024-05-14T15:22:50.929 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6111 2024-05-14T15:22:50.929 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6112 2024-05-14T15:22:50.929 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6113 2024-05-14T15:22:50.929 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6117 2024-05-14T15:22:50.930 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 826 2024-05-14T15:22:50.930 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 827 2024-05-14T15:22:50.930 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 828 2024-05-14T15:22:50.930 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 14 15:22 pg_filenode.map 2024-05-14T15:22:50.930 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 14 15:22 PG_VERSION 2024-05-14T15:22:50.930 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:50.930 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-05-14T15:22:50.930 INFO:teuthology.orchestra.run.smithi069.stdout:total 7778 2024-05-14T15:22:50.930 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 15:22 . 2024-05-14T15:22:50.930 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 May 14 15:22 .. 2024-05-14T15:22:50.930 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 112 2024-05-14T15:22:50.930 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 113 2024-05-14T15:22:50.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 15:22 1247 2024-05-14T15:22:50.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1247_fsm 2024-05-14T15:22:50.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1247_vm 2024-05-14T15:22:50.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 14 15:22 1249 2024-05-14T15:22:50.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1249_fsm 2024-05-14T15:22:50.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1249_vm 2024-05-14T15:22:50.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 14 15:22 1255 2024-05-14T15:22:50.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1255_fsm 2024-05-14T15:22:50.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1255_vm 2024-05-14T15:22:50.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 14 15:22 1259 2024-05-14T15:22:50.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1259_fsm 2024-05-14T15:22:50.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1259_vm 2024-05-14T15:22:50.931 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 14 15:22 13344 2024-05-14T15:22:50.932 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13344_fsm 2024-05-14T15:22:50.932 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13344_vm 2024-05-14T15:22:50.932 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13346 2024-05-14T15:22:50.932 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13348 2024-05-14T15:22:50.932 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13349 2024-05-14T15:22:50.932 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13349_fsm 2024-05-14T15:22:50.932 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13349_vm 2024-05-14T15:22:50.932 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13351 2024-05-14T15:22:50.932 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13353 2024-05-14T15:22:50.932 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13354 2024-05-14T15:22:50.932 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13354_fsm 2024-05-14T15:22:50.932 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13354_vm 2024-05-14T15:22:50.932 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13356 2024-05-14T15:22:50.932 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13358 2024-05-14T15:22:50.932 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13359 2024-05-14T15:22:50.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13359_fsm 2024-05-14T15:22:50.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13359_vm 2024-05-14T15:22:50.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13361 2024-05-14T15:22:50.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13363 2024-05-14T15:22:50.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 1417 2024-05-14T15:22:50.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 1418 2024-05-14T15:22:50.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 174 2024-05-14T15:22:50.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 175 2024-05-14T15:22:50.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2187 2024-05-14T15:22:50.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2224 2024-05-14T15:22:50.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2328 2024-05-14T15:22:50.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2336 2024-05-14T15:22:50.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2337 2024-05-14T15:22:50.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2579 2024-05-14T15:22:50.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2600 2024-05-14T15:22:50.933 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2600_fsm 2024-05-14T15:22:50.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2600_vm 2024-05-14T15:22:50.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2601 2024-05-14T15:22:50.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2601_fsm 2024-05-14T15:22:50.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2601_vm 2024-05-14T15:22:50.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2602 2024-05-14T15:22:50.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2602_fsm 2024-05-14T15:22:50.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2602_vm 2024-05-14T15:22:50.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2603 2024-05-14T15:22:50.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2603_fsm 2024-05-14T15:22:50.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2603_vm 2024-05-14T15:22:50.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2604 2024-05-14T15:22:50.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2605 2024-05-14T15:22:50.934 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2605_fsm 2024-05-14T15:22:50.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2605_vm 2024-05-14T15:22:50.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2606 2024-05-14T15:22:50.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2606_fsm 2024-05-14T15:22:50.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2606_vm 2024-05-14T15:22:50.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2607 2024-05-14T15:22:50.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2607_fsm 2024-05-14T15:22:50.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2607_vm 2024-05-14T15:22:50.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 14 15:22 2608 2024-05-14T15:22:50.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2608_fsm 2024-05-14T15:22:50.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2608_vm 2024-05-14T15:22:50.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 14 15:22 2609 2024-05-14T15:22:50.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2609_fsm 2024-05-14T15:22:50.935 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2609_vm 2024-05-14T15:22:50.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2610 2024-05-14T15:22:50.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2610_fsm 2024-05-14T15:22:50.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2610_vm 2024-05-14T15:22:50.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2611 2024-05-14T15:22:50.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2612 2024-05-14T15:22:50.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2612_fsm 2024-05-14T15:22:50.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2612_vm 2024-05-14T15:22:50.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2613 2024-05-14T15:22:50.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2615 2024-05-14T15:22:50.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2615_fsm 2024-05-14T15:22:50.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2615_vm 2024-05-14T15:22:50.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2616 2024-05-14T15:22:50.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2616_fsm 2024-05-14T15:22:50.936 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2616_vm 2024-05-14T15:22:50.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 14 15:22 2617 2024-05-14T15:22:50.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2617_fsm 2024-05-14T15:22:50.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2617_vm 2024-05-14T15:22:50.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 14 15:22 2618 2024-05-14T15:22:50.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2618_fsm 2024-05-14T15:22:50.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2618_vm 2024-05-14T15:22:50.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 14 15:22 2619 2024-05-14T15:22:50.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2619_fsm 2024-05-14T15:22:50.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2619_vm 2024-05-14T15:22:50.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2620 2024-05-14T15:22:50.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2650 2024-05-14T15:22:50.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2651 2024-05-14T15:22:50.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2652 2024-05-14T15:22:50.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2653 2024-05-14T15:22:50.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2654 2024-05-14T15:22:50.937 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2655 2024-05-14T15:22:50.938 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2656 2024-05-14T15:22:50.938 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2657 2024-05-14T15:22:50.938 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 14 15:22 2658 2024-05-14T15:22:50.938 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 15:22 2659 2024-05-14T15:22:50.938 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2660 2024-05-14T15:22:50.938 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2661 2024-05-14T15:22:50.938 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2662 2024-05-14T15:22:50.938 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2663 2024-05-14T15:22:50.938 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2664 2024-05-14T15:22:50.938 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2665 2024-05-14T15:22:50.938 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2666 2024-05-14T15:22:50.938 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2667 2024-05-14T15:22:50.938 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2668 2024-05-14T15:22:50.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2669 2024-05-14T15:22:50.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2670 2024-05-14T15:22:50.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 14 15:22 2673 2024-05-14T15:22:50.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 14 15:22 2674 2024-05-14T15:22:50.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 14 15:22 2675 2024-05-14T15:22:50.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2678 2024-05-14T15:22:50.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2679 2024-05-14T15:22:50.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2680 2024-05-14T15:22:50.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2681 2024-05-14T15:22:50.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2682 2024-05-14T15:22:50.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2683 2024-05-14T15:22:50.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2684 2024-05-14T15:22:50.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2685 2024-05-14T15:22:50.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2686 2024-05-14T15:22:50.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2687 2024-05-14T15:22:50.939 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2688 2024-05-14T15:22:50.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2689 2024-05-14T15:22:50.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 14 15:22 2690 2024-05-14T15:22:50.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 14 15:22 2691 2024-05-14T15:22:50.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2692 2024-05-14T15:22:50.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2693 2024-05-14T15:22:50.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2696 2024-05-14T15:22:50.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2699 2024-05-14T15:22:50.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2701 2024-05-14T15:22:50.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2702 2024-05-14T15:22:50.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2703 2024-05-14T15:22:50.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2704 2024-05-14T15:22:50.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2753 2024-05-14T15:22:50.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2753_fsm 2024-05-14T15:22:50.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2753_vm 2024-05-14T15:22:50.940 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2754 2024-05-14T15:22:50.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2755 2024-05-14T15:22:50.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2756 2024-05-14T15:22:50.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2757 2024-05-14T15:22:50.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2830 2024-05-14T15:22:50.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2831 2024-05-14T15:22:50.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2832 2024-05-14T15:22:50.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2833 2024-05-14T15:22:50.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2834 2024-05-14T15:22:50.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2835 2024-05-14T15:22:50.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2836 2024-05-14T15:22:50.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2837 2024-05-14T15:22:50.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 14 15:22 2838 2024-05-14T15:22:50.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2838_fsm 2024-05-14T15:22:50.941 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2838_vm 2024-05-14T15:22:50.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2839 2024-05-14T15:22:50.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2840 2024-05-14T15:22:50.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2840_fsm 2024-05-14T15:22:50.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2840_vm 2024-05-14T15:22:50.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2841 2024-05-14T15:22:50.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2995 2024-05-14T15:22:50.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2996 2024-05-14T15:22:50.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3079 2024-05-14T15:22:50.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3079_fsm 2024-05-14T15:22:50.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3079_vm 2024-05-14T15:22:50.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3080 2024-05-14T15:22:50.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3081 2024-05-14T15:22:50.942 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 3085 2024-05-14T15:22:50.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3118 2024-05-14T15:22:50.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3119 2024-05-14T15:22:50.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 14 15:22 3164 2024-05-14T15:22:50.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3256 2024-05-14T15:22:50.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3257 2024-05-14T15:22:50.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3258 2024-05-14T15:22:50.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3350 2024-05-14T15:22:50.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3351 2024-05-14T15:22:50.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3379 2024-05-14T15:22:50.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3380 2024-05-14T15:22:50.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3381 2024-05-14T15:22:50.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3394 2024-05-14T15:22:50.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3394_fsm 2024-05-14T15:22:50.943 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3394_vm 2024-05-14T15:22:50.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3395 2024-05-14T15:22:50.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3429 2024-05-14T15:22:50.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3430 2024-05-14T15:22:50.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3431 2024-05-14T15:22:50.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3433 2024-05-14T15:22:50.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3439 2024-05-14T15:22:50.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3440 2024-05-14T15:22:50.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 3455 2024-05-14T15:22:50.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 14 15:22 3456 2024-05-14T15:22:50.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3456_fsm 2024-05-14T15:22:50.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3456_vm 2024-05-14T15:22:50.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3466 2024-05-14T15:22:50.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3467 2024-05-14T15:22:50.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3468 2024-05-14T15:22:50.944 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3501 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3502 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3503 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3534 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3541 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3541_fsm 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3541_vm 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3542 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3574 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3575 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3576 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3596 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3597 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3598 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3599 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3600 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3600_fsm 2024-05-14T15:22:50.945 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3600_vm 2024-05-14T15:22:50.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3601 2024-05-14T15:22:50.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3601_fsm 2024-05-14T15:22:50.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3601_vm 2024-05-14T15:22:50.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3602 2024-05-14T15:22:50.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3602_fsm 2024-05-14T15:22:50.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3602_vm 2024-05-14T15:22:50.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3603 2024-05-14T15:22:50.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3603_fsm 2024-05-14T15:22:50.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3603_vm 2024-05-14T15:22:50.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3604 2024-05-14T15:22:50.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3605 2024-05-14T15:22:50.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3606 2024-05-14T15:22:50.946 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3607 2024-05-14T15:22:50.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3608 2024-05-14T15:22:50.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 3609 2024-05-14T15:22:50.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3712 2024-05-14T15:22:50.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3764 2024-05-14T15:22:50.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3764_fsm 2024-05-14T15:22:50.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3764_vm 2024-05-14T15:22:50.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3766 2024-05-14T15:22:50.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3767 2024-05-14T15:22:50.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3997 2024-05-14T15:22:50.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4143 2024-05-14T15:22:50.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4144 2024-05-14T15:22:50.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4145 2024-05-14T15:22:50.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4146 2024-05-14T15:22:50.947 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4147 2024-05-14T15:22:50.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4148 2024-05-14T15:22:50.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4149 2024-05-14T15:22:50.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4150 2024-05-14T15:22:50.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4151 2024-05-14T15:22:50.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4152 2024-05-14T15:22:50.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4153 2024-05-14T15:22:50.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4154 2024-05-14T15:22:50.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4155 2024-05-14T15:22:50.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4156 2024-05-14T15:22:50.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4157 2024-05-14T15:22:50.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4158 2024-05-14T15:22:50.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4159 2024-05-14T15:22:50.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4160 2024-05-14T15:22:50.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4161 2024-05-14T15:22:50.948 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4162 2024-05-14T15:22:51.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:51 smithi092 ceph-mon[34729]: pgmap v39: 129 pgs: 129 active+clean; 48 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 547 KiB/s wr, 208 op/s 2024-05-14T15:22:51.468 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:51 smithi069 ceph-mon[31270]: pgmap v39: 129 pgs: 129 active+clean; 48 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 547 KiB/s wr, 208 op/s 2024-05-14T15:22:51.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:51 smithi203 ceph-mon[34567]: pgmap v39: 129 pgs: 129 active+clean; 48 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 478 KiB/s rd, 547 KiB/s wr, 208 op/s 2024-05-14T15:22:52.382 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4163 2024-05-14T15:22:52.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4164 2024-05-14T15:22:52.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4165 2024-05-14T15:22:52.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4166 2024-05-14T15:22:52.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4167 2024-05-14T15:22:52.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4168 2024-05-14T15:22:52.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4169 2024-05-14T15:22:52.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4170 2024-05-14T15:22:52.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4171 2024-05-14T15:22:52.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4172 2024-05-14T15:22:52.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4173 2024-05-14T15:22:52.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4174 2024-05-14T15:22:52.383 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 5002 2024-05-14T15:22:52.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 548 2024-05-14T15:22:52.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 549 2024-05-14T15:22:52.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6102 2024-05-14T15:22:52.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6104 2024-05-14T15:22:52.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6106 2024-05-14T15:22:52.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6110 2024-05-14T15:22:52.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6111 2024-05-14T15:22:52.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6112 2024-05-14T15:22:52.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6113 2024-05-14T15:22:52.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6117 2024-05-14T15:22:52.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 826 2024-05-14T15:22:52.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 827 2024-05-14T15:22:52.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 828 2024-05-14T15:22:52.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 14 15:22 pg_filenode.map 2024-05-14T15:22:52.384 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 14 15:22 PG_VERSION 2024-05-14T15:22:52.385 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.385 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-05-14T15:22:52.385 INFO:teuthology.orchestra.run.smithi069.stdout:total 7778 2024-05-14T15:22:52.385 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 15:22 . 2024-05-14T15:22:52.385 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 5 postgres postgres system_u:object_r:postgresql_db_t:s0 23889417 May 14 15:22 .. 2024-05-14T15:22:52.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 112 2024-05-14T15:22:52.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 113 2024-05-14T15:22:52.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 15:22 1247 2024-05-14T15:22:52.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1247_fsm 2024-05-14T15:22:52.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1247_vm 2024-05-14T15:22:52.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 14 15:22 1249 2024-05-14T15:22:52.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1249_fsm 2024-05-14T15:22:52.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1249_vm 2024-05-14T15:22:52.385 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 14 15:22 1255 2024-05-14T15:22:52.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1255_fsm 2024-05-14T15:22:52.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1255_vm 2024-05-14T15:22:52.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 14 15:22 1259 2024-05-14T15:22:52.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1259_fsm 2024-05-14T15:22:52.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1259_vm 2024-05-14T15:22:52.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 14 15:22 13344 2024-05-14T15:22:52.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13344_fsm 2024-05-14T15:22:52.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13344_vm 2024-05-14T15:22:52.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13346 2024-05-14T15:22:52.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13348 2024-05-14T15:22:52.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13349 2024-05-14T15:22:52.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13349_fsm 2024-05-14T15:22:52.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13349_vm 2024-05-14T15:22:52.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13351 2024-05-14T15:22:52.386 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13353 2024-05-14T15:22:52.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13354 2024-05-14T15:22:52.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13354_fsm 2024-05-14T15:22:52.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13354_vm 2024-05-14T15:22:52.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13356 2024-05-14T15:22:52.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13358 2024-05-14T15:22:52.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13359 2024-05-14T15:22:52.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13359_fsm 2024-05-14T15:22:52.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13359_vm 2024-05-14T15:22:52.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13361 2024-05-14T15:22:52.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13363 2024-05-14T15:22:52.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 1417 2024-05-14T15:22:52.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 1418 2024-05-14T15:22:52.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 174 2024-05-14T15:22:52.387 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 175 2024-05-14T15:22:52.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2187 2024-05-14T15:22:52.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2224 2024-05-14T15:22:52.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2328 2024-05-14T15:22:52.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2336 2024-05-14T15:22:52.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2337 2024-05-14T15:22:52.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2579 2024-05-14T15:22:52.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2600 2024-05-14T15:22:52.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2600_fsm 2024-05-14T15:22:52.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2600_vm 2024-05-14T15:22:52.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2601 2024-05-14T15:22:52.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2601_fsm 2024-05-14T15:22:52.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2601_vm 2024-05-14T15:22:52.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2602 2024-05-14T15:22:52.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2602_fsm 2024-05-14T15:22:52.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2602_vm 2024-05-14T15:22:52.388 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2603 2024-05-14T15:22:52.389 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2603_fsm 2024-05-14T15:22:52.389 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2603_vm 2024-05-14T15:22:52.389 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2604 2024-05-14T15:22:52.389 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2605 2024-05-14T15:22:52.389 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2605_fsm 2024-05-14T15:22:52.389 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2605_vm 2024-05-14T15:22:52.389 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2606 2024-05-14T15:22:52.389 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2606_fsm 2024-05-14T15:22:52.389 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2606_vm 2024-05-14T15:22:52.389 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2607 2024-05-14T15:22:52.389 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2607_fsm 2024-05-14T15:22:52.389 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2607_vm 2024-05-14T15:22:52.389 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 14 15:22 2608 2024-05-14T15:22:52.389 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2608_fsm 2024-05-14T15:22:52.390 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2608_vm 2024-05-14T15:22:52.390 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 14 15:22 2609 2024-05-14T15:22:52.390 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2609_fsm 2024-05-14T15:22:52.390 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2609_vm 2024-05-14T15:22:52.390 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2610 2024-05-14T15:22:52.390 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2610_fsm 2024-05-14T15:22:52.390 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2610_vm 2024-05-14T15:22:52.390 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2611 2024-05-14T15:22:52.390 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2612 2024-05-14T15:22:52.390 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2612_fsm 2024-05-14T15:22:52.390 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2612_vm 2024-05-14T15:22:52.390 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2613 2024-05-14T15:22:52.390 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2615 2024-05-14T15:22:52.390 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2615_fsm 2024-05-14T15:22:52.391 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2615_vm 2024-05-14T15:22:52.391 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2616 2024-05-14T15:22:52.391 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2616_fsm 2024-05-14T15:22:52.391 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2616_vm 2024-05-14T15:22:52.391 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 14 15:22 2617 2024-05-14T15:22:52.391 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2617_fsm 2024-05-14T15:22:52.391 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2617_vm 2024-05-14T15:22:52.391 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 14 15:22 2618 2024-05-14T15:22:52.391 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2618_fsm 2024-05-14T15:22:52.391 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2618_vm 2024-05-14T15:22:52.391 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 14 15:22 2619 2024-05-14T15:22:52.391 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2619_fsm 2024-05-14T15:22:52.391 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2619_vm 2024-05-14T15:22:52.391 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2620 2024-05-14T15:22:52.391 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2650 2024-05-14T15:22:52.392 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2651 2024-05-14T15:22:52.392 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2652 2024-05-14T15:22:52.392 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2653 2024-05-14T15:22:52.392 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2654 2024-05-14T15:22:52.392 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2655 2024-05-14T15:22:52.392 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2656 2024-05-14T15:22:52.392 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2657 2024-05-14T15:22:52.392 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 14 15:22 2658 2024-05-14T15:22:52.392 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 15:22 2659 2024-05-14T15:22:52.392 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2660 2024-05-14T15:22:52.392 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2661 2024-05-14T15:22:52.392 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2662 2024-05-14T15:22:52.392 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2663 2024-05-14T15:22:52.392 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2664 2024-05-14T15:22:52.392 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2665 2024-05-14T15:22:52.393 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2666 2024-05-14T15:22:52.393 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2667 2024-05-14T15:22:52.393 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2668 2024-05-14T15:22:52.393 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2669 2024-05-14T15:22:52.393 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2670 2024-05-14T15:22:52.393 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 14 15:22 2673 2024-05-14T15:22:52.393 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 14 15:22 2674 2024-05-14T15:22:52.393 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 14 15:22 2675 2024-05-14T15:22:52.393 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2678 2024-05-14T15:22:52.393 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2679 2024-05-14T15:22:52.393 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2680 2024-05-14T15:22:52.393 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2681 2024-05-14T15:22:52.393 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2682 2024-05-14T15:22:52.393 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2683 2024-05-14T15:22:52.393 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2684 2024-05-14T15:22:52.394 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2685 2024-05-14T15:22:52.394 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2686 2024-05-14T15:22:52.394 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2687 2024-05-14T15:22:52.394 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2688 2024-05-14T15:22:52.394 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2689 2024-05-14T15:22:52.394 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 14 15:22 2690 2024-05-14T15:22:52.394 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 14 15:22 2691 2024-05-14T15:22:52.394 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2692 2024-05-14T15:22:52.394 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2693 2024-05-14T15:22:52.394 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2696 2024-05-14T15:22:52.394 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2699 2024-05-14T15:22:52.394 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2701 2024-05-14T15:22:52.395 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2702 2024-05-14T15:22:52.395 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2703 2024-05-14T15:22:52.395 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2704 2024-05-14T15:22:52.395 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2753 2024-05-14T15:22:52.395 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2753_fsm 2024-05-14T15:22:52.395 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2753_vm 2024-05-14T15:22:52.395 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2754 2024-05-14T15:22:52.395 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2755 2024-05-14T15:22:52.395 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2756 2024-05-14T15:22:52.395 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2757 2024-05-14T15:22:52.395 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2830 2024-05-14T15:22:52.395 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2831 2024-05-14T15:22:52.395 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2832 2024-05-14T15:22:52.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2833 2024-05-14T15:22:52.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2834 2024-05-14T15:22:52.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2835 2024-05-14T15:22:52.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2836 2024-05-14T15:22:52.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2837 2024-05-14T15:22:52.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 14 15:22 2838 2024-05-14T15:22:52.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2838_fsm 2024-05-14T15:22:52.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2838_vm 2024-05-14T15:22:52.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2839 2024-05-14T15:22:52.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2840 2024-05-14T15:22:52.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2840_fsm 2024-05-14T15:22:52.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2840_vm 2024-05-14T15:22:52.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2841 2024-05-14T15:22:52.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2995 2024-05-14T15:22:52.396 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2996 2024-05-14T15:22:52.397 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3079 2024-05-14T15:22:52.397 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3079_fsm 2024-05-14T15:22:52.397 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3079_vm 2024-05-14T15:22:52.397 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3080 2024-05-14T15:22:52.397 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3081 2024-05-14T15:22:52.397 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 3085 2024-05-14T15:22:52.397 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3118 2024-05-14T15:22:52.397 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3119 2024-05-14T15:22:52.397 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 14 15:22 3164 2024-05-14T15:22:52.397 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3256 2024-05-14T15:22:52.397 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3257 2024-05-14T15:22:52.397 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3258 2024-05-14T15:22:52.397 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3350 2024-05-14T15:22:52.397 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3351 2024-05-14T15:22:52.398 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3379 2024-05-14T15:22:52.398 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3380 2024-05-14T15:22:52.398 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3381 2024-05-14T15:22:52.398 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3394 2024-05-14T15:22:52.398 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3394_fsm 2024-05-14T15:22:52.398 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3394_vm 2024-05-14T15:22:52.398 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3395 2024-05-14T15:22:52.398 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3429 2024-05-14T15:22:52.398 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3430 2024-05-14T15:22:52.398 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3431 2024-05-14T15:22:52.398 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3433 2024-05-14T15:22:52.398 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3439 2024-05-14T15:22:52.398 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3440 2024-05-14T15:22:52.398 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 3455 2024-05-14T15:22:52.399 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 14 15:22 3456 2024-05-14T15:22:52.399 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3456_fsm 2024-05-14T15:22:52.399 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3456_vm 2024-05-14T15:22:52.399 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3466 2024-05-14T15:22:52.399 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3467 2024-05-14T15:22:52.399 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3468 2024-05-14T15:22:52.399 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3501 2024-05-14T15:22:52.399 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3502 2024-05-14T15:22:52.399 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3503 2024-05-14T15:22:52.399 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3534 2024-05-14T15:22:52.399 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3541 2024-05-14T15:22:52.399 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3541_fsm 2024-05-14T15:22:52.399 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3541_vm 2024-05-14T15:22:52.399 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3542 2024-05-14T15:22:52.399 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3574 2024-05-14T15:22:52.400 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3575 2024-05-14T15:22:52.400 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3576 2024-05-14T15:22:52.400 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3596 2024-05-14T15:22:52.400 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3597 2024-05-14T15:22:52.400 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3598 2024-05-14T15:22:52.400 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3599 2024-05-14T15:22:52.400 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3600 2024-05-14T15:22:52.400 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3600_fsm 2024-05-14T15:22:52.400 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3600_vm 2024-05-14T15:22:52.400 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3601 2024-05-14T15:22:52.400 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3601_fsm 2024-05-14T15:22:52.400 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3601_vm 2024-05-14T15:22:52.401 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3602 2024-05-14T15:22:52.401 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3602_fsm 2024-05-14T15:22:52.401 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3602_vm 2024-05-14T15:22:52.401 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3603 2024-05-14T15:22:52.401 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3603_fsm 2024-05-14T15:22:52.401 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3603_vm 2024-05-14T15:22:52.401 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3604 2024-05-14T15:22:52.401 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3605 2024-05-14T15:22:52.401 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3606 2024-05-14T15:22:52.401 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3607 2024-05-14T15:22:52.401 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3608 2024-05-14T15:22:52.401 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 3609 2024-05-14T15:22:52.401 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3712 2024-05-14T15:22:52.401 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3764 2024-05-14T15:22:52.402 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3764_fsm 2024-05-14T15:22:52.402 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3764_vm 2024-05-14T15:22:52.402 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3766 2024-05-14T15:22:52.402 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3767 2024-05-14T15:22:52.402 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3997 2024-05-14T15:22:52.402 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4143 2024-05-14T15:22:52.402 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4144 2024-05-14T15:22:52.402 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4145 2024-05-14T15:22:52.402 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4146 2024-05-14T15:22:52.402 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4147 2024-05-14T15:22:52.402 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4148 2024-05-14T15:22:52.402 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4149 2024-05-14T15:22:52.403 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4150 2024-05-14T15:22:52.403 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4151 2024-05-14T15:22:52.403 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4152 2024-05-14T15:22:52.403 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4153 2024-05-14T15:22:52.403 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4154 2024-05-14T15:22:52.403 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4155 2024-05-14T15:22:52.403 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4156 2024-05-14T15:22:52.403 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4157 2024-05-14T15:22:52.403 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4158 2024-05-14T15:22:52.403 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4159 2024-05-14T15:22:52.403 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4160 2024-05-14T15:22:52.403 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4161 2024-05-14T15:22:52.403 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4162 2024-05-14T15:22:52.403 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4163 2024-05-14T15:22:52.403 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4164 2024-05-14T15:22:52.403 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4165 2024-05-14T15:22:52.404 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4166 2024-05-14T15:22:52.404 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4167 2024-05-14T15:22:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.401+0000 7fad33400640 1 -- 172.21.15.69:0/835113688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c10bec0 msgr2=0x7fad2c105a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.401+0000 7fad33400640 1 --2- 172.21.15.69:0/835113688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c10bec0 0x7fad2c105a60 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7fad1c009900 tx=0x7fad1c02a410 comp rx=0 tx=0).stop 2024-05-14T15:22:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.401+0000 7fad33400640 1 -- 172.21.15.69:0/835113688 shutdown_connections 2024-05-14T15:22:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.401+0000 7fad33400640 1 --2- 172.21.15.69:0/835113688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad2c106610 0x7fad2c1129e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.401+0000 7fad33400640 1 --2- 172.21.15.69:0/835113688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad2c10c360 0x7fad2c105fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.401+0000 7fad33400640 1 --2- 172.21.15.69:0/835113688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c10bec0 0x7fad2c105a60 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.401+0000 7fad33400640 1 -- 172.21.15.69:0/835113688 >> 172.21.15.69:0/835113688 conn(0x7fad2c1016c0 msgr2=0x7fad2c103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.401+0000 7fad33400640 1 -- 172.21.15.69:0/835113688 shutdown_connections 2024-05-14T15:22:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.401+0000 7fad33400640 1 -- 172.21.15.69:0/835113688 wait complete. 2024-05-14T15:22:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.402+0000 7fad33400640 1 Processor -- start 2024-05-14T15:22:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.402+0000 7fad33400640 1 -- start start 2024-05-14T15:22:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.403+0000 7fad33400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad2c106610 0x7fad2c1a2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.403+0000 7fad33400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c10bec0 0x7fad2c1a2b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.403+0000 7fad33400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad2c10c360 0x7fad2c19c840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.403+0000 7fad33400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fad2c115fc0 con 0x7fad2c10bec0 2024-05-14T15:22:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.403+0000 7fad33400640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fad2c115e40 con 0x7fad2c106610 2024-05-14T15:22:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.403+0000 7fad33400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fad2c116140 con 0x7fad2c10c360 2024-05-14T15:22:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.403+0000 7fad23e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c10bec0 0x7fad2c1a2b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.403+0000 7fad23e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c10bec0 0x7fad2c1a2b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34814/0 (socket says 172.21.15.69:34814) 2024-05-14T15:22:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.403+0000 7fad23e00640 1 -- 172.21.15.69:0/3773323173 learned_addr learned my addr 172.21.15.69:0/3773323173 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.403+0000 7fad30a00640 1 --2- 172.21.15.69:0/3773323173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad2c106610 0x7fad2c1a2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.404+0000 7fad31400640 1 --2- 172.21.15.69:0/3773323173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad2c10c360 0x7fad2c19c840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.405+0000 7fad31400640 1 -- 172.21.15.69:0/3773323173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad2c106610 msgr2=0x7fad2c1a2610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.405+0000 7fad31400640 1 --2- 172.21.15.69:0/3773323173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad2c106610 0x7fad2c1a2610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.405+0000 7fad31400640 1 -- 172.21.15.69:0/3773323173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c10bec0 msgr2=0x7fad2c1a2b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.405+0000 7fad31400640 1 --2- 172.21.15.69:0/3773323173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c10bec0 0x7fad2c1a2b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.405+0000 7fad31400640 1 -- 172.21.15.69:0/3773323173 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad2c19cf20 con 0x7fad2c10c360 2024-05-14T15:22:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.405+0000 7fad31400640 1 --2- 172.21.15.69:0/3773323173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad2c10c360 0x7fad2c19c840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fad2400e940 tx=0x7fad2400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.406+0000 7fad2a000640 1 -- 172.21.15.69:0/3773323173 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad24004d20 con 0x7fad2c10c360 2024-05-14T15:22:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.406+0000 7fad33400640 1 -- 172.21.15.69:0/3773323173 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad2c19d210 con 0x7fad2c10c360 2024-05-14T15:22:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.406+0000 7fad33400640 1 -- 172.21.15.69:0/3773323173 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad2c1a9460 con 0x7fad2c10c360 2024-05-14T15:22:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.406+0000 7fad2a000640 1 -- 172.21.15.69:0/3773323173 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad24011470 con 0x7fad2c10c360 2024-05-14T15:22:52.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.406+0000 7fad2a000640 1 -- 172.21.15.69:0/3773323173 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad2401f060 con 0x7fad2c10c360 2024-05-14T15:22:52.409 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.409+0000 7fad3a46f740 1 Processor -- start 2024-05-14T15:22:52.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.411+0000 7fad2a000640 1 -- 172.21.15.69:0/3773323173 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 24) ==== 149885+0+0 (secure 0 0 0) 0x7fad2400cb20 con 0x7fad2c10c360 2024-05-14T15:22:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.411+0000 7fad3a46f740 1 -- start start 2024-05-14T15:22:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.412+0000 7fad3a46f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84fc1b0 0x563de889d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.412+0000 7fad3a46f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84d32f0 0x563de889d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.412+0000 7fad3a46f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84db4d0 0x563de889dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.412+0000 7fad3a46f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x563de8802550 con 0x563de84db4d0 2024-05-14T15:22:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.412+0000 7fad3a46f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563de87a7bc0 con 0x563de84fc1b0 2024-05-14T15:22:52.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.412+0000 7fad3a46f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563de87fe510 con 0x563de84d32f0 2024-05-14T15:22:52.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.412+0000 7fad23e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84db4d0 0x563de889dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.413+0000 7fad23e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84db4d0 0x563de889dd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34816/0 (socket says 172.21.15.69:34816) 2024-05-14T15:22:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.413+0000 7fad23e00640 1 -- 172.21.15.69:0/3892268791 learned_addr learned my addr 172.21.15.69:0/3892268791 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.413+0000 7fad23e00640 1 --2- 172.21.15.69:0/3892268791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84fc1b0 0x563de889d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.413+0000 7fad30a00640 1 --2- 172.21.15.69:0/3892268791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84d32f0 0x563de889d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.413+0000 7fad23e00640 1 -- 172.21.15.69:0/3892268791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84d32f0 msgr2=0x563de889d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.413+0000 7fad23e00640 1 --2- 172.21.15.69:0/3892268791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84d32f0 0x563de889d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.413+0000 7fad23e00640 1 -- 172.21.15.69:0/3892268791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84fc1b0 msgr2=0x563de889d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.413+0000 7fad23e00640 1 --2- 172.21.15.69:0/3892268791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84fc1b0 0x563de889d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.413+0000 7fad23e00640 1 -- 172.21.15.69:0/3892268791 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563de8514210 con 0x563de84db4d0 2024-05-14T15:22:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.413+0000 7fad2a000640 1 --2- 172.21.15.69:0/3773323173 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fad100b2a70 0x7fad100b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.414+0000 7fad23e00640 1 --2- 172.21.15.69:0/3892268791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84db4d0 0x563de889dd00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fad14005e00 tx=0x7fad14005d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fbf529a94949a9e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.414+0000 7fad2a000640 1 -- 172.21.15.69:0/3773323173 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fad240e2c40 con 0x7fad2c10c360 2024-05-14T15:22:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.414+0000 7fad21c00640 1 -- 172.21.15.69:0/3892268791 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad14012ca0 con 0x563de84db4d0 2024-05-14T15:22:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.414+0000 7fad30a00640 1 --2- 172.21.15.69:0/3773323173 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fad100b2a70 0x7fad100b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.414+0000 7fad21c00640 1 -- 172.21.15.69:0/3892268791 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad14012e40 con 0x563de84db4d0 2024-05-14T15:22:52.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.414+0000 7fad21c00640 1 -- 172.21.15.69:0/3892268791 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad14010770 con 0x563de84db4d0 2024-05-14T15:22:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.415+0000 7fad3a46f740 1 -- 172.21.15.69:0/3892268791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84db4d0 msgr2=0x563de889dd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.415+0000 7fad30a00640 1 --2- 172.21.15.69:0/3773323173 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fad100b2a70 0x7fad100b4f80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0057c0 tx=0x7fad1c000bc0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.415+0000 7fad3a46f740 1 --2- 172.21.15.69:0/3892268791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84db4d0 0x563de889dd00 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fad14005e00 tx=0x7fad14005d30 comp rx=0 tx=0).stop 2024-05-14T15:22:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.416+0000 7fad3a46f740 1 -- 172.21.15.69:0/3892268791 shutdown_connections 2024-05-14T15:22:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.416+0000 7fad3a46f740 1 --2- 172.21.15.69:0/3892268791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84db4d0 0x563de889dd00 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.416+0000 7fad3a46f740 1 --2- 172.21.15.69:0/3892268791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84d32f0 0x563de889d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.416+0000 7fad3a46f740 1 --2- 172.21.15.69:0/3892268791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84fc1b0 0x563de889d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.416+0000 7fad3a46f740 1 -- 172.21.15.69:0/3892268791 >> 172.21.15.69:0/3892268791 conn(0x563de84f0300 msgr2=0x563de8899a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.416+0000 7fad3a46f740 1 -- 172.21.15.69:0/3892268791 shutdown_connections 2024-05-14T15:22:52.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.416+0000 7fad3a46f740 1 -- 172.21.15.69:0/3892268791 wait complete. 2024-05-14T15:22:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.416+0000 7fad3a46f740 1 -- start start 2024-05-14T15:22:52.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.417+0000 7fad3a46f740 1 Processor -- start 2024-05-14T15:22:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.417+0000 7fad3a46f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84d32f0 0x563de88a7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.417+0000 7fad3a46f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84db4d0 0x563de88a7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.417+0000 7fad3a46f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84fc1b0 0x563de88c4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.417+0000 7fad3a46f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x563de88bb3c0 con 0x563de84d32f0 2024-05-14T15:22:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.417+0000 7fad3a46f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563de87bb660 con 0x563de84fc1b0 2024-05-14T15:22:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.417+0000 7fad3a46f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563de88bb540 con 0x563de84db4d0 2024-05-14T15:22:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.418+0000 7fad3a46f740 10 client.0 _ll_register_callbacks cb 0x563de8785400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.418+0000 7fad30a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84d32f0 0x563de88a7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.418+0000 7fad30a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84d32f0 0x563de88a7710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34826/0 (socket says 172.21.15.69:34826) 2024-05-14T15:22:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.418+0000 7fad30a00640 1 -- 172.21.15.69:0/3550793372 learned_addr learned my addr 172.21.15.69:0/3550793372 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.418+0000 7fad23e00640 1 --2- 172.21.15.69:0/3550793372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84db4d0 0x563de88a7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.418+0000 7fad31400640 1 --2- 172.21.15.69:0/3550793372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84fc1b0 0x563de88c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.418+0000 7fad30a00640 1 -- 172.21.15.69:0/3550793372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84db4d0 msgr2=0x563de88a7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.418+0000 7fad30a00640 1 --2- 172.21.15.69:0/3550793372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84db4d0 0x563de88a7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.418+0000 7fad30a00640 1 -- 172.21.15.69:0/3550793372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84fc1b0 msgr2=0x563de88c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.418+0000 7fad30a00640 1 --2- 172.21.15.69:0/3550793372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84fc1b0 0x563de88c4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.418+0000 7fad30a00640 1 -- 172.21.15.69:0/3550793372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563de85e0620 con 0x563de84d32f0 2024-05-14T15:22:52.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.418+0000 7fad31400640 1 --2- 172.21.15.69:0/3550793372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84fc1b0 0x563de88c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:22:52.421 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.419+0000 7fad30a00640 1 --2- 172.21.15.69:0/3550793372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84d32f0 0x563de88a7710 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fad1c004650 tx=0x7fad1c005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23287a8f606b41b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.419+0000 7fad1a000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.419+0000 7fad1a000640 1 -- 172.21.15.69:0/3550793372 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1c04e070 con 0x563de84d32f0 2024-05-14T15:22:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.419+0000 7fad1a000640 1 -- 172.21.15.69:0/3550793372 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fad1c04a650 con 0x563de84d32f0 2024-05-14T15:22:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.419+0000 7fad3a46f740 1 -- 172.21.15.69:0/3550793372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563de8810160 con 0x563de84d32f0 2024-05-14T15:22:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.420+0000 7fad1a000640 1 -- 172.21.15.69:0/3550793372 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fad1c05a050 con 0x563de84d32f0 2024-05-14T15:22:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.420+0000 7fad3a46f740 10 client.15654 fetch_fsmap learned FSMap version 33 2024-05-14T15:22:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.420+0000 7fad3a46f740 1 -- 172.21.15.69:0/3550793372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563de88c75a0 con 0x563de84d32f0 2024-05-14T15:22:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.420+0000 7fad1a000640 1 -- 172.21.15.69:0/3550793372 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x563de8810160 con 0x563de84d32f0 2024-05-14T15:22:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.420+0000 7fad1a000640 1 -- 172.21.15.69:0/3550793372 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fad1c03d8a0 con 0x563de84d32f0 2024-05-14T15:22:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.421+0000 7fad3a46f740 10 client.15654 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:22:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.421+0000 7fad3a46f740 10 client.15654 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:22:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.421+0000 7fad3a46f740 20 client.15654 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:52.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.421+0000 7fad3a46f740 1 --2- 172.21.15.69:0/3550793372 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x563de84bad80 0x563de88cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.421+0000 7fad3a46f740 4 client.15654 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:22:52.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.421+0000 7fad3a46f740 1 -- 172.21.15.69:0/3550793372 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563de8809fd0 con 0x563de84bad80 2024-05-14T15:22:52.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.421+0000 7fad23e00640 1 --2- 172.21.15.69:0/3550793372 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x563de84bad80 0x563de88cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.422+0000 7fad1a000640 10 client.15654 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:52.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.422+0000 7fad23e00640 1 --2- 172.21.15.69:0/3550793372 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x563de84bad80 0x563de88cabf0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa773754c7c8f7f8 server_cookie=46b6fe1394eabb45 in_seq=0 out_seq=0 2024-05-14T15:22:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.424+0000 7fad1a000640 1 -- 172.21.15.69:0/3550793372 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x563de8809fd0 con 0x563de84bad80 2024-05-14T15:22:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.424+0000 7fad1a000640 10 client.15654 handle_command_reply: tid=0 2024-05-14T15:22:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.424+0000 7fad3a46f740 1 client.15654 shutdown 2024-05-14T15:22:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.424+0000 7fad3a46f740 1 -- 172.21.15.69:0/3550793372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84d32f0 msgr2=0x563de88a7710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.424+0000 7fad3a46f740 1 --2- 172.21.15.69:0/3550793372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84d32f0 0x563de88a7710 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fad1c004650 tx=0x7fad1c005f30 comp rx=0 tx=0).stop 2024-05-14T15:22:52.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.425+0000 7fad3a46f740 1 -- 172.21.15.69:0/3550793372 shutdown_connections 2024-05-14T15:22:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.425+0000 7fad3a46f740 1 --2- 172.21.15.69:0/3550793372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84fc1b0 0x563de88c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.425+0000 7fad3a46f740 1 --2- 172.21.15.69:0/3550793372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84db4d0 0x563de88a7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.425+0000 7fad3a46f740 1 --2- 172.21.15.69:0/3550793372 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x563de84bad80 0x563de88cabf0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.425+0000 7fad3a46f740 1 --2- 172.21.15.69:0/3550793372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84d32f0 0x563de88a7710 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.425+0000 7fad1a000640 0 client.15654 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.425+0000 7fad3a46f740 1 -- 172.21.15.69:0/3550793372 >> 172.21.15.69:0/3550793372 conn(0x563de84f0300 msgr2=0x563de889efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.425+0000 7fad3a46f740 1 -- 172.21.15.69:0/3550793372 shutdown_connections 2024-05-14T15:22:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.425+0000 7fad3a46f740 1 -- 172.21.15.69:0/3550793372 wait complete. 2024-05-14T15:22:52.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.425+0000 7fad3a46f740 20 client.15654 trim_cache size 0 max 16384 2024-05-14T15:22:52.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.446+0000 7fad3a46f740 1 Processor -- start 2024-05-14T15:22:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.446+0000 7fad3a46f740 1 -- start start 2024-05-14T15:22:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.446+0000 7fad3a46f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84d32f0 0x563de8898000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.446+0000 7fad3a46f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84db4d0 0x563de88a7da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.446+0000 7fad3a46f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84fc1b0 0x563de88d03b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.446+0000 7fad3a46f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fad0800ff60 con 0x563de84d32f0 2024-05-14T15:22:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.446+0000 7fad3a46f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fad08011b90 con 0x563de84fc1b0 2024-05-14T15:22:52.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.446+0000 7fad3a46f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fad08010630 con 0x563de84db4d0 2024-05-14T15:22:52.448 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.447+0000 7fad30a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84d32f0 0x563de8898000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.448 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.447+0000 7fad30a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84d32f0 0x563de8898000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34840/0 (socket says 172.21.15.69:34840) 2024-05-14T15:22:52.448 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.447+0000 7fad30a00640 1 -- 172.21.15.69:0/3503045139 learned_addr learned my addr 172.21.15.69:0/3503045139 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:52.448 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.447+0000 7fad31400640 1 --2- 172.21.15.69:0/3503045139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84fc1b0 0x563de88d03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.447+0000 7fad23e00640 1 --2- 172.21.15.69:0/3503045139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84db4d0 0x563de88a7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.447+0000 7fad30a00640 1 -- 172.21.15.69:0/3503045139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84db4d0 msgr2=0x563de88a7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.447+0000 7fad30a00640 1 --2- 172.21.15.69:0/3503045139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84db4d0 0x563de88a7da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.447+0000 7fad30a00640 1 -- 172.21.15.69:0/3503045139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84fc1b0 msgr2=0x563de88d03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.447+0000 7fad30a00640 1 --2- 172.21.15.69:0/3503045139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84fc1b0 0x563de88d03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.447+0000 7fad30a00640 1 -- 172.21.15.69:0/3503045139 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563de889a620 con 0x563de84d32f0 2024-05-14T15:22:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.448+0000 7fad30a00640 1 --2- 172.21.15.69:0/3503045139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84d32f0 0x563de8898000 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fad1c004310 tx=0x7fad1c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a926c65dbcb9ea39 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.448+0000 7fad21200640 1 -- 172.21.15.69:0/3503045139 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1c04e040 con 0x563de84d32f0 2024-05-14T15:22:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.448+0000 7fad21200640 1 -- 172.21.15.69:0/3503045139 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad1c063070 con 0x563de84d32f0 2024-05-14T15:22:52.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.448+0000 7fad21200640 1 -- 172.21.15.69:0/3503045139 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad1c035040 con 0x563de84d32f0 2024-05-14T15:22:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.450+0000 7fad3a46f740 1 -- 172.21.15.69:0/3503045139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84d32f0 msgr2=0x563de8898000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.450+0000 7fad3a46f740 1 --2- 172.21.15.69:0/3503045139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84d32f0 0x563de8898000 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fad1c004310 tx=0x7fad1c005fd0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.450+0000 7fad3a46f740 1 -- 172.21.15.69:0/3503045139 shutdown_connections 2024-05-14T15:22:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.450+0000 7fad3a46f740 1 --2- 172.21.15.69:0/3503045139 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84fc1b0 0x563de88d03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.450+0000 7fad3a46f740 1 --2- 172.21.15.69:0/3503045139 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84db4d0 0x563de88a7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.450+0000 7fad3a46f740 1 --2- 172.21.15.69:0/3503045139 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84d32f0 0x563de8898000 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.450+0000 7fad3a46f740 1 -- 172.21.15.69:0/3503045139 >> 172.21.15.69:0/3503045139 conn(0x563de84f0300 msgr2=0x563de88a9650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.450+0000 7fad3a46f740 1 -- 172.21.15.69:0/3503045139 shutdown_connections 2024-05-14T15:22:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.450+0000 7fad3a46f740 1 -- 172.21.15.69:0/3503045139 wait complete. 2024-05-14T15:22:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.450+0000 7fad3a46f740 1 -- start start 2024-05-14T15:22:52.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.451+0000 7fad3a46f740 1 Processor -- start 2024-05-14T15:22:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.451+0000 7fad3a46f740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84d32f0 0x563de88c0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.451+0000 7fad3a46f740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84db4d0 0x563de88bbe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.451+0000 7fad3a46f740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84fc1b0 0x563de88bc3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.451+0000 7fad3a46f740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fad08011400 con 0x563de84fc1b0 2024-05-14T15:22:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.451+0000 7fad3a46f740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fad08010d30 con 0x563de84d32f0 2024-05-14T15:22:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.451+0000 7fad3a46f740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fad0800df40 con 0x563de84db4d0 2024-05-14T15:22:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.451+0000 7fad3a46f740 10 client.0 _ll_register_callbacks cb 0x7fad1c004240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:52.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.451+0000 7fad31400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84fc1b0 0x563de88bc3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.452+0000 7fad31400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84fc1b0 0x563de88bc3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34846/0 (socket says 172.21.15.69:34846) 2024-05-14T15:22:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.452+0000 7fad31400640 1 -- 172.21.15.69:0/1922896948 learned_addr learned my addr 172.21.15.69:0/1922896948 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.452+0000 7fad30a00640 1 --2- 172.21.15.69:0/1922896948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84d32f0 0x563de88c0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.452+0000 7fad23e00640 1 --2- 172.21.15.69:0/1922896948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84db4d0 0x563de88bbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.452+0000 7fad31400640 1 -- 172.21.15.69:0/1922896948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84db4d0 msgr2=0x563de88bbe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.452+0000 7fad31400640 1 --2- 172.21.15.69:0/1922896948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84db4d0 0x563de88bbe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.452+0000 7fad31400640 1 -- 172.21.15.69:0/1922896948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84d32f0 msgr2=0x563de88c0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.452+0000 7fad31400640 1 --2- 172.21.15.69:0/1922896948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84d32f0 0x563de88c0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.452+0000 7fad31400640 1 -- 172.21.15.69:0/1922896948 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563de88bc8f0 con 0x563de84fc1b0 2024-05-14T15:22:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.452+0000 7fad23e00640 1 --2- 172.21.15.69:0/1922896948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84db4d0 0x563de88bbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:22:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.452+0000 7fad31400640 1 --2- 172.21.15.69:0/1922896948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84fc1b0 0x563de88bc3b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fad240a5a50 tx=0x7fad240a9ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161beb47ad783325 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:52.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.452+0000 7fad1a000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.453+0000 7fad1a000640 1 -- 172.21.15.69:0/1922896948 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad240c3060 con 0x563de84fc1b0 2024-05-14T15:22:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.453+0000 7fad1a000640 1 -- 172.21.15.69:0/1922896948 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fad240e0350 con 0x563de84fc1b0 2024-05-14T15:22:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.453+0000 7fad3a46f740 1 -- 172.21.15.69:0/1922896948 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad1c063070 con 0x563de84fc1b0 2024-05-14T15:22:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.453+0000 7fad1a000640 1 -- 172.21.15.69:0/1922896948 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fad240a94e0 con 0x563de84fc1b0 2024-05-14T15:22:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.453+0000 7fad3a46f740 10 client.15660 fetch_fsmap learned FSMap version 33 2024-05-14T15:22:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.453+0000 7fad3a46f740 1 -- 172.21.15.69:0/1922896948 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563de8932c30 con 0x563de84fc1b0 2024-05-14T15:22:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.453+0000 7fad1a000640 1 -- 172.21.15.69:0/1922896948 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fad1c063070 con 0x563de84fc1b0 2024-05-14T15:22:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.453+0000 7fad1a000640 1 -- 172.21.15.69:0/1922896948 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fad2400f040 con 0x563de84fc1b0 2024-05-14T15:22:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.453+0000 7fad3a46f740 10 client.15660 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:22:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.453+0000 7fad3a46f740 10 client.15660 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:22:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.453+0000 7fad3a46f740 20 client.15660 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.453+0000 7fad3a46f740 1 --2- 172.21.15.69:0/1922896948 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x563de84901c0 0x563de8935450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.454+0000 7fad3a46f740 4 client.15660 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:22:52.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.454+0000 7fad3a46f740 1 -- 172.21.15.69:0/1922896948 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563de87854b0 con 0x563de84901c0 2024-05-14T15:22:52.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.454+0000 7fad30a00640 1 --2- 172.21.15.69:0/1922896948 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x563de84901c0 0x563de8935450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.455+0000 7fad1a000640 10 client.15660 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:52.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.455+0000 7fad30a00640 1 --2- 172.21.15.69:0/1922896948 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x563de84901c0 0x563de8935450 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=608c8d7e550a0bb3 server_cookie=4aa109e47a9e1cb3 in_seq=0 out_seq=0 2024-05-14T15:22:52.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4168 2024-05-14T15:22:52.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4169 2024-05-14T15:22:52.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4170 2024-05-14T15:22:52.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4171 2024-05-14T15:22:52.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4172 2024-05-14T15:22:52.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4173 2024-05-14T15:22:52.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4174 2024-05-14T15:22:52.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 5002 2024-05-14T15:22:52.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 548 2024-05-14T15:22:52.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 549 2024-05-14T15:22:52.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6102 2024-05-14T15:22:52.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6104 2024-05-14T15:22:52.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6106 2024-05-14T15:22:52.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6110 2024-05-14T15:22:52.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6111 2024-05-14T15:22:52.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6112 2024-05-14T15:22:52.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6113 2024-05-14T15:22:52.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6117 2024-05-14T15:22:52.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 826 2024-05-14T15:22:52.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 827 2024-05-14T15:22:52.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 828 2024-05-14T15:22:52.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 14 15:22 pg_filenode.map 2024-05-14T15:22:52.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 14 15:22 PG_VERSION 2024-05-14T15:22:52.508 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.508 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/global: 2024-05-14T15:22:52.508 INFO:teuthology.orchestra.run.smithi069.stdout:total 538 2024-05-14T15:22:52.508 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 549376 May 14 15:22 . 2024-05-14T15:22:52.508 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1213 2024-05-14T15:22:52.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1213_fsm 2024-05-14T15:22:52.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1213_vm 2024-05-14T15:22:52.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1214 2024-05-14T15:22:52.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1214_fsm 2024-05-14T15:22:52.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1214_vm 2024-05-14T15:22:52.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 1232 2024-05-14T15:22:52.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 1233 2024-05-14T15:22:52.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1260 2024-05-14T15:22:52.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1260_fsm 2024-05-14T15:22:52.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1260_vm 2024-05-14T15:22:52.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1261 2024-05-14T15:22:52.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1261_fsm 2024-05-14T15:22:52.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1261_vm 2024-05-14T15:22:52.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1262 2024-05-14T15:22:52.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1262_fsm 2024-05-14T15:22:52.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1262_vm 2024-05-14T15:22:52.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2396 2024-05-14T15:22:52.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2396_fsm 2024-05-14T15:22:52.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2396_vm 2024-05-14T15:22:52.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2397 2024-05-14T15:22:52.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2671 2024-05-14T15:22:52.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2672 2024-05-14T15:22:52.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2676 2024-05-14T15:22:52.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2677 2024-05-14T15:22:52.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2694 2024-05-14T15:22:52.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2695 2024-05-14T15:22:52.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2697 2024-05-14T15:22:52.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2698 2024-05-14T15:22:52.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2846 2024-05-14T15:22:52.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2847 2024-05-14T15:22:52.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2964 2024-05-14T15:22:52.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2965 2024-05-14T15:22:52.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2966 2024-05-14T15:22:52.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2967 2024-05-14T15:22:52.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3592 2024-05-14T15:22:52.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3593 2024-05-14T15:22:52.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4060 2024-05-14T15:22:52.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4061 2024-05-14T15:22:52.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4175 2024-05-14T15:22:52.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4176 2024-05-14T15:22:52.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4177 2024-05-14T15:22:52.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4178 2024-05-14T15:22:52.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4181 2024-05-14T15:22:52.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4182 2024-05-14T15:22:52.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4183 2024-05-14T15:22:52.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4184 2024-05-14T15:22:52.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4185 2024-05-14T15:22:52.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4186 2024-05-14T15:22:52.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6000 2024-05-14T15:22:52.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6001 2024-05-14T15:22:52.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6002 2024-05-14T15:22:52.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6100 2024-05-14T15:22:52.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6114 2024-05-14T15:22:52.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6115 2024-05-14T15:22:52.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 pg_control 2024-05-14T15:22:52.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 14 15:22 pg_filenode.map 2024-05-14T15:22:52.518 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.518 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/log: 2024-05-14T15:22:52.518 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:22:52.518 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:22:52.527 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.526+0000 7fad1a000640 1 -- 172.21.15.69:0/1922896948 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563de87854b0 con 0x563de84901c0 2024-05-14T15:22:52.527 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.527+0000 7fad1a000640 10 client.15660 handle_command_reply: tid=0 2024-05-14T15:22:52.527 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.527+0000 7fad3a46f740 1 client.15660 shutdown 2024-05-14T15:22:52.527 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.527+0000 7fad3a46f740 1 -- 172.21.15.69:0/1922896948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84fc1b0 msgr2=0x563de88bc3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.527 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.527+0000 7fad3a46f740 1 --2- 172.21.15.69:0/1922896948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84fc1b0 0x563de88bc3b0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fad240a5a50 tx=0x7fad240a9ff0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.527+0000 7fad3a46f740 1 -- 172.21.15.69:0/1922896948 shutdown_connections 2024-05-14T15:22:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.527+0000 7fad3a46f740 1 --2- 172.21.15.69:0/1922896948 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x563de84901c0 0x563de8935450 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.527+0000 7fad3a46f740 1 --2- 172.21.15.69:0/1922896948 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x563de84fc1b0 0x563de88bc3b0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.527+0000 7fad3a46f740 1 --2- 172.21.15.69:0/1922896948 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x563de84db4d0 0x563de88bbe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.527+0000 7fad3a46f740 1 --2- 172.21.15.69:0/1922896948 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x563de84d32f0 0x563de88c0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.527+0000 7fad3a46f740 1 -- 172.21.15.69:0/1922896948 >> 172.21.15.69:0/1922896948 conn(0x563de84f0300 msgr2=0x563de88a0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.527+0000 7fad1a000640 0 client.15660 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:22:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.527+0000 7fad3a46f740 1 -- 172.21.15.69:0/1922896948 shutdown_connections 2024-05-14T15:22:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.527+0000 7fad3a46f740 1 -- 172.21.15.69:0/1922896948 wait complete. 2024-05-14T15:22:52.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.528+0000 7fad3a46f740 20 client.15660 trim_cache size 0 max 16384 2024-05-14T15:22:52.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:22:52.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:22:52.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:22:52.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:22:52.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.528+0000 7fad33400640 1 -- 172.21.15.69:0/3773323173 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fad100b2a70 msgr2=0x7fad100b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.528+0000 7fad33400640 1 --2- 172.21.15.69:0/3773323173 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fad100b2a70 0x7fad100b4f80 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fad1c0057c0 tx=0x7fad1c000bc0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.529+0000 7fad33400640 1 -- 172.21.15.69:0/3773323173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad2c10c360 msgr2=0x7fad2c19c840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.529+0000 7fad33400640 1 --2- 172.21.15.69:0/3773323173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad2c10c360 0x7fad2c19c840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fad2400e940 tx=0x7fad2400ee00 comp rx=0 tx=0).stop 2024-05-14T15:22:52.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.529+0000 7fad33400640 1 -- 172.21.15.69:0/3773323173 shutdown_connections 2024-05-14T15:22:52.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.529+0000 7fad33400640 1 --2- 172.21.15.69:0/3773323173 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fad100b2a70 0x7fad100b4f80 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.529+0000 7fad33400640 1 --2- 172.21.15.69:0/3773323173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fad2c10c360 0x7fad2c19c840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.529+0000 7fad33400640 1 --2- 172.21.15.69:0/3773323173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fad2c10bec0 0x7fad2c1a2b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.529+0000 7fad33400640 1 --2- 172.21.15.69:0/3773323173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fad2c106610 0x7fad2c1a2610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.529+0000 7fad33400640 1 -- 172.21.15.69:0/3773323173 >> 172.21.15.69:0/3773323173 conn(0x7fad2c1016c0 msgr2=0x7fad2c101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:52.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.529+0000 7fad33400640 1 -- 172.21.15.69:0/3773323173 shutdown_connections 2024-05-14T15:22:52.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:22:52.529+0000 7fad33400640 1 -- 172.21.15.69:0/3773323173 wait complete. 2024-05-14T15:22:52.740 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.740 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.740 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-05-14T15:22:52.740 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:22:52.740 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:22:52.740 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.741 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.741 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-05-14T15:22:52.741 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:22:52.741 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:22:52.741 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.741 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.741 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-05-14T15:22:52.741 INFO:teuthology.orchestra.run.smithi069.stdout:total 3 2024-05-14T15:22:52.741 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 15:22 . 2024-05-14T15:22:52.741 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.741 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 mappings 2024-05-14T15:22:52.741 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 15:22 replorigin_checkpoint 2024-05-14T15:22:52.742 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 snapshots 2024-05-14T15:22:52.742 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.742 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-05-14T15:22:52.742 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:22:52.742 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:22:52.742 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 15:22 .. 2024-05-14T15:22:52.742 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.742 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-05-14T15:22:52.742 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:22:52.742 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:22:52.742 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 15:22 .. 2024-05-14T15:22:52.742 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.742 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-05-14T15:22:52.742 INFO:teuthology.orchestra.run.smithi069.stdout:total 2 2024-05-14T15:22:52.742 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 . 2024-05-14T15:22:52.743 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.743 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 members 2024-05-14T15:22:52.743 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 offsets 2024-05-14T15:22:52.743 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.743 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-05-14T15:22:52.743 INFO:teuthology.orchestra.run.smithi069.stdout:total 9 2024-05-14T15:22:52.743 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 . 2024-05-14T15:22:52.743 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 .. 2024-05-14T15:22:52.743 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 0000 2024-05-14T15:22:52.743 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.743 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-05-14T15:22:52.744 INFO:teuthology.orchestra.run.smithi069.stdout:total 9 2024-05-14T15:22:52.744 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 . 2024-05-14T15:22:52.744 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 .. 2024-05-14T15:22:52.744 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 0000 2024-05-14T15:22:52.744 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.744 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-05-14T15:22:52.744 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:22:52.744 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:22:52.744 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.744 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.744 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-05-14T15:22:52.745 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:22:52.745 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:22:52.745 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.745 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.745 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-05-14T15:22:52.745 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:22:52.745 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:22:52.745 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.745 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.745 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-05-14T15:22:52.745 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:22:52.745 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:22:52.745 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.745 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.745 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-05-14T15:22:52.745 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:22:52.746 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:22:52.746 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.746 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.746 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-05-14T15:22:52.746 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:22:52.746 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:22:52.746 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.746 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.746 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-05-14T15:22:52.809 INFO:teuthology.orchestra.run.smithi069.stdout:total 9 2024-05-14T15:22:52.809 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 . 2024-05-14T15:22:52.810 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 0000 2024-05-14T15:22:52.810 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.810 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-05-14T15:22:52.810 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:22:52.810 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:22:52.810 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.810 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.810 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-05-14T15:22:52.810 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:22:52.810 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:22:52.810 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.810 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.811 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-05-14T15:22:52.811 INFO:teuthology.orchestra.run.smithi069.stdout:total 16386 2024-05-14T15:22:52.811 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:22 . 2024-05-14T15:22:52.811 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:22 000000010000000000000001 2024-05-14T15:22:52.811 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 archive_status 2024-05-14T15:22:52.811 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.811 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-05-14T15:22:52.811 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:22:52.811 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:22:52.811 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:22 .. 2024-05-14T15:22:52.811 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:22:52.811 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-05-14T15:22:52.812 INFO:teuthology.orchestra.run.smithi069.stdout:total 9 2024-05-14T15:22:52.812 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 . 2024-05-14T15:22:52.812 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 41283110 May 14 15:22 .. 2024-05-14T15:22:52.812 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 0000 2024-05-14T15:22:52.819 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl start postgresql' 2024-05-14T15:22:52.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.863+0000 7fbb5e600700 1 -- 172.21.15.69:0/3974667024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb58108f00 msgr2=0x7fbb58109310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.863+0000 7fbb5e600700 1 --2- 172.21.15.69:0/3974667024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb58108f00 0x7fbb58109310 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbb440099c0 tx=0x7fbb44009cd0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.864+0000 7fbb5e600700 1 -- 172.21.15.69:0/3974667024 shutdown_connections 2024-05-14T15:22:52.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.864+0000 7fbb5e600700 1 --2- 172.21.15.69:0/3974667024 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb58109850 0x7fbb581111b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.864+0000 7fbb5e600700 1 --2- 172.21.15.69:0/3974667024 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb581045d0 0x7fbb581049e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.864+0000 7fbb5e600700 1 --2- 172.21.15.69:0/3974667024 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb58108f00 0x7fbb58109310 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.864+0000 7fbb5e600700 1 -- 172.21.15.69:0/3974667024 >> 172.21.15.69:0/3974667024 conn(0x7fbb580ffea0 msgr2=0x7fbb581022f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:52.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.864+0000 7fbb5e600700 1 -- 172.21.15.69:0/3974667024 shutdown_connections 2024-05-14T15:22:52.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.864+0000 7fbb5e600700 1 -- 172.21.15.69:0/3974667024 wait complete. 2024-05-14T15:22:52.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.865+0000 7fbb5e600700 1 Processor -- start 2024-05-14T15:22:52.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.865+0000 7fbb5e600700 1 -- start start 2024-05-14T15:22:52.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.865+0000 7fbb5e600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb581045d0 0x7fbb58076bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.865+0000 7fbb5e600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb58108f00 0x7fbb58077110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.865+0000 7fbb5e600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb58109850 0x7fbb58077650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.865+0000 7fbb5e600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581143d0 con 0x7fbb58109850 2024-05-14T15:22:52.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.865+0000 7fbb5e600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb58114250 con 0x7fbb581045d0 2024-05-14T15:22:52.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.865+0000 7fbb5e600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbb58114550 con 0x7fbb58108f00 2024-05-14T15:22:52.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.866+0000 7fbb57e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb58109850 0x7fbb58077650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.866+0000 7fbb57e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb58109850 0x7fbb58077650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35928/0 (socket says 172.21.15.69:35928) 2024-05-14T15:22:52.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.866+0000 7fbb57e00700 1 -- 172.21.15.69:0/2047441044 learned_addr learned my addr 172.21.15.69:0/2047441044 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:52.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.866+0000 7fbb57400700 1 --2- 172.21.15.69:0/2047441044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb581045d0 0x7fbb58076bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.866+0000 7fbb56a00700 1 --2- 172.21.15.69:0/2047441044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb58108f00 0x7fbb58077110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.866+0000 7fbb57e00700 1 -- 172.21.15.69:0/2047441044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb58108f00 msgr2=0x7fbb58077110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.866+0000 7fbb57e00700 1 --2- 172.21.15.69:0/2047441044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb58108f00 0x7fbb58077110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.866+0000 7fbb57e00700 1 -- 172.21.15.69:0/2047441044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb581045d0 msgr2=0x7fbb58076bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.866+0000 7fbb57e00700 1 --2- 172.21.15.69:0/2047441044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb581045d0 0x7fbb58076bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.866+0000 7fbb57e00700 1 -- 172.21.15.69:0/2047441044 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb581a9160 con 0x7fbb58109850 2024-05-14T15:22:52.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.867+0000 7fbb57e00700 1 --2- 172.21.15.69:0/2047441044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb58109850 0x7fbb58077650 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000b970 tx=0x7fbb5000bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:52.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.867+0000 7fbb4fe00700 1 -- 172.21.15.69:0/2047441044 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb5000d860 con 0x7fbb58109850 2024-05-14T15:22:52.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.867+0000 7fbb4fe00700 1 -- 172.21.15.69:0/2047441044 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb5000e430 con 0x7fbb58109850 2024-05-14T15:22:52.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.867+0000 7fbb5e600700 1 -- 172.21.15.69:0/2047441044 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb581a9450 con 0x7fbb58109850 2024-05-14T15:22:52.868 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.867+0000 7fbb4fe00700 1 -- 172.21.15.69:0/2047441044 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50017660 con 0x7fbb58109850 2024-05-14T15:22:52.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.867+0000 7fbb5e600700 1 -- 172.21.15.69:0/2047441044 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb581a9960 con 0x7fbb58109850 2024-05-14T15:22:52.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.871+0000 7fbb4fe00700 1 -- 172.21.15.69:0/2047441044 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 149885+0+0 (secure 0 0 0) 0x7fbb500203f0 con 0x7fbb58109850 2024-05-14T15:22:52.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.872+0000 7fbb6d1b1b80 1 Processor -- start 2024-05-14T15:22:52.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.873+0000 7fbb6d1b1b80 1 -- start start 2024-05-14T15:22:52.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.873+0000 7fbb4fe00700 1 --2- 172.21.15.69:0/2047441044 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbb3c0b2b90 0x7fbb3c0b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.873+0000 7fbb6d1b1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3ddce40 0x561bf3f602f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.873+0000 7fbb6d1b1b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3f60830 0x561bf3f5a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.873+0000 7fbb4fe00700 1 -- 172.21.15.69:0/2047441044 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fbb500e28c0 con 0x7fbb58109850 2024-05-14T15:22:52.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.873+0000 7fbb6d1b1b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f5a9f0 0x561bf3f5ae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.873+0000 7fbb6d1b1b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x561bf3e7ca20 con 0x561bf3f5a9f0 2024-05-14T15:22:52.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.873+0000 7fbb6d1b1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561bf3e1a760 con 0x561bf3ddce40 2024-05-14T15:22:52.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.873+0000 7fbb6d1b1b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561bf3e789e0 con 0x561bf3f60830 2024-05-14T15:22:52.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.873+0000 7fbb56a00700 1 --2- 172.21.15.69:0/2047441044 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbb3c0b2b90 0x7fbb3c0b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.874+0000 7fbb57e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f5a9f0 0x561bf3f5ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.874+0000 7fbb57e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f5a9f0 0x561bf3f5ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35944/0 (socket says 172.21.15.69:35944) 2024-05-14T15:22:52.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.874+0000 7fbb57e00700 1 -- 172.21.15.69:0/452820889 learned_addr learned my addr 172.21.15.69:0/452820889 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:52.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.874+0000 7fbb57400700 1 --2- 172.21.15.69:0/452820889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3ddce40 0x561bf3f602f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.874+0000 7fbb56a00700 1 --2- 172.21.15.69:0/452820889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3f60830 0x561bf3f5a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.874+0000 7fbb57e00700 1 -- 172.21.15.69:0/452820889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3f60830 msgr2=0x561bf3f5a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:52.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.874+0000 7fbb57e00700 1 --2- 172.21.15.69:0/452820889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3f60830 0x561bf3f5a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.874+0000 7fbb57e00700 1 -- 172.21.15.69:0/452820889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3ddce40 msgr2=0x561bf3f602f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:52.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.874+0000 7fbb57e00700 1 --2- 172.21.15.69:0/452820889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3ddce40 0x561bf3f602f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.874+0000 7fbb57e00700 1 -- 172.21.15.69:0/452820889 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bf3dc98d0 con 0x561bf3f5a9f0 2024-05-14T15:22:52.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.875+0000 7fbb57e00700 1 --2- 172.21.15.69:0/452820889 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f5a9f0 0x561bf3f5ae00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbb500a55c0 tx=0x7fbb500a9c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94305b1194ca782 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:52.875 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.875+0000 7fbb56a00700 1 --2- 172.21.15.69:0/2047441044 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbb3c0b2b90 0x7fbb3c0b50a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009990 tx=0x7fbb44005050 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:52.876 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.875+0000 7fbb4cc00700 1 -- 172.21.15.69:0/452820889 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb500a9310 con 0x561bf3f5a9f0 2024-05-14T15:22:52.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.875+0000 7fbb4cc00700 1 -- 172.21.15.69:0/452820889 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb500b23a0 con 0x561bf3f5a9f0 2024-05-14T15:22:52.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.875+0000 7fbb4cc00700 1 -- 172.21.15.69:0/452820889 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb50091110 con 0x561bf3f5a9f0 2024-05-14T15:22:52.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.876+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/452820889 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f5a9f0 msgr2=0x561bf3f5ae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.876+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/452820889 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f5a9f0 0x561bf3f5ae00 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbb500a55c0 tx=0x7fbb500a9c40 comp rx=0 tx=0).stop 2024-05-14T15:22:52.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.876+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/452820889 shutdown_connections 2024-05-14T15:22:52.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.876+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/452820889 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f5a9f0 0x561bf3f5ae00 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.876+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/452820889 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3ddce40 0x561bf3f602f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.876+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/452820889 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3f60830 0x561bf3f5a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.876+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/452820889 >> 172.21.15.69:0/452820889 conn(0x561bf3e21f70 msgr2=0x561bf3f552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:52.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.876+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/452820889 shutdown_connections 2024-05-14T15:22:52.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.876+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/452820889 wait complete. 2024-05-14T15:22:52.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.877+0000 7fbb6d1b1b80 1 -- start start 2024-05-14T15:22:52.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.877+0000 7fbb6d1b1b80 1 Processor -- start 2024-05-14T15:22:52.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.878+0000 7fbb6d1b1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3ddce40 0x561bf3f64040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.878+0000 7fbb6d1b1b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3f5a9f0 0x561bf3f64580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.878+0000 7fbb6d1b1b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f60830 0x561bf3f64ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.878+0000 7fbb6d1b1b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x561bf3f67310 con 0x561bf3f60830 2024-05-14T15:22:52.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.878+0000 7fbb6d1b1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561bf3de2b20 con 0x561bf3ddce40 2024-05-14T15:22:52.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.878+0000 7fbb6d1b1b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561bf3f67490 con 0x561bf3f5a9f0 2024-05-14T15:22:52.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.878+0000 7fbb6d1b1b80 10 client.0 _ll_register_callbacks cb 0x561bf3e23c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:52.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.878+0000 7fbb57e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f60830 0x561bf3f64ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.878+0000 7fbb57e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f60830 0x561bf3f64ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35960/0 (socket says 172.21.15.69:35960) 2024-05-14T15:22:52.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.878+0000 7fbb57e00700 1 -- 172.21.15.69:0/1946945602 learned_addr learned my addr 172.21.15.69:0/1946945602 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:52.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.878+0000 7fbb57400700 1 --2- 172.21.15.69:0/1946945602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3ddce40 0x561bf3f64040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.878+0000 7fbb56a00700 1 --2- 172.21.15.69:0/1946945602 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3f5a9f0 0x561bf3f64580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.879+0000 7fbb57e00700 1 -- 172.21.15.69:0/1946945602 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3f5a9f0 msgr2=0x561bf3f64580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:52.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.879+0000 7fbb57e00700 1 --2- 172.21.15.69:0/1946945602 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3f5a9f0 0x561bf3f64580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.879+0000 7fbb57e00700 1 -- 172.21.15.69:0/1946945602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3ddce40 msgr2=0x561bf3f64040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:52.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.879+0000 7fbb57e00700 1 --2- 172.21.15.69:0/1946945602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3ddce40 0x561bf3f64040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.879+0000 7fbb57e00700 1 -- 172.21.15.69:0/1946945602 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bf3e42420 con 0x561bf3f60830 2024-05-14T15:22:52.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.879+0000 7fbb56a00700 1 --2- 172.21.15.69:0/1946945602 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3f5a9f0 0x561bf3f64580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:22:52.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.879+0000 7fbb57400700 1 --2- 172.21.15.69:0/1946945602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3ddce40 0x561bf3f64040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:22:52.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.879+0000 7fbb57e00700 1 --2- 172.21.15.69:0/1946945602 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f60830 0x561bf3f64ac0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbb500098f0 tx=0x7fbb5000eaf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fefedb419fe1fec7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:52.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.879+0000 7fbb41600700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:52.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.879+0000 7fbb41600700 1 -- 172.21.15.69:0/1946945602 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb500c8060 con 0x561bf3f60830 2024-05-14T15:22:52.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.879+0000 7fbb41600700 1 -- 172.21.15.69:0/1946945602 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fbb500a99b0 con 0x561bf3f60830 2024-05-14T15:22:52.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.879+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/1946945602 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb500b23a0 con 0x561bf3f60830 2024-05-14T15:22:52.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.880+0000 7fbb41600700 1 -- 172.21.15.69:0/1946945602 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbb50089050 con 0x561bf3f60830 2024-05-14T15:22:52.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.880+0000 7fbb6d1b1b80 10 client.15672 fetch_fsmap learned FSMap version 33 2024-05-14T15:22:52.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.880+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/1946945602 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561bf3f71ea0 con 0x561bf3f60830 2024-05-14T15:22:52.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.880+0000 7fbb41600700 1 -- 172.21.15.69:0/1946945602 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb500b23a0 con 0x561bf3f60830 2024-05-14T15:22:52.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.880+0000 7fbb41600700 1 -- 172.21.15.69:0/1946945602 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fbb500a87a0 con 0x561bf3f60830 2024-05-14T15:22:52.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.880+0000 7fbb6d1b1b80 10 client.15672 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:22:52.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.880+0000 7fbb6d1b1b80 10 client.15672 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-05-14T15:22:52.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.880+0000 7fbb6d1b1b80 20 client.15672 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:52.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.880+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/1946945602 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x561bf3f74370 0x561bf3f76790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.880+0000 7fbb6d1b1b80 4 client.15672 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:22:52.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.880+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/1946945602 --> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561bf3f271c0 con 0x561bf3f74370 2024-05-14T15:22:52.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.881+0000 7fbb57400700 1 --2- 172.21.15.69:0/1946945602 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x561bf3f74370 0x561bf3f76790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.882+0000 7fbb41600700 10 client.15672 ms_handle_connect on v2:172.21.15.92:6834/360295917 2024-05-14T15:22:52.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.882+0000 7fbb57400700 1 --2- 172.21.15.69:0/1946945602 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x561bf3f74370 0x561bf3f76790 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=da450128e78dc13b server_cookie=36c2051b9cb347ea in_seq=0 out_seq=0 2024-05-14T15:22:52.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.884+0000 7fbb41600700 1 -- 172.21.15.69:0/1946945602 <== mds.2 v2:172.21.15.92:6834/360295917 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561bf3f271c0 con 0x561bf3f74370 2024-05-14T15:22:52.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.884+0000 7fbb41600700 10 client.15672 handle_command_reply: tid=0 2024-05-14T15:22:52.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.884+0000 7fbb6d1b1b80 1 client.15672 shutdown 2024-05-14T15:22:52.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.885+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/1946945602 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f60830 msgr2=0x561bf3f64ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.885+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/1946945602 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f60830 0x561bf3f64ac0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbb500098f0 tx=0x7fbb5000eaf0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.885+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/1946945602 shutdown_connections 2024-05-14T15:22:52.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.885+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/1946945602 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f60830 0x561bf3f64ac0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.885+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/1946945602 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x561bf3f74370 0x561bf3f76790 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.885+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/1946945602 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3ddce40 0x561bf3f64040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.885+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/1946945602 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3f5a9f0 0x561bf3f64580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.885+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/1946945602 >> 172.21.15.69:0/1946945602 conn(0x561bf3e21f70 msgr2=0x561bf3f594a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:52.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.885+0000 7fbb41600700 0 client.15672 ms_handle_reset on v2:172.21.15.92:6834/360295917 2024-05-14T15:22:52.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.885+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/1946945602 shutdown_connections 2024-05-14T15:22:52.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.885+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/1946945602 wait complete. 2024-05-14T15:22:52.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.885+0000 7fbb6d1b1b80 20 client.15672 trim_cache size 0 max 16384 2024-05-14T15:22:52.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.902+0000 7fbb6d1b1b80 1 Processor -- start 2024-05-14T15:22:52.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.902+0000 7fbb6d1b1b80 1 -- start start 2024-05-14T15:22:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.903+0000 7fbb6d1b1b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3ddce40 0x561bf3f5a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.903+0000 7fbb6d1b1b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f5a9f0 0x561bf3f706f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.903+0000 7fbb6d1b1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3f60830 0x561bf3f5f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.903+0000 7fbb6d1b1b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581b2810 con 0x561bf3f5a9f0 2024-05-14T15:22:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.903+0000 7fbb6d1b1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581b4440 con 0x561bf3f60830 2024-05-14T15:22:52.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.903+0000 7fbb6d1b1b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581b2ee0 con 0x561bf3ddce40 2024-05-14T15:22:52.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.903+0000 7fbb56a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f5a9f0 0x561bf3f706f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.903+0000 7fbb56a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f5a9f0 0x561bf3f706f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35970/0 (socket says 172.21.15.69:35970) 2024-05-14T15:22:52.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.903+0000 7fbb56a00700 1 -- 172.21.15.69:0/3352937292 learned_addr learned my addr 172.21.15.69:0/3352937292 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:52.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.903+0000 7fbb57e00700 1 --2- 172.21.15.69:0/3352937292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3f60830 0x561bf3f5f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.903+0000 7fbb57400700 1 --2- 172.21.15.69:0/3352937292 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3ddce40 0x561bf3f5a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.903+0000 7fbb56a00700 1 -- 172.21.15.69:0/3352937292 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3ddce40 msgr2=0x561bf3f5a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.904+0000 7fbb56a00700 1 --2- 172.21.15.69:0/3352937292 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3ddce40 0x561bf3f5a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.904+0000 7fbb56a00700 1 -- 172.21.15.69:0/3352937292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3f60830 msgr2=0x561bf3f5f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.904+0000 7fbb56a00700 1 --2- 172.21.15.69:0/3352937292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3f60830 0x561bf3f5f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.904+0000 7fbb56a00700 1 -- 172.21.15.69:0/3352937292 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561bf3f60d60 con 0x561bf3f5a9f0 2024-05-14T15:22:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.904+0000 7fbb56a00700 1 --2- 172.21.15.69:0/3352937292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f5a9f0 0x561bf3f706f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbb440099c0 tx=0x7fbb44027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e7e350ac5b926a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:52.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.904+0000 7fbb43e00700 1 -- 172.21.15.69:0/3352937292 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb44021040 con 0x561bf3f5a9f0 2024-05-14T15:22:52.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.905+0000 7fbb43e00700 1 -- 172.21.15.69:0/3352937292 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb4402d070 con 0x561bf3f5a9f0 2024-05-14T15:22:52.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.905+0000 7fbb43e00700 1 -- 172.21.15.69:0/3352937292 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4400fc70 con 0x561bf3f5a9f0 2024-05-14T15:22:52.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.905+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/3352937292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f5a9f0 msgr2=0x561bf3f706f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.905+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/3352937292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f5a9f0 0x561bf3f706f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbb440099c0 tx=0x7fbb44027000 comp rx=0 tx=0).stop 2024-05-14T15:22:52.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.906+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/3352937292 shutdown_connections 2024-05-14T15:22:52.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.906+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/3352937292 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3f60830 0x561bf3f5f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.906+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/3352937292 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3ddce40 0x561bf3f5a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.906+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/3352937292 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3f5a9f0 0x561bf3f706f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.906+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/3352937292 >> 172.21.15.69:0/3352937292 conn(0x561bf3e21f70 msgr2=0x561bf3f5f130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:52.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.906+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/3352937292 shutdown_connections 2024-05-14T15:22:52.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.906+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/3352937292 wait complete. 2024-05-14T15:22:52.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.906+0000 7fbb6d1b1b80 1 -- start start 2024-05-14T15:22:52.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.907+0000 7fbb6d1b1b80 1 Processor -- start 2024-05-14T15:22:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.907+0000 7fbb6d1b1b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3ddce40 0x561bf3f70490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.907+0000 7fbb6d1b1b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3f5a9f0 0x561bf3f77d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.907+0000 7fbb6d1b1b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3f60830 0x561bf3f782b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.907+0000 7fbb6d1b1b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581b3cb0 con 0x561bf3ddce40 2024-05-14T15:22:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.907+0000 7fbb6d1b1b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581b35e0 con 0x561bf3f60830 2024-05-14T15:22:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.907+0000 7fbb6d1b1b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbb581b07b0 con 0x561bf3f5a9f0 2024-05-14T15:22:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.907+0000 7fbb6d1b1b80 10 client.0 _ll_register_callbacks cb 0x561bf3e23c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.908+0000 7fbb57400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3ddce40 0x561bf3f70490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.908+0000 7fbb57400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3ddce40 0x561bf3f70490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35972/0 (socket says 172.21.15.69:35972) 2024-05-14T15:22:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.908+0000 7fbb57400700 1 -- 172.21.15.69:0/1190964880 learned_addr learned my addr 172.21.15.69:0/1190964880 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.908+0000 7fbb56a00700 1 --2- 172.21.15.69:0/1190964880 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3f5a9f0 0x561bf3f77d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.908+0000 7fbb57e00700 1 --2- 172.21.15.69:0/1190964880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3f60830 0x561bf3f782b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.908+0000 7fbb57400700 1 -- 172.21.15.69:0/1190964880 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3f5a9f0 msgr2=0x561bf3f77d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.908+0000 7fbb57400700 1 --2- 172.21.15.69:0/1190964880 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3f5a9f0 0x561bf3f77d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.908+0000 7fbb57400700 1 -- 172.21.15.69:0/1190964880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3f60830 msgr2=0x561bf3f782b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.908+0000 7fbb57400700 1 --2- 172.21.15.69:0/1190964880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3f60830 0x561bf3f782b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.908+0000 7fbb57400700 1 -- 172.21.15.69:0/1190964880 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561bf3f787f0 con 0x561bf3ddce40 2024-05-14T15:22:52.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.908+0000 7fbb57400700 1 --2- 172.21.15.69:0/1190964880 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3ddce40 0x561bf3f70490 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x561bf3f673d0 tx=0x7fbb4800be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47c8e07e8af2f04c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:52.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.909+0000 7fbb41600700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:52.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.909+0000 7fbb41600700 1 -- 172.21.15.69:0/1190964880 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb4801d3b0 con 0x561bf3ddce40 2024-05-14T15:22:52.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.909+0000 7fbb41600700 1 -- 172.21.15.69:0/1190964880 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fbb4801d550 con 0x561bf3ddce40 2024-05-14T15:22:52.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.909+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/1190964880 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb4402d070 con 0x561bf3ddce40 2024-05-14T15:22:52.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.909+0000 7fbb41600700 1 -- 172.21.15.69:0/1190964880 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbb4802b050 con 0x561bf3ddce40 2024-05-14T15:22:52.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.909+0000 7fbb6d1b1b80 10 client.15678 fetch_fsmap learned FSMap version 33 2024-05-14T15:22:52.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.909+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/1190964880 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x561bf3fde5d0 con 0x561bf3ddce40 2024-05-14T15:22:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.910+0000 7fbb41600700 1 -- 172.21.15.69:0/1190964880 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb4402d070 con 0x561bf3ddce40 2024-05-14T15:22:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.910+0000 7fbb41600700 1 -- 172.21.15.69:0/1190964880 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fbb48026bc0 con 0x561bf3ddce40 2024-05-14T15:22:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.910+0000 7fbb6d1b1b80 10 client.15678 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:22:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.910+0000 7fbb6d1b1b80 10 client.15678 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-05-14T15:22:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.910+0000 7fbb6d1b1b80 20 client.15678 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.910+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/1190964880 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x561bf3fdece0 0x561bf3fe1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.910+0000 7fbb6d1b1b80 4 client.15678 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:22:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.910+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/1190964880 --> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561bf3e8a400 con 0x561bf3fdece0 2024-05-14T15:22:52.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.911+0000 7fbb56a00700 1 --2- 172.21.15.69:0/1190964880 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x561bf3fdece0 0x561bf3fe1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:52.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.912+0000 7fbb56a00700 1 --2- 172.21.15.69:0/1190964880 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x561bf3fdece0 0x561bf3fe1100 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1ad96e3c0642ee89 server_cookie=46a51250e417cbd4 in_seq=0 out_seq=0 2024-05-14T15:22:52.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.912+0000 7fbb41600700 10 client.15678 ms_handle_connect on v2:172.21.15.92:6834/360295917 2024-05-14T15:22:52.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.912+0000 7fbb41600700 1 -- 172.21.15.69:0/1190964880 <== mds.2 v2:172.21.15.92:6834/360295917 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561bf3e8a400 con 0x561bf3fdece0 2024-05-14T15:22:52.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.912+0000 7fbb41600700 10 client.15678 handle_command_reply: tid=0 2024-05-14T15:22:52.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.912+0000 7fbb6d1b1b80 1 client.15678 shutdown 2024-05-14T15:22:52.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.913+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/1190964880 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3ddce40 msgr2=0x561bf3f70490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.913+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/1190964880 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3ddce40 0x561bf3f70490 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x561bf3f673d0 tx=0x7fbb4800be80 comp rx=0 tx=0).stop 2024-05-14T15:22:52.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.913+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/1190964880 shutdown_connections 2024-05-14T15:22:52.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.913+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/1190964880 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561bf3ddce40 0x561bf3f70490 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.913+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/1190964880 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x561bf3fdece0 0x561bf3fe1100 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.913+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/1190964880 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561bf3f60830 0x561bf3f782b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.913+0000 7fbb6d1b1b80 1 --2- 172.21.15.69:0/1190964880 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561bf3f5a9f0 0x561bf3f77d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.913+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/1190964880 >> 172.21.15.69:0/1190964880 conn(0x561bf3e21f70 msgr2=0x561bf3f5dcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:52.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.913+0000 7fbb41600700 0 client.15678 ms_handle_reset on v2:172.21.15.92:6834/360295917 2024-05-14T15:22:52.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.913+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/1190964880 shutdown_connections 2024-05-14T15:22:52.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.913+0000 7fbb6d1b1b80 1 -- 172.21.15.69:0/1190964880 wait complete. 2024-05-14T15:22:52.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.913+0000 7fbb6d1b1b80 20 client.15678 trim_cache size 0 max 16384 2024-05-14T15:22:52.915 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:22:52.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.914+0000 7fbb5e600700 1 -- 172.21.15.69:0/2047441044 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbb3c0b2b90 msgr2=0x7fbb3c0b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.914+0000 7fbb5e600700 1 --2- 172.21.15.69:0/2047441044 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbb3c0b2b90 0x7fbb3c0b50a0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbb44009990 tx=0x7fbb44005050 comp rx=0 tx=0).stop 2024-05-14T15:22:52.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.914+0000 7fbb5e600700 1 -- 172.21.15.69:0/2047441044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb58109850 msgr2=0x7fbb58077650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:52.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.914+0000 7fbb5e600700 1 --2- 172.21.15.69:0/2047441044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb58109850 0x7fbb58077650 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbb5000b970 tx=0x7fbb5000bc80 comp rx=0 tx=0).stop 2024-05-14T15:22:52.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.914+0000 7fbb5e600700 1 -- 172.21.15.69:0/2047441044 shutdown_connections 2024-05-14T15:22:52.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.914+0000 7fbb5e600700 1 --2- 172.21.15.69:0/2047441044 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbb3c0b2b90 0x7fbb3c0b50a0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.914+0000 7fbb5e600700 1 --2- 172.21.15.69:0/2047441044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb58109850 0x7fbb58077650 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.914+0000 7fbb5e600700 1 --2- 172.21.15.69:0/2047441044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb581045d0 0x7fbb58076bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.914+0000 7fbb5e600700 1 --2- 172.21.15.69:0/2047441044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb58108f00 0x7fbb58077110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:52.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.914+0000 7fbb5e600700 1 -- 172.21.15.69:0/2047441044 >> 172.21.15.69:0/2047441044 conn(0x7fbb580ffea0 msgr2=0x7fbb5810a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:52.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.914+0000 7fbb5e600700 1 -- 172.21.15.69:0/2047441044 shutdown_connections 2024-05-14T15:22:52.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:52.915+0000 7fbb5e600700 1 -- 172.21.15.69:0/2047441044 wait complete. 2024-05-14T15:22:53.401 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:53 smithi069 ceph-mon[31270]: pgmap v40: 129 pgs: 129 active+clean; 48 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 393 KiB/s wr, 185 op/s 2024-05-14T15:22:53.426 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -s 32 -i' 2024-05-14T15:22:53.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:53 smithi092 ceph-mon[34729]: pgmap v40: 129 pgs: 129 active+clean; 48 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 393 KiB/s wr, 185 op/s 2024-05-14T15:22:53.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:53 smithi203 ceph-mon[34567]: pgmap v40: 129 pgs: 129 active+clean; 48 MiB data, 547 MiB used, 1.0 TiB / 1.0 TiB avail; 330 KiB/s rd, 393 KiB/s wr, 185 op/s 2024-05-14T15:22:53.814 INFO:teuthology.orchestra.run.smithi069.stderr:dropping old tables... 2024-05-14T15:22:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:NOTICE: table "pgbench_accounts" does not exist, skipping 2024-05-14T15:22:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:NOTICE: table "pgbench_branches" does not exist, skipping 2024-05-14T15:22:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:NOTICE: table "pgbench_history" does not exist, skipping 2024-05-14T15:22:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:NOTICE: table "pgbench_tellers" does not exist, skipping 2024-05-14T15:22:53.863 INFO:teuthology.orchestra.run.smithi069.stderr:creating tables... 2024-05-14T15:22:53.944 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-14T15:22:54.170 INFO:teuthology.orchestra.run.smithi069.stderr:generating data (client-side)... 2024-05-14T15:22:54.387 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:22:55.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:55 smithi092 ceph-mon[34729]: pgmap v41: 129 pgs: 129 active+clean; 44 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 423 KiB/s wr, 199 op/s 2024-05-14T15:22:55.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:55 smithi069 ceph-mon[31270]: pgmap v41: 129 pgs: 129 active+clean; 44 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 423 KiB/s wr, 199 op/s 2024-05-14T15:22:55.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:55 smithi203 ceph-mon[34567]: pgmap v41: 129 pgs: 129 active+clean; 44 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 341 KiB/s rd, 423 KiB/s wr, 199 op/s 2024-05-14T15:22:56.205 INFO:teuthology.orchestra.run.smithi069.stderr:100000 of 3200000 tuples (3%) done (elapsed 1.81 s, remaining 56.24 s) 2024-05-14T15:22:56.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.888+0000 7f8579600700 1 -- 172.21.15.69:0/503652878 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856800bab0 con 0x7f857c075b60 2024-05-14T15:22:56.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.889+0000 7f8581800700 1 -- 172.21.15.69:0/503652878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f857c075b60 msgr2=0x7f857c075f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:56.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.889+0000 7f8581800700 1 --2- 172.21.15.69:0/503652878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f857c075b60 0x7f857c075f70 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8568009990 tx=0x7f8568009ca0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.889+0000 7f8581800700 1 -- 172.21.15.69:0/503652878 shutdown_connections 2024-05-14T15:22:56.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.889+0000 7f8581800700 1 --2- 172.21.15.69:0/503652878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f857c075b60 0x7f857c075f70 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.889+0000 7f8581800700 1 --2- 172.21.15.69:0/503652878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f857c115370 0x7f857c117790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.889+0000 7f8581800700 1 --2- 172.21.15.69:0/503652878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f857c0764b0 0x7f857c114e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.889+0000 7f8581800700 1 -- 172.21.15.69:0/503652878 >> 172.21.15.69:0/503652878 conn(0x7f857c100040 msgr2=0x7f857c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:56.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.889+0000 7f8581800700 1 -- 172.21.15.69:0/503652878 shutdown_connections 2024-05-14T15:22:56.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.889+0000 7f8581800700 1 -- 172.21.15.69:0/503652878 wait complete. 2024-05-14T15:22:56.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.891+0000 7f8581800700 1 Processor -- start 2024-05-14T15:22:56.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.891+0000 7f8581800700 1 -- start start 2024-05-14T15:22:56.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.892+0000 7f8581800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f857c075b60 0x7f857c1a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.892+0000 7f8581800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f857c0764b0 0x7f857c1a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.892+0000 7f8581800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f857c115370 0x7f857c1a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.892+0000 7f8581800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f857c11a9d0 con 0x7f857c115370 2024-05-14T15:22:56.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.892+0000 7f8581800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f857c11a850 con 0x7f857c075b60 2024-05-14T15:22:56.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.892+0000 7f8581800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f857c11ab50 con 0x7f857c0764b0 2024-05-14T15:22:56.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.892+0000 7f857b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f857c115370 0x7f857c1a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.892+0000 7f857b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f857c115370 0x7f857c1a5b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35988/0 (socket says 172.21.15.69:35988) 2024-05-14T15:22:56.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.892+0000 7f857b400700 1 -- 172.21.15.69:0/3222888096 learned_addr learned my addr 172.21.15.69:0/3222888096 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.892+0000 7f857a000700 1 --2- 172.21.15.69:0/3222888096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f857c0764b0 0x7f857c1a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.892+0000 7f857aa00700 1 --2- 172.21.15.69:0/3222888096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f857c075b60 0x7f857c1a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.893+0000 7f857a000700 1 -- 172.21.15.69:0/3222888096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f857c075b60 msgr2=0x7f857c1a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.893+0000 7f857a000700 1 --2- 172.21.15.69:0/3222888096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f857c075b60 0x7f857c1a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.893+0000 7f857a000700 1 -- 172.21.15.69:0/3222888096 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f857c115370 msgr2=0x7f857c1a5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.893+0000 7f857a000700 1 --2- 172.21.15.69:0/3222888096 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f857c115370 0x7f857c1a5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.893+0000 7f857a000700 1 -- 172.21.15.69:0/3222888096 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f857c1a6230 con 0x7f857c0764b0 2024-05-14T15:22:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.893+0000 7f857a000700 1 --2- 172.21.15.69:0/3222888096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f857c0764b0 0x7f857c1a1900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f856c00d750 tx=0x7f856c00da60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:56.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.894+0000 7f8573400700 1 -- 172.21.15.69:0/3222888096 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c014030 con 0x7f857c0764b0 2024-05-14T15:22:56.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.894+0000 7f8573400700 1 -- 172.21.15.69:0/3222888096 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f856c0044b0 con 0x7f857c0764b0 2024-05-14T15:22:56.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.894+0000 7f8573400700 1 -- 172.21.15.69:0/3222888096 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c0052f0 con 0x7f857c0764b0 2024-05-14T15:22:56.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.894+0000 7f8581800700 1 -- 172.21.15.69:0/3222888096 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f857c1a6520 con 0x7f857c0764b0 2024-05-14T15:22:56.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.894+0000 7f8581800700 1 -- 172.21.15.69:0/3222888096 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f857c1a6950 con 0x7f857c0764b0 2024-05-14T15:22:56.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.901+0000 7f8573400700 1 -- 172.21.15.69:0/3222888096 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 24) ==== 149885+0+0 (secure 0 0 0) 0x7f856c004750 con 0x7f857c0764b0 2024-05-14T15:22:56.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.902+0000 7f8573400700 1 --2- 172.21.15.69:0/3222888096 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f85600b2b10 0x7f85600b5020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.903+0000 7f8573400700 1 -- 172.21.15.69:0/3222888096 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f856c0e24c0 con 0x7f857c0764b0 2024-05-14T15:22:56.903 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.903+0000 7f857aa00700 1 --2- 172.21.15.69:0/3222888096 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f85600b2b10 0x7f85600b5020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.904+0000 7f859037cb80 1 Processor -- start 2024-05-14T15:22:56.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.904+0000 7f859037cb80 1 -- start start 2024-05-14T15:22:56.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.905+0000 7f857aa00700 1 --2- 172.21.15.69:0/3222888096 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f85600b2b10 0x7f85600b5020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f856800b2e0 tx=0x7f8568005fb0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:56.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.905+0000 7f859037cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16aed8e40 0x55b16b05c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.905+0000 7f859037cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b05cbf0 0x55b16b056710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.905+0000 7f859037cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16b056c50 0x55b16b057060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.905+0000 7f859037cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55b16af78a20 con 0x55b16b05cbf0 2024-05-14T15:22:56.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.905+0000 7f859037cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b16af16760 con 0x55b16b056c50 2024-05-14T15:22:56.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.905+0000 7f859037cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b16af749e0 con 0x55b16aed8e40 2024-05-14T15:22:56.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.906+0000 7f857aa00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16aed8e40 0x55b16b05c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.906+0000 7f857aa00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16aed8e40 0x55b16b05c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:47638/0 (socket says 172.21.15.69:47638) 2024-05-14T15:22:56.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.906+0000 7f857aa00700 1 -- 172.21.15.69:0/4196153400 learned_addr learned my addr 172.21.15.69:0/4196153400 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:56.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.906+0000 7f857b400700 1 --2- 172.21.15.69:0/4196153400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16b056c50 0x55b16b057060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.906+0000 7f857a000700 1 --2- 172.21.15.69:0/4196153400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b05cbf0 0x55b16b056710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.906+0000 7f857aa00700 1 -- 172.21.15.69:0/4196153400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16b056c50 msgr2=0x55b16b057060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:56.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.906+0000 7f857aa00700 1 --2- 172.21.15.69:0/4196153400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16b056c50 0x55b16b057060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.906+0000 7f857aa00700 1 -- 172.21.15.69:0/4196153400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b05cbf0 msgr2=0x55b16b056710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:56.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.907+0000 7f857aa00700 1 --2- 172.21.15.69:0/4196153400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b05cbf0 0x55b16b056710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.907+0000 7f857aa00700 1 -- 172.21.15.69:0/4196153400 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b16aec58d0 con 0x55b16aed8e40 2024-05-14T15:22:56.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.907+0000 7f857a000700 1 --2- 172.21.15.69:0/4196153400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b05cbf0 0x55b16b056710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:22:56.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.908+0000 7f857aa00700 1 --2- 172.21.15.69:0/4196153400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16aed8e40 0x55b16b05c6b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8568015000 tx=0x7f856801e000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3439a3b91771b758 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:56.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.908+0000 7f8567e00700 1 -- 172.21.15.69:0/4196153400 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8568003880 con 0x55b16aed8e40 2024-05-14T15:22:56.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.908+0000 7f8567e00700 1 -- 172.21.15.69:0/4196153400 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8568025470 con 0x55b16aed8e40 2024-05-14T15:22:56.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.908+0000 7f8567e00700 1 -- 172.21.15.69:0/4196153400 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856800f6c0 con 0x55b16aed8e40 2024-05-14T15:22:56.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.909+0000 7f859037cb80 1 -- 172.21.15.69:0/4196153400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16aed8e40 msgr2=0x55b16b05c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:56.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.909+0000 7f859037cb80 1 --2- 172.21.15.69:0/4196153400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16aed8e40 0x55b16b05c6b0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8568015000 tx=0x7f856801e000 comp rx=0 tx=0).stop 2024-05-14T15:22:56.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.909+0000 7f859037cb80 1 -- 172.21.15.69:0/4196153400 shutdown_connections 2024-05-14T15:22:56.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.909+0000 7f859037cb80 1 --2- 172.21.15.69:0/4196153400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16b056c50 0x55b16b057060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.909+0000 7f859037cb80 1 --2- 172.21.15.69:0/4196153400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16aed8e40 0x55b16b05c6b0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.909+0000 7f859037cb80 1 --2- 172.21.15.69:0/4196153400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b05cbf0 0x55b16b056710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.909+0000 7f859037cb80 1 -- 172.21.15.69:0/4196153400 >> 172.21.15.69:0/4196153400 conn(0x55b16af17a80 msgr2=0x55b16b051790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:56.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.910+0000 7f859037cb80 1 -- 172.21.15.69:0/4196153400 shutdown_connections 2024-05-14T15:22:56.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.910+0000 7f859037cb80 1 -- 172.21.15.69:0/4196153400 wait complete. 2024-05-14T15:22:56.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.911+0000 7f859037cb80 1 -- start start 2024-05-14T15:22:56.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.911+0000 7f859037cb80 1 Processor -- start 2024-05-14T15:22:56.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.912+0000 7f859037cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16aed8e40 0x55b16b0603d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.912+0000 7f859037cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16b056c50 0x55b16b060910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.912+0000 7f859037cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b05cbf0 0x55b16b060e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.912+0000 7f859037cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55b16b063660 con 0x55b16b05cbf0 2024-05-14T15:22:56.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.912+0000 7f859037cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55b16aedeb20 con 0x55b16b056c50 2024-05-14T15:22:56.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.912+0000 7f859037cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55b16b0637e0 con 0x55b16aed8e40 2024-05-14T15:22:56.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.912+0000 7f859037cb80 10 client.0 _ll_register_callbacks cb 0x55b16af0c380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:56.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.912+0000 7f857aa00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16aed8e40 0x55b16b0603d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.912+0000 7f857aa00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16aed8e40 0x55b16b0603d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:47646/0 (socket says 172.21.15.69:47646) 2024-05-14T15:22:56.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.912+0000 7f857aa00700 1 -- 172.21.15.69:0/3788940373 learned_addr learned my addr 172.21.15.69:0/3788940373 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:56.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.913+0000 7f857a000700 1 --2- 172.21.15.69:0/3788940373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16b056c50 0x55b16b060910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.912+0000 7f857b400700 1 --2- 172.21.15.69:0/3788940373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b05cbf0 0x55b16b060e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.913+0000 7f857b400700 1 -- 172.21.15.69:0/3788940373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16aed8e40 msgr2=0x55b16b0603d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:56.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.913+0000 7f857b400700 1 --2- 172.21.15.69:0/3788940373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16aed8e40 0x55b16b0603d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.913+0000 7f857b400700 1 -- 172.21.15.69:0/3788940373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16b056c50 msgr2=0x55b16b060910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:56.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.913+0000 7f857b400700 1 --2- 172.21.15.69:0/3788940373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16b056c50 0x55b16b060910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.913+0000 7f857b400700 1 -- 172.21.15.69:0/3788940373 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b16af3e420 con 0x55b16b05cbf0 2024-05-14T15:22:56.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.913+0000 7f857a000700 1 --2- 172.21.15.69:0/3788940373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16b056c50 0x55b16b060910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:22:56.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.914+0000 7f857b400700 1 --2- 172.21.15.69:0/3788940373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b05cbf0 0x55b16b060e50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8574009c10 tx=0x7f8574014600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd8ee806ec0d76a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:56.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.914+0000 7f8564c00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:22:56.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.914+0000 7f8564c00700 1 -- 172.21.15.69:0/3788940373 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8574004db0 con 0x55b16b05cbf0 2024-05-14T15:22:56.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.914+0000 7f8564c00700 1 -- 172.21.15.69:0/3788940373 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f85740090d0 con 0x55b16b05cbf0 2024-05-14T15:22:56.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.914+0000 7f859037cb80 1 -- 172.21.15.69:0/3788940373 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8568025470 con 0x55b16b05cbf0 2024-05-14T15:22:56.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.915+0000 7f8564c00700 1 -- 172.21.15.69:0/3788940373 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f8574026050 con 0x55b16b05cbf0 2024-05-14T15:22:56.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.915+0000 7f859037cb80 10 client.15690 fetch_fsmap learned FSMap version 33 2024-05-14T15:22:56.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.915+0000 7f859037cb80 1 -- 172.21.15.69:0/3788940373 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b16b06e310 con 0x55b16b05cbf0 2024-05-14T15:22:56.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.916+0000 7f8564c00700 1 -- 172.21.15.69:0/3788940373 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8568025470 con 0x55b16b05cbf0 2024-05-14T15:22:56.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.916+0000 7f8564c00700 1 -- 172.21.15.69:0/3788940373 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f8574004320 con 0x55b16b05cbf0 2024-05-14T15:22:56.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.916+0000 7f859037cb80 10 client.15690 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:22:56.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.916+0000 7f859037cb80 10 client.15690 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-14T15:22:56.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.916+0000 7f859037cb80 20 client.15690 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:56.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.916+0000 7f859037cb80 1 --2- 172.21.15.69:0/3788940373 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55b16b070950 0x55b16b072df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.916+0000 7f859037cb80 4 client.15690 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:22:56.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.916+0000 7f859037cb80 1 -- 172.21.15.69:0/3788940373 --> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b16b023070 con 0x55b16b070950 2024-05-14T15:22:56.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.917+0000 7f857aa00700 1 --2- 172.21.15.69:0/3788940373 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55b16b070950 0x55b16b072df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.918+0000 7f857aa00700 1 --2- 172.21.15.69:0/3788940373 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55b16b070950 0x55b16b072df0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=13bc025e698f60b6 server_cookie=4abb7729882c01c0 in_seq=0 out_seq=0 2024-05-14T15:22:56.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.918+0000 7f8564c00700 10 client.15690 ms_handle_connect on v2:172.21.15.92:6836/1669439322 2024-05-14T15:22:56.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.919+0000 7f8564c00700 1 -- 172.21.15.69:0/3788940373 <== mds.1 v2:172.21.15.92:6836/1669439322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55b16b023070 con 0x55b16b070950 2024-05-14T15:22:56.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.919+0000 7f8564c00700 10 client.15690 handle_command_reply: tid=0 2024-05-14T15:22:56.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.919+0000 7f859037cb80 1 client.15690 shutdown 2024-05-14T15:22:56.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.919+0000 7f859037cb80 1 -- 172.21.15.69:0/3788940373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b05cbf0 msgr2=0x55b16b060e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:56.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.919+0000 7f859037cb80 1 --2- 172.21.15.69:0/3788940373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b05cbf0 0x55b16b060e50 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8574009c10 tx=0x7f8574014600 comp rx=0 tx=0).stop 2024-05-14T15:22:56.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.920+0000 7f859037cb80 1 -- 172.21.15.69:0/3788940373 shutdown_connections 2024-05-14T15:22:56.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.920+0000 7f859037cb80 1 --2- 172.21.15.69:0/3788940373 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55b16b070950 0x55b16b072df0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.920+0000 7f859037cb80 1 --2- 172.21.15.69:0/3788940373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b05cbf0 0x55b16b060e50 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.920+0000 7f859037cb80 1 --2- 172.21.15.69:0/3788940373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16aed8e40 0x55b16b0603d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.920+0000 7f8564c00700 0 client.15690 ms_handle_reset on v2:172.21.15.92:6836/1669439322 2024-05-14T15:22:56.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.920+0000 7f859037cb80 1 --2- 172.21.15.69:0/3788940373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16b056c50 0x55b16b060910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.920+0000 7f859037cb80 1 -- 172.21.15.69:0/3788940373 >> 172.21.15.69:0/3788940373 conn(0x55b16af17a80 msgr2=0x55b16b04b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:56.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.920+0000 7f859037cb80 1 -- 172.21.15.69:0/3788940373 shutdown_connections 2024-05-14T15:22:56.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.920+0000 7f859037cb80 1 -- 172.21.15.69:0/3788940373 wait complete. 2024-05-14T15:22:56.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.920+0000 7f859037cb80 20 client.15690 trim_cache size 0 max 16384 2024-05-14T15:22:56.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.943+0000 7f859037cb80 1 Processor -- start 2024-05-14T15:22:56.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.943+0000 7f859037cb80 1 -- start start 2024-05-14T15:22:56.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.944+0000 7f859037cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16aed8e40 0x55b16b056710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.944+0000 7f859037cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b056c50 0x55b16b05ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.944+0000 7f859037cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16b05cbf0 0x55b16b06c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.944+0000 7f859037cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f857c1bf450 con 0x55b16b056c50 2024-05-14T15:22:56.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.944+0000 7f859037cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f857c1c1080 con 0x55b16aed8e40 2024-05-14T15:22:56.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.944+0000 7f859037cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f857c1bfb20 con 0x55b16b05cbf0 2024-05-14T15:22:56.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.944+0000 7f857aa00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16aed8e40 0x55b16b056710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.944+0000 7f857aa00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16aed8e40 0x55b16b056710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:52772/0 (socket says 172.21.15.69:52772) 2024-05-14T15:22:56.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.944+0000 7f857aa00700 1 -- 172.21.15.69:0/2783166922 learned_addr learned my addr 172.21.15.69:0/2783166922 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:56.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.944+0000 7f857b400700 1 --2- 172.21.15.69:0/2783166922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16b05cbf0 0x55b16b06c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.944+0000 7f857a000700 1 --2- 172.21.15.69:0/2783166922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b056c50 0x55b16b05ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.945+0000 7f857aa00700 1 -- 172.21.15.69:0/2783166922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16b05cbf0 msgr2=0x55b16b06c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:56.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.945+0000 7f857aa00700 1 --2- 172.21.15.69:0/2783166922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16b05cbf0 0x55b16b06c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.945+0000 7f857aa00700 1 -- 172.21.15.69:0/2783166922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b056c50 msgr2=0x55b16b05ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:56.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.945+0000 7f857aa00700 1 --2- 172.21.15.69:0/2783166922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b056c50 0x55b16b05ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.945+0000 7f857aa00700 1 -- 172.21.15.69:0/2783166922 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b16b05c080 con 0x55b16aed8e40 2024-05-14T15:22:56.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.945+0000 7f857a000700 1 --2- 172.21.15.69:0/2783166922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b056c50 0x55b16b05ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:22:56.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.945+0000 7f857aa00700 1 --2- 172.21.15.69:0/2783166922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16aed8e40 0x55b16b056710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f85680050a0 tx=0x7f85680096e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bb72ef427faafe30 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:56.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.945+0000 7f8567400700 1 -- 172.21.15.69:0/2783166922 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85680258a0 con 0x55b16aed8e40 2024-05-14T15:22:56.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.946+0000 7f8567400700 1 -- 172.21.15.69:0/2783166922 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8568025a40 con 0x55b16aed8e40 2024-05-14T15:22:56.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.946+0000 7f8567400700 1 -- 172.21.15.69:0/2783166922 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856800f6c0 con 0x55b16aed8e40 2024-05-14T15:22:56.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.947+0000 7f859037cb80 1 -- 172.21.15.69:0/2783166922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16aed8e40 msgr2=0x55b16b056710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:56.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.947+0000 7f859037cb80 1 --2- 172.21.15.69:0/2783166922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16aed8e40 0x55b16b056710 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f85680050a0 tx=0x7f85680096e0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.947+0000 7f859037cb80 1 -- 172.21.15.69:0/2783166922 shutdown_connections 2024-05-14T15:22:56.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.947+0000 7f859037cb80 1 --2- 172.21.15.69:0/2783166922 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16b05cbf0 0x55b16b06c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.947+0000 7f859037cb80 1 --2- 172.21.15.69:0/2783166922 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16aed8e40 0x55b16b056710 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.947+0000 7f859037cb80 1 --2- 172.21.15.69:0/2783166922 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16b056c50 0x55b16b05ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.947+0000 7f859037cb80 1 -- 172.21.15.69:0/2783166922 >> 172.21.15.69:0/2783166922 conn(0x55b16af17a80 msgr2=0x55b16b051500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:56.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.947+0000 7f859037cb80 1 -- 172.21.15.69:0/2783166922 shutdown_connections 2024-05-14T15:22:56.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.948+0000 7f859037cb80 1 -- 172.21.15.69:0/2783166922 wait complete. 2024-05-14T15:22:56.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.948+0000 7f859037cb80 1 -- start start 2024-05-14T15:22:56.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.949+0000 7f859037cb80 1 Processor -- start 2024-05-14T15:22:56.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.950+0000 7f859037cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16aed8e40 0x55b16b0780f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.950+0000 7f859037cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16b056c50 0x55b16b078630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.950+0000 7f859037cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16b05cbf0 0x55b16b0da160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.950+0000 7f859037cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f857c1c08f0 con 0x55b16aed8e40 2024-05-14T15:22:56.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.950+0000 7f859037cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f857c1c0220 con 0x55b16b05cbf0 2024-05-14T15:22:56.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.950+0000 7f859037cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f857c073f80 con 0x55b16b056c50 2024-05-14T15:22:56.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.950+0000 7f859037cb80 10 client.0 _ll_register_callbacks cb 0x55b16af0c380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:22:56.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.950+0000 7f857a000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16b056c50 0x55b16b078630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.950+0000 7f857a000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16b056c50 0x55b16b078630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:47664/0 (socket says 172.21.15.69:47664) 2024-05-14T15:22:56.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.950+0000 7f857a000700 1 -- 172.21.15.69:0/3934466925 learned_addr learned my addr 172.21.15.69:0/3934466925 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:22:56.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.951+0000 7f857aa00700 1 --2- 172.21.15.69:0/3934466925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16aed8e40 0x55b16b0780f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.951+0000 7f857b400700 1 --2- 172.21.15.69:0/3934466925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16b05cbf0 0x55b16b0da160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.952+0000 7f857a000700 1 -- 172.21.15.69:0/3934466925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16b05cbf0 msgr2=0x55b16b0da160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:56.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.952+0000 7f857a000700 1 --2- 172.21.15.69:0/3934466925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16b05cbf0 0x55b16b0da160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.952+0000 7f857a000700 1 -- 172.21.15.69:0/3934466925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16aed8e40 msgr2=0x55b16b0780f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:22:56.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.952+0000 7f857a000700 1 --2- 172.21.15.69:0/3934466925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16aed8e40 0x55b16b0780f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.952+0000 7f857a000700 1 -- 172.21.15.69:0/3934466925 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b16b078e50 con 0x55b16b056c50 2024-05-14T15:22:56.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.952+0000 7f857aa00700 1 --2- 172.21.15.69:0/3934466925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16aed8e40 0x55b16b0780f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:22:56.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.953+0000 7f857a000700 1 --2- 172.21.15.69:0/3934466925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16b056c50 0x55b16b078630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f856c0a91d0 tx=0x7f856c0a9780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7b79678e5117a197 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:22:56.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.953+0000 7f8564c00700 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:22:56.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.954+0000 7f8564c00700 1 -- 172.21.15.69:0/3934466925 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f856c01d040 con 0x55b16b056c50 2024-05-14T15:22:56.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.954+0000 7f859037cb80 1 -- 172.21.15.69:0/3934466925 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8568025a40 con 0x55b16b056c50 2024-05-14T15:22:56.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.954+0000 7f8564c00700 1 -- 172.21.15.69:0/3934466925 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f856c0ad150 con 0x55b16b056c50 2024-05-14T15:22:56.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.954+0000 7f8564c00700 1 -- 172.21.15.69:0/3934466925 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f856c0ad3b0 con 0x55b16b056c50 2024-05-14T15:22:56.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.954+0000 7f859037cb80 10 client.25276 fetch_fsmap learned FSMap version 33 2024-05-14T15:22:56.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.954+0000 7f859037cb80 1 -- 172.21.15.69:0/3934466925 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55b16b0db670 con 0x55b16b056c50 2024-05-14T15:22:56.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.955+0000 7f8564c00700 1 -- 172.21.15.69:0/3934466925 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8568025a40 con 0x55b16b056c50 2024-05-14T15:22:56.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.955+0000 7f8564c00700 1 -- 172.21.15.69:0/3934466925 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f856c005490 con 0x55b16b056c50 2024-05-14T15:22:56.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.955+0000 7f859037cb80 10 client.25276 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:22:56.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.955+0000 7f859037cb80 10 client.25276 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-14T15:22:56.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.955+0000 7f859037cb80 20 client.25276 populate_metadata read hostname 'smithi069' 2024-05-14T15:22:56.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.955+0000 7f859037cb80 1 --2- 172.21.15.69:0/3934466925 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55b16b0dbd80 0x55b16b0de1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:22:56.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.955+0000 7f859037cb80 4 client.25276 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:22:56.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.955+0000 7f859037cb80 1 -- 172.21.15.69:0/3934466925 --> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b16af86400 con 0x55b16b0dbd80 2024-05-14T15:22:56.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.956+0000 7f857aa00700 1 --2- 172.21.15.69:0/3934466925 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55b16b0dbd80 0x55b16b0de1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:22:56.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.957+0000 7f857aa00700 1 --2- 172.21.15.69:0/3934466925 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55b16b0dbd80 0x55b16b0de1a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c3f2632dacd71f5 server_cookie=3a86bacc5c8963f2 in_seq=0 out_seq=0 2024-05-14T15:22:56.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.957+0000 7f8564c00700 10 client.25276 ms_handle_connect on v2:172.21.15.92:6836/1669439322 2024-05-14T15:22:56.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.957+0000 7f8564c00700 1 -- 172.21.15.69:0/3934466925 <== mds.1 v2:172.21.15.92:6836/1669439322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b16af86400 con 0x55b16b0dbd80 2024-05-14T15:22:56.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.957+0000 7f8564c00700 10 client.25276 handle_command_reply: tid=0 2024-05-14T15:22:56.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.957+0000 7f859037cb80 1 client.25276 shutdown 2024-05-14T15:22:56.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.958+0000 7f859037cb80 1 -- 172.21.15.69:0/3934466925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16b056c50 msgr2=0x55b16b078630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:56.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.958+0000 7f859037cb80 1 --2- 172.21.15.69:0/3934466925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16b056c50 0x55b16b078630 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f856c0a91d0 tx=0x7f856c0a9780 comp rx=0 tx=0).stop 2024-05-14T15:22:56.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.958+0000 7f859037cb80 1 -- 172.21.15.69:0/3934466925 shutdown_connections 2024-05-14T15:22:56.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.958+0000 7f859037cb80 1 --2- 172.21.15.69:0/3934466925 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55b16b0dbd80 0x55b16b0de1a0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.958+0000 7f859037cb80 1 --2- 172.21.15.69:0/3934466925 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55b16aed8e40 0x55b16b0780f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.958+0000 7f859037cb80 1 --2- 172.21.15.69:0/3934466925 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55b16b05cbf0 0x55b16b0da160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.958+0000 7f859037cb80 1 --2- 172.21.15.69:0/3934466925 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55b16b056c50 0x55b16b078630 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.958+0000 7f859037cb80 1 -- 172.21.15.69:0/3934466925 >> 172.21.15.69:0/3934466925 conn(0x55b16af17a80 msgr2=0x55b16b05eb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:56.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.958+0000 7f8564c00700 0 client.25276 ms_handle_reset on v2:172.21.15.92:6836/1669439322 2024-05-14T15:22:56.960 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:22:56.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.958+0000 7f859037cb80 1 -- 172.21.15.69:0/3934466925 shutdown_connections 2024-05-14T15:22:56.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.958+0000 7f859037cb80 1 -- 172.21.15.69:0/3934466925 wait complete. 2024-05-14T15:22:56.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.959+0000 7f859037cb80 20 client.25276 trim_cache size 0 max 16384 2024-05-14T15:22:56.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.959+0000 7f8581800700 1 -- 172.21.15.69:0/3222888096 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f85600b2b10 msgr2=0x7f85600b5020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:56.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.959+0000 7f8581800700 1 --2- 172.21.15.69:0/3222888096 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f85600b2b10 0x7f85600b5020 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f856800b2e0 tx=0x7f8568005fb0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.960+0000 7f8581800700 1 -- 172.21.15.69:0/3222888096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f857c0764b0 msgr2=0x7f857c1a1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:22:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.960+0000 7f8581800700 1 --2- 172.21.15.69:0/3222888096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f857c0764b0 0x7f857c1a1900 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f856c00d750 tx=0x7f856c00da60 comp rx=0 tx=0).stop 2024-05-14T15:22:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.960+0000 7f8581800700 1 -- 172.21.15.69:0/3222888096 shutdown_connections 2024-05-14T15:22:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.960+0000 7f8581800700 1 --2- 172.21.15.69:0/3222888096 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f85600b2b10 0x7f85600b5020 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.960+0000 7f8581800700 1 --2- 172.21.15.69:0/3222888096 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f857c115370 0x7f857c1a5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.960+0000 7f8581800700 1 --2- 172.21.15.69:0/3222888096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f857c075b60 0x7f857c1a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.960+0000 7f8581800700 1 --2- 172.21.15.69:0/3222888096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f857c0764b0 0x7f857c1a1900 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:22:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.960+0000 7f8581800700 1 -- 172.21.15.69:0/3222888096 >> 172.21.15.69:0/3222888096 conn(0x7f857c100040 msgr2=0x7f857c102000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:22:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.960+0000 7f8581800700 1 -- 172.21.15.69:0/3222888096 shutdown_connections 2024-05-14T15:22:56.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:22:56.960+0000 7f8581800700 1 -- 172.21.15.69:0/3222888096 wait complete. 2024-05-14T15:22:57.415 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:57 smithi069 ceph-mon[31270]: pgmap v42: 129 pgs: 129 active+clean; 44 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 218 KiB/s wr, 71 op/s 2024-05-14T15:22:57.416 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:57 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:22:57.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:57 smithi092 ceph-mon[34729]: pgmap v42: 129 pgs: 129 active+clean; 44 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 218 KiB/s wr, 71 op/s 2024-05-14T15:22:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:57 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:22:57.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:57 smithi203 ceph-mon[34567]: pgmap v42: 129 pgs: 129 active+clean; 44 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 199 KiB/s rd, 218 KiB/s wr, 71 op/s 2024-05-14T15:22:57.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:57 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:22:57.920 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-14T15:22:58.173 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:58 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:22:58.173 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:58 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:22:58.173 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:58 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:22:58.384 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:22:58.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:58 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:22:58.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:58 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:22:58.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:58 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:22:58.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:58 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:22:58.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:58 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:22:58.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:58 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:22:59.366 INFO:teuthology.orchestra.run.smithi069.stderr:200000 of 3200000 tuples (6%) done (elapsed 4.98 s, remaining 74.63 s) 2024-05-14T15:22:59.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:22:59 smithi092 ceph-mon[34729]: pgmap v43: 129 pgs: 129 active+clean; 44 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 216 KiB/s wr, 64 op/s 2024-05-14T15:22:59.466 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:22:59 smithi069 ceph-mon[31270]: pgmap v43: 129 pgs: 129 active+clean; 44 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 216 KiB/s wr, 64 op/s 2024-05-14T15:22:59.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:22:59 smithi203 ceph-mon[34567]: pgmap v43: 129 pgs: 129 active+clean; 44 MiB data, 535 MiB used, 1.0 TiB / 1.0 TiB avail; 198 KiB/s rd, 216 KiB/s wr, 64 op/s 2024-05-14T15:23:00.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.896+0000 7f56f0600700 1 -- 172.21.15.69:0/3699348211 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56e8107df0 msgr2=0x7f56e8108200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:00.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.896+0000 7f56f0600700 1 --2- 172.21.15.69:0/3699348211 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56e8107df0 0x7f56e8108200 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f56d40099c0 tx=0x7f56d4009cd0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.896+0000 7f56f0600700 1 -- 172.21.15.69:0/3699348211 shutdown_connections 2024-05-14T15:23:00.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.896+0000 7f56f0600700 1 --2- 172.21.15.69:0/3699348211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56e8108740 0x7f56e81100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.896+0000 7f56f0600700 1 --2- 172.21.15.69:0/3699348211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56e81034c0 0x7f56e81038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.896+0000 7f56f0600700 1 --2- 172.21.15.69:0/3699348211 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56e8107df0 0x7f56e8108200 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.896+0000 7f56f0600700 1 -- 172.21.15.69:0/3699348211 >> 172.21.15.69:0/3699348211 conn(0x7f56e80fedc0 msgr2=0x7f56e81011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:00.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.896+0000 7f56f0600700 1 -- 172.21.15.69:0/3699348211 shutdown_connections 2024-05-14T15:23:00.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.897+0000 7f56f0600700 1 -- 172.21.15.69:0/3699348211 wait complete. 2024-05-14T15:23:00.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.898+0000 7f56f0600700 1 Processor -- start 2024-05-14T15:23:00.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.898+0000 7f56f0600700 1 -- start start 2024-05-14T15:23:00.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.899+0000 7f56f0600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56e81034c0 0x7f56e819ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.899+0000 7f56f0600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56e8107df0 0x7f56e819b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.899+0000 7f56f0600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56e8108740 0x7f56e819f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.899+0000 7f56f0600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f56e8113250 con 0x7f56e81034c0 2024-05-14T15:23:00.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.899+0000 7f56f0600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81130d0 con 0x7f56e8107df0 2024-05-14T15:23:00.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.899+0000 7f56f0600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f56e81133d0 con 0x7f56e8108740 2024-05-14T15:23:00.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.899+0000 7f56edc00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56e81034c0 0x7f56e819ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.899+0000 7f56edc00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56e81034c0 0x7f56e819ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36052/0 (socket says 172.21.15.69:36052) 2024-05-14T15:23:00.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.899+0000 7f56edc00700 1 -- 172.21.15.69:0/3223219482 learned_addr learned my addr 172.21.15.69:0/3223219482 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:00.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.900+0000 7f56ed200700 1 --2- 172.21.15.69:0/3223219482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56e8107df0 0x7f56e819b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.900+0000 7f56ee600700 1 --2- 172.21.15.69:0/3223219482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56e8108740 0x7f56e819f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.900+0000 7f56edc00700 1 -- 172.21.15.69:0/3223219482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56e8108740 msgr2=0x7f56e819f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:00.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.900+0000 7f56edc00700 1 --2- 172.21.15.69:0/3223219482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56e8108740 0x7f56e819f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.900+0000 7f56edc00700 1 -- 172.21.15.69:0/3223219482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56e8107df0 msgr2=0x7f56e819b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:00.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.900+0000 7f56edc00700 1 --2- 172.21.15.69:0/3223219482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56e8107df0 0x7f56e819b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.900+0000 7f56edc00700 1 -- 172.21.15.69:0/3223219482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56e819fc20 con 0x7f56e81034c0 2024-05-14T15:23:00.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.901+0000 7f56edc00700 1 --2- 172.21.15.69:0/3223219482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56e81034c0 0x7f56e819ad50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00d950 tx=0x7f56dc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:00.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.901+0000 7f56e6000700 1 -- 172.21.15.69:0/3223219482 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc016070 con 0x7f56e81034c0 2024-05-14T15:23:00.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.901+0000 7f56f0600700 1 -- 172.21.15.69:0/3223219482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56e819ff10 con 0x7f56e81034c0 2024-05-14T15:23:00.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.901+0000 7f56f0600700 1 -- 172.21.15.69:0/3223219482 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56e80ff1d0 con 0x7f56e81034c0 2024-05-14T15:23:00.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.901+0000 7f56e6000700 1 -- 172.21.15.69:0/3223219482 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56dc010460 con 0x7f56e81034c0 2024-05-14T15:23:00.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.901+0000 7f56e6000700 1 -- 172.21.15.69:0/3223219482 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc00f620 con 0x7f56e81034c0 2024-05-14T15:23:00.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.906+0000 7f56e6000700 1 -- 172.21.15.69:0/3223219482 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 149885+0+0 (secure 0 0 0) 0x7f56dc019070 con 0x7f56e81034c0 2024-05-14T15:23:00.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.907+0000 7f56ff098b80 1 Processor -- start 2024-05-14T15:23:00.907 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.907+0000 7f56ff098b80 1 -- start start 2024-05-14T15:23:00.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.907+0000 7f56ff098b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af529e40 0x5578af6b5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.908+0000 7f56ff098b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b6010 0x5578af6afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.908+0000 7f56ff098b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b0200 0x5578af6b0610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.908+0000 7f56ff098b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5578af5c9a20 con 0x5578af6b6010 2024-05-14T15:23:00.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.908+0000 7f56ff098b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5578af567760 con 0x5578af6b0200 2024-05-14T15:23:00.908 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.908+0000 7f56ff098b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5578af5c59e0 con 0x5578af529e40 2024-05-14T15:23:00.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.908+0000 7f56ed200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b0200 0x5578af6b0610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.908+0000 7f56edc00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b6010 0x5578af6afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.908+0000 7f56ed200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b0200 0x5578af6b0610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:52794/0 (socket says 172.21.15.69:52794) 2024-05-14T15:23:00.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.908+0000 7f56ed200700 1 -- 172.21.15.69:0/3820578989 learned_addr learned my addr 172.21.15.69:0/3820578989 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:00.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.908+0000 7f56ee600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af529e40 0x5578af6b5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.909+0000 7f56edc00700 1 -- 172.21.15.69:0/3820578989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af529e40 msgr2=0x5578af6b5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:00.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.909+0000 7f56edc00700 1 --2- 172.21.15.69:0/3820578989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af529e40 0x5578af6b5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.909+0000 7f56e6000700 1 --2- 172.21.15.69:0/3223219482 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f56d00b2b90 0x7f56d00b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.909+0000 7f56edc00700 1 -- 172.21.15.69:0/3820578989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b0200 msgr2=0x5578af6b0610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:00.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.909+0000 7f56edc00700 1 --2- 172.21.15.69:0/3820578989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b0200 0x5578af6b0610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.909+0000 7f56edc00700 1 -- 172.21.15.69:0/3820578989 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578af5168d0 con 0x5578af6b6010 2024-05-14T15:23:00.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.909+0000 7f56ee600700 1 --2- 172.21.15.69:0/3820578989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af529e40 0x5578af6b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:23:00.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.910+0000 7f56e6000700 1 -- 172.21.15.69:0/3223219482 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f56dc0e2b70 con 0x7f56e81034c0 2024-05-14T15:23:00.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.910+0000 7f56ee600700 1 --2- 172.21.15.69:0/3223219482 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f56d00b2b90 0x7f56d00b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.910+0000 7f56edc00700 1 --2- 172.21.15.69:0/3820578989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b6010 0x5578af6afcc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0dfd30 tx=0x7f56dc0a5ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ce4b98a8538b76 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:00.911 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.911+0000 7f56daa00700 1 -- 172.21.15.69:0/3820578989 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc020070 con 0x5578af6b6010 2024-05-14T15:23:00.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.911+0000 7f56daa00700 1 -- 172.21.15.69:0/3820578989 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56dc010940 con 0x5578af6b6010 2024-05-14T15:23:00.912 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.911+0000 7f56daa00700 1 -- 172.21.15.69:0/3820578989 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56dc0aa920 con 0x5578af6b6010 2024-05-14T15:23:00.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.912+0000 7f56ff098b80 1 -- 172.21.15.69:0/3820578989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b6010 msgr2=0x5578af6afcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:00.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.912+0000 7f56ee600700 1 --2- 172.21.15.69:0/3223219482 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f56d00b2b90 0x7f56d00b50a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009e20 tx=0x7f56e0009040 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:00.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.912+0000 7f56ff098b80 1 --2- 172.21.15.69:0/3820578989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b6010 0x5578af6afcc0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f56dc0dfd30 tx=0x7f56dc0a5ec0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.913+0000 7f56ff098b80 1 -- 172.21.15.69:0/3820578989 shutdown_connections 2024-05-14T15:23:00.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.913+0000 7f56ff098b80 1 --2- 172.21.15.69:0/3820578989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b0200 0x5578af6b0610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.913+0000 7f56ff098b80 1 --2- 172.21.15.69:0/3820578989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af529e40 0x5578af6b5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.913 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.913+0000 7f56ff098b80 1 --2- 172.21.15.69:0/3820578989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b6010 0x5578af6afcc0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.913+0000 7f56ff098b80 1 -- 172.21.15.69:0/3820578989 >> 172.21.15.69:0/3820578989 conn(0x5578af56ef70 msgr2=0x5578af6a22d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:00.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.913+0000 7f56ff098b80 1 -- 172.21.15.69:0/3820578989 shutdown_connections 2024-05-14T15:23:00.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.913+0000 7f56ff098b80 1 -- 172.21.15.69:0/3820578989 wait complete. 2024-05-14T15:23:00.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.914+0000 7f56ff098b80 1 -- start start 2024-05-14T15:23:00.914 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.914+0000 7f56ff098b80 1 Processor -- start 2024-05-14T15:23:00.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.914+0000 7f56ff098b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af529e40 0x5578af6b9730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.914+0000 7f56ff098b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b0200 0x5578af6b9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.914+0000 7f56ff098b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af6b6010 0x5578af6ba1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.914+0000 7f56ff098b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5578af6bcb10 con 0x5578af529e40 2024-05-14T15:23:00.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.914+0000 7f56ff098b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5578af52fb20 con 0x5578af6b0200 2024-05-14T15:23:00.915 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.914+0000 7f56ff098b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5578af6bcc90 con 0x5578af6b6010 2024-05-14T15:23:00.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.915+0000 7f56ff098b80 10 client.0 _ll_register_callbacks cb 0x5578af570c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:00.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.915+0000 7f56edc00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af529e40 0x5578af6b9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.915+0000 7f56ed200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b0200 0x5578af6b9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.915+0000 7f56edc00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af529e40 0x5578af6b9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36062/0 (socket says 172.21.15.69:36062) 2024-05-14T15:23:00.916 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.915+0000 7f56edc00700 1 -- 172.21.15.69:0/4101858559 learned_addr learned my addr 172.21.15.69:0/4101858559 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:00.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.915+0000 7f56ee600700 1 --2- 172.21.15.69:0/4101858559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af6b6010 0x5578af6ba1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.916+0000 7f56ed200700 1 -- 172.21.15.69:0/4101858559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af6b6010 msgr2=0x5578af6ba1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:00.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.916+0000 7f56ed200700 1 --2- 172.21.15.69:0/4101858559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af6b6010 0x5578af6ba1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.916+0000 7f56ed200700 1 -- 172.21.15.69:0/4101858559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af529e40 msgr2=0x5578af6b9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:00.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.916+0000 7f56ed200700 1 --2- 172.21.15.69:0/4101858559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af529e40 0x5578af6b9730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.916+0000 7f56ed200700 1 -- 172.21.15.69:0/4101858559 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578af58f420 con 0x5578af6b0200 2024-05-14T15:23:00.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.917+0000 7f56ed200700 1 --2- 172.21.15.69:0/4101858559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b0200 0x5578af6b9c70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f56d4006010 tx=0x7f56d4005770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea80939314b2a42b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:00.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.917+0000 7f56cf400700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:23:00.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.917+0000 7f56cf400700 1 -- 172.21.15.69:0/4101858559 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4027060 con 0x5578af6b0200 2024-05-14T15:23:00.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.917+0000 7f56cf400700 1 -- 172.21.15.69:0/4101858559 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f56d400bba0 con 0x5578af6b0200 2024-05-14T15:23:00.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.918+0000 7f56ff098b80 1 -- 172.21.15.69:0/4101858559 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5578af6741c0 con 0x5578af6b0200 2024-05-14T15:23:00.919 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.918+0000 7f56cf400700 1 -- 172.21.15.69:0/4101858559 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f56d402e050 con 0x5578af6b0200 2024-05-14T15:23:00.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.918+0000 7f56ff098b80 10 client.35291 fetch_fsmap learned FSMap version 33 2024-05-14T15:23:00.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.918+0000 7f56ff098b80 1 -- 172.21.15.69:0/4101858559 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5578af6c7600 con 0x5578af6b0200 2024-05-14T15:23:00.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.919+0000 7f56cf400700 1 -- 172.21.15.69:0/4101858559 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x5578af6741c0 con 0x5578af6b0200 2024-05-14T15:23:00.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.919+0000 7f56cf400700 1 -- 172.21.15.69:0/4101858559 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f56d4021070 con 0x5578af6b0200 2024-05-14T15:23:00.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.919+0000 7f56ff098b80 10 client.35291 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:23:00.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.919+0000 7f56ff098b80 10 client.35291 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:00.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.919+0000 7f56ff098b80 20 client.35291 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:00.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.919+0000 7f56ff098b80 1 --2- 172.21.15.69:0/4101858559 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578af6c9c90 0x5578af6cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.919+0000 7f56ff098b80 4 client.35291 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:23:00.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.919+0000 7f56ff098b80 1 -- 172.21.15.69:0/4101858559 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578af5d7400 con 0x5578af6c9c90 2024-05-14T15:23:00.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.920+0000 7f56edc00700 1 --2- 172.21.15.69:0/4101858559 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578af6c9c90 0x5578af6cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.921+0000 7f56edc00700 1 --2- 172.21.15.69:0/4101858559 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578af6c9c90 0x5578af6cc0f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c23e8b36a75478fd server_cookie=8abbd66f390922ef in_seq=0 out_seq=0 2024-05-14T15:23:00.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.921+0000 7f56cf400700 10 client.35291 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:00.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.923+0000 7f56cf400700 1 -- 172.21.15.69:0/4101858559 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5578af5d7400 con 0x5578af6c9c90 2024-05-14T15:23:00.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.923+0000 7f56cf400700 10 client.35291 handle_command_reply: tid=0 2024-05-14T15:23:00.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.923+0000 7f56ff098b80 1 client.35291 shutdown 2024-05-14T15:23:00.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.923+0000 7f56ff098b80 1 -- 172.21.15.69:0/4101858559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b0200 msgr2=0x5578af6b9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:00.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.923+0000 7f56ff098b80 1 --2- 172.21.15.69:0/4101858559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b0200 0x5578af6b9c70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f56d4006010 tx=0x7f56d4005770 comp rx=0 tx=0).stop 2024-05-14T15:23:00.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.924+0000 7f56ff098b80 1 -- 172.21.15.69:0/4101858559 shutdown_connections 2024-05-14T15:23:00.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.924+0000 7f56ff098b80 1 --2- 172.21.15.69:0/4101858559 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578af6c9c90 0x5578af6cc0f0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.924+0000 7f56ff098b80 1 --2- 172.21.15.69:0/4101858559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af529e40 0x5578af6b9730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.924+0000 7f56ff098b80 1 --2- 172.21.15.69:0/4101858559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af6b6010 0x5578af6ba1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.924+0000 7f56ff098b80 1 --2- 172.21.15.69:0/4101858559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b0200 0x5578af6b9c70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.924+0000 7f56ff098b80 1 -- 172.21.15.69:0/4101858559 >> 172.21.15.69:0/4101858559 conn(0x5578af56ef70 msgr2=0x5578af6a64a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:00.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.924+0000 7f56cf400700 0 client.35291 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:00.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.924+0000 7f56ff098b80 1 -- 172.21.15.69:0/4101858559 shutdown_connections 2024-05-14T15:23:00.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.924+0000 7f56ff098b80 1 -- 172.21.15.69:0/4101858559 wait complete. 2024-05-14T15:23:00.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.925+0000 7f56ff098b80 20 client.35291 trim_cache size 0 max 16384 2024-05-14T15:23:00.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.942+0000 7f56ff098b80 1 Processor -- start 2024-05-14T15:23:00.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.942+0000 7f56ff098b80 1 -- start start 2024-05-14T15:23:00.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.943+0000 7f56ff098b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af529e40 0x5578af6afcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.943+0000 7f56ff098b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b0200 0x5578af6a2360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.943+0000 7f56ff098b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b6010 0x5578af6b9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.943+0000 7f56ff098b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f56c800ee80 con 0x5578af6b0200 2024-05-14T15:23:00.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.943+0000 7f56ff098b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f56c8010ab0 con 0x5578af6b6010 2024-05-14T15:23:00.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.943+0000 7f56ff098b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f56c800f550 con 0x5578af529e40 2024-05-14T15:23:00.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.943+0000 7f56ed200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b0200 0x5578af6a2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.943+0000 7f56ed200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b0200 0x5578af6a2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36072/0 (socket says 172.21.15.69:36072) 2024-05-14T15:23:00.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.943+0000 7f56ed200700 1 -- 172.21.15.69:0/450145928 learned_addr learned my addr 172.21.15.69:0/450145928 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:00.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.944+0000 7f56edc00700 1 --2- 172.21.15.69:0/450145928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af529e40 0x5578af6afcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.944+0000 7f56ee600700 1 --2- 172.21.15.69:0/450145928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b6010 0x5578af6b9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.944+0000 7f56ed200700 1 -- 172.21.15.69:0/450145928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af529e40 msgr2=0x5578af6afcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:00.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.944+0000 7f56ed200700 1 --2- 172.21.15.69:0/450145928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af529e40 0x5578af6afcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.944+0000 7f56ed200700 1 -- 172.21.15.69:0/450145928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b6010 msgr2=0x5578af6b9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:00.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.944+0000 7f56ed200700 1 --2- 172.21.15.69:0/450145928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b6010 0x5578af6b9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.944+0000 7f56ed200700 1 -- 172.21.15.69:0/450145928 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578af6a3b70 con 0x5578af6b0200 2024-05-14T15:23:00.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.944+0000 7f56ee600700 1 --2- 172.21.15.69:0/450145928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b6010 0x5578af6b9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:23:00.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.944+0000 7f56ed200700 1 --2- 172.21.15.69:0/450145928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b0200 0x5578af6a2360 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f56d40098e0 tx=0x7f56d4009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d25f4d4a941cdf50 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:00.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.945+0000 7f56da000700 1 -- 172.21.15.69:0/450145928 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4027070 con 0x5578af6b0200 2024-05-14T15:23:00.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.945+0000 7f56da000700 1 -- 172.21.15.69:0/450145928 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56d400be30 con 0x5578af6b0200 2024-05-14T15:23:00.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.945+0000 7f56da000700 1 -- 172.21.15.69:0/450145928 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4003ae0 con 0x5578af6b0200 2024-05-14T15:23:00.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.946+0000 7f56ff098b80 1 -- 172.21.15.69:0/450145928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b0200 msgr2=0x5578af6a2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:00.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.946+0000 7f56ff098b80 1 --2- 172.21.15.69:0/450145928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b0200 0x5578af6a2360 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f56d40098e0 tx=0x7f56d4009cd0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.946+0000 7f56ff098b80 1 -- 172.21.15.69:0/450145928 shutdown_connections 2024-05-14T15:23:00.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.946+0000 7f56ff098b80 1 --2- 172.21.15.69:0/450145928 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b6010 0x5578af6b9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.946+0000 7f56ff098b80 1 --2- 172.21.15.69:0/450145928 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af529e40 0x5578af6afcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.946+0000 7f56ff098b80 1 --2- 172.21.15.69:0/450145928 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b0200 0x5578af6a2360 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.946+0000 7f56ff098b80 1 -- 172.21.15.69:0/450145928 >> 172.21.15.69:0/450145928 conn(0x5578af56ef70 msgr2=0x5578af6b3490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:00.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.947+0000 7f56ff098b80 1 -- 172.21.15.69:0/450145928 shutdown_connections 2024-05-14T15:23:00.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.947+0000 7f56ff098b80 1 -- 172.21.15.69:0/450145928 wait complete. 2024-05-14T15:23:00.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.947+0000 7f56ff098b80 1 -- start start 2024-05-14T15:23:00.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.947+0000 7f56ff098b80 1 Processor -- start 2024-05-14T15:23:00.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.948+0000 7f56ff098b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af529e40 0x5578af6c2150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.948+0000 7f56ff098b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b0200 0x5578af6d0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.948+0000 7f56ff098b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b6010 0x5578af6d0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.948+0000 7f56ff098b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f56c8010320 con 0x5578af6b0200 2024-05-14T15:23:00.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.948+0000 7f56ff098b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f56c800fc50 con 0x5578af6b6010 2024-05-14T15:23:00.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.948+0000 7f56ff098b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f56c800ce20 con 0x5578af529e40 2024-05-14T15:23:00.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.948+0000 7f56ff098b80 10 client.0 _ll_register_callbacks cb 0x5578af570c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:00.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.948+0000 7f56ed200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b0200 0x5578af6d0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.949+0000 7f56ed200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b0200 0x5578af6d0a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36080/0 (socket says 172.21.15.69:36080) 2024-05-14T15:23:00.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.949+0000 7f56ed200700 1 -- 172.21.15.69:0/3065726822 learned_addr learned my addr 172.21.15.69:0/3065726822 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:00.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.949+0000 7f56edc00700 1 --2- 172.21.15.69:0/3065726822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af529e40 0x5578af6c2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.949+0000 7f56ee600700 1 --2- 172.21.15.69:0/3065726822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b6010 0x5578af6d0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.949+0000 7f56ed200700 1 -- 172.21.15.69:0/3065726822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af529e40 msgr2=0x5578af6c2150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:00.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.949+0000 7f56ed200700 1 --2- 172.21.15.69:0/3065726822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af529e40 0x5578af6c2150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.949+0000 7f56ed200700 1 -- 172.21.15.69:0/3065726822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b6010 msgr2=0x5578af6d0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:00.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.949+0000 7f56ed200700 1 --2- 172.21.15.69:0/3065726822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b6010 0x5578af6d0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.949+0000 7f56ed200700 1 -- 172.21.15.69:0/3065726822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578af6d1500 con 0x5578af6b0200 2024-05-14T15:23:00.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.950+0000 7f56ed200700 1 --2- 172.21.15.69:0/3065726822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b0200 0x5578af6d0a80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f56d40054b0 tx=0x7f56d4009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7237360cc4a00429 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:00.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.950+0000 7f56cf400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:00.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.950+0000 7f56cf400700 1 -- 172.21.15.69:0/3065726822 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56d4041060 con 0x5578af6b0200 2024-05-14T15:23:00.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.950+0000 7f56ff098b80 1 -- 172.21.15.69:0/3065726822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f56d400be30 con 0x5578af6b0200 2024-05-14T15:23:00.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.950+0000 7f56cf400700 1 -- 172.21.15.69:0/3065726822 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f56d400b9a0 con 0x5578af6b0200 2024-05-14T15:23:00.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.951+0000 7f56cf400700 1 -- 172.21.15.69:0/3065726822 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f56d4048050 con 0x5578af6b0200 2024-05-14T15:23:00.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.951+0000 7f56ff098b80 10 client.15711 fetch_fsmap learned FSMap version 33 2024-05-14T15:23:00.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.951+0000 7f56ff098b80 1 -- 172.21.15.69:0/3065726822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5578af733fc0 con 0x5578af6b0200 2024-05-14T15:23:00.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.951+0000 7f56cf400700 1 -- 172.21.15.69:0/3065726822 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f56d400be30 con 0x5578af6b0200 2024-05-14T15:23:00.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.952+0000 7f56cf400700 1 -- 172.21.15.69:0/3065726822 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f56d403b070 con 0x5578af6b0200 2024-05-14T15:23:00.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.952+0000 7f56ff098b80 10 client.15711 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:23:00.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.952+0000 7f56ff098b80 10 client.15711 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:00.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.952+0000 7f56ff098b80 20 client.15711 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:00.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.952+0000 7f56ff098b80 1 --2- 172.21.15.69:0/3065726822 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578af734640 0x5578af736a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:00.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.952+0000 7f56ff098b80 4 client.15711 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:23:00.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.952+0000 7f56ff098b80 1 -- 172.21.15.69:0/3065726822 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5578af5d14a0 con 0x5578af734640 2024-05-14T15:23:00.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.952+0000 7f56edc00700 1 --2- 172.21.15.69:0/3065726822 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578af734640 0x5578af736a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:00.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.953+0000 7f56edc00700 1 --2- 172.21.15.69:0/3065726822 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578af734640 0x5578af736a60 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb6396eea109c216 server_cookie=f1fb29c1f8fc226d in_seq=0 out_seq=0 2024-05-14T15:23:00.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.953+0000 7f56cf400700 10 client.15711 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:00.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.954+0000 7f56cf400700 1 -- 172.21.15.69:0/3065726822 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5578af5d14a0 con 0x5578af734640 2024-05-14T15:23:00.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.954+0000 7f56cf400700 10 client.15711 handle_command_reply: tid=0 2024-05-14T15:23:00.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.954+0000 7f56ff098b80 1 client.15711 shutdown 2024-05-14T15:23:00.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.954+0000 7f56ff098b80 1 -- 172.21.15.69:0/3065726822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b0200 msgr2=0x5578af6d0a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:00.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.954+0000 7f56ff098b80 1 --2- 172.21.15.69:0/3065726822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b0200 0x5578af6d0a80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f56d40054b0 tx=0x7f56d4009380 comp rx=0 tx=0).stop 2024-05-14T15:23:00.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.955+0000 7f56ff098b80 1 -- 172.21.15.69:0/3065726822 shutdown_connections 2024-05-14T15:23:00.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.955+0000 7f56ff098b80 1 --2- 172.21.15.69:0/3065726822 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578af734640 0x5578af736a60 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.955+0000 7f56ff098b80 1 --2- 172.21.15.69:0/3065726822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578af6b6010 0x5578af6d0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.955+0000 7f56ff098b80 1 --2- 172.21.15.69:0/3065726822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578af529e40 0x5578af6c2150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.955+0000 7f56ff098b80 1 --2- 172.21.15.69:0/3065726822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578af6b0200 0x5578af6d0a80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.955+0000 7f56ff098b80 1 -- 172.21.15.69:0/3065726822 >> 172.21.15.69:0/3065726822 conn(0x5578af56ef70 msgr2=0x5578af69c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:00.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.955+0000 7f56cf400700 0 client.15711 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:00.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.955+0000 7f56ff098b80 1 -- 172.21.15.69:0/3065726822 shutdown_connections 2024-05-14T15:23:00.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.955+0000 7f56ff098b80 1 -- 172.21.15.69:0/3065726822 wait complete. 2024-05-14T15:23:00.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.956+0000 7f56ff098b80 20 client.15711 trim_cache size 0 max 16384 2024-05-14T15:23:00.960 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:23:00.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.959+0000 7f56f0600700 1 -- 172.21.15.69:0/3223219482 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f56d00b2b90 msgr2=0x7f56d00b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:00.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.959+0000 7f56f0600700 1 --2- 172.21.15.69:0/3223219482 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f56d00b2b90 0x7f56d00b50a0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f56e0009e20 tx=0x7f56e0009040 comp rx=0 tx=0).stop 2024-05-14T15:23:00.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.960+0000 7f56f0600700 1 -- 172.21.15.69:0/3223219482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56e81034c0 msgr2=0x7f56e819ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:00.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.960+0000 7f56f0600700 1 --2- 172.21.15.69:0/3223219482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56e81034c0 0x7f56e819ad50 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00d950 tx=0x7f56dc00dd10 comp rx=0 tx=0).stop 2024-05-14T15:23:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.960+0000 7f56f0600700 1 -- 172.21.15.69:0/3223219482 shutdown_connections 2024-05-14T15:23:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.960+0000 7f56f0600700 1 --2- 172.21.15.69:0/3223219482 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f56d00b2b90 0x7f56d00b50a0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.960+0000 7f56f0600700 1 --2- 172.21.15.69:0/3223219482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f56e81034c0 0x7f56e819ad50 secure :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00d950 tx=0x7f56dc00dd10 comp rx=0 tx=0).stop 2024-05-14T15:23:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.960+0000 7f56f0600700 1 --2- 172.21.15.69:0/3223219482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f56e8108740 0x7f56e819f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.960+0000 7f56f0600700 1 --2- 172.21.15.69:0/3223219482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f56e8107df0 0x7f56e819b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:00.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.960+0000 7f56f0600700 1 -- 172.21.15.69:0/3223219482 >> 172.21.15.69:0/3223219482 conn(0x7f56e80fedc0 msgr2=0x7f56e806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:00.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.962+0000 7f56f0600700 1 -- 172.21.15.69:0/3223219482 shutdown_connections 2024-05-14T15:23:00.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:00.962+0000 7f56f0600700 1 -- 172.21.15.69:0/3223219482 wait complete. 2024-05-14T15:23:01.183 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:01 smithi069 ceph-mon[31270]: pgmap v44: 129 pgs: 129 active+clean; 78 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 4.8 MiB/s wr, 79 op/s 2024-05-14T15:23:01.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:01 smithi092 ceph-mon[34729]: pgmap v44: 129 pgs: 129 active+clean; 78 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 4.8 MiB/s wr, 79 op/s 2024-05-14T15:23:01.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:01 smithi203 ceph-mon[34567]: pgmap v44: 129 pgs: 129 active+clean; 78 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 221 KiB/s rd, 4.8 MiB/s wr, 79 op/s 2024-05-14T15:23:02.427 INFO:teuthology.orchestra.run.smithi069.stderr:300000 of 3200000 tuples (9%) done (elapsed 8.04 s, remaining 77.68 s) 2024-05-14T15:23:03.028 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-14T15:23:03.029 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-14T15:23:03.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:03 smithi092 ceph-mon[34729]: pgmap v45: 129 pgs: 129 active+clean; 78 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.7 MiB/s wr, 29 op/s 2024-05-14T15:23:03.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:03 smithi069 ceph-mon[31270]: pgmap v45: 129 pgs: 129 active+clean; 78 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.7 MiB/s wr, 29 op/s 2024-05-14T15:23:03.536 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:23:03.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:03 smithi203 ceph-mon[34567]: pgmap v45: 129 pgs: 129 active+clean; 78 MiB data, 605 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 4.7 MiB/s wr, 29 op/s 2024-05-14T15:23:05.178 INFO:teuthology.orchestra.run.smithi069.stderr:400000 of 3200000 tuples (12%) done (elapsed 10.79 s, remaining 75.51 s) 2024-05-14T15:23:05.194 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:05 smithi069 ceph-mon[31270]: pgmap v46: 129 pgs: 129 active+clean; 131 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 11 MiB/s wr, 57 op/s 2024-05-14T15:23:05.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:05 smithi203 ceph-mon[34567]: pgmap v46: 129 pgs: 129 active+clean; 131 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 11 MiB/s wr, 57 op/s 2024-05-14T15:23:05.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:05 smithi092 ceph-mon[34729]: pgmap v46: 129 pgs: 129 active+clean; 131 MiB data, 704 MiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 11 MiB/s wr, 57 op/s 2024-05-14T15:23:05.783 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.782+0000 7fb5b7c00640 1 -- 172.21.15.69:0/3064753527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5b010a170 msgr2=0x7fb5b0103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.782+0000 7fb5b7c00640 1 --2- 172.21.15.69:0/3064753527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5b010a170 0x7fb5b0103db0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fb59c009900 tx=0x7fb59c02a3f0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.782+0000 7fb5b7c00640 1 -- 172.21.15.69:0/3064753527 shutdown_connections 2024-05-14T15:23:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.782+0000 7fb5b7c00640 1 --2- 172.21.15.69:0/3064753527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5b0104420 0x7fb5b01107f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.782+0000 7fb5b7c00640 1 --2- 172.21.15.69:0/3064753527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5b010a170 0x7fb5b0103db0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.782+0000 7fb5b7c00640 1 --2- 172.21.15.69:0/3064753527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5b0109cd0 0x7fb5b0103870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.782+0000 7fb5b7c00640 1 -- 172.21.15.69:0/3064753527 >> 172.21.15.69:0/3064753527 conn(0x7fb5b00793d0 msgr2=0x7fb5b0079810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.782+0000 7fb5b7c00640 1 -- 172.21.15.69:0/3064753527 shutdown_connections 2024-05-14T15:23:05.784 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.782+0000 7fb5b7c00640 1 -- 172.21.15.69:0/3064753527 wait complete. 2024-05-14T15:23:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.783+0000 7fb5b7c00640 1 Processor -- start 2024-05-14T15:23:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.784+0000 7fb5b7c00640 1 -- start start 2024-05-14T15:23:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.784+0000 7fb5b7c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5b0104420 0x7fb5b0074fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.784+0000 7fb5b7c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5b0109cd0 0x7fb5b0075510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.784+0000 7fb5b7c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5b010a170 0x7fb5b0075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.784+0000 7fb5b7c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0113da0 con 0x7fb5b0109cd0 2024-05-14T15:23:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.784+0000 7fb5b7c00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0113c20 con 0x7fb5b0104420 2024-05-14T15:23:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.784+0000 7fb5b7c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b0113f20 con 0x7fb5b010a170 2024-05-14T15:23:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.784+0000 7fb5afe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5b0109cd0 0x7fb5b0075510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.784+0000 7fb5afe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5b0109cd0 0x7fb5b0075510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58618/0 (socket says 172.21.15.69:58618) 2024-05-14T15:23:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.784+0000 7fb5afe00640 1 -- 172.21.15.69:0/3567284407 learned_addr learned my addr 172.21.15.69:0/3567284407 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.785+0000 7fb5b5200640 1 --2- 172.21.15.69:0/3567284407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5b0104420 0x7fb5b0074fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.787 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.785+0000 7fb5b5c00640 1 --2- 172.21.15.69:0/3567284407 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5b010a170 0x7fb5b0075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.785+0000 7fb5afe00640 1 -- 172.21.15.69:0/3567284407 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5b010a170 msgr2=0x7fb5b0075a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.785+0000 7fb5afe00640 1 --2- 172.21.15.69:0/3567284407 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5b010a170 0x7fb5b0075a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.785+0000 7fb5afe00640 1 -- 172.21.15.69:0/3567284407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5b0104420 msgr2=0x7fb5b0074fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.785+0000 7fb5afe00640 1 --2- 172.21.15.69:0/3567284407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5b0104420 0x7fb5b0074fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.785+0000 7fb5afe00640 1 -- 172.21.15.69:0/3567284407 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5b01a8a90 con 0x7fb5b0109cd0 2024-05-14T15:23:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.785+0000 7fb5afe00640 1 --2- 172.21.15.69:0/3567284407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5b0109cd0 0x7fb5b0075510 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb59c02a910 tx=0x7fb59c003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.786+0000 7fb5ad600640 1 -- 172.21.15.69:0/3567284407 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c03f070 con 0x7fb5b0109cd0 2024-05-14T15:23:05.788 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.786+0000 7fb5ad600640 1 -- 172.21.15.69:0/3567284407 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb59c03bdc0 con 0x7fb5b0109cd0 2024-05-14T15:23:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.786+0000 7fb5b7c00640 1 -- 172.21.15.69:0/3567284407 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5b01a8d20 con 0x7fb5b0109cd0 2024-05-14T15:23:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.786+0000 7fb5ad600640 1 -- 172.21.15.69:0/3567284407 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c035030 con 0x7fb5b0109cd0 2024-05-14T15:23:05.789 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.786+0000 7fb5b7c00640 1 -- 172.21.15.69:0/3567284407 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5b01a91c0 con 0x7fb5b0109cd0 2024-05-14T15:23:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.790+0000 7fb5bec30740 1 Processor -- start 2024-05-14T15:23:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.790+0000 7fb5bec30740 1 -- start start 2024-05-14T15:23:05.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.790+0000 7fb5bec30740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab814871b0 0x55ab81828280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.790+0000 7fb5bec30740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab8145e2f0 0x55ab818287c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.790+0000 7fb5bec30740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814664d0 0x55ab81828d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.790+0000 7fb5bec30740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ab8178d550 con 0x55ab814664d0 2024-05-14T15:23:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.790+0000 7fb5bec30740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab81732bc0 con 0x55ab8145e2f0 2024-05-14T15:23:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.790+0000 7fb5bec30740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ab81789510 con 0x55ab814871b0 2024-05-14T15:23:05.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.791+0000 7fb5ad600640 1 -- 172.21.15.69:0/3567284407 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 149885+0+0 (secure 0 0 0) 0x7fb59c042070 con 0x7fb5b0109cd0 2024-05-14T15:23:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.791+0000 7fb5b5c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab814871b0 0x55ab81828280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.791+0000 7fb5b5200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab8145e2f0 0x55ab818287c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.791+0000 7fb5b5c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab814871b0 0x55ab81828280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:58370/0 (socket says 172.21.15.69:58370) 2024-05-14T15:23:05.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.791+0000 7fb5b5c00640 1 -- 172.21.15.69:0/398133211 learned_addr learned my addr 172.21.15.69:0/398133211 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:05.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.792+0000 7fb5b5200640 1 -- 172.21.15.69:0/398133211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab814871b0 msgr2=0x55ab81828280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:05.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.792+0000 7fb5b5200640 1 --2- 172.21.15.69:0/398133211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab814871b0 0x55ab81828280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.792+0000 7fb5b5200640 1 -- 172.21.15.69:0/398133211 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814664d0 msgr2=0x55ab81828d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:05.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.792+0000 7fb5b5200640 1 --2- 172.21.15.69:0/398133211 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814664d0 0x55ab81828d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.792+0000 7fb5b5200640 1 -- 172.21.15.69:0/398133211 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab8149f210 con 0x55ab8145e2f0 2024-05-14T15:23:05.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.792+0000 7fb5b5200640 1 --2- 172.21.15.69:0/398133211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab8145e2f0 0x55ab818287c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400caf0 tx=0x7fb5a400e350 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4b3c5ba9a295423 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:05.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.793+0000 7fb5ad600640 1 --2- 172.21.15.69:0/3567284407 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb5980b2a70 0x7fb5980b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.793+0000 7fb5a2000640 1 -- 172.21.15.69:0/398133211 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4014070 con 0x55ab8145e2f0 2024-05-14T15:23:05.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.793+0000 7fb5a2000640 1 -- 172.21.15.69:0/398133211 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5a4005020 con 0x55ab8145e2f0 2024-05-14T15:23:05.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.793+0000 7fb5a2000640 1 -- 172.21.15.69:0/398133211 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a4004b00 con 0x55ab8145e2f0 2024-05-14T15:23:05.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.793+0000 7fb5ad600640 1 -- 172.21.15.69:0/3567284407 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fb59c103630 con 0x7fb5b0109cd0 2024-05-14T15:23:05.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.793+0000 7fb5b5c00640 1 --2- 172.21.15.69:0/3567284407 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb5980b2a70 0x7fb5980b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.794+0000 7fb5bec30740 1 -- 172.21.15.69:0/398133211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab8145e2f0 msgr2=0x55ab818287c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:05.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.794+0000 7fb5bec30740 1 --2- 172.21.15.69:0/398133211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab8145e2f0 0x55ab818287c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb5a400caf0 tx=0x7fb5a400e350 comp rx=0 tx=0).stop 2024-05-14T15:23:05.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.794+0000 7fb5b5c00640 1 --2- 172.21.15.69:0/3567284407 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb5980b2a70 0x7fb5980b4f80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55ab818253f0 tx=0x7fb5a8007740 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:05.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.794+0000 7fb5bec30740 1 -- 172.21.15.69:0/398133211 shutdown_connections 2024-05-14T15:23:05.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.794+0000 7fb5bec30740 1 --2- 172.21.15.69:0/398133211 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814664d0 0x55ab81828d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.794+0000 7fb5bec30740 1 --2- 172.21.15.69:0/398133211 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab8145e2f0 0x55ab818287c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.794+0000 7fb5bec30740 1 --2- 172.21.15.69:0/398133211 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab814871b0 0x55ab81828280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.794+0000 7fb5bec30740 1 -- 172.21.15.69:0/398133211 >> 172.21.15.69:0/398133211 conn(0x55ab8147b300 msgr2=0x55ab81824a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.794+0000 7fb5bec30740 1 -- 172.21.15.69:0/398133211 shutdown_connections 2024-05-14T15:23:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.794+0000 7fb5bec30740 1 -- 172.21.15.69:0/398133211 wait complete. 2024-05-14T15:23:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.795+0000 7fb5bec30740 1 -- start start 2024-05-14T15:23:05.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.795+0000 7fb5bec30740 1 Processor -- start 2024-05-14T15:23:05.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.796+0000 7fb5bec30740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab8145e2f0 0x55ab818327b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.796+0000 7fb5bec30740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814664d0 0x55ab81832cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.796+0000 7fb5bec30740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab814871b0 0x55ab818470f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.796+0000 7fb5bec30740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ab81835400 con 0x55ab814664d0 2024-05-14T15:23:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.796+0000 7fb5bec30740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ab81746660 con 0x55ab814871b0 2024-05-14T15:23:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.796+0000 7fb5bec30740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ab81835580 con 0x55ab8145e2f0 2024-05-14T15:23:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.796+0000 7fb5bec30740 10 client.0 _ll_register_callbacks cb 0x55ab81710400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.796+0000 7fb5afe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814664d0 0x55ab81832cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.796+0000 7fb5afe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814664d0 0x55ab81832cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58638/0 (socket says 172.21.15.69:58638) 2024-05-14T15:23:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.796+0000 7fb5afe00640 1 -- 172.21.15.69:0/1375605475 learned_addr learned my addr 172.21.15.69:0/1375605475 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.797+0000 7fb5b5c00640 1 --2- 172.21.15.69:0/1375605475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab814871b0 0x55ab818470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.797+0000 7fb5b5200640 1 --2- 172.21.15.69:0/1375605475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab8145e2f0 0x55ab818327b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.797+0000 7fb5afe00640 1 -- 172.21.15.69:0/1375605475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab8145e2f0 msgr2=0x55ab818327b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.797+0000 7fb5afe00640 1 --2- 172.21.15.69:0/1375605475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab8145e2f0 0x55ab818327b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.797+0000 7fb5afe00640 1 -- 172.21.15.69:0/1375605475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab814871b0 msgr2=0x55ab818470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.797+0000 7fb5afe00640 1 --2- 172.21.15.69:0/1375605475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab814871b0 0x55ab818470f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.797+0000 7fb5afe00640 1 -- 172.21.15.69:0/1375605475 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab8156b620 con 0x55ab814664d0 2024-05-14T15:23:05.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.797+0000 7fb5afe00640 1 --2- 172.21.15.69:0/1375605475 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814664d0 0x55ab81832cf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0c7650 tx=0x7fb59c0c9df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adeebe51726977a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:05.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.797+0000 7fb596a00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.798+0000 7fb596a00640 1 -- 172.21.15.69:0/1375605475 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb59c049040 con 0x55ab814664d0 2024-05-14T15:23:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.798+0000 7fb596a00640 1 -- 172.21.15.69:0/1375605475 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fb59c031520 con 0x55ab814664d0 2024-05-14T15:23:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.798+0000 7fb5bec30740 1 -- 172.21.15.69:0/1375605475 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5a4005020 con 0x55ab814664d0 2024-05-14T15:23:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.798+0000 7fb596a00640 1 -- 172.21.15.69:0/1375605475 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb59c0ca3e0 con 0x55ab814664d0 2024-05-14T15:23:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.798+0000 7fb5bec30740 10 client.15720 fetch_fsmap learned FSMap version 33 2024-05-14T15:23:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.798+0000 7fb5bec30740 1 -- 172.21.15.69:0/1375605475 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ab81838120 con 0x55ab814664d0 2024-05-14T15:23:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.798+0000 7fb596a00640 1 -- 172.21.15.69:0/1375605475 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5a4005020 con 0x55ab814664d0 2024-05-14T15:23:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.799+0000 7fb596a00640 1 -- 172.21.15.69:0/1375605475 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fb59c1032b0 con 0x55ab814664d0 2024-05-14T15:23:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.800+0000 7fb5bec30740 10 client.15720 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:23:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.800+0000 7fb5bec30740 10 client.15720 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:05.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.800+0000 7fb5bec30740 20 client.15720 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.800+0000 7fb5bec30740 1 --2- 172.21.15.69:0/1375605475 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ab81445d80 0x55ab8183b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.800+0000 7fb5bec30740 4 client.15720 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:23:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.800+0000 7fb5bec30740 1 -- 172.21.15.69:0/1375605475 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab8179b160 con 0x55ab81445d80 2024-05-14T15:23:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.800+0000 7fb5b5200640 1 --2- 172.21.15.69:0/1375605475 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ab81445d80 0x55ab8183b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.801+0000 7fb5b5200640 1 --2- 172.21.15.69:0/1375605475 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ab81445d80 0x55ab8183b6a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f93f013a49db1c36 server_cookie=aa83bf0db4dbde7f in_seq=0 out_seq=0 2024-05-14T15:23:05.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.801+0000 7fb596a00640 10 client.15720 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:05.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.803+0000 7fb596a00640 1 -- 172.21.15.69:0/1375605475 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ab8179b160 con 0x55ab81445d80 2024-05-14T15:23:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.803+0000 7fb596a00640 10 client.15720 handle_command_reply: tid=0 2024-05-14T15:23:05.805 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.803+0000 7fb5bec30740 1 client.15720 shutdown 2024-05-14T15:23:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.804+0000 7fb5bec30740 1 -- 172.21.15.69:0/1375605475 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814664d0 msgr2=0x55ab81832cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.804+0000 7fb5bec30740 1 --2- 172.21.15.69:0/1375605475 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814664d0 0x55ab81832cf0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0c7650 tx=0x7fb59c0c9df0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.804+0000 7fb5bec30740 1 -- 172.21.15.69:0/1375605475 shutdown_connections 2024-05-14T15:23:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.804+0000 7fb5bec30740 1 --2- 172.21.15.69:0/1375605475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab814871b0 0x55ab818470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.804+0000 7fb5bec30740 1 --2- 172.21.15.69:0/1375605475 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ab81445d80 0x55ab8183b6a0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.804+0000 7fb5bec30740 1 --2- 172.21.15.69:0/1375605475 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814664d0 0x55ab81832cf0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.804+0000 7fb5bec30740 1 --2- 172.21.15.69:0/1375605475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab8145e2f0 0x55ab818327b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.804+0000 7fb596a00640 0 client.15720 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.804+0000 7fb5bec30740 1 -- 172.21.15.69:0/1375605475 >> 172.21.15.69:0/1375605475 conn(0x55ab8147b300 msgr2=0x55ab81829fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.804+0000 7fb5bec30740 1 -- 172.21.15.69:0/1375605475 shutdown_connections 2024-05-14T15:23:05.806 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.804+0000 7fb5bec30740 1 -- 172.21.15.69:0/1375605475 wait complete. 2024-05-14T15:23:05.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.804+0000 7fb5bec30740 20 client.15720 trim_cache size 0 max 16384 2024-05-14T15:23:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.826+0000 7fb5bec30740 1 Processor -- start 2024-05-14T15:23:05.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.826+0000 7fb5bec30740 1 -- start start 2024-05-14T15:23:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.827+0000 7fb5bec30740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab8145e2f0 0x55ab81823710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.827+0000 7fb5bec30740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab814664d0 0x55ab81823c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.827+0000 7fb5bec30740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814871b0 0x55ab81846b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.827+0000 7fb5bec30740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b01aef80 con 0x55ab814871b0 2024-05-14T15:23:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.827+0000 7fb5bec30740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b01b0bb0 con 0x55ab814664d0 2024-05-14T15:23:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.827+0000 7fb5bec30740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b01af650 con 0x55ab8145e2f0 2024-05-14T15:23:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.827+0000 7fb5b5c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814871b0 0x55ab81846b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.827+0000 7fb5b5c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814871b0 0x55ab81846b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58644/0 (socket says 172.21.15.69:58644) 2024-05-14T15:23:05.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.827+0000 7fb5b5c00640 1 -- 172.21.15.69:0/1048404498 learned_addr learned my addr 172.21.15.69:0/1048404498 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.827+0000 7fb5afe00640 1 --2- 172.21.15.69:0/1048404498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab814664d0 0x55ab81823c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.828+0000 7fb5b5200640 1 --2- 172.21.15.69:0/1048404498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab8145e2f0 0x55ab81823710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.828+0000 7fb5b5c00640 1 -- 172.21.15.69:0/1048404498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab8145e2f0 msgr2=0x55ab81823710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.828+0000 7fb5b5c00640 1 --2- 172.21.15.69:0/1048404498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab8145e2f0 0x55ab81823710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.828+0000 7fb5b5c00640 1 -- 172.21.15.69:0/1048404498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab814664d0 msgr2=0x55ab81823c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.828+0000 7fb5b5c00640 1 --2- 172.21.15.69:0/1048404498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab814664d0 0x55ab81823c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.828+0000 7fb5b5c00640 1 -- 172.21.15.69:0/1048404498 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab818325b0 con 0x55ab814871b0 2024-05-14T15:23:05.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.828+0000 7fb5b5c00640 1 --2- 172.21.15.69:0/1048404498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814871b0 0x55ab81846b00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800f7d0 tx=0x7fb5a8007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c2f23f705099206 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.829+0000 7fb5a1600640 1 -- 172.21.15.69:0/1048404498 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a801bd80 con 0x55ab814871b0 2024-05-14T15:23:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.829+0000 7fb5a1600640 1 -- 172.21.15.69:0/1048404498 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5a800fe70 con 0x55ab814871b0 2024-05-14T15:23:05.831 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.829+0000 7fb5a1600640 1 -- 172.21.15.69:0/1048404498 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a80047c0 con 0x55ab814871b0 2024-05-14T15:23:05.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.830+0000 7fb5bec30740 1 -- 172.21.15.69:0/1048404498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814871b0 msgr2=0x55ab81846b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:05.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.830+0000 7fb5bec30740 1 --2- 172.21.15.69:0/1048404498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814871b0 0x55ab81846b00 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fb5a800f7d0 tx=0x7fb5a8007f90 comp rx=0 tx=0).stop 2024-05-14T15:23:05.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.830+0000 7fb5bec30740 1 -- 172.21.15.69:0/1048404498 shutdown_connections 2024-05-14T15:23:05.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.830+0000 7fb5bec30740 1 --2- 172.21.15.69:0/1048404498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814871b0 0x55ab81846b00 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.830+0000 7fb5bec30740 1 --2- 172.21.15.69:0/1048404498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab814664d0 0x55ab81823c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.830+0000 7fb5bec30740 1 --2- 172.21.15.69:0/1048404498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab8145e2f0 0x55ab81823710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.830+0000 7fb5bec30740 1 -- 172.21.15.69:0/1048404498 >> 172.21.15.69:0/1048404498 conn(0x55ab8147b300 msgr2=0x55ab81823000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:05.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.830+0000 7fb5bec30740 1 -- 172.21.15.69:0/1048404498 shutdown_connections 2024-05-14T15:23:05.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.830+0000 7fb5bec30740 1 -- 172.21.15.69:0/1048404498 wait complete. 2024-05-14T15:23:05.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.831+0000 7fb5bec30740 1 -- start start 2024-05-14T15:23:05.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.831+0000 7fb5bec30740 1 Processor -- start 2024-05-14T15:23:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.832+0000 7fb5bec30740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab8145e2f0 0x55ab8183be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.832+0000 7fb5bec30740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab814664d0 0x55ab8183c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.832+0000 7fb5bec30740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814871b0 0x55ab818bc200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.832+0000 7fb5bec30740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b01b0420 con 0x55ab814871b0 2024-05-14T15:23:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.832+0000 7fb5bec30740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b01afd50 con 0x55ab814664d0 2024-05-14T15:23:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.832+0000 7fb5bec30740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb5b01acf60 con 0x55ab8145e2f0 2024-05-14T15:23:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.832+0000 7fb5bec30740 10 client.0 _ll_register_callbacks cb 0x7fb59c005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.832+0000 7fb5b5c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814871b0 0x55ab818bc200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.832+0000 7fb5b5c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814871b0 0x55ab818bc200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58656/0 (socket says 172.21.15.69:58656) 2024-05-14T15:23:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.832+0000 7fb5b5c00640 1 -- 172.21.15.69:0/505079797 learned_addr learned my addr 172.21.15.69:0/505079797 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.832+0000 7fb5afe00640 1 --2- 172.21.15.69:0/505079797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab814664d0 0x55ab8183c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.832+0000 7fb5b5200640 1 --2- 172.21.15.69:0/505079797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab8145e2f0 0x55ab8183be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.833+0000 7fb5b5c00640 1 -- 172.21.15.69:0/505079797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab8145e2f0 msgr2=0x55ab8183be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.833+0000 7fb5b5c00640 1 --2- 172.21.15.69:0/505079797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab8145e2f0 0x55ab8183be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.833+0000 7fb5b5c00640 1 -- 172.21.15.69:0/505079797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab814664d0 msgr2=0x55ab8183c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.833+0000 7fb5b5c00640 1 --2- 172.21.15.69:0/505079797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab814664d0 0x55ab8183c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.833+0000 7fb5b5c00640 1 -- 172.21.15.69:0/505079797 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab818bc740 con 0x55ab814871b0 2024-05-14T15:23:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.833+0000 7fb5b5c00640 1 --2- 172.21.15.69:0/505079797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814871b0 0x55ab818bc200 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8004280 tx=0x7fb5a8005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e680883b66e19246 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.833+0000 7fb596a00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.834+0000 7fb596a00640 1 -- 172.21.15.69:0/505079797 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5a8036060 con 0x55ab814871b0 2024-05-14T15:23:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.834+0000 7fb596a00640 1 -- 172.21.15.69:0/505079797 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fb5a80045d0 con 0x55ab814871b0 2024-05-14T15:23:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.834+0000 7fb5bec30740 1 -- 172.21.15.69:0/505079797 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb5a800fe70 con 0x55ab814871b0 2024-05-14T15:23:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.834+0000 7fb596a00640 1 -- 172.21.15.69:0/505079797 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fb5a80047d0 con 0x55ab814871b0 2024-05-14T15:23:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.834+0000 7fb5bec30740 10 client.15726 fetch_fsmap learned FSMap version 33 2024-05-14T15:23:05.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.834+0000 7fb5bec30740 1 -- 172.21.15.69:0/505079797 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ab818bd840 con 0x55ab814871b0 2024-05-14T15:23:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.835+0000 7fb596a00640 1 -- 172.21.15.69:0/505079797 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5a800fe70 con 0x55ab814871b0 2024-05-14T15:23:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.835+0000 7fb596a00640 1 -- 172.21.15.69:0/505079797 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fb5a8025070 con 0x55ab814871b0 2024-05-14T15:23:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.835+0000 7fb5bec30740 10 client.15726 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:23:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.835+0000 7fb5bec30740 10 client.15726 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.835+0000 7fb5bec30740 20 client.15726 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.835+0000 7fb5bec30740 1 --2- 172.21.15.69:0/505079797 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ab8141b1c0 0x55ab818bffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.835+0000 7fb5bec30740 4 client.15726 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:23:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.835+0000 7fb5bec30740 1 -- 172.21.15.69:0/505079797 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ab81794fd0 con 0x55ab8141b1c0 2024-05-14T15:23:05.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.836+0000 7fb5b5200640 1 --2- 172.21.15.69:0/505079797 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ab8141b1c0 0x55ab818bffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.837+0000 7fb5b5200640 1 --2- 172.21.15.69:0/505079797 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ab8141b1c0 0x55ab818bffe0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25c7f23b3cc0e01b server_cookie=3466b5bf34b240e8 in_seq=0 out_seq=0 2024-05-14T15:23:05.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.837+0000 7fb596a00640 10 client.15726 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.889+0000 7fb596a00640 1 -- 172.21.15.69:0/505079797 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ab81794fd0 con 0x55ab8141b1c0 2024-05-14T15:23:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.889+0000 7fb596a00640 10 client.15726 handle_command_reply: tid=0 2024-05-14T15:23:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.889+0000 7fb5bec30740 1 client.15726 shutdown 2024-05-14T15:23:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.890+0000 7fb5bec30740 1 -- 172.21.15.69:0/505079797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814871b0 msgr2=0x55ab818bc200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.890+0000 7fb5bec30740 1 --2- 172.21.15.69:0/505079797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814871b0 0x55ab818bc200 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fb5a8004280 tx=0x7fb5a8005bd0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.890+0000 7fb5bec30740 1 -- 172.21.15.69:0/505079797 shutdown_connections 2024-05-14T15:23:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.890+0000 7fb5bec30740 1 --2- 172.21.15.69:0/505079797 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ab8141b1c0 0x55ab818bffe0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.890+0000 7fb5bec30740 1 --2- 172.21.15.69:0/505079797 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ab814871b0 0x55ab818bc200 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.890+0000 7fb5bec30740 1 --2- 172.21.15.69:0/505079797 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ab814664d0 0x55ab8183c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.890+0000 7fb5bec30740 1 --2- 172.21.15.69:0/505079797 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ab8145e2f0 0x55ab8183be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.890+0000 7fb5bec30740 1 -- 172.21.15.69:0/505079797 >> 172.21.15.69:0/505079797 conn(0x55ab8147b300 msgr2=0x55ab81823a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.890+0000 7fb596a00640 0 client.15726 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.890+0000 7fb5bec30740 1 -- 172.21.15.69:0/505079797 shutdown_connections 2024-05-14T15:23:05.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.890+0000 7fb5bec30740 1 -- 172.21.15.69:0/505079797 wait complete. 2024-05-14T15:23:05.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.890+0000 7fb5bec30740 20 client.15726 trim_cache size 0 max 16384 2024-05-14T15:23:05.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:23:05.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:23:05.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:23:05.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:23:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.891+0000 7fb5b7c00640 1 -- 172.21.15.69:0/3567284407 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb5980b2a70 msgr2=0x7fb5980b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.891+0000 7fb5b7c00640 1 --2- 172.21.15.69:0/3567284407 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb5980b2a70 0x7fb5980b4f80 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x55ab818253f0 tx=0x7fb5a8007740 comp rx=0 tx=0).stop 2024-05-14T15:23:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.891+0000 7fb5b7c00640 1 -- 172.21.15.69:0/3567284407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5b0109cd0 msgr2=0x7fb5b0075510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.891+0000 7fb5b7c00640 1 --2- 172.21.15.69:0/3567284407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5b0109cd0 0x7fb5b0075510 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb59c02a910 tx=0x7fb59c003d60 comp rx=0 tx=0).stop 2024-05-14T15:23:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.892+0000 7fb5b7c00640 1 -- 172.21.15.69:0/3567284407 shutdown_connections 2024-05-14T15:23:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.892+0000 7fb5b7c00640 1 --2- 172.21.15.69:0/3567284407 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb5980b2a70 0x7fb5980b4f80 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.892+0000 7fb5b7c00640 1 --2- 172.21.15.69:0/3567284407 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5b010a170 0x7fb5b0075a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.892+0000 7fb5b7c00640 1 --2- 172.21.15.69:0/3567284407 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5b0109cd0 0x7fb5b0075510 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.892+0000 7fb5b7c00640 1 --2- 172.21.15.69:0/3567284407 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5b0104420 0x7fb5b0074fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.892+0000 7fb5b7c00640 1 -- 172.21.15.69:0/3567284407 >> 172.21.15.69:0/3567284407 conn(0x7fb5b00793d0 msgr2=0x7fb5b0105370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.892+0000 7fb5b7c00640 1 -- 172.21.15.69:0/3567284407 shutdown_connections 2024-05-14T15:23:05.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:05.892+0000 7fb5b7c00640 1 -- 172.21.15.69:0/3567284407 wait complete. 2024-05-14T15:23:05.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.944+0000 7f9c13200700 1 -- 172.21.15.69:0/580638381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c0c1030c0 msgr2=0x7f9c0c1034d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:05.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.944+0000 7f9c13200700 1 --2- 172.21.15.69:0/580638381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c0c1030c0 0x7f9c0c1034d0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009990 tx=0x7f9bfc009ca0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.944+0000 7f9c13200700 1 -- 172.21.15.69:0/580638381 shutdown_connections 2024-05-14T15:23:05.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.944+0000 7f9c13200700 1 --2- 172.21.15.69:0/580638381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c0c1030c0 0x7f9c0c1034d0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.944+0000 7f9c13200700 1 --2- 172.21.15.69:0/580638381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c0c110c70 0x7f9c0c113090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.944+0000 7f9c13200700 1 --2- 172.21.15.69:0/580638381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c0c103a10 0x7f9c0c110730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.944+0000 7f9c13200700 1 -- 172.21.15.69:0/580638381 >> 172.21.15.69:0/580638381 conn(0x7f9c0c0fedc0 msgr2=0x7f9c0c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:05.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.945+0000 7f9c13200700 1 -- 172.21.15.69:0/580638381 shutdown_connections 2024-05-14T15:23:05.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.945+0000 7f9c13200700 1 -- 172.21.15.69:0/580638381 wait complete. 2024-05-14T15:23:05.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.946+0000 7f9c13200700 1 Processor -- start 2024-05-14T15:23:05.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.946+0000 7f9c13200700 1 -- start start 2024-05-14T15:23:05.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.947+0000 7f9c13200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c0c1030c0 0x7f9c0c19cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.947+0000 7f9c13200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c0c103a10 0x7f9c0c19d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.947+0000 7f9c13200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c0c110c70 0x7f9c0c1a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.947+0000 7f9c13200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c116560 con 0x7f9c0c103a10 2024-05-14T15:23:05.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.947+0000 7f9c13200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c1163e0 con 0x7f9c0c1030c0 2024-05-14T15:23:05.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.947+0000 7f9c13200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c1166e0 con 0x7f9c0c110c70 2024-05-14T15:23:05.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.947+0000 7f9c0b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c0c103a10 0x7f9c0c19d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.947+0000 7f9c0b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c0c103a10 0x7f9c0c19d490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58682/0 (socket says 172.21.15.69:58682) 2024-05-14T15:23:05.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.948+0000 7f9c0b400700 1 -- 172.21.15.69:0/3002728124 learned_addr learned my addr 172.21.15.69:0/3002728124 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:05.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.948+0000 7f9c0be00700 1 --2- 172.21.15.69:0/3002728124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c0c1030c0 0x7f9c0c19cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.948+0000 7f9c11200700 1 --2- 172.21.15.69:0/3002728124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c0c110c70 0x7f9c0c1a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.948+0000 7f9c0b400700 1 -- 172.21.15.69:0/3002728124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c0c110c70 msgr2=0x7f9c0c1a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:05.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.948+0000 7f9c0b400700 1 --2- 172.21.15.69:0/3002728124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c0c110c70 0x7f9c0c1a1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.948+0000 7f9c0b400700 1 -- 172.21.15.69:0/3002728124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c0c1030c0 msgr2=0x7f9c0c19cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:05.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.948+0000 7f9c0b400700 1 --2- 172.21.15.69:0/3002728124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c0c1030c0 0x7f9c0c19cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.948+0000 7f9c0b400700 1 -- 172.21.15.69:0/3002728124 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0c1a1d10 con 0x7f9c0c103a10 2024-05-14T15:23:05.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.949+0000 7f9c0b400700 1 --2- 172.21.15.69:0/3002728124 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c0c103a10 0x7f9c0c19d490 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800c9e0 tx=0x7f9bf800cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:05.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.949+0000 7f9c08c00700 1 -- 172.21.15.69:0/3002728124 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8007aa0 con 0x7f9c0c103a10 2024-05-14T15:23:05.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.949+0000 7f9c08c00700 1 -- 172.21.15.69:0/3002728124 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bf8007c40 con 0x7f9c0c103a10 2024-05-14T15:23:05.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.949+0000 7f9c08c00700 1 -- 172.21.15.69:0/3002728124 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8018660 con 0x7f9c0c103a10 2024-05-14T15:23:05.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.952+0000 7f9c13200700 1 -- 172.21.15.69:0/3002728124 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0c1a2000 con 0x7f9c0c103a10 2024-05-14T15:23:05.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.952+0000 7f9c13200700 1 -- 172.21.15.69:0/3002728124 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c0c1a24c0 con 0x7f9c0c103a10 2024-05-14T15:23:05.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.956+0000 7f9c08c00700 1 -- 172.21.15.69:0/3002728124 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 24) ==== 149885+0+0 (secure 0 0 0) 0x7f9bf8018800 con 0x7f9c0c103a10 2024-05-14T15:23:05.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.957+0000 7f9c21dffb80 1 Processor -- start 2024-05-14T15:23:05.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.958+0000 7f9c21dffb80 1 -- start start 2024-05-14T15:23:05.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.958+0000 7f9c08c00700 1 --2- 172.21.15.69:0/3002728124 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9bf00b2b90 0x7f9bf00b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.958+0000 7f9c21dffb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c5d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.958+0000 7f9c08c00700 1 -- 172.21.15.69:0/3002728124 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f9bf80e3060 con 0x7f9c0c103a10 2024-05-14T15:23:05.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.958+0000 7f9c21dffb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c57530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.958+0000 7f9c21dffb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7c57a70 0x55ddb7c57e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.958+0000 7f9c21dffb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ddb7b79aa0 con 0x55ddb7c57a70 2024-05-14T15:23:05.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.958+0000 7f9c21dffb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ddb7b177e0 con 0x55ddb7ad9ec0 2024-05-14T15:23:05.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.958+0000 7f9c21dffb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ddb7b75a60 con 0x55ddb7c5d8b0 2024-05-14T15:23:05.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.959+0000 7f9c11200700 1 --2- 172.21.15.69:0/3002728124 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9bf00b2b90 0x7f9bf00b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.959+0000 7f9c11200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7c57a70 0x55ddb7c57e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.959+0000 7f9c0b400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c57530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.959+0000 7f9c11200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7c57a70 0x55ddb7c57e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58684/0 (socket says 172.21.15.69:58684) 2024-05-14T15:23:05.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.959+0000 7f9c11200700 1 -- 172.21.15.69:0/3351040019 learned_addr learned my addr 172.21.15.69:0/3351040019 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:05.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.959+0000 7f9c0be00700 1 --2- 172.21.15.69:0/3351040019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c5d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.960+0000 7f9c11200700 1 -- 172.21.15.69:0/3351040019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c5d8b0 msgr2=0x55ddb7c57530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:05.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.960+0000 7f9c11200700 1 --2- 172.21.15.69:0/3351040019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c57530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.960+0000 7f9c11200700 1 -- 172.21.15.69:0/3351040019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7ad9ec0 msgr2=0x55ddb7c5d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:05.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.960+0000 7f9c11200700 1 --2- 172.21.15.69:0/3351040019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c5d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.960+0000 7f9c11200700 1 -- 172.21.15.69:0/3351040019 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddb7ac6950 con 0x55ddb7c57a70 2024-05-14T15:23:05.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.960+0000 7f9c11200700 1 --2- 172.21.15.69:0/3002728124 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9bf00b2b90 0x7f9bf00b50a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9c04007fd0 tx=0x7f9c04013380 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:05.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.960+0000 7f9c11200700 1 --2- 172.21.15.69:0/3351040019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7c57a70 0x55ddb7c57e80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9c04013780 tx=0x7f9c0401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e21d3296cd575d13 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:05.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.961+0000 7f9c01600700 1 -- 172.21.15.69:0/3351040019 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04017e90 con 0x55ddb7c57a70 2024-05-14T15:23:05.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.961+0000 7f9c01600700 1 -- 172.21.15.69:0/3351040019 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c0401d070 con 0x55ddb7c57a70 2024-05-14T15:23:05.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.961+0000 7f9c01600700 1 -- 172.21.15.69:0/3351040019 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c040199c0 con 0x55ddb7c57a70 2024-05-14T15:23:05.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.962+0000 7f9c21dffb80 1 -- 172.21.15.69:0/3351040019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7c57a70 msgr2=0x55ddb7c57e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:05.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.962+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/3351040019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7c57a70 0x55ddb7c57e80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f9c04013780 tx=0x7f9c0401a000 comp rx=0 tx=0).stop 2024-05-14T15:23:05.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.962+0000 7f9c21dffb80 1 -- 172.21.15.69:0/3351040019 shutdown_connections 2024-05-14T15:23:05.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.962+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/3351040019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7c57a70 0x55ddb7c57e80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.962+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/3351040019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c5d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.962+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/3351040019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c57530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.962+0000 7f9c21dffb80 1 -- 172.21.15.69:0/3351040019 >> 172.21.15.69:0/3351040019 conn(0x55ddb7b1eff0 msgr2=0x55ddb7c52350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:05.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.962+0000 7f9c21dffb80 1 -- 172.21.15.69:0/3351040019 shutdown_connections 2024-05-14T15:23:05.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.962+0000 7f9c21dffb80 1 -- 172.21.15.69:0/3351040019 wait complete. 2024-05-14T15:23:05.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.963+0000 7f9c21dffb80 1 -- start start 2024-05-14T15:23:05.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.963+0000 7f9c21dffb80 1 Processor -- start 2024-05-14T15:23:05.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.964+0000 7f9c21dffb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c61120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.964+0000 7f9c21dffb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7c57a70 0x55ddb7c61660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.964+0000 7f9c21dffb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c61ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.964+0000 7f9c21dffb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ddb7c642d0 con 0x55ddb7ad9ec0 2024-05-14T15:23:05.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.964+0000 7f9c21dffb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ddb7adfba0 con 0x55ddb7c57a70 2024-05-14T15:23:05.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.964+0000 7f9c21dffb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ddb7c64450 con 0x55ddb7c5d8b0 2024-05-14T15:23:05.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.964+0000 7f9c0be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c61120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.964+0000 7f9c21dffb80 10 client.0 _ll_register_callbacks cb 0x55ddb7b20cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:05.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.964+0000 7f9c0be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c61120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58700/0 (socket says 172.21.15.69:58700) 2024-05-14T15:23:05.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.964+0000 7f9c0be00700 1 -- 172.21.15.69:0/1397759307 learned_addr learned my addr 172.21.15.69:0/1397759307 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:05.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.964+0000 7f9c0b400700 1 --2- 172.21.15.69:0/1397759307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7c57a70 0x55ddb7c61660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.965+0000 7f9c11200700 1 --2- 172.21.15.69:0/1397759307 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c61ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.965+0000 7f9c0be00700 1 -- 172.21.15.69:0/1397759307 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c5d8b0 msgr2=0x55ddb7c61ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:05.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.965+0000 7f9c0be00700 1 --2- 172.21.15.69:0/1397759307 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c61ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.965+0000 7f9c0be00700 1 -- 172.21.15.69:0/1397759307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7c57a70 msgr2=0x55ddb7c61660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:05.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.965+0000 7f9c0be00700 1 --2- 172.21.15.69:0/1397759307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7c57a70 0x55ddb7c61660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.965+0000 7f9c0be00700 1 -- 172.21.15.69:0/1397759307 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddb7b3f4a0 con 0x55ddb7ad9ec0 2024-05-14T15:23:05.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.965+0000 7f9c0be00700 1 --2- 172.21.15.69:0/1397759307 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c61120 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009990 tx=0x7f9bfc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a89f63ea4e58337 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:05.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.965+0000 7f9bf6000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:05.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.966+0000 7f9bf6000700 1 -- 172.21.15.69:0/1397759307 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc029060 con 0x55ddb7ad9ec0 2024-05-14T15:23:05.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.966+0000 7f9bf6000700 1 -- 172.21.15.69:0/1397759307 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f9bfc005450 con 0x55ddb7ad9ec0 2024-05-14T15:23:05.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.966+0000 7f9c21dffb80 1 -- 172.21.15.69:0/1397759307 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9c0401d070 con 0x55ddb7ad9ec0 2024-05-14T15:23:05.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.967+0000 7f9bf6000700 1 -- 172.21.15.69:0/1397759307 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9bfc005650 con 0x55ddb7ad9ec0 2024-05-14T15:23:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.967+0000 7f9c21dffb80 10 client.15738 fetch_fsmap learned FSMap version 33 2024-05-14T15:23:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.967+0000 7f9c21dffb80 1 -- 172.21.15.69:0/1397759307 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ddb7c6ee70 con 0x55ddb7ad9ec0 2024-05-14T15:23:05.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.967+0000 7f9bf6000700 1 -- 172.21.15.69:0/1397759307 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9c0401d070 con 0x55ddb7ad9ec0 2024-05-14T15:23:05.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.968+0000 7f9bf6000700 1 -- 172.21.15.69:0/1397759307 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f9bfc00f810 con 0x55ddb7ad9ec0 2024-05-14T15:23:05.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.968+0000 7f9c21dffb80 10 client.15738 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:23:05.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.968+0000 7f9c21dffb80 10 client.15738 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:05.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.968+0000 7f9c21dffb80 20 client.15738 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:05.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.968+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/1397759307 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ddb7c71400 0x55ddb7c738d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:05.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.968+0000 7f9c21dffb80 4 client.15738 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:23:05.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.968+0000 7f9c21dffb80 1 -- 172.21.15.69:0/1397759307 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddb7c24240 con 0x55ddb7c71400 2024-05-14T15:23:05.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.969+0000 7f9c0b400700 1 --2- 172.21.15.69:0/1397759307 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ddb7c71400 0x55ddb7c738d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:05.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.970+0000 7f9c0b400700 1 --2- 172.21.15.69:0/1397759307 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ddb7c71400 0x55ddb7c738d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=962f5b2da55b093f server_cookie=71612014797f7ff8 in_seq=0 out_seq=0 2024-05-14T15:23:05.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.970+0000 7f9bf6000700 10 client.15738 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:05.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.972+0000 7f9bf6000700 1 -- 172.21.15.69:0/1397759307 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ddb7c24240 con 0x55ddb7c71400 2024-05-14T15:23:05.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.972+0000 7f9bf6000700 10 client.15738 handle_command_reply: tid=0 2024-05-14T15:23:05.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.972+0000 7f9c21dffb80 1 client.15738 shutdown 2024-05-14T15:23:05.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.972+0000 7f9c21dffb80 1 -- 172.21.15.69:0/1397759307 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7ad9ec0 msgr2=0x55ddb7c61120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:05.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.972+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/1397759307 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c61120 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc009990 tx=0x7f9bfc003f10 comp rx=0 tx=0).stop 2024-05-14T15:23:05.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.972+0000 7f9c21dffb80 1 -- 172.21.15.69:0/1397759307 shutdown_connections 2024-05-14T15:23:05.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.972+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/1397759307 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ddb7c71400 0x55ddb7c738d0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.973+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/1397759307 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c61120 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.973+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/1397759307 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c61ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.973+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/1397759307 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7c57a70 0x55ddb7c61660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:05.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.973+0000 7f9c21dffb80 1 -- 172.21.15.69:0/1397759307 >> 172.21.15.69:0/1397759307 conn(0x55ddb7b1eff0 msgr2=0x55ddb7c56520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:05.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.973+0000 7f9bf6000700 0 client.15738 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:05.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.973+0000 7f9c21dffb80 1 -- 172.21.15.69:0/1397759307 shutdown_connections 2024-05-14T15:23:05.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.973+0000 7f9c21dffb80 1 -- 172.21.15.69:0/1397759307 wait complete. 2024-05-14T15:23:05.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.973+0000 7f9c21dffb80 20 client.15738 trim_cache size 0 max 16384 2024-05-14T15:23:06.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.999+0000 7f9c21dffb80 1 Processor -- start 2024-05-14T15:23:06.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.999+0000 7f9c21dffb80 1 -- start start 2024-05-14T15:23:06.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.999+0000 7f9c21dffb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c57530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:06.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.999+0000 7f9c21dffb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7c57a70 0x55ddb7c5b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:06.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.999+0000 7f9c21dffb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c619e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:06.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.999+0000 7f9c21dffb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c1b2710 con 0x55ddb7ad9ec0 2024-05-14T15:23:06.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.999+0000 7f9c21dffb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c1b4340 con 0x55ddb7c57a70 2024-05-14T15:23:06.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:05.999+0000 7f9c21dffb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c1b2de0 con 0x55ddb7c5d8b0 2024-05-14T15:23:06.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.000+0000 7f9c0be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c57530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:06.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.000+0000 7f9c0be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c57530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58704/0 (socket says 172.21.15.69:58704) 2024-05-14T15:23:06.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.000+0000 7f9c0be00700 1 -- 172.21.15.69:0/2063276823 learned_addr learned my addr 172.21.15.69:0/2063276823 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:06.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.000+0000 7f9c0b400700 1 --2- 172.21.15.69:0/2063276823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7c57a70 0x55ddb7c5b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:06.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.000+0000 7f9c11200700 1 --2- 172.21.15.69:0/2063276823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c619e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:06.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.000+0000 7f9c0be00700 1 -- 172.21.15.69:0/2063276823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c5d8b0 msgr2=0x55ddb7c619e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:06.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.000+0000 7f9c0be00700 1 --2- 172.21.15.69:0/2063276823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c619e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.000+0000 7f9c0be00700 1 -- 172.21.15.69:0/2063276823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7c57a70 msgr2=0x55ddb7c5b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:06.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.000+0000 7f9c0be00700 1 --2- 172.21.15.69:0/2063276823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7c57a70 0x55ddb7c5b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.000+0000 7f9c0be00700 1 -- 172.21.15.69:0/2063276823 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddb7c4cea0 con 0x55ddb7ad9ec0 2024-05-14T15:23:06.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.000+0000 7f9c0b400700 1 --2- 172.21.15.69:0/2063276823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7c57a70 0x55ddb7c5b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:23:06.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.000+0000 7f9c11200700 1 --2- 172.21.15.69:0/2063276823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:23:06.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.001+0000 7f9c0be00700 1 --2- 172.21.15.69:0/2063276823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c57530 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0098e0 tx=0x7f9bfc009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61a13e913ba1f54d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:06.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.001+0000 7f9c00c00700 1 -- 172.21.15.69:0/2063276823 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc029040 con 0x55ddb7ad9ec0 2024-05-14T15:23:06.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.001+0000 7f9c00c00700 1 -- 172.21.15.69:0/2063276823 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bfc00b540 con 0x55ddb7ad9ec0 2024-05-14T15:23:06.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.001+0000 7f9c00c00700 1 -- 172.21.15.69:0/2063276823 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bfc033080 con 0x55ddb7ad9ec0 2024-05-14T15:23:06.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.002+0000 7f9c21dffb80 1 -- 172.21.15.69:0/2063276823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7ad9ec0 msgr2=0x55ddb7c57530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:06.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.002+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/2063276823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c57530 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0098e0 tx=0x7f9bfc009ca0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.002+0000 7f9c21dffb80 1 -- 172.21.15.69:0/2063276823 shutdown_connections 2024-05-14T15:23:06.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.002+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/2063276823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c57530 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.002+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/2063276823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c619e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.002+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/2063276823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7c57a70 0x55ddb7c5b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.002+0000 7f9c21dffb80 1 -- 172.21.15.69:0/2063276823 >> 172.21.15.69:0/2063276823 conn(0x55ddb7b1eff0 msgr2=0x55ddb7c4c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:06.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.003+0000 7f9c21dffb80 1 -- 172.21.15.69:0/2063276823 shutdown_connections 2024-05-14T15:23:06.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.003+0000 7f9c21dffb80 1 -- 172.21.15.69:0/2063276823 wait complete. 2024-05-14T15:23:06.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.003+0000 7f9c21dffb80 1 -- start start 2024-05-14T15:23:06.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.003+0000 7f9c21dffb80 1 Processor -- start 2024-05-14T15:23:06.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.004+0000 7f9c21dffb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c66670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:06.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.004+0000 7f9c21dffb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c57a70 0x55ddb7c66bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:06.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.004+0000 7f9c21dffb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c670f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:06.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.004+0000 7f9c21dffb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c1b3bb0 con 0x55ddb7c5d8b0 2024-05-14T15:23:06.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.004+0000 7f9c21dffb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c1b34e0 con 0x55ddb7ad9ec0 2024-05-14T15:23:06.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.004+0000 7f9c21dffb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9c0c1b06b0 con 0x55ddb7c57a70 2024-05-14T15:23:06.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.004+0000 7f9c21dffb80 10 client.0 _ll_register_callbacks cb 0x55ddb7b20cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:06.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.005+0000 7f9c11200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c670f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:06.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.005+0000 7f9c11200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c670f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58714/0 (socket says 172.21.15.69:58714) 2024-05-14T15:23:06.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.005+0000 7f9c11200700 1 -- 172.21.15.69:0/2906927452 learned_addr learned my addr 172.21.15.69:0/2906927452 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:06.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.005+0000 7f9c0be00700 1 --2- 172.21.15.69:0/2906927452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c66670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:06.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.005+0000 7f9c0b400700 1 --2- 172.21.15.69:0/2906927452 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c57a70 0x55ddb7c66bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:06.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.005+0000 7f9c11200700 1 -- 172.21.15.69:0/2906927452 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c57a70 msgr2=0x55ddb7c66bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:06.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.005+0000 7f9c11200700 1 --2- 172.21.15.69:0/2906927452 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c57a70 0x55ddb7c66bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.005+0000 7f9c11200700 1 -- 172.21.15.69:0/2906927452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7ad9ec0 msgr2=0x55ddb7c66670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:06.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.005+0000 7f9c11200700 1 --2- 172.21.15.69:0/2906927452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c66670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.005+0000 7f9c11200700 1 -- 172.21.15.69:0/2906927452 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddb7cdbc50 con 0x55ddb7c5d8b0 2024-05-14T15:23:06.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.006+0000 7f9c11200700 1 --2- 172.21.15.69:0/2906927452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c670f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9c04007830 tx=0x7f9c04019960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3512e0ca807d53c6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:06.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.006+0000 7f9bf6000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:06.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.006+0000 7f9bf6000700 1 -- 172.21.15.69:0/2906927452 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c04030070 con 0x55ddb7c5d8b0 2024-05-14T15:23:06.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.006+0000 7f9c21dffb80 1 -- 172.21.15.69:0/2906927452 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bfc00b540 con 0x55ddb7c5d8b0 2024-05-14T15:23:06.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.006+0000 7f9bf6000700 1 -- 172.21.15.69:0/2906927452 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f9c04010040 con 0x55ddb7c5d8b0 2024-05-14T15:23:06.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.006+0000 7f9bf6000700 1 -- 172.21.15.69:0/2906927452 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f9c04017e90 con 0x55ddb7c5d8b0 2024-05-14T15:23:06.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.006+0000 7f9c21dffb80 10 client.15744 fetch_fsmap learned FSMap version 33 2024-05-14T15:23:06.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.006+0000 7f9c21dffb80 1 -- 172.21.15.69:0/2906927452 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55ddb7cdcc70 con 0x55ddb7c5d8b0 2024-05-14T15:23:06.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.007+0000 7f9bf6000700 1 -- 172.21.15.69:0/2906927452 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bfc00b540 con 0x55ddb7c5d8b0 2024-05-14T15:23:06.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.007+0000 7f9bf6000700 1 -- 172.21.15.69:0/2906927452 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f9c04016040 con 0x55ddb7c5d8b0 2024-05-14T15:23:06.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.007+0000 7f9c21dffb80 10 client.15744 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:23:06.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.007+0000 7f9c21dffb80 10 client.15744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:06.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.007+0000 7f9c21dffb80 20 client.15744 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:06.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.007+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/2906927452 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ddb7cdd130 0x55ddb7cdf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:06.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.007+0000 7f9c21dffb80 4 client.15744 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-14T15:23:06.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.007+0000 7f9c21dffb80 1 -- 172.21.15.69:0/2906927452 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ddb7b87480 con 0x55ddb7cdd130 2024-05-14T15:23:06.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.008+0000 7f9c0be00700 1 --2- 172.21.15.69:0/2906927452 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ddb7cdd130 0x55ddb7cdf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:06.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.009+0000 7f9c0be00700 1 --2- 172.21.15.69:0/2906927452 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ddb7cdd130 0x55ddb7cdf550 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1267cdfcf06a56aa server_cookie=43003184f766aac5 in_seq=0 out_seq=0 2024-05-14T15:23:06.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.009+0000 7f9bf6000700 10 client.15744 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:06.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.010+0000 7f9bf6000700 1 -- 172.21.15.69:0/2906927452 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ddb7b87480 con 0x55ddb7cdd130 2024-05-14T15:23:06.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.010+0000 7f9bf6000700 10 client.15744 handle_command_reply: tid=0 2024-05-14T15:23:06.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.011+0000 7f9c21dffb80 1 client.15744 shutdown 2024-05-14T15:23:06.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.011+0000 7f9c21dffb80 1 -- 172.21.15.69:0/2906927452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7c5d8b0 msgr2=0x55ddb7c670f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.011+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/2906927452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c670f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f9c04007830 tx=0x7f9c04019960 comp rx=0 tx=0).stop 2024-05-14T15:23:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.011+0000 7f9c21dffb80 1 -- 172.21.15.69:0/2906927452 shutdown_connections 2024-05-14T15:23:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.011+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/2906927452 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ddb7cdd130 0x55ddb7cdf550 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.011+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/2906927452 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ddb7c5d8b0 0x55ddb7c670f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.011+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/2906927452 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ddb7ad9ec0 0x55ddb7c66670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.011+0000 7f9c21dffb80 1 --2- 172.21.15.69:0/2906927452 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ddb7c57a70 0x55ddb7c66bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.011+0000 7f9c21dffb80 1 -- 172.21.15.69:0/2906927452 >> 172.21.15.69:0/2906927452 conn(0x55ddb7b1eff0 msgr2=0x55ddb7c4c790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.011+0000 7f9bf6000700 0 client.15744 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.011+0000 7f9c21dffb80 1 -- 172.21.15.69:0/2906927452 shutdown_connections 2024-05-14T15:23:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.011+0000 7f9c21dffb80 1 -- 172.21.15.69:0/2906927452 wait complete. 2024-05-14T15:23:06.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.011+0000 7f9c21dffb80 20 client.15744 trim_cache size 0 max 16384 2024-05-14T15:23:06.014 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:23:06.014 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2024-05-14T15:23:06.014 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "6fcf1e3f-37b0-4796-9bb4-e59bf38a839c", 2024-05-14T15:23:06.014 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2024-05-14T15:23:06.014 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:23:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.012+0000 7f9c13200700 1 -- 172.21.15.69:0/3002728124 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9bf00b2b90 msgr2=0x7f9bf00b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.012+0000 7f9c13200700 1 --2- 172.21.15.69:0/3002728124 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9bf00b2b90 0x7f9bf00b50a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9c04007fd0 tx=0x7f9c04013380 comp rx=0 tx=0).stop 2024-05-14T15:23:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.012+0000 7f9c13200700 1 -- 172.21.15.69:0/3002728124 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c0c103a10 msgr2=0x7f9c0c19d490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.012+0000 7f9c13200700 1 --2- 172.21.15.69:0/3002728124 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c0c103a10 0x7f9c0c19d490 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800c9e0 tx=0x7f9bf800cda0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.013+0000 7f9c13200700 1 -- 172.21.15.69:0/3002728124 shutdown_connections 2024-05-14T15:23:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.013+0000 7f9c13200700 1 --2- 172.21.15.69:0/3002728124 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9bf00b2b90 0x7f9bf00b50a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.013+0000 7f9c13200700 1 --2- 172.21.15.69:0/3002728124 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9c0c110c70 0x7f9c0c1a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.013+0000 7f9c13200700 1 --2- 172.21.15.69:0/3002728124 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9c0c1030c0 0x7f9c0c19cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.013+0000 7f9c13200700 1 --2- 172.21.15.69:0/3002728124 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9c0c103a10 0x7f9c0c19d490 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.013+0000 7f9c13200700 1 -- 172.21.15.69:0/3002728124 >> 172.21.15.69:0/3002728124 conn(0x7f9c0c0fedc0 msgr2=0x7f9c0c112740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.013+0000 7f9c13200700 1 -- 172.21.15.69:0/3002728124 shutdown_connections 2024-05-14T15:23:06.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:06.013+0000 7f9c13200700 1 -- 172.21.15.69:0/3002728124 wait complete. 2024-05-14T15:23:06.443 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:23:06 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b[64556]: 2024-05-14T15:23:06.048+0000 7f1329000700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001b [...3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical/ auth{1=1,2=1,3=1,4=1} v634 ap=2 f(v10 m2024-05-14T15:22:33.427523+0000 3=1+2) n(v3 rc2024-05-14T15:22:33.427523+0000 b8 4=1+3) (inest sync->mix g=1,2,3,4) caps={25000=pAsLsXsFs/-@53} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55799700a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001b:[<0x10000000006/pg_logical v46>,<0x10000000005/data v96>,<0x10000000003/postgres v21>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v37>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v46>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000001b:[<0x10000000006/pg_logical v634>,<0x10000000005/data v328>,<0x10000000003/postgres v113>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v125>,<0x10000000001/sv_0 v139>,<0x10000000000/qa v127>,<0x1/volumes v119>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-14T15:22:33.396239+0000 4=2+2)","ondisk_value.rstat":"n(v0 rc2024-05-14T15:22:33.427523+0000 b8 4=1+3)","memory_value.dirstat":"f(v10 m2024-05-14T15:22:33.427523+0000 3=1+2)","memory_value.rstat":"n(v3 rc2024-05-14T15:22:33.427523+0000 b8 4=1+3)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-14T15:23:06.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:06 smithi092 ceph-mon[34729]: scrub queued for path: / 2024-05-14T15:23:06.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:06 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:06.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:06 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:23:06.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:06 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:23:06.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:06 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:06.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:06 smithi092 ceph-mon[34729]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2024-05-14T15:23:06.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:06 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:23:06.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:06 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:06.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:06 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:23:06.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:06 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:06.445 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:06 smithi069 ceph-mon[31270]: scrub queued for path: / 2024-05-14T15:23:06.445 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:06 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:06.445 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:06 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:23:06.446 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:06 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:23:06.446 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:06 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:06.446 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:06 smithi069 ceph-mon[31270]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2024-05-14T15:23:06.446 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:06 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:23:06.446 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:06 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:06.446 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:06 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:23:06.446 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:06 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:06.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:06 smithi203 ceph-mon[34567]: scrub queued for path: / 2024-05-14T15:23:06.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:06 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:06.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:06 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:23:06.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:06 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:23:06.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:06 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:06.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:06 smithi203 ceph-mon[34567]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2024-05-14T15:23:06.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:06 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:23:06.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:06 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:06.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:06 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:23:06.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:06 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.247 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T15:23:07.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: pgmap v47: 129 pgs: 129 active+clean; 135 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 43 op/s 2024-05-14T15:23:07.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:23:07.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:23:07.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:23:07.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:23:07.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:23:07.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:23:07.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:23:07.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:23:07.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:23:07.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:07 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: pgmap v47: 129 pgs: 129 active+clean; 135 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 43 op/s 2024-05-14T15:23:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:23:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:23:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:23:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:23:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:23:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:23:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:23:07.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:23:07.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:23:07.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:07 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: pgmap v47: 129 pgs: 129 active+clean; 135 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 43 op/s 2024-05-14T15:23:07.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:23:07.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:23:07.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:23:07.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:23:07.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:23:07.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:23:07.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:23:07.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:23:07.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:23:07.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:07 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:23:07.756 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:23:08.432 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:08 smithi069 ceph-mon[31270]: pgmap v48: 129 pgs: 129 active+clean; 135 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 42 op/s 2024-05-14T15:23:08.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:08 smithi203 ceph-mon[34567]: pgmap v48: 129 pgs: 129 active+clean; 135 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 42 op/s 2024-05-14T15:23:08.692 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:08 smithi092 ceph-mon[34729]: pgmap v48: 129 pgs: 129 active+clean; 135 MiB data, 714 MiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 11 MiB/s wr, 42 op/s 2024-05-14T15:23:08.982 INFO:teuthology.orchestra.run.smithi069.stderr:500000 of 3200000 tuples (15%) done (elapsed 14.59 s, remaining 78.78 s) 2024-05-14T15:23:10.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.293+0000 7f5e8b000700 1 -- 172.21.15.69:0/325304381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e84076680 msgr2=0x7f5e84110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:10.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.293+0000 7f5e8b000700 1 --2- 172.21.15.69:0/325304381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e84076680 0x7f5e84110660 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f5e70009990 tx=0x7f5e70009ca0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.293+0000 7f5e8b000700 1 -- 172.21.15.69:0/325304381 shutdown_connections 2024-05-14T15:23:10.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.293+0000 7f5e8b000700 1 --2- 172.21.15.69:0/325304381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e84110ba0 0x7f5e84113000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.293+0000 7f5e8b000700 1 --2- 172.21.15.69:0/325304381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e84075d30 0x7f5e84076140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.293+0000 7f5e8b000700 1 --2- 172.21.15.69:0/325304381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e84076680 0x7f5e84110660 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.293+0000 7f5e8b000700 1 -- 172.21.15.69:0/325304381 >> 172.21.15.69:0/325304381 conn(0x7f5e84100040 msgr2=0x7f5e84102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:10.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.293+0000 7f5e8b000700 1 -- 172.21.15.69:0/325304381 shutdown_connections 2024-05-14T15:23:10.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.293+0000 7f5e8b000700 1 -- 172.21.15.69:0/325304381 wait complete. 2024-05-14T15:23:10.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.295+0000 7f5e8b000700 1 Processor -- start 2024-05-14T15:23:10.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.295+0000 7f5e8b000700 1 -- start start 2024-05-14T15:23:10.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.295+0000 7f5e8b000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e84075d30 0x7f5e8419cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.295+0000 7f5e8b000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e84076680 0x7f5e8419d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.295+0000 7f5e8b000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e84110ba0 0x7f5e841a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.296+0000 7f5e8b000700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841165a0 con 0x7f5e84110ba0 2024-05-14T15:23:10.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.296+0000 7f5e8b000700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5e84116420 con 0x7f5e84075d30 2024-05-14T15:23:10.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.296+0000 7f5e8b000700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5e84116720 con 0x7f5e84076680 2024-05-14T15:23:10.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.296+0000 7f5e89000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e84110ba0 0x7f5e841a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.296+0000 7f5e89000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e84110ba0 0x7f5e841a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58732/0 (socket says 172.21.15.69:58732) 2024-05-14T15:23:10.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.296+0000 7f5e89000700 1 -- 172.21.15.69:0/607482349 learned_addr learned my addr 172.21.15.69:0/607482349 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:10.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.296+0000 7f5e83e00700 1 --2- 172.21.15.69:0/607482349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e84075d30 0x7f5e8419cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.296+0000 7f5e83400700 1 --2- 172.21.15.69:0/607482349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e84076680 0x7f5e8419d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.297+0000 7f5e89000700 1 -- 172.21.15.69:0/607482349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e84076680 msgr2=0x7f5e8419d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:10.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.297+0000 7f5e89000700 1 --2- 172.21.15.69:0/607482349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e84076680 0x7f5e8419d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.297+0000 7f5e89000700 1 -- 172.21.15.69:0/607482349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e84075d30 msgr2=0x7f5e8419cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:10.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.297+0000 7f5e89000700 1 --2- 172.21.15.69:0/607482349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e84075d30 0x7f5e8419cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.297+0000 7f5e89000700 1 -- 172.21.15.69:0/607482349 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e841a1e80 con 0x7f5e84110ba0 2024-05-14T15:23:10.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.297+0000 7f5e89000700 1 --2- 172.21.15.69:0/607482349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e84110ba0 0x7f5e841a17e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c0094f0 tx=0x7f5e7c00d3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:10.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.297+0000 7f5e80c00700 1 -- 172.21.15.69:0/607482349 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c00ddd0 con 0x7f5e84110ba0 2024-05-14T15:23:10.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.297+0000 7f5e80c00700 1 -- 172.21.15.69:0/607482349 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e7c009e20 con 0x7f5e84110ba0 2024-05-14T15:23:10.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.297+0000 7f5e8b000700 1 -- 172.21.15.69:0/607482349 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e841a2170 con 0x7f5e84110ba0 2024-05-14T15:23:10.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.298+0000 7f5e80c00700 1 -- 172.21.15.69:0/607482349 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c015400 con 0x7f5e84110ba0 2024-05-14T15:23:10.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.298+0000 7f5e8b000700 1 -- 172.21.15.69:0/607482349 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e841a9a90 con 0x7f5e84110ba0 2024-05-14T15:23:10.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.302+0000 7f5e80c00700 1 -- 172.21.15.69:0/607482349 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f5e7c005020 con 0x7f5e84110ba0 2024-05-14T15:23:10.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.304+0000 7f5e99abcb80 1 Processor -- start 2024-05-14T15:23:10.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.304+0000 7f5e99abcb80 1 -- start start 2024-05-14T15:23:10.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.304+0000 7f5e80c00700 1 --2- 172.21.15.69:0/607482349 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5e680b29f0 0x7f5e680b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.304+0000 7f5e99abcb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a880a0e40 0x564a882246b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.304+0000 7f5e99abcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88224bf0 0x564a8821e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.304+0000 7f5e99abcb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a8821ec50 0x564a8821f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.304+0000 7f5e99abcb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564a88140a20 con 0x564a880a0e40 2024-05-14T15:23:10.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.304+0000 7f5e99abcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564a880de760 con 0x564a88224bf0 2024-05-14T15:23:10.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.304+0000 7f5e99abcb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564a8813c9e0 con 0x564a8821ec50 2024-05-14T15:23:10.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.304+0000 7f5e80c00700 1 -- 172.21.15.69:0/607482349 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5e7c0e2460 con 0x7f5e84110ba0 2024-05-14T15:23:10.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.305+0000 7f5e83400700 1 --2- 172.21.15.69:0/607482349 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5e680b29f0 0x7f5e680b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.305+0000 7f5e83400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88224bf0 0x564a8821e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.305+0000 7f5e83400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88224bf0 0x564a8821e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:46724/0 (socket says 172.21.15.69:46724) 2024-05-14T15:23:10.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.305+0000 7f5e83400700 1 -- 172.21.15.69:0/3018769282 learned_addr learned my addr 172.21.15.69:0/3018769282 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:10.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.305+0000 7f5e89000700 1 --2- 172.21.15.69:0/3018769282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a8821ec50 0x564a8821f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.306+0000 7f5e83400700 1 --2- 172.21.15.69:0/607482349 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5e680b29f0 0x7f5e680b4f00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5e70000c00 tx=0x7f5e70009710 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:10.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.306+0000 7f5e89000700 1 -- 172.21.15.69:0/3018769282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88224bf0 msgr2=0x564a8821e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:10.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.306+0000 7f5e89000700 1 --2- 172.21.15.69:0/3018769282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88224bf0 0x564a8821e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.306+0000 7f5e89000700 1 -- 172.21.15.69:0/3018769282 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a880a0e40 msgr2=0x564a882246b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:10.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.306+0000 7f5e83e00700 1 --2- 172.21.15.69:0/3018769282 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a880a0e40 0x564a882246b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.306+0000 7f5e89000700 1 --2- 172.21.15.69:0/3018769282 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a880a0e40 0x564a882246b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.306+0000 7f5e89000700 1 -- 172.21.15.69:0/3018769282 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a8808d8d0 con 0x564a8821ec50 2024-05-14T15:23:10.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.307+0000 7f5e83e00700 1 --2- 172.21.15.69:0/3018769282 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a880a0e40 0x564a882246b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:23:10.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.307+0000 7f5e89000700 1 --2- 172.21.15.69:0/3018769282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a8821ec50 0x564a8821f060 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c0df7a0 tx=0x7f5e7c0a8f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99903e99b3bd4f94 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:10.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.307+0000 7f5e79600700 1 -- 172.21.15.69:0/3018769282 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c0ad6e0 con 0x564a8821ec50 2024-05-14T15:23:10.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.308+0000 7f5e79600700 1 -- 172.21.15.69:0/3018769282 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e7c0b2190 con 0x564a8821ec50 2024-05-14T15:23:10.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.308+0000 7f5e79600700 1 -- 172.21.15.69:0/3018769282 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7c0a9590 con 0x564a8821ec50 2024-05-14T15:23:10.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.309+0000 7f5e99abcb80 1 -- 172.21.15.69:0/3018769282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a8821ec50 msgr2=0x564a8821f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:10.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.309+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/3018769282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a8821ec50 0x564a8821f060 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c0df7a0 tx=0x7f5e7c0a8f40 comp rx=0 tx=0).stop 2024-05-14T15:23:10.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.309+0000 7f5e99abcb80 1 -- 172.21.15.69:0/3018769282 shutdown_connections 2024-05-14T15:23:10.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.309+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/3018769282 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a880a0e40 0x564a882246b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.309+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/3018769282 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a8821ec50 0x564a8821f060 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.309+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/3018769282 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88224bf0 0x564a8821e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.309+0000 7f5e99abcb80 1 -- 172.21.15.69:0/3018769282 >> 172.21.15.69:0/3018769282 conn(0x564a880dfa80 msgr2=0x564a88219790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:10.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.309+0000 7f5e99abcb80 1 -- 172.21.15.69:0/3018769282 shutdown_connections 2024-05-14T15:23:10.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.310+0000 7f5e99abcb80 1 -- 172.21.15.69:0/3018769282 wait complete. 2024-05-14T15:23:10.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.310+0000 7f5e99abcb80 1 -- start start 2024-05-14T15:23:10.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.311+0000 7f5e99abcb80 1 Processor -- start 2024-05-14T15:23:10.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.311+0000 7f5e99abcb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a880a0e40 0x564a882283d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.311+0000 7f5e99abcb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a8821ec50 0x564a88228910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.311+0000 7f5e99abcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88224bf0 0x564a88228e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.311+0000 7f5e99abcb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564a88233e70 con 0x564a8821ec50 2024-05-14T15:23:10.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.311+0000 7f5e99abcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564a880a6b20 con 0x564a88224bf0 2024-05-14T15:23:10.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.311+0000 7f5e99abcb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564a88233ff0 con 0x564a880a0e40 2024-05-14T15:23:10.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.311+0000 7f5e99abcb80 10 client.0 _ll_register_callbacks cb 0x564a880d4380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:10.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.312+0000 7f5e83400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a8821ec50 0x564a88228910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.312+0000 7f5e83400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a8821ec50 0x564a88228910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58754/0 (socket says 172.21.15.69:58754) 2024-05-14T15:23:10.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.312+0000 7f5e83400700 1 -- 172.21.15.69:0/815194691 learned_addr learned my addr 172.21.15.69:0/815194691 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:10.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.312+0000 7f5e83e00700 1 --2- 172.21.15.69:0/815194691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a880a0e40 0x564a882283d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.312+0000 7f5e83400700 1 -- 172.21.15.69:0/815194691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a880a0e40 msgr2=0x564a882283d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:10.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.312+0000 7f5e83400700 1 --2- 172.21.15.69:0/815194691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a880a0e40 0x564a882283d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.312+0000 7f5e89000700 1 --2- 172.21.15.69:0/815194691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88224bf0 0x564a88228e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.312+0000 7f5e83400700 1 -- 172.21.15.69:0/815194691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88224bf0 msgr2=0x564a88228e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:10.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.312+0000 7f5e83400700 1 --2- 172.21.15.69:0/815194691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88224bf0 0x564a88228e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.312+0000 7f5e83400700 1 -- 172.21.15.69:0/815194691 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a88106420 con 0x564a8821ec50 2024-05-14T15:23:10.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.312+0000 7f5e83e00700 1 --2- 172.21.15.69:0/815194691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a880a0e40 0x564a882283d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:23:10.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.312+0000 7f5e89000700 1 --2- 172.21.15.69:0/815194691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88224bf0 0x564a88228e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:23:10.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.313+0000 7f5e83400700 1 --2- 172.21.15.69:0/815194691 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a8821ec50 0x564a88228910 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5e70005f50 tx=0x7f5e70005fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26d9b964a501348 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:10.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.313+0000 7f5e6e000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:10.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.313+0000 7f5e6e000700 1 -- 172.21.15.69:0/815194691 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e70033060 con 0x564a8821ec50 2024-05-14T15:23:10.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.313+0000 7f5e6e000700 1 -- 172.21.15.69:0/815194691 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5e7000baa0 con 0x564a8821ec50 2024-05-14T15:23:10.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.313+0000 7f5e99abcb80 1 -- 172.21.15.69:0/815194691 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e7c0b2190 con 0x564a8821ec50 2024-05-14T15:23:10.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.314+0000 7f5e6e000700 1 -- 172.21.15.69:0/815194691 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5e7000bca0 con 0x564a8821ec50 2024-05-14T15:23:10.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.314+0000 7f5e99abcb80 10 client.15753 fetch_fsmap learned FSMap version 33 2024-05-14T15:23:10.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.314+0000 7f5e99abcb80 1 -- 172.21.15.69:0/815194691 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564a8823ea50 con 0x564a8821ec50 2024-05-14T15:23:10.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.314+0000 7f5e6e000700 1 -- 172.21.15.69:0/815194691 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e7c0b2190 con 0x564a8821ec50 2024-05-14T15:23:10.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.314+0000 7f5e6e000700 1 -- 172.21.15.69:0/815194691 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f5e70026430 con 0x564a8821ec50 2024-05-14T15:23:10.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.314+0000 7f5e99abcb80 10 client.15753 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:23:10.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.315+0000 7f5e99abcb80 10 client.15753 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:10.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.315+0000 7f5e99abcb80 20 client.15753 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:10.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.315+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/815194691 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564a88241090 0x564a882434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.315+0000 7f5e99abcb80 4 client.15753 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:23:10.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.315+0000 7f5e99abcb80 1 -- 172.21.15.69:0/815194691 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a881eb070 con 0x564a88241090 2024-05-14T15:23:10.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.316+0000 7f5e83e00700 1 --2- 172.21.15.69:0/815194691 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564a88241090 0x564a882434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.317+0000 7f5e83e00700 1 --2- 172.21.15.69:0/815194691 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564a88241090 0x564a882434d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=879d6693beff77c9 server_cookie=5ccd2bb450ad6577 in_seq=0 out_seq=0 2024-05-14T15:23:10.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.317+0000 7f5e6e000700 10 client.15753 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:10.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.318+0000 7f5e6e000700 1 -- 172.21.15.69:0/815194691 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564a881eb070 con 0x564a88241090 2024-05-14T15:23:10.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.318+0000 7f5e6e000700 10 client.15753 handle_command_reply: tid=0 2024-05-14T15:23:10.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.319+0000 7f5e99abcb80 1 client.15753 shutdown 2024-05-14T15:23:10.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.319+0000 7f5e99abcb80 1 -- 172.21.15.69:0/815194691 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a8821ec50 msgr2=0x564a88228910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:10.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.319+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/815194691 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a8821ec50 0x564a88228910 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5e70005f50 tx=0x7f5e70005fb0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.319+0000 7f5e99abcb80 1 -- 172.21.15.69:0/815194691 shutdown_connections 2024-05-14T15:23:10.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.319+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/815194691 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564a88241090 0x564a882434d0 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.319+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/815194691 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88224bf0 0x564a88228e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.319+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/815194691 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a880a0e40 0x564a882283d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.319+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/815194691 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a8821ec50 0x564a88228910 secure :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f5e70005f50 tx=0x7f5e70005fb0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.319+0000 7f5e6e000700 0 client.15753 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:10.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.319+0000 7f5e99abcb80 1 -- 172.21.15.69:0/815194691 >> 172.21.15.69:0/815194691 conn(0x564a880dfa80 msgr2=0x564a8821d700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:10.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.320+0000 7f5e99abcb80 1 -- 172.21.15.69:0/815194691 shutdown_connections 2024-05-14T15:23:10.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.320+0000 7f5e99abcb80 1 -- 172.21.15.69:0/815194691 wait complete. 2024-05-14T15:23:10.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.320+0000 7f5e99abcb80 20 client.15753 trim_cache size 0 max 16384 2024-05-14T15:23:10.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.347+0000 7f5e99abcb80 1 Processor -- start 2024-05-14T15:23:10.348 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.347+0000 7f5e99abcb80 1 -- start start 2024-05-14T15:23:10.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.347+0000 7f5e99abcb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a880a0e40 0x564a8821e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.347+0000 7f5e99abcb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a88224bf0 0x564a88227710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.347+0000 7f5e99abcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88228c90 0x564a882195a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.347+0000 7f5e99abcb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841ae3f0 con 0x564a88224bf0 2024-05-14T15:23:10.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.347+0000 7f5e99abcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841b0020 con 0x564a88228c90 2024-05-14T15:23:10.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.347+0000 7f5e99abcb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841aeac0 con 0x564a880a0e40 2024-05-14T15:23:10.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.348+0000 7f5e83400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a88224bf0 0x564a88227710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.348+0000 7f5e83400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a88224bf0 0x564a88227710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58760/0 (socket says 172.21.15.69:58760) 2024-05-14T15:23:10.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.348+0000 7f5e83400700 1 -- 172.21.15.69:0/883909539 learned_addr learned my addr 172.21.15.69:0/883909539 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:10.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.348+0000 7f5e83e00700 1 --2- 172.21.15.69:0/883909539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a880a0e40 0x564a8821e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.348+0000 7f5e89000700 1 --2- 172.21.15.69:0/883909539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88228c90 0x564a882195a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.348+0000 7f5e83400700 1 -- 172.21.15.69:0/883909539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a880a0e40 msgr2=0x564a8821e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:10.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.348+0000 7f5e83400700 1 --2- 172.21.15.69:0/883909539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a880a0e40 0x564a8821e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.349+0000 7f5e83400700 1 -- 172.21.15.69:0/883909539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88228c90 msgr2=0x564a882195a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:10.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.349+0000 7f5e83400700 1 --2- 172.21.15.69:0/883909539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88228c90 0x564a882195a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.349+0000 7f5e83400700 1 -- 172.21.15.69:0/883909539 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a8821b1d0 con 0x564a88224bf0 2024-05-14T15:23:10.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.349+0000 7f5e89000700 1 --2- 172.21.15.69:0/883909539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88228c90 0x564a882195a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:23:10.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.349+0000 7f5e83400700 1 --2- 172.21.15.69:0/883909539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a88224bf0 0x564a88227710 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5e70003760 tx=0x7f5e70009ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4add629a6d74e38d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:10.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.349+0000 7f5e78c00700 1 -- 172.21.15.69:0/883909539 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e70033040 con 0x564a88224bf0 2024-05-14T15:23:10.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.349+0000 7f5e78c00700 1 -- 172.21.15.69:0/883909539 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e7002a070 con 0x564a88224bf0 2024-05-14T15:23:10.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.349+0000 7f5e78c00700 1 -- 172.21.15.69:0/883909539 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7003a030 con 0x564a88224bf0 2024-05-14T15:23:10.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.351+0000 7f5e99abcb80 1 -- 172.21.15.69:0/883909539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a88224bf0 msgr2=0x564a88227710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:10.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.351+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/883909539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a88224bf0 0x564a88227710 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f5e70003760 tx=0x7f5e70009ca0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.351+0000 7f5e99abcb80 1 -- 172.21.15.69:0/883909539 shutdown_connections 2024-05-14T15:23:10.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.351+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/883909539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a88228c90 0x564a882195a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.351+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/883909539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a880a0e40 0x564a8821e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.351+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/883909539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a88224bf0 0x564a88227710 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.351+0000 7f5e99abcb80 1 -- 172.21.15.69:0/883909539 >> 172.21.15.69:0/883909539 conn(0x564a880dfa80 msgr2=0x564a88218e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:10.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.351+0000 7f5e99abcb80 1 -- 172.21.15.69:0/883909539 shutdown_connections 2024-05-14T15:23:10.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.351+0000 7f5e99abcb80 1 -- 172.21.15.69:0/883909539 wait complete. 2024-05-14T15:23:10.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.352+0000 7f5e99abcb80 1 -- start start 2024-05-14T15:23:10.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.352+0000 7f5e99abcb80 1 Processor -- start 2024-05-14T15:23:10.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.353+0000 7f5e99abcb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a880a0e40 0x564a88236210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.353+0000 7f5e99abcb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a88224bf0 0x564a88236750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.353+0000 7f5e99abcb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a88228c90 0x564a88236c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.353+0000 7f5e99abcb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841af890 con 0x564a88224bf0 2024-05-14T15:23:10.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.353+0000 7f5e99abcb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841af1c0 con 0x564a880a0e40 2024-05-14T15:23:10.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.353+0000 7f5e99abcb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5e841ac390 con 0x564a88228c90 2024-05-14T15:23:10.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.353+0000 7f5e99abcb80 10 client.0 _ll_register_callbacks cb 0x564a880d4380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:10.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.353+0000 7f5e83400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a88224bf0 0x564a88236750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.353+0000 7f5e83400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a88224bf0 0x564a88236750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58766/0 (socket says 172.21.15.69:58766) 2024-05-14T15:23:10.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.353+0000 7f5e83400700 1 -- 172.21.15.69:0/1590302532 learned_addr learned my addr 172.21.15.69:0/1590302532 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:10.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.354+0000 7f5e83e00700 1 --2- 172.21.15.69:0/1590302532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a880a0e40 0x564a88236210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.354+0000 7f5e89000700 1 --2- 172.21.15.69:0/1590302532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a88228c90 0x564a88236c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.354+0000 7f5e83400700 1 -- 172.21.15.69:0/1590302532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a88228c90 msgr2=0x564a88236c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.354+0000 7f5e83400700 1 --2- 172.21.15.69:0/1590302532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a88228c90 0x564a88236c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.354+0000 7f5e83400700 1 -- 172.21.15.69:0/1590302532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a880a0e40 msgr2=0x564a88236210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.354+0000 7f5e83400700 1 --2- 172.21.15.69:0/1590302532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a880a0e40 0x564a88236210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.354+0000 7f5e83400700 1 -- 172.21.15.69:0/1590302532 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a88239c70 con 0x564a88224bf0 2024-05-14T15:23:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.354+0000 7f5e89000700 1 --2- 172.21.15.69:0/1590302532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a88228c90 0x564a88236c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:23:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.354+0000 7f5e83400700 1 --2- 172.21.15.69:0/1590302532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a88224bf0 0x564a88236750 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5e700098e0 tx=0x7f5e70005e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80fdbf28a22d4b10 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.354+0000 7f5e6e000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.355+0000 7f5e6e000700 1 -- 172.21.15.69:0/1590302532 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e7003a070 con 0x564a88224bf0 2024-05-14T15:23:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.355+0000 7f5e99abcb80 1 -- 172.21.15.69:0/1590302532 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5e7002a070 con 0x564a88224bf0 2024-05-14T15:23:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.355+0000 7f5e6e000700 1 -- 172.21.15.69:0/1590302532 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5e7000f670 con 0x564a88224bf0 2024-05-14T15:23:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.355+0000 7f5e6e000700 1 -- 172.21.15.69:0/1590302532 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5e7004c050 con 0x564a88224bf0 2024-05-14T15:23:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.355+0000 7f5e99abcb80 10 client.15759 fetch_fsmap learned FSMap version 33 2024-05-14T15:23:10.357 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.355+0000 7f5e99abcb80 1 -- 172.21.15.69:0/1590302532 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564a882ac8f0 con 0x564a88224bf0 2024-05-14T15:23:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.356+0000 7f5e6e000700 1 -- 172.21.15.69:0/1590302532 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5e7002a070 con 0x564a88224bf0 2024-05-14T15:23:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.356+0000 7f5e6e000700 1 -- 172.21.15.69:0/1590302532 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7f5e7002e990 con 0x564a88224bf0 2024-05-14T15:23:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.356+0000 7f5e99abcb80 10 client.15759 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:23:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.356+0000 7f5e99abcb80 10 client.15759 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.356+0000 7f5e99abcb80 20 client.15759 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.356+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/1590302532 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564a882ad030 0x564a882af450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:10.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.356+0000 7f5e99abcb80 4 client.15759 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T15:23:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.356+0000 7f5e99abcb80 1 -- 172.21.15.69:0/1590302532 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564a8814e400 con 0x564a882ad030 2024-05-14T15:23:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.357+0000 7f5e83e00700 1 --2- 172.21.15.69:0/1590302532 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564a882ad030 0x564a882af450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.358+0000 7f5e83e00700 1 --2- 172.21.15.69:0/1590302532 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564a882ad030 0x564a882af450 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=51c311187423d50c server_cookie=78dd371da3280ce5 in_seq=0 out_seq=0 2024-05-14T15:23:10.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.358+0000 7f5e6e000700 10 client.15759 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:10.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.358+0000 7f5e6e000700 1 -- 172.21.15.69:0/1590302532 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564a8814e400 con 0x564a882ad030 2024-05-14T15:23:10.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.358+0000 7f5e6e000700 10 client.15759 handle_command_reply: tid=0 2024-05-14T15:23:10.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.358+0000 7f5e99abcb80 1 client.15759 shutdown 2024-05-14T15:23:10.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.358+0000 7f5e99abcb80 1 -- 172.21.15.69:0/1590302532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a88224bf0 msgr2=0x564a88236750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:10.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.358+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/1590302532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a88224bf0 0x564a88236750 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f5e700098e0 tx=0x7f5e70005e80 comp rx=0 tx=0).stop 2024-05-14T15:23:10.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.359+0000 7f5e99abcb80 1 -- 172.21.15.69:0/1590302532 shutdown_connections 2024-05-14T15:23:10.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.359+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/1590302532 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564a882ad030 0x564a882af450 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.359+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/1590302532 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a88228c90 0x564a88236c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.359+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/1590302532 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a880a0e40 0x564a88236210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.359+0000 7f5e99abcb80 1 --2- 172.21.15.69:0/1590302532 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a88224bf0 0x564a88236750 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.359+0000 7f5e99abcb80 1 -- 172.21.15.69:0/1590302532 >> 172.21.15.69:0/1590302532 conn(0x564a880dfa80 msgr2=0x564a88227470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:10.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.359+0000 7f5e6e000700 0 client.15759 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:10.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.359+0000 7f5e99abcb80 1 -- 172.21.15.69:0/1590302532 shutdown_connections 2024-05-14T15:23:10.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.359+0000 7f5e99abcb80 1 -- 172.21.15.69:0/1590302532 wait complete. 2024-05-14T15:23:10.361 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.359+0000 7f5e99abcb80 20 client.15759 trim_cache size 0 max 16384 2024-05-14T15:23:10.361 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:23:10.362 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-14T15:23:10.362 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2024-05-14T15:23:10.362 INFO:teuthology.orchestra.run.smithi069.stdout: "6fcf1e3f-37b0-4796-9bb4-e59bf38a839c": { 2024-05-14T15:23:10.362 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2024-05-14T15:23:10.362 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "6fcf1e3f-37b0-4796-9bb4-e59bf38a839c", 2024-05-14T15:23:10.362 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2024-05-14T15:23:10.362 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:23:10.362 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:23:10.362 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:23:10.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.360+0000 7f5e8b000700 1 -- 172.21.15.69:0/607482349 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5e680b29f0 msgr2=0x7f5e680b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:10.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.360+0000 7f5e8b000700 1 --2- 172.21.15.69:0/607482349 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5e680b29f0 0x7f5e680b4f00 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f5e70000c00 tx=0x7f5e70009710 comp rx=0 tx=0).stop 2024-05-14T15:23:10.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.360+0000 7f5e8b000700 1 -- 172.21.15.69:0/607482349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e84110ba0 msgr2=0x7f5e841a17e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:10.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.360+0000 7f5e8b000700 1 --2- 172.21.15.69:0/607482349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e84110ba0 0x7f5e841a17e0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f5e7c0094f0 tx=0x7f5e7c00d3b0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.360+0000 7f5e8b000700 1 -- 172.21.15.69:0/607482349 shutdown_connections 2024-05-14T15:23:10.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.360+0000 7f5e8b000700 1 --2- 172.21.15.69:0/607482349 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5e680b29f0 0x7f5e680b4f00 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.360+0000 7f5e8b000700 1 --2- 172.21.15.69:0/607482349 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5e84110ba0 0x7f5e841a17e0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.360+0000 7f5e8b000700 1 --2- 172.21.15.69:0/607482349 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5e84075d30 0x7f5e8419cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.360+0000 7f5e8b000700 1 --2- 172.21.15.69:0/607482349 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5e84076680 0x7f5e8419d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:10.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.360+0000 7f5e8b000700 1 -- 172.21.15.69:0/607482349 >> 172.21.15.69:0/607482349 conn(0x7f5e84100040 msgr2=0x7f5e84100790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:10.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.361+0000 7f5e8b000700 1 -- 172.21.15.69:0/607482349 shutdown_connections 2024-05-14T15:23:10.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:10.361+0000 7f5e8b000700 1 -- 172.21.15.69:0/607482349 wait complete. 2024-05-14T15:23:11.192 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:10 smithi069 ceph-mon[31270]: pgmap v49: 129 pgs: 129 active+clean; 170 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 17 MiB/s wr, 124 op/s 2024-05-14T15:23:11.192 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:10 smithi069 ceph-mon[31270]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-05-14T15:23:11.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:10 smithi092 ceph-mon[34729]: pgmap v49: 129 pgs: 129 active+clean; 170 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 17 MiB/s wr, 124 op/s 2024-05-14T15:23:11.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:10 smithi092 ceph-mon[34729]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-05-14T15:23:11.276 INFO:tasks.cephfs.filesystem:scrub status for tag:6fcf1e3f-37b0-4796-9bb4-e59bf38a839c - {'path': '/', 'tag': '6fcf1e3f-37b0-4796-9bb4-e59bf38a839c', 'options': 'recursive,force'} 2024-05-14T15:23:11.298 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:10 smithi203 ceph-mon[34567]: pgmap v49: 129 pgs: 129 active+clean; 170 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 136 KiB/s rd, 17 MiB/s wr, 124 op/s 2024-05-14T15:23:11.298 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:10 smithi203 ceph-mon[34567]: mgrmap e25: x(active, since 92s), standbys: z, y 2024-05-14T15:23:12.578 INFO:teuthology.orchestra.run.smithi069.stderr:600000 of 3200000 tuples (18%) done (elapsed 18.19 s, remaining 78.81 s) 2024-05-14T15:23:13.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:12 smithi092 ceph-mon[34729]: pgmap v50: 129 pgs: 129 active+clean; 170 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 12 MiB/s wr, 109 op/s 2024-05-14T15:23:13.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:12 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:23:13.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:12 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:23:13.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:12 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:23:13.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:12 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:23:13.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:12 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:23:13.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:12 smithi069 ceph-mon[31270]: pgmap v50: 129 pgs: 129 active+clean; 170 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 12 MiB/s wr, 109 op/s 2024-05-14T15:23:13.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:12 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:23:13.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:12 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:23:13.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:12 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:23:13.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:12 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:23:13.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:12 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:23:13.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:12 smithi203 ceph-mon[34567]: pgmap v50: 129 pgs: 129 active+clean; 170 MiB data, 780 MiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 12 MiB/s wr, 109 op/s 2024-05-14T15:23:13.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:12 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:23:13.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:12 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:23:13.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:12 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:23:13.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:12 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:23:13.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:12 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:23:15.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:14 smithi092 ceph-mon[34729]: pgmap v51: 129 pgs: 129 active+clean; 196 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 16 MiB/s wr, 117 op/s 2024-05-14T15:23:15.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:14 smithi069 ceph-mon[31270]: pgmap v51: 129 pgs: 129 active+clean; 196 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 16 MiB/s wr, 117 op/s 2024-05-14T15:23:15.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:14 smithi203 ceph-mon[34567]: pgmap v51: 129 pgs: 129 active+clean; 196 MiB data, 828 MiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 16 MiB/s wr, 117 op/s 2024-05-14T15:23:17.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:16 smithi092 ceph-mon[34729]: pgmap v52: 129 pgs: 129 active+clean; 206 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 11 MiB/s wr, 90 op/s 2024-05-14T15:23:17.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:16 smithi069 ceph-mon[31270]: pgmap v52: 129 pgs: 129 active+clean; 206 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 11 MiB/s wr, 90 op/s 2024-05-14T15:23:17.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:16 smithi203 ceph-mon[34567]: pgmap v52: 129 pgs: 129 active+clean; 206 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 11 MiB/s wr, 90 op/s 2024-05-14T15:23:17.362 INFO:teuthology.orchestra.run.smithi069.stderr:700000 of 3200000 tuples (21%) done (elapsed 22.97 s, remaining 82.04 s) 2024-05-14T15:23:19.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.135+0000 7fd68fe00640 1 -- 172.21.15.69:0/3803542303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd690104210 msgr2=0x7fd6901105e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.135+0000 7fd68fe00640 1 --2- 172.21.15.69:0/3803542303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd690104210 0x7fd6901105e0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd688009ca0 tx=0x7fd68802a8c0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.135+0000 7fd68fe00640 1 -- 172.21.15.69:0/3803542303 shutdown_connections 2024-05-14T15:23:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.135+0000 7fd68fe00640 1 --2- 172.21.15.69:0/3803542303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd690104210 0x7fd6901105e0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.135+0000 7fd68fe00640 1 --2- 172.21.15.69:0/3803542303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd690109f60 0x7fd690103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.135+0000 7fd68fe00640 1 --2- 172.21.15.69:0/3803542303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd690109ac0 0x7fd690103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.135+0000 7fd68fe00640 1 -- 172.21.15.69:0/3803542303 >> 172.21.15.69:0/3803542303 conn(0x7fd690079150 msgr2=0x7fd690079590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.136+0000 7fd68fe00640 1 -- 172.21.15.69:0/3803542303 shutdown_connections 2024-05-14T15:23:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.136+0000 7fd68fe00640 1 -- 172.21.15.69:0/3803542303 wait complete. 2024-05-14T15:23:19.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.137+0000 7fd68fe00640 1 Processor -- start 2024-05-14T15:23:19.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.137+0000 7fd68fe00640 1 -- start start 2024-05-14T15:23:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.138+0000 7fd68fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd690104210 0x7fd6901a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.138+0000 7fd68fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd690109ac0 0x7fd6901a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.138+0000 7fd68fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd690109f60 0x7fd69019c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.138+0000 7fd68fe00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd690113bd0 con 0x7fd690109ac0 2024-05-14T15:23:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.138+0000 7fd68fe00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd690113a50 con 0x7fd690109f60 2024-05-14T15:23:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.138+0000 7fd68fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd690113d50 con 0x7fd690104210 2024-05-14T15:23:19.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.138+0000 7fd68e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd690109ac0 0x7fd6901a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.138+0000 7fd68e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd690109ac0 0x7fd6901a2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42956/0 (socket says 172.21.15.69:42956) 2024-05-14T15:23:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.138+0000 7fd68e000640 1 -- 172.21.15.69:0/14332022 learned_addr learned my addr 172.21.15.69:0/14332022 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.139+0000 7fd68ea00640 1 --2- 172.21.15.69:0/14332022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd690104210 0x7fd6901a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.139+0000 7fd68f400640 1 --2- 172.21.15.69:0/14332022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd690109f60 0x7fd69019c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.139+0000 7fd68e000640 1 -- 172.21.15.69:0/14332022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd690104210 msgr2=0x7fd6901a24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.139+0000 7fd68e000640 1 --2- 172.21.15.69:0/14332022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd690104210 0x7fd6901a24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.139+0000 7fd68e000640 1 -- 172.21.15.69:0/14332022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd690109f60 msgr2=0x7fd69019c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.139+0000 7fd68e000640 1 --2- 172.21.15.69:0/14332022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd690109f60 0x7fd69019c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.139+0000 7fd68e000640 1 -- 172.21.15.69:0/14332022 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69019cda0 con 0x7fd690109ac0 2024-05-14T15:23:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.139+0000 7fd68e000640 1 --2- 172.21.15.69:0/14332022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd690109ac0 0x7fd6901a2a30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd67c005fd0 tx=0x7fd67c00dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.140+0000 7fd687400640 1 -- 172.21.15.69:0/14332022 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c017070 con 0x7fd690109ac0 2024-05-14T15:23:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.140+0000 7fd687400640 1 -- 172.21.15.69:0/14332022 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd67c009c30 con 0x7fd690109ac0 2024-05-14T15:23:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.140+0000 7fd68fe00640 1 -- 172.21.15.69:0/14332022 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69019d030 con 0x7fd690109ac0 2024-05-14T15:23:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.140+0000 7fd687400640 1 -- 172.21.15.69:0/14332022 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c003c90 con 0x7fd690109ac0 2024-05-14T15:23:19.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.140+0000 7fd68fe00640 1 -- 172.21.15.69:0/14332022 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6901a9290 con 0x7fd690109ac0 2024-05-14T15:23:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.144+0000 7fd69c9c8740 1 Processor -- start 2024-05-14T15:23:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.145+0000 7fd69c9c8740 1 -- start start 2024-05-14T15:23:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.145+0000 7fd69c9c8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 0x5621efa37480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.145+0000 7fd69c9c8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef66d2f0 0x5621efa379c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.145+0000 7fd69c9c8740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6754d0 0x5621efa37f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.145+0000 7fd69c9c8740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5621ef99c550 con 0x5621ef6754d0 2024-05-14T15:23:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.145+0000 7fd69c9c8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5621ef941bc0 con 0x5621ef66d2f0 2024-05-14T15:23:19.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.145+0000 7fd69c9c8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5621ef998510 con 0x5621ef6961b0 2024-05-14T15:23:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.146+0000 7fd68f400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 0x5621efa37480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.146+0000 7fd68ea00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef66d2f0 0x5621efa379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.146+0000 7fd68f400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 0x5621efa37480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:53568/0 (socket says 172.21.15.69:53568) 2024-05-14T15:23:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.146+0000 7fd68f400640 1 -- 172.21.15.69:0/3869213440 learned_addr learned my addr 172.21.15.69:0/3869213440 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.146+0000 7fd687400640 1 -- 172.21.15.69:0/14332022 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd67c004020 con 0x7fd690109ac0 2024-05-14T15:23:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.146+0000 7fd68e000640 1 --2- 172.21.15.69:0/3869213440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6754d0 0x5621efa37f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.147+0000 7fd68ea00640 1 -- 172.21.15.69:0/3869213440 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 msgr2=0x5621efa37480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.147+0000 7fd68ea00640 1 --2- 172.21.15.69:0/3869213440 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 0x5621efa37480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.147+0000 7fd68ea00640 1 -- 172.21.15.69:0/3869213440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6754d0 msgr2=0x5621efa37f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.147+0000 7fd68ea00640 1 --2- 172.21.15.69:0/3869213440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6754d0 0x5621efa37f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.147+0000 7fd68ea00640 1 -- 172.21.15.69:0/3869213440 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621ef6ae210 con 0x5621ef66d2f0 2024-05-14T15:23:19.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.147+0000 7fd68f400640 1 --2- 172.21.15.69:0/3869213440 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 0x5621efa37480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:23:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.147+0000 7fd68ea00640 1 --2- 172.21.15.69:0/3869213440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef66d2f0 0x5621efa379c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd680009b40 tx=0x7fd6800113e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4a2d65f82c4eb45f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.148+0000 7fd67be00640 1 -- 172.21.15.69:0/3869213440 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680011e10 con 0x5621ef66d2f0 2024-05-14T15:23:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.148+0000 7fd67be00640 1 -- 172.21.15.69:0/3869213440 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6800128e0 con 0x5621ef66d2f0 2024-05-14T15:23:19.148 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.148+0000 7fd67be00640 1 -- 172.21.15.69:0/3869213440 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68000f930 con 0x5621ef66d2f0 2024-05-14T15:23:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.148+0000 7fd687400640 1 --2- 172.21.15.69:0/14332022 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd6740b29d0 0x7fd6740b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.149+0000 7fd687400640 1 -- 172.21.15.69:0/14332022 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fd67c0e22c0 con 0x7fd690109ac0 2024-05-14T15:23:19.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.149+0000 7fd68f400640 1 --2- 172.21.15.69:0/14332022 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd6740b29d0 0x7fd6740b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.149+0000 7fd69c9c8740 1 -- 172.21.15.69:0/3869213440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef66d2f0 msgr2=0x5621efa379c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.149+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/3869213440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef66d2f0 0x5621efa379c0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd680009b40 tx=0x7fd6800113e0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.149+0000 7fd69c9c8740 1 -- 172.21.15.69:0/3869213440 shutdown_connections 2024-05-14T15:23:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.149+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/3869213440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6754d0 0x5621efa37f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.149+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/3869213440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef66d2f0 0x5621efa379c0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.149+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/3869213440 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 0x5621efa37480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.149+0000 7fd69c9c8740 1 -- 172.21.15.69:0/3869213440 >> 172.21.15.69:0/3869213440 conn(0x5621ef68a300 msgr2=0x5621efa33c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.150+0000 7fd69c9c8740 1 -- 172.21.15.69:0/3869213440 shutdown_connections 2024-05-14T15:23:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.150+0000 7fd68f400640 1 --2- 172.21.15.69:0/14332022 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd6740b29d0 0x7fd6740b4ee0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd6880094e0 tx=0x7fd688005c50 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:19.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.150+0000 7fd69c9c8740 1 -- 172.21.15.69:0/3869213440 wait complete. 2024-05-14T15:23:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.150+0000 7fd69c9c8740 1 -- start start 2024-05-14T15:23:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.151+0000 7fd69c9c8740 1 Processor -- start 2024-05-14T15:23:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.151+0000 7fd69c9c8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef66d2f0 0x5621efa41a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.151+0000 7fd69c9c8740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6754d0 0x5621efa41f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.151+0000 7fd69c9c8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 0x5621efa4da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.151+0000 7fd69c9c8740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5621efa445b0 con 0x5621ef6754d0 2024-05-14T15:23:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.151+0000 7fd69c9c8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5621ef955660 con 0x5621ef66d2f0 2024-05-14T15:23:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.151+0000 7fd69c9c8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5621efa44730 con 0x5621ef6961b0 2024-05-14T15:23:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.152+0000 7fd69c9c8740 10 client.0 _ll_register_callbacks cb 0x5621ef91f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.152+0000 7fd68e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6754d0 0x5621efa41f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.152+0000 7fd68e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6754d0 0x5621efa41f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42974/0 (socket says 172.21.15.69:42974) 2024-05-14T15:23:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.152+0000 7fd68e000640 1 -- 172.21.15.69:0/3518594044 learned_addr learned my addr 172.21.15.69:0/3518594044 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.152+0000 7fd68ea00640 1 --2- 172.21.15.69:0/3518594044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef66d2f0 0x5621efa41a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.152+0000 7fd68f400640 1 --2- 172.21.15.69:0/3518594044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 0x5621efa4da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.153+0000 7fd68e000640 1 -- 172.21.15.69:0/3518594044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 msgr2=0x5621efa4da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.153+0000 7fd68e000640 1 --2- 172.21.15.69:0/3518594044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 0x5621efa4da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.153+0000 7fd68e000640 1 -- 172.21.15.69:0/3518594044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef66d2f0 msgr2=0x5621efa41a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.153+0000 7fd68e000640 1 --2- 172.21.15.69:0/3518594044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef66d2f0 0x5621efa41a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.153+0000 7fd68e000640 1 -- 172.21.15.69:0/3518594044 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621ef77a620 con 0x5621ef6754d0 2024-05-14T15:23:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.153+0000 7fd68e000640 1 --2- 172.21.15.69:0/3518594044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6754d0 0x5621efa41f40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0a6460 tx=0x7fd67c004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f6caa22308d79a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.153+0000 7fd678c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.153+0000 7fd678c00640 1 -- 172.21.15.69:0/3518594044 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0a8d00 con 0x5621ef6754d0 2024-05-14T15:23:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.153+0000 7fd678c00640 1 -- 172.21.15.69:0/3518594044 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fd67c0a5480 con 0x5621ef6754d0 2024-05-14T15:23:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.153+0000 7fd69c9c8740 1 -- 172.21.15.69:0/3518594044 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6800128e0 con 0x5621ef6754d0 2024-05-14T15:23:19.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.154+0000 7fd678c00640 1 -- 172.21.15.69:0/3518594044 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd67c0a98f0 con 0x5621ef6754d0 2024-05-14T15:23:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.154+0000 7fd69c9c8740 10 client.15771 fetch_fsmap learned FSMap version 33 2024-05-14T15:23:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.154+0000 7fd69c9c8740 1 -- 172.21.15.69:0/3518594044 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5621efa508a0 con 0x5621ef6754d0 2024-05-14T15:23:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.154+0000 7fd678c00640 1 -- 172.21.15.69:0/3518594044 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6800128e0 con 0x5621ef6754d0 2024-05-14T15:23:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.154+0000 7fd678c00640 1 -- 172.21.15.69:0/3518594044 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fd67c0e5c60 con 0x5621ef6754d0 2024-05-14T15:23:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.155+0000 7fd69c9c8740 10 client.15771 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:23:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.155+0000 7fd69c9c8740 10 client.15771 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.155+0000 7fd69c9c8740 20 client.15771 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.155+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/3518594044 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5621ef654d80 0x5621efa53e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.155+0000 7fd69c9c8740 4 client.15771 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:23:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.155+0000 7fd69c9c8740 1 -- 172.21.15.69:0/3518594044 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621ef9aa160 con 0x5621ef654d80 2024-05-14T15:23:19.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.156+0000 7fd68ea00640 1 --2- 172.21.15.69:0/3518594044 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5621ef654d80 0x5621efa53e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.158+0000 7fd68ea00640 1 --2- 172.21.15.69:0/3518594044 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5621ef654d80 0x5621efa53e70 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=989e338e921f3ac8 server_cookie=481c695de222dfbd in_seq=0 out_seq=0 2024-05-14T15:23:19.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.158+0000 7fd678c00640 10 client.15771 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.160+0000 7fd678c00640 1 -- 172.21.15.69:0/3518594044 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5621ef9aa160 con 0x5621ef654d80 2024-05-14T15:23:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.160+0000 7fd678c00640 10 client.15771 handle_command_reply: tid=0 2024-05-14T15:23:19.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.160+0000 7fd69c9c8740 1 client.15771 shutdown 2024-05-14T15:23:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.160+0000 7fd69c9c8740 1 -- 172.21.15.69:0/3518594044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6754d0 msgr2=0x5621efa41f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.160+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/3518594044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6754d0 0x5621efa41f40 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0a6460 tx=0x7fd67c004590 comp rx=0 tx=0).stop 2024-05-14T15:23:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.161+0000 7fd69c9c8740 1 -- 172.21.15.69:0/3518594044 shutdown_connections 2024-05-14T15:23:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.161+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/3518594044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 0x5621efa4da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.161+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/3518594044 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5621ef654d80 0x5621efa53e70 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.161+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/3518594044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6754d0 0x5621efa41f40 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.161+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/3518594044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef66d2f0 0x5621efa41a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.161+0000 7fd678c00640 0 client.15771 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.161+0000 7fd69c9c8740 1 -- 172.21.15.69:0/3518594044 >> 172.21.15.69:0/3518594044 conn(0x5621ef68a300 msgr2=0x5621efa391a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.161+0000 7fd69c9c8740 1 -- 172.21.15.69:0/3518594044 shutdown_connections 2024-05-14T15:23:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.161+0000 7fd69c9c8740 1 -- 172.21.15.69:0/3518594044 wait complete. 2024-05-14T15:23:19.162 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.161+0000 7fd69c9c8740 20 client.15771 trim_cache size 0 max 16384 2024-05-14T15:23:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.184+0000 7fd69c9c8740 1 Processor -- start 2024-05-14T15:23:19.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.184+0000 7fd69c9c8740 1 -- start start 2024-05-14T15:23:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.184+0000 7fd69c9c8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef66d2f0 0x5621efa410d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.184+0000 7fd69c9c8740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6961b0 0x5621efa43940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.185+0000 7fd69c9c8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef62a1c0 0x5621efa59620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.185+0000 7fd69c9c8740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b3320 con 0x5621ef6961b0 2024-05-14T15:23:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.185+0000 7fd69c9c8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b4f50 con 0x5621ef62a1c0 2024-05-14T15:23:19.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.185+0000 7fd69c9c8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b39f0 con 0x5621ef66d2f0 2024-05-14T15:23:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.185+0000 7fd68e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6961b0 0x5621efa43940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.186+0000 7fd68f400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef62a1c0 0x5621efa59620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.186+0000 7fd68e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6961b0 0x5621efa43940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42990/0 (socket says 172.21.15.69:42990) 2024-05-14T15:23:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.186+0000 7fd68e000640 1 -- 172.21.15.69:0/574932129 learned_addr learned my addr 172.21.15.69:0/574932129 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:19.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.186+0000 7fd68ea00640 1 --2- 172.21.15.69:0/574932129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef66d2f0 0x5621efa410d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.186+0000 7fd68e000640 1 -- 172.21.15.69:0/574932129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef66d2f0 msgr2=0x5621efa410d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.186+0000 7fd68e000640 1 --2- 172.21.15.69:0/574932129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef66d2f0 0x5621efa410d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.186+0000 7fd68e000640 1 -- 172.21.15.69:0/574932129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef62a1c0 msgr2=0x5621efa59620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.186+0000 7fd68e000640 1 --2- 172.21.15.69:0/574932129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef62a1c0 0x5621efa59620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.186+0000 7fd68e000640 1 -- 172.21.15.69:0/574932129 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621efa3fd40 con 0x5621ef6961b0 2024-05-14T15:23:19.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.187+0000 7fd68e000640 1 --2- 172.21.15.69:0/574932129 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6961b0 0x5621efa43940 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0dfc60 tx=0x7fd67c0a90c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54088ef1aba0431a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.187+0000 7fd67b400640 1 -- 172.21.15.69:0/574932129 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0a8d00 con 0x5621ef6961b0 2024-05-14T15:23:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.187+0000 7fd67b400640 1 -- 172.21.15.69:0/574932129 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd67c009de0 con 0x5621ef6961b0 2024-05-14T15:23:19.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.187+0000 7fd67b400640 1 -- 172.21.15.69:0/574932129 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c0a5480 con 0x5621ef6961b0 2024-05-14T15:23:19.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.189+0000 7fd69c9c8740 1 -- 172.21.15.69:0/574932129 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6961b0 msgr2=0x5621efa43940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:19.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.189+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/574932129 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6961b0 0x5621efa43940 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0dfc60 tx=0x7fd67c0a90c0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.189+0000 7fd69c9c8740 1 -- 172.21.15.69:0/574932129 shutdown_connections 2024-05-14T15:23:19.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.189+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/574932129 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef62a1c0 0x5621efa59620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.189+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/574932129 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef6961b0 0x5621efa43940 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.189+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/574932129 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef66d2f0 0x5621efa410d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.189+0000 7fd69c9c8740 1 -- 172.21.15.69:0/574932129 >> 172.21.15.69:0/574932129 conn(0x5621ef68a300 msgr2=0x5621efa32d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:19.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.189+0000 7fd69c9c8740 1 -- 172.21.15.69:0/574932129 shutdown_connections 2024-05-14T15:23:19.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.190+0000 7fd69c9c8740 1 -- 172.21.15.69:0/574932129 wait complete. 2024-05-14T15:23:19.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.191+0000 7fd69c9c8740 1 -- start start 2024-05-14T15:23:19.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.191+0000 7fd69c9c8740 1 Processor -- start 2024-05-14T15:23:19.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.192+0000 7fd69c9c8740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef62a1c0 0x5621efa44d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.192+0000 7fd69c9c8740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef66d2f0 0x5621efa452a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.192+0000 7fd69c9c8740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 0x5621efaba1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.192+0000 7fd69c9c8740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b47c0 con 0x5621ef66d2f0 2024-05-14T15:23:19.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.192+0000 7fd69c9c8740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b40f0 con 0x5621ef62a1c0 2024-05-14T15:23:19.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.192+0000 7fd69c9c8740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd6901b1300 con 0x5621ef6961b0 2024-05-14T15:23:19.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.192+0000 7fd69c9c8740 10 client.0 _ll_register_callbacks cb 0x7fd67c00df10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:19.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:18 smithi092 ceph-mon[34729]: pgmap v53: 129 pgs: 129 active+clean; 206 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 11 MiB/s wr, 90 op/s 2024-05-14T15:23:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.192+0000 7fd68e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef66d2f0 0x5621efa452a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.192+0000 7fd68e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef66d2f0 0x5621efa452a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43000/0 (socket says 172.21.15.69:43000) 2024-05-14T15:23:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.192+0000 7fd68e000640 1 -- 172.21.15.69:0/37083150 learned_addr learned my addr 172.21.15.69:0/37083150 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.193+0000 7fd68ea00640 1 --2- 172.21.15.69:0/37083150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef62a1c0 0x5621efa44d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.193+0000 7fd68f400640 1 --2- 172.21.15.69:0/37083150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 0x5621efaba1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.193+0000 7fd68e000640 1 -- 172.21.15.69:0/37083150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 msgr2=0x5621efaba1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.193+0000 7fd68e000640 1 --2- 172.21.15.69:0/37083150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 0x5621efaba1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.193+0000 7fd68e000640 1 -- 172.21.15.69:0/37083150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef62a1c0 msgr2=0x5621efa44d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.193+0000 7fd68e000640 1 --2- 172.21.15.69:0/37083150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef62a1c0 0x5621efa44d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.193+0000 7fd68e000640 1 -- 172.21.15.69:0/37083150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621efaba700 con 0x5621ef66d2f0 2024-05-14T15:23:19.195 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.193+0000 7fd68f400640 1 --2- 172.21.15.69:0/37083150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 0x5621efaba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:23:19.195 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.193+0000 7fd68e000640 1 --2- 172.21.15.69:0/37083150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef66d2f0 0x5621efa452a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0a8ef0 tx=0x7fd67c0e5e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8668885a58d464 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:19.195 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.193+0000 7fd678c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:19.195 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.194+0000 7fd678c00640 1 -- 172.21.15.69:0/37083150 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd67c014020 con 0x5621ef66d2f0 2024-05-14T15:23:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.194+0000 7fd678c00640 1 -- 172.21.15.69:0/37083150 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fd67c0ad330 con 0x5621ef66d2f0 2024-05-14T15:23:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.194+0000 7fd69c9c8740 1 -- 172.21.15.69:0/37083150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd67c009de0 con 0x5621ef66d2f0 2024-05-14T15:23:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.194+0000 7fd678c00640 1 -- 172.21.15.69:0/37083150 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd67c0a8d00 con 0x5621ef66d2f0 2024-05-14T15:23:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.195+0000 7fd69c9c8740 10 client.15777 fetch_fsmap learned FSMap version 33 2024-05-14T15:23:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.195+0000 7fd69c9c8740 1 -- 172.21.15.69:0/37083150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5621efabb920 con 0x5621ef66d2f0 2024-05-14T15:23:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.195+0000 7fd678c00640 1 -- 172.21.15.69:0/37083150 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd67c009de0 con 0x5621ef66d2f0 2024-05-14T15:23:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.195+0000 7fd678c00640 1 -- 172.21.15.69:0/37083150 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 33) ==== 8382+0+0 (secure 0 0 0) 0x7fd67c0b4030 con 0x5621ef66d2f0 2024-05-14T15:23:19.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.195+0000 7fd69c9c8740 10 client.15777 fetch_fsmap finished waiting for FSMap version 33 2024-05-14T15:23:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.195+0000 7fd69c9c8740 10 client.15777 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.195+0000 7fd69c9c8740 20 client.15777 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.195+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/37083150 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5621efabbe30 0x5621efabe250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.195+0000 7fd69c9c8740 4 client.15777 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:23:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.195+0000 7fd69c9c8740 1 -- 172.21.15.69:0/37083150 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5621ef9a3fd0 con 0x5621efabbe30 2024-05-14T15:23:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.196+0000 7fd68ea00640 1 --2- 172.21.15.69:0/37083150 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5621efabbe30 0x5621efabe250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.197+0000 7fd68ea00640 1 --2- 172.21.15.69:0/37083150 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5621efabbe30 0x5621efabe250 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4259659c6cd77dbf server_cookie=c0fe9b61131ee37e in_seq=0 out_seq=0 2024-05-14T15:23:19.197 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.197+0000 7fd678c00640 10 client.15777 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:19.222 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:18 smithi069 ceph-mon[31270]: pgmap v53: 129 pgs: 129 active+clean; 206 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 11 MiB/s wr, 90 op/s 2024-05-14T15:23:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.238+0000 7fd678c00640 1 -- 172.21.15.69:0/37083150 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5621ef9a3fd0 con 0x5621efabbe30 2024-05-14T15:23:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.238+0000 7fd678c00640 10 client.15777 handle_command_reply: tid=0 2024-05-14T15:23:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.238+0000 7fd69c9c8740 1 client.15777 shutdown 2024-05-14T15:23:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.238+0000 7fd69c9c8740 1 -- 172.21.15.69:0/37083150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef66d2f0 msgr2=0x5621efa452a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.238+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/37083150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef66d2f0 0x5621efa452a0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fd67c0a8ef0 tx=0x7fd67c0e5e30 comp rx=0 tx=0).stop 2024-05-14T15:23:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.238+0000 7fd69c9c8740 1 -- 172.21.15.69:0/37083150 shutdown_connections 2024-05-14T15:23:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.238+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/37083150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5621ef6961b0 0x5621efaba1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.238+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/37083150 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5621efabbe30 0x5621efabe250 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.238+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/37083150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5621ef66d2f0 0x5621efa452a0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.238+0000 7fd69c9c8740 1 --2- 172.21.15.69:0/37083150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5621ef62a1c0 0x5621efa44d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.238+0000 7fd678c00640 0 client.15777 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:19.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.238+0000 7fd69c9c8740 1 -- 172.21.15.69:0/37083150 >> 172.21.15.69:0/37083150 conn(0x5621ef68a300 msgr2=0x5621efa37e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.239+0000 7fd69c9c8740 1 -- 172.21.15.69:0/37083150 shutdown_connections 2024-05-14T15:23:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.239+0000 7fd69c9c8740 1 -- 172.21.15.69:0/37083150 wait complete. 2024-05-14T15:23:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.239+0000 7fd69c9c8740 20 client.15777 trim_cache size 0 max 16384 2024-05-14T15:23:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:23:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:23:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:23:19.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:23:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.240+0000 7fd68fe00640 1 -- 172.21.15.69:0/14332022 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd6740b29d0 msgr2=0x7fd6740b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.240+0000 7fd68fe00640 1 --2- 172.21.15.69:0/14332022 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd6740b29d0 0x7fd6740b4ee0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fd6880094e0 tx=0x7fd688005c50 comp rx=0 tx=0).stop 2024-05-14T15:23:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.240+0000 7fd68fe00640 1 -- 172.21.15.69:0/14332022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd690109ac0 msgr2=0x7fd6901a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.240+0000 7fd68fe00640 1 --2- 172.21.15.69:0/14332022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd690109ac0 0x7fd6901a2a30 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd67c005fd0 tx=0x7fd67c00dde0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.240+0000 7fd68fe00640 1 -- 172.21.15.69:0/14332022 shutdown_connections 2024-05-14T15:23:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.240+0000 7fd68fe00640 1 --2- 172.21.15.69:0/14332022 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd6740b29d0 0x7fd6740b4ee0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.240+0000 7fd68fe00640 1 --2- 172.21.15.69:0/14332022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd690109f60 0x7fd69019c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.240+0000 7fd68fe00640 1 --2- 172.21.15.69:0/14332022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd690109ac0 0x7fd6901a2a30 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.240+0000 7fd68fe00640 1 --2- 172.21.15.69:0/14332022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd690104210 0x7fd6901a24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.240+0000 7fd68fe00640 1 -- 172.21.15.69:0/14332022 >> 172.21.15.69:0/14332022 conn(0x7fd690079150 msgr2=0x7fd690076810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:19.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.240+0000 7fd68fe00640 1 -- 172.21.15.69:0/14332022 shutdown_connections 2024-05-14T15:23:19.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:19.240+0000 7fd68fe00640 1 -- 172.21.15.69:0/14332022 wait complete. 2024-05-14T15:23:19.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:18 smithi203 ceph-mon[34567]: pgmap v53: 129 pgs: 129 active+clean; 206 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 11 MiB/s wr, 90 op/s 2024-05-14T15:23:21.192 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:20 smithi092 ceph-mon[34729]: pgmap v54: 129 pgs: 129 active+clean; 217 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 14 MiB/s wr, 98 op/s 2024-05-14T15:23:21.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:20 smithi069 ceph-mon[31270]: pgmap v54: 129 pgs: 129 active+clean; 217 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 14 MiB/s wr, 98 op/s 2024-05-14T15:23:21.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:20 smithi203 ceph-mon[34567]: pgmap v54: 129 pgs: 129 active+clean; 217 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 14 MiB/s wr, 98 op/s 2024-05-14T15:23:22.185 INFO:teuthology.orchestra.run.smithi069.stderr:800000 of 3200000 tuples (25%) done (elapsed 27.79 s, remaining 83.38 s) 2024-05-14T15:23:23.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:22 smithi069 ceph-mon[31270]: pgmap v55: 129 pgs: 129 active+clean; 217 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 MiB/s wr, 16 op/s 2024-05-14T15:23:23.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:22 smithi203 ceph-mon[34567]: pgmap v55: 129 pgs: 129 active+clean; 217 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 MiB/s wr, 16 op/s 2024-05-14T15:23:23.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:22 smithi092 ceph-mon[34729]: pgmap v55: 129 pgs: 129 active+clean; 217 MiB data, 879 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.6 MiB/s wr, 16 op/s 2024-05-14T15:23:25.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:24 smithi069 ceph-mon[31270]: pgmap v56: 129 pgs: 129 active+clean; 249 MiB data, 934 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 28 op/s 2024-05-14T15:23:25.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:24 smithi203 ceph-mon[34567]: pgmap v56: 129 pgs: 129 active+clean; 249 MiB data, 934 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 28 op/s 2024-05-14T15:23:25.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:24 smithi092 ceph-mon[34729]: pgmap v56: 129 pgs: 129 active+clean; 249 MiB data, 934 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 13 MiB/s wr, 28 op/s 2024-05-14T15:23:26.446 INFO:teuthology.orchestra.run.smithi069.stderr:900000 of 3200000 tuples (28%) done (elapsed 32.05 s, remaining 81.92 s) 2024-05-14T15:23:27.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:26 smithi069 ceph-mon[31270]: pgmap v57: 129 pgs: 129 active+clean; 249 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 20 op/s 2024-05-14T15:23:27.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:26 smithi203 ceph-mon[34567]: pgmap v57: 129 pgs: 129 active+clean; 249 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 20 op/s 2024-05-14T15:23:27.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:26 smithi092 ceph-mon[34729]: pgmap v57: 129 pgs: 129 active+clean; 249 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 9.1 MiB/s wr, 20 op/s 2024-05-14T15:23:29.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:28 smithi069 ceph-mon[31270]: pgmap v58: 129 pgs: 129 active+clean; 249 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.9 MiB/s wr, 20 op/s 2024-05-14T15:23:29.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:28 smithi203 ceph-mon[34567]: pgmap v58: 129 pgs: 129 active+clean; 249 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.9 MiB/s wr, 20 op/s 2024-05-14T15:23:29.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:28 smithi092 ceph-mon[34729]: pgmap v58: 129 pgs: 129 active+clean; 249 MiB data, 940 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 7.9 MiB/s wr, 20 op/s 2024-05-14T15:23:30.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:29 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:23:30.435 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:29 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:23:30.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:29 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:23:31.097 INFO:teuthology.orchestra.run.smithi069.stderr:1000000 of 3200000 tuples (31%) done (elapsed 36.71 s, remaining 80.75 s) 2024-05-14T15:23:31.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:31 smithi069 ceph-mon[31270]: pgmap v59: 129 pgs: 129 active+clean; 278 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 29 op/s 2024-05-14T15:23:31.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:31 smithi203 ceph-mon[34567]: pgmap v59: 129 pgs: 129 active+clean; 278 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 29 op/s 2024-05-14T15:23:31.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:31 smithi092 ceph-mon[34729]: pgmap v59: 129 pgs: 129 active+clean; 278 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 12 MiB/s wr, 29 op/s 2024-05-14T15:23:32.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.473+0000 7f96ecc00640 1 -- 172.21.15.69:0/3575210858 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e810bd00 msgr2=0x7f96e81058a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.473+0000 7f96ecc00640 1 --2- 172.21.15.69:0/3575210858 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e810bd00 0x7f96e81058a0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f96d8009900 tx=0x7f96d802a3f0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.473+0000 7f96ecc00640 1 -- 172.21.15.69:0/3575210858 shutdown_connections 2024-05-14T15:23:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.473+0000 7f96ecc00640 1 --2- 172.21.15.69:0/3575210858 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96e8106450 0x7f96e8112820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.473+0000 7f96ecc00640 1 --2- 172.21.15.69:0/3575210858 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e810c1a0 0x7f96e8105de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.473+0000 7f96ecc00640 1 --2- 172.21.15.69:0/3575210858 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e810bd00 0x7f96e81058a0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.473+0000 7f96ecc00640 1 -- 172.21.15.69:0/3575210858 >> 172.21.15.69:0/3575210858 conn(0x7f96e807d520 msgr2=0x7f96e807d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.473+0000 7f96ecc00640 1 -- 172.21.15.69:0/3575210858 shutdown_connections 2024-05-14T15:23:32.474 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.473+0000 7f96ecc00640 1 -- 172.21.15.69:0/3575210858 wait complete. 2024-05-14T15:23:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.474+0000 7f96ecc00640 1 Processor -- start 2024-05-14T15:23:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.475+0000 7f96ecc00640 1 -- start start 2024-05-14T15:23:32.475 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.475+0000 7f96ecc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e8106450 0x7f96e81a2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.475+0000 7f96ecc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96e810bd00 0x7f96e81a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.475+0000 7f96ecc00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e810c1a0 0x7f96e819c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.475+0000 7f96ecc00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f96e8115e00 con 0x7f96e8106450 2024-05-14T15:23:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.475+0000 7f96ecc00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f96e8115c80 con 0x7f96e810c1a0 2024-05-14T15:23:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.475+0000 7f96ecc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f96e8115f80 con 0x7f96e810bd00 2024-05-14T15:23:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.475+0000 7f96e7400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e8106450 0x7f96e81a2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.475+0000 7f96e7400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e8106450 0x7f96e81a2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51900/0 (socket says 172.21.15.69:51900) 2024-05-14T15:23:32.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.475+0000 7f96e7400640 1 -- 172.21.15.69:0/2592028491 learned_addr learned my addr 172.21.15.69:0/2592028491 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.476+0000 7f96dfe00640 1 --2- 172.21.15.69:0/2592028491 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96e810bd00 0x7f96e81a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.476+0000 7f96e7e00640 1 --2- 172.21.15.69:0/2592028491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e810c1a0 0x7f96e819c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.476+0000 7f96e7400640 1 -- 172.21.15.69:0/2592028491 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96e810bd00 msgr2=0x7f96e81a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.476+0000 7f96e7400640 1 --2- 172.21.15.69:0/2592028491 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96e810bd00 0x7f96e81a2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.476+0000 7f96e7400640 1 -- 172.21.15.69:0/2592028491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e810c1a0 msgr2=0x7f96e819c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.476+0000 7f96e7400640 1 --2- 172.21.15.69:0/2592028491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e810c1a0 0x7f96e819c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.476+0000 7f96e7400640 1 -- 172.21.15.69:0/2592028491 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e819ccc0 con 0x7f96e8106450 2024-05-14T15:23:32.478 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.476+0000 7f96e7400640 1 --2- 172.21.15.69:0/2592028491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e8106450 0x7f96e81a2500 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f96d802a910 tx=0x7f96d8003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:32.478 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.477+0000 7f96e4c00640 1 -- 172.21.15.69:0/2592028491 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d803f070 con 0x7f96e8106450 2024-05-14T15:23:32.478 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.477+0000 7f96e4c00640 1 -- 172.21.15.69:0/2592028491 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96d8003e10 con 0x7f96e8106450 2024-05-14T15:23:32.478 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.477+0000 7f96e4c00640 1 -- 172.21.15.69:0/2592028491 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d8035030 con 0x7f96e8106450 2024-05-14T15:23:32.478 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.477+0000 7f96ecc00640 1 -- 172.21.15.69:0/2592028491 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e819cf50 con 0x7f96e8106450 2024-05-14T15:23:32.478 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.477+0000 7f96ecc00640 1 -- 172.21.15.69:0/2592028491 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e819d3f0 con 0x7f96e8106450 2024-05-14T15:23:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.481+0000 7f96f5192740 1 Processor -- start 2024-05-14T15:23:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.481+0000 7f96f5192740 1 -- start start 2024-05-14T15:23:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.482+0000 7f96f5192740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825c11b0 0x557582962480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.482+0000 7f96f5192740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825982f0 0x5575829629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.482+0000 7f96f5192740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825a04d0 0x557582962f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.482 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.482+0000 7f96f5192740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5575828c7550 con 0x5575825c11b0 2024-05-14T15:23:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.482+0000 7f96f5192740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55758286cbc0 con 0x5575825982f0 2024-05-14T15:23:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.482+0000 7f96f5192740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5575828c3510 con 0x5575825a04d0 2024-05-14T15:23:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.482+0000 7f96e4c00640 1 -- 172.21.15.69:0/2592028491 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f96d8042070 con 0x7f96e8106450 2024-05-14T15:23:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.482+0000 7f96e7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825c11b0 0x557582962480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.482+0000 7f96e7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825c11b0 0x557582962480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51904/0 (socket says 172.21.15.69:51904) 2024-05-14T15:23:32.483 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.482+0000 7f96e7e00640 1 -- 172.21.15.69:0/1759069627 learned_addr learned my addr 172.21.15.69:0/1759069627 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.482+0000 7f96e7400640 1 --2- 172.21.15.69:0/1759069627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825982f0 0x5575829629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.483+0000 7f96dfe00640 1 --2- 172.21.15.69:0/1759069627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825a04d0 0x557582962f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.483+0000 7f96e7e00640 1 -- 172.21.15.69:0/1759069627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825a04d0 msgr2=0x557582962f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.483+0000 7f96e7e00640 1 --2- 172.21.15.69:0/1759069627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825a04d0 0x557582962f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.484 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.483+0000 7f96e7e00640 1 -- 172.21.15.69:0/1759069627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825982f0 msgr2=0x5575829629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.483+0000 7f96e7e00640 1 --2- 172.21.15.69:0/1759069627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825982f0 0x5575829629c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.483+0000 7f96e7e00640 1 -- 172.21.15.69:0/1759069627 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575825d9210 con 0x5575825c11b0 2024-05-14T15:23:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.483+0000 7f96e7e00640 1 --2- 172.21.15.69:0/1759069627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825c11b0 0x557582962480 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009ee0 tx=0x7f96e0010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5807395da4731011 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.483+0000 7f96d7e00640 1 -- 172.21.15.69:0/1759069627 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0016070 con 0x5575825c11b0 2024-05-14T15:23:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.483+0000 7f96d7e00640 1 -- 172.21.15.69:0/1759069627 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96e0004d20 con 0x5575825c11b0 2024-05-14T15:23:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.483+0000 7f96d7e00640 1 -- 172.21.15.69:0/1759069627 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e00126b0 con 0x5575825c11b0 2024-05-14T15:23:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.484+0000 7f96e4c00640 1 --2- 172.21.15.69:0/2592028491 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f96cc0b2a50 0x7f96cc0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.484+0000 7f96e4c00640 1 -- 172.21.15.69:0/2592028491 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f96d8103270 con 0x7f96e8106450 2024-05-14T15:23:32.485 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.484+0000 7f96e7400640 1 --2- 172.21.15.69:0/2592028491 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f96cc0b2a50 0x7f96cc0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.485+0000 7f96f5192740 1 -- 172.21.15.69:0/1759069627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825c11b0 msgr2=0x557582962480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.485+0000 7f96f5192740 1 --2- 172.21.15.69:0/1759069627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825c11b0 0x557582962480 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009ee0 tx=0x7f96e0010740 comp rx=0 tx=0).stop 2024-05-14T15:23:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.485+0000 7f96f5192740 1 -- 172.21.15.69:0/1759069627 shutdown_connections 2024-05-14T15:23:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.485+0000 7f96f5192740 1 --2- 172.21.15.69:0/1759069627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825a04d0 0x557582962f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.485+0000 7f96f5192740 1 --2- 172.21.15.69:0/1759069627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825982f0 0x5575829629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.486 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.485+0000 7f96f5192740 1 --2- 172.21.15.69:0/1759069627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825c11b0 0x557582962480 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.485+0000 7f96f5192740 1 -- 172.21.15.69:0/1759069627 >> 172.21.15.69:0/1759069627 conn(0x5575825b5300 msgr2=0x55758295ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.485+0000 7f96f5192740 1 -- 172.21.15.69:0/1759069627 shutdown_connections 2024-05-14T15:23:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.485+0000 7f96f5192740 1 -- 172.21.15.69:0/1759069627 wait complete. 2024-05-14T15:23:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.485+0000 7f96e7400640 1 --2- 172.21.15.69:0/2592028491 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f96cc0b2a50 0x7f96cc0b4f60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55758295ff70 tx=0x7f96d8009260 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.486+0000 7f96f5192740 1 -- start start 2024-05-14T15:23:32.487 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.486+0000 7f96f5192740 1 Processor -- start 2024-05-14T15:23:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.486+0000 7f96f5192740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825982f0 0x55758296c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.486+0000 7f96f5192740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825a04d0 0x55758296cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.486+0000 7f96f5192740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825c11b0 0x557582978a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.486+0000 7f96f5192740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55758296f5b0 con 0x5575825a04d0 2024-05-14T15:23:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.486+0000 7f96f5192740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557582880660 con 0x5575825c11b0 2024-05-14T15:23:32.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.486+0000 7f96f5192740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55758296f730 con 0x5575825982f0 2024-05-14T15:23:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.487+0000 7f96f5192740 10 client.0 _ll_register_callbacks cb 0x55758284a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.487+0000 7f96dfe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825a04d0 0x55758296cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.487+0000 7f96dfe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825a04d0 0x55758296cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51912/0 (socket says 172.21.15.69:51912) 2024-05-14T15:23:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.487+0000 7f96dfe00640 1 -- 172.21.15.69:0/287126377 learned_addr learned my addr 172.21.15.69:0/287126377 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.487+0000 7f96e7e00640 1 --2- 172.21.15.69:0/287126377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825982f0 0x55758296c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.487+0000 7f96e7e00640 1 --2- 172.21.15.69:0/287126377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825c11b0 0x557582978a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.487+0000 7f96dfe00640 1 -- 172.21.15.69:0/287126377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825982f0 msgr2=0x55758296c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.487+0000 7f96dfe00640 1 --2- 172.21.15.69:0/287126377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825982f0 0x55758296c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.487+0000 7f96dfe00640 1 -- 172.21.15.69:0/287126377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825c11b0 msgr2=0x557582978a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.487+0000 7f96dfe00640 1 --2- 172.21.15.69:0/287126377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825c11b0 0x557582978a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.487+0000 7f96dfe00640 1 -- 172.21.15.69:0/287126377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575826a5620 con 0x5575825a04d0 2024-05-14T15:23:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.488+0000 7f96dfe00640 1 --2- 172.21.15.69:0/287126377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825a04d0 0x55758296cf10 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f96d000af20 tx=0x7f96d000f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82b779dfac68eabb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.488+0000 7f96d4c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:32.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.488+0000 7f96d4c00640 1 -- 172.21.15.69:0/287126377 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0011850 con 0x5575825a04d0 2024-05-14T15:23:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.488+0000 7f96d4c00640 1 -- 172.21.15.69:0/287126377 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f96d00119f0 con 0x5575825a04d0 2024-05-14T15:23:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.488+0000 7f96f5192740 1 -- 172.21.15.69:0/287126377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96e0004d20 con 0x5575825a04d0 2024-05-14T15:23:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.488+0000 7f96d4c00640 1 -- 172.21.15.69:0/287126377 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f96d0023050 con 0x5575825a04d0 2024-05-14T15:23:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.488+0000 7f96f5192740 10 client.15789 fetch_fsmap learned FSMap version 34 2024-05-14T15:23:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.488+0000 7f96f5192740 1 -- 172.21.15.69:0/287126377 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55758297b8b0 con 0x5575825a04d0 2024-05-14T15:23:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.489+0000 7f96d4c00640 1 -- 172.21.15.69:0/287126377 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96e0004d20 con 0x5575825a04d0 2024-05-14T15:23:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.489+0000 7f96d4c00640 1 -- 172.21.15.69:0/287126377 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 34) ==== 8386+0+0 (secure 0 0 0) 0x7f96d00103d0 con 0x5575825a04d0 2024-05-14T15:23:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.489+0000 7f96f5192740 10 client.15789 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T15:23:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.489+0000 7f96f5192740 10 client.15789 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.489+0000 7f96f5192740 20 client.15789 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.489+0000 7f96f5192740 1 --2- 172.21.15.69:0/287126377 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55758257fd80 0x55758297eec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.489+0000 7f96f5192740 4 client.15789 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:23:32.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.489+0000 7f96f5192740 1 -- 172.21.15.69:0/287126377 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575828d5160 con 0x55758257fd80 2024-05-14T15:23:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.490+0000 7f96e7e00640 1 --2- 172.21.15.69:0/287126377 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55758257fd80 0x55758297eec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.491+0000 7f96e7e00640 1 --2- 172.21.15.69:0/287126377 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55758257fd80 0x55758297eec0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ecfde9986ffea3f server_cookie=ffb90c7a9ce46500 in_seq=0 out_seq=0 2024-05-14T15:23:32.492 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.491+0000 7f96d4c00640 10 client.15789 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.493+0000 7f96d4c00640 1 -- 172.21.15.69:0/287126377 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5575828d5160 con 0x55758257fd80 2024-05-14T15:23:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.493+0000 7f96d4c00640 10 client.15789 handle_command_reply: tid=0 2024-05-14T15:23:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.493+0000 7f96f5192740 1 client.15789 shutdown 2024-05-14T15:23:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.493+0000 7f96f5192740 1 -- 172.21.15.69:0/287126377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825a04d0 msgr2=0x55758296cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.493+0000 7f96f5192740 1 --2- 172.21.15.69:0/287126377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825a04d0 0x55758296cf10 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f96d000af20 tx=0x7f96d000f7f0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.493+0000 7f96f5192740 1 -- 172.21.15.69:0/287126377 shutdown_connections 2024-05-14T15:23:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.493+0000 7f96f5192740 1 --2- 172.21.15.69:0/287126377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825c11b0 0x557582978a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.493+0000 7f96f5192740 1 --2- 172.21.15.69:0/287126377 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55758257fd80 0x55758297eec0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.493+0000 7f96f5192740 1 --2- 172.21.15.69:0/287126377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825a04d0 0x55758296cf10 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.493+0000 7f96d4c00640 0 client.15789 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.493+0000 7f96f5192740 1 --2- 172.21.15.69:0/287126377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825982f0 0x55758296c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.493+0000 7f96f5192740 1 -- 172.21.15.69:0/287126377 >> 172.21.15.69:0/287126377 conn(0x5575825b5300 msgr2=0x5575829622b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:32.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.493+0000 7f96f5192740 1 -- 172.21.15.69:0/287126377 shutdown_connections 2024-05-14T15:23:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.494+0000 7f96f5192740 1 -- 172.21.15.69:0/287126377 wait complete. 2024-05-14T15:23:32.495 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.494+0000 7f96f5192740 20 client.15789 trim_cache size 0 max 16384 2024-05-14T15:23:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.515+0000 7f96f5192740 1 Processor -- start 2024-05-14T15:23:32.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.515+0000 7f96f5192740 1 -- start start 2024-05-14T15:23:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.515+0000 7f96f5192740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825982f0 0x55758296e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.515+0000 7f96f5192740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825a04d0 0x55758295d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.515+0000 7f96f5192740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825c11b0 0x55758295dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.515+0000 7f96f5192740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f96e81b3250 con 0x5575825c11b0 2024-05-14T15:23:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.515+0000 7f96f5192740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f96e81b4eb0 con 0x5575825982f0 2024-05-14T15:23:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.515+0000 7f96f5192740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f96e81b3920 con 0x5575825a04d0 2024-05-14T15:23:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.515+0000 7f96e7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825c11b0 0x55758295dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.516+0000 7f96e7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825c11b0 0x55758295dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51928/0 (socket says 172.21.15.69:51928) 2024-05-14T15:23:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.516+0000 7f96e7e00640 1 -- 172.21.15.69:0/1676988010 learned_addr learned my addr 172.21.15.69:0/1676988010 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.516+0000 7f96dfe00640 1 --2- 172.21.15.69:0/1676988010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825a04d0 0x55758295d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.516+0000 7f96e7e00640 1 --2- 172.21.15.69:0/1676988010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825982f0 0x55758296e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.516+0000 7f96e7e00640 1 -- 172.21.15.69:0/1676988010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825a04d0 msgr2=0x55758295d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.516+0000 7f96e7e00640 1 --2- 172.21.15.69:0/1676988010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825a04d0 0x55758295d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.516+0000 7f96e7e00640 1 -- 172.21.15.69:0/1676988010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825982f0 msgr2=0x55758296e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.516+0000 7f96e7e00640 1 --2- 172.21.15.69:0/1676988010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825982f0 0x55758296e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.516+0000 7f96e7e00640 1 -- 172.21.15.69:0/1676988010 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557582958f80 con 0x5575825c11b0 2024-05-14T15:23:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.516+0000 7f96dfe00640 1 --2- 172.21.15.69:0/1676988010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825a04d0 0x55758295d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:23:32.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.516+0000 7f96e7e00640 1 --2- 172.21.15.69:0/1676988010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825c11b0 0x55758295dea0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009ca0 tx=0x7f96e0005b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf58bcddd84f9759 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.517+0000 7f96d7400640 1 -- 172.21.15.69:0/1676988010 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0016040 con 0x5575825c11b0 2024-05-14T15:23:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.517+0000 7f96d7400640 1 -- 172.21.15.69:0/1676988010 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96e002f070 con 0x5575825c11b0 2024-05-14T15:23:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.517+0000 7f96d7400640 1 -- 172.21.15.69:0/1676988010 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e0012890 con 0x5575825c11b0 2024-05-14T15:23:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.518+0000 7f96f5192740 1 -- 172.21.15.69:0/1676988010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825c11b0 msgr2=0x55758295dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.518+0000 7f96f5192740 1 --2- 172.21.15.69:0/1676988010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825c11b0 0x55758295dea0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009ca0 tx=0x7f96e0005b00 comp rx=0 tx=0).stop 2024-05-14T15:23:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.518+0000 7f96f5192740 1 -- 172.21.15.69:0/1676988010 shutdown_connections 2024-05-14T15:23:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.518+0000 7f96f5192740 1 --2- 172.21.15.69:0/1676988010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825c11b0 0x55758295dea0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.518+0000 7f96f5192740 1 --2- 172.21.15.69:0/1676988010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825a04d0 0x55758295d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.518+0000 7f96f5192740 1 --2- 172.21.15.69:0/1676988010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825982f0 0x55758296e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.518+0000 7f96f5192740 1 -- 172.21.15.69:0/1676988010 >> 172.21.15.69:0/1676988010 conn(0x5575825b5300 msgr2=0x55758295d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.518+0000 7f96f5192740 1 -- 172.21.15.69:0/1676988010 shutdown_connections 2024-05-14T15:23:32.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.518+0000 7f96f5192740 1 -- 172.21.15.69:0/1676988010 wait complete. 2024-05-14T15:23:32.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.519+0000 7f96f5192740 1 -- start start 2024-05-14T15:23:32.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.519+0000 7f96f5192740 1 Processor -- start 2024-05-14T15:23:32.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96f5192740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825982f0 0x5575829df640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96f5192740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825a04d0 0x5575829dfba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96f5192740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825c11b0 0x55758296fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96f5192740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f96e81b4720 con 0x5575825a04d0 2024-05-14T15:23:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96f5192740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f96e81b4020 con 0x5575825c11b0 2024-05-14T15:23:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96f5192740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f96e81b1230 con 0x5575825982f0 2024-05-14T15:23:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96f5192740 10 client.0 _ll_register_callbacks cb 0x7f96d0005870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96dfe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825a04d0 0x5575829dfba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96dfe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825a04d0 0x5575829dfba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51936/0 (socket says 172.21.15.69:51936) 2024-05-14T15:23:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96dfe00640 1 -- 172.21.15.69:0/2222179773 learned_addr learned my addr 172.21.15.69:0/2222179773 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96e7e00640 1 --2- 172.21.15.69:0/2222179773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825982f0 0x5575829df640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96e7e00640 1 --2- 172.21.15.69:0/2222179773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825c11b0 0x55758296fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96dfe00640 1 -- 172.21.15.69:0/2222179773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825982f0 msgr2=0x5575829df640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96dfe00640 1 --2- 172.21.15.69:0/2222179773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825982f0 0x5575829df640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96dfe00640 1 -- 172.21.15.69:0/2222179773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825c11b0 msgr2=0x55758296fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:32.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96dfe00640 1 --2- 172.21.15.69:0/2222179773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825c11b0 0x55758296fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96dfe00640 1 -- 172.21.15.69:0/2222179773 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5575829704a0 con 0x5575825a04d0 2024-05-14T15:23:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.520+0000 7f96e7e00640 1 --2- 172.21.15.69:0/2222179773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825c11b0 0x55758296fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:23:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.521+0000 7f96dfe00640 1 --2- 172.21.15.69:0/2222179773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825a04d0 0x5575829dfba0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x5575829599b0 tx=0x7f96d000a400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e913aa00efb16881 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.521+0000 7f96d4c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.521+0000 7f96d4c00640 1 -- 172.21.15.69:0/2222179773 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d002d070 con 0x5575825a04d0 2024-05-14T15:23:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.521+0000 7f96d4c00640 1 -- 172.21.15.69:0/2222179773 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f96d00052c0 con 0x5575825a04d0 2024-05-14T15:23:32.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.521+0000 7f96f5192740 1 -- 172.21.15.69:0/2222179773 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f96e002f070 con 0x5575825a04d0 2024-05-14T15:23:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.521+0000 7f96d4c00640 1 -- 172.21.15.69:0/2222179773 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f96d00054c0 con 0x5575825a04d0 2024-05-14T15:23:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.522+0000 7f96f5192740 10 client.15795 fetch_fsmap learned FSMap version 34 2024-05-14T15:23:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.522+0000 7f96f5192740 1 -- 172.21.15.69:0/2222179773 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5575829e6c50 con 0x5575825a04d0 2024-05-14T15:23:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.522+0000 7f96d4c00640 1 -- 172.21.15.69:0/2222179773 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f96e002f070 con 0x5575825a04d0 2024-05-14T15:23:32.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.522+0000 7f96d4c00640 1 -- 172.21.15.69:0/2222179773 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 34) ==== 8386+0+0 (secure 0 0 0) 0x7f96d0026030 con 0x5575825a04d0 2024-05-14T15:23:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.522+0000 7f96f5192740 10 client.15795 fetch_fsmap finished waiting for FSMap version 34 2024-05-14T15:23:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.522+0000 7f96f5192740 10 client.15795 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.522+0000 7f96f5192740 20 client.15795 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.522+0000 7f96f5192740 1 --2- 172.21.15.69:0/2222179773 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5575825551c0 0x5575829e9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.522+0000 7f96f5192740 4 client.15795 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:23:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.522+0000 7f96f5192740 1 -- 172.21.15.69:0/2222179773 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5575828cefd0 con 0x5575825551c0 2024-05-14T15:23:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.523+0000 7f96e7e00640 1 --2- 172.21.15.69:0/2222179773 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5575825551c0 0x5575829e9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.524+0000 7f96e7e00640 1 --2- 172.21.15.69:0/2222179773 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5575825551c0 0x5575829e9500 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c00ddda89c74f09 server_cookie=39572c2eaecf90b4 in_seq=0 out_seq=0 2024-05-14T15:23:32.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.524+0000 7f96d4c00640 10 client.15795 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.563+0000 7f96d4c00640 1 -- 172.21.15.69:0/2222179773 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5575828cefd0 con 0x5575825551c0 2024-05-14T15:23:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.563+0000 7f96d4c00640 10 client.15795 handle_command_reply: tid=0 2024-05-14T15:23:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.563+0000 7f96f5192740 1 client.15795 shutdown 2024-05-14T15:23:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.563+0000 7f96f5192740 1 -- 172.21.15.69:0/2222179773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825a04d0 msgr2=0x5575829dfba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.563+0000 7f96f5192740 1 --2- 172.21.15.69:0/2222179773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825a04d0 0x5575829dfba0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x5575829599b0 tx=0x7f96d000a400 comp rx=0 tx=0).stop 2024-05-14T15:23:32.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.563+0000 7f96f5192740 1 -- 172.21.15.69:0/2222179773 shutdown_connections 2024-05-14T15:23:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.563+0000 7f96f5192740 1 --2- 172.21.15.69:0/2222179773 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5575825c11b0 0x55758296fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.563+0000 7f96f5192740 1 --2- 172.21.15.69:0/2222179773 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5575825551c0 0x5575829e9500 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.563+0000 7f96f5192740 1 --2- 172.21.15.69:0/2222179773 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5575825a04d0 0x5575829dfba0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.564+0000 7f96f5192740 1 --2- 172.21.15.69:0/2222179773 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5575825982f0 0x5575829df640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.564+0000 7f96d4c00640 0 client.15795 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.564+0000 7f96f5192740 1 -- 172.21.15.69:0/2222179773 >> 172.21.15.69:0/2222179773 conn(0x5575825b5300 msgr2=0x55758295dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.564+0000 7f96f5192740 1 -- 172.21.15.69:0/2222179773 shutdown_connections 2024-05-14T15:23:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.564+0000 7f96f5192740 1 -- 172.21.15.69:0/2222179773 wait complete. 2024-05-14T15:23:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.564+0000 7f96f5192740 20 client.15795 trim_cache size 0 max 16384 2024-05-14T15:23:32.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:23:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:23:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:23:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:23:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.565+0000 7f96ecc00640 1 -- 172.21.15.69:0/2592028491 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f96cc0b2a50 msgr2=0x7f96cc0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.565+0000 7f96ecc00640 1 --2- 172.21.15.69:0/2592028491 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f96cc0b2a50 0x7f96cc0b4f60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55758295ff70 tx=0x7f96d8009260 comp rx=0 tx=0).stop 2024-05-14T15:23:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.565+0000 7f96ecc00640 1 -- 172.21.15.69:0/2592028491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e8106450 msgr2=0x7f96e81a2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:32.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.565+0000 7f96ecc00640 1 --2- 172.21.15.69:0/2592028491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e8106450 0x7f96e81a2500 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f96d802a910 tx=0x7f96d8003c20 comp rx=0 tx=0).stop 2024-05-14T15:23:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.565+0000 7f96ecc00640 1 -- 172.21.15.69:0/2592028491 shutdown_connections 2024-05-14T15:23:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.565+0000 7f96ecc00640 1 --2- 172.21.15.69:0/2592028491 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f96cc0b2a50 0x7f96cc0b4f60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.565+0000 7f96ecc00640 1 --2- 172.21.15.69:0/2592028491 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f96e810c1a0 0x7f96e819c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.565+0000 7f96ecc00640 1 --2- 172.21.15.69:0/2592028491 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f96e810bd00 0x7f96e81a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.565+0000 7f96ecc00640 1 --2- 172.21.15.69:0/2592028491 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f96e8106450 0x7f96e81a2500 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.565+0000 7f96ecc00640 1 -- 172.21.15.69:0/2592028491 >> 172.21.15.69:0/2592028491 conn(0x7f96e807d520 msgr2=0x7f96e81073a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.565+0000 7f96ecc00640 1 -- 172.21.15.69:0/2592028491 shutdown_connections 2024-05-14T15:23:32.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:32.565+0000 7f96ecc00640 1 -- 172.21.15.69:0/2592028491 wait complete. 2024-05-14T15:23:33.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:33 smithi203 ceph-mon[34567]: pgmap v60: 129 pgs: 129 active+clean; 278 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.1 MiB/s wr, 21 op/s 2024-05-14T15:23:33.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:33 smithi092 ceph-mon[34729]: pgmap v60: 129 pgs: 129 active+clean; 278 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.1 MiB/s wr, 21 op/s 2024-05-14T15:23:33.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:33 smithi069 ceph-mon[31270]: pgmap v60: 129 pgs: 129 active+clean; 278 MiB data, 1005 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 9.1 MiB/s wr, 21 op/s 2024-05-14T15:23:35.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:35 smithi203 ceph-mon[34567]: pgmap v61: 129 pgs: 129 active+clean; 300 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 13 MiB/s wr, 33 op/s 2024-05-14T15:23:35.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:35 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:23:35.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:35 smithi092 ceph-mon[34729]: pgmap v61: 129 pgs: 129 active+clean; 300 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 13 MiB/s wr, 33 op/s 2024-05-14T15:23:35.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:35 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:23:35.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:35 smithi069 ceph-mon[31270]: pgmap v61: 129 pgs: 129 active+clean; 300 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 13 MiB/s wr, 33 op/s 2024-05-14T15:23:35.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:35 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:23:35.808 INFO:teuthology.orchestra.run.smithi069.stderr:1100000 of 3200000 tuples (34%) done (elapsed 41.42 s, remaining 79.07 s) 2024-05-14T15:23:37.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:37 smithi203 ceph-mon[34567]: pgmap v62: 129 pgs: 129 active+clean; 300 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.7 MiB/s wr, 21 op/s 2024-05-14T15:23:37.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:37 smithi092 ceph-mon[34729]: pgmap v62: 129 pgs: 129 active+clean; 300 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.7 MiB/s wr, 21 op/s 2024-05-14T15:23:37.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:37 smithi069 ceph-mon[31270]: pgmap v62: 129 pgs: 129 active+clean; 300 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.7 MiB/s wr, 21 op/s 2024-05-14T15:23:39.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:39 smithi203 ceph-mon[34567]: pgmap v63: 129 pgs: 129 active+clean; 300 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.7 MiB/s wr, 21 op/s 2024-05-14T15:23:39.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:39 smithi092 ceph-mon[34729]: pgmap v63: 129 pgs: 129 active+clean; 300 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.7 MiB/s wr, 21 op/s 2024-05-14T15:23:39.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:39 smithi069 ceph-mon[31270]: pgmap v63: 129 pgs: 129 active+clean; 300 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 8.7 MiB/s wr, 21 op/s 2024-05-14T15:23:39.949 INFO:teuthology.orchestra.run.smithi069.stderr:1200000 of 3200000 tuples (37%) done (elapsed 45.56 s, remaining 75.93 s) 2024-05-14T15:23:41.277 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T15:23:41.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:41 smithi203 ceph-mon[34567]: pgmap v64: 129 pgs: 129 active+clean; 321 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 29 op/s 2024-05-14T15:23:41.363 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:41 smithi069 ceph-mon[31270]: pgmap v64: 129 pgs: 129 active+clean; 321 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 29 op/s 2024-05-14T15:23:41.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:41 smithi092 ceph-mon[34729]: pgmap v64: 129 pgs: 129 active+clean; 321 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 29 op/s 2024-05-14T15:23:41.782 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:23:43.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:43 smithi069 ceph-mon[31270]: pgmap v65: 129 pgs: 129 active+clean; 321 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 20 op/s 2024-05-14T15:23:43.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:43 smithi203 ceph-mon[34567]: pgmap v65: 129 pgs: 129 active+clean; 321 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 20 op/s 2024-05-14T15:23:43.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:43 smithi092 ceph-mon[34729]: pgmap v65: 129 pgs: 129 active+clean; 321 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 8.1 MiB/s wr, 20 op/s 2024-05-14T15:23:43.687 INFO:teuthology.orchestra.run.smithi069.stderr:1300000 of 3200000 tuples (40%) done (elapsed 49.30 s, remaining 72.05 s) 2024-05-14T15:23:44.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.469+0000 7f5d87a00700 1 -- 172.21.15.69:0/2532857661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d80109870 msgr2=0x7f5d801111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:44.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.469+0000 7f5d87a00700 1 --2- 172.21.15.69:0/2532857661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d80109870 0x7f5d801111d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f5d7800b0d0 tx=0x7f5d7800b3e0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.470+0000 7f5d87a00700 1 -- 172.21.15.69:0/2532857661 shutdown_connections 2024-05-14T15:23:44.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.470+0000 7f5d87a00700 1 --2- 172.21.15.69:0/2532857661 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d80109870 0x7f5d801111d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.470+0000 7f5d87a00700 1 --2- 172.21.15.69:0/2532857661 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d801045f0 0x7f5d80104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.470+0000 7f5d87a00700 1 --2- 172.21.15.69:0/2532857661 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d80108f20 0x7f5d80109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.470+0000 7f5d87a00700 1 -- 172.21.15.69:0/2532857661 >> 172.21.15.69:0/2532857661 conn(0x7f5d80100040 msgr2=0x7f5d80102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:44.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.470+0000 7f5d87a00700 1 -- 172.21.15.69:0/2532857661 shutdown_connections 2024-05-14T15:23:44.471 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.470+0000 7f5d87a00700 1 -- 172.21.15.69:0/2532857661 wait complete. 2024-05-14T15:23:44.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.471+0000 7f5d87a00700 1 Processor -- start 2024-05-14T15:23:44.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.471+0000 7f5d87a00700 1 -- start start 2024-05-14T15:23:44.472 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.472+0000 7f5d87a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d801045f0 0x7f5d80075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.472+0000 7f5d87a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d80108f20 0x7f5d80076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.472+0000 7f5d87a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d80109870 0x7f5d80076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.472+0000 7f5d87a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5d80114350 con 0x7f5d80109870 2024-05-14T15:23:44.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.472+0000 7f5d87a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5d801141d0 con 0x7f5d801045f0 2024-05-14T15:23:44.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.472+0000 7f5d87a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5d801144d0 con 0x7f5d80108f20 2024-05-14T15:23:44.473 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.472+0000 7f5d85a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d80109870 0x7f5d80076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.472+0000 7f5d85a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d80109870 0x7f5d80076540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38832/0 (socket says 172.21.15.69:38832) 2024-05-14T15:23:44.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.472+0000 7f5d85a00700 1 -- 172.21.15.69:0/1985086840 learned_addr learned my addr 172.21.15.69:0/1985086840 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:44.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.472+0000 7f5d85000700 1 --2- 172.21.15.69:0/1985086840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d801045f0 0x7f5d80075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.473+0000 7f5d7fe00700 1 --2- 172.21.15.69:0/1985086840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d80108f20 0x7f5d80076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.473+0000 7f5d85a00700 1 -- 172.21.15.69:0/1985086840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d80108f20 msgr2=0x7f5d80076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:44.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.473+0000 7f5d85a00700 1 --2- 172.21.15.69:0/1985086840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d80108f20 0x7f5d80076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.473+0000 7f5d85a00700 1 -- 172.21.15.69:0/1985086840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d801045f0 msgr2=0x7f5d80075ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:44.474 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.473+0000 7f5d85a00700 1 --2- 172.21.15.69:0/1985086840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d801045f0 0x7f5d80075ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.473+0000 7f5d85a00700 1 -- 172.21.15.69:0/1985086840 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d801a90c0 con 0x7f5d80109870 2024-05-14T15:23:44.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.474+0000 7f5d85a00700 1 --2- 172.21.15.69:0/1985086840 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d80109870 0x7f5d80076540 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009850 tx=0x7f5d78007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:44.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.474+0000 7f5d7d600700 1 -- 172.21.15.69:0/1985086840 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7801f070 con 0x7f5d80109870 2024-05-14T15:23:44.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.474+0000 7f5d7d600700 1 -- 172.21.15.69:0/1985086840 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d78005500 con 0x7f5d80109870 2024-05-14T15:23:44.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.474+0000 7f5d87a00700 1 -- 172.21.15.69:0/1985086840 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d801a9350 con 0x7f5d80109870 2024-05-14T15:23:44.475 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.474+0000 7f5d7d600700 1 -- 172.21.15.69:0/1985086840 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7801b8f0 con 0x7f5d80109870 2024-05-14T15:23:44.476 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.474+0000 7f5d87a00700 1 -- 172.21.15.69:0/1985086840 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d801a9800 con 0x7f5d80109870 2024-05-14T15:23:44.480 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.480+0000 7f5d96480b80 1 Processor -- start 2024-05-14T15:23:44.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.480+0000 7f5d7d600700 1 -- 172.21.15.69:0/1985086840 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f5d78022070 con 0x7f5d80109870 2024-05-14T15:23:44.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.481+0000 7f5d96480b80 1 -- start start 2024-05-14T15:23:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.481+0000 7f5d96480b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a7738a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.481+0000 7f5d96480b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a77389f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.481+0000 7f5d96480b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a77389fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.481+0000 7f5d96480b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55a7737c1a20 con 0x55a77389f9f0 2024-05-14T15:23:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.481+0000 7f5d96480b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a77375f760 con 0x55a773721e40 2024-05-14T15:23:44.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.481+0000 7f5d96480b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a7737bd9e0 con 0x55a7738a5830 2024-05-14T15:23:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.482+0000 7f5d7fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a77389fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.482+0000 7f5d7fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a77389fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38848/0 (socket says 172.21.15.69:38848) 2024-05-14T15:23:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.482+0000 7f5d7fe00700 1 -- 172.21.15.69:0/1777394047 learned_addr learned my addr 172.21.15.69:0/1777394047 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.482+0000 7f5d85000700 1 --2- 172.21.15.69:0/1777394047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a77389f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.482+0000 7f5d7fe00700 1 --2- 172.21.15.69:0/1777394047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a7738a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.483+0000 7f5d7fe00700 1 -- 172.21.15.69:0/1777394047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 msgr2=0x55a77389f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.483+0000 7f5d7fe00700 1 --2- 172.21.15.69:0/1777394047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a77389f4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.483+0000 7f5d7fe00700 1 -- 172.21.15.69:0/1777394047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 msgr2=0x55a7738a52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:44.483 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.483+0000 7f5d7fe00700 1 --2- 172.21.15.69:0/1777394047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a7738a52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.483+0000 7f5d7fe00700 1 -- 172.21.15.69:0/1777394047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a77370e8d0 con 0x55a77389f9f0 2024-05-14T15:23:44.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.483+0000 7f5d7fe00700 1 --2- 172.21.15.69:0/1777394047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a77389fe00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c012780 tx=0x7f5d6c00b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cc4d8732baa1b76 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:44.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.484+0000 7f5d72000700 1 -- 172.21.15.69:0/1777394047 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c012da0 con 0x55a77389f9f0 2024-05-14T15:23:44.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.484+0000 7f5d72000700 1 -- 172.21.15.69:0/1777394047 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d6c004cc0 con 0x55a77389f9f0 2024-05-14T15:23:44.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.484+0000 7f5d72000700 1 -- 172.21.15.69:0/1777394047 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c00f650 con 0x55a77389f9f0 2024-05-14T15:23:44.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.485+0000 7f5d7d600700 1 --2- 172.21.15.69:0/1985086840 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5d680b2a70 0x7f5d680b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.485+0000 7f5d96480b80 1 -- 172.21.15.69:0/1777394047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 msgr2=0x55a77389fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:44.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.485+0000 7f5d96480b80 1 --2- 172.21.15.69:0/1777394047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a77389fe00 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c012780 tx=0x7f5d6c00b780 comp rx=0 tx=0).stop 2024-05-14T15:23:44.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.485+0000 7f5d7d600700 1 -- 172.21.15.69:0/1985086840 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5d7800f020 con 0x7f5d80109870 2024-05-14T15:23:44.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.485+0000 7f5d96480b80 1 -- 172.21.15.69:0/1777394047 shutdown_connections 2024-05-14T15:23:44.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.485+0000 7f5d96480b80 1 --2- 172.21.15.69:0/1777394047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a77389fe00 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.485+0000 7f5d96480b80 1 --2- 172.21.15.69:0/1777394047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a7738a52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.485+0000 7f5d96480b80 1 --2- 172.21.15.69:0/1777394047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a77389f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.485+0000 7f5d96480b80 1 -- 172.21.15.69:0/1777394047 >> 172.21.15.69:0/1777394047 conn(0x55a773766f70 msgr2=0x55a77389a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:44.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.486+0000 7f5d96480b80 1 -- 172.21.15.69:0/1777394047 shutdown_connections 2024-05-14T15:23:44.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.486+0000 7f5d85000700 1 --2- 172.21.15.69:0/1985086840 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5d680b2a70 0x7f5d680b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.486+0000 7f5d96480b80 1 -- 172.21.15.69:0/1777394047 wait complete. 2024-05-14T15:23:44.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.487+0000 7f5d85000700 1 --2- 172.21.15.69:0/1985086840 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5d680b2a70 0x7f5d680b4f80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55a77389bab0 tx=0x7f5d7400b410 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:44.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.487+0000 7f5d96480b80 1 -- start start 2024-05-14T15:23:44.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.487+0000 7f5d96480b80 1 Processor -- start 2024-05-14T15:23:44.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.488+0000 7f5d96480b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a7738a8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.488+0000 7f5d96480b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a7738a94a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.488+0000 7f5d96480b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a7738a99e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.488+0000 7f5d96480b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55a7738bd320 con 0x55a77389f9f0 2024-05-14T15:23:44.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.488+0000 7f5d96480b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a773727b20 con 0x55a773721e40 2024-05-14T15:23:44.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.488+0000 7f5d96480b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a7738bd4a0 con 0x55a7738a5830 2024-05-14T15:23:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.488+0000 7f5d96480b80 10 client.0 _ll_register_callbacks cb 0x55a773768c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.488+0000 7f5d7fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a7738a94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.489+0000 7f5d7fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a7738a94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38854/0 (socket says 172.21.15.69:38854) 2024-05-14T15:23:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.489+0000 7f5d7fe00700 1 -- 172.21.15.69:0/4284049080 learned_addr learned my addr 172.21.15.69:0/4284049080 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.489+0000 7f5d85a00700 1 --2- 172.21.15.69:0/4284049080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a7738a99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.489+0000 7f5d85000700 1 --2- 172.21.15.69:0/4284049080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a7738a8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.489+0000 7f5d7fe00700 1 -- 172.21.15.69:0/4284049080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 msgr2=0x55a7738a99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.489+0000 7f5d7fe00700 1 --2- 172.21.15.69:0/4284049080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a7738a99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.489+0000 7f5d7fe00700 1 -- 172.21.15.69:0/4284049080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 msgr2=0x55a7738a8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.489+0000 7f5d7fe00700 1 --2- 172.21.15.69:0/4284049080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a7738a8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.489+0000 7f5d7fe00700 1 -- 172.21.15.69:0/4284049080 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a773787420 con 0x55a77389f9f0 2024-05-14T15:23:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.490+0000 7f5d7fe00700 1 --2- 172.21.15.69:0/4284049080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a7738a94a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00b2a0 tx=0x7f5d6c00b630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cabf49cffe142695 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:44.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.490+0000 7f5d66a00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.490+0000 7f5d66a00700 1 -- 172.21.15.69:0/4284049080 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d6c004fb0 con 0x55a77389f9f0 2024-05-14T15:23:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.490+0000 7f5d66a00700 1 -- 172.21.15.69:0/4284049080 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5d6c004750 con 0x55a77389f9f0 2024-05-14T15:23:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.490+0000 7f5d96480b80 1 -- 172.21.15.69:0/4284049080 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d6c004cc0 con 0x55a77389f9f0 2024-05-14T15:23:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.490+0000 7f5d66a00700 1 -- 172.21.15.69:0/4284049080 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5d6c030050 con 0x55a77389f9f0 2024-05-14T15:23:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.490+0000 7f5d96480b80 10 client.15807 fetch_fsmap learned FSMap version 35 2024-05-14T15:23:44.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.491+0000 7f5d96480b80 1 -- 172.21.15.69:0/4284049080 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a7738c7e30 con 0x55a77389f9f0 2024-05-14T15:23:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.491+0000 7f5d66a00700 1 -- 172.21.15.69:0/4284049080 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d6c004cc0 con 0x55a77389f9f0 2024-05-14T15:23:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.491+0000 7f5d66a00700 1 -- 172.21.15.69:0/4284049080 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f5d6c01fc30 con 0x55a77389f9f0 2024-05-14T15:23:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.491+0000 7f5d96480b80 10 client.15807 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:23:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.491+0000 7f5d96480b80 10 client.15807 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.491+0000 7f5d96480b80 20 client.15807 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.491+0000 7f5d96480b80 1 --2- 172.21.15.69:0/4284049080 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a7738ca300 0x55a7738cc720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.491+0000 7f5d96480b80 4 client.15807 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:23:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.491+0000 7f5d96480b80 1 -- 172.21.15.69:0/4284049080 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a77386c1c0 con 0x55a7738ca300 2024-05-14T15:23:44.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.492+0000 7f5d85000700 1 --2- 172.21.15.69:0/4284049080 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a7738ca300 0x55a7738cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.493+0000 7f5d85000700 1 --2- 172.21.15.69:0/4284049080 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a7738ca300 0x55a7738cc720 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de9985b3e7cf36da server_cookie=ee385ddcb456bdba in_seq=0 out_seq=0 2024-05-14T15:23:44.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.493+0000 7f5d66a00700 10 client.15807 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:44.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.495+0000 7f5d66a00700 1 -- 172.21.15.69:0/4284049080 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a77386c1c0 con 0x55a7738ca300 2024-05-14T15:23:44.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.495+0000 7f5d66a00700 10 client.15807 handle_command_reply: tid=0 2024-05-14T15:23:44.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.495+0000 7f5d96480b80 1 client.15807 shutdown 2024-05-14T15:23:44.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.496+0000 7f5d96480b80 1 -- 172.21.15.69:0/4284049080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 msgr2=0x55a7738a94a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:44.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.496+0000 7f5d96480b80 1 --2- 172.21.15.69:0/4284049080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a7738a94a0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f5d6c00b2a0 tx=0x7f5d6c00b630 comp rx=0 tx=0).stop 2024-05-14T15:23:44.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.496+0000 7f5d96480b80 1 -- 172.21.15.69:0/4284049080 shutdown_connections 2024-05-14T15:23:44.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.496+0000 7f5d96480b80 1 --2- 172.21.15.69:0/4284049080 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a7738ca300 0x55a7738cc720 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.496+0000 7f5d96480b80 1 --2- 172.21.15.69:0/4284049080 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a7738a99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.496+0000 7f5d96480b80 1 --2- 172.21.15.69:0/4284049080 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a7738a8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.496+0000 7f5d96480b80 1 --2- 172.21.15.69:0/4284049080 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a7738a94a0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.496+0000 7f5d96480b80 1 -- 172.21.15.69:0/4284049080 >> 172.21.15.69:0/4284049080 conn(0x55a773766f70 msgr2=0x55a77389e4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:44.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.496+0000 7f5d66a00700 0 client.15807 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:44.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.496+0000 7f5d96480b80 1 -- 172.21.15.69:0/4284049080 shutdown_connections 2024-05-14T15:23:44.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.496+0000 7f5d96480b80 1 -- 172.21.15.69:0/4284049080 wait complete. 2024-05-14T15:23:44.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.496+0000 7f5d96480b80 20 client.15807 trim_cache size 0 max 16384 2024-05-14T15:23:44.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.522+0000 7f5d96480b80 1 Processor -- start 2024-05-14T15:23:44.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.522+0000 7f5d96480b80 1 -- start start 2024-05-14T15:23:44.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.523+0000 7f5d96480b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a77389f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.523+0000 7f5d96480b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a7738a9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.523+0000 7f5d96480b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a7738c63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.523+0000 7f5d96480b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5d801a9ed0 con 0x55a77389f9f0 2024-05-14T15:23:44.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.523+0000 7f5d96480b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5d801abb90 con 0x55a773721e40 2024-05-14T15:23:44.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.523+0000 7f5d96480b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5d801aa5a0 con 0x55a7738a5830 2024-05-14T15:23:44.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.523+0000 7f5d7fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a7738a9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.523+0000 7f5d7fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a7738a9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38858/0 (socket says 172.21.15.69:38858) 2024-05-14T15:23:44.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.523+0000 7f5d7fe00700 1 -- 172.21.15.69:0/1484863438 learned_addr learned my addr 172.21.15.69:0/1484863438 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:44.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.524+0000 7f5d85000700 1 --2- 172.21.15.69:0/1484863438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a77389f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.524+0000 7f5d85a00700 1 --2- 172.21.15.69:0/1484863438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a7738c63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.524+0000 7f5d85000700 1 -- 172.21.15.69:0/1484863438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 msgr2=0x55a7738c63d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:44.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.524+0000 7f5d85000700 1 --2- 172.21.15.69:0/1484863438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a7738c63d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.524+0000 7f5d85000700 1 -- 172.21.15.69:0/1484863438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 msgr2=0x55a7738a9820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:44.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.524+0000 7f5d85000700 1 --2- 172.21.15.69:0/1484863438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a7738a9820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.524+0000 7f5d85000700 1 -- 172.21.15.69:0/1484863438 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a7738bd170 con 0x55a773721e40 2024-05-14T15:23:44.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.525+0000 7f5d85000700 1 --2- 172.21.15.69:0/1484863438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a77389f4b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55a7738ccd60 tx=0x7f5d74016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93d81321ce425106 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:44.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.525+0000 7f5d71600700 1 -- 172.21.15.69:0/1484863438 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7402e020 con 0x55a773721e40 2024-05-14T15:23:44.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.526+0000 7f5d71600700 1 -- 172.21.15.69:0/1484863438 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d74004cc0 con 0x55a773721e40 2024-05-14T15:23:44.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.526+0000 7f5d71600700 1 -- 172.21.15.69:0/1484863438 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7402aad0 con 0x55a773721e40 2024-05-14T15:23:44.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.527+0000 7f5d96480b80 1 -- 172.21.15.69:0/1484863438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 msgr2=0x55a77389f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:44.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.527+0000 7f5d96480b80 1 --2- 172.21.15.69:0/1484863438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a77389f4b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x55a7738ccd60 tx=0x7f5d74016000 comp rx=0 tx=0).stop 2024-05-14T15:23:44.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.527+0000 7f5d96480b80 1 -- 172.21.15.69:0/1484863438 shutdown_connections 2024-05-14T15:23:44.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.527+0000 7f5d96480b80 1 --2- 172.21.15.69:0/1484863438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a7738c63d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.527+0000 7f5d96480b80 1 --2- 172.21.15.69:0/1484863438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a77389f4b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.527+0000 7f5d96480b80 1 --2- 172.21.15.69:0/1484863438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a7738a9820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.527+0000 7f5d96480b80 1 -- 172.21.15.69:0/1484863438 >> 172.21.15.69:0/1484863438 conn(0x55a773766f70 msgr2=0x55a7738940a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:44.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.527+0000 7f5d96480b80 1 -- 172.21.15.69:0/1484863438 shutdown_connections 2024-05-14T15:23:44.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.527+0000 7f5d96480b80 1 -- 172.21.15.69:0/1484863438 wait complete. 2024-05-14T15:23:44.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.528+0000 7f5d96480b80 1 -- start start 2024-05-14T15:23:44.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.528+0000 7f5d96480b80 1 Processor -- start 2024-05-14T15:23:44.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.529+0000 7f5d96480b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a7738c2950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.529+0000 7f5d96480b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a7738bf720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.529+0000 7f5d96480b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a7738bfc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.529+0000 7f5d96480b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5d801ab400 con 0x55a77389f9f0 2024-05-14T15:23:44.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.529+0000 7f5d96480b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5d801aaca0 con 0x55a773721e40 2024-05-14T15:23:44.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.529+0000 7f5d96480b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5d80073e80 con 0x55a7738a5830 2024-05-14T15:23:44.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.529+0000 7f5d96480b80 10 client.0 _ll_register_callbacks cb 0x55a773768c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:44.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.530+0000 7f5d7fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a7738bf720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.530+0000 7f5d85a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a7738bfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.530+0000 7f5d85a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a7738bfc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:51188/0 (socket says 172.21.15.69:51188) 2024-05-14T15:23:44.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.530+0000 7f5d85a00700 1 -- 172.21.15.69:0/3667017606 learned_addr learned my addr 172.21.15.69:0/3667017606 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.530+0000 7f5d85000700 1 --2- 172.21.15.69:0/3667017606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a7738c2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.531+0000 7f5d85a00700 1 -- 172.21.15.69:0/3667017606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 msgr2=0x55a7738c2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.531+0000 7f5d85a00700 1 --2- 172.21.15.69:0/3667017606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a7738c2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.531+0000 7f5d85a00700 1 -- 172.21.15.69:0/3667017606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 msgr2=0x55a7738bf720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.531+0000 7f5d85a00700 1 --2- 172.21.15.69:0/3667017606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a7738bf720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.531+0000 7f5d85a00700 1 -- 172.21.15.69:0/3667017606 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a7738c3170 con 0x55a7738a5830 2024-05-14T15:23:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.531+0000 7f5d85000700 1 --2- 172.21.15.69:0/3667017606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a7738c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:23:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.531+0000 7f5d85a00700 1 --2- 172.21.15.69:0/3667017606 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a7738bfc60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5d780a6da0 tx=0x7f5d78009600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=70be2eb4e8e1db36 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:44.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.531+0000 7f5d66a00700 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:23:44.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.532+0000 7f5d66a00700 1 -- 172.21.15.69:0/3667017606 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d780ca060 con 0x55a7738a5830 2024-05-14T15:23:44.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.532+0000 7f5d96480b80 1 -- 172.21.15.69:0/3667017606 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5d74004cc0 con 0x55a7738a5830 2024-05-14T15:23:44.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.532+0000 7f5d66a00700 1 -- 172.21.15.69:0/3667017606 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5d780ab190 con 0x55a7738a5830 2024-05-14T15:23:44.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.532+0000 7f5d66a00700 1 -- 172.21.15.69:0/3667017606 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5d780aa830 con 0x55a7738a5830 2024-05-14T15:23:44.533 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.532+0000 7f5d96480b80 10 client.25381 fetch_fsmap learned FSMap version 35 2024-05-14T15:23:44.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.532+0000 7f5d96480b80 1 -- 172.21.15.69:0/3667017606 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a77393dd20 con 0x55a7738a5830 2024-05-14T15:23:44.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.533+0000 7f5d66a00700 1 -- 172.21.15.69:0/3667017606 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5d74004cc0 con 0x55a7738a5830 2024-05-14T15:23:44.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.533+0000 7f5d66a00700 1 -- 172.21.15.69:0/3667017606 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f5d78011070 con 0x55a7738a5830 2024-05-14T15:23:44.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.533+0000 7f5d96480b80 10 client.25381 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:23:44.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.533+0000 7f5d96480b80 10 client.25381 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:44.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.533+0000 7f5d96480b80 20 client.25381 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:44.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.533+0000 7f5d96480b80 1 --2- 172.21.15.69:0/3667017606 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a77393e4d0 0x55a7739408f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:44.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.533+0000 7f5d96480b80 4 client.25381 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T15:23:44.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.533+0000 7f5d96480b80 1 -- 172.21.15.69:0/3667017606 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a7737cf400 con 0x55a77393e4d0 2024-05-14T15:23:44.535 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.534+0000 7f5d85000700 1 --2- 172.21.15.69:0/3667017606 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a77393e4d0 0x55a7739408f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:44.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.535+0000 7f5d66a00700 10 client.25381 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:44.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.535+0000 7f5d85000700 1 --2- 172.21.15.69:0/3667017606 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a77393e4d0 0x55a7739408f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e8a21b3a32e5204 server_cookie=1d69894201bed2e6 in_seq=0 out_seq=0 2024-05-14T15:23:44.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.535+0000 7f5d66a00700 1 -- 172.21.15.69:0/3667017606 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a7737cf400 con 0x55a77393e4d0 2024-05-14T15:23:44.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.535+0000 7f5d66a00700 10 client.25381 handle_command_reply: tid=0 2024-05-14T15:23:44.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.536+0000 7f5d96480b80 1 client.25381 shutdown 2024-05-14T15:23:44.536 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.536+0000 7f5d96480b80 1 -- 172.21.15.69:0/3667017606 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 msgr2=0x55a7738bfc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:44.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.536+0000 7f5d96480b80 1 --2- 172.21.15.69:0/3667017606 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a7738bfc60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5d780a6da0 tx=0x7f5d78009600 comp rx=0 tx=0).stop 2024-05-14T15:23:44.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.536+0000 7f5d96480b80 1 -- 172.21.15.69:0/3667017606 shutdown_connections 2024-05-14T15:23:44.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.536+0000 7f5d96480b80 1 --2- 172.21.15.69:0/3667017606 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a77393e4d0 0x55a7739408f0 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.536+0000 7f5d96480b80 1 --2- 172.21.15.69:0/3667017606 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7738a5830 0x55a7738bfc60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.536+0000 7f5d96480b80 1 --2- 172.21.15.69:0/3667017606 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a773721e40 0x55a7738c2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.536+0000 7f5d96480b80 1 --2- 172.21.15.69:0/3667017606 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a77389f9f0 0x55a7738bf720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.536+0000 7f5d96480b80 1 -- 172.21.15.69:0/3667017606 >> 172.21.15.69:0/3667017606 conn(0x55a773766f70 msgr2=0x55a7738a4870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:44.537 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.536+0000 7f5d66a00700 0 client.25381 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:44.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.537+0000 7f5d96480b80 1 -- 172.21.15.69:0/3667017606 shutdown_connections 2024-05-14T15:23:44.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.538+0000 7f5d96480b80 1 -- 172.21.15.69:0/3667017606 wait complete. 2024-05-14T15:23:44.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.538+0000 7f5d96480b80 20 client.25381 trim_cache size 0 max 16384 2024-05-14T15:23:44.539 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:23:44.539 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2024-05-14T15:23:44.539 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2024-05-14T15:23:44.539 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:23:44.539 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.539+0000 7f5d87a00700 1 -- 172.21.15.69:0/1985086840 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5d680b2a70 msgr2=0x7f5d680b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:44.539 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.539+0000 7f5d87a00700 1 --2- 172.21.15.69:0/1985086840 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5d680b2a70 0x7f5d680b4f80 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x55a77389bab0 tx=0x7f5d7400b410 comp rx=0 tx=0).stop 2024-05-14T15:23:44.539 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.539+0000 7f5d87a00700 1 -- 172.21.15.69:0/1985086840 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d80109870 msgr2=0x7f5d80076540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:44.539 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.539+0000 7f5d87a00700 1 --2- 172.21.15.69:0/1985086840 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d80109870 0x7f5d80076540 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009850 tx=0x7f5d78007d90 comp rx=0 tx=0).stop 2024-05-14T15:23:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.539+0000 7f5d87a00700 1 -- 172.21.15.69:0/1985086840 shutdown_connections 2024-05-14T15:23:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.539+0000 7f5d87a00700 1 --2- 172.21.15.69:0/1985086840 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5d680b2a70 0x7f5d680b4f80 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.539+0000 7f5d87a00700 1 --2- 172.21.15.69:0/1985086840 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5d80109870 0x7f5d80076540 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.539+0000 7f5d87a00700 1 --2- 172.21.15.69:0/1985086840 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5d801045f0 0x7f5d80075ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.539+0000 7f5d87a00700 1 --2- 172.21.15.69:0/1985086840 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5d80108f20 0x7f5d80076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.539+0000 7f5d87a00700 1 -- 172.21.15.69:0/1985086840 >> 172.21.15.69:0/1985086840 conn(0x7f5d80100040 msgr2=0x7f5d80108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:44.540 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.540+0000 7f5d87a00700 1 -- 172.21.15.69:0/1985086840 shutdown_connections 2024-05-14T15:23:44.541 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:44.540+0000 7f5d87a00700 1 -- 172.21.15.69:0/1985086840 wait complete. 2024-05-14T15:23:45.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:45 smithi069 ceph-mon[31270]: pgmap v66: 129 pgs: 129 active+clean; 353 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 30 op/s 2024-05-14T15:23:45.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:45 smithi203 ceph-mon[34567]: pgmap v66: 129 pgs: 129 active+clean; 353 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 30 op/s 2024-05-14T15:23:45.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:45 smithi092 ceph-mon[34729]: pgmap v66: 129 pgs: 129 active+clean; 353 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 13 MiB/s wr, 30 op/s 2024-05-14T15:23:45.518 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-14T15:23:45.519 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:23:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.848+0000 7ff2a3e00640 1 -- 172.21.15.69:0/437050714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2a4104210 msgr2=0x7ff2a41105e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.848+0000 7ff2a3e00640 1 --2- 172.21.15.69:0/437050714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2a4104210 0x7ff2a41105e0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009ca0 tx=0x7ff29c02a8c0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.849+0000 7ff2a3e00640 1 -- 172.21.15.69:0/437050714 shutdown_connections 2024-05-14T15:23:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.849+0000 7ff2a3e00640 1 --2- 172.21.15.69:0/437050714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2a4104210 0x7ff2a41105e0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.849+0000 7ff2a3e00640 1 --2- 172.21.15.69:0/437050714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2a4109f60 0x7ff2a4103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.849+0000 7ff2a3e00640 1 --2- 172.21.15.69:0/437050714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2a4109ac0 0x7ff2a4103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.849+0000 7ff2a3e00640 1 -- 172.21.15.69:0/437050714 >> 172.21.15.69:0/437050714 conn(0x7ff2a4079150 msgr2=0x7ff2a4079590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.849+0000 7ff2a3e00640 1 -- 172.21.15.69:0/437050714 shutdown_connections 2024-05-14T15:23:45.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.849+0000 7ff2a3e00640 1 -- 172.21.15.69:0/437050714 wait complete. 2024-05-14T15:23:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.851+0000 7ff2a3e00640 1 Processor -- start 2024-05-14T15:23:45.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.851+0000 7ff2a3e00640 1 -- start start 2024-05-14T15:23:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.852+0000 7ff2a3e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2a4104210 0x7ff2a4111150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.852+0000 7ff2a3e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2a4109ac0 0x7ff2a4111690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.852+0000 7ff2a3e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2a4109f60 0x7ff2a4111bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.852+0000 7ff2a3e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a4115d60 con 0x7ff2a4109f60 2024-05-14T15:23:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.852+0000 7ff2a3e00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a4115be0 con 0x7ff2a4104210 2024-05-14T15:23:45.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.852+0000 7ff2a3e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a4115ee0 con 0x7ff2a4109ac0 2024-05-14T15:23:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.852+0000 7ff2a3400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2a4109f60 0x7ff2a4111bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.852+0000 7ff2a3400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2a4109f60 0x7ff2a4111bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38878/0 (socket says 172.21.15.69:38878) 2024-05-14T15:23:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.852+0000 7ff2a3400640 1 -- 172.21.15.69:0/3794799937 learned_addr learned my addr 172.21.15.69:0/3794799937 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.852+0000 7ff2a2a00640 1 --2- 172.21.15.69:0/3794799937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2a4104210 0x7ff2a4111150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:45.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.852+0000 7ff2a2000640 1 --2- 172.21.15.69:0/3794799937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2a4109ac0 0x7ff2a4111690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.853+0000 7ff2a3400640 1 -- 172.21.15.69:0/3794799937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2a4109ac0 msgr2=0x7ff2a4111690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.853+0000 7ff2a3400640 1 --2- 172.21.15.69:0/3794799937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2a4109ac0 0x7ff2a4111690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.853+0000 7ff2a3400640 1 -- 172.21.15.69:0/3794799937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2a4104210 msgr2=0x7ff2a4111150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.853+0000 7ff2a3400640 1 --2- 172.21.15.69:0/3794799937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2a4104210 0x7ff2a4111150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.853+0000 7ff2a3400640 1 -- 172.21.15.69:0/3794799937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a41acd90 con 0x7ff2a4109f60 2024-05-14T15:23:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.854+0000 7ff2a3400640 1 --2- 172.21.15.69:0/3794799937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2a4109f60 0x7ff2a4111bd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff29c031040 tx=0x7ff29c032bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:45.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.854+0000 7ff29b400640 1 -- 172.21.15.69:0/3794799937 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c032eb0 con 0x7ff2a4109f60 2024-05-14T15:23:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.855+0000 7ff29b400640 1 -- 172.21.15.69:0/3794799937 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff29c0044d0 con 0x7ff2a4109f60 2024-05-14T15:23:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.855+0000 7ff2a3e00640 1 -- 172.21.15.69:0/3794799937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a41acfc0 con 0x7ff2a4109f60 2024-05-14T15:23:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.855+0000 7ff29b400640 1 -- 172.21.15.69:0/3794799937 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29c030b20 con 0x7ff2a4109f60 2024-05-14T15:23:45.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.855+0000 7ff2a3e00640 1 -- 172.21.15.69:0/3794799937 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a41ad480 con 0x7ff2a4109f60 2024-05-14T15:23:45.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.861+0000 7ff29b400640 1 -- 172.21.15.69:0/3794799937 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ff29c030d00 con 0x7ff2a4109f60 2024-05-14T15:23:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.861+0000 7ff2b07a9740 1 Processor -- start 2024-05-14T15:23:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.862+0000 7ff2b07a9740 1 -- start start 2024-05-14T15:23:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.862+0000 7ff2b07a9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe5d1b0 0x55a1cc1fe480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.862+0000 7ff2b07a9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbe342f0 0x55a1cc1fe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.863+0000 7ff2b07a9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc1fef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.863+0000 7ff2b07a9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55a1cc163550 con 0x55a1cbe5d1b0 2024-05-14T15:23:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.863+0000 7ff2b07a9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a1cc108bc0 con 0x55a1cbe3c4d0 2024-05-14T15:23:45.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.863+0000 7ff2b07a9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a1cc15f510 con 0x55a1cbe342f0 2024-05-14T15:23:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.863+0000 7ff2a2a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbe342f0 0x55a1cc1fe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.863+0000 7ff2a2a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbe342f0 0x55a1cc1fe9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:51216/0 (socket says 172.21.15.69:51216) 2024-05-14T15:23:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.863+0000 7ff2a2a00640 1 -- 172.21.15.69:0/2252892714 learned_addr learned my addr 172.21.15.69:0/2252892714 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.864+0000 7ff29b400640 1 --2- 172.21.15.69:0/3794799937 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff2880b2ae0 0x7ff2880b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.864+0000 7ff2a2a00640 1 -- 172.21.15.69:0/2252892714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe3c4d0 msgr2=0x55a1cc1fef00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:23:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.864+0000 7ff2a2a00640 1 --2- 172.21.15.69:0/2252892714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc1fef00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.864+0000 7ff2a2a00640 1 -- 172.21.15.69:0/2252892714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe5d1b0 msgr2=0x55a1cc1fe480 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:23:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.864+0000 7ff2a2a00640 1 --2- 172.21.15.69:0/2252892714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe5d1b0 0x55a1cc1fe480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.864+0000 7ff2a2a00640 1 -- 172.21.15.69:0/2252892714 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1cbe75210 con 0x55a1cbe342f0 2024-05-14T15:23:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.864+0000 7ff2a3400640 1 --2- 172.21.15.69:0/3794799937 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff2880b2ae0 0x7ff2880b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:45.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.864+0000 7ff29b400640 1 -- 172.21.15.69:0/3794799937 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7ff29c103f40 con 0x7ff2a4109f60 2024-05-14T15:23:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.865+0000 7ff2a2a00640 1 --2- 172.21.15.69:0/2252892714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbe342f0 0x55a1cc1fe9c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff29400bcb0 tx=0x7ff2940107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4af5b47de663f9e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.865+0000 7ff28fe00640 1 -- 172.21.15.69:0/2252892714 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff294004030 con 0x55a1cbe342f0 2024-05-14T15:23:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.865+0000 7ff28fe00640 1 -- 172.21.15.69:0/2252892714 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2940035f0 con 0x55a1cbe342f0 2024-05-14T15:23:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.865+0000 7ff28fe00640 1 -- 172.21.15.69:0/2252892714 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff294011680 con 0x55a1cbe342f0 2024-05-14T15:23:45.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.865+0000 7ff2a3400640 1 --2- 172.21.15.69:0/3794799937 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff2880b2ae0 0x7ff2880b4ff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009620 tx=0x7ff29c040000 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.867+0000 7ff2b07a9740 1 -- 172.21.15.69:0/2252892714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbe342f0 msgr2=0x55a1cc1fe9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.867+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/2252892714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbe342f0 0x55a1cc1fe9c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff29400bcb0 tx=0x7ff2940107a0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.867+0000 7ff2b07a9740 1 -- 172.21.15.69:0/2252892714 shutdown_connections 2024-05-14T15:23:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.867+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/2252892714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc1fef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.867+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/2252892714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbe342f0 0x55a1cc1fe9c0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.867+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/2252892714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe5d1b0 0x55a1cc1fe480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.867+0000 7ff2b07a9740 1 -- 172.21.15.69:0/2252892714 >> 172.21.15.69:0/2252892714 conn(0x55a1cbe51300 msgr2=0x55a1cc1fac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.868+0000 7ff2b07a9740 1 -- 172.21.15.69:0/2252892714 shutdown_connections 2024-05-14T15:23:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.868+0000 7ff2b07a9740 1 -- 172.21.15.69:0/2252892714 wait complete. 2024-05-14T15:23:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.869+0000 7ff2b07a9740 1 -- start start 2024-05-14T15:23:45.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.869+0000 7ff2b07a9740 1 Processor -- start 2024-05-14T15:23:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.870+0000 7ff2b07a9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbe342f0 0x55a1cc208950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.870+0000 7ff2b07a9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc208e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.870+0000 7ff2b07a9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe5d1b0 0x55a1cc214a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.870+0000 7ff2b07a9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55a1cc20b5b0 con 0x55a1cbe5d1b0 2024-05-14T15:23:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.870+0000 7ff2b07a9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a1cc11c660 con 0x55a1cbe3c4d0 2024-05-14T15:23:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.870+0000 7ff2b07a9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a1cc20b730 con 0x55a1cbe342f0 2024-05-14T15:23:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.870+0000 7ff2a2000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe5d1b0 0x55a1cc214a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.871+0000 7ff2a2000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe5d1b0 0x55a1cc214a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38884/0 (socket says 172.21.15.69:38884) 2024-05-14T15:23:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.871+0000 7ff2a2000640 1 -- 172.21.15.69:0/3219466503 learned_addr learned my addr 172.21.15.69:0/3219466503 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.870+0000 7ff2b07a9740 10 client.0 _ll_register_callbacks cb 0x55a1cc0e6400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.871+0000 7ff2a2000640 1 --2- 172.21.15.69:0/3219466503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbe342f0 0x55a1cc208950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:45.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.871+0000 7ff2a2a00640 1 --2- 172.21.15.69:0/3219466503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc208e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.872+0000 7ff2a2000640 1 -- 172.21.15.69:0/3219466503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbe342f0 msgr2=0x55a1cc208950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.872+0000 7ff2a2000640 1 --2- 172.21.15.69:0/3219466503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbe342f0 0x55a1cc208950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.872+0000 7ff2a2000640 1 -- 172.21.15.69:0/3219466503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe3c4d0 msgr2=0x55a1cc208e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.872+0000 7ff2a2000640 1 --2- 172.21.15.69:0/3219466503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc208e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.872+0000 7ff2a2000640 1 -- 172.21.15.69:0/3219466503 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1cbf41620 con 0x55a1cbe5d1b0 2024-05-14T15:23:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.872+0000 7ff2a2000640 1 --2- 172.21.15.69:0/3219466503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe5d1b0 0x55a1cc214a90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff2a406c3b0 tx=0x7ff29000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=331e4b0b47294b8f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.873+0000 7ff28cc00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:45.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.873+0000 7ff28cc00640 1 -- 172.21.15.69:0/3219466503 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff290004220 con 0x55a1cbe5d1b0 2024-05-14T15:23:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.873+0000 7ff28cc00640 1 -- 172.21.15.69:0/3219466503 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7ff290004020 con 0x55a1cbe5d1b0 2024-05-14T15:23:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.873+0000 7ff2b07a9740 1 -- 172.21.15.69:0/3219466503 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2940035f0 con 0x55a1cbe5d1b0 2024-05-14T15:23:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.874+0000 7ff28cc00640 1 -- 172.21.15.69:0/3219466503 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff290004220 con 0x55a1cbe5d1b0 2024-05-14T15:23:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.874+0000 7ff2b07a9740 10 client.15822 fetch_fsmap learned FSMap version 35 2024-05-14T15:23:45.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.874+0000 7ff2b07a9740 1 -- 172.21.15.69:0/3219466503 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a1cc2178a0 con 0x55a1cbe5d1b0 2024-05-14T15:23:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.874+0000 7ff28cc00640 1 -- 172.21.15.69:0/3219466503 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2940035f0 con 0x55a1cbe5d1b0 2024-05-14T15:23:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.874+0000 7ff28cc00640 1 -- 172.21.15.69:0/3219466503 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7ff2900047a0 con 0x55a1cbe5d1b0 2024-05-14T15:23:45.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.875+0000 7ff2b07a9740 10 client.15822 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:23:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.875+0000 7ff2b07a9740 10 client.15822 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.875+0000 7ff2b07a9740 20 client.15822 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.875+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/3219466503 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a1cbe1bd80 0x55a1cc21af00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.875+0000 7ff2b07a9740 4 client.15822 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:23:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.875+0000 7ff2b07a9740 1 -- 172.21.15.69:0/3219466503 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1cc171160 con 0x55a1cbe1bd80 2024-05-14T15:23:45.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.876+0000 7ff2a2a00640 1 --2- 172.21.15.69:0/3219466503 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a1cbe1bd80 0x55a1cc21af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.877+0000 7ff2a2a00640 1 --2- 172.21.15.69:0/3219466503 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a1cbe1bd80 0x55a1cc21af00 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfafd85aa48e913e server_cookie=3b70e2e8f2bf929f in_seq=0 out_seq=0 2024-05-14T15:23:45.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.877+0000 7ff28cc00640 10 client.15822 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.879+0000 7ff28cc00640 1 -- 172.21.15.69:0/3219466503 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a1cc171160 con 0x55a1cbe1bd80 2024-05-14T15:23:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.879+0000 7ff28cc00640 10 client.15822 handle_command_reply: tid=0 2024-05-14T15:23:45.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.879+0000 7ff2b07a9740 1 client.15822 shutdown 2024-05-14T15:23:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.880+0000 7ff2b07a9740 1 -- 172.21.15.69:0/3219466503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe5d1b0 msgr2=0x55a1cc214a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:45.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.880+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/3219466503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe5d1b0 0x55a1cc214a90 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7ff2a406c3b0 tx=0x7ff29000c490 comp rx=0 tx=0).stop 2024-05-14T15:23:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.880+0000 7ff2b07a9740 1 -- 172.21.15.69:0/3219466503 shutdown_connections 2024-05-14T15:23:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.880+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/3219466503 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a1cbe1bd80 0x55a1cc21af00 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.880+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/3219466503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe5d1b0 0x55a1cc214a90 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.880+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/3219466503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc208e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.880+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/3219466503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbe342f0 0x55a1cc208950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.880+0000 7ff2b07a9740 1 -- 172.21.15.69:0/3219466503 >> 172.21.15.69:0/3219466503 conn(0x55a1cbe51300 msgr2=0x55a1cc2001a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.883+0000 7ff28cc00640 0 client.15822 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.883+0000 7ff2b07a9740 1 -- 172.21.15.69:0/3219466503 shutdown_connections 2024-05-14T15:23:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.883+0000 7ff2b07a9740 1 -- 172.21.15.69:0/3219466503 wait complete. 2024-05-14T15:23:45.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.883+0000 7ff2b07a9740 20 client.15822 trim_cache size 0 max 16384 2024-05-14T15:23:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.908+0000 7ff2b07a9740 1 Processor -- start 2024-05-14T15:23:45.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.908+0000 7ff2b07a9740 1 -- start start 2024-05-14T15:23:45.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.908+0000 7ff2b07a9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe342f0 0x55a1cc1fab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.909+0000 7ff2b07a9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc2206c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.909+0000 7ff2b07a9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbdf11c0 0x55a1cc220c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.909+0000 7ff2b07a9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a41b76e0 con 0x55a1cbe3c4d0 2024-05-14T15:23:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.909+0000 7ff2b07a9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a41b93a0 con 0x55a1cbe342f0 2024-05-14T15:23:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.909+0000 7ff2b07a9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a41b7db0 con 0x55a1cbdf11c0 2024-05-14T15:23:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.909+0000 7ff2a2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc2206c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.909+0000 7ff2a2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc2206c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38890/0 (socket says 172.21.15.69:38890) 2024-05-14T15:23:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.909+0000 7ff2a2a00640 1 -- 172.21.15.69:0/2637470787 learned_addr learned my addr 172.21.15.69:0/2637470787 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.909+0000 7ff2a2000640 1 --2- 172.21.15.69:0/2637470787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe342f0 0x55a1cc1fab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:45.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.909+0000 7ff2a2000640 1 --2- 172.21.15.69:0/2637470787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbdf11c0 0x55a1cc220c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.910+0000 7ff2a2a00640 1 -- 172.21.15.69:0/2637470787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbdf11c0 msgr2=0x55a1cc220c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.910+0000 7ff2a2a00640 1 --2- 172.21.15.69:0/2637470787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbdf11c0 0x55a1cc220c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.910+0000 7ff2a2a00640 1 -- 172.21.15.69:0/2637470787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe342f0 msgr2=0x55a1cc1fab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.910+0000 7ff2a2a00640 1 --2- 172.21.15.69:0/2637470787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe342f0 0x55a1cc1fab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.910+0000 7ff2a2a00640 1 -- 172.21.15.69:0/2637470787 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1cc209c00 con 0x55a1cbe3c4d0 2024-05-14T15:23:45.911 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.910+0000 7ff2a2a00640 1 --2- 172.21.15.69:0/2637470787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc2206c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x55a1cc1fbf70 tx=0x7ff294003eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2dd3ce20a1e97b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.911+0000 7ff28f400640 1 -- 172.21.15.69:0/2637470787 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29402f070 con 0x55a1cbe3c4d0 2024-05-14T15:23:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.911+0000 7ff28f400640 1 -- 172.21.15.69:0/2637470787 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2940035f0 con 0x55a1cbe3c4d0 2024-05-14T15:23:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.911+0000 7ff28f400640 1 -- 172.21.15.69:0/2637470787 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2940266e0 con 0x55a1cbe3c4d0 2024-05-14T15:23:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.912+0000 7ff2b07a9740 1 -- 172.21.15.69:0/2637470787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe3c4d0 msgr2=0x55a1cc2206c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.912+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/2637470787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc2206c0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x55a1cc1fbf70 tx=0x7ff294003eb0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.912+0000 7ff2b07a9740 1 -- 172.21.15.69:0/2637470787 shutdown_connections 2024-05-14T15:23:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.912+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/2637470787 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbdf11c0 0x55a1cc220c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.912+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/2637470787 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc2206c0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.912+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/2637470787 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe342f0 0x55a1cc1fab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.912+0000 7ff2b07a9740 1 -- 172.21.15.69:0/2637470787 >> 172.21.15.69:0/2637470787 conn(0x55a1cbe51300 msgr2=0x55a1cc1fa400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.912+0000 7ff2b07a9740 1 -- 172.21.15.69:0/2637470787 shutdown_connections 2024-05-14T15:23:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.912+0000 7ff2b07a9740 1 -- 172.21.15.69:0/2637470787 wait complete. 2024-05-14T15:23:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.913+0000 7ff2b07a9740 1 -- start start 2024-05-14T15:23:45.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.913+0000 7ff2b07a9740 1 Processor -- start 2024-05-14T15:23:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.914+0000 7ff2b07a9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbdf11c0 0x55a1cc20b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.914+0000 7ff2b07a9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe342f0 0x55a1cc20bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.914+0000 7ff2b07a9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc20c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.914+0000 7ff2b07a9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a41b8c10 con 0x55a1cbe3c4d0 2024-05-14T15:23:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.914+0000 7ff2b07a9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a41b84b0 con 0x55a1cbe342f0 2024-05-14T15:23:45.915 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.914+0000 7ff2b07a9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a41b56c0 con 0x55a1cbdf11c0 2024-05-14T15:23:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.914+0000 7ff2b07a9740 10 client.0 _ll_register_callbacks cb 0x7ff29000c3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.915+0000 7ff2a2000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc20c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.915+0000 7ff2a2000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc20c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38900/0 (socket says 172.21.15.69:38900) 2024-05-14T15:23:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.915+0000 7ff2a2000640 1 -- 172.21.15.69:0/601106900 learned_addr learned my addr 172.21.15.69:0/601106900 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.915+0000 7ff2a2a00640 1 --2- 172.21.15.69:0/601106900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe342f0 0x55a1cc20bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:45.916 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.915+0000 7ff2a2000640 1 --2- 172.21.15.69:0/601106900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbdf11c0 0x55a1cc20b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.915+0000 7ff2a2a00640 1 -- 172.21.15.69:0/601106900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbdf11c0 msgr2=0x55a1cc20b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.915+0000 7ff2a2a00640 1 --2- 172.21.15.69:0/601106900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbdf11c0 0x55a1cc20b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.915+0000 7ff2a2a00640 1 -- 172.21.15.69:0/601106900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe3c4d0 msgr2=0x55a1cc20c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.915+0000 7ff2a2a00640 1 --2- 172.21.15.69:0/601106900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc20c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.915+0000 7ff2a2a00640 1 -- 172.21.15.69:0/601106900 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1cc281390 con 0x55a1cbe342f0 2024-05-14T15:23:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.915+0000 7ff2a2000640 1 --2- 172.21.15.69:0/601106900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc20c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:23:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.916+0000 7ff2a2a00640 1 --2- 172.21.15.69:0/601106900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe342f0 0x55a1cc20bef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55a1cc215840 tx=0x7ff29400b720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ec91f39111e36d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.916+0000 7ff28cc00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:23:45.917 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.916+0000 7ff28cc00640 1 -- 172.21.15.69:0/601106900 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff29402f040 con 0x55a1cbe342f0 2024-05-14T15:23:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.916+0000 7ff28cc00640 1 -- 172.21.15.69:0/601106900 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7ff294003be0 con 0x55a1cbe342f0 2024-05-14T15:23:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.916+0000 7ff2b07a9740 1 -- 172.21.15.69:0/601106900 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2940035f0 con 0x55a1cbe342f0 2024-05-14T15:23:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.917+0000 7ff28cc00640 1 -- 172.21.15.69:0/601106900 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7ff2940050b0 con 0x55a1cbe342f0 2024-05-14T15:23:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.917+0000 7ff2b07a9740 10 client.35399 fetch_fsmap learned FSMap version 35 2024-05-14T15:23:45.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.917+0000 7ff2b07a9740 1 -- 172.21.15.69:0/601106900 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55a1cc282620 con 0x55a1cbe342f0 2024-05-14T15:23:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.917+0000 7ff28cc00640 1 -- 172.21.15.69:0/601106900 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff2940035f0 con 0x55a1cbe342f0 2024-05-14T15:23:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.918+0000 7ff28cc00640 1 -- 172.21.15.69:0/601106900 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7ff294029780 con 0x55a1cbe342f0 2024-05-14T15:23:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.918+0000 7ff2b07a9740 10 client.35399 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:23:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.918+0000 7ff2b07a9740 10 client.35399 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.918+0000 7ff2b07a9740 20 client.35399 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.918+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/601106900 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a1cc282bd0 0x55a1cc284ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.918+0000 7ff2b07a9740 4 client.35399 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:23:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.918+0000 7ff2b07a9740 1 -- 172.21.15.69:0/601106900 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a1cc16afd0 con 0x55a1cc282bd0 2024-05-14T15:23:45.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.919+0000 7ff2a2000640 1 --2- 172.21.15.69:0/601106900 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a1cc282bd0 0x55a1cc284ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.919+0000 7ff2a2000640 1 --2- 172.21.15.69:0/601106900 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a1cc282bd0 0x55a1cc284ff0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34be8944bf53bd0 server_cookie=9d55862dbe64c03a in_seq=0 out_seq=0 2024-05-14T15:23:45.920 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.919+0000 7ff28cc00640 10 client.35399 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.959+0000 7ff28cc00640 1 -- 172.21.15.69:0/601106900 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a1cc16afd0 con 0x55a1cc282bd0 2024-05-14T15:23:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.960+0000 7ff28cc00640 10 client.35399 handle_command_reply: tid=0 2024-05-14T15:23:45.960 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.960+0000 7ff2b07a9740 1 client.35399 shutdown 2024-05-14T15:23:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.960+0000 7ff2b07a9740 1 -- 172.21.15.69:0/601106900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe342f0 msgr2=0x55a1cc20bef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.960+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/601106900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe342f0 0x55a1cc20bef0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55a1cc215840 tx=0x7ff29400b720 comp rx=0 tx=0).stop 2024-05-14T15:23:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.960+0000 7ff2b07a9740 1 -- 172.21.15.69:0/601106900 shutdown_connections 2024-05-14T15:23:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.960+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/601106900 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a1cc282bd0 0x55a1cc284ff0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.960+0000 7ff28cc00640 0 client.35399 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.960+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/601106900 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1cbe3c4d0 0x55a1cc20c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.960+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/601106900 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1cbe342f0 0x55a1cc20bef0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.960+0000 7ff2b07a9740 1 --2- 172.21.15.69:0/601106900 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1cbdf11c0 0x55a1cc20b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.961 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.960+0000 7ff2b07a9740 1 -- 172.21.15.69:0/601106900 >> 172.21.15.69:0/601106900 conn(0x55a1cbe51300 msgr2=0x55a1cc1f9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.960+0000 7ff2b07a9740 1 -- 172.21.15.69:0/601106900 shutdown_connections 2024-05-14T15:23:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.960+0000 7ff2b07a9740 1 -- 172.21.15.69:0/601106900 wait complete. 2024-05-14T15:23:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.961+0000 7ff2b07a9740 20 client.35399 trim_cache size 0 max 16384 2024-05-14T15:23:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:23:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:23:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:23:45.962 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:23:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.962+0000 7ff2a3e00640 1 -- 172.21.15.69:0/3794799937 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff2880b2ae0 msgr2=0x7ff2880b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.962+0000 7ff2a3e00640 1 --2- 172.21.15.69:0/3794799937 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff2880b2ae0 0x7ff2880b4ff0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ff29c009620 tx=0x7ff29c040000 comp rx=0 tx=0).stop 2024-05-14T15:23:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.962+0000 7ff2a3e00640 1 -- 172.21.15.69:0/3794799937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2a4109f60 msgr2=0x7ff2a4111bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.962+0000 7ff2a3e00640 1 --2- 172.21.15.69:0/3794799937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2a4109f60 0x7ff2a4111bd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7ff29c031040 tx=0x7ff29c032bc0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.962+0000 7ff2a3e00640 1 -- 172.21.15.69:0/3794799937 shutdown_connections 2024-05-14T15:23:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.962+0000 7ff2a3e00640 1 --2- 172.21.15.69:0/3794799937 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff2880b2ae0 0x7ff2880b4ff0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.962+0000 7ff2a3e00640 1 --2- 172.21.15.69:0/3794799937 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff2a4109f60 0x7ff2a4111bd0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.962+0000 7ff2a3e00640 1 --2- 172.21.15.69:0/3794799937 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff2a4109ac0 0x7ff2a4111690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.962+0000 7ff2a3e00640 1 --2- 172.21.15.69:0/3794799937 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff2a4104210 0x7ff2a4111150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.962+0000 7ff2a3e00640 1 -- 172.21.15.69:0/3794799937 >> 172.21.15.69:0/3794799937 conn(0x7ff2a4079150 msgr2=0x7ff2a4101000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.963+0000 7ff2a3e00640 1 -- 172.21.15.69:0/3794799937 shutdown_connections 2024-05-14T15:23:45.964 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:45.963+0000 7ff2a3e00640 1 -- 172.21.15.69:0/3794799937 wait complete. 2024-05-14T15:23:46.062 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:23:46.730 INFO:teuthology.orchestra.run.smithi069.stderr:1400000 of 3200000 tuples (43%) done (elapsed 52.34 s, remaining 67.29 s) 2024-05-14T15:23:47.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:47 smithi203 ceph-mon[34567]: pgmap v67: 129 pgs: 129 active+clean; 353 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.9 MiB/s wr, 19 op/s 2024-05-14T15:23:47.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:47 smithi092 ceph-mon[34729]: pgmap v67: 129 pgs: 129 active+clean; 353 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.9 MiB/s wr, 19 op/s 2024-05-14T15:23:47.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:47 smithi069 ceph-mon[31270]: pgmap v67: 129 pgs: 129 active+clean; 353 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.9 MiB/s wr, 19 op/s 2024-05-14T15:23:48.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.624+0000 7fae14600700 1 -- 172.21.15.69:0/3016352842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae0c108f20 msgr2=0x7fae0c109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.624+0000 7fae14600700 1 --2- 172.21.15.69:0/3016352842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae0c108f20 0x7fae0c109330 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fadf80099c0 tx=0x7fadf8009cd0 comp rx=0 tx=0).stop 2024-05-14T15:23:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.624+0000 7fae14600700 1 -- 172.21.15.69:0/3016352842 shutdown_connections 2024-05-14T15:23:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.624+0000 7fae14600700 1 --2- 172.21.15.69:0/3016352842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae0c109870 0x7fae0c1111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.624+0000 7fae14600700 1 --2- 172.21.15.69:0/3016352842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae0c1045f0 0x7fae0c104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.624+0000 7fae14600700 1 --2- 172.21.15.69:0/3016352842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae0c108f20 0x7fae0c109330 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.624+0000 7fae14600700 1 -- 172.21.15.69:0/3016352842 >> 172.21.15.69:0/3016352842 conn(0x7fae0c100040 msgr2=0x7fae0c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.625+0000 7fae14600700 1 -- 172.21.15.69:0/3016352842 shutdown_connections 2024-05-14T15:23:48.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.625+0000 7fae14600700 1 -- 172.21.15.69:0/3016352842 wait complete. 2024-05-14T15:23:48.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.626+0000 7fae14600700 1 Processor -- start 2024-05-14T15:23:48.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.626+0000 7fae14600700 1 -- start start 2024-05-14T15:23:48.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.627+0000 7fae14600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae0c1045f0 0x7fae0c19d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:48.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.627+0000 7fae14600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae0c108f20 0x7fae0c19d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:48.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.627+0000 7fae14600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae0c109870 0x7fae0c1a1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:48.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.627+0000 7fae14600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c1143f0 con 0x7fae0c108f20 2024-05-14T15:23:48.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.627+0000 7fae14600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c114270 con 0x7fae0c109870 2024-05-14T15:23:48.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.627+0000 7fae14600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fae0c114570 con 0x7fae0c1045f0 2024-05-14T15:23:48.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.627+0000 7fae11200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae0c108f20 0x7fae0c19d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:48.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.627+0000 7fae11200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae0c108f20 0x7fae0c19d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38930/0 (socket says 172.21.15.69:38930) 2024-05-14T15:23:48.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.627+0000 7fae11200700 1 -- 172.21.15.69:0/3124244357 learned_addr learned my addr 172.21.15.69:0/3124244357 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:48.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.627+0000 7fae11c00700 1 --2- 172.21.15.69:0/3124244357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae0c1045f0 0x7fae0c19d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:48.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.628+0000 7fae12600700 1 --2- 172.21.15.69:0/3124244357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae0c109870 0x7fae0c1a1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:48.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.628+0000 7fae11200700 1 -- 172.21.15.69:0/3124244357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae0c1045f0 msgr2=0x7fae0c19d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:48.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.628+0000 7fae11200700 1 --2- 172.21.15.69:0/3124244357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae0c1045f0 0x7fae0c19d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:48.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.628+0000 7fae11200700 1 -- 172.21.15.69:0/3124244357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae0c109870 msgr2=0x7fae0c1a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:48.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.628+0000 7fae11200700 1 --2- 172.21.15.69:0/3124244357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae0c109870 0x7fae0c1a1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:48.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.628+0000 7fae11200700 1 -- 172.21.15.69:0/3124244357 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae0c1a1fb0 con 0x7fae0c108f20 2024-05-14T15:23:48.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.628+0000 7fae11200700 1 --2- 172.21.15.69:0/3124244357 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae0c108f20 0x7fae0c19d680 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fadf800b580 tx=0x7fadf80057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:48.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.629+0000 7fae0a000700 1 -- 172.21.15.69:0/3124244357 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8027070 con 0x7fae0c108f20 2024-05-14T15:23:48.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.629+0000 7fae0a000700 1 -- 172.21.15.69:0/3124244357 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fadf800fc80 con 0x7fae0c108f20 2024-05-14T15:23:48.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.629+0000 7fae14600700 1 -- 172.21.15.69:0/3124244357 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae0c1a2240 con 0x7fae0c108f20 2024-05-14T15:23:48.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.629+0000 7fae0a000700 1 -- 172.21.15.69:0/3124244357 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf8022d70 con 0x7fae0c108f20 2024-05-14T15:23:48.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.629+0000 7fae14600700 1 -- 172.21.15.69:0/3124244357 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae0c1a9bc0 con 0x7fae0c108f20 2024-05-14T15:23:48.632 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.630+0000 7fae14600700 1 -- 172.21.15.69:0/3124244357 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae0c0512c0 con 0x7fae0c108f20 2024-05-14T15:23:48.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.633+0000 7fae0a000700 1 -- 172.21.15.69:0/3124244357 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fadf8022500 con 0x7fae0c108f20 2024-05-14T15:23:48.636 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.635+0000 7fae0a000700 1 --2- 172.21.15.69:0/3124244357 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fadf40b2a70 0x7fadf40b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:48.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.635+0000 7fae0a000700 1 -- 172.21.15.69:0/3124244357 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fadf80e3a70 con 0x7fae0c108f20 2024-05-14T15:23:48.637 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.636+0000 7fae11c00700 1 --2- 172.21.15.69:0/3124244357 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fadf40b2a70 0x7fadf40b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:48.638 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.637+0000 7fae11c00700 1 --2- 172.21.15.69:0/3124244357 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fadf40b2a70 0x7fadf40b4f80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fae0000a400 tx=0x7fae0000d040 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:48.640 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.639+0000 7fae0a000700 1 -- 172.21.15.69:0/3124244357 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fadf8013070 con 0x7fae0c108f20 2024-05-14T15:23:48.972 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.970+0000 7fae14600700 1 -- 172.21.15.69:0/3124244357 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae0c1a9d90 con 0x7fae0c108f20 2024-05-14T15:23:48.973 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.972+0000 7fae0a000700 1 -- 172.21.15.69:0/3124244357 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11945 (secure 0 0 0) 0x7fadf80ab0d0 con 0x7fae0c108f20 2024-05-14T15:23:48.974 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:23:48.974 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T15:16:11.716543+0000","modified":"2024-05-14T15:23:33.337258+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34490,"mds_1":34460,"mds_2":34433,"mds_3":34409,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":31,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":35,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34490":{"gid":34490,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34490,"qdb_cluster":[34433,24451,34409,34490,34460]},"id":1}]} 2024-05-14T15:23:48.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.975+0000 7fae14600700 1 -- 172.21.15.69:0/3124244357 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fadf40b2a70 msgr2=0x7fadf40b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:48.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.975+0000 7fae14600700 1 --2- 172.21.15.69:0/3124244357 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fadf40b2a70 0x7fadf40b4f80 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fae0000a400 tx=0x7fae0000d040 comp rx=0 tx=0).stop 2024-05-14T15:23:48.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.975+0000 7fae14600700 1 -- 172.21.15.69:0/3124244357 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae0c108f20 msgr2=0x7fae0c19d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:48.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.975+0000 7fae14600700 1 --2- 172.21.15.69:0/3124244357 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae0c108f20 0x7fae0c19d680 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fadf800b580 tx=0x7fadf80057c0 comp rx=0 tx=0).stop 2024-05-14T15:23:48.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.975+0000 7fae14600700 1 -- 172.21.15.69:0/3124244357 shutdown_connections 2024-05-14T15:23:48.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.975+0000 7fae14600700 1 --2- 172.21.15.69:0/3124244357 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fadf40b2a70 0x7fadf40b4f80 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:48.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.975+0000 7fae14600700 1 --2- 172.21.15.69:0/3124244357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae0c109870 0x7fae0c1a1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:48.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.975+0000 7fae14600700 1 --2- 172.21.15.69:0/3124244357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae0c1045f0 0x7fae0c19d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:48.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.975+0000 7fae14600700 1 --2- 172.21.15.69:0/3124244357 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae0c108f20 0x7fae0c19d680 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:48.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.975+0000 7fae14600700 1 -- 172.21.15.69:0/3124244357 >> 172.21.15.69:0/3124244357 conn(0x7fae0c100040 msgr2=0x7fae0c10a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:48.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.976+0000 7fae14600700 1 -- 172.21.15.69:0/3124244357 shutdown_connections 2024-05-14T15:23:48.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:48.976+0000 7fae14600700 1 -- 172.21.15.69:0/3124244357 wait complete. 2024-05-14T15:23:48.979 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 35 2024-05-14T15:23:49.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:49 smithi069 ceph-mon[31270]: pgmap v68: 129 pgs: 129 active+clean; 353 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.9 MiB/s wr, 18 op/s 2024-05-14T15:23:49.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:49 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3124244357' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:23:49.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:49 smithi203 ceph-mon[34567]: pgmap v68: 129 pgs: 129 active+clean; 353 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.9 MiB/s wr, 18 op/s 2024-05-14T15:23:49.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:49 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3124244357' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:23:49.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:49 smithi092 ceph-mon[34729]: pgmap v68: 129 pgs: 129 active+clean; 353 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 8.9 MiB/s wr, 18 op/s 2024-05-14T15:23:49.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:49 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3124244357' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:23:49.982 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-14T15:23:50.029 INFO:teuthology.orchestra.run.smithi069.stderr:1500000 of 3200000 tuples (46%) done (elapsed 55.64 s, remaining 63.06 s) 2024-05-14T15:23:50.470 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:23:51.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:51 smithi203 ceph-mon[34567]: pgmap v69: 129 pgs: 129 active+clean; 393 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 31 op/s 2024-05-14T15:23:51.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:51 smithi092 ceph-mon[34729]: pgmap v69: 129 pgs: 129 active+clean; 393 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 31 op/s 2024-05-14T15:23:51.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:51 smithi069 ceph-mon[31270]: pgmap v69: 129 pgs: 129 active+clean; 393 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 15 MiB/s wr, 31 op/s 2024-05-14T15:23:53.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.027+0000 7f5b73e00700 1 -- 172.21.15.69:0/3079015607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b6c105e70 msgr2=0x7f5b6c10e3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:53.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.027+0000 7f5b73e00700 1 --2- 172.21.15.69:0/3079015607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b6c105e70 0x7f5b6c10e3c0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f5b58009990 tx=0x7f5b58009ca0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.027+0000 7f5b73e00700 1 -- 172.21.15.69:0/3079015607 shutdown_connections 2024-05-14T15:23:53.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.027+0000 7f5b73e00700 1 --2- 172.21.15.69:0/3079015607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b6c10e900 0x7f5b6c110dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.027+0000 7f5b73e00700 1 --2- 172.21.15.69:0/3079015607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b6c105520 0x7f5b6c105930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.027+0000 7f5b73e00700 1 --2- 172.21.15.69:0/3079015607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b6c105e70 0x7f5b6c10e3c0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.027+0000 7f5b73e00700 1 -- 172.21.15.69:0/3079015607 >> 172.21.15.69:0/3079015607 conn(0x7f5b6c0fedc0 msgr2=0x7f5b6c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:53.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.028+0000 7f5b73e00700 1 -- 172.21.15.69:0/3079015607 shutdown_connections 2024-05-14T15:23:53.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.028+0000 7f5b73e00700 1 -- 172.21.15.69:0/3079015607 wait complete. 2024-05-14T15:23:53.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.029+0000 7f5b73e00700 1 Processor -- start 2024-05-14T15:23:53.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.029+0000 7f5b73e00700 1 -- start start 2024-05-14T15:23:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.029+0000 7f5b73e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b6c105520 0x7f5b6c1a09a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.029+0000 7f5b73e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b6c105e70 0x7f5b6c1a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.030+0000 7f5b73e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b6c10e900 0x7f5b6c19ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.030+0000 7f5b73e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1142f0 con 0x7f5b6c105e70 2024-05-14T15:23:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.030+0000 7f5b73e00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c114170 con 0x7f5b6c105520 2024-05-14T15:23:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.030+0000 7f5b73e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c114470 con 0x7f5b6c10e900 2024-05-14T15:23:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.030+0000 7f5b70a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b6c105e70 0x7f5b6c1a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.030+0000 7f5b70a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b6c105e70 0x7f5b6c1a0ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54494/0 (socket says 172.21.15.69:54494) 2024-05-14T15:23:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.030+0000 7f5b70a00700 1 -- 172.21.15.69:0/2704884849 learned_addr learned my addr 172.21.15.69:0/2704884849 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.030+0000 7f5b71400700 1 --2- 172.21.15.69:0/2704884849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b6c105520 0x7f5b6c1a09a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.030+0000 7f5b71e00700 1 --2- 172.21.15.69:0/2704884849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b6c10e900 0x7f5b6c19ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.030+0000 7f5b70a00700 1 -- 172.21.15.69:0/2704884849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b6c10e900 msgr2=0x7f5b6c19ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:53.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.030+0000 7f5b70a00700 1 --2- 172.21.15.69:0/2704884849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b6c10e900 0x7f5b6c19ab30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.030+0000 7f5b70a00700 1 -- 172.21.15.69:0/2704884849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b6c105520 msgr2=0x7f5b6c1a09a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:53.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.030+0000 7f5b70a00700 1 --2- 172.21.15.69:0/2704884849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b6c105520 0x7f5b6c1a09a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.030+0000 7f5b70a00700 1 -- 172.21.15.69:0/2704884849 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b6c19b260 con 0x7f5b6c105e70 2024-05-14T15:23:53.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.031+0000 7f5b71400700 1 --2- 172.21.15.69:0/2704884849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b6c105520 0x7f5b6c1a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:23:53.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.031+0000 7f5b70a00700 1 --2- 172.21.15.69:0/2704884849 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b6c105e70 0x7f5b6c1a0ee0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5b58000c00 tx=0x7f5b580047b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:53.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.031+0000 7f5b6a000700 1 -- 172.21.15.69:0/2704884849 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b58027070 con 0x7f5b6c105e70 2024-05-14T15:23:53.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.031+0000 7f5b6a000700 1 -- 172.21.15.69:0/2704884849 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b5800fdb0 con 0x7f5b6c105e70 2024-05-14T15:23:53.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.031+0000 7f5b6a000700 1 -- 172.21.15.69:0/2704884849 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b580173f0 con 0x7f5b6c105e70 2024-05-14T15:23:53.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.031+0000 7f5b73e00700 1 -- 172.21.15.69:0/2704884849 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b6c19b4f0 con 0x7f5b6c105e70 2024-05-14T15:23:53.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.032+0000 7f5b73e00700 1 -- 172.21.15.69:0/2704884849 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b6c1a7750 con 0x7f5b6c105e70 2024-05-14T15:23:53.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.036+0000 7f5b6a000700 1 -- 172.21.15.69:0/2704884849 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f5b5802a070 con 0x7f5b6c105e70 2024-05-14T15:23:53.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.037+0000 7f5b8289cb80 1 Processor -- start 2024-05-14T15:23:53.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.037+0000 7f5b8289cb80 1 -- start start 2024-05-14T15:23:53.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.038+0000 7f5b8289cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56493362ae40 0x5649337b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.038+0000 7f5b8289cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337b2fb0 0x5649337acb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.038+0000 7f5b8289cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5649337ad060 0x5649337ad470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.038+0000 7f5b8289cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5649336caa20 con 0x56493362ae40 2024-05-14T15:23:53.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.038+0000 7f5b8289cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564933668760 con 0x5649337b2fb0 2024-05-14T15:23:53.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.038+0000 7f5b8289cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5649336c69e0 con 0x5649337ad060 2024-05-14T15:23:53.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.038+0000 7f5b71e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56493362ae40 0x5649337b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.038+0000 7f5b71e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56493362ae40 0x5649337b2a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54510/0 (socket says 172.21.15.69:54510) 2024-05-14T15:23:53.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.038+0000 7f5b71e00700 1 -- 172.21.15.69:0/1721649126 learned_addr learned my addr 172.21.15.69:0/1721649126 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:53.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.038+0000 7f5b71400700 1 --2- 172.21.15.69:0/1721649126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337b2fb0 0x5649337acb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.038+0000 7f5b6a000700 1 --2- 172.21.15.69:0/2704884849 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5b540b2a70 0x7f5b540b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.038+0000 7f5b70a00700 1 --2- 172.21.15.69:0/1721649126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5649337ad060 0x5649337ad470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.039+0000 7f5b71e00700 1 -- 172.21.15.69:0/1721649126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5649337ad060 msgr2=0x5649337ad470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:53.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.039+0000 7f5b71e00700 1 --2- 172.21.15.69:0/1721649126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5649337ad060 0x5649337ad470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.039+0000 7f5b71e00700 1 -- 172.21.15.69:0/1721649126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337b2fb0 msgr2=0x5649337acb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:53.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.039+0000 7f5b71e00700 1 --2- 172.21.15.69:0/1721649126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337b2fb0 0x5649337acb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.039+0000 7f5b71e00700 1 -- 172.21.15.69:0/1721649126 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649336178d0 con 0x56493362ae40 2024-05-14T15:23:53.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.039+0000 7f5b6a000700 1 -- 172.21.15.69:0/2704884849 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5b580e3c60 con 0x7f5b6c105e70 2024-05-14T15:23:53.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.039+0000 7f5b71e00700 1 --2- 172.21.15.69:0/2704884849 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5b540b2a70 0x7f5b540b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.039+0000 7f5b71e00700 1 --2- 172.21.15.69:0/1721649126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56493362ae40 0x5649337b2a70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5b64008650 tx=0x7f5b64008960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4025118082ad190a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:53.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.040+0000 7f5b5ea00700 1 -- 172.21.15.69:0/1721649126 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64022440 con 0x56493362ae40 2024-05-14T15:23:53.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.040+0000 7f5b5ea00700 1 -- 172.21.15.69:0/1721649126 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b64022a70 con 0x56493362ae40 2024-05-14T15:23:53.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.040+0000 7f5b5ea00700 1 -- 172.21.15.69:0/1721649126 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b640207e0 con 0x56493362ae40 2024-05-14T15:23:53.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.040+0000 7f5b71e00700 1 --2- 172.21.15.69:0/2704884849 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5b540b2a70 0x7f5b540b4f80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5b6401f000 tx=0x7f5b64018000 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:53.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.041+0000 7f5b8289cb80 1 -- 172.21.15.69:0/1721649126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56493362ae40 msgr2=0x5649337b2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:53.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.041+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/1721649126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56493362ae40 0x5649337b2a70 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f5b64008650 tx=0x7f5b64008960 comp rx=0 tx=0).stop 2024-05-14T15:23:53.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.042+0000 7f5b8289cb80 1 -- 172.21.15.69:0/1721649126 shutdown_connections 2024-05-14T15:23:53.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.042+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/1721649126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56493362ae40 0x5649337b2a70 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.042+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/1721649126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5649337ad060 0x5649337ad470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.042+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/1721649126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337b2fb0 0x5649337acb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.042+0000 7f5b8289cb80 1 -- 172.21.15.69:0/1721649126 >> 172.21.15.69:0/1721649126 conn(0x564933669a80 msgr2=0x5649337a3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:53.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.042+0000 7f5b8289cb80 1 -- 172.21.15.69:0/1721649126 shutdown_connections 2024-05-14T15:23:53.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.042+0000 7f5b8289cb80 1 -- 172.21.15.69:0/1721649126 wait complete. 2024-05-14T15:23:53.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.043+0000 7f5b8289cb80 1 -- start start 2024-05-14T15:23:53.044 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.043+0000 7f5b8289cb80 1 Processor -- start 2024-05-14T15:23:53.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.043+0000 7f5b8289cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56493362ae40 0x5649337b6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.043+0000 7f5b8289cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337ad060 0x5649337b6d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.043+0000 7f5b8289cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5649337b2fb0 0x5649337b7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.043+0000 7f5b8289cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5649337b9ab0 con 0x56493362ae40 2024-05-14T15:23:53.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.043+0000 7f5b8289cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564933630b20 con 0x5649337ad060 2024-05-14T15:23:53.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.043+0000 7f5b8289cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5649337b9c30 con 0x5649337b2fb0 2024-05-14T15:23:53.045 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.044+0000 7f5b8289cb80 10 client.0 _ll_register_callbacks cb 0x56493365e380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:53.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.044+0000 7f5b71400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56493362ae40 0x5649337b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.044+0000 7f5b71400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56493362ae40 0x5649337b6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54526/0 (socket says 172.21.15.69:54526) 2024-05-14T15:23:53.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.044+0000 7f5b71400700 1 -- 172.21.15.69:0/2628407300 learned_addr learned my addr 172.21.15.69:0/2628407300 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:53.046 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.044+0000 7f5b70a00700 1 --2- 172.21.15.69:0/2628407300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337ad060 0x5649337b6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.044+0000 7f5b71e00700 1 --2- 172.21.15.69:0/2628407300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5649337b2fb0 0x5649337b7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.045+0000 7f5b71400700 1 -- 172.21.15.69:0/2628407300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5649337b2fb0 msgr2=0x5649337b7280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:53.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.045+0000 7f5b71400700 1 --2- 172.21.15.69:0/2628407300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5649337b2fb0 0x5649337b7280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.045+0000 7f5b71400700 1 -- 172.21.15.69:0/2628407300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337ad060 msgr2=0x5649337b6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:53.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.045+0000 7f5b71400700 1 --2- 172.21.15.69:0/2628407300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337ad060 0x5649337b6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.045+0000 7f5b71400700 1 -- 172.21.15.69:0/2628407300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564933690420 con 0x56493362ae40 2024-05-14T15:23:53.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.045+0000 7f5b70a00700 1 --2- 172.21.15.69:0/2628407300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337ad060 0x5649337b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:23:53.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.045+0000 7f5b71400700 1 --2- 172.21.15.69:0/2628407300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56493362ae40 0x5649337b6800 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5b60011a60 tx=0x7f5b60011d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=267bc03d7325b50d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:53.047 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.045+0000 7f5b53400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:53.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.045+0000 7f5b53400700 1 -- 172.21.15.69:0/2628407300 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b6000fcc0 con 0x56493362ae40 2024-05-14T15:23:53.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.045+0000 7f5b8289cb80 1 -- 172.21.15.69:0/2628407300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b64022a70 con 0x56493362ae40 2024-05-14T15:23:53.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.045+0000 7f5b53400700 1 -- 172.21.15.69:0/2628407300 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5b60004830 con 0x56493362ae40 2024-05-14T15:23:53.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.046+0000 7f5b53400700 1 -- 172.21.15.69:0/2628407300 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5b60023050 con 0x56493362ae40 2024-05-14T15:23:53.048 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.046+0000 7f5b8289cb80 10 client.15846 fetch_fsmap learned FSMap version 35 2024-05-14T15:23:53.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.046+0000 7f5b8289cb80 1 -- 172.21.15.69:0/2628407300 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x5649337c4740 con 0x56493362ae40 2024-05-14T15:23:53.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.046+0000 7f5b53400700 1 -- 172.21.15.69:0/2628407300 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b64022a70 con 0x56493362ae40 2024-05-14T15:23:53.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.046+0000 7f5b53400700 1 -- 172.21.15.69:0/2628407300 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f5b60018030 con 0x56493362ae40 2024-05-14T15:23:53.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.046+0000 7f5b8289cb80 10 client.15846 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:23:53.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.046+0000 7f5b8289cb80 10 client.15846 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.i 2024-05-14T15:23:53.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.047+0000 7f5b8289cb80 20 client.15846 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:53.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.047+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/2628407300 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x5649337c6cd0 0x5649337c9170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.047+0000 7f5b8289cb80 4 client.15846 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:23:53.049 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.047+0000 7f5b8289cb80 1 -- 172.21.15.69:0/2628407300 --> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564933775070 con 0x5649337c6cd0 2024-05-14T15:23:53.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.047+0000 7f5b70a00700 1 --2- 172.21.15.69:0/2628407300 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x5649337c6cd0 0x5649337c9170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.048+0000 7f5b70a00700 1 --2- 172.21.15.69:0/2628407300 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x5649337c6cd0 0x5649337c9170 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8033ebbd20a62aae server_cookie=933e3d0a693c671d in_seq=0 out_seq=0 2024-05-14T15:23:53.050 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.048+0000 7f5b53400700 10 client.15846 ms_handle_connect on v2:172.21.15.203:6838/3167469844 2024-05-14T15:23:53.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.050+0000 7f5b53400700 1 -- 172.21.15.69:0/2628407300 <== mds.4 v2:172.21.15.203:6838/3167469844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564933775070 con 0x5649337c6cd0 2024-05-14T15:23:53.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.050+0000 7f5b53400700 10 client.15846 handle_command_reply: tid=0 2024-05-14T15:23:53.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.050+0000 7f5b8289cb80 1 client.15846 shutdown 2024-05-14T15:23:53.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.051+0000 7f5b8289cb80 1 -- 172.21.15.69:0/2628407300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56493362ae40 msgr2=0x5649337b6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:53.052 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.051+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/2628407300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56493362ae40 0x5649337b6800 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f5b60011a60 tx=0x7f5b60011d70 comp rx=0 tx=0).stop 2024-05-14T15:23:53.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.051+0000 7f5b8289cb80 1 -- 172.21.15.69:0/2628407300 shutdown_connections 2024-05-14T15:23:53.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.051+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/2628407300 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x5649337c6cd0 0x5649337c9170 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.051+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/2628407300 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56493362ae40 0x5649337b6800 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.051+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/2628407300 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5649337b2fb0 0x5649337b7280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.051+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/2628407300 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337ad060 0x5649337b6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.051+0000 7f5b53400700 0 client.15846 ms_handle_reset on v2:172.21.15.203:6838/3167469844 2024-05-14T15:23:53.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.051+0000 7f5b8289cb80 1 -- 172.21.15.69:0/2628407300 >> 172.21.15.69:0/2628407300 conn(0x564933669a80 msgr2=0x5649337a7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:53.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.051+0000 7f5b8289cb80 1 -- 172.21.15.69:0/2628407300 shutdown_connections 2024-05-14T15:23:53.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.051+0000 7f5b8289cb80 1 -- 172.21.15.69:0/2628407300 wait complete. 2024-05-14T15:23:53.053 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.051+0000 7f5b8289cb80 20 client.15846 trim_cache size 0 max 16384 2024-05-14T15:23:53.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.074+0000 7f5b8289cb80 1 Processor -- start 2024-05-14T15:23:53.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.074+0000 7f5b8289cb80 1 -- start start 2024-05-14T15:23:53.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.074+0000 7f5b8289cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56493362ae40 0x5649337b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.074+0000 7f5b8289cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5649337ad060 0x5649337c2b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.074+0000 7f5b8289cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5649337b2fb0 0x5649337b67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.075+0000 7f5b8289cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1ae370 con 0x5649337ad060 2024-05-14T15:23:53.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.075+0000 7f5b8289cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1b0030 con 0x56493362ae40 2024-05-14T15:23:53.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.075+0000 7f5b8289cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1aea40 con 0x5649337b2fb0 2024-05-14T15:23:53.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.075+0000 7f5b70a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5649337ad060 0x5649337c2b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.075+0000 7f5b70a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5649337ad060 0x5649337c2b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54536/0 (socket says 172.21.15.69:54536) 2024-05-14T15:23:53.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.075+0000 7f5b70a00700 1 -- 172.21.15.69:0/1045910671 learned_addr learned my addr 172.21.15.69:0/1045910671 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:53.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.075+0000 7f5b71400700 1 --2- 172.21.15.69:0/1045910671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56493362ae40 0x5649337b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.075+0000 7f5b71e00700 1 --2- 172.21.15.69:0/1045910671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5649337b2fb0 0x5649337b67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.076+0000 7f5b70a00700 1 -- 172.21.15.69:0/1045910671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5649337b2fb0 msgr2=0x5649337b67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:53.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.076+0000 7f5b70a00700 1 --2- 172.21.15.69:0/1045910671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5649337b2fb0 0x5649337b67c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.076+0000 7f5b70a00700 1 -- 172.21.15.69:0/1045910671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56493362ae40 msgr2=0x5649337b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:53.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.076+0000 7f5b70a00700 1 --2- 172.21.15.69:0/1045910671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56493362ae40 0x5649337b20b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.076+0000 7f5b70a00700 1 -- 172.21.15.69:0/1045910671 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5649337b4d70 con 0x5649337ad060 2024-05-14T15:23:53.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.076+0000 7f5b70a00700 1 --2- 172.21.15.69:0/1045910671 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5649337ad060 0x5649337c2b40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5b580aa8c0 tx=0x7f5b580a7210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac0876c58f3c233e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:53.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.076+0000 7f5b5e000700 1 -- 172.21.15.69:0/1045910671 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b580aa6d0 con 0x5649337ad060 2024-05-14T15:23:53.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.076+0000 7f5b5e000700 1 -- 172.21.15.69:0/1045910671 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b580ab2c0 con 0x5649337ad060 2024-05-14T15:23:53.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.077+0000 7f5b5e000700 1 -- 172.21.15.69:0/1045910671 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b580aae20 con 0x5649337ad060 2024-05-14T15:23:53.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.078+0000 7f5b8289cb80 1 -- 172.21.15.69:0/1045910671 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5649337ad060 msgr2=0x5649337c2b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:53.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.078+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/1045910671 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5649337ad060 0x5649337c2b40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f5b580aa8c0 tx=0x7f5b580a7210 comp rx=0 tx=0).stop 2024-05-14T15:23:53.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.078+0000 7f5b8289cb80 1 -- 172.21.15.69:0/1045910671 shutdown_connections 2024-05-14T15:23:53.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.078+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/1045910671 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5649337b2fb0 0x5649337b67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.078+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/1045910671 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56493362ae40 0x5649337b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.078+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/1045910671 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5649337ad060 0x5649337c2b40 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.078+0000 7f5b8289cb80 1 -- 172.21.15.69:0/1045910671 >> 172.21.15.69:0/1045910671 conn(0x564933669a80 msgr2=0x5649337b19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:53.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.078+0000 7f5b8289cb80 1 -- 172.21.15.69:0/1045910671 shutdown_connections 2024-05-14T15:23:53.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.078+0000 7f5b8289cb80 1 -- 172.21.15.69:0/1045910671 wait complete. 2024-05-14T15:23:53.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.078+0000 7f5b8289cb80 1 -- start start 2024-05-14T15:23:53.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.079+0000 7f5b8289cb80 1 Processor -- start 2024-05-14T15:23:53.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.079+0000 7f5b8289cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56493362ae40 0x5649337ce150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.079+0000 7f5b8289cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337b2fb0 0x5649337ce690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.079+0000 7f5b8289cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5649337cebd0 0x5649338304e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.079+0000 7f5b8289cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1af8a0 con 0x5649337cebd0 2024-05-14T15:23:53.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.079+0000 7f5b8289cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1af140 con 0x5649337b2fb0 2024-05-14T15:23:53.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.079+0000 7f5b8289cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6c1ac310 con 0x56493362ae40 2024-05-14T15:23:53.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.079+0000 7f5b8289cb80 10 client.0 _ll_register_callbacks cb 0x56493365e380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:53.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.080+0000 7f5b71e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5649337cebd0 0x5649338304e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.080+0000 7f5b71e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5649337cebd0 0x5649338304e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54552/0 (socket says 172.21.15.69:54552) 2024-05-14T15:23:53.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.080+0000 7f5b71e00700 1 -- 172.21.15.69:0/2607256824 learned_addr learned my addr 172.21.15.69:0/2607256824 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:53.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.080+0000 7f5b70a00700 1 --2- 172.21.15.69:0/2607256824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337b2fb0 0x5649337ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.080+0000 7f5b71400700 1 --2- 172.21.15.69:0/2607256824 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56493362ae40 0x5649337ce150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.080+0000 7f5b71e00700 1 -- 172.21.15.69:0/2607256824 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56493362ae40 msgr2=0x5649337ce150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:53.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.080+0000 7f5b71e00700 1 --2- 172.21.15.69:0/2607256824 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56493362ae40 0x5649337ce150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.080+0000 7f5b71e00700 1 -- 172.21.15.69:0/2607256824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337b2fb0 msgr2=0x5649337ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:53.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.080+0000 7f5b71e00700 1 --2- 172.21.15.69:0/2607256824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337b2fb0 0x5649337ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.080+0000 7f5b71e00700 1 -- 172.21.15.69:0/2607256824 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564933830a20 con 0x5649337cebd0 2024-05-14T15:23:53.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.081+0000 7f5b70a00700 1 --2- 172.21.15.69:0/2607256824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337b2fb0 0x5649337ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:23:53.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.081+0000 7f5b71e00700 1 --2- 172.21.15.69:0/2607256824 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5649337cebd0 0x5649338304e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5b64008620 tx=0x7f5b64008530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1372b5eb52406e2d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:53.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.081+0000 7f5b53400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:53.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.081+0000 7f5b53400700 1 -- 172.21.15.69:0/2607256824 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b64031020 con 0x5649337cebd0 2024-05-14T15:23:53.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.081+0000 7f5b53400700 1 -- 172.21.15.69:0/2607256824 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5b64020cd0 con 0x5649337cebd0 2024-05-14T15:23:53.083 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.081+0000 7f5b8289cb80 1 -- 172.21.15.69:0/2607256824 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b580ab2c0 con 0x5649337cebd0 2024-05-14T15:23:53.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.082+0000 7f5b53400700 1 -- 172.21.15.69:0/2607256824 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5b6403c050 con 0x5649337cebd0 2024-05-14T15:23:53.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.082+0000 7f5b8289cb80 10 client.15852 fetch_fsmap learned FSMap version 35 2024-05-14T15:23:53.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.082+0000 7f5b8289cb80 1 -- 172.21.15.69:0/2607256824 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x564933831ae0 con 0x5649337cebd0 2024-05-14T15:23:53.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.082+0000 7f5b53400700 1 -- 172.21.15.69:0/2607256824 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b580ab2c0 con 0x5649337cebd0 2024-05-14T15:23:53.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.082+0000 7f5b53400700 1 -- 172.21.15.69:0/2607256824 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f5b64016030 con 0x5649337cebd0 2024-05-14T15:23:53.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.082+0000 7f5b8289cb80 10 client.15852 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:23:53.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.082+0000 7f5b8289cb80 10 client.15852 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.i 2024-05-14T15:23:53.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.082+0000 7f5b8289cb80 20 client.15852 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:53.084 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.083+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/2607256824 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x5649338320b0 0x5649338344d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:53.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.083+0000 7f5b8289cb80 4 client.15852 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:23:53.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.083+0000 7f5b8289cb80 1 -- 172.21.15.69:0/2607256824 --> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5649336d8400 con 0x5649338320b0 2024-05-14T15:23:53.085 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.083+0000 7f5b71400700 1 --2- 172.21.15.69:0/2607256824 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x5649338320b0 0x5649338344d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:53.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.084+0000 7f5b53400700 10 client.15852 ms_handle_connect on v2:172.21.15.203:6838/3167469844 2024-05-14T15:23:53.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.084+0000 7f5b71400700 1 --2- 172.21.15.69:0/2607256824 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x5649338320b0 0x5649338344d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=9e406bd4b5cf9871 server_cookie=f960447058dd2bf4 in_seq=0 out_seq=0 2024-05-14T15:23:53.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.085+0000 7f5b53400700 1 -- 172.21.15.69:0/2607256824 <== mds.4 v2:172.21.15.203:6838/3167469844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5649336d8400 con 0x5649338320b0 2024-05-14T15:23:53.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.085+0000 7f5b53400700 10 client.15852 handle_command_reply: tid=0 2024-05-14T15:23:53.086 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.085+0000 7f5b8289cb80 1 client.15852 shutdown 2024-05-14T15:23:53.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.085+0000 7f5b8289cb80 1 -- 172.21.15.69:0/2607256824 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5649337cebd0 msgr2=0x5649338304e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:53.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.085+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/2607256824 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5649337cebd0 0x5649338304e0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f5b64008620 tx=0x7f5b64008530 comp rx=0 tx=0).stop 2024-05-14T15:23:53.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.085+0000 7f5b8289cb80 1 -- 172.21.15.69:0/2607256824 shutdown_connections 2024-05-14T15:23:53.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.085+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/2607256824 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x5649338320b0 0x5649338344d0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.085+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/2607256824 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5649337cebd0 0x5649338304e0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.085+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/2607256824 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56493362ae40 0x5649337ce150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.085+0000 7f5b8289cb80 1 --2- 172.21.15.69:0/2607256824 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5649337b2fb0 0x5649337ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.085+0000 7f5b53400700 0 client.15852 ms_handle_reset on v2:172.21.15.203:6838/3167469844 2024-05-14T15:23:53.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.085+0000 7f5b8289cb80 1 -- 172.21.15.69:0/2607256824 >> 172.21.15.69:0/2607256824 conn(0x564933669a80 msgr2=0x5649337a7700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:53.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.086+0000 7f5b8289cb80 1 -- 172.21.15.69:0/2607256824 shutdown_connections 2024-05-14T15:23:53.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.086+0000 7f5b8289cb80 1 -- 172.21.15.69:0/2607256824 wait complete. 2024-05-14T15:23:53.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.086+0000 7f5b8289cb80 20 client.15852 trim_cache size 0 max 16384 2024-05-14T15:23:53.088 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:23:53.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.087+0000 7f5b73e00700 1 -- 172.21.15.69:0/2704884849 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5b540b2a70 msgr2=0x7f5b540b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:53.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.087+0000 7f5b73e00700 1 --2- 172.21.15.69:0/2704884849 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5b540b2a70 0x7f5b540b4f80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5b6401f000 tx=0x7f5b64018000 comp rx=0 tx=0).stop 2024-05-14T15:23:53.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.087+0000 7f5b73e00700 1 -- 172.21.15.69:0/2704884849 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b6c105e70 msgr2=0x7f5b6c1a0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:53.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.087+0000 7f5b73e00700 1 --2- 172.21.15.69:0/2704884849 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b6c105e70 0x7f5b6c1a0ee0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f5b58000c00 tx=0x7f5b580047b0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.087+0000 7f5b73e00700 1 -- 172.21.15.69:0/2704884849 shutdown_connections 2024-05-14T15:23:53.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.087+0000 7f5b73e00700 1 --2- 172.21.15.69:0/2704884849 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5b540b2a70 0x7f5b540b4f80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.087+0000 7f5b73e00700 1 --2- 172.21.15.69:0/2704884849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b6c10e900 0x7f5b6c19ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.087+0000 7f5b73e00700 1 --2- 172.21.15.69:0/2704884849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b6c105520 0x7f5b6c1a09a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.087+0000 7f5b73e00700 1 --2- 172.21.15.69:0/2704884849 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b6c105e70 0x7f5b6c1a0ee0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:53.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.087+0000 7f5b73e00700 1 -- 172.21.15.69:0/2704884849 >> 172.21.15.69:0/2704884849 conn(0x7f5b6c0fedc0 msgr2=0x7f5b6c0ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:53.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.087+0000 7f5b73e00700 1 -- 172.21.15.69:0/2704884849 shutdown_connections 2024-05-14T15:23:53.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:53.088+0000 7f5b73e00700 1 -- 172.21.15.69:0/2704884849 wait complete. 2024-05-14T15:23:53.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:53 smithi092 ceph-mon[34729]: pgmap v70: 129 pgs: 129 active+clean; 393 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T15:23:53.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:53 smithi069 ceph-mon[31270]: pgmap v70: 129 pgs: 129 active+clean; 393 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T15:23:53.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:53 smithi203 ceph-mon[34567]: pgmap v70: 129 pgs: 129 active+clean; 393 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T15:23:53.865 INFO:teuthology.orchestra.run.smithi069.stderr:1600000 of 3200000 tuples (50%) done (elapsed 59.47 s, remaining 59.47 s) 2024-05-14T15:23:54.089 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-14T15:23:54.626 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:23:55.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:55 smithi092 ceph-mon[34729]: pgmap v71: 129 pgs: 129 active+clean; 425 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 34 op/s 2024-05-14T15:23:55.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:55 smithi069 ceph-mon[31270]: pgmap v71: 129 pgs: 129 active+clean; 425 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 34 op/s 2024-05-14T15:23:55.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:55 smithi203 ceph-mon[34567]: pgmap v71: 129 pgs: 129 active+clean; 425 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 17 MiB/s wr, 34 op/s 2024-05-14T15:23:56.528 INFO:teuthology.orchestra.run.smithi069.stderr:1700000 of 3200000 tuples (53%) done (elapsed 62.14 s, remaining 54.83 s) 2024-05-14T15:23:57.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.193+0000 7f5f66800700 1 -- 172.21.15.69:0/1764500895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f6010b8a0 msgr2=0x7f5f60113200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:57.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.193+0000 7f5f66800700 1 --2- 172.21.15.69:0/1764500895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f6010b8a0 0x7f5f60113200 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f5f5800b0d0 tx=0x7f5f5800b3e0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.193+0000 7f5f66800700 1 -- 172.21.15.69:0/1764500895 shutdown_connections 2024-05-14T15:23:57.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.193+0000 7f5f66800700 1 --2- 172.21.15.69:0/1764500895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f6010b8a0 0x7f5f60113200 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.193+0000 7f5f66800700 1 --2- 172.21.15.69:0/1764500895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f60106620 0x7f5f60106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.193+0000 7f5f66800700 1 --2- 172.21.15.69:0/1764500895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f6010af50 0x7f5f6010b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.193+0000 7f5f66800700 1 -- 172.21.15.69:0/1764500895 >> 172.21.15.69:0/1764500895 conn(0x7f5f60102030 msgr2=0x7f5f60104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:57.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.193+0000 7f5f66800700 1 -- 172.21.15.69:0/1764500895 shutdown_connections 2024-05-14T15:23:57.195 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.193+0000 7f5f66800700 1 -- 172.21.15.69:0/1764500895 wait complete. 2024-05-14T15:23:57.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.194+0000 7f5f66800700 1 Processor -- start 2024-05-14T15:23:57.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.194+0000 7f5f66800700 1 -- start start 2024-05-14T15:23:57.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.195+0000 7f5f66800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f60106620 0x7f5f6019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.195+0000 7f5f66800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f6010af50 0x7f5f6019d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.195+0000 7f5f66800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f6010b8a0 0x7f5f601a1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.196 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.195+0000 7f5f66800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5f601163d0 con 0x7f5f60106620 2024-05-14T15:23:57.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.195+0000 7f5f66800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5f60116250 con 0x7f5f6010af50 2024-05-14T15:23:57.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.195+0000 7f5f66800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5f60116550 con 0x7f5f6010b8a0 2024-05-14T15:23:57.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.195+0000 7f5f65400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f60106620 0x7f5f6019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.195+0000 7f5f65400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f60106620 0x7f5f6019cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54562/0 (socket says 172.21.15.69:54562) 2024-05-14T15:23:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.195+0000 7f5f65400700 1 -- 172.21.15.69:0/1554448047 learned_addr learned my addr 172.21.15.69:0/1554448047 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.196+0000 7f5f65e00700 1 --2- 172.21.15.69:0/1554448047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f6010b8a0 0x7f5f601a1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.196+0000 7f5f64a00700 1 --2- 172.21.15.69:0/1554448047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f6010af50 0x7f5f6019d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.196+0000 7f5f65400700 1 -- 172.21.15.69:0/1554448047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f6010b8a0 msgr2=0x7f5f601a1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.196+0000 7f5f65400700 1 --2- 172.21.15.69:0/1554448047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f6010b8a0 0x7f5f601a1570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.196+0000 7f5f65400700 1 -- 172.21.15.69:0/1554448047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f6010af50 msgr2=0x7f5f6019d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.196+0000 7f5f65400700 1 --2- 172.21.15.69:0/1554448047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f6010af50 0x7f5f6019d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.196+0000 7f5f65400700 1 -- 172.21.15.69:0/1554448047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f601a1c10 con 0x7f5f60106620 2024-05-14T15:23:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.196+0000 7f5f65400700 1 --2- 172.21.15.69:0/1554448047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f60106620 0x7f5f6019cd40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400d950 tx=0x7f5f5400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.197+0000 7f5f5e000700 1 -- 172.21.15.69:0/1554448047 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f54016070 con 0x7f5f60106620 2024-05-14T15:23:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.197+0000 7f5f5e000700 1 -- 172.21.15.69:0/1554448047 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5f5400fd20 con 0x7f5f60106620 2024-05-14T15:23:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.197+0000 7f5f66800700 1 -- 172.21.15.69:0/1554448047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f601a1f00 con 0x7f5f60106620 2024-05-14T15:23:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.197+0000 7f5f5e000700 1 -- 172.21.15.69:0/1554448047 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f5400e3b0 con 0x7f5f60106620 2024-05-14T15:23:57.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.197+0000 7f5f66800700 1 -- 172.21.15.69:0/1554448047 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f601a9820 con 0x7f5f60106620 2024-05-14T15:23:57.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.201+0000 7f5f5e000700 1 -- 172.21.15.69:0/1554448047 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f5f54019070 con 0x7f5f60106620 2024-05-14T15:23:57.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.203+0000 7f5f5e000700 1 --2- 172.21.15.69:0/1554448047 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5f480b29f0 0x7f5f480b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.204 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.203+0000 7f5f769b5b80 1 Processor -- start 2024-05-14T15:23:57.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.203+0000 7f5f5e000700 1 -- 172.21.15.69:0/1554448047 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5f540e24f0 con 0x7f5f60106620 2024-05-14T15:23:57.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.203+0000 7f5f769b5b80 1 -- start start 2024-05-14T15:23:57.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.203+0000 7f5f64a00700 1 --2- 172.21.15.69:0/1554448047 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5f480b29f0 0x7f5f480b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.204+0000 7f5f769b5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa4c3e40 0x556afa647540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.204+0000 7f5f769b5b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa647a80 0x556afa641700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.204+0000 7f5f769b5b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa641c40 0x556afa642050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.204+0000 7f5f769b5b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x556afa563a20 con 0x556afa641c40 2024-05-14T15:23:57.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.204+0000 7f5f769b5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556afa501760 con 0x556afa4c3e40 2024-05-14T15:23:57.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.204+0000 7f5f769b5b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556afa55f9e0 con 0x556afa647a80 2024-05-14T15:23:57.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.204+0000 7f5f65e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa641c40 0x556afa642050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.204+0000 7f5f64a00700 1 --2- 172.21.15.69:0/1554448047 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5f480b29f0 0x7f5f480b4f00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5f601059f0 tx=0x7f5f4c00b410 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:57.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.204+0000 7f5f65e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa641c40 0x556afa642050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54572/0 (socket says 172.21.15.69:54572) 2024-05-14T15:23:57.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.204+0000 7f5f65e00700 1 -- 172.21.15.69:0/1778278785 learned_addr learned my addr 172.21.15.69:0/1778278785 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:57.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.204+0000 7f5f65400700 1 --2- 172.21.15.69:0/1778278785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa4c3e40 0x556afa647540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.205+0000 7f5f64a00700 1 --2- 172.21.15.69:0/1778278785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa647a80 0x556afa641700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.205+0000 7f5f65e00700 1 -- 172.21.15.69:0/1778278785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa647a80 msgr2=0x556afa641700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:57.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.205+0000 7f5f65e00700 1 --2- 172.21.15.69:0/1778278785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa647a80 0x556afa641700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.205+0000 7f5f65e00700 1 -- 172.21.15.69:0/1778278785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa4c3e40 msgr2=0x556afa647540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:57.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.205+0000 7f5f65e00700 1 --2- 172.21.15.69:0/1778278785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa4c3e40 0x556afa647540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.205+0000 7f5f65e00700 1 -- 172.21.15.69:0/1778278785 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556afa4b08d0 con 0x556afa641c40 2024-05-14T15:23:57.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.205+0000 7f5f65e00700 1 --2- 172.21.15.69:0/1778278785 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa641c40 0x556afa642050 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5f58009c60 tx=0x7f5f580098c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fadf76c2de61f0d6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:57.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.206+0000 7f5f52a00700 1 -- 172.21.15.69:0/1778278785 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f580092d0 con 0x556afa641c40 2024-05-14T15:23:57.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.206+0000 7f5f52a00700 1 -- 172.21.15.69:0/1778278785 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5f58020070 con 0x556afa641c40 2024-05-14T15:23:57.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.206+0000 7f5f52a00700 1 -- 172.21.15.69:0/1778278785 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f580056e0 con 0x556afa641c40 2024-05-14T15:23:57.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.207+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1778278785 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa641c40 msgr2=0x556afa642050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:57.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.207+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/1778278785 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa641c40 0x556afa642050 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f5f58009c60 tx=0x7f5f580098c0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.207+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1778278785 shutdown_connections 2024-05-14T15:23:57.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.207+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/1778278785 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa641c40 0x556afa642050 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.207+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/1778278785 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa4c3e40 0x556afa647540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.207+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/1778278785 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa647a80 0x556afa641700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.207+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1778278785 >> 172.21.15.69:0/1778278785 conn(0x556afa508f70 msgr2=0x556afa63c400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:57.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.208+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1778278785 shutdown_connections 2024-05-14T15:23:57.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.208+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1778278785 wait complete. 2024-05-14T15:23:57.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.208+0000 7f5f769b5b80 1 -- start start 2024-05-14T15:23:57.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.209+0000 7f5f769b5b80 1 Processor -- start 2024-05-14T15:23:57.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.209+0000 7f5f769b5b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa4c3e40 0x556afa64b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.209+0000 7f5f769b5b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa641c40 0x556afa64b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.209+0000 7f5f769b5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa647a80 0x556afa64bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.209+0000 7f5f769b5b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x556afa64e490 con 0x556afa4c3e40 2024-05-14T15:23:57.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.209+0000 7f5f769b5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556afa4c9b20 con 0x556afa647a80 2024-05-14T15:23:57.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.209+0000 7f5f769b5b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556afa64e610 con 0x556afa641c40 2024-05-14T15:23:57.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.209+0000 7f5f769b5b80 10 client.0 _ll_register_callbacks cb 0x556afa50ac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:57.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.211+0000 7f5f65400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa4c3e40 0x556afa64b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.211+0000 7f5f65400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa4c3e40 0x556afa64b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54576/0 (socket says 172.21.15.69:54576) 2024-05-14T15:23:57.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.211+0000 7f5f65400700 1 -- 172.21.15.69:0/1533395056 learned_addr learned my addr 172.21.15.69:0/1533395056 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:57.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.211+0000 7f5f64a00700 1 --2- 172.21.15.69:0/1533395056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa641c40 0x556afa64b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.211+0000 7f5f65e00700 1 --2- 172.21.15.69:0/1533395056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa647a80 0x556afa64bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.211+0000 7f5f65400700 1 -- 172.21.15.69:0/1533395056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa641c40 msgr2=0x556afa64b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:57.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.211+0000 7f5f65400700 1 --2- 172.21.15.69:0/1533395056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa641c40 0x556afa64b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.211+0000 7f5f65400700 1 -- 172.21.15.69:0/1533395056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa647a80 msgr2=0x556afa64bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:57.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.211+0000 7f5f65400700 1 --2- 172.21.15.69:0/1533395056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa647a80 0x556afa64bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.211+0000 7f5f65400700 1 -- 172.21.15.69:0/1533395056 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556afa529420 con 0x556afa4c3e40 2024-05-14T15:23:57.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.211+0000 7f5f65400700 1 --2- 172.21.15.69:0/1533395056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa4c3e40 0x556afa64b1a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5f540df890 tx=0x7f5f540108d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9a96011f75f62e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:57.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.211+0000 7f5f47400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:57.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.211+0000 7f5f47400700 1 -- 172.21.15.69:0/1533395056 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f54020070 con 0x556afa4c3e40 2024-05-14T15:23:57.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.211+0000 7f5f47400700 1 -- 172.21.15.69:0/1533395056 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5f540a9620 con 0x556afa4c3e40 2024-05-14T15:23:57.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.211+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1533395056 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f58020070 con 0x556afa4c3e40 2024-05-14T15:23:57.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.212+0000 7f5f47400700 1 -- 172.21.15.69:0/1533395056 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5f540ad770 con 0x556afa4c3e40 2024-05-14T15:23:57.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.212+0000 7f5f769b5b80 10 client.15864 fetch_fsmap learned FSMap version 35 2024-05-14T15:23:57.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.212+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1533395056 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556afa659040 con 0x556afa4c3e40 2024-05-14T15:23:57.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.212+0000 7f5f47400700 1 -- 172.21.15.69:0/1533395056 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5f58020070 con 0x556afa4c3e40 2024-05-14T15:23:57.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.212+0000 7f5f47400700 1 -- 172.21.15.69:0/1533395056 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f5f540a8620 con 0x556afa4c3e40 2024-05-14T15:23:57.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.213+0000 7f5f769b5b80 10 client.15864 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:23:57.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.213+0000 7f5f769b5b80 10 client.15864 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-05-14T15:23:57.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.213+0000 7f5f769b5b80 20 client.15864 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:57.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.213+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/1533395056 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x556afa65b510 0x556afa65d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.213+0000 7f5f769b5b80 4 client.15864 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:23:57.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.213+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1533395056 --> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556afa60e1c0 con 0x556afa65b510 2024-05-14T15:23:57.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.213+0000 7f5f64a00700 1 --2- 172.21.15.69:0/1533395056 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x556afa65b510 0x556afa65d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.214+0000 7f5f64a00700 1 --2- 172.21.15.69:0/1533395056 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x556afa65b510 0x556afa65d980 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=e57aab311b134cb0 server_cookie=618a33fe6a8fadb7 in_seq=0 out_seq=0 2024-05-14T15:23:57.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.214+0000 7f5f47400700 10 client.15864 ms_handle_connect on v2:172.21.15.92:6832/1997000798 2024-05-14T15:23:57.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.216+0000 7f5f47400700 1 -- 172.21.15.69:0/1533395056 <== mds.3 v2:172.21.15.92:6832/1997000798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556afa60e1c0 con 0x556afa65b510 2024-05-14T15:23:57.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.216+0000 7f5f47400700 10 client.15864 handle_command_reply: tid=0 2024-05-14T15:23:57.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.217+0000 7f5f769b5b80 1 client.15864 shutdown 2024-05-14T15:23:57.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.217+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1533395056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa4c3e40 msgr2=0x556afa64b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:57.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.217+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/1533395056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa4c3e40 0x556afa64b1a0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f5f540df890 tx=0x7f5f540108d0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.217+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1533395056 shutdown_connections 2024-05-14T15:23:57.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.217+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/1533395056 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x556afa65b510 0x556afa65d980 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.217+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/1533395056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa4c3e40 0x556afa64b1a0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.217+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/1533395056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa647a80 0x556afa64bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.217+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/1533395056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa641c40 0x556afa64b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.217+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1533395056 >> 172.21.15.69:0/1533395056 conn(0x556afa508f70 msgr2=0x556afa6406f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:57.219 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.217+0000 7f5f47400700 0 client.15864 ms_handle_reset on v2:172.21.15.92:6832/1997000798 2024-05-14T15:23:57.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.217+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1533395056 shutdown_connections 2024-05-14T15:23:57.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.218+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1533395056 wait complete. 2024-05-14T15:23:57.220 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.218+0000 7f5f769b5b80 20 client.15864 trim_cache size 0 max 16384 2024-05-14T15:23:57.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.239+0000 7f5f769b5b80 1 Processor -- start 2024-05-14T15:23:57.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.240+0000 7f5f769b5b80 1 -- start start 2024-05-14T15:23:57.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.240+0000 7f5f769b5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa4c3e40 0x556afa641700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.240+0000 7f5f769b5b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa641c40 0x556afa646930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.240+0000 7f5f769b5b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa647a80 0x556afa657520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.240+0000 7f5f769b5b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5f601b2540 con 0x556afa647a80 2024-05-14T15:23:57.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.240+0000 7f5f769b5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5f601b4200 con 0x556afa4c3e40 2024-05-14T15:23:57.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.240+0000 7f5f769b5b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5f601b2c10 con 0x556afa641c40 2024-05-14T15:23:57.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.240+0000 7f5f65e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa647a80 0x556afa657520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.240+0000 7f5f65e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa647a80 0x556afa657520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54590/0 (socket says 172.21.15.69:54590) 2024-05-14T15:23:57.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.240+0000 7f5f65e00700 1 -- 172.21.15.69:0/3785318987 learned_addr learned my addr 172.21.15.69:0/3785318987 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:57.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.241+0000 7f5f64a00700 1 --2- 172.21.15.69:0/3785318987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa641c40 0x556afa646930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.241+0000 7f5f65e00700 1 -- 172.21.15.69:0/3785318987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa641c40 msgr2=0x556afa646930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:57.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.241+0000 7f5f65e00700 1 --2- 172.21.15.69:0/3785318987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa641c40 0x556afa646930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.241+0000 7f5f65e00700 1 -- 172.21.15.69:0/3785318987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa4c3e40 msgr2=0x556afa641700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:57.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.241+0000 7f5f65e00700 1 --2- 172.21.15.69:0/3785318987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa4c3e40 0x556afa641700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.241+0000 7f5f65e00700 1 -- 172.21.15.69:0/3785318987 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556afa64af70 con 0x556afa647a80 2024-05-14T15:23:57.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.241+0000 7f5f65e00700 1 --2- 172.21.15.69:0/3785318987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa647a80 0x556afa657520 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5f58009c90 tx=0x7f5f58000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f75cdadf04db3154 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:57.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.241+0000 7f5f52000700 1 -- 172.21.15.69:0/3785318987 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58003a00 con 0x556afa647a80 2024-05-14T15:23:57.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.242+0000 7f5f52000700 1 -- 172.21.15.69:0/3785318987 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5f58020070 con 0x556afa647a80 2024-05-14T15:23:57.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.242+0000 7f5f52000700 1 -- 172.21.15.69:0/3785318987 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f58007820 con 0x556afa647a80 2024-05-14T15:23:57.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.242+0000 7f5f769b5b80 1 -- 172.21.15.69:0/3785318987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa647a80 msgr2=0x556afa657520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:57.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.243+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/3785318987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa647a80 0x556afa657520 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f5f58009c90 tx=0x7f5f58000f40 comp rx=0 tx=0).stop 2024-05-14T15:23:57.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.243+0000 7f5f769b5b80 1 -- 172.21.15.69:0/3785318987 shutdown_connections 2024-05-14T15:23:57.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.243+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/3785318987 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa647a80 0x556afa657520 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.243+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/3785318987 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa4c3e40 0x556afa641700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.243+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/3785318987 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa641c40 0x556afa646930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.243+0000 7f5f769b5b80 1 -- 172.21.15.69:0/3785318987 >> 172.21.15.69:0/3785318987 conn(0x556afa508f70 msgr2=0x556afa646220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:57.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.243+0000 7f5f769b5b80 1 -- 172.21.15.69:0/3785318987 shutdown_connections 2024-05-14T15:23:57.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.243+0000 7f5f769b5b80 1 -- 172.21.15.69:0/3785318987 wait complete. 2024-05-14T15:23:57.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.243+0000 7f5f769b5b80 1 -- start start 2024-05-14T15:23:57.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.244+0000 7f5f769b5b80 1 Processor -- start 2024-05-14T15:23:57.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.244+0000 7f5f769b5b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa4c3e40 0x556afa663440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.244+0000 7f5f769b5b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa641c40 0x556afa6538a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.244+0000 7f5f769b5b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa647a80 0x556afa653de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.244+0000 7f5f769b5b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5f601b3a70 con 0x556afa641c40 2024-05-14T15:23:57.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.244+0000 7f5f769b5b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5f601b3310 con 0x556afa647a80 2024-05-14T15:23:57.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.244+0000 7f5f769b5b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5f601b04e0 con 0x556afa4c3e40 2024-05-14T15:23:57.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.244+0000 7f5f769b5b80 10 client.0 _ll_register_callbacks cb 0x556afa50ac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:57.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.245+0000 7f5f64a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa641c40 0x556afa6538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.245+0000 7f5f65400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa4c3e40 0x556afa663440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.245+0000 7f5f65400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa4c3e40 0x556afa663440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:38990/0 (socket says 172.21.15.69:38990) 2024-05-14T15:23:57.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.245+0000 7f5f65400700 1 -- 172.21.15.69:0/1537271729 learned_addr learned my addr 172.21.15.69:0/1537271729 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:57.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.245+0000 7f5f65e00700 1 --2- 172.21.15.69:0/1537271729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa647a80 0x556afa653de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.246+0000 7f5f64a00700 1 -- 172.21.15.69:0/1537271729 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa4c3e40 msgr2=0x556afa663440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:57.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.246+0000 7f5f64a00700 1 --2- 172.21.15.69:0/1537271729 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa4c3e40 0x556afa663440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.246+0000 7f5f64a00700 1 -- 172.21.15.69:0/1537271729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa647a80 msgr2=0x556afa653de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:57.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.246+0000 7f5f64a00700 1 --2- 172.21.15.69:0/1537271729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa647a80 0x556afa653de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.246+0000 7f5f64a00700 1 -- 172.21.15.69:0/1537271729 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556afa663b80 con 0x556afa641c40 2024-05-14T15:23:57.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.246+0000 7f5f64a00700 1 --2- 172.21.15.69:0/1537271729 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa641c40 0x556afa6538a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x556afa63df10 tx=0x7f5f4c0047c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7a717379733350 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:57.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.246+0000 7f5f47400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:57.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.246+0000 7f5f47400700 1 -- 172.21.15.69:0/1537271729 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f4c004a30 con 0x556afa641c40 2024-05-14T15:23:57.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.246+0000 7f5f47400700 1 -- 172.21.15.69:0/1537271729 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5f4c004bd0 con 0x556afa641c40 2024-05-14T15:23:57.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.246+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1537271729 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5f58020070 con 0x556afa641c40 2024-05-14T15:23:57.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.247+0000 7f5f47400700 1 -- 172.21.15.69:0/1537271729 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f5f4c036050 con 0x556afa641c40 2024-05-14T15:23:57.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.247+0000 7f5f769b5b80 10 client.15870 fetch_fsmap learned FSMap version 35 2024-05-14T15:23:57.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.247+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1537271729 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x556afa6c4e10 con 0x556afa641c40 2024-05-14T15:23:57.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.247+0000 7f5f47400700 1 -- 172.21.15.69:0/1537271729 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5f58020070 con 0x556afa641c40 2024-05-14T15:23:57.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.247+0000 7f5f47400700 1 -- 172.21.15.69:0/1537271729 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f5f4c028ce0 con 0x556afa641c40 2024-05-14T15:23:57.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.247+0000 7f5f769b5b80 10 client.15870 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:23:57.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.247+0000 7f5f769b5b80 10 client.15870 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-05-14T15:23:57.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.247+0000 7f5f769b5b80 20 client.15870 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:57.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.247+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/1537271729 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x556afa6c54a0 0x556afa6c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:57.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.247+0000 7f5f769b5b80 4 client.15870 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:23:57.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.247+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1537271729 --> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556afa571400 con 0x556afa6c54a0 2024-05-14T15:23:57.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.248+0000 7f5f65400700 1 --2- 172.21.15.69:0/1537271729 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x556afa6c54a0 0x556afa6c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:57.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.249+0000 7f5f47400700 10 client.15870 ms_handle_connect on v2:172.21.15.92:6832/1997000798 2024-05-14T15:23:57.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.249+0000 7f5f65400700 1 --2- 172.21.15.69:0/1537271729 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x556afa6c54a0 0x556afa6c78c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=bc0083451b5550a0 server_cookie=ef2588b355d125d4 in_seq=0 out_seq=0 2024-05-14T15:23:57.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.250+0000 7f5f47400700 1 -- 172.21.15.69:0/1537271729 <== mds.3 v2:172.21.15.92:6832/1997000798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556afa571400 con 0x556afa6c54a0 2024-05-14T15:23:57.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.250+0000 7f5f47400700 10 client.15870 handle_command_reply: tid=0 2024-05-14T15:23:57.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.250+0000 7f5f769b5b80 1 client.15870 shutdown 2024-05-14T15:23:57.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.250+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1537271729 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa641c40 msgr2=0x556afa6538a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:57.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.250+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/1537271729 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa641c40 0x556afa6538a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x556afa63df10 tx=0x7f5f4c0047c0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.250+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1537271729 shutdown_connections 2024-05-14T15:23:57.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.250+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/1537271729 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x556afa6c54a0 0x556afa6c78c0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.250+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/1537271729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556afa647a80 0x556afa653de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.250+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/1537271729 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556afa4c3e40 0x556afa663440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.250+0000 7f5f769b5b80 1 --2- 172.21.15.69:0/1537271729 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556afa641c40 0x556afa6538a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.250+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1537271729 >> 172.21.15.69:0/1537271729 conn(0x556afa508f70 msgr2=0x556afa644e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:57.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.250+0000 7f5f47400700 0 client.15870 ms_handle_reset on v2:172.21.15.92:6832/1997000798 2024-05-14T15:23:57.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.251+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1537271729 shutdown_connections 2024-05-14T15:23:57.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.251+0000 7f5f769b5b80 1 -- 172.21.15.69:0/1537271729 wait complete. 2024-05-14T15:23:57.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.251+0000 7f5f769b5b80 20 client.15870 trim_cache size 0 max 16384 2024-05-14T15:23:57.253 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:23:57.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.252+0000 7f5f66800700 1 -- 172.21.15.69:0/1554448047 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5f480b29f0 msgr2=0x7f5f480b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:57.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.252+0000 7f5f66800700 1 --2- 172.21.15.69:0/1554448047 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5f480b29f0 0x7f5f480b4f00 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5f601059f0 tx=0x7f5f4c00b410 comp rx=0 tx=0).stop 2024-05-14T15:23:57.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.252+0000 7f5f66800700 1 -- 172.21.15.69:0/1554448047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f60106620 msgr2=0x7f5f6019cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:57.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.252+0000 7f5f66800700 1 --2- 172.21.15.69:0/1554448047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f60106620 0x7f5f6019cd40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f5f5400d950 tx=0x7f5f5400dc60 comp rx=0 tx=0).stop 2024-05-14T15:23:57.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.252+0000 7f5f66800700 1 -- 172.21.15.69:0/1554448047 shutdown_connections 2024-05-14T15:23:57.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.252+0000 7f5f66800700 1 --2- 172.21.15.69:0/1554448047 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5f480b29f0 0x7f5f480b4f00 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.252+0000 7f5f66800700 1 --2- 172.21.15.69:0/1554448047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5f60106620 0x7f5f6019cd40 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.252+0000 7f5f66800700 1 --2- 172.21.15.69:0/1554448047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5f6010b8a0 0x7f5f601a1570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.252+0000 7f5f66800700 1 --2- 172.21.15.69:0/1554448047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5f6010af50 0x7f5f6019d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:57.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.252+0000 7f5f66800700 1 -- 172.21.15.69:0/1554448047 >> 172.21.15.69:0/1554448047 conn(0x7f5f60102030 msgr2=0x7f5f6010a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:57.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.252+0000 7f5f66800700 1 -- 172.21.15.69:0/1554448047 shutdown_connections 2024-05-14T15:23:57.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:23:57.252+0000 7f5f66800700 1 -- 172.21.15.69:0/1554448047 wait complete. 2024-05-14T15:23:57.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:57 smithi092 ceph-mon[34729]: pgmap v72: 129 pgs: 129 active+clean; 425 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 24 op/s 2024-05-14T15:23:57.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:57 smithi069 ceph-mon[31270]: pgmap v72: 129 pgs: 129 active+clean; 425 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 24 op/s 2024-05-14T15:23:57.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:57 smithi203 ceph-mon[34567]: pgmap v72: 129 pgs: 129 active+clean; 425 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 24 op/s 2024-05-14T15:23:58.248 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-14T15:23:58.732 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:23:59.209 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.208+0000 7f679ac00640 1 -- 172.21.15.69:0/1886110952 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6794109c90 msgr2=0x7f6794103830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.208+0000 7f679ac00640 1 --2- 172.21.15.69:0/1886110952 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6794109c90 0x7f6794103830 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6784009900 tx=0x7f678402a410 comp rx=0 tx=0).stop 2024-05-14T15:23:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.208+0000 7f679ac00640 1 -- 172.21.15.69:0/1886110952 shutdown_connections 2024-05-14T15:23:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.208+0000 7f679ac00640 1 --2- 172.21.15.69:0/1886110952 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67941043e0 0x7f67941107b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.208+0000 7f679ac00640 1 --2- 172.21.15.69:0/1886110952 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f679410a130 0x7f6794103d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.208+0000 7f679ac00640 1 --2- 172.21.15.69:0/1886110952 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6794109c90 0x7f6794103830 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.208+0000 7f679ac00640 1 -- 172.21.15.69:0/1886110952 >> 172.21.15.69:0/1886110952 conn(0x7f67940ff350 msgr2=0x7f67941017a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.209+0000 7f679ac00640 1 -- 172.21.15.69:0/1886110952 shutdown_connections 2024-05-14T15:23:59.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.209+0000 7f679ac00640 1 -- 172.21.15.69:0/1886110952 wait complete. 2024-05-14T15:23:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.210+0000 7f679ac00640 1 Processor -- start 2024-05-14T15:23:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.210+0000 7f679ac00640 1 -- start start 2024-05-14T15:23:59.211 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.211+0000 7f679ac00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67941043e0 0x7f67941a0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.211+0000 7f679ac00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6794109c90 0x7f67941a0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.211+0000 7f679ac00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f679410a130 0x7f679419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.211+0000 7f679ac00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6794113d30 con 0x7f679410a130 2024-05-14T15:23:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.211+0000 7f679ac00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6794113bb0 con 0x7f67941043e0 2024-05-14T15:23:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.211+0000 7f679ac00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6794113eb0 con 0x7f6794109c90 2024-05-14T15:23:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.211+0000 7f6798c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f679410a130 0x7f679419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.211+0000 7f6793e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67941043e0 0x7f67941a0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:59.212 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.211+0000 7f6793e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67941043e0 0x7f67941a0510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:36954/0 (socket says 172.21.15.69:36954) 2024-05-14T15:23:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.211+0000 7f6793e00640 1 -- 172.21.15.69:0/2202217914 learned_addr learned my addr 172.21.15.69:0/2202217914 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.212+0000 7f6793400640 1 --2- 172.21.15.69:0/2202217914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6794109c90 0x7f67941a0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:59.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.212+0000 7f6798c00640 1 -- 172.21.15.69:0/2202217914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6794109c90 msgr2=0x7f67941a0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.212+0000 7f6798c00640 1 --2- 172.21.15.69:0/2202217914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6794109c90 0x7f67941a0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.212+0000 7f6798c00640 1 -- 172.21.15.69:0/2202217914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67941043e0 msgr2=0x7f67941a0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.212+0000 7f6798c00640 1 --2- 172.21.15.69:0/2202217914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67941043e0 0x7f67941a0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.212+0000 7f6798c00640 1 -- 172.21.15.69:0/2202217914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f679419adc0 con 0x7f679410a130 2024-05-14T15:23:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.212+0000 7f6793e00640 1 --2- 172.21.15.69:0/2202217914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67941043e0 0x7f67941a0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:23:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.213+0000 7f6798c00640 1 --2- 172.21.15.69:0/2202217914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f679410a130 0x7f679419a690 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f678c00da10 tx=0x7f678c00ded0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.213+0000 7f6790c00640 1 -- 172.21.15.69:0/2202217914 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c00bd70 con 0x7f679410a130 2024-05-14T15:23:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.213+0000 7f6790c00640 1 -- 172.21.15.69:0/2202217914 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f678c003e00 con 0x7f679410a130 2024-05-14T15:23:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.213+0000 7f6790c00640 1 -- 172.21.15.69:0/2202217914 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f678c0106c0 con 0x7f679410a130 2024-05-14T15:23:59.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.213+0000 7f679ac00640 1 -- 172.21.15.69:0/2202217914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f679419b050 con 0x7f679410a130 2024-05-14T15:23:59.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.213+0000 7f679ac00640 1 -- 172.21.15.69:0/2202217914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6794076010 con 0x7f679410a130 2024-05-14T15:23:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.217+0000 7f6790c00640 1 -- 172.21.15.69:0/2202217914 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f678c003970 con 0x7f679410a130 2024-05-14T15:23:59.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.218+0000 7f67a1bcf740 1 Processor -- start 2024-05-14T15:23:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.218+0000 7f67a1bcf740 1 -- start start 2024-05-14T15:23:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.218+0000 7f67a1bcf740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca6611b0 0x55eacaa02280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.218+0000 7f67a1bcf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6382f0 0x55eacaa027c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.218+0000 7f67a1bcf740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca6404d0 0x55eacaa02d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.218+0000 7f67a1bcf740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55eaca967550 con 0x55eaca6611b0 2024-05-14T15:23:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.218+0000 7f67a1bcf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55eaca90cbc0 con 0x55eaca6382f0 2024-05-14T15:23:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.218+0000 7f67a1bcf740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55eaca963510 con 0x55eaca6404d0 2024-05-14T15:23:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.219+0000 7f6793400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca6611b0 0x55eacaa02280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:59.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.219+0000 7f6793e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6382f0 0x55eacaa027c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.219+0000 7f6793e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6382f0 0x55eacaa027c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:36958/0 (socket says 172.21.15.69:36958) 2024-05-14T15:23:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.219+0000 7f6793e00640 1 -- 172.21.15.69:0/2675942686 learned_addr learned my addr 172.21.15.69:0/2675942686 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.219+0000 7f6790c00640 1 --2- 172.21.15.69:0/2202217914 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f67780b6de0 0x7f67780b92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.219+0000 7f6790c00640 1 -- 172.21.15.69:0/2202217914 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f678c0e2d90 con 0x7f679410a130 2024-05-14T15:23:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.220+0000 7f6798c00640 1 --2- 172.21.15.69:0/2202217914 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f67780b6de0 0x7f67780b92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.220+0000 7f6793e00640 1 -- 172.21.15.69:0/2675942686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca6404d0 msgr2=0x55eacaa02d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.220+0000 7f6793e00640 1 --2- 172.21.15.69:0/2675942686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca6404d0 0x55eacaa02d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.220+0000 7f6793e00640 1 -- 172.21.15.69:0/2675942686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca6611b0 msgr2=0x55eacaa02280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.220+0000 7f6793e00640 1 --2- 172.21.15.69:0/2675942686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca6611b0 0x55eacaa02280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.220+0000 7f6793e00640 1 -- 172.21.15.69:0/2675942686 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eaca679210 con 0x55eaca6382f0 2024-05-14T15:23:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.220+0000 7f6793400640 1 --2- 172.21.15.69:0/2675942686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca6611b0 0x55eacaa02280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:23:59.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.220+0000 7f6793e00640 1 --2- 172.21.15.69:0/2675942686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6382f0 0x55eacaa027c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6784006010 tx=0x7f6784043be0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8596d1684ac314a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.221+0000 7f6789200640 1 -- 172.21.15.69:0/2675942686 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6784035070 con 0x55eaca6382f0 2024-05-14T15:23:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.221+0000 7f6789200640 1 -- 172.21.15.69:0/2675942686 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67840044c0 con 0x55eaca6382f0 2024-05-14T15:23:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.221+0000 7f6789200640 1 -- 172.21.15.69:0/2675942686 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6784003cb0 con 0x55eaca6382f0 2024-05-14T15:23:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.222+0000 7f67a1bcf740 1 -- 172.21.15.69:0/2675942686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6382f0 msgr2=0x55eacaa027c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.222+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/2675942686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6382f0 0x55eacaa027c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6784006010 tx=0x7f6784043be0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.223 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.222+0000 7f6798c00640 1 --2- 172.21.15.69:0/2202217914 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f67780b6de0 0x7f67780b92f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f678c004af0 tx=0x7f678c004a40 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:59.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:59 smithi069 ceph-mon[31270]: pgmap v73: 129 pgs: 129 active+clean; 425 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 24 op/s 2024-05-14T15:23:59.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:23:59 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:23:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.223+0000 7f67a1bcf740 1 -- 172.21.15.69:0/2675942686 shutdown_connections 2024-05-14T15:23:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.223+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/2675942686 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca6404d0 0x55eacaa02d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.223+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/2675942686 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6382f0 0x55eacaa027c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.223+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/2675942686 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca6611b0 0x55eacaa02280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.223+0000 7f67a1bcf740 1 -- 172.21.15.69:0/2675942686 >> 172.21.15.69:0/2675942686 conn(0x55eaca655300 msgr2=0x55eaca9fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.223+0000 7f67a1bcf740 1 -- 172.21.15.69:0/2675942686 shutdown_connections 2024-05-14T15:23:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.223+0000 7f67a1bcf740 1 -- 172.21.15.69:0/2675942686 wait complete. 2024-05-14T15:23:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.223+0000 7f67a1bcf740 1 -- start start 2024-05-14T15:23:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.224+0000 7f67a1bcf740 1 Processor -- start 2024-05-14T15:23:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.224+0000 7f67a1bcf740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca6404d0 0x55eacaa0c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.224+0000 7f67a1bcf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6611b0 0x55eacaa0ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.224+0000 7f67a1bcf740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca61fd80 0x55eacaa12800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.224+0000 7f67a1bcf740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55eacaa0f350 con 0x55eaca61fd80 2024-05-14T15:23:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.224+0000 7f67a1bcf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55eaca920660 con 0x55eaca6611b0 2024-05-14T15:23:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.224+0000 7f67a1bcf740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55eacaa0f4d0 con 0x55eaca6404d0 2024-05-14T15:23:59.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.224+0000 7f67a1bcf740 10 client.0 _ll_register_callbacks cb 0x55eaca8ea400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.225+0000 7f6793400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca61fd80 0x55eacaa12800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.225+0000 7f6793e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6611b0 0x55eacaa0ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.225+0000 7f6793e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6611b0 0x55eacaa0ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:36966/0 (socket says 172.21.15.69:36966) 2024-05-14T15:23:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.225+0000 7f6793e00640 1 -- 172.21.15.69:0/438913443 learned_addr learned my addr 172.21.15.69:0/438913443 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.225+0000 7f6793400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca61fd80 0x55eacaa12800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54632/0 (socket says 172.21.15.69:54632) 2024-05-14T15:23:59.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.226+0000 7f6793400640 1 -- 172.21.15.69:0/438913443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca6404d0 msgr2=0x55eacaa0c8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:23:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.226+0000 7f6793400640 1 --2- 172.21.15.69:0/438913443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca6404d0 0x55eacaa0c8c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.226+0000 7f6793400640 1 -- 172.21.15.69:0/438913443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6611b0 msgr2=0x55eacaa0ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.226+0000 7f6793400640 1 --2- 172.21.15.69:0/438913443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6611b0 0x55eacaa0ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.226+0000 7f6793400640 1 -- 172.21.15.69:0/438913443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eaca745620 con 0x55eaca61fd80 2024-05-14T15:23:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.227+0000 7f6793400640 1 --2- 172.21.15.69:0/438913443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca61fd80 0x55eacaa12800 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f679419be30 tx=0x7f678000bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b1dd1ffd950b0c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.227+0000 7f677d600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.227+0000 7f677d600640 1 -- 172.21.15.69:0/438913443 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780012660 con 0x55eaca61fd80 2024-05-14T15:23:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.227+0000 7f677d600640 1 -- 172.21.15.69:0/438913443 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f6780012800 con 0x55eaca61fd80 2024-05-14T15:23:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.227+0000 7f67a1bcf740 1 -- 172.21.15.69:0/438913443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55eaca975160 con 0x55eaca61fd80 2024-05-14T15:23:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.227+0000 7f677d600640 1 -- 172.21.15.69:0/438913443 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f6780012a00 con 0x55eaca61fd80 2024-05-14T15:23:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.227+0000 7f67a1bcf740 10 client.15882 fetch_fsmap learned FSMap version 35 2024-05-14T15:23:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.227+0000 7f67a1bcf740 1 -- 172.21.15.69:0/438913443 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55eacaa1b7e0 con 0x55eaca61fd80 2024-05-14T15:23:59.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.228+0000 7f677d600640 1 -- 172.21.15.69:0/438913443 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55eaca975160 con 0x55eaca61fd80 2024-05-14T15:23:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.229+0000 7f677d600640 1 -- 172.21.15.69:0/438913443 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f6780019070 con 0x55eaca61fd80 2024-05-14T15:23:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.229+0000 7f67a1bcf740 10 client.15882 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:23:59.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.229+0000 7f67a1bcf740 10 client.15882 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.229+0000 7f67a1bcf740 20 client.15882 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.229+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/438913443 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55eaca5f51c0 0x55eacaa1ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.229+0000 7f67a1bcf740 4 client.15882 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:23:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.229+0000 7f67a1bcf740 1 -- 172.21.15.69:0/438913443 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eaca96efd0 con 0x55eaca5f51c0 2024-05-14T15:23:59.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.230+0000 7f6793e00640 1 --2- 172.21.15.69:0/438913443 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55eaca5f51c0 0x55eacaa1ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.230+0000 7f6793e00640 1 --2- 172.21.15.69:0/438913443 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55eaca5f51c0 0x55eacaa1ee30 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53ee4c3033e03436 server_cookie=47ec6b54c544944c in_seq=0 out_seq=0 2024-05-14T15:23:59.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.230+0000 7f677d600640 10 client.15882 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.231+0000 7f677d600640 1 -- 172.21.15.69:0/438913443 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55eaca96efd0 con 0x55eaca5f51c0 2024-05-14T15:23:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.231+0000 7f677d600640 10 client.15882 handle_command_reply: tid=0 2024-05-14T15:23:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.232+0000 7f67a1bcf740 1 client.15882 shutdown 2024-05-14T15:23:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.232+0000 7f67a1bcf740 1 -- 172.21.15.69:0/438913443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca61fd80 msgr2=0x55eacaa12800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.232+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/438913443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca61fd80 0x55eacaa12800 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f679419be30 tx=0x7f678000bf20 comp rx=0 tx=0).stop 2024-05-14T15:23:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.232+0000 7f67a1bcf740 1 -- 172.21.15.69:0/438913443 shutdown_connections 2024-05-14T15:23:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.232+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/438913443 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55eaca5f51c0 0x55eacaa1ee30 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.232+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/438913443 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca61fd80 0x55eacaa12800 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.232+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/438913443 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6611b0 0x55eacaa0ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.232+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/438913443 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca6404d0 0x55eacaa0c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.232+0000 7f677d600640 0 client.15882 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.232+0000 7f67a1bcf740 1 -- 172.21.15.69:0/438913443 >> 172.21.15.69:0/438913443 conn(0x55eaca655300 msgr2=0x55eacaa03fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:59.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.232+0000 7f67a1bcf740 1 -- 172.21.15.69:0/438913443 shutdown_connections 2024-05-14T15:23:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.233+0000 7f67a1bcf740 1 -- 172.21.15.69:0/438913443 wait complete. 2024-05-14T15:23:59.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.234+0000 7f67a1bcf740 20 client.15882 trim_cache size 0 max 16384 2024-05-14T15:23:59.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.254+0000 7f67a1bcf740 1 Processor -- start 2024-05-14T15:23:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.254+0000 7f67a1bcf740 1 -- start start 2024-05-14T15:23:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.255+0000 7f67a1bcf740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca655300 0x55eacaa02810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.255+0000 7f67a1bcf740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca61fd80 0x55eacaa02d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.255+0000 7f67a1bcf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6404d0 0x55eacaa12770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.255+0000 7f67a1bcf740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f67941af140 con 0x55eaca61fd80 2024-05-14T15:23:59.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.255+0000 7f67a1bcf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f67941b0e00 con 0x55eaca6404d0 2024-05-14T15:23:59.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.255+0000 7f67a1bcf740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f67941af810 con 0x55eaca655300 2024-05-14T15:23:59.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.255+0000 7f6793400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca655300 0x55eacaa02810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:59.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.255+0000 7f6793400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca655300 0x55eacaa02810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:39044/0 (socket says 172.21.15.69:39044) 2024-05-14T15:23:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.255+0000 7f6793400640 1 -- 172.21.15.69:0/433980267 learned_addr learned my addr 172.21.15.69:0/433980267 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.255+0000 7f6793400640 1 --2- 172.21.15.69:0/433980267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6404d0 0x55eacaa12770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.256+0000 7f6793400640 1 -- 172.21.15.69:0/433980267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6404d0 msgr2=0x55eacaa12770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.256+0000 7f6793400640 1 --2- 172.21.15.69:0/433980267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6404d0 0x55eacaa12770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.256+0000 7f6793400640 1 -- 172.21.15.69:0/433980267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca61fd80 msgr2=0x55eacaa02d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.256+0000 7f6793400640 1 --2- 172.21.15.69:0/433980267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca61fd80 0x55eacaa02d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.256+0000 7f6793400640 1 -- 172.21.15.69:0/433980267 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eacaa0ac00 con 0x55eaca655300 2024-05-14T15:23:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.257+0000 7f6793400640 1 --2- 172.21.15.69:0/433980267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca655300 0x55eacaa02810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6780005fd0 tx=0x7f678000b740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f47d8fadecd55f38 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.257+0000 7f677fe00640 1 -- 172.21.15.69:0/433980267 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780012da0 con 0x55eaca655300 2024-05-14T15:23:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.257+0000 7f677fe00640 1 -- 172.21.15.69:0/433980267 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f678000f3f0 con 0x55eaca655300 2024-05-14T15:23:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.257+0000 7f677fe00640 1 -- 172.21.15.69:0/433980267 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6780011800 con 0x55eaca655300 2024-05-14T15:23:59.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.258+0000 7f67a1bcf740 1 -- 172.21.15.69:0/433980267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca655300 msgr2=0x55eacaa02810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.258+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/433980267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca655300 0x55eacaa02810 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6780005fd0 tx=0x7f678000b740 comp rx=0 tx=0).stop 2024-05-14T15:23:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.258+0000 7f67a1bcf740 1 -- 172.21.15.69:0/433980267 shutdown_connections 2024-05-14T15:23:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.258+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/433980267 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca6404d0 0x55eacaa12770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.258+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/433980267 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca61fd80 0x55eacaa02d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.258+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/433980267 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca655300 0x55eacaa02810 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.259 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.258+0000 7f67a1bcf740 1 -- 172.21.15.69:0/433980267 >> 172.21.15.69:0/433980267 conn(0x55eacaa06740 msgr2=0x55eacaa02100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.259+0000 7f67a1bcf740 1 -- 172.21.15.69:0/433980267 shutdown_connections 2024-05-14T15:23:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.259+0000 7f67a1bcf740 1 -- 172.21.15.69:0/433980267 wait complete. 2024-05-14T15:23:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.259+0000 7f67a1bcf740 1 -- start start 2024-05-14T15:23:59.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.259+0000 7f67a1bcf740 1 Processor -- start 2024-05-14T15:23:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.260+0000 7f67a1bcf740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca61fd80 0x55eacaa18e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.260+0000 7f67a1bcf740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca6404d0 0x55eacaa141d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.260+0000 7f67a1bcf740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca655300 0x55eacaa14710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.260+0000 7f67a1bcf740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f67941b0670 con 0x55eaca6404d0 2024-05-14T15:23:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.260+0000 7f67a1bcf740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f67941aff10 con 0x55eaca655300 2024-05-14T15:23:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.260+0000 7f67a1bcf740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f67941ad120 con 0x55eaca61fd80 2024-05-14T15:23:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.261+0000 7f67a1bcf740 10 client.0 _ll_register_callbacks cb 0x7f6780005610 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:23:59.262 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.261+0000 7f6793e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca6404d0 0x55eacaa141d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.261+0000 7f6793e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca6404d0 0x55eacaa141d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54644/0 (socket says 172.21.15.69:54644) 2024-05-14T15:23:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.261+0000 7f6793e00640 1 -- 172.21.15.69:0/4164377989 learned_addr learned my addr 172.21.15.69:0/4164377989 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:23:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.261+0000 7f6793400640 1 --2- 172.21.15.69:0/4164377989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca61fd80 0x55eacaa18e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.261+0000 7f6793400640 1 --2- 172.21.15.69:0/4164377989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca655300 0x55eacaa14710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.261+0000 7f6793e00640 1 -- 172.21.15.69:0/4164377989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca61fd80 msgr2=0x55eacaa18e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.261+0000 7f6793e00640 1 --2- 172.21.15.69:0/4164377989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca61fd80 0x55eacaa18e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.261+0000 7f6793e00640 1 -- 172.21.15.69:0/4164377989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca655300 msgr2=0x55eacaa14710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:23:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.261+0000 7f6793e00640 1 --2- 172.21.15.69:0/4164377989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca655300 0x55eacaa14710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.261+0000 7f6793e00640 1 -- 172.21.15.69:0/4164377989 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eacaa14c50 con 0x55eaca6404d0 2024-05-14T15:23:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.261+0000 7f6793400640 1 --2- 172.21.15.69:0/4164377989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca655300 0x55eacaa14710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:23:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.262+0000 7f6793e00640 1 --2- 172.21.15.69:0/4164377989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca6404d0 0x55eacaa141d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f67840038c0 tx=0x7f678402ab10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09e27badc0e9d5a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:23:59.263 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.262+0000 7f677d600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:23:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.262+0000 7f677d600640 1 -- 172.21.15.69:0/4164377989 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6784035040 con 0x55eaca6404d0 2024-05-14T15:23:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.262+0000 7f677d600640 1 -- 172.21.15.69:0/4164377989 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f6784031400 con 0x55eaca6404d0 2024-05-14T15:23:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.262+0000 7f67a1bcf740 1 -- 172.21.15.69:0/4164377989 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f678000f3f0 con 0x55eaca6404d0 2024-05-14T15:23:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.262+0000 7f677d600640 1 -- 172.21.15.69:0/4164377989 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f678406a050 con 0x55eaca6404d0 2024-05-14T15:23:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.263+0000 7f67a1bcf740 10 client.15885 fetch_fsmap learned FSMap version 35 2024-05-14T15:23:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.263+0000 7f67a1bcf740 1 -- 172.21.15.69:0/4164377989 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55eacaa86db0 con 0x55eaca6404d0 2024-05-14T15:23:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.263+0000 7f677d600640 1 -- 172.21.15.69:0/4164377989 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f678000f3f0 con 0x55eaca6404d0 2024-05-14T15:23:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.263+0000 7f677d600640 1 -- 172.21.15.69:0/4164377989 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f678404a070 con 0x55eaca6404d0 2024-05-14T15:23:59.265 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.263+0000 7f67a1bcf740 10 client.15885 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:23:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.263+0000 7f67a1bcf740 10 client.15885 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:23:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.263+0000 7f67a1bcf740 20 client.15885 populate_metadata read hostname 'smithi069' 2024-05-14T15:23:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.263+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/4164377989 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55eaca6611b0 0x55eacaa890f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:23:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.263+0000 7f67a1bcf740 4 client.15885 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:23:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.263+0000 7f67a1bcf740 1 -- 172.21.15.69:0/4164377989 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55eaca8ea4b0 con 0x55eaca6611b0 2024-05-14T15:23:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.264+0000 7f6793400640 1 --2- 172.21.15.69:0/4164377989 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55eaca6611b0 0x55eacaa890f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:23:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.265+0000 7f677d600640 10 client.15885 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:59.266 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.265+0000 7f6793400640 1 --2- 172.21.15.69:0/4164377989 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55eaca6611b0 0x55eacaa890f0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a434ae6d6c7ee821 server_cookie=f0b31fedbd218c2f in_seq=0 out_seq=0 2024-05-14T15:23:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.309+0000 7f677d600640 1 -- 172.21.15.69:0/4164377989 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55eaca8ea4b0 con 0x55eaca6611b0 2024-05-14T15:23:59.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.309+0000 7f677d600640 10 client.15885 handle_command_reply: tid=0 2024-05-14T15:23:59.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.309+0000 7f67a1bcf740 1 client.15885 shutdown 2024-05-14T15:23:59.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.309+0000 7f67a1bcf740 1 -- 172.21.15.69:0/4164377989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca6404d0 msgr2=0x55eacaa141d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:59.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.309+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/4164377989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca6404d0 0x55eacaa141d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f67840038c0 tx=0x7f678402ab10 comp rx=0 tx=0).stop 2024-05-14T15:23:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.309+0000 7f67a1bcf740 1 -- 172.21.15.69:0/4164377989 shutdown_connections 2024-05-14T15:23:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.310+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/4164377989 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55eaca655300 0x55eacaa14710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.310+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/4164377989 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55eaca6611b0 0x55eacaa890f0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.310+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/4164377989 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55eaca6404d0 0x55eacaa141d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.310+0000 7f677d600640 0 client.15885 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:23:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.310+0000 7f67a1bcf740 1 --2- 172.21.15.69:0/4164377989 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55eaca61fd80 0x55eacaa18e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.311+0000 7f67a1bcf740 1 -- 172.21.15.69:0/4164377989 >> 172.21.15.69:0/4164377989 conn(0x55eacaa06740 msgr2=0x55eaca9fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.311+0000 7f67a1bcf740 1 -- 172.21.15.69:0/4164377989 shutdown_connections 2024-05-14T15:23:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.311+0000 7f67a1bcf740 1 -- 172.21.15.69:0/4164377989 wait complete. 2024-05-14T15:23:59.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.311+0000 7f67a1bcf740 20 client.15885 trim_cache size 0 max 16384 2024-05-14T15:23:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:23:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:23:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:23:59.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:23:59.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.316+0000 7f679ac00640 1 -- 172.21.15.69:0/2202217914 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f67780b6de0 msgr2=0x7f67780b92f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.316+0000 7f679ac00640 1 --2- 172.21.15.69:0/2202217914 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f67780b6de0 0x7f67780b92f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f678c004af0 tx=0x7f678c004a40 comp rx=0 tx=0).stop 2024-05-14T15:23:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.316+0000 7f679ac00640 1 -- 172.21.15.69:0/2202217914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f679410a130 msgr2=0x7f679419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:23:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.316+0000 7f679ac00640 1 --2- 172.21.15.69:0/2202217914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f679410a130 0x7f679419a690 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f678c00da10 tx=0x7f678c00ded0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.317+0000 7f679ac00640 1 -- 172.21.15.69:0/2202217914 shutdown_connections 2024-05-14T15:23:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.317+0000 7f679ac00640 1 --2- 172.21.15.69:0/2202217914 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f67780b6de0 0x7f67780b92f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.317+0000 7f679ac00640 1 --2- 172.21.15.69:0/2202217914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f679410a130 0x7f679419a690 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.317+0000 7f679ac00640 1 --2- 172.21.15.69:0/2202217914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6794109c90 0x7f67941a0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.317+0000 7f679ac00640 1 --2- 172.21.15.69:0/2202217914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f67941043e0 0x7f67941a0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:23:59.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.317+0000 7f679ac00640 1 -- 172.21.15.69:0/2202217914 >> 172.21.15.69:0/2202217914 conn(0x7f67940ff350 msgr2=0x7f67940ff760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:23:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.317+0000 7f679ac00640 1 -- 172.21.15.69:0/2202217914 shutdown_connections 2024-05-14T15:23:59.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:23:59.317+0000 7f679ac00640 1 -- 172.21.15.69:0/2202217914 wait complete. 2024-05-14T15:23:59.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:59 smithi092 ceph-mon[34729]: pgmap v73: 129 pgs: 129 active+clean; 425 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 24 op/s 2024-05-14T15:23:59.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:23:59 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:23:59.471 INFO:teuthology.orchestra.run.smithi069.stderr:1800000 of 3200000 tuples (56%) done (elapsed 65.08 s, remaining 50.62 s) 2024-05-14T15:23:59.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:59 smithi203 ceph-mon[34567]: pgmap v73: 129 pgs: 129 active+clean; 425 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 12 MiB/s wr, 24 op/s 2024-05-14T15:23:59.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:23:59 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:24:00.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:00 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:24:00.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:00 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:24:00.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:00 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:24:00.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:00 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:24:00.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:00 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:24:00.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:00 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:24:00.597 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:00 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:24:00.597 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:00 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:24:00.598 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:00 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:24:01.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.104+0000 7f95bea00700 1 -- 172.21.15.69:0/1723424098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95b8109880 msgr2=0x7f95b81111e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:01.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.104+0000 7f95bea00700 1 --2- 172.21.15.69:0/1723424098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95b8109880 0x7f95b81111e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f95b000b0d0 tx=0x7f95b000b3e0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.104+0000 7f95bea00700 1 -- 172.21.15.69:0/1723424098 shutdown_connections 2024-05-14T15:24:01.105 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.104+0000 7f95bea00700 1 --2- 172.21.15.69:0/1723424098 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95b8104650 0x7f95b8104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.104+0000 7f95bea00700 1 --2- 172.21.15.69:0/1723424098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95b8109880 0x7f95b81111e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.104+0000 7f95bea00700 1 --2- 172.21.15.69:0/1723424098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b8108f30 0x7f95b8109340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.104+0000 7f95bea00700 1 -- 172.21.15.69:0/1723424098 >> 172.21.15.69:0/1723424098 conn(0x7f95b8079f00 msgr2=0x7f95b807a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:01.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.104+0000 7f95bea00700 1 -- 172.21.15.69:0/1723424098 shutdown_connections 2024-05-14T15:24:01.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.104+0000 7f95bea00700 1 -- 172.21.15.69:0/1723424098 wait complete. 2024-05-14T15:24:01.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.106+0000 7f95bea00700 1 Processor -- start 2024-05-14T15:24:01.106 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.106+0000 7f95bea00700 1 -- start start 2024-05-14T15:24:01.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.107+0000 7f95bea00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95b8104650 0x7f95b8075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.107+0000 7f95bea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95b8108f30 0x7f95b8076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.107+0000 7f95bea00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b8109880 0x7f95b8076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.107+0000 7f95bea00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f95b8114380 con 0x7f95b8108f30 2024-05-14T15:24:01.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.107+0000 7f95bea00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95b8114200 con 0x7f95b8109880 2024-05-14T15:24:01.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.107+0000 7f95bea00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f95b8114500 con 0x7f95b8104650 2024-05-14T15:24:01.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.107+0000 7f95b7400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95b8108f30 0x7f95b8076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.108 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.107+0000 7f95b7400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95b8108f30 0x7f95b8076000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54656/0 (socket says 172.21.15.69:54656) 2024-05-14T15:24:01.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.107+0000 7f95b7400700 1 -- 172.21.15.69:0/2973011090 learned_addr learned my addr 172.21.15.69:0/2973011090 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:01.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.107+0000 7f95b7e00700 1 --2- 172.21.15.69:0/2973011090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95b8104650 0x7f95b8075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.108+0000 7f95bca00700 1 --2- 172.21.15.69:0/2973011090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b8109880 0x7f95b8076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.108+0000 7f95b7400700 1 -- 172.21.15.69:0/2973011090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95b8104650 msgr2=0x7f95b8075ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:01.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.108+0000 7f95b7400700 1 --2- 172.21.15.69:0/2973011090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95b8104650 0x7f95b8075ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.108+0000 7f95b7400700 1 -- 172.21.15.69:0/2973011090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b8109880 msgr2=0x7f95b8076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:01.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.108+0000 7f95b7400700 1 --2- 172.21.15.69:0/2973011090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b8109880 0x7f95b8076540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.108+0000 7f95b7400700 1 -- 172.21.15.69:0/2973011090 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95b81a90b0 con 0x7f95b8108f30 2024-05-14T15:24:01.109 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.108+0000 7f95b7400700 1 --2- 172.21.15.69:0/2973011090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95b8108f30 0x7f95b8076000 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f95a400e9f0 tx=0x7f95a400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:01.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.109+0000 7f95b4c00700 1 -- 172.21.15.69:0/2973011090 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a400cbd0 con 0x7f95b8108f30 2024-05-14T15:24:01.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.109+0000 7f95b4c00700 1 -- 172.21.15.69:0/2973011090 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95a400cd70 con 0x7f95b8108f30 2024-05-14T15:24:01.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.109+0000 7f95bea00700 1 -- 172.21.15.69:0/2973011090 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95b81a93a0 con 0x7f95b8108f30 2024-05-14T15:24:01.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.109+0000 7f95b4c00700 1 -- 172.21.15.69:0/2973011090 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4005580 con 0x7f95b8108f30 2024-05-14T15:24:01.110 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.109+0000 7f95bea00700 1 -- 172.21.15.69:0/2973011090 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95b81a98e0 con 0x7f95b8108f30 2024-05-14T15:24:01.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.113+0000 7f95b4c00700 1 -- 172.21.15.69:0/2973011090 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f95a4004750 con 0x7f95b8108f30 2024-05-14T15:24:01.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.114+0000 7f95b4c00700 1 --2- 172.21.15.69:0/2973011090 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f959c0b2a70 0x7f959c0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.115+0000 7f95b4c00700 1 -- 172.21.15.69:0/2973011090 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f95a40e2b80 con 0x7f95b8108f30 2024-05-14T15:24:01.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.115+0000 7f95b7e00700 1 --2- 172.21.15.69:0/2973011090 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f959c0b2a70 0x7f959c0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.116+0000 7f95cd46bb80 1 Processor -- start 2024-05-14T15:24:01.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.116+0000 7f95b7e00700 1 --2- 172.21.15.69:0/2973011090 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f959c0b2a70 0x7f959c0b4f80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009c60 tx=0x7f95a8009260 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:01.116 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.116+0000 7f95cd46bb80 1 -- start start 2024-05-14T15:24:01.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.116+0000 7f95cd46bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17c71e40 0x557b17df56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.116+0000 7f95cd46bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17df5bf0 0x557b17def710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.116+0000 7f95cd46bb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17defc50 0x557b17df0060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.116+0000 7f95cd46bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x557b17d11a20 con 0x557b17c71e40 2024-05-14T15:24:01.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.116+0000 7f95cd46bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557b17caf760 con 0x557b17df5bf0 2024-05-14T15:24:01.117 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.116+0000 7f95cd46bb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557b17d0d9e0 con 0x557b17defc50 2024-05-14T15:24:01.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.117+0000 7f95b7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17c71e40 0x557b17df56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.117+0000 7f95b7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17c71e40 0x557b17df56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54668/0 (socket says 172.21.15.69:54668) 2024-05-14T15:24:01.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.117+0000 7f95b7e00700 1 -- 172.21.15.69:0/1401450045 learned_addr learned my addr 172.21.15.69:0/1401450045 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:01.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.117+0000 7f95b7400700 1 --2- 172.21.15.69:0/1401450045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17df5bf0 0x557b17def710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.118+0000 7f95b7e00700 1 -- 172.21.15.69:0/1401450045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17defc50 msgr2=0x557b17df0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:01.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.118+0000 7f95b7e00700 1 --2- 172.21.15.69:0/1401450045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17defc50 0x557b17df0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.118 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.118+0000 7f95b7e00700 1 -- 172.21.15.69:0/1401450045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17df5bf0 msgr2=0x557b17def710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:01.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.118+0000 7f95b7e00700 1 --2- 172.21.15.69:0/1401450045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17df5bf0 0x557b17def710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.118+0000 7f95b7e00700 1 -- 172.21.15.69:0/1401450045 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b17c5e8d0 con 0x557b17c71e40 2024-05-14T15:24:01.119 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.118+0000 7f95b7e00700 1 --2- 172.21.15.69:0/1401450045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17c71e40 0x557b17df56b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f95a800e4e0 tx=0x7f95a8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c82e9a0db659c7f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:01.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.122+0000 7f95ad600700 1 -- 172.21.15.69:0/1401450045 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a8026430 con 0x557b17c71e40 2024-05-14T15:24:01.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.122+0000 7f95ad600700 1 -- 172.21.15.69:0/1401450045 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95a801c8a0 con 0x557b17c71e40 2024-05-14T15:24:01.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.122+0000 7f95ad600700 1 -- 172.21.15.69:0/1401450045 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a801d8b0 con 0x557b17c71e40 2024-05-14T15:24:01.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.123+0000 7f95cd46bb80 1 -- 172.21.15.69:0/1401450045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17c71e40 msgr2=0x557b17df56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:01.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.123+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/1401450045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17c71e40 0x557b17df56b0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f95a800e4e0 tx=0x7f95a8014000 comp rx=0 tx=0).stop 2024-05-14T15:24:01.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.124+0000 7f95cd46bb80 1 -- 172.21.15.69:0/1401450045 shutdown_connections 2024-05-14T15:24:01.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.124+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/1401450045 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17c71e40 0x557b17df56b0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.124+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/1401450045 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17defc50 0x557b17df0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.124+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/1401450045 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17df5bf0 0x557b17def710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.124+0000 7f95cd46bb80 1 -- 172.21.15.69:0/1401450045 >> 172.21.15.69:0/1401450045 conn(0x557b17cb0a80 msgr2=0x557b17dea790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:01.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.124+0000 7f95cd46bb80 1 -- 172.21.15.69:0/1401450045 shutdown_connections 2024-05-14T15:24:01.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.124+0000 7f95cd46bb80 1 -- 172.21.15.69:0/1401450045 wait complete. 2024-05-14T15:24:01.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.124+0000 7f95cd46bb80 1 -- start start 2024-05-14T15:24:01.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.125+0000 7f95cd46bb80 1 Processor -- start 2024-05-14T15:24:01.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.125+0000 7f95cd46bb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17c71e40 0x557b17df9420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.125+0000 7f95cd46bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17defc50 0x557b17df9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.125+0000 7f95cd46bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17df5bf0 0x557b17df9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.125+0000 7f95cd46bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x557b17dfc6c0 con 0x557b17defc50 2024-05-14T15:24:01.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.125+0000 7f95cd46bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557b17c77b20 con 0x557b17df5bf0 2024-05-14T15:24:01.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.125+0000 7f95cd46bb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557b17dfc840 con 0x557b17c71e40 2024-05-14T15:24:01.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.125+0000 7f95cd46bb80 10 client.0 _ll_register_callbacks cb 0x557b17ca5380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:01.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.126+0000 7f95b7400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17defc50 0x557b17df9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.126+0000 7f95b7400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17defc50 0x557b17df9960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54678/0 (socket says 172.21.15.69:54678) 2024-05-14T15:24:01.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.126+0000 7f95b7400700 1 -- 172.21.15.69:0/3276314550 learned_addr learned my addr 172.21.15.69:0/3276314550 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:01.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.126+0000 7f95b7e00700 1 --2- 172.21.15.69:0/3276314550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17c71e40 0x557b17df9420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.126+0000 7f95bca00700 1 --2- 172.21.15.69:0/3276314550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17df5bf0 0x557b17df9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.126+0000 7f95b7400700 1 -- 172.21.15.69:0/3276314550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17c71e40 msgr2=0x557b17df9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:01.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.126+0000 7f95b7400700 1 --2- 172.21.15.69:0/3276314550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17c71e40 0x557b17df9420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.126+0000 7f95b7400700 1 -- 172.21.15.69:0/3276314550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17df5bf0 msgr2=0x557b17df9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:01.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.126+0000 7f95b7400700 1 --2- 172.21.15.69:0/3276314550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17df5bf0 0x557b17df9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.127+0000 7f95b7400700 1 -- 172.21.15.69:0/3276314550 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b17cd7420 con 0x557b17defc50 2024-05-14T15:24:01.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.127+0000 7f95b7400700 1 --2- 172.21.15.69:0/3276314550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17defc50 0x557b17df9960 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f95a40a6d20 tx=0x7f95a40a5ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11eab7cbc9e6d900 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:01.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.127+0000 7f95a2000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:01.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.127+0000 7f95a2000700 1 -- 172.21.15.69:0/3276314550 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a40b2250 con 0x557b17defc50 2024-05-14T15:24:01.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.127+0000 7f95a2000700 1 -- 172.21.15.69:0/3276314550 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f95a40a5040 con 0x557b17defc50 2024-05-14T15:24:01.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.127+0000 7f95cd46bb80 1 -- 172.21.15.69:0/3276314550 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95a801c8a0 con 0x557b17defc50 2024-05-14T15:24:01.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.128+0000 7f95a2000700 1 -- 172.21.15.69:0/3276314550 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f95a40a95c0 con 0x557b17defc50 2024-05-14T15:24:01.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.128+0000 7f95cd46bb80 10 client.15897 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:01.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.128+0000 7f95cd46bb80 1 -- 172.21.15.69:0/3276314550 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557b17e07320 con 0x557b17defc50 2024-05-14T15:24:01.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.128+0000 7f95a2000700 1 -- 172.21.15.69:0/3276314550 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95a801c8a0 con 0x557b17defc50 2024-05-14T15:24:01.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.128+0000 7f95a2000700 1 -- 172.21.15.69:0/3276314550 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f95a40cc0b0 con 0x557b17defc50 2024-05-14T15:24:01.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.128+0000 7f95cd46bb80 10 client.15897 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:01.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.128+0000 7f95cd46bb80 10 client.15897 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-05-14T15:24:01.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.128+0000 7f95cd46bb80 20 client.15897 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:01.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.128+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/3276314550 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x557b17e09960 0x557b17e0bd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.129+0000 7f95cd46bb80 4 client.15897 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:24:01.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.129+0000 7f95cd46bb80 1 -- 172.21.15.69:0/3276314550 --> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b17dbc070 con 0x557b17e09960 2024-05-14T15:24:01.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.129+0000 7f95b7e00700 1 --2- 172.21.15.69:0/3276314550 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x557b17e09960 0x557b17e0bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.130+0000 7f95a2000700 10 client.15897 ms_handle_connect on v2:172.21.15.92:6834/360295917 2024-05-14T15:24:01.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.130+0000 7f95b7e00700 1 --2- 172.21.15.69:0/3276314550 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x557b17e09960 0x557b17e0bd80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3cc57fe121881d52 server_cookie=c896a30c10fda3b6 in_seq=0 out_seq=0 2024-05-14T15:24:01.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.133+0000 7f95a2000700 1 -- 172.21.15.69:0/3276314550 <== mds.2 v2:172.21.15.92:6834/360295917 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557b17dbc070 con 0x557b17e09960 2024-05-14T15:24:01.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.133+0000 7f95a2000700 10 client.15897 handle_command_reply: tid=0 2024-05-14T15:24:01.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.133+0000 7f95cd46bb80 1 client.15897 shutdown 2024-05-14T15:24:01.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.133+0000 7f95cd46bb80 1 -- 172.21.15.69:0/3276314550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17defc50 msgr2=0x557b17df9960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:01.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.133+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/3276314550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17defc50 0x557b17df9960 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f95a40a6d20 tx=0x7f95a40a5ff0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.133+0000 7f95cd46bb80 1 -- 172.21.15.69:0/3276314550 shutdown_connections 2024-05-14T15:24:01.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.133+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/3276314550 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x557b17e09960 0x557b17e0bd80 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.133+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/3276314550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17df5bf0 0x557b17df9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.133+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/3276314550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17c71e40 0x557b17df9420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.133+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/3276314550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17defc50 0x557b17df9960 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.133+0000 7f95cd46bb80 1 -- 172.21.15.69:0/3276314550 >> 172.21.15.69:0/3276314550 conn(0x557b17cb0a80 msgr2=0x557b17dee700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:01.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.133+0000 7f95a2000700 0 client.15897 ms_handle_reset on v2:172.21.15.92:6834/360295917 2024-05-14T15:24:01.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.134+0000 7f95cd46bb80 1 -- 172.21.15.69:0/3276314550 shutdown_connections 2024-05-14T15:24:01.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.134+0000 7f95cd46bb80 1 -- 172.21.15.69:0/3276314550 wait complete. 2024-05-14T15:24:01.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.134+0000 7f95cd46bb80 20 client.15897 trim_cache size 0 max 16384 2024-05-14T15:24:01.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.150+0000 7f95cd46bb80 1 Processor -- start 2024-05-14T15:24:01.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.151+0000 7f95cd46bb80 1 -- start start 2024-05-14T15:24:01.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.151+0000 7f95cd46bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17c71e40 0x557b17def710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.151+0000 7f95cd46bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17defc50 0x557b17df8380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.151+0000 7f95cd46bb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17df5bf0 0x557b17df37b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.151+0000 7f95cd46bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f95b81b2770 con 0x557b17c71e40 2024-05-14T15:24:01.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.151+0000 7f95cd46bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95b81b4430 con 0x557b17defc50 2024-05-14T15:24:01.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.151+0000 7f95cd46bb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f95b81b2e40 con 0x557b17df5bf0 2024-05-14T15:24:01.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.152+0000 7f95b7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17c71e40 0x557b17def710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.152+0000 7f95b7e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17c71e40 0x557b17def710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54686/0 (socket says 172.21.15.69:54686) 2024-05-14T15:24:01.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.152+0000 7f95b7e00700 1 -- 172.21.15.69:0/1880740511 learned_addr learned my addr 172.21.15.69:0/1880740511 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:01.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.152+0000 7f95b7400700 1 --2- 172.21.15.69:0/1880740511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17defc50 0x557b17df8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.152+0000 7f95bca00700 1 --2- 172.21.15.69:0/1880740511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17df5bf0 0x557b17df37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.152+0000 7f95b7e00700 1 -- 172.21.15.69:0/1880740511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17df5bf0 msgr2=0x557b17df37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:01.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.152+0000 7f95b7e00700 1 --2- 172.21.15.69:0/1880740511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17df5bf0 0x557b17df37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.152+0000 7f95b7e00700 1 -- 172.21.15.69:0/1880740511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17defc50 msgr2=0x557b17df8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:01.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.152+0000 7f95b7e00700 1 --2- 172.21.15.69:0/1880740511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17defc50 0x557b17df8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.152+0000 7f95b7e00700 1 -- 172.21.15.69:0/1880740511 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b17df91f0 con 0x557b17c71e40 2024-05-14T15:24:01.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.152+0000 7f95b7400700 1 --2- 172.21.15.69:0/1880740511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17defc50 0x557b17df8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:24:01.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.153+0000 7f95b7e00700 1 --2- 172.21.15.69:0/1880740511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17c71e40 0x557b17def710 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x557b17df0a30 tx=0x7f95a80092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bd03f0b5a76e312 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:01.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.153+0000 7f95acc00700 1 -- 172.21.15.69:0/1880740511 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a8039070 con 0x557b17c71e40 2024-05-14T15:24:01.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.153+0000 7f95acc00700 1 -- 172.21.15.69:0/1880740511 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95a800edf0 con 0x557b17c71e40 2024-05-14T15:24:01.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.153+0000 7f95acc00700 1 -- 172.21.15.69:0/1880740511 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a8003cc0 con 0x557b17c71e40 2024-05-14T15:24:01.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.154+0000 7f95cd46bb80 1 -- 172.21.15.69:0/1880740511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17c71e40 msgr2=0x557b17def710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:01.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.154+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/1880740511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17c71e40 0x557b17def710 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x557b17df0a30 tx=0x7f95a80092d0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.154+0000 7f95cd46bb80 1 -- 172.21.15.69:0/1880740511 shutdown_connections 2024-05-14T15:24:01.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.154+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/1880740511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17c71e40 0x557b17def710 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.154+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/1880740511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17df5bf0 0x557b17df37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.154+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/1880740511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17defc50 0x557b17df8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.154+0000 7f95cd46bb80 1 -- 172.21.15.69:0/1880740511 >> 172.21.15.69:0/1880740511 conn(0x557b17cb0a80 msgr2=0x557b17df30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:01.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.154+0000 7f95cd46bb80 1 -- 172.21.15.69:0/1880740511 shutdown_connections 2024-05-14T15:24:01.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.154+0000 7f95cd46bb80 1 -- 172.21.15.69:0/1880740511 wait complete. 2024-05-14T15:24:01.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.155+0000 7f95cd46bb80 1 -- start start 2024-05-14T15:24:01.156 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.155+0000 7f95cd46bb80 1 Processor -- start 2024-05-14T15:24:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.156+0000 7f95cd46bb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17c71e40 0x557b17e01e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.156+0000 7f95cd46bb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17defc50 0x557b17dee700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.156+0000 7f95cd46bb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17df5bf0 0x557b17deec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.156+0000 7f95cd46bb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f95b81b3ca0 con 0x557b17defc50 2024-05-14T15:24:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.156+0000 7f95cd46bb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f95b81b3540 con 0x557b17df5bf0 2024-05-14T15:24:01.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.156+0000 7f95cd46bb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f95b81b0710 con 0x557b17c71e40 2024-05-14T15:24:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.156+0000 7f95cd46bb80 10 client.0 _ll_register_callbacks cb 0x557b17ca5380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.156+0000 7f95b7400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17defc50 0x557b17dee700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.156+0000 7f95b7400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17defc50 0x557b17dee700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54696/0 (socket says 172.21.15.69:54696) 2024-05-14T15:24:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.156+0000 7f95b7400700 1 -- 172.21.15.69:0/3200113953 learned_addr learned my addr 172.21.15.69:0/3200113953 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.156+0000 7f95b7e00700 1 --2- 172.21.15.69:0/3200113953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17c71e40 0x557b17e01e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.156+0000 7f95bca00700 1 --2- 172.21.15.69:0/3200113953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17df5bf0 0x557b17deec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.157+0000 7f95b7400700 1 -- 172.21.15.69:0/3200113953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17c71e40 msgr2=0x557b17e01e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.157+0000 7f95b7400700 1 --2- 172.21.15.69:0/3200113953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17c71e40 0x557b17e01e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.157+0000 7f95b7400700 1 -- 172.21.15.69:0/3200113953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17df5bf0 msgr2=0x557b17deec40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.157+0000 7f95b7400700 1 --2- 172.21.15.69:0/3200113953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17df5bf0 0x557b17deec40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.157+0000 7f95b7400700 1 -- 172.21.15.69:0/3200113953 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b17def180 con 0x557b17defc50 2024-05-14T15:24:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.157+0000 7f95bca00700 1 --2- 172.21.15.69:0/3200113953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17df5bf0 0x557b17deec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:24:01.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.157+0000 7f95b7400700 1 --2- 172.21.15.69:0/3200113953 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17defc50 0x557b17dee700 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f95a40a97b0 tx=0x7f95a40092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f070d0303b2886a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:01.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.157+0000 7f95a2000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:01.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.157+0000 7f95a2000700 1 -- 172.21.15.69:0/3200113953 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95a4085020 con 0x557b17defc50 2024-05-14T15:24:01.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.157+0000 7f95cd46bb80 1 -- 172.21.15.69:0/3200113953 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95a800edf0 con 0x557b17defc50 2024-05-14T15:24:01.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.157+0000 7f95a2000700 1 -- 172.21.15.69:0/3200113953 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f95a40a5040 con 0x557b17defc50 2024-05-14T15:24:01.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.158+0000 7f95a2000700 1 -- 172.21.15.69:0/3200113953 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f95a40b2250 con 0x557b17defc50 2024-05-14T15:24:01.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.158+0000 7f95cd46bb80 10 client.15903 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:01.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.158+0000 7f95cd46bb80 1 -- 172.21.15.69:0/3200113953 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x557b17e73ba0 con 0x557b17defc50 2024-05-14T15:24:01.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.158+0000 7f95a2000700 1 -- 172.21.15.69:0/3200113953 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f95a800edf0 con 0x557b17defc50 2024-05-14T15:24:01.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.158+0000 7f95a2000700 1 -- 172.21.15.69:0/3200113953 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f95a40a5420 con 0x557b17defc50 2024-05-14T15:24:01.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.158+0000 7f95cd46bb80 10 client.15903 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:01.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.158+0000 7f95cd46bb80 10 client.15903 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-05-14T15:24:01.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.158+0000 7f95cd46bb80 20 client.15903 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:01.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.158+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/3200113953 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x557b17e740f0 0x557b17e76510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:01.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.158+0000 7f95cd46bb80 4 client.15903 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:24:01.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.158+0000 7f95cd46bb80 1 -- 172.21.15.69:0/3200113953 --> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557b17d1f400 con 0x557b17e740f0 2024-05-14T15:24:01.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.159+0000 7f95b7e00700 1 --2- 172.21.15.69:0/3200113953 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x557b17e740f0 0x557b17e76510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:01.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.160+0000 7f95b7e00700 1 --2- 172.21.15.69:0/3200113953 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x557b17e740f0 0x557b17e76510 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8e72b5105fd225ee server_cookie=c5f775ec5ae335c5 in_seq=0 out_seq=0 2024-05-14T15:24:01.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.160+0000 7f95a2000700 10 client.15903 ms_handle_connect on v2:172.21.15.92:6834/360295917 2024-05-14T15:24:01.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.161+0000 7f95a2000700 1 -- 172.21.15.69:0/3200113953 <== mds.2 v2:172.21.15.92:6834/360295917 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557b17d1f400 con 0x557b17e740f0 2024-05-14T15:24:01.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.161+0000 7f95a2000700 10 client.15903 handle_command_reply: tid=0 2024-05-14T15:24:01.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.161+0000 7f95cd46bb80 1 client.15903 shutdown 2024-05-14T15:24:01.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.161+0000 7f95cd46bb80 1 -- 172.21.15.69:0/3200113953 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17defc50 msgr2=0x557b17dee700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:01.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.161+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/3200113953 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17defc50 0x557b17dee700 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f95a40a97b0 tx=0x7f95a40092d0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.161+0000 7f95cd46bb80 1 -- 172.21.15.69:0/3200113953 shutdown_connections 2024-05-14T15:24:01.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.161+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/3200113953 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x557b17e740f0 0x557b17e76510 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.161+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/3200113953 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557b17df5bf0 0x557b17deec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.161+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/3200113953 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557b17c71e40 0x557b17e01e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.161+0000 7f95cd46bb80 1 --2- 172.21.15.69:0/3200113953 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557b17defc50 0x557b17dee700 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.161+0000 7f95cd46bb80 1 -- 172.21.15.69:0/3200113953 >> 172.21.15.69:0/3200113953 conn(0x557b17cb0a80 msgr2=0x557b17df30a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:01.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.161+0000 7f95a2000700 0 client.15903 ms_handle_reset on v2:172.21.15.92:6834/360295917 2024-05-14T15:24:01.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.161+0000 7f95cd46bb80 1 -- 172.21.15.69:0/3200113953 shutdown_connections 2024-05-14T15:24:01.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.161+0000 7f95cd46bb80 1 -- 172.21.15.69:0/3200113953 wait complete. 2024-05-14T15:24:01.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.161+0000 7f95cd46bb80 20 client.15903 trim_cache size 0 max 16384 2024-05-14T15:24:01.163 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:24:01.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.162+0000 7f95bea00700 1 -- 172.21.15.69:0/2973011090 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f959c0b2a70 msgr2=0x7f959c0b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:01.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.162+0000 7f95bea00700 1 --2- 172.21.15.69:0/2973011090 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f959c0b2a70 0x7f959c0b4f80 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f95a8009c60 tx=0x7f95a8009260 comp rx=0 tx=0).stop 2024-05-14T15:24:01.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.162+0000 7f95bea00700 1 -- 172.21.15.69:0/2973011090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95b8108f30 msgr2=0x7f95b8076000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:01.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.162+0000 7f95bea00700 1 --2- 172.21.15.69:0/2973011090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95b8108f30 0x7f95b8076000 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f95a400e9f0 tx=0x7f95a400ed00 comp rx=0 tx=0).stop 2024-05-14T15:24:01.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.162+0000 7f95bea00700 1 -- 172.21.15.69:0/2973011090 shutdown_connections 2024-05-14T15:24:01.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.162+0000 7f95bea00700 1 --2- 172.21.15.69:0/2973011090 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f959c0b2a70 0x7f959c0b4f80 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.162+0000 7f95bea00700 1 --2- 172.21.15.69:0/2973011090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f95b8109880 0x7f95b8076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.162+0000 7f95bea00700 1 --2- 172.21.15.69:0/2973011090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f95b8104650 0x7f95b8075ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.162+0000 7f95bea00700 1 --2- 172.21.15.69:0/2973011090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f95b8108f30 0x7f95b8076000 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:01.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.162+0000 7f95bea00700 1 -- 172.21.15.69:0/2973011090 >> 172.21.15.69:0/2973011090 conn(0x7f95b8079f00 msgr2=0x7f95b8102010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:01.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.162+0000 7f95bea00700 1 -- 172.21.15.69:0/2973011090 shutdown_connections 2024-05-14T15:24:01.165 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:01.163+0000 7f95bea00700 1 -- 172.21.15.69:0/2973011090 wait complete. 2024-05-14T15:24:01.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:01 smithi092 ceph-mon[34729]: pgmap v74: 129 pgs: 129 active+clean; 461 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 18 MiB/s wr, 36 op/s 2024-05-14T15:24:01.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:01 smithi069 ceph-mon[31270]: pgmap v74: 129 pgs: 129 active+clean; 461 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 18 MiB/s wr, 36 op/s 2024-05-14T15:24:01.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:01 smithi203 ceph-mon[34567]: pgmap v74: 129 pgs: 129 active+clean; 461 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 18 MiB/s wr, 36 op/s 2024-05-14T15:24:02.185 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-14T15:24:02.406 INFO:teuthology.orchestra.run.smithi069.stderr:1900000 of 3200000 tuples (59%) done (elapsed 68.01 s, remaining 46.54 s) 2024-05-14T15:24:02.660 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:24:03.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:03 smithi092 ceph-mon[34729]: pgmap v75: 129 pgs: 129 active+clean; 461 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T15:24:03.447 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:03 smithi069 ceph-mon[31270]: pgmap v75: 129 pgs: 129 active+clean; 461 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T15:24:03.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:03 smithi203 ceph-mon[34567]: pgmap v75: 129 pgs: 129 active+clean; 461 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 11 MiB/s wr, 23 op/s 2024-05-14T15:24:05.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:05 smithi092 ceph-mon[34729]: pgmap v76: 129 pgs: 129 active+clean; 518 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 18 MiB/s wr, 52 op/s 2024-05-14T15:24:05.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:05 smithi069 ceph-mon[31270]: pgmap v76: 129 pgs: 129 active+clean; 518 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 18 MiB/s wr, 52 op/s 2024-05-14T15:24:05.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:05 smithi203 ceph-mon[34567]: pgmap v76: 129 pgs: 129 active+clean; 518 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 18 MiB/s wr, 52 op/s 2024-05-14T15:24:05.598 INFO:teuthology.orchestra.run.smithi069.stderr:2000000 of 3200000 tuples (62%) done (elapsed 71.21 s, remaining 42.72 s) 2024-05-14T15:24:06.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.381+0000 7f9d5d400700 1 -- 172.21.15.69:0/408644199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d5810e8e0 msgr2=0x7f9d58110dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:06.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.381+0000 7f9d5d400700 1 --2- 172.21.15.69:0/408644199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d5810e8e0 0x7f9d58110dc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009f90 tx=0x7f9d5000b330 comp rx=0 tx=0).stop 2024-05-14T15:24:06.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.382+0000 7f9d5d400700 1 -- 172.21.15.69:0/408644199 shutdown_connections 2024-05-14T15:24:06.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.382+0000 7f9d5d400700 1 --2- 172.21.15.69:0/408644199 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d5810e8e0 0x7f9d58110dc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.382+0000 7f9d5d400700 1 --2- 172.21.15.69:0/408644199 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d58105500 0x7f9d58105910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.382+0000 7f9d5d400700 1 --2- 172.21.15.69:0/408644199 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d58105e50 0x7f9d5810e3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.382+0000 7f9d5d400700 1 -- 172.21.15.69:0/408644199 >> 172.21.15.69:0/408644199 conn(0x7f9d580fedc0 msgr2=0x7f9d581011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:06.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.382+0000 7f9d5d400700 1 -- 172.21.15.69:0/408644199 shutdown_connections 2024-05-14T15:24:06.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.382+0000 7f9d5d400700 1 -- 172.21.15.69:0/408644199 wait complete. 2024-05-14T15:24:06.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.383+0000 7f9d5d400700 1 Processor -- start 2024-05-14T15:24:06.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.383+0000 7f9d5d400700 1 -- start start 2024-05-14T15:24:06.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.384+0000 7f9d5d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d58105500 0x7f9d581a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.384+0000 7f9d5d400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d58105e50 0x7f9d581a3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.384+0000 7f9d5d400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d5810e8e0 0x7f9d5819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.384+0000 7f9d5d400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9d58103730 con 0x7f9d58105500 2024-05-14T15:24:06.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.384+0000 7f9d5d400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d581035b0 con 0x7f9d5810e8e0 2024-05-14T15:24:06.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.384+0000 7f9d5d400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9d581038b0 con 0x7f9d58105e50 2024-05-14T15:24:06.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.384+0000 7f9d56800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d58105500 0x7f9d581a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.384+0000 7f9d56800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d58105500 0x7f9d581a2af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43958/0 (socket says 172.21.15.69:43958) 2024-05-14T15:24:06.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.384+0000 7f9d56800700 1 -- 172.21.15.69:0/1976123588 learned_addr learned my addr 172.21.15.69:0/1976123588 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:06.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.385+0000 7f9d55e00700 1 --2- 172.21.15.69:0/1976123588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d58105e50 0x7f9d581a3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.385+0000 7f9d57200700 1 --2- 172.21.15.69:0/1976123588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d5810e8e0 0x7f9d5819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.385+0000 7f9d56800700 1 -- 172.21.15.69:0/1976123588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d58105e50 msgr2=0x7f9d581a3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:06.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.385+0000 7f9d56800700 1 --2- 172.21.15.69:0/1976123588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d58105e50 0x7f9d581a3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.385+0000 7f9d56800700 1 -- 172.21.15.69:0/1976123588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d5810e8e0 msgr2=0x7f9d5819ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:06.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.385+0000 7f9d56800700 1 --2- 172.21.15.69:0/1976123588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d5810e8e0 0x7f9d5819ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.385+0000 7f9d56800700 1 -- 172.21.15.69:0/1976123588 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5819d500 con 0x7f9d58105500 2024-05-14T15:24:06.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.385+0000 7f9d57200700 1 --2- 172.21.15.69:0/1976123588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d5810e8e0 0x7f9d5819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:24:06.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.385+0000 7f9d56800700 1 --2- 172.21.15.69:0/1976123588 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d58105500 0x7f9d581a2af0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800e9a0 tx=0x7f9d4800ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:06.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.386+0000 7f9d4f400700 1 -- 172.21.15.69:0/1976123588 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4800cbd0 con 0x7f9d58105500 2024-05-14T15:24:06.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.386+0000 7f9d5d400700 1 -- 172.21.15.69:0/1976123588 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5819d790 con 0x7f9d58105500 2024-05-14T15:24:06.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.386+0000 7f9d4f400700 1 -- 172.21.15.69:0/1976123588 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d4800cd70 con 0x7f9d58105500 2024-05-14T15:24:06.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.386+0000 7f9d4f400700 1 -- 172.21.15.69:0/1976123588 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48018680 con 0x7f9d58105500 2024-05-14T15:24:06.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.386+0000 7f9d5d400700 1 -- 172.21.15.69:0/1976123588 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d581a9930 con 0x7f9d58105500 2024-05-14T15:24:06.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.390+0000 7f9d4f400700 1 -- 172.21.15.69:0/1976123588 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9d48010950 con 0x7f9d58105500 2024-05-14T15:24:06.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.392+0000 7f9d6bfa6b80 1 Processor -- start 2024-05-14T15:24:06.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.392+0000 7f9d4f400700 1 --2- 172.21.15.69:0/1976123588 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9d3c0b29f0 0x7f9d3c0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.392+0000 7f9d6bfa6b80 1 -- start start 2024-05-14T15:24:06.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.392+0000 7f9d4f400700 1 -- 172.21.15.69:0/1976123588 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f9d480e2d60 con 0x7f9d58105500 2024-05-14T15:24:06.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.392+0000 7f9d6bfa6b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d3169ee40 0x555d3182ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.393+0000 7f9d6bfa6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3182b3b0 0x555d31824f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.393+0000 7f9d6bfa6b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d31825460 0x555d31825870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.393+0000 7f9d6bfa6b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x555d3173ea20 con 0x555d31825460 2024-05-14T15:24:06.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.393+0000 7f9d6bfa6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555d316dc760 con 0x555d3182b3b0 2024-05-14T15:24:06.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.393+0000 7f9d6bfa6b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555d3173a9e0 con 0x555d3169ee40 2024-05-14T15:24:06.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.393+0000 7f9d57200700 1 --2- 172.21.15.69:0/1976123588 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9d3c0b29f0 0x7f9d3c0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.393+0000 7f9d55e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3182b3b0 0x555d31824f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.393+0000 7f9d57200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d31825460 0x555d31825870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.393+0000 7f9d56800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d3169ee40 0x555d3182ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.393+0000 7f9d57200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d31825460 0x555d31825870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43972/0 (socket says 172.21.15.69:43972) 2024-05-14T15:24:06.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.393+0000 7f9d57200700 1 -- 172.21.15.69:0/1016158875 learned_addr learned my addr 172.21.15.69:0/1016158875 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:06.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.394+0000 7f9d57200700 1 --2- 172.21.15.69:0/1976123588 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9d3c0b29f0 0x7f9d3c0b4f00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d50003b60 tx=0x7f9d50003b90 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:06.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.394+0000 7f9d57200700 1 -- 172.21.15.69:0/1016158875 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d3169ee40 msgr2=0x555d3182ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:06.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.394+0000 7f9d57200700 1 --2- 172.21.15.69:0/1016158875 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d3169ee40 0x555d3182ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.394+0000 7f9d57200700 1 -- 172.21.15.69:0/1016158875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3182b3b0 msgr2=0x555d31824f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:06.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.394+0000 7f9d57200700 1 --2- 172.21.15.69:0/1016158875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3182b3b0 0x555d31824f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.394+0000 7f9d57200700 1 -- 172.21.15.69:0/1016158875 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d3168b8d0 con 0x555d31825460 2024-05-14T15:24:06.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.395+0000 7f9d57200700 1 --2- 172.21.15.69:0/1016158875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d31825460 0x555d31825870 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9d50003db0 tx=0x7f9d50027000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8dbac4978a9b47c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:06.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.395+0000 7f9d43e00700 1 -- 172.21.15.69:0/1016158875 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d50003e60 con 0x555d31825460 2024-05-14T15:24:06.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.395+0000 7f9d43e00700 1 -- 172.21.15.69:0/1016158875 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d50007b90 con 0x555d31825460 2024-05-14T15:24:06.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.395+0000 7f9d43e00700 1 -- 172.21.15.69:0/1016158875 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5001fce0 con 0x555d31825460 2024-05-14T15:24:06.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.396+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/1016158875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d31825460 msgr2=0x555d31825870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:06.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.396+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/1016158875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d31825460 0x555d31825870 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9d50003db0 tx=0x7f9d50027000 comp rx=0 tx=0).stop 2024-05-14T15:24:06.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.396+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/1016158875 shutdown_connections 2024-05-14T15:24:06.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.396+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/1016158875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d31825460 0x555d31825870 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.396+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/1016158875 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d3169ee40 0x555d3182ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.396+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/1016158875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3182b3b0 0x555d31824f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.396+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/1016158875 >> 172.21.15.69:0/1016158875 conn(0x555d316dda80 msgr2=0x555d31817790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:06.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.396+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/1016158875 shutdown_connections 2024-05-14T15:24:06.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.396+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/1016158875 wait complete. 2024-05-14T15:24:06.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.397+0000 7f9d6bfa6b80 1 -- start start 2024-05-14T15:24:06.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.397+0000 7f9d6bfa6b80 1 Processor -- start 2024-05-14T15:24:06.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.398+0000 7f9d6bfa6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3169ee40 0x555d3182ec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.398+0000 7f9d6bfa6b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d31825460 0x555d3182f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.398+0000 7f9d6bfa6b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d3182b3b0 0x555d3182f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.398+0000 7f9d6bfa6b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x555d31831df0 con 0x555d3182b3b0 2024-05-14T15:24:06.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.398+0000 7f9d6bfa6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555d316a4b20 con 0x555d3169ee40 2024-05-14T15:24:06.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.398+0000 7f9d6bfa6b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555d31831f70 con 0x555d31825460 2024-05-14T15:24:06.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.398+0000 7f9d6bfa6b80 10 client.0 _ll_register_callbacks cb 0x555d316d2380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:06.399 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.398+0000 7f9d57200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d3182b3b0 0x555d3182f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.398+0000 7f9d57200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d3182b3b0 0x555d3182f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43976/0 (socket says 172.21.15.69:43976) 2024-05-14T15:24:06.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.398+0000 7f9d57200700 1 -- 172.21.15.69:0/2937093815 learned_addr learned my addr 172.21.15.69:0/2937093815 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:06.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.399+0000 7f9d55e00700 1 --2- 172.21.15.69:0/2937093815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d31825460 0x555d3182f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.399+0000 7f9d56800700 1 --2- 172.21.15.69:0/2937093815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3169ee40 0x555d3182ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.399+0000 7f9d57200700 1 -- 172.21.15.69:0/2937093815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d31825460 msgr2=0x555d3182f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:06.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.399+0000 7f9d57200700 1 --2- 172.21.15.69:0/2937093815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d31825460 0x555d3182f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.399+0000 7f9d57200700 1 -- 172.21.15.69:0/2937093815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3169ee40 msgr2=0x555d3182ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:06.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.399+0000 7f9d57200700 1 --2- 172.21.15.69:0/2937093815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3169ee40 0x555d3182ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.399+0000 7f9d57200700 1 -- 172.21.15.69:0/2937093815 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d31704420 con 0x555d3182b3b0 2024-05-14T15:24:06.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.399+0000 7f9d57200700 1 --2- 172.21.15.69:0/2937093815 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d3182b3b0 0x555d3182f710 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009d50 tx=0x7f9d5001f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00224e959859e43 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:06.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.399+0000 7f9d40c00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:06.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.400+0000 7f9d40c00700 1 -- 172.21.15.69:0/2937093815 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5002e040 con 0x555d3182b3b0 2024-05-14T15:24:06.401 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.400+0000 7f9d40c00700 1 -- 172.21.15.69:0/2937093815 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f9d500077c0 con 0x555d3182b3b0 2024-05-14T15:24:06.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.400+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/2937093815 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d50007b90 con 0x555d3182b3b0 2024-05-14T15:24:06.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.400+0000 7f9d40c00700 1 -- 172.21.15.69:0/2937093815 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9d50042050 con 0x555d3182b3b0 2024-05-14T15:24:06.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.400+0000 7f9d6bfa6b80 10 client.15915 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:06.402 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.400+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/2937093815 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x555d31831df0 con 0x555d3182b3b0 2024-05-14T15:24:06.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.401+0000 7f9d40c00700 1 -- 172.21.15.69:0/2937093815 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d50007b90 con 0x555d3182b3b0 2024-05-14T15:24:06.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.401+0000 7f9d40c00700 1 -- 172.21.15.69:0/2937093815 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f9d50011070 con 0x555d3182b3b0 2024-05-14T15:24:06.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.401+0000 7f9d6bfa6b80 10 client.15915 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:06.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.401+0000 7f9d6bfa6b80 10 client.15915 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-14T15:24:06.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.401+0000 7f9d6bfa6b80 20 client.15915 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:06.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.401+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/2937093815 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x555d3183ed20 0x555d31841140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.401+0000 7f9d6bfa6b80 4 client.15915 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:24:06.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.401+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/2937093815 --> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d317e9070 con 0x555d3183ed20 2024-05-14T15:24:06.403 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.402+0000 7f9d56800700 1 --2- 172.21.15.69:0/2937093815 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x555d3183ed20 0x555d31841140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.403+0000 7f9d56800700 1 --2- 172.21.15.69:0/2937093815 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x555d3183ed20 0x555d31841140 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=28721f949726cb36 server_cookie=889f5a7e0960fa1b in_seq=0 out_seq=0 2024-05-14T15:24:06.404 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.403+0000 7f9d40c00700 10 client.15915 ms_handle_connect on v2:172.21.15.92:6836/1669439322 2024-05-14T15:24:06.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.405+0000 7f9d40c00700 1 -- 172.21.15.69:0/2937093815 <== mds.1 v2:172.21.15.92:6836/1669439322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555d317e9070 con 0x555d3183ed20 2024-05-14T15:24:06.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.405+0000 7f9d40c00700 10 client.15915 handle_command_reply: tid=0 2024-05-14T15:24:06.405 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.405+0000 7f9d6bfa6b80 1 client.15915 shutdown 2024-05-14T15:24:06.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.405+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/2937093815 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d3182b3b0 msgr2=0x555d3182f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:06.406 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.405+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/2937093815 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d3182b3b0 0x555d3182f710 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f9d50009d50 tx=0x7f9d5001f6a0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.405+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/2937093815 shutdown_connections 2024-05-14T15:24:06.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.405+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/2937093815 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x555d3183ed20 0x555d31841140 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.405+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/2937093815 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d3182b3b0 0x555d3182f710 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.405+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/2937093815 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3169ee40 0x555d3182ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.405+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/2937093815 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d31825460 0x555d3182f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.405+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/2937093815 >> 172.21.15.69:0/2937093815 conn(0x555d316dda80 msgr2=0x555d3181b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:06.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.405+0000 7f9d40c00700 0 client.15915 ms_handle_reset on v2:172.21.15.92:6836/1669439322 2024-05-14T15:24:06.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.406+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/2937093815 shutdown_connections 2024-05-14T15:24:06.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.406+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/2937093815 wait complete. 2024-05-14T15:24:06.407 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.406+0000 7f9d6bfa6b80 20 client.15915 trim_cache size 0 max 16384 2024-05-14T15:24:06.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.422+0000 7f9d6bfa6b80 1 Processor -- start 2024-05-14T15:24:06.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.422+0000 7f9d6bfa6b80 1 -- start start 2024-05-14T15:24:06.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.423+0000 7f9d6bfa6b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d3169ee40 0x555d3182c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.423+0000 7f9d6bfa6b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d31825460 0x555d31828fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.423+0000 7f9d6bfa6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3182b3b0 0x555d3183ae80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.423+0000 7f9d6bfa6b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9d581ae290 con 0x555d3169ee40 2024-05-14T15:24:06.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.423+0000 7f9d6bfa6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d581aff50 con 0x555d3182b3b0 2024-05-14T15:24:06.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.423+0000 7f9d6bfa6b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9d581ae960 con 0x555d31825460 2024-05-14T15:24:06.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.423+0000 7f9d56800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d3169ee40 0x555d3182c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.423+0000 7f9d56800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d3169ee40 0x555d3182c950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43980/0 (socket says 172.21.15.69:43980) 2024-05-14T15:24:06.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.423+0000 7f9d56800700 1 -- 172.21.15.69:0/4158084516 learned_addr learned my addr 172.21.15.69:0/4158084516 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:06.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.423+0000 7f9d57200700 1 --2- 172.21.15.69:0/4158084516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3182b3b0 0x555d3183ae80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.424+0000 7f9d55e00700 1 --2- 172.21.15.69:0/4158084516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d31825460 0x555d31828fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.424+0000 7f9d56800700 1 -- 172.21.15.69:0/4158084516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d31825460 msgr2=0x555d31828fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:06.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.424+0000 7f9d56800700 1 --2- 172.21.15.69:0/4158084516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d31825460 0x555d31828fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.424+0000 7f9d56800700 1 -- 172.21.15.69:0/4158084516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3182b3b0 msgr2=0x555d3183ae80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:06.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.424+0000 7f9d56800700 1 --2- 172.21.15.69:0/4158084516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3182b3b0 0x555d3183ae80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.424+0000 7f9d56800700 1 -- 172.21.15.69:0/4158084516 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d31813d90 con 0x555d3169ee40 2024-05-14T15:24:06.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.424+0000 7f9d57200700 1 --2- 172.21.15.69:0/4158084516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3182b3b0 0x555d3183ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:24:06.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.424+0000 7f9d55e00700 1 --2- 172.21.15.69:0/4158084516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d31825460 0x555d31828fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:24:06.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.424+0000 7f9d56800700 1 --2- 172.21.15.69:0/4158084516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d3169ee40 0x555d3182c950 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9d480a5cb0 tx=0x7f9d480cc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7988245ecbf8e55e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:06.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.425+0000 7f9d43400700 1 -- 172.21.15.69:0/4158084516 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4808e070 con 0x555d3169ee40 2024-05-14T15:24:06.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.425+0000 7f9d43400700 1 -- 172.21.15.69:0/4158084516 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d480c2020 con 0x555d3169ee40 2024-05-14T15:24:06.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.425+0000 7f9d43400700 1 -- 172.21.15.69:0/4158084516 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d480a9e90 con 0x555d3169ee40 2024-05-14T15:24:06.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.426+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/4158084516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d3169ee40 msgr2=0x555d3182c950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:06.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.426+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/4158084516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d3169ee40 0x555d3182c950 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f9d480a5cb0 tx=0x7f9d480cc040 comp rx=0 tx=0).stop 2024-05-14T15:24:06.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.426+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/4158084516 shutdown_connections 2024-05-14T15:24:06.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.426+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/4158084516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d3169ee40 0x555d3182c950 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.426+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/4158084516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3182b3b0 0x555d3183ae80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.426+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/4158084516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d31825460 0x555d31828fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.426+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/4158084516 >> 172.21.15.69:0/4158084516 conn(0x555d316dda80 msgr2=0x555d318288d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:06.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.426+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/4158084516 shutdown_connections 2024-05-14T15:24:06.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.426+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/4158084516 wait complete. 2024-05-14T15:24:06.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.427+0000 7f9d6bfa6b80 1 -- start start 2024-05-14T15:24:06.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.427+0000 7f9d6bfa6b80 1 Processor -- start 2024-05-14T15:24:06.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.427+0000 7f9d6bfa6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3169ee40 0x555d31837560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.427+0000 7f9d6bfa6b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d31825460 0x555d31845bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.428+0000 7f9d6bfa6b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d3182b3b0 0x555d318460f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.428+0000 7f9d6bfa6b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9d581af7c0 con 0x555d31825460 2024-05-14T15:24:06.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.428+0000 7f9d6bfa6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9d581af060 con 0x555d3169ee40 2024-05-14T15:24:06.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.428+0000 7f9d6bfa6b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9d581ac230 con 0x555d3182b3b0 2024-05-14T15:24:06.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.428+0000 7f9d6bfa6b80 10 client.0 _ll_register_callbacks cb 0x555d316d2380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:06.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.428+0000 7f9d55e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d31825460 0x555d31845bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.428+0000 7f9d55e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d31825460 0x555d31845bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43982/0 (socket says 172.21.15.69:43982) 2024-05-14T15:24:06.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.428+0000 7f9d55e00700 1 -- 172.21.15.69:0/1557197350 learned_addr learned my addr 172.21.15.69:0/1557197350 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:06.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.428+0000 7f9d56800700 1 --2- 172.21.15.69:0/1557197350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3169ee40 0x555d31837560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.428+0000 7f9d57200700 1 --2- 172.21.15.69:0/1557197350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d3182b3b0 0x555d318460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.428+0000 7f9d55e00700 1 -- 172.21.15.69:0/1557197350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d3182b3b0 msgr2=0x555d318460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:06.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.428+0000 7f9d55e00700 1 --2- 172.21.15.69:0/1557197350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d3182b3b0 0x555d318460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.428+0000 7f9d55e00700 1 -- 172.21.15.69:0/1557197350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3169ee40 msgr2=0x555d31837560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:06.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.428+0000 7f9d55e00700 1 --2- 172.21.15.69:0/1557197350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3169ee40 0x555d31837560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.428+0000 7f9d55e00700 1 -- 172.21.15.69:0/1557197350 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d31846630 con 0x555d31825460 2024-05-14T15:24:06.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.428+0000 7f9d57200700 1 --2- 172.21.15.69:0/1557197350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d3182b3b0 0x555d318460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:24:06.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.429+0000 7f9d55e00700 1 --2- 172.21.15.69:0/1557197350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d31825460 0x555d31845bb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9d5810fbc0 tx=0x7f9d44014a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e28fc0e68d4770a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:06.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.429+0000 7f9d40c00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:06.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.429+0000 7f9d40c00700 1 -- 172.21.15.69:0/1557197350 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d44004250 con 0x555d31825460 2024-05-14T15:24:06.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.429+0000 7f9d40c00700 1 -- 172.21.15.69:0/1557197350 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f9d440043f0 con 0x555d31825460 2024-05-14T15:24:06.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.429+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/1557197350 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d480c2020 con 0x555d31825460 2024-05-14T15:24:06.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.430+0000 7f9d40c00700 1 -- 172.21.15.69:0/1557197350 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f9d44029050 con 0x555d31825460 2024-05-14T15:24:06.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.430+0000 7f9d6bfa6b80 10 client.15921 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:06.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.430+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/1557197350 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x555d318a8f70 con 0x555d31825460 2024-05-14T15:24:06.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.430+0000 7f9d40c00700 1 -- 172.21.15.69:0/1557197350 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9d480c2020 con 0x555d31825460 2024-05-14T15:24:06.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.430+0000 7f9d40c00700 1 -- 172.21.15.69:0/1557197350 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f9d44011640 con 0x555d31825460 2024-05-14T15:24:06.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.430+0000 7f9d6bfa6b80 10 client.15921 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:06.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.430+0000 7f9d6bfa6b80 10 client.15921 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-14T15:24:06.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.430+0000 7f9d6bfa6b80 20 client.15921 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:06.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.431+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/1557197350 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x555d318a97c0 0x555d318abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:06.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.431+0000 7f9d6bfa6b80 4 client.15921 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:24:06.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.431+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/1557197350 --> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555d3174c400 con 0x555d318a97c0 2024-05-14T15:24:06.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.432+0000 7f9d56800700 1 --2- 172.21.15.69:0/1557197350 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x555d318a97c0 0x555d318abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:06.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.432+0000 7f9d56800700 1 --2- 172.21.15.69:0/1557197350 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x555d318a97c0 0x555d318abbe0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c03cbd36a664eaee server_cookie=9b0c9f844749547 in_seq=0 out_seq=0 2024-05-14T15:24:06.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.432+0000 7f9d40c00700 10 client.15921 ms_handle_connect on v2:172.21.15.92:6836/1669439322 2024-05-14T15:24:06.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.433+0000 7f9d40c00700 1 -- 172.21.15.69:0/1557197350 <== mds.1 v2:172.21.15.92:6836/1669439322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555d3174c400 con 0x555d318a97c0 2024-05-14T15:24:06.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.433+0000 7f9d40c00700 10 client.15921 handle_command_reply: tid=0 2024-05-14T15:24:06.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.433+0000 7f9d6bfa6b80 1 client.15921 shutdown 2024-05-14T15:24:06.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.433+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/1557197350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d31825460 msgr2=0x555d31845bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:06.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.433+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/1557197350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d31825460 0x555d31845bb0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f9d5810fbc0 tx=0x7f9d44014a40 comp rx=0 tx=0).stop 2024-05-14T15:24:06.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.433+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/1557197350 shutdown_connections 2024-05-14T15:24:06.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.433+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/1557197350 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x555d318a97c0 0x555d318abbe0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.433+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/1557197350 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d3182b3b0 0x555d318460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.433+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/1557197350 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d3169ee40 0x555d31837560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.433+0000 7f9d6bfa6b80 1 --2- 172.21.15.69:0/1557197350 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d31825460 0x555d31845bb0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.433+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/1557197350 >> 172.21.15.69:0/1557197350 conn(0x555d316dda80 msgr2=0x555d3181b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:06.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.433+0000 7f9d40c00700 0 client.15921 ms_handle_reset on v2:172.21.15.92:6836/1669439322 2024-05-14T15:24:06.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.434+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/1557197350 shutdown_connections 2024-05-14T15:24:06.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.434+0000 7f9d6bfa6b80 1 -- 172.21.15.69:0/1557197350 wait complete. 2024-05-14T15:24:06.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.434+0000 7f9d6bfa6b80 20 client.15921 trim_cache size 0 max 16384 2024-05-14T15:24:06.436 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:24:06.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.435+0000 7f9d5d400700 1 -- 172.21.15.69:0/1976123588 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9d3c0b29f0 msgr2=0x7f9d3c0b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:06.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.435+0000 7f9d5d400700 1 --2- 172.21.15.69:0/1976123588 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9d3c0b29f0 0x7f9d3c0b4f00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d50003b60 tx=0x7f9d50003b90 comp rx=0 tx=0).stop 2024-05-14T15:24:06.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.435+0000 7f9d5d400700 1 -- 172.21.15.69:0/1976123588 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d58105500 msgr2=0x7f9d581a2af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.435+0000 7f9d5d400700 1 --2- 172.21.15.69:0/1976123588 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d58105500 0x7f9d581a2af0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800e9a0 tx=0x7f9d4800ed60 comp rx=0 tx=0).stop 2024-05-14T15:24:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.435+0000 7f9d5d400700 1 -- 172.21.15.69:0/1976123588 shutdown_connections 2024-05-14T15:24:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.435+0000 7f9d5d400700 1 --2- 172.21.15.69:0/1976123588 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9d3c0b29f0 0x7f9d3c0b4f00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.435+0000 7f9d5d400700 1 --2- 172.21.15.69:0/1976123588 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9d58105500 0x7f9d581a2af0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.435+0000 7f9d5d400700 1 --2- 172.21.15.69:0/1976123588 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9d5810e8e0 0x7f9d5819ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.435+0000 7f9d5d400700 1 --2- 172.21.15.69:0/1976123588 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9d58105e50 0x7f9d581a3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.435+0000 7f9d5d400700 1 -- 172.21.15.69:0/1976123588 >> 172.21.15.69:0/1976123588 conn(0x7f9d580fedc0 msgr2=0x7f9d5810fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.435+0000 7f9d5d400700 1 -- 172.21.15.69:0/1976123588 shutdown_connections 2024-05-14T15:24:06.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:06.435+0000 7f9d5d400700 1 -- 172.21.15.69:0/1976123588 wait complete. 2024-05-14T15:24:07.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:07 smithi069 ceph-mon[31270]: pgmap v77: 129 pgs: 129 active+clean; 518 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 41 op/s 2024-05-14T15:24:07.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:07 smithi092 ceph-mon[34729]: pgmap v77: 129 pgs: 129 active+clean; 518 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 41 op/s 2024-05-14T15:24:07.449 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-14T15:24:07.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:07 smithi203 ceph-mon[34567]: pgmap v77: 129 pgs: 129 active+clean; 518 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 41 op/s 2024-05-14T15:24:07.922 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:24:09.131 INFO:teuthology.orchestra.run.smithi069.stderr:2100000 of 3200000 tuples (65%) done (elapsed 74.74 s, remaining 39.15 s) 2024-05-14T15:24:09.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:09 smithi092 ceph-mon[34729]: pgmap v78: 129 pgs: 129 active+clean; 518 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 41 op/s 2024-05-14T15:24:09.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:09 smithi069 ceph-mon[31270]: pgmap v78: 129 pgs: 129 active+clean; 518 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 41 op/s 2024-05-14T15:24:09.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:09 smithi203 ceph-mon[34567]: pgmap v78: 129 pgs: 129 active+clean; 518 MiB data, 1.4 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 13 MiB/s wr, 41 op/s 2024-05-14T15:24:10.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.558+0000 7f703e800700 1 -- 172.21.15.69:0/3513246977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f703810af50 msgr2=0x7f703810b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:10.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.558+0000 7f703e800700 1 --2- 172.21.15.69:0/3513246977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f703810af50 0x7f703810b360 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f70240099c0 tx=0x7f7024009cd0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.558+0000 7f703e800700 1 -- 172.21.15.69:0/3513246977 shutdown_connections 2024-05-14T15:24:10.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.558+0000 7f703e800700 1 --2- 172.21.15.69:0/3513246977 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f703810b8a0 0x7f7038113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.558+0000 7f703e800700 1 --2- 172.21.15.69:0/3513246977 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7038106620 0x7f7038106a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.558+0000 7f703e800700 1 --2- 172.21.15.69:0/3513246977 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f703810af50 0x7f703810b360 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.558+0000 7f703e800700 1 -- 172.21.15.69:0/3513246977 >> 172.21.15.69:0/3513246977 conn(0x7f7038102030 msgr2=0x7f7038104450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:10.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.558+0000 7f703e800700 1 -- 172.21.15.69:0/3513246977 shutdown_connections 2024-05-14T15:24:10.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.558+0000 7f703e800700 1 -- 172.21.15.69:0/3513246977 wait complete. 2024-05-14T15:24:10.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.560+0000 7f703e800700 1 Processor -- start 2024-05-14T15:24:10.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.560+0000 7f703e800700 1 -- start start 2024-05-14T15:24:10.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.560+0000 7f703e800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7038106620 0x7f703819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.560+0000 7f703e800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f703810af50 0x7f703819d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.560+0000 7f703e800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f703810b8a0 0x7f70381a1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.560+0000 7f703e800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f70381163b0 con 0x7f7038106620 2024-05-14T15:24:10.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.560+0000 7f703e800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7038116230 con 0x7f703810af50 2024-05-14T15:24:10.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.560+0000 7f703e800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7038116530 con 0x7f703810b8a0 2024-05-14T15:24:10.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.561+0000 7f703d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7038106620 0x7f703819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.561+0000 7f703d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7038106620 0x7f703819ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44004/0 (socket says 172.21.15.69:44004) 2024-05-14T15:24:10.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.561+0000 7f703d400700 1 -- 172.21.15.69:0/2113961866 learned_addr learned my addr 172.21.15.69:0/2113961866 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:10.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.561+0000 7f703ca00700 1 --2- 172.21.15.69:0/2113961866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f703810af50 0x7f703819d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.561+0000 7f703de00700 1 --2- 172.21.15.69:0/2113961866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f703810b8a0 0x7f70381a1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.561+0000 7f703d400700 1 -- 172.21.15.69:0/2113961866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f703810b8a0 msgr2=0x7f70381a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:10.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.561+0000 7f703d400700 1 --2- 172.21.15.69:0/2113961866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f703810b8a0 0x7f70381a1670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.561+0000 7f703d400700 1 -- 172.21.15.69:0/2113961866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f703810af50 msgr2=0x7f703819d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:10.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.561+0000 7f703d400700 1 --2- 172.21.15.69:0/2113961866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f703810af50 0x7f703819d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.561+0000 7f703d400700 1 -- 172.21.15.69:0/2113961866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70381a1c60 con 0x7f7038106620 2024-05-14T15:24:10.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.562+0000 7f703d400700 1 --2- 172.21.15.69:0/2113961866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7038106620 0x7f703819ce40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f702c00c9b0 tx=0x7f702c00ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:10.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.562+0000 7f7036000700 1 -- 172.21.15.69:0/2113961866 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c007b00 con 0x7f7038106620 2024-05-14T15:24:10.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.562+0000 7f7036000700 1 -- 172.21.15.69:0/2113961866 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f702c007ca0 con 0x7f7038106620 2024-05-14T15:24:10.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.562+0000 7f703e800700 1 -- 172.21.15.69:0/2113961866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70381a1f50 con 0x7f7038106620 2024-05-14T15:24:10.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.562+0000 7f7036000700 1 -- 172.21.15.69:0/2113961866 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c018660 con 0x7f7038106620 2024-05-14T15:24:10.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.562+0000 7f703e800700 1 -- 172.21.15.69:0/2113961866 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70381a2460 con 0x7f7038106620 2024-05-14T15:24:10.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.567+0000 7f7036000700 1 -- 172.21.15.69:0/2113961866 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f702c004830 con 0x7f7038106620 2024-05-14T15:24:10.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.567+0000 7f704e939b80 1 Processor -- start 2024-05-14T15:24:10.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.568+0000 7f704e939b80 1 -- start start 2024-05-14T15:24:10.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.568+0000 7f704e939b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a488e40 0x55581a60c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.568+0000 7f704e939b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a60ca80 0x55581a606700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.568+0000 7f704e939b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a606c40 0x55581a607050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.568+0000 7f704e939b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55581a528a20 con 0x55581a60ca80 2024-05-14T15:24:10.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.568+0000 7f704e939b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55581a4c6760 con 0x55581a488e40 2024-05-14T15:24:10.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.568+0000 7f704e939b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55581a5249e0 con 0x55581a606c40 2024-05-14T15:24:10.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.568+0000 7f703d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a60ca80 0x55581a606700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.569+0000 7f703d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a60ca80 0x55581a606700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44020/0 (socket says 172.21.15.69:44020) 2024-05-14T15:24:10.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.569+0000 7f703d400700 1 -- 172.21.15.69:0/1223274073 learned_addr learned my addr 172.21.15.69:0/1223274073 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:10.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.569+0000 7f7036000700 1 --2- 172.21.15.69:0/2113961866 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f70200b29f0 0x7f70200b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.569+0000 7f703ca00700 1 --2- 172.21.15.69:0/1223274073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a606c40 0x55581a607050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.569+0000 7f7036000700 1 -- 172.21.15.69:0/2113961866 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f702c0e2a50 con 0x7f7038106620 2024-05-14T15:24:10.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.570+0000 7f703de00700 1 --2- 172.21.15.69:0/1223274073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a488e40 0x55581a60c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.570+0000 7f703de00700 1 --2- 172.21.15.69:0/2113961866 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f70200b29f0 0x7f70200b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.570+0000 7f703d400700 1 -- 172.21.15.69:0/1223274073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a606c40 msgr2=0x55581a607050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:10.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.570+0000 7f703d400700 1 --2- 172.21.15.69:0/1223274073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a606c40 0x55581a607050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.570+0000 7f703d400700 1 -- 172.21.15.69:0/1223274073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a488e40 msgr2=0x55581a60c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:10.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.570+0000 7f703d400700 1 --2- 172.21.15.69:0/1223274073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a488e40 0x55581a60c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.570+0000 7f703d400700 1 -- 172.21.15.69:0/1223274073 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55581a4758d0 con 0x55581a60ca80 2024-05-14T15:24:10.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.570+0000 7f703d400700 1 --2- 172.21.15.69:0/1223274073 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a60ca80 0x55581a606700 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f702c0bff50 tx=0x7f702c00ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9327f7e67d6afe9e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:10.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.571+0000 7f702aa00700 1 -- 172.21.15.69:0/1223274073 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c0a9270 con 0x55581a60ca80 2024-05-14T15:24:10.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.571+0000 7f703de00700 1 --2- 172.21.15.69:0/2113961866 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f70200b29f0 0x7f70200b4f00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55581a6079b0 tx=0x7f7030009680 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:10.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.571+0000 7f702aa00700 1 -- 172.21.15.69:0/1223274073 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f702c0b20d0 con 0x55581a60ca80 2024-05-14T15:24:10.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.571+0000 7f702aa00700 1 -- 172.21.15.69:0/1223274073 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c0a9090 con 0x55581a60ca80 2024-05-14T15:24:10.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.572+0000 7f704e939b80 1 -- 172.21.15.69:0/1223274073 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a60ca80 msgr2=0x55581a606700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:10.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.572+0000 7f704e939b80 1 --2- 172.21.15.69:0/1223274073 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a60ca80 0x55581a606700 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f702c0bff50 tx=0x7f702c00ff90 comp rx=0 tx=0).stop 2024-05-14T15:24:10.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.572+0000 7f704e939b80 1 -- 172.21.15.69:0/1223274073 shutdown_connections 2024-05-14T15:24:10.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.572+0000 7f704e939b80 1 --2- 172.21.15.69:0/1223274073 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a606c40 0x55581a607050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.572+0000 7f704e939b80 1 --2- 172.21.15.69:0/1223274073 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a488e40 0x55581a60c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.572+0000 7f704e939b80 1 --2- 172.21.15.69:0/1223274073 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a60ca80 0x55581a606700 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.572+0000 7f704e939b80 1 -- 172.21.15.69:0/1223274073 >> 172.21.15.69:0/1223274073 conn(0x55581a4cdf70 msgr2=0x55581a601400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:10.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.572+0000 7f704e939b80 1 -- 172.21.15.69:0/1223274073 shutdown_connections 2024-05-14T15:24:10.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.572+0000 7f704e939b80 1 -- 172.21.15.69:0/1223274073 wait complete. 2024-05-14T15:24:10.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.573+0000 7f704e939b80 1 -- start start 2024-05-14T15:24:10.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.573+0000 7f704e939b80 1 Processor -- start 2024-05-14T15:24:10.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.574+0000 7f704e939b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a488e40 0x55581a6101c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.574+0000 7f704e939b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a606c40 0x55581a610700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.574+0000 7f704e939b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a60ca80 0x55581a610c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.574+0000 7f704e939b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55581a613490 con 0x55581a488e40 2024-05-14T15:24:10.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.574+0000 7f704e939b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55581a48eb20 con 0x55581a606c40 2024-05-14T15:24:10.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.574+0000 7f704e939b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55581a613610 con 0x55581a60ca80 2024-05-14T15:24:10.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.574+0000 7f704e939b80 10 client.0 _ll_register_callbacks cb 0x55581a4cfc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:10.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.574+0000 7f703d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a488e40 0x55581a6101c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.574+0000 7f703d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a488e40 0x55581a6101c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44030/0 (socket says 172.21.15.69:44030) 2024-05-14T15:24:10.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.574+0000 7f703d400700 1 -- 172.21.15.69:0/3855118914 learned_addr learned my addr 172.21.15.69:0/3855118914 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:10.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.574+0000 7f703ca00700 1 --2- 172.21.15.69:0/3855118914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a606c40 0x55581a610700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.574+0000 7f703d400700 1 -- 172.21.15.69:0/3855118914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a60ca80 msgr2=0x55581a610c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:10.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.575+0000 7f703d400700 1 --2- 172.21.15.69:0/3855118914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a60ca80 0x55581a610c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.575+0000 7f703d400700 1 -- 172.21.15.69:0/3855118914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a606c40 msgr2=0x55581a610700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:10.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.575+0000 7f703d400700 1 --2- 172.21.15.69:0/3855118914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a606c40 0x55581a610700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.575+0000 7f703d400700 1 -- 172.21.15.69:0/3855118914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55581a4ee420 con 0x55581a488e40 2024-05-14T15:24:10.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.575+0000 7f703d400700 1 --2- 172.21.15.69:0/3855118914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a488e40 0x55581a6101c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f702c0a9620 tx=0x7f702c0a5f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed975fb523bf0f2a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:10.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.575+0000 7f701f400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:10.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.575+0000 7f701f400700 1 -- 172.21.15.69:0/3855118914 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c0a9090 con 0x55581a488e40 2024-05-14T15:24:10.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.575+0000 7f701f400700 1 -- 172.21.15.69:0/3855118914 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f702c0cadd0 con 0x55581a488e40 2024-05-14T15:24:10.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.575+0000 7f704e939b80 1 -- 172.21.15.69:0/3855118914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f702c0b20d0 con 0x55581a488e40 2024-05-14T15:24:10.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.576+0000 7f701f400700 1 -- 172.21.15.69:0/3855118914 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f702c0a9270 con 0x55581a488e40 2024-05-14T15:24:10.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.576+0000 7f704e939b80 10 client.15933 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:10.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.576+0000 7f704e939b80 1 -- 172.21.15.69:0/3855118914 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55581a61e0f0 con 0x55581a488e40 2024-05-14T15:24:10.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.576+0000 7f701f400700 1 -- 172.21.15.69:0/3855118914 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f702c0b20d0 con 0x55581a488e40 2024-05-14T15:24:10.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.576+0000 7f701f400700 1 -- 172.21.15.69:0/3855118914 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f702c06f1a0 con 0x55581a488e40 2024-05-14T15:24:10.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.576+0000 7f704e939b80 10 client.15933 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:10.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.576+0000 7f704e939b80 10 client.15933 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:24:10.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.576+0000 7f704e939b80 20 client.15933 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:10.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.576+0000 7f704e939b80 1 --2- 172.21.15.69:0/3855118914 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55581a6205c0 0x55581a6229e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.576+0000 7f704e939b80 4 client.15933 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:24:10.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.576+0000 7f704e939b80 1 -- 172.21.15.69:0/3855118914 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55581a5d31c0 con 0x55581a6205c0 2024-05-14T15:24:10.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.577+0000 7f703ca00700 1 --2- 172.21.15.69:0/3855118914 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55581a6205c0 0x55581a6229e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.578+0000 7f703ca00700 1 --2- 172.21.15.69:0/3855118914 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55581a6205c0 0x55581a6229e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4af2e88a77376b03 server_cookie=cde2160cb4a628c9 in_seq=0 out_seq=0 2024-05-14T15:24:10.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.578+0000 7f701f400700 10 client.15933 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:10.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.580+0000 7f701f400700 1 -- 172.21.15.69:0/3855118914 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55581a5d31c0 con 0x55581a6205c0 2024-05-14T15:24:10.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.580+0000 7f701f400700 10 client.15933 handle_command_reply: tid=0 2024-05-14T15:24:10.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.580+0000 7f704e939b80 1 client.15933 shutdown 2024-05-14T15:24:10.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.581+0000 7f704e939b80 1 -- 172.21.15.69:0/3855118914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a488e40 msgr2=0x55581a6101c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:10.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.581+0000 7f704e939b80 1 --2- 172.21.15.69:0/3855118914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a488e40 0x55581a6101c0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f702c0a9620 tx=0x7f702c0a5f10 comp rx=0 tx=0).stop 2024-05-14T15:24:10.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.581+0000 7f704e939b80 1 -- 172.21.15.69:0/3855118914 shutdown_connections 2024-05-14T15:24:10.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.581+0000 7f704e939b80 1 --2- 172.21.15.69:0/3855118914 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55581a6205c0 0x55581a6229e0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.581+0000 7f704e939b80 1 --2- 172.21.15.69:0/3855118914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a488e40 0x55581a6101c0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.581+0000 7f704e939b80 1 --2- 172.21.15.69:0/3855118914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a60ca80 0x55581a610c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.581+0000 7f704e939b80 1 --2- 172.21.15.69:0/3855118914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a606c40 0x55581a610700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.581+0000 7f704e939b80 1 -- 172.21.15.69:0/3855118914 >> 172.21.15.69:0/3855118914 conn(0x55581a4cdf70 msgr2=0x55581a6056f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:10.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.581+0000 7f701f400700 0 client.15933 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:10.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.581+0000 7f704e939b80 1 -- 172.21.15.69:0/3855118914 shutdown_connections 2024-05-14T15:24:10.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.581+0000 7f704e939b80 1 -- 172.21.15.69:0/3855118914 wait complete. 2024-05-14T15:24:10.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.581+0000 7f704e939b80 20 client.15933 trim_cache size 0 max 16384 2024-05-14T15:24:10.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.600+0000 7f704e939b80 1 Processor -- start 2024-05-14T15:24:10.600 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.600+0000 7f704e939b80 1 -- start start 2024-05-14T15:24:10.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.600+0000 7f704e939b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a488e40 0x55581a606700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.600+0000 7f704e939b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a606c40 0x55581a61c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.600+0000 7f704e939b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a60ca80 0x55581a610890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.600+0000 7f704e939b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f70381b24f0 con 0x55581a606c40 2024-05-14T15:24:10.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.600+0000 7f704e939b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f70381b41b0 con 0x55581a60ca80 2024-05-14T15:24:10.601 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.600+0000 7f704e939b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f70381b2bc0 con 0x55581a488e40 2024-05-14T15:24:10.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.601+0000 7f703ca00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a606c40 0x55581a61c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.601+0000 7f703ca00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a606c40 0x55581a61c940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44036/0 (socket says 172.21.15.69:44036) 2024-05-14T15:24:10.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.601+0000 7f703ca00700 1 -- 172.21.15.69:0/392788026 learned_addr learned my addr 172.21.15.69:0/392788026 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:10.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.601+0000 7f703d400700 1 --2- 172.21.15.69:0/392788026 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a488e40 0x55581a606700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.601+0000 7f703de00700 1 --2- 172.21.15.69:0/392788026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a60ca80 0x55581a610890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.601+0000 7f703ca00700 1 -- 172.21.15.69:0/392788026 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a488e40 msgr2=0x55581a606700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:10.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.601+0000 7f703ca00700 1 --2- 172.21.15.69:0/392788026 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a488e40 0x55581a606700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.601+0000 7f703ca00700 1 -- 172.21.15.69:0/392788026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a60ca80 msgr2=0x55581a610890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:10.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.601+0000 7f703ca00700 1 --2- 172.21.15.69:0/392788026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a60ca80 0x55581a610890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.601+0000 7f703ca00700 1 -- 172.21.15.69:0/392788026 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55581a612fc0 con 0x55581a606c40 2024-05-14T15:24:10.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.601+0000 7f703de00700 1 --2- 172.21.15.69:0/392788026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a60ca80 0x55581a610890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:24:10.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.602+0000 7f703ca00700 1 --2- 172.21.15.69:0/392788026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a606c40 0x55581a61c940 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7024009990 tx=0x7f7024005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c981791a0068aeb3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:10.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.602+0000 7f702a000700 1 -- 172.21.15.69:0/392788026 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702402d070 con 0x55581a606c40 2024-05-14T15:24:10.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.602+0000 7f702a000700 1 -- 172.21.15.69:0/392788026 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f702400be20 con 0x55581a606c40 2024-05-14T15:24:10.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.602+0000 7f702a000700 1 -- 172.21.15.69:0/392788026 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70240271b0 con 0x55581a606c40 2024-05-14T15:24:10.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.603+0000 7f704e939b80 1 -- 172.21.15.69:0/392788026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a606c40 msgr2=0x55581a61c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:10.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.603+0000 7f704e939b80 1 --2- 172.21.15.69:0/392788026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a606c40 0x55581a61c940 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f7024009990 tx=0x7f7024005040 comp rx=0 tx=0).stop 2024-05-14T15:24:10.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.603+0000 7f704e939b80 1 -- 172.21.15.69:0/392788026 shutdown_connections 2024-05-14T15:24:10.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.603+0000 7f704e939b80 1 --2- 172.21.15.69:0/392788026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a60ca80 0x55581a610890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.603+0000 7f704e939b80 1 --2- 172.21.15.69:0/392788026 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a488e40 0x55581a606700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.603+0000 7f704e939b80 1 --2- 172.21.15.69:0/392788026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a606c40 0x55581a61c940 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.603+0000 7f704e939b80 1 -- 172.21.15.69:0/392788026 >> 172.21.15.69:0/392788026 conn(0x55581a4cdf70 msgr2=0x55581a610180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:10.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.604+0000 7f704e939b80 1 -- 172.21.15.69:0/392788026 shutdown_connections 2024-05-14T15:24:10.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.604+0000 7f704e939b80 1 -- 172.21.15.69:0/392788026 wait complete. 2024-05-14T15:24:10.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.604+0000 7f704e939b80 1 -- start start 2024-05-14T15:24:10.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.605+0000 7f704e939b80 1 Processor -- start 2024-05-14T15:24:10.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.605+0000 7f704e939b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a488e40 0x55581a622da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.605+0000 7f704e939b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a606c40 0x55581a6232e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.605+0000 7f704e939b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a60ca80 0x55581a688b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.605+0000 7f704e939b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f70381b3a20 con 0x55581a488e40 2024-05-14T15:24:10.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.605+0000 7f704e939b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f70381b32c0 con 0x55581a606c40 2024-05-14T15:24:10.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.605+0000 7f704e939b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f70381b0490 con 0x55581a60ca80 2024-05-14T15:24:10.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.605+0000 7f704e939b80 10 client.0 _ll_register_callbacks cb 0x55581a4cfc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:10.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.606+0000 7f703d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a488e40 0x55581a622da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.606+0000 7f703d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a488e40 0x55581a622da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44038/0 (socket says 172.21.15.69:44038) 2024-05-14T15:24:10.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.606+0000 7f703d400700 1 -- 172.21.15.69:0/2543642345 learned_addr learned my addr 172.21.15.69:0/2543642345 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:10.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.606+0000 7f703de00700 1 --2- 172.21.15.69:0/2543642345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a60ca80 0x55581a688b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.606+0000 7f703ca00700 1 --2- 172.21.15.69:0/2543642345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a606c40 0x55581a6232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.606+0000 7f703d400700 1 -- 172.21.15.69:0/2543642345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a60ca80 msgr2=0x55581a688b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:10.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.606+0000 7f703d400700 1 --2- 172.21.15.69:0/2543642345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a60ca80 0x55581a688b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.606+0000 7f703d400700 1 -- 172.21.15.69:0/2543642345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a606c40 msgr2=0x55581a6232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:10.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.606+0000 7f703d400700 1 --2- 172.21.15.69:0/2543642345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a606c40 0x55581a6232e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.606+0000 7f703d400700 1 -- 172.21.15.69:0/2543642345 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55581a689070 con 0x55581a488e40 2024-05-14T15:24:10.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.606+0000 7f703ca00700 1 --2- 172.21.15.69:0/2543642345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a606c40 0x55581a6232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:24:10.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.607+0000 7f703d400700 1 --2- 172.21.15.69:0/2543642345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a488e40 0x55581a622da0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f702c00afd0 tx=0x7f702c0a94f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b713e20298696534 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:10.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.607+0000 7f701f400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:10.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.607+0000 7f701f400700 1 -- 172.21.15.69:0/2543642345 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f702c0a9090 con 0x55581a488e40 2024-05-14T15:24:10.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.607+0000 7f701f400700 1 -- 172.21.15.69:0/2543642345 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f702c0a8d80 con 0x55581a488e40 2024-05-14T15:24:10.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.607+0000 7f704e939b80 1 -- 172.21.15.69:0/2543642345 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f702400be20 con 0x55581a488e40 2024-05-14T15:24:10.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.607+0000 7f701f400700 1 -- 172.21.15.69:0/2543642345 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f702c0a57e0 con 0x55581a488e40 2024-05-14T15:24:10.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.607+0000 7f704e939b80 10 client.15939 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:10.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.607+0000 7f704e939b80 1 -- 172.21.15.69:0/2543642345 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55581a68a240 con 0x55581a488e40 2024-05-14T15:24:10.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.608+0000 7f701f400700 1 -- 172.21.15.69:0/2543642345 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f702400be20 con 0x55581a488e40 2024-05-14T15:24:10.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.608+0000 7f701f400700 1 -- 172.21.15.69:0/2543642345 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f702c0a85f0 con 0x55581a488e40 2024-05-14T15:24:10.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.608+0000 7f704e939b80 10 client.15939 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:10.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.608+0000 7f704e939b80 10 client.15939 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:24:10.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.608+0000 7f704e939b80 20 client.15939 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:10.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.608+0000 7f704e939b80 1 --2- 172.21.15.69:0/2543642345 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55581a68a6f0 0x55581a68cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:10.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.608+0000 7f704e939b80 4 client.15939 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:24:10.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.608+0000 7f704e939b80 1 -- 172.21.15.69:0/2543642345 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55581a536400 con 0x55581a68a6f0 2024-05-14T15:24:10.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.609+0000 7f703ca00700 1 --2- 172.21.15.69:0/2543642345 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55581a68a6f0 0x55581a68cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:10.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.610+0000 7f703ca00700 1 --2- 172.21.15.69:0/2543642345 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55581a68a6f0 0x55581a68cb10 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=598bc1536654ff16 server_cookie=dd8bf69d29ab55c5 in_seq=0 out_seq=0 2024-05-14T15:24:10.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.610+0000 7f701f400700 10 client.15939 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:10.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.610+0000 7f701f400700 1 -- 172.21.15.69:0/2543642345 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55581a536400 con 0x55581a68a6f0 2024-05-14T15:24:10.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.610+0000 7f701f400700 10 client.15939 handle_command_reply: tid=0 2024-05-14T15:24:10.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.610+0000 7f704e939b80 1 client.15939 shutdown 2024-05-14T15:24:10.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.610+0000 7f704e939b80 1 -- 172.21.15.69:0/2543642345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a488e40 msgr2=0x55581a622da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:10.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.610+0000 7f704e939b80 1 --2- 172.21.15.69:0/2543642345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a488e40 0x55581a622da0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f702c00afd0 tx=0x7f702c0a94f0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.611+0000 7f704e939b80 1 -- 172.21.15.69:0/2543642345 shutdown_connections 2024-05-14T15:24:10.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.611+0000 7f704e939b80 1 --2- 172.21.15.69:0/2543642345 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55581a68a6f0 0x55581a68cb10 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.611+0000 7f704e939b80 1 --2- 172.21.15.69:0/2543642345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55581a488e40 0x55581a622da0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.611+0000 7f704e939b80 1 --2- 172.21.15.69:0/2543642345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55581a60ca80 0x55581a688b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.611+0000 7f704e939b80 1 --2- 172.21.15.69:0/2543642345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55581a606c40 0x55581a6232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.611+0000 7f704e939b80 1 -- 172.21.15.69:0/2543642345 >> 172.21.15.69:0/2543642345 conn(0x55581a4cdf70 msgr2=0x55581a60a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:10.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.611+0000 7f701f400700 0 client.15939 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:10.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.611+0000 7f704e939b80 1 -- 172.21.15.69:0/2543642345 shutdown_connections 2024-05-14T15:24:10.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.611+0000 7f704e939b80 1 -- 172.21.15.69:0/2543642345 wait complete. 2024-05-14T15:24:10.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.611+0000 7f704e939b80 20 client.15939 trim_cache size 0 max 16384 2024-05-14T15:24:10.614 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:24:10.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.612+0000 7f703e800700 1 -- 172.21.15.69:0/2113961866 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f70200b29f0 msgr2=0x7f70200b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:10.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.612+0000 7f703e800700 1 --2- 172.21.15.69:0/2113961866 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f70200b29f0 0x7f70200b4f00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x55581a6079b0 tx=0x7f7030009680 comp rx=0 tx=0).stop 2024-05-14T15:24:10.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.612+0000 7f703e800700 1 -- 172.21.15.69:0/2113961866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7038106620 msgr2=0x7f703819ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:10.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.612+0000 7f703e800700 1 --2- 172.21.15.69:0/2113961866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7038106620 0x7f703819ce40 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f702c00c9b0 tx=0x7f702c00ccc0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.613+0000 7f703e800700 1 -- 172.21.15.69:0/2113961866 shutdown_connections 2024-05-14T15:24:10.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.613+0000 7f703e800700 1 --2- 172.21.15.69:0/2113961866 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f70200b29f0 0x7f70200b4f00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.613+0000 7f703e800700 1 --2- 172.21.15.69:0/2113961866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7038106620 0x7f703819ce40 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.613+0000 7f703e800700 1 --2- 172.21.15.69:0/2113961866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f703810b8a0 0x7f70381a1670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.613+0000 7f703e800700 1 --2- 172.21.15.69:0/2113961866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f703810af50 0x7f703819d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:10.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.613+0000 7f703e800700 1 -- 172.21.15.69:0/2113961866 >> 172.21.15.69:0/2113961866 conn(0x7f7038102030 msgr2=0x7f703810c800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:10.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.613+0000 7f703e800700 1 -- 172.21.15.69:0/2113961866 shutdown_connections 2024-05-14T15:24:10.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:10.613+0000 7f703e800700 1 -- 172.21.15.69:0/2113961866 wait complete. 2024-05-14T15:24:10.703 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:10 smithi069 ceph-mon[31270]: pgmap v79: 129 pgs: 129 active+clean; 560 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 51 op/s 2024-05-14T15:24:10.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:10 smithi203 ceph-mon[34567]: pgmap v79: 129 pgs: 129 active+clean; 560 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 51 op/s 2024-05-14T15:24:10.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:10 smithi092 ceph-mon[34729]: pgmap v79: 129 pgs: 129 active+clean; 560 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 19 MiB/s wr, 51 op/s 2024-05-14T15:24:12.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.559+0000 7f18bd800640 1 -- 172.21.15.69:0/3139629156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18b810bed0 msgr2=0x7f18b8105a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:12.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.559+0000 7f18bd800640 1 --2- 172.21.15.69:0/3139629156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18b810bed0 0x7f18b8105a70 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009900 tx=0x7f18a802a410 comp rx=0 tx=0).stop 2024-05-14T15:24:12.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.559+0000 7f18bd800640 1 -- 172.21.15.69:0/3139629156 shutdown_connections 2024-05-14T15:24:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.559+0000 7f18bd800640 1 --2- 172.21.15.69:0/3139629156 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18b8106620 0x7f18b81129f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.559+0000 7f18bd800640 1 --2- 172.21.15.69:0/3139629156 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b810c370 0x7f18b8105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.559+0000 7f18bd800640 1 --2- 172.21.15.69:0/3139629156 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18b810bed0 0x7f18b8105a70 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.559+0000 7f18bd800640 1 -- 172.21.15.69:0/3139629156 >> 172.21.15.69:0/3139629156 conn(0x7f18b81016c0 msgr2=0x7f18b8103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.560+0000 7f18bd800640 1 -- 172.21.15.69:0/3139629156 shutdown_connections 2024-05-14T15:24:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.560+0000 7f18bd800640 1 -- 172.21.15.69:0/3139629156 wait complete. 2024-05-14T15:24:12.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.561+0000 7f18bd800640 1 Processor -- start 2024-05-14T15:24:12.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.561+0000 7f18bd800640 1 -- start start 2024-05-14T15:24:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.562+0000 7f18bd800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b8106620 0x7f18b81a2680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.562+0000 7f18bd800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18b810bed0 0x7f18b81a2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.562+0000 7f18bd800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18b810c370 0x7f18b819c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.562+0000 7f18bd800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f18b8115fd0 con 0x7f18b810c370 2024-05-14T15:24:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.562+0000 7f18bd800640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f18b8115e50 con 0x7f18b810bed0 2024-05-14T15:24:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.562+0000 7f18bd800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f18b8116150 con 0x7f18b8106620 2024-05-14T15:24:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.562+0000 7f18b7400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18b810c370 0x7f18b819c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.562+0000 7f18b7400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18b810c370 0x7f18b819c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44054/0 (socket says 172.21.15.69:44054) 2024-05-14T15:24:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.562+0000 7f18b7400640 1 -- 172.21.15.69:0/1413517570 learned_addr learned my addr 172.21.15.69:0/1413517570 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:12.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.563+0000 7f18b6a00640 1 --2- 172.21.15.69:0/1413517570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b8106620 0x7f18b81a2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.563+0000 7f18b6000640 1 --2- 172.21.15.69:0/1413517570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18b810bed0 0x7f18b81a2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.563+0000 7f18b7400640 1 -- 172.21.15.69:0/1413517570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b8106620 msgr2=0x7f18b81a2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.563+0000 7f18b7400640 1 --2- 172.21.15.69:0/1413517570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b8106620 0x7f18b81a2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.563+0000 7f18b7400640 1 -- 172.21.15.69:0/1413517570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18b810bed0 msgr2=0x7f18b81a2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.563+0000 7f18b7400640 1 --2- 172.21.15.69:0/1413517570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18b810bed0 0x7f18b81a2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.563+0000 7f18b7400640 1 -- 172.21.15.69:0/1413517570 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18b819cf30 con 0x7f18b810c370 2024-05-14T15:24:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.563+0000 7f18b7400640 1 --2- 172.21.15.69:0/1413517570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18b810c370 0x7f18b819c890 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f18b000eaa0 tx=0x7f18b000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.564+0000 7f18af400640 1 -- 172.21.15.69:0/1413517570 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b000cdb0 con 0x7f18b810c370 2024-05-14T15:24:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.564+0000 7f18af400640 1 -- 172.21.15.69:0/1413517570 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18b0005020 con 0x7f18b810c370 2024-05-14T15:24:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.564+0000 7f18bd800640 1 -- 172.21.15.69:0/1413517570 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18b819d220 con 0x7f18b810c370 2024-05-14T15:24:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.564+0000 7f18af400640 1 -- 172.21.15.69:0/1413517570 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00116d0 con 0x7f18b810c370 2024-05-14T15:24:12.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.564+0000 7f18bd800640 1 -- 172.21.15.69:0/1413517570 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18b81a9500 con 0x7f18b810c370 2024-05-14T15:24:12.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.568+0000 7f18c4802740 1 Processor -- start 2024-05-14T15:24:12.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.569+0000 7f18af400640 1 -- 172.21.15.69:0/1413517570 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f18b0011870 con 0x7f18b810c370 2024-05-14T15:24:12.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.569+0000 7f18c4802740 1 -- start start 2024-05-14T15:24:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.570+0000 7f18c4802740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c2bd1b0 0x56321c65e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.570+0000 7f18c4802740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2942f0 0x56321c65e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.570+0000 7f18c4802740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c29c4d0 0x56321c65ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.570+0000 7f18c4802740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56321c5c3550 con 0x56321c29c4d0 2024-05-14T15:24:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.570+0000 7f18c4802740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56321c568bc0 con 0x56321c2bd1b0 2024-05-14T15:24:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.570+0000 7f18c4802740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56321c5bf510 con 0x56321c2942f0 2024-05-14T15:24:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.570+0000 7f18b6000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c29c4d0 0x56321c65ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.570+0000 7f18b6000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c29c4d0 0x56321c65ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44068/0 (socket says 172.21.15.69:44068) 2024-05-14T15:24:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.570+0000 7f18b6000640 1 -- 172.21.15.69:0/2310583400 learned_addr learned my addr 172.21.15.69:0/2310583400 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.570+0000 7f18b6000640 1 --2- 172.21.15.69:0/2310583400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c2bd1b0 0x56321c65e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.570+0000 7f18b6a00640 1 --2- 172.21.15.69:0/2310583400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2942f0 0x56321c65e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.571+0000 7f18b6000640 1 -- 172.21.15.69:0/2310583400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2942f0 msgr2=0x56321c65e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.571+0000 7f18b6000640 1 --2- 172.21.15.69:0/2310583400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2942f0 0x56321c65e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.571+0000 7f18b6000640 1 -- 172.21.15.69:0/2310583400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c2bd1b0 msgr2=0x56321c65e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.571+0000 7f18b6000640 1 --2- 172.21.15.69:0/2310583400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c2bd1b0 0x56321c65e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.571+0000 7f18b6000640 1 -- 172.21.15.69:0/2310583400 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56321c2d5210 con 0x56321c29c4d0 2024-05-14T15:24:12.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.571+0000 7f18af400640 1 --2- 172.21.15.69:0/1413517570 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f189c0b2950 0x7f189c0b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.571+0000 7f18b6000640 1 --2- 172.21.15.69:0/2310583400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c29c4d0 0x56321c65ed00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f18a40134e0 tx=0x7f18a400c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cefdb47f28b68e85 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:12.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.571+0000 7f18af400640 1 -- 172.21.15.69:0/1413517570 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f18b00e30a0 con 0x7f18b810c370 2024-05-14T15:24:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.571+0000 7f18b6a00640 1 --2- 172.21.15.69:0/1413517570 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f189c0b2950 0x7f189c0b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.571+0000 7f18a3e00640 1 -- 172.21.15.69:0/2310583400 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4004230 con 0x56321c29c4d0 2024-05-14T15:24:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.571+0000 7f18a3e00640 1 -- 172.21.15.69:0/2310583400 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18a401a070 con 0x56321c29c4d0 2024-05-14T15:24:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.571+0000 7f18a3e00640 1 -- 172.21.15.69:0/2310583400 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4011700 con 0x56321c29c4d0 2024-05-14T15:24:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.573+0000 7f18c4802740 1 -- 172.21.15.69:0/2310583400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c29c4d0 msgr2=0x56321c65ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.573+0000 7f18b6a00640 1 --2- 172.21.15.69:0/1413517570 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f189c0b2950 0x7f189c0b4e60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18a80057c0 tx=0x7f18a8005a20 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.573+0000 7f18c4802740 1 --2- 172.21.15.69:0/2310583400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c29c4d0 0x56321c65ed00 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f18a40134e0 tx=0x7f18a400c3b0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.573+0000 7f18c4802740 1 -- 172.21.15.69:0/2310583400 shutdown_connections 2024-05-14T15:24:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.573+0000 7f18c4802740 1 --2- 172.21.15.69:0/2310583400 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c29c4d0 0x56321c65ed00 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.573+0000 7f18c4802740 1 --2- 172.21.15.69:0/2310583400 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2942f0 0x56321c65e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.573+0000 7f18c4802740 1 --2- 172.21.15.69:0/2310583400 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c2bd1b0 0x56321c65e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.573+0000 7f18c4802740 1 -- 172.21.15.69:0/2310583400 >> 172.21.15.69:0/2310583400 conn(0x56321c2b1300 msgr2=0x56321c65aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.573+0000 7f18c4802740 1 -- 172.21.15.69:0/2310583400 shutdown_connections 2024-05-14T15:24:12.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.573+0000 7f18c4802740 1 -- 172.21.15.69:0/2310583400 wait complete. 2024-05-14T15:24:12.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.574+0000 7f18c4802740 1 -- start start 2024-05-14T15:24:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.574+0000 7f18c4802740 1 Processor -- start 2024-05-14T15:24:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.575+0000 7f18c4802740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c2942f0 0x56321c668740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.575+0000 7f18c4802740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c29c4d0 0x56321c668c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.575+0000 7f18c4802740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2bd1b0 0x56321c674860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.575+0000 7f18c4802740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56321c66b3b0 con 0x56321c2942f0 2024-05-14T15:24:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.575+0000 7f18c4802740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56321c57c660 con 0x56321c29c4d0 2024-05-14T15:24:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.575+0000 7f18c4802740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56321c66b530 con 0x56321c2bd1b0 2024-05-14T15:24:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.575+0000 7f18c4802740 10 client.0 _ll_register_callbacks cb 0x56321c546400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.575+0000 7f18b6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c2942f0 0x56321c668740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.575+0000 7f18b6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c2942f0 0x56321c668740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44070/0 (socket says 172.21.15.69:44070) 2024-05-14T15:24:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.575+0000 7f18b6a00640 1 -- 172.21.15.69:0/3993121549 learned_addr learned my addr 172.21.15.69:0/3993121549 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.575+0000 7f18b6000640 1 --2- 172.21.15.69:0/3993121549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c29c4d0 0x56321c668c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.575+0000 7f18b7400640 1 --2- 172.21.15.69:0/3993121549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2bd1b0 0x56321c674860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.576+0000 7f18b6a00640 1 -- 172.21.15.69:0/3993121549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2bd1b0 msgr2=0x56321c674860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.576+0000 7f18b6a00640 1 --2- 172.21.15.69:0/3993121549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2bd1b0 0x56321c674860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.576+0000 7f18b6a00640 1 -- 172.21.15.69:0/3993121549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c29c4d0 msgr2=0x56321c668c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.576+0000 7f18b6a00640 1 --2- 172.21.15.69:0/3993121549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c29c4d0 0x56321c668c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.576+0000 7f18b6a00640 1 -- 172.21.15.69:0/3993121549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56321c3a1620 con 0x56321c2942f0 2024-05-14T15:24:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.576+0000 7f18b6000640 1 --2- 172.21.15.69:0/3993121549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c29c4d0 0x56321c668c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:24:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.576+0000 7f18b7400640 1 --2- 172.21.15.69:0/3993121549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2bd1b0 0x56321c674860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:24:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.576+0000 7f18b6a00640 1 --2- 172.21.15.69:0/3993121549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c2942f0 0x56321c668740 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009900 tx=0x7f18a8009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e8362386d42bf6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.576+0000 7f18a0c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.576+0000 7f18a0c00640 1 -- 172.21.15.69:0/3993121549 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a804c070 con 0x56321c2942f0 2024-05-14T15:24:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.576+0000 7f18a0c00640 1 -- 172.21.15.69:0/3993121549 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f18a8004c10 con 0x56321c2942f0 2024-05-14T15:24:12.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.576+0000 7f18c4802740 1 -- 172.21.15.69:0/3993121549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18a401a070 con 0x56321c2942f0 2024-05-14T15:24:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.577+0000 7f18a0c00640 1 -- 172.21.15.69:0/3993121549 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f18a8058050 con 0x56321c2942f0 2024-05-14T15:24:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.577+0000 7f18c4802740 10 client.15951 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.577+0000 7f18c4802740 1 -- 172.21.15.69:0/3993121549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56321c6775c0 con 0x56321c2942f0 2024-05-14T15:24:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.577+0000 7f18a0c00640 1 -- 172.21.15.69:0/3993121549 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18a401a070 con 0x56321c2942f0 2024-05-14T15:24:12.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.577+0000 7f18a0c00640 1 -- 172.21.15.69:0/3993121549 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f18a80484c0 con 0x56321c2942f0 2024-05-14T15:24:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.577+0000 7f18c4802740 10 client.15951 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.577+0000 7f18c4802740 10 client.15951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:24:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.577+0000 7f18c4802740 20 client.15951 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.578+0000 7f18c4802740 1 --2- 172.21.15.69:0/3993121549 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56321c27bd80 0x56321c67abb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.578+0000 7f18c4802740 4 client.15951 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:24:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.578+0000 7f18c4802740 1 -- 172.21.15.69:0/3993121549 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56321c5d1160 con 0x56321c27bd80 2024-05-14T15:24:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.578+0000 7f18b6000640 1 --2- 172.21.15.69:0/3993121549 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56321c27bd80 0x56321c67abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.579+0000 7f18b6000640 1 --2- 172.21.15.69:0/3993121549 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56321c27bd80 0x56321c67abb0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=511a0181404b0db9 server_cookie=2384503e794fd54c in_seq=0 out_seq=0 2024-05-14T15:24:12.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.579+0000 7f18a0c00640 10 client.15951 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:12.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.581+0000 7f18a0c00640 1 -- 172.21.15.69:0/3993121549 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56321c5d1160 con 0x56321c27bd80 2024-05-14T15:24:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.581+0000 7f18a0c00640 10 client.15951 handle_command_reply: tid=0 2024-05-14T15:24:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.581+0000 7f18c4802740 1 client.15951 shutdown 2024-05-14T15:24:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.581+0000 7f18c4802740 1 -- 172.21.15.69:0/3993121549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c2942f0 msgr2=0x56321c668740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.581+0000 7f18c4802740 1 --2- 172.21.15.69:0/3993121549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c2942f0 0x56321c668740 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009900 tx=0x7f18a8009260 comp rx=0 tx=0).stop 2024-05-14T15:24:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.582+0000 7f18c4802740 1 -- 172.21.15.69:0/3993121549 shutdown_connections 2024-05-14T15:24:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.582+0000 7f18c4802740 1 --2- 172.21.15.69:0/3993121549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2bd1b0 0x56321c674860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.582+0000 7f18c4802740 1 --2- 172.21.15.69:0/3993121549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c29c4d0 0x56321c668c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.582+0000 7f18c4802740 1 --2- 172.21.15.69:0/3993121549 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56321c27bd80 0x56321c67abb0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.582+0000 7f18c4802740 1 --2- 172.21.15.69:0/3993121549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c2942f0 0x56321c668740 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.582+0000 7f18c4802740 1 -- 172.21.15.69:0/3993121549 >> 172.21.15.69:0/3993121549 conn(0x56321c2b1300 msgr2=0x56321c65ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.582+0000 7f18a0c00640 0 client.15951 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.582+0000 7f18c4802740 1 -- 172.21.15.69:0/3993121549 shutdown_connections 2024-05-14T15:24:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.582+0000 7f18c4802740 1 -- 172.21.15.69:0/3993121549 wait complete. 2024-05-14T15:24:12.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.582+0000 7f18c4802740 20 client.15951 trim_cache size 0 max 16384 2024-05-14T15:24:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.601+0000 7f18c4802740 1 Processor -- start 2024-05-14T15:24:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.602+0000 7f18c4802740 1 -- start start 2024-05-14T15:24:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.602+0000 7f18c4802740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2942f0 0x56321c667470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.602+0000 7f18c4802740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c29c4d0 0x56321c680370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.602+0000 7f18c4802740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c2bd1b0 0x56321c6808b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.602+0000 7f18c4802740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81b3430 con 0x56321c2bd1b0 2024-05-14T15:24:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.602+0000 7f18c4802740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81b50f0 con 0x56321c29c4d0 2024-05-14T15:24:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.602+0000 7f18c4802740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81b3b00 con 0x56321c2942f0 2024-05-14T15:24:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.602+0000 7f18b7400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c2bd1b0 0x56321c6808b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.602+0000 7f18b7400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c2bd1b0 0x56321c6808b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44072/0 (socket says 172.21.15.69:44072) 2024-05-14T15:24:12.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.602+0000 7f18b7400640 1 -- 172.21.15.69:0/2185280760 learned_addr learned my addr 172.21.15.69:0/2185280760 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:12.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.603+0000 7f18b6000640 1 --2- 172.21.15.69:0/2185280760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c29c4d0 0x56321c680370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.603+0000 7f18b6a00640 1 --2- 172.21.15.69:0/2185280760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2942f0 0x56321c667470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.603+0000 7f18b7400640 1 -- 172.21.15.69:0/2185280760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2942f0 msgr2=0x56321c667470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:12.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.603+0000 7f18b7400640 1 --2- 172.21.15.69:0/2185280760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2942f0 0x56321c667470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.603+0000 7f18b7400640 1 -- 172.21.15.69:0/2185280760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c29c4d0 msgr2=0x56321c680370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:12.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.603+0000 7f18b7400640 1 --2- 172.21.15.69:0/2185280760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c29c4d0 0x56321c680370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.603+0000 7f18b7400640 1 -- 172.21.15.69:0/2185280760 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56321c656270 con 0x56321c2bd1b0 2024-05-14T15:24:12.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.603+0000 7f18b6a00640 1 --2- 172.21.15.69:0/2185280760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2942f0 0x56321c667470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:24:12.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.603+0000 7f18b7400640 1 --2- 172.21.15.69:0/2185280760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c2bd1b0 0x56321c6808b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f18b00a71e0 tx=0x7f18b00a99f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc7c904579d8b73e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:12.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.604+0000 7f18a3400640 1 -- 172.21.15.69:0/2185280760 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b001f070 con 0x56321c2bd1b0 2024-05-14T15:24:12.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.604+0000 7f18a3400640 1 -- 172.21.15.69:0/2185280760 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18b00b2dd0 con 0x56321c2bd1b0 2024-05-14T15:24:12.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.604+0000 7f18a3400640 1 -- 172.21.15.69:0/2185280760 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b00b2940 con 0x56321c2bd1b0 2024-05-14T15:24:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.605+0000 7f18c4802740 1 -- 172.21.15.69:0/2185280760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c2bd1b0 msgr2=0x56321c6808b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.605+0000 7f18c4802740 1 --2- 172.21.15.69:0/2185280760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c2bd1b0 0x56321c6808b0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f18b00a71e0 tx=0x7f18b00a99f0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.605+0000 7f18c4802740 1 -- 172.21.15.69:0/2185280760 shutdown_connections 2024-05-14T15:24:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.605+0000 7f18c4802740 1 --2- 172.21.15.69:0/2185280760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c2bd1b0 0x56321c6808b0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.605+0000 7f18c4802740 1 --2- 172.21.15.69:0/2185280760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c29c4d0 0x56321c680370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.605+0000 7f18c4802740 1 --2- 172.21.15.69:0/2185280760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2942f0 0x56321c667470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.605+0000 7f18c4802740 1 -- 172.21.15.69:0/2185280760 >> 172.21.15.69:0/2185280760 conn(0x56321c2b1300 msgr2=0x56321c659a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.605+0000 7f18c4802740 1 -- 172.21.15.69:0/2185280760 shutdown_connections 2024-05-14T15:24:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.605+0000 7f18c4802740 1 -- 172.21.15.69:0/2185280760 wait complete. 2024-05-14T15:24:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.605+0000 7f18c4802740 1 -- start start 2024-05-14T15:24:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.606+0000 7f18c4802740 1 Processor -- start 2024-05-14T15:24:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.606+0000 7f18c4802740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2942f0 0x56321c66b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.606+0000 7f18c4802740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c29c4d0 0x56321c66bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.606+0000 7f18c4802740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c2bd1b0 0x56321c66c200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.606+0000 7f18c4802740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81b4960 con 0x56321c29c4d0 2024-05-14T15:24:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.606+0000 7f18c4802740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81b4200 con 0x56321c2bd1b0 2024-05-14T15:24:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.606+0000 7f18c4802740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f18b81b1410 con 0x56321c2942f0 2024-05-14T15:24:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.606+0000 7f18c4802740 10 client.0 _ll_register_callbacks cb 0x7f18a8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.607+0000 7f18b6000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c29c4d0 0x56321c66bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.607+0000 7f18b6000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c29c4d0 0x56321c66bcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44076/0 (socket says 172.21.15.69:44076) 2024-05-14T15:24:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.607+0000 7f18b6000640 1 -- 172.21.15.69:0/843602161 learned_addr learned my addr 172.21.15.69:0/843602161 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:12.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.607+0000 7f18b6a00640 1 --2- 172.21.15.69:0/843602161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2942f0 0x56321c66b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.607+0000 7f18b7400640 1 --2- 172.21.15.69:0/843602161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c2bd1b0 0x56321c66c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.607+0000 7f18b6000640 1 -- 172.21.15.69:0/843602161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2942f0 msgr2=0x56321c66b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.607+0000 7f18b6000640 1 --2- 172.21.15.69:0/843602161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2942f0 0x56321c66b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.607+0000 7f18b6000640 1 -- 172.21.15.69:0/843602161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c2bd1b0 msgr2=0x56321c66c200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.607+0000 7f18b6000640 1 --2- 172.21.15.69:0/843602161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c2bd1b0 0x56321c66c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.607+0000 7f18b6000640 1 -- 172.21.15.69:0/843602161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56321c6e0f10 con 0x56321c29c4d0 2024-05-14T15:24:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.607+0000 7f18b6000640 1 --2- 172.21.15.69:0/843602161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c29c4d0 0x56321c66bcc0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f18a400c3f0 tx=0x7f18a400c360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ff983b92cad70d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.607+0000 7f18a0c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.608+0000 7f18a0c00640 1 -- 172.21.15.69:0/843602161 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a4013260 con 0x56321c29c4d0 2024-05-14T15:24:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.608+0000 7f18a0c00640 1 -- 172.21.15.69:0/843602161 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f18a4003890 con 0x56321c29c4d0 2024-05-14T15:24:12.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.608+0000 7f18c4802740 1 -- 172.21.15.69:0/843602161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18b00b2dd0 con 0x56321c29c4d0 2024-05-14T15:24:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.608+0000 7f18a0c00640 1 -- 172.21.15.69:0/843602161 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f18a4039050 con 0x56321c29c4d0 2024-05-14T15:24:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.608+0000 7f18c4802740 10 client.15957 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.608+0000 7f18c4802740 1 -- 172.21.15.69:0/843602161 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56321c6e2050 con 0x56321c29c4d0 2024-05-14T15:24:12.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.608+0000 7f18a0c00640 1 -- 172.21.15.69:0/843602161 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f18b00b2dd0 con 0x56321c29c4d0 2024-05-14T15:24:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.609+0000 7f18a0c00640 1 -- 172.21.15.69:0/843602161 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f18a4003e80 con 0x56321c29c4d0 2024-05-14T15:24:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.609+0000 7f18c4802740 10 client.15957 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.609+0000 7f18c4802740 10 client.15957 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:24:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.609+0000 7f18c4802740 20 client.15957 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.609+0000 7f18c4802740 1 --2- 172.21.15.69:0/843602161 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56321c2511c0 0x56321c6e4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.609+0000 7f18c4802740 4 client.15957 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:24:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.609+0000 7f18c4802740 1 -- 172.21.15.69:0/843602161 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56321c5cafd0 con 0x56321c2511c0 2024-05-14T15:24:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.610+0000 7f18b6a00640 1 --2- 172.21.15.69:0/843602161 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56321c2511c0 0x56321c6e4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.610+0000 7f18a0c00640 10 client.15957 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:12.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.610+0000 7f18b6a00640 1 --2- 172.21.15.69:0/843602161 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56321c2511c0 0x56321c6e4750 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67c3fabbc7f61f61 server_cookie=2c102d2383c6e742 in_seq=0 out_seq=0 2024-05-14T15:24:12.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.657+0000 7f18a0c00640 1 -- 172.21.15.69:0/843602161 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56321c5cafd0 con 0x56321c2511c0 2024-05-14T15:24:12.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.657+0000 7f18a0c00640 10 client.15957 handle_command_reply: tid=0 2024-05-14T15:24:12.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.657+0000 7f18c4802740 1 client.15957 shutdown 2024-05-14T15:24:12.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.657+0000 7f18c4802740 1 -- 172.21.15.69:0/843602161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c29c4d0 msgr2=0x56321c66bcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:12.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.657+0000 7f18c4802740 1 --2- 172.21.15.69:0/843602161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c29c4d0 0x56321c66bcc0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f18a400c3f0 tx=0x7f18a400c360 comp rx=0 tx=0).stop 2024-05-14T15:24:12.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.657+0000 7f18c4802740 1 -- 172.21.15.69:0/843602161 shutdown_connections 2024-05-14T15:24:12.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.657+0000 7f18c4802740 1 --2- 172.21.15.69:0/843602161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56321c2bd1b0 0x56321c66c200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.657+0000 7f18c4802740 1 --2- 172.21.15.69:0/843602161 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56321c2511c0 0x56321c6e4750 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.657+0000 7f18c4802740 1 --2- 172.21.15.69:0/843602161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56321c29c4d0 0x56321c66bcc0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.657+0000 7f18c4802740 1 --2- 172.21.15.69:0/843602161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56321c2942f0 0x56321c66b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.657+0000 7f18a0c00640 0 client.15957 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:12.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.657+0000 7f18c4802740 1 -- 172.21.15.69:0/843602161 >> 172.21.15.69:0/843602161 conn(0x56321c2b1300 msgr2=0x56321c659a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:12.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.657+0000 7f18c4802740 1 -- 172.21.15.69:0/843602161 shutdown_connections 2024-05-14T15:24:12.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.658+0000 7f18c4802740 1 -- 172.21.15.69:0/843602161 wait complete. 2024-05-14T15:24:12.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.658+0000 7f18c4802740 20 client.15957 trim_cache size 0 max 16384 2024-05-14T15:24:12.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:24:12.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:24:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:24:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:24:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.659+0000 7f18bd800640 1 -- 172.21.15.69:0/1413517570 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f189c0b2950 msgr2=0x7f189c0b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.659+0000 7f18bd800640 1 --2- 172.21.15.69:0/1413517570 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f189c0b2950 0x7f189c0b4e60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f18a80057c0 tx=0x7f18a8005a20 comp rx=0 tx=0).stop 2024-05-14T15:24:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.659+0000 7f18bd800640 1 -- 172.21.15.69:0/1413517570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18b810c370 msgr2=0x7f18b819c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.659+0000 7f18bd800640 1 --2- 172.21.15.69:0/1413517570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18b810c370 0x7f18b819c890 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f18b000eaa0 tx=0x7f18b000ef60 comp rx=0 tx=0).stop 2024-05-14T15:24:12.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.659+0000 7f18bd800640 1 -- 172.21.15.69:0/1413517570 shutdown_connections 2024-05-14T15:24:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.659+0000 7f18bd800640 1 --2- 172.21.15.69:0/1413517570 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f189c0b2950 0x7f189c0b4e60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.659+0000 7f18bd800640 1 --2- 172.21.15.69:0/1413517570 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18b810c370 0x7f18b819c890 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.659+0000 7f18bd800640 1 --2- 172.21.15.69:0/1413517570 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f18b810bed0 0x7f18b81a2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.659+0000 7f18bd800640 1 --2- 172.21.15.69:0/1413517570 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18b8106620 0x7f18b81a2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.659+0000 7f18bd800640 1 -- 172.21.15.69:0/1413517570 >> 172.21.15.69:0/1413517570 conn(0x7f18b81016c0 msgr2=0x7f18b8101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.659+0000 7f18bd800640 1 -- 172.21.15.69:0/1413517570 shutdown_connections 2024-05-14T15:24:12.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:12.659+0000 7f18bd800640 1 -- 172.21.15.69:0/1413517570 wait complete. 2024-05-14T15:24:12.797 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-14T15:24:12.797 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-14T15:24:12.898 INFO:teuthology.orchestra.run.smithi069.stderr:2200000 of 3200000 tuples (68%) done (elapsed 78.51 s, remaining 35.68 s) 2024-05-14T15:24:13.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:12 smithi069 ceph-mon[31270]: pgmap v80: 129 pgs: 129 active+clean; 560 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 39 op/s 2024-05-14T15:24:13.258 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:24:13.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:12 smithi203 ceph-mon[34567]: pgmap v80: 129 pgs: 129 active+clean; 560 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 39 op/s 2024-05-14T15:24:13.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:12 smithi092 ceph-mon[34729]: pgmap v80: 129 pgs: 129 active+clean; 560 MiB data, 1.5 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 13 MiB/s wr, 39 op/s 2024-05-14T15:24:15.304 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:14 smithi069 ceph-mon[31270]: pgmap v81: 129 pgs: 129 active+clean; 592 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 18 MiB/s wr, 51 op/s 2024-05-14T15:24:15.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:14 smithi203 ceph-mon[34567]: pgmap v81: 129 pgs: 129 active+clean; 592 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 18 MiB/s wr, 51 op/s 2024-05-14T15:24:15.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:14 smithi092 ceph-mon[34729]: pgmap v81: 129 pgs: 129 active+clean; 592 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 18 MiB/s wr, 51 op/s 2024-05-14T15:24:15.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.730+0000 7f469ac00700 1 -- 172.21.15.69:0/4152233774 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4694108f40 msgr2=0x7f4694109350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:15.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.730+0000 7f469ac00700 1 --2- 172.21.15.69:0/4152233774 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4694108f40 0x7f4694109350 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f46800099c0 tx=0x7f4680009cd0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.730+0000 7f469ac00700 1 -- 172.21.15.69:0/4152233774 shutdown_connections 2024-05-14T15:24:15.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.730+0000 7f469ac00700 1 --2- 172.21.15.69:0/4152233774 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4694109890 0x7f46941111f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.730+0000 7f469ac00700 1 --2- 172.21.15.69:0/4152233774 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4694104610 0x7f4694104a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.730+0000 7f469ac00700 1 --2- 172.21.15.69:0/4152233774 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4694108f40 0x7f4694109350 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.730+0000 7f469ac00700 1 -- 172.21.15.69:0/4152233774 >> 172.21.15.69:0/4152233774 conn(0x7f469407af70 msgr2=0x7f469407b3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:15.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.730+0000 7f469ac00700 1 -- 172.21.15.69:0/4152233774 shutdown_connections 2024-05-14T15:24:15.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.730+0000 7f469ac00700 1 -- 172.21.15.69:0/4152233774 wait complete. 2024-05-14T15:24:15.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.732+0000 7f469ac00700 1 Processor -- start 2024-05-14T15:24:15.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.732+0000 7f469ac00700 1 -- start start 2024-05-14T15:24:15.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.733+0000 7f469ac00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4694104610 0x7f4694075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.733+0000 7f469ac00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4694108f40 0x7f4694076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.733+0000 7f469ac00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4694109890 0x7f4694076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.733+0000 7f469ac00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f46941143a0 con 0x7f4694108f40 2024-05-14T15:24:15.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.733+0000 7f469ac00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4694114220 con 0x7f4694109890 2024-05-14T15:24:15.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.733+0000 7f469ac00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4694114520 con 0x7f4694104610 2024-05-14T15:24:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.734+0000 7f4693400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4694108f40 0x7f4694076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.734+0000 7f4693400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4694108f40 0x7f4694076000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36178/0 (socket says 172.21.15.69:36178) 2024-05-14T15:24:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.734+0000 7f4693400700 1 -- 172.21.15.69:0/640570648 learned_addr learned my addr 172.21.15.69:0/640570648 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.734+0000 7f4693e00700 1 --2- 172.21.15.69:0/640570648 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4694104610 0x7f4694075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.734+0000 7f4698c00700 1 --2- 172.21.15.69:0/640570648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4694109890 0x7f4694076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.734+0000 7f4693400700 1 -- 172.21.15.69:0/640570648 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4694104610 msgr2=0x7f4694075ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.734+0000 7f4693400700 1 --2- 172.21.15.69:0/640570648 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4694104610 0x7f4694075ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.734+0000 7f4693400700 1 -- 172.21.15.69:0/640570648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4694109890 msgr2=0x7f4694076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.734+0000 7f4693400700 1 --2- 172.21.15.69:0/640570648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4694109890 0x7f4694076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.734+0000 7f4693400700 1 -- 172.21.15.69:0/640570648 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46941a9150 con 0x7f4694108f40 2024-05-14T15:24:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.735+0000 7f4693400700 1 --2- 172.21.15.69:0/640570648 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4694108f40 0x7f4694076000 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f468000b580 tx=0x7f46800057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.735+0000 7f4690c00700 1 -- 172.21.15.69:0/640570648 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680027070 con 0x7f4694108f40 2024-05-14T15:24:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.735+0000 7f4690c00700 1 -- 172.21.15.69:0/640570648 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f468000fd30 con 0x7f4694108f40 2024-05-14T15:24:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.735+0000 7f4690c00700 1 -- 172.21.15.69:0/640570648 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4680022e50 con 0x7f4694108f40 2024-05-14T15:24:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.735+0000 7f469ac00700 1 -- 172.21.15.69:0/640570648 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46941a93e0 con 0x7f4694108f40 2024-05-14T15:24:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.736+0000 7f469ac00700 1 -- 172.21.15.69:0/640570648 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46941a9830 con 0x7f4694108f40 2024-05-14T15:24:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.740+0000 7f4690c00700 1 -- 172.21.15.69:0/640570648 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f468002a070 con 0x7f4694108f40 2024-05-14T15:24:15.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.742+0000 7f46a978cb80 1 Processor -- start 2024-05-14T15:24:15.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.742+0000 7f46a978cb80 1 -- start start 2024-05-14T15:24:15.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.743+0000 7f46a978cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cbd4ec0 0x56059cd58370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.743+0000 7f46a978cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd588b0 0x56059cd52530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.743+0000 7f46a978cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd52a70 0x56059cd52e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.743+0000 7f46a978cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56059cc74aa0 con 0x56059cd52a70 2024-05-14T15:24:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.743+0000 7f46a978cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56059cc127e0 con 0x56059cd588b0 2024-05-14T15:24:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.743+0000 7f46a978cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56059cc70a60 con 0x56059cbd4ec0 2024-05-14T15:24:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.743+0000 7f4690c00700 1 --2- 172.21.15.69:0/640570648 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f46780b2b90 0x7f46780b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.743+0000 7f4690c00700 1 -- 172.21.15.69:0/640570648 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f46800e36d0 con 0x7f4694108f40 2024-05-14T15:24:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.743+0000 7f4693e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd588b0 0x56059cd52530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.743+0000 7f4693e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd588b0 0x56059cd52530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:57368/0 (socket says 172.21.15.69:57368) 2024-05-14T15:24:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.744+0000 7f4693e00700 1 -- 172.21.15.69:0/1399416610 learned_addr learned my addr 172.21.15.69:0/1399416610 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.744+0000 7f4698c00700 1 --2- 172.21.15.69:0/640570648 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f46780b2b90 0x7f46780b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.744+0000 7f4693400700 1 --2- 172.21.15.69:0/1399416610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd52a70 0x56059cd52e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.744+0000 7f4693e00700 1 -- 172.21.15.69:0/1399416610 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cbd4ec0 msgr2=0x56059cd58370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:24:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.744+0000 7f4693e00700 1 --2- 172.21.15.69:0/1399416610 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cbd4ec0 0x56059cd58370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.744+0000 7f4693e00700 1 -- 172.21.15.69:0/1399416610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd52a70 msgr2=0x56059cd52e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:15.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.744+0000 7f4693e00700 1 --2- 172.21.15.69:0/1399416610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd52a70 0x56059cd52e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.744+0000 7f4693e00700 1 -- 172.21.15.69:0/1399416610 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56059cbc1950 con 0x56059cd588b0 2024-05-14T15:24:15.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.745+0000 7f4698c00700 1 --2- 172.21.15.69:0/640570648 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f46780b2b90 0x7f46780b50a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f468c009cb0 tx=0x7f468c009040 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:15.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.745+0000 7f4693e00700 1 --2- 172.21.15.69:0/1399416610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd588b0 0x56059cd52530 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f468400bd70 tx=0x7f46840106b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2002dbe13758562c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:15.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.745+0000 7f4689600700 1 -- 172.21.15.69:0/1399416610 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4684010e40 con 0x56059cd588b0 2024-05-14T15:24:15.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.746+0000 7f4689600700 1 -- 172.21.15.69:0/1399416610 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f468401c910 con 0x56059cd588b0 2024-05-14T15:24:15.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.746+0000 7f4689600700 1 -- 172.21.15.69:0/1399416610 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4684011800 con 0x56059cd588b0 2024-05-14T15:24:15.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.747+0000 7f46a978cb80 1 -- 172.21.15.69:0/1399416610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd588b0 msgr2=0x56059cd52530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:15.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.747+0000 7f46a978cb80 1 --2- 172.21.15.69:0/1399416610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd588b0 0x56059cd52530 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f468400bd70 tx=0x7f46840106b0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.747+0000 7f46a978cb80 1 -- 172.21.15.69:0/1399416610 shutdown_connections 2024-05-14T15:24:15.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.747+0000 7f46a978cb80 1 --2- 172.21.15.69:0/1399416610 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd52a70 0x56059cd52e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.747+0000 7f46a978cb80 1 --2- 172.21.15.69:0/1399416610 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cbd4ec0 0x56059cd58370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.747+0000 7f46a978cb80 1 --2- 172.21.15.69:0/1399416610 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd588b0 0x56059cd52530 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.747+0000 7f46a978cb80 1 -- 172.21.15.69:0/1399416610 >> 172.21.15.69:0/1399416610 conn(0x56059cc19ff0 msgr2=0x56059cd4d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:15.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.747+0000 7f46a978cb80 1 -- 172.21.15.69:0/1399416610 shutdown_connections 2024-05-14T15:24:15.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.748+0000 7f46a978cb80 1 -- 172.21.15.69:0/1399416610 wait complete. 2024-05-14T15:24:15.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.748+0000 7f46a978cb80 1 -- start start 2024-05-14T15:24:15.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.749+0000 7f46a978cb80 1 Processor -- start 2024-05-14T15:24:15.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.750+0000 7f46a978cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cbd4ec0 0x56059cd5bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.750+0000 7f46a978cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd52a70 0x56059cd5c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.750+0000 7f46a978cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd5ca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.750+0000 7f46a978cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56059cd5f390 con 0x56059cd588b0 2024-05-14T15:24:15.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.750+0000 7f46a978cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56059cbdaba0 con 0x56059cd52a70 2024-05-14T15:24:15.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.750+0000 7f46a978cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56059cd5f510 con 0x56059cbd4ec0 2024-05-14T15:24:15.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.750+0000 7f46a978cb80 10 client.0 _ll_register_callbacks cb 0x56059cc1bcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:15.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.750+0000 7f4698c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd5ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.750+0000 7f4698c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd5ca40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36196/0 (socket says 172.21.15.69:36196) 2024-05-14T15:24:15.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.750+0000 7f4698c00700 1 -- 172.21.15.69:0/2041181548 learned_addr learned my addr 172.21.15.69:0/2041181548 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:15.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.750+0000 7f4693400700 1 --2- 172.21.15.69:0/2041181548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd52a70 0x56059cd5c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.750+0000 7f4693e00700 1 --2- 172.21.15.69:0/2041181548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cbd4ec0 0x56059cd5bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.751+0000 7f4698c00700 1 -- 172.21.15.69:0/2041181548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cbd4ec0 msgr2=0x56059cd5bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:15.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.751+0000 7f4698c00700 1 --2- 172.21.15.69:0/2041181548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cbd4ec0 0x56059cd5bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.751+0000 7f4698c00700 1 -- 172.21.15.69:0/2041181548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd52a70 msgr2=0x56059cd5c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:15.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.751+0000 7f4698c00700 1 --2- 172.21.15.69:0/2041181548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd52a70 0x56059cd5c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.751+0000 7f4698c00700 1 -- 172.21.15.69:0/2041181548 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56059cc3a4a0 con 0x56059cd588b0 2024-05-14T15:24:15.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.752+0000 7f4698c00700 1 --2- 172.21.15.69:0/2041181548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd5ca40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f468c018aa0 tx=0x7f468c004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d34888f934ce6e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:15.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.752+0000 7f467e000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:15.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.752+0000 7f467e000700 1 -- 172.21.15.69:0/2041181548 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c026060 con 0x56059cd588b0 2024-05-14T15:24:15.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.752+0000 7f467e000700 1 -- 172.21.15.69:0/2041181548 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f468c0147e0 con 0x56059cd588b0 2024-05-14T15:24:15.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.752+0000 7f46a978cb80 1 -- 172.21.15.69:0/2041181548 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f468401c910 con 0x56059cd588b0 2024-05-14T15:24:15.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.753+0000 7f467e000700 1 -- 172.21.15.69:0/2041181548 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f468c02d050 con 0x56059cd588b0 2024-05-14T15:24:15.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.753+0000 7f46a978cb80 10 client.15969 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:15.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.753+0000 7f46a978cb80 1 -- 172.21.15.69:0/2041181548 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56059cd69ee0 con 0x56059cd588b0 2024-05-14T15:24:15.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.753+0000 7f467e000700 1 -- 172.21.15.69:0/2041181548 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f468401c910 con 0x56059cd588b0 2024-05-14T15:24:15.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.753+0000 7f467e000700 1 -- 172.21.15.69:0/2041181548 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f468c016720 con 0x56059cd588b0 2024-05-14T15:24:15.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.753+0000 7f46a978cb80 10 client.15969 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:15.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.753+0000 7f46a978cb80 10 client.15969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:24:15.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.753+0000 7f46a978cb80 20 client.15969 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:15.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.753+0000 7f46a978cb80 1 --2- 172.21.15.69:0/2041181548 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56059cd6c520 0x56059cd6e980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.753+0000 7f46a978cb80 4 client.15969 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:24:15.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.753+0000 7f46a978cb80 1 -- 172.21.15.69:0/2041181548 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56059cd1f240 con 0x56059cd6c520 2024-05-14T15:24:15.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.754+0000 7f4693e00700 1 --2- 172.21.15.69:0/2041181548 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56059cd6c520 0x56059cd6e980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.755+0000 7f467e000700 10 client.15969 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:15.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.755+0000 7f4693e00700 1 --2- 172.21.15.69:0/2041181548 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56059cd6c520 0x56059cd6e980 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf764f8e82ec4ffc server_cookie=ce6da66647dbf15d in_seq=0 out_seq=0 2024-05-14T15:24:15.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.757+0000 7f467e000700 1 -- 172.21.15.69:0/2041181548 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56059cd1f240 con 0x56059cd6c520 2024-05-14T15:24:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.757+0000 7f467e000700 10 client.15969 handle_command_reply: tid=0 2024-05-14T15:24:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.757+0000 7f46a978cb80 1 client.15969 shutdown 2024-05-14T15:24:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.757+0000 7f46a978cb80 1 -- 172.21.15.69:0/2041181548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 msgr2=0x56059cd5ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.757+0000 7f46a978cb80 1 --2- 172.21.15.69:0/2041181548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd5ca40 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f468c018aa0 tx=0x7f468c004ad0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.757+0000 7f46a978cb80 1 -- 172.21.15.69:0/2041181548 shutdown_connections 2024-05-14T15:24:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.757+0000 7f46a978cb80 1 --2- 172.21.15.69:0/2041181548 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56059cd6c520 0x56059cd6e980 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.757+0000 7f46a978cb80 1 --2- 172.21.15.69:0/2041181548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd5ca40 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.757+0000 7f46a978cb80 1 --2- 172.21.15.69:0/2041181548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cbd4ec0 0x56059cd5bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.757+0000 7f46a978cb80 1 --2- 172.21.15.69:0/2041181548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd52a70 0x56059cd5c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.757+0000 7f46a978cb80 1 -- 172.21.15.69:0/2041181548 >> 172.21.15.69:0/2041181548 conn(0x56059cc19ff0 msgr2=0x56059cd51520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:15.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.758+0000 7f467e000700 0 client.15969 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:15.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.758+0000 7f46a978cb80 1 -- 172.21.15.69:0/2041181548 shutdown_connections 2024-05-14T15:24:15.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.758+0000 7f46a978cb80 1 -- 172.21.15.69:0/2041181548 wait complete. 2024-05-14T15:24:15.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.758+0000 7f46a978cb80 20 client.15969 trim_cache size 0 max 16384 2024-05-14T15:24:15.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.783+0000 7f46a978cb80 1 Processor -- start 2024-05-14T15:24:15.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.783+0000 7f46a978cb80 1 -- start start 2024-05-14T15:24:15.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.783+0000 7f46a978cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cbd4ec0 0x56059cd52530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.783+0000 7f46a978cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cd52a70 0x56059cd47830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.783+0000 7f46a978cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd68440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.783+0000 7f46a978cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f46941ae330 con 0x56059cd588b0 2024-05-14T15:24:15.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.783+0000 7f46a978cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f46941afff0 con 0x56059cbd4ec0 2024-05-14T15:24:15.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.783+0000 7f46a978cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f46941aea00 con 0x56059cd52a70 2024-05-14T15:24:15.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.784+0000 7f4698c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd68440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.784+0000 7f4698c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd68440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36206/0 (socket says 172.21.15.69:36206) 2024-05-14T15:24:15.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.784+0000 7f4698c00700 1 -- 172.21.15.69:0/2031217650 learned_addr learned my addr 172.21.15.69:0/2031217650 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:15.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.784+0000 7f4693e00700 1 --2- 172.21.15.69:0/2031217650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cbd4ec0 0x56059cd52530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.784+0000 7f4693400700 1 --2- 172.21.15.69:0/2031217650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cd52a70 0x56059cd47830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.785+0000 7f4698c00700 1 -- 172.21.15.69:0/2031217650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cd52a70 msgr2=0x56059cd47830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:15.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.785+0000 7f4698c00700 1 --2- 172.21.15.69:0/2031217650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cd52a70 0x56059cd47830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.785+0000 7f4698c00700 1 -- 172.21.15.69:0/2031217650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cbd4ec0 msgr2=0x56059cd52530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:15.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.785+0000 7f4698c00700 1 --2- 172.21.15.69:0/2031217650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cbd4ec0 0x56059cd52530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.785+0000 7f4698c00700 1 -- 172.21.15.69:0/2031217650 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56059cd5ef70 con 0x56059cd588b0 2024-05-14T15:24:15.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.785+0000 7f4693e00700 1 --2- 172.21.15.69:0/2031217650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cbd4ec0 0x56059cd52530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:24:15.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.785+0000 7f4698c00700 1 --2- 172.21.15.69:0/2031217650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd68440 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f468c000f80 tx=0x7f468c007bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e413737be1bb5048 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:15.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.785+0000 7f4688c00700 1 -- 172.21.15.69:0/2031217650 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c004b40 con 0x56059cd588b0 2024-05-14T15:24:15.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.785+0000 7f4688c00700 1 -- 172.21.15.69:0/2031217650 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f468c0168b0 con 0x56059cd588b0 2024-05-14T15:24:15.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.785+0000 7f4688c00700 1 -- 172.21.15.69:0/2031217650 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c014a70 con 0x56059cd588b0 2024-05-14T15:24:15.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.787+0000 7f46a978cb80 1 -- 172.21.15.69:0/2031217650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 msgr2=0x56059cd68440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:15.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.787+0000 7f46a978cb80 1 --2- 172.21.15.69:0/2031217650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd68440 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f468c000f80 tx=0x7f468c007bb0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.787+0000 7f46a978cb80 1 -- 172.21.15.69:0/2031217650 shutdown_connections 2024-05-14T15:24:15.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.787+0000 7f46a978cb80 1 --2- 172.21.15.69:0/2031217650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd68440 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.787+0000 7f46a978cb80 1 --2- 172.21.15.69:0/2031217650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cbd4ec0 0x56059cd52530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.787+0000 7f46a978cb80 1 --2- 172.21.15.69:0/2031217650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cd52a70 0x56059cd47830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.787+0000 7f46a978cb80 1 -- 172.21.15.69:0/2031217650 >> 172.21.15.69:0/2031217650 conn(0x56059cc19ff0 msgr2=0x56059cd47120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:15.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.787+0000 7f46a978cb80 1 -- 172.21.15.69:0/2031217650 shutdown_connections 2024-05-14T15:24:15.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.787+0000 7f46a978cb80 1 -- 172.21.15.69:0/2031217650 wait complete. 2024-05-14T15:24:15.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.788+0000 7f46a978cb80 1 -- start start 2024-05-14T15:24:15.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.788+0000 7f46a978cb80 1 Processor -- start 2024-05-14T15:24:15.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.789+0000 7f46a978cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cbd4ec0 0x56059cd647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.789+0000 7f46a978cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd52a70 0x56059cd64d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.789+0000 7f46a978cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd61790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.789+0000 7f46a978cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f46941af860 con 0x56059cd588b0 2024-05-14T15:24:15.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.789+0000 7f46a978cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f46941af100 con 0x56059cd52a70 2024-05-14T15:24:15.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.789+0000 7f46a978cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f46941ac2d0 con 0x56059cbd4ec0 2024-05-14T15:24:15.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.789+0000 7f46a978cb80 10 client.0 _ll_register_callbacks cb 0x56059cc1bcf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:15.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.789+0000 7f4698c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd61790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.789+0000 7f4698c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd61790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36220/0 (socket says 172.21.15.69:36220) 2024-05-14T15:24:15.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.789+0000 7f4698c00700 1 -- 172.21.15.69:0/784427651 learned_addr learned my addr 172.21.15.69:0/784427651 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:15.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.789+0000 7f4693400700 1 --2- 172.21.15.69:0/784427651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd52a70 0x56059cd64d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.790+0000 7f4693e00700 1 --2- 172.21.15.69:0/784427651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cbd4ec0 0x56059cd647c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.790+0000 7f4698c00700 1 -- 172.21.15.69:0/784427651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cbd4ec0 msgr2=0x56059cd647c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:15.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.790+0000 7f4698c00700 1 --2- 172.21.15.69:0/784427651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cbd4ec0 0x56059cd647c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.790+0000 7f4698c00700 1 -- 172.21.15.69:0/784427651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd52a70 msgr2=0x56059cd64d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:15.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.790+0000 7f4698c00700 1 --2- 172.21.15.69:0/784427651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd52a70 0x56059cd64d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.790+0000 7f4698c00700 1 -- 172.21.15.69:0/784427651 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56059cd61ec0 con 0x56059cd588b0 2024-05-14T15:24:15.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.790+0000 7f4698c00700 1 --2- 172.21.15.69:0/784427651 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd61790 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f468c004fa0 tx=0x7f468c018e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42848ec90f636bee server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:15.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.790+0000 7f467e000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:15.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.791+0000 7f467e000700 1 -- 172.21.15.69:0/784427651 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f468c03f060 con 0x56059cd588b0 2024-05-14T15:24:15.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.791+0000 7f467e000700 1 -- 172.21.15.69:0/784427651 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f468c036040 con 0x56059cd588b0 2024-05-14T15:24:15.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.791+0000 7f46a978cb80 1 -- 172.21.15.69:0/784427651 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56059cc82480 con 0x56059cd588b0 2024-05-14T15:24:15.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.791+0000 7f467e000700 1 -- 172.21.15.69:0/784427651 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f468c016420 con 0x56059cd588b0 2024-05-14T15:24:15.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.791+0000 7f46a978cb80 10 client.15975 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:15.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.791+0000 7f46a978cb80 1 -- 172.21.15.69:0/784427651 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56059cdd7750 con 0x56059cd588b0 2024-05-14T15:24:15.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.792+0000 7f467e000700 1 -- 172.21.15.69:0/784427651 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56059cc82480 con 0x56059cd588b0 2024-05-14T15:24:15.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.792+0000 7f467e000700 1 -- 172.21.15.69:0/784427651 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f468c03a480 con 0x56059cd588b0 2024-05-14T15:24:15.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.792+0000 7f46a978cb80 10 client.15975 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:15.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.792+0000 7f46a978cb80 10 client.15975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:24:15.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.792+0000 7f46a978cb80 20 client.15975 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:15.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.792+0000 7f46a978cb80 1 --2- 172.21.15.69:0/784427651 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56059cdd7d70 0x56059cdda190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:15.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.792+0000 7f46a978cb80 4 client.15975 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-14T15:24:15.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.792+0000 7f46a978cb80 1 -- 172.21.15.69:0/784427651 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56059cc7c520 con 0x56059cdd7d70 2024-05-14T15:24:15.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.793+0000 7f4693e00700 1 --2- 172.21.15.69:0/784427651 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56059cdd7d70 0x56059cdda190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:15.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.794+0000 7f4693e00700 1 --2- 172.21.15.69:0/784427651 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56059cdd7d70 0x56059cdda190 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ccbc11e1eb8733d3 server_cookie=89953f72249e059f in_seq=0 out_seq=0 2024-05-14T15:24:15.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.794+0000 7f467e000700 10 client.15975 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:15.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.796+0000 7f467e000700 1 -- 172.21.15.69:0/784427651 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56059cc7c520 con 0x56059cdd7d70 2024-05-14T15:24:15.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.796+0000 7f467e000700 10 client.15975 handle_command_reply: tid=0 2024-05-14T15:24:15.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.796+0000 7f46a978cb80 1 client.15975 shutdown 2024-05-14T15:24:15.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.797+0000 7f46a978cb80 1 -- 172.21.15.69:0/784427651 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 msgr2=0x56059cd61790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:15.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.797+0000 7f46a978cb80 1 --2- 172.21.15.69:0/784427651 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd61790 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f468c004fa0 tx=0x7f468c018e60 comp rx=0 tx=0).stop 2024-05-14T15:24:15.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.797+0000 7f46a978cb80 1 -- 172.21.15.69:0/784427651 shutdown_connections 2024-05-14T15:24:15.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.797+0000 7f46a978cb80 1 --2- 172.21.15.69:0/784427651 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56059cdd7d70 0x56059cdda190 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.797+0000 7f46a978cb80 1 --2- 172.21.15.69:0/784427651 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56059cd588b0 0x56059cd61790 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.797+0000 7f46a978cb80 1 --2- 172.21.15.69:0/784427651 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56059cbd4ec0 0x56059cd647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.797+0000 7f46a978cb80 1 --2- 172.21.15.69:0/784427651 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56059cd52a70 0x56059cd64d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.797+0000 7f46a978cb80 1 -- 172.21.15.69:0/784427651 >> 172.21.15.69:0/784427651 conn(0x56059cc19ff0 msgr2=0x56059cd56590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:15.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.797+0000 7f467e000700 0 client.15975 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:15.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.797+0000 7f46a978cb80 1 -- 172.21.15.69:0/784427651 shutdown_connections 2024-05-14T15:24:15.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.797+0000 7f46a978cb80 1 -- 172.21.15.69:0/784427651 wait complete. 2024-05-14T15:24:15.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.798+0000 7f46a978cb80 20 client.15975 trim_cache size 0 max 16384 2024-05-14T15:24:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:24:15.799 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2024-05-14T15:24:15.799 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "95b7d2ba-4fed-4c3c-bf45-54e0e7d9c2c9", 2024-05-14T15:24:15.799 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2024-05-14T15:24:15.799 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:24:15.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.799+0000 7f469ac00700 1 -- 172.21.15.69:0/640570648 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f46780b2b90 msgr2=0x7f46780b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:15.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.799+0000 7f469ac00700 1 --2- 172.21.15.69:0/640570648 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f46780b2b90 0x7f46780b50a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f468c009cb0 tx=0x7f468c009040 comp rx=0 tx=0).stop 2024-05-14T15:24:15.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.799+0000 7f469ac00700 1 -- 172.21.15.69:0/640570648 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4694108f40 msgr2=0x7f4694076000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:15.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.799+0000 7f469ac00700 1 --2- 172.21.15.69:0/640570648 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4694108f40 0x7f4694076000 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f468000b580 tx=0x7f46800057c0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.799+0000 7f469ac00700 1 -- 172.21.15.69:0/640570648 shutdown_connections 2024-05-14T15:24:15.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.799+0000 7f469ac00700 1 --2- 172.21.15.69:0/640570648 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f46780b2b90 0x7f46780b50a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.799+0000 7f469ac00700 1 --2- 172.21.15.69:0/640570648 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4694109890 0x7f4694076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.799+0000 7f469ac00700 1 --2- 172.21.15.69:0/640570648 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4694104610 0x7f4694075ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.799+0000 7f469ac00700 1 --2- 172.21.15.69:0/640570648 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4694108f40 0x7f4694076000 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:15.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.799+0000 7f469ac00700 1 -- 172.21.15.69:0/640570648 >> 172.21.15.69:0/640570648 conn(0x7f469407af70 msgr2=0x7f4694101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:15.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.799+0000 7f469ac00700 1 -- 172.21.15.69:0/640570648 shutdown_connections 2024-05-14T15:24:15.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:15.800+0000 7f469ac00700 1 -- 172.21.15.69:0/640570648 wait complete. 2024-05-14T15:24:15.807 INFO:teuthology.orchestra.run.smithi069.stderr:2300000 of 3200000 tuples (71%) done (elapsed 81.42 s, remaining 31.86 s) 2024-05-14T15:24:16.193 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:24:15 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b[64556]: 2024-05-14T15:24:15.824+0000 7f1329000700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001b [...3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical/ auth{1=1,2=1,3=1,4=1} v634 ap=2 f(v10 m2024-05-14T15:22:33.427523+0000 3=1+2) n(v3 rc2024-05-14T15:22:33.427523+0000 b8 4=1+3) (inest sync->mix g=1,2,3,4) caps={25000=pAsLsXsFs/-@53} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55799700a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001b:[<0x10000000006/pg_logical v46>,<0x10000000005/data v96>,<0x10000000003/postgres v21>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v37>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v46>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000001b:[<0x10000000006/pg_logical v634>,<0x10000000005/data v484>,<0x10000000003/postgres v180>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v194>,<0x10000000001/sv_0 v209>,<0x10000000000/qa v197>,<0x1/volumes v184>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-14T15:22:33.396239+0000 4=2+2)","ondisk_value.rstat":"n(v0 rc2024-05-14T15:22:33.427523+0000 b8 4=1+3)","memory_value.dirstat":"f(v10 m2024-05-14T15:22:33.427523+0000 3=1+2)","memory_value.rstat":"n(v3 rc2024-05-14T15:22:33.427523+0000 b8 4=1+3)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-14T15:24:16.193 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:24:15 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b[64556]: 2024-05-14T15:24:15.833+0000 7f1329000700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000019 [...5,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_stat_tmp/ auth{1=1,2=1,3=1,4=1} v795 ap=2 f(v10 m2024-05-14T15:23:53.912066+0000 3=3+0) n(v1 rc2024-05-14T15:23:53.912066+0000 b3816 4=3+1) old_inodes=2 (inest sync->mix g=1,2,3,4) caps={25000=pAsLsXsFs/-@40} | dirtyscattered=0 request=0 lock=0 importing=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x557997009b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000019:[<0x10000000006/pg_stat_tmp v38>,<0x10000000005/data v96>,<0x10000000003/postgres v21>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v37>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v46>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000019:[<0x10000000006/pg_stat_tmp v795>,<0x10000000005/data v484>,<0x10000000003/postgres v180>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v194>,<0x10000000001/sv_0 v209>,<0x10000000000/qa v197>,<0x1/volumes v184>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-14T15:23:53.876687+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-05-14T15:23:53.912066+0000 b3816 4=3+1)","memory_value.dirstat":"f(v10 m2024-05-14T15:23:53.912066+0000 3=3+0)","memory_value.rstat":"n(v1 rc2024-05-14T15:23:53.912066+0000 b3816 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-14T15:24:16.896 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T15:24:17.205 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub queued for path: / 2024-05-14T15:24:17.205 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.205 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:24:17.205 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:24:17.205 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.205 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:24:17.205 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:24:17.205 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.205 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.205 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:24:17.205 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:24:17.205 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2024-05-14T15:24:17.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:24:17.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000019 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_stat_tmp) see mds.b log and `damage ls` output for details 2024-05-14T15:24:17.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:24:17.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:24:17.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:24:17.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:24:17.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:24:17.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:24:17.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:24:17.206 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: pgmap v82: 129 pgs: 129 active+clean; 592 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 22 op/s 2024-05-14T15:24:17.207 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.207 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.207 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.207 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.207 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:16 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub queued for path: / 2024-05-14T15:24:17.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:24:17.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:24:17.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:24:17.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:24:17.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:24:17.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:24:17.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2024-05-14T15:24:17.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:24:17.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000019 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_stat_tmp) see mds.b log and `damage ls` output for details 2024-05-14T15:24:17.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:24:17.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:24:17.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:24:17.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:24:17.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:24:17.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:24:17.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:24:17.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: pgmap v82: 129 pgs: 129 active+clean; 592 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 22 op/s 2024-05-14T15:24:17.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:16 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.370 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:24:17.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub queued for path: / 2024-05-14T15:24:17.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:24:17.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:24:17.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:24:17.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:24:17.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:24:17.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:24:17.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2024-05-14T15:24:17.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:24:17.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000019 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_stat_tmp) see mds.b log and `damage ls` output for details 2024-05-14T15:24:17.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:24:17.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:24:17.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:24:17.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:24:17.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:24:17.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:24:17.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:24:17.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: pgmap v82: 129 pgs: 129 active+clean; 592 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 22 op/s 2024-05-14T15:24:17.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.446 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.446 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:17.446 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:16 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:24:19.108 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:18 smithi069 ceph-mon[31270]: pgmap v83: 129 pgs: 129 active+clean; 592 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 22 op/s 2024-05-14T15:24:19.280 INFO:teuthology.orchestra.run.smithi069.stderr:2400000 of 3200000 tuples (75%) done (elapsed 84.89 s, remaining 28.30 s) 2024-05-14T15:24:19.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:18 smithi203 ceph-mon[34567]: pgmap v83: 129 pgs: 129 active+clean; 592 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 22 op/s 2024-05-14T15:24:19.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:18 smithi092 ceph-mon[34729]: pgmap v83: 129 pgs: 129 active+clean; 592 MiB data, 1.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 11 MiB/s wr, 22 op/s 2024-05-14T15:24:19.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.755+0000 7fbad3e00700 1 -- 172.21.15.69:0/3620250344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbad4102f30 msgr2=0x7fbad41110d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:19.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.755+0000 7fbad3e00700 1 --2- 172.21.15.69:0/3620250344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbad4102f30 0x7fbad41110d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7fbacc00b0a0 tx=0x7fbacc00b3b0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.756+0000 7fbad3e00700 1 -- 172.21.15.69:0/3620250344 shutdown_connections 2024-05-14T15:24:19.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.756+0000 7fbad3e00700 1 --2- 172.21.15.69:0/3620250344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbad4102f30 0x7fbad41110d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.756+0000 7fbad3e00700 1 --2- 172.21.15.69:0/3620250344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbad4109260 0x7fbad4109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.756+0000 7fbad3e00700 1 --2- 172.21.15.69:0/3620250344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbad41025e0 0x7fbad41029f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.756+0000 7fbad3e00700 1 -- 172.21.15.69:0/3620250344 >> 172.21.15.69:0/3620250344 conn(0x7fbad4078370 msgr2=0x7fbad40787b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:19.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.757+0000 7fbad3e00700 1 -- 172.21.15.69:0/3620250344 shutdown_connections 2024-05-14T15:24:19.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.757+0000 7fbad3e00700 1 -- 172.21.15.69:0/3620250344 wait complete. 2024-05-14T15:24:19.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.758+0000 7fbad3e00700 1 Processor -- start 2024-05-14T15:24:19.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.758+0000 7fbad3e00700 1 -- start start 2024-05-14T15:24:19.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.759+0000 7fbad3e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbad41025e0 0x7fbad41037c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.759+0000 7fbad3e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbad4102f30 0x7fbad4103d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.759+0000 7fbad3e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbad4109260 0x7fbad4104240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.759+0000 7fbad3e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbad4114400 con 0x7fbad4102f30 2024-05-14T15:24:19.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.759+0000 7fbad3e00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbad4114280 con 0x7fbad41025e0 2024-05-14T15:24:19.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.759+0000 7fbad3e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbad4114580 con 0x7fbad4109260 2024-05-14T15:24:19.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.759+0000 7fbad2000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbad4102f30 0x7fbad4103d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:19.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.760+0000 7fbad2000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbad4102f30 0x7fbad4103d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36232/0 (socket says 172.21.15.69:36232) 2024-05-14T15:24:19.760 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.760+0000 7fbad2000700 1 -- 172.21.15.69:0/2728850527 learned_addr learned my addr 172.21.15.69:0/2728850527 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:19.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.760+0000 7fbad2a00700 1 --2- 172.21.15.69:0/2728850527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbad41025e0 0x7fbad41037c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:19.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.760+0000 7fbad3400700 1 --2- 172.21.15.69:0/2728850527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbad4109260 0x7fbad4104240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:19.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.760+0000 7fbad2000700 1 -- 172.21.15.69:0/2728850527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbad4109260 msgr2=0x7fbad4104240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:19.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.760+0000 7fbad2000700 1 --2- 172.21.15.69:0/2728850527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbad4109260 0x7fbad4104240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.760+0000 7fbad2000700 1 -- 172.21.15.69:0/2728850527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbad41025e0 msgr2=0x7fbad41037c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:19.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.760+0000 7fbad2000700 1 --2- 172.21.15.69:0/2728850527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbad41025e0 0x7fbad41037c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.760+0000 7fbad2000700 1 -- 172.21.15.69:0/2728850527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad41a9090 con 0x7fbad4102f30 2024-05-14T15:24:19.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.761+0000 7fbad2000700 1 --2- 172.21.15.69:0/2728850527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbad4102f30 0x7fbad4103d00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbac000d980 tx=0x7fbac000dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:19.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.761+0000 7fbacb400700 1 -- 172.21.15.69:0/2728850527 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac0017070 con 0x7fbad4102f30 2024-05-14T15:24:19.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.761+0000 7fbacb400700 1 -- 172.21.15.69:0/2728850527 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbac0010460 con 0x7fbad4102f30 2024-05-14T15:24:19.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.761+0000 7fbad3e00700 1 -- 172.21.15.69:0/2728850527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad41a9380 con 0x7fbad4102f30 2024-05-14T15:24:19.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.761+0000 7fbacb400700 1 -- 172.21.15.69:0/2728850527 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac000de60 con 0x7fbad4102f30 2024-05-14T15:24:19.762 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.761+0000 7fbad3e00700 1 -- 172.21.15.69:0/2728850527 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad41a98c0 con 0x7fbad4102f30 2024-05-14T15:24:19.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.765+0000 7fbacb400700 1 -- 172.21.15.69:0/2728850527 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fbac000f620 con 0x7fbad4102f30 2024-05-14T15:24:19.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.767+0000 7fbacb400700 1 --2- 172.21.15.69:0/2728850527 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbab80b29f0 0x7fbab80b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.767+0000 7fbae8690b80 1 Processor -- start 2024-05-14T15:24:19.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.768+0000 7fbacb400700 1 -- 172.21.15.69:0/2728850527 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fbac00e2470 con 0x7fbad4102f30 2024-05-14T15:24:19.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.768+0000 7fbae8690b80 1 -- start start 2024-05-14T15:24:19.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.768+0000 7fbad2a00700 1 --2- 172.21.15.69:0/2728850527 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbab80b29f0 0x7fbab80b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:19.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.768+0000 7fbae8690b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a5bae40 0x56221a73e540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.768+0000 7fbae8690b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a73ea80 0x56221a738700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.768+0000 7fbae8690b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a738c40 0x56221a739050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.768+0000 7fbae8690b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56221a65aa20 con 0x56221a73ea80 2024-05-14T15:24:19.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.768+0000 7fbae8690b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56221a5f8760 con 0x56221a738c40 2024-05-14T15:24:19.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.768+0000 7fbae8690b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56221a6569e0 con 0x56221a5bae40 2024-05-14T15:24:19.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.769+0000 7fbad2000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a73ea80 0x56221a738700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:19.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.769+0000 7fbad2000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a73ea80 0x56221a738700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36246/0 (socket says 172.21.15.69:36246) 2024-05-14T15:24:19.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.769+0000 7fbad2000700 1 -- 172.21.15.69:0/3497863741 learned_addr learned my addr 172.21.15.69:0/3497863741 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:19.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.769+0000 7fbad2a00700 1 --2- 172.21.15.69:0/3497863741 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a5bae40 0x56221a73e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:19.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.769+0000 7fbad2a00700 1 --2- 172.21.15.69:0/2728850527 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbab80b29f0 0x7fbab80b4f00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbac4005950 tx=0x7fbac40058e0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:19.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.769+0000 7fbad2000700 1 -- 172.21.15.69:0/3497863741 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a5bae40 msgr2=0x56221a73e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:19.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.769+0000 7fbad2000700 1 --2- 172.21.15.69:0/3497863741 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a5bae40 0x56221a73e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.769+0000 7fbad2000700 1 -- 172.21.15.69:0/3497863741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a738c40 msgr2=0x56221a739050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:19.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.769+0000 7fbad2000700 1 --2- 172.21.15.69:0/3497863741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a738c40 0x56221a739050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.769+0000 7fbad2000700 1 -- 172.21.15.69:0/3497863741 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56221a5a78d0 con 0x56221a73ea80 2024-05-14T15:24:19.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.770+0000 7fbad2000700 1 --2- 172.21.15.69:0/3497863741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a73ea80 0x56221a738700 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbac00a9040 tx=0x7fbac00a9b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=274e31e1602139a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.770+0000 7fbabfe00700 1 -- 172.21.15.69:0/3497863741 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac0020070 con 0x56221a73ea80 2024-05-14T15:24:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.770+0000 7fbabfe00700 1 -- 172.21.15.69:0/3497863741 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbac00b21a0 con 0x56221a73ea80 2024-05-14T15:24:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.770+0000 7fbabfe00700 1 -- 172.21.15.69:0/3497863741 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac00a85a0 con 0x56221a73ea80 2024-05-14T15:24:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.771+0000 7fbae8690b80 1 -- 172.21.15.69:0/3497863741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a73ea80 msgr2=0x56221a738700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.771+0000 7fbae8690b80 1 --2- 172.21.15.69:0/3497863741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a73ea80 0x56221a738700 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fbac00a9040 tx=0x7fbac00a9b10 comp rx=0 tx=0).stop 2024-05-14T15:24:19.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.772+0000 7fbae8690b80 1 -- 172.21.15.69:0/3497863741 shutdown_connections 2024-05-14T15:24:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.772+0000 7fbae8690b80 1 --2- 172.21.15.69:0/3497863741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a738c40 0x56221a739050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.772+0000 7fbae8690b80 1 --2- 172.21.15.69:0/3497863741 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a5bae40 0x56221a73e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.772+0000 7fbae8690b80 1 --2- 172.21.15.69:0/3497863741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a73ea80 0x56221a738700 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.772+0000 7fbae8690b80 1 -- 172.21.15.69:0/3497863741 >> 172.21.15.69:0/3497863741 conn(0x56221a5fff70 msgr2=0x56221a733400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.772+0000 7fbae8690b80 1 -- 172.21.15.69:0/3497863741 shutdown_connections 2024-05-14T15:24:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.772+0000 7fbae8690b80 1 -- 172.21.15.69:0/3497863741 wait complete. 2024-05-14T15:24:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.773+0000 7fbae8690b80 1 -- start start 2024-05-14T15:24:19.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.773+0000 7fbae8690b80 1 Processor -- start 2024-05-14T15:24:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbae8690b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a5bae40 0x56221a7421e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbae8690b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a738c40 0x56221a742720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbae8690b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a73ea80 0x56221a742c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbae8690b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56221a745490 con 0x56221a738c40 2024-05-14T15:24:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbae8690b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56221a5c0b20 con 0x56221a73ea80 2024-05-14T15:24:19.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbae8690b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56221a745610 con 0x56221a5bae40 2024-05-14T15:24:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbae8690b80 10 client.0 _ll_register_callbacks cb 0x56221a601c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbad2000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a738c40 0x56221a742720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbad2000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a738c40 0x56221a742720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36254/0 (socket says 172.21.15.69:36254) 2024-05-14T15:24:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbad2000700 1 -- 172.21.15.69:0/4158815514 learned_addr learned my addr 172.21.15.69:0/4158815514 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbad2a00700 1 --2- 172.21.15.69:0/4158815514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a5bae40 0x56221a7421e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbad3400700 1 --2- 172.21.15.69:0/4158815514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a73ea80 0x56221a742c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbad2000700 1 -- 172.21.15.69:0/4158815514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a5bae40 msgr2=0x56221a7421e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbad2000700 1 --2- 172.21.15.69:0/4158815514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a5bae40 0x56221a7421e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbad2000700 1 -- 172.21.15.69:0/4158815514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a73ea80 msgr2=0x56221a742c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbad2000700 1 --2- 172.21.15.69:0/4158815514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a73ea80 0x56221a742c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.774+0000 7fbad2000700 1 -- 172.21.15.69:0/4158815514 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56221a620420 con 0x56221a738c40 2024-05-14T15:24:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.775+0000 7fbad2000700 1 --2- 172.21.15.69:0/4158815514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a738c40 0x56221a742720 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbac0010d40 tx=0x7fbac00a5a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3778a250c3ef1a9d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:19.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.775+0000 7fbabcc00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:19.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.775+0000 7fbabcc00700 1 -- 172.21.15.69:0/4158815514 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac00c3060 con 0x56221a738c40 2024-05-14T15:24:19.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.775+0000 7fbabcc00700 1 -- 172.21.15.69:0/4158815514 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fbac0009d40 con 0x56221a738c40 2024-05-14T15:24:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.775+0000 7fbae8690b80 1 -- 172.21.15.69:0/4158815514 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbac00b21a0 con 0x56221a738c40 2024-05-14T15:24:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.775+0000 7fbabcc00700 1 -- 172.21.15.69:0/4158815514 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fbac0020030 con 0x56221a738c40 2024-05-14T15:24:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.775+0000 7fbae8690b80 10 client.15987 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.775+0000 7fbae8690b80 1 -- 172.21.15.69:0/4158815514 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56221a7500f0 con 0x56221a738c40 2024-05-14T15:24:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.776+0000 7fbabcc00700 1 -- 172.21.15.69:0/4158815514 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbac00b21a0 con 0x56221a738c40 2024-05-14T15:24:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.776+0000 7fbabcc00700 1 -- 172.21.15.69:0/4158815514 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7fbac00ad160 con 0x56221a738c40 2024-05-14T15:24:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.776+0000 7fbae8690b80 10 client.15987 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.776+0000 7fbae8690b80 10 client.15987 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:24:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.776+0000 7fbae8690b80 20 client.15987 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.776+0000 7fbae8690b80 1 --2- 172.21.15.69:0/4158815514 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56221a7525c0 0x56221a7549e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.776+0000 7fbae8690b80 4 client.15987 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:24:19.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.776+0000 7fbae8690b80 1 -- 172.21.15.69:0/4158815514 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56221a7051c0 con 0x56221a7525c0 2024-05-14T15:24:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.777+0000 7fbad2a00700 1 --2- 172.21.15.69:0/4158815514 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56221a7525c0 0x56221a7549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.778+0000 7fbad2a00700 1 --2- 172.21.15.69:0/4158815514 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56221a7525c0 0x56221a7549e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f3f07efc14837533 server_cookie=3b19995b2ee0e6df in_seq=0 out_seq=0 2024-05-14T15:24:19.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.778+0000 7fbabcc00700 10 client.15987 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.780+0000 7fbabcc00700 1 -- 172.21.15.69:0/4158815514 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56221a7051c0 con 0x56221a7525c0 2024-05-14T15:24:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.780+0000 7fbabcc00700 10 client.15987 handle_command_reply: tid=0 2024-05-14T15:24:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.780+0000 7fbae8690b80 1 client.15987 shutdown 2024-05-14T15:24:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.780+0000 7fbae8690b80 1 -- 172.21.15.69:0/4158815514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a738c40 msgr2=0x56221a742720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.780+0000 7fbae8690b80 1 --2- 172.21.15.69:0/4158815514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a738c40 0x56221a742720 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fbac0010d40 tx=0x7fbac00a5a50 comp rx=0 tx=0).stop 2024-05-14T15:24:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.780+0000 7fbae8690b80 1 -- 172.21.15.69:0/4158815514 shutdown_connections 2024-05-14T15:24:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.780+0000 7fbae8690b80 1 --2- 172.21.15.69:0/4158815514 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56221a7525c0 0x56221a7549e0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.780+0000 7fbae8690b80 1 --2- 172.21.15.69:0/4158815514 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a73ea80 0x56221a742c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.780+0000 7fbae8690b80 1 --2- 172.21.15.69:0/4158815514 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a5bae40 0x56221a7421e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.780+0000 7fbae8690b80 1 --2- 172.21.15.69:0/4158815514 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a738c40 0x56221a742720 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.780+0000 7fbae8690b80 1 -- 172.21.15.69:0/4158815514 >> 172.21.15.69:0/4158815514 conn(0x56221a5fff70 msgr2=0x56221a7376f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:19.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.781+0000 7fbabcc00700 0 client.15987 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.781+0000 7fbae8690b80 1 -- 172.21.15.69:0/4158815514 shutdown_connections 2024-05-14T15:24:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.781+0000 7fbae8690b80 1 -- 172.21.15.69:0/4158815514 wait complete. 2024-05-14T15:24:19.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.781+0000 7fbae8690b80 20 client.15987 trim_cache size 0 max 16384 2024-05-14T15:24:19.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.808+0000 7fbae8690b80 1 Processor -- start 2024-05-14T15:24:19.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.808+0000 7fbae8690b80 1 -- start start 2024-05-14T15:24:19.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.809+0000 7fbae8690b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a5bae40 0x56221a738700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.809+0000 7fbae8690b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a738c40 0x56221a7411b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.809+0000 7fbae8690b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a73ea80 0x56221a742bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.809+0000 7fbae8690b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbab400eda0 con 0x56221a5bae40 2024-05-14T15:24:19.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.809+0000 7fbae8690b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbab4010a60 con 0x56221a738c40 2024-05-14T15:24:19.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.809+0000 7fbae8690b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbab400f470 con 0x56221a73ea80 2024-05-14T15:24:19.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.809+0000 7fbad2a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a5bae40 0x56221a738700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:19.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.809+0000 7fbad2a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a5bae40 0x56221a738700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36264/0 (socket says 172.21.15.69:36264) 2024-05-14T15:24:19.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.809+0000 7fbad2a00700 1 -- 172.21.15.69:0/2445676266 learned_addr learned my addr 172.21.15.69:0/2445676266 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:19.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.810+0000 7fbad2000700 1 --2- 172.21.15.69:0/2445676266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a738c40 0x56221a7411b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:19.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.810+0000 7fbad2a00700 1 -- 172.21.15.69:0/2445676266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a73ea80 msgr2=0x56221a742bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:19.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.810+0000 7fbad2a00700 1 --2- 172.21.15.69:0/2445676266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a73ea80 0x56221a742bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.810+0000 7fbad2a00700 1 -- 172.21.15.69:0/2445676266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a738c40 msgr2=0x56221a7411b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:19.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.810+0000 7fbad2a00700 1 --2- 172.21.15.69:0/2445676266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a738c40 0x56221a7411b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.810+0000 7fbad2a00700 1 -- 172.21.15.69:0/2445676266 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56221a72fc40 con 0x56221a5bae40 2024-05-14T15:24:19.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.810+0000 7fbad2a00700 1 --2- 172.21.15.69:0/2445676266 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a5bae40 0x56221a738700 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x56221a7399b0 tx=0x7fbac4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=397d2c2babca06fd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:19.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.811+0000 7fbabf400700 1 -- 172.21.15.69:0/2445676266 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4021dc0 con 0x56221a5bae40 2024-05-14T15:24:19.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.811+0000 7fbabf400700 1 -- 172.21.15.69:0/2445676266 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbac402f070 con 0x56221a5bae40 2024-05-14T15:24:19.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.811+0000 7fbabf400700 1 -- 172.21.15.69:0/2445676266 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4011880 con 0x56221a5bae40 2024-05-14T15:24:19.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.812+0000 7fbae8690b80 1 -- 172.21.15.69:0/2445676266 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a5bae40 msgr2=0x56221a738700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:19.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.812+0000 7fbae8690b80 1 --2- 172.21.15.69:0/2445676266 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a5bae40 0x56221a738700 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x56221a7399b0 tx=0x7fbac4014000 comp rx=0 tx=0).stop 2024-05-14T15:24:19.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.812+0000 7fbae8690b80 1 -- 172.21.15.69:0/2445676266 shutdown_connections 2024-05-14T15:24:19.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.812+0000 7fbae8690b80 1 --2- 172.21.15.69:0/2445676266 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a5bae40 0x56221a738700 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.812+0000 7fbae8690b80 1 --2- 172.21.15.69:0/2445676266 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a73ea80 0x56221a742bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.812+0000 7fbae8690b80 1 --2- 172.21.15.69:0/2445676266 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a738c40 0x56221a7411b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.812+0000 7fbae8690b80 1 -- 172.21.15.69:0/2445676266 >> 172.21.15.69:0/2445676266 conn(0x56221a5fff70 msgr2=0x56221a73da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:19.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.812+0000 7fbae8690b80 1 -- 172.21.15.69:0/2445676266 shutdown_connections 2024-05-14T15:24:19.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.812+0000 7fbae8690b80 1 -- 172.21.15.69:0/2445676266 wait complete. 2024-05-14T15:24:19.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.813+0000 7fbae8690b80 1 -- start start 2024-05-14T15:24:19.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.813+0000 7fbae8690b80 1 Processor -- start 2024-05-14T15:24:19.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.813+0000 7fbae8690b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a5bae40 0x56221a757ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.814+0000 7fbae8690b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a738c40 0x56221a7552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.814+0000 7fbae8690b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a73ea80 0x56221a7557e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.814+0000 7fbae8690b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbab40102d0 con 0x56221a5bae40 2024-05-14T15:24:19.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.814+0000 7fbae8690b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbab400fb70 con 0x56221a738c40 2024-05-14T15:24:19.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.814+0000 7fbae8690b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbab400cd40 con 0x56221a73ea80 2024-05-14T15:24:19.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.814+0000 7fbae8690b80 10 client.0 _ll_register_callbacks cb 0x56221a601c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:19.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.814+0000 7fbad2a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a5bae40 0x56221a757ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:19.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.814+0000 7fbad2a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a5bae40 0x56221a757ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36276/0 (socket says 172.21.15.69:36276) 2024-05-14T15:24:19.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.814+0000 7fbad2a00700 1 -- 172.21.15.69:0/2957517230 learned_addr learned my addr 172.21.15.69:0/2957517230 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:19.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.814+0000 7fbad2a00700 1 -- 172.21.15.69:0/2957517230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a73ea80 msgr2=0x56221a7557e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:19.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.814+0000 7fbad2a00700 1 --2- 172.21.15.69:0/2957517230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a73ea80 0x56221a7557e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.814+0000 7fbad2a00700 1 -- 172.21.15.69:0/2957517230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a738c40 msgr2=0x56221a7552a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:19.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.814+0000 7fbad2000700 1 --2- 172.21.15.69:0/2957517230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a738c40 0x56221a7552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:19.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.814+0000 7fbad2a00700 1 --2- 172.21.15.69:0/2957517230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a738c40 0x56221a7552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.814+0000 7fbad2a00700 1 -- 172.21.15.69:0/2957517230 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56221a733ed0 con 0x56221a5bae40 2024-05-14T15:24:19.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.815+0000 7fbad2a00700 1 --2- 172.21.15.69:0/2957517230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a5bae40 0x56221a757ed0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbac4023010 tx=0x7fbac4021c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba0761bd0d28c3a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:19.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.815+0000 7fbabcc00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:19.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.815+0000 7fbabcc00700 1 -- 172.21.15.69:0/2957517230 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac4005450 con 0x56221a5bae40 2024-05-14T15:24:19.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.815+0000 7fbabcc00700 1 -- 172.21.15.69:0/2957517230 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fbac40055f0 con 0x56221a5bae40 2024-05-14T15:24:19.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.815+0000 7fbae8690b80 1 -- 172.21.15.69:0/2957517230 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbac402f070 con 0x56221a5bae40 2024-05-14T15:24:19.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.816+0000 7fbabcc00700 1 -- 172.21.15.69:0/2957517230 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fbac4004750 con 0x56221a5bae40 2024-05-14T15:24:19.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.816+0000 7fbae8690b80 10 client.15993 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:19.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.816+0000 7fbae8690b80 1 -- 172.21.15.69:0/2957517230 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x56221a7bc7a0 con 0x56221a5bae40 2024-05-14T15:24:19.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.816+0000 7fbabcc00700 1 -- 172.21.15.69:0/2957517230 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbac402f070 con 0x56221a5bae40 2024-05-14T15:24:19.817 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.816+0000 7fbabcc00700 1 -- 172.21.15.69:0/2957517230 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7fbac40297b0 con 0x56221a5bae40 2024-05-14T15:24:19.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.816+0000 7fbae8690b80 10 client.15993 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:19.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.816+0000 7fbae8690b80 10 client.15993 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:24:19.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.816+0000 7fbae8690b80 20 client.15993 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:19.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.816+0000 7fbae8690b80 1 --2- 172.21.15.69:0/2957517230 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56221a7bcf30 0x56221a7bf350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:19.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.816+0000 7fbae8690b80 4 client.15993 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T15:24:19.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.817+0000 7fbae8690b80 1 -- 172.21.15.69:0/2957517230 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56221a668400 con 0x56221a7bcf30 2024-05-14T15:24:19.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.817+0000 7fbad2000700 1 --2- 172.21.15.69:0/2957517230 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56221a7bcf30 0x56221a7bf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:19.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.818+0000 7fbad2000700 1 --2- 172.21.15.69:0/2957517230 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56221a7bcf30 0x56221a7bf350 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=84d8c29bd2402742 server_cookie=c984a6cfa1b7c5ad in_seq=0 out_seq=0 2024-05-14T15:24:19.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.818+0000 7fbabcc00700 10 client.15993 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:19.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.819+0000 7fbabcc00700 1 -- 172.21.15.69:0/2957517230 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56221a668400 con 0x56221a7bcf30 2024-05-14T15:24:19.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.819+0000 7fbabcc00700 10 client.15993 handle_command_reply: tid=0 2024-05-14T15:24:19.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.819+0000 7fbae8690b80 1 client.15993 shutdown 2024-05-14T15:24:19.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.819+0000 7fbae8690b80 1 -- 172.21.15.69:0/2957517230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a5bae40 msgr2=0x56221a757ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:19.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.819+0000 7fbae8690b80 1 --2- 172.21.15.69:0/2957517230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a5bae40 0x56221a757ed0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fbac4023010 tx=0x7fbac4021c70 comp rx=0 tx=0).stop 2024-05-14T15:24:19.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.819+0000 7fbae8690b80 1 -- 172.21.15.69:0/2957517230 shutdown_connections 2024-05-14T15:24:19.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.819+0000 7fbae8690b80 1 --2- 172.21.15.69:0/2957517230 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56221a7bcf30 0x56221a7bf350 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.819+0000 7fbae8690b80 1 --2- 172.21.15.69:0/2957517230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56221a5bae40 0x56221a757ed0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.819+0000 7fbabcc00700 0 client.15993 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:19.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.819+0000 7fbae8690b80 1 --2- 172.21.15.69:0/2957517230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56221a73ea80 0x56221a7557e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.819+0000 7fbae8690b80 1 --2- 172.21.15.69:0/2957517230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56221a738c40 0x56221a7552a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.820+0000 7fbae8690b80 1 -- 172.21.15.69:0/2957517230 >> 172.21.15.69:0/2957517230 conn(0x56221a5fff70 msgr2=0x56221a73da40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:19.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.820+0000 7fbae8690b80 1 -- 172.21.15.69:0/2957517230 shutdown_connections 2024-05-14T15:24:19.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.820+0000 7fbae8690b80 1 -- 172.21.15.69:0/2957517230 wait complete. 2024-05-14T15:24:19.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.820+0000 7fbae8690b80 20 client.15993 trim_cache size 0 max 16384 2024-05-14T15:24:19.822 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:24:19.822 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-14T15:24:19.822 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2024-05-14T15:24:19.822 INFO:teuthology.orchestra.run.smithi069.stdout: "95b7d2ba-4fed-4c3c-bf45-54e0e7d9c2c9": { 2024-05-14T15:24:19.822 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2024-05-14T15:24:19.822 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "95b7d2ba-4fed-4c3c-bf45-54e0e7d9c2c9", 2024-05-14T15:24:19.822 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2024-05-14T15:24:19.822 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:24:19.822 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:24:19.822 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:24:19.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.821+0000 7fbad3e00700 1 -- 172.21.15.69:0/2728850527 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbab80b29f0 msgr2=0x7fbab80b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:19.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.821+0000 7fbad3e00700 1 --2- 172.21.15.69:0/2728850527 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbab80b29f0 0x7fbab80b4f00 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbac4005950 tx=0x7fbac40058e0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.821+0000 7fbad3e00700 1 -- 172.21.15.69:0/2728850527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbad4102f30 msgr2=0x7fbad4103d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:19.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.821+0000 7fbad3e00700 1 --2- 172.21.15.69:0/2728850527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbad4102f30 0x7fbad4103d00 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fbac000d980 tx=0x7fbac000dd40 comp rx=0 tx=0).stop 2024-05-14T15:24:19.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.821+0000 7fbad3e00700 1 -- 172.21.15.69:0/2728850527 shutdown_connections 2024-05-14T15:24:19.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.821+0000 7fbad3e00700 1 --2- 172.21.15.69:0/2728850527 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbab80b29f0 0x7fbab80b4f00 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.821+0000 7fbad3e00700 1 --2- 172.21.15.69:0/2728850527 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbad4109260 0x7fbad4104240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.821+0000 7fbad3e00700 1 --2- 172.21.15.69:0/2728850527 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbad41025e0 0x7fbad41037c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.821+0000 7fbad3e00700 1 --2- 172.21.15.69:0/2728850527 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbad4102f30 0x7fbad4103d00 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:19.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.821+0000 7fbad3e00700 1 -- 172.21.15.69:0/2728850527 >> 172.21.15.69:0/2728850527 conn(0x7fbad4078370 msgr2=0x7fbad40ffe00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:19.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.821+0000 7fbad3e00700 1 -- 172.21.15.69:0/2728850527 shutdown_connections 2024-05-14T15:24:19.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:19.822+0000 7fbad3e00700 1 -- 172.21.15.69:0/2728850527 wait complete. 2024-05-14T15:24:20.822 INFO:tasks.cephfs.filesystem:scrub status for tag:95b7d2ba-4fed-4c3c-bf45-54e0e7d9c2c9 - {'path': '/', 'tag': '95b7d2ba-4fed-4c3c-bf45-54e0e7d9c2c9', 'options': 'recursive,force'} 2024-05-14T15:24:21.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:20 smithi069 ceph-mon[31270]: pgmap v84: 129 pgs: 129 active+clean; 628 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 17 MiB/s wr, 99 op/s 2024-05-14T15:24:21.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:20 smithi203 ceph-mon[34567]: pgmap v84: 129 pgs: 129 active+clean; 628 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 17 MiB/s wr, 99 op/s 2024-05-14T15:24:21.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:20 smithi092 ceph-mon[34729]: pgmap v84: 129 pgs: 129 active+clean; 628 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 17 MiB/s wr, 99 op/s 2024-05-14T15:24:23.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:23 smithi203 ceph-mon[34567]: pgmap v85: 129 pgs: 129 active+clean; 628 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 12 MiB/s wr, 89 op/s 2024-05-14T15:24:23.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:23 smithi092 ceph-mon[34729]: pgmap v85: 129 pgs: 129 active+clean; 628 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 12 MiB/s wr, 89 op/s 2024-05-14T15:24:23.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:23 smithi069 ceph-mon[31270]: pgmap v85: 129 pgs: 129 active+clean; 628 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 12 MiB/s wr, 89 op/s 2024-05-14T15:24:24.047 INFO:teuthology.orchestra.run.smithi069.stderr:2500000 of 3200000 tuples (78%) done (elapsed 89.66 s, remaining 25.10 s) 2024-05-14T15:24:25.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:25 smithi203 ceph-mon[34567]: pgmap v86: 129 pgs: 129 active+clean; 662 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 17 MiB/s wr, 98 op/s 2024-05-14T15:24:25.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:25 smithi092 ceph-mon[34729]: pgmap v86: 129 pgs: 129 active+clean; 662 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 17 MiB/s wr, 98 op/s 2024-05-14T15:24:25.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:25 smithi069 ceph-mon[31270]: pgmap v86: 129 pgs: 129 active+clean; 662 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 98 KiB/s rd, 17 MiB/s wr, 98 op/s 2024-05-14T15:24:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.889+0000 7f3bcd000640 1 -- 172.21.15.69:0/3999800926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3bc810da70 msgr2=0x7f3bc810fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.889+0000 7f3bcd000640 1 --2- 172.21.15.69:0/3999800926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3bc810da70 0x7f3bc810fe90 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009900 tx=0x7f3bb402a3f0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.889+0000 7f3bcd000640 1 -- 172.21.15.69:0/3999800926 shutdown_connections 2024-05-14T15:24:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.889+0000 7f3bcd000640 1 --2- 172.21.15.69:0/3999800926 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc81103d0 0x7f3bc81127f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.889+0000 7f3bcd000640 1 --2- 172.21.15.69:0/3999800926 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3bc810da70 0x7f3bc810fe90 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.889+0000 7f3bcd000640 1 --2- 172.21.15.69:0/3999800926 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bc8102830 0x7f3bc8102c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.889+0000 7f3bcd000640 1 -- 172.21.15.69:0/3999800926 >> 172.21.15.69:0/3999800926 conn(0x7f3bc80fe220 msgr2=0x7f3bc8100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:25.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.889+0000 7f3bcd000640 1 -- 172.21.15.69:0/3999800926 shutdown_connections 2024-05-14T15:24:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.889+0000 7f3bcd000640 1 -- 172.21.15.69:0/3999800926 wait complete. 2024-05-14T15:24:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.890+0000 7f3bcd000640 1 Processor -- start 2024-05-14T15:24:25.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.891+0000 7f3bcd000640 1 -- start start 2024-05-14T15:24:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.891+0000 7f3bcd000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bc8102830 0x7f3bc819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.891+0000 7f3bcd000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3bc810da70 0x7f3bc819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.891+0000 7f3bcd000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc81103d0 0x7f3bc81a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.891+0000 7f3bcd000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc8115d40 con 0x7f3bc810da70 2024-05-14T15:24:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.891+0000 7f3bcd000640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc8115bc0 con 0x7f3bc81103d0 2024-05-14T15:24:25.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.891+0000 7f3bcd000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc8115ec0 con 0x7f3bc8102830 2024-05-14T15:24:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.892+0000 7f3bc6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3bc810da70 0x7f3bc819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.892+0000 7f3bc6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3bc810da70 0x7f3bc819cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55618/0 (socket says 172.21.15.69:55618) 2024-05-14T15:24:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.892+0000 7f3bc6a00640 1 -- 172.21.15.69:0/154924681 learned_addr learned my addr 172.21.15.69:0/154924681 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.892+0000 7f3bc7400640 1 --2- 172.21.15.69:0/154924681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bc8102830 0x7f3bc819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.892+0000 7f3bc7e00640 1 --2- 172.21.15.69:0/154924681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc81103d0 0x7f3bc81a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.892+0000 7f3bc6a00640 1 -- 172.21.15.69:0/154924681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bc8102830 msgr2=0x7f3bc819c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.892+0000 7f3bc6a00640 1 --2- 172.21.15.69:0/154924681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bc8102830 0x7f3bc819c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.892+0000 7f3bc6a00640 1 -- 172.21.15.69:0/154924681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc81103d0 msgr2=0x7f3bc81a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.892+0000 7f3bc6a00640 1 --2- 172.21.15.69:0/154924681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc81103d0 0x7f3bc81a1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.892+0000 7f3bc6a00640 1 -- 172.21.15.69:0/154924681 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bc81a15e0 con 0x7f3bc810da70 2024-05-14T15:24:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.892+0000 7f3bc7400640 1 --2- 172.21.15.69:0/154924681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bc8102830 0x7f3bc819c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:24:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.892+0000 7f3bc7e00640 1 --2- 172.21.15.69:0/154924681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc81103d0 0x7f3bc81a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:24:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.893+0000 7f3bc6a00640 1 --2- 172.21.15.69:0/154924681 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3bc810da70 0x7f3bc819cd60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009230 tx=0x7f3bb40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.893+0000 7f3bbfe00640 1 -- 172.21.15.69:0/154924681 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb403f030 con 0x7f3bc810da70 2024-05-14T15:24:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.893+0000 7f3bbfe00640 1 -- 172.21.15.69:0/154924681 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bb40317e0 con 0x7f3bc810da70 2024-05-14T15:24:25.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.893+0000 7f3bbfe00640 1 -- 172.21.15.69:0/154924681 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4035070 con 0x7f3bc810da70 2024-05-14T15:24:25.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.893+0000 7f3bcd000640 1 -- 172.21.15.69:0/154924681 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bc81a1870 con 0x7f3bc810da70 2024-05-14T15:24:25.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.893+0000 7f3bcd000640 1 -- 172.21.15.69:0/154924681 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bc81a1db0 con 0x7f3bc810da70 2024-05-14T15:24:25.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.898+0000 7f3bd55ea740 1 Processor -- start 2024-05-14T15:24:25.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.898+0000 7f3bd55ea740 1 -- start start 2024-05-14T15:24:25.899 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.898+0000 7f3bd55ea740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637e41b0 0x55c163b85470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.899 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.898+0000 7f3bd55ea740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637bb2f0 0x55c163b859b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.899 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.898+0000 7f3bd55ea740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637c34d0 0x55c163b85ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.899 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.898+0000 7f3bd55ea740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55c163aea550 con 0x55c1637c34d0 2024-05-14T15:24:25.899 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.898+0000 7f3bd55ea740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c163a8fbc0 con 0x55c1637bb2f0 2024-05-14T15:24:25.899 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.898+0000 7f3bd55ea740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c163ae6510 con 0x55c1637e41b0 2024-05-14T15:24:25.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.899+0000 7f3bc7e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637e41b0 0x55c163b85470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.899+0000 7f3bc7400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637bb2f0 0x55c163b859b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.899+0000 7f3bc7e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637e41b0 0x55c163b85470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:50450/0 (socket says 172.21.15.69:50450) 2024-05-14T15:24:25.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.899+0000 7f3bc7e00640 1 -- 172.21.15.69:0/599570373 learned_addr learned my addr 172.21.15.69:0/599570373 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:25.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.899+0000 7f3bbfe00640 1 -- 172.21.15.69:0/154924681 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3bb4042030 con 0x7f3bc810da70 2024-05-14T15:24:25.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.899+0000 7f3bc6a00640 1 --2- 172.21.15.69:0/599570373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637c34d0 0x55c163b85ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.900+0000 7f3bc7e00640 1 -- 172.21.15.69:0/599570373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637bb2f0 msgr2=0x55c163b859b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:25.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.900+0000 7f3bc7e00640 1 --2- 172.21.15.69:0/599570373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637bb2f0 0x55c163b859b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.900+0000 7f3bc7e00640 1 -- 172.21.15.69:0/599570373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637c34d0 msgr2=0x55c163b85ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:25.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.900+0000 7f3bc7e00640 1 --2- 172.21.15.69:0/599570373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637c34d0 0x55c163b85ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.900+0000 7f3bc7e00640 1 -- 172.21.15.69:0/599570373 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1637fc210 con 0x55c1637e41b0 2024-05-14T15:24:25.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.900+0000 7f3bc7e00640 1 --2- 172.21.15.69:0/599570373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637e41b0 0x55c163b85470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0007e60 tx=0x7f3bc000e720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1051f376a778160 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:25.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.901+0000 7f3bbcc00640 1 -- 172.21.15.69:0/599570373 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0014070 con 0x55c1637e41b0 2024-05-14T15:24:25.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.901+0000 7f3bbcc00640 1 -- 172.21.15.69:0/599570373 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bc0004d20 con 0x55c1637e41b0 2024-05-14T15:24:25.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.901+0000 7f3bbcc00640 1 -- 172.21.15.69:0/599570373 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0005380 con 0x55c1637e41b0 2024-05-14T15:24:25.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.901+0000 7f3bbfe00640 1 --2- 172.21.15.69:0/154924681 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3bac0b29d0 0x7f3bac0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.902+0000 7f3bbfe00640 1 -- 172.21.15.69:0/154924681 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f3bb4102f50 con 0x7f3bc810da70 2024-05-14T15:24:25.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.902+0000 7f3bc7400640 1 --2- 172.21.15.69:0/154924681 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3bac0b29d0 0x7f3bac0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.902+0000 7f3bd55ea740 1 -- 172.21.15.69:0/599570373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637e41b0 msgr2=0x55c163b85470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:25.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.902+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/599570373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637e41b0 0x55c163b85470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0007e60 tx=0x7f3bc000e720 comp rx=0 tx=0).stop 2024-05-14T15:24:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.902+0000 7f3bd55ea740 1 -- 172.21.15.69:0/599570373 shutdown_connections 2024-05-14T15:24:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.902+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/599570373 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637c34d0 0x55c163b85ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.902+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/599570373 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637bb2f0 0x55c163b859b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.902+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/599570373 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637e41b0 0x55c163b85470 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.902+0000 7f3bd55ea740 1 -- 172.21.15.69:0/599570373 >> 172.21.15.69:0/599570373 conn(0x55c1637d8300 msgr2=0x55c163b81c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.902+0000 7f3bd55ea740 1 -- 172.21.15.69:0/599570373 shutdown_connections 2024-05-14T15:24:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.902+0000 7f3bd55ea740 1 -- 172.21.15.69:0/599570373 wait complete. 2024-05-14T15:24:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.903+0000 7f3bc7400640 1 --2- 172.21.15.69:0/154924681 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3bac0b29d0 0x7f3bac0b4ee0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55c163b86820 tx=0x7f3bb800b5a0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.903+0000 7f3bd55ea740 1 -- start start 2024-05-14T15:24:25.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.903+0000 7f3bd55ea740 1 Processor -- start 2024-05-14T15:24:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.904+0000 7f3bd55ea740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637bb2f0 0x55c163b8f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.904+0000 7f3bd55ea740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637c34d0 0x55c163b8feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.904+0000 7f3bd55ea740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637e41b0 0x55c163b9ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.904+0000 7f3bd55ea740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55c163b925a0 con 0x55c1637e41b0 2024-05-14T15:24:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.904+0000 7f3bd55ea740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c163aa3660 con 0x55c1637c34d0 2024-05-14T15:24:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.904+0000 7f3bd55ea740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c163b92720 con 0x55c1637bb2f0 2024-05-14T15:24:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.904+0000 7f3bd55ea740 10 client.0 _ll_register_callbacks cb 0x55c163a6d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.904+0000 7f3bc7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637e41b0 0x55c163b9ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.904+0000 7f3bc7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637e41b0 0x55c163b9ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55636/0 (socket says 172.21.15.69:55636) 2024-05-14T15:24:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.904+0000 7f3bc7e00640 1 -- 172.21.15.69:0/3422139042 learned_addr learned my addr 172.21.15.69:0/3422139042 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.905+0000 7f3bc7400640 1 --2- 172.21.15.69:0/3422139042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637bb2f0 0x55c163b8f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.905+0000 7f3bc6a00640 1 --2- 172.21.15.69:0/3422139042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637c34d0 0x55c163b8feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.905+0000 7f3bc7e00640 1 -- 172.21.15.69:0/3422139042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637bb2f0 msgr2=0x55c163b8f970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.905+0000 7f3bc7e00640 1 --2- 172.21.15.69:0/3422139042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637bb2f0 0x55c163b8f970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.905+0000 7f3bc7e00640 1 -- 172.21.15.69:0/3422139042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637c34d0 msgr2=0x55c163b8feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.905+0000 7f3bc7e00640 1 --2- 172.21.15.69:0/3422139042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637c34d0 0x55c163b8feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.905+0000 7f3bc7e00640 1 -- 172.21.15.69:0/3422139042 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1638c8620 con 0x55c1637e41b0 2024-05-14T15:24:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.905+0000 7f3bc7e00640 1 --2- 172.21.15.69:0/3422139042 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637e41b0 0x55c163b9ba80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0000f80 tx=0x7f3bc0007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce2ecbfd8befe5f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:25.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.905+0000 7f3bb1600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:25.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.906+0000 7f3bb1600640 1 -- 172.21.15.69:0/3422139042 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0027060 con 0x55c1637e41b0 2024-05-14T15:24:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.906+0000 7f3bb1600640 1 -- 172.21.15.69:0/3422139042 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f3bc0005300 con 0x55c1637e41b0 2024-05-14T15:24:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.906+0000 7f3bd55ea740 1 -- 172.21.15.69:0/3422139042 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bc0004d20 con 0x55c1637e41b0 2024-05-14T15:24:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.906+0000 7f3bb1600640 1 -- 172.21.15.69:0/3422139042 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3bc002e050 con 0x55c1637e41b0 2024-05-14T15:24:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.906+0000 7f3bd55ea740 10 client.16005 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.906+0000 7f3bd55ea740 1 -- 172.21.15.69:0/3422139042 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c163b9e830 con 0x55c1637e41b0 2024-05-14T15:24:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.907+0000 7f3bb1600640 1 -- 172.21.15.69:0/3422139042 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bc0004d20 con 0x55c1637e41b0 2024-05-14T15:24:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.907+0000 7f3bb1600640 1 -- 172.21.15.69:0/3422139042 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f3bc00185a0 con 0x55c1637e41b0 2024-05-14T15:24:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.908+0000 7f3bd55ea740 10 client.16005 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.908+0000 7f3bd55ea740 10 client.16005 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:24:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.908+0000 7f3bd55ea740 20 client.16005 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.908+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/3422139042 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c1637a2d80 0x55c163ba1bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.908+0000 7f3bd55ea740 4 client.16005 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:24:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.908+0000 7f3bd55ea740 1 -- 172.21.15.69:0/3422139042 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c163af8160 con 0x55c1637a2d80 2024-05-14T15:24:25.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.908+0000 7f3bc7400640 1 --2- 172.21.15.69:0/3422139042 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c1637a2d80 0x55c163ba1bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.909+0000 7f3bc7400640 1 --2- 172.21.15.69:0/3422139042 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c1637a2d80 0x55c163ba1bf0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=884876fef9d93a0c server_cookie=bbb459020bb08e4e in_seq=0 out_seq=0 2024-05-14T15:24:25.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.909+0000 7f3bb1600640 10 client.16005 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:25.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.911+0000 7f3bb1600640 1 -- 172.21.15.69:0/3422139042 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c163af8160 con 0x55c1637a2d80 2024-05-14T15:24:25.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.911+0000 7f3bb1600640 10 client.16005 handle_command_reply: tid=0 2024-05-14T15:24:25.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.911+0000 7f3bd55ea740 1 client.16005 shutdown 2024-05-14T15:24:25.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.911+0000 7f3bd55ea740 1 -- 172.21.15.69:0/3422139042 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637e41b0 msgr2=0x55c163b9ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.912+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/3422139042 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637e41b0 0x55c163b9ba80 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0000f80 tx=0x7f3bc0007bd0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.912+0000 7f3bd55ea740 1 -- 172.21.15.69:0/3422139042 shutdown_connections 2024-05-14T15:24:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.912+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/3422139042 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c1637a2d80 0x55c163ba1bf0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.912+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/3422139042 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637e41b0 0x55c163b9ba80 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.912+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/3422139042 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637c34d0 0x55c163b8feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.912+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/3422139042 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637bb2f0 0x55c163b8f970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.912+0000 7f3bb1600640 0 client.16005 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.912+0000 7f3bd55ea740 1 -- 172.21.15.69:0/3422139042 >> 172.21.15.69:0/3422139042 conn(0x55c1637d8300 msgr2=0x55c163b852a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.912+0000 7f3bd55ea740 1 -- 172.21.15.69:0/3422139042 shutdown_connections 2024-05-14T15:24:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.912+0000 7f3bd55ea740 1 -- 172.21.15.69:0/3422139042 wait complete. 2024-05-14T15:24:25.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.912+0000 7f3bd55ea740 20 client.16005 trim_cache size 0 max 16384 2024-05-14T15:24:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.930+0000 7f3bd55ea740 1 Processor -- start 2024-05-14T15:24:25.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.930+0000 7f3bd55ea740 1 -- start start 2024-05-14T15:24:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.931+0000 7f3bd55ea740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637bb2f0 0x55c163b89fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.931+0000 7f3bd55ea740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637c34d0 0x55c163b9b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.931+0000 7f3bd55ea740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637e41b0 0x55c163b9bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.931+0000 7f3bd55ea740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc81b3360 con 0x55c1637bb2f0 2024-05-14T15:24:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.931+0000 7f3bd55ea740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc81b5020 con 0x55c1637c34d0 2024-05-14T15:24:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.931+0000 7f3bd55ea740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc81b3a30 con 0x55c1637e41b0 2024-05-14T15:24:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.931+0000 7f3bc7400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637bb2f0 0x55c163b89fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.931+0000 7f3bc7400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637bb2f0 0x55c163b89fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55652/0 (socket says 172.21.15.69:55652) 2024-05-14T15:24:25.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.931+0000 7f3bc7400640 1 -- 172.21.15.69:0/246861414 learned_addr learned my addr 172.21.15.69:0/246861414 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:25.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.932+0000 7f3bc6a00640 1 --2- 172.21.15.69:0/246861414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637c34d0 0x55c163b9b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.932+0000 7f3bc7e00640 1 --2- 172.21.15.69:0/246861414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637e41b0 0x55c163b9bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.932+0000 7f3bc7400640 1 -- 172.21.15.69:0/246861414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637e41b0 msgr2=0x55c163b9bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:25.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.932+0000 7f3bc7400640 1 --2- 172.21.15.69:0/246861414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637e41b0 0x55c163b9bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.932+0000 7f3bc7400640 1 -- 172.21.15.69:0/246861414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637c34d0 msgr2=0x55c163b9b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:25.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.932+0000 7f3bc7400640 1 --2- 172.21.15.69:0/246861414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637c34d0 0x55c163b9b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.932+0000 7f3bc7400640 1 -- 172.21.15.69:0/246861414 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c163b86850 con 0x55c1637bb2f0 2024-05-14T15:24:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.932+0000 7f3bc7400640 1 --2- 172.21.15.69:0/246861414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637bb2f0 0x55c163b89fc0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x55c163b82bb0 tx=0x7f3bb8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cd63736942e9123 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.932+0000 7f3bb3e00640 1 -- 172.21.15.69:0/246861414 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8005020 con 0x55c1637bb2f0 2024-05-14T15:24:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.932+0000 7f3bb3e00640 1 -- 172.21.15.69:0/246861414 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bb80047a0 con 0x55c1637bb2f0 2024-05-14T15:24:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.932+0000 7f3bb3e00640 1 -- 172.21.15.69:0/246861414 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8028520 con 0x55c1637bb2f0 2024-05-14T15:24:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.933+0000 7f3bd55ea740 1 -- 172.21.15.69:0/246861414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637bb2f0 msgr2=0x55c163b89fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.933+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/246861414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637bb2f0 0x55c163b89fc0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x55c163b82bb0 tx=0x7f3bb8018000 comp rx=0 tx=0).stop 2024-05-14T15:24:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.934+0000 7f3bd55ea740 1 -- 172.21.15.69:0/246861414 shutdown_connections 2024-05-14T15:24:25.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.934+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/246861414 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637e41b0 0x55c163b9bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.934+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/246861414 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637c34d0 0x55c163b9b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.934+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/246861414 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637bb2f0 0x55c163b89fc0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.934+0000 7f3bd55ea740 1 -- 172.21.15.69:0/246861414 >> 172.21.15.69:0/246861414 conn(0x55c1637d8300 msgr2=0x55c163b85200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:25.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.934+0000 7f3bd55ea740 1 -- 172.21.15.69:0/246861414 shutdown_connections 2024-05-14T15:24:25.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.934+0000 7f3bd55ea740 1 -- 172.21.15.69:0/246861414 wait complete. 2024-05-14T15:24:25.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.934+0000 7f3bd55ea740 1 -- start start 2024-05-14T15:24:25.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.935+0000 7f3bd55ea740 1 Processor -- start 2024-05-14T15:24:25.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.935+0000 7f3bd55ea740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637bb2f0 0x55c163ba1fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.935+0000 7f3bd55ea740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637c34d0 0x55c163ba2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.935+0000 7f3bd55ea740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637e41b0 0x55c163c07d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.935+0000 7f3bd55ea740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc81b4890 con 0x55c1637c34d0 2024-05-14T15:24:25.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.935+0000 7f3bd55ea740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc81b4130 con 0x55c1637e41b0 2024-05-14T15:24:25.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.935+0000 7f3bd55ea740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3bc81b1340 con 0x55c1637bb2f0 2024-05-14T15:24:25.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.935+0000 7f3bd55ea740 10 client.0 _ll_register_callbacks cb 0x7f3bb800b440 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:25.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.936+0000 7f3bc6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637c34d0 0x55c163ba2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.936+0000 7f3bc6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637c34d0 0x55c163ba2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55666/0 (socket says 172.21.15.69:55666) 2024-05-14T15:24:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.936+0000 7f3bc6a00640 1 -- 172.21.15.69:0/3713771372 learned_addr learned my addr 172.21.15.69:0/3713771372 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:25.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.936+0000 7f3bc7400640 1 --2- 172.21.15.69:0/3713771372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637bb2f0 0x55c163ba1fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.936+0000 7f3bc7e00640 1 --2- 172.21.15.69:0/3713771372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637e41b0 0x55c163c07d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.936+0000 7f3bc6a00640 1 -- 172.21.15.69:0/3713771372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637bb2f0 msgr2=0x55c163ba1fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.936+0000 7f3bc6a00640 1 --2- 172.21.15.69:0/3713771372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637bb2f0 0x55c163ba1fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.936+0000 7f3bc6a00640 1 -- 172.21.15.69:0/3713771372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637e41b0 msgr2=0x55c163c07d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.936+0000 7f3bc6a00640 1 --2- 172.21.15.69:0/3713771372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637e41b0 0x55c163c07d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.936+0000 7f3bc6a00640 1 -- 172.21.15.69:0/3713771372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c163c08250 con 0x55c1637c34d0 2024-05-14T15:24:25.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.936+0000 7f3bc6a00640 1 --2- 172.21.15.69:0/3713771372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637c34d0 0x55c163ba2500 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40c9b80 tx=0x7f3bb40c5e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1161c0b30bdda039 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.936+0000 7f3bb1600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.937+0000 7f3bb1600640 1 -- 172.21.15.69:0/3713771372 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bb4049040 con 0x55c1637c34d0 2024-05-14T15:24:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.937+0000 7f3bb1600640 1 -- 172.21.15.69:0/3713771372 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f3bb41050d0 con 0x55c1637c34d0 2024-05-14T15:24:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.937+0000 7f3bd55ea740 1 -- 172.21.15.69:0/3713771372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bb80047a0 con 0x55c1637c34d0 2024-05-14T15:24:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.937+0000 7f3bb1600640 1 -- 172.21.15.69:0/3713771372 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f3bb40c95f0 con 0x55c1637c34d0 2024-05-14T15:24:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.937+0000 7f3bd55ea740 10 client.16011 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.937+0000 7f3bd55ea740 1 -- 172.21.15.69:0/3713771372 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55c163c09510 con 0x55c1637c34d0 2024-05-14T15:24:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.937+0000 7f3bb1600640 1 -- 172.21.15.69:0/3713771372 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3bb80047a0 con 0x55c1637c34d0 2024-05-14T15:24:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.937+0000 7f3bb1600640 1 -- 172.21.15.69:0/3713771372 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f3bb40ca0e0 con 0x55c1637c34d0 2024-05-14T15:24:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.937+0000 7f3bd55ea740 10 client.16011 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.937+0000 7f3bd55ea740 10 client.16011 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:24:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.937+0000 7f3bd55ea740 20 client.16011 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:25.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.937+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/3713771372 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c1637781c0 0x55c163c0bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.937+0000 7f3bd55ea740 4 client.16011 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:24:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.937+0000 7f3bd55ea740 1 -- 172.21.15.69:0/3713771372 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c163af1fd0 con 0x55c1637781c0 2024-05-14T15:24:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.938+0000 7f3bc7400640 1 --2- 172.21.15.69:0/3713771372 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c1637781c0 0x55c163c0bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.939+0000 7f3bc7400640 1 --2- 172.21.15.69:0/3713771372 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c1637781c0 0x55c163c0bdc0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aaaf1f6af3bb368 server_cookie=835f3678326778fc in_seq=0 out_seq=0 2024-05-14T15:24:25.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.939+0000 7f3bb1600640 10 client.16011 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.988+0000 7f3bb1600640 1 -- 172.21.15.69:0/3713771372 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c163af1fd0 con 0x55c1637781c0 2024-05-14T15:24:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.988+0000 7f3bb1600640 10 client.16011 handle_command_reply: tid=0 2024-05-14T15:24:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.988+0000 7f3bd55ea740 1 client.16011 shutdown 2024-05-14T15:24:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.989+0000 7f3bd55ea740 1 -- 172.21.15.69:0/3713771372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637c34d0 msgr2=0x55c163ba2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.989+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/3713771372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637c34d0 0x55c163ba2500 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40c9b80 tx=0x7f3bb40c5e70 comp rx=0 tx=0).stop 2024-05-14T15:24:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.989+0000 7f3bd55ea740 1 -- 172.21.15.69:0/3713771372 shutdown_connections 2024-05-14T15:24:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.989+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/3713771372 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1637e41b0 0x55c163c07d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.989+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/3713771372 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c1637781c0 0x55c163c0bdc0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.989+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/3713771372 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1637c34d0 0x55c163ba2500 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.989+0000 7f3bd55ea740 1 --2- 172.21.15.69:0/3713771372 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1637bb2f0 0x55c163ba1fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.989+0000 7f3bd55ea740 1 -- 172.21.15.69:0/3713771372 >> 172.21.15.69:0/3713771372 conn(0x55c1637d8300 msgr2=0x55c163b90e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:25.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.989+0000 7f3bb1600640 0 client.16011 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.989+0000 7f3bd55ea740 1 -- 172.21.15.69:0/3713771372 shutdown_connections 2024-05-14T15:24:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.989+0000 7f3bd55ea740 1 -- 172.21.15.69:0/3713771372 wait complete. 2024-05-14T15:24:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.990+0000 7f3bd55ea740 20 client.16011 trim_cache size 0 max 16384 2024-05-14T15:24:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:24:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:24:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:24:25.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:24:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.990+0000 7f3bcd000640 1 -- 172.21.15.69:0/154924681 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3bac0b29d0 msgr2=0x7f3bac0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.990+0000 7f3bcd000640 1 --2- 172.21.15.69:0/154924681 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3bac0b29d0 0x7f3bac0b4ee0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x55c163b86820 tx=0x7f3bb800b5a0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.990+0000 7f3bcd000640 1 -- 172.21.15.69:0/154924681 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3bc810da70 msgr2=0x7f3bc819cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.990+0000 7f3bcd000640 1 --2- 172.21.15.69:0/154924681 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3bc810da70 0x7f3bc819cd60 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f3bb4009230 tx=0x7f3bb40042f0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.991+0000 7f3bcd000640 1 -- 172.21.15.69:0/154924681 shutdown_connections 2024-05-14T15:24:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.991+0000 7f3bcd000640 1 --2- 172.21.15.69:0/154924681 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3bac0b29d0 0x7f3bac0b4ee0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.991+0000 7f3bcd000640 1 --2- 172.21.15.69:0/154924681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3bc81103d0 0x7f3bc81a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.991+0000 7f3bcd000640 1 --2- 172.21.15.69:0/154924681 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3bc810da70 0x7f3bc819cd60 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.991+0000 7f3bcd000640 1 --2- 172.21.15.69:0/154924681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3bc8102830 0x7f3bc819c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.991+0000 7f3bcd000640 1 -- 172.21.15.69:0/154924681 >> 172.21.15.69:0/154924681 conn(0x7f3bc80fe220 msgr2=0x7f3bc8100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:25.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.991+0000 7f3bcd000640 1 -- 172.21.15.69:0/154924681 shutdown_connections 2024-05-14T15:24:25.993 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:25.991+0000 7f3bcd000640 1 -- 172.21.15.69:0/154924681 wait complete. 2024-05-14T15:24:27.330 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:27 smithi069 ceph-mon[31270]: pgmap v87: 129 pgs: 129 active+clean; 662 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 11 MiB/s wr, 86 op/s 2024-05-14T15:24:27.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:27 smithi203 ceph-mon[34567]: pgmap v87: 129 pgs: 129 active+clean; 662 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 11 MiB/s wr, 86 op/s 2024-05-14T15:24:27.414 INFO:teuthology.orchestra.run.smithi069.stderr:2600000 of 3200000 tuples (81%) done (elapsed 93.02 s, remaining 21.47 s) 2024-05-14T15:24:27.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:27 smithi092 ceph-mon[34729]: pgmap v87: 129 pgs: 129 active+clean; 662 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 11 MiB/s wr, 86 op/s 2024-05-14T15:24:28.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:28 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:24:28.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:28 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:24:28.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:28 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:24:28.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:28 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:24:28.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:28 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:24:28.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:28 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:24:28.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:28 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:24:28.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:28 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:24:28.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:28 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:24:28.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:28 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:24:28.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:28 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:24:28.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:28 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:24:28.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:28 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:24:28.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:28 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:24:28.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:28 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:24:29.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:29 smithi203 ceph-mon[34567]: pgmap v88: 129 pgs: 129 active+clean; 662 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 11 MiB/s wr, 86 op/s 2024-05-14T15:24:29.377 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:29 smithi069 ceph-mon[31270]: pgmap v88: 129 pgs: 129 active+clean; 662 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 11 MiB/s wr, 86 op/s 2024-05-14T15:24:29.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:29 smithi092 ceph-mon[34729]: pgmap v88: 129 pgs: 129 active+clean; 662 MiB data, 1.7 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 11 MiB/s wr, 86 op/s 2024-05-14T15:24:31.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:31 smithi203 ceph-mon[34567]: pgmap v89: 129 pgs: 129 active+clean; 680 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 15 MiB/s wr, 96 op/s 2024-05-14T15:24:31.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:31 smithi092 ceph-mon[34729]: pgmap v89: 129 pgs: 129 active+clean; 680 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 15 MiB/s wr, 96 op/s 2024-05-14T15:24:31.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:31 smithi069 ceph-mon[31270]: pgmap v89: 129 pgs: 129 active+clean; 680 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 15 MiB/s wr, 96 op/s 2024-05-14T15:24:32.094 INFO:teuthology.orchestra.run.smithi069.stderr:2700000 of 3200000 tuples (84%) done (elapsed 97.70 s, remaining 18.09 s) 2024-05-14T15:24:33.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:33 smithi203 ceph-mon[34567]: pgmap v90: 129 pgs: 129 active+clean; 680 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.8 MiB/s wr, 19 op/s 2024-05-14T15:24:33.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:33 smithi092 ceph-mon[34729]: pgmap v90: 129 pgs: 129 active+clean; 680 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.8 MiB/s wr, 19 op/s 2024-05-14T15:24:33.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:33 smithi069 ceph-mon[31270]: pgmap v90: 129 pgs: 129 active+clean; 680 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.8 MiB/s wr, 19 op/s 2024-05-14T15:24:35.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:35 smithi203 ceph-mon[34567]: pgmap v91: 129 pgs: 129 active+clean; 708 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 28 op/s 2024-05-14T15:24:35.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:35 smithi092 ceph-mon[34729]: pgmap v91: 129 pgs: 129 active+clean; 708 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 28 op/s 2024-05-14T15:24:35.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:35 smithi069 ceph-mon[31270]: pgmap v91: 129 pgs: 129 active+clean; 708 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 28 op/s 2024-05-14T15:24:36.463 INFO:teuthology.orchestra.run.smithi069.stderr:2800000 of 3200000 tuples (87%) done (elapsed 102.07 s, remaining 14.58 s) 2024-05-14T15:24:37.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:37 smithi203 ceph-mon[34567]: pgmap v92: 129 pgs: 129 active+clean; 708 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.4 MiB/s wr, 19 op/s 2024-05-14T15:24:37.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:37 smithi092 ceph-mon[34729]: pgmap v92: 129 pgs: 129 active+clean; 708 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.4 MiB/s wr, 19 op/s 2024-05-14T15:24:37.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:37 smithi069 ceph-mon[31270]: pgmap v92: 129 pgs: 129 active+clean; 708 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.4 MiB/s wr, 19 op/s 2024-05-14T15:24:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.235+0000 7fa140a00640 1 -- 172.21.15.69:0/1911034801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa13c1027f0 msgr2=0x7fa13c102c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.235+0000 7fa140a00640 1 --2- 172.21.15.69:0/1911034801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa13c1027f0 0x7fa13c102c00 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fa12c009900 tx=0x7fa12c02a410 comp rx=0 tx=0).stop 2024-05-14T15:24:39.237 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.235+0000 7fa140a00640 1 -- 172.21.15.69:0/1911034801 shutdown_connections 2024-05-14T15:24:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.235+0000 7fa140a00640 1 --2- 172.21.15.69:0/1911034801 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa13c110390 0x7fa13c1127b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.235+0000 7fa140a00640 1 --2- 172.21.15.69:0/1911034801 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa13c10da30 0x7fa13c10fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.235+0000 7fa140a00640 1 --2- 172.21.15.69:0/1911034801 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa13c1027f0 0x7fa13c102c00 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.235+0000 7fa140a00640 1 -- 172.21.15.69:0/1911034801 >> 172.21.15.69:0/1911034801 conn(0x7fa13c078140 msgr2=0x7fa13c078580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.235+0000 7fa140a00640 1 -- 172.21.15.69:0/1911034801 shutdown_connections 2024-05-14T15:24:39.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.236+0000 7fa140a00640 1 -- 172.21.15.69:0/1911034801 wait complete. 2024-05-14T15:24:39.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.237+0000 7fa140a00640 1 Processor -- start 2024-05-14T15:24:39.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.237+0000 7fa140a00640 1 -- start start 2024-05-14T15:24:39.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.237+0000 7fa140a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa13c1027f0 0x7fa13c19c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.237+0000 7fa140a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa13c10da30 0x7fa13c19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.237+0000 7fa140a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa13c110390 0x7fa13c1a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.237+0000 7fa140a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c115da0 con 0x7fa13c10da30 2024-05-14T15:24:39.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.237+0000 7fa140a00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c115c20 con 0x7fa13c1027f0 2024-05-14T15:24:39.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.237+0000 7fa140a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c115f20 con 0x7fa13c110390 2024-05-14T15:24:39.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.238+0000 7fa139e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa13c10da30 0x7fa13c19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.238+0000 7fa139e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa13c10da30 0x7fa13c19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57508/0 (socket says 172.21.15.69:57508) 2024-05-14T15:24:39.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.238+0000 7fa139e00640 1 -- 172.21.15.69:0/4250885868 learned_addr learned my addr 172.21.15.69:0/4250885868 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:39.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.238+0000 7fa13b200640 1 --2- 172.21.15.69:0/4250885868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa13c110390 0x7fa13c1a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.238+0000 7fa13a800640 1 --2- 172.21.15.69:0/4250885868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa13c1027f0 0x7fa13c19c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.238+0000 7fa139e00640 1 -- 172.21.15.69:0/4250885868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa13c110390 msgr2=0x7fa13c1a0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:39.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.238+0000 7fa139e00640 1 --2- 172.21.15.69:0/4250885868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa13c110390 0x7fa13c1a0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.238+0000 7fa139e00640 1 -- 172.21.15.69:0/4250885868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa13c1027f0 msgr2=0x7fa13c19c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:39.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.238+0000 7fa139e00640 1 --2- 172.21.15.69:0/4250885868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa13c1027f0 0x7fa13c19c7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.238+0000 7fa139e00640 1 -- 172.21.15.69:0/4250885868 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13c1a1620 con 0x7fa13c10da30 2024-05-14T15:24:39.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.239+0000 7fa139e00640 1 --2- 172.21.15.69:0/4250885868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa13c10da30 0x7fa13c19cd20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa12800d950 tx=0x7fa12800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:39.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.239+0000 7fa133400640 1 -- 172.21.15.69:0/4250885868 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa128017070 con 0x7fa13c10da30 2024-05-14T15:24:39.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.239+0000 7fa140a00640 1 -- 172.21.15.69:0/4250885868 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa13c1a1910 con 0x7fa13c10da30 2024-05-14T15:24:39.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.239+0000 7fa133400640 1 -- 172.21.15.69:0/4250885868 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa128009c30 con 0x7fa13c10da30 2024-05-14T15:24:39.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.239+0000 7fa133400640 1 -- 172.21.15.69:0/4250885868 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12800f620 con 0x7fa13c10da30 2024-05-14T15:24:39.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.239+0000 7fa140a00640 1 -- 172.21.15.69:0/4250885868 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa13c1a9290 con 0x7fa13c10da30 2024-05-14T15:24:39.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.243+0000 7fa14836d740 1 Processor -- start 2024-05-14T15:24:39.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.243+0000 7fa14836d740 1 -- start start 2024-05-14T15:24:39.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.243+0000 7fa14836d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704c3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.243+0000 7fa14836d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.244+0000 7fa14836d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d701014d0 0x560d704c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.244+0000 7fa14836d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560d70428550 con 0x560d700f92f0 2024-05-14T15:24:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.244+0000 7fa14836d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560d703cdbc0 con 0x560d701014d0 2024-05-14T15:24:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.244+0000 7fa14836d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560d70424510 con 0x560d701221b0 2024-05-14T15:24:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.244+0000 7fa13a800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.244+0000 7fa13a800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704c39c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57514/0 (socket says 172.21.15.69:57514) 2024-05-14T15:24:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.244+0000 7fa13a800640 1 -- 172.21.15.69:0/3539660170 learned_addr learned my addr 172.21.15.69:0/3539660170 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.244+0000 7fa13b200640 1 --2- 172.21.15.69:0/3539660170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704c3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.244+0000 7fa13a800640 1 -- 172.21.15.69:0/3539660170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 msgr2=0x560d704c3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.244+0000 7fa13a800640 1 --2- 172.21.15.69:0/3539660170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704c3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.244+0000 7fa13a800640 1 -- 172.21.15.69:0/3539660170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d701014d0 msgr2=0x560d704c3f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:24:39.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.244+0000 7fa13a800640 1 --2- 172.21.15.69:0/3539660170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d701014d0 0x560d704c3f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.244+0000 7fa13a800640 1 -- 172.21.15.69:0/3539660170 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d7013a210 con 0x560d700f92f0 2024-05-14T15:24:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.245+0000 7fa13a800640 1 --2- 172.21.15.69:0/3539660170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704c39c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa12c02aa00 tx=0x7fa12c004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5674a293acea1a10 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:39.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.245+0000 7fa133400640 1 -- 172.21.15.69:0/4250885868 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa128010460 con 0x7fa13c10da30 2024-05-14T15:24:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.245+0000 7fa127400640 1 -- 172.21.15.69:0/3539660170 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c035030 con 0x560d700f92f0 2024-05-14T15:24:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.245+0000 7fa127400640 1 -- 172.21.15.69:0/3539660170 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa12c0054d0 con 0x560d700f92f0 2024-05-14T15:24:39.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.245+0000 7fa127400640 1 -- 172.21.15.69:0/3539660170 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c0035f0 con 0x560d700f92f0 2024-05-14T15:24:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.247+0000 7fa14836d740 1 -- 172.21.15.69:0/3539660170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 msgr2=0x560d704c39c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.247+0000 7fa14836d740 1 --2- 172.21.15.69:0/3539660170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704c39c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa12c02aa00 tx=0x7fa12c004200 comp rx=0 tx=0).stop 2024-05-14T15:24:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.247+0000 7fa14836d740 1 -- 172.21.15.69:0/3539660170 shutdown_connections 2024-05-14T15:24:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.247+0000 7fa14836d740 1 --2- 172.21.15.69:0/3539660170 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d701014d0 0x560d704c3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.247+0000 7fa14836d740 1 --2- 172.21.15.69:0/3539660170 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704c39c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.247+0000 7fa14836d740 1 --2- 172.21.15.69:0/3539660170 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704c3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.247+0000 7fa14836d740 1 -- 172.21.15.69:0/3539660170 >> 172.21.15.69:0/3539660170 conn(0x560d70116300 msgr2=0x560d704bfc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.247+0000 7fa14836d740 1 -- 172.21.15.69:0/3539660170 shutdown_connections 2024-05-14T15:24:39.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.247+0000 7fa133400640 1 --2- 172.21.15.69:0/4250885868 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1200b29d0 0x7fa1200b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.247+0000 7fa14836d740 1 -- 172.21.15.69:0/3539660170 wait complete. 2024-05-14T15:24:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.247+0000 7fa133400640 1 -- 172.21.15.69:0/4250885868 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fa1280e2630 con 0x7fa13c10da30 2024-05-14T15:24:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.247+0000 7fa13a800640 1 --2- 172.21.15.69:0/4250885868 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1200b29d0 0x7fa1200b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.248+0000 7fa14836d740 1 -- start start 2024-05-14T15:24:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.248+0000 7fa14836d740 1 Processor -- start 2024-05-14T15:24:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.248+0000 7fa13a800640 1 --2- 172.21.15.69:0/4250885868 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1200b29d0 0x7fa1200b4ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa12c02a930 tx=0x7fa12c005fd0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa14836d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa14836d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d701014d0 0x560d704cdf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa14836d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704d9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa14836d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560d704d0550 con 0x560d700f92f0 2024-05-14T15:24:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa14836d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560d703e1660 con 0x560d701014d0 2024-05-14T15:24:39.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa14836d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560d704d06d0 con 0x560d701221b0 2024-05-14T15:24:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa14836d740 10 client.0 _ll_register_callbacks cb 0x560d703ab400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa13a800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa13a800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57520/0 (socket says 172.21.15.69:57520) 2024-05-14T15:24:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa13a800640 1 -- 172.21.15.69:0/3608082097 learned_addr learned my addr 172.21.15.69:0/3608082097 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa139e00640 1 --2- 172.21.15.69:0/3608082097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d701014d0 0x560d704cdf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa13b200640 1 --2- 172.21.15.69:0/3608082097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704d9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa13a800640 1 -- 172.21.15.69:0/3608082097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 msgr2=0x560d704d9a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa13a800640 1 --2- 172.21.15.69:0/3608082097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704d9a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa13a800640 1 -- 172.21.15.69:0/3608082097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d701014d0 msgr2=0x560d704cdf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa13a800640 1 --2- 172.21.15.69:0/3608082097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d701014d0 0x560d704cdf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.249+0000 7fa13a800640 1 -- 172.21.15.69:0/3608082097 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d70206620 con 0x560d700f92f0 2024-05-14T15:24:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.250+0000 7fa13b200640 1 --2- 172.21.15.69:0/3608082097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704d9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:24:39.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.250+0000 7fa13a800640 1 --2- 172.21.15.69:0/3608082097 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704cd9d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa12c042000 tx=0x7fa12c004200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e804e5f7131b9e87 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.250+0000 7fa11be00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.250+0000 7fa11be00640 1 -- 172.21.15.69:0/3608082097 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c035050 con 0x560d700f92f0 2024-05-14T15:24:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.250+0000 7fa11be00640 1 -- 172.21.15.69:0/3608082097 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fa12c0050d0 con 0x560d700f92f0 2024-05-14T15:24:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.250+0000 7fa14836d740 1 -- 172.21.15.69:0/3608082097 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa12c0054d0 con 0x560d700f92f0 2024-05-14T15:24:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.250+0000 7fa11be00640 1 -- 172.21.15.69:0/3608082097 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa12c062050 con 0x560d700f92f0 2024-05-14T15:24:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.250+0000 7fa14836d740 10 client.16023 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.250+0000 7fa14836d740 1 -- 172.21.15.69:0/3608082097 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560d704dc820 con 0x560d700f92f0 2024-05-14T15:24:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.251+0000 7fa11be00640 1 -- 172.21.15.69:0/3608082097 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa12c0054d0 con 0x560d700f92f0 2024-05-14T15:24:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.251+0000 7fa11be00640 1 -- 172.21.15.69:0/3608082097 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7fa12c0504b0 con 0x560d700f92f0 2024-05-14T15:24:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.251+0000 7fa14836d740 10 client.16023 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:39.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.251+0000 7fa14836d740 10 client.16023 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:24:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.251+0000 7fa14836d740 20 client.16023 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.251+0000 7fa14836d740 1 --2- 172.21.15.69:0/3608082097 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560d700e0d80 0x560d704dfb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.251+0000 7fa14836d740 4 client.16023 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:24:39.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.251+0000 7fa14836d740 1 -- 172.21.15.69:0/3608082097 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d70436160 con 0x560d700e0d80 2024-05-14T15:24:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.252+0000 7fa139e00640 1 --2- 172.21.15.69:0/3608082097 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560d700e0d80 0x560d704dfb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.253+0000 7fa11be00640 10 client.16023 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.253+0000 7fa139e00640 1 --2- 172.21.15.69:0/3608082097 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560d700e0d80 0x560d704dfb80 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db5acb975e70d1c9 server_cookie=79dc950f9a0c0bdf in_seq=0 out_seq=0 2024-05-14T15:24:39.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.255+0000 7fa11be00640 1 -- 172.21.15.69:0/3608082097 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560d70436160 con 0x560d700e0d80 2024-05-14T15:24:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.255+0000 7fa11be00640 10 client.16023 handle_command_reply: tid=0 2024-05-14T15:24:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.255+0000 7fa14836d740 1 client.16023 shutdown 2024-05-14T15:24:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.255+0000 7fa14836d740 1 -- 172.21.15.69:0/3608082097 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 msgr2=0x560d704cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.255+0000 7fa14836d740 1 --2- 172.21.15.69:0/3608082097 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704cd9d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa12c042000 tx=0x7fa12c004200 comp rx=0 tx=0).stop 2024-05-14T15:24:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.255+0000 7fa14836d740 1 -- 172.21.15.69:0/3608082097 shutdown_connections 2024-05-14T15:24:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.255+0000 7fa14836d740 1 --2- 172.21.15.69:0/3608082097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704d9a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.255+0000 7fa14836d740 1 --2- 172.21.15.69:0/3608082097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d701014d0 0x560d704cdf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.255+0000 7fa14836d740 1 --2- 172.21.15.69:0/3608082097 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560d700e0d80 0x560d704dfb80 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.255+0000 7fa14836d740 1 --2- 172.21.15.69:0/3608082097 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704cd9d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.255+0000 7fa14836d740 1 -- 172.21.15.69:0/3608082097 >> 172.21.15.69:0/3608082097 conn(0x560d70116300 msgr2=0x560d704c51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.255+0000 7fa11be00640 0 client.16023 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.255+0000 7fa14836d740 1 -- 172.21.15.69:0/3608082097 shutdown_connections 2024-05-14T15:24:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.255+0000 7fa14836d740 1 -- 172.21.15.69:0/3608082097 wait complete. 2024-05-14T15:24:39.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.256+0000 7fa14836d740 20 client.16023 trim_cache size 0 max 16384 2024-05-14T15:24:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.272+0000 7fa14836d740 1 Processor -- start 2024-05-14T15:24:39.274 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.272+0000 7fa14836d740 1 -- start start 2024-05-14T15:24:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.273+0000 7fa14836d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d700f92f0 0x560d704c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.273+0000 7fa14836d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d701014d0 0x560d704e5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.273+0000 7fa14836d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704e5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.273+0000 7fa14836d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c1b3260 con 0x560d701014d0 2024-05-14T15:24:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.273+0000 7fa14836d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c1b4f20 con 0x560d700f92f0 2024-05-14T15:24:39.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.273+0000 7fa14836d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c1b3930 con 0x560d701221b0 2024-05-14T15:24:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.273+0000 7fa139e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d701014d0 0x560d704e5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.273+0000 7fa139e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d701014d0 0x560d704e5120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57532/0 (socket says 172.21.15.69:57532) 2024-05-14T15:24:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.273+0000 7fa139e00640 1 -- 172.21.15.69:0/2979407739 learned_addr learned my addr 172.21.15.69:0/2979407739 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.274+0000 7fa13a800640 1 --2- 172.21.15.69:0/2979407739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d700f92f0 0x560d704c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.274+0000 7fa13b200640 1 --2- 172.21.15.69:0/2979407739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704e5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.274+0000 7fa139e00640 1 -- 172.21.15.69:0/2979407739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 msgr2=0x560d704e5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.274+0000 7fa139e00640 1 --2- 172.21.15.69:0/2979407739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704e5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.274+0000 7fa139e00640 1 -- 172.21.15.69:0/2979407739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d700f92f0 msgr2=0x560d704c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.274+0000 7fa139e00640 1 --2- 172.21.15.69:0/2979407739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d700f92f0 0x560d704c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.274+0000 7fa139e00640 1 -- 172.21.15.69:0/2979407739 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d704c8430 con 0x560d701014d0 2024-05-14T15:24:39.276 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.274+0000 7fa13a800640 1 --2- 172.21.15.69:0/2979407739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d700f92f0 0x560d704c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:24:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.274+0000 7fa139e00640 1 --2- 172.21.15.69:0/2979407739 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d701014d0 0x560d704e5120 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa1280058c0 tx=0x7fa128010ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404f2fd31c5f9e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.274+0000 7fa126a00640 1 -- 172.21.15.69:0/2979407739 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1280c2070 con 0x560d701014d0 2024-05-14T15:24:39.277 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.274+0000 7fa126a00640 1 -- 172.21.15.69:0/2979407739 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1280c3e50 con 0x560d701014d0 2024-05-14T15:24:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.274+0000 7fa126a00640 1 -- 172.21.15.69:0/2979407739 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa128020040 con 0x560d701014d0 2024-05-14T15:24:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.275+0000 7fa14836d740 1 -- 172.21.15.69:0/2979407739 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d701014d0 msgr2=0x560d704e5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.275+0000 7fa14836d740 1 --2- 172.21.15.69:0/2979407739 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d701014d0 0x560d704e5120 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7fa1280058c0 tx=0x7fa128010ec0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.275+0000 7fa14836d740 1 -- 172.21.15.69:0/2979407739 shutdown_connections 2024-05-14T15:24:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.275+0000 7fa14836d740 1 --2- 172.21.15.69:0/2979407739 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704e5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.275+0000 7fa14836d740 1 --2- 172.21.15.69:0/2979407739 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d701014d0 0x560d704e5120 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.275+0000 7fa14836d740 1 --2- 172.21.15.69:0/2979407739 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d700f92f0 0x560d704c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.275+0000 7fa14836d740 1 -- 172.21.15.69:0/2979407739 >> 172.21.15.69:0/2979407739 conn(0x560d70116300 msgr2=0x560d704bec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.276+0000 7fa14836d740 1 -- 172.21.15.69:0/2979407739 shutdown_connections 2024-05-14T15:24:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.276+0000 7fa14836d740 1 -- 172.21.15.69:0/2979407739 wait complete. 2024-05-14T15:24:39.278 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.276+0000 7fa14836d740 1 -- start start 2024-05-14T15:24:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.276+0000 7fa14836d740 1 Processor -- start 2024-05-14T15:24:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.277+0000 7fa14836d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704d5d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.277+0000 7fa14836d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d701014d0 0x560d704d10c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.277+0000 7fa14836d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704d1600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.277+0000 7fa14836d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c1b4790 con 0x560d700f92f0 2024-05-14T15:24:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.277+0000 7fa14836d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c1b4030 con 0x560d701014d0 2024-05-14T15:24:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.277+0000 7fa14836d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa13c1b1240 con 0x560d701221b0 2024-05-14T15:24:39.281 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.277+0000 7fa14836d740 10 client.0 _ll_register_callbacks cb 0x7fa12c0040d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.277+0000 7fa13a800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704d5d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.277+0000 7fa13a800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704d5d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57534/0 (socket says 172.21.15.69:57534) 2024-05-14T15:24:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.277+0000 7fa13a800640 1 -- 172.21.15.69:0/618976114 learned_addr learned my addr 172.21.15.69:0/618976114 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.278+0000 7fa13b200640 1 --2- 172.21.15.69:0/618976114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704d1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.278+0000 7fa13a800640 1 -- 172.21.15.69:0/618976114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 msgr2=0x560d704d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.278+0000 7fa13a800640 1 --2- 172.21.15.69:0/618976114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704d1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.278+0000 7fa13a800640 1 -- 172.21.15.69:0/618976114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d701014d0 msgr2=0x560d704d10c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.278+0000 7fa139e00640 1 --2- 172.21.15.69:0/618976114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d701014d0 0x560d704d10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.278+0000 7fa13a800640 1 --2- 172.21.15.69:0/618976114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d701014d0 0x560d704d10c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.278+0000 7fa13a800640 1 -- 172.21.15.69:0/618976114 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d704d1b90 con 0x560d700f92f0 2024-05-14T15:24:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.278+0000 7fa13b200640 1 --2- 172.21.15.69:0/618976114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704d1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:24:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.278+0000 7fa139e00640 1 --2- 172.21.15.69:0/618976114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d701014d0 0x560d704d10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:24:39.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.278+0000 7fa13a800640 1 --2- 172.21.15.69:0/618976114 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704d5d70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa12c02a450 tx=0x7fa12c004b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a465315c4d850e69 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.278+0000 7fa11be00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.278+0000 7fa11be00640 1 -- 172.21.15.69:0/618976114 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa12c035070 con 0x560d700f92f0 2024-05-14T15:24:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.278+0000 7fa11be00640 1 -- 172.21.15.69:0/618976114 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fa12c050420 con 0x560d700f92f0 2024-05-14T15:24:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.278+0000 7fa14836d740 1 -- 172.21.15.69:0/618976114 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1280c3e50 con 0x560d700f92f0 2024-05-14T15:24:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.279+0000 7fa11be00640 1 -- 172.21.15.69:0/618976114 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fa12c050620 con 0x560d700f92f0 2024-05-14T15:24:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.279+0000 7fa14836d740 10 client.16029 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.279+0000 7fa14836d740 1 -- 172.21.15.69:0/618976114 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x560d70547990 con 0x560d700f92f0 2024-05-14T15:24:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.279+0000 7fa11be00640 1 -- 172.21.15.69:0/618976114 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa1280c3e50 con 0x560d700f92f0 2024-05-14T15:24:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.279+0000 7fa11be00640 1 -- 172.21.15.69:0/618976114 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7fa12c003b00 con 0x560d700f92f0 2024-05-14T15:24:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.280+0000 7fa14836d740 10 client.16029 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.280+0000 7fa14836d740 10 client.16029 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:24:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.280+0000 7fa14836d740 20 client.16029 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.280+0000 7fa14836d740 1 --2- 172.21.15.69:0/618976114 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560d700b61c0 0x560d7054a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.280+0000 7fa14836d740 4 client.16029 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:24:39.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.280+0000 7fa14836d740 1 -- 172.21.15.69:0/618976114 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d7042ffd0 con 0x560d700b61c0 2024-05-14T15:24:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.280+0000 7fa139e00640 1 --2- 172.21.15.69:0/618976114 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560d700b61c0 0x560d7054a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.281+0000 7fa139e00640 1 --2- 172.21.15.69:0/618976114 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560d700b61c0 0x560d7054a180 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81b4459c3dbd43ae server_cookie=1c7098685689e688 in_seq=0 out_seq=0 2024-05-14T15:24:39.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.281+0000 7fa11be00640 10 client.16029 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.324+0000 7fa11be00640 1 -- 172.21.15.69:0/618976114 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d7042ffd0 con 0x560d700b61c0 2024-05-14T15:24:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.324+0000 7fa11be00640 10 client.16029 handle_command_reply: tid=0 2024-05-14T15:24:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.324+0000 7fa14836d740 1 client.16029 shutdown 2024-05-14T15:24:39.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.324+0000 7fa14836d740 1 -- 172.21.15.69:0/618976114 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 msgr2=0x560d704d5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.324+0000 7fa14836d740 1 --2- 172.21.15.69:0/618976114 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704d5d70 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7fa12c02a450 tx=0x7fa12c004b10 comp rx=0 tx=0).stop 2024-05-14T15:24:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.324+0000 7fa14836d740 1 -- 172.21.15.69:0/618976114 shutdown_connections 2024-05-14T15:24:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.324+0000 7fa14836d740 1 --2- 172.21.15.69:0/618976114 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d701221b0 0x560d704d1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.324+0000 7fa14836d740 1 --2- 172.21.15.69:0/618976114 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d701014d0 0x560d704d10c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.324+0000 7fa14836d740 1 --2- 172.21.15.69:0/618976114 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560d700b61c0 0x560d7054a180 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.324+0000 7fa14836d740 1 --2- 172.21.15.69:0/618976114 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d700f92f0 0x560d704d5d70 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.324+0000 7fa14836d740 1 -- 172.21.15.69:0/618976114 >> 172.21.15.69:0/618976114 conn(0x560d70116300 msgr2=0x560d704c3c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.325+0000 7fa11be00640 0 client.16029 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.325+0000 7fa14836d740 1 -- 172.21.15.69:0/618976114 shutdown_connections 2024-05-14T15:24:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.325+0000 7fa14836d740 1 -- 172.21.15.69:0/618976114 wait complete. 2024-05-14T15:24:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.325+0000 7fa14836d740 20 client.16029 trim_cache size 0 max 16384 2024-05-14T15:24:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:24:39.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:24:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:24:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:24:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.326+0000 7fa140a00640 1 -- 172.21.15.69:0/4250885868 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1200b29d0 msgr2=0x7fa1200b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.326+0000 7fa140a00640 1 --2- 172.21.15.69:0/4250885868 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1200b29d0 0x7fa1200b4ee0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa12c02a930 tx=0x7fa12c005fd0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.326+0000 7fa140a00640 1 -- 172.21.15.69:0/4250885868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa13c10da30 msgr2=0x7fa13c19cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.326+0000 7fa140a00640 1 --2- 172.21.15.69:0/4250885868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa13c10da30 0x7fa13c19cd20 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7fa12800d950 tx=0x7fa12800de10 comp rx=0 tx=0).stop 2024-05-14T15:24:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.326+0000 7fa140a00640 1 -- 172.21.15.69:0/4250885868 shutdown_connections 2024-05-14T15:24:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.326+0000 7fa140a00640 1 --2- 172.21.15.69:0/4250885868 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1200b29d0 0x7fa1200b4ee0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.326+0000 7fa140a00640 1 --2- 172.21.15.69:0/4250885868 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa13c110390 0x7fa13c1a0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.326+0000 7fa140a00640 1 --2- 172.21.15.69:0/4250885868 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa13c10da30 0x7fa13c19cd20 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.326+0000 7fa140a00640 1 --2- 172.21.15.69:0/4250885868 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa13c1027f0 0x7fa13c19c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.326+0000 7fa140a00640 1 -- 172.21.15.69:0/4250885868 >> 172.21.15.69:0/4250885868 conn(0x7fa13c078140 msgr2=0x7fa13c101160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.327+0000 7fa140a00640 1 -- 172.21.15.69:0/4250885868 shutdown_connections 2024-05-14T15:24:39.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:39.327+0000 7fa140a00640 1 -- 172.21.15.69:0/4250885868 wait complete. 2024-05-14T15:24:39.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:39 smithi203 ceph-mon[34567]: pgmap v93: 129 pgs: 129 active+clean; 708 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.4 MiB/s wr, 19 op/s 2024-05-14T15:24:39.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:39 smithi092 ceph-mon[34729]: pgmap v93: 129 pgs: 129 active+clean; 708 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.4 MiB/s wr, 19 op/s 2024-05-14T15:24:39.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:39 smithi069 ceph-mon[31270]: pgmap v93: 129 pgs: 129 active+clean; 708 MiB data, 1.8 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 8.4 MiB/s wr, 19 op/s 2024-05-14T15:24:40.872 INFO:teuthology.orchestra.run.smithi069.stderr:2900000 of 3200000 tuples (90%) done (elapsed 106.48 s, remaining 11.02 s) 2024-05-14T15:24:41.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:41 smithi203 ceph-mon[34567]: pgmap v94: 129 pgs: 129 active+clean; 736 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 27 op/s 2024-05-14T15:24:41.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:41 smithi092 ceph-mon[34729]: pgmap v94: 129 pgs: 129 active+clean; 736 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 27 op/s 2024-05-14T15:24:41.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:41 smithi069 ceph-mon[31270]: pgmap v94: 129 pgs: 129 active+clean; 736 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 27 op/s 2024-05-14T15:24:43.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:43 smithi203 ceph-mon[34567]: pgmap v95: 129 pgs: 129 active+clean; 736 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.8 MiB/s wr, 17 op/s 2024-05-14T15:24:43.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:43 smithi092 ceph-mon[34729]: pgmap v95: 129 pgs: 129 active+clean; 736 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.8 MiB/s wr, 17 op/s 2024-05-14T15:24:43.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:43 smithi069 ceph-mon[31270]: pgmap v95: 129 pgs: 129 active+clean; 736 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.8 MiB/s wr, 17 op/s 2024-05-14T15:24:45.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:45 smithi203 ceph-mon[34567]: pgmap v96: 129 pgs: 129 active+clean; 761 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 27 op/s 2024-05-14T15:24:45.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:45 smithi092 ceph-mon[34729]: pgmap v96: 129 pgs: 129 active+clean; 761 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 27 op/s 2024-05-14T15:24:45.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:45 smithi069 ceph-mon[31270]: pgmap v96: 129 pgs: 129 active+clean; 761 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 13 MiB/s wr, 27 op/s 2024-05-14T15:24:45.895 INFO:teuthology.orchestra.run.smithi069.stderr:3000000 of 3200000 tuples (93%) done (elapsed 111.50 s, remaining 7.43 s) 2024-05-14T15:24:47.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:47 smithi092 ceph-mon[34729]: pgmap v97: 129 pgs: 129 active+clean; 761 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.4 MiB/s wr, 18 op/s 2024-05-14T15:24:47.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:47 smithi069 ceph-mon[31270]: pgmap v97: 129 pgs: 129 active+clean; 761 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.4 MiB/s wr, 18 op/s 2024-05-14T15:24:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:47 smithi203 ceph-mon[34567]: pgmap v97: 129 pgs: 129 active+clean; 761 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.4 MiB/s wr, 18 op/s 2024-05-14T15:24:49.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:49 smithi092 ceph-mon[34729]: pgmap v98: 129 pgs: 129 active+clean; 761 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.4 MiB/s wr, 18 op/s 2024-05-14T15:24:49.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:49 smithi069 ceph-mon[31270]: pgmap v98: 129 pgs: 129 active+clean; 761 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.4 MiB/s wr, 18 op/s 2024-05-14T15:24:49.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:49 smithi203 ceph-mon[34567]: pgmap v98: 129 pgs: 129 active+clean; 761 MiB data, 1.9 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 8.4 MiB/s wr, 18 op/s 2024-05-14T15:24:50.163 INFO:teuthology.orchestra.run.smithi069.stderr:3100000 of 3200000 tuples (96%) done (elapsed 115.77 s, remaining 3.73 s) 2024-05-14T15:24:50.823 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T15:24:51.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:51 smithi069 ceph-mon[31270]: pgmap v99: 129 pgs: 129 active+clean; 781 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 27 op/s 2024-05-14T15:24:51.328 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:24:51.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:51 smithi092 ceph-mon[34729]: pgmap v99: 129 pgs: 129 active+clean; 781 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 27 op/s 2024-05-14T15:24:51.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:51 smithi203 ceph-mon[34567]: pgmap v99: 129 pgs: 129 active+clean; 781 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 12 MiB/s wr, 27 op/s 2024-05-14T15:24:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.583+0000 7f45dfe00640 1 -- 172.21.15.69:0/813651331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45e0109f80 msgr2=0x7f45e0103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.583+0000 7f45dfe00640 1 --2- 172.21.15.69:0/813651331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45e0109f80 0x7f45e0103bc0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009900 tx=0x7f45cc02a410 comp rx=0 tx=0).stop 2024-05-14T15:24:52.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.583+0000 7f45dfe00640 1 -- 172.21.15.69:0/813651331 shutdown_connections 2024-05-14T15:24:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.584+0000 7f45dfe00640 1 --2- 172.21.15.69:0/813651331 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45e0104230 0x7f45e0110600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.584+0000 7f45dfe00640 1 --2- 172.21.15.69:0/813651331 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45e0109f80 0x7f45e0103bc0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.584+0000 7f45dfe00640 1 --2- 172.21.15.69:0/813651331 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45e0109ae0 0x7f45e0103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.584+0000 7f45dfe00640 1 -- 172.21.15.69:0/813651331 >> 172.21.15.69:0/813651331 conn(0x7f45e00ff340 msgr2=0x7f45e0101760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.584+0000 7f45dfe00640 1 -- 172.21.15.69:0/813651331 shutdown_connections 2024-05-14T15:24:52.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.584+0000 7f45dfe00640 1 -- 172.21.15.69:0/813651331 wait complete. 2024-05-14T15:24:52.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.585+0000 7f45dfe00640 1 Processor -- start 2024-05-14T15:24:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.585+0000 7f45dfe00640 1 -- start start 2024-05-14T15:24:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.585+0000 7f45dfe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45e0104230 0x7f45e019d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.586+0000 7f45dfe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45e0109ae0 0x7f45e019db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.586+0000 7f45dfe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45e0109f80 0x7f45e01a84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.586+0000 7f45dfe00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f45e0113b80 con 0x7f45e0104230 2024-05-14T15:24:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.586+0000 7f45dfe00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45e0113a00 con 0x7f45e0109ae0 2024-05-14T15:24:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.586+0000 7f45dfe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f45e0113d00 con 0x7f45e0109f80 2024-05-14T15:24:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.586+0000 7f45dea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45e0104230 0x7f45e019d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.586+0000 7f45dea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45e0104230 0x7f45e019d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47866/0 (socket says 172.21.15.69:47866) 2024-05-14T15:24:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.586+0000 7f45dea00640 1 -- 172.21.15.69:0/674792473 learned_addr learned my addr 172.21.15.69:0/674792473 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:52.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.586+0000 7f45de000640 1 --2- 172.21.15.69:0/674792473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45e0109ae0 0x7f45e019db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.586+0000 7f45df400640 1 --2- 172.21.15.69:0/674792473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45e0109f80 0x7f45e01a84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.587+0000 7f45dea00640 1 -- 172.21.15.69:0/674792473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45e0109f80 msgr2=0x7f45e01a84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.587+0000 7f45dea00640 1 --2- 172.21.15.69:0/674792473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45e0109f80 0x7f45e01a84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.587+0000 7f45dea00640 1 -- 172.21.15.69:0/674792473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45e0109ae0 msgr2=0x7f45e019db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.587+0000 7f45dea00640 1 --2- 172.21.15.69:0/674792473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45e0109ae0 0x7f45e019db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.587+0000 7f45dea00640 1 -- 172.21.15.69:0/674792473 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e01a8a20 con 0x7f45e0104230 2024-05-14T15:24:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.587+0000 7f45de000640 1 --2- 172.21.15.69:0/674792473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45e0109ae0 0x7f45e019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:24:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.587+0000 7f45df400640 1 --2- 172.21.15.69:0/674792473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45e0109f80 0x7f45e01a84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:24:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.587+0000 7f45dea00640 1 --2- 172.21.15.69:0/674792473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45e0104230 0x7f45e019d640 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f45d0005fd0 tx=0x7f45d000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.587+0000 7f45d7400640 1 -- 172.21.15.69:0/674792473 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d0017070 con 0x7f45e0104230 2024-05-14T15:24:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.587+0000 7f45dfe00640 1 -- 172.21.15.69:0/674792473 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e01a8d10 con 0x7f45e0104230 2024-05-14T15:24:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.587+0000 7f45d7400640 1 -- 172.21.15.69:0/674792473 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45d0009c30 con 0x7f45e0104230 2024-05-14T15:24:52.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.587+0000 7f45d7400640 1 -- 172.21.15.69:0/674792473 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d0003c70 con 0x7f45e0104230 2024-05-14T15:24:52.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.588+0000 7f45dfe00640 1 -- 172.21.15.69:0/674792473 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e01a9180 con 0x7f45e0104230 2024-05-14T15:24:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.591+0000 7f45eca19740 1 Processor -- start 2024-05-14T15:24:52.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.591+0000 7f45eca19740 1 -- start start 2024-05-14T15:24:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.592+0000 7f45eca19740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94d1b1b0 0x55ff950bc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.592+0000 7f45eca19740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94cf22f0 0x55ff950bc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.592+0000 7f45eca19740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94cfa4d0 0x55ff950bcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.592+0000 7f45eca19740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ff95021550 con 0x55ff94d1b1b0 2024-05-14T15:24:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.592+0000 7f45eca19740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ff94fc6bc0 con 0x55ff94cf22f0 2024-05-14T15:24:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.592+0000 7f45eca19740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ff9501d510 con 0x55ff94cfa4d0 2024-05-14T15:24:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.592+0000 7f45df400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94d1b1b0 0x55ff950bc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.592+0000 7f45d7400640 1 -- 172.21.15.69:0/674792473 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f45d0010460 con 0x7f45e0104230 2024-05-14T15:24:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.592+0000 7f45df400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94d1b1b0 0x55ff950bc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47872/0 (socket says 172.21.15.69:47872) 2024-05-14T15:24:52.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.592+0000 7f45df400640 1 -- 172.21.15.69:0/3542602901 learned_addr learned my addr 172.21.15.69:0/3542602901 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.593+0000 7f45de000640 1 --2- 172.21.15.69:0/3542602901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94cfa4d0 0x55ff950bcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.593+0000 7f45df400640 1 -- 172.21.15.69:0/3542602901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94cfa4d0 msgr2=0x55ff950bcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.593+0000 7f45df400640 1 --2- 172.21.15.69:0/3542602901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94cfa4d0 0x55ff950bcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.594 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.593+0000 7f45df400640 1 -- 172.21.15.69:0/3542602901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94cf22f0 msgr2=0x55ff950bc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.593+0000 7f45df400640 1 --2- 172.21.15.69:0/3542602901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94cf22f0 0x55ff950bc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.593+0000 7f45df400640 1 -- 172.21.15.69:0/3542602901 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff94d33210 con 0x55ff94d1b1b0 2024-05-14T15:24:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.593+0000 7f45df400640 1 --2- 172.21.15.69:0/3542602901 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94d1b1b0 0x55ff950bc480 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f45d8008dd0 tx=0x7f45d800d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9cd6ebb350f7503 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.594+0000 7f45cbe00640 1 -- 172.21.15.69:0/3542602901 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d800f830 con 0x55ff94d1b1b0 2024-05-14T15:24:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.594+0000 7f45cbe00640 1 -- 172.21.15.69:0/3542602901 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45d800de20 con 0x55ff94d1b1b0 2024-05-14T15:24:52.595 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.594+0000 7f45cbe00640 1 -- 172.21.15.69:0/3542602901 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45d800ec80 con 0x55ff94d1b1b0 2024-05-14T15:24:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.594+0000 7f45d7400640 1 --2- 172.21.15.69:0/674792473 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f45c40b29d0 0x7f45c40b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.595+0000 7f45d7400640 1 -- 172.21.15.69:0/674792473 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f45d00e26b0 con 0x7f45e0104230 2024-05-14T15:24:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.595+0000 7f45dea00640 1 --2- 172.21.15.69:0/674792473 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f45c40b29d0 0x7f45c40b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.595+0000 7f45eca19740 1 -- 172.21.15.69:0/3542602901 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94d1b1b0 msgr2=0x55ff950bc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.595+0000 7f45eca19740 1 --2- 172.21.15.69:0/3542602901 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94d1b1b0 0x55ff950bc480 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f45d8008dd0 tx=0x7f45d800d710 comp rx=0 tx=0).stop 2024-05-14T15:24:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.595+0000 7f45eca19740 1 -- 172.21.15.69:0/3542602901 shutdown_connections 2024-05-14T15:24:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.595+0000 7f45eca19740 1 --2- 172.21.15.69:0/3542602901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94cfa4d0 0x55ff950bcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.595+0000 7f45eca19740 1 --2- 172.21.15.69:0/3542602901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94cf22f0 0x55ff950bc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.595+0000 7f45eca19740 1 --2- 172.21.15.69:0/3542602901 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94d1b1b0 0x55ff950bc480 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.595+0000 7f45eca19740 1 -- 172.21.15.69:0/3542602901 >> 172.21.15.69:0/3542602901 conn(0x55ff94d0f300 msgr2=0x55ff950b8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.595+0000 7f45eca19740 1 -- 172.21.15.69:0/3542602901 shutdown_connections 2024-05-14T15:24:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.595+0000 7f45eca19740 1 -- 172.21.15.69:0/3542602901 wait complete. 2024-05-14T15:24:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.595+0000 7f45dea00640 1 --2- 172.21.15.69:0/674792473 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f45c40b29d0 0x7f45c40b4ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55ff950b9f70 tx=0x7f45d000df10 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.596+0000 7f45eca19740 1 -- start start 2024-05-14T15:24:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.596+0000 7f45eca19740 1 Processor -- start 2024-05-14T15:24:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.597+0000 7f45eca19740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94cf22f0 0x55ff950c6950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.597+0000 7f45eca19740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950c6e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.597+0000 7f45eca19740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94d1b1b0 0x55ff950d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.597+0000 7f45eca19740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ff950c95b0 con 0x55ff94cfa4d0 2024-05-14T15:24:52.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.597+0000 7f45eca19740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ff94fda660 con 0x55ff94d1b1b0 2024-05-14T15:24:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.597+0000 7f45eca19740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ff950c9730 con 0x55ff94cf22f0 2024-05-14T15:24:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.597+0000 7f45eca19740 10 client.0 _ll_register_callbacks cb 0x55ff94fa4400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.597+0000 7f45de000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950c6e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.598+0000 7f45de000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950c6e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47884/0 (socket says 172.21.15.69:47884) 2024-05-14T15:24:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.598+0000 7f45de000640 1 -- 172.21.15.69:0/4049150150 learned_addr learned my addr 172.21.15.69:0/4049150150 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.598+0000 7f45df400640 1 --2- 172.21.15.69:0/4049150150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94cf22f0 0x55ff950c6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.598+0000 7f45df400640 1 --2- 172.21.15.69:0/4049150150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94d1b1b0 0x55ff950d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.598+0000 7f45de000640 1 -- 172.21.15.69:0/4049150150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94cf22f0 msgr2=0x55ff950c6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.598+0000 7f45de000640 1 --2- 172.21.15.69:0/4049150150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94cf22f0 0x55ff950c6950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.598+0000 7f45de000640 1 -- 172.21.15.69:0/4049150150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94d1b1b0 msgr2=0x55ff950d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.598+0000 7f45de000640 1 --2- 172.21.15.69:0/4049150150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94d1b1b0 0x55ff950d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.598+0000 7f45de000640 1 -- 172.21.15.69:0/4049150150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff94dff620 con 0x55ff94cfa4d0 2024-05-14T15:24:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.598+0000 7f45df400640 1 --2- 172.21.15.69:0/4049150150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94d1b1b0 0x55ff950d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:24:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.599+0000 7f45de000640 1 --2- 172.21.15.69:0/4049150150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950c6e90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f45cc000c00 tx=0x7f45cc031720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8cca75764cd94aa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.599+0000 7f45c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.599+0000 7f45c8c00640 1 -- 172.21.15.69:0/4049150150 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc035070 con 0x55ff94cfa4d0 2024-05-14T15:24:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.599+0000 7f45c8c00640 1 -- 172.21.15.69:0/4049150150 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f45cc004240 con 0x55ff94cfa4d0 2024-05-14T15:24:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.599+0000 7f45eca19740 1 -- 172.21.15.69:0/4049150150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45d800de20 con 0x55ff94cfa4d0 2024-05-14T15:24:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.599+0000 7f45c8c00640 1 -- 172.21.15.69:0/4049150150 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f45cc004440 con 0x55ff94cfa4d0 2024-05-14T15:24:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.599+0000 7f45eca19740 10 client.16041 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.599+0000 7f45eca19740 1 -- 172.21.15.69:0/4049150150 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ff950d5830 con 0x55ff94cfa4d0 2024-05-14T15:24:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.600+0000 7f45c8c00640 1 -- 172.21.15.69:0/4049150150 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45d800de20 con 0x55ff94cfa4d0 2024-05-14T15:24:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.600+0000 7f45c8c00640 1 -- 172.21.15.69:0/4049150150 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f45cc004b50 con 0x55ff94cfa4d0 2024-05-14T15:24:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.600+0000 7f45eca19740 10 client.16041 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.600+0000 7f45eca19740 10 client.16041 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:24:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.600+0000 7f45eca19740 20 client.16041 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.600+0000 7f45eca19740 1 --2- 172.21.15.69:0/4049150150 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ff94cd9d80 0x55ff950d8e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.600+0000 7f45eca19740 4 client.16041 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:24:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.600+0000 7f45eca19740 1 -- 172.21.15.69:0/4049150150 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ff9502f160 con 0x55ff94cd9d80 2024-05-14T15:24:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.601+0000 7f45df400640 1 --2- 172.21.15.69:0/4049150150 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ff94cd9d80 0x55ff950d8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.602+0000 7f45c8c00640 10 client.16041 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.602+0000 7f45df400640 1 --2- 172.21.15.69:0/4049150150 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ff94cd9d80 0x55ff950d8e20 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81d149a69f31ce55 server_cookie=2a63feafec3c5da8 in_seq=0 out_seq=0 2024-05-14T15:24:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.604+0000 7f45c8c00640 1 -- 172.21.15.69:0/4049150150 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ff9502f160 con 0x55ff94cd9d80 2024-05-14T15:24:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.604+0000 7f45c8c00640 10 client.16041 handle_command_reply: tid=0 2024-05-14T15:24:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.604+0000 7f45eca19740 1 client.16041 shutdown 2024-05-14T15:24:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.604+0000 7f45eca19740 1 -- 172.21.15.69:0/4049150150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 msgr2=0x55ff950c6e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.604+0000 7f45eca19740 1 --2- 172.21.15.69:0/4049150150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950c6e90 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f45cc000c00 tx=0x7f45cc031720 comp rx=0 tx=0).stop 2024-05-14T15:24:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.604+0000 7f45eca19740 1 -- 172.21.15.69:0/4049150150 shutdown_connections 2024-05-14T15:24:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.605+0000 7f45eca19740 1 --2- 172.21.15.69:0/4049150150 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94d1b1b0 0x55ff950d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.605+0000 7f45eca19740 1 --2- 172.21.15.69:0/4049150150 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ff94cd9d80 0x55ff950d8e20 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.605+0000 7f45eca19740 1 --2- 172.21.15.69:0/4049150150 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950c6e90 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.605+0000 7f45eca19740 1 --2- 172.21.15.69:0/4049150150 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94cf22f0 0x55ff950c6950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.605+0000 7f45eca19740 1 -- 172.21.15.69:0/4049150150 >> 172.21.15.69:0/4049150150 conn(0x55ff94d0f300 msgr2=0x55ff950bc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.605+0000 7f45c8c00640 0 client.16041 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.605+0000 7f45eca19740 1 -- 172.21.15.69:0/4049150150 shutdown_connections 2024-05-14T15:24:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.605+0000 7f45eca19740 1 -- 172.21.15.69:0/4049150150 wait complete. 2024-05-14T15:24:52.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.605+0000 7f45eca19740 20 client.16041 trim_cache size 0 max 16384 2024-05-14T15:24:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.626+0000 7f45eca19740 1 Processor -- start 2024-05-14T15:24:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.626+0000 7f45eca19740 1 -- start start 2024-05-14T15:24:52.627 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.627+0000 7f45eca19740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94cf22f0 0x55ff950c5720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.627+0000 7f45eca19740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950de630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.627+0000 7f45eca19740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94d1b1b0 0x55ff950deb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.627+0000 7f45eca19740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f45e01b3250 con 0x55ff94cfa4d0 2024-05-14T15:24:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.627+0000 7f45eca19740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45e01b4f10 con 0x55ff94cf22f0 2024-05-14T15:24:52.628 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.627+0000 7f45eca19740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f45e01b3920 con 0x55ff94d1b1b0 2024-05-14T15:24:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.627+0000 7f45de000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950de630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.627+0000 7f45de000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950de630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47900/0 (socket says 172.21.15.69:47900) 2024-05-14T15:24:52.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.627+0000 7f45de000640 1 -- 172.21.15.69:0/625051003 learned_addr learned my addr 172.21.15.69:0/625051003 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.627+0000 7f45df400640 1 --2- 172.21.15.69:0/625051003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94cf22f0 0x55ff950c5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.627+0000 7f45df400640 1 --2- 172.21.15.69:0/625051003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94d1b1b0 0x55ff950deb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.628+0000 7f45de000640 1 -- 172.21.15.69:0/625051003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94d1b1b0 msgr2=0x55ff950deb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.628+0000 7f45de000640 1 --2- 172.21.15.69:0/625051003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94d1b1b0 0x55ff950deb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.628+0000 7f45de000640 1 -- 172.21.15.69:0/625051003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94cf22f0 msgr2=0x55ff950c5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.628+0000 7f45de000640 1 --2- 172.21.15.69:0/625051003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94cf22f0 0x55ff950c5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.628+0000 7f45de000640 1 -- 172.21.15.69:0/625051003 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ff950c4c90 con 0x55ff94cfa4d0 2024-05-14T15:24:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.628+0000 7f45df400640 1 --2- 172.21.15.69:0/625051003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94cf22f0 0x55ff950c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:24:52.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.628+0000 7f45de000640 1 --2- 172.21.15.69:0/625051003 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950de630 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f45cc004f40 tx=0x7f45cc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e00ae600d6dc7597 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.628+0000 7f45cb400640 1 -- 172.21.15.69:0/625051003 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc035040 con 0x55ff94cfa4d0 2024-05-14T15:24:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.628+0000 7f45cb400640 1 -- 172.21.15.69:0/625051003 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45cc003960 con 0x55ff94cfa4d0 2024-05-14T15:24:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.628+0000 7f45cb400640 1 -- 172.21.15.69:0/625051003 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc003c00 con 0x55ff94cfa4d0 2024-05-14T15:24:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.629+0000 7f45eca19740 1 -- 172.21.15.69:0/625051003 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 msgr2=0x55ff950de630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.629+0000 7f45eca19740 1 --2- 172.21.15.69:0/625051003 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950de630 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f45cc004f40 tx=0x7f45cc001e70 comp rx=0 tx=0).stop 2024-05-14T15:24:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.629+0000 7f45eca19740 1 -- 172.21.15.69:0/625051003 shutdown_connections 2024-05-14T15:24:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.629+0000 7f45eca19740 1 --2- 172.21.15.69:0/625051003 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94d1b1b0 0x55ff950deb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.629+0000 7f45eca19740 1 --2- 172.21.15.69:0/625051003 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950de630 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.630+0000 7f45eca19740 1 --2- 172.21.15.69:0/625051003 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94cf22f0 0x55ff950c5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.630+0000 7f45eca19740 1 -- 172.21.15.69:0/625051003 >> 172.21.15.69:0/625051003 conn(0x55ff94d0f300 msgr2=0x55ff950c5010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.630+0000 7f45eca19740 1 -- 172.21.15.69:0/625051003 shutdown_connections 2024-05-14T15:24:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.630+0000 7f45eca19740 1 -- 172.21.15.69:0/625051003 wait complete. 2024-05-14T15:24:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.630+0000 7f45eca19740 1 -- start start 2024-05-14T15:24:52.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.630+0000 7f45eca19740 1 Processor -- start 2024-05-14T15:24:52.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.631+0000 7f45eca19740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94cf22f0 0x55ff950cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.631+0000 7f45eca19740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950cbd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.631+0000 7f45eca19740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94d1b1b0 0x55ff950cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.631+0000 7f45eca19740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f45e01b4780 con 0x55ff94cfa4d0 2024-05-14T15:24:52.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.631+0000 7f45eca19740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f45e01b4020 con 0x55ff94cf22f0 2024-05-14T15:24:52.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.631+0000 7f45eca19740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f45e01b1230 con 0x55ff94d1b1b0 2024-05-14T15:24:52.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.631+0000 7f45eca19740 10 client.0 _ll_register_callbacks cb 0x7f45cc009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:52.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.631+0000 7f45de000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950cbd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.631+0000 7f45de000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950cbd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:47906/0 (socket says 172.21.15.69:47906) 2024-05-14T15:24:52.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.631+0000 7f45de000640 1 -- 172.21.15.69:0/4196377316 learned_addr learned my addr 172.21.15.69:0/4196377316 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.632+0000 7f45df400640 1 --2- 172.21.15.69:0/4196377316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94cf22f0 0x55ff950cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.632+0000 7f45df400640 1 --2- 172.21.15.69:0/4196377316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94d1b1b0 0x55ff950cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.632+0000 7f45de000640 1 -- 172.21.15.69:0/4196377316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94d1b1b0 msgr2=0x55ff950cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.632+0000 7f45de000640 1 --2- 172.21.15.69:0/4196377316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94d1b1b0 0x55ff950cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.632+0000 7f45de000640 1 -- 172.21.15.69:0/4196377316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94cf22f0 msgr2=0x55ff950cb830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.632+0000 7f45de000640 1 --2- 172.21.15.69:0/4196377316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94cf22f0 0x55ff950cb830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.632+0000 7f45de000640 1 -- 172.21.15.69:0/4196377316 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ff9513f390 con 0x55ff94cfa4d0 2024-05-14T15:24:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.632+0000 7f45df400640 1 --2- 172.21.15.69:0/4196377316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94cf22f0 0x55ff950cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:24:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.632+0000 7f45de000640 1 --2- 172.21.15.69:0/4196377316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950cbd70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0036e0 tx=0x7f45cc0329d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd97326e4c8682d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.632+0000 7f45c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.632+0000 7f45c8c00640 1 -- 172.21.15.69:0/4196377316 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45cc035040 con 0x55ff94cfa4d0 2024-05-14T15:24:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.633+0000 7f45eca19740 1 -- 172.21.15.69:0/4196377316 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45cc003960 con 0x55ff94cfa4d0 2024-05-14T15:24:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.633+0000 7f45c8c00640 1 -- 172.21.15.69:0/4196377316 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f45cc004ad0 con 0x55ff94cfa4d0 2024-05-14T15:24:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.633+0000 7f45c8c00640 1 -- 172.21.15.69:0/4196377316 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7f45cc004cd0 con 0x55ff94cfa4d0 2024-05-14T15:24:52.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.633+0000 7f45eca19740 10 client.16047 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.633+0000 7f45eca19740 1 -- 172.21.15.69:0/4196377316 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x55ff95140620 con 0x55ff94cfa4d0 2024-05-14T15:24:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.633+0000 7f45c8c00640 1 -- 172.21.15.69:0/4196377316 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f45cc003960 con 0x55ff94cfa4d0 2024-05-14T15:24:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.633+0000 7f45c8c00640 1 -- 172.21.15.69:0/4196377316 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7f45cc044770 con 0x55ff94cfa4d0 2024-05-14T15:24:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.633+0000 7f45eca19740 10 client.16047 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.633+0000 7f45eca19740 10 client.16047 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:24:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.633+0000 7f45eca19740 20 client.16047 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.634+0000 7f45eca19740 1 --2- 172.21.15.69:0/4196377316 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ff94caf1c0 0x55ff95142ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.634+0000 7f45eca19740 4 client.16047 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:24:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.634+0000 7f45eca19740 1 -- 172.21.15.69:0/4196377316 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ff95028fd0 con 0x55ff94caf1c0 2024-05-14T15:24:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.634+0000 7f45df400640 1 --2- 172.21.15.69:0/4196377316 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ff94caf1c0 0x55ff95142ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.635+0000 7f45df400640 1 --2- 172.21.15.69:0/4196377316 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ff94caf1c0 0x55ff95142ab0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b282e8d997015fab server_cookie=6e70a33f101a26bd in_seq=0 out_seq=0 2024-05-14T15:24:52.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.635+0000 7f45c8c00640 10 client.16047 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:52.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.669+0000 7f45c8c00640 1 -- 172.21.15.69:0/4196377316 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ff95028fd0 con 0x55ff94caf1c0 2024-05-14T15:24:52.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.669+0000 7f45c8c00640 10 client.16047 handle_command_reply: tid=0 2024-05-14T15:24:52.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.669+0000 7f45eca19740 1 client.16047 shutdown 2024-05-14T15:24:52.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.670+0000 7f45eca19740 1 -- 172.21.15.69:0/4196377316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 msgr2=0x55ff950cbd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:52.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.670+0000 7f45eca19740 1 --2- 172.21.15.69:0/4196377316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950cbd70 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f45cc0036e0 tx=0x7f45cc0329d0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.670+0000 7f45eca19740 1 -- 172.21.15.69:0/4196377316 shutdown_connections 2024-05-14T15:24:52.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.670+0000 7f45eca19740 1 --2- 172.21.15.69:0/4196377316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ff94d1b1b0 0x55ff950cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.670+0000 7f45eca19740 1 --2- 172.21.15.69:0/4196377316 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ff94caf1c0 0x55ff95142ab0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.670+0000 7f45eca19740 1 --2- 172.21.15.69:0/4196377316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ff94cfa4d0 0x55ff950cbd70 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.670+0000 7f45eca19740 1 --2- 172.21.15.69:0/4196377316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ff94cf22f0 0x55ff950cb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.670+0000 7f45eca19740 1 -- 172.21.15.69:0/4196377316 >> 172.21.15.69:0/4196377316 conn(0x55ff94d0f300 msgr2=0x55ff950c7df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:52.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.670+0000 7f45c8c00640 0 client.16047 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:52.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.670+0000 7f45eca19740 1 -- 172.21.15.69:0/4196377316 shutdown_connections 2024-05-14T15:24:52.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.670+0000 7f45eca19740 1 -- 172.21.15.69:0/4196377316 wait complete. 2024-05-14T15:24:52.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.670+0000 7f45eca19740 20 client.16047 trim_cache size 0 max 16384 2024-05-14T15:24:52.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:24:52.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:24:52.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:24:52.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:24:52.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.671+0000 7f45dfe00640 1 -- 172.21.15.69:0/674792473 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f45c40b29d0 msgr2=0x7f45c40b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:52.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.671+0000 7f45dfe00640 1 --2- 172.21.15.69:0/674792473 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f45c40b29d0 0x7f45c40b4ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55ff950b9f70 tx=0x7f45d000df10 comp rx=0 tx=0).stop 2024-05-14T15:24:52.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.671+0000 7f45dfe00640 1 -- 172.21.15.69:0/674792473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45e0104230 msgr2=0x7f45e019d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:52.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.671+0000 7f45dfe00640 1 --2- 172.21.15.69:0/674792473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45e0104230 0x7f45e019d640 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f45d0005fd0 tx=0x7f45d000dde0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.671+0000 7f45dfe00640 1 -- 172.21.15.69:0/674792473 shutdown_connections 2024-05-14T15:24:52.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.671+0000 7f45dfe00640 1 --2- 172.21.15.69:0/674792473 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f45c40b29d0 0x7f45c40b4ee0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.671+0000 7f45dfe00640 1 --2- 172.21.15.69:0/674792473 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f45e0109f80 0x7f45e01a84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.671+0000 7f45dfe00640 1 --2- 172.21.15.69:0/674792473 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f45e0109ae0 0x7f45e019db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.671+0000 7f45dfe00640 1 --2- 172.21.15.69:0/674792473 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f45e0104230 0x7f45e019d640 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.671+0000 7f45dfe00640 1 -- 172.21.15.69:0/674792473 >> 172.21.15.69:0/674792473 conn(0x7f45e00ff340 msgr2=0x7f45e010f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.672+0000 7f45dfe00640 1 -- 172.21.15.69:0/674792473 shutdown_connections 2024-05-14T15:24:52.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:24:52.672+0000 7f45dfe00640 1 -- 172.21.15.69:0/674792473 wait complete. 2024-05-14T15:24:53.118 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:53 smithi069 ceph-mon[31270]: pgmap v100: 129 pgs: 129 active+clean; 781 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.9 MiB/s wr, 18 op/s 2024-05-14T15:24:53.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:53 smithi092 ceph-mon[34729]: pgmap v100: 129 pgs: 129 active+clean; 781 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.9 MiB/s wr, 18 op/s 2024-05-14T15:24:53.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:53 smithi203 ceph-mon[34567]: pgmap v100: 129 pgs: 129 active+clean; 781 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 7.9 MiB/s wr, 18 op/s 2024-05-14T15:24:53.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.919+0000 7fb975c00700 1 -- 172.21.15.69:0/3011343654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9701034c0 msgr2=0x7fb9701038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:53.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.919+0000 7fb975c00700 1 --2- 172.21.15.69:0/3011343654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9701034c0 0x7fb9701038d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fb9600099c0 tx=0x7fb960009cd0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.919+0000 7fb975c00700 1 -- 172.21.15.69:0/3011343654 shutdown_connections 2024-05-14T15:24:53.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.919+0000 7fb975c00700 1 --2- 172.21.15.69:0/3011343654 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9701034c0 0x7fb9701038d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.919+0000 7fb975c00700 1 --2- 172.21.15.69:0/3011343654 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb970108740 0x7fb9701100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.919+0000 7fb975c00700 1 --2- 172.21.15.69:0/3011343654 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb970107df0 0x7fb970108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.919+0000 7fb975c00700 1 -- 172.21.15.69:0/3011343654 >> 172.21.15.69:0/3011343654 conn(0x7fb9700fedc0 msgr2=0x7fb9701011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:53.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.919+0000 7fb975c00700 1 -- 172.21.15.69:0/3011343654 shutdown_connections 2024-05-14T15:24:53.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.919+0000 7fb975c00700 1 -- 172.21.15.69:0/3011343654 wait complete. 2024-05-14T15:24:53.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.921+0000 7fb975c00700 1 Processor -- start 2024-05-14T15:24:53.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.921+0000 7fb975c00700 1 -- start start 2024-05-14T15:24:53.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.921+0000 7fb975c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9701034c0 0x7fb9701997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.921+0000 7fb975c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb970107df0 0x7fb970199d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.922+0000 7fb975c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb970108740 0x7fb9701a0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.922+0000 7fb975c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb970114370 con 0x7fb9701034c0 2024-05-14T15:24:53.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.922+0000 7fb975c00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb9701141f0 con 0x7fb970108740 2024-05-14T15:24:53.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.922+0000 7fb975c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb9701144f0 con 0x7fb970107df0 2024-05-14T15:24:53.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.922+0000 7fb96ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9701034c0 0x7fb9701997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.922+0000 7fb96ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9701034c0 0x7fb9701997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43394/0 (socket says 172.21.15.69:43394) 2024-05-14T15:24:53.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.922+0000 7fb96ea00700 1 -- 172.21.15.69:0/2882275563 learned_addr learned my addr 172.21.15.69:0/2882275563 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:53.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.922+0000 7fb96f400700 1 --2- 172.21.15.69:0/2882275563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb970108740 0x7fb9701a0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.922+0000 7fb96e000700 1 --2- 172.21.15.69:0/2882275563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb970107df0 0x7fb970199d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.922+0000 7fb96ea00700 1 -- 172.21.15.69:0/2882275563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb970107df0 msgr2=0x7fb970199d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:53.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.922+0000 7fb96ea00700 1 --2- 172.21.15.69:0/2882275563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb970107df0 0x7fb970199d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.922+0000 7fb96ea00700 1 -- 172.21.15.69:0/2882275563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb970108740 msgr2=0x7fb9701a0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:53.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.922+0000 7fb96ea00700 1 --2- 172.21.15.69:0/2882275563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb970108740 0x7fb9701a0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.922+0000 7fb96ea00700 1 -- 172.21.15.69:0/2882275563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9701a0d80 con 0x7fb9701034c0 2024-05-14T15:24:53.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.923+0000 7fb96ea00700 1 --2- 172.21.15.69:0/2882275563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9701034c0 0x7fb9701997e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb960005f50 tx=0x7fb96000f460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:53.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.923+0000 7fb967400700 1 -- 172.21.15.69:0/2882275563 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb960027070 con 0x7fb9701034c0 2024-05-14T15:24:53.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.923+0000 7fb967400700 1 -- 172.21.15.69:0/2882275563 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb96000fdd0 con 0x7fb9701034c0 2024-05-14T15:24:53.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.923+0000 7fb967400700 1 -- 172.21.15.69:0/2882275563 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9600173f0 con 0x7fb9701034c0 2024-05-14T15:24:53.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.923+0000 7fb975c00700 1 -- 172.21.15.69:0/2882275563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9701a1010 con 0x7fb9701034c0 2024-05-14T15:24:53.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.924+0000 7fb975c00700 1 -- 172.21.15.69:0/2882275563 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9701a14a0 con 0x7fb9701034c0 2024-05-14T15:24:53.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.928+0000 7fb967400700 1 -- 172.21.15.69:0/2882275563 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb96002a070 con 0x7fb9701034c0 2024-05-14T15:24:53.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.929+0000 7fb98464eb80 1 Processor -- start 2024-05-14T15:24:53.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.930+0000 7fb98464eb80 1 -- start start 2024-05-14T15:24:53.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.930+0000 7fb98464eb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992977e40 0x562992afb6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.930+0000 7fb98464eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 0x562992af5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.930+0000 7fb98464eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992af5c50 0x562992af6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.930+0000 7fb98464eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x562992a17a20 con 0x562992af5c50 2024-05-14T15:24:53.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.930+0000 7fb98464eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5629929b5760 con 0x562992afbbf0 2024-05-14T15:24:53.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.930+0000 7fb98464eb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562992a139e0 con 0x562992977e40 2024-05-14T15:24:53.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.930+0000 7fb967400700 1 --2- 172.21.15.69:0/2882275563 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb9540b29f0 0x7fb9540b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.931+0000 7fb967400700 1 -- 172.21.15.69:0/2882275563 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fb9600e3960 con 0x7fb9701034c0 2024-05-14T15:24:53.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.931+0000 7fb96ea00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 0x562992af5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.931+0000 7fb96ea00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 0x562992af5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:60980/0 (socket says 172.21.15.69:60980) 2024-05-14T15:24:53.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.931+0000 7fb96ea00700 1 -- 172.21.15.69:0/2394668240 learned_addr learned my addr 172.21.15.69:0/2394668240 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:53.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.931+0000 7fb96e000700 1 --2- 172.21.15.69:0/2394668240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992af5c50 0x562992af6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.931+0000 7fb96f400700 1 --2- 172.21.15.69:0/2394668240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992977e40 0x562992afb6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.932+0000 7fb96ea00700 1 -- 172.21.15.69:0/2394668240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992977e40 msgr2=0x562992afb6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:53.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.932+0000 7fb96ea00700 1 --2- 172.21.15.69:0/2394668240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992977e40 0x562992afb6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.932+0000 7fb96ea00700 1 -- 172.21.15.69:0/2394668240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992af5c50 msgr2=0x562992af6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:53.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.932+0000 7fb96ea00700 1 --2- 172.21.15.69:0/2394668240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992af5c50 0x562992af6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.932+0000 7fb96ea00700 1 -- 172.21.15.69:0/2394668240 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629929648d0 con 0x562992afbbf0 2024-05-14T15:24:53.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.932+0000 7fb96f400700 1 --2- 172.21.15.69:0/2882275563 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb9540b29f0 0x7fb9540b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.932+0000 7fb96ea00700 1 --2- 172.21.15.69:0/2394668240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 0x562992af5710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb960000c00 tx=0x7fb960009310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9ee9347ec5489842 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:53.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.933+0000 7fb95be00700 1 -- 172.21.15.69:0/2394668240 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9600aafc0 con 0x562992afbbf0 2024-05-14T15:24:53.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.933+0000 7fb95be00700 1 -- 172.21.15.69:0/2394668240 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9600aa8c0 con 0x562992afbbf0 2024-05-14T15:24:53.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.933+0000 7fb95be00700 1 -- 172.21.15.69:0/2394668240 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9600226b0 con 0x562992afbbf0 2024-05-14T15:24:53.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.935+0000 7fb98464eb80 1 -- 172.21.15.69:0/2394668240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 msgr2=0x562992af5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:53.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.935+0000 7fb98464eb80 1 --2- 172.21.15.69:0/2394668240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 0x562992af5710 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fb960000c00 tx=0x7fb960009310 comp rx=0 tx=0).stop 2024-05-14T15:24:53.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.935+0000 7fb96f400700 1 --2- 172.21.15.69:0/2882275563 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb9540b29f0 0x7fb9540b4f00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x562992af6a30 tx=0x7fb96800b040 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:53.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.935+0000 7fb98464eb80 1 -- 172.21.15.69:0/2394668240 shutdown_connections 2024-05-14T15:24:53.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.935+0000 7fb98464eb80 1 --2- 172.21.15.69:0/2394668240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992af5c50 0x562992af6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.935+0000 7fb98464eb80 1 --2- 172.21.15.69:0/2394668240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992977e40 0x562992afb6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.935+0000 7fb98464eb80 1 --2- 172.21.15.69:0/2394668240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 0x562992af5710 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.935+0000 7fb98464eb80 1 -- 172.21.15.69:0/2394668240 >> 172.21.15.69:0/2394668240 conn(0x5629929b6a80 msgr2=0x562992af0790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:53.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.936+0000 7fb98464eb80 1 -- 172.21.15.69:0/2394668240 shutdown_connections 2024-05-14T15:24:53.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.936+0000 7fb98464eb80 1 -- 172.21.15.69:0/2394668240 wait complete. 2024-05-14T15:24:53.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.937+0000 7fb98464eb80 1 -- start start 2024-05-14T15:24:53.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.937+0000 7fb98464eb80 1 Processor -- start 2024-05-14T15:24:53.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.938+0000 7fb98464eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992977e40 0x562992aff390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.938+0000 7fb98464eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992af5c50 0x562992aff8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.938+0000 7fb98464eb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992afbbf0 0x562992affe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.938+0000 7fb98464eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x562992b02480 con 0x562992977e40 2024-05-14T15:24:53.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.938+0000 7fb98464eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56299297db20 con 0x562992af5c50 2024-05-14T15:24:53.939 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.938+0000 7fb98464eb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562992b02600 con 0x562992afbbf0 2024-05-14T15:24:53.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.938+0000 7fb98464eb80 10 client.0 _ll_register_callbacks cb 0x5629929ab380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:53.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.939+0000 7fb96ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992977e40 0x562992aff390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.939+0000 7fb96ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992977e40 0x562992aff390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43422/0 (socket says 172.21.15.69:43422) 2024-05-14T15:24:53.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.939+0000 7fb96ea00700 1 -- 172.21.15.69:0/1602400545 learned_addr learned my addr 172.21.15.69:0/1602400545 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:53.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.939+0000 7fb96f400700 1 --2- 172.21.15.69:0/1602400545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992afbbf0 0x562992affe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.939+0000 7fb96e000700 1 --2- 172.21.15.69:0/1602400545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992af5c50 0x562992aff8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.939+0000 7fb96ea00700 1 -- 172.21.15.69:0/1602400545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992afbbf0 msgr2=0x562992affe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:53.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.939+0000 7fb96ea00700 1 --2- 172.21.15.69:0/1602400545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992afbbf0 0x562992affe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.939+0000 7fb96ea00700 1 -- 172.21.15.69:0/1602400545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992af5c50 msgr2=0x562992aff8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:53.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.939+0000 7fb96ea00700 1 --2- 172.21.15.69:0/1602400545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992af5c50 0x562992aff8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.939+0000 7fb96ea00700 1 -- 172.21.15.69:0/1602400545 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629929dd420 con 0x562992977e40 2024-05-14T15:24:53.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.940+0000 7fb96e000700 1 --2- 172.21.15.69:0/1602400545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992af5c50 0x562992aff8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.940+0000 7fb96ea00700 1 --2- 172.21.15.69:0/1602400545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992977e40 0x562992aff390 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb9600a6940 tx=0x7fb9600229c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0c2acf596cb5826 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.940+0000 7fb958c00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.940+0000 7fb958c00700 1 -- 172.21.15.69:0/1602400545 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9600e1130 con 0x562992977e40 2024-05-14T15:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.941+0000 7fb958c00700 1 -- 172.21.15.69:0/1602400545 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fb9600a6eb0 con 0x562992977e40 2024-05-14T15:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.941+0000 7fb98464eb80 1 -- 172.21.15.69:0/1602400545 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9600aa8c0 con 0x562992977e40 2024-05-14T15:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.941+0000 7fb958c00700 1 -- 172.21.15.69:0/1602400545 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb9600b3690 con 0x562992977e40 2024-05-14T15:24:53.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.941+0000 7fb98464eb80 10 client.16059 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.941+0000 7fb98464eb80 1 -- 172.21.15.69:0/1602400545 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562992b02480 con 0x562992977e40 2024-05-14T15:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.941+0000 7fb958c00700 1 -- 172.21.15.69:0/1602400545 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9600aa8c0 con 0x562992977e40 2024-05-14T15:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.941+0000 7fb958c00700 1 -- 172.21.15.69:0/1602400545 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7fb9600b3200 con 0x562992977e40 2024-05-14T15:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.942+0000 7fb98464eb80 10 client.16059 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.942+0000 7fb98464eb80 10 client.16059 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.942+0000 7fb98464eb80 20 client.16059 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.942+0000 7fb98464eb80 1 --2- 172.21.15.69:0/1602400545 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562992b0f3b0 0x562992b11840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.942+0000 7fb98464eb80 4 client.16059 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.942+0000 7fb98464eb80 1 -- 172.21.15.69:0/1602400545 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562992ac2070 con 0x562992b0f3b0 2024-05-14T15:24:53.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.942+0000 7fb96e000700 1 --2- 172.21.15.69:0/1602400545 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562992b0f3b0 0x562992b11840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.944+0000 7fb96e000700 1 --2- 172.21.15.69:0/1602400545 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562992b0f3b0 0x562992b11840 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96efc320522a6f43 server_cookie=a26fd91e3071d07b in_seq=0 out_seq=0 2024-05-14T15:24:53.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.944+0000 7fb958c00700 10 client.16059 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:53.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.946+0000 7fb958c00700 1 -- 172.21.15.69:0/1602400545 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562992ac2070 con 0x562992b0f3b0 2024-05-14T15:24:53.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.946+0000 7fb958c00700 10 client.16059 handle_command_reply: tid=0 2024-05-14T15:24:53.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.946+0000 7fb98464eb80 1 client.16059 shutdown 2024-05-14T15:24:53.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.946+0000 7fb98464eb80 1 -- 172.21.15.69:0/1602400545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992977e40 msgr2=0x562992aff390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:53.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.946+0000 7fb98464eb80 1 --2- 172.21.15.69:0/1602400545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992977e40 0x562992aff390 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fb9600a6940 tx=0x7fb9600229c0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.946+0000 7fb98464eb80 1 -- 172.21.15.69:0/1602400545 shutdown_connections 2024-05-14T15:24:53.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.946+0000 7fb98464eb80 1 --2- 172.21.15.69:0/1602400545 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562992b0f3b0 0x562992b11840 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.946+0000 7fb98464eb80 1 --2- 172.21.15.69:0/1602400545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992977e40 0x562992aff390 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.946+0000 7fb98464eb80 1 --2- 172.21.15.69:0/1602400545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992afbbf0 0x562992affe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.946+0000 7fb958c00700 0 client.16059 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:53.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.946+0000 7fb98464eb80 1 --2- 172.21.15.69:0/1602400545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992af5c50 0x562992aff8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.946+0000 7fb98464eb80 1 -- 172.21.15.69:0/1602400545 >> 172.21.15.69:0/1602400545 conn(0x5629929b6a80 msgr2=0x562992af4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:53.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.946+0000 7fb98464eb80 1 -- 172.21.15.69:0/1602400545 shutdown_connections 2024-05-14T15:24:53.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.946+0000 7fb98464eb80 1 -- 172.21.15.69:0/1602400545 wait complete. 2024-05-14T15:24:53.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.947+0000 7fb98464eb80 20 client.16059 trim_cache size 0 max 16384 2024-05-14T15:24:53.955 INFO:teuthology.orchestra.run.smithi069.stderr:3200000 of 3200000 tuples (100%) done (elapsed 119.56 s, remaining 0.00 s) 2024-05-14T15:24:53.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.974+0000 7fb98464eb80 1 Processor -- start 2024-05-14T15:24:53.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.974+0000 7fb98464eb80 1 -- start start 2024-05-14T15:24:53.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.974+0000 7fb98464eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992af5c50 0x562992af5710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.974+0000 7fb98464eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 0x562992af9b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.974+0000 7fb98464eb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992b0b3d0 0x562992b0b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.974+0000 7fb98464eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb9701bf2f0 con 0x562992af5c50 2024-05-14T15:24:53.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.974+0000 7fb98464eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb9701c0fb0 con 0x562992afbbf0 2024-05-14T15:24:53.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.974+0000 7fb98464eb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb9701bf9c0 con 0x562992b0b3d0 2024-05-14T15:24:53.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.975+0000 7fb96ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992af5c50 0x562992af5710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.975+0000 7fb96ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992af5c50 0x562992af5710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43432/0 (socket says 172.21.15.69:43432) 2024-05-14T15:24:53.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.975+0000 7fb96ea00700 1 -- 172.21.15.69:0/1768250658 learned_addr learned my addr 172.21.15.69:0/1768250658 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:53.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.975+0000 7fb96e000700 1 --2- 172.21.15.69:0/1768250658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 0x562992af9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.975+0000 7fb96f400700 1 --2- 172.21.15.69:0/1768250658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992b0b3d0 0x562992b0b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.976+0000 7fb96ea00700 1 -- 172.21.15.69:0/1768250658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992b0b3d0 msgr2=0x562992b0b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:53.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.976+0000 7fb96ea00700 1 --2- 172.21.15.69:0/1768250658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992b0b3d0 0x562992b0b7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.976+0000 7fb96ea00700 1 -- 172.21.15.69:0/1768250658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 msgr2=0x562992af9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:53.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.976+0000 7fb96ea00700 1 --2- 172.21.15.69:0/1768250658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 0x562992af9b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.976+0000 7fb96ea00700 1 -- 172.21.15.69:0/1768250658 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562992b0bd20 con 0x562992af5c50 2024-05-14T15:24:53.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.976+0000 7fb96ea00700 1 --2- 172.21.15.69:0/1768250658 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992af5c50 0x562992af5710 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb9600cd300 tx=0x7fb960009310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127d813991681bbd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:53.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.977+0000 7fb95b400700 1 -- 172.21.15.69:0/1768250658 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9600c7080 con 0x562992af5c50 2024-05-14T15:24:53.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.977+0000 7fb95b400700 1 -- 172.21.15.69:0/1768250658 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9600aafc0 con 0x562992af5c50 2024-05-14T15:24:53.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.977+0000 7fb95b400700 1 -- 172.21.15.69:0/1768250658 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9600aab20 con 0x562992af5c50 2024-05-14T15:24:53.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.978+0000 7fb98464eb80 1 -- 172.21.15.69:0/1768250658 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992af5c50 msgr2=0x562992af5710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:53.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.978+0000 7fb98464eb80 1 --2- 172.21.15.69:0/1768250658 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992af5c50 0x562992af5710 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fb9600cd300 tx=0x7fb960009310 comp rx=0 tx=0).stop 2024-05-14T15:24:53.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.978+0000 7fb98464eb80 1 -- 172.21.15.69:0/1768250658 shutdown_connections 2024-05-14T15:24:53.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.978+0000 7fb98464eb80 1 --2- 172.21.15.69:0/1768250658 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992af5c50 0x562992af5710 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.978+0000 7fb98464eb80 1 --2- 172.21.15.69:0/1768250658 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992b0b3d0 0x562992b0b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.978+0000 7fb98464eb80 1 --2- 172.21.15.69:0/1768250658 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 0x562992af9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.978+0000 7fb98464eb80 1 -- 172.21.15.69:0/1768250658 >> 172.21.15.69:0/1768250658 conn(0x5629929b6a80 msgr2=0x562992afdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:53.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.979+0000 7fb98464eb80 1 -- 172.21.15.69:0/1768250658 shutdown_connections 2024-05-14T15:24:53.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.979+0000 7fb98464eb80 1 -- 172.21.15.69:0/1768250658 wait complete. 2024-05-14T15:24:53.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.979+0000 7fb98464eb80 1 -- start start 2024-05-14T15:24:53.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.979+0000 7fb98464eb80 1 Processor -- start 2024-05-14T15:24:53.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.980+0000 7fb98464eb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992af5c50 0x562992b07690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.980+0000 7fb98464eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 0x562992b07bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.980+0000 7fb98464eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992b0b3d0 0x562992b04660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.980+0000 7fb98464eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb9701c0820 con 0x562992b0b3d0 2024-05-14T15:24:53.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.980+0000 7fb98464eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb9701c00c0 con 0x562992afbbf0 2024-05-14T15:24:53.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.980+0000 7fb98464eb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb9701bd290 con 0x562992af5c50 2024-05-14T15:24:53.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.980+0000 7fb98464eb80 10 client.0 _ll_register_callbacks cb 0x5629929ab380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:24:53.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.981+0000 7fb96f400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992b0b3d0 0x562992b04660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.981+0000 7fb96f400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992b0b3d0 0x562992b04660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43446/0 (socket says 172.21.15.69:43446) 2024-05-14T15:24:53.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.981+0000 7fb96f400700 1 -- 172.21.15.69:0/2693955607 learned_addr learned my addr 172.21.15.69:0/2693955607 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:53.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.981+0000 7fb96e000700 1 --2- 172.21.15.69:0/2693955607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 0x562992b07bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.981+0000 7fb96ea00700 1 --2- 172.21.15.69:0/2693955607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992af5c50 0x562992b07690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.981+0000 7fb96f400700 1 -- 172.21.15.69:0/2693955607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992af5c50 msgr2=0x562992b07690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:53.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.981+0000 7fb96f400700 1 --2- 172.21.15.69:0/2693955607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992af5c50 0x562992b07690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.981+0000 7fb96f400700 1 -- 172.21.15.69:0/2693955607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 msgr2=0x562992b07bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:24:53.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.981+0000 7fb96f400700 1 --2- 172.21.15.69:0/2693955607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 0x562992b07bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.981+0000 7fb96f400700 1 -- 172.21.15.69:0/2693955607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562992b04ba0 con 0x562992b0b3d0 2024-05-14T15:24:53.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.981+0000 7fb96ea00700 1 --2- 172.21.15.69:0/2693955607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992af5c50 0x562992b07690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:24:53.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.982+0000 7fb96f400700 1 --2- 172.21.15.69:0/2693955607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992b0b3d0 0x562992b04660 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb968016c00 tx=0x7fb968009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90d2c4cbb7d0044 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:53.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.982+0000 7fb958c00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:24:53.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.982+0000 7fb958c00700 1 -- 172.21.15.69:0/2693955607 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb968012040 con 0x562992b0b3d0 2024-05-14T15:24:53.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.982+0000 7fb958c00700 1 -- 172.21.15.69:0/2693955607 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fb968022a20 con 0x562992b0b3d0 2024-05-14T15:24:53.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.982+0000 7fb98464eb80 1 -- 172.21.15.69:0/2693955607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9600aafc0 con 0x562992b0b3d0 2024-05-14T15:24:53.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.982+0000 7fb958c00700 1 -- 172.21.15.69:0/2693955607 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=35) ==== 24+0+0 (secure 0 0 0) 0x7fb968022c20 con 0x562992b0b3d0 2024-05-14T15:24:53.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.982+0000 7fb98464eb80 10 client.16065 fetch_fsmap learned FSMap version 35 2024-05-14T15:24:53.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.982+0000 7fb98464eb80 1 -- 172.21.15.69:0/2693955607 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=35,monmap=4+}) -- 0x562992b7a310 con 0x562992b0b3d0 2024-05-14T15:24:53.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.983+0000 7fb958c00700 1 -- 172.21.15.69:0/2693955607 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb9600aafc0 con 0x562992b0b3d0 2024-05-14T15:24:53.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.983+0000 7fb958c00700 1 -- 172.21.15.69:0/2693955607 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 35) ==== 8394+0+0 (secure 0 0 0) 0x7fb968015050 con 0x562992b0b3d0 2024-05-14T15:24:53.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.983+0000 7fb98464eb80 10 client.16065 fetch_fsmap finished waiting for FSMap version 35 2024-05-14T15:24:53.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.983+0000 7fb98464eb80 10 client.16065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:24:53.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.983+0000 7fb98464eb80 20 client.16065 populate_metadata read hostname 'smithi069' 2024-05-14T15:24:53.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.983+0000 7fb98464eb80 1 --2- 172.21.15.69:0/2693955607 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562992b7ab60 0x562992b7cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:53.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.983+0000 7fb98464eb80 4 client.16065 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T15:24:53.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.983+0000 7fb98464eb80 1 -- 172.21.15.69:0/2693955607 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562992a25400 con 0x562992b7ab60 2024-05-14T15:24:53.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.984+0000 7fb96ea00700 1 --2- 172.21.15.69:0/2693955607 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562992b7ab60 0x562992b7cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:53.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.985+0000 7fb96ea00700 1 --2- 172.21.15.69:0/2693955607 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562992b7ab60 0x562992b7cf80 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2da42b7b33b534ab server_cookie=df101449b50b30b0 in_seq=0 out_seq=0 2024-05-14T15:24:53.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.985+0000 7fb958c00700 10 client.16065 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:53.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.989+0000 7fb958c00700 1 -- 172.21.15.69:0/2693955607 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562992a25400 con 0x562992b7ab60 2024-05-14T15:24:53.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.989+0000 7fb958c00700 10 client.16065 handle_command_reply: tid=0 2024-05-14T15:24:53.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.989+0000 7fb98464eb80 1 client.16065 shutdown 2024-05-14T15:24:53.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.989+0000 7fb98464eb80 1 -- 172.21.15.69:0/2693955607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992b0b3d0 msgr2=0x562992b04660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:53.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.989+0000 7fb98464eb80 1 --2- 172.21.15.69:0/2693955607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992b0b3d0 0x562992b04660 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fb968016c00 tx=0x7fb968009040 comp rx=0 tx=0).stop 2024-05-14T15:24:53.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.989+0000 7fb98464eb80 1 -- 172.21.15.69:0/2693955607 shutdown_connections 2024-05-14T15:24:53.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.989+0000 7fb98464eb80 1 --2- 172.21.15.69:0/2693955607 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562992b7ab60 0x562992b7cf80 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.989+0000 7fb98464eb80 1 --2- 172.21.15.69:0/2693955607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562992b0b3d0 0x562992b04660 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.989+0000 7fb98464eb80 1 --2- 172.21.15.69:0/2693955607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562992af5c50 0x562992b07690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.989+0000 7fb98464eb80 1 --2- 172.21.15.69:0/2693955607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562992afbbf0 0x562992b07bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.989+0000 7fb98464eb80 1 -- 172.21.15.69:0/2693955607 >> 172.21.15.69:0/2693955607 conn(0x5629929b6a80 msgr2=0x562992b0b7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:53.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.989+0000 7fb958c00700 0 client.16065 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:24:53.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.990+0000 7fb98464eb80 1 -- 172.21.15.69:0/2693955607 shutdown_connections 2024-05-14T15:24:53.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.990+0000 7fb98464eb80 1 -- 172.21.15.69:0/2693955607 wait complete. 2024-05-14T15:24:53.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.990+0000 7fb98464eb80 20 client.16065 trim_cache size 0 max 16384 2024-05-14T15:24:53.991 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:24:53.991 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2024-05-14T15:24:53.991 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2024-05-14T15:24:53.992 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:24:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.991+0000 7fb975c00700 1 -- 172.21.15.69:0/2882275563 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb9540b29f0 msgr2=0x7fb9540b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.991+0000 7fb975c00700 1 --2- 172.21.15.69:0/2882275563 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb9540b29f0 0x7fb9540b4f00 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x562992af6a30 tx=0x7fb96800b040 comp rx=0 tx=0).stop 2024-05-14T15:24:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.991+0000 7fb975c00700 1 -- 172.21.15.69:0/2882275563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9701034c0 msgr2=0x7fb9701997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.991+0000 7fb975c00700 1 --2- 172.21.15.69:0/2882275563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9701034c0 0x7fb9701997e0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fb960005f50 tx=0x7fb96000f460 comp rx=0 tx=0).stop 2024-05-14T15:24:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.991+0000 7fb975c00700 1 -- 172.21.15.69:0/2882275563 shutdown_connections 2024-05-14T15:24:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.991+0000 7fb975c00700 1 --2- 172.21.15.69:0/2882275563 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb9540b29f0 0x7fb9540b4f00 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.991+0000 7fb975c00700 1 --2- 172.21.15.69:0/2882275563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb9701034c0 0x7fb9701997e0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.991+0000 7fb975c00700 1 --2- 172.21.15.69:0/2882275563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb970108740 0x7fb9701a0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.991+0000 7fb975c00700 1 --2- 172.21.15.69:0/2882275563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb970107df0 0x7fb970199d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:53.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.991+0000 7fb975c00700 1 -- 172.21.15.69:0/2882275563 >> 172.21.15.69:0/2882275563 conn(0x7fb9700fedc0 msgr2=0x7fb9700ff1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:53.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.991+0000 7fb975c00700 1 -- 172.21.15.69:0/2882275563 shutdown_connections 2024-05-14T15:24:53.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:53.991+0000 7fb975c00700 1 -- 172.21.15.69:0/2882275563 wait complete. 2024-05-14T15:24:54.237 INFO:teuthology.orchestra.run.smithi069.stderr:vacuuming... 2024-05-14T15:24:54.918 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-14T15:24:54.918 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:24:55.389 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:24:55.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:55 smithi092 ceph-mon[34729]: pgmap v101: 129 pgs: 129 active+clean; 813 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 13 MiB/s wr, 31 op/s 2024-05-14T15:24:55.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:55 smithi069 ceph-mon[31270]: pgmap v101: 129 pgs: 129 active+clean; 813 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 13 MiB/s wr, 31 op/s 2024-05-14T15:24:55.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:55 smithi203 ceph-mon[34567]: pgmap v101: 129 pgs: 129 active+clean; 813 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 13 MiB/s wr, 31 op/s 2024-05-14T15:24:57.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:57 smithi069 ceph-mon[31270]: pgmap v102: 129 pgs: 129 active+clean; 813 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.2 MiB/s wr, 21 op/s 2024-05-14T15:24:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:57 smithi092 ceph-mon[34729]: pgmap v102: 129 pgs: 129 active+clean; 813 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.2 MiB/s wr, 21 op/s 2024-05-14T15:24:57.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:57 smithi203 ceph-mon[34567]: pgmap v102: 129 pgs: 129 active+clean; 813 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.2 MiB/s wr, 21 op/s 2024-05-14T15:24:57.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.930+0000 7f3086c00700 1 -- 172.21.15.69:0/1065368575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30801032e0 msgr2=0x7f30801036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:57.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.930+0000 7f3086c00700 1 --2- 172.21.15.69:0/1065368575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30801032e0 0x7f30801036f0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f3074009a40 tx=0x7f3074009d50 comp rx=0 tx=0).stop 2024-05-14T15:24:57.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.930+0000 7f3086c00700 1 -- 172.21.15.69:0/1065368575 shutdown_connections 2024-05-14T15:24:57.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.930+0000 7f3086c00700 1 --2- 172.21.15.69:0/1065368575 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30801032e0 0x7f30801036f0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:57.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.930+0000 7f3086c00700 1 --2- 172.21.15.69:0/1065368575 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3080108560 0x7f308010fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:57.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.930+0000 7f3086c00700 1 --2- 172.21.15.69:0/1065368575 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3080107c10 0x7f3080108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:57.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.930+0000 7f3086c00700 1 -- 172.21.15.69:0/1065368575 >> 172.21.15.69:0/1065368575 conn(0x7f3080078ac0 msgr2=0x7f3080078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:57.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.931+0000 7f3086c00700 1 -- 172.21.15.69:0/1065368575 shutdown_connections 2024-05-14T15:24:57.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.931+0000 7f3086c00700 1 -- 172.21.15.69:0/1065368575 wait complete. 2024-05-14T15:24:57.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.932+0000 7f3086c00700 1 Processor -- start 2024-05-14T15:24:57.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.932+0000 7f3086c00700 1 -- start start 2024-05-14T15:24:57.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.933+0000 7f3086c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30801032e0 0x7f308019e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:57.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.933+0000 7f3086c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3080107c10 0x7f308019eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:57.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.933+0000 7f3086c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3080108560 0x7f30801987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:57.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.933+0000 7f3086c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3080111ff0 con 0x7f3080107c10 2024-05-14T15:24:57.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.933+0000 7f3086c00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3080111e70 con 0x7f3080108560 2024-05-14T15:24:57.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.933+0000 7f3086c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3080112170 con 0x7f30801032e0 2024-05-14T15:24:57.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.933+0000 7f3084e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3080107c10 0x7f308019eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:57.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.933+0000 7f3084e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3080107c10 0x7f308019eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43458/0 (socket says 172.21.15.69:43458) 2024-05-14T15:24:57.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.933+0000 7f3084e00700 1 -- 172.21.15.69:0/3894000329 learned_addr learned my addr 172.21.15.69:0/3894000329 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:24:57.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.934+0000 7f3085800700 1 --2- 172.21.15.69:0/3894000329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30801032e0 0x7f308019e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:57.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.934+0000 7f3086200700 1 --2- 172.21.15.69:0/3894000329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3080108560 0x7f30801987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:57.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.934+0000 7f3084e00700 1 -- 172.21.15.69:0/3894000329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30801032e0 msgr2=0x7f308019e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:57.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.934+0000 7f3084e00700 1 --2- 172.21.15.69:0/3894000329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30801032e0 0x7f308019e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:57.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.934+0000 7f3084e00700 1 -- 172.21.15.69:0/3894000329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3080108560 msgr2=0x7f30801987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:57.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.934+0000 7f3084e00700 1 --2- 172.21.15.69:0/3894000329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3080108560 0x7f30801987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:57.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.934+0000 7f3084e00700 1 -- 172.21.15.69:0/3894000329 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3080198e90 con 0x7f3080107c10 2024-05-14T15:24:57.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.934+0000 7f3086200700 1 --2- 172.21.15.69:0/3894000329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3080108560 0x7f30801987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:24:57.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.935+0000 7f3084e00700 1 --2- 172.21.15.69:0/3894000329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3080107c10 0x7f308019eb10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f306c00c9e0 tx=0x7f306c00cda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:57.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.935+0000 7f307e000700 1 -- 172.21.15.69:0/3894000329 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c007aa0 con 0x7f3080107c10 2024-05-14T15:24:57.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.935+0000 7f307e000700 1 -- 172.21.15.69:0/3894000329 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f306c007c40 con 0x7f3080107c10 2024-05-14T15:24:57.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.935+0000 7f3086c00700 1 -- 172.21.15.69:0/3894000329 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3080199180 con 0x7f3080107c10 2024-05-14T15:24:57.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.935+0000 7f307e000700 1 -- 172.21.15.69:0/3894000329 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c018660 con 0x7f3080107c10 2024-05-14T15:24:57.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.935+0000 7f3086c00700 1 -- 172.21.15.69:0/3894000329 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30801a5410 con 0x7f3080107c10 2024-05-14T15:24:57.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.937+0000 7f3086c00700 1 -- 172.21.15.69:0/3894000329 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3080104790 con 0x7f3080107c10 2024-05-14T15:24:57.940 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.940+0000 7f307e000700 1 -- 172.21.15.69:0/3894000329 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f306c018800 con 0x7f3080107c10 2024-05-14T15:24:57.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.942+0000 7f307e000700 1 --2- 172.21.15.69:0/3894000329 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f30680b29f0 0x7f30680b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:24:57.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.942+0000 7f307e000700 1 -- 172.21.15.69:0/3894000329 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f306c0e29b0 con 0x7f3080107c10 2024-05-14T15:24:57.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.942+0000 7f3085800700 1 --2- 172.21.15.69:0/3894000329 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f30680b29f0 0x7f30680b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:24:57.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.943+0000 7f3085800700 1 --2- 172.21.15.69:0/3894000329 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f30680b29f0 0x7f30680b4f00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3074005fd0 tx=0x7f30740095f0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:24:57.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:57.947+0000 7f307e000700 1 -- 172.21.15.69:0/3894000329 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f306c014030 con 0x7f3080107c10 2024-05-14T15:24:58.270 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:58.269+0000 7f3086c00700 1 -- 172.21.15.69:0/3894000329 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f308002e5f0 con 0x7f3080107c10 2024-05-14T15:24:58.272 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:58.271+0000 7f307e000700 1 -- 172.21.15.69:0/3894000329 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 35 v35) ==== 94+0+11945 (secure 0 0 0) 0x7f306c0a9f80 con 0x7f3080107c10 2024-05-14T15:24:58.273 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:24:58.273 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":35,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":35,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T15:16:11.716543+0000","modified":"2024-05-14T15:23:33.337258+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34490,"mds_1":34460,"mds_2":34433,"mds_3":34409,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":31,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":35,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34490":{"gid":34490,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34490,"qdb_cluster":[34433,24451,34409,34490,34460]},"id":1}]} 2024-05-14T15:24:58.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:58.275+0000 7f3086c00700 1 -- 172.21.15.69:0/3894000329 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f30680b29f0 msgr2=0x7f30680b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:58.275 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:58.275+0000 7f3086c00700 1 --2- 172.21.15.69:0/3894000329 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f30680b29f0 0x7f30680b4f00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3074005fd0 tx=0x7f30740095f0 comp rx=0 tx=0).stop 2024-05-14T15:24:58.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:58.275+0000 7f3086c00700 1 -- 172.21.15.69:0/3894000329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3080107c10 msgr2=0x7f308019eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:24:58.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:58.275+0000 7f3086c00700 1 --2- 172.21.15.69:0/3894000329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3080107c10 0x7f308019eb10 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f306c00c9e0 tx=0x7f306c00cda0 comp rx=0 tx=0).stop 2024-05-14T15:24:58.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:58.275+0000 7f3086c00700 1 -- 172.21.15.69:0/3894000329 shutdown_connections 2024-05-14T15:24:58.276 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:58.275+0000 7f3086c00700 1 --2- 172.21.15.69:0/3894000329 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f30680b29f0 0x7f30680b4f00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:58.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:58.275+0000 7f3086c00700 1 --2- 172.21.15.69:0/3894000329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3080108560 0x7f30801987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:58.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:58.275+0000 7f3086c00700 1 --2- 172.21.15.69:0/3894000329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30801032e0 0x7f308019e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:58.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:58.275+0000 7f3086c00700 1 --2- 172.21.15.69:0/3894000329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3080107c10 0x7f308019eb10 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:24:58.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:58.275+0000 7f3086c00700 1 -- 172.21.15.69:0/3894000329 >> 172.21.15.69:0/3894000329 conn(0x7f3080078ac0 msgr2=0x7f3080100890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:24:58.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:58.275+0000 7f3086c00700 1 -- 172.21.15.69:0/3894000329 shutdown_connections 2024-05-14T15:24:58.277 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:24:58.276+0000 7f3086c00700 1 -- 172.21.15.69:0/3894000329 wait complete. 2024-05-14T15:24:58.278 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 35 2024-05-14T15:24:59.213 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-14T15:24:59.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:59 smithi092 ceph-mon[34729]: pgmap v103: 129 pgs: 129 active+clean; 813 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.2 MiB/s wr, 21 op/s 2024-05-14T15:24:59.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:24:59 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3894000329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:24:59.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:59 smithi069 ceph-mon[31270]: pgmap v103: 129 pgs: 129 active+clean; 813 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.2 MiB/s wr, 21 op/s 2024-05-14T15:24:59.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:24:59 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3894000329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:24:59.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:59 smithi203 ceph-mon[34567]: pgmap v103: 129 pgs: 129 active+clean; 813 MiB data, 2.0 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 9.2 MiB/s wr, 21 op/s 2024-05-14T15:24:59.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:24:59 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3894000329' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:24:59.695 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:25:01.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:01 smithi092 ceph-mon[34729]: pgmap v104: 129 pgs: 129 active+clean; 863 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 14 MiB/s wr, 39 op/s 2024-05-14T15:25:01.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:01 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:25:01.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:01 smithi069 ceph-mon[31270]: pgmap v104: 129 pgs: 129 active+clean; 863 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 14 MiB/s wr, 39 op/s 2024-05-14T15:25:01.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:01 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:25:01.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:01 smithi203 ceph-mon[34567]: pgmap v104: 129 pgs: 129 active+clean; 863 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 14 MiB/s wr, 39 op/s 2024-05-14T15:25:01.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:01 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:25:02.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.187+0000 7fd5b8600700 1 -- 172.21.15.69:0/3805697653 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b0109870 msgr2=0x7fd5b01111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:02.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.187+0000 7fd5b8600700 1 --2- 172.21.15.69:0/3805697653 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b0109870 0x7fd5b01111d0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800b0d0 tx=0x7fd5a800b3e0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.187+0000 7fd5b8600700 1 -- 172.21.15.69:0/3805697653 shutdown_connections 2024-05-14T15:25:02.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.187+0000 7fd5b8600700 1 --2- 172.21.15.69:0/3805697653 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b0109870 0x7fd5b01111d0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.187+0000 7fd5b8600700 1 --2- 172.21.15.69:0/3805697653 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b01045f0 0x7fd5b0104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.187+0000 7fd5b8600700 1 --2- 172.21.15.69:0/3805697653 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5b0108f20 0x7fd5b0109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.188 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.187+0000 7fd5b8600700 1 -- 172.21.15.69:0/3805697653 >> 172.21.15.69:0/3805697653 conn(0x7fd5b0100040 msgr2=0x7fd5b0102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:02.189 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:02 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:02.189 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:02 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:25:02.189 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:02 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:25:02.189 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:02 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:25:02.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.187+0000 7fd5b8600700 1 -- 172.21.15.69:0/3805697653 shutdown_connections 2024-05-14T15:25:02.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.187+0000 7fd5b8600700 1 -- 172.21.15.69:0/3805697653 wait complete. 2024-05-14T15:25:02.189 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.189+0000 7fd5b8600700 1 Processor -- start 2024-05-14T15:25:02.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.189+0000 7fd5b8600700 1 -- start start 2024-05-14T15:25:02.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.190+0000 7fd5b8600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b01045f0 0x7fd5b0075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.190+0000 7fd5b8600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b0108f20 0x7fd5b0076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.190+0000 7fd5b8600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5b0109870 0x7fd5b0076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.190+0000 7fd5b8600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b01143a0 con 0x7fd5b01045f0 2024-05-14T15:25:02.190 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.190+0000 7fd5b8600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0114220 con 0x7fd5b0109870 2024-05-14T15:25:02.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.190+0000 7fd5b8600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd5b0114520 con 0x7fd5b0108f20 2024-05-14T15:25:02.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.190+0000 7fd5b5c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b01045f0 0x7fd5b0075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.190+0000 7fd5b5c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b01045f0 0x7fd5b0075ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43474/0 (socket says 172.21.15.69:43474) 2024-05-14T15:25:02.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.190+0000 7fd5b5c00700 1 -- 172.21.15.69:0/1537369682 learned_addr learned my addr 172.21.15.69:0/1537369682 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:02.191 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.190+0000 7fd5b5200700 1 --2- 172.21.15.69:0/1537369682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b0108f20 0x7fd5b0076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.190+0000 7fd5b6600700 1 --2- 172.21.15.69:0/1537369682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5b0109870 0x7fd5b0076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.191+0000 7fd5b5c00700 1 -- 172.21.15.69:0/1537369682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b0108f20 msgr2=0x7fd5b0076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:02.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.191+0000 7fd5b5c00700 1 --2- 172.21.15.69:0/1537369682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b0108f20 0x7fd5b0076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.191+0000 7fd5b5c00700 1 -- 172.21.15.69:0/1537369682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5b0109870 msgr2=0x7fd5b0076540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:02.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.191+0000 7fd5b5c00700 1 --2- 172.21.15.69:0/1537369682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5b0109870 0x7fd5b0076540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.191+0000 7fd5b5c00700 1 -- 172.21.15.69:0/1537369682 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b01a9020 con 0x7fd5b01045f0 2024-05-14T15:25:02.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.191+0000 7fd5b5c00700 1 --2- 172.21.15.69:0/1537369682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b01045f0 0x7fd5b0075ac0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd5a400c9b0 tx=0x7fd5a400ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:02.192 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.191+0000 7fd5ae000700 1 -- 172.21.15.69:0/1537369682 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4007b00 con 0x7fd5b01045f0 2024-05-14T15:25:02.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.192+0000 7fd5b8600700 1 -- 172.21.15.69:0/1537369682 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b01a9310 con 0x7fd5b01045f0 2024-05-14T15:25:02.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.192+0000 7fd5b8600700 1 -- 172.21.15.69:0/1537369682 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5b01a98a0 con 0x7fd5b01045f0 2024-05-14T15:25:02.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.192+0000 7fd5ae000700 1 -- 172.21.15.69:0/1537369682 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5a4007ca0 con 0x7fd5b01045f0 2024-05-14T15:25:02.193 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.192+0000 7fd5ae000700 1 -- 172.21.15.69:0/1537369682 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4018660 con 0x7fd5b01045f0 2024-05-14T15:25:02.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.196+0000 7fd5ae000700 1 -- 172.21.15.69:0/1537369682 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd5a4004830 con 0x7fd5b01045f0 2024-05-14T15:25:02.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.196+0000 7fd5c717db80 1 Processor -- start 2024-05-14T15:25:02.197 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.197+0000 7fd5c717db80 1 -- start start 2024-05-14T15:25:02.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.197+0000 7fd5c717db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb297926b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.197+0000 7fd5c717db80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb29792bf0 0x55bb2978c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.197+0000 7fd5c717db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb2978cc50 0x55bb2978d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.197+0000 7fd5c717db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55bb296aea20 con 0x55bb2978cc50 2024-05-14T15:25:02.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.197+0000 7fd5c717db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bb2964c760 con 0x55bb2960ee40 2024-05-14T15:25:02.198 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.197+0000 7fd5c717db80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bb296aa9e0 con 0x55bb29792bf0 2024-05-14T15:25:02.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.198+0000 7fd5b5200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb2978cc50 0x55bb2978d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.198+0000 7fd5b5200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb2978cc50 0x55bb2978d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43480/0 (socket says 172.21.15.69:43480) 2024-05-14T15:25:02.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.198+0000 7fd5b5200700 1 -- 172.21.15.69:0/669541245 learned_addr learned my addr 172.21.15.69:0/669541245 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:02.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.198+0000 7fd5b6600700 1 --2- 172.21.15.69:0/669541245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb297926b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.199 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.198+0000 7fd5ae000700 1 --2- 172.21.15.69:0/1537369682 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5980b2a70 0x7fd5980b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.198+0000 7fd5b5200700 1 -- 172.21.15.69:0/669541245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb29792bf0 msgr2=0x55bb2978c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:02.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.198+0000 7fd5b5200700 1 --2- 172.21.15.69:0/669541245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb29792bf0 0x55bb2978c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.198+0000 7fd5b5200700 1 -- 172.21.15.69:0/669541245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 msgr2=0x55bb297926b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:02.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.198+0000 7fd5b5200700 1 --2- 172.21.15.69:0/669541245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb297926b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.198+0000 7fd5b5200700 1 -- 172.21.15.69:0/669541245 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb295fb8d0 con 0x55bb2978cc50 2024-05-14T15:25:02.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.198+0000 7fd5ae000700 1 -- 172.21.15.69:0/1537369682 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fd5a40e2940 con 0x7fd5b01045f0 2024-05-14T15:25:02.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.198+0000 7fd5b6600700 1 --2- 172.21.15.69:0/1537369682 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5980b2a70 0x7fd5980b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.199+0000 7fd5b5200700 1 --2- 172.21.15.69:0/669541245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb2978cc50 0x55bb2978d060 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00ac60 tx=0x7fd59c00af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d14f2dfc856ee7ad server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:02.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.199+0000 7fd5a2a00700 1 -- 172.21.15.69:0/669541245 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c00fe90 con 0x55bb2978cc50 2024-05-14T15:25:02.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.199+0000 7fd5a2a00700 1 -- 172.21.15.69:0/669541245 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd59c0044c0 con 0x55bb2978cc50 2024-05-14T15:25:02.200 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.199+0000 7fd5a2a00700 1 -- 172.21.15.69:0/669541245 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd59c018690 con 0x55bb2978cc50 2024-05-14T15:25:02.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.200+0000 7fd5c717db80 1 -- 172.21.15.69:0/669541245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb2978cc50 msgr2=0x55bb2978d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:02.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.200+0000 7fd5b6600700 1 --2- 172.21.15.69:0/1537369682 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5980b2a70 0x7fd5980b4f80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009900 tx=0x7fd5a80099e0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:02.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.200+0000 7fd5c717db80 1 --2- 172.21.15.69:0/669541245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb2978cc50 0x55bb2978d060 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fd59c00ac60 tx=0x7fd59c00af70 comp rx=0 tx=0).stop 2024-05-14T15:25:02.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.200+0000 7fd5c717db80 1 -- 172.21.15.69:0/669541245 shutdown_connections 2024-05-14T15:25:02.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.200+0000 7fd5c717db80 1 --2- 172.21.15.69:0/669541245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb2978cc50 0x55bb2978d060 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.200+0000 7fd5c717db80 1 --2- 172.21.15.69:0/669541245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb297926b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.200+0000 7fd5c717db80 1 --2- 172.21.15.69:0/669541245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb29792bf0 0x55bb2978c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.200+0000 7fd5c717db80 1 -- 172.21.15.69:0/669541245 >> 172.21.15.69:0/669541245 conn(0x55bb2964da80 msgr2=0x55bb29787790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:02.201 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.201+0000 7fd5c717db80 1 -- 172.21.15.69:0/669541245 shutdown_connections 2024-05-14T15:25:02.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.201+0000 7fd5c717db80 1 -- 172.21.15.69:0/669541245 wait complete. 2024-05-14T15:25:02.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.201+0000 7fd5c717db80 1 -- start start 2024-05-14T15:25:02.202 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.202+0000 7fd5c717db80 1 Processor -- start 2024-05-14T15:25:02.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.202+0000 7fd5c717db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb29796350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.202+0000 7fd5c717db80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 0x55bb29796890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.202+0000 7fd5c717db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 0x55bb29796dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.202+0000 7fd5c717db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55bb297996c0 con 0x55bb29792bf0 2024-05-14T15:25:02.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.202+0000 7fd5c717db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bb29614b20 con 0x55bb2960ee40 2024-05-14T15:25:02.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.202+0000 7fd5c717db80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bb29799840 con 0x55bb2978cc50 2024-05-14T15:25:02.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.202+0000 7fd5c717db80 10 client.0 _ll_register_callbacks cb 0x55bb29642380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:02.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.203+0000 7fd5b6600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 0x55bb29796dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.205 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.203+0000 7fd5b5200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 0x55bb29796890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.203+0000 7fd5b5200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 0x55bb29796890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:55656/0 (socket says 172.21.15.69:55656) 2024-05-14T15:25:02.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.203+0000 7fd5b5200700 1 -- 172.21.15.69:0/1802662503 learned_addr learned my addr 172.21.15.69:0/1802662503 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:02.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.203+0000 7fd5b5c00700 1 --2- 172.21.15.69:0/1802662503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb29796350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.203+0000 7fd5b6600700 1 -- 172.21.15.69:0/1802662503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 msgr2=0x55bb29796890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:02.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.203+0000 7fd5b6600700 1 --2- 172.21.15.69:0/1802662503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 0x55bb29796890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.203+0000 7fd5b6600700 1 -- 172.21.15.69:0/1802662503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 msgr2=0x55bb29796350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:02.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.203+0000 7fd5b6600700 1 --2- 172.21.15.69:0/1802662503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb29796350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.203+0000 7fd5b6600700 1 -- 172.21.15.69:0/1802662503 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb29674420 con 0x55bb29792bf0 2024-05-14T15:25:02.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.203+0000 7fd5b5c00700 1 --2- 172.21.15.69:0/1802662503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb29796350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:25:02.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.203+0000 7fd5b5200700 1 --2- 172.21.15.69:0/1802662503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 0x55bb29796890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:25:02.206 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.204+0000 7fd5b6600700 1 --2- 172.21.15.69:0/1802662503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 0x55bb29796dd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x55bb2978da30 tx=0x7fd5a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6adfe79df840838b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:02.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.204+0000 7fd597400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:02.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.204+0000 7fd597400700 1 -- 172.21.15.69:0/1802662503 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a802d020 con 0x55bb29792bf0 2024-05-14T15:25:02.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.204+0000 7fd5c717db80 1 -- 172.21.15.69:0/1802662503 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd59c0044c0 con 0x55bb29792bf0 2024-05-14T15:25:02.207 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.204+0000 7fd597400700 1 -- 172.21.15.69:0/1802662503 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fd5a8029450 con 0x55bb29792bf0 2024-05-14T15:25:02.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.205+0000 7fd597400700 1 -- 172.21.15.69:0/1802662503 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd5a8038050 con 0x55bb29792bf0 2024-05-14T15:25:02.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.205+0000 7fd5c717db80 10 client.16083 fetch_fsmap learned FSMap version 36 2024-05-14T15:25:02.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.205+0000 7fd5c717db80 1 -- 172.21.15.69:0/1802662503 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55bb297a4300 con 0x55bb29792bf0 2024-05-14T15:25:02.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.205+0000 7fd597400700 1 -- 172.21.15.69:0/1802662503 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd59c0044c0 con 0x55bb29792bf0 2024-05-14T15:25:02.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.205+0000 7fd597400700 1 -- 172.21.15.69:0/1802662503 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 36) ==== 8390+0+0 (secure 0 0 0) 0x7fd5a8011070 con 0x55bb29792bf0 2024-05-14T15:25:02.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.205+0000 7fd5c717db80 10 client.16083 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T15:25:02.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.205+0000 7fd5c717db80 10 client.16083 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.i 2024-05-14T15:25:02.208 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.205+0000 7fd5c717db80 20 client.16083 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:02.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.205+0000 7fd5c717db80 1 --2- 172.21.15.69:0/1802662503 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55bb297a68e0 0x55bb297a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.205+0000 7fd5c717db80 4 client.16083 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:25:02.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.205+0000 7fd5c717db80 1 -- 172.21.15.69:0/1802662503 --> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bb29759070 con 0x55bb297a68e0 2024-05-14T15:25:02.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.206+0000 7fd5b5c00700 1 --2- 172.21.15.69:0/1802662503 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55bb297a68e0 0x55bb297a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.207+0000 7fd5b5c00700 1 --2- 172.21.15.69:0/1802662503 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55bb297a68e0 0x55bb297a8d70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=26d30df439268fa7 server_cookie=7d615bbe1018c96c in_seq=0 out_seq=0 2024-05-14T15:25:02.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.207+0000 7fd597400700 10 client.16083 ms_handle_connect on v2:172.21.15.203:6838/3167469844 2024-05-14T15:25:02.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.209+0000 7fd597400700 1 -- 172.21.15.69:0/1802662503 <== mds.4 v2:172.21.15.203:6838/3167469844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bb29759070 con 0x55bb297a68e0 2024-05-14T15:25:02.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.209+0000 7fd597400700 10 client.16083 handle_command_reply: tid=0 2024-05-14T15:25:02.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.210+0000 7fd5c717db80 1 client.16083 shutdown 2024-05-14T15:25:02.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.210+0000 7fd5c717db80 1 -- 172.21.15.69:0/1802662503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 msgr2=0x55bb29796dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:02.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.210+0000 7fd5c717db80 1 --2- 172.21.15.69:0/1802662503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 0x55bb29796dd0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x55bb2978da30 tx=0x7fd5a800b040 comp rx=0 tx=0).stop 2024-05-14T15:25:02.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.210+0000 7fd5c717db80 1 -- 172.21.15.69:0/1802662503 shutdown_connections 2024-05-14T15:25:02.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.210+0000 7fd5c717db80 1 --2- 172.21.15.69:0/1802662503 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55bb297a68e0 0x55bb297a8d70 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.211 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.210+0000 7fd5c717db80 1 --2- 172.21.15.69:0/1802662503 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 0x55bb29796dd0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.210+0000 7fd5c717db80 1 --2- 172.21.15.69:0/1802662503 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb29796350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.210+0000 7fd5c717db80 1 --2- 172.21.15.69:0/1802662503 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 0x55bb29796890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.210+0000 7fd597400700 0 client.16083 ms_handle_reset on v2:172.21.15.203:6838/3167469844 2024-05-14T15:25:02.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.210+0000 7fd5c717db80 1 -- 172.21.15.69:0/1802662503 >> 172.21.15.69:0/1802662503 conn(0x55bb2964da80 msgr2=0x55bb2978b700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:02.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.210+0000 7fd5c717db80 1 -- 172.21.15.69:0/1802662503 shutdown_connections 2024-05-14T15:25:02.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.210+0000 7fd5c717db80 1 -- 172.21.15.69:0/1802662503 wait complete. 2024-05-14T15:25:02.212 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.210+0000 7fd5c717db80 20 client.16083 trim_cache size 0 max 16384 2024-05-14T15:25:02.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.231+0000 7fd5c717db80 1 Processor -- start 2024-05-14T15:25:02.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.231+0000 7fd5c717db80 1 -- start start 2024-05-14T15:25:02.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.232+0000 7fd5c717db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb2978c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.232+0000 7fd5c717db80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 0x55bb297878c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.232+0000 7fd5c717db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 0x55bb29796c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.232+0000 7fd5c717db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd59000eda0 con 0x55bb29792bf0 2024-05-14T15:25:02.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.232+0000 7fd5c717db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd590010a30 con 0x55bb2960ee40 2024-05-14T15:25:02.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.232+0000 7fd5c717db80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd59000f470 con 0x55bb2978cc50 2024-05-14T15:25:02.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.232+0000 7fd5b6600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 0x55bb29796c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.232+0000 7fd5b6600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 0x55bb29796c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43490/0 (socket says 172.21.15.69:43490) 2024-05-14T15:25:02.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.232+0000 7fd5b6600700 1 -- 172.21.15.69:0/1738915313 learned_addr learned my addr 172.21.15.69:0/1738915313 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:02.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.232+0000 7fd5b5200700 1 --2- 172.21.15.69:0/1738915313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 0x55bb297878c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.233+0000 7fd5b5c00700 1 --2- 172.21.15.69:0/1738915313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb2978c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.233+0000 7fd5b6600700 1 -- 172.21.15.69:0/1738915313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 msgr2=0x55bb297878c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:02.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.233+0000 7fd5b6600700 1 --2- 172.21.15.69:0/1738915313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 0x55bb297878c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.233+0000 7fd5b6600700 1 -- 172.21.15.69:0/1738915313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 msgr2=0x55bb2978c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:02.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.233+0000 7fd5b6600700 1 --2- 172.21.15.69:0/1738915313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb2978c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.233+0000 7fd5b6600700 1 -- 172.21.15.69:0/1738915313 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bb29792080 con 0x55bb29792bf0 2024-05-14T15:25:02.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.233+0000 7fd5b6600700 1 --2- 172.21.15.69:0/1738915313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 0x55bb29796c10 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800b0d0 tx=0x7fd5a8007c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d555638e5cad9b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:02.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.234+0000 7fd5a2000700 1 -- 172.21.15.69:0/1738915313 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8040070 con 0x55bb29792bf0 2024-05-14T15:25:02.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.234+0000 7fd5a2000700 1 -- 172.21.15.69:0/1738915313 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5a801dcb0 con 0x55bb29792bf0 2024-05-14T15:25:02.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.234+0000 7fd5a2000700 1 -- 172.21.15.69:0/1738915313 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a802d070 con 0x55bb29792bf0 2024-05-14T15:25:02.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.235+0000 7fd5c717db80 1 -- 172.21.15.69:0/1738915313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 msgr2=0x55bb29796c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:02.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.235+0000 7fd5c717db80 1 --2- 172.21.15.69:0/1738915313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 0x55bb29796c10 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fd5a800b0d0 tx=0x7fd5a8007c30 comp rx=0 tx=0).stop 2024-05-14T15:25:02.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.235+0000 7fd5c717db80 1 -- 172.21.15.69:0/1738915313 shutdown_connections 2024-05-14T15:25:02.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.235+0000 7fd5c717db80 1 --2- 172.21.15.69:0/1738915313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 0x55bb29796c10 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.235+0000 7fd5c717db80 1 --2- 172.21.15.69:0/1738915313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb2978c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.235+0000 7fd5c717db80 1 --2- 172.21.15.69:0/1738915313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 0x55bb297878c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.235+0000 7fd5c717db80 1 -- 172.21.15.69:0/1738915313 >> 172.21.15.69:0/1738915313 conn(0x55bb2964da80 msgr2=0x55bb297952d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:02.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.235+0000 7fd5c717db80 1 -- 172.21.15.69:0/1738915313 shutdown_connections 2024-05-14T15:25:02.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.235+0000 7fd5c717db80 1 -- 172.21.15.69:0/1738915313 wait complete. 2024-05-14T15:25:02.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.236+0000 7fd5c717db80 1 -- start start 2024-05-14T15:25:02.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.236+0000 7fd5c717db80 1 Processor -- start 2024-05-14T15:25:02.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.237+0000 7fd5c717db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb2979ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.237+0000 7fd5c717db80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 0x55bb297ad960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.237+0000 7fd5c717db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 0x55bb297adea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.237+0000 7fd5c717db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd5900102a0 con 0x55bb29792bf0 2024-05-14T15:25:02.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.237+0000 7fd5c717db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd59000fb40 con 0x55bb2960ee40 2024-05-14T15:25:02.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.237+0000 7fd5c717db80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd59000cd40 con 0x55bb2978cc50 2024-05-14T15:25:02.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.237+0000 7fd5c717db80 10 client.0 _ll_register_callbacks cb 0x55bb29642380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:02.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.237+0000 7fd5b5c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb2979ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.237+0000 7fd5b6600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 0x55bb297adea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.237+0000 7fd5b5c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb2979ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:32824/0 (socket says 172.21.15.69:32824) 2024-05-14T15:25:02.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.237+0000 7fd5b5c00700 1 -- 172.21.15.69:0/2585836883 learned_addr learned my addr 172.21.15.69:0/2585836883 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:02.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.237+0000 7fd5b5200700 1 --2- 172.21.15.69:0/2585836883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 0x55bb297ad960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.238+0000 7fd5b6600700 1 -- 172.21.15.69:0/2585836883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 msgr2=0x55bb297ad960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:02.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.238+0000 7fd5b6600700 1 --2- 172.21.15.69:0/2585836883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 0x55bb297ad960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.238+0000 7fd5b6600700 1 -- 172.21.15.69:0/2585836883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 msgr2=0x55bb2979ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:02.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.238+0000 7fd5b6600700 1 --2- 172.21.15.69:0/2585836883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb2979ef30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.238+0000 7fd5b6600700 1 -- 172.21.15.69:0/2585836883 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bb297ae460 con 0x55bb29792bf0 2024-05-14T15:25:02.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.238+0000 7fd5b6600700 1 --2- 172.21.15.69:0/2585836883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 0x55bb297adea0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd5a801db60 tx=0x7fd5a801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0e2b4fbc428598a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:02.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.238+0000 7fd597400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:02.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.239+0000 7fd597400700 1 -- 172.21.15.69:0/2585836883 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a8040050 con 0x55bb29792bf0 2024-05-14T15:25:02.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.239+0000 7fd597400700 1 -- 172.21.15.69:0/2585836883 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fd5a801d620 con 0x55bb29792bf0 2024-05-14T15:25:02.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.239+0000 7fd5c717db80 1 -- 172.21.15.69:0/2585836883 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5a801dcb0 con 0x55bb29792bf0 2024-05-14T15:25:02.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.239+0000 7fd597400700 1 -- 172.21.15.69:0/2585836883 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7fd5a802d040 con 0x55bb29792bf0 2024-05-14T15:25:02.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.239+0000 7fd5c717db80 10 client.16089 fetch_fsmap learned FSMap version 36 2024-05-14T15:25:02.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.239+0000 7fd5c717db80 1 -- 172.21.15.69:0/2585836883 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55bb29819660 con 0x55bb29792bf0 2024-05-14T15:25:02.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.240+0000 7fd597400700 1 -- 172.21.15.69:0/2585836883 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5a801dcb0 con 0x55bb29792bf0 2024-05-14T15:25:02.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.240+0000 7fd597400700 1 -- 172.21.15.69:0/2585836883 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 36) ==== 8390+0+0 (secure 0 0 0) 0x7fd5a8011050 con 0x55bb29792bf0 2024-05-14T15:25:02.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.240+0000 7fd5c717db80 10 client.16089 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T15:25:02.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.240+0000 7fd5c717db80 10 client.16089 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.i 2024-05-14T15:25:02.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.240+0000 7fd5c717db80 20 client.16089 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:02.243 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.240+0000 7fd5c717db80 1 --2- 172.21.15.69:0/2585836883 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55bb29819c00 0x55bb2981c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:02.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.240+0000 7fd5c717db80 4 client.16089 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:25:02.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.240+0000 7fd5c717db80 1 -- 172.21.15.69:0/2585836883 --> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bb296bc400 con 0x55bb29819c00 2024-05-14T15:25:02.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.241+0000 7fd5b5c00700 1 --2- 172.21.15.69:0/2585836883 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55bb29819c00 0x55bb2981c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:02.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.242+0000 7fd5b5c00700 1 --2- 172.21.15.69:0/2585836883 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55bb29819c00 0x55bb2981c020 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=f703c8aed6cd5f19 server_cookie=c6e061e4cef79609 in_seq=0 out_seq=0 2024-05-14T15:25:02.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.242+0000 7fd597400700 10 client.16089 ms_handle_connect on v2:172.21.15.203:6838/3167469844 2024-05-14T15:25:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.242+0000 7fd597400700 1 -- 172.21.15.69:0/2585836883 <== mds.4 v2:172.21.15.203:6838/3167469844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bb296bc400 con 0x55bb29819c00 2024-05-14T15:25:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.242+0000 7fd597400700 10 client.16089 handle_command_reply: tid=0 2024-05-14T15:25:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.242+0000 7fd5c717db80 1 client.16089 shutdown 2024-05-14T15:25:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.242+0000 7fd5c717db80 1 -- 172.21.15.69:0/2585836883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 msgr2=0x55bb297adea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.242+0000 7fd5c717db80 1 --2- 172.21.15.69:0/2585836883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 0x55bb297adea0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fd5a801db60 tx=0x7fd5a801e000 comp rx=0 tx=0).stop 2024-05-14T15:25:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.243+0000 7fd5c717db80 1 -- 172.21.15.69:0/2585836883 shutdown_connections 2024-05-14T15:25:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.243+0000 7fd5c717db80 1 --2- 172.21.15.69:0/2585836883 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55bb29819c00 0x55bb2981c020 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.243+0000 7fd5c717db80 1 --2- 172.21.15.69:0/2585836883 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bb29792bf0 0x55bb297adea0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.243+0000 7fd5c717db80 1 --2- 172.21.15.69:0/2585836883 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bb2960ee40 0x55bb2979ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.243+0000 7fd5c717db80 1 --2- 172.21.15.69:0/2585836883 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bb2978cc50 0x55bb297ad960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.243+0000 7fd5c717db80 1 -- 172.21.15.69:0/2585836883 >> 172.21.15.69:0/2585836883 conn(0x55bb2964da80 msgr2=0x55bb29790000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:02.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.243+0000 7fd597400700 0 client.16089 ms_handle_reset on v2:172.21.15.203:6838/3167469844 2024-05-14T15:25:02.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.243+0000 7fd5c717db80 1 -- 172.21.15.69:0/2585836883 shutdown_connections 2024-05-14T15:25:02.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.243+0000 7fd5c717db80 1 -- 172.21.15.69:0/2585836883 wait complete. 2024-05-14T15:25:02.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.243+0000 7fd5c717db80 20 client.16089 trim_cache size 0 max 16384 2024-05-14T15:25:02.247 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:25:02.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.244+0000 7fd5b8600700 1 -- 172.21.15.69:0/1537369682 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5980b2a70 msgr2=0x7fd5980b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:02.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.244+0000 7fd5b8600700 1 --2- 172.21.15.69:0/1537369682 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5980b2a70 0x7fd5980b4f80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd5a8009900 tx=0x7fd5a80099e0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.244+0000 7fd5b8600700 1 -- 172.21.15.69:0/1537369682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b01045f0 msgr2=0x7fd5b0075ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:02.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.244+0000 7fd5b8600700 1 --2- 172.21.15.69:0/1537369682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b01045f0 0x7fd5b0075ac0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fd5a400c9b0 tx=0x7fd5a400ccc0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.244+0000 7fd5b8600700 1 -- 172.21.15.69:0/1537369682 shutdown_connections 2024-05-14T15:25:02.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.244+0000 7fd5b8600700 1 --2- 172.21.15.69:0/1537369682 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5980b2a70 0x7fd5980b4f80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.244+0000 7fd5b8600700 1 --2- 172.21.15.69:0/1537369682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5b01045f0 0x7fd5b0075ac0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.244+0000 7fd5b8600700 1 --2- 172.21.15.69:0/1537369682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd5b0109870 0x7fd5b0076540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.244+0000 7fd5b8600700 1 --2- 172.21.15.69:0/1537369682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd5b0108f20 0x7fd5b0076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:02.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.244+0000 7fd5b8600700 1 -- 172.21.15.69:0/1537369682 >> 172.21.15.69:0/1537369682 conn(0x7fd5b0100040 msgr2=0x7fd5b0108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:02.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.245+0000 7fd5b8600700 1 -- 172.21.15.69:0/1537369682 shutdown_connections 2024-05-14T15:25:02.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:02.245+0000 7fd5b8600700 1 -- 172.21.15.69:0/1537369682 wait complete. 2024-05-14T15:25:02.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:02 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:02.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:02 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:25:02.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:02 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:25:02.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:02 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:25:02.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:02 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:02.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:02 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:25:02.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:02 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:25:02.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:02 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:25:03.243 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-14T15:25:03.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:03 smithi092 ceph-mon[34729]: pgmap v105: 129 pgs: 129 active+clean; 863 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 30 op/s 2024-05-14T15:25:03.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:03 smithi069 ceph-mon[31270]: pgmap v105: 129 pgs: 129 active+clean; 863 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 30 op/s 2024-05-14T15:25:03.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:03 smithi203 ceph-mon[34567]: pgmap v105: 129 pgs: 129 active+clean; 863 MiB data, 2.1 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 10 MiB/s wr, 30 op/s 2024-05-14T15:25:03.712 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:25:05.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:05 smithi069 ceph-mon[31270]: pgmap v106: 129 pgs: 129 active+clean; 952 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 17 MiB/s wr, 56 op/s 2024-05-14T15:25:05.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:05 smithi092 ceph-mon[34729]: pgmap v106: 129 pgs: 129 active+clean; 952 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 17 MiB/s wr, 56 op/s 2024-05-14T15:25:05.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:05 smithi203 ceph-mon[34567]: pgmap v106: 129 pgs: 129 active+clean; 952 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 17 MiB/s wr, 56 op/s 2024-05-14T15:25:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.920+0000 7f5b1ca00640 1 -- 172.21.15.69:0/240030224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b18075430 msgr2=0x7f5b18075840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.920+0000 7f5b1ca00640 1 --2- 172.21.15.69:0/240030224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b18075430 0x7f5b18075840 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f5b08009ca0 tx=0x7f5b0802a950 comp rx=0 tx=0).stop 2024-05-14T15:25:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.920+0000 7f5b1ca00640 1 -- 172.21.15.69:0/240030224 shutdown_connections 2024-05-14T15:25:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.920+0000 7f5b1ca00640 1 --2- 172.21.15.69:0/240030224 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b18110330 0x7f5b18112750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.920+0000 7f5b1ca00640 1 --2- 172.21.15.69:0/240030224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b1810d9d0 0x7f5b1810fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.920+0000 7f5b1ca00640 1 --2- 172.21.15.69:0/240030224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b18075430 0x7f5b18075840 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.920+0000 7f5b1ca00640 1 -- 172.21.15.69:0/240030224 >> 172.21.15.69:0/240030224 conn(0x7f5b18079110 msgr2=0x7f5b18079550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.921+0000 7f5b1ca00640 1 -- 172.21.15.69:0/240030224 shutdown_connections 2024-05-14T15:25:05.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.921+0000 7f5b1ca00640 1 -- 172.21.15.69:0/240030224 wait complete. 2024-05-14T15:25:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.922+0000 7f5b1ca00640 1 Processor -- start 2024-05-14T15:25:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.922+0000 7f5b1ca00640 1 -- start start 2024-05-14T15:25:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.922+0000 7f5b1ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b18075430 0x7f5b1819c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.922+0000 7f5b1ca00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b1810d9d0 0x7f5b1819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.922+0000 7f5b1ca00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b18110330 0x7f5b181a1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.922+0000 7f5b1ca00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5b18115da0 con 0x7f5b18075430 2024-05-14T15:25:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.922+0000 7f5b1ca00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b18115c20 con 0x7f5b18110330 2024-05-14T15:25:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.922+0000 7f5b1ca00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5b18115f20 con 0x7f5b1810d9d0 2024-05-14T15:25:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.923+0000 7f5b17400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b18075430 0x7f5b1819c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:05.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.923+0000 7f5b17400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b18075430 0x7f5b1819c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54806/0 (socket says 172.21.15.69:54806) 2024-05-14T15:25:05.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.923+0000 7f5b17400640 1 -- 172.21.15.69:0/2595092403 learned_addr learned my addr 172.21.15.69:0/2595092403 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:05.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.923+0000 7f5b0ea00640 1 --2- 172.21.15.69:0/2595092403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b1810d9d0 0x7f5b1819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:05.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.923+0000 7f5b17e00640 1 --2- 172.21.15.69:0/2595092403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b18110330 0x7f5b181a1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:05.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.923+0000 7f5b17400640 1 -- 172.21.15.69:0/2595092403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b1810d9d0 msgr2=0x7f5b1819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:05.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.923+0000 7f5b17400640 1 --2- 172.21.15.69:0/2595092403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b1810d9d0 0x7f5b1819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.923+0000 7f5b17400640 1 -- 172.21.15.69:0/2595092403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b18110330 msgr2=0x7f5b181a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:05.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.923+0000 7f5b17400640 1 --2- 172.21.15.69:0/2595092403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b18110330 0x7f5b181a1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.923+0000 7f5b17400640 1 -- 172.21.15.69:0/2595092403 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b181a1660 con 0x7f5b18075430 2024-05-14T15:25:05.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.923+0000 7f5b0ea00640 1 --2- 172.21.15.69:0/2595092403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b1810d9d0 0x7f5b1819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:25:05.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.924+0000 7f5b17400640 1 --2- 172.21.15.69:0/2595092403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b18075430 0x7f5b1819c800 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5b08005e30 tx=0x7f5b08003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:05.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.924+0000 7f5b14c00640 1 -- 172.21.15.69:0/2595092403 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08034040 con 0x7f5b18075430 2024-05-14T15:25:05.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.924+0000 7f5b1ca00640 1 -- 172.21.15.69:0/2595092403 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b181a18f0 con 0x7f5b18075430 2024-05-14T15:25:05.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.924+0000 7f5b14c00640 1 -- 172.21.15.69:0/2595092403 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b080308d0 con 0x7f5b18075430 2024-05-14T15:25:05.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.924+0000 7f5b14c00640 1 -- 172.21.15.69:0/2595092403 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08004790 con 0x7f5b18075430 2024-05-14T15:25:05.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.924+0000 7f5b1ca00640 1 -- 172.21.15.69:0/2595092403 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b181a1e30 con 0x7f5b18075430 2024-05-14T15:25:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.928+0000 7f5b2500a740 1 Processor -- start 2024-05-14T15:25:05.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.929+0000 7f5b2500a740 1 -- start start 2024-05-14T15:25:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.929+0000 7f5b2500a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7e21b0 0x55595cb83480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.929+0000 7f5b2500a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb839c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.929+0000 7f5b14c00640 1 -- 172.21.15.69:0/2595092403 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f5b08037020 con 0x7f5b18075430 2024-05-14T15:25:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.929+0000 7f5b2500a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7c14d0 0x55595cb83f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.929+0000 7f5b2500a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55595cae8550 con 0x55595c7b92f0 2024-05-14T15:25:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.929+0000 7f5b2500a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55595ca8dbc0 con 0x55595c7e21b0 2024-05-14T15:25:05.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.929+0000 7f5b2500a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55595cae4510 con 0x55595c7c14d0 2024-05-14T15:25:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.930+0000 7f5b17400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb839c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.930+0000 7f5b17400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb839c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54818/0 (socket says 172.21.15.69:54818) 2024-05-14T15:25:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.930+0000 7f5b17400640 1 -- 172.21.15.69:0/3139863837 learned_addr learned my addr 172.21.15.69:0/3139863837 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.930+0000 7f5b17e00640 1 --2- 172.21.15.69:0/3139863837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7e21b0 0x55595cb83480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.930+0000 7f5b0ea00640 1 --2- 172.21.15.69:0/3139863837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7c14d0 0x55595cb83f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:05.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.930+0000 7f5b17400640 1 -- 172.21.15.69:0/3139863837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7c14d0 msgr2=0x55595cb83f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.930+0000 7f5b17400640 1 --2- 172.21.15.69:0/3139863837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7c14d0 0x55595cb83f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.930+0000 7f5b17400640 1 -- 172.21.15.69:0/3139863837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7e21b0 msgr2=0x55595cb83480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.930+0000 7f5b17400640 1 --2- 172.21.15.69:0/3139863837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7e21b0 0x55595cb83480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.930+0000 7f5b17400640 1 -- 172.21.15.69:0/3139863837 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55595c7fa210 con 0x55595c7b92f0 2024-05-14T15:25:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.930+0000 7f5b0ea00640 1 --2- 172.21.15.69:0/3139863837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7c14d0 0x55595cb83f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:25:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.931+0000 7f5b17400640 1 --2- 172.21.15.69:0/3139863837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb839c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5b08100e80 tx=0x7f5b08107b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=311b7e4f4395e727 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.931+0000 7f5b07e00640 1 -- 172.21.15.69:0/3139863837 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b08117070 con 0x55595c7b92f0 2024-05-14T15:25:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.931+0000 7f5b07e00640 1 -- 172.21.15.69:0/3139863837 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b08110850 con 0x55595c7b92f0 2024-05-14T15:25:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.931+0000 7f5b07e00640 1 -- 172.21.15.69:0/3139863837 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0810f960 con 0x55595c7b92f0 2024-05-14T15:25:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.931+0000 7f5b14c00640 1 --2- 172.21.15.69:0/2595092403 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5afc0b2950 0x7f5afc0b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.931+0000 7f5b14c00640 1 -- 172.21.15.69:0/2595092403 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5b08103af0 con 0x7f5b18075430 2024-05-14T15:25:05.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.932+0000 7f5b17e00640 1 --2- 172.21.15.69:0/2595092403 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5afc0b2950 0x7f5afc0b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.932+0000 7f5b2500a740 1 -- 172.21.15.69:0/3139863837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 msgr2=0x55595cb839c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.932+0000 7f5b2500a740 1 --2- 172.21.15.69:0/3139863837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb839c0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5b08100e80 tx=0x7f5b08107b90 comp rx=0 tx=0).stop 2024-05-14T15:25:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.932+0000 7f5b2500a740 1 -- 172.21.15.69:0/3139863837 shutdown_connections 2024-05-14T15:25:05.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.932+0000 7f5b2500a740 1 --2- 172.21.15.69:0/3139863837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7c14d0 0x55595cb83f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.932+0000 7f5b2500a740 1 --2- 172.21.15.69:0/3139863837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb839c0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.932+0000 7f5b2500a740 1 --2- 172.21.15.69:0/3139863837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7e21b0 0x55595cb83480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.932+0000 7f5b2500a740 1 -- 172.21.15.69:0/3139863837 >> 172.21.15.69:0/3139863837 conn(0x55595c7d6300 msgr2=0x55595cb7fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.932+0000 7f5b2500a740 1 -- 172.21.15.69:0/3139863837 shutdown_connections 2024-05-14T15:25:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.933+0000 7f5b17e00640 1 --2- 172.21.15.69:0/2595092403 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5afc0b2950 0x7f5afc0b4e60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55595cb805f0 tx=0x7f5b1000b420 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.933+0000 7f5b2500a740 1 -- 172.21.15.69:0/3139863837 wait complete. 2024-05-14T15:25:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.933+0000 7f5b2500a740 1 -- start start 2024-05-14T15:25:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.933+0000 7f5b2500a740 1 Processor -- start 2024-05-14T15:25:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.934+0000 7f5b2500a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7b92f0 0x55595cb8d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.934+0000 7f5b2500a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7c14d0 0x55595cb8def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.934+0000 7f5b2500a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7e21b0 0x55595cb99760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.934+0000 7f5b2500a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55595cb90370 con 0x55595c7e21b0 2024-05-14T15:25:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.934+0000 7f5b2500a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55595caa1660 con 0x55595c7b92f0 2024-05-14T15:25:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.934+0000 7f5b2500a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55595cb904f0 con 0x55595c7c14d0 2024-05-14T15:25:05.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.934+0000 7f5b2500a740 10 client.0 _ll_register_callbacks cb 0x55595ca6b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.934+0000 7f5b17e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7e21b0 0x55595cb99760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.935+0000 7f5b17e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7e21b0 0x55595cb99760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54824/0 (socket says 172.21.15.69:54824) 2024-05-14T15:25:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.935+0000 7f5b17e00640 1 -- 172.21.15.69:0/1013053035 learned_addr learned my addr 172.21.15.69:0/1013053035 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.935+0000 7f5b0ea00640 1 --2- 172.21.15.69:0/1013053035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7c14d0 0x55595cb8def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:05.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.935+0000 7f5b17400640 1 --2- 172.21.15.69:0/1013053035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7b92f0 0x55595cb8d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.935+0000 7f5b17e00640 1 -- 172.21.15.69:0/1013053035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7c14d0 msgr2=0x55595cb8def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.935+0000 7f5b17e00640 1 --2- 172.21.15.69:0/1013053035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7c14d0 0x55595cb8def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.935+0000 7f5b17e00640 1 -- 172.21.15.69:0/1013053035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7b92f0 msgr2=0x55595cb8d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.935+0000 7f5b17e00640 1 --2- 172.21.15.69:0/1013053035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7b92f0 0x55595cb8d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.935+0000 7f5b17e00640 1 -- 172.21.15.69:0/1013053035 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55595c8c6620 con 0x55595c7e21b0 2024-05-14T15:25:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.935+0000 7f5b17400640 1 --2- 172.21.15.69:0/1013053035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7b92f0 0x55595cb8d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:25:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.936+0000 7f5b17e00640 1 --2- 172.21.15.69:0/1013053035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7e21b0 0x55595cb99760 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5b10010650 tx=0x7f5b100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bca359259dd905ac server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.936+0000 7f5b04c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.936+0000 7f5b04c00640 1 -- 172.21.15.69:0/1013053035 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1000f910 con 0x55595c7e21b0 2024-05-14T15:25:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.936+0000 7f5b2500a740 1 -- 172.21.15.69:0/1013053035 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5b08110850 con 0x55595c7e21b0 2024-05-14T15:25:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.936+0000 7f5b04c00640 1 -- 172.21.15.69:0/1013053035 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5b1000fab0 con 0x55595c7e21b0 2024-05-14T15:25:05.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.936+0000 7f5b04c00640 1 -- 172.21.15.69:0/1013053035 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5b10030050 con 0x55595c7e21b0 2024-05-14T15:25:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.936+0000 7f5b2500a740 10 client.16101 fetch_fsmap learned FSMap version 36 2024-05-14T15:25:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.936+0000 7f5b2500a740 1 -- 172.21.15.69:0/1013053035 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55595cb9c560 con 0x55595c7e21b0 2024-05-14T15:25:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.937+0000 7f5b04c00640 1 -- 172.21.15.69:0/1013053035 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b08110850 con 0x55595c7e21b0 2024-05-14T15:25:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.937+0000 7f5b04c00640 1 -- 172.21.15.69:0/1013053035 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 36) ==== 8390+0+0 (secure 0 0 0) 0x7f5b1001d380 con 0x55595c7e21b0 2024-05-14T15:25:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.937+0000 7f5b2500a740 10 client.16101 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T15:25:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.937+0000 7f5b2500a740 10 client.16101 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:25:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.937+0000 7f5b2500a740 20 client.16101 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.937+0000 7f5b2500a740 1 --2- 172.21.15.69:0/1013053035 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55595c7a0d80 0x55595cb9fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.937+0000 7f5b2500a740 4 client.16101 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:25:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.937+0000 7f5b2500a740 1 -- 172.21.15.69:0/1013053035 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55595caf6160 con 0x55595c7a0d80 2024-05-14T15:25:05.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.938+0000 7f5b17400640 1 --2- 172.21.15.69:0/1013053035 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55595c7a0d80 0x55595cb9fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.939+0000 7f5b17400640 1 --2- 172.21.15.69:0/1013053035 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55595c7a0d80 0x55595cb9fb50 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9d2be928e72d9a5 server_cookie=ef4b7060c653e6a2 in_seq=0 out_seq=0 2024-05-14T15:25:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.939+0000 7f5b04c00640 10 client.16101 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.941+0000 7f5b04c00640 1 -- 172.21.15.69:0/1013053035 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55595caf6160 con 0x55595c7a0d80 2024-05-14T15:25:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.941+0000 7f5b04c00640 10 client.16101 handle_command_reply: tid=0 2024-05-14T15:25:05.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.941+0000 7f5b2500a740 1 client.16101 shutdown 2024-05-14T15:25:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.941+0000 7f5b2500a740 1 -- 172.21.15.69:0/1013053035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7e21b0 msgr2=0x55595cb99760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:05.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.941+0000 7f5b2500a740 1 --2- 172.21.15.69:0/1013053035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7e21b0 0x55595cb99760 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5b10010650 tx=0x7f5b100046c0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.941+0000 7f5b2500a740 1 -- 172.21.15.69:0/1013053035 shutdown_connections 2024-05-14T15:25:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.941+0000 7f5b2500a740 1 --2- 172.21.15.69:0/1013053035 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55595c7a0d80 0x55595cb9fb50 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.941+0000 7f5b2500a740 1 --2- 172.21.15.69:0/1013053035 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7e21b0 0x55595cb99760 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.941+0000 7f5b2500a740 1 --2- 172.21.15.69:0/1013053035 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7c14d0 0x55595cb8def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.941+0000 7f5b2500a740 1 --2- 172.21.15.69:0/1013053035 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7b92f0 0x55595cb8d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.941+0000 7f5b04c00640 0 client.16101 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.941+0000 7f5b2500a740 1 -- 172.21.15.69:0/1013053035 >> 172.21.15.69:0/1013053035 conn(0x55595c7d6300 msgr2=0x55595cb832b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.942+0000 7f5b2500a740 1 -- 172.21.15.69:0/1013053035 shutdown_connections 2024-05-14T15:25:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.942+0000 7f5b2500a740 1 -- 172.21.15.69:0/1013053035 wait complete. 2024-05-14T15:25:05.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.942+0000 7f5b2500a740 20 client.16101 trim_cache size 0 max 16384 2024-05-14T15:25:05.965 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.964+0000 7f5b2500a740 1 Processor -- start 2024-05-14T15:25:05.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.964+0000 7f5b2500a740 1 -- start start 2024-05-14T15:25:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.965+0000 7f5b2500a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb7e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.965+0000 7f5b2500a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7c14d0 0x55595cb7eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.965+0000 7f5b2500a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7e21b0 0x55595cba5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.965+0000 7f5b2500a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5b181b32d0 con 0x55595c7b92f0 2024-05-14T15:25:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.965+0000 7f5b2500a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b181b4f60 con 0x55595c7e21b0 2024-05-14T15:25:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.965+0000 7f5b2500a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5b181b39a0 con 0x55595c7c14d0 2024-05-14T15:25:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.965+0000 7f5b17400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb7e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.965+0000 7f5b17400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb7e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54830/0 (socket says 172.21.15.69:54830) 2024-05-14T15:25:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.965+0000 7f5b17400640 1 -- 172.21.15.69:0/452392906 learned_addr learned my addr 172.21.15.69:0/452392906 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.966+0000 7f5b0ea00640 1 --2- 172.21.15.69:0/452392906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7c14d0 0x55595cb7eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.966+0000 7f5b17e00640 1 --2- 172.21.15.69:0/452392906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7e21b0 0x55595cba5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.966+0000 7f5b17400640 1 -- 172.21.15.69:0/452392906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7c14d0 msgr2=0x55595cb7eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.966+0000 7f5b17400640 1 --2- 172.21.15.69:0/452392906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7c14d0 0x55595cb7eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.966+0000 7f5b17400640 1 -- 172.21.15.69:0/452392906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7e21b0 msgr2=0x55595cba5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.966+0000 7f5b17400640 1 --2- 172.21.15.69:0/452392906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7e21b0 0x55595cba5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.966+0000 7f5b17400640 1 -- 172.21.15.69:0/452392906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55595cb79ef0 con 0x55595c7b92f0 2024-05-14T15:25:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.966+0000 7f5b17e00640 1 --2- 172.21.15.69:0/452392906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7e21b0 0x55595cba5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:25:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.966+0000 7f5b17400640 1 --2- 172.21.15.69:0/452392906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb7e960 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5b08107cc0 tx=0x7f5b0802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9281bbe0bcd0a09 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.966+0000 7f5b07400640 1 -- 172.21.15.69:0/452392906 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b080ca8a0 con 0x55595c7b92f0 2024-05-14T15:25:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.967+0000 7f5b07400640 1 -- 172.21.15.69:0/452392906 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5b080098d0 con 0x55595c7b92f0 2024-05-14T15:25:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.967+0000 7f5b07400640 1 -- 172.21.15.69:0/452392906 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b0802c040 con 0x55595c7b92f0 2024-05-14T15:25:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.968+0000 7f5b2500a740 1 -- 172.21.15.69:0/452392906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 msgr2=0x55595cb7e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.968+0000 7f5b2500a740 1 --2- 172.21.15.69:0/452392906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb7e960 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f5b08107cc0 tx=0x7f5b0802a950 comp rx=0 tx=0).stop 2024-05-14T15:25:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.968+0000 7f5b2500a740 1 -- 172.21.15.69:0/452392906 shutdown_connections 2024-05-14T15:25:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.968+0000 7f5b2500a740 1 --2- 172.21.15.69:0/452392906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7e21b0 0x55595cba5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.968+0000 7f5b2500a740 1 --2- 172.21.15.69:0/452392906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7c14d0 0x55595cb7eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.968+0000 7f5b2500a740 1 --2- 172.21.15.69:0/452392906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb7e960 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.968+0000 7f5b2500a740 1 -- 172.21.15.69:0/452392906 >> 172.21.15.69:0/452392906 conn(0x55595c7d6300 msgr2=0x55595cb7e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.968+0000 7f5b2500a740 1 -- 172.21.15.69:0/452392906 shutdown_connections 2024-05-14T15:25:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.968+0000 7f5b2500a740 1 -- 172.21.15.69:0/452392906 wait complete. 2024-05-14T15:25:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.969+0000 7f5b2500a740 1 -- start start 2024-05-14T15:25:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.969+0000 7f5b2500a740 1 Processor -- start 2024-05-14T15:25:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.969+0000 7f5b2500a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb90d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.969+0000 7f5b2500a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7c14d0 0x55595cb91280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.969+0000 7f5b2500a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7e21b0 0x55595cbffe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.969+0000 7f5b2500a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5b181b47d0 con 0x55595c7b92f0 2024-05-14T15:25:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.969+0000 7f5b2500a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5b181b4070 con 0x55595c7c14d0 2024-05-14T15:25:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.969+0000 7f5b2500a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5b181b12b0 con 0x55595c7e21b0 2024-05-14T15:25:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.969+0000 7f5b2500a740 10 client.0 _ll_register_callbacks cb 0x7f5b1000b980 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.970+0000 7f5b17400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb90d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.970+0000 7f5b17400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb90d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54836/0 (socket says 172.21.15.69:54836) 2024-05-14T15:25:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.970+0000 7f5b17400640 1 -- 172.21.15.69:0/3739353273 learned_addr learned my addr 172.21.15.69:0/3739353273 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.970+0000 7f5b17e00640 1 --2- 172.21.15.69:0/3739353273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7e21b0 0x55595cbffe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.970+0000 7f5b0ea00640 1 --2- 172.21.15.69:0/3739353273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7c14d0 0x55595cb91280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.970+0000 7f5b17400640 1 -- 172.21.15.69:0/3739353273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7e21b0 msgr2=0x55595cbffe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.970+0000 7f5b17400640 1 --2- 172.21.15.69:0/3739353273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7e21b0 0x55595cbffe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.970+0000 7f5b17400640 1 -- 172.21.15.69:0/3739353273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7c14d0 msgr2=0x55595cb91280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.970+0000 7f5b17400640 1 --2- 172.21.15.69:0/3739353273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7c14d0 0x55595cb91280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.970+0000 7f5b17400640 1 -- 172.21.15.69:0/3739353273 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55595cb7b0e0 con 0x55595c7b92f0 2024-05-14T15:25:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.971+0000 7f5b17400640 1 --2- 172.21.15.69:0/3739353273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb90d40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5b080ed010 tx=0x7f5b08100ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d60f93f6d93b9676 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:06.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.971+0000 7f5b04c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.971+0000 7f5b04c00640 1 -- 172.21.15.69:0/3739353273 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b080b0060 con 0x55595c7b92f0 2024-05-14T15:25:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.971+0000 7f5b04c00640 1 -- 172.21.15.69:0/3739353273 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f5b080c70c0 con 0x55595c7b92f0 2024-05-14T15:25:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.971+0000 7f5b2500a740 1 -- 172.21.15.69:0/3739353273 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55595caeffd0 con 0x55595c7b92f0 2024-05-14T15:25:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.971+0000 7f5b04c00640 1 -- 172.21.15.69:0/3739353273 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f5b0810f360 con 0x55595c7b92f0 2024-05-14T15:25:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.971+0000 7f5b2500a740 10 client.16107 fetch_fsmap learned FSMap version 36 2024-05-14T15:25:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.971+0000 7f5b2500a740 1 -- 172.21.15.69:0/3739353273 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55595cb7b0e0 con 0x55595c7b92f0 2024-05-14T15:25:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.972+0000 7f5b04c00640 1 -- 172.21.15.69:0/3739353273 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55595caeffd0 con 0x55595c7b92f0 2024-05-14T15:25:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.972+0000 7f5b04c00640 1 -- 172.21.15.69:0/3739353273 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 36) ==== 8390+0+0 (secure 0 0 0) 0x7f5b080c6d60 con 0x55595c7b92f0 2024-05-14T15:25:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.972+0000 7f5b2500a740 10 client.16107 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T15:25:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.972+0000 7f5b2500a740 10 client.16107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:25:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.972+0000 7f5b2500a740 20 client.16107 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.972+0000 7f5b2500a740 1 --2- 172.21.15.69:0/3739353273 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55595c7761c0 0x55595cc09690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.972+0000 7f5b2500a740 4 client.16107 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:25:06.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.972+0000 7f5b2500a740 1 -- 172.21.15.69:0/3739353273 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55595ca6b4b0 con 0x55595c7761c0 2024-05-14T15:25:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.973+0000 7f5b0ea00640 1 --2- 172.21.15.69:0/3739353273 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55595c7761c0 0x55595cc09690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.974+0000 7f5b0ea00640 1 --2- 172.21.15.69:0/3739353273 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55595c7761c0 0x55595cc09690 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=95e0b57acfd4cbd6 server_cookie=848c9a2a438a61a5 in_seq=0 out_seq=0 2024-05-14T15:25:06.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:05.974+0000 7f5b04c00640 10 client.16107 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.026+0000 7f5b04c00640 1 -- 172.21.15.69:0/3739353273 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55595ca6b4b0 con 0x55595c7761c0 2024-05-14T15:25:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.026+0000 7f5b04c00640 10 client.16107 handle_command_reply: tid=0 2024-05-14T15:25:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.026+0000 7f5b2500a740 1 client.16107 shutdown 2024-05-14T15:25:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.026+0000 7f5b2500a740 1 -- 172.21.15.69:0/3739353273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 msgr2=0x55595cb90d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.026+0000 7f5b2500a740 1 --2- 172.21.15.69:0/3739353273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb90d40 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f5b080ed010 tx=0x7f5b08100ef0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.026+0000 7f5b2500a740 1 -- 172.21.15.69:0/3739353273 shutdown_connections 2024-05-14T15:25:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.026+0000 7f5b2500a740 1 --2- 172.21.15.69:0/3739353273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55595c7e21b0 0x55595cbffe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.026+0000 7f5b2500a740 1 --2- 172.21.15.69:0/3739353273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55595c7c14d0 0x55595cb91280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.026+0000 7f5b2500a740 1 --2- 172.21.15.69:0/3739353273 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55595c7761c0 0x55595cc09690 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.026+0000 7f5b2500a740 1 --2- 172.21.15.69:0/3739353273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55595c7b92f0 0x55595cb90d40 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.026+0000 7f5b2500a740 1 -- 172.21.15.69:0/3739353273 >> 172.21.15.69:0/3739353273 conn(0x55595c7d6300 msgr2=0x55595cb87140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.026+0000 7f5b04c00640 0 client.16107 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.027+0000 7f5b2500a740 1 -- 172.21.15.69:0/3739353273 shutdown_connections 2024-05-14T15:25:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.027+0000 7f5b2500a740 1 -- 172.21.15.69:0/3739353273 wait complete. 2024-05-14T15:25:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.027+0000 7f5b2500a740 20 client.16107 trim_cache size 0 max 16384 2024-05-14T15:25:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:25:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:25:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:25:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:25:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.028+0000 7f5b1ca00640 1 -- 172.21.15.69:0/2595092403 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5afc0b2950 msgr2=0x7f5afc0b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.028+0000 7f5b1ca00640 1 --2- 172.21.15.69:0/2595092403 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5afc0b2950 0x7f5afc0b4e60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55595cb805f0 tx=0x7f5b1000b420 comp rx=0 tx=0).stop 2024-05-14T15:25:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.028+0000 7f5b1ca00640 1 -- 172.21.15.69:0/2595092403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b18075430 msgr2=0x7f5b1819c800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.028+0000 7f5b1ca00640 1 --2- 172.21.15.69:0/2595092403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b18075430 0x7f5b1819c800 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f5b08005e30 tx=0x7f5b08003f90 comp rx=0 tx=0).stop 2024-05-14T15:25:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.028+0000 7f5b1ca00640 1 -- 172.21.15.69:0/2595092403 shutdown_connections 2024-05-14T15:25:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.028+0000 7f5b1ca00640 1 --2- 172.21.15.69:0/2595092403 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f5afc0b2950 0x7f5afc0b4e60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.028+0000 7f5b1ca00640 1 --2- 172.21.15.69:0/2595092403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5b18110330 0x7f5b181a1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.028+0000 7f5b1ca00640 1 --2- 172.21.15.69:0/2595092403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5b1810d9d0 0x7f5b1819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.028+0000 7f5b1ca00640 1 --2- 172.21.15.69:0/2595092403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5b18075430 0x7f5b1819c800 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.028+0000 7f5b1ca00640 1 -- 172.21.15.69:0/2595092403 >> 172.21.15.69:0/2595092403 conn(0x7f5b18079110 msgr2=0x7f5b181022e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.028+0000 7f5b1ca00640 1 -- 172.21.15.69:0/2595092403 shutdown_connections 2024-05-14T15:25:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:06.028+0000 7f5b1ca00640 1 -- 172.21.15.69:0/2595092403 wait complete. 2024-05-14T15:25:06.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.442+0000 7f6a9aa00700 1 -- 172.21.15.69:0/1039043980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a941045f0 msgr2=0x7f6a94104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:06.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.442+0000 7f6a9aa00700 1 --2- 172.21.15.69:0/1039043980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a941045f0 0x7f6a94104a00 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6a840099c0 tx=0x7f6a84009cd0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.442+0000 7f6a9aa00700 1 -- 172.21.15.69:0/1039043980 shutdown_connections 2024-05-14T15:25:06.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.442+0000 7f6a9aa00700 1 --2- 172.21.15.69:0/1039043980 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a941045f0 0x7f6a94104a00 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.442+0000 7f6a9aa00700 1 --2- 172.21.15.69:0/1039043980 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a94109870 0x7f6a941111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.442+0000 7f6a9aa00700 1 --2- 172.21.15.69:0/1039043980 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a94108f20 0x7f6a94109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.442+0000 7f6a9aa00700 1 -- 172.21.15.69:0/1039043980 >> 172.21.15.69:0/1039043980 conn(0x7f6a94100040 msgr2=0x7f6a94102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:06.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.442+0000 7f6a9aa00700 1 -- 172.21.15.69:0/1039043980 shutdown_connections 2024-05-14T15:25:06.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.442+0000 7f6a9aa00700 1 -- 172.21.15.69:0/1039043980 wait complete. 2024-05-14T15:25:06.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.444+0000 7f6a9aa00700 1 Processor -- start 2024-05-14T15:25:06.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.444+0000 7f6a9aa00700 1 -- start start 2024-05-14T15:25:06.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.444+0000 7f6a9aa00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a941045f0 0x7f6a9419ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.444+0000 7f6a9aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a94108f20 0x7f6a9419b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.444+0000 7f6a9aa00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a94109870 0x7f6a9419f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.444+0000 7f6a9aa00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6a94114370 con 0x7f6a94108f20 2024-05-14T15:25:06.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.444+0000 7f6a9aa00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6a941141f0 con 0x7f6a94109870 2024-05-14T15:25:06.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.444+0000 7f6a9aa00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a941144f0 con 0x7f6a941045f0 2024-05-14T15:25:06.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.445+0000 7f6a93400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a94108f20 0x7f6a9419b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.445+0000 7f6a93400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a94108f20 0x7f6a9419b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54862/0 (socket says 172.21.15.69:54862) 2024-05-14T15:25:06.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.445+0000 7f6a93400700 1 -- 172.21.15.69:0/4232800044 learned_addr learned my addr 172.21.15.69:0/4232800044 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:06.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.445+0000 7f6a93e00700 1 --2- 172.21.15.69:0/4232800044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a941045f0 0x7f6a9419ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.445+0000 7f6a98a00700 1 --2- 172.21.15.69:0/4232800044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a94109870 0x7f6a9419f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.445+0000 7f6a93400700 1 -- 172.21.15.69:0/4232800044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a941045f0 msgr2=0x7f6a9419ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:06.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.445+0000 7f6a93400700 1 --2- 172.21.15.69:0/4232800044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a941045f0 0x7f6a9419ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.445+0000 7f6a93400700 1 -- 172.21.15.69:0/4232800044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a94109870 msgr2=0x7f6a9419f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:06.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.445+0000 7f6a93400700 1 --2- 172.21.15.69:0/4232800044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a94109870 0x7f6a9419f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.445+0000 7f6a93400700 1 -- 172.21.15.69:0/4232800044 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a9419fc50 con 0x7f6a94108f20 2024-05-14T15:25:06.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.446+0000 7f6a93400700 1 --2- 172.21.15.69:0/4232800044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a94108f20 0x7f6a9419b320 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000d950 tx=0x7f6a8000dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:06.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.446+0000 7f6a90c00700 1 -- 172.21.15.69:0/4232800044 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a80017070 con 0x7f6a94108f20 2024-05-14T15:25:06.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.446+0000 7f6a90c00700 1 -- 172.21.15.69:0/4232800044 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a80005020 con 0x7f6a94108f20 2024-05-14T15:25:06.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.446+0000 7f6a90c00700 1 -- 172.21.15.69:0/4232800044 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8000f980 con 0x7f6a94108f20 2024-05-14T15:25:06.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.446+0000 7f6a9aa00700 1 -- 172.21.15.69:0/4232800044 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a9419ff40 con 0x7f6a94108f20 2024-05-14T15:25:06.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.447+0000 7f6a9aa00700 1 -- 172.21.15.69:0/4232800044 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a941a7860 con 0x7f6a94108f20 2024-05-14T15:25:06.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.451+0000 7f6a90c00700 1 -- 172.21.15.69:0/4232800044 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6a80004a30 con 0x7f6a94108f20 2024-05-14T15:25:06.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.452+0000 7f6a90c00700 1 --2- 172.21.15.69:0/4232800044 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6a780b2b40 0x7f6a780b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.453+0000 7f6a90c00700 1 -- 172.21.15.69:0/4232800044 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f6a800e2060 con 0x7f6a94108f20 2024-05-14T15:25:06.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.453+0000 7f6a93e00700 1 --2- 172.21.15.69:0/4232800044 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6a780b2b40 0x7f6a780b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.453+0000 7f6aa954db80 1 Processor -- start 2024-05-14T15:25:06.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.453+0000 7f6aa954db80 1 -- start start 2024-05-14T15:25:06.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.454+0000 7f6a93e00700 1 --2- 172.21.15.69:0/4232800044 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6a780b2b40 0x7f6a780b5050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6a840058e0 tx=0x7f6a84005fb0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:06.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.454+0000 7f6aa954db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55868139ee40 0x558681526310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.454+0000 7f6aa954db80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558681526850 0x558681526c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.454+0000 7f6aa954db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868152f380 0x5586815317a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.454+0000 7f6aa954db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55868143ea20 con 0x55868152f380 2024-05-14T15:25:06.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.454+0000 7f6aa954db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5586813dc760 con 0x55868139ee40 2024-05-14T15:25:06.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.454+0000 7f6aa954db80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55868143a9e0 con 0x558681526850 2024-05-14T15:25:06.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.454+0000 7f6a98a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868152f380 0x5586815317a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.454+0000 7f6a98a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868152f380 0x5586815317a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54864/0 (socket says 172.21.15.69:54864) 2024-05-14T15:25:06.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.454+0000 7f6a98a00700 1 -- 172.21.15.69:0/737916627 learned_addr learned my addr 172.21.15.69:0/737916627 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:06.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.455+0000 7f6a93400700 1 --2- 172.21.15.69:0/737916627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558681526850 0x558681526c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.455+0000 7f6a93e00700 1 --2- 172.21.15.69:0/737916627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55868139ee40 0x558681526310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.455+0000 7f6a98a00700 1 -- 172.21.15.69:0/737916627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558681526850 msgr2=0x558681526c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:06.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.455+0000 7f6a98a00700 1 --2- 172.21.15.69:0/737916627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558681526850 0x558681526c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.455+0000 7f6a98a00700 1 -- 172.21.15.69:0/737916627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55868139ee40 msgr2=0x558681526310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:06.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.455+0000 7f6a98a00700 1 --2- 172.21.15.69:0/737916627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55868139ee40 0x558681526310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.455+0000 7f6a98a00700 1 -- 172.21.15.69:0/737916627 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55868138b8d0 con 0x55868152f380 2024-05-14T15:25:06.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.455+0000 7f6a93400700 1 --2- 172.21.15.69:0/737916627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558681526850 0x558681526c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:25:06.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.455+0000 7f6a98a00700 1 --2- 172.21.15.69:0/737916627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868152f380 0x5586815317a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c003fa0 tx=0x7f6a8c009ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1279e43bb736f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:06.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.456+0000 7f6a89600700 1 -- 172.21.15.69:0/737916627 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c004bb0 con 0x55868152f380 2024-05-14T15:25:06.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.456+0000 7f6a89600700 1 -- 172.21.15.69:0/737916627 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a8c004d50 con 0x55868152f380 2024-05-14T15:25:06.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.456+0000 7f6a89600700 1 -- 172.21.15.69:0/737916627 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c007cc0 con 0x55868152f380 2024-05-14T15:25:06.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.457+0000 7f6aa954db80 1 -- 172.21.15.69:0/737916627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868152f380 msgr2=0x5586815317a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:06.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.457+0000 7f6aa954db80 1 --2- 172.21.15.69:0/737916627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868152f380 0x5586815317a0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c003fa0 tx=0x7f6a8c009ba0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.457+0000 7f6aa954db80 1 -- 172.21.15.69:0/737916627 shutdown_connections 2024-05-14T15:25:06.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.457+0000 7f6aa954db80 1 --2- 172.21.15.69:0/737916627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868152f380 0x5586815317a0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.457+0000 7f6aa954db80 1 --2- 172.21.15.69:0/737916627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55868139ee40 0x558681526310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.457+0000 7f6aa954db80 1 --2- 172.21.15.69:0/737916627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558681526850 0x558681526c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.457+0000 7f6aa954db80 1 -- 172.21.15.69:0/737916627 >> 172.21.15.69:0/737916627 conn(0x5586813dda80 msgr2=0x558681517a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:06.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.457+0000 7f6aa954db80 1 -- 172.21.15.69:0/737916627 shutdown_connections 2024-05-14T15:25:06.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.457+0000 7f6aa954db80 1 -- 172.21.15.69:0/737916627 wait complete. 2024-05-14T15:25:06.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.458+0000 7f6aa954db80 1 -- start start 2024-05-14T15:25:06.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.458+0000 7f6aa954db80 1 Processor -- start 2024-05-14T15:25:06.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.459+0000 7f6aa954db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868139ee40 0x55868152c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.459+0000 7f6aa954db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558681526850 0x55868152c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.459+0000 7f6aa954db80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55868152f380 0x55868152cd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.459+0000 7f6aa954db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x558681531e90 con 0x55868139ee40 2024-05-14T15:25:06.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.459+0000 7f6aa954db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5586813a4b20 con 0x558681526850 2024-05-14T15:25:06.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.459+0000 7f6aa954db80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558681532010 con 0x55868152f380 2024-05-14T15:25:06.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.459+0000 7f6aa954db80 10 client.0 _ll_register_callbacks cb 0x5586813d2380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:06.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.459+0000 7f6a93e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868139ee40 0x55868152c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.459+0000 7f6a93e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868139ee40 0x55868152c310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54874/0 (socket says 172.21.15.69:54874) 2024-05-14T15:25:06.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.459+0000 7f6a93e00700 1 -- 172.21.15.69:0/3024021847 learned_addr learned my addr 172.21.15.69:0/3024021847 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:06.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.460+0000 7f6a93400700 1 --2- 172.21.15.69:0/3024021847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558681526850 0x55868152c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.460+0000 7f6a98a00700 1 --2- 172.21.15.69:0/3024021847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55868152f380 0x55868152cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.460+0000 7f6a93e00700 1 -- 172.21.15.69:0/3024021847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55868152f380 msgr2=0x55868152cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:06.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.460+0000 7f6a93e00700 1 --2- 172.21.15.69:0/3024021847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55868152f380 0x55868152cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.460+0000 7f6a93e00700 1 -- 172.21.15.69:0/3024021847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558681526850 msgr2=0x55868152c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:06.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.460+0000 7f6a93e00700 1 --2- 172.21.15.69:0/3024021847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558681526850 0x55868152c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.460+0000 7f6a93e00700 1 -- 172.21.15.69:0/3024021847 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558681404420 con 0x55868139ee40 2024-05-14T15:25:06.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.460+0000 7f6a93e00700 1 --2- 172.21.15.69:0/3024021847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868139ee40 0x55868152c310 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6a840099c0 tx=0x7f6a84009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffa8395b7bfe3f53 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:06.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.460+0000 7f6a7e000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:06.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.461+0000 7f6a7e000700 1 -- 172.21.15.69:0/3024021847 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a84034060 con 0x55868139ee40 2024-05-14T15:25:06.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.461+0000 7f6a7e000700 1 -- 172.21.15.69:0/3024021847 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f6a8400f460 con 0x55868139ee40 2024-05-14T15:25:06.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.461+0000 7f6aa954db80 1 -- 172.21.15.69:0/3024021847 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a8c004d50 con 0x55868139ee40 2024-05-14T15:25:06.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.461+0000 7f6a7e000700 1 -- 172.21.15.69:0/3024021847 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6a84003e70 con 0x55868139ee40 2024-05-14T15:25:06.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.461+0000 7f6aa954db80 10 client.16119 fetch_fsmap learned FSMap version 36 2024-05-14T15:25:06.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.461+0000 7f6aa954db80 1 -- 172.21.15.69:0/3024021847 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55868153cac0 con 0x55868139ee40 2024-05-14T15:25:06.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.462+0000 7f6a7e000700 1 -- 172.21.15.69:0/3024021847 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a8c004d50 con 0x55868139ee40 2024-05-14T15:25:06.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.462+0000 7f6a7e000700 1 -- 172.21.15.69:0/3024021847 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 36) ==== 8390+0+0 (secure 0 0 0) 0x7f6a8402e070 con 0x55868139ee40 2024-05-14T15:25:06.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.462+0000 7f6aa954db80 10 client.16119 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T15:25:06.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.462+0000 7f6aa954db80 10 client.16119 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-05-14T15:25:06.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.462+0000 7f6aa954db80 20 client.16119 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:06.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.462+0000 7f6aa954db80 1 --2- 172.21.15.69:0/3024021847 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55868153f050 0x5586815414f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.462+0000 7f6aa954db80 4 client.16119 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:25:06.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.462+0000 7f6aa954db80 1 -- 172.21.15.69:0/3024021847 --> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586814e9070 con 0x55868153f050 2024-05-14T15:25:06.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.463+0000 7f6a93400700 1 --2- 172.21.15.69:0/3024021847 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55868153f050 0x5586815414f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.464+0000 7f6a93400700 1 --2- 172.21.15.69:0/3024021847 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55868153f050 0x5586815414f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=d37d21fb2a92acfa server_cookie=bf9f81f0839cb46a in_seq=0 out_seq=0 2024-05-14T15:25:06.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.464+0000 7f6a7e000700 10 client.16119 ms_handle_connect on v2:172.21.15.92:6832/1997000798 2024-05-14T15:25:06.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.466+0000 7f6a7e000700 1 -- 172.21.15.69:0/3024021847 <== mds.3 v2:172.21.15.92:6832/1997000798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5586814e9070 con 0x55868153f050 2024-05-14T15:25:06.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.466+0000 7f6a7e000700 10 client.16119 handle_command_reply: tid=0 2024-05-14T15:25:06.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.466+0000 7f6aa954db80 1 client.16119 shutdown 2024-05-14T15:25:06.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.466+0000 7f6aa954db80 1 -- 172.21.15.69:0/3024021847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868139ee40 msgr2=0x55868152c310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:06.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.466+0000 7f6aa954db80 1 --2- 172.21.15.69:0/3024021847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868139ee40 0x55868152c310 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6a840099c0 tx=0x7f6a84009cd0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.467+0000 7f6aa954db80 1 -- 172.21.15.69:0/3024021847 shutdown_connections 2024-05-14T15:25:06.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.467+0000 7f6aa954db80 1 --2- 172.21.15.69:0/3024021847 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55868153f050 0x5586815414f0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.467+0000 7f6aa954db80 1 --2- 172.21.15.69:0/3024021847 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868139ee40 0x55868152c310 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.467+0000 7f6aa954db80 1 --2- 172.21.15.69:0/3024021847 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55868152f380 0x55868152cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.467+0000 7f6aa954db80 1 --2- 172.21.15.69:0/3024021847 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558681526850 0x55868152c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.467+0000 7f6a7e000700 0 client.16119 ms_handle_reset on v2:172.21.15.92:6832/1997000798 2024-05-14T15:25:06.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.467+0000 7f6aa954db80 1 -- 172.21.15.69:0/3024021847 >> 172.21.15.69:0/3024021847 conn(0x5586813dda80 msgr2=0x5586815196f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:06.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.467+0000 7f6aa954db80 1 -- 172.21.15.69:0/3024021847 shutdown_connections 2024-05-14T15:25:06.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.467+0000 7f6aa954db80 1 -- 172.21.15.69:0/3024021847 wait complete. 2024-05-14T15:25:06.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.467+0000 7f6aa954db80 20 client.16119 trim_cache size 0 max 16384 2024-05-14T15:25:06.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.486+0000 7f6aa954db80 1 Processor -- start 2024-05-14T15:25:06.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.487+0000 7f6aa954db80 1 -- start start 2024-05-14T15:25:06.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.487+0000 7f6aa954db80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55868139ee40 0x55868152cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.487+0000 7f6aa954db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558681526850 0x55868152bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.487+0000 7f6aa954db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868152f380 0x55868153af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.487+0000 7f6aa954db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6a941ae260 con 0x55868152f380 2024-05-14T15:25:06.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.487+0000 7f6aa954db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6a941afef0 con 0x558681526850 2024-05-14T15:25:06.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.487+0000 7f6aa954db80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a941ae930 con 0x55868139ee40 2024-05-14T15:25:06.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.488+0000 7f6a98a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868152f380 0x55868153af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.488+0000 7f6a98a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868152f380 0x55868153af20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54886/0 (socket says 172.21.15.69:54886) 2024-05-14T15:25:06.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.488+0000 7f6a98a00700 1 -- 172.21.15.69:0/1488581213 learned_addr learned my addr 172.21.15.69:0/1488581213 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:06.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.488+0000 7f6a93e00700 1 --2- 172.21.15.69:0/1488581213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55868139ee40 0x55868152cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.488+0000 7f6a93400700 1 --2- 172.21.15.69:0/1488581213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558681526850 0x55868152bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.488+0000 7f6a98a00700 1 -- 172.21.15.69:0/1488581213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55868139ee40 msgr2=0x55868152cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:06.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.488+0000 7f6a98a00700 1 --2- 172.21.15.69:0/1488581213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55868139ee40 0x55868152cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.488+0000 7f6a98a00700 1 -- 172.21.15.69:0/1488581213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558681526850 msgr2=0x55868152bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:06.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.488+0000 7f6a98a00700 1 --2- 172.21.15.69:0/1488581213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558681526850 0x55868152bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.488+0000 7f6a98a00700 1 -- 172.21.15.69:0/1488581213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55868151c480 con 0x55868152f380 2024-05-14T15:25:06.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.489+0000 7f6a98a00700 1 --2- 172.21.15.69:0/1488581213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868152f380 0x55868153af20 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c003f40 tx=0x7f6a8c005500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e738d5ecec0d820 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:06.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.489+0000 7f6a88c00700 1 -- 172.21.15.69:0/1488581213 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c0056f0 con 0x55868152f380 2024-05-14T15:25:06.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.489+0000 7f6a88c00700 1 -- 172.21.15.69:0/1488581213 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a8c005890 con 0x55868152f380 2024-05-14T15:25:06.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.489+0000 7f6a88c00700 1 -- 172.21.15.69:0/1488581213 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a8c015800 con 0x55868152f380 2024-05-14T15:25:06.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.490+0000 7f6aa954db80 1 -- 172.21.15.69:0/1488581213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868152f380 msgr2=0x55868153af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:06.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.490+0000 7f6aa954db80 1 --2- 172.21.15.69:0/1488581213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868152f380 0x55868153af20 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7f6a8c003f40 tx=0x7f6a8c005500 comp rx=0 tx=0).stop 2024-05-14T15:25:06.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.490+0000 7f6aa954db80 1 -- 172.21.15.69:0/1488581213 shutdown_connections 2024-05-14T15:25:06.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.490+0000 7f6aa954db80 1 --2- 172.21.15.69:0/1488581213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55868152f380 0x55868153af20 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.490+0000 7f6aa954db80 1 --2- 172.21.15.69:0/1488581213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55868139ee40 0x55868152cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.490+0000 7f6aa954db80 1 --2- 172.21.15.69:0/1488581213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558681526850 0x55868152bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.490+0000 7f6aa954db80 1 -- 172.21.15.69:0/1488581213 >> 172.21.15.69:0/1488581213 conn(0x5586813dda80 msgr2=0x55868151bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:06.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.490+0000 7f6aa954db80 1 -- 172.21.15.69:0/1488581213 shutdown_connections 2024-05-14T15:25:06.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.490+0000 7f6aa954db80 1 -- 172.21.15.69:0/1488581213 wait complete. 2024-05-14T15:25:06.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.491+0000 7f6aa954db80 1 -- start start 2024-05-14T15:25:06.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.491+0000 7f6aa954db80 1 Processor -- start 2024-05-14T15:25:06.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.492+0000 7f6aa954db80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55868139ee40 0x5586815376e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.492+0000 7f6aa954db80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558681526850 0x558681532a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.492+0000 7f6aa954db80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55868152f380 0x558681532fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.492+0000 7f6aa954db80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6a941af760 con 0x558681526850 2024-05-14T15:25:06.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.492+0000 7f6aa954db80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6a941af000 con 0x55868152f380 2024-05-14T15:25:06.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.492+0000 7f6aa954db80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6a941ac200 con 0x55868139ee40 2024-05-14T15:25:06.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.492+0000 7f6aa954db80 10 client.0 _ll_register_callbacks cb 0x5586813d2380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:06.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.492+0000 7f6a93400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558681526850 0x558681532a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.492+0000 7f6a93400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558681526850 0x558681532a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54900/0 (socket says 172.21.15.69:54900) 2024-05-14T15:25:06.493 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.492+0000 7f6a93400700 1 -- 172.21.15.69:0/3807705681 learned_addr learned my addr 172.21.15.69:0/3807705681 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:06.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.492+0000 7f6a93e00700 1 --2- 172.21.15.69:0/3807705681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55868139ee40 0x5586815376e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.493+0000 7f6a98a00700 1 --2- 172.21.15.69:0/3807705681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55868152f380 0x558681532fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.493+0000 7f6a93400700 1 -- 172.21.15.69:0/3807705681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55868139ee40 msgr2=0x5586815376e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:06.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.493+0000 7f6a93400700 1 --2- 172.21.15.69:0/3807705681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55868139ee40 0x5586815376e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.493+0000 7f6a93400700 1 -- 172.21.15.69:0/3807705681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55868152f380 msgr2=0x558681532fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:06.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.493+0000 7f6a93400700 1 --2- 172.21.15.69:0/3807705681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55868152f380 0x558681532fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.493+0000 7f6a93400700 1 -- 172.21.15.69:0/3807705681 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558681533610 con 0x558681526850 2024-05-14T15:25:06.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.493+0000 7f6a93400700 1 --2- 172.21.15.69:0/3807705681 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558681526850 0x558681532a90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6a800df460 tx=0x7f6a8000b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8fffb1457b9510 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:06.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.493+0000 7f6a7e000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:06.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.494+0000 7f6a7e000700 1 -- 172.21.15.69:0/3807705681 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a80020040 con 0x558681526850 2024-05-14T15:25:06.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.494+0000 7f6a7e000700 1 -- 172.21.15.69:0/3807705681 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f6a800a91f0 con 0x558681526850 2024-05-14T15:25:06.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.494+0000 7f6aa954db80 1 -- 172.21.15.69:0/3807705681 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6a8c005890 con 0x558681526850 2024-05-14T15:25:06.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.494+0000 7f6a7e000700 1 -- 172.21.15.69:0/3807705681 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6a800a93f0 con 0x558681526850 2024-05-14T15:25:06.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.494+0000 7f6aa954db80 10 client.16125 fetch_fsmap learned FSMap version 36 2024-05-14T15:25:06.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.494+0000 7f6aa954db80 1 -- 172.21.15.69:0/3807705681 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5586815a9690 con 0x558681526850 2024-05-14T15:25:06.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.494+0000 7f6a7e000700 1 -- 172.21.15.69:0/3807705681 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6a8c005890 con 0x558681526850 2024-05-14T15:25:06.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.495+0000 7f6a7e000700 1 -- 172.21.15.69:0/3807705681 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 36) ==== 8390+0+0 (secure 0 0 0) 0x7f6a800b8ce0 con 0x558681526850 2024-05-14T15:25:06.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.495+0000 7f6aa954db80 10 client.16125 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T15:25:06.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.495+0000 7f6aa954db80 10 client.16125 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-05-14T15:25:06.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.495+0000 7f6aa954db80 20 client.16125 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:06.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.495+0000 7f6aa954db80 1 --2- 172.21.15.69:0/3807705681 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x5586815a9e20 0x5586815ac240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:06.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.495+0000 7f6aa954db80 4 client.16125 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:25:06.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.495+0000 7f6aa954db80 1 -- 172.21.15.69:0/3807705681 --> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55868144c400 con 0x5586815a9e20 2024-05-14T15:25:06.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.496+0000 7f6a93e00700 1 --2- 172.21.15.69:0/3807705681 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x5586815a9e20 0x5586815ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:06.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.496+0000 7f6a93e00700 1 --2- 172.21.15.69:0/3807705681 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x5586815a9e20 0x5586815ac240 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=a889eb2d4b38bc13 server_cookie=70735ef18af0c1e6 in_seq=0 out_seq=0 2024-05-14T15:25:06.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.496+0000 7f6a7e000700 10 client.16125 ms_handle_connect on v2:172.21.15.92:6832/1997000798 2024-05-14T15:25:06.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.498+0000 7f6a7e000700 1 -- 172.21.15.69:0/3807705681 <== mds.3 v2:172.21.15.92:6832/1997000798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55868144c400 con 0x5586815a9e20 2024-05-14T15:25:06.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.498+0000 7f6a7e000700 10 client.16125 handle_command_reply: tid=0 2024-05-14T15:25:06.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.498+0000 7f6aa954db80 1 client.16125 shutdown 2024-05-14T15:25:06.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.498+0000 7f6aa954db80 1 -- 172.21.15.69:0/3807705681 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558681526850 msgr2=0x558681532a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:06.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.498+0000 7f6aa954db80 1 --2- 172.21.15.69:0/3807705681 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558681526850 0x558681532a90 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f6a800df460 tx=0x7f6a8000b510 comp rx=0 tx=0).stop 2024-05-14T15:25:06.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.498+0000 7f6aa954db80 1 -- 172.21.15.69:0/3807705681 shutdown_connections 2024-05-14T15:25:06.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.498+0000 7f6aa954db80 1 --2- 172.21.15.69:0/3807705681 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x5586815a9e20 0x5586815ac240 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.498+0000 7f6aa954db80 1 --2- 172.21.15.69:0/3807705681 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55868152f380 0x558681532fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.498+0000 7f6aa954db80 1 --2- 172.21.15.69:0/3807705681 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55868139ee40 0x5586815376e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.498+0000 7f6a7e000700 0 client.16125 ms_handle_reset on v2:172.21.15.92:6832/1997000798 2024-05-14T15:25:06.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.498+0000 7f6aa954db80 1 --2- 172.21.15.69:0/3807705681 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558681526850 0x558681532a90 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.498+0000 7f6aa954db80 1 -- 172.21.15.69:0/3807705681 >> 172.21.15.69:0/3807705681 conn(0x5586813dda80 msgr2=0x55868151bd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:06.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.499+0000 7f6aa954db80 1 -- 172.21.15.69:0/3807705681 shutdown_connections 2024-05-14T15:25:06.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.499+0000 7f6aa954db80 1 -- 172.21.15.69:0/3807705681 wait complete. 2024-05-14T15:25:06.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.499+0000 7f6aa954db80 20 client.16125 trim_cache size 0 max 16384 2024-05-14T15:25:06.500 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:25:06.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.500+0000 7f6a9aa00700 1 -- 172.21.15.69:0/4232800044 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6a780b2b40 msgr2=0x7f6a780b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:06.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.500+0000 7f6a9aa00700 1 --2- 172.21.15.69:0/4232800044 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6a780b2b40 0x7f6a780b5050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6a840058e0 tx=0x7f6a84005fb0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.500+0000 7f6a9aa00700 1 -- 172.21.15.69:0/4232800044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a94108f20 msgr2=0x7f6a9419b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:06.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.500+0000 7f6a9aa00700 1 --2- 172.21.15.69:0/4232800044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a94108f20 0x7f6a9419b320 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6a8000d950 tx=0x7f6a8000dc60 comp rx=0 tx=0).stop 2024-05-14T15:25:06.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.500+0000 7f6a9aa00700 1 -- 172.21.15.69:0/4232800044 shutdown_connections 2024-05-14T15:25:06.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.500+0000 7f6a9aa00700 1 --2- 172.21.15.69:0/4232800044 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6a780b2b40 0x7f6a780b5050 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.500+0000 7f6a9aa00700 1 --2- 172.21.15.69:0/4232800044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6a94109870 0x7f6a9419f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.500+0000 7f6a9aa00700 1 --2- 172.21.15.69:0/4232800044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6a941045f0 0x7f6a9419ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.500+0000 7f6a9aa00700 1 --2- 172.21.15.69:0/4232800044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6a94108f20 0x7f6a9419b320 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:06.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.500+0000 7f6a9aa00700 1 -- 172.21.15.69:0/4232800044 >> 172.21.15.69:0/4232800044 conn(0x7f6a94100040 msgr2=0x7f6a94102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:06.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.500+0000 7f6a9aa00700 1 -- 172.21.15.69:0/4232800044 shutdown_connections 2024-05-14T15:25:06.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:06.500+0000 7f6a9aa00700 1 -- 172.21.15.69:0/4232800044 wait complete. 2024-05-14T15:25:07.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:07 smithi069 ceph-mon[31270]: pgmap v107: 129 pgs: 129 active+clean; 952 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 43 op/s 2024-05-14T15:25:07.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:07 smithi092 ceph-mon[34729]: pgmap v107: 129 pgs: 129 active+clean; 952 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 43 op/s 2024-05-14T15:25:07.485 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-14T15:25:07.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:07 smithi203 ceph-mon[34567]: pgmap v107: 129 pgs: 129 active+clean; 952 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 43 op/s 2024-05-14T15:25:07.959 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:25:09.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:09 smithi092 ceph-mon[34729]: pgmap v108: 129 pgs: 129 active+clean; 952 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 43 op/s 2024-05-14T15:25:09.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:09 smithi069 ceph-mon[31270]: pgmap v108: 129 pgs: 129 active+clean; 952 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 43 op/s 2024-05-14T15:25:09.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:09 smithi203 ceph-mon[34567]: pgmap v108: 129 pgs: 129 active+clean; 952 MiB data, 2.3 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 12 MiB/s wr, 43 op/s 2024-05-14T15:25:11.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:11 smithi092 ceph-mon[34729]: pgmap v109: 129 pgs: 129 active+clean; 1016 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 17 MiB/s wr, 54 op/s 2024-05-14T15:25:11.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:11 smithi069 ceph-mon[31270]: pgmap v109: 129 pgs: 129 active+clean; 1016 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 17 MiB/s wr, 54 op/s 2024-05-14T15:25:11.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.559+0000 7f2412c00700 1 -- 172.21.15.69:0/2634502540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f240c109870 msgr2=0x7f240c1111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:11.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.559+0000 7f2412c00700 1 --2- 172.21.15.69:0/2634502540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f240c109870 0x7f240c1111d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f240400b0d0 tx=0x7f240400b3e0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.559+0000 7f2412c00700 1 -- 172.21.15.69:0/2634502540 shutdown_connections 2024-05-14T15:25:11.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.559+0000 7f2412c00700 1 --2- 172.21.15.69:0/2634502540 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f240c109870 0x7f240c1111d0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.559+0000 7f2412c00700 1 --2- 172.21.15.69:0/2634502540 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f240c1045f0 0x7f240c104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.559+0000 7f2412c00700 1 --2- 172.21.15.69:0/2634502540 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f240c108f20 0x7f240c109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.559+0000 7f2412c00700 1 -- 172.21.15.69:0/2634502540 >> 172.21.15.69:0/2634502540 conn(0x7f240c100040 msgr2=0x7f240c102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:11.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.559+0000 7f2412c00700 1 -- 172.21.15.69:0/2634502540 shutdown_connections 2024-05-14T15:25:11.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.559+0000 7f2412c00700 1 -- 172.21.15.69:0/2634502540 wait complete. 2024-05-14T15:25:11.561 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.561+0000 7f2412c00700 1 Processor -- start 2024-05-14T15:25:11.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.561+0000 7f2412c00700 1 -- start start 2024-05-14T15:25:11.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.561+0000 7f2412c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f240c1045f0 0x7f240c19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.561+0000 7f2412c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f240c108f20 0x7f240c19d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.561+0000 7f2412c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f240c109870 0x7f240c1a1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.561+0000 7f2412c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f240c114350 con 0x7f240c1045f0 2024-05-14T15:25:11.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.561+0000 7f2412c00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f240c1141d0 con 0x7f240c108f20 2024-05-14T15:25:11.562 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.561+0000 7f2412c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f240c1144d0 con 0x7f240c109870 2024-05-14T15:25:11.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.562+0000 7f240be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f240c1045f0 0x7f240c19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.563 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.562+0000 7f240be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f240c1045f0 0x7f240c19cf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54920/0 (socket says 172.21.15.69:54920) 2024-05-14T15:25:11.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.562+0000 7f240be00700 1 -- 172.21.15.69:0/57340999 learned_addr learned my addr 172.21.15.69:0/57340999 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:11.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.562+0000 7f240b400700 1 --2- 172.21.15.69:0/57340999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f240c108f20 0x7f240c19d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.562+0000 7f240be00700 1 -- 172.21.15.69:0/57340999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f240c109870 msgr2=0x7f240c1a1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:11.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.562+0000 7f240be00700 1 --2- 172.21.15.69:0/57340999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f240c109870 0x7f240c1a1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.562+0000 7f240be00700 1 -- 172.21.15.69:0/57340999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f240c108f20 msgr2=0x7f240c19d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:11.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.562+0000 7f240be00700 1 --2- 172.21.15.69:0/57340999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f240c108f20 0x7f240c19d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.562+0000 7f240be00700 1 -- 172.21.15.69:0/57340999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240c1a1dc0 con 0x7f240c1045f0 2024-05-14T15:25:11.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.563+0000 7f240be00700 1 --2- 172.21.15.69:0/57340999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f240c1045f0 0x7f240c19cf40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00d950 tx=0x7f23fc00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:11.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.563+0000 7f2408c00700 1 -- 172.21.15.69:0/57340999 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc016070 con 0x7f240c1045f0 2024-05-14T15:25:11.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.563+0000 7f2412c00700 1 -- 172.21.15.69:0/57340999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240c1a20b0 con 0x7f240c1045f0 2024-05-14T15:25:11.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.563+0000 7f2408c00700 1 -- 172.21.15.69:0/57340999 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23fc010460 con 0x7f240c1045f0 2024-05-14T15:25:11.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.563+0000 7f2408c00700 1 -- 172.21.15.69:0/57340999 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc00f620 con 0x7f240c1045f0 2024-05-14T15:25:11.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.563+0000 7f2412c00700 1 -- 172.21.15.69:0/57340999 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f240c1a99d0 con 0x7f240c1045f0 2024-05-14T15:25:11.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.569+0000 7f2408c00700 1 -- 172.21.15.69:0/57340999 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f23fc019070 con 0x7f240c1045f0 2024-05-14T15:25:11.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.570+0000 7f242164ab80 1 Processor -- start 2024-05-14T15:25:11.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.570+0000 7f242164ab80 1 -- start start 2024-05-14T15:25:11.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.571+0000 7f242164ab80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda3c1e40 0x55aeda5456b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.571+0000 7f242164ab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda545bf0 0x55aeda53f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.571+0000 7f2408c00700 1 --2- 172.21.15.69:0/57340999 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f23f00b2a70 0x7f23f00b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.571+0000 7f242164ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda53fc50 0x55aeda540060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.571+0000 7f242164ab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55aeda461a20 con 0x55aeda545bf0 2024-05-14T15:25:11.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.571+0000 7f242164ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aeda3ff760 con 0x55aeda53fc50 2024-05-14T15:25:11.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.571+0000 7f242164ab80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55aeda45d9e0 con 0x55aeda3c1e40 2024-05-14T15:25:11.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.571+0000 7f240be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda545bf0 0x55aeda53f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.571+0000 7f240be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda545bf0 0x55aeda53f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54924/0 (socket says 172.21.15.69:54924) 2024-05-14T15:25:11.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.571+0000 7f240be00700 1 -- 172.21.15.69:0/3685130130 learned_addr learned my addr 172.21.15.69:0/3685130130 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:11.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.571+0000 7f240b400700 1 --2- 172.21.15.69:0/57340999 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f23f00b2a70 0x7f23f00b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.571+0000 7f2410c00700 1 --2- 172.21.15.69:0/3685130130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda3c1e40 0x55aeda5456b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.572+0000 7f2410c00700 1 --2- 172.21.15.69:0/3685130130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda53fc50 0x55aeda540060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.572+0000 7f2408c00700 1 -- 172.21.15.69:0/57340999 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f23fc0e2590 con 0x7f240c1045f0 2024-05-14T15:25:11.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.572+0000 7f240be00700 1 -- 172.21.15.69:0/3685130130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda3c1e40 msgr2=0x55aeda5456b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:11.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.572+0000 7f240be00700 1 --2- 172.21.15.69:0/3685130130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda3c1e40 0x55aeda5456b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.572+0000 7f240be00700 1 -- 172.21.15.69:0/3685130130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda53fc50 msgr2=0x55aeda540060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:11.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.572+0000 7f240be00700 1 --2- 172.21.15.69:0/3685130130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda53fc50 0x55aeda540060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.572+0000 7f240be00700 1 -- 172.21.15.69:0/3685130130 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aeda3ae8d0 con 0x55aeda545bf0 2024-05-14T15:25:11.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.572+0000 7f240be00700 1 --2- 172.21.15.69:0/3685130130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda545bf0 0x55aeda53f710 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0a5540 tx=0x7f23fc012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775c94eee0fb1cc4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:11.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.572+0000 7f2401600700 1 -- 172.21.15.69:0/3685130130 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc020070 con 0x55aeda545bf0 2024-05-14T15:25:11.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.573+0000 7f2401600700 1 -- 172.21.15.69:0/3685130130 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23fc0a94c0 con 0x55aeda545bf0 2024-05-14T15:25:11.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.573+0000 7f2401600700 1 -- 172.21.15.69:0/3685130130 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23fc010ac0 con 0x55aeda545bf0 2024-05-14T15:25:11.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.574+0000 7f242164ab80 1 -- 172.21.15.69:0/3685130130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda545bf0 msgr2=0x55aeda53f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:11.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.574+0000 7f242164ab80 1 --2- 172.21.15.69:0/3685130130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda545bf0 0x55aeda53f710 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f23fc0a5540 tx=0x7f23fc012000 comp rx=0 tx=0).stop 2024-05-14T15:25:11.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.574+0000 7f240b400700 1 --2- 172.21.15.69:0/57340999 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f23f00b2a70 0x7f23f00b4f80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f23f8005fd0 tx=0x7f23f8005db0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:11.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.574+0000 7f242164ab80 1 -- 172.21.15.69:0/3685130130 shutdown_connections 2024-05-14T15:25:11.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.574+0000 7f242164ab80 1 --2- 172.21.15.69:0/3685130130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda53fc50 0x55aeda540060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.574+0000 7f242164ab80 1 --2- 172.21.15.69:0/3685130130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda3c1e40 0x55aeda5456b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.574+0000 7f242164ab80 1 --2- 172.21.15.69:0/3685130130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda545bf0 0x55aeda53f710 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.574+0000 7f242164ab80 1 -- 172.21.15.69:0/3685130130 >> 172.21.15.69:0/3685130130 conn(0x55aeda400a80 msgr2=0x55aeda53a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:11.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.574+0000 7f242164ab80 1 -- 172.21.15.69:0/3685130130 shutdown_connections 2024-05-14T15:25:11.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.574+0000 7f242164ab80 1 -- 172.21.15.69:0/3685130130 wait complete. 2024-05-14T15:25:11.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.575+0000 7f242164ab80 1 -- start start 2024-05-14T15:25:11.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.575+0000 7f242164ab80 1 Processor -- start 2024-05-14T15:25:11.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.576+0000 7f242164ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda3c1e40 0x55aeda5493d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.576+0000 7f242164ab80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda53fc50 0x55aeda549910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.576+0000 7f242164ab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda545bf0 0x55aeda549e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.576+0000 7f242164ab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55aeda54c600 con 0x55aeda545bf0 2024-05-14T15:25:11.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.576+0000 7f242164ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55aeda3c7b20 con 0x55aeda3c1e40 2024-05-14T15:25:11.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.576+0000 7f242164ab80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55aeda54c780 con 0x55aeda53fc50 2024-05-14T15:25:11.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.576+0000 7f242164ab80 10 client.0 _ll_register_callbacks cb 0x55aeda3f5380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:11.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.576+0000 7f2410c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda545bf0 0x55aeda549e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.576+0000 7f2410c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda545bf0 0x55aeda549e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54936/0 (socket says 172.21.15.69:54936) 2024-05-14T15:25:11.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.576+0000 7f2410c00700 1 -- 172.21.15.69:0/1879466636 learned_addr learned my addr 172.21.15.69:0/1879466636 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:11.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.576+0000 7f240be00700 1 --2- 172.21.15.69:0/1879466636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda3c1e40 0x55aeda5493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.577+0000 7f240b400700 1 --2- 172.21.15.69:0/1879466636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda53fc50 0x55aeda549910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.577+0000 7f2410c00700 1 -- 172.21.15.69:0/1879466636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda53fc50 msgr2=0x55aeda549910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:11.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.577+0000 7f2410c00700 1 --2- 172.21.15.69:0/1879466636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda53fc50 0x55aeda549910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.577+0000 7f2410c00700 1 -- 172.21.15.69:0/1879466636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda3c1e40 msgr2=0x55aeda5493d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:11.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.577+0000 7f2410c00700 1 --2- 172.21.15.69:0/1879466636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda3c1e40 0x55aeda5493d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.577+0000 7f2410c00700 1 -- 172.21.15.69:0/1879466636 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aeda427420 con 0x55aeda545bf0 2024-05-14T15:25:11.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.577+0000 7f240be00700 1 --2- 172.21.15.69:0/1879466636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda3c1e40 0x55aeda5493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:25:11.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.577+0000 7f2410c00700 1 --2- 172.21.15.69:0/1879466636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda545bf0 0x55aeda549e50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2404015000 tx=0x7f24040094d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1710790298af9b88 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:11.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.577+0000 7f23f6000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.578+0000 7f23f6000700 1 -- 172.21.15.69:0/1879466636 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2404024070 con 0x55aeda545bf0 2024-05-14T15:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.578+0000 7f23f6000700 1 -- 172.21.15.69:0/1879466636 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f24040075c0 con 0x55aeda545bf0 2024-05-14T15:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.578+0000 7f242164ab80 1 -- 172.21.15.69:0/1879466636 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23fc0a94c0 con 0x55aeda545bf0 2024-05-14T15:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.578+0000 7f23f6000700 1 -- 172.21.15.69:0/1879466636 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f240402f050 con 0x55aeda545bf0 2024-05-14T15:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.578+0000 7f242164ab80 10 client.16137 fetch_fsmap learned FSMap version 36 2024-05-14T15:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.578+0000 7f242164ab80 1 -- 172.21.15.69:0/1879466636 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55aeda557220 con 0x55aeda545bf0 2024-05-14T15:25:11.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.579+0000 7f23f6000700 1 -- 172.21.15.69:0/1879466636 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23fc0a94c0 con 0x55aeda545bf0 2024-05-14T15:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.579+0000 7f23f6000700 1 -- 172.21.15.69:0/1879466636 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 36) ==== 8390+0+0 (secure 0 0 0) 0x7f2404011070 con 0x55aeda545bf0 2024-05-14T15:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.579+0000 7f242164ab80 10 client.16137 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T15:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.579+0000 7f242164ab80 10 client.16137 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-05-14T15:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.579+0000 7f242164ab80 20 client.16137 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.579+0000 7f242164ab80 1 --2- 172.21.15.69:0/1879466636 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55aeda5599e0 0x55aeda55be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.579+0000 7f242164ab80 4 client.16137 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.579+0000 7f242164ab80 1 -- 172.21.15.69:0/1879466636 --> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55aeda50c070 con 0x55aeda5599e0 2024-05-14T15:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.580+0000 7f240be00700 1 --2- 172.21.15.69:0/1879466636 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55aeda5599e0 0x55aeda55be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.581 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.581+0000 7f23f6000700 10 client.16137 ms_handle_connect on v2:172.21.15.92:6834/360295917 2024-05-14T15:25:11.582 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.581+0000 7f240be00700 1 --2- 172.21.15.69:0/1879466636 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55aeda5599e0 0x55aeda55be00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=45fb9f6bfd52ae4 server_cookie=d6dd90d6fd2d5009 in_seq=0 out_seq=0 2024-05-14T15:25:11.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.583+0000 7f23f6000700 1 -- 172.21.15.69:0/1879466636 <== mds.2 v2:172.21.15.92:6834/360295917 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55aeda50c070 con 0x55aeda5599e0 2024-05-14T15:25:11.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.583+0000 7f23f6000700 10 client.16137 handle_command_reply: tid=0 2024-05-14T15:25:11.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.583+0000 7f242164ab80 1 client.16137 shutdown 2024-05-14T15:25:11.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.583+0000 7f242164ab80 1 -- 172.21.15.69:0/1879466636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda545bf0 msgr2=0x55aeda549e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:11.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.583+0000 7f242164ab80 1 --2- 172.21.15.69:0/1879466636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda545bf0 0x55aeda549e50 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f2404015000 tx=0x7f24040094d0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.583+0000 7f242164ab80 1 -- 172.21.15.69:0/1879466636 shutdown_connections 2024-05-14T15:25:11.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.583+0000 7f242164ab80 1 --2- 172.21.15.69:0/1879466636 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda545bf0 0x55aeda549e50 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.583+0000 7f242164ab80 1 --2- 172.21.15.69:0/1879466636 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55aeda5599e0 0x55aeda55be00 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.584+0000 7f242164ab80 1 --2- 172.21.15.69:0/1879466636 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda3c1e40 0x55aeda5493d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.584+0000 7f242164ab80 1 --2- 172.21.15.69:0/1879466636 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda53fc50 0x55aeda549910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.584+0000 7f242164ab80 1 -- 172.21.15.69:0/1879466636 >> 172.21.15.69:0/1879466636 conn(0x55aeda400a80 msgr2=0x55aeda53e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:11.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.584+0000 7f23f6000700 0 client.16137 ms_handle_reset on v2:172.21.15.92:6834/360295917 2024-05-14T15:25:11.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.584+0000 7f242164ab80 1 -- 172.21.15.69:0/1879466636 shutdown_connections 2024-05-14T15:25:11.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.584+0000 7f242164ab80 1 -- 172.21.15.69:0/1879466636 wait complete. 2024-05-14T15:25:11.585 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.584+0000 7f242164ab80 20 client.16137 trim_cache size 0 max 16384 2024-05-14T15:25:11.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:11 smithi203 ceph-mon[34567]: pgmap v109: 129 pgs: 129 active+clean; 1016 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 17 MiB/s wr, 54 op/s 2024-05-14T15:25:11.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.602+0000 7f242164ab80 1 Processor -- start 2024-05-14T15:25:11.602 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.602+0000 7f242164ab80 1 -- start start 2024-05-14T15:25:11.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.602+0000 7f242164ab80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda3c1e40 0x55aeda53f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.602+0000 7f242164ab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda53fc50 0x55aeda543b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.602+0000 7f242164ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda545bf0 0x55aeda54b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.602+0000 7f242164ab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f240c1b2840 con 0x55aeda53fc50 2024-05-14T15:25:11.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.602+0000 7f242164ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f240c1b44d0 con 0x55aeda545bf0 2024-05-14T15:25:11.603 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.602+0000 7f242164ab80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f240c1b2f10 con 0x55aeda3c1e40 2024-05-14T15:25:11.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.603+0000 7f240b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda53fc50 0x55aeda543b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.603+0000 7f240b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda53fc50 0x55aeda543b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54946/0 (socket says 172.21.15.69:54946) 2024-05-14T15:25:11.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.603+0000 7f240b400700 1 -- 172.21.15.69:0/1059873417 learned_addr learned my addr 172.21.15.69:0/1059873417 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:11.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.603+0000 7f240be00700 1 --2- 172.21.15.69:0/1059873417 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda3c1e40 0x55aeda53f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.604 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.603+0000 7f2410c00700 1 --2- 172.21.15.69:0/1059873417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda545bf0 0x55aeda54b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.603+0000 7f240b400700 1 -- 172.21.15.69:0/1059873417 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda3c1e40 msgr2=0x55aeda53f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:11.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.603+0000 7f240b400700 1 --2- 172.21.15.69:0/1059873417 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda3c1e40 0x55aeda53f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.603+0000 7f240b400700 1 -- 172.21.15.69:0/1059873417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda545bf0 msgr2=0x55aeda54b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:11.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.603+0000 7f240b400700 1 --2- 172.21.15.69:0/1059873417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda545bf0 0x55aeda54b870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.603+0000 7f240b400700 1 -- 172.21.15.69:0/1059873417 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55aeda540060 con 0x55aeda53fc50 2024-05-14T15:25:11.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.603+0000 7f2410c00700 1 --2- 172.21.15.69:0/1059873417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda545bf0 0x55aeda54b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:25:11.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.604+0000 7f240b400700 1 --2- 172.21.15.69:0/1059873417 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda53fc50 0x55aeda543b00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f240c107920 tx=0x7f23f8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928367c89819fb49 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:11.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.604+0000 7f2400c00700 1 -- 172.21.15.69:0/1059873417 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8010ba0 con 0x55aeda53fc50 2024-05-14T15:25:11.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.604+0000 7f2400c00700 1 -- 172.21.15.69:0/1059873417 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23f8010d40 con 0x55aeda53fc50 2024-05-14T15:25:11.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.604+0000 7f2400c00700 1 -- 172.21.15.69:0/1059873417 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8005660 con 0x55aeda53fc50 2024-05-14T15:25:11.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.605+0000 7f242164ab80 1 -- 172.21.15.69:0/1059873417 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda53fc50 msgr2=0x55aeda543b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:11.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.605+0000 7f242164ab80 1 --2- 172.21.15.69:0/1059873417 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda53fc50 0x55aeda543b00 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f240c107920 tx=0x7f23f8011000 comp rx=0 tx=0).stop 2024-05-14T15:25:11.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.605+0000 7f242164ab80 1 -- 172.21.15.69:0/1059873417 shutdown_connections 2024-05-14T15:25:11.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.605+0000 7f242164ab80 1 --2- 172.21.15.69:0/1059873417 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda545bf0 0x55aeda54b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.605+0000 7f242164ab80 1 --2- 172.21.15.69:0/1059873417 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda3c1e40 0x55aeda53f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.605+0000 7f242164ab80 1 --2- 172.21.15.69:0/1059873417 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda53fc50 0x55aeda543b00 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.605+0000 7f242164ab80 1 -- 172.21.15.69:0/1059873417 >> 172.21.15.69:0/1059873417 conn(0x55aeda400a80 msgr2=0x55aeda547ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:11.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.605+0000 7f242164ab80 1 -- 172.21.15.69:0/1059873417 shutdown_connections 2024-05-14T15:25:11.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.605+0000 7f242164ab80 1 -- 172.21.15.69:0/1059873417 wait complete. 2024-05-14T15:25:11.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.606+0000 7f242164ab80 1 -- start start 2024-05-14T15:25:11.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.606+0000 7f242164ab80 1 Processor -- start 2024-05-14T15:25:11.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.607+0000 7f242164ab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda3c1e40 0x55aeda54cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.607+0000 7f242164ab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda53fc50 0x55aeda54d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.607+0000 7f242164ab80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda545bf0 0x55aeda5bbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.607+0000 7f242164ab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f240c1b3d40 con 0x55aeda53fc50 2024-05-14T15:25:11.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.607+0000 7f242164ab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f240c1b35e0 con 0x55aeda3c1e40 2024-05-14T15:25:11.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.607+0000 7f242164ab80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f240c1b07e0 con 0x55aeda545bf0 2024-05-14T15:25:11.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.607+0000 7f242164ab80 10 client.0 _ll_register_callbacks cb 0x55aeda3f5380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:11.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.607+0000 7f240b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda53fc50 0x55aeda54d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.608+0000 7f240b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda53fc50 0x55aeda54d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54950/0 (socket says 172.21.15.69:54950) 2024-05-14T15:25:11.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.608+0000 7f240b400700 1 -- 172.21.15.69:0/343084780 learned_addr learned my addr 172.21.15.69:0/343084780 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:11.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.608+0000 7f2410c00700 1 --2- 172.21.15.69:0/343084780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda545bf0 0x55aeda5bbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.608+0000 7f240be00700 1 --2- 172.21.15.69:0/343084780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda3c1e40 0x55aeda54cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.608+0000 7f240b400700 1 -- 172.21.15.69:0/343084780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda545bf0 msgr2=0x55aeda5bbf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:11.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.608+0000 7f240b400700 1 --2- 172.21.15.69:0/343084780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda545bf0 0x55aeda5bbf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.608+0000 7f240b400700 1 -- 172.21.15.69:0/343084780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda3c1e40 msgr2=0x55aeda54cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:11.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.608+0000 7f240b400700 1 --2- 172.21.15.69:0/343084780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda3c1e40 0x55aeda54cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.608+0000 7f240b400700 1 -- 172.21.15.69:0/343084780 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55aeda5bc530 con 0x55aeda53fc50 2024-05-14T15:25:11.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.608+0000 7f2410c00700 1 --2- 172.21.15.69:0/343084780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda545bf0 0x55aeda5bbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:25:11.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.609+0000 7f240b400700 1 --2- 172.21.15.69:0/343084780 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda53fc50 0x55aeda54d4d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f23f800b010 tx=0x7f23f800eaa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbe966a2c100e8a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:11.610 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.609+0000 7f23f6000700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.609+0000 7f23f6000700 1 -- 172.21.15.69:0/343084780 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f8036060 con 0x55aeda53fc50 2024-05-14T15:25:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.609+0000 7f23f6000700 1 -- 172.21.15.69:0/343084780 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f23f8004750 con 0x55aeda53fc50 2024-05-14T15:25:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.609+0000 7f242164ab80 1 -- 172.21.15.69:0/343084780 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f23f8010d40 con 0x55aeda53fc50 2024-05-14T15:25:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.610+0000 7f23f6000700 1 -- 172.21.15.69:0/343084780 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f23f803d050 con 0x55aeda53fc50 2024-05-14T15:25:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.610+0000 7f242164ab80 10 client.16143 fetch_fsmap learned FSMap version 36 2024-05-14T15:25:11.611 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.610+0000 7f242164ab80 1 -- 172.21.15.69:0/343084780 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55aeda5c3850 con 0x55aeda53fc50 2024-05-14T15:25:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.610+0000 7f23f6000700 1 -- 172.21.15.69:0/343084780 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f23f8010d40 con 0x55aeda53fc50 2024-05-14T15:25:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.610+0000 7f23f6000700 1 -- 172.21.15.69:0/343084780 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 36) ==== 8390+0+0 (secure 0 0 0) 0x7f23f801ea80 con 0x55aeda53fc50 2024-05-14T15:25:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.611+0000 7f242164ab80 10 client.16143 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T15:25:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.611+0000 7f242164ab80 10 client.16143 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-05-14T15:25:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.611+0000 7f242164ab80 20 client.16143 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.611+0000 7f242164ab80 1 --2- 172.21.15.69:0/343084780 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55aeda5c3f60 0x55aeda5c6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.611+0000 7f242164ab80 4 client.16143 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:25:11.612 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.611+0000 7f242164ab80 1 -- 172.21.15.69:0/343084780 --> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55aeda46f400 con 0x55aeda5c3f60 2024-05-14T15:25:11.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.611+0000 7f240be00700 1 --2- 172.21.15.69:0/343084780 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55aeda5c3f60 0x55aeda5c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:11.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.612+0000 7f240be00700 1 --2- 172.21.15.69:0/343084780 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55aeda5c3f60 0x55aeda5c6380 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4d9c7078fcc7c42f server_cookie=eec21a05d7705ec7 in_seq=0 out_seq=0 2024-05-14T15:25:11.613 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.612+0000 7f23f6000700 10 client.16143 ms_handle_connect on v2:172.21.15.92:6834/360295917 2024-05-14T15:25:11.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.613+0000 7f23f6000700 1 -- 172.21.15.69:0/343084780 <== mds.2 v2:172.21.15.92:6834/360295917 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55aeda46f400 con 0x55aeda5c3f60 2024-05-14T15:25:11.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.613+0000 7f23f6000700 10 client.16143 handle_command_reply: tid=0 2024-05-14T15:25:11.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.613+0000 7f242164ab80 1 client.16143 shutdown 2024-05-14T15:25:11.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.613+0000 7f242164ab80 1 -- 172.21.15.69:0/343084780 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda53fc50 msgr2=0x55aeda54d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:11.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.613+0000 7f242164ab80 1 --2- 172.21.15.69:0/343084780 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda53fc50 0x55aeda54d4d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f23f800b010 tx=0x7f23f800eaa0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.613+0000 7f242164ab80 1 -- 172.21.15.69:0/343084780 shutdown_connections 2024-05-14T15:25:11.614 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.613+0000 7f242164ab80 1 --2- 172.21.15.69:0/343084780 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55aeda5c3f60 0x55aeda5c6380 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.613+0000 7f242164ab80 1 --2- 172.21.15.69:0/343084780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55aeda545bf0 0x55aeda5bbf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.613+0000 7f242164ab80 1 --2- 172.21.15.69:0/343084780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55aeda3c1e40 0x55aeda54cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.613+0000 7f242164ab80 1 --2- 172.21.15.69:0/343084780 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55aeda53fc50 0x55aeda54d4d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.613+0000 7f242164ab80 1 -- 172.21.15.69:0/343084780 >> 172.21.15.69:0/343084780 conn(0x55aeda400a80 msgr2=0x55aeda549cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:11.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.613+0000 7f23f6000700 0 client.16143 ms_handle_reset on v2:172.21.15.92:6834/360295917 2024-05-14T15:25:11.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.614+0000 7f242164ab80 1 -- 172.21.15.69:0/343084780 shutdown_connections 2024-05-14T15:25:11.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.614+0000 7f242164ab80 1 -- 172.21.15.69:0/343084780 wait complete. 2024-05-14T15:25:11.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.614+0000 7f242164ab80 20 client.16143 trim_cache size 0 max 16384 2024-05-14T15:25:11.616 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:25:11.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.615+0000 7f2412c00700 1 -- 172.21.15.69:0/57340999 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f23f00b2a70 msgr2=0x7f23f00b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:11.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.615+0000 7f2412c00700 1 --2- 172.21.15.69:0/57340999 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f23f00b2a70 0x7f23f00b4f80 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f23f8005fd0 tx=0x7f23f8005db0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.615+0000 7f2412c00700 1 -- 172.21.15.69:0/57340999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f240c1045f0 msgr2=0x7f240c19cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:11.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.615+0000 7f2412c00700 1 --2- 172.21.15.69:0/57340999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f240c1045f0 0x7f240c19cf40 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f23fc00d950 tx=0x7f23fc00dd10 comp rx=0 tx=0).stop 2024-05-14T15:25:11.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.615+0000 7f2412c00700 1 -- 172.21.15.69:0/57340999 shutdown_connections 2024-05-14T15:25:11.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.615+0000 7f2412c00700 1 --2- 172.21.15.69:0/57340999 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f23f00b2a70 0x7f23f00b4f80 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.615+0000 7f2412c00700 1 --2- 172.21.15.69:0/57340999 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f240c1045f0 0x7f240c19cf40 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.615+0000 7f2412c00700 1 --2- 172.21.15.69:0/57340999 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f240c109870 0x7f240c1a1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.615+0000 7f2412c00700 1 --2- 172.21.15.69:0/57340999 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f240c108f20 0x7f240c19d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:11.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.615+0000 7f2412c00700 1 -- 172.21.15.69:0/57340999 >> 172.21.15.69:0/57340999 conn(0x7f240c100040 msgr2=0x7f240c1087e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:11.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.615+0000 7f2412c00700 1 -- 172.21.15.69:0/57340999 shutdown_connections 2024-05-14T15:25:11.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:11.615+0000 7f2412c00700 1 -- 172.21.15.69:0/57340999 wait complete. 2024-05-14T15:25:12.585 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-14T15:25:13.063 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:25:13.467 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:13 smithi069 ceph-mon[31270]: pgmap v110: 129 pgs: 129 active+clean; 1016 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 13 MiB/s wr, 37 op/s 2024-05-14T15:25:13.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:13 smithi203 ceph-mon[34567]: pgmap v110: 129 pgs: 129 active+clean; 1016 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 13 MiB/s wr, 37 op/s 2024-05-14T15:25:13.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:13 smithi092 ceph-mon[34729]: pgmap v110: 129 pgs: 129 active+clean; 1016 MiB data, 2.4 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 13 MiB/s wr, 37 op/s 2024-05-14T15:25:15.329 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:15 smithi069 ceph-mon[31270]: pgmap v111: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 45 op/s 2024-05-14T15:25:15.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:15 smithi203 ceph-mon[34567]: pgmap v111: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 45 op/s 2024-05-14T15:25:15.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:15 smithi092 ceph-mon[34729]: pgmap v111: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 18 MiB/s wr, 45 op/s 2024-05-14T15:25:15.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.715+0000 7f3256800700 1 -- 172.21.15.69:0/1317130945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3250105290 msgr2=0x7f32501056a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:15.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.715+0000 7f3256800700 1 --2- 172.21.15.69:0/1317130945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3250105290 0x7f32501056a0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3244009990 tx=0x7f3244009ca0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.715+0000 7f3256800700 1 -- 172.21.15.69:0/1317130945 shutdown_connections 2024-05-14T15:25:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.715+0000 7f3256800700 1 --2- 172.21.15.69:0/1317130945 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3250105290 0x7f32501056a0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.715+0000 7f3256800700 1 --2- 172.21.15.69:0/1317130945 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f325010e700 0x7f3250110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.715+0000 7f3256800700 1 --2- 172.21.15.69:0/1317130945 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3250105be0 0x7f325010e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.715+0000 7f3256800700 1 -- 172.21.15.69:0/1317130945 >> 172.21.15.69:0/1317130945 conn(0x7f3250078ac0 msgr2=0x7f3250078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.715+0000 7f3256800700 1 -- 172.21.15.69:0/1317130945 shutdown_connections 2024-05-14T15:25:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.715+0000 7f3256800700 1 -- 172.21.15.69:0/1317130945 wait complete. 2024-05-14T15:25:15.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.717+0000 7f3256800700 1 Processor -- start 2024-05-14T15:25:15.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.717+0000 7f3256800700 1 -- start start 2024-05-14T15:25:15.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.718+0000 7f3256800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3250105290 0x7f325019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.718+0000 7f3256800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3250105be0 0x7f325019d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.718+0000 7f3256800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f325010e700 0x7f32501a1580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.718+0000 7f3256800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3250114100 con 0x7f3250105be0 2024-05-14T15:25:15.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.718+0000 7f3256800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3250113f80 con 0x7f325010e700 2024-05-14T15:25:15.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.718+0000 7f3256800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3250114280 con 0x7f3250105290 2024-05-14T15:25:15.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.718+0000 7f3254a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3250105be0 0x7f325019d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.718+0000 7f3254a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3250105be0 0x7f325019d2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60572/0 (socket says 172.21.15.69:60572) 2024-05-14T15:25:15.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.718+0000 7f3254a00700 1 -- 172.21.15.69:0/1151355448 learned_addr learned my addr 172.21.15.69:0/1151355448 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:15.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.718+0000 7f3255e00700 1 --2- 172.21.15.69:0/1151355448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f325010e700 0x7f32501a1580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.718+0000 7f3255400700 1 --2- 172.21.15.69:0/1151355448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3250105290 0x7f325019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.719+0000 7f3254a00700 1 -- 172.21.15.69:0/1151355448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3250105290 msgr2=0x7f325019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:15.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.719+0000 7f3254a00700 1 --2- 172.21.15.69:0/1151355448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3250105290 0x7f325019cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.719+0000 7f3254a00700 1 -- 172.21.15.69:0/1151355448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f325010e700 msgr2=0x7f32501a1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:15.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.719+0000 7f3254a00700 1 --2- 172.21.15.69:0/1151355448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f325010e700 0x7f32501a1580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.719+0000 7f3254a00700 1 -- 172.21.15.69:0/1151355448 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32501a1c20 con 0x7f3250105be0 2024-05-14T15:25:15.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.719+0000 7f3254a00700 1 --2- 172.21.15.69:0/1151355448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3250105be0 0x7f325019d2f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f323c00d950 tx=0x7f323c00dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:15.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.720+0000 7f324e000700 1 -- 172.21.15.69:0/1151355448 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c016070 con 0x7f3250105be0 2024-05-14T15:25:15.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.720+0000 7f324e000700 1 -- 172.21.15.69:0/1151355448 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f323c010460 con 0x7f3250105be0 2024-05-14T15:25:15.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.720+0000 7f3256800700 1 -- 172.21.15.69:0/1151355448 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32501a1f10 con 0x7f3250105be0 2024-05-14T15:25:15.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.720+0000 7f324e000700 1 -- 172.21.15.69:0/1151355448 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c00f620 con 0x7f3250105be0 2024-05-14T15:25:15.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.720+0000 7f3256800700 1 -- 172.21.15.69:0/1151355448 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32501a9830 con 0x7f3250105be0 2024-05-14T15:25:15.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.726+0000 7f324e000700 1 -- 172.21.15.69:0/1151355448 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f323c019070 con 0x7f3250105be0 2024-05-14T15:25:15.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.726+0000 7f3266a20b80 1 Processor -- start 2024-05-14T15:25:15.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.727+0000 7f3266a20b80 1 -- start start 2024-05-14T15:25:15.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.727+0000 7f3266a20b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661ae72e40 0x55661aff0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.727+0000 7f3266a20b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1280 0x55661affa8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.727+0000 7f3266a20b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1690 0x55661affce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.727+0000 7f3266a20b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55661af12a20 con 0x55661aff1690 2024-05-14T15:25:15.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.727+0000 7f3266a20b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55661aeb0760 con 0x55661ae72e40 2024-05-14T15:25:15.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.727+0000 7f3266a20b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55661af0e9e0 con 0x55661aff1280 2024-05-14T15:25:15.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.728+0000 7f3254a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1690 0x55661affce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.728+0000 7f3254a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1690 0x55661affce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60574/0 (socket says 172.21.15.69:60574) 2024-05-14T15:25:15.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.728+0000 7f3254a00700 1 -- 172.21.15.69:0/888496244 learned_addr learned my addr 172.21.15.69:0/888496244 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:15.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.728+0000 7f3255400700 1 --2- 172.21.15.69:0/888496244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1280 0x55661affa8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.728+0000 7f3255e00700 1 --2- 172.21.15.69:0/888496244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661ae72e40 0x55661aff0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.728+0000 7f324e000700 1 --2- 172.21.15.69:0/1151355448 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f32380b2a70 0x7f32380b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.728+0000 7f3255e00700 1 --2- 172.21.15.69:0/1151355448 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f32380b2a70 0x7f32380b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.728+0000 7f324e000700 1 -- 172.21.15.69:0/1151355448 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f323c0e24b0 con 0x7f3250105be0 2024-05-14T15:25:15.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.729+0000 7f3255400700 1 -- 172.21.15.69:0/888496244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661ae72e40 msgr2=0x55661aff0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:15.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.729+0000 7f3255400700 1 --2- 172.21.15.69:0/888496244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661ae72e40 0x55661aff0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.729+0000 7f3255400700 1 -- 172.21.15.69:0/888496244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1690 msgr2=0x55661affce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:15.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.729+0000 7f3255400700 1 --2- 172.21.15.69:0/888496244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1690 0x55661affce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.729+0000 7f3255400700 1 -- 172.21.15.69:0/888496244 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661ae5f8d0 con 0x55661aff1280 2024-05-14T15:25:15.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.729+0000 7f3254a00700 1 --2- 172.21.15.69:0/888496244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1690 0x55661affce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:25:15.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.730+0000 7f3255e00700 1 --2- 172.21.15.69:0/1151355448 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f32380b2a70 0x7f32380b4f80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55661afec500 tx=0x7f3248004b40 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:15.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.730+0000 7f3255400700 1 --2- 172.21.15.69:0/888496244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1280 0x55661affa8e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3244006010 tx=0x7f32440096a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85f252c6b869d5d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:15.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.731+0000 7f3242a00700 1 -- 172.21.15.69:0/888496244 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244026070 con 0x55661aff1280 2024-05-14T15:25:15.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.731+0000 7f3242a00700 1 -- 172.21.15.69:0/888496244 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3244003c50 con 0x55661aff1280 2024-05-14T15:25:15.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.731+0000 7f3242a00700 1 -- 172.21.15.69:0/888496244 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f324400b7d0 con 0x55661aff1280 2024-05-14T15:25:15.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.732+0000 7f3266a20b80 1 -- 172.21.15.69:0/888496244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1280 msgr2=0x55661affa8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:15.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.732+0000 7f3266a20b80 1 --2- 172.21.15.69:0/888496244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1280 0x55661affa8e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3244006010 tx=0x7f32440096a0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.732+0000 7f3266a20b80 1 -- 172.21.15.69:0/888496244 shutdown_connections 2024-05-14T15:25:15.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.732+0000 7f3266a20b80 1 --2- 172.21.15.69:0/888496244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1690 0x55661affce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.732+0000 7f3266a20b80 1 --2- 172.21.15.69:0/888496244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661ae72e40 0x55661aff0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.732+0000 7f3266a20b80 1 --2- 172.21.15.69:0/888496244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1280 0x55661affa8e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.732+0000 7f3266a20b80 1 -- 172.21.15.69:0/888496244 >> 172.21.15.69:0/888496244 conn(0x55661aeb1a80 msgr2=0x55661afebb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:15.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.732+0000 7f3266a20b80 1 -- 172.21.15.69:0/888496244 shutdown_connections 2024-05-14T15:25:15.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.732+0000 7f3266a20b80 1 -- 172.21.15.69:0/888496244 wait complete. 2024-05-14T15:25:15.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.733+0000 7f3266a20b80 1 -- start start 2024-05-14T15:25:15.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.733+0000 7f3266a20b80 1 Processor -- start 2024-05-14T15:25:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.734+0000 7f3266a20b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661ae72e40 0x55661affa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.734+0000 7f3266a20b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1280 0x55661affa910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.734+0000 7f3266a20b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1690 0x55661affae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.734+0000 7f3266a20b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55661affd740 con 0x55661aff1690 2024-05-14T15:25:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.734+0000 7f3266a20b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55661ae78b20 con 0x55661ae72e40 2024-05-14T15:25:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.734+0000 7f3266a20b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55661affd8c0 con 0x55661aff1280 2024-05-14T15:25:15.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.734+0000 7f3266a20b80 10 client.0 _ll_register_callbacks cb 0x55661aea6380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.735+0000 7f3255400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661ae72e40 0x55661affa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.735+0000 7f3255e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1690 0x55661affae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.735+0000 7f3255e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1690 0x55661affae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60580/0 (socket says 172.21.15.69:60580) 2024-05-14T15:25:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.735+0000 7f3255e00700 1 -- 172.21.15.69:0/2513340159 learned_addr learned my addr 172.21.15.69:0/2513340159 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:15.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.735+0000 7f3254a00700 1 --2- 172.21.15.69:0/2513340159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1280 0x55661affa910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.735+0000 7f3255400700 1 -- 172.21.15.69:0/2513340159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1280 msgr2=0x55661affa910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.735+0000 7f3255400700 1 --2- 172.21.15.69:0/2513340159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1280 0x55661affa910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.735+0000 7f3255400700 1 -- 172.21.15.69:0/2513340159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1690 msgr2=0x55661affae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.735+0000 7f3255400700 1 --2- 172.21.15.69:0/2513340159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1690 0x55661affae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.735+0000 7f3255400700 1 -- 172.21.15.69:0/2513340159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55661aed8420 con 0x55661ae72e40 2024-05-14T15:25:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.735+0000 7f3255e00700 1 --2- 172.21.15.69:0/2513340159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1690 0x55661affae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:25:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.736+0000 7f3255400700 1 --2- 172.21.15.69:0/2513340159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661ae72e40 0x55661affa3d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f324400b5c0 tx=0x7f3244003f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25e0e03905bea5a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:15.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.736+0000 7f3237400700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:25:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.736+0000 7f3237400700 1 -- 172.21.15.69:0/2513340159 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3244026070 con 0x55661ae72e40 2024-05-14T15:25:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.737+0000 7f3266a20b80 1 -- 172.21.15.69:0/2513340159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3244003c50 con 0x55661ae72e40 2024-05-14T15:25:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.737+0000 7f3237400700 1 -- 172.21.15.69:0/2513340159 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f324400b770 con 0x55661ae72e40 2024-05-14T15:25:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.737+0000 7f3237400700 1 -- 172.21.15.69:0/2513340159 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f32440056d0 con 0x55661ae72e40 2024-05-14T15:25:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.737+0000 7f3266a20b80 10 client.35672 fetch_fsmap learned FSMap version 36 2024-05-14T15:25:15.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.737+0000 7f3266a20b80 1 -- 172.21.15.69:0/2513340159 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55661b0083e0 con 0x55661ae72e40 2024-05-14T15:25:15.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.738+0000 7f3237400700 1 -- 172.21.15.69:0/2513340159 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3244003c50 con 0x55661ae72e40 2024-05-14T15:25:15.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.738+0000 7f3237400700 1 -- 172.21.15.69:0/2513340159 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 36) ==== 8390+0+0 (secure 0 0 0) 0x7f324400f970 con 0x55661ae72e40 2024-05-14T15:25:15.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.738+0000 7f3266a20b80 10 client.35672 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T15:25:15.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.738+0000 7f3266a20b80 10 client.35672 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-14T15:25:15.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.738+0000 7f3266a20b80 20 client.35672 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:15.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.738+0000 7f3266a20b80 1 --2- 172.21.15.69:0/2513340159 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55661b00a8b0 0x55661b00ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.738+0000 7f3266a20b80 4 client.35672 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:25:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.738+0000 7f3266a20b80 1 -- 172.21.15.69:0/2513340159 --> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55661afbd070 con 0x55661b00a8b0 2024-05-14T15:25:15.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.739+0000 7f3254a00700 1 --2- 172.21.15.69:0/2513340159 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55661b00a8b0 0x55661b00ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.740+0000 7f3254a00700 1 --2- 172.21.15.69:0/2513340159 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55661b00a8b0 0x55661b00ccd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2fb6954f392f4a13 server_cookie=168428f523298e91 in_seq=0 out_seq=0 2024-05-14T15:25:15.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.740+0000 7f3237400700 10 client.35672 ms_handle_connect on v2:172.21.15.92:6836/1669439322 2024-05-14T15:25:15.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.742+0000 7f3237400700 1 -- 172.21.15.69:0/2513340159 <== mds.1 v2:172.21.15.92:6836/1669439322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55661afbd070 con 0x55661b00a8b0 2024-05-14T15:25:15.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.742+0000 7f3237400700 10 client.35672 handle_command_reply: tid=0 2024-05-14T15:25:15.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.742+0000 7f3266a20b80 1 client.35672 shutdown 2024-05-14T15:25:15.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.742+0000 7f3266a20b80 1 -- 172.21.15.69:0/2513340159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661ae72e40 msgr2=0x55661affa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:15.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.742+0000 7f3266a20b80 1 --2- 172.21.15.69:0/2513340159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661ae72e40 0x55661affa3d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f324400b5c0 tx=0x7f3244003f90 comp rx=0 tx=0).stop 2024-05-14T15:25:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.743+0000 7f3266a20b80 1 -- 172.21.15.69:0/2513340159 shutdown_connections 2024-05-14T15:25:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.743+0000 7f3266a20b80 1 --2- 172.21.15.69:0/2513340159 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55661b00a8b0 0x55661b00ccd0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.743+0000 7f3266a20b80 1 --2- 172.21.15.69:0/2513340159 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1690 0x55661affae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.743+0000 7f3266a20b80 1 --2- 172.21.15.69:0/2513340159 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661ae72e40 0x55661affa3d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.743+0000 7f3266a20b80 1 --2- 172.21.15.69:0/2513340159 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1280 0x55661affa910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.743+0000 7f3237400700 0 client.35672 ms_handle_reset on v2:172.21.15.92:6836/1669439322 2024-05-14T15:25:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.743+0000 7f3266a20b80 1 -- 172.21.15.69:0/2513340159 >> 172.21.15.69:0/2513340159 conn(0x55661aeb1a80 msgr2=0x55661afef700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.743+0000 7f3266a20b80 1 -- 172.21.15.69:0/2513340159 shutdown_connections 2024-05-14T15:25:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.743+0000 7f3266a20b80 1 -- 172.21.15.69:0/2513340159 wait complete. 2024-05-14T15:25:15.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.743+0000 7f3266a20b80 20 client.35672 trim_cache size 0 max 16384 2024-05-14T15:25:15.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.766+0000 7f3266a20b80 1 Processor -- start 2024-05-14T15:25:15.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.766+0000 7f3266a20b80 1 -- start start 2024-05-14T15:25:15.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.766+0000 7f3266a20b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661ae72e40 0x55661aff9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.766+0000 7f3266a20b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1280 0x55661b006b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.766+0000 7f3266a20b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1690 0x55661affc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.766+0000 7f3266a20b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f32501b2490 con 0x55661aff1280 2024-05-14T15:25:15.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.766+0000 7f3266a20b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f32501b4120 con 0x55661ae72e40 2024-05-14T15:25:15.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.766+0000 7f3266a20b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f32501b2b60 con 0x55661aff1690 2024-05-14T15:25:15.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.767+0000 7f3254a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1280 0x55661b006b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.767+0000 7f3254a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1280 0x55661b006b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60592/0 (socket says 172.21.15.69:60592) 2024-05-14T15:25:15.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.767+0000 7f3254a00700 1 -- 172.21.15.69:0/104016657 learned_addr learned my addr 172.21.15.69:0/104016657 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:15.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.767+0000 7f3255400700 1 --2- 172.21.15.69:0/104016657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661ae72e40 0x55661aff9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.767+0000 7f3255e00700 1 --2- 172.21.15.69:0/104016657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1690 0x55661affc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.767+0000 7f3254a00700 1 -- 172.21.15.69:0/104016657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1690 msgr2=0x55661affc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:15.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.767+0000 7f3254a00700 1 --2- 172.21.15.69:0/104016657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1690 0x55661affc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.767+0000 7f3254a00700 1 -- 172.21.15.69:0/104016657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661ae72e40 msgr2=0x55661aff9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:15.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.767+0000 7f3254a00700 1 --2- 172.21.15.69:0/104016657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661ae72e40 0x55661aff9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.767+0000 7f3254a00700 1 -- 172.21.15.69:0/104016657 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55661aff8940 con 0x55661aff1280 2024-05-14T15:25:15.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.767+0000 7f3255e00700 1 --2- 172.21.15.69:0/104016657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1690 0x55661affc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:25:15.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.768+0000 7f3254a00700 1 --2- 172.21.15.69:0/104016657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1280 0x55661b006b60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f323c0a5500 tx=0x7f323c0e4a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1d453f7ae8e4b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:15.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.768+0000 7f3242000700 1 -- 172.21.15.69:0/104016657 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c020040 con 0x55661aff1280 2024-05-14T15:25:15.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.768+0000 7f3242000700 1 -- 172.21.15.69:0/104016657 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f323c0a8f90 con 0x55661aff1280 2024-05-14T15:25:15.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.768+0000 7f3242000700 1 -- 172.21.15.69:0/104016657 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c0ad830 con 0x55661aff1280 2024-05-14T15:25:15.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.769+0000 7f3266a20b80 1 -- 172.21.15.69:0/104016657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1280 msgr2=0x55661b006b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:15.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.769+0000 7f3266a20b80 1 --2- 172.21.15.69:0/104016657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1280 0x55661b006b60 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f323c0a5500 tx=0x7f323c0e4a30 comp rx=0 tx=0).stop 2024-05-14T15:25:15.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.769+0000 7f3266a20b80 1 -- 172.21.15.69:0/104016657 shutdown_connections 2024-05-14T15:25:15.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.769+0000 7f3266a20b80 1 --2- 172.21.15.69:0/104016657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661aff1690 0x55661affc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.769+0000 7f3266a20b80 1 --2- 172.21.15.69:0/104016657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661ae72e40 0x55661aff9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.769+0000 7f3266a20b80 1 --2- 172.21.15.69:0/104016657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1280 0x55661b006b60 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.769+0000 7f3266a20b80 1 -- 172.21.15.69:0/104016657 >> 172.21.15.69:0/104016657 conn(0x55661aeb1a80 msgr2=0x55661afeae90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:15.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.769+0000 7f3266a20b80 1 -- 172.21.15.69:0/104016657 shutdown_connections 2024-05-14T15:25:15.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.769+0000 7f3266a20b80 1 -- 172.21.15.69:0/104016657 wait complete. 2024-05-14T15:25:15.771 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.770+0000 7f3266a20b80 1 -- start start 2024-05-14T15:25:15.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.770+0000 7f3266a20b80 1 Processor -- start 2024-05-14T15:25:15.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.771+0000 7f3266a20b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661ae72e40 0x55661b010050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.771+0000 7f3266a20b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1280 0x55661b00d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.771+0000 7f3266a20b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661aff1690 0x55661b00d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.771+0000 7f3266a20b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f32501b3990 con 0x55661aff1280 2024-05-14T15:25:15.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.771+0000 7f3266a20b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f32501b3230 con 0x55661aff1690 2024-05-14T15:25:15.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.771+0000 7f3266a20b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f32501b0430 con 0x55661ae72e40 2024-05-14T15:25:15.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.771+0000 7f3266a20b80 10 client.0 _ll_register_callbacks cb 0x55661aea6380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:15.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.771+0000 7f3254a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1280 0x55661b00d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.771+0000 7f3254a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1280 0x55661b00d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60602/0 (socket says 172.21.15.69:60602) 2024-05-14T15:25:15.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.771+0000 7f3254a00700 1 -- 172.21.15.69:0/2394282379 learned_addr learned my addr 172.21.15.69:0/2394282379 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:15.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.772+0000 7f3255400700 1 --2- 172.21.15.69:0/2394282379 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661ae72e40 0x55661b010050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.772+0000 7f3254a00700 1 -- 172.21.15.69:0/2394282379 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661ae72e40 msgr2=0x55661b010050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:15.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.772+0000 7f3254a00700 1 --2- 172.21.15.69:0/2394282379 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661ae72e40 0x55661b010050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.772+0000 7f3254a00700 1 -- 172.21.15.69:0/2394282379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661aff1690 msgr2=0x55661b00d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:15.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.772+0000 7f3254a00700 1 --2- 172.21.15.69:0/2394282379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661aff1690 0x55661b00d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.772+0000 7f3254a00700 1 -- 172.21.15.69:0/2394282379 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55661b00ded0 con 0x55661aff1280 2024-05-14T15:25:15.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.772+0000 7f3255400700 1 --2- 172.21.15.69:0/2394282379 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661ae72e40 0x55661b010050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:25:15.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.772+0000 7f3254a00700 1 --2- 172.21.15.69:0/2394282379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1280 0x55661b00d420 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f323c0a9410 tx=0x7f323c0e2440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=500daa5ba22169a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:15.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.772+0000 7f3237400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:15.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.773+0000 7f3237400700 1 -- 172.21.15.69:0/2394282379 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f323c020070 con 0x55661aff1280 2024-05-14T15:25:15.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.773+0000 7f3237400700 1 -- 172.21.15.69:0/2394282379 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f323c0a96e0 con 0x55661aff1280 2024-05-14T15:25:15.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.773+0000 7f3266a20b80 1 -- 172.21.15.69:0/2394282379 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f323c0a8f90 con 0x55661aff1280 2024-05-14T15:25:15.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.773+0000 7f3237400700 1 -- 172.21.15.69:0/2394282379 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f323c0b22e0 con 0x55661aff1280 2024-05-14T15:25:15.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.773+0000 7f3266a20b80 10 client.16161 fetch_fsmap learned FSMap version 36 2024-05-14T15:25:15.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.773+0000 7f3266a20b80 1 -- 172.21.15.69:0/2394282379 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55661b074a50 con 0x55661aff1280 2024-05-14T15:25:15.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.774+0000 7f3237400700 1 -- 172.21.15.69:0/2394282379 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f323c0a8f90 con 0x55661aff1280 2024-05-14T15:25:15.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.774+0000 7f3237400700 1 -- 172.21.15.69:0/2394282379 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 36) ==== 8390+0+0 (secure 0 0 0) 0x7f323c0b1e50 con 0x55661aff1280 2024-05-14T15:25:15.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.775+0000 7f3266a20b80 10 client.16161 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T15:25:15.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.775+0000 7f3266a20b80 10 client.16161 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-14T15:25:15.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.775+0000 7f3266a20b80 20 client.16161 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:15.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.775+0000 7f3266a20b80 1 --2- 172.21.15.69:0/2394282379 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55661b075220 0x55661b077640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:15.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.775+0000 7f3266a20b80 4 client.16161 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:25:15.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.775+0000 7f3266a20b80 1 -- 172.21.15.69:0/2394282379 --> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55661af20400 con 0x55661b075220 2024-05-14T15:25:15.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.775+0000 7f3255400700 1 --2- 172.21.15.69:0/2394282379 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55661b075220 0x55661b077640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:15.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.776+0000 7f3255400700 1 --2- 172.21.15.69:0/2394282379 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55661b075220 0x55661b077640 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d85a0bf61e29c585 server_cookie=160bfcce81d59ad in_seq=0 out_seq=0 2024-05-14T15:25:15.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.776+0000 7f3237400700 10 client.16161 ms_handle_connect on v2:172.21.15.92:6836/1669439322 2024-05-14T15:25:15.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.777+0000 7f3237400700 1 -- 172.21.15.69:0/2394282379 <== mds.1 v2:172.21.15.92:6836/1669439322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55661af20400 con 0x55661b075220 2024-05-14T15:25:15.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.777+0000 7f3237400700 10 client.16161 handle_command_reply: tid=0 2024-05-14T15:25:15.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.777+0000 7f3266a20b80 1 client.16161 shutdown 2024-05-14T15:25:15.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.777+0000 7f3266a20b80 1 -- 172.21.15.69:0/2394282379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1280 msgr2=0x55661b00d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:15.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.777+0000 7f3266a20b80 1 --2- 172.21.15.69:0/2394282379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1280 0x55661b00d420 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f323c0a9410 tx=0x7f323c0e2440 comp rx=0 tx=0).stop 2024-05-14T15:25:15.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.777+0000 7f3266a20b80 1 -- 172.21.15.69:0/2394282379 shutdown_connections 2024-05-14T15:25:15.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.777+0000 7f3266a20b80 1 --2- 172.21.15.69:0/2394282379 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x55661b075220 0x55661b077640 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.777+0000 7f3266a20b80 1 --2- 172.21.15.69:0/2394282379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55661aff1690 0x55661b00d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.777+0000 7f3266a20b80 1 --2- 172.21.15.69:0/2394282379 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55661ae72e40 0x55661b010050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.777+0000 7f3266a20b80 1 --2- 172.21.15.69:0/2394282379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55661aff1280 0x55661b00d420 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.777+0000 7f3237400700 0 client.16161 ms_handle_reset on v2:172.21.15.92:6836/1669439322 2024-05-14T15:25:15.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.777+0000 7f3266a20b80 1 -- 172.21.15.69:0/2394282379 >> 172.21.15.69:0/2394282379 conn(0x55661aeb1a80 msgr2=0x55661afeb8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:15.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.778+0000 7f3266a20b80 1 -- 172.21.15.69:0/2394282379 shutdown_connections 2024-05-14T15:25:15.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.778+0000 7f3266a20b80 1 -- 172.21.15.69:0/2394282379 wait complete. 2024-05-14T15:25:15.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.778+0000 7f3266a20b80 20 client.16161 trim_cache size 0 max 16384 2024-05-14T15:25:15.780 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:25:15.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.779+0000 7f3256800700 1 -- 172.21.15.69:0/1151355448 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f32380b2a70 msgr2=0x7f32380b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:15.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.779+0000 7f3256800700 1 --2- 172.21.15.69:0/1151355448 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f32380b2a70 0x7f32380b4f80 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55661afec500 tx=0x7f3248004b40 comp rx=0 tx=0).stop 2024-05-14T15:25:15.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.779+0000 7f3256800700 1 -- 172.21.15.69:0/1151355448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3250105be0 msgr2=0x7f325019d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:15.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.779+0000 7f3256800700 1 --2- 172.21.15.69:0/1151355448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3250105be0 0x7f325019d2f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f323c00d950 tx=0x7f323c00dd10 comp rx=0 tx=0).stop 2024-05-14T15:25:15.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.779+0000 7f3256800700 1 -- 172.21.15.69:0/1151355448 shutdown_connections 2024-05-14T15:25:15.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.779+0000 7f3256800700 1 --2- 172.21.15.69:0/1151355448 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f32380b2a70 0x7f32380b4f80 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.779+0000 7f3256800700 1 --2- 172.21.15.69:0/1151355448 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f325010e700 0x7f32501a1580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.779+0000 7f3256800700 1 --2- 172.21.15.69:0/1151355448 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3250105290 0x7f325019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.779+0000 7f3256800700 1 --2- 172.21.15.69:0/1151355448 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3250105be0 0x7f325019d2f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:15.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.779+0000 7f3256800700 1 -- 172.21.15.69:0/1151355448 >> 172.21.15.69:0/1151355448 conn(0x7f3250078ac0 msgr2=0x7f32500ffdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:15.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.779+0000 7f3256800700 1 -- 172.21.15.69:0/1151355448 shutdown_connections 2024-05-14T15:25:15.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:15.780+0000 7f3256800700 1 -- 172.21.15.69:0/1151355448 wait complete. 2024-05-14T15:25:16.742 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-14T15:25:17.221 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:25:17.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:17 smithi069 ceph-mon[31270]: pgmap v112: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 20 op/s 2024-05-14T15:25:17.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:17 smithi203 ceph-mon[34567]: pgmap v112: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 20 op/s 2024-05-14T15:25:17.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:17 smithi092 ceph-mon[34729]: pgmap v112: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 20 op/s 2024-05-14T15:25:19.286 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:19 smithi069 ceph-mon[31270]: pgmap v113: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 20 op/s 2024-05-14T15:25:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.289+0000 7f4665800640 1 -- 172.21.15.69:0/2955452023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4660104260 msgr2=0x7f46601105e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.289+0000 7f4665800640 1 --2- 172.21.15.69:0/2955452023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4660104260 0x7f46601105e0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4658009ca0 tx=0x7f465802a8c0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.289+0000 7f4665800640 1 -- 172.21.15.69:0/2955452023 shutdown_connections 2024-05-14T15:25:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.289+0000 7f4665800640 1 --2- 172.21.15.69:0/2955452023 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4660104260 0x7f46601105e0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.289+0000 7f4665800640 1 --2- 172.21.15.69:0/2955452023 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4660109f60 0x7f4660103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.289+0000 7f4665800640 1 --2- 172.21.15.69:0/2955452023 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4660109ac0 0x7f46601036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.289+0000 7f4665800640 1 -- 172.21.15.69:0/2955452023 >> 172.21.15.69:0/2955452023 conn(0x7f4660079250 msgr2=0x7f4660079690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.289+0000 7f4665800640 1 -- 172.21.15.69:0/2955452023 shutdown_connections 2024-05-14T15:25:19.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.289+0000 7f4665800640 1 -- 172.21.15.69:0/2955452023 wait complete. 2024-05-14T15:25:19.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.291+0000 7f4665800640 1 Processor -- start 2024-05-14T15:25:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.291+0000 7f4665800640 1 -- start start 2024-05-14T15:25:19.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.291+0000 7f4665800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4660104260 0x7f466010a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.291+0000 7f4665800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4660109ac0 0x7f466010aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.291+0000 7f4665800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4660109f60 0x7f466010b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.291+0000 7f4665800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4660113bb0 con 0x7f4660104260 2024-05-14T15:25:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.291+0000 7f4665800640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4660113a30 con 0x7f4660109f60 2024-05-14T15:25:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.291+0000 7f4665800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4660113d30 con 0x7f4660109ac0 2024-05-14T15:25:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.292+0000 7f465fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4660104260 0x7f466010a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.292+0000 7f465fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4660104260 0x7f466010a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60614/0 (socket says 172.21.15.69:60614) 2024-05-14T15:25:19.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.292+0000 7f465fe00640 1 -- 172.21.15.69:0/2193069951 learned_addr learned my addr 172.21.15.69:0/2193069951 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.292+0000 7f465f400640 1 --2- 172.21.15.69:0/2193069951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4660109ac0 0x7f466010aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.292+0000 7f465fe00640 1 -- 172.21.15.69:0/2193069951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4660109ac0 msgr2=0x7f466010aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.292+0000 7f4664e00640 1 --2- 172.21.15.69:0/2193069951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4660109f60 0x7f466010b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.292+0000 7f465fe00640 1 --2- 172.21.15.69:0/2193069951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4660109ac0 0x7f466010aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.292+0000 7f465fe00640 1 -- 172.21.15.69:0/2193069951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4660109f60 msgr2=0x7f466010b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.292+0000 7f465fe00640 1 --2- 172.21.15.69:0/2193069951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4660109f60 0x7f466010b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.292+0000 7f465fe00640 1 -- 172.21.15.69:0/2193069951 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46601ace00 con 0x7f4660104260 2024-05-14T15:25:19.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.293+0000 7f465fe00640 1 --2- 172.21.15.69:0/2193069951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4660104260 0x7f466010a590 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4650005fd0 tx=0x7f465000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.293+0000 7f465cc00640 1 -- 172.21.15.69:0/2193069951 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4650017070 con 0x7f4660104260 2024-05-14T15:25:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.293+0000 7f465cc00640 1 -- 172.21.15.69:0/2193069951 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4650009c30 con 0x7f4660104260 2024-05-14T15:25:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.293+0000 7f465cc00640 1 -- 172.21.15.69:0/2193069951 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4650003c70 con 0x7f4660104260 2024-05-14T15:25:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.293+0000 7f4665800640 1 -- 172.21.15.69:0/2193069951 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46601ad090 con 0x7f4660104260 2024-05-14T15:25:19.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.293+0000 7f4665800640 1 -- 172.21.15.69:0/2193069951 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46601ad5e0 con 0x7f4660104260 2024-05-14T15:25:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.298+0000 7f466de20740 1 Processor -- start 2024-05-14T15:25:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.299+0000 7f466de20740 1 -- start start 2024-05-14T15:25:19.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.299+0000 7f465cc00640 1 -- 172.21.15.69:0/2193069951 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4650003e10 con 0x7f4660104260 2024-05-14T15:25:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.300+0000 7f466de20740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c6f1b0 0x55e8f6010480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.300+0000 7f466de20740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c462f0 0x55e8f60109c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.300+0000 7f466de20740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f6010f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.300+0000 7f466de20740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55e8f5f75550 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.300+0000 7f466de20740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e8f5f1abc0 con 0x55e8f5c6f1b0 2024-05-14T15:25:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.300+0000 7f466de20740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e8f5f71510 con 0x55e8f5c462f0 2024-05-14T15:25:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.300+0000 7f465f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f6010f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.300+0000 7f465f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f6010f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60628/0 (socket says 172.21.15.69:60628) 2024-05-14T15:25:19.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.300+0000 7f465f400640 1 -- 172.21.15.69:0/3487173690 learned_addr learned my addr 172.21.15.69:0/3487173690 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.300+0000 7f4664e00640 1 --2- 172.21.15.69:0/3487173690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c6f1b0 0x55e8f6010480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.300+0000 7f465fe00640 1 --2- 172.21.15.69:0/3487173690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c462f0 0x55e8f60109c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.301+0000 7f465cc00640 1 --2- 172.21.15.69:0/2193069951 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f46440b29d0 0x7f46440b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.301+0000 7f465f400640 1 -- 172.21.15.69:0/3487173690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c462f0 msgr2=0x55e8f60109c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.301+0000 7f465f400640 1 --2- 172.21.15.69:0/3487173690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c462f0 0x55e8f60109c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.301+0000 7f465f400640 1 -- 172.21.15.69:0/3487173690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c6f1b0 msgr2=0x55e8f6010480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.301+0000 7f465f400640 1 --2- 172.21.15.69:0/3487173690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c6f1b0 0x55e8f6010480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.301+0000 7f465f400640 1 -- 172.21.15.69:0/3487173690 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8f5c87210 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.301+0000 7f465fe00640 1 --2- 172.21.15.69:0/3487173690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c462f0 0x55e8f60109c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:25:19.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.301+0000 7f465cc00640 1 -- 172.21.15.69:0/2193069951 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f46500e2760 con 0x7f4660104260 2024-05-14T15:25:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.302+0000 7f4664e00640 1 --2- 172.21.15.69:0/2193069951 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f46440b29d0 0x7f46440b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.302+0000 7f465f400640 1 --2- 172.21.15.69:0/3487173690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f6010f00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f464c009af0 tx=0x7f464c0113e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7df5812b0a126286 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.303+0000 7f4664e00640 1 --2- 172.21.15.69:0/2193069951 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f46440b29d0 0x7f46440b4ee0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f465802aeb0 tx=0x7f46580095c0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.303+0000 7f4655600640 1 -- 172.21.15.69:0/3487173690 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c011e10 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.303+0000 7f4655600640 1 -- 172.21.15.69:0/3487173690 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f464c016070 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.303+0000 7f4655600640 1 -- 172.21.15.69:0/3487173690 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c004a00 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.304+0000 7f466de20740 1 -- 172.21.15.69:0/3487173690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 msgr2=0x55e8f6010f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.304+0000 7f466de20740 1 --2- 172.21.15.69:0/3487173690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f6010f00 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f464c009af0 tx=0x7f464c0113e0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.304+0000 7f466de20740 1 -- 172.21.15.69:0/3487173690 shutdown_connections 2024-05-14T15:25:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.304+0000 7f466de20740 1 --2- 172.21.15.69:0/3487173690 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f6010f00 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.304+0000 7f466de20740 1 --2- 172.21.15.69:0/3487173690 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c462f0 0x55e8f60109c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.304+0000 7f466de20740 1 --2- 172.21.15.69:0/3487173690 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c6f1b0 0x55e8f6010480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.304+0000 7f466de20740 1 -- 172.21.15.69:0/3487173690 >> 172.21.15.69:0/3487173690 conn(0x55e8f5c63300 msgr2=0x55e8f600cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.305+0000 7f466de20740 1 -- 172.21.15.69:0/3487173690 shutdown_connections 2024-05-14T15:25:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.305+0000 7f466de20740 1 -- 172.21.15.69:0/3487173690 wait complete. 2024-05-14T15:25:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.305+0000 7f466de20740 1 -- start start 2024-05-14T15:25:19.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.306+0000 7f466de20740 1 Processor -- start 2024-05-14T15:25:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.306+0000 7f466de20740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c462f0 0x55e8f601a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.306+0000 7f466de20740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c4e4d0 0x55e8f601ae50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.307+0000 7f466de20740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c6f1b0 0x55e8f6026a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.307+0000 7f466de20740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55e8f601d5b0 con 0x55e8f5c462f0 2024-05-14T15:25:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.307+0000 7f466de20740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e8f5f2e660 con 0x55e8f5c6f1b0 2024-05-14T15:25:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.307+0000 7f466de20740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e8f601d730 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.307+0000 7f466de20740 10 client.0 _ll_register_callbacks cb 0x55e8f5ef8400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.307+0000 7f465fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c462f0 0x55e8f601a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.307+0000 7f465fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c462f0 0x55e8f601a910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60642/0 (socket says 172.21.15.69:60642) 2024-05-14T15:25:19.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.307+0000 7f465fe00640 1 -- 172.21.15.69:0/2729096043 learned_addr learned my addr 172.21.15.69:0/2729096043 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.307+0000 7f465f400640 1 --2- 172.21.15.69:0/2729096043 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c4e4d0 0x55e8f601ae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.308+0000 7f465fe00640 1 -- 172.21.15.69:0/2729096043 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c4e4d0 msgr2=0x55e8f601ae50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.308+0000 7f465fe00640 1 --2- 172.21.15.69:0/2729096043 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c4e4d0 0x55e8f601ae50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.308+0000 7f465fe00640 1 -- 172.21.15.69:0/2729096043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c6f1b0 msgr2=0x55e8f6026a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.308+0000 7f465fe00640 1 --2- 172.21.15.69:0/2729096043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c6f1b0 0x55e8f6026a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.308+0000 7f465fe00640 1 -- 172.21.15.69:0/2729096043 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8f5d53620 con 0x55e8f5c462f0 2024-05-14T15:25:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.308+0000 7f465fe00640 1 --2- 172.21.15.69:0/2729096043 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c462f0 0x55e8f601a910 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f46500a68a0 tx=0x7f46500a9400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63c6b9bc887ed494 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.308+0000 7f464a000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.308+0000 7f464a000640 1 -- 172.21.15.69:0/2729096043 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46500035f0 con 0x55e8f5c462f0 2024-05-14T15:25:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.308+0000 7f466de20740 1 -- 172.21.15.69:0/2729096043 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f464c016070 con 0x55e8f5c462f0 2024-05-14T15:25:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.309+0000 7f464a000640 1 -- 172.21.15.69:0/2729096043 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f46500a58c0 con 0x55e8f5c462f0 2024-05-14T15:25:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.309+0000 7f464a000640 1 -- 172.21.15.69:0/2729096043 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f46500a9140 con 0x55e8f5c462f0 2024-05-14T15:25:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.309+0000 7f466de20740 10 client.16173 fetch_fsmap learned FSMap version 36 2024-05-14T15:25:19.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.309+0000 7f466de20740 1 -- 172.21.15.69:0/2729096043 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e8f60297e0 con 0x55e8f5c462f0 2024-05-14T15:25:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.309+0000 7f464a000640 1 -- 172.21.15.69:0/2729096043 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f464c016070 con 0x55e8f5c462f0 2024-05-14T15:25:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.310+0000 7f464a000640 1 -- 172.21.15.69:0/2729096043 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 36) ==== 8390+0+0 (secure 0 0 0) 0x7f46500e22d0 con 0x55e8f5c462f0 2024-05-14T15:25:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.310+0000 7f466de20740 10 client.16173 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T15:25:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.310+0000 7f466de20740 10 client.16173 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:25:19.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.310+0000 7f466de20740 20 client.16173 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.310+0000 7f466de20740 1 --2- 172.21.15.69:0/2729096043 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55e8f5c2dd80 0x55e8f602cd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.310+0000 7f466de20740 4 client.16173 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.310+0000 7f466de20740 1 -- 172.21.15.69:0/2729096043 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8f5f83160 con 0x55e8f5c2dd80 2024-05-14T15:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.310+0000 7f465f400640 1 --2- 172.21.15.69:0/2729096043 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55e8f5c2dd80 0x55e8f602cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.312+0000 7f464a000640 10 client.16173 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:19.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.312+0000 7f465f400640 1 --2- 172.21.15.69:0/2729096043 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55e8f5c2dd80 0x55e8f602cd80 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aef447f21370629a server_cookie=fd736a2ed2b694b3 in_seq=0 out_seq=0 2024-05-14T15:25:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.313+0000 7f464a000640 1 -- 172.21.15.69:0/2729096043 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e8f5f83160 con 0x55e8f5c2dd80 2024-05-14T15:25:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.313+0000 7f464a000640 10 client.16173 handle_command_reply: tid=0 2024-05-14T15:25:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.313+0000 7f466de20740 1 client.16173 shutdown 2024-05-14T15:25:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.314+0000 7f466de20740 1 -- 172.21.15.69:0/2729096043 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c462f0 msgr2=0x55e8f601a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.314+0000 7f466de20740 1 --2- 172.21.15.69:0/2729096043 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c462f0 0x55e8f601a910 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f46500a68a0 tx=0x7f46500a9400 comp rx=0 tx=0).stop 2024-05-14T15:25:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.314+0000 7f466de20740 1 -- 172.21.15.69:0/2729096043 shutdown_connections 2024-05-14T15:25:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.314+0000 7f466de20740 1 --2- 172.21.15.69:0/2729096043 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c6f1b0 0x55e8f6026a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.314+0000 7f466de20740 1 --2- 172.21.15.69:0/2729096043 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c4e4d0 0x55e8f601ae50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.314+0000 7f466de20740 1 --2- 172.21.15.69:0/2729096043 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55e8f5c2dd80 0x55e8f602cd80 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.314+0000 7f466de20740 1 --2- 172.21.15.69:0/2729096043 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c462f0 0x55e8f601a910 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.314+0000 7f466de20740 1 -- 172.21.15.69:0/2729096043 >> 172.21.15.69:0/2729096043 conn(0x55e8f5c63300 msgr2=0x55e8f60121a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.314+0000 7f464a000640 0 client.16173 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.314+0000 7f466de20740 1 -- 172.21.15.69:0/2729096043 shutdown_connections 2024-05-14T15:25:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.314+0000 7f466de20740 1 -- 172.21.15.69:0/2729096043 wait complete. 2024-05-14T15:25:19.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.314+0000 7f466de20740 20 client.16173 trim_cache size 0 max 16384 2024-05-14T15:25:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.339+0000 7f466de20740 1 Processor -- start 2024-05-14T15:25:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.339+0000 7f466de20740 1 -- start start 2024-05-14T15:25:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.340+0000 7f466de20740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c462f0 0x55e8f601c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.340+0000 7f466de20740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f6011220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.340+0000 7f466de20740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c6f1b0 0x55e8f600b960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.340+0000 7f466de20740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f46601b7740 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.340+0000 7f466de20740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f46601b93d0 con 0x55e8f5c462f0 2024-05-14T15:25:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.340+0000 7f466de20740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f46601b7e10 con 0x55e8f5c6f1b0 2024-05-14T15:25:19.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.341+0000 7f465f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f6011220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.341+0000 7f465fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c462f0 0x55e8f601c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.341+0000 7f465fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c462f0 0x55e8f601c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:56896/0 (socket says 172.21.15.69:56896) 2024-05-14T15:25:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.341+0000 7f465fe00640 1 -- 172.21.15.69:0/727080685 learned_addr learned my addr 172.21.15.69:0/727080685 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.341+0000 7f465f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f6011220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60648/0 (socket says 172.21.15.69:60648) 2024-05-14T15:25:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.341+0000 7f4664e00640 1 --2- 172.21.15.69:0/727080685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c6f1b0 0x55e8f600b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.342+0000 7f465f400640 1 -- 172.21.15.69:0/727080685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c6f1b0 msgr2=0x55e8f600b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:19.343 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.342+0000 7f465f400640 1 --2- 172.21.15.69:0/727080685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c6f1b0 0x55e8f600b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.342+0000 7f465f400640 1 -- 172.21.15.69:0/727080685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c462f0 msgr2=0x55e8f601c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.342+0000 7f465f400640 1 --2- 172.21.15.69:0/727080685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c462f0 0x55e8f601c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.342+0000 7f465f400640 1 -- 172.21.15.69:0/727080685 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8f6018c50 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.342+0000 7f465f400640 1 --2- 172.21.15.69:0/727080685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f6011220 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f464c009ac0 tx=0x7f464c005870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23282635b5665d5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.343+0000 7f4654c00640 1 -- 172.21.15.69:0/727080685 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c005640 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.343+0000 7f4654c00640 1 -- 172.21.15.69:0/727080685 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f464c016040 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.343+0000 7f4654c00640 1 -- 172.21.15.69:0/727080685 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c003e40 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.345+0000 7f466de20740 1 -- 172.21.15.69:0/727080685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 msgr2=0x55e8f6011220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.345+0000 7f466de20740 1 --2- 172.21.15.69:0/727080685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f6011220 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f464c009ac0 tx=0x7f464c005870 comp rx=0 tx=0).stop 2024-05-14T15:25:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.345+0000 7f466de20740 1 -- 172.21.15.69:0/727080685 shutdown_connections 2024-05-14T15:25:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.345+0000 7f466de20740 1 --2- 172.21.15.69:0/727080685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c6f1b0 0x55e8f600b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.345+0000 7f466de20740 1 --2- 172.21.15.69:0/727080685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f6011220 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.345+0000 7f466de20740 1 --2- 172.21.15.69:0/727080685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c462f0 0x55e8f601c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.345+0000 7f466de20740 1 -- 172.21.15.69:0/727080685 >> 172.21.15.69:0/727080685 conn(0x55e8f5c63300 msgr2=0x55e8f600b250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.345+0000 7f466de20740 1 -- 172.21.15.69:0/727080685 shutdown_connections 2024-05-14T15:25:19.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.345+0000 7f466de20740 1 -- 172.21.15.69:0/727080685 wait complete. 2024-05-14T15:25:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.346+0000 7f466de20740 1 -- start start 2024-05-14T15:25:19.348 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.346+0000 7f466de20740 1 Processor -- start 2024-05-14T15:25:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.347+0000 7f466de20740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c462f0 0x55e8f601df80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.347+0000 7f466de20740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f601e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.347+0000 7f466de20740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c6f1b0 0x55e8f608d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.347+0000 7f466de20740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f46601b8c40 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.347+0000 7f466de20740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f46601b84e0 con 0x55e8f5c6f1b0 2024-05-14T15:25:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.347+0000 7f466de20740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f46601b5720 con 0x55e8f5c462f0 2024-05-14T15:25:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.347+0000 7f466de20740 10 client.0 _ll_register_callbacks cb 0x7f4650005bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.347+0000 7f465f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f601e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.347+0000 7f465f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f601e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60650/0 (socket says 172.21.15.69:60650) 2024-05-14T15:25:19.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.347+0000 7f465f400640 1 -- 172.21.15.69:0/1444689470 learned_addr learned my addr 172.21.15.69:0/1444689470 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.348+0000 7f4664e00640 1 --2- 172.21.15.69:0/1444689470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c6f1b0 0x55e8f608d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.348+0000 7f465f400640 1 -- 172.21.15.69:0/1444689470 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c462f0 msgr2=0x55e8f601df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.348+0000 7f465f400640 1 --2- 172.21.15.69:0/1444689470 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c462f0 0x55e8f601df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.348+0000 7f465f400640 1 -- 172.21.15.69:0/1444689470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c6f1b0 msgr2=0x55e8f608d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.348+0000 7f465f400640 1 --2- 172.21.15.69:0/1444689470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c6f1b0 0x55e8f608d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.348+0000 7f465f400640 1 -- 172.21.15.69:0/1444689470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e8f608d680 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.348+0000 7f4664e00640 1 --2- 172.21.15.69:0/1444689470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c6f1b0 0x55e8f608d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:25:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.348+0000 7f465f400640 1 --2- 172.21.15.69:0/1444689470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f601e4e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f464c005520 tx=0x7f464c011a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e70b660c1e876299 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.348+0000 7f464a000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.349+0000 7f464a000640 1 -- 172.21.15.69:0/1444689470 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f464c011d10 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.349+0000 7f464a000640 1 -- 172.21.15.69:0/1444689470 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f464c0035f0 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.349+0000 7f466de20740 1 -- 172.21.15.69:0/1444689470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f464c016040 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.350+0000 7f464a000640 1 -- 172.21.15.69:0/1444689470 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f464c0037f0 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.350+0000 7f466de20740 10 client.16179 fetch_fsmap learned FSMap version 36 2024-05-14T15:25:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.350+0000 7f466de20740 1 -- 172.21.15.69:0/1444689470 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55e8f60949b0 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.350+0000 7f464a000640 1 -- 172.21.15.69:0/1444689470 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f464c016040 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.350+0000 7f464a000640 1 -- 172.21.15.69:0/1444689470 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 36) ==== 8390+0+0 (secure 0 0 0) 0x7f464c02a490 con 0x55e8f5c4e4d0 2024-05-14T15:25:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.350+0000 7f466de20740 10 client.16179 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T15:25:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.350+0000 7f466de20740 10 client.16179 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:25:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.350+0000 7f466de20740 20 client.16179 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.350+0000 7f466de20740 1 --2- 172.21.15.69:0/1444689470 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55e8f5c031c0 0x55e8f6096f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.351+0000 7f466de20740 4 client.16179 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:25:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.351+0000 7f466de20740 1 -- 172.21.15.69:0/1444689470 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e8f5f7cfd0 con 0x55e8f5c031c0 2024-05-14T15:25:19.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.351+0000 7f465fe00640 1 --2- 172.21.15.69:0/1444689470 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55e8f5c031c0 0x55e8f6096f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.352+0000 7f465fe00640 1 --2- 172.21.15.69:0/1444689470 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55e8f5c031c0 0x55e8f6096f50 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=424b751946bceed3 server_cookie=fd3a0d6467a6226f in_seq=0 out_seq=0 2024-05-14T15:25:19.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.352+0000 7f464a000640 10 client.16179 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.388+0000 7f464a000640 1 -- 172.21.15.69:0/1444689470 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e8f5f7cfd0 con 0x55e8f5c031c0 2024-05-14T15:25:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.388+0000 7f464a000640 10 client.16179 handle_command_reply: tid=0 2024-05-14T15:25:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.388+0000 7f466de20740 1 client.16179 shutdown 2024-05-14T15:25:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.389+0000 7f466de20740 1 -- 172.21.15.69:0/1444689470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 msgr2=0x55e8f601e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.389+0000 7f466de20740 1 --2- 172.21.15.69:0/1444689470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f601e4e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f464c005520 tx=0x7f464c011a10 comp rx=0 tx=0).stop 2024-05-14T15:25:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.389+0000 7f466de20740 1 -- 172.21.15.69:0/1444689470 shutdown_connections 2024-05-14T15:25:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.389+0000 7f466de20740 1 --2- 172.21.15.69:0/1444689470 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e8f5c6f1b0 0x55e8f608d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.389+0000 7f466de20740 1 --2- 172.21.15.69:0/1444689470 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55e8f5c031c0 0x55e8f6096f50 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.389+0000 7f466de20740 1 --2- 172.21.15.69:0/1444689470 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e8f5c4e4d0 0x55e8f601e4e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.389+0000 7f466de20740 1 --2- 172.21.15.69:0/1444689470 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e8f5c462f0 0x55e8f601df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.389+0000 7f464a000640 0 client.16179 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:19.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.389+0000 7f466de20740 1 -- 172.21.15.69:0/1444689470 >> 172.21.15.69:0/1444689470 conn(0x55e8f5c63300 msgr2=0x55e8f600bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:19.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.389+0000 7f466de20740 1 -- 172.21.15.69:0/1444689470 shutdown_connections 2024-05-14T15:25:19.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.389+0000 7f466de20740 1 -- 172.21.15.69:0/1444689470 wait complete. 2024-05-14T15:25:19.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.389+0000 7f466de20740 20 client.16179 trim_cache size 0 max 16384 2024-05-14T15:25:19.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:25:19.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:25:19.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:25:19.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:25:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.390+0000 7f4665800640 1 -- 172.21.15.69:0/2193069951 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f46440b29d0 msgr2=0x7f46440b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.390+0000 7f4665800640 1 --2- 172.21.15.69:0/2193069951 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f46440b29d0 0x7f46440b4ee0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f465802aeb0 tx=0x7f46580095c0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.390+0000 7f4665800640 1 -- 172.21.15.69:0/2193069951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4660104260 msgr2=0x7f466010a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.390+0000 7f4665800640 1 --2- 172.21.15.69:0/2193069951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4660104260 0x7f466010a590 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4650005fd0 tx=0x7f465000dde0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.390+0000 7f4665800640 1 -- 172.21.15.69:0/2193069951 shutdown_connections 2024-05-14T15:25:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.390+0000 7f4665800640 1 --2- 172.21.15.69:0/2193069951 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f46440b29d0 0x7f46440b4ee0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.390+0000 7f4665800640 1 --2- 172.21.15.69:0/2193069951 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4660109f60 0x7f466010b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.390+0000 7f4665800640 1 --2- 172.21.15.69:0/2193069951 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4660109ac0 0x7f466010aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.390+0000 7f4665800640 1 --2- 172.21.15.69:0/2193069951 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4660104260 0x7f466010a590 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.390+0000 7f4665800640 1 -- 172.21.15.69:0/2193069951 >> 172.21.15.69:0/2193069951 conn(0x7f4660079250 msgr2=0x7f46600768a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.390+0000 7f4665800640 1 -- 172.21.15.69:0/2193069951 shutdown_connections 2024-05-14T15:25:19.394 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:19.390+0000 7f4665800640 1 -- 172.21.15.69:0/2193069951 wait complete. 2024-05-14T15:25:19.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:19 smithi203 ceph-mon[34567]: pgmap v113: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 20 op/s 2024-05-14T15:25:19.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.678+0000 7f6feb200700 1 -- 172.21.15.69:0/2728294513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fec1032e0 msgr2=0x7f6fec1036f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.678+0000 7f6feb200700 1 --2- 172.21.15.69:0/2728294513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fec1032e0 0x7f6fec1036f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40099c0 tx=0x7f6fe4009cd0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.678+0000 7f6feb200700 1 -- 172.21.15.69:0/2728294513 shutdown_connections 2024-05-14T15:25:19.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.678+0000 7f6feb200700 1 --2- 172.21.15.69:0/2728294513 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fec1032e0 0x7f6fec1036f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.678+0000 7f6feb200700 1 --2- 172.21.15.69:0/2728294513 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fec108560 0x7f6fec10fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.678+0000 7f6feb200700 1 --2- 172.21.15.69:0/2728294513 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fec107c10 0x7f6fec108020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.678+0000 7f6feb200700 1 -- 172.21.15.69:0/2728294513 >> 172.21.15.69:0/2728294513 conn(0x7f6fec078ac0 msgr2=0x7f6fec078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:19.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.678+0000 7f6feb200700 1 -- 172.21.15.69:0/2728294513 shutdown_connections 2024-05-14T15:25:19.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.678+0000 7f6feb200700 1 -- 172.21.15.69:0/2728294513 wait complete. 2024-05-14T15:25:19.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.680+0000 7f6feb200700 1 Processor -- start 2024-05-14T15:25:19.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.680+0000 7f6feb200700 1 -- start start 2024-05-14T15:25:19.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.680+0000 7f6feb200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fec1032e0 0x7f6fec19cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.680+0000 7f6feb200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fec107c10 0x7f6fec19d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.680+0000 7f6feb200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fec108560 0x7f6fec1a1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.680+0000 7f6feb200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec113090 con 0x7f6fec1032e0 2024-05-14T15:25:19.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.680+0000 7f6feb200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec112f10 con 0x7f6fec108560 2024-05-14T15:25:19.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.680+0000 7f6feb200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec113210 con 0x7f6fec107c10 2024-05-14T15:25:19.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.681+0000 7f6fe9e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fec1032e0 0x7f6fec19cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.681+0000 7f6fe9e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fec1032e0 0x7f6fec19cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60658/0 (socket says 172.21.15.69:60658) 2024-05-14T15:25:19.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.681+0000 7f6fe9e00700 1 -- 172.21.15.69:0/2109372367 learned_addr learned my addr 172.21.15.69:0/2109372367 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:19.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.681+0000 7f6fea800700 1 --2- 172.21.15.69:0/2109372367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fec108560 0x7f6fec1a1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.681+0000 7f6fe9e00700 1 -- 172.21.15.69:0/2109372367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fec107c10 msgr2=0x7f6fec19d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.681+0000 7f6fe9400700 1 --2- 172.21.15.69:0/2109372367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fec107c10 0x7f6fec19d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.681+0000 7f6fe9e00700 1 --2- 172.21.15.69:0/2109372367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fec107c10 0x7f6fec19d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.681+0000 7f6fe9e00700 1 -- 172.21.15.69:0/2109372367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fec108560 msgr2=0x7f6fec1a1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.681+0000 7f6fe9e00700 1 --2- 172.21.15.69:0/2109372367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fec108560 0x7f6fec1a1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.681+0000 7f6fe9e00700 1 -- 172.21.15.69:0/2109372367 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fec1a1cb0 con 0x7f6fec1032e0 2024-05-14T15:25:19.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.681+0000 7f6fea800700 1 --2- 172.21.15.69:0/2109372367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fec108560 0x7f6fec1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:25:19.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.682+0000 7f6fe9e00700 1 --2- 172.21.15.69:0/2109372367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fec1032e0 0x7f6fec19cde0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4000c00 tx=0x7f6fe400f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:19.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.682+0000 7f6fe2a00700 1 -- 172.21.15.69:0/2109372367 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe4027070 con 0x7f6fec1032e0 2024-05-14T15:25:19.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.682+0000 7f6fe2a00700 1 -- 172.21.15.69:0/2109372367 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fe400fe50 con 0x7f6fec1032e0 2024-05-14T15:25:19.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.682+0000 7f6fe2a00700 1 -- 172.21.15.69:0/2109372367 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40173f0 con 0x7f6fec1032e0 2024-05-14T15:25:19.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.682+0000 7f6feb200700 1 -- 172.21.15.69:0/2109372367 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fec1a1f40 con 0x7f6fec1032e0 2024-05-14T15:25:19.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.682+0000 7f6feb200700 1 -- 172.21.15.69:0/2109372367 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fec1a2420 con 0x7f6fec1032e0 2024-05-14T15:25:19.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.688+0000 7f6fe2a00700 1 -- 172.21.15.69:0/2109372367 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6fe402a070 con 0x7f6fec1032e0 2024-05-14T15:25:19.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.689+0000 7f6fff8a9b80 1 Processor -- start 2024-05-14T15:25:19.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.689+0000 7f6fff8a9b80 1 -- start start 2024-05-14T15:25:19.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.689+0000 7f6fff8a9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x55855948fd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.689+0000 7f6fff8a9b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490280 0x5585594998e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.689+0000 7f6fff8a9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559490690 0x55855949be30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.689+0000 7f6fff8a9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5585593b1a20 con 0x558559311e40 2024-05-14T15:25:19.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.689+0000 7f6fff8a9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55855934f760 con 0x558559490690 2024-05-14T15:25:19.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.689+0000 7f6fff8a9b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5585593ad9e0 con 0x558559490280 2024-05-14T15:25:19.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.690+0000 7f6fe2a00700 1 --2- 172.21.15.69:0/2109372367 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6fd00b29f0 0x7f6fd00b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.690+0000 7f6fe9e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490280 0x5585594998e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.690+0000 7f6fe9400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559490690 0x55855949be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.690+0000 7f6fea800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x55855948fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.690+0000 7f6fe2a00700 1 -- 172.21.15.69:0/2109372367 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f6fe40e37c0 con 0x7f6fec1032e0 2024-05-14T15:25:19.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.690+0000 7f6fe9e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490280 0x5585594998e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:44534/0 (socket says 172.21.15.69:44534) 2024-05-14T15:25:19.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.690+0000 7f6fe9e00700 1 -- 172.21.15.69:0/884034546 learned_addr learned my addr 172.21.15.69:0/884034546 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:19.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:19 smithi092 ceph-mon[34729]: pgmap v113: 129 pgs: 129 active+clean; 1.1 GiB data, 2.6 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 11 MiB/s wr, 20 op/s 2024-05-14T15:25:19.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.691+0000 7f6fea800700 1 --2- 172.21.15.69:0/2109372367 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6fd00b29f0 0x7f6fd00b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.691+0000 7f6fea800700 1 -- 172.21.15.69:0/884034546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490280 msgr2=0x5585594998e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:19.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.691+0000 7f6fea800700 1 --2- 172.21.15.69:0/884034546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490280 0x5585594998e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.691+0000 7f6fea800700 1 -- 172.21.15.69:0/884034546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559490690 msgr2=0x55855949be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:19.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.691+0000 7f6fea800700 1 --2- 172.21.15.69:0/884034546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559490690 0x55855949be30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.691+0000 7f6fea800700 1 -- 172.21.15.69:0/884034546 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585592fe8d0 con 0x558559311e40 2024-05-14T15:25:19.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.692+0000 7f6fea800700 1 --2- 172.21.15.69:0/884034546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x55855948fd40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc007700 tx=0x7f6fdc007a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dee5ef1117d084b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:19.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.692+0000 7f6fea800700 1 --2- 172.21.15.69:0/2109372367 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6fd00b29f0 0x7f6fd00b4f00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00e000 tx=0x7f6fdc01a000 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:19.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.692+0000 7f6fd7400700 1 -- 172.21.15.69:0/884034546 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc017b20 con 0x558559311e40 2024-05-14T15:25:19.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.692+0000 7f6fd7400700 1 -- 172.21.15.69:0/884034546 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fdc01c070 con 0x558559311e40 2024-05-14T15:25:19.694 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.692+0000 7f6fd7400700 1 -- 172.21.15.69:0/884034546 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fdc020dd0 con 0x558559311e40 2024-05-14T15:25:19.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.693+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/884034546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 msgr2=0x55855948fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.693+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/884034546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x55855948fd40 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc007700 tx=0x7f6fdc007a10 comp rx=0 tx=0).stop 2024-05-14T15:25:19.695 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.694+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/884034546 shutdown_connections 2024-05-14T15:25:19.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.694+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/884034546 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x55855948fd40 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.694+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/884034546 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559490690 0x55855949be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.694+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/884034546 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490280 0x5585594998e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.694+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/884034546 >> 172.21.15.69:0/884034546 conn(0x558559350a80 msgr2=0x55855948ab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:19.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.694+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/884034546 shutdown_connections 2024-05-14T15:25:19.696 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.694+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/884034546 wait complete. 2024-05-14T15:25:19.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.695+0000 7f6fff8a9b80 1 -- start start 2024-05-14T15:25:19.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.695+0000 7f6fff8a9b80 1 Processor -- start 2024-05-14T15:25:19.697 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.695+0000 7f6fff8a9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x5585594a8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.695+0000 7f6fff8a9b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490280 0x5585594a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.696+0000 7f6fff8a9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559490690 0x5585594a2480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.696+0000 7f6fff8a9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55855949c740 con 0x558559311e40 2024-05-14T15:25:19.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.696+0000 7f6fff8a9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558559317b20 con 0x558559490690 2024-05-14T15:25:19.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.696+0000 7f6fff8a9b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55855949c8c0 con 0x558559490280 2024-05-14T15:25:19.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.696+0000 7f6fff8a9b80 10 client.0 _ll_register_callbacks cb 0x558559345380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:19.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.696+0000 7f6fe9e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x5585594a8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.696+0000 7f6fe9e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x5585594a8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60670/0 (socket says 172.21.15.69:60670) 2024-05-14T15:25:19.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.696+0000 7f6fe9e00700 1 -- 172.21.15.69:0/2542284162 learned_addr learned my addr 172.21.15.69:0/2542284162 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:19.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.696+0000 7f6fea800700 1 --2- 172.21.15.69:0/2542284162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559490690 0x5585594a2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.696+0000 7f6fe9400700 1 --2- 172.21.15.69:0/2542284162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490280 0x5585594a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.696+0000 7f6fe9e00700 1 -- 172.21.15.69:0/2542284162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490280 msgr2=0x5585594a85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.696+0000 7f6fe9e00700 1 --2- 172.21.15.69:0/2542284162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490280 0x5585594a85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.696+0000 7f6fe9e00700 1 -- 172.21.15.69:0/2542284162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559490690 msgr2=0x5585594a2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.696+0000 7f6fe9e00700 1 --2- 172.21.15.69:0/2542284162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559490690 0x5585594a2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.697+0000 7f6fe9e00700 1 -- 172.21.15.69:0/2542284162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558559377420 con 0x558559311e40 2024-05-14T15:25:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.697+0000 7f6fe9400700 1 --2- 172.21.15.69:0/2542284162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490280 0x5585594a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:25:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.697+0000 7f6fe9e00700 1 --2- 172.21.15.69:0/2542284162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x5585594a8080 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40e0b00 tx=0x7f6fe4022990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba597f79aa1d139b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.697+0000 7f6fcbe00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.697+0000 7f6fcbe00700 1 -- 172.21.15.69:0/2542284162 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40aa780 con 0x558559311e40 2024-05-14T15:25:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.697+0000 7f6fcbe00700 1 -- 172.21.15.69:0/2542284162 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f6fe40aabf0 con 0x558559311e40 2024-05-14T15:25:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.697+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/2542284162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fdc01c070 con 0x558559311e40 2024-05-14T15:25:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.697+0000 7f6fcbe00700 1 -- 172.21.15.69:0/2542284162 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6fe40aeb30 con 0x558559311e40 2024-05-14T15:25:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.697+0000 7f6fff8a9b80 10 client.16191 fetch_fsmap learned FSMap version 36 2024-05-14T15:25:19.700 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.697+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/2542284162 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x5585594afca0 con 0x558559311e40 2024-05-14T15:25:19.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.698+0000 7f6fcbe00700 1 -- 172.21.15.69:0/2542284162 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fdc01c070 con 0x558559311e40 2024-05-14T15:25:19.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.698+0000 7f6fcbe00700 1 -- 172.21.15.69:0/2542284162 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 36) ==== 8390+0+0 (secure 0 0 0) 0x7f6fe4092070 con 0x558559311e40 2024-05-14T15:25:19.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.698+0000 7f6fff8a9b80 10 client.16191 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T15:25:19.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.698+0000 7f6fff8a9b80 10 client.16191 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:25:19.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.698+0000 7f6fff8a9b80 20 client.16191 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:19.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.698+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/2542284162 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5585594b2320 0x5585594b47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.701 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.698+0000 7f6fff8a9b80 4 client.16191 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:25:19.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.698+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/2542284162 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55855945c070 con 0x5585594b2320 2024-05-14T15:25:19.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.699+0000 7f6fe9400700 1 --2- 172.21.15.69:0/2542284162 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5585594b2320 0x5585594b47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.700+0000 7f6fe9400700 1 --2- 172.21.15.69:0/2542284162 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5585594b2320 0x5585594b47f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c01140945911609 server_cookie=3d557fdbfb254bce in_seq=0 out_seq=0 2024-05-14T15:25:19.702 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.700+0000 7f6fcbe00700 10 client.16191 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:19.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.702+0000 7f6fcbe00700 1 -- 172.21.15.69:0/2542284162 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55855945c070 con 0x5585594b2320 2024-05-14T15:25:19.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.702+0000 7f6fcbe00700 10 client.16191 handle_command_reply: tid=0 2024-05-14T15:25:19.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.702+0000 7f6fff8a9b80 1 client.16191 shutdown 2024-05-14T15:25:19.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.702+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/2542284162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 msgr2=0x5585594a8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.702+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/2542284162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x5585594a8080 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40e0b00 tx=0x7f6fe4022990 comp rx=0 tx=0).stop 2024-05-14T15:25:19.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.702+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/2542284162 shutdown_connections 2024-05-14T15:25:19.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.702+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/2542284162 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5585594b2320 0x5585594b47f0 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.703+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/2542284162 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x5585594a8080 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.703+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/2542284162 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559490690 0x5585594a2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.703+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/2542284162 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490280 0x5585594a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.703+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/2542284162 >> 172.21.15.69:0/2542284162 conn(0x558559350a80 msgr2=0x55855948c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:19.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.703+0000 7f6fcbe00700 0 client.16191 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:19.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.703+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/2542284162 shutdown_connections 2024-05-14T15:25:19.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.703+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/2542284162 wait complete. 2024-05-14T15:25:19.705 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.703+0000 7f6fff8a9b80 20 client.16191 trim_cache size 0 max 16384 2024-05-14T15:25:19.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.722+0000 7f6fff8a9b80 1 Processor -- start 2024-05-14T15:25:19.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.722+0000 7f6fff8a9b80 1 -- start start 2024-05-14T15:25:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.722+0000 7f6fff8a9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x5585594a2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.723+0000 7f6fff8a9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559490280 0x5585594b9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.723+0000 7f6fff8a9b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490690 0x5585594ba4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.723+0000 7f6fff8a9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec1ae0d0 con 0x558559311e40 2024-05-14T15:25:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.723+0000 7f6fff8a9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec1afd60 con 0x558559490280 2024-05-14T15:25:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.723+0000 7f6fff8a9b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec1ae7a0 con 0x558559490690 2024-05-14T15:25:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.723+0000 7f6fe9e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x5585594a2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.723+0000 7f6fe9e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x5585594a2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60686/0 (socket says 172.21.15.69:60686) 2024-05-14T15:25:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.723+0000 7f6fe9e00700 1 -- 172.21.15.69:0/3829579306 learned_addr learned my addr 172.21.15.69:0/3829579306 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:19.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.723+0000 7f6fe9400700 1 --2- 172.21.15.69:0/3829579306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559490280 0x5585594b9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.723+0000 7f6fea800700 1 --2- 172.21.15.69:0/3829579306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490690 0x5585594ba4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.724+0000 7f6fe9e00700 1 -- 172.21.15.69:0/3829579306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490690 msgr2=0x5585594ba4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.724+0000 7f6fe9e00700 1 --2- 172.21.15.69:0/3829579306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490690 0x5585594ba4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.724+0000 7f6fe9e00700 1 -- 172.21.15.69:0/3829579306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559490280 msgr2=0x5585594b9fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.724+0000 7f6fe9e00700 1 --2- 172.21.15.69:0/3829579306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559490280 0x5585594b9fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.724+0000 7f6fe9e00700 1 -- 172.21.15.69:0/3829579306 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5585594a17a0 con 0x558559311e40 2024-05-14T15:25:19.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.724+0000 7f6fe9e00700 1 --2- 172.21.15.69:0/3829579306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x5585594a2440 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40aa710 tx=0x7f6fe40aa680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba3e7503cbf1ab63 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:19.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.724+0000 7f6fd6a00700 1 -- 172.21.15.69:0/3829579306 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40b3550 con 0x558559311e40 2024-05-14T15:25:19.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.724+0000 7f6fd6a00700 1 -- 172.21.15.69:0/3829579306 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fe40aabf0 con 0x558559311e40 2024-05-14T15:25:19.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.724+0000 7f6fd6a00700 1 -- 172.21.15.69:0/3829579306 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fe40e35c0 con 0x558559311e40 2024-05-14T15:25:19.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.725+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/3829579306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 msgr2=0x5585594a2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.725+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/3829579306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x5585594a2440 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f6fe40aa710 tx=0x7f6fe40aa680 comp rx=0 tx=0).stop 2024-05-14T15:25:19.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.725+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/3829579306 shutdown_connections 2024-05-14T15:25:19.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.725+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/3829579306 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559311e40 0x5585594a2440 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.725+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/3829579306 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490690 0x5585594ba4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.725+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/3829579306 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559490280 0x5585594b9fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.725+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/3829579306 >> 172.21.15.69:0/3829579306 conn(0x558559350a80 msgr2=0x5585594a1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:19.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.726+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/3829579306 shutdown_connections 2024-05-14T15:25:19.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.726+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/3829579306 wait complete. 2024-05-14T15:25:19.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.726+0000 7f6fff8a9b80 1 -- start start 2024-05-14T15:25:19.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.726+0000 7f6fff8a9b80 1 Processor -- start 2024-05-14T15:25:19.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.727+0000 7f6fff8a9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559311e40 0x5585594ab140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.727+0000 7f6fff8a9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559490280 0x5585594ab680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.727+0000 7f6fff8a9b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490690 0x55855951ab60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.727+0000 7f6fff8a9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec1af5d0 con 0x558559490280 2024-05-14T15:25:19.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.727+0000 7f6fff8a9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec1aee70 con 0x558559311e40 2024-05-14T15:25:19.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.727+0000 7f6fff8a9b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6fec1ac070 con 0x558559490690 2024-05-14T15:25:19.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.727+0000 7f6fff8a9b80 10 client.0 _ll_register_callbacks cb 0x558559345380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.727+0000 7f6fe9400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559490280 0x5585594ab680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.727+0000 7f6fe9400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559490280 0x5585594ab680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60702/0 (socket says 172.21.15.69:60702) 2024-05-14T15:25:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.727+0000 7f6fe9400700 1 -- 172.21.15.69:0/723098906 learned_addr learned my addr 172.21.15.69:0/723098906 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.728+0000 7f6fe9e00700 1 --2- 172.21.15.69:0/723098906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559311e40 0x5585594ab140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.728+0000 7f6fe9400700 1 -- 172.21.15.69:0/723098906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490690 msgr2=0x55855951ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.728+0000 7f6fe9400700 1 --2- 172.21.15.69:0/723098906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490690 0x55855951ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.728+0000 7f6fe9400700 1 -- 172.21.15.69:0/723098906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559311e40 msgr2=0x5585594ab140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.728+0000 7f6fe9400700 1 --2- 172.21.15.69:0/723098906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559311e40 0x5585594ab140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.728+0000 7f6fe9400700 1 -- 172.21.15.69:0/723098906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55855951b0a0 con 0x558559490280 2024-05-14T15:25:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.728+0000 7f6fe9e00700 1 --2- 172.21.15.69:0/723098906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559311e40 0x5585594ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:25:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.728+0000 7f6fe9400700 1 --2- 172.21.15.69:0/723098906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559490280 0x5585594ab680 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8005950 tx=0x7f6fd80119e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9997b2bb865205ca server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:19.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.728+0000 7f6fcbe00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.729+0000 7f6fcbe00700 1 -- 172.21.15.69:0/723098906 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fd801a760 con 0x558559490280 2024-05-14T15:25:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.729+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/723098906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fe40aabf0 con 0x558559490280 2024-05-14T15:25:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.729+0000 7f6fcbe00700 1 -- 172.21.15.69:0/723098906 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f6fd801a900 con 0x558559490280 2024-05-14T15:25:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.729+0000 7f6fcbe00700 1 -- 172.21.15.69:0/723098906 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f6fd802c050 con 0x558559490280 2024-05-14T15:25:19.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.729+0000 7f6fff8a9b80 10 client.16197 fetch_fsmap learned FSMap version 36 2024-05-14T15:25:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.729+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/723098906 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x55855951c1a0 con 0x558559490280 2024-05-14T15:25:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.730+0000 7f6fcbe00700 1 -- 172.21.15.69:0/723098906 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fe40aabf0 con 0x558559490280 2024-05-14T15:25:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.730+0000 7f6fcbe00700 1 -- 172.21.15.69:0/723098906 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 36) ==== 8390+0+0 (secure 0 0 0) 0x7f6fd8010430 con 0x558559490280 2024-05-14T15:25:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.730+0000 7f6fff8a9b80 10 client.16197 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T15:25:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.730+0000 7f6fff8a9b80 10 client.16197 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:25:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.730+0000 7f6fff8a9b80 20 client.16197 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.730+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/723098906 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55855951c9d0 0x55855951edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.730+0000 7f6fff8a9b80 4 client.16197 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:25:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.730+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/723098906 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5585593bf400 con 0x55855951c9d0 2024-05-14T15:25:19.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.731+0000 7f6fe9e00700 1 --2- 172.21.15.69:0/723098906 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55855951c9d0 0x55855951edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:19.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.732+0000 7f6fe9e00700 1 --2- 172.21.15.69:0/723098906 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55855951c9d0 0x55855951edf0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb04ac53938beb5f server_cookie=64b50147bbfba4b6 in_seq=0 out_seq=0 2024-05-14T15:25:19.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.732+0000 7f6fcbe00700 10 client.16197 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:19.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.732+0000 7f6fcbe00700 1 -- 172.21.15.69:0/723098906 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5585593bf400 con 0x55855951c9d0 2024-05-14T15:25:19.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.732+0000 7f6fcbe00700 10 client.16197 handle_command_reply: tid=0 2024-05-14T15:25:19.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.732+0000 7f6fff8a9b80 1 client.16197 shutdown 2024-05-14T15:25:19.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.732+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/723098906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559490280 msgr2=0x5585594ab680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.732+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/723098906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559490280 0x5585594ab680 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6fd8005950 tx=0x7f6fd80119e0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.733+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/723098906 shutdown_connections 2024-05-14T15:25:19.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.733+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/723098906 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55855951c9d0 0x55855951edf0 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.733+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/723098906 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558559490690 0x55855951ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.733+0000 7f6fcbe00700 0 client.16197 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:19.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.733+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/723098906 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558559311e40 0x5585594ab140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.733+0000 7f6fff8a9b80 1 --2- 172.21.15.69:0/723098906 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558559490280 0x5585594ab680 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.733+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/723098906 >> 172.21.15.69:0/723098906 conn(0x558559350a80 msgr2=0x5585594a0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:19.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.733+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/723098906 shutdown_connections 2024-05-14T15:25:19.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.733+0000 7f6fff8a9b80 1 -- 172.21.15.69:0/723098906 wait complete. 2024-05-14T15:25:19.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.733+0000 7f6fff8a9b80 20 client.16197 trim_cache size 0 max 16384 2024-05-14T15:25:19.736 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:25:19.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.734+0000 7f6feb200700 1 -- 172.21.15.69:0/2109372367 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6fd00b29f0 msgr2=0x7f6fd00b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.734+0000 7f6feb200700 1 --2- 172.21.15.69:0/2109372367 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6fd00b29f0 0x7f6fd00b4f00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6fdc00e000 tx=0x7f6fdc01a000 comp rx=0 tx=0).stop 2024-05-14T15:25:19.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.734+0000 7f6feb200700 1 -- 172.21.15.69:0/2109372367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fec1032e0 msgr2=0x7f6fec19cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:19.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.734+0000 7f6feb200700 1 --2- 172.21.15.69:0/2109372367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fec1032e0 0x7f6fec19cde0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f6fe4000c00 tx=0x7f6fe400f510 comp rx=0 tx=0).stop 2024-05-14T15:25:19.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.735+0000 7f6feb200700 1 -- 172.21.15.69:0/2109372367 shutdown_connections 2024-05-14T15:25:19.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.735+0000 7f6feb200700 1 --2- 172.21.15.69:0/2109372367 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6fd00b29f0 0x7f6fd00b4f00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.735+0000 7f6feb200700 1 --2- 172.21.15.69:0/2109372367 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fec1032e0 0x7f6fec19cde0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.735+0000 7f6feb200700 1 --2- 172.21.15.69:0/2109372367 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fec108560 0x7f6fec1a1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.735+0000 7f6feb200700 1 --2- 172.21.15.69:0/2109372367 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fec107c10 0x7f6fec19d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:19.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.735+0000 7f6feb200700 1 -- 172.21.15.69:0/2109372367 >> 172.21.15.69:0/2109372367 conn(0x7f6fec078ac0 msgr2=0x7f6fec06b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:19.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.735+0000 7f6feb200700 1 -- 172.21.15.69:0/2109372367 shutdown_connections 2024-05-14T15:25:19.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:19.736+0000 7f6feb200700 1 -- 172.21.15.69:0/2109372367 wait complete. 2024-05-14T15:25:21.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:21 smithi069 ceph-mon[31270]: pgmap v114: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 28 op/s 2024-05-14T15:25:21.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:21 smithi203 ceph-mon[34567]: pgmap v114: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 28 op/s 2024-05-14T15:25:21.702 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:21 smithi092 ceph-mon[34729]: pgmap v114: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 16 MiB/s wr, 28 op/s 2024-05-14T15:25:21.775 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-14T15:25:21.775 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-14T15:25:22.277 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:25:23.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:23 smithi203 ceph-mon[34567]: pgmap v115: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 16 op/s 2024-05-14T15:25:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:23 smithi092 ceph-mon[34729]: pgmap v115: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 16 op/s 2024-05-14T15:25:23.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:23 smithi069 ceph-mon[31270]: pgmap v115: 129 pgs: 129 active+clean; 1.1 GiB data, 2.7 GiB used, 1.0 TiB / 1.0 TiB avail; 9.0 KiB/s rd, 11 MiB/s wr, 16 op/s 2024-05-14T15:25:24.313 INFO:teuthology.orchestra.run.smithi069.stderr:creating primary keys... 2024-05-14T15:25:24.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.762+0000 7f015a800700 1 -- 172.21.15.69:0/3455060274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0154109870 msgr2=0x7f01541111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:24.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.762+0000 7f015a800700 1 --2- 172.21.15.69:0/3455060274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0154109870 0x7f01541111d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f014c00b0d0 tx=0x7f014c00b3e0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.762+0000 7f015a800700 1 -- 172.21.15.69:0/3455060274 shutdown_connections 2024-05-14T15:25:24.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.762+0000 7f015a800700 1 --2- 172.21.15.69:0/3455060274 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0154109870 0x7f01541111d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.762+0000 7f015a800700 1 --2- 172.21.15.69:0/3455060274 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f01541045f0 0x7f0154104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.762+0000 7f015a800700 1 --2- 172.21.15.69:0/3455060274 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0154108f20 0x7f0154109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.762+0000 7f015a800700 1 -- 172.21.15.69:0/3455060274 >> 172.21.15.69:0/3455060274 conn(0x7f0154100040 msgr2=0x7f0154102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:24.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.762+0000 7f015a800700 1 -- 172.21.15.69:0/3455060274 shutdown_connections 2024-05-14T15:25:24.765 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.762+0000 7f015a800700 1 -- 172.21.15.69:0/3455060274 wait complete. 2024-05-14T15:25:24.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.764+0000 7f015a800700 1 Processor -- start 2024-05-14T15:25:24.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.764+0000 7f015a800700 1 -- start start 2024-05-14T15:25:24.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.765+0000 7f015a800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01541045f0 0x7f0154075ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.765+0000 7f015a800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0154108f20 0x7f0154076000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.766 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.765+0000 7f015a800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0154109870 0x7f0154076540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.765+0000 7f015a800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f01541143a0 con 0x7f0154109870 2024-05-14T15:25:24.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.765+0000 7f015a800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0154114220 con 0x7f01541045f0 2024-05-14T15:25:24.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.765+0000 7f015a800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0154114520 con 0x7f0154108f20 2024-05-14T15:25:24.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.765+0000 7f0153e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0154109870 0x7f0154076540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.767 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.765+0000 7f0153e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0154109870 0x7f0154076540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48574/0 (socket says 172.21.15.69:48574) 2024-05-14T15:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.765+0000 7f0153e00700 1 -- 172.21.15.69:0/1013109603 learned_addr learned my addr 172.21.15.69:0/1013109603 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.765+0000 7f0153400700 1 --2- 172.21.15.69:0/1013109603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01541045f0 0x7f0154075ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.765+0000 7f0152a00700 1 --2- 172.21.15.69:0/1013109603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0154108f20 0x7f0154076000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.766+0000 7f0153e00700 1 -- 172.21.15.69:0/1013109603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0154108f20 msgr2=0x7f0154076000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.766+0000 7f0153e00700 1 --2- 172.21.15.69:0/1013109603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0154108f20 0x7f0154076000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.768 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.766+0000 7f0153e00700 1 -- 172.21.15.69:0/1013109603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01541045f0 msgr2=0x7f0154075ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.766+0000 7f0153e00700 1 --2- 172.21.15.69:0/1013109603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01541045f0 0x7f0154075ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.766+0000 7f0153e00700 1 -- 172.21.15.69:0/1013109603 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01541a9110 con 0x7f0154109870 2024-05-14T15:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.767+0000 7f0153e00700 1 --2- 172.21.15.69:0/1013109603 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0154109870 0x7f0154076540 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f014c007d10 tx=0x7f014c007d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.767+0000 7f014be00700 1 -- 172.21.15.69:0/1013109603 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c01f070 con 0x7f0154109870 2024-05-14T15:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.767+0000 7f014be00700 1 -- 172.21.15.69:0/1013109603 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f014c003e10 con 0x7f0154109870 2024-05-14T15:25:24.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.767+0000 7f014be00700 1 -- 172.21.15.69:0/1013109603 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f014c01b740 con 0x7f0154109870 2024-05-14T15:25:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.767+0000 7f015a800700 1 -- 172.21.15.69:0/1013109603 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01541a93a0 con 0x7f0154109870 2024-05-14T15:25:24.770 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.767+0000 7f015a800700 1 -- 172.21.15.69:0/1013109603 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01541a9850 con 0x7f0154109870 2024-05-14T15:25:24.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.774+0000 7f014be00700 1 -- 172.21.15.69:0/1013109603 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f014c022070 con 0x7f0154109870 2024-05-14T15:25:24.776 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.774+0000 7f01693eeb80 1 Processor -- start 2024-05-14T15:25:24.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.775+0000 7f01693eeb80 1 -- start start 2024-05-14T15:25:24.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.775+0000 7f01693eeb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f990b7ec0 0x556f9923b370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.775+0000 7f01693eeb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f9923b8b0 0x556f99235530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.775+0000 7f01693eeb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f99235a70 0x556f99235e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.775+0000 7f01693eeb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x556f99157aa0 con 0x556f9923b8b0 2024-05-14T15:25:24.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.775+0000 7f01693eeb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556f990f57e0 con 0x556f99235a70 2024-05-14T15:25:24.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.775+0000 7f01693eeb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556f99153a60 con 0x556f990b7ec0 2024-05-14T15:25:24.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.776+0000 7f014be00700 1 --2- 172.21.15.69:0/1013109603 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f01380b2a70 0x7f01380b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.778 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.776+0000 7f0153400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f9923b8b0 0x556f99235530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.776+0000 7f0153400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f9923b8b0 0x556f99235530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48576/0 (socket says 172.21.15.69:48576) 2024-05-14T15:25:24.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.776+0000 7f0153400700 1 -- 172.21.15.69:0/2488034599 learned_addr learned my addr 172.21.15.69:0/2488034599 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:24.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.776+0000 7f0152a00700 1 --2- 172.21.15.69:0/2488034599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f990b7ec0 0x556f9923b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.776+0000 7f014be00700 1 -- 172.21.15.69:0/1013109603 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f014c00f020 con 0x7f0154109870 2024-05-14T15:25:24.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.777+0000 7f0153400700 1 -- 172.21.15.69:0/2488034599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f990b7ec0 msgr2=0x556f9923b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:24.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.777+0000 7f0153400700 1 --2- 172.21.15.69:0/2488034599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f990b7ec0 0x556f9923b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.777+0000 7f0153400700 1 -- 172.21.15.69:0/2488034599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f99235a70 msgr2=0x556f99235e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:24.779 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.776+0000 7f0152a00700 1 --2- 172.21.15.69:0/2488034599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f99235a70 0x556f99235e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.777+0000 7f0153e00700 1 --2- 172.21.15.69:0/1013109603 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f01380b2a70 0x7f01380b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.777+0000 7f0153400700 1 --2- 172.21.15.69:0/2488034599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f99235a70 0x556f99235e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.777+0000 7f0153400700 1 -- 172.21.15.69:0/2488034599 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f990a4950 con 0x556f9923b8b0 2024-05-14T15:25:24.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.777+0000 7f0152a00700 1 --2- 172.21.15.69:0/2488034599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f99235a70 0x556f99235e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:25:24.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.778+0000 7f0153400700 1 --2- 172.21.15.69:0/2488034599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f9923b8b0 0x556f99235530 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f014400bd70 tx=0x7f014400f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53594137c42dde48 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:24.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.778+0000 7f0148c00700 1 -- 172.21.15.69:0/2488034599 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0144015070 con 0x556f9923b8b0 2024-05-14T15:25:24.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.778+0000 7f0148c00700 1 -- 172.21.15.69:0/2488034599 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f014400fe50 con 0x556f9923b8b0 2024-05-14T15:25:24.780 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.778+0000 7f0148c00700 1 -- 172.21.15.69:0/2488034599 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01440116c0 con 0x556f9923b8b0 2024-05-14T15:25:24.781 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.780+0000 7f01693eeb80 1 -- 172.21.15.69:0/2488034599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f9923b8b0 msgr2=0x556f99235530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:24.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.780+0000 7f01693eeb80 1 --2- 172.21.15.69:0/2488034599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f9923b8b0 0x556f99235530 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f014400bd70 tx=0x7f014400f640 comp rx=0 tx=0).stop 2024-05-14T15:25:24.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.780+0000 7f0153e00700 1 --2- 172.21.15.69:0/1013109603 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f01380b2a70 0x7f01380b4f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f014c0e12b0 tx=0x7f014c006230 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:24.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.780+0000 7f01693eeb80 1 -- 172.21.15.69:0/2488034599 shutdown_connections 2024-05-14T15:25:24.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.780+0000 7f01693eeb80 1 --2- 172.21.15.69:0/2488034599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f99235a70 0x556f99235e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.780+0000 7f01693eeb80 1 --2- 172.21.15.69:0/2488034599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f990b7ec0 0x556f9923b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.780+0000 7f01693eeb80 1 --2- 172.21.15.69:0/2488034599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f9923b8b0 0x556f99235530 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.782 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.780+0000 7f01693eeb80 1 -- 172.21.15.69:0/2488034599 >> 172.21.15.69:0/2488034599 conn(0x556f990fcff0 msgr2=0x556f99230350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:24.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.781+0000 7f01693eeb80 1 -- 172.21.15.69:0/2488034599 shutdown_connections 2024-05-14T15:25:24.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.781+0000 7f01693eeb80 1 -- 172.21.15.69:0/2488034599 wait complete. 2024-05-14T15:25:24.783 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.782+0000 7f01693eeb80 1 -- start start 2024-05-14T15:25:24.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.782+0000 7f01693eeb80 1 Processor -- start 2024-05-14T15:25:24.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.783+0000 7f01693eeb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f990b7ec0 0x556f9923efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.783+0000 7f01693eeb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f99235a70 0x556f9923f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.785 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.783+0000 7f01693eeb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f9923b8b0 0x556f9923fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.783+0000 7f01693eeb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x556f99242390 con 0x556f990b7ec0 2024-05-14T15:25:24.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.783+0000 7f01693eeb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556f990bdba0 con 0x556f9923b8b0 2024-05-14T15:25:24.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.783+0000 7f01693eeb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556f99242510 con 0x556f99235a70 2024-05-14T15:25:24.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.783+0000 7f01693eeb80 10 client.0 _ll_register_callbacks cb 0x556f990fecf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:24.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.784+0000 7f0152a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f990b7ec0 0x556f9923efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.784+0000 7f0152a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f990b7ec0 0x556f9923efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48578/0 (socket says 172.21.15.69:48578) 2024-05-14T15:25:24.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.784+0000 7f0152a00700 1 -- 172.21.15.69:0/1069719057 learned_addr learned my addr 172.21.15.69:0/1069719057 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:24.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.784+0000 7f0153400700 1 --2- 172.21.15.69:0/1069719057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f99235a70 0x556f9923f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.784+0000 7f0152a00700 1 --2- 172.21.15.69:0/1069719057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f9923b8b0 0x556f9923fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.785+0000 7f0152a00700 1 -- 172.21.15.69:0/1069719057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f99235a70 msgr2=0x556f9923f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:24.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.785+0000 7f0152a00700 1 --2- 172.21.15.69:0/1069719057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f99235a70 0x556f9923f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.785+0000 7f0152a00700 1 -- 172.21.15.69:0/1069719057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f9923b8b0 msgr2=0x556f9923fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:24.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.785+0000 7f0152a00700 1 --2- 172.21.15.69:0/1069719057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f9923b8b0 0x556f9923fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.785+0000 7f0152a00700 1 -- 172.21.15.69:0/1069719057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f9911d4a0 con 0x556f990b7ec0 2024-05-14T15:25:24.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.785+0000 7f0152a00700 1 --2- 172.21.15.69:0/1069719057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f990b7ec0 0x556f9923efe0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0140007fa0 tx=0x7f01400078f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5459765a2ae50f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:24.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.785+0000 7f013d600700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:24.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.786+0000 7f013d600700 1 -- 172.21.15.69:0/1069719057 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140004260 con 0x556f990b7ec0 2024-05-14T15:25:24.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.786+0000 7f013d600700 1 -- 172.21.15.69:0/1069719057 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f0140004400 con 0x556f990b7ec0 2024-05-14T15:25:24.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.786+0000 7f01693eeb80 1 -- 172.21.15.69:0/1069719057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f014400fe50 con 0x556f990b7ec0 2024-05-14T15:25:24.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.786+0000 7f013d600700 1 -- 172.21.15.69:0/1069719057 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0140026050 con 0x556f990b7ec0 2024-05-14T15:25:24.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.786+0000 7f01693eeb80 10 client.16209 fetch_fsmap learned FSMap version 36 2024-05-14T15:25:24.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.786+0000 7f01693eeb80 1 -- 172.21.15.69:0/1069719057 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x556f9924ce40 con 0x556f990b7ec0 2024-05-14T15:25:24.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.787+0000 7f013d600700 1 -- 172.21.15.69:0/1069719057 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f014400fe50 con 0x556f990b7ec0 2024-05-14T15:25:24.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.787+0000 7f013d600700 1 -- 172.21.15.69:0/1069719057 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 36) ==== 8390+0+0 (secure 0 0 0) 0x7f014001f060 con 0x556f990b7ec0 2024-05-14T15:25:24.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.787+0000 7f01693eeb80 10 client.16209 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T15:25:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.787+0000 7f01693eeb80 10 client.16209 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:25:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.787+0000 7f01693eeb80 20 client.16209 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.787+0000 7f01693eeb80 1 --2- 172.21.15.69:0/1069719057 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x556f9924f480 0x556f992518a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.787+0000 7f01693eeb80 4 client.16209 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:25:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.787+0000 7f01693eeb80 1 -- 172.21.15.69:0/1069719057 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556f99202240 con 0x556f9924f480 2024-05-14T15:25:24.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.788+0000 7f0153400700 1 --2- 172.21.15.69:0/1069719057 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x556f9924f480 0x556f992518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.789+0000 7f0153400700 1 --2- 172.21.15.69:0/1069719057 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x556f9924f480 0x556f992518a0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0e25633b38cac23 server_cookie=724a1374715ffaa7 in_seq=0 out_seq=0 2024-05-14T15:25:24.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.789+0000 7f013d600700 10 client.16209 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:24.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.791+0000 7f013d600700 1 -- 172.21.15.69:0/1069719057 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556f99202240 con 0x556f9924f480 2024-05-14T15:25:24.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.791+0000 7f013d600700 10 client.16209 handle_command_reply: tid=0 2024-05-14T15:25:24.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.791+0000 7f01693eeb80 1 client.16209 shutdown 2024-05-14T15:25:24.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.792+0000 7f01693eeb80 1 -- 172.21.15.69:0/1069719057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f990b7ec0 msgr2=0x556f9923efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:24.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.792+0000 7f01693eeb80 1 --2- 172.21.15.69:0/1069719057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f990b7ec0 0x556f9923efe0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0140007fa0 tx=0x7f01400078f0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.792+0000 7f01693eeb80 1 -- 172.21.15.69:0/1069719057 shutdown_connections 2024-05-14T15:25:24.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.792+0000 7f01693eeb80 1 --2- 172.21.15.69:0/1069719057 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x556f9924f480 0x556f992518a0 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.792+0000 7f01693eeb80 1 --2- 172.21.15.69:0/1069719057 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f990b7ec0 0x556f9923efe0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.794 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.792+0000 7f01693eeb80 1 --2- 172.21.15.69:0/1069719057 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f9923b8b0 0x556f9923fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.792+0000 7f01693eeb80 1 --2- 172.21.15.69:0/1069719057 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f99235a70 0x556f9923f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.792+0000 7f01693eeb80 1 -- 172.21.15.69:0/1069719057 >> 172.21.15.69:0/1069719057 conn(0x556f990fcff0 msgr2=0x556f99234520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:24.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.792+0000 7f013d600700 0 client.16209 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:24.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.793+0000 7f01693eeb80 1 -- 172.21.15.69:0/1069719057 shutdown_connections 2024-05-14T15:25:24.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.793+0000 7f01693eeb80 1 -- 172.21.15.69:0/1069719057 wait complete. 2024-05-14T15:25:24.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.793+0000 7f01693eeb80 20 client.16209 trim_cache size 0 max 16384 2024-05-14T15:25:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.816+0000 7f01693eeb80 1 Processor -- start 2024-05-14T15:25:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.816+0000 7f01693eeb80 1 -- start start 2024-05-14T15:25:24.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.817+0000 7f01693eeb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f990b7ec0 0x556f99235530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.817+0000 7f01693eeb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f99235a70 0x556f99239760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.817+0000 7f01693eeb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f9923b8b0 0x556f9924b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.817+0000 7f01693eeb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f01541b2840 con 0x556f9923b8b0 2024-05-14T15:25:24.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.817+0000 7f01693eeb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f01541b44d0 con 0x556f990b7ec0 2024-05-14T15:25:24.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.817+0000 7f01693eeb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f01541b2f10 con 0x556f99235a70 2024-05-14T15:25:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.817+0000 7f0152a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f9923b8b0 0x556f9924b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.817+0000 7f0152a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f9923b8b0 0x556f9924b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48584/0 (socket says 172.21.15.69:48584) 2024-05-14T15:25:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.817+0000 7f0152a00700 1 -- 172.21.15.69:0/2028567822 learned_addr learned my addr 172.21.15.69:0/2028567822 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.818+0000 7f0153400700 1 --2- 172.21.15.69:0/2028567822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f99235a70 0x556f99239760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.818+0000 7f0152a00700 1 --2- 172.21.15.69:0/2028567822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f990b7ec0 0x556f99235530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.818+0000 7f0152a00700 1 -- 172.21.15.69:0/2028567822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f99235a70 msgr2=0x556f99239760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:24.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.818+0000 7f0152a00700 1 --2- 172.21.15.69:0/2028567822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f99235a70 0x556f99239760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.818+0000 7f0152a00700 1 -- 172.21.15.69:0/2028567822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f990b7ec0 msgr2=0x556f99235530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:24.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.818+0000 7f0152a00700 1 --2- 172.21.15.69:0/2028567822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f990b7ec0 0x556f99235530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.818+0000 7f0152a00700 1 -- 172.21.15.69:0/2028567822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556f99231070 con 0x556f9923b8b0 2024-05-14T15:25:24.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.818+0000 7f0152a00700 1 --2- 172.21.15.69:0/2028567822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f9923b8b0 0x556f9924b410 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0140014680 tx=0x7f0140007fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1120e879ca79f47d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:24.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.819+0000 7f013fe00700 1 -- 172.21.15.69:0/2028567822 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140007500 con 0x556f9923b8b0 2024-05-14T15:25:24.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.819+0000 7f013fe00700 1 -- 172.21.15.69:0/2028567822 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0140003ca0 con 0x556f9923b8b0 2024-05-14T15:25:24.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.819+0000 7f013fe00700 1 -- 172.21.15.69:0/2028567822 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140005020 con 0x556f9923b8b0 2024-05-14T15:25:24.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.820+0000 7f01693eeb80 1 -- 172.21.15.69:0/2028567822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f9923b8b0 msgr2=0x556f9924b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:24.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.820+0000 7f01693eeb80 1 --2- 172.21.15.69:0/2028567822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f9923b8b0 0x556f9924b410 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0140014680 tx=0x7f0140007fd0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.820+0000 7f01693eeb80 1 -- 172.21.15.69:0/2028567822 shutdown_connections 2024-05-14T15:25:24.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.820+0000 7f01693eeb80 1 --2- 172.21.15.69:0/2028567822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f9923b8b0 0x556f9924b410 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.820+0000 7f01693eeb80 1 --2- 172.21.15.69:0/2028567822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f990b7ec0 0x556f99235530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.820+0000 7f01693eeb80 1 --2- 172.21.15.69:0/2028567822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f99235a70 0x556f99239760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.820+0000 7f01693eeb80 1 -- 172.21.15.69:0/2028567822 >> 172.21.15.69:0/2028567822 conn(0x556f990fcff0 msgr2=0x556f9923a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:24.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.820+0000 7f01693eeb80 1 -- 172.21.15.69:0/2028567822 shutdown_connections 2024-05-14T15:25:24.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.821+0000 7f01693eeb80 1 -- 172.21.15.69:0/2028567822 wait complete. 2024-05-14T15:25:24.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.821+0000 7f01693eeb80 1 -- start start 2024-05-14T15:25:24.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.821+0000 7f01693eeb80 1 Processor -- start 2024-05-14T15:25:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.822+0000 7f01693eeb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f990b7ec0 0x556f99247990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.822+0000 7f01693eeb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f99235a70 0x556f99244760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.822+0000 7f01693eeb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f9923b8b0 0x556f99244ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.822+0000 7f01693eeb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f01541b3d40 con 0x556f990b7ec0 2024-05-14T15:25:24.824 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.822+0000 7f01693eeb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f01541b35e0 con 0x556f99235a70 2024-05-14T15:25:24.825 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.822+0000 7f01693eeb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f01541b07e0 con 0x556f9923b8b0 2024-05-14T15:25:24.825 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.822+0000 7f01693eeb80 10 client.0 _ll_register_callbacks cb 0x556f990fecf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:24.825 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.823+0000 7f0152a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f990b7ec0 0x556f99247990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.825 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.823+0000 7f0152a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f990b7ec0 0x556f99247990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48592/0 (socket says 172.21.15.69:48592) 2024-05-14T15:25:24.825 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.823+0000 7f0152a00700 1 -- 172.21.15.69:0/3343539225 learned_addr learned my addr 172.21.15.69:0/3343539225 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:24.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.823+0000 7f0152a00700 1 --2- 172.21.15.69:0/3343539225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f9923b8b0 0x556f99244ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.823+0000 7f0152a00700 1 -- 172.21.15.69:0/3343539225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f9923b8b0 msgr2=0x556f99244ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:24.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.823+0000 7f0152a00700 1 --2- 172.21.15.69:0/3343539225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f9923b8b0 0x556f99244ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.823+0000 7f0152a00700 1 -- 172.21.15.69:0/3343539225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f99235a70 msgr2=0x556f99244760 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:25:24.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.823+0000 7f0152a00700 1 --2- 172.21.15.69:0/3343539225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f99235a70 0x556f99244760 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.823+0000 7f0152a00700 1 -- 172.21.15.69:0/3343539225 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556f992451e0 con 0x556f990b7ec0 2024-05-14T15:25:24.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.824+0000 7f0152a00700 1 --2- 172.21.15.69:0/3343539225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f990b7ec0 0x556f99247990 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0140005a60 tx=0x7f0140007ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44d0e602ca18dd0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:24.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.824+0000 7f013d600700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:24.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.824+0000 7f013d600700 1 -- 172.21.15.69:0/3343539225 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0140005300 con 0x556f990b7ec0 2024-05-14T15:25:24.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.824+0000 7f013d600700 1 -- 172.21.15.69:0/3343539225 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f01400054a0 con 0x556f990b7ec0 2024-05-14T15:25:24.826 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.824+0000 7f01693eeb80 1 -- 172.21.15.69:0/3343539225 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0140003ca0 con 0x556f990b7ec0 2024-05-14T15:25:24.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.825+0000 7f013d600700 1 -- 172.21.15.69:0/3343539225 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=36) ==== 24+0+0 (secure 0 0 0) 0x7f0140003890 con 0x556f990b7ec0 2024-05-14T15:25:24.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.825+0000 7f01693eeb80 10 client.16215 fetch_fsmap learned FSMap version 36 2024-05-14T15:25:24.827 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.825+0000 7f01693eeb80 1 -- 172.21.15.69:0/3343539225 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=36,monmap=4+}) -- 0x556f992ba820 con 0x556f990b7ec0 2024-05-14T15:25:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.825+0000 7f013d600700 1 -- 172.21.15.69:0/3343539225 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0140003ca0 con 0x556f990b7ec0 2024-05-14T15:25:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.825+0000 7f013d600700 1 -- 172.21.15.69:0/3343539225 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 36) ==== 8390+0+0 (secure 0 0 0) 0x7f0140037020 con 0x556f990b7ec0 2024-05-14T15:25:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.826+0000 7f01693eeb80 10 client.16215 fetch_fsmap finished waiting for FSMap version 36 2024-05-14T15:25:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.826+0000 7f01693eeb80 10 client.16215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:25:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.826+0000 7f01693eeb80 20 client.16215 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.826+0000 7f01693eeb80 1 --2- 172.21.15.69:0/3343539225 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x556f992bae20 0x556f992bd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.826+0000 7f01693eeb80 4 client.16215 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-14T15:25:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.826+0000 7f01693eeb80 1 -- 172.21.15.69:0/3343539225 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556f99165480 con 0x556f992bae20 2024-05-14T15:25:24.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.827+0000 7f0153400700 1 --2- 172.21.15.69:0/3343539225 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x556f992bae20 0x556f992bd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.828+0000 7f0153400700 1 --2- 172.21.15.69:0/3343539225 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x556f992bae20 0x556f992bd240 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4f4f2ba1f037dac7 server_cookie=864b02b1b411f11a in_seq=0 out_seq=0 2024-05-14T15:25:24.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.828+0000 7f013d600700 10 client.16215 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:24.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.830+0000 7f013d600700 1 -- 172.21.15.69:0/3343539225 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556f99165480 con 0x556f992bae20 2024-05-14T15:25:24.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.830+0000 7f013d600700 10 client.16215 handle_command_reply: tid=0 2024-05-14T15:25:24.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.831+0000 7f01693eeb80 1 client.16215 shutdown 2024-05-14T15:25:24.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.831+0000 7f01693eeb80 1 -- 172.21.15.69:0/3343539225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f990b7ec0 msgr2=0x556f99247990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:24.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.831+0000 7f01693eeb80 1 --2- 172.21.15.69:0/3343539225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f990b7ec0 0x556f99247990 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f0140005a60 tx=0x7f0140007ef0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.831+0000 7f01693eeb80 1 -- 172.21.15.69:0/3343539225 shutdown_connections 2024-05-14T15:25:24.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.831+0000 7f01693eeb80 1 --2- 172.21.15.69:0/3343539225 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x556f992bae20 0x556f992bd240 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.831+0000 7f01693eeb80 1 --2- 172.21.15.69:0/3343539225 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556f990b7ec0 0x556f99247990 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.831+0000 7f01693eeb80 1 --2- 172.21.15.69:0/3343539225 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556f9923b8b0 0x556f99244ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.831+0000 7f01693eeb80 1 --2- 172.21.15.69:0/3343539225 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556f99235a70 0x556f99244760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.831+0000 7f01693eeb80 1 -- 172.21.15.69:0/3343539225 >> 172.21.15.69:0/3343539225 conn(0x556f990fcff0 msgr2=0x556f9923a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.831+0000 7f013d600700 0 client.16215 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.831+0000 7f01693eeb80 1 -- 172.21.15.69:0/3343539225 shutdown_connections 2024-05-14T15:25:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.831+0000 7f01693eeb80 1 -- 172.21.15.69:0/3343539225 wait complete. 2024-05-14T15:25:24.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.832+0000 7f01693eeb80 20 client.16215 trim_cache size 0 max 16384 2024-05-14T15:25:24.834 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:25:24.834 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2024-05-14T15:25:24.834 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "d854f8de-2022-47bf-ad43-7dae13f5e9f8", 2024-05-14T15:25:24.835 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2024-05-14T15:25:24.835 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:25:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.832+0000 7f015a800700 1 -- 172.21.15.69:0/1013109603 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f01380b2a70 msgr2=0x7f01380b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.832+0000 7f015a800700 1 --2- 172.21.15.69:0/1013109603 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f01380b2a70 0x7f01380b4f80 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f014c0e12b0 tx=0x7f014c006230 comp rx=0 tx=0).stop 2024-05-14T15:25:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.832+0000 7f015a800700 1 -- 172.21.15.69:0/1013109603 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0154109870 msgr2=0x7f0154076540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:24.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.832+0000 7f015a800700 1 --2- 172.21.15.69:0/1013109603 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0154109870 0x7f0154076540 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f014c007d10 tx=0x7f014c007d40 comp rx=0 tx=0).stop 2024-05-14T15:25:24.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.833+0000 7f015a800700 1 -- 172.21.15.69:0/1013109603 shutdown_connections 2024-05-14T15:25:24.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.833+0000 7f015a800700 1 --2- 172.21.15.69:0/1013109603 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f01380b2a70 0x7f01380b4f80 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.833+0000 7f015a800700 1 --2- 172.21.15.69:0/1013109603 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0154109870 0x7f0154076540 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.833+0000 7f015a800700 1 --2- 172.21.15.69:0/1013109603 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f01541045f0 0x7f0154075ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.833+0000 7f015a800700 1 --2- 172.21.15.69:0/1013109603 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0154108f20 0x7f0154076000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:24.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.833+0000 7f015a800700 1 -- 172.21.15.69:0/1013109603 >> 172.21.15.69:0/1013109603 conn(0x7f0154100040 msgr2=0x7f0154108690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:24.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.833+0000 7f015a800700 1 -- 172.21.15.69:0/1013109603 shutdown_connections 2024-05-14T15:25:24.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:24.833+0000 7f015a800700 1 -- 172.21.15.69:0/1013109603 wait complete. 2024-05-14T15:25:25.193 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:25:24 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b[64556]: 2024-05-14T15:25:24.874+0000 7f1329000700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001b [...3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical/ auth{1=1,2=1,3=1,4=1} v634 ap=2 f(v10 m2024-05-14T15:22:33.427523+0000 3=1+2) n(v3 rc2024-05-14T15:22:33.427523+0000 b8 4=1+3) (inest sync->mix g=1,2,3,4) caps={25000=pAsLsXsFs/-@53} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55799700a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001b:[<0x10000000006/pg_logical v46>,<0x10000000005/data v96>,<0x10000000003/postgres v21>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v37>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v46>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000001b:[<0x10000000006/pg_logical v634>,<0x10000000005/data v620>,<0x10000000003/postgres v234>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v250>,<0x10000000001/sv_0 v270>,<0x10000000000/qa v260>,<0x1/volumes v243>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-14T15:22:33.396239+0000 4=2+2)","ondisk_value.rstat":"n(v0 rc2024-05-14T15:22:33.427523+0000 b8 4=1+3)","memory_value.dirstat":"f(v10 m2024-05-14T15:22:33.427523+0000 3=1+2)","memory_value.rstat":"n(v3 rc2024-05-14T15:22:33.427523+0000 b8 4=1+3)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-14T15:25:25.423 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:25 smithi069 ceph-mon[31270]: pgmap v116: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 MiB/s wr, 29 op/s 2024-05-14T15:25:25.423 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:25 smithi069 ceph-mon[31270]: scrub queued for path: / 2024-05-14T15:25:25.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:25 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:25 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:25:25.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:25 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:25:25.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:25 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:25 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:25:25.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:25 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:25 smithi069 ceph-mon[31270]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2024-05-14T15:25:25.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:25 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:25:25.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:25 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:25 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:25:25.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:25 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.424 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:25 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:25 smithi203 ceph-mon[34567]: pgmap v116: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 MiB/s wr, 29 op/s 2024-05-14T15:25:25.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:25 smithi203 ceph-mon[34567]: scrub queued for path: / 2024-05-14T15:25:25.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:25 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:25 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:25:25.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:25 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:25:25.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:25 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:25 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:25:25.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:25 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:25 smithi203 ceph-mon[34567]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2024-05-14T15:25:25.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:25 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:25:25.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:25 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:25 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:25:25.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:25 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:25 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:25 smithi092 ceph-mon[34729]: pgmap v116: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 18 MiB/s wr, 29 op/s 2024-05-14T15:25:25.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:25 smithi092 ceph-mon[34729]: scrub queued for path: / 2024-05-14T15:25:25.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:25 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:25 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:25:25.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:25 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:25:25.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:25 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:25 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:25:25.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:25 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:25 smithi092 ceph-mon[34729]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2024-05-14T15:25:25.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:25 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:25:25.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:25 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:25 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:25:25.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:25 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:25 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:25.972 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T15:25:26.459 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:25:26.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:25:26.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:25:26.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:25:26.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:25:26.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:25:26.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:25:26.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:25:26.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:25:26.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:25:26.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:26 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.614 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:25:26.614 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.614 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:25:26.614 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.614 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:25:26.614 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:25:26.614 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.614 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:25:26.615 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.615 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.615 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:25:26.615 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:25:26.615 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.615 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:25:26.615 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:25:26.615 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.615 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.615 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:26 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:25:26.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:25:26.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:25:26.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:25:26.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:25:26.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:25:26.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:25:26.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:25:26.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:25:26.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:26.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:26 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:25:27.507 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:27 smithi069 ceph-mon[31270]: pgmap v117: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 20 op/s 2024-05-14T15:25:27.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:27 smithi203 ceph-mon[34567]: pgmap v117: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 20 op/s 2024-05-14T15:25:27.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:27 smithi092 ceph-mon[34729]: pgmap v117: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 20 op/s 2024-05-14T15:25:28.532 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:28 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:28.533 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:28 smithi069 ceph-mon[31270]: pgmap v118: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 20 op/s 2024-05-14T15:25:28.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:28 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:28.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:28 smithi203 ceph-mon[34567]: pgmap v118: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 20 op/s 2024-05-14T15:25:28.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:28 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:28.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:28 smithi092 ceph-mon[34729]: pgmap v118: 129 pgs: 129 active+clean; 1.2 GiB data, 2.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 13 MiB/s wr, 20 op/s 2024-05-14T15:25:28.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.964+0000 7fe3a8200700 1 -- 172.21.15.69:0/810251594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3a0107e10 msgr2=0x7fe3a0108220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:28.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.964+0000 7fe3a8200700 1 --2- 172.21.15.69:0/810251594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3a0107e10 0x7fe3a0108220 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fe38c0099c0 tx=0x7fe38c009cd0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.964+0000 7fe3a8200700 1 -- 172.21.15.69:0/810251594 shutdown_connections 2024-05-14T15:25:28.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.964+0000 7fe3a8200700 1 --2- 172.21.15.69:0/810251594 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a0108760 0x7fe3a01100c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.964+0000 7fe3a8200700 1 --2- 172.21.15.69:0/810251594 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3a01034e0 0x7fe3a01038f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.964+0000 7fe3a8200700 1 --2- 172.21.15.69:0/810251594 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3a0107e10 0x7fe3a0108220 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.964+0000 7fe3a8200700 1 -- 172.21.15.69:0/810251594 >> 172.21.15.69:0/810251594 conn(0x7fe3a00fef30 msgr2=0x7fe3a0101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:28.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.965+0000 7fe3a8200700 1 -- 172.21.15.69:0/810251594 shutdown_connections 2024-05-14T15:25:28.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.965+0000 7fe3a8200700 1 -- 172.21.15.69:0/810251594 wait complete. 2024-05-14T15:25:28.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.966+0000 7fe3a8200700 1 Processor -- start 2024-05-14T15:25:28.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.967+0000 7fe3a8200700 1 -- start start 2024-05-14T15:25:28.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.967+0000 7fe3a8200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3a01034e0 0x7fe3a019cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:28.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.967+0000 7fe3a8200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a0107e10 0x7fe3a019d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:28.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.967+0000 7fe3a8200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3a0108760 0x7fe3a01a1750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:28.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.967+0000 7fe3a8200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a0113220 con 0x7fe3a01034e0 2024-05-14T15:25:28.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.967+0000 7fe3a8200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01130a0 con 0x7fe3a0107e10 2024-05-14T15:25:28.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.967+0000 7fe3a8200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01133a0 con 0x7fe3a0108760 2024-05-14T15:25:28.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.968+0000 7fe3a5800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3a01034e0 0x7fe3a019cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:28.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.968+0000 7fe3a5800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3a01034e0 0x7fe3a019cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48602/0 (socket says 172.21.15.69:48602) 2024-05-14T15:25:28.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.968+0000 7fe3a5800700 1 -- 172.21.15.69:0/2549827666 learned_addr learned my addr 172.21.15.69:0/2549827666 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:28.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.968+0000 7fe3a4e00700 1 --2- 172.21.15.69:0/2549827666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a0107e10 0x7fe3a019d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:28.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.968+0000 7fe3a6200700 1 --2- 172.21.15.69:0/2549827666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3a0108760 0x7fe3a01a1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:28.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.969+0000 7fe3a5800700 1 -- 172.21.15.69:0/2549827666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3a0108760 msgr2=0x7fe3a01a1750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:28.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.969+0000 7fe3a5800700 1 --2- 172.21.15.69:0/2549827666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3a0108760 0x7fe3a01a1750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.969+0000 7fe3a5800700 1 -- 172.21.15.69:0/2549827666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a0107e10 msgr2=0x7fe3a019d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:28.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.969+0000 7fe3a5800700 1 --2- 172.21.15.69:0/2549827666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a0107e10 0x7fe3a019d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.969+0000 7fe3a5800700 1 -- 172.21.15.69:0/2549827666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a01a1df0 con 0x7fe3a01034e0 2024-05-14T15:25:28.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.969+0000 7fe3a5800700 1 --2- 172.21.15.69:0/2549827666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3a01034e0 0x7fe3a019cf20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe39400d950 tx=0x7fe39400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:28.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.969+0000 7fe39e000700 1 -- 172.21.15.69:0/2549827666 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe394016070 con 0x7fe3a01034e0 2024-05-14T15:25:28.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.970+0000 7fe39e000700 1 -- 172.21.15.69:0/2549827666 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe39400fd20 con 0x7fe3a01034e0 2024-05-14T15:25:28.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.970+0000 7fe3a8200700 1 -- 172.21.15.69:0/2549827666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a01a20e0 con 0x7fe3a01034e0 2024-05-14T15:25:28.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.970+0000 7fe39e000700 1 -- 172.21.15.69:0/2549827666 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39400e3b0 con 0x7fe3a01034e0 2024-05-14T15:25:28.971 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.970+0000 7fe3a8200700 1 -- 172.21.15.69:0/2549827666 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3a01a9a00 con 0x7fe3a01034e0 2024-05-14T15:25:28.976 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.975+0000 7fe39e000700 1 -- 172.21.15.69:0/2549827666 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe394019070 con 0x7fe3a01034e0 2024-05-14T15:25:28.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.976+0000 7fe3b6dcfb80 1 Processor -- start 2024-05-14T15:25:28.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.976+0000 7fe39e000700 1 --2- 172.21.15.69:0/2549827666 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe3880b29f0 0x7fe3880b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:28.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.976+0000 7fe3b6dcfb80 1 -- start start 2024-05-14T15:25:28.977 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.977+0000 7fe39e000700 1 -- 172.21.15.69:0/2549827666 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fe3940e2490 con 0x7fe3a01034e0 2024-05-14T15:25:28.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.977+0000 7fe3a6200700 1 --2- 172.21.15.69:0/2549827666 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe3880b29f0 0x7fe3880b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:28.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.977+0000 7fe3b6dcfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304c97e40 0x564304e1b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:28.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.977+0000 7fe3b6dcfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304e1bbf0 0x564304e15710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:28.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.977+0000 7fe3b6dcfb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304e15c50 0x564304e16060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:28.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.977+0000 7fe3b6dcfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564304d37a20 con 0x564304c97e40 2024-05-14T15:25:28.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.977+0000 7fe3b6dcfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564304cd5760 con 0x564304e1bbf0 2024-05-14T15:25:28.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.977+0000 7fe3b6dcfb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564304d339e0 con 0x564304e15c50 2024-05-14T15:25:28.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.978+0000 7fe3a5800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304c97e40 0x564304e1b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:28.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.978+0000 7fe3a5800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304c97e40 0x564304e1b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48614/0 (socket says 172.21.15.69:48614) 2024-05-14T15:25:28.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.978+0000 7fe3a5800700 1 -- 172.21.15.69:0/4068564475 learned_addr learned my addr 172.21.15.69:0/4068564475 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:28.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.978+0000 7fe3a4e00700 1 --2- 172.21.15.69:0/4068564475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304e1bbf0 0x564304e15710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:28.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.978+0000 7fe3a6200700 1 --2- 172.21.15.69:0/2549827666 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe3880b29f0 0x7fe3880b4f00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe398003ee0 tx=0x7fe398009100 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:28.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.978+0000 7fe3a6200700 1 --2- 172.21.15.69:0/4068564475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304e15c50 0x564304e16060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:28.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.979+0000 7fe3a5800700 1 -- 172.21.15.69:0/4068564475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304e15c50 msgr2=0x564304e16060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:28.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.979+0000 7fe3a5800700 1 --2- 172.21.15.69:0/4068564475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304e15c50 0x564304e16060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.979+0000 7fe3a5800700 1 -- 172.21.15.69:0/4068564475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304e1bbf0 msgr2=0x564304e15710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:28.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.979+0000 7fe3a5800700 1 --2- 172.21.15.69:0/4068564475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304e1bbf0 0x564304e15710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.979+0000 7fe3a5800700 1 -- 172.21.15.69:0/4068564475 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564304c848d0 con 0x564304c97e40 2024-05-14T15:25:28.980 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.979+0000 7fe3a5800700 1 --2- 172.21.15.69:0/4068564475 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304c97e40 0x564304e1b6b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe3940a5440 tx=0x7fe3940a8fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f36c6aded80acd4a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:28.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.980+0000 7fe392a00700 1 -- 172.21.15.69:0/4068564475 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe394020070 con 0x564304c97e40 2024-05-14T15:25:28.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.980+0000 7fe392a00700 1 -- 172.21.15.69:0/4068564475 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3940a93c0 con 0x564304c97e40 2024-05-14T15:25:28.981 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.980+0000 7fe392a00700 1 -- 172.21.15.69:0/4068564475 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3940a9620 con 0x564304c97e40 2024-05-14T15:25:28.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.981+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/4068564475 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304c97e40 msgr2=0x564304e1b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:28.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.981+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/4068564475 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304c97e40 0x564304e1b6b0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7fe3940a5440 tx=0x7fe3940a8fa0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.981+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/4068564475 shutdown_connections 2024-05-14T15:25:28.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.981+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/4068564475 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304c97e40 0x564304e1b6b0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.981+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/4068564475 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304e15c50 0x564304e16060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.982 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.981+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/4068564475 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304e1bbf0 0x564304e15710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.981+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/4068564475 >> 172.21.15.69:0/4068564475 conn(0x564304cd6a80 msgr2=0x564304e10790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:28.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.981+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/4068564475 shutdown_connections 2024-05-14T15:25:28.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.982+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/4068564475 wait complete. 2024-05-14T15:25:28.983 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.983+0000 7fe3b6dcfb80 1 -- start start 2024-05-14T15:25:28.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.983+0000 7fe3b6dcfb80 1 Processor -- start 2024-05-14T15:25:28.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.984+0000 7fe3b6dcfb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304c97e40 0x564304e1f460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:28.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.984+0000 7fe3b6dcfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304e15c50 0x564304e1f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:28.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.984+0000 7fe3b6dcfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304e1bbf0 0x564304e1fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:28.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.984+0000 7fe3b6dcfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564304e22600 con 0x564304e15c50 2024-05-14T15:25:28.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.984+0000 7fe3b6dcfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564304c9db20 con 0x564304e1bbf0 2024-05-14T15:25:28.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.984+0000 7fe3b6dcfb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564304e22780 con 0x564304c97e40 2024-05-14T15:25:28.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.984+0000 7fe3b6dcfb80 10 client.0 _ll_register_callbacks cb 0x564304ccb380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:28.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.984+0000 7fe3a4e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304e15c50 0x564304e1f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:28.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.984+0000 7fe3a4e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304e15c50 0x564304e1f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48620/0 (socket says 172.21.15.69:48620) 2024-05-14T15:25:28.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.984+0000 7fe3a4e00700 1 -- 172.21.15.69:0/3633505116 learned_addr learned my addr 172.21.15.69:0/3633505116 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:28.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.984+0000 7fe3a5800700 1 --2- 172.21.15.69:0/3633505116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304c97e40 0x564304e1f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:28.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.984+0000 7fe3a6200700 1 --2- 172.21.15.69:0/3633505116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304e1bbf0 0x564304e1fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:28.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.985+0000 7fe3a4e00700 1 -- 172.21.15.69:0/3633505116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304c97e40 msgr2=0x564304e1f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:28.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.985+0000 7fe3a4e00700 1 --2- 172.21.15.69:0/3633505116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304c97e40 0x564304e1f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.985+0000 7fe3a4e00700 1 -- 172.21.15.69:0/3633505116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304e1bbf0 msgr2=0x564304e1fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:28.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.985+0000 7fe3a4e00700 1 --2- 172.21.15.69:0/3633505116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304e1bbf0 0x564304e1fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.985+0000 7fe3a4e00700 1 -- 172.21.15.69:0/3633505116 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564304cfd420 con 0x564304e15c50 2024-05-14T15:25:28.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.985+0000 7fe3a4e00700 1 --2- 172.21.15.69:0/3633505116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304e15c50 0x564304e1f9a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0076ab0 tx=0x7fe38c009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b35e7005aca1f744 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:28.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.985+0000 7fe387400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:28.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.986+0000 7fe387400700 1 -- 172.21.15.69:0/3633505116 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00bce0 con 0x564304e15c50 2024-05-14T15:25:28.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.986+0000 7fe387400700 1 -- 172.21.15.69:0/3633505116 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fe38c003680 con 0x564304e15c50 2024-05-14T15:25:28.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.986+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/3633505116 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3940a93c0 con 0x564304e15c50 2024-05-14T15:25:28.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.987+0000 7fe387400700 1 -- 172.21.15.69:0/3633505116 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe38c003880 con 0x564304e15c50 2024-05-14T15:25:28.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.987+0000 7fe3b6dcfb80 10 client.16227 fetch_fsmap learned FSMap version 37 2024-05-14T15:25:28.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.987+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/3633505116 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x564304e2d2f0 con 0x564304e15c50 2024-05-14T15:25:28.988 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.988+0000 7fe387400700 1 -- 172.21.15.69:0/3633505116 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3940a93c0 con 0x564304e15c50 2024-05-14T15:25:28.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.988+0000 7fe387400700 1 -- 172.21.15.69:0/3633505116 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fe38c0239e0 con 0x564304e15c50 2024-05-14T15:25:28.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.988+0000 7fe3b6dcfb80 10 client.16227 fetch_fsmap finished waiting for FSMap version 37 2024-05-14T15:25:28.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.988+0000 7fe3b6dcfb80 10 client.16227 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:25:28.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.988+0000 7fe3b6dcfb80 20 client.16227 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:28.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.988+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/3633505116 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564304e2f930 0x564304e31d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:28.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.988+0000 7fe3b6dcfb80 4 client.16227 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:25:28.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.988+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/3633505116 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564304de2070 con 0x564304e2f930 2024-05-14T15:25:28.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.989+0000 7fe3a5800700 1 --2- 172.21.15.69:0/3633505116 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564304e2f930 0x564304e31d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:28.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.990+0000 7fe387400700 10 client.16227 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:28.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.990+0000 7fe3a5800700 1 --2- 172.21.15.69:0/3633505116 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564304e2f930 0x564304e31d50 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46e444ce4d329cdc server_cookie=7042de08aaf4435a in_seq=0 out_seq=0 2024-05-14T15:25:28.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.992+0000 7fe387400700 1 -- 172.21.15.69:0/3633505116 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564304de2070 con 0x564304e2f930 2024-05-14T15:25:28.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.992+0000 7fe387400700 10 client.16227 handle_command_reply: tid=0 2024-05-14T15:25:28.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.992+0000 7fe3b6dcfb80 1 client.16227 shutdown 2024-05-14T15:25:28.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.993+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/3633505116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304e15c50 msgr2=0x564304e1f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:28.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.993+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/3633505116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304e15c50 0x564304e1f9a0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe3a0076ab0 tx=0x7fe38c009640 comp rx=0 tx=0).stop 2024-05-14T15:25:28.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.993+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/3633505116 shutdown_connections 2024-05-14T15:25:28.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.993+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/3633505116 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564304e2f930 0x564304e31d50 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.994 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.993+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/3633505116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304e1bbf0 0x564304e1fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.993+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/3633505116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304c97e40 0x564304e1f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.993+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/3633505116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304e15c50 0x564304e1f9a0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:28.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.993+0000 7fe387400700 0 client.16227 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:28.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.993+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/3633505116 >> 172.21.15.69:0/3633505116 conn(0x564304cd6a80 msgr2=0x564304e14700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:28.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.993+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/3633505116 shutdown_connections 2024-05-14T15:25:28.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.994+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/3633505116 wait complete. 2024-05-14T15:25:28.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:28.994+0000 7fe3b6dcfb80 20 client.16227 trim_cache size 0 max 16384 2024-05-14T15:25:29.025 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.024+0000 7fe3b6dcfb80 1 Processor -- start 2024-05-14T15:25:29.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.025+0000 7fe3b6dcfb80 1 -- start start 2024-05-14T15:25:29.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.025+0000 7fe3b6dcfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304c97e40 0x564304e15710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:29.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.025+0000 7fe3b6dcfb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304e15c50 0x564304e1fe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:29.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.025+0000 7fe3b6dcfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304e1bbf0 0x564304e197b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:29.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.025+0000 7fe3b6dcfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01b2670 con 0x564304c97e40 2024-05-14T15:25:29.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.025+0000 7fe3b6dcfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01b42a0 con 0x564304e1bbf0 2024-05-14T15:25:29.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.025+0000 7fe3b6dcfb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01b2d40 con 0x564304e15c50 2024-05-14T15:25:29.029 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.026+0000 7fe3a5800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304c97e40 0x564304e15710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:29.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.026+0000 7fe3a5800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304c97e40 0x564304e15710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48622/0 (socket says 172.21.15.69:48622) 2024-05-14T15:25:29.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.026+0000 7fe3a5800700 1 -- 172.21.15.69:0/1204358303 learned_addr learned my addr 172.21.15.69:0/1204358303 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:29.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.026+0000 7fe3a6200700 1 --2- 172.21.15.69:0/1204358303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304e1bbf0 0x564304e197b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:29.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.026+0000 7fe3a4e00700 1 --2- 172.21.15.69:0/1204358303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304e15c50 0x564304e1fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:29.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.027+0000 7fe3a5800700 1 -- 172.21.15.69:0/1204358303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304e15c50 msgr2=0x564304e1fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:29.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.027+0000 7fe3a5800700 1 --2- 172.21.15.69:0/1204358303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304e15c50 0x564304e1fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:29.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.027+0000 7fe3a5800700 1 -- 172.21.15.69:0/1204358303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304e1bbf0 msgr2=0x564304e197b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:29.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.027+0000 7fe3a5800700 1 --2- 172.21.15.69:0/1204358303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304e1bbf0 0x564304e197b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:29.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.027+0000 7fe3a5800700 1 -- 172.21.15.69:0/1204358303 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564304e0b0e0 con 0x564304c97e40 2024-05-14T15:25:29.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.027+0000 7fe3a5800700 1 --2- 172.21.15.69:0/1204358303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304c97e40 0x564304e15710 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe3940a9350 tx=0x7fe3940a92c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb17ce8043914657 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:29.030 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.028+0000 7fe392000700 1 -- 172.21.15.69:0/1204358303 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe394020070 con 0x564304c97e40 2024-05-14T15:25:29.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.028+0000 7fe392000700 1 -- 172.21.15.69:0/1204358303 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3940a93c0 con 0x564304c97e40 2024-05-14T15:25:29.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.028+0000 7fe392000700 1 -- 172.21.15.69:0/1204358303 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3940b1ff0 con 0x564304c97e40 2024-05-14T15:25:29.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.029+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/1204358303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304c97e40 msgr2=0x564304e15710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:29.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.029+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/1204358303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304c97e40 0x564304e15710 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7fe3940a9350 tx=0x7fe3940a92c0 comp rx=0 tx=0).stop 2024-05-14T15:25:29.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.029+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/1204358303 shutdown_connections 2024-05-14T15:25:29.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.029+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/1204358303 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304c97e40 0x564304e15710 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:29.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.029+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/1204358303 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304e1bbf0 0x564304e197b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:29.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.029+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/1204358303 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304e15c50 0x564304e1fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:29.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.029+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/1204358303 >> 172.21.15.69:0/1204358303 conn(0x564304cd6a80 msgr2=0x564304e190a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:29.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.030+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/1204358303 shutdown_connections 2024-05-14T15:25:29.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.030+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/1204358303 wait complete. 2024-05-14T15:25:29.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.030+0000 7fe3b6dcfb80 1 -- start start 2024-05-14T15:25:29.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.031+0000 7fe3b6dcfb80 1 Processor -- start 2024-05-14T15:25:29.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.031+0000 7fe3b6dcfb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304c97e40 0x564304e26a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:29.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.031+0000 7fe3b6dcfb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304e15c50 0x564304e26f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:29.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.031+0000 7fe3b6dcfb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304e1bbf0 0x564304e27490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:29.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.031+0000 7fe3b6dcfb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01b3b70 con 0x564304e1bbf0 2024-05-14T15:25:29.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.031+0000 7fe3b6dcfb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01b3410 con 0x564304c97e40 2024-05-14T15:25:29.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.031+0000 7fe3b6dcfb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe3a01b0610 con 0x564304e15c50 2024-05-14T15:25:29.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.031+0000 7fe3b6dcfb80 10 client.0 _ll_register_callbacks cb 0x564304ccb380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:29.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.032+0000 7fe3a6200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304e1bbf0 0x564304e27490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:29.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.032+0000 7fe3a6200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304e1bbf0 0x564304e27490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48632/0 (socket says 172.21.15.69:48632) 2024-05-14T15:25:29.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.032+0000 7fe3a6200700 1 -- 172.21.15.69:0/665209887 learned_addr learned my addr 172.21.15.69:0/665209887 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:29.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.032+0000 7fe3a4e00700 1 --2- 172.21.15.69:0/665209887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304e15c50 0x564304e26f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:29.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.032+0000 7fe3a5800700 1 --2- 172.21.15.69:0/665209887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304c97e40 0x564304e26a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:29.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.033+0000 7fe3a6200700 1 -- 172.21.15.69:0/665209887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304e15c50 msgr2=0x564304e26f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:29.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.033+0000 7fe3a6200700 1 --2- 172.21.15.69:0/665209887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304e15c50 0x564304e26f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:29.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.033+0000 7fe3a6200700 1 -- 172.21.15.69:0/665209887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304c97e40 msgr2=0x564304e26a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:29.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.033+0000 7fe3a6200700 1 --2- 172.21.15.69:0/665209887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304c97e40 0x564304e26a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:29.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.033+0000 7fe3a6200700 1 -- 172.21.15.69:0/665209887 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564304e27b70 con 0x564304e1bbf0 2024-05-14T15:25:29.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.034+0000 7fe3a6200700 1 --2- 172.21.15.69:0/665209887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304e1bbf0 0x564304e27490 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe398008ac0 tx=0x7fe398004b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=781400927214e543 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:29.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.034+0000 7fe387400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:29.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.034+0000 7fe387400700 1 -- 172.21.15.69:0/665209887 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe39801c040 con 0x564304e1bbf0 2024-05-14T15:25:29.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.034+0000 7fe387400700 1 -- 172.21.15.69:0/665209887 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fe398015ad0 con 0x564304e1bbf0 2024-05-14T15:25:29.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.035+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/665209887 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe3940a93c0 con 0x564304e1bbf0 2024-05-14T15:25:29.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.035+0000 7fe387400700 1 -- 172.21.15.69:0/665209887 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fe398036050 con 0x564304e1bbf0 2024-05-14T15:25:29.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.035+0000 7fe3b6dcfb80 10 client.16233 fetch_fsmap learned FSMap version 37 2024-05-14T15:25:29.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.035+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/665209887 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=37,monmap=4+}) -- 0x564304eab8e0 con 0x564304e1bbf0 2024-05-14T15:25:29.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.035+0000 7fe387400700 1 -- 172.21.15.69:0/665209887 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe3940a93c0 con 0x564304e1bbf0 2024-05-14T15:25:29.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.036+0000 7fe387400700 1 -- 172.21.15.69:0/665209887 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 37) ==== 8382+0+0 (secure 0 0 0) 0x7fe398022040 con 0x564304e1bbf0 2024-05-14T15:25:29.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.036+0000 7fe3b6dcfb80 10 client.16233 fetch_fsmap finished waiting for FSMap version 37 2024-05-14T15:25:29.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.036+0000 7fe3b6dcfb80 10 client.16233 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:25:29.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.036+0000 7fe3b6dcfb80 20 client.16233 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:29.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.036+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/665209887 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564304eac030 0x564304eae450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:29.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.036+0000 7fe3b6dcfb80 4 client.16233 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T15:25:29.037 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.036+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/665209887 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564304d45400 con 0x564304eac030 2024-05-14T15:25:29.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.037+0000 7fe3a5800700 1 --2- 172.21.15.69:0/665209887 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564304eac030 0x564304eae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:29.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.038+0000 7fe387400700 10 client.16233 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:29.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.038+0000 7fe3a5800700 1 --2- 172.21.15.69:0/665209887 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564304eac030 0x564304eae450 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6961c20f7ccc333 server_cookie=c48dd9076712ab20 in_seq=0 out_seq=0 2024-05-14T15:25:29.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.038+0000 7fe387400700 1 -- 172.21.15.69:0/665209887 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x564304d45400 con 0x564304eac030 2024-05-14T15:25:29.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.038+0000 7fe387400700 10 client.16233 handle_command_reply: tid=0 2024-05-14T15:25:29.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.038+0000 7fe3b6dcfb80 1 client.16233 shutdown 2024-05-14T15:25:29.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.039+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/665209887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304e1bbf0 msgr2=0x564304e27490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:29.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.039+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/665209887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304e1bbf0 0x564304e27490 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7fe398008ac0 tx=0x7fe398004b40 comp rx=0 tx=0).stop 2024-05-14T15:25:29.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.039+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/665209887 shutdown_connections 2024-05-14T15:25:29.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.039+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/665209887 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564304eac030 0x564304eae450 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:29.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.039+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/665209887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564304e1bbf0 0x564304e27490 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:29.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.039+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/665209887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564304c97e40 0x564304e26a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:29.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.039+0000 7fe3b6dcfb80 1 --2- 172.21.15.69:0/665209887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564304e15c50 0x564304e26f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:29.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.039+0000 7fe387400700 0 client.16233 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:29.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.039+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/665209887 >> 172.21.15.69:0/665209887 conn(0x564304cd6a80 msgr2=0x564304e1fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:29.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.039+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/665209887 shutdown_connections 2024-05-14T15:25:29.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.039+0000 7fe3b6dcfb80 1 -- 172.21.15.69:0/665209887 wait complete. 2024-05-14T15:25:29.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.040+0000 7fe3b6dcfb80 20 client.16233 trim_cache size 0 max 16384 2024-05-14T15:25:29.041 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:25:29.041 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-14T15:25:29.041 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2024-05-14T15:25:29.041 INFO:teuthology.orchestra.run.smithi069.stdout: "d854f8de-2022-47bf-ad43-7dae13f5e9f8": { 2024-05-14T15:25:29.041 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2024-05-14T15:25:29.042 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "d854f8de-2022-47bf-ad43-7dae13f5e9f8", 2024-05-14T15:25:29.042 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2024-05-14T15:25:29.042 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:25:29.042 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:25:29.042 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:25:29.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.040+0000 7fe3a8200700 1 -- 172.21.15.69:0/2549827666 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe3880b29f0 msgr2=0x7fe3880b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:29.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.040+0000 7fe3a8200700 1 --2- 172.21.15.69:0/2549827666 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe3880b29f0 0x7fe3880b4f00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fe398003ee0 tx=0x7fe398009100 comp rx=0 tx=0).stop 2024-05-14T15:25:29.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.040+0000 7fe3a8200700 1 -- 172.21.15.69:0/2549827666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3a01034e0 msgr2=0x7fe3a019cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:29.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.040+0000 7fe3a8200700 1 --2- 172.21.15.69:0/2549827666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3a01034e0 0x7fe3a019cf20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fe39400d950 tx=0x7fe39400dc60 comp rx=0 tx=0).stop 2024-05-14T15:25:29.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.041+0000 7fe3a8200700 1 -- 172.21.15.69:0/2549827666 shutdown_connections 2024-05-14T15:25:29.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.041+0000 7fe3a8200700 1 --2- 172.21.15.69:0/2549827666 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe3880b29f0 0x7fe3880b4f00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:29.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.041+0000 7fe3a8200700 1 --2- 172.21.15.69:0/2549827666 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe3a01034e0 0x7fe3a019cf20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:29.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.041+0000 7fe3a8200700 1 --2- 172.21.15.69:0/2549827666 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe3a0108760 0x7fe3a01a1750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:29.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.041+0000 7fe3a8200700 1 --2- 172.21.15.69:0/2549827666 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe3a0107e10 0x7fe3a019d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:29.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.041+0000 7fe3a8200700 1 -- 172.21.15.69:0/2549827666 >> 172.21.15.69:0/2549827666 conn(0x7fe3a00fef30 msgr2=0x7fe3a0106840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:29.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.041+0000 7fe3a8200700 1 -- 172.21.15.69:0/2549827666 shutdown_connections 2024-05-14T15:25:29.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:25:29.041+0000 7fe3a8200700 1 -- 172.21.15.69:0/2549827666 wait complete. 2024-05-14T15:25:30.251 INFO:tasks.cephfs.filesystem:scrub status for tag:d854f8de-2022-47bf-ad43-7dae13f5e9f8 - {'path': '/', 'tag': 'd854f8de-2022-47bf-ad43-7dae13f5e9f8', 'options': 'recursive,force'} 2024-05-14T15:25:31.270 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:31 smithi069 ceph-mon[31270]: pgmap v119: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 20 MiB/s wr, 103 op/s 2024-05-14T15:25:31.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:31 smithi203 ceph-mon[34567]: pgmap v119: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 20 MiB/s wr, 103 op/s 2024-05-14T15:25:31.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:31 smithi092 ceph-mon[34729]: pgmap v119: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 20 MiB/s wr, 103 op/s 2024-05-14T15:25:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.638+0000 7f7ae9e00640 1 -- 172.21.15.69:0/301393876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4102470 msgr2=0x7f7ae4102880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.638+0000 7f7ae9e00640 1 --2- 172.21.15.69:0/301393876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4102470 0x7f7ae4102880 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009900 tx=0x7f7ad402a420 comp rx=0 tx=0).stop 2024-05-14T15:25:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.638+0000 7f7ae9e00640 1 -- 172.21.15.69:0/301393876 shutdown_connections 2024-05-14T15:25:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.638+0000 7f7ae9e00640 1 --2- 172.21.15.69:0/301393876 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ae4108f70 0x7f7ae41106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.638+0000 7f7ae9e00640 1 --2- 172.21.15.69:0/301393876 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ae41084f0 0x7f7ae4108900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.638+0000 7f7ae9e00640 1 --2- 172.21.15.69:0/301393876 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4102470 0x7f7ae4102880 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.638+0000 7f7ae9e00640 1 -- 172.21.15.69:0/301393876 >> 172.21.15.69:0/301393876 conn(0x7f7ae40779e0 msgr2=0x7f7ae4077e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.638+0000 7f7ae9e00640 1 -- 172.21.15.69:0/301393876 shutdown_connections 2024-05-14T15:25:32.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.638+0000 7f7ae9e00640 1 -- 172.21.15.69:0/301393876 wait complete. 2024-05-14T15:25:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.639+0000 7f7ae9e00640 1 Processor -- start 2024-05-14T15:25:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.639+0000 7f7ae9e00640 1 -- start start 2024-05-14T15:25:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.640+0000 7f7ae9e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4102470 0x7f7ae419a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.640+0000 7f7ae9e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ae41084f0 0x7f7ae419ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.640+0000 7f7ae9e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ae4108f70 0x7f7ae419f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.640+0000 7f7ae9e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae4113dc0 con 0x7f7ae4102470 2024-05-14T15:25:32.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.640+0000 7f7ae9e00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae4113c40 con 0x7f7ae41084f0 2024-05-14T15:25:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.640+0000 7f7ae9e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae4113f40 con 0x7f7ae4108f70 2024-05-14T15:25:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.640+0000 7f7ae2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4102470 0x7f7ae419a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.640+0000 7f7ae2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4102470 0x7f7ae419a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48638/0 (socket says 172.21.15.69:48638) 2024-05-14T15:25:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.640+0000 7f7ae2a00640 1 -- 172.21.15.69:0/2061788810 learned_addr learned my addr 172.21.15.69:0/2061788810 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.640+0000 7f7adbe00640 1 --2- 172.21.15.69:0/2061788810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ae41084f0 0x7f7ae419ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.640+0000 7f7ae3400640 1 --2- 172.21.15.69:0/2061788810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ae4108f70 0x7f7ae419f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.640+0000 7f7ae2a00640 1 -- 172.21.15.69:0/2061788810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ae4108f70 msgr2=0x7f7ae419f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.641+0000 7f7ae2a00640 1 --2- 172.21.15.69:0/2061788810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ae4108f70 0x7f7ae419f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.641+0000 7f7ae2a00640 1 -- 172.21.15.69:0/2061788810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ae41084f0 msgr2=0x7f7ae419ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.641+0000 7f7ae2a00640 1 --2- 172.21.15.69:0/2061788810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ae41084f0 0x7f7ae419ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.641+0000 7f7ae2a00640 1 -- 172.21.15.69:0/2061788810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ae419f5e0 con 0x7f7ae4102470 2024-05-14T15:25:32.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.641+0000 7f7ae3400640 1 --2- 172.21.15.69:0/2061788810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ae4108f70 0x7f7ae419f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:25:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.641+0000 7f7ae2a00640 1 --2- 172.21.15.69:0/2061788810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4102470 0x7f7ae419a800 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009230 tx=0x7f7ad4003d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.641+0000 7f7ae8a00640 1 -- 172.21.15.69:0/2061788810 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad403f070 con 0x7f7ae4102470 2024-05-14T15:25:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.641+0000 7f7ae8a00640 1 -- 172.21.15.69:0/2061788810 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ad403bd00 con 0x7f7ae4102470 2024-05-14T15:25:32.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.641+0000 7f7ae8a00640 1 -- 172.21.15.69:0/2061788810 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4035030 con 0x7f7ae4102470 2024-05-14T15:25:32.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.642+0000 7f7ae9e00640 1 -- 172.21.15.69:0/2061788810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ae419f870 con 0x7f7ae4102470 2024-05-14T15:25:32.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.642+0000 7f7ae9e00640 1 -- 172.21.15.69:0/2061788810 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ae419fd60 con 0x7f7ae4102470 2024-05-14T15:25:32.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.646+0000 7f7af0e22740 1 Processor -- start 2024-05-14T15:25:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.646+0000 7f7af0e22740 1 -- start start 2024-05-14T15:25:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.646+0000 7f7ae8a00640 1 -- 172.21.15.69:0/2061788810 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f7ad4042070 con 0x7f7ae4102470 2024-05-14T15:25:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.646+0000 7f7af0e22740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da558b1b0 0x562da592c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.647+0000 7f7af0e22740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da55622f0 0x562da592c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.647+0000 7f7af0e22740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da556a4d0 0x562da592cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.647+0000 7f7af0e22740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x562da5891550 con 0x562da55622f0 2024-05-14T15:25:32.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.647+0000 7f7af0e22740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562da5836bc0 con 0x562da558b1b0 2024-05-14T15:25:32.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.647+0000 7f7af0e22740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562da588d510 con 0x562da556a4d0 2024-05-14T15:25:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.647+0000 7f7ae2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da55622f0 0x562da592c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.647+0000 7f7ae2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da55622f0 0x562da592c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48640/0 (socket says 172.21.15.69:48640) 2024-05-14T15:25:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.647+0000 7f7ae2a00640 1 -- 172.21.15.69:0/3430048882 learned_addr learned my addr 172.21.15.69:0/3430048882 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.647+0000 7f7ae3400640 1 --2- 172.21.15.69:0/3430048882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da558b1b0 0x562da592c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.647+0000 7f7adbe00640 1 --2- 172.21.15.69:0/3430048882 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da556a4d0 0x562da592cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.648+0000 7f7ae2a00640 1 -- 172.21.15.69:0/3430048882 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da556a4d0 msgr2=0x562da592cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.648+0000 7f7ae2a00640 1 --2- 172.21.15.69:0/3430048882 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da556a4d0 0x562da592cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.648+0000 7f7ae2a00640 1 -- 172.21.15.69:0/3430048882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da558b1b0 msgr2=0x562da592c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.648+0000 7f7ae2a00640 1 --2- 172.21.15.69:0/3430048882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da558b1b0 0x562da592c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.648+0000 7f7ae2a00640 1 -- 172.21.15.69:0/3430048882 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da55a3210 con 0x562da55622f0 2024-05-14T15:25:32.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.648+0000 7f7ae2a00640 1 --2- 172.21.15.69:0/3430048882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da55622f0 0x562da592c7c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7ad41008c0 tx=0x7f7ad4109b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c53bad9a8d1998f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:32.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.648+0000 7f7ae8a00640 1 --2- 172.21.15.69:0/2061788810 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7ac80b2950 0x7f7ac80b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.649+0000 7f7ad3e00640 1 -- 172.21.15.69:0/3430048882 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4112070 con 0x562da55622f0 2024-05-14T15:25:32.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.649+0000 7f7ae8a00640 1 -- 172.21.15.69:0/2061788810 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f7ad41035b0 con 0x7f7ae4102470 2024-05-14T15:25:32.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.649+0000 7f7ad3e00640 1 -- 172.21.15.69:0/3430048882 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ad40c9ff0 con 0x562da55622f0 2024-05-14T15:25:32.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.649+0000 7f7ad3e00640 1 -- 172.21.15.69:0/3430048882 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad40c63a0 con 0x562da55622f0 2024-05-14T15:25:32.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.649+0000 7f7ae3400640 1 --2- 172.21.15.69:0/2061788810 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7ac80b2950 0x7f7ac80b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.650+0000 7f7af0e22740 1 -- 172.21.15.69:0/3430048882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da55622f0 msgr2=0x562da592c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:32.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.650+0000 7f7af0e22740 1 --2- 172.21.15.69:0/3430048882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da55622f0 0x562da592c7c0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f7ad41008c0 tx=0x7f7ad4109b40 comp rx=0 tx=0).stop 2024-05-14T15:25:32.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.650+0000 7f7ae3400640 1 --2- 172.21.15.69:0/2061788810 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7ac80b2950 0x7f7ac80b4e60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x562da59293f0 tx=0x7f7adc0086a0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:32.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.650+0000 7f7af0e22740 1 -- 172.21.15.69:0/3430048882 shutdown_connections 2024-05-14T15:25:32.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.650+0000 7f7af0e22740 1 --2- 172.21.15.69:0/3430048882 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da556a4d0 0x562da592cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.650+0000 7f7af0e22740 1 --2- 172.21.15.69:0/3430048882 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da55622f0 0x562da592c7c0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.650+0000 7f7af0e22740 1 --2- 172.21.15.69:0/3430048882 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da558b1b0 0x562da592c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.650+0000 7f7af0e22740 1 -- 172.21.15.69:0/3430048882 >> 172.21.15.69:0/3430048882 conn(0x562da557f300 msgr2=0x562da5928a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:32.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.650+0000 7f7af0e22740 1 -- 172.21.15.69:0/3430048882 shutdown_connections 2024-05-14T15:25:32.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.650+0000 7f7af0e22740 1 -- 172.21.15.69:0/3430048882 wait complete. 2024-05-14T15:25:32.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.651+0000 7f7af0e22740 1 -- start start 2024-05-14T15:25:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.651+0000 7f7af0e22740 1 Processor -- start 2024-05-14T15:25:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.652+0000 7f7af0e22740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da55622f0 0x562da59366f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.652+0000 7f7af0e22740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da556a4d0 0x562da5936c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.652+0000 7f7af0e22740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da558b1b0 0x562da5942560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.652+0000 7f7af0e22740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x562da5939170 con 0x562da556a4d0 2024-05-14T15:25:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.652+0000 7f7af0e22740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562da584a660 con 0x562da55622f0 2024-05-14T15:25:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.652+0000 7f7af0e22740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562da59392f0 con 0x562da558b1b0 2024-05-14T15:25:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.652+0000 7f7af0e22740 10 client.0 _ll_register_callbacks cb 0x562da5814400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.652+0000 7f7adbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da556a4d0 0x562da5936c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.652+0000 7f7adbe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da556a4d0 0x562da5936c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48642/0 (socket says 172.21.15.69:48642) 2024-05-14T15:25:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.652+0000 7f7adbe00640 1 -- 172.21.15.69:0/2923815180 learned_addr learned my addr 172.21.15.69:0/2923815180 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.652+0000 7f7ae2a00640 1 --2- 172.21.15.69:0/2923815180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da55622f0 0x562da59366f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.653+0000 7f7ae3400640 1 --2- 172.21.15.69:0/2923815180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da558b1b0 0x562da5942560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.653+0000 7f7adbe00640 1 -- 172.21.15.69:0/2923815180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da558b1b0 msgr2=0x562da5942560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:32.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.653+0000 7f7adbe00640 1 --2- 172.21.15.69:0/2923815180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da558b1b0 0x562da5942560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.653+0000 7f7adbe00640 1 -- 172.21.15.69:0/2923815180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da55622f0 msgr2=0x562da59366f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.653+0000 7f7adbe00640 1 --2- 172.21.15.69:0/2923815180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da55622f0 0x562da59366f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.653+0000 7f7adbe00640 1 -- 172.21.15.69:0/2923815180 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562da566f620 con 0x562da556a4d0 2024-05-14T15:25:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.653+0000 7f7adbe00640 1 --2- 172.21.15.69:0/2923815180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da556a4d0 0x562da5936c30 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00bf60 tx=0x7f7acc00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbea91db5a9b862 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.653+0000 7f7ad0c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.653+0000 7f7ad0c00640 1 -- 172.21.15.69:0/2923815180 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc018020 con 0x562da556a4d0 2024-05-14T15:25:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.654+0000 7f7ad0c00640 1 -- 172.21.15.69:0/2923815180 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f7acc014660 con 0x562da556a4d0 2024-05-14T15:25:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.654+0000 7f7af0e22740 1 -- 172.21.15.69:0/2923815180 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ad40c9ff0 con 0x562da556a4d0 2024-05-14T15:25:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.654+0000 7f7ad0c00640 1 -- 172.21.15.69:0/2923815180 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f7acc023050 con 0x562da556a4d0 2024-05-14T15:25:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.654+0000 7f7af0e22740 10 client.16245 fetch_fsmap learned FSMap version 38 2024-05-14T15:25:32.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.654+0000 7f7af0e22740 1 -- 172.21.15.69:0/2923815180 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x562da59452d0 con 0x562da556a4d0 2024-05-14T15:25:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.654+0000 7f7ad0c00640 1 -- 172.21.15.69:0/2923815180 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ad40c9ff0 con 0x562da556a4d0 2024-05-14T15:25:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.655+0000 7f7ad0c00640 1 -- 172.21.15.69:0/2923815180 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 38) ==== 8374+0+0 (secure 0 0 0) 0x7f7acc0139e0 con 0x562da556a4d0 2024-05-14T15:25:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.655+0000 7f7af0e22740 10 client.16245 fetch_fsmap finished waiting for FSMap version 38 2024-05-14T15:25:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.655+0000 7f7af0e22740 10 client.16245 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:25:32.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.655+0000 7f7af0e22740 20 client.16245 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:32.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.655+0000 7f7af0e22740 1 --2- 172.21.15.69:0/2923815180 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562da5549d80 0x562da59487f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.655+0000 7f7af0e22740 4 client.16245 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:25:32.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.655+0000 7f7af0e22740 1 -- 172.21.15.69:0/2923815180 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562da589f160 con 0x562da5549d80 2024-05-14T15:25:32.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.655+0000 7f7ae2a00640 1 --2- 172.21.15.69:0/2923815180 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562da5549d80 0x562da59487f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.656+0000 7f7ad0c00640 10 client.16245 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:32.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.656+0000 7f7ae2a00640 1 --2- 172.21.15.69:0/2923815180 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562da5549d80 0x562da59487f0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5766157e80835250 server_cookie=da337f77ed20b0ff in_seq=0 out_seq=0 2024-05-14T15:25:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.658+0000 7f7ad0c00640 1 -- 172.21.15.69:0/2923815180 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562da589f160 con 0x562da5549d80 2024-05-14T15:25:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.658+0000 7f7ad0c00640 10 client.16245 handle_command_reply: tid=0 2024-05-14T15:25:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.658+0000 7f7af0e22740 1 client.16245 shutdown 2024-05-14T15:25:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.659+0000 7f7af0e22740 1 -- 172.21.15.69:0/2923815180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da556a4d0 msgr2=0x562da5936c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.659+0000 7f7af0e22740 1 --2- 172.21.15.69:0/2923815180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da556a4d0 0x562da5936c30 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00bf60 tx=0x7f7acc00bf90 comp rx=0 tx=0).stop 2024-05-14T15:25:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.659+0000 7f7af0e22740 1 -- 172.21.15.69:0/2923815180 shutdown_connections 2024-05-14T15:25:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.659+0000 7f7af0e22740 1 --2- 172.21.15.69:0/2923815180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da558b1b0 0x562da5942560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.659+0000 7f7af0e22740 1 --2- 172.21.15.69:0/2923815180 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562da5549d80 0x562da59487f0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.659+0000 7f7af0e22740 1 --2- 172.21.15.69:0/2923815180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da556a4d0 0x562da5936c30 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.659+0000 7f7af0e22740 1 --2- 172.21.15.69:0/2923815180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da55622f0 0x562da59366f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.659+0000 7f7af0e22740 1 -- 172.21.15.69:0/2923815180 >> 172.21.15.69:0/2923815180 conn(0x562da557f300 msgr2=0x562da592c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.659+0000 7f7ad0c00640 0 client.16245 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:32.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.659+0000 7f7af0e22740 1 -- 172.21.15.69:0/2923815180 shutdown_connections 2024-05-14T15:25:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.659+0000 7f7af0e22740 1 -- 172.21.15.69:0/2923815180 wait complete. 2024-05-14T15:25:32.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.659+0000 7f7af0e22740 20 client.16245 trim_cache size 0 max 16384 2024-05-14T15:25:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.679+0000 7f7af0e22740 1 Processor -- start 2024-05-14T15:25:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.679+0000 7f7af0e22740 1 -- start start 2024-05-14T15:25:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.679+0000 7f7af0e22740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da55622f0 0x562da592d020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.679+0000 7f7af0e22740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da556a4d0 0x562da592e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.679+0000 7f7af0e22740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da558b1b0 0x562da594dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.679+0000 7f7af0e22740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41b1260 con 0x562da55622f0 2024-05-14T15:25:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.679+0000 7f7af0e22740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41b2e30 con 0x562da558b1b0 2024-05-14T15:25:32.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.679+0000 7f7af0e22740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41b1930 con 0x562da556a4d0 2024-05-14T15:25:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.679+0000 7f7ae2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da55622f0 0x562da592d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.679+0000 7f7ae2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da55622f0 0x562da592d020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48650/0 (socket says 172.21.15.69:48650) 2024-05-14T15:25:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.679+0000 7f7ae2a00640 1 -- 172.21.15.69:0/3460494734 learned_addr learned my addr 172.21.15.69:0/3460494734 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.680+0000 7f7ae3400640 1 --2- 172.21.15.69:0/3460494734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da558b1b0 0x562da594dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.680+0000 7f7ae2a00640 1 -- 172.21.15.69:0/3460494734 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da556a4d0 msgr2=0x562da592e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.680+0000 7f7ae2a00640 1 --2- 172.21.15.69:0/3460494734 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da556a4d0 0x562da592e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.680+0000 7f7ae2a00640 1 -- 172.21.15.69:0/3460494734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da558b1b0 msgr2=0x562da594dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.680+0000 7f7ae2a00640 1 --2- 172.21.15.69:0/3460494734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da558b1b0 0x562da594dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.680+0000 7f7ae2a00640 1 -- 172.21.15.69:0/3460494734 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562da5931190 con 0x562da55622f0 2024-05-14T15:25:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.680+0000 7f7ae2a00640 1 --2- 172.21.15.69:0/3460494734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da55622f0 0x562da592d020 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40c6560 tx=0x7f7ad402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705253e398bb65b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.681+0000 7f7ad3400640 1 -- 172.21.15.69:0/3460494734 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4112040 con 0x562da55622f0 2024-05-14T15:25:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.681+0000 7f7ad3400640 1 -- 172.21.15.69:0/3460494734 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ad4109320 con 0x562da55622f0 2024-05-14T15:25:32.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.681+0000 7f7ad3400640 1 -- 172.21.15.69:0/3460494734 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad40412c0 con 0x562da55622f0 2024-05-14T15:25:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.682+0000 7f7af0e22740 1 -- 172.21.15.69:0/3460494734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da55622f0 msgr2=0x562da592d020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.682+0000 7f7af0e22740 1 --2- 172.21.15.69:0/3460494734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da55622f0 0x562da592d020 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40c6560 tx=0x7f7ad402a420 comp rx=0 tx=0).stop 2024-05-14T15:25:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.682+0000 7f7af0e22740 1 -- 172.21.15.69:0/3460494734 shutdown_connections 2024-05-14T15:25:32.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.682+0000 7f7af0e22740 1 --2- 172.21.15.69:0/3460494734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da558b1b0 0x562da594dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.682+0000 7f7af0e22740 1 --2- 172.21.15.69:0/3460494734 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da556a4d0 0x562da592e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.682+0000 7f7af0e22740 1 --2- 172.21.15.69:0/3460494734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da55622f0 0x562da592d020 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.682+0000 7f7af0e22740 1 -- 172.21.15.69:0/3460494734 >> 172.21.15.69:0/3460494734 conn(0x562da557f300 msgr2=0x562da592dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.682+0000 7f7af0e22740 1 -- 172.21.15.69:0/3460494734 shutdown_connections 2024-05-14T15:25:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.682+0000 7f7af0e22740 1 -- 172.21.15.69:0/3460494734 wait complete. 2024-05-14T15:25:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.682+0000 7f7af0e22740 1 -- start start 2024-05-14T15:25:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.683+0000 7f7af0e22740 1 Processor -- start 2024-05-14T15:25:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.683+0000 7f7af0e22740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da556a4d0 0x562da593e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.683+0000 7f7af0e22740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da558b1b0 0x562da59abea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.683+0000 7f7af0e22740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da551f1c0 0x562da59ac3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.683+0000 7f7af0e22740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41b2760 con 0x562da556a4d0 2024-05-14T15:25:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.683+0000 7f7af0e22740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41b2000 con 0x562da558b1b0 2024-05-14T15:25:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.683+0000 7f7af0e22740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7ae41af240 con 0x562da551f1c0 2024-05-14T15:25:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.683+0000 7f7af0e22740 10 client.0 _ll_register_callbacks cb 0x7f7acc00b280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.683+0000 7f7ae2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da556a4d0 0x562da593e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.684+0000 7f7ae2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da556a4d0 0x562da593e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48666/0 (socket says 172.21.15.69:48666) 2024-05-14T15:25:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.684+0000 7f7ae2a00640 1 -- 172.21.15.69:0/2122279884 learned_addr learned my addr 172.21.15.69:0/2122279884 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.684+0000 7f7adbe00640 1 --2- 172.21.15.69:0/2122279884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da558b1b0 0x562da59abea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.684+0000 7f7ae3400640 1 --2- 172.21.15.69:0/2122279884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da551f1c0 0x562da59ac3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.684+0000 7f7ae2a00640 1 -- 172.21.15.69:0/2122279884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da551f1c0 msgr2=0x562da59ac3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.684+0000 7f7ae2a00640 1 --2- 172.21.15.69:0/2122279884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da551f1c0 0x562da59ac3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.684+0000 7f7ae2a00640 1 -- 172.21.15.69:0/2122279884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da558b1b0 msgr2=0x562da59abea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.684+0000 7f7ae2a00640 1 --2- 172.21.15.69:0/2122279884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da558b1b0 0x562da59abea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.684+0000 7f7ae2a00640 1 -- 172.21.15.69:0/2122279884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562da59ac920 con 0x562da556a4d0 2024-05-14T15:25:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.684+0000 7f7ae2a00640 1 --2- 172.21.15.69:0/2122279884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da556a4d0 0x562da593e8f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40ca470 tx=0x7f7ad4109b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=175dec1450f5150c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.684+0000 7f7ad0c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.685+0000 7f7ad0c00640 1 -- 172.21.15.69:0/2122279884 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4112070 con 0x562da556a4d0 2024-05-14T15:25:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.685+0000 7f7ad0c00640 1 -- 172.21.15.69:0/2122279884 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f7ad40c6ad0 con 0x562da556a4d0 2024-05-14T15:25:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.685+0000 7f7af0e22740 1 -- 172.21.15.69:0/2122279884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ad4109320 con 0x562da556a4d0 2024-05-14T15:25:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.685+0000 7f7ad0c00640 1 -- 172.21.15.69:0/2122279884 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f7ad40c9c50 con 0x562da556a4d0 2024-05-14T15:25:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.685+0000 7f7af0e22740 10 client.16251 fetch_fsmap learned FSMap version 38 2024-05-14T15:25:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.685+0000 7f7af0e22740 1 -- 172.21.15.69:0/2122279884 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=4+}) -- 0x562da59aa2d0 con 0x562da556a4d0 2024-05-14T15:25:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.685+0000 7f7ad0c00640 1 -- 172.21.15.69:0/2122279884 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7ad4109320 con 0x562da556a4d0 2024-05-14T15:25:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.685+0000 7f7ad0c00640 1 -- 172.21.15.69:0/2122279884 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 38) ==== 8374+0+0 (secure 0 0 0) 0x7f7ad4100bd0 con 0x562da556a4d0 2024-05-14T15:25:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.685+0000 7f7af0e22740 10 client.16251 fetch_fsmap finished waiting for FSMap version 38 2024-05-14T15:25:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.685+0000 7f7af0e22740 10 client.16251 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:25:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.685+0000 7f7af0e22740 20 client.16251 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.686+0000 7f7af0e22740 1 --2- 172.21.15.69:0/2122279884 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562da59b97a0 0x562da59bbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:32.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.686+0000 7f7af0e22740 4 client.16251 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:25:32.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.686+0000 7f7af0e22740 1 -- 172.21.15.69:0/2122279884 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562da5898fd0 con 0x562da59b97a0 2024-05-14T15:25:32.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.686+0000 7f7adbe00640 1 --2- 172.21.15.69:0/2122279884 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562da59b97a0 0x562da59bbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:32.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.687+0000 7f7ad0c00640 10 client.16251 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:32.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.687+0000 7f7adbe00640 1 --2- 172.21.15.69:0/2122279884 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562da59b97a0 0x562da59bbbc0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6f7d0b99375012c server_cookie=7689c8d7c59c5846 in_seq=0 out_seq=0 2024-05-14T15:25:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.740+0000 7f7ad0c00640 1 -- 172.21.15.69:0/2122279884 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562da5898fd0 con 0x562da59b97a0 2024-05-14T15:25:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.740+0000 7f7ad0c00640 10 client.16251 handle_command_reply: tid=0 2024-05-14T15:25:32.741 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.740+0000 7f7af0e22740 1 client.16251 shutdown 2024-05-14T15:25:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.741+0000 7f7af0e22740 1 -- 172.21.15.69:0/2122279884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da556a4d0 msgr2=0x562da593e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.741+0000 7f7af0e22740 1 --2- 172.21.15.69:0/2122279884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da556a4d0 0x562da593e8f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7ad40ca470 tx=0x7f7ad4109b40 comp rx=0 tx=0).stop 2024-05-14T15:25:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.741+0000 7f7af0e22740 1 -- 172.21.15.69:0/2122279884 shutdown_connections 2024-05-14T15:25:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.741+0000 7f7af0e22740 1 --2- 172.21.15.69:0/2122279884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562da551f1c0 0x562da59ac3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.741+0000 7f7af0e22740 1 --2- 172.21.15.69:0/2122279884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562da558b1b0 0x562da59abea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.741+0000 7f7af0e22740 1 --2- 172.21.15.69:0/2122279884 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562da59b97a0 0x562da59bbbc0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.741+0000 7f7af0e22740 1 --2- 172.21.15.69:0/2122279884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562da556a4d0 0x562da593e8f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.741+0000 7f7ad0c00640 0 client.16251 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:32.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.741+0000 7f7af0e22740 1 -- 172.21.15.69:0/2122279884 >> 172.21.15.69:0/2122279884 conn(0x562da557f300 msgr2=0x562da592e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.741+0000 7f7af0e22740 1 -- 172.21.15.69:0/2122279884 shutdown_connections 2024-05-14T15:25:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.741+0000 7f7af0e22740 1 -- 172.21.15.69:0/2122279884 wait complete. 2024-05-14T15:25:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.742+0000 7f7af0e22740 20 client.16251 trim_cache size 0 max 16384 2024-05-14T15:25:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:25:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:25:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:25:32.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:25:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.742+0000 7f7ae9e00640 1 -- 172.21.15.69:0/2061788810 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7ac80b2950 msgr2=0x7f7ac80b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.742+0000 7f7ae9e00640 1 --2- 172.21.15.69:0/2061788810 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7ac80b2950 0x7f7ac80b4e60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x562da59293f0 tx=0x7f7adc0086a0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.742+0000 7f7ae9e00640 1 -- 172.21.15.69:0/2061788810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4102470 msgr2=0x7f7ae419a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.742+0000 7f7ae9e00640 1 --2- 172.21.15.69:0/2061788810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4102470 0x7f7ae419a800 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009230 tx=0x7f7ad4003d60 comp rx=0 tx=0).stop 2024-05-14T15:25:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.743+0000 7f7ae9e00640 1 -- 172.21.15.69:0/2061788810 shutdown_connections 2024-05-14T15:25:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.743+0000 7f7ae9e00640 1 --2- 172.21.15.69:0/2061788810 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7ac80b2950 0x7f7ac80b4e60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.743+0000 7f7ae9e00640 1 --2- 172.21.15.69:0/2061788810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7ae4108f70 0x7f7ae419f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.743+0000 7f7ae9e00640 1 --2- 172.21.15.69:0/2061788810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7ae41084f0 0x7f7ae419ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.743+0000 7f7ae9e00640 1 --2- 172.21.15.69:0/2061788810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7ae4102470 0x7f7ae419a800 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.743+0000 7f7ae9e00640 1 -- 172.21.15.69:0/2061788810 >> 172.21.15.69:0/2061788810 conn(0x7f7ae40779e0 msgr2=0x7f7ae4100690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.743+0000 7f7ae9e00640 1 -- 172.21.15.69:0/2061788810 shutdown_connections 2024-05-14T15:25:32.745 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:32.743+0000 7f7ae9e00640 1 -- 172.21.15.69:0/2061788810 wait complete. 2024-05-14T15:25:33.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:33 smithi203 ceph-mon[34567]: pgmap v120: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 15 MiB/s wr, 94 op/s 2024-05-14T15:25:33.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:33 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:33.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:33 smithi092 ceph-mon[34729]: pgmap v120: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 15 MiB/s wr, 94 op/s 2024-05-14T15:25:33.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:33 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:33.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:33 smithi069 ceph-mon[31270]: pgmap v120: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 104 KiB/s rd, 15 MiB/s wr, 94 op/s 2024-05-14T15:25:33.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:33 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:35.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:35 smithi092 ceph-mon[34729]: pgmap v121: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 21 MiB/s wr, 109 op/s 2024-05-14T15:25:35.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:35 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:35.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:35 smithi069 ceph-mon[31270]: pgmap v121: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 21 MiB/s wr, 109 op/s 2024-05-14T15:25:35.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:35 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:35.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:35 smithi203 ceph-mon[34567]: pgmap v121: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 21 MiB/s wr, 109 op/s 2024-05-14T15:25:35.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:35 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:37.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:37 smithi092 ceph-mon[34729]: pgmap v122: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 14 MiB/s wr, 97 op/s 2024-05-14T15:25:37.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:37 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:25:37.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:37 smithi069 ceph-mon[31270]: pgmap v122: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 14 MiB/s wr, 97 op/s 2024-05-14T15:25:37.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:37 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:25:37.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:37 smithi203 ceph-mon[34567]: pgmap v122: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 14 MiB/s wr, 97 op/s 2024-05-14T15:25:37.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:37 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:25:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:38 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:25:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:38 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:25:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:38 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:25:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:38 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:25:38.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:38 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:25:38.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:38 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:25:38.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:38 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:25:38.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:38 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:25:38.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:38 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:25:38.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:38 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:25:38.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:38 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:25:38.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:38 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:25:39.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:39 smithi092 ceph-mon[34729]: pgmap v123: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 14 MiB/s wr, 97 op/s 2024-05-14T15:25:39.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:39 smithi069 ceph-mon[31270]: pgmap v123: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 14 MiB/s wr, 97 op/s 2024-05-14T15:25:39.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:39 smithi203 ceph-mon[34567]: pgmap v123: 129 pgs: 129 active+clean; 1.3 GiB data, 3.0 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 14 MiB/s wr, 97 op/s 2024-05-14T15:25:40.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:40 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:40.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:40 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:40.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:40 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:41.411 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:41 smithi069 ceph-mon[31270]: pgmap v124: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 19 MiB/s wr, 107 op/s 2024-05-14T15:25:41.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:41 smithi092 ceph-mon[34729]: pgmap v124: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 19 MiB/s wr, 107 op/s 2024-05-14T15:25:41.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:41 smithi203 ceph-mon[34567]: pgmap v124: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 19 MiB/s wr, 107 op/s 2024-05-14T15:25:43.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:43 smithi092 ceph-mon[34729]: pgmap v125: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 25 op/s 2024-05-14T15:25:43.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:43 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:43.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:43 smithi069 ceph-mon[31270]: pgmap v125: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 25 op/s 2024-05-14T15:25:43.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:43 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:43.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:43 smithi203 ceph-mon[34567]: pgmap v125: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 11 MiB/s wr, 25 op/s 2024-05-14T15:25:43.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:43 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:45.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:45 smithi092 ceph-mon[34729]: pgmap v126: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 35 op/s 2024-05-14T15:25:45.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:45 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:45.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:45 smithi069 ceph-mon[31270]: pgmap v126: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 35 op/s 2024-05-14T15:25:45.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:45 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:45.590 INFO:teuthology.orchestra.run.smithi069.stderr:done in 171.78 s (drop tables 0.05 s, create tables 0.31 s, client-side generate 120.07 s, vacuum 30.08 s, primary keys 21.28 s). 2024-05-14T15:25:45.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:45 smithi203 ceph-mon[34567]: pgmap v126: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 15 MiB/s wr, 35 op/s 2024-05-14T15:25:45.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:45 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:45.600 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo -u postgres -- pgbench -c 100 -j 4 --progress=5 --time=900' 2024-05-14T15:25:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.976+0000 7f5303e00640 1 -- 172.21.15.69:0/1204873238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5304104200 msgr2=0x7f53041105d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.976+0000 7f5303e00640 1 --2- 172.21.15.69:0/1204873238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5304104200 0x7f53041105d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f52fc009ca0 tx=0x7f52fc02a8c0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.976+0000 7f5303e00640 1 -- 172.21.15.69:0/1204873238 shutdown_connections 2024-05-14T15:25:45.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.976+0000 7f5303e00640 1 --2- 172.21.15.69:0/1204873238 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5304104200 0x7f53041105d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.976+0000 7f5303e00640 1 --2- 172.21.15.69:0/1204873238 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5304109f50 0x7f5304103b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.976+0000 7f5303e00640 1 --2- 172.21.15.69:0/1204873238 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5304109ab0 0x7f5304103650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.976+0000 7f5303e00640 1 -- 172.21.15.69:0/1204873238 >> 172.21.15.69:0/1204873238 conn(0x7f53040ff360 msgr2=0x7f5304101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.976+0000 7f5303e00640 1 -- 172.21.15.69:0/1204873238 shutdown_connections 2024-05-14T15:25:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.977+0000 7f5303e00640 1 -- 172.21.15.69:0/1204873238 wait complete. 2024-05-14T15:25:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.978+0000 7f5303e00640 1 Processor -- start 2024-05-14T15:25:45.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.978+0000 7f5303e00640 1 -- start start 2024-05-14T15:25:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.978+0000 7f5303e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5304104200 0x7f53040760e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.978+0000 7f5303e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5304109ab0 0x7f5304076620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.978+0000 7f5303e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5304109f50 0x7f5304076b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.978+0000 7f5303e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5304113bc0 con 0x7f5304109ab0 2024-05-14T15:25:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.978+0000 7f5303e00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f5304113a40 con 0x7f5304109f50 2024-05-14T15:25:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.978+0000 7f5303e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f5304113d40 con 0x7f5304104200 2024-05-14T15:25:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.979+0000 7f5302000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5304109ab0 0x7f5304076620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.979+0000 7f5302000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5304109ab0 0x7f5304076620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54994/0 (socket says 172.21.15.69:54994) 2024-05-14T15:25:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.979+0000 7f5302000640 1 -- 172.21.15.69:0/4158273502 learned_addr learned my addr 172.21.15.69:0/4158273502 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.979+0000 7f5302a00640 1 --2- 172.21.15.69:0/4158273502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5304104200 0x7f53040760e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.979+0000 7f5303400640 1 --2- 172.21.15.69:0/4158273502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5304109f50 0x7f5304076b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:45.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.979+0000 7f5302000640 1 -- 172.21.15.69:0/4158273502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5304104200 msgr2=0x7f53040760e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.979+0000 7f5302000640 1 --2- 172.21.15.69:0/4158273502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5304104200 0x7f53040760e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.979+0000 7f5302000640 1 -- 172.21.15.69:0/4158273502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5304109f50 msgr2=0x7f5304076b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.979+0000 7f5302000640 1 --2- 172.21.15.69:0/4158273502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5304109f50 0x7f5304076b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.979+0000 7f5302000640 1 -- 172.21.15.69:0/4158273502 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53041a8900 con 0x7f5304109ab0 2024-05-14T15:25:45.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.979+0000 7f5302000640 1 --2- 172.21.15.69:0/4158273502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5304109ab0 0x7f5304076620 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f52f0005d00 tx=0x7f52f000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.980+0000 7f52fb400640 1 -- 172.21.15.69:0/4158273502 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f0017070 con 0x7f5304109ab0 2024-05-14T15:25:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.980+0000 7f52fb400640 1 -- 172.21.15.69:0/4158273502 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52f0009c30 con 0x7f5304109ab0 2024-05-14T15:25:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.980+0000 7f5303e00640 1 -- 172.21.15.69:0/4158273502 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53041a8bf0 con 0x7f5304109ab0 2024-05-14T15:25:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.980+0000 7f52fb400640 1 -- 172.21.15.69:0/4158273502 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f000f620 con 0x7f5304109ab0 2024-05-14T15:25:45.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.980+0000 7f5303e00640 1 -- 172.21.15.69:0/4158273502 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53041a90f0 con 0x7f5304109ab0 2024-05-14T15:25:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.983+0000 7f53107eb740 1 Processor -- start 2024-05-14T15:25:45.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.983+0000 7f53107eb740 1 -- start start 2024-05-14T15:25:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.984+0000 7f52fb400640 1 -- 172.21.15.69:0/4158273502 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f52f001a070 con 0x7f5304109ab0 2024-05-14T15:25:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.984+0000 7f53107eb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c59480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:45.985 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.984+0000 7f53107eb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae188f2f0 0x558ae1c599c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.984+0000 7f53107eb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae18974d0 0x558ae1c59f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.984+0000 7f53107eb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x558ae1bbe550 con 0x558ae18b81b0 2024-05-14T15:25:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.984+0000 7f53107eb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558ae1b63bc0 con 0x558ae188f2f0 2024-05-14T15:25:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.984+0000 7f53107eb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558ae1bba510 con 0x558ae18974d0 2024-05-14T15:25:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.984+0000 7f5303400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c59480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.984+0000 7f5303400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c59480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54998/0 (socket says 172.21.15.69:54998) 2024-05-14T15:25:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.984+0000 7f5303400640 1 -- 172.21.15.69:0/2852484589 learned_addr learned my addr 172.21.15.69:0/2852484589 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.985+0000 7f5302a00640 1 --2- 172.21.15.69:0/2852484589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae188f2f0 0x558ae1c599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.985+0000 7f5302000640 1 --2- 172.21.15.69:0/2852484589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae18974d0 0x558ae1c59f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:45.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.985+0000 7f5303400640 1 -- 172.21.15.69:0/2852484589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae18974d0 msgr2=0x558ae1c59f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.985+0000 7f5303400640 1 --2- 172.21.15.69:0/2852484589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae18974d0 0x558ae1c59f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.985+0000 7f5303400640 1 -- 172.21.15.69:0/2852484589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae188f2f0 msgr2=0x558ae1c599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.985+0000 7f5303400640 1 --2- 172.21.15.69:0/2852484589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae188f2f0 0x558ae1c599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.985+0000 7f5303400640 1 -- 172.21.15.69:0/2852484589 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ae18d0210 con 0x558ae18b81b0 2024-05-14T15:25:45.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.985+0000 7f5302000640 1 --2- 172.21.15.69:0/2852484589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae18974d0 0x558ae1c59f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:25:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.985+0000 7f5303400640 1 --2- 172.21.15.69:0/2852484589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c59480 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f52fc005cc0 tx=0x7f52fc009a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8952f48c2520acdf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.986+0000 7f52efe00640 1 -- 172.21.15.69:0/2852484589 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52fc031980 con 0x558ae18b81b0 2024-05-14T15:25:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.986+0000 7f52efe00640 1 -- 172.21.15.69:0/2852484589 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52fc036040 con 0x558ae18b81b0 2024-05-14T15:25:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.986+0000 7f52efe00640 1 -- 172.21.15.69:0/2852484589 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52fc004310 con 0x558ae18b81b0 2024-05-14T15:25:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.986+0000 7f52fb400640 1 --2- 172.21.15.69:0/4158273502 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f52e80b2950 0x7f52e80b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.986+0000 7f52fb400640 1 -- 172.21.15.69:0/4158273502 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f52f00e24a0 con 0x7f5304109ab0 2024-05-14T15:25:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.986+0000 7f5302a00640 1 --2- 172.21.15.69:0/4158273502 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f52e80b2950 0x7f52e80b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:45.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.987+0000 7f53107eb740 1 -- 172.21.15.69:0/2852484589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 msgr2=0x558ae1c59480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.987+0000 7f53107eb740 1 --2- 172.21.15.69:0/2852484589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c59480 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f52fc005cc0 tx=0x7f52fc009a20 comp rx=0 tx=0).stop 2024-05-14T15:25:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.987+0000 7f53107eb740 1 -- 172.21.15.69:0/2852484589 shutdown_connections 2024-05-14T15:25:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.987+0000 7f53107eb740 1 --2- 172.21.15.69:0/2852484589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae18974d0 0x558ae1c59f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.987+0000 7f53107eb740 1 --2- 172.21.15.69:0/2852484589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae188f2f0 0x558ae1c599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.987+0000 7f53107eb740 1 --2- 172.21.15.69:0/2852484589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c59480 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.987+0000 7f53107eb740 1 -- 172.21.15.69:0/2852484589 >> 172.21.15.69:0/2852484589 conn(0x558ae18ac300 msgr2=0x558ae1c55c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.987+0000 7f53107eb740 1 -- 172.21.15.69:0/2852484589 shutdown_connections 2024-05-14T15:25:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.987+0000 7f5302a00640 1 --2- 172.21.15.69:0/4158273502 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f52e80b2950 0x7f52e80b4e60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f52f4005fd0 tx=0x7f52f400b650 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.987+0000 7f53107eb740 1 -- 172.21.15.69:0/2852484589 wait complete. 2024-05-14T15:25:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.987+0000 7f53107eb740 1 -- start start 2024-05-14T15:25:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.988+0000 7f53107eb740 1 Processor -- start 2024-05-14T15:25:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.988+0000 7f53107eb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae188f2f0 0x558ae1c63990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.988+0000 7f53107eb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae18974d0 0x558ae1c63ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.988+0000 7f53107eb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c6fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:45.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.988+0000 7f53107eb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x558ae1c66550 con 0x558ae18b81b0 2024-05-14T15:25:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.988+0000 7f53107eb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558ae1b77660 con 0x558ae18974d0 2024-05-14T15:25:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.988+0000 7f53107eb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558ae1c666d0 con 0x558ae188f2f0 2024-05-14T15:25:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.988+0000 7f53107eb740 10 client.0 _ll_register_callbacks cb 0x558ae1b41400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.988+0000 7f5303400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c6fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.989+0000 7f5303400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c6fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55000/0 (socket says 172.21.15.69:55000) 2024-05-14T15:25:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.989+0000 7f5303400640 1 -- 172.21.15.69:0/1847798166 learned_addr learned my addr 172.21.15.69:0/1847798166 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.989+0000 7f5302a00640 1 --2- 172.21.15.69:0/1847798166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae188f2f0 0x558ae1c63990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.989+0000 7f5303400640 1 -- 172.21.15.69:0/1847798166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae188f2f0 msgr2=0x558ae1c63990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.989+0000 7f5303400640 1 --2- 172.21.15.69:0/1847798166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae188f2f0 0x558ae1c63990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.989+0000 7f5303400640 1 -- 172.21.15.69:0/1847798166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae18974d0 msgr2=0x558ae1c63ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.989+0000 7f5303400640 1 --2- 172.21.15.69:0/1847798166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae18974d0 0x558ae1c63ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.989+0000 7f5303400640 1 -- 172.21.15.69:0/1847798166 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ae199c620 con 0x558ae18b81b0 2024-05-14T15:25:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.989+0000 7f5303400640 1 --2- 172.21.15.69:0/1847798166 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c6fa30 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f52fc02a900 tx=0x7f52fc009910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ea753be3c5bd2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:45.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.989+0000 7f52ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.990+0000 7f52ecc00640 1 -- 172.21.15.69:0/1847798166 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52fc04a040 con 0x558ae18b81b0 2024-05-14T15:25:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.990+0000 7f53107eb740 1 -- 172.21.15.69:0/1847798166 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52fc036040 con 0x558ae18b81b0 2024-05-14T15:25:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.990+0000 7f52ecc00640 1 -- 172.21.15.69:0/1847798166 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f52fc003b70 con 0x558ae18b81b0 2024-05-14T15:25:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.990+0000 7f52ecc00640 1 -- 172.21.15.69:0/1847798166 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f52fc05c050 con 0x558ae18b81b0 2024-05-14T15:25:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.990+0000 7f53107eb740 10 client.16263 fetch_fsmap learned FSMap version 42 2024-05-14T15:25:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.990+0000 7f53107eb740 1 -- 172.21.15.69:0/1847798166 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558ae1c66550 con 0x558ae18b81b0 2024-05-14T15:25:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.990+0000 7f52ecc00640 1 -- 172.21.15.69:0/1847798166 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52fc036040 con 0x558ae18b81b0 2024-05-14T15:25:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.991+0000 7f52ecc00640 1 -- 172.21.15.69:0/1847798166 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 42) ==== 8386+0+0 (secure 0 0 0) 0x7f52fc04d070 con 0x558ae18b81b0 2024-05-14T15:25:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.991+0000 7f53107eb740 10 client.16263 fetch_fsmap finished waiting for FSMap version 42 2024-05-14T15:25:45.994 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.991+0000 7f53107eb740 10 client.16263 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:25:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.991+0000 7f53107eb740 20 client.16263 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.991+0000 7f53107eb740 1 --2- 172.21.15.69:0/1847798166 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558ae1876d80 0x558ae1c758f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.991+0000 7f53107eb740 4 client.16263 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:25:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.991+0000 7f53107eb740 1 -- 172.21.15.69:0/1847798166 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558ae1bcc160 con 0x558ae1876d80 2024-05-14T15:25:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.992+0000 7f5302a00640 1 --2- 172.21.15.69:0/1847798166 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558ae1876d80 0x558ae1c758f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.993+0000 7f52ecc00640 10 client.16263 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:45.995 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.993+0000 7f5302a00640 1 --2- 172.21.15.69:0/1847798166 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558ae1876d80 0x558ae1c758f0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6c63bb0a5dc515f server_cookie=eb80fee315bb9a52 in_seq=0 out_seq=0 2024-05-14T15:25:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.997+0000 7f52ecc00640 1 -- 172.21.15.69:0/1847798166 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558ae1bcc160 con 0x558ae1876d80 2024-05-14T15:25:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.997+0000 7f52ecc00640 10 client.16263 handle_command_reply: tid=0 2024-05-14T15:25:45.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.997+0000 7f53107eb740 1 client.16263 shutdown 2024-05-14T15:25:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.997+0000 7f53107eb740 1 -- 172.21.15.69:0/1847798166 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 msgr2=0x558ae1c6fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.997+0000 7f53107eb740 1 --2- 172.21.15.69:0/1847798166 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c6fa30 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f52fc02a900 tx=0x7f52fc009910 comp rx=0 tx=0).stop 2024-05-14T15:25:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.997+0000 7f53107eb740 1 -- 172.21.15.69:0/1847798166 shutdown_connections 2024-05-14T15:25:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.997+0000 7f53107eb740 1 --2- 172.21.15.69:0/1847798166 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558ae1876d80 0x558ae1c758f0 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.997+0000 7f53107eb740 1 --2- 172.21.15.69:0/1847798166 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c6fa30 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.997+0000 7f53107eb740 1 --2- 172.21.15.69:0/1847798166 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae18974d0 0x558ae1c63ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.997+0000 7f53107eb740 1 --2- 172.21.15.69:0/1847798166 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae188f2f0 0x558ae1c63990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.997+0000 7f53107eb740 1 -- 172.21.15.69:0/1847798166 >> 172.21.15.69:0/1847798166 conn(0x558ae18ac300 msgr2=0x558ae1c592b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.997+0000 7f52ecc00640 0 client.16263 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.997+0000 7f53107eb740 1 -- 172.21.15.69:0/1847798166 shutdown_connections 2024-05-14T15:25:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.997+0000 7f53107eb740 1 -- 172.21.15.69:0/1847798166 wait complete. 2024-05-14T15:25:45.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:45.998+0000 7f53107eb740 20 client.16263 trim_cache size 0 max 16384 2024-05-14T15:25:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.016+0000 7f53107eb740 1 Processor -- start 2024-05-14T15:25:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.016+0000 7f53107eb740 1 -- start start 2024-05-14T15:25:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.016+0000 7f53107eb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae188f2f0 0x558ae1c54250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.016+0000 7f53107eb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae18974d0 0x558ae1c63060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.016+0000 7f53107eb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c7b010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.016+0000 7f53107eb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f53041b3290 con 0x558ae18b81b0 2024-05-14T15:25:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.016+0000 7f53107eb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f53041b4ef0 con 0x558ae188f2f0 2024-05-14T15:25:46.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.016+0000 7f53107eb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f53041b3960 con 0x558ae18974d0 2024-05-14T15:25:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.017+0000 7f5303400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c7b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.017+0000 7f5303400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c7b010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55012/0 (socket says 172.21.15.69:55012) 2024-05-14T15:25:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.017+0000 7f5303400640 1 -- 172.21.15.69:0/4280680059 learned_addr learned my addr 172.21.15.69:0/4280680059 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.017+0000 7f5302000640 1 --2- 172.21.15.69:0/4280680059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae18974d0 0x558ae1c63060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.017+0000 7f5302a00640 1 --2- 172.21.15.69:0/4280680059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae188f2f0 0x558ae1c54250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.017+0000 7f5303400640 1 -- 172.21.15.69:0/4280680059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae18974d0 msgr2=0x558ae1c63060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.017+0000 7f5303400640 1 --2- 172.21.15.69:0/4280680059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae18974d0 0x558ae1c63060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.017+0000 7f5303400640 1 -- 172.21.15.69:0/4280680059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae188f2f0 msgr2=0x558ae1c54250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.017+0000 7f5303400640 1 --2- 172.21.15.69:0/4280680059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae188f2f0 0x558ae1c54250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.017+0000 7f5303400640 1 -- 172.21.15.69:0/4280680059 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558ae1c5a860 con 0x558ae18b81b0 2024-05-14T15:25:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.017+0000 7f5303400640 1 --2- 172.21.15.69:0/4280680059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c7b010 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f52fc002230 tx=0x7f52fc000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b3be790a6d52ea server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:46.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.018+0000 7f52ef400640 1 -- 172.21.15.69:0/4280680059 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52fc065070 con 0x558ae18b81b0 2024-05-14T15:25:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.018+0000 7f52ef400640 1 -- 172.21.15.69:0/4280680059 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52fc036040 con 0x558ae18b81b0 2024-05-14T15:25:46.020 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.018+0000 7f52ef400640 1 -- 172.21.15.69:0/4280680059 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52fc030c40 con 0x558ae18b81b0 2024-05-14T15:25:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.019+0000 7f53107eb740 1 -- 172.21.15.69:0/4280680059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 msgr2=0x558ae1c7b010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.019+0000 7f53107eb740 1 --2- 172.21.15.69:0/4280680059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c7b010 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f52fc002230 tx=0x7f52fc000f40 comp rx=0 tx=0).stop 2024-05-14T15:25:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.019+0000 7f53107eb740 1 -- 172.21.15.69:0/4280680059 shutdown_connections 2024-05-14T15:25:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.019+0000 7f53107eb740 1 --2- 172.21.15.69:0/4280680059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18b81b0 0x558ae1c7b010 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.019+0000 7f53107eb740 1 --2- 172.21.15.69:0/4280680059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae18974d0 0x558ae1c63060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.019+0000 7f53107eb740 1 --2- 172.21.15.69:0/4280680059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae188f2f0 0x558ae1c54250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.019+0000 7f53107eb740 1 -- 172.21.15.69:0/4280680059 >> 172.21.15.69:0/4280680059 conn(0x558ae18ac300 msgr2=0x558ae1c59c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.019+0000 7f53107eb740 1 -- 172.21.15.69:0/4280680059 shutdown_connections 2024-05-14T15:25:46.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.019+0000 7f53107eb740 1 -- 172.21.15.69:0/4280680059 wait complete. 2024-05-14T15:25:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.019+0000 7f53107eb740 1 -- start start 2024-05-14T15:25:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.020+0000 7f53107eb740 1 Processor -- start 2024-05-14T15:25:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.020+0000 7f53107eb740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae188f2f0 0x558ae1c6bf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.020+0000 7f53107eb740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18974d0 0x558ae1c67280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.020+0000 7f53107eb740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae18b81b0 0x558ae1c677c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.020+0000 7f53107eb740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f53041b47c0 con 0x558ae18974d0 2024-05-14T15:25:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.020+0000 7f53107eb740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f53041b4030 con 0x558ae18b81b0 2024-05-14T15:25:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.020+0000 7f53107eb740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f53041b1270 con 0x558ae188f2f0 2024-05-14T15:25:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.020+0000 7f53107eb740 10 client.0 _ll_register_callbacks cb 0x7f52fc0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.021+0000 7f5302000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18974d0 0x558ae1c67280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.021+0000 7f5302000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18974d0 0x558ae1c67280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55024/0 (socket says 172.21.15.69:55024) 2024-05-14T15:25:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.021+0000 7f5302000640 1 -- 172.21.15.69:0/1847843146 learned_addr learned my addr 172.21.15.69:0/1847843146 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.021+0000 7f5302a00640 1 --2- 172.21.15.69:0/1847843146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae188f2f0 0x558ae1c6bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:46.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.021+0000 7f5303400640 1 --2- 172.21.15.69:0/1847843146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae18b81b0 0x558ae1c677c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.021+0000 7f5302000640 1 -- 172.21.15.69:0/1847843146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae188f2f0 msgr2=0x558ae1c6bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.021+0000 7f5302000640 1 --2- 172.21.15.69:0/1847843146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae188f2f0 0x558ae1c6bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.021+0000 7f5302000640 1 -- 172.21.15.69:0/1847843146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae18b81b0 msgr2=0x558ae1c677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.021+0000 7f5302000640 1 --2- 172.21.15.69:0/1847843146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae18b81b0 0x558ae1c677c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.021+0000 7f5302000640 1 -- 172.21.15.69:0/1847843146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558ae1c4fef0 con 0x558ae18974d0 2024-05-14T15:25:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.021+0000 7f5303400640 1 --2- 172.21.15.69:0/1847843146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae18b81b0 0x558ae1c677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:25:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.021+0000 7f5302000640 1 --2- 172.21.15.69:0/1847843146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18974d0 0x558ae1c67280 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f52f00a9300 tx=0x7f52f00a8d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=916030a93eb72e29 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.021+0000 7f52ecc00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.021+0000 7f52ecc00640 1 -- 172.21.15.69:0/1847843146 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52f0021070 con 0x558ae18974d0 2024-05-14T15:25:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.022+0000 7f52ecc00640 1 -- 172.21.15.69:0/1847843146 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f52f0005a70 con 0x558ae18974d0 2024-05-14T15:25:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.022+0000 7f53107eb740 1 -- 172.21.15.69:0/1847843146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52fc036040 con 0x558ae18974d0 2024-05-14T15:25:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.022+0000 7f52ecc00640 1 -- 172.21.15.69:0/1847843146 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=42) ==== 24+0+0 (secure 0 0 0) 0x7f52f00a8e80 con 0x558ae18974d0 2024-05-14T15:25:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.022+0000 7f53107eb740 10 client.16269 fetch_fsmap learned FSMap version 42 2024-05-14T15:25:46.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.022+0000 7f53107eb740 1 -- 172.21.15.69:0/1847843146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=42,monmap=4+}) -- 0x558ae1cdd900 con 0x558ae18974d0 2024-05-14T15:25:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.022+0000 7f52ecc00640 1 -- 172.21.15.69:0/1847843146 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52fc036040 con 0x558ae18974d0 2024-05-14T15:25:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.022+0000 7f52ecc00640 1 -- 172.21.15.69:0/1847843146 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 42) ==== 8386+0+0 (secure 0 0 0) 0x7f52f00e2120 con 0x558ae18974d0 2024-05-14T15:25:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.022+0000 7f53107eb740 10 client.16269 fetch_fsmap finished waiting for FSMap version 42 2024-05-14T15:25:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.022+0000 7f53107eb740 10 client.16269 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:25:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.022+0000 7f53107eb740 20 client.16269 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.022+0000 7f53107eb740 1 --2- 172.21.15.69:0/1847843146 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558ae184c1c0 0x558ae1ce0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.022+0000 7f53107eb740 4 client.16269 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:25:46.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.022+0000 7f53107eb740 1 -- 172.21.15.69:0/1847843146 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558ae1bc5fd0 con 0x558ae184c1c0 2024-05-14T15:25:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.023+0000 7f5302a00640 1 --2- 172.21.15.69:0/1847843146 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558ae184c1c0 0x558ae1ce0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.024+0000 7f5302a00640 1 --2- 172.21.15.69:0/1847843146 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558ae184c1c0 0x558ae1ce0140 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ba0b9175b2e3df0 server_cookie=e5c278adedfbaa1c in_seq=0 out_seq=0 2024-05-14T15:25:46.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.024+0000 7f52ecc00640 10 client.16269 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.078+0000 7f52ecc00640 1 -- 172.21.15.69:0/1847843146 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558ae1bc5fd0 con 0x558ae184c1c0 2024-05-14T15:25:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.078+0000 7f52ecc00640 10 client.16269 handle_command_reply: tid=0 2024-05-14T15:25:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.078+0000 7f53107eb740 1 client.16269 shutdown 2024-05-14T15:25:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.078+0000 7f53107eb740 1 -- 172.21.15.69:0/1847843146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18974d0 msgr2=0x558ae1c67280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:46.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.078+0000 7f53107eb740 1 --2- 172.21.15.69:0/1847843146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18974d0 0x558ae1c67280 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f52f00a9300 tx=0x7f52f00a8d80 comp rx=0 tx=0).stop 2024-05-14T15:25:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.079+0000 7f53107eb740 1 -- 172.21.15.69:0/1847843146 shutdown_connections 2024-05-14T15:25:46.080 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.079+0000 7f53107eb740 1 --2- 172.21.15.69:0/1847843146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558ae18b81b0 0x558ae1c677c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.079+0000 7f53107eb740 1 --2- 172.21.15.69:0/1847843146 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558ae184c1c0 0x558ae1ce0140 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.079+0000 7f53107eb740 1 --2- 172.21.15.69:0/1847843146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558ae18974d0 0x558ae1c67280 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.079+0000 7f53107eb740 1 --2- 172.21.15.69:0/1847843146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558ae188f2f0 0x558ae1c6bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.079+0000 7f52ecc00640 0 client.16269 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.079+0000 7f53107eb740 1 -- 172.21.15.69:0/1847843146 >> 172.21.15.69:0/1847843146 conn(0x558ae18ac300 msgr2=0x558ae1c599a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.079+0000 7f53107eb740 1 -- 172.21.15.69:0/1847843146 shutdown_connections 2024-05-14T15:25:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.079+0000 7f53107eb740 1 -- 172.21.15.69:0/1847843146 wait complete. 2024-05-14T15:25:46.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.079+0000 7f53107eb740 20 client.16269 trim_cache size 0 max 16384 2024-05-14T15:25:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:25:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:25:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:25:46.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:25:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.080+0000 7f5303e00640 1 -- 172.21.15.69:0/4158273502 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f52e80b2950 msgr2=0x7f52e80b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.080+0000 7f5303e00640 1 --2- 172.21.15.69:0/4158273502 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f52e80b2950 0x7f52e80b4e60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f52f4005fd0 tx=0x7f52f400b650 comp rx=0 tx=0).stop 2024-05-14T15:25:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.080+0000 7f5303e00640 1 -- 172.21.15.69:0/4158273502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5304109ab0 msgr2=0x7f5304076620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.080+0000 7f5303e00640 1 --2- 172.21.15.69:0/4158273502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5304109ab0 0x7f5304076620 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f52f0005d00 tx=0x7f52f000dde0 comp rx=0 tx=0).stop 2024-05-14T15:25:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.080+0000 7f5303e00640 1 -- 172.21.15.69:0/4158273502 shutdown_connections 2024-05-14T15:25:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.080+0000 7f5303e00640 1 --2- 172.21.15.69:0/4158273502 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f52e80b2950 0x7f52e80b4e60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.080+0000 7f5303e00640 1 --2- 172.21.15.69:0/4158273502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5304109f50 0x7f5304076b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.080+0000 7f5303e00640 1 --2- 172.21.15.69:0/4158273502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5304109ab0 0x7f5304076620 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:46.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.080+0000 7f5303e00640 1 --2- 172.21.15.69:0/4158273502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5304104200 0x7f53040760e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:46.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.080+0000 7f5303e00640 1 -- 172.21.15.69:0/4158273502 >> 172.21.15.69:0/4158273502 conn(0x7f53040ff360 msgr2=0x7f5304101a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:46.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.081+0000 7f5303e00640 1 -- 172.21.15.69:0/4158273502 shutdown_connections 2024-05-14T15:25:46.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:46.081+0000 7f5303e00640 1 -- 172.21.15.69:0/4158273502 wait complete. 2024-05-14T15:25:46.367 INFO:teuthology.orchestra.run.smithi069.stderr:starting vacuum...end. 2024-05-14T15:25:47.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:47 smithi069 ceph-mon[31270]: pgmap v127: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.6 MiB/s wr, 21 op/s 2024-05-14T15:25:47.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:47 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:47 smithi203 ceph-mon[34567]: pgmap v127: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.6 MiB/s wr, 21 op/s 2024-05-14T15:25:47.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:47 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:47.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:47 smithi092 ceph-mon[34729]: pgmap v127: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.6 MiB/s wr, 21 op/s 2024-05-14T15:25:47.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:47 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:49.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:49 smithi069 ceph-mon[31270]: pgmap v128: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.6 MiB/s wr, 21 op/s 2024-05-14T15:25:49.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:49 smithi203 ceph-mon[34567]: pgmap v128: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.6 MiB/s wr, 21 op/s 2024-05-14T15:25:49.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:49 smithi092 ceph-mon[34729]: pgmap v128: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 9.6 MiB/s wr, 21 op/s 2024-05-14T15:25:51.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 5.0 s, 382.2 tps, lat 233.354 ms stddev 462.452 2024-05-14T15:25:51.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:51 smithi069 ceph-mon[31270]: pgmap v129: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 12 MiB/s wr, 55 op/s 2024-05-14T15:25:51.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:51 smithi203 ceph-mon[34567]: pgmap v129: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 12 MiB/s wr, 55 op/s 2024-05-14T15:25:51.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:51 smithi092 ceph-mon[34729]: pgmap v129: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 12 MiB/s wr, 55 op/s 2024-05-14T15:25:52.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:52 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:52.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:52 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:52.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:52 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:25:53.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:53 smithi203 ceph-mon[34567]: pgmap v130: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.4 MiB/s wr, 44 op/s 2024-05-14T15:25:53.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:53 smithi092 ceph-mon[34729]: pgmap v130: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.4 MiB/s wr, 44 op/s 2024-05-14T15:25:53.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:53 smithi069 ceph-mon[31270]: pgmap v130: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.4 MiB/s wr, 44 op/s 2024-05-14T15:25:55.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:55 smithi203 ceph-mon[34567]: pgmap v131: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 8.8 MiB/s wr, 97 op/s 2024-05-14T15:25:55.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:55 smithi092 ceph-mon[34729]: pgmap v131: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 8.8 MiB/s wr, 97 op/s 2024-05-14T15:25:55.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:55 smithi069 ceph-mon[31270]: pgmap v131: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 8.8 MiB/s wr, 97 op/s 2024-05-14T15:25:56.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 10.0 s, 1026.0 tps, lat 96.910 ms stddev 47.844 2024-05-14T15:25:56.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:56 smithi203 ceph-mon[34567]: pgmap v132: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.6 MiB/s wr, 87 op/s 2024-05-14T15:25:56.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:56 smithi092 ceph-mon[34729]: pgmap v132: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.6 MiB/s wr, 87 op/s 2024-05-14T15:25:56.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:56 smithi069 ceph-mon[31270]: pgmap v132: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.6 MiB/s wr, 87 op/s 2024-05-14T15:25:59.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:25:59 smithi203 ceph-mon[34567]: pgmap v133: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.6 MiB/s wr, 87 op/s 2024-05-14T15:25:59.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.379+0000 7f53bbe00640 1 -- 172.21.15.69:0/36510861 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b4031d80 con 0x7f53bc109ce0 2024-05-14T15:25:59.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.380+0000 7f53c4200640 1 -- 172.21.15.69:0/36510861 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53bc109ce0 msgr2=0x7f53bc103880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:59.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.380+0000 7f53c4200640 1 --2- 172.21.15.69:0/36510861 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53bc109ce0 0x7f53bc103880 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f53b4009ca0 tx=0x7f53b402a8c0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.380+0000 7f53c4200640 1 -- 172.21.15.69:0/36510861 shutdown_connections 2024-05-14T15:25:59.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.380+0000 7f53c4200640 1 --2- 172.21.15.69:0/36510861 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53bc104430 0x7f53bc110800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.380+0000 7f53c4200640 1 --2- 172.21.15.69:0/36510861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53bc10a180 0x7f53bc103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.380+0000 7f53c4200640 1 --2- 172.21.15.69:0/36510861 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53bc109ce0 0x7f53bc103880 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.380+0000 7f53c4200640 1 -- 172.21.15.69:0/36510861 >> 172.21.15.69:0/36510861 conn(0x7f53bc079450 msgr2=0x7f53bc079890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:59.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.380+0000 7f53c4200640 1 -- 172.21.15.69:0/36510861 shutdown_connections 2024-05-14T15:25:59.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.380+0000 7f53c4200640 1 -- 172.21.15.69:0/36510861 wait complete. 2024-05-14T15:25:59.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.382+0000 7f53c4200640 1 Processor -- start 2024-05-14T15:25:59.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.382+0000 7f53c4200640 1 -- start start 2024-05-14T15:25:59.384 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.383+0000 7f53c4200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53bc104430 0x7f53bc1a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.384 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.383+0000 7f53c4200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53bc109ce0 0x7f53bc1a0a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.384 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.383+0000 7f53c4200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53bc10a180 0x7f53bc19a720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.384 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.383+0000 7f53c4200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f53bc113dc0 con 0x7f53bc109ce0 2024-05-14T15:25:59.384 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.383+0000 7f53c4200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f53bc113c40 con 0x7f53bc10a180 2024-05-14T15:25:59.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.383+0000 7f53c4200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f53bc113f40 con 0x7f53bc104430 2024-05-14T15:25:59.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.383+0000 7f53c0e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53bc109ce0 0x7f53bc1a0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.383+0000 7f53c0e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53bc109ce0 0x7f53bc1a0a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35138/0 (socket says 172.21.15.69:35138) 2024-05-14T15:25:59.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.383+0000 7f53c0e00640 1 -- 172.21.15.69:0/1341180046 learned_addr learned my addr 172.21.15.69:0/1341180046 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:59.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.383+0000 7f53c2200640 1 --2- 172.21.15.69:0/1341180046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53bc10a180 0x7f53bc19a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.384+0000 7f53c1800640 1 --2- 172.21.15.69:0/1341180046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53bc104430 0x7f53bc1a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.384+0000 7f53c0e00640 1 -- 172.21.15.69:0/1341180046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53bc104430 msgr2=0x7f53bc1a0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.384+0000 7f53c0e00640 1 --2- 172.21.15.69:0/1341180046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53bc104430 0x7f53bc1a0550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.384+0000 7f53c0e00640 1 -- 172.21.15.69:0/1341180046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53bc10a180 msgr2=0x7f53bc19a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.384+0000 7f53c0e00640 1 --2- 172.21.15.69:0/1341180046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53bc10a180 0x7f53bc19a720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.384+0000 7f53c0e00640 1 -- 172.21.15.69:0/1341180046 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53bc19adf0 con 0x7f53bc109ce0 2024-05-14T15:25:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.385+0000 7f53c0e00640 1 --2- 172.21.15.69:0/1341180046 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53bc109ce0 0x7f53bc1a0a90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f53b000d740 tx=0x7f53b000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.385+0000 7f53ba000640 1 -- 172.21.15.69:0/1341180046 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0017070 con 0x7f53bc109ce0 2024-05-14T15:25:59.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.385+0000 7f53c4200640 1 -- 172.21.15.69:0/1341180046 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53bc19b0e0 con 0x7f53bc109ce0 2024-05-14T15:25:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.386+0000 7f53c4200640 1 -- 172.21.15.69:0/1341180046 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53bc074f00 con 0x7f53bc109ce0 2024-05-14T15:25:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.386+0000 7f53ba000640 1 -- 172.21.15.69:0/1341180046 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53b000de50 con 0x7f53bc109ce0 2024-05-14T15:25:59.387 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.386+0000 7f53ba000640 1 -- 172.21.15.69:0/1341180046 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0003bb0 con 0x7f53bc109ce0 2024-05-14T15:25:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.391+0000 7f53ba000640 1 -- 172.21.15.69:0/1341180046 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f53b0010460 con 0x7f53bc109ce0 2024-05-14T15:25:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.393+0000 7f53cb1fd740 1 Processor -- start 2024-05-14T15:25:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.394+0000 7f53ba000640 1 --2- 172.21.15.69:0/1341180046 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f53a40b29d0 0x7f53a40b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.394+0000 7f53cb1fd740 1 -- start start 2024-05-14T15:25:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.394+0000 7f53cb1fd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c7c1b0 0x55c2d701d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.394+0000 7f53cb1fd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 0x55c2d701d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.395+0000 7f53cb1fd740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d701dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.395+0000 7f53cb1fd740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55c2d6f82550 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.395+0000 7f53cb1fd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c2d6f27bc0 con 0x55c2d6c532f0 2024-05-14T15:25:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.395+0000 7f53cb1fd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c2d6f7e510 con 0x55c2d6c7c1b0 2024-05-14T15:25:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.395+0000 7f53c2200640 1 --2- 172.21.15.69:0/1341180046 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f53a40b29d0 0x7f53a40b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.395+0000 7f53c0e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 0x55c2d701d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.395+0000 7f53c0e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 0x55c2d701d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:50190/0 (socket says 172.21.15.69:50190) 2024-05-14T15:25:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.395+0000 7f53c0e00640 1 -- 172.21.15.69:0/205361293 learned_addr learned my addr 172.21.15.69:0/205361293 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.395+0000 7f53c1800640 1 --2- 172.21.15.69:0/205361293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c7c1b0 0x55c2d701d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.396+0000 7f53ba000640 1 -- 172.21.15.69:0/1341180046 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f53b00e2180 con 0x7f53bc109ce0 2024-05-14T15:25:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.396+0000 7f53c0e00640 1 -- 172.21.15.69:0/205361293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c7c1b0 msgr2=0x55c2d701d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.396+0000 7f53c0e00640 1 --2- 172.21.15.69:0/205361293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c7c1b0 0x55c2d701d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.396+0000 7f53c0e00640 1 -- 172.21.15.69:0/205361293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 msgr2=0x55c2d701dd00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:25:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.396+0000 7f53c2200640 1 --2- 172.21.15.69:0/205361293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d701dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.396+0000 7f53c0e00640 1 --2- 172.21.15.69:0/205361293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d701dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.396+0000 7f53c0e00640 1 -- 172.21.15.69:0/205361293 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2d6c94210 con 0x55c2d6c532f0 2024-05-14T15:25:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.397+0000 7f53c2200640 1 --2- 172.21.15.69:0/205361293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d701dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:25:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.398+0000 7f53c0e00640 1 --2- 172.21.15.69:0/205361293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 0x55c2d701d7c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f53b00a9120 tx=0x7f53b006d7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a563507a20e6681a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.398+0000 7f53c2200640 1 --2- 172.21.15.69:0/1341180046 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f53a40b29d0 0x7f53a40b4ee0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f53a8005fd0 tx=0x7f53a8004150 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.398+0000 7f53aea00640 1 -- 172.21.15.69:0/205361293 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b0020040 con 0x55c2d6c532f0 2024-05-14T15:25:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.398+0000 7f53aea00640 1 -- 172.21.15.69:0/205361293 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53b00a8ca0 con 0x55c2d6c532f0 2024-05-14T15:25:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.398+0000 7f53aea00640 1 -- 172.21.15.69:0/205361293 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b00a5420 con 0x55c2d6c532f0 2024-05-14T15:25:59.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.400+0000 7f53cb1fd740 1 -- 172.21.15.69:0/205361293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 msgr2=0x55c2d701d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:59.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.400+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/205361293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 0x55c2d701d7c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f53b00a9120 tx=0x7f53b006d7d0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.400+0000 7f53cb1fd740 1 -- 172.21.15.69:0/205361293 shutdown_connections 2024-05-14T15:25:59.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.400+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/205361293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d701dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.400+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/205361293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 0x55c2d701d7c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.400+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/205361293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c7c1b0 0x55c2d701d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.400+0000 7f53cb1fd740 1 -- 172.21.15.69:0/205361293 >> 172.21.15.69:0/205361293 conn(0x55c2d6c70300 msgr2=0x55c2d7019a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:59.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.400+0000 7f53cb1fd740 1 -- 172.21.15.69:0/205361293 shutdown_connections 2024-05-14T15:25:59.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.400+0000 7f53cb1fd740 1 -- 172.21.15.69:0/205361293 wait complete. 2024-05-14T15:25:59.402 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.401+0000 7f53cb1fd740 1 -- start start 2024-05-14T15:25:59.402 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.401+0000 7f53cb1fd740 1 Processor -- start 2024-05-14T15:25:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.402+0000 7f53cb1fd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 0x55c2d70274a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.403+0000 7f53cb1fd740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d70279e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.403+0000 7f53cb1fd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c7c1b0 0x55c2d7033830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.403+0000 7f53c0e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d70279e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.403+0000 7f53c0e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d70279e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35142/0 (socket says 172.21.15.69:35142) 2024-05-14T15:25:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.403+0000 7f53c0e00640 1 -- 172.21.15.69:0/3070948202 learned_addr learned my addr 172.21.15.69:0/3070948202 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.403+0000 7f53cb1fd740 1 -- 172.21.15.69:0/3070948202 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55c2d702a350 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.403+0000 7f53cb1fd740 1 -- 172.21.15.69:0/3070948202 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c2d6f3b660 con 0x55c2d6c532f0 2024-05-14T15:25:59.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.403+0000 7f53cb1fd740 1 -- 172.21.15.69:0/3070948202 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c2d702a4d0 con 0x55c2d6c7c1b0 2024-05-14T15:25:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.403+0000 7f53c1800640 1 --2- 172.21.15.69:0/3070948202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 0x55c2d70274a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.404+0000 7f53c2200640 1 --2- 172.21.15.69:0/3070948202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c7c1b0 0x55c2d7033830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.404+0000 7f53cb1fd740 10 client.0 _ll_register_callbacks cb 0x55c2d6f05400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.404+0000 7f53c0e00640 1 -- 172.21.15.69:0/3070948202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c7c1b0 msgr2=0x55c2d7033830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.404+0000 7f53c0e00640 1 --2- 172.21.15.69:0/3070948202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c7c1b0 0x55c2d7033830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.404+0000 7f53c0e00640 1 -- 172.21.15.69:0/3070948202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 msgr2=0x55c2d70274a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.404+0000 7f53c0e00640 1 --2- 172.21.15.69:0/3070948202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 0x55c2d70274a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.404+0000 7f53c0e00640 1 -- 172.21.15.69:0/3070948202 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2d6d60620 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.405+0000 7f53c0e00640 1 --2- 172.21.15.69:0/3070948202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d70279e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009610 tx=0x7f53b00a56b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db5af5a9f40472a2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.405+0000 7f53a3400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.405+0000 7f53a3400640 1 -- 172.21.15.69:0/3070948202 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b00c2070 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.405+0000 7f53a3400640 1 -- 172.21.15.69:0/3070948202 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f53b00df7a0 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.405+0000 7f53cb1fd740 1 -- 172.21.15.69:0/3070948202 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53b00a8ca0 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.406+0000 7f53a3400640 1 -- 172.21.15.69:0/3070948202 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f53b0020050 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.406+0000 7f53cb1fd740 10 client.16278 fetch_fsmap learned FSMap version 44 2024-05-14T15:25:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.406+0000 7f53cb1fd740 1 -- 172.21.15.69:0/3070948202 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55c2d7036440 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.406+0000 7f53a3400640 1 -- 172.21.15.69:0/3070948202 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53b00a8ca0 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.407+0000 7f53a3400640 1 -- 172.21.15.69:0/3070948202 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7f53b00a4b00 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.407+0000 7f53cb1fd740 10 client.16278 fetch_fsmap finished waiting for FSMap version 44 2024-05-14T15:25:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.407+0000 7f53cb1fd740 10 client.16278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:25:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.407+0000 7f53cb1fd740 20 client.16278 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.407+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/3070948202 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c2d6c3ad80 0x55c2d70397a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.407+0000 7f53cb1fd740 4 client.16278 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:25:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.407+0000 7f53cb1fd740 1 -- 172.21.15.69:0/3070948202 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c2d6f90160 con 0x55c2d6c3ad80 2024-05-14T15:25:59.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.408+0000 7f53c1800640 1 --2- 172.21.15.69:0/3070948202 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c2d6c3ad80 0x55c2d70397a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.409+0000 7f53a3400640 10 client.16278 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:59.410 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.409+0000 7f53c1800640 1 --2- 172.21.15.69:0/3070948202 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c2d6c3ad80 0x55c2d70397a0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97b32dce0a3e0eb2 server_cookie=70dcf6f7b241c60e in_seq=0 out_seq=0 2024-05-14T15:25:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.411+0000 7f53a3400640 1 -- 172.21.15.69:0/3070948202 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c2d6f90160 con 0x55c2d6c3ad80 2024-05-14T15:25:59.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.411+0000 7f53a3400640 10 client.16278 handle_command_reply: tid=0 2024-05-14T15:25:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.412+0000 7f53cb1fd740 1 client.16278 shutdown 2024-05-14T15:25:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.412+0000 7f53cb1fd740 1 -- 172.21.15.69:0/3070948202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 msgr2=0x55c2d70279e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:59.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.412+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/3070948202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d70279e0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f53b0009610 tx=0x7f53b00a56b0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.413+0000 7f53cb1fd740 1 -- 172.21.15.69:0/3070948202 shutdown_connections 2024-05-14T15:25:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.413+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/3070948202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c7c1b0 0x55c2d7033830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.413+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/3070948202 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c2d6c3ad80 0x55c2d70397a0 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.413+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/3070948202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d70279e0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.413+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/3070948202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 0x55c2d70274a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.413+0000 7f53a3400640 0 client.16278 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.413+0000 7f53cb1fd740 1 -- 172.21.15.69:0/3070948202 >> 172.21.15.69:0/3070948202 conn(0x55c2d6c70300 msgr2=0x55c2d701d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.413+0000 7f53cb1fd740 1 -- 172.21.15.69:0/3070948202 shutdown_connections 2024-05-14T15:25:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.413+0000 7f53cb1fd740 1 -- 172.21.15.69:0/3070948202 wait complete. 2024-05-14T15:25:59.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.413+0000 7f53cb1fd740 20 client.16278 trim_cache size 0 max 16384 2024-05-14T15:25:59.428 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:25:59 smithi069 ceph-mon[31270]: pgmap v133: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.6 MiB/s wr, 87 op/s 2024-05-14T15:25:59.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:25:59 smithi092 ceph-mon[34729]: pgmap v133: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 4.6 MiB/s wr, 87 op/s 2024-05-14T15:25:59.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.446+0000 7f53cb1fd740 1 Processor -- start 2024-05-14T15:25:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.446+0000 7f53cb1fd740 1 -- start start 2024-05-14T15:25:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.447+0000 7f53cb1fd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c532f0 0x55c2d7029b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.447+0000 7f53cb1fd740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d7018a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.447+0000 7f53cb1fd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c7c1b0 0x55c2d70337a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.447+0000 7f53cb1fd740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f539c00ff60 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.447+0000 7f53cb1fd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f539c011bf0 con 0x55c2d6c7c1b0 2024-05-14T15:25:59.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.447+0000 7f53cb1fd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f539c010630 con 0x55c2d6c532f0 2024-05-14T15:25:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.447+0000 7f53c1800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c532f0 0x55c2d7029b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.448+0000 7f53c2200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c7c1b0 0x55c2d70337a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.448 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.448+0000 7f53c2200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c7c1b0 0x55c2d70337a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:50210/0 (socket says 172.21.15.69:50210) 2024-05-14T15:25:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.448+0000 7f53c2200640 1 -- 172.21.15.69:0/2802056947 learned_addr learned my addr 172.21.15.69:0/2802056947 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.448+0000 7f53c0e00640 1 --2- 172.21.15.69:0/2802056947 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d7018a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.449+0000 7f53c2200640 1 -- 172.21.15.69:0/2802056947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c532f0 msgr2=0x55c2d7029b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.449+0000 7f53c2200640 1 --2- 172.21.15.69:0/2802056947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c532f0 0x55c2d7029b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.449+0000 7f53c2200640 1 -- 172.21.15.69:0/2802056947 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 msgr2=0x55c2d7018a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.449+0000 7f53c2200640 1 --2- 172.21.15.69:0/2802056947 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d7018a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.449+0000 7f53c2200640 1 -- 172.21.15.69:0/2802056947 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c2d7027d40 con 0x55c2d6c7c1b0 2024-05-14T15:25:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.449+0000 7f53c2200640 1 --2- 172.21.15.69:0/2802056947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c7c1b0 0x55c2d70337a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f53a8003f70 tx=0x7f53a8014040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4681c7b54ab6a83d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:59.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.450+0000 7f53ae000640 1 -- 172.21.15.69:0/2802056947 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a8028440 con 0x55c2d6c7c1b0 2024-05-14T15:25:59.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.450+0000 7f53ae000640 1 -- 172.21.15.69:0/2802056947 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53a8027870 con 0x55c2d6c7c1b0 2024-05-14T15:25:59.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.450+0000 7f53ae000640 1 -- 172.21.15.69:0/2802056947 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53a800f7c0 con 0x55c2d6c7c1b0 2024-05-14T15:25:59.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.451+0000 7f53cb1fd740 1 -- 172.21.15.69:0/2802056947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c7c1b0 msgr2=0x55c2d70337a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:59.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.451+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/2802056947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c7c1b0 0x55c2d70337a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f53a8003f70 tx=0x7f53a8014040 comp rx=0 tx=0).stop 2024-05-14T15:25:59.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.452+0000 7f53cb1fd740 1 -- 172.21.15.69:0/2802056947 shutdown_connections 2024-05-14T15:25:59.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.452+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/2802056947 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c7c1b0 0x55c2d70337a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.452+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/2802056947 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d7018a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.452+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/2802056947 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c532f0 0x55c2d7029b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.452+0000 7f53cb1fd740 1 -- 172.21.15.69:0/2802056947 >> 172.21.15.69:0/2802056947 conn(0x55c2d6c70300 msgr2=0x55c2d701d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:59.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.452+0000 7f53cb1fd740 1 -- 172.21.15.69:0/2802056947 shutdown_connections 2024-05-14T15:25:59.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.453+0000 7f53cb1fd740 1 -- 172.21.15.69:0/2802056947 wait complete. 2024-05-14T15:25:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.453+0000 7f53cb1fd740 1 -- start start 2024-05-14T15:25:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.453+0000 7f53cb1fd740 1 Processor -- start 2024-05-14T15:25:59.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.454+0000 7f53cb1fd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 0x55c2d703cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.454+0000 7f53cb1fd740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d703a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.454+0000 7f53cb1fd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c7c1b0 0x55c2d703a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.454+0000 7f53cb1fd740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f539c0114c0 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.454+0000 7f53cb1fd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f539c010d30 con 0x55c2d6c532f0 2024-05-14T15:25:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.454+0000 7f53cb1fd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f539c00df40 con 0x55c2d6c7c1b0 2024-05-14T15:25:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.454+0000 7f53cb1fd740 10 client.0 _ll_register_callbacks cb 0x7f53b4009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:25:59.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.454+0000 7f53c0e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d703a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.455+0000 7f53c0e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d703a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35154/0 (socket says 172.21.15.69:35154) 2024-05-14T15:25:59.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.455+0000 7f53c0e00640 1 -- 172.21.15.69:0/2484812502 learned_addr learned my addr 172.21.15.69:0/2484812502 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:25:59.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.455+0000 7f53c2200640 1 --2- 172.21.15.69:0/2484812502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c7c1b0 0x55c2d703a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.455+0000 7f53c1800640 1 --2- 172.21.15.69:0/2484812502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 0x55c2d703cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.455+0000 7f53c0e00640 1 -- 172.21.15.69:0/2484812502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c7c1b0 msgr2=0x55c2d703a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.455+0000 7f53c0e00640 1 --2- 172.21.15.69:0/2484812502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c7c1b0 0x55c2d703a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.455+0000 7f53c0e00640 1 -- 172.21.15.69:0/2484812502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 msgr2=0x55c2d703cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:25:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.455+0000 7f53c0e00640 1 --2- 172.21.15.69:0/2484812502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 0x55c2d703cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.455+0000 7f53c0e00640 1 -- 172.21.15.69:0/2484812502 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c2d703ade0 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.455+0000 7f53c1800640 1 --2- 172.21.15.69:0/2484812502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 0x55c2d703cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:25:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.456+0000 7f53c0e00640 1 --2- 172.21.15.69:0/2484812502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d703a110 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f53b00a4f50 tx=0x7f53b00ad2e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00b53112ecb7e46 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:25:59.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.456+0000 7f53a3400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:25:59.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.456+0000 7f53a3400640 1 -- 172.21.15.69:0/2484812502 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b008a060 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.456+0000 7f53a3400640 1 -- 172.21.15.69:0/2484812502 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f53b00a83f0 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.457+0000 7f53cb1fd740 1 -- 172.21.15.69:0/2484812502 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f53a8027870 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.457+0000 7f53a3400640 1 -- 172.21.15.69:0/2484812502 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f53b00c2070 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.457+0000 7f53cb1fd740 10 client.16284 fetch_fsmap learned FSMap version 44 2024-05-14T15:25:59.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.457+0000 7f53cb1fd740 1 -- 172.21.15.69:0/2484812502 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x55c2d70a1830 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.458+0000 7f53a3400640 1 -- 172.21.15.69:0/2484812502 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f53a8027870 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.458+0000 7f53a3400640 1 -- 172.21.15.69:0/2484812502 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7f53b00ae5f0 con 0x55c2d6c5b4d0 2024-05-14T15:25:59.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.458+0000 7f53cb1fd740 10 client.16284 fetch_fsmap finished waiting for FSMap version 44 2024-05-14T15:25:59.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.458+0000 7f53cb1fd740 10 client.16284 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:25:59.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.458+0000 7f53cb1fd740 20 client.16284 populate_metadata read hostname 'smithi069' 2024-05-14T15:25:59.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.458+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/2484812502 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c2d6c101c0 0x55c2d70a3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:25:59.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.458+0000 7f53cb1fd740 4 client.16284 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:25:59.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.458+0000 7f53cb1fd740 1 -- 172.21.15.69:0/2484812502 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c2d6f89fd0 con 0x55c2d6c101c0 2024-05-14T15:25:59.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.459+0000 7f53c1800640 1 --2- 172.21.15.69:0/2484812502 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c2d6c101c0 0x55c2d70a3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:25:59.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.460+0000 7f53a3400640 10 client.16284 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:59.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.460+0000 7f53c1800640 1 --2- 172.21.15.69:0/2484812502 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c2d6c101c0 0x55c2d70a3e30 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b720845d1324a2ea server_cookie=6ebd5a8ae8130704 in_seq=0 out_seq=0 2024-05-14T15:25:59.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.498+0000 7f53a3400640 1 -- 172.21.15.69:0/2484812502 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c2d6f89fd0 con 0x55c2d6c101c0 2024-05-14T15:25:59.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.498+0000 7f53a3400640 10 client.16284 handle_command_reply: tid=0 2024-05-14T15:25:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.498+0000 7f53cb1fd740 1 client.16284 shutdown 2024-05-14T15:25:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.498+0000 7f53cb1fd740 1 -- 172.21.15.69:0/2484812502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 msgr2=0x55c2d703a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:59.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.498+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/2484812502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d703a110 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f53b00a4f50 tx=0x7f53b00ad2e0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.499+0000 7f53cb1fd740 1 -- 172.21.15.69:0/2484812502 shutdown_connections 2024-05-14T15:25:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.499+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/2484812502 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c2d6c7c1b0 0x55c2d703a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.499+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/2484812502 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c2d6c101c0 0x55c2d70a3e30 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.499+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/2484812502 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c2d6c5b4d0 0x55c2d703a110 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.499+0000 7f53cb1fd740 1 --2- 172.21.15.69:0/2484812502 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c2d6c532f0 0x55c2d703cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.499+0000 7f53cb1fd740 1 -- 172.21.15.69:0/2484812502 >> 172.21.15.69:0/2484812502 conn(0x55c2d6c70300 msgr2=0x55c2d7027490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.499+0000 7f53a3400640 0 client.16284 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:25:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.499+0000 7f53cb1fd740 1 -- 172.21.15.69:0/2484812502 shutdown_connections 2024-05-14T15:25:59.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.499+0000 7f53cb1fd740 1 -- 172.21.15.69:0/2484812502 wait complete. 2024-05-14T15:25:59.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.499+0000 7f53cb1fd740 20 client.16284 trim_cache size 0 max 16384 2024-05-14T15:25:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:25:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:25:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:25:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:25:59.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.501+0000 7f53c4200640 1 -- 172.21.15.69:0/1341180046 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f53a40b29d0 msgr2=0x7f53a40b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.501+0000 7f53c4200640 1 --2- 172.21.15.69:0/1341180046 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f53a40b29d0 0x7f53a40b4ee0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f53a8005fd0 tx=0x7f53a8004150 comp rx=0 tx=0).stop 2024-05-14T15:25:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.502+0000 7f53c4200640 1 -- 172.21.15.69:0/1341180046 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53bc109ce0 msgr2=0x7f53bc1a0a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:25:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.502+0000 7f53c4200640 1 --2- 172.21.15.69:0/1341180046 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53bc109ce0 0x7f53bc1a0a90 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f53b000d740 tx=0x7f53b000dc00 comp rx=0 tx=0).stop 2024-05-14T15:25:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.502+0000 7f53c4200640 1 -- 172.21.15.69:0/1341180046 shutdown_connections 2024-05-14T15:25:59.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.502+0000 7f53c4200640 1 --2- 172.21.15.69:0/1341180046 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f53a40b29d0 0x7f53a40b4ee0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.502+0000 7f53c4200640 1 --2- 172.21.15.69:0/1341180046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f53bc10a180 0x7f53bc19a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.502+0000 7f53c4200640 1 --2- 172.21.15.69:0/1341180046 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f53bc109ce0 0x7f53bc1a0a90 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.502+0000 7f53c4200640 1 --2- 172.21.15.69:0/1341180046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f53bc104430 0x7f53bc1a0550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:25:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.502+0000 7f53c4200640 1 -- 172.21.15.69:0/1341180046 >> 172.21.15.69:0/1341180046 conn(0x7f53bc079450 msgr2=0x7f53bc105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:25:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.503+0000 7f53c4200640 1 -- 172.21.15.69:0/1341180046 shutdown_connections 2024-05-14T15:25:59.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:25:59.503+0000 7f53c4200640 1 -- 172.21.15.69:0/1341180046 wait complete. 2024-05-14T15:26:00.252 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T15:26:00.802 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:26:01.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:01 smithi069 ceph-mon[31270]: pgmap v134: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 5.6 MiB/s wr, 175 op/s 2024-05-14T15:26:01.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:01 smithi203 ceph-mon[34567]: pgmap v134: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 5.6 MiB/s wr, 175 op/s 2024-05-14T15:26:01.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 15.0 s, 875.4 tps, lat 113.926 ms stddev 70.287 2024-05-14T15:26:01.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:01 smithi092 ceph-mon[34729]: pgmap v134: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 5.6 MiB/s wr, 175 op/s 2024-05-14T15:26:03.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:03 smithi203 ceph-mon[34567]: pgmap v135: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 3.5 MiB/s wr, 141 op/s 2024-05-14T15:26:03.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:03 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:26:03.350 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:03 smithi069 ceph-mon[31270]: pgmap v135: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 3.5 MiB/s wr, 141 op/s 2024-05-14T15:26:03.351 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:03 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:26:03.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:03 smithi092 ceph-mon[34729]: pgmap v135: 129 pgs: 129 active+clean; 1.3 GiB data, 3.1 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 3.5 MiB/s wr, 141 op/s 2024-05-14T15:26:03.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:03 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:26:04.031 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.026+0000 7f660fc00700 1 -- 172.21.15.69:0/3229933236 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f660810a930 msgr2=0x7f660810ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:04.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.026+0000 7f660fc00700 1 --2- 172.21.15.69:0/3229933236 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f660810a930 0x7f660810ad40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f65f800b0a0 tx=0x7f65f800b3b0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.027+0000 7f660fc00700 1 -- 172.21.15.69:0/3229933236 shutdown_connections 2024-05-14T15:26:04.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.027+0000 7f660fc00700 1 --2- 172.21.15.69:0/3229933236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f660811d930 0x7f660811fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.027+0000 7f660fc00700 1 --2- 172.21.15.69:0/3229933236 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f660810a930 0x7f660810ad40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.027+0000 7f660fc00700 1 --2- 172.21.15.69:0/3229933236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f660810b280 0x7f660811d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.027+0000 7f660fc00700 1 -- 172.21.15.69:0/3229933236 >> 172.21.15.69:0/3229933236 conn(0x7f660806f4d0 msgr2=0x7f660806f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:04.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.027+0000 7f660fc00700 1 -- 172.21.15.69:0/3229933236 shutdown_connections 2024-05-14T15:26:04.032 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.027+0000 7f660fc00700 1 -- 172.21.15.69:0/3229933236 wait complete. 2024-05-14T15:26:04.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.029+0000 7f660fc00700 1 Processor -- start 2024-05-14T15:26:04.033 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.031+0000 7f660fc00700 1 -- start start 2024-05-14T15:26:04.034 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.032+0000 7f660fc00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f660810a930 0x7f66081af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.035 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.033+0000 7f660fc00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f660810b280 0x7f66081afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.034+0000 7f660d200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f660810a930 0x7f66081af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.036 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.034+0000 7f660d200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f660810a930 0x7f66081af870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:33560/0 (socket says 172.21.15.69:33560) 2024-05-14T15:26:04.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.035+0000 7f660d200700 1 -- 172.21.15.69:0/787141113 learned_addr learned my addr 172.21.15.69:0/787141113 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:04.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.035+0000 7f660fc00700 1 --2- 172.21.15.69:0/787141113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f660811d930 0x7f66081a9a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.038 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.035+0000 7f660fc00700 1 -- 172.21.15.69:0/787141113 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6608123210 con 0x7f660810b280 2024-05-14T15:26:04.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.035+0000 7f660fc00700 1 -- 172.21.15.69:0/787141113 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6608123090 con 0x7f660810a930 2024-05-14T15:26:04.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.035+0000 7f660fc00700 1 -- 172.21.15.69:0/787141113 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6608123390 con 0x7f660811d930 2024-05-14T15:26:04.039 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.036+0000 7f660dc00700 1 --2- 172.21.15.69:0/787141113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f660811d930 0x7f66081a9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.038+0000 7f65ffe00700 1 --2- 172.21.15.69:0/787141113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f660810b280 0x7f66081afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.038+0000 7f660dc00700 1 -- 172.21.15.69:0/787141113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f660810a930 msgr2=0x7f66081af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:04.040 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.038+0000 7f660dc00700 1 --2- 172.21.15.69:0/787141113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f660810a930 0x7f66081af870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.038+0000 7f660dc00700 1 -- 172.21.15.69:0/787141113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f660810b280 msgr2=0x7f66081afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:04.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.038+0000 7f660dc00700 1 --2- 172.21.15.69:0/787141113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f660810b280 0x7f66081afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.041 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.038+0000 7f660dc00700 1 -- 172.21.15.69:0/787141113 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66081aa140 con 0x7f660811d930 2024-05-14T15:26:04.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.040+0000 7f660dc00700 1 --2- 172.21.15.69:0/787141113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f660811d930 0x7f66081a9a90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f660000e8d0 tx=0x7f660000ebe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:04.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.040+0000 7f6606000700 1 -- 172.21.15.69:0/787141113 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600004220 con 0x7f660811d930 2024-05-14T15:26:04.042 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.041+0000 7f660fc00700 1 -- 172.21.15.69:0/787141113 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66081aa3d0 con 0x7f660811d930 2024-05-14T15:26:04.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.040+0000 7f6606000700 1 -- 172.21.15.69:0/787141113 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f66000043c0 con 0x7f660811d930 2024-05-14T15:26:04.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.041+0000 7f6606000700 1 -- 172.21.15.69:0/787141113 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6600003d60 con 0x7f660811d930 2024-05-14T15:26:04.043 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.041+0000 7f660fc00700 1 -- 172.21.15.69:0/787141113 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66081b6700 con 0x7f660811d930 2024-05-14T15:26:04.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.048+0000 7f6606000700 1 -- 172.21.15.69:0/787141113 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f660000c810 con 0x7f660811d930 2024-05-14T15:26:04.051 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.049+0000 7f661e6d8b80 1 Processor -- start 2024-05-14T15:26:04.054 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.050+0000 7f661e6d8b80 1 -- start start 2024-05-14T15:26:04.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.050+0000 7f661e6d8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc2dde40 0x5574dc4616b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.050+0000 7f661e6d8b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc461bf0 0x5574dc45b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.051+0000 7f661e6d8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc45bc50 0x5574dc45c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.051+0000 7f661e6d8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5574dc37da20 con 0x5574dc2dde40 2024-05-14T15:26:04.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.051+0000 7f661e6d8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5574dc31b760 con 0x5574dc45bc50 2024-05-14T15:26:04.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.051+0000 7f661e6d8b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5574dc3799e0 con 0x5574dc461bf0 2024-05-14T15:26:04.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.051+0000 7f65ffe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc2dde40 0x5574dc4616b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.051+0000 7f65ffe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc2dde40 0x5574dc4616b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37452/0 (socket says 172.21.15.69:37452) 2024-05-14T15:26:04.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.051+0000 7f65ffe00700 1 -- 172.21.15.69:0/293451605 learned_addr learned my addr 172.21.15.69:0/293451605 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:04.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.052+0000 7f6606000700 1 --2- 172.21.15.69:0/787141113 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f65ec0b2a70 0x7f65ec0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.052+0000 7f6606000700 1 -- 172.21.15.69:0/787141113 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f66000e2bf0 con 0x7f660811d930 2024-05-14T15:26:04.055 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.052+0000 7f65ffe00700 1 --2- 172.21.15.69:0/293451605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc45bc50 0x5574dc45c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.053+0000 7f660dc00700 1 --2- 172.21.15.69:0/787141113 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f65ec0b2a70 0x7f65ec0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.053+0000 7f660d200700 1 --2- 172.21.15.69:0/293451605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc461bf0 0x5574dc45b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.057 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.055+0000 7f660d200700 1 -- 172.21.15.69:0/293451605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc45bc50 msgr2=0x5574dc45c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:04.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.055+0000 7f660dc00700 1 --2- 172.21.15.69:0/787141113 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f65ec0b2a70 0x7f65ec0b4f80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f66000037d0 tx=0x7f6600003720 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:04.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.055+0000 7f660d200700 1 --2- 172.21.15.69:0/293451605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc45bc50 0x5574dc45c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.055+0000 7f660d200700 1 -- 172.21.15.69:0/293451605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc2dde40 msgr2=0x5574dc4616b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:04.058 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.055+0000 7f660d200700 1 --2- 172.21.15.69:0/293451605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc2dde40 0x5574dc4616b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.055+0000 7f660d200700 1 -- 172.21.15.69:0/293451605 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574dc2ca8d0 con 0x5574dc461bf0 2024-05-14T15:26:04.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.056+0000 7f65ffe00700 1 --2- 172.21.15.69:0/293451605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc45bc50 0x5574dc45c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:26:04.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.057+0000 7f660d200700 1 --2- 172.21.15.69:0/293451605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc461bf0 0x5574dc45b710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f65f800b780 tx=0x7f65f8009520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d57c6de9e239ef1d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:04.059 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.058+0000 7f65fe000700 1 -- 172.21.15.69:0/293451605 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8020070 con 0x5574dc461bf0 2024-05-14T15:26:04.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.058+0000 7f65fe000700 1 -- 172.21.15.69:0/293451605 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65f800bd30 con 0x5574dc461bf0 2024-05-14T15:26:04.060 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.058+0000 7f65fe000700 1 -- 172.21.15.69:0/293451605 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8020070 con 0x5574dc461bf0 2024-05-14T15:26:04.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.060+0000 7f661e6d8b80 1 -- 172.21.15.69:0/293451605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc461bf0 msgr2=0x5574dc45b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:04.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.060+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/293451605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc461bf0 0x5574dc45b710 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f65f800b780 tx=0x7f65f8009520 comp rx=0 tx=0).stop 2024-05-14T15:26:04.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.060+0000 7f661e6d8b80 1 -- 172.21.15.69:0/293451605 shutdown_connections 2024-05-14T15:26:04.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.060+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/293451605 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc2dde40 0x5574dc4616b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.060+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/293451605 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc45bc50 0x5574dc45c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.060+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/293451605 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc461bf0 0x5574dc45b710 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.060+0000 7f661e6d8b80 1 -- 172.21.15.69:0/293451605 >> 172.21.15.69:0/293451605 conn(0x5574dc31ca80 msgr2=0x5574dc456790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:04.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.062+0000 7f661e6d8b80 1 -- 172.21.15.69:0/293451605 shutdown_connections 2024-05-14T15:26:04.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.062+0000 7f661e6d8b80 1 -- 172.21.15.69:0/293451605 wait complete. 2024-05-14T15:26:04.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.063+0000 7f661e6d8b80 1 -- start start 2024-05-14T15:26:04.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.063+0000 7f661e6d8b80 1 Processor -- start 2024-05-14T15:26:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.064+0000 7f661e6d8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc2dde40 0x5574dc465390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.064+0000 7f661e6d8b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc45bc50 0x5574dc4658d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.064+0000 7f661e6d8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc461bf0 0x5574dc465e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.064+0000 7f661e6d8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5574dc479670 con 0x5574dc2dde40 2024-05-14T15:26:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.064+0000 7f661e6d8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5574dc2e3b20 con 0x5574dc461bf0 2024-05-14T15:26:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.064+0000 7f661e6d8b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5574dc4797f0 con 0x5574dc45bc50 2024-05-14T15:26:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.064+0000 7f661e6d8b80 10 client.0 _ll_register_callbacks cb 0x5574dc311380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.064+0000 7f65ffe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc2dde40 0x5574dc465390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.065+0000 7f660d200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc45bc50 0x5574dc4658d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.065+0000 7f660d200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc45bc50 0x5574dc4658d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:48016/0 (socket says 172.21.15.69:48016) 2024-05-14T15:26:04.068 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.065+0000 7f660d200700 1 -- 172.21.15.69:0/810137921 learned_addr learned my addr 172.21.15.69:0/810137921 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:04.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.066+0000 7f65ffe00700 1 --2- 172.21.15.69:0/810137921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc461bf0 0x5574dc465e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.066+0000 7f660d200700 1 -- 172.21.15.69:0/810137921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc461bf0 msgr2=0x5574dc465e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:04.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.066+0000 7f660d200700 1 --2- 172.21.15.69:0/810137921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc461bf0 0x5574dc465e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.066+0000 7f660d200700 1 -- 172.21.15.69:0/810137921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc2dde40 msgr2=0x5574dc465390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:04.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.066+0000 7f660d200700 1 --2- 172.21.15.69:0/810137921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc2dde40 0x5574dc465390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.066+0000 7f660d200700 1 -- 172.21.15.69:0/810137921 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574dc343420 con 0x5574dc45bc50 2024-05-14T15:26:04.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.067+0000 7f660d200700 1 --2- 172.21.15.69:0/810137921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc45bc50 0x5574dc4658d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f65f8007820 tx=0x7f65f8007900 comp rx=0 tx=0).ready entity=mon.1 client_cookie=652c0f7c4aaa9ddd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:04.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.067+0000 7f65f6a00700 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:26:04.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.068+0000 7f65f6a00700 1 -- 172.21.15.69:0/810137921 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f8020070 con 0x5574dc45bc50 2024-05-14T15:26:04.070 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.068+0000 7f661e6d8b80 1 -- 172.21.15.69:0/810137921 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65f800bd30 con 0x5574dc45bc50 2024-05-14T15:26:04.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.068+0000 7f65f6a00700 1 -- 172.21.15.69:0/810137921 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f65f800f040 con 0x5574dc45bc50 2024-05-14T15:26:04.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.070+0000 7f65f6a00700 1 -- 172.21.15.69:0/810137921 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f65f8034050 con 0x5574dc45bc50 2024-05-14T15:26:04.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.070+0000 7f661e6d8b80 10 client.25768 fetch_fsmap learned FSMap version 44 2024-05-14T15:26:04.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.070+0000 7f661e6d8b80 1 -- 172.21.15.69:0/810137921 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5574dc479670 con 0x5574dc45bc50 2024-05-14T15:26:04.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.070+0000 7f65f6a00700 1 -- 172.21.15.69:0/810137921 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65f800bd30 con 0x5574dc45bc50 2024-05-14T15:26:04.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.071+0000 7f65f6a00700 1 -- 172.21.15.69:0/810137921 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7f65f8011070 con 0x5574dc45bc50 2024-05-14T15:26:04.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.071+0000 7f661e6d8b80 10 client.25768 fetch_fsmap finished waiting for FSMap version 44 2024-05-14T15:26:04.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.071+0000 7f661e6d8b80 10 client.25768 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:26:04.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.071+0000 7f661e6d8b80 20 client.25768 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:04.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.071+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/810137921 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5574dc486330 0x5574dc488750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.071+0000 7f661e6d8b80 4 client.25768 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:26:04.073 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.071+0000 7f661e6d8b80 1 -- 172.21.15.69:0/810137921 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5574dc428070 con 0x5574dc486330 2024-05-14T15:26:04.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.073+0000 7f65ffe00700 1 --2- 172.21.15.69:0/810137921 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5574dc486330 0x5574dc488750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.075+0000 7f65ffe00700 1 --2- 172.21.15.69:0/810137921 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5574dc486330 0x5574dc488750 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2931491620a60fe9 server_cookie=7df83db2f1563833 in_seq=0 out_seq=0 2024-05-14T15:26:04.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.075+0000 7f65f6a00700 10 client.25768 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:04.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.077+0000 7f65f6a00700 1 -- 172.21.15.69:0/810137921 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5574dc428070 con 0x5574dc486330 2024-05-14T15:26:04.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.077+0000 7f65f6a00700 10 client.25768 handle_command_reply: tid=0 2024-05-14T15:26:04.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.077+0000 7f661e6d8b80 1 client.25768 shutdown 2024-05-14T15:26:04.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.078+0000 7f661e6d8b80 1 -- 172.21.15.69:0/810137921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc45bc50 msgr2=0x5574dc4658d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:04.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.078+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/810137921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc45bc50 0x5574dc4658d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f65f8007820 tx=0x7f65f8007900 comp rx=0 tx=0).stop 2024-05-14T15:26:04.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.079+0000 7f661e6d8b80 1 -- 172.21.15.69:0/810137921 shutdown_connections 2024-05-14T15:26:04.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.079+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/810137921 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5574dc486330 0x5574dc488750 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.079+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/810137921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc2dde40 0x5574dc465390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.079+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/810137921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc461bf0 0x5574dc465e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.079+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/810137921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc45bc50 0x5574dc4658d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.079+0000 7f661e6d8b80 1 -- 172.21.15.69:0/810137921 >> 172.21.15.69:0/810137921 conn(0x5574dc31ca80 msgr2=0x5574dc45a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:04.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.079+0000 7f65f6a00700 0 client.25768 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:04.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.079+0000 7f661e6d8b80 1 -- 172.21.15.69:0/810137921 shutdown_connections 2024-05-14T15:26:04.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.080+0000 7f661e6d8b80 1 -- 172.21.15.69:0/810137921 wait complete. 2024-05-14T15:26:04.082 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.080+0000 7f661e6d8b80 20 client.25768 trim_cache size 0 max 16384 2024-05-14T15:26:04.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.121+0000 7f661e6d8b80 1 Processor -- start 2024-05-14T15:26:04.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.121+0000 7f661e6d8b80 1 -- start start 2024-05-14T15:26:04.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.122+0000 7f661e6d8b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc2dde40 0x5574dc463010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.122+0000 7f661e6d8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc45bc50 0x5574dc4568c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.122+0000 7f661e6d8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc461bf0 0x5574dc45f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.122+0000 7f661e6d8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f66081b6a20 con 0x5574dc45bc50 2024-05-14T15:26:04.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.122+0000 7f661e6d8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f66081b86b0 con 0x5574dc461bf0 2024-05-14T15:26:04.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.122+0000 7f661e6d8b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f66081b70f0 con 0x5574dc2dde40 2024-05-14T15:26:04.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.123+0000 7f65ffe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc2dde40 0x5574dc463010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.123+0000 7f65ffe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc2dde40 0x5574dc463010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:48020/0 (socket says 172.21.15.69:48020) 2024-05-14T15:26:04.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.123+0000 7f65ffe00700 1 -- 172.21.15.69:0/3352739422 learned_addr learned my addr 172.21.15.69:0/3352739422 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:04.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.123+0000 7f65ffe00700 1 --2- 172.21.15.69:0/3352739422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc461bf0 0x5574dc45f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.124+0000 7f65ffe00700 1 -- 172.21.15.69:0/3352739422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc461bf0 msgr2=0x5574dc45f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:04.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.124+0000 7f65ffe00700 1 --2- 172.21.15.69:0/3352739422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc461bf0 0x5574dc45f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.124+0000 7f65ffe00700 1 -- 172.21.15.69:0/3352739422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc45bc50 msgr2=0x5574dc4568c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:04.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.124+0000 7f65ffe00700 1 --2- 172.21.15.69:0/3352739422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc45bc50 0x5574dc4568c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.124+0000 7f65ffe00700 1 -- 172.21.15.69:0/3352739422 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574dc460b60 con 0x5574dc2dde40 2024-05-14T15:26:04.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.125+0000 7f65ffe00700 1 --2- 172.21.15.69:0/3352739422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc2dde40 0x5574dc463010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65f00048a0 tx=0x7f65f0008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b21b9e479e0fd37 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:04.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.125+0000 7f65fd600700 1 -- 172.21.15.69:0/3352739422 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f000f040 con 0x5574dc2dde40 2024-05-14T15:26:04.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.125+0000 7f65fd600700 1 -- 172.21.15.69:0/3352739422 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65f0010040 con 0x5574dc2dde40 2024-05-14T15:26:04.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.126+0000 7f65fd600700 1 -- 172.21.15.69:0/3352739422 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f00179b0 con 0x5574dc2dde40 2024-05-14T15:26:04.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.128+0000 7f661e6d8b80 1 -- 172.21.15.69:0/3352739422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc2dde40 msgr2=0x5574dc463010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:04.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.128+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/3352739422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc2dde40 0x5574dc463010 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f65f00048a0 tx=0x7f65f0008040 comp rx=0 tx=0).stop 2024-05-14T15:26:04.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.128+0000 7f661e6d8b80 1 -- 172.21.15.69:0/3352739422 shutdown_connections 2024-05-14T15:26:04.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.128+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/3352739422 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc461bf0 0x5574dc45f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.128+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/3352739422 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc2dde40 0x5574dc463010 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.128+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/3352739422 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc45bc50 0x5574dc4568c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.129+0000 7f661e6d8b80 1 -- 172.21.15.69:0/3352739422 >> 172.21.15.69:0/3352739422 conn(0x5574dc31ca80 msgr2=0x5574dc45f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:04.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.129+0000 7f661e6d8b80 1 -- 172.21.15.69:0/3352739422 shutdown_connections 2024-05-14T15:26:04.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.129+0000 7f661e6d8b80 1 -- 172.21.15.69:0/3352739422 wait complete. 2024-05-14T15:26:04.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.130+0000 7f661e6d8b80 1 -- start start 2024-05-14T15:26:04.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.131+0000 7f661e6d8b80 1 Processor -- start 2024-05-14T15:26:04.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.132+0000 7f661e6d8b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc2dde40 0x5574dc47ef80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.132+0000 7f661e6d8b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc45bc50 0x5574dc47c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.132+0000 7f661e6d8b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc461bf0 0x5574dc47c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.132+0000 7f661e6d8b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f66081b7f80 con 0x5574dc461bf0 2024-05-14T15:26:04.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.132+0000 7f661e6d8b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f66081b77f0 con 0x5574dc2dde40 2024-05-14T15:26:04.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.132+0000 7f65ffe00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc2dde40 0x5574dc47ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.133+0000 7f661e6d8b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f66081194d0 con 0x5574dc45bc50 2024-05-14T15:26:04.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.133+0000 7f661e6d8b80 10 client.0 _ll_register_callbacks cb 0x5574dc311380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:04.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.133+0000 7f65ffe00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc2dde40 0x5574dc47ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:33610/0 (socket says 172.21.15.69:33610) 2024-05-14T15:26:04.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.133+0000 7f65ffe00700 1 -- 172.21.15.69:0/1194599064 learned_addr learned my addr 172.21.15.69:0/1194599064 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:04.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.133+0000 7f65ffe00700 1 --2- 172.21.15.69:0/1194599064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc461bf0 0x5574dc47c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.133+0000 7f660d200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc45bc50 0x5574dc47c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.134+0000 7f65ffe00700 1 -- 172.21.15.69:0/1194599064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc45bc50 msgr2=0x5574dc47c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:04.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.134+0000 7f65ffe00700 1 --2- 172.21.15.69:0/1194599064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc45bc50 0x5574dc47c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.134+0000 7f65ffe00700 1 -- 172.21.15.69:0/1194599064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc461bf0 msgr2=0x5574dc47c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:04.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.134+0000 7f65ffe00700 1 --2- 172.21.15.69:0/1194599064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc461bf0 0x5574dc47c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.134+0000 7f65ffe00700 1 -- 172.21.15.69:0/1194599064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5574dc47cfe0 con 0x5574dc2dde40 2024-05-14T15:26:04.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.135+0000 7f660d200700 1 --2- 172.21.15.69:0/1194599064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc45bc50 0x5574dc47c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:26:04.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.136+0000 7f65ffe00700 1 --2- 172.21.15.69:0/1194599064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc2dde40 0x5574dc47ef80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f65f0007690 tx=0x7f65f0006ac0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f63cba44c0e2f5a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:04.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.136+0000 7f65f6a00700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:26:04.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.136+0000 7f65f6a00700 1 -- 172.21.15.69:0/1194599064 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65f0018d10 con 0x5574dc2dde40 2024-05-14T15:26:04.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.136+0000 7f661e6d8b80 1 -- 172.21.15.69:0/1194599064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65f0010040 con 0x5574dc2dde40 2024-05-14T15:26:04.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.136+0000 7f65f6a00700 1 -- 172.21.15.69:0/1194599064 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f65f002d450 con 0x5574dc2dde40 2024-05-14T15:26:04.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.137+0000 7f65f6a00700 1 -- 172.21.15.69:0/1194599064 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7f65f003f050 con 0x5574dc2dde40 2024-05-14T15:26:04.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.137+0000 7f661e6d8b80 10 client.35789 fetch_fsmap learned FSMap version 44 2024-05-14T15:26:04.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.137+0000 7f661e6d8b80 1 -- 172.21.15.69:0/1194599064 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5574dc4f0750 con 0x5574dc2dde40 2024-05-14T15:26:04.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.138+0000 7f65f6a00700 1 -- 172.21.15.69:0/1194599064 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f65f0010040 con 0x5574dc2dde40 2024-05-14T15:26:04.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.138+0000 7f65f6a00700 1 -- 172.21.15.69:0/1194599064 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7f65f001fce0 con 0x5574dc2dde40 2024-05-14T15:26:04.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.138+0000 7f661e6d8b80 10 client.35789 fetch_fsmap finished waiting for FSMap version 44 2024-05-14T15:26:04.140 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.138+0000 7f661e6d8b80 10 client.35789 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:26:04.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.138+0000 7f661e6d8b80 20 client.35789 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:04.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.139+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/1194599064 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5574dc4f0c60 0x5574dc4f3080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:04.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.139+0000 7f661e6d8b80 4 client.35789 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T15:26:04.141 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.139+0000 7f661e6d8b80 1 -- 172.21.15.69:0/1194599064 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5574dc38b400 con 0x5574dc4f0c60 2024-05-14T15:26:04.142 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.140+0000 7f660d200700 1 --2- 172.21.15.69:0/1194599064 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5574dc4f0c60 0x5574dc4f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:04.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.141+0000 7f65f6a00700 10 client.35789 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:04.143 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.141+0000 7f660d200700 1 --2- 172.21.15.69:0/1194599064 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5574dc4f0c60 0x5574dc4f3080 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8bbe22ecb10dd64 server_cookie=5ccfb2229c32cceb in_seq=0 out_seq=0 2024-05-14T15:26:04.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.142+0000 7f65f6a00700 1 -- 172.21.15.69:0/1194599064 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5574dc38b400 con 0x5574dc4f0c60 2024-05-14T15:26:04.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.142+0000 7f65f6a00700 10 client.35789 handle_command_reply: tid=0 2024-05-14T15:26:04.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.142+0000 7f661e6d8b80 1 client.35789 shutdown 2024-05-14T15:26:04.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.142+0000 7f661e6d8b80 1 -- 172.21.15.69:0/1194599064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc2dde40 msgr2=0x5574dc47ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:04.144 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.142+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/1194599064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc2dde40 0x5574dc47ef80 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f65f0007690 tx=0x7f65f0006ac0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.143+0000 7f661e6d8b80 1 -- 172.21.15.69:0/1194599064 shutdown_connections 2024-05-14T15:26:04.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.143+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/1194599064 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5574dc4f0c60 0x5574dc4f3080 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.143+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/1194599064 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574dc461bf0 0x5574dc47c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.143+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/1194599064 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574dc2dde40 0x5574dc47ef80 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.143+0000 7f661e6d8b80 1 --2- 172.21.15.69:0/1194599064 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574dc45bc50 0x5574dc47c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.143+0000 7f65f6a00700 0 client.35789 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:04.145 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.143+0000 7f661e6d8b80 1 -- 172.21.15.69:0/1194599064 >> 172.21.15.69:0/1194599064 conn(0x5574dc31ca80 msgr2=0x5574dc456620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:04.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.144+0000 7f661e6d8b80 1 -- 172.21.15.69:0/1194599064 shutdown_connections 2024-05-14T15:26:04.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.144+0000 7f661e6d8b80 1 -- 172.21.15.69:0/1194599064 wait complete. 2024-05-14T15:26:04.146 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.144+0000 7f661e6d8b80 20 client.35789 trim_cache size 0 max 16384 2024-05-14T15:26:04.147 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:26:04.147 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2024-05-14T15:26:04.147 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2024-05-14T15:26:04.147 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:26:04.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.145+0000 7f660fc00700 1 -- 172.21.15.69:0/787141113 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f65ec0b2a70 msgr2=0x7f65ec0b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:04.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.145+0000 7f660fc00700 1 --2- 172.21.15.69:0/787141113 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f65ec0b2a70 0x7f65ec0b4f80 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f66000037d0 tx=0x7f6600003720 comp rx=0 tx=0).stop 2024-05-14T15:26:04.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.145+0000 7f660fc00700 1 -- 172.21.15.69:0/787141113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f660811d930 msgr2=0x7f66081a9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:04.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.145+0000 7f660fc00700 1 --2- 172.21.15.69:0/787141113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f660811d930 0x7f66081a9a90 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f660000e8d0 tx=0x7f660000ebe0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.145+0000 7f660fc00700 1 -- 172.21.15.69:0/787141113 shutdown_connections 2024-05-14T15:26:04.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.145+0000 7f660fc00700 1 --2- 172.21.15.69:0/787141113 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f65ec0b2a70 0x7f65ec0b4f80 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.145+0000 7f660fc00700 1 --2- 172.21.15.69:0/787141113 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f660811d930 0x7f66081a9a90 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.145+0000 7f660fc00700 1 --2- 172.21.15.69:0/787141113 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f660810a930 0x7f66081af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.145+0000 7f660fc00700 1 --2- 172.21.15.69:0/787141113 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f660810b280 0x7f66081afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:04.148 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.146+0000 7f660fc00700 1 -- 172.21.15.69:0/787141113 >> 172.21.15.69:0/787141113 conn(0x7f660806f4d0 msgr2=0x7f660811b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:04.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.146+0000 7f660fc00700 1 -- 172.21.15.69:0/787141113 shutdown_connections 2024-05-14T15:26:04.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:04.147+0000 7f660fc00700 1 -- 172.21.15.69:0/787141113 wait complete. 2024-05-14T15:26:04.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:04 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:26:04.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:04 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:26:04.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:04 smithi069 ceph-mon[31270]: pgmap v136: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 6.6 MiB/s wr, 436 op/s 2024-05-14T15:26:05.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:04 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:26:05.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:04 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:26:05.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:04 smithi203 ceph-mon[34567]: pgmap v136: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 6.6 MiB/s wr, 436 op/s 2024-05-14T15:26:05.157 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-14T15:26:05.157 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:26:05.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:04 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:26:05.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:04 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:26:05.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:04 smithi092 ceph-mon[34729]: pgmap v136: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 6.6 MiB/s wr, 436 op/s 2024-05-14T15:26:05.959 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:26:06.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:05 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:26:06.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:05 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:26:06.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:05 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:26:06.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 20.0 s, 558.6 tps, lat 179.695 ms stddev 61.541 2024-05-14T15:26:06.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:05 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:26:06.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:05 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:26:06.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:05 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:26:06.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:05 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:26:06.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:05 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:26:06.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:05 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:26:07.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:06 smithi203 ceph-mon[34567]: pgmap v137: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.1 MiB/s wr, 383 op/s 2024-05-14T15:26:07.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:06 smithi092 ceph-mon[34729]: pgmap v137: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.1 MiB/s wr, 383 op/s 2024-05-14T15:26:07.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:06 smithi069 ceph-mon[31270]: pgmap v137: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.1 MiB/s wr, 383 op/s 2024-05-14T15:26:09.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:08 smithi069 ceph-mon[31270]: pgmap v138: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.1 MiB/s wr, 383 op/s 2024-05-14T15:26:09.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:08 smithi203 ceph-mon[34567]: pgmap v138: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.1 MiB/s wr, 383 op/s 2024-05-14T15:26:09.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:08 smithi092 ceph-mon[34729]: pgmap v138: 129 pgs: 129 active+clean; 1.4 GiB data, 3.2 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 4.1 MiB/s wr, 383 op/s 2024-05-14T15:26:10.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.989+0000 7f4402400700 1 -- 172.21.15.69:0/341482884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43fc1054a0 msgr2=0x7f43fc1058b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:10.992 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.989+0000 7f4402400700 1 --2- 172.21.15.69:0/341482884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43fc1054a0 0x7f43fc1058b0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009990 tx=0x7f43ec009ca0 comp rx=0 tx=0).stop 2024-05-14T15:26:10.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.990+0000 7f4402400700 1 -- 172.21.15.69:0/341482884 shutdown_connections 2024-05-14T15:26:10.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.990+0000 7f4402400700 1 --2- 172.21.15.69:0/341482884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43fc1054a0 0x7f43fc1058b0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:10.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.990+0000 7f4402400700 1 --2- 172.21.15.69:0/341482884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc10e910 0x7f43fc110dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:10.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.990+0000 7f4402400700 1 --2- 172.21.15.69:0/341482884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43fc105df0 0x7f43fc10e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:10.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.990+0000 7f4402400700 1 -- 172.21.15.69:0/341482884 >> 172.21.15.69:0/341482884 conn(0x7f43fc0fedc0 msgr2=0x7f43fc1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:10.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.991+0000 7f4402400700 1 -- 172.21.15.69:0/341482884 shutdown_connections 2024-05-14T15:26:10.993 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.991+0000 7f4402400700 1 -- 172.21.15.69:0/341482884 wait complete. 2024-05-14T15:26:10.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.993+0000 7f4402400700 1 Processor -- start 2024-05-14T15:26:10.995 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.993+0000 7f4402400700 1 -- start start 2024-05-14T15:26:10.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.994+0000 7f4402400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43fc1054a0 0x7f43fc19cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:10.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.994+0000 7f4402400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc105df0 0x7f43fc19d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:10.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.994+0000 7f4402400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43fc10e910 0x7f43fc1a1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:10.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.994+0000 7f4402400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc114310 con 0x7f43fc10e910 2024-05-14T15:26:10.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.994+0000 7f4402400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc114190 con 0x7f43fc105df0 2024-05-14T15:26:10.996 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.994+0000 7f4402400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f43fc114490 con 0x7f43fc1054a0 2024-05-14T15:26:10.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.994+0000 7f43fbe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43fc10e910 0x7f43fc1a1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:10.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.994+0000 7f43faa00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc105df0 0x7f43fc19d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:10.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.994+0000 7f43faa00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc105df0 0x7f43fc19d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:33618/0 (socket says 172.21.15.69:33618) 2024-05-14T15:26:10.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.994+0000 7f43faa00700 1 -- 172.21.15.69:0/2742874818 learned_addr learned my addr 172.21.15.69:0/2742874818 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:10.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.994+0000 7f43fb400700 1 --2- 172.21.15.69:0/2742874818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43fc1054a0 0x7f43fc19cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:10.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.995+0000 7f43fb400700 1 -- 172.21.15.69:0/2742874818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc105df0 msgr2=0x7f43fc19d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:10.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.995+0000 7f43fb400700 1 --2- 172.21.15.69:0/2742874818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc105df0 0x7f43fc19d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:10.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.995+0000 7f43fb400700 1 -- 172.21.15.69:0/2742874818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43fc10e910 msgr2=0x7f43fc1a1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:10.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.995+0000 7f43fb400700 1 --2- 172.21.15.69:0/2742874818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43fc10e910 0x7f43fc1a1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:10.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.995+0000 7f43fb400700 1 -- 172.21.15.69:0/2742874818 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc1a1e10 con 0x7f43fc1054a0 2024-05-14T15:26:10.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:10.996+0000 7f43fb400700 1 --2- 172.21.15.69:0/2742874818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43fc1054a0 0x7f43fc19cf40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009990 tx=0x7f43ec0057c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:11.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.000+0000 7f43f3e00700 1 -- 172.21.15.69:0/2742874818 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec027070 con 0x7f43fc1054a0 2024-05-14T15:26:11.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.000+0000 7f43f3e00700 1 -- 172.21.15.69:0/2742874818 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f43ec022470 con 0x7f43fc1054a0 2024-05-14T15:26:11.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.000+0000 7f4402400700 1 -- 172.21.15.69:0/2742874818 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43fc1a20a0 con 0x7f43fc1054a0 2024-05-14T15:26:11.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.000+0000 7f43f3e00700 1 -- 172.21.15.69:0/2742874818 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ec017650 con 0x7f43fc1054a0 2024-05-14T15:26:11.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.001+0000 7f4402400700 1 -- 172.21.15.69:0/2742874818 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43fc1a9a20 con 0x7f43fc1054a0 2024-05-14T15:26:11.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.003+0000 7f4402400700 1 -- 172.21.15.69:0/2742874818 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43fc0512c0 con 0x7f43fc1054a0 2024-05-14T15:26:11.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.006+0000 7f43f3e00700 1 -- 172.21.15.69:0/2742874818 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f43ec02a070 con 0x7f43fc1054a0 2024-05-14T15:26:11.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.007+0000 7f43f3e00700 1 --2- 172.21.15.69:0/2742874818 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f43e00b2af0 0x7f43e00b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:11.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.008+0000 7f43f3e00700 1 -- 172.21.15.69:0/2742874818 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f43ec0e3380 con 0x7f43fc1054a0 2024-05-14T15:26:11.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.008+0000 7f43faa00700 1 --2- 172.21.15.69:0/2742874818 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f43e00b2af0 0x7f43e00b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:11.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.009+0000 7f43faa00700 1 --2- 172.21.15.69:0/2742874818 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f43e00b2af0 0x7f43e00b5000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f43fc102330 tx=0x7f43e8009260 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:11.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.016+0000 7f43f3e00700 1 -- 172.21.15.69:0/2742874818 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f43ec013070 con 0x7f43fc1054a0 2024-05-14T15:26:11.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:10 smithi203 ceph-mon[34567]: pgmap v139: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 6.7 MiB/s wr, 693 op/s 2024-05-14T15:26:11.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 25.0 s, 612.2 tps, lat 163.233 ms stddev 84.470 2024-05-14T15:26:11.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:10 smithi092 ceph-mon[34729]: pgmap v139: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 6.7 MiB/s wr, 693 op/s 2024-05-14T15:26:11.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:10 smithi069 ceph-mon[31270]: pgmap v139: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 6.7 MiB/s wr, 693 op/s 2024-05-14T15:26:11.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.480+0000 7f4402400700 1 -- 172.21.15.69:0/2742874818 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43fc19e2a0 con 0x7f43fc1054a0 2024-05-14T15:26:11.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.482+0000 7f43f3e00700 1 -- 172.21.15.69:0/2742874818 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 44 v44) ==== 94+0+11944 (secure 0 0 0) 0x7f43ec0aab80 con 0x7f43fc1054a0 2024-05-14T15:26:11.485 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:26:11.486 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":44,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":44,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T15:16:11.716543+0000","modified":"2024-05-14T15:25:50.465999+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34490,"mds_1":34460,"mds_2":34433,"mds_3":34409,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":31,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":35,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34490":{"gid":34490,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34490,"qdb_cluster":[34460,34490,34409,34433,24451]},"id":1}]} 2024-05-14T15:26:11.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.486+0000 7f4402400700 1 -- 172.21.15.69:0/2742874818 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f43e00b2af0 msgr2=0x7f43e00b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:11.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.486+0000 7f4402400700 1 --2- 172.21.15.69:0/2742874818 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f43e00b2af0 0x7f43e00b5000 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f43fc102330 tx=0x7f43e8009260 comp rx=0 tx=0).stop 2024-05-14T15:26:11.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.486+0000 7f4402400700 1 -- 172.21.15.69:0/2742874818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43fc1054a0 msgr2=0x7f43fc19cf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:11.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.486+0000 7f4402400700 1 --2- 172.21.15.69:0/2742874818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43fc1054a0 0x7f43fc19cf40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f43ec009990 tx=0x7f43ec0057c0 comp rx=0 tx=0).stop 2024-05-14T15:26:11.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.487+0000 7f4402400700 1 -- 172.21.15.69:0/2742874818 shutdown_connections 2024-05-14T15:26:11.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.487+0000 7f4402400700 1 --2- 172.21.15.69:0/2742874818 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f43e00b2af0 0x7f43e00b5000 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:11.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.487+0000 7f4402400700 1 --2- 172.21.15.69:0/2742874818 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f43fc10e910 0x7f43fc1a1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:11.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.487+0000 7f4402400700 1 --2- 172.21.15.69:0/2742874818 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43fc1054a0 0x7f43fc19cf40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:11.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.487+0000 7f4402400700 1 --2- 172.21.15.69:0/2742874818 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43fc105df0 0x7f43fc19d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:11.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.487+0000 7f4402400700 1 -- 172.21.15.69:0/2742874818 >> 172.21.15.69:0/2742874818 conn(0x7f43fc0fedc0 msgr2=0x7f43fc0ff310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:11.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.487+0000 7f4402400700 1 -- 172.21.15.69:0/2742874818 shutdown_connections 2024-05-14T15:26:11.490 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:11.487+0000 7f4402400700 1 -- 172.21.15.69:0/2742874818 wait complete. 2024-05-14T15:26:11.491 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 44 2024-05-14T15:26:12.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:12 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2742874818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:26:12.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:12 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2742874818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:26:12.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:12 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2742874818' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:26:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.816+0000 7fbf50c00640 1 -- 172.21.15.69:0/3644579523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf4c10f340 msgr2=0x7fbf4c10f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.816+0000 7fbf50c00640 1 --2- 172.21.15.69:0/3644579523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf4c10f340 0x7fbf4c10f750 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fbf34009900 tx=0x7fbf3402a3f0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.816+0000 7fbf50c00640 1 -- 172.21.15.69:0/3644579523 shutdown_connections 2024-05-14T15:26:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.816+0000 7fbf50c00640 1 --2- 172.21.15.69:0/3644579523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf4c1150a0 0x7fbf4c117540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.816+0000 7fbf50c00640 1 --2- 172.21.15.69:0/3644579523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf4c10f340 0x7fbf4c10f750 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.816+0000 7fbf50c00640 1 --2- 172.21.15.69:0/3644579523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf4c10ad70 0x7fbf4c10ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.816+0000 7fbf50c00640 1 -- 172.21.15.69:0/3644579523 >> 172.21.15.69:0/3644579523 conn(0x7fbf4c06edb0 msgr2=0x7fbf4c06f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.816+0000 7fbf50c00640 1 -- 172.21.15.69:0/3644579523 shutdown_connections 2024-05-14T15:26:12.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.816+0000 7fbf50c00640 1 -- 172.21.15.69:0/3644579523 wait complete. 2024-05-14T15:26:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.820+0000 7fbf50c00640 1 Processor -- start 2024-05-14T15:26:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.820+0000 7fbf50c00640 1 -- start start 2024-05-14T15:26:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.821+0000 7fbf50c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf4c10ad70 0x7fbf4c1a19f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.821+0000 7fbf50c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf4c10f340 0x7fbf4c1a1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.822+0000 7fbf50c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf4c1150a0 0x7fbf4c1a2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.822+0000 7fbf50c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c11c540 con 0x7fbf4c1150a0 2024-05-14T15:26:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.822+0000 7fbf50c00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c11c3c0 con 0x7fbf4c10f340 2024-05-14T15:26:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.822+0000 7fbf50c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c11c6c0 con 0x7fbf4c10ad70 2024-05-14T15:26:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.822+0000 7fbf49e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf4c10ad70 0x7fbf4c1a19f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.822+0000 7fbf49e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf4c10ad70 0x7fbf4c1a19f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:48110/0 (socket says 172.21.15.69:48110) 2024-05-14T15:26:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.822+0000 7fbf49e00640 1 -- 172.21.15.69:0/2642746791 learned_addr learned my addr 172.21.15.69:0/2642746791 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.823+0000 7fbf49400640 1 --2- 172.21.15.69:0/2642746791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf4c10f340 0x7fbf4c1a1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.823+0000 7fbf49e00640 1 -- 172.21.15.69:0/2642746791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf4c10f340 msgr2=0x7fbf4c1a1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.823+0000 7fbf49e00640 1 --2- 172.21.15.69:0/2642746791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf4c10f340 0x7fbf4c1a1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.823+0000 7fbf49e00640 1 -- 172.21.15.69:0/2642746791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf4c1150a0 msgr2=0x7fbf4c1a2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.823+0000 7fbf49e00640 1 --2- 172.21.15.69:0/2642746791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf4c1150a0 0x7fbf4c1a2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.823+0000 7fbf49e00640 1 -- 172.21.15.69:0/2642746791 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4c1b5750 con 0x7fbf4c10ad70 2024-05-14T15:26:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.824+0000 7fbf49e00640 1 --2- 172.21.15.69:0/2642746791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf4c10ad70 0x7fbf4c1a19f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400ea80 tx=0x7fbf4400ef40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.824+0000 7fbf42a00640 1 -- 172.21.15.69:0/2642746791 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4400ce40 con 0x7fbf4c10ad70 2024-05-14T15:26:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.825+0000 7fbf50c00640 1 -- 172.21.15.69:0/2642746791 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf4c1b5a40 con 0x7fbf4c10ad70 2024-05-14T15:26:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.825+0000 7fbf42a00640 1 -- 172.21.15.69:0/2642746791 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf44011900 con 0x7fbf4c10ad70 2024-05-14T15:26:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.825+0000 7fbf42a00640 1 -- 172.21.15.69:0/2642746791 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4400ce40 con 0x7fbf4c10ad70 2024-05-14T15:26:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.825+0000 7fbf50c00640 1 -- 172.21.15.69:0/2642746791 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf4c1b5f60 con 0x7fbf4c10ad70 2024-05-14T15:26:12.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.832+0000 7fbf57bf4740 1 Processor -- start 2024-05-14T15:26:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.832+0000 7fbf57bf4740 1 -- start start 2024-05-14T15:26:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.832+0000 7fbf42a00640 1 -- 172.21.15.69:0/2642746791 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fbf44010770 con 0x7fbf4c10ad70 2024-05-14T15:26:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.832+0000 7fbf57bf4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cfa1b0 0x5640b209b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.832+0000 7fbf57bf4740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 0x5640b209b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.832+0000 7fbf57bf4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cd94d0 0x5640b209bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.832+0000 7fbf57bf4740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5640b2000550 con 0x5640b1cd12f0 2024-05-14T15:26:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.832+0000 7fbf57bf4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5640b1fa5bc0 con 0x5640b1cfa1b0 2024-05-14T15:26:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.832+0000 7fbf57bf4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5640b1ffc510 con 0x5640b1cd94d0 2024-05-14T15:26:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.833+0000 7fbf4a800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cfa1b0 0x5640b209b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.833+0000 7fbf4a800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cfa1b0 0x5640b209b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:42910/0 (socket says 172.21.15.69:42910) 2024-05-14T15:26:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.833+0000 7fbf4a800640 1 -- 172.21.15.69:0/2370973226 learned_addr learned my addr 172.21.15.69:0/2370973226 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.833+0000 7fbf4a800640 1 -- 172.21.15.69:0/2370973226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cd94d0 msgr2=0x5640b209bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.833+0000 7fbf4a800640 1 --2- 172.21.15.69:0/2370973226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cd94d0 0x5640b209bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.833+0000 7fbf49e00640 1 --2- 172.21.15.69:0/2370973226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 0x5640b209b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.834+0000 7fbf4a800640 1 -- 172.21.15.69:0/2370973226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 msgr2=0x5640b209b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.834+0000 7fbf4a800640 1 --2- 172.21.15.69:0/2370973226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 0x5640b209b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.834+0000 7fbf4a800640 1 -- 172.21.15.69:0/2370973226 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b1d12210 con 0x5640b1cfa1b0 2024-05-14T15:26:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.834+0000 7fbf49e00640 1 --2- 172.21.15.69:0/2370973226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 0x5640b209b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:26:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.834+0000 7fbf4a800640 1 --2- 172.21.15.69:0/2370973226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cfa1b0 0x5640b209b280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00b9e0 tx=0x7fbf3c00bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=33735337e2ec6e43 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.835+0000 7fbf3b000640 1 -- 172.21.15.69:0/2370973226 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c016070 con 0x5640b1cfa1b0 2024-05-14T15:26:12.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.835+0000 7fbf3b000640 1 -- 172.21.15.69:0/2370973226 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf3c0054b0 con 0x5640b1cfa1b0 2024-05-14T15:26:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.835+0000 7fbf3b000640 1 -- 172.21.15.69:0/2370973226 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3c004c40 con 0x5640b1cfa1b0 2024-05-14T15:26:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.836+0000 7fbf57bf4740 1 -- 172.21.15.69:0/2370973226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cfa1b0 msgr2=0x5640b209b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.836+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/2370973226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cfa1b0 0x5640b209b280 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c00b9e0 tx=0x7fbf3c00bea0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.836+0000 7fbf57bf4740 1 -- 172.21.15.69:0/2370973226 shutdown_connections 2024-05-14T15:26:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.836+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/2370973226 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cd94d0 0x5640b209bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.836+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/2370973226 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 0x5640b209b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.836+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/2370973226 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cfa1b0 0x5640b209b280 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.836+0000 7fbf57bf4740 1 -- 172.21.15.69:0/2370973226 >> 172.21.15.69:0/2370973226 conn(0x5640b1cee300 msgr2=0x5640b2097a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.836+0000 7fbf57bf4740 1 -- 172.21.15.69:0/2370973226 shutdown_connections 2024-05-14T15:26:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.836+0000 7fbf57bf4740 1 -- 172.21.15.69:0/2370973226 wait complete. 2024-05-14T15:26:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.836+0000 7fbf42a00640 1 --2- 172.21.15.69:0/2642746791 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbf300b2a60 0x7fbf300b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.837+0000 7fbf42a00640 1 -- 172.21.15.69:0/2642746791 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fbf440e2c20 con 0x7fbf4c10ad70 2024-05-14T15:26:12.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.837+0000 7fbf57bf4740 1 -- start start 2024-05-14T15:26:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.838+0000 7fbf57bf4740 1 Processor -- start 2024-05-14T15:26:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.838+0000 7fbf49400640 1 --2- 172.21.15.69:0/2642746791 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbf300b2a60 0x7fbf300b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.838+0000 7fbf57bf4740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 0x5640b20a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.838+0000 7fbf57bf4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cd94d0 0x5640b20a5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.838+0000 7fbf57bf4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cfa1b0 0x5640b20c2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.838+0000 7fbf57bf4740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5640b20b93c0 con 0x5640b1cd12f0 2024-05-14T15:26:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.838+0000 7fbf57bf4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5640b1fb9660 con 0x5640b1cd94d0 2024-05-14T15:26:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.838+0000 7fbf57bf4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5640b20b9540 con 0x5640b1cfa1b0 2024-05-14T15:26:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.839+0000 7fbf57bf4740 10 client.0 _ll_register_callbacks cb 0x5640b1f83400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:12.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.839+0000 7fbf49400640 1 --2- 172.21.15.69:0/2642746791 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbf300b2a60 0x7fbf300b4f70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbf340057c0 tx=0x7fbf34005fd0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.840+0000 7fbf49e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 0x5640b20a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.840+0000 7fbf4a800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cfa1b0 0x5640b20c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.840+0000 7fbf49e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 0x5640b20a57b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44532/0 (socket says 172.21.15.69:44532) 2024-05-14T15:26:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.840+0000 7fbf49e00640 1 -- 172.21.15.69:0/3799012019 learned_addr learned my addr 172.21.15.69:0/3799012019 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:12.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.840+0000 7fbf49400640 1 --2- 172.21.15.69:0/3799012019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cd94d0 0x5640b20a5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.840+0000 7fbf49e00640 1 -- 172.21.15.69:0/3799012019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cfa1b0 msgr2=0x5640b20c2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.840+0000 7fbf49e00640 1 --2- 172.21.15.69:0/3799012019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cfa1b0 0x5640b20c2870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.840+0000 7fbf49e00640 1 -- 172.21.15.69:0/3799012019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cd94d0 msgr2=0x5640b20a5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.840+0000 7fbf49e00640 1 --2- 172.21.15.69:0/3799012019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cd94d0 0x5640b20a5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.840+0000 7fbf49e00640 1 -- 172.21.15.69:0/3799012019 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b1dde620 con 0x5640b1cd12f0 2024-05-14T15:26:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.841+0000 7fbf49e00640 1 --2- 172.21.15.69:0/3799012019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 0x5640b20a57b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbf440a9850 tx=0x7fbf440a99e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1f535cbeb9cf14 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:12.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.841+0000 7fbf2f400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:26:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.841+0000 7fbf2f400640 1 -- 172.21.15.69:0/3799012019 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf440a9660 con 0x5640b1cd12f0 2024-05-14T15:26:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.841+0000 7fbf2f400640 1 -- 172.21.15.69:0/3799012019 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fbf440b2520 con 0x5640b1cd12f0 2024-05-14T15:26:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.841+0000 7fbf57bf4740 1 -- 172.21.15.69:0/3799012019 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf3c0054b0 con 0x5640b1cd12f0 2024-05-14T15:26:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.842+0000 7fbf2f400640 1 -- 172.21.15.69:0/3799012019 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fbf440aa250 con 0x5640b1cd12f0 2024-05-14T15:26:12.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.842+0000 7fbf57bf4740 10 client.16308 fetch_fsmap learned FSMap version 44 2024-05-14T15:26:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.842+0000 7fbf57bf4740 1 -- 172.21.15.69:0/3799012019 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5640b20c5620 con 0x5640b1cd12f0 2024-05-14T15:26:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.843+0000 7fbf2f400640 1 -- 172.21.15.69:0/3799012019 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf3c0054b0 con 0x5640b1cd12f0 2024-05-14T15:26:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.843+0000 7fbf2f400640 1 -- 172.21.15.69:0/3799012019 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7fbf4400f040 con 0x5640b1cd12f0 2024-05-14T15:26:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.843+0000 7fbf57bf4740 10 client.16308 fetch_fsmap finished waiting for FSMap version 44 2024-05-14T15:26:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.843+0000 7fbf57bf4740 10 client.16308 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:26:12.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.843+0000 7fbf57bf4740 20 client.16308 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.843+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/3799012019 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5640b1cb8d80 0x5640b20c8af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.843+0000 7fbf57bf4740 4 client.16308 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:26:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.843+0000 7fbf57bf4740 1 -- 172.21.15.69:0/3799012019 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640b200e160 con 0x5640b1cb8d80 2024-05-14T15:26:12.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.844+0000 7fbf49400640 1 --2- 172.21.15.69:0/3799012019 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5640b1cb8d80 0x5640b20c8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.845+0000 7fbf49400640 1 --2- 172.21.15.69:0/3799012019 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5640b1cb8d80 0x5640b20c8af0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=537babb36a9dd89e server_cookie=e125993ad24af37d in_seq=0 out_seq=0 2024-05-14T15:26:12.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.845+0000 7fbf2f400640 10 client.16308 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.848+0000 7fbf2f400640 1 -- 172.21.15.69:0/3799012019 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5640b200e160 con 0x5640b1cb8d80 2024-05-14T15:26:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.848+0000 7fbf2f400640 10 client.16308 handle_command_reply: tid=0 2024-05-14T15:26:12.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.848+0000 7fbf57bf4740 1 client.16308 shutdown 2024-05-14T15:26:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.849+0000 7fbf57bf4740 1 -- 172.21.15.69:0/3799012019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 msgr2=0x5640b20a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.849+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/3799012019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 0x5640b20a57b0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fbf440a9850 tx=0x7fbf440a99e0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.849+0000 7fbf57bf4740 1 -- 172.21.15.69:0/3799012019 shutdown_connections 2024-05-14T15:26:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.849+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/3799012019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cfa1b0 0x5640b20c2870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.849+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/3799012019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cd94d0 0x5640b20a5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.849+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/3799012019 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5640b1cb8d80 0x5640b20c8af0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.849+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/3799012019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 0x5640b20a57b0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.849+0000 7fbf2f400640 0 client.16308 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.849+0000 7fbf57bf4740 1 -- 172.21.15.69:0/3799012019 >> 172.21.15.69:0/3799012019 conn(0x5640b1cee300 msgr2=0x5640b209b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:12.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.850+0000 7fbf57bf4740 1 -- 172.21.15.69:0/3799012019 shutdown_connections 2024-05-14T15:26:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.850+0000 7fbf57bf4740 1 -- 172.21.15.69:0/3799012019 wait complete. 2024-05-14T15:26:12.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.851+0000 7fbf57bf4740 20 client.16308 trim_cache size 0 max 16384 2024-05-14T15:26:12.868 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-14T15:26:12.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.885+0000 7fbf57bf4740 1 Processor -- start 2024-05-14T15:26:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.886+0000 7fbf57bf4740 1 -- start start 2024-05-14T15:26:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.886+0000 7fbf57bf4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cd12f0 0x5640b209bae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.886+0000 7fbf57bf4740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd94d0 0x5640b20ce2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.886+0000 7fbf57bf4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cfa1b0 0x5640b20ce7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.886+0000 7fbf57bf4740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c1b9df0 con 0x5640b1cd94d0 2024-05-14T15:26:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.886+0000 7fbf57bf4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c1b7a60 con 0x5640b1cfa1b0 2024-05-14T15:26:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.886+0000 7fbf57bf4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c1b96f0 con 0x5640b1cd12f0 2024-05-14T15:26:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.887+0000 7fbf49400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd94d0 0x5640b20ce2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.887+0000 7fbf49400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd94d0 0x5640b20ce2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44540/0 (socket says 172.21.15.69:44540) 2024-05-14T15:26:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.887+0000 7fbf49400640 1 -- 172.21.15.69:0/655452511 learned_addr learned my addr 172.21.15.69:0/655452511 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.887+0000 7fbf4a800640 1 --2- 172.21.15.69:0/655452511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cfa1b0 0x5640b20ce7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.888+0000 7fbf49400640 1 -- 172.21.15.69:0/655452511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cd12f0 msgr2=0x5640b209bae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:26:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.888+0000 7fbf49400640 1 --2- 172.21.15.69:0/655452511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cd12f0 0x5640b209bae0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.888+0000 7fbf49400640 1 -- 172.21.15.69:0/655452511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cfa1b0 msgr2=0x5640b20ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:12.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.888+0000 7fbf49400640 1 --2- 172.21.15.69:0/655452511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cfa1b0 0x5640b20ce7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.888+0000 7fbf49400640 1 -- 172.21.15.69:0/655452511 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640b2098b40 con 0x5640b1cd94d0 2024-05-14T15:26:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.888+0000 7fbf4a800640 1 --2- 172.21.15.69:0/655452511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cfa1b0 0x5640b20ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:26:12.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.889+0000 7fbf49400640 1 --2- 172.21.15.69:0/655452511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd94d0 0x5640b20ce2b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c06c7c0 tx=0x7fbf34040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5f3ad764a408fe server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.889+0000 7fbf3a600640 1 -- 172.21.15.69:0/655452511 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf34035040 con 0x5640b1cd94d0 2024-05-14T15:26:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.889+0000 7fbf3a600640 1 -- 172.21.15.69:0/655452511 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf34003d20 con 0x5640b1cd94d0 2024-05-14T15:26:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.889+0000 7fbf3a600640 1 -- 172.21.15.69:0/655452511 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf3403c8d0 con 0x5640b1cd94d0 2024-05-14T15:26:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.890+0000 7fbf57bf4740 1 -- 172.21.15.69:0/655452511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd94d0 msgr2=0x5640b20ce2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.890+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/655452511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd94d0 0x5640b20ce2b0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c06c7c0 tx=0x7fbf34040000 comp rx=0 tx=0).stop 2024-05-14T15:26:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.891+0000 7fbf57bf4740 1 -- 172.21.15.69:0/655452511 shutdown_connections 2024-05-14T15:26:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.891+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/655452511 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cfa1b0 0x5640b20ce7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.891+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/655452511 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd94d0 0x5640b20ce2b0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.891+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/655452511 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cd12f0 0x5640b209bae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.891+0000 7fbf57bf4740 1 -- 172.21.15.69:0/655452511 >> 172.21.15.69:0/655452511 conn(0x5640b1cee300 msgr2=0x5640b2096a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:12.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.891+0000 7fbf57bf4740 1 -- 172.21.15.69:0/655452511 shutdown_connections 2024-05-14T15:26:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.891+0000 7fbf57bf4740 1 -- 172.21.15.69:0/655452511 wait complete. 2024-05-14T15:26:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.892+0000 7fbf57bf4740 1 -- start start 2024-05-14T15:26:12.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.892+0000 7fbf57bf4740 1 Processor -- start 2024-05-14T15:26:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.894+0000 7fbf57bf4740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 0x5640b20ba480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.894+0000 7fbf57bf4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cd94d0 0x5640b20ba9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.894+0000 7fbf57bf4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cfa1b0 0x5640b20baf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.894+0000 7fbf57bf4740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c1b8830 con 0x5640b1cd12f0 2024-05-14T15:26:12.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.894+0000 7fbf57bf4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c1b8130 con 0x5640b1cd94d0 2024-05-14T15:26:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.894+0000 7fbf57bf4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c1b8fc0 con 0x5640b1cfa1b0 2024-05-14T15:26:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.894+0000 7fbf57bf4740 10 client.0 _ll_register_callbacks cb 0x7fbf44011c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.895+0000 7fbf49400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cd94d0 0x5640b20ba9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.895+0000 7fbf49400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cd94d0 0x5640b20ba9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:42926/0 (socket says 172.21.15.69:42926) 2024-05-14T15:26:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.895+0000 7fbf49400640 1 -- 172.21.15.69:0/2676812424 learned_addr learned my addr 172.21.15.69:0/2676812424 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:12.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.895+0000 7fbf49e00640 1 --2- 172.21.15.69:0/2676812424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 0x5640b20ba480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.896+0000 7fbf4a800640 1 --2- 172.21.15.69:0/2676812424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cfa1b0 0x5640b20baf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.896+0000 7fbf49e00640 1 -- 172.21.15.69:0/2676812424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cfa1b0 msgr2=0x5640b20baf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.896+0000 7fbf49e00640 1 --2- 172.21.15.69:0/2676812424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cfa1b0 0x5640b20baf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.896+0000 7fbf49e00640 1 -- 172.21.15.69:0/2676812424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cd94d0 msgr2=0x5640b20ba9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.896+0000 7fbf49e00640 1 --2- 172.21.15.69:0/2676812424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cd94d0 0x5640b20ba9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.896+0000 7fbf49e00640 1 -- 172.21.15.69:0/2676812424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5640b2098950 con 0x5640b1cd12f0 2024-05-14T15:26:12.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.896+0000 7fbf49400640 1 --2- 172.21.15.69:0/2676812424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cd94d0 0x5640b20ba9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:26:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.896+0000 7fbf49e00640 1 --2- 172.21.15.69:0/2676812424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 0x5640b20ba480 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fbf440a9ae0 tx=0x7fbf44005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=908b00cae9987b7d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.897+0000 7fbf2f400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:26:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.897+0000 7fbf2f400640 1 -- 172.21.15.69:0/2676812424 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf440e5070 con 0x5640b1cd12f0 2024-05-14T15:26:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.897+0000 7fbf2f400640 1 -- 172.21.15.69:0/2676812424 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fbf440af090 con 0x5640b1cd12f0 2024-05-14T15:26:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.897+0000 7fbf57bf4740 1 -- 172.21.15.69:0/2676812424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf34003d20 con 0x5640b1cd12f0 2024-05-14T15:26:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.897+0000 7fbf2f400640 1 -- 172.21.15.69:0/2676812424 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7fbf440a6ac0 con 0x5640b1cd12f0 2024-05-14T15:26:12.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.898+0000 7fbf57bf4740 10 client.16314 fetch_fsmap learned FSMap version 44 2024-05-14T15:26:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.898+0000 7fbf57bf4740 1 -- 172.21.15.69:0/2676812424 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5640b2130ed0 con 0x5640b1cd12f0 2024-05-14T15:26:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.898+0000 7fbf2f400640 1 -- 172.21.15.69:0/2676812424 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbf440a9660 con 0x5640b1cd12f0 2024-05-14T15:26:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.898+0000 7fbf2f400640 1 -- 172.21.15.69:0/2676812424 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7fbf440af290 con 0x5640b1cd12f0 2024-05-14T15:26:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.898+0000 7fbf57bf4740 10 client.16314 fetch_fsmap finished waiting for FSMap version 44 2024-05-14T15:26:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.898+0000 7fbf57bf4740 10 client.16314 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:26:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.898+0000 7fbf57bf4740 20 client.16314 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.898+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/2676812424 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5640b1c8e1c0 0x5640b21336a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.898+0000 7fbf57bf4740 4 client.16314 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:26:12.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.898+0000 7fbf57bf4740 1 -- 172.21.15.69:0/2676812424 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fbf34003d20 con 0x5640b1c8e1c0 2024-05-14T15:26:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.899+0000 7fbf49400640 1 --2- 172.21.15.69:0/2676812424 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5640b1c8e1c0 0x5640b21336a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.900+0000 7fbf49400640 1 --2- 172.21.15.69:0/2676812424 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5640b1c8e1c0 0x5640b21336a0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2640b1d529b4111b server_cookie=d2b52df41ee68d27 in_seq=0 out_seq=0 2024-05-14T15:26:12.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.900+0000 7fbf2f400640 10 client.16314 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.922+0000 7fbf2f400640 1 -- 172.21.15.69:0/2676812424 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fbf34003d20 con 0x5640b1c8e1c0 2024-05-14T15:26:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.922+0000 7fbf2f400640 10 client.16314 handle_command_reply: tid=0 2024-05-14T15:26:12.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.922+0000 7fbf57bf4740 1 client.16314 shutdown 2024-05-14T15:26:12.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.923+0000 7fbf57bf4740 1 -- 172.21.15.69:0/2676812424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 msgr2=0x5640b20ba480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:12.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.923+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/2676812424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 0x5640b20ba480 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fbf440a9ae0 tx=0x7fbf44005f10 comp rx=0 tx=0).stop 2024-05-14T15:26:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.924+0000 7fbf57bf4740 1 -- 172.21.15.69:0/2676812424 shutdown_connections 2024-05-14T15:26:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.924+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/2676812424 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640b1cfa1b0 0x5640b20baf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.924+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/2676812424 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640b1cd94d0 0x5640b20ba9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.924+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/2676812424 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5640b1c8e1c0 0x5640b21336a0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.925+0000 7fbf57bf4740 1 --2- 172.21.15.69:0/2676812424 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640b1cd12f0 0x5640b20ba480 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.925+0000 7fbf2f400640 0 client.16314 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.925+0000 7fbf57bf4740 1 -- 172.21.15.69:0/2676812424 >> 172.21.15.69:0/2676812424 conn(0x5640b1cee300 msgr2=0x5640b20a4e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.925+0000 7fbf57bf4740 1 -- 172.21.15.69:0/2676812424 shutdown_connections 2024-05-14T15:26:12.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.925+0000 7fbf57bf4740 1 -- 172.21.15.69:0/2676812424 wait complete. 2024-05-14T15:26:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.926+0000 7fbf57bf4740 20 client.16314 trim_cache size 0 max 16384 2024-05-14T15:26:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:26:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:26:12.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:26:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:26:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.927+0000 7fbf50c00640 1 -- 172.21.15.69:0/2642746791 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbf300b2a60 msgr2=0x7fbf300b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.928+0000 7fbf50c00640 1 --2- 172.21.15.69:0/2642746791 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbf300b2a60 0x7fbf300b4f70 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbf340057c0 tx=0x7fbf34005fd0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.928+0000 7fbf50c00640 1 -- 172.21.15.69:0/2642746791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf4c10ad70 msgr2=0x7fbf4c1a19f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:12.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.928+0000 7fbf50c00640 1 --2- 172.21.15.69:0/2642746791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf4c10ad70 0x7fbf4c1a19f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbf4400ea80 tx=0x7fbf4400ef40 comp rx=0 tx=0).stop 2024-05-14T15:26:12.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.928+0000 7fbf50c00640 1 -- 172.21.15.69:0/2642746791 shutdown_connections 2024-05-14T15:26:12.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.928+0000 7fbf50c00640 1 --2- 172.21.15.69:0/2642746791 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbf300b2a60 0x7fbf300b4f70 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.928+0000 7fbf50c00640 1 --2- 172.21.15.69:0/2642746791 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbf4c1150a0 0x7fbf4c1a2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.928+0000 7fbf50c00640 1 --2- 172.21.15.69:0/2642746791 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbf4c10f340 0x7fbf4c1a1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.928+0000 7fbf50c00640 1 --2- 172.21.15.69:0/2642746791 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbf4c10ad70 0x7fbf4c1a19f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:12.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.928+0000 7fbf50c00640 1 -- 172.21.15.69:0/2642746791 >> 172.21.15.69:0/2642746791 conn(0x7fbf4c06edb0 msgr2=0x7fbf4c10bdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:12.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.929+0000 7fbf50c00640 1 -- 172.21.15.69:0/2642746791 shutdown_connections 2024-05-14T15:26:12.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:12.929+0000 7fbf50c00640 1 -- 172.21.15.69:0/2642746791 wait complete. 2024-05-14T15:26:13.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:13 smithi069 ceph-mon[31270]: pgmap v140: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 604 op/s 2024-05-14T15:26:13.344 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:13 smithi092 ceph-mon[34729]: pgmap v140: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 604 op/s 2024-05-14T15:26:13.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:13 smithi203 ceph-mon[34567]: pgmap v140: 129 pgs: 129 active+clean; 1.4 GiB data, 3.3 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.7 MiB/s wr, 604 op/s 2024-05-14T15:26:13.545 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:26:15.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:15 smithi203 ceph-mon[34567]: pgmap v141: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.7 MiB/s wr, 973 op/s 2024-05-14T15:26:15.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:15 smithi092 ceph-mon[34729]: pgmap v141: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.7 MiB/s wr, 973 op/s 2024-05-14T15:26:15.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:15 smithi069 ceph-mon[31270]: pgmap v141: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 8.7 MiB/s wr, 973 op/s 2024-05-14T15:26:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 30.0 s, 708.8 tps, lat 89.221 ms stddev 54.893 2024-05-14T15:26:16.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.210+0000 7feacbc00700 1 -- 172.21.15.69:0/1929858821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feac4106570 msgr2=0x7feac4106980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:16.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.211+0000 7feacbc00700 1 --2- 172.21.15.69:0/1929858821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feac4106570 0x7feac4106980 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7feab00098f0 tx=0x7feab0009c00 comp rx=0 tx=0).stop 2024-05-14T15:26:16.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.211+0000 7feacbc00700 1 -- 172.21.15.69:0/1929858821 shutdown_connections 2024-05-14T15:26:16.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.211+0000 7feacbc00700 1 --2- 172.21.15.69:0/1929858821 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feac4106ec0 0x7feac4113350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.211+0000 7feacbc00700 1 --2- 172.21.15.69:0/1929858821 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feac410c5b0 0x7feac410c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.211+0000 7feacbc00700 1 --2- 172.21.15.69:0/1929858821 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feac4106570 0x7feac4106980 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.211+0000 7feacbc00700 1 -- 172.21.15.69:0/1929858821 >> 172.21.15.69:0/1929858821 conn(0x7feac4102050 msgr2=0x7feac41044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:16.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.211+0000 7feacbc00700 1 -- 172.21.15.69:0/1929858821 shutdown_connections 2024-05-14T15:26:16.648 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.212+0000 7feacbc00700 1 -- 172.21.15.69:0/1929858821 wait complete. 2024-05-14T15:26:16.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.213+0000 7feacbc00700 1 Processor -- start 2024-05-14T15:26:16.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.214+0000 7feacbc00700 1 -- start start 2024-05-14T15:26:16.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.214+0000 7feacbc00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feac4106570 0x7feac419d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.214+0000 7feacbc00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feac4106ec0 0x7feac419d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.214+0000 7feacbc00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feac410c5b0 0x7feac41a1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.214+0000 7feacbc00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7feac4116590 con 0x7feac410c5b0 2024-05-14T15:26:16.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.214+0000 7feacbc00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feac4116410 con 0x7feac4106570 2024-05-14T15:26:16.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.214+0000 7feacbc00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feac4116710 con 0x7feac4106ec0 2024-05-14T15:26:16.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.215+0000 7feac3e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feac4106ec0 0x7feac419d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:16.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.215+0000 7feac3e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feac4106ec0 0x7feac419d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:48148/0 (socket says 172.21.15.69:48148) 2024-05-14T15:26:16.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.215+0000 7feac3e00700 1 -- 172.21.15.69:0/4221557698 learned_addr learned my addr 172.21.15.69:0/4221557698 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:16.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.215+0000 7feac9c00700 1 --2- 172.21.15.69:0/4221557698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feac410c5b0 0x7feac41a1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:16.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.215+0000 7feac3e00700 1 -- 172.21.15.69:0/4221557698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feac4106570 msgr2=0x7feac419d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:16.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.215+0000 7feac3e00700 1 --2- 172.21.15.69:0/4221557698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feac4106570 0x7feac419d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.215+0000 7feac3e00700 1 -- 172.21.15.69:0/4221557698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feac410c5b0 msgr2=0x7feac41a1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:16.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.215+0000 7feac3e00700 1 --2- 172.21.15.69:0/4221557698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feac410c5b0 0x7feac41a1830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.215+0000 7feac3e00700 1 -- 172.21.15.69:0/4221557698 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac41a1ed0 con 0x7feac4106ec0 2024-05-14T15:26:16.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.216+0000 7feac3e00700 1 --2- 172.21.15.69:0/4221557698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feac4106ec0 0x7feac419d5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feab0009810 tx=0x7feab0009400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:16.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.216+0000 7feac1600700 1 -- 172.21.15.69:0/4221557698 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab000bb30 con 0x7feac4106ec0 2024-05-14T15:26:16.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.217+0000 7feac1600700 1 -- 172.21.15.69:0/4221557698 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feab00054d0 con 0x7feac4106ec0 2024-05-14T15:26:16.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.217+0000 7feac1600700 1 -- 172.21.15.69:0/4221557698 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab0017400 con 0x7feac4106ec0 2024-05-14T15:26:16.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.217+0000 7feacbc00700 1 -- 172.21.15.69:0/4221557698 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac41a2160 con 0x7feac4106ec0 2024-05-14T15:26:16.651 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.217+0000 7feacbc00700 1 -- 172.21.15.69:0/4221557698 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac41a25f0 con 0x7feac4106ec0 2024-05-14T15:26:16.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.222+0000 7feada698b80 1 Processor -- start 2024-05-14T15:26:16.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.223+0000 7feada698b80 1 -- start start 2024-05-14T15:26:16.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.223+0000 7feada698b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f59cfe40 0x5579f5b536b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.223+0000 7feada698b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b4d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.223+0000 7feada698b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 0x5579f5b4e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.223+0000 7feada698b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5579f5a6fa20 con 0x5579f5b4dc50 2024-05-14T15:26:16.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.223+0000 7feada698b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5579f5a0d760 con 0x5579f59cfe40 2024-05-14T15:26:16.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.223+0000 7feada698b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5579f5a6b9e0 con 0x5579f5b53bf0 2024-05-14T15:26:16.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.224+0000 7feac9200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b4d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:16.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.224+0000 7feac9200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b4d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:48160/0 (socket says 172.21.15.69:48160) 2024-05-14T15:26:16.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.224+0000 7feac9200700 1 -- 172.21.15.69:0/3630937561 learned_addr learned my addr 172.21.15.69:0/3630937561 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:16.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.224+0000 7feac9c00700 1 --2- 172.21.15.69:0/3630937561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f59cfe40 0x5579f5b536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:16.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.225+0000 7feac9200700 1 -- 172.21.15.69:0/3630937561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f59cfe40 msgr2=0x5579f5b536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:16.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.225+0000 7feac9200700 1 --2- 172.21.15.69:0/3630937561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f59cfe40 0x5579f5b536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.652 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.225+0000 7feac9200700 1 -- 172.21.15.69:0/3630937561 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 msgr2=0x5579f5b4e060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:26:16.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.225+0000 7feac9200700 1 --2- 172.21.15.69:0/3630937561 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 0x5579f5b4e060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.225+0000 7feac9200700 1 -- 172.21.15.69:0/3630937561 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579f59bc8d0 con 0x5579f5b53bf0 2024-05-14T15:26:16.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.225+0000 7feac1600700 1 -- 172.21.15.69:0/4221557698 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7feab00175a0 con 0x7feac4106ec0 2024-05-14T15:26:16.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.225+0000 7feac9200700 1 --2- 172.21.15.69:0/3630937561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b4d710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feab800bb60 tx=0x7feab800be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cee2032174f270e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:16.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.226+0000 7feab6000700 1 -- 172.21.15.69:0/3630937561 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8014030 con 0x5579f5b53bf0 2024-05-14T15:26:16.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.227+0000 7feab6000700 1 -- 172.21.15.69:0/3630937561 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feab800dd20 con 0x5579f5b53bf0 2024-05-14T15:26:16.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.227+0000 7feab6000700 1 -- 172.21.15.69:0/3630937561 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab8005310 con 0x5579f5b53bf0 2024-05-14T15:26:16.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.228+0000 7feac1600700 1 --2- 172.21.15.69:0/4221557698 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7feaac0b2bc0 0x7feaac0b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.228+0000 7feac1600700 1 -- 172.21.15.69:0/4221557698 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7feab00e3910 con 0x7feac4106ec0 2024-05-14T15:26:16.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.228+0000 7feada698b80 1 -- 172.21.15.69:0/3630937561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 msgr2=0x5579f5b4d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:16.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.228+0000 7feada698b80 1 --2- 172.21.15.69:0/3630937561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b4d710 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7feab800bb60 tx=0x7feab800be70 comp rx=0 tx=0).stop 2024-05-14T15:26:16.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.228+0000 7feac9c00700 1 --2- 172.21.15.69:0/4221557698 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7feaac0b2bc0 0x7feaac0b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:16.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.228+0000 7feada698b80 1 -- 172.21.15.69:0/3630937561 shutdown_connections 2024-05-14T15:26:16.653 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.228+0000 7feada698b80 1 --2- 172.21.15.69:0/3630937561 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 0x5579f5b4e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.228+0000 7feada698b80 1 --2- 172.21.15.69:0/3630937561 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f59cfe40 0x5579f5b536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.228+0000 7feada698b80 1 --2- 172.21.15.69:0/3630937561 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b4d710 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.228+0000 7feada698b80 1 -- 172.21.15.69:0/3630937561 >> 172.21.15.69:0/3630937561 conn(0x5579f5a0ea80 msgr2=0x5579f5b48790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:16.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.230+0000 7feac9c00700 1 --2- 172.21.15.69:0/4221557698 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7feaac0b2bc0 0x7feaac0b50d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x5579f5b4ea30 tx=0x7feabc00b040 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:16.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.230+0000 7feada698b80 1 -- 172.21.15.69:0/3630937561 shutdown_connections 2024-05-14T15:26:16.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.230+0000 7feada698b80 1 -- 172.21.15.69:0/3630937561 wait complete. 2024-05-14T15:26:16.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.232+0000 7feada698b80 1 -- start start 2024-05-14T15:26:16.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.232+0000 7feada698b80 1 Processor -- start 2024-05-14T15:26:16.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.233+0000 7feada698b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f59cfe40 0x5579f5b573f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.233+0000 7feada698b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 0x5579f5b57930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.233+0000 7feada698b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b57e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.233+0000 7feada698b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5579f5b5a6c0 con 0x5579f5b4dc50 2024-05-14T15:26:16.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.233+0000 7feada698b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5579f59d5b20 con 0x5579f59cfe40 2024-05-14T15:26:16.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.233+0000 7feada698b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5579f5b5a840 con 0x5579f5b53bf0 2024-05-14T15:26:16.654 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.233+0000 7feada698b80 10 client.0 _ll_register_callbacks cb 0x5579f5a03380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:16.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.233+0000 7feac9200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f59cfe40 0x5579f5b573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:16.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.233+0000 7feac3e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 0x5579f5b57930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:16.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.233+0000 7feac9200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f59cfe40 0x5579f5b573f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:42960/0 (socket says 172.21.15.69:42960) 2024-05-14T15:26:16.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.234+0000 7feac9200700 1 -- 172.21.15.69:0/200574747 learned_addr learned my addr 172.21.15.69:0/200574747 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:16.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.234+0000 7feac9c00700 1 --2- 172.21.15.69:0/200574747 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b57e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:16.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.233+0000 7feac3e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 0x5579f5b57930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44570/0 (socket says 172.21.15.69:44570) 2024-05-14T15:26:16.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.234+0000 7feac9c00700 1 -- 172.21.15.69:0/200574747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f59cfe40 msgr2=0x5579f5b573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:16.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.234+0000 7feac9c00700 1 --2- 172.21.15.69:0/200574747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f59cfe40 0x5579f5b573f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.234+0000 7feac9c00700 1 -- 172.21.15.69:0/200574747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 msgr2=0x5579f5b57930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:16.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.234+0000 7feac9c00700 1 --2- 172.21.15.69:0/200574747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 0x5579f5b57930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.234+0000 7feac9c00700 1 -- 172.21.15.69:0/200574747 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579f5a35420 con 0x5579f5b53bf0 2024-05-14T15:26:16.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.234+0000 7feac3e00700 1 --2- 172.21.15.69:0/200574747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 0x5579f5b57930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:26:16.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.235+0000 7feac9c00700 1 --2- 172.21.15.69:0/200574747 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b57e70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feabc009e60 tx=0x7feabc004b40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e13567856d871e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:16.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.235+0000 7feaaaa00700 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:26:16.655 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.235+0000 7feaaaa00700 1 -- 172.21.15.69:0/200574747 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc029060 con 0x5579f5b53bf0 2024-05-14T15:26:16.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.235+0000 7feaaaa00700 1 -- 172.21.15.69:0/200574747 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7feabc016630 con 0x5579f5b53bf0 2024-05-14T15:26:16.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.236+0000 7feada698b80 1 -- 172.21.15.69:0/200574747 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feab800dd20 con 0x5579f5b53bf0 2024-05-14T15:26:16.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.236+0000 7feaaaa00700 1 -- 172.21.15.69:0/200574747 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7feabc016830 con 0x5579f5b53bf0 2024-05-14T15:26:16.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.236+0000 7feada698b80 10 client.25804 fetch_fsmap learned FSMap version 44 2024-05-14T15:26:16.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.236+0000 7feada698b80 1 -- 172.21.15.69:0/200574747 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5579f5b653a0 con 0x5579f5b53bf0 2024-05-14T15:26:16.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.237+0000 7feaaaa00700 1 -- 172.21.15.69:0/200574747 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feab800dd20 con 0x5579f5b53bf0 2024-05-14T15:26:16.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.237+0000 7feaaaa00700 1 -- 172.21.15.69:0/200574747 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7feabc024780 con 0x5579f5b53bf0 2024-05-14T15:26:16.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.237+0000 7feada698b80 10 client.25804 fetch_fsmap finished waiting for FSMap version 44 2024-05-14T15:26:16.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.237+0000 7feada698b80 10 client.25804 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.i 2024-05-14T15:26:16.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.237+0000 7feada698b80 20 client.25804 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:16.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.238+0000 7feada698b80 1 --2- 172.21.15.69:0/200574747 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x5579f5b67ba0 0x5579f5b6a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.238+0000 7feada698b80 4 client.25804 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:26:16.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.238+0000 7feada698b80 1 -- 172.21.15.69:0/200574747 --> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5579f5b1a070 con 0x5579f5b67ba0 2024-05-14T15:26:16.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.239+0000 7feac9200700 1 --2- 172.21.15.69:0/200574747 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x5579f5b67ba0 0x5579f5b6a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:16.656 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.240+0000 7feac9200700 1 --2- 172.21.15.69:0/200574747 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x5579f5b67ba0 0x5579f5b6a010 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8d74c3f4a4091ed1 server_cookie=ba2c0bb2dabac6e6 in_seq=0 out_seq=0 2024-05-14T15:26:16.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.240+0000 7feaaaa00700 10 client.25804 ms_handle_connect on v2:172.21.15.203:6838/3167469844 2024-05-14T15:26:16.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.241+0000 7feaaaa00700 1 -- 172.21.15.69:0/200574747 <== mds.4 v2:172.21.15.203:6838/3167469844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5579f5b1a070 con 0x5579f5b67ba0 2024-05-14T15:26:16.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.241+0000 7feaaaa00700 10 client.25804 handle_command_reply: tid=0 2024-05-14T15:26:16.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.241+0000 7feada698b80 1 client.25804 shutdown 2024-05-14T15:26:16.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.241+0000 7feada698b80 1 -- 172.21.15.69:0/200574747 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 msgr2=0x5579f5b57e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:16.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.241+0000 7feada698b80 1 --2- 172.21.15.69:0/200574747 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b57e70 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7feabc009e60 tx=0x7feabc004b40 comp rx=0 tx=0).stop 2024-05-14T15:26:16.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.241+0000 7feada698b80 1 -- 172.21.15.69:0/200574747 shutdown_connections 2024-05-14T15:26:16.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.241+0000 7feada698b80 1 --2- 172.21.15.69:0/200574747 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x5579f5b67ba0 0x5579f5b6a010 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.241+0000 7feada698b80 1 --2- 172.21.15.69:0/200574747 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b57e70 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.241+0000 7feada698b80 1 --2- 172.21.15.69:0/200574747 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f59cfe40 0x5579f5b573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.241+0000 7feada698b80 1 --2- 172.21.15.69:0/200574747 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 0x5579f5b57930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.241+0000 7feaaaa00700 0 client.25804 ms_handle_reset on v2:172.21.15.203:6838/3167469844 2024-05-14T15:26:16.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.241+0000 7feada698b80 1 -- 172.21.15.69:0/200574747 >> 172.21.15.69:0/200574747 conn(0x5579f5a0ea80 msgr2=0x5579f5b4c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:16.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.242+0000 7feada698b80 1 -- 172.21.15.69:0/200574747 shutdown_connections 2024-05-14T15:26:16.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.242+0000 7feada698b80 1 -- 172.21.15.69:0/200574747 wait complete. 2024-05-14T15:26:16.657 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.242+0000 7feada698b80 20 client.25804 trim_cache size 0 max 16384 2024-05-14T15:26:16.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.268+0000 7feada698b80 1 Processor -- start 2024-05-14T15:26:16.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.268+0000 7feada698b80 1 -- start start 2024-05-14T15:26:16.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.268+0000 7feada698b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f59cfe40 0x5579f5b4d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.268+0000 7feada698b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 0x5579f5b517e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.268+0000 7feada698b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b63710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.268+0000 7feada698b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7feac41b2750 con 0x5579f5b4dc50 2024-05-14T15:26:16.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.268+0000 7feada698b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feac41b43e0 con 0x5579f59cfe40 2024-05-14T15:26:16.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.268+0000 7feada698b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feac41b2e20 con 0x5579f5b53bf0 2024-05-14T15:26:16.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.269+0000 7feac3e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 0x5579f5b517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:16.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.269+0000 7feac9c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b63710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:16.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.269+0000 7feac9c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b63710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:48188/0 (socket says 172.21.15.69:48188) 2024-05-14T15:26:16.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.269+0000 7feac3e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 0x5579f5b517e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44586/0 (socket says 172.21.15.69:44586) 2024-05-14T15:26:16.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.269+0000 7feac9c00700 1 -- 172.21.15.69:0/1664448117 learned_addr learned my addr 172.21.15.69:0/1664448117 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:16.658 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.269+0000 7feac9200700 1 --2- 172.21.15.69:0/1664448117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f59cfe40 0x5579f5b4d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:16.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.269+0000 7feac9c00700 1 -- 172.21.15.69:0/1664448117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f59cfe40 msgr2=0x5579f5b4d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:16.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.269+0000 7feac9c00700 1 --2- 172.21.15.69:0/1664448117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f59cfe40 0x5579f5b4d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.269+0000 7feac9c00700 1 -- 172.21.15.69:0/1664448117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 msgr2=0x5579f5b517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:16.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.269+0000 7feac9c00700 1 --2- 172.21.15.69:0/1664448117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 0x5579f5b517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.269+0000 7feac9c00700 1 -- 172.21.15.69:0/1664448117 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579f5b430e0 con 0x5579f5b53bf0 2024-05-14T15:26:16.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.270+0000 7feac9c00700 1 --2- 172.21.15.69:0/1664448117 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b63710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feabc007b20 tx=0x7feabc004720 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d3d4966b04800f4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:16.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.270+0000 7feab5600700 1 -- 172.21.15.69:0/1664448117 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc03c070 con 0x5579f5b53bf0 2024-05-14T15:26:16.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.270+0000 7feab5600700 1 -- 172.21.15.69:0/1664448117 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feabc01f050 con 0x5579f5b53bf0 2024-05-14T15:26:16.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.270+0000 7feab5600700 1 -- 172.21.15.69:0/1664448117 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc033080 con 0x5579f5b53bf0 2024-05-14T15:26:16.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.271+0000 7feada698b80 1 -- 172.21.15.69:0/1664448117 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 msgr2=0x5579f5b63710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:16.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.271+0000 7feada698b80 1 --2- 172.21.15.69:0/1664448117 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b63710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7feabc007b20 tx=0x7feabc004720 comp rx=0 tx=0).stop 2024-05-14T15:26:16.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.271+0000 7feada698b80 1 -- 172.21.15.69:0/1664448117 shutdown_connections 2024-05-14T15:26:16.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.271+0000 7feada698b80 1 --2- 172.21.15.69:0/1664448117 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b53bf0 0x5579f5b63710 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.659 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.271+0000 7feada698b80 1 --2- 172.21.15.69:0/1664448117 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f59cfe40 0x5579f5b4d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.271+0000 7feada698b80 1 --2- 172.21.15.69:0/1664448117 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f5b4dc50 0x5579f5b517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.271+0000 7feada698b80 1 -- 172.21.15.69:0/1664448117 >> 172.21.15.69:0/1664448117 conn(0x5579f5a0ea80 msgr2=0x5579f5b510d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.272+0000 7feada698b80 1 -- 172.21.15.69:0/1664448117 shutdown_connections 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.272+0000 7feada698b80 1 -- 172.21.15.69:0/1664448117 wait complete. 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.272+0000 7feada698b80 1 -- start start 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.272+0000 7feada698b80 1 Processor -- start 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.273+0000 7feada698b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f59cfe40 0x5579f5b5fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.273+0000 7feada698b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b4dc50 0x5579f5b62ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.273+0000 7feada698b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f5b53bf0 0x5579f5b63220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.274+0000 7feada698b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7feac41b3cb0 con 0x5579f59cfe40 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.274+0000 7feada698b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feac41b3520 con 0x5579f5b53bf0 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.274+0000 7feada698b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feac41b06f0 con 0x5579f5b4dc50 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.274+0000 7feada698b80 10 client.0 _ll_register_callbacks cb 0x5579f5a03380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.274+0000 7feac3e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b4dc50 0x5579f5b62ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.274+0000 7feac9c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f5b53bf0 0x5579f5b63220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.274+0000 7feac9c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f5b53bf0 0x5579f5b63220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:42988/0 (socket says 172.21.15.69:42988) 2024-05-14T15:26:16.660 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.274+0000 7feac9c00700 1 -- 172.21.15.69:0/2601656518 learned_addr learned my addr 172.21.15.69:0/2601656518 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:16.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.274+0000 7feac9200700 1 --2- 172.21.15.69:0/2601656518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f59cfe40 0x5579f5b5fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:16.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.275+0000 7feac3e00700 1 -- 172.21.15.69:0/2601656518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f5b53bf0 msgr2=0x5579f5b63220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:16.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.275+0000 7feac3e00700 1 --2- 172.21.15.69:0/2601656518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f5b53bf0 0x5579f5b63220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.275+0000 7feac3e00700 1 -- 172.21.15.69:0/2601656518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f59cfe40 msgr2=0x5579f5b5fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:16.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.275+0000 7feac3e00700 1 --2- 172.21.15.69:0/2601656518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f59cfe40 0x5579f5b5fea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.275+0000 7feac3e00700 1 -- 172.21.15.69:0/2601656518 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579f5b5a7f0 con 0x5579f5b4dc50 2024-05-14T15:26:16.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.275+0000 7feac3e00700 1 --2- 172.21.15.69:0/2601656518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b4dc50 0x5579f5b62ce0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feab00e0c50 tx=0x7feab00a4f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c71650bff7d1ac4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:16.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.275+0000 7feaaaa00700 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:26:16.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.275+0000 7feaaaa00700 1 -- 172.21.15.69:0/2601656518 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feab00c7020 con 0x5579f5b4dc50 2024-05-14T15:26:16.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.276+0000 7feada698b80 1 -- 172.21.15.69:0/2601656518 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7feabc01f050 con 0x5579f5b4dc50 2024-05-14T15:26:16.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.276+0000 7feaaaa00700 1 -- 172.21.15.69:0/2601656518 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7feab0005040 con 0x5579f5b4dc50 2024-05-14T15:26:16.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.276+0000 7feaaaa00700 1 -- 172.21.15.69:0/2601656518 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=44) ==== 24+0+0 (secure 0 0 0) 0x7feab00c3020 con 0x5579f5b4dc50 2024-05-14T15:26:16.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.276+0000 7feada698b80 10 client.25810 fetch_fsmap learned FSMap version 44 2024-05-14T15:26:16.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.276+0000 7feada698b80 1 -- 172.21.15.69:0/2601656518 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=44,monmap=4+}) -- 0x5579f5bda860 con 0x5579f5b4dc50 2024-05-14T15:26:16.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.277+0000 7feaaaa00700 1 -- 172.21.15.69:0/2601656518 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feabc01f050 con 0x5579f5b4dc50 2024-05-14T15:26:16.661 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.278+0000 7feaaaa00700 1 -- 172.21.15.69:0/2601656518 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 44) ==== 8394+0+0 (secure 0 0 0) 0x7feab001f070 con 0x5579f5b4dc50 2024-05-14T15:26:16.662 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:26:16.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.278+0000 7feada698b80 10 client.25810 fetch_fsmap finished waiting for FSMap version 44 2024-05-14T15:26:16.662 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.278+0000 7feada698b80 10 client.25810 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.i 2024-05-14T15:26:16.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.278+0000 7feada698b80 20 client.25810 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:16.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.278+0000 7feada698b80 1 --2- 172.21.15.69:0/2601656518 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x5579f5bdaef0 0x5579f5bdd310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:16.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.278+0000 7feada698b80 4 client.25810 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:26:16.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.278+0000 7feada698b80 1 -- 172.21.15.69:0/2601656518 --> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5579f5a7d400 con 0x5579f5bdaef0 2024-05-14T15:26:16.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.278+0000 7feac9200700 1 --2- 172.21.15.69:0/2601656518 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x5579f5bdaef0 0x5579f5bdd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:16.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.279+0000 7feac9200700 1 --2- 172.21.15.69:0/2601656518 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x5579f5bdaef0 0x5579f5bdd310 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=319db9ab8d9b2444 server_cookie=73b2114590514d82 in_seq=0 out_seq=0 2024-05-14T15:26:16.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.279+0000 7feaaaa00700 10 client.25810 ms_handle_connect on v2:172.21.15.203:6838/3167469844 2024-05-14T15:26:16.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.280+0000 7feaaaa00700 1 -- 172.21.15.69:0/2601656518 <== mds.4 v2:172.21.15.203:6838/3167469844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5579f5a7d400 con 0x5579f5bdaef0 2024-05-14T15:26:16.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.280+0000 7feaaaa00700 10 client.25810 handle_command_reply: tid=0 2024-05-14T15:26:16.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.280+0000 7feada698b80 1 client.25810 shutdown 2024-05-14T15:26:16.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.280+0000 7feada698b80 1 -- 172.21.15.69:0/2601656518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b4dc50 msgr2=0x5579f5b62ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:16.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.280+0000 7feada698b80 1 --2- 172.21.15.69:0/2601656518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b4dc50 0x5579f5b62ce0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feab00e0c50 tx=0x7feab00a4f90 comp rx=0 tx=0).stop 2024-05-14T15:26:16.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.280+0000 7feada698b80 1 -- 172.21.15.69:0/2601656518 shutdown_connections 2024-05-14T15:26:16.663 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.280+0000 7feada698b80 1 --2- 172.21.15.69:0/2601656518 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x5579f5bdaef0 0x5579f5bdd310 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.280+0000 7feada698b80 1 --2- 172.21.15.69:0/2601656518 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5579f59cfe40 0x5579f5b5fea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.280+0000 7feaaaa00700 0 client.25810 ms_handle_reset on v2:172.21.15.203:6838/3167469844 2024-05-14T15:26:16.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.280+0000 7feada698b80 1 --2- 172.21.15.69:0/2601656518 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5579f5b53bf0 0x5579f5b63220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.280+0000 7feada698b80 1 --2- 172.21.15.69:0/2601656518 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5579f5b4dc50 0x5579f5b62ce0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.280+0000 7feada698b80 1 -- 172.21.15.69:0/2601656518 >> 172.21.15.69:0/2601656518 conn(0x5579f5a0ea80 msgr2=0x5579f5b47e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:16.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.281+0000 7feada698b80 1 -- 172.21.15.69:0/2601656518 shutdown_connections 2024-05-14T15:26:16.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.281+0000 7feada698b80 1 -- 172.21.15.69:0/2601656518 wait complete. 2024-05-14T15:26:16.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.281+0000 7feada698b80 20 client.25810 trim_cache size 0 max 16384 2024-05-14T15:26:16.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.282+0000 7feacbc00700 1 -- 172.21.15.69:0/4221557698 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7feaac0b2bc0 msgr2=0x7feaac0b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:16.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.282+0000 7feacbc00700 1 --2- 172.21.15.69:0/4221557698 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7feaac0b2bc0 0x7feaac0b50d0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x5579f5b4ea30 tx=0x7feabc00b040 comp rx=0 tx=0).stop 2024-05-14T15:26:16.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.282+0000 7feacbc00700 1 -- 172.21.15.69:0/4221557698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feac4106ec0 msgr2=0x7feac419d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:16.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.282+0000 7feacbc00700 1 --2- 172.21.15.69:0/4221557698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feac4106ec0 0x7feac419d5a0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7feab0009810 tx=0x7feab0009400 comp rx=0 tx=0).stop 2024-05-14T15:26:16.664 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.283+0000 7feacbc00700 1 -- 172.21.15.69:0/4221557698 shutdown_connections 2024-05-14T15:26:16.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.283+0000 7feacbc00700 1 --2- 172.21.15.69:0/4221557698 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7feaac0b2bc0 0x7feaac0b50d0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.283+0000 7feacbc00700 1 --2- 172.21.15.69:0/4221557698 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feac410c5b0 0x7feac41a1830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.283+0000 7feacbc00700 1 --2- 172.21.15.69:0/4221557698 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feac4106570 0x7feac419d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.283+0000 7feacbc00700 1 --2- 172.21.15.69:0/4221557698 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feac4106ec0 0x7feac419d5a0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:16.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.283+0000 7feacbc00700 1 -- 172.21.15.69:0/4221557698 >> 172.21.15.69:0/4221557698 conn(0x7feac4102050 msgr2=0x7feac41038b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:16.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.283+0000 7feacbc00700 1 -- 172.21.15.69:0/4221557698 shutdown_connections 2024-05-14T15:26:16.665 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:16.284+0000 7feacbc00700 1 -- 172.21.15.69:0/4221557698 wait complete. 2024-05-14T15:26:17.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:17 smithi203 ceph-mon[34567]: pgmap v142: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.6 MiB/s wr, 677 op/s 2024-05-14T15:26:17.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:17 smithi092 ceph-mon[34729]: pgmap v142: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.6 MiB/s wr, 677 op/s 2024-05-14T15:26:17.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:17 smithi069 ceph-mon[31270]: pgmap v142: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.6 MiB/s wr, 677 op/s 2024-05-14T15:26:18.065 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-14T15:26:18.731 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:26:19.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:19 smithi069 ceph-mon[31270]: pgmap v143: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.6 MiB/s wr, 677 op/s 2024-05-14T15:26:19.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:19 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:26:19.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:19 smithi203 ceph-mon[34567]: pgmap v143: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.6 MiB/s wr, 677 op/s 2024-05-14T15:26:19.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:19 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:26:19.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:19 smithi092 ceph-mon[34729]: pgmap v143: 129 pgs: 129 active+clean; 1.4 GiB data, 3.4 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.6 MiB/s wr, 677 op/s 2024-05-14T15:26:19.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:19 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:26:21.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:21 smithi203 ceph-mon[34567]: pgmap v144: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.1 MiB/s wr, 1.08k op/s 2024-05-14T15:26:21.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 35.0 s, 629.4 tps, lat 45.992 ms stddev 11.190 2024-05-14T15:26:21.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.416+0000 7f259be00700 1 -- 172.21.15.69:0/2229897516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2594109870 msgr2=0x7f25941111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:21.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.416+0000 7f259be00700 1 --2- 172.21.15.69:0/2229897516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2594109870 0x7f25941111d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f258400b0d0 tx=0x7f258400b3e0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.418 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:21 smithi069 ceph-mon[31270]: pgmap v144: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.1 MiB/s wr, 1.08k op/s 2024-05-14T15:26:21.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.416+0000 7f259be00700 1 -- 172.21.15.69:0/2229897516 shutdown_connections 2024-05-14T15:26:21.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.416+0000 7f259be00700 1 --2- 172.21.15.69:0/2229897516 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2594109870 0x7f25941111d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.416+0000 7f259be00700 1 --2- 172.21.15.69:0/2229897516 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25941045f0 0x7f2594104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.416+0000 7f259be00700 1 --2- 172.21.15.69:0/2229897516 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2594108f20 0x7f2594109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.418 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.416+0000 7f259be00700 1 -- 172.21.15.69:0/2229897516 >> 172.21.15.69:0/2229897516 conn(0x7f2594100040 msgr2=0x7f2594102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:21.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.418+0000 7f259be00700 1 -- 172.21.15.69:0/2229897516 shutdown_connections 2024-05-14T15:26:21.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.418+0000 7f259be00700 1 -- 172.21.15.69:0/2229897516 wait complete. 2024-05-14T15:26:21.421 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.420+0000 7f259be00700 1 Processor -- start 2024-05-14T15:26:21.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.420+0000 7f259be00700 1 -- start start 2024-05-14T15:26:21.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.421+0000 7f259be00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25941045f0 0x7f259410dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.423 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.421+0000 7f259be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2594108f20 0x7f259410e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.421+0000 7f259be00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2594109870 0x7f25941a6bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.421+0000 7f259be00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2594076ba0 con 0x7f2594108f20 2024-05-14T15:26:21.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.421+0000 7f259be00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2594076a20 con 0x7f25941045f0 2024-05-14T15:26:21.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.421+0000 7f259be00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2594076d20 con 0x7f2594109870 2024-05-14T15:26:21.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.422+0000 7f2598a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2594108f20 0x7f259410e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.422+0000 7f2598a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2594108f20 0x7f259410e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44610/0 (socket says 172.21.15.69:44610) 2024-05-14T15:26:21.424 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.422+0000 7f2598a00700 1 -- 172.21.15.69:0/1658433539 learned_addr learned my addr 172.21.15.69:0/1658433539 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:21.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.424+0000 7f2599e00700 1 --2- 172.21.15.69:0/1658433539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2594109870 0x7f25941a6bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.424+0000 7f2599400700 1 --2- 172.21.15.69:0/1658433539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25941045f0 0x7f259410dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.425+0000 7f2599e00700 1 -- 172.21.15.69:0/1658433539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25941045f0 msgr2=0x7f259410dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:21.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.425+0000 7f2599e00700 1 --2- 172.21.15.69:0/1658433539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25941045f0 0x7f259410dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.425+0000 7f2599e00700 1 -- 172.21.15.69:0/1658433539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2594108f20 msgr2=0x7f259410e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:21.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.425+0000 7f2599e00700 1 --2- 172.21.15.69:0/1658433539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2594108f20 0x7f259410e2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.425+0000 7f2599e00700 1 -- 172.21.15.69:0/1658433539 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25941a7170 con 0x7f2594109870 2024-05-14T15:26:21.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.426+0000 7f2599e00700 1 --2- 172.21.15.69:0/1658433539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2594109870 0x7f25941a6bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2584015000 tx=0x7f25840089b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:21.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.427+0000 7f2592000700 1 -- 172.21.15.69:0/1658433539 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258401f030 con 0x7f2594109870 2024-05-14T15:26:21.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.427+0000 7f2592000700 1 -- 172.21.15.69:0/1658433539 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2584008e20 con 0x7f2594109870 2024-05-14T15:26:21.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.427+0000 7f2592000700 1 -- 172.21.15.69:0/1658433539 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258401b760 con 0x7f2594109870 2024-05-14T15:26:21.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.427+0000 7f259be00700 1 -- 172.21.15.69:0/1658433539 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25941a7400 con 0x7f2594109870 2024-05-14T15:26:21.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.428+0000 7f259be00700 1 -- 172.21.15.69:0/1658433539 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25941a7890 con 0x7f2594109870 2024-05-14T15:26:21.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.434+0000 7f2592000700 1 -- 172.21.15.69:0/1658433539 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2584022030 con 0x7f2594109870 2024-05-14T15:26:21.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.437+0000 7f25aa934b80 1 Processor -- start 2024-05-14T15:26:21.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.437+0000 7f2592000700 1 --2- 172.21.15.69:0/1658433539 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f25780b2b40 0x7f25780b5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.437+0000 7f25aa934b80 1 -- start start 2024-05-14T15:26:21.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.437+0000 7f2592000700 1 -- 172.21.15.69:0/1658433539 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f25840e3680 con 0x7f2594109870 2024-05-14T15:26:21.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.437+0000 7f25aa934b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81795e40 0x55cc819192f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.438+0000 7f25aa934b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc81919830 0x55cc819134b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.438+0000 7f25aa934b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc819139f0 0x55cc81913e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.438+0000 7f25aa934b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cc81835a20 con 0x55cc81919830 2024-05-14T15:26:21.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.438+0000 7f25aa934b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cc817d3760 con 0x55cc819139f0 2024-05-14T15:26:21.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.438+0000 7f25aa934b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cc818319e0 con 0x55cc81795e40 2024-05-14T15:26:21.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.438+0000 7f2599400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81795e40 0x55cc819192f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.438+0000 7f2599400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81795e40 0x55cc819192f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:48222/0 (socket says 172.21.15.69:48222) 2024-05-14T15:26:21.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.438+0000 7f2599400700 1 -- 172.21.15.69:0/727538667 learned_addr learned my addr 172.21.15.69:0/727538667 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:21.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.439+0000 7f2598a00700 1 --2- 172.21.15.69:0/1658433539 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f25780b2b40 0x7f25780b5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.439+0000 7f2599e00700 1 --2- 172.21.15.69:0/727538667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc819139f0 0x55cc81913e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.440+0000 7f2598a00700 1 --2- 172.21.15.69:0/727538667 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc81919830 0x55cc819134b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.439+0000 7f2599400700 1 -- 172.21.15.69:0/727538667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc819139f0 msgr2=0x55cc81913e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:21.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.441+0000 7f2599400700 1 --2- 172.21.15.69:0/727538667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc819139f0 0x55cc81913e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.441+0000 7f2599400700 1 -- 172.21.15.69:0/727538667 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc81919830 msgr2=0x55cc819134b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:21.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.441+0000 7f2599400700 1 --2- 172.21.15.69:0/727538667 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc81919830 0x55cc819134b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.441+0000 7f2599400700 1 -- 172.21.15.69:0/727538667 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc817828d0 con 0x55cc81795e40 2024-05-14T15:26:21.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.441+0000 7f2598a00700 1 --2- 172.21.15.69:0/727538667 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc81919830 0x55cc819134b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:26:21.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.441+0000 7f2599e00700 1 --2- 172.21.15.69:0/727538667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc819139f0 0x55cc81913e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:26:21.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.441+0000 7f2598a00700 1 --2- 172.21.15.69:0/1658433539 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f25780b2b40 0x7f25780b5050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2580005f30 tx=0x7f2580005ec0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:21.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:21 smithi092 ceph-mon[34729]: pgmap v144: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 9.1 MiB/s wr, 1.08k op/s 2024-05-14T15:26:21.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.442+0000 7f2599400700 1 --2- 172.21.15.69:0/727538667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81795e40 0x55cc819192f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f258c007c90 tx=0x7f258c0103d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=369477443ff34296 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:21.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.443+0000 7f258aa00700 1 -- 172.21.15.69:0/727538667 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c010d60 con 0x55cc81795e40 2024-05-14T15:26:21.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.443+0000 7f258aa00700 1 -- 172.21.15.69:0/727538667 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f258c015070 con 0x55cc81795e40 2024-05-14T15:26:21.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.443+0000 7f258aa00700 1 -- 172.21.15.69:0/727538667 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c003dd0 con 0x55cc81795e40 2024-05-14T15:26:21.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.444+0000 7f25aa934b80 1 -- 172.21.15.69:0/727538667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81795e40 msgr2=0x55cc819192f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:21.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.444+0000 7f25aa934b80 1 --2- 172.21.15.69:0/727538667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81795e40 0x55cc819192f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f258c007c90 tx=0x7f258c0103d0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.444+0000 7f25aa934b80 1 -- 172.21.15.69:0/727538667 shutdown_connections 2024-05-14T15:26:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.444+0000 7f25aa934b80 1 --2- 172.21.15.69:0/727538667 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc819139f0 0x55cc81913e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.445+0000 7f25aa934b80 1 --2- 172.21.15.69:0/727538667 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81795e40 0x55cc819192f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.445+0000 7f25aa934b80 1 --2- 172.21.15.69:0/727538667 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc81919830 0x55cc819134b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.445+0000 7f25aa934b80 1 -- 172.21.15.69:0/727538667 >> 172.21.15.69:0/727538667 conn(0x55cc817daf70 msgr2=0x55cc8190e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.445+0000 7f25aa934b80 1 -- 172.21.15.69:0/727538667 shutdown_connections 2024-05-14T15:26:21.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.445+0000 7f25aa934b80 1 -- 172.21.15.69:0/727538667 wait complete. 2024-05-14T15:26:21.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.446+0000 7f25aa934b80 1 -- start start 2024-05-14T15:26:21.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.446+0000 7f25aa934b80 1 Processor -- start 2024-05-14T15:26:21.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.447+0000 7f25aa934b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc81795e40 0x55cc8191cff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.447+0000 7f25aa934b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc819139f0 0x55cc8191d530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.448+0000 7f25aa934b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81919830 0x55cc8191da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.448+0000 7f25aa934b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cc81920310 con 0x55cc819139f0 2024-05-14T15:26:21.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.448+0000 7f25aa934b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cc8179bb20 con 0x55cc81795e40 2024-05-14T15:26:21.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.448+0000 7f25aa934b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cc81920490 con 0x55cc81919830 2024-05-14T15:26:21.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.448+0000 7f25aa934b80 10 client.0 _ll_register_callbacks cb 0x55cc817dcc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:21.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.448+0000 7f2599400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc81795e40 0x55cc8191cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.448+0000 7f2598a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc819139f0 0x55cc8191d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.448+0000 7f2599400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc81795e40 0x55cc8191cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:43034/0 (socket says 172.21.15.69:43034) 2024-05-14T15:26:21.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.448+0000 7f2599400700 1 -- 172.21.15.69:0/1422896153 learned_addr learned my addr 172.21.15.69:0/1422896153 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:21.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.449+0000 7f2599e00700 1 --2- 172.21.15.69:0/1422896153 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81919830 0x55cc8191da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.449+0000 7f2599400700 1 -- 172.21.15.69:0/1422896153 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81919830 msgr2=0x55cc8191da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.449+0000 7f2599400700 1 --2- 172.21.15.69:0/1422896153 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81919830 0x55cc8191da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.449+0000 7f2599400700 1 -- 172.21.15.69:0/1422896153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc819139f0 msgr2=0x55cc8191d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.449+0000 7f2599400700 1 --2- 172.21.15.69:0/1422896153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc819139f0 0x55cc8191d530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.449+0000 7f2599400700 1 -- 172.21.15.69:0/1422896153 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc817fb420 con 0x55cc81795e40 2024-05-14T15:26:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.450+0000 7f2599400700 1 --2- 172.21.15.69:0/1422896153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc81795e40 0x55cc8191cff0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f258c005fa0 tx=0x7f258c010e40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=322c3a2b228f957 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.450+0000 7f257f400700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:26:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.450+0000 7f257f400700 1 -- 172.21.15.69:0/1422896153 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f258c029060 con 0x55cc81795e40 2024-05-14T15:26:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.450+0000 7f25aa934b80 1 -- 172.21.15.69:0/1422896153 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f258c015070 con 0x55cc81795e40 2024-05-14T15:26:21.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.450+0000 7f257f400700 1 -- 172.21.15.69:0/1422896153 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f258c004050 con 0x55cc81795e40 2024-05-14T15:26:21.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.452+0000 7f257f400700 1 -- 172.21.15.69:0/1422896153 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f258c030050 con 0x55cc81795e40 2024-05-14T15:26:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.452+0000 7f25aa934b80 10 client.35834 fetch_fsmap learned FSMap version 45 2024-05-14T15:26:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.452+0000 7f25aa934b80 1 -- 172.21.15.69:0/1422896153 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55cc8192ad30 con 0x55cc81795e40 2024-05-14T15:26:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.453+0000 7f257f400700 1 -- 172.21.15.69:0/1422896153 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f258c015070 con 0x55cc81795e40 2024-05-14T15:26:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.453+0000 7f257f400700 1 -- 172.21.15.69:0/1422896153 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 45) ==== 8398+0+0 (secure 0 0 0) 0x7f258c023030 con 0x55cc81795e40 2024-05-14T15:26:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.454+0000 7f25aa934b80 10 client.35834 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T15:26:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.454+0000 7f25aa934b80 10 client.35834 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-05-14T15:26:21.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.454+0000 7f25aa934b80 20 client.35834 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.454+0000 7f25aa934b80 1 --2- 172.21.15.69:0/1422896153 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55cc8192d200 0x55cc8192f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.454+0000 7f25aa934b80 4 client.35834 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:26:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.454+0000 7f25aa934b80 1 -- 172.21.15.69:0/1422896153 --> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc818e01c0 con 0x55cc8192d200 2024-05-14T15:26:21.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.454+0000 7f2598a00700 1 --2- 172.21.15.69:0/1422896153 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55cc8192d200 0x55cc8192f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.459+0000 7f2598a00700 1 --2- 172.21.15.69:0/1422896153 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55cc8192d200 0x55cc8192f620 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=77e11198d3122470 server_cookie=cafb50d0c7036e77 in_seq=0 out_seq=0 2024-05-14T15:26:21.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.459+0000 7f257f400700 10 client.35834 ms_handle_connect on v2:172.21.15.92:6832/1997000798 2024-05-14T15:26:21.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.462+0000 7f257f400700 1 -- 172.21.15.69:0/1422896153 <== mds.3 v2:172.21.15.92:6832/1997000798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cc818e01c0 con 0x55cc8192d200 2024-05-14T15:26:21.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.462+0000 7f257f400700 10 client.35834 handle_command_reply: tid=0 2024-05-14T15:26:21.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.462+0000 7f25aa934b80 1 client.35834 shutdown 2024-05-14T15:26:21.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.463+0000 7f25aa934b80 1 -- 172.21.15.69:0/1422896153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc81795e40 msgr2=0x55cc8191cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:21.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.463+0000 7f25aa934b80 1 --2- 172.21.15.69:0/1422896153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc81795e40 0x55cc8191cff0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f258c005fa0 tx=0x7f258c010e40 comp rx=0 tx=0).stop 2024-05-14T15:26:21.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.463+0000 7f25aa934b80 1 -- 172.21.15.69:0/1422896153 shutdown_connections 2024-05-14T15:26:21.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.463+0000 7f25aa934b80 1 --2- 172.21.15.69:0/1422896153 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55cc8192d200 0x55cc8192f620 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.463+0000 7f25aa934b80 1 --2- 172.21.15.69:0/1422896153 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81919830 0x55cc8191da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.463+0000 7f25aa934b80 1 --2- 172.21.15.69:0/1422896153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc81795e40 0x55cc8191cff0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.463+0000 7f25aa934b80 1 --2- 172.21.15.69:0/1422896153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc819139f0 0x55cc8191d530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.463+0000 7f25aa934b80 1 -- 172.21.15.69:0/1422896153 >> 172.21.15.69:0/1422896153 conn(0x55cc817daf70 msgr2=0x55cc819124a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.464+0000 7f257f400700 0 client.35834 ms_handle_reset on v2:172.21.15.92:6832/1997000798 2024-05-14T15:26:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.464+0000 7f25aa934b80 1 -- 172.21.15.69:0/1422896153 shutdown_connections 2024-05-14T15:26:21.465 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.465+0000 7f25aa934b80 1 -- 172.21.15.69:0/1422896153 wait complete. 2024-05-14T15:26:21.466 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.465+0000 7f25aa934b80 20 client.35834 trim_cache size 0 max 16384 2024-05-14T15:26:21.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.493+0000 7f25aa934b80 1 Processor -- start 2024-05-14T15:26:21.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.493+0000 7f25aa934b80 1 -- start start 2024-05-14T15:26:21.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.493+0000 7f25aa934b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc81795e40 0x55cc819134b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.493+0000 7f25aa934b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc819139f0 0x55cc8191bf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.493+0000 7f25aa934b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81919830 0x55cc8191d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.493+0000 7f25aa934b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f25941bf0a0 con 0x55cc819139f0 2024-05-14T15:26:21.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.493+0000 7f25aa934b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f25941c0d60 con 0x55cc81795e40 2024-05-14T15:26:21.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.493+0000 7f25aa934b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f25941bf7a0 con 0x55cc81919830 2024-05-14T15:26:21.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.494+0000 7f2599e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81919830 0x55cc8191d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.494+0000 7f2599e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81919830 0x55cc8191d8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:48242/0 (socket says 172.21.15.69:48242) 2024-05-14T15:26:21.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.494+0000 7f2599e00700 1 -- 172.21.15.69:0/1773778014 learned_addr learned my addr 172.21.15.69:0/1773778014 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:21.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.494+0000 7f2599e00700 1 -- 172.21.15.69:0/1773778014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc81795e40 msgr2=0x55cc819134b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:26:21.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.494+0000 7f2599e00700 1 --2- 172.21.15.69:0/1773778014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc81795e40 0x55cc819134b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.495+0000 7f2599e00700 1 -- 172.21.15.69:0/1773778014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc819139f0 msgr2=0x55cc8191bf70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:26:21.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.496+0000 7f2598a00700 1 --2- 172.21.15.69:0/1773778014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc819139f0 0x55cc8191bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.496+0000 7f2599e00700 1 --2- 172.21.15.69:0/1773778014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc819139f0 0x55cc8191bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.496+0000 7f2599e00700 1 -- 172.21.15.69:0/1773778014 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc81914360 con 0x55cc81919830 2024-05-14T15:26:21.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.497+0000 7f2599e00700 1 --2- 172.21.15.69:0/1773778014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81919830 0x55cc8191d8b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f25840aa5d0 tx=0x7f25840a9e30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b047babfa94ebbdd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:21.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.497+0000 7f258a000700 1 -- 172.21.15.69:0/1773778014 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2584029070 con 0x55cc81919830 2024-05-14T15:26:21.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.497+0000 7f258a000700 1 -- 172.21.15.69:0/1773778014 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25840aa640 con 0x55cc81919830 2024-05-14T15:26:21.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.497+0000 7f258a000700 1 -- 172.21.15.69:0/1773778014 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25840e2040 con 0x55cc81919830 2024-05-14T15:26:21.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.498+0000 7f25aa934b80 1 -- 172.21.15.69:0/1773778014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81919830 msgr2=0x55cc8191d8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:21.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.498+0000 7f25aa934b80 1 --2- 172.21.15.69:0/1773778014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81919830 0x55cc8191d8b0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f25840aa5d0 tx=0x7f25840a9e30 comp rx=0 tx=0).stop 2024-05-14T15:26:21.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.499+0000 7f25aa934b80 1 -- 172.21.15.69:0/1773778014 shutdown_connections 2024-05-14T15:26:21.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.499+0000 7f25aa934b80 1 --2- 172.21.15.69:0/1773778014 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc81919830 0x55cc8191d8b0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.499+0000 7f25aa934b80 1 --2- 172.21.15.69:0/1773778014 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc81795e40 0x55cc819134b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.499+0000 7f25aa934b80 1 --2- 172.21.15.69:0/1773778014 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc819139f0 0x55cc8191bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.499+0000 7f25aa934b80 1 -- 172.21.15.69:0/1773778014 >> 172.21.15.69:0/1773778014 conn(0x55cc817daf70 msgr2=0x55cc81916d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:21.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.499+0000 7f25aa934b80 1 -- 172.21.15.69:0/1773778014 shutdown_connections 2024-05-14T15:26:21.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.499+0000 7f25aa934b80 1 -- 172.21.15.69:0/1773778014 wait complete. 2024-05-14T15:26:21.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.499+0000 7f25aa934b80 1 -- start start 2024-05-14T15:26:21.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.500+0000 7f25aa934b80 1 Processor -- start 2024-05-14T15:26:21.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.500+0000 7f25aa934b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc81795e40 0x55cc819259d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.500+0000 7f25aa934b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc819139f0 0x55cc819340c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.501+0000 7f25aa934b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc81919830 0x55cc81934600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.501+0000 7f25aa934b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f25941c0630 con 0x55cc81919830 2024-05-14T15:26:21.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.501+0000 7f25aa934b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f25941bfea0 con 0x55cc81795e40 2024-05-14T15:26:21.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.501+0000 7f25aa934b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2594073dc0 con 0x55cc819139f0 2024-05-14T15:26:21.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.501+0000 7f25aa934b80 10 client.0 _ll_register_callbacks cb 0x55cc817dcc70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:21.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.501+0000 7f2598a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc819139f0 0x55cc819340c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.501+0000 7f2599400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc81795e40 0x55cc819259d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.501+0000 7f2598a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc819139f0 0x55cc819340c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:48258/0 (socket says 172.21.15.69:48258) 2024-05-14T15:26:21.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.501+0000 7f2598a00700 1 -- 172.21.15.69:0/3181924168 learned_addr learned my addr 172.21.15.69:0/3181924168 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:21.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.502+0000 7f2599e00700 1 --2- 172.21.15.69:0/3181924168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc81919830 0x55cc81934600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.502+0000 7f2598a00700 1 -- 172.21.15.69:0/3181924168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc81795e40 msgr2=0x55cc819259d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:21.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.502+0000 7f2598a00700 1 --2- 172.21.15.69:0/3181924168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc81795e40 0x55cc819259d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.502+0000 7f2598a00700 1 -- 172.21.15.69:0/3181924168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc81919830 msgr2=0x55cc81934600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:21.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.502+0000 7f2598a00700 1 --2- 172.21.15.69:0/3181924168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc81919830 0x55cc81934600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.502+0000 7f2598a00700 1 -- 172.21.15.69:0/3181924168 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc81934b40 con 0x55cc819139f0 2024-05-14T15:26:21.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.502+0000 7f2598a00700 1 --2- 172.21.15.69:0/3181924168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc819139f0 0x55cc819340c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2594109450 tx=0x7f258000a400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6b8d3c2a5cd6c1c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:21.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.502+0000 7f257f400700 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:26:21.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.503+0000 7f257f400700 1 -- 172.21.15.69:0/3181924168 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2580027740 con 0x55cc819139f0 2024-05-14T15:26:21.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.503+0000 7f257f400700 1 -- 172.21.15.69:0/3181924168 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f25800278e0 con 0x55cc819139f0 2024-05-14T15:26:21.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.503+0000 7f25aa934b80 1 -- 172.21.15.69:0/3181924168 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f25840aa640 con 0x55cc819139f0 2024-05-14T15:26:21.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.504+0000 7f257f400700 1 -- 172.21.15.69:0/3181924168 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) ==== 24+0+0 (secure 0 0 0) 0x7f2580030420 con 0x55cc819139f0 2024-05-14T15:26:21.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.504+0000 7f25aa934b80 10 client.25828 fetch_fsmap learned FSMap version 45 2024-05-14T15:26:21.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.504+0000 7f25aa934b80 1 -- 172.21.15.69:0/3181924168 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=4+}) -- 0x55cc819974c0 con 0x55cc819139f0 2024-05-14T15:26:21.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.505+0000 7f257f400700 1 -- 172.21.15.69:0/3181924168 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f25840aa640 con 0x55cc819139f0 2024-05-14T15:26:21.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.505+0000 7f257f400700 1 -- 172.21.15.69:0/3181924168 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 45) ==== 8398+0+0 (secure 0 0 0) 0x7f258003a420 con 0x55cc819139f0 2024-05-14T15:26:21.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.505+0000 7f25aa934b80 10 client.25828 fetch_fsmap finished waiting for FSMap version 45 2024-05-14T15:26:21.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.505+0000 7f25aa934b80 10 client.25828 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-05-14T15:26:21.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.505+0000 7f25aa934b80 20 client.25828 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:21.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.505+0000 7f25aa934b80 1 --2- 172.21.15.69:0/3181924168 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55cc81997cb0 0x55cc8199a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:21.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.505+0000 7f25aa934b80 4 client.25828 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:26:21.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.505+0000 7f25aa934b80 1 -- 172.21.15.69:0/3181924168 --> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cc81843400 con 0x55cc81997cb0 2024-05-14T15:26:21.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.506+0000 7f2599400700 1 --2- 172.21.15.69:0/3181924168 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55cc81997cb0 0x55cc8199a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:21.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.508+0000 7f257f400700 10 client.25828 ms_handle_connect on v2:172.21.15.92:6832/1997000798 2024-05-14T15:26:21.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.508+0000 7f2599400700 1 --2- 172.21.15.69:0/3181924168 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55cc81997cb0 0x55cc8199a0d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=f8436b19434ed2aa server_cookie=1b55390182ce9c9f in_seq=0 out_seq=0 2024-05-14T15:26:21.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.509+0000 7f257f400700 1 -- 172.21.15.69:0/3181924168 <== mds.3 v2:172.21.15.92:6832/1997000798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cc81843400 con 0x55cc81997cb0 2024-05-14T15:26:21.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.509+0000 7f257f400700 10 client.25828 handle_command_reply: tid=0 2024-05-14T15:26:21.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.509+0000 7f25aa934b80 1 client.25828 shutdown 2024-05-14T15:26:21.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.510+0000 7f25aa934b80 1 -- 172.21.15.69:0/3181924168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc819139f0 msgr2=0x55cc819340c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:21.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.510+0000 7f25aa934b80 1 --2- 172.21.15.69:0/3181924168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc819139f0 0x55cc819340c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2594109450 tx=0x7f258000a400 comp rx=0 tx=0).stop 2024-05-14T15:26:21.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.510+0000 7f25aa934b80 1 -- 172.21.15.69:0/3181924168 shutdown_connections 2024-05-14T15:26:21.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.510+0000 7f25aa934b80 1 --2- 172.21.15.69:0/3181924168 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55cc81997cb0 0x55cc8199a0d0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.510+0000 7f257f400700 0 client.25828 ms_handle_reset on v2:172.21.15.92:6832/1997000798 2024-05-14T15:26:21.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.510+0000 7f25aa934b80 1 --2- 172.21.15.69:0/3181924168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc81919830 0x55cc81934600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.510+0000 7f25aa934b80 1 --2- 172.21.15.69:0/3181924168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc81795e40 0x55cc819259d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.510+0000 7f25aa934b80 1 --2- 172.21.15.69:0/3181924168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc819139f0 0x55cc819340c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.510+0000 7f25aa934b80 1 -- 172.21.15.69:0/3181924168 >> 172.21.15.69:0/3181924168 conn(0x55cc817daf70 msgr2=0x55cc819080a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:21.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.510+0000 7f25aa934b80 1 -- 172.21.15.69:0/3181924168 shutdown_connections 2024-05-14T15:26:21.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.510+0000 7f25aa934b80 1 -- 172.21.15.69:0/3181924168 wait complete. 2024-05-14T15:26:21.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.511+0000 7f25aa934b80 20 client.25828 trim_cache size 0 max 16384 2024-05-14T15:26:21.513 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:26:21.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.511+0000 7f259be00700 1 -- 172.21.15.69:0/1658433539 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f25780b2b40 msgr2=0x7f25780b5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:21.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.511+0000 7f259be00700 1 --2- 172.21.15.69:0/1658433539 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f25780b2b40 0x7f25780b5050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2580005f30 tx=0x7f2580005ec0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.511+0000 7f259be00700 1 -- 172.21.15.69:0/1658433539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2594109870 msgr2=0x7f25941a6bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:21.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.511+0000 7f259be00700 1 --2- 172.21.15.69:0/1658433539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2594109870 0x7f25941a6bb0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2584015000 tx=0x7f25840089b0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.512+0000 7f259be00700 1 -- 172.21.15.69:0/1658433539 shutdown_connections 2024-05-14T15:26:21.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.512+0000 7f259be00700 1 --2- 172.21.15.69:0/1658433539 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f25780b2b40 0x7f25780b5050 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.512+0000 7f259be00700 1 --2- 172.21.15.69:0/1658433539 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2594109870 0x7f25941a6bb0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.512+0000 7f259be00700 1 --2- 172.21.15.69:0/1658433539 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f25941045f0 0x7f259410dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.512+0000 7f259be00700 1 --2- 172.21.15.69:0/1658433539 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2594108f20 0x7f259410e2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:21.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.512+0000 7f259be00700 1 -- 172.21.15.69:0/1658433539 >> 172.21.15.69:0/1658433539 conn(0x7f2594100040 msgr2=0x7f2594106480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:21.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.512+0000 7f259be00700 1 -- 172.21.15.69:0/1658433539 shutdown_connections 2024-05-14T15:26:21.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:21.513+0000 7f259be00700 1 -- 172.21.15.69:0/1658433539 wait complete. 2024-05-14T15:26:22.534 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-14T15:26:23.253 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:26:23.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:23 smithi203 ceph-mon[34567]: pgmap v145: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.6 MiB/s wr, 769 op/s 2024-05-14T15:26:23.439 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:23 smithi069 ceph-mon[31270]: pgmap v145: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.6 MiB/s wr, 769 op/s 2024-05-14T15:26:23.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:23 smithi092 ceph-mon[34729]: pgmap v145: 129 pgs: 129 active+clean; 1.5 GiB data, 3.6 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.6 MiB/s wr, 769 op/s 2024-05-14T15:26:24.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:24 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:26:24.397 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:24 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:26:24.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:24 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:26:25.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:25 smithi069 ceph-mon[31270]: pgmap v146: 129 pgs: 129 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.8 MiB/s wr, 1.15k op/s 2024-05-14T15:26:25.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:25 smithi203 ceph-mon[34567]: pgmap v146: 129 pgs: 129 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.8 MiB/s wr, 1.15k op/s 2024-05-14T15:26:25.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:25 smithi092 ceph-mon[34729]: pgmap v146: 129 pgs: 129 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.8 MiB/s wr, 1.15k op/s 2024-05-14T15:26:25.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.982+0000 7f0f4fe00700 1 -- 172.21.15.69:0/2867771517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f481045f0 msgr2=0x7f0f48104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:25.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.982+0000 7f0f4fe00700 1 --2- 172.21.15.69:0/2867771517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f481045f0 0x7f0f48104a00 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0099c0 tx=0x7f0f3c009cd0 comp rx=0 tx=0).stop 2024-05-14T15:26:25.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.983+0000 7f0f4fe00700 1 -- 172.21.15.69:0/2867771517 shutdown_connections 2024-05-14T15:26:25.984 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.983+0000 7f0f4fe00700 1 --2- 172.21.15.69:0/2867771517 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f481045f0 0x7f0f48104a00 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:25.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.983+0000 7f0f4fe00700 1 --2- 172.21.15.69:0/2867771517 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f48109870 0x7f0f481111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:25.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.983+0000 7f0f4fe00700 1 --2- 172.21.15.69:0/2867771517 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48108f20 0x7f0f48109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:25.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.983+0000 7f0f4fe00700 1 -- 172.21.15.69:0/2867771517 >> 172.21.15.69:0/2867771517 conn(0x7f0f48100040 msgr2=0x7f0f48102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:25.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.983+0000 7f0f4fe00700 1 -- 172.21.15.69:0/2867771517 shutdown_connections 2024-05-14T15:26:25.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.983+0000 7f0f4fe00700 1 -- 172.21.15.69:0/2867771517 wait complete. 2024-05-14T15:26:25.985 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.984+0000 7f0f4fe00700 1 Processor -- start 2024-05-14T15:26:25.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.985+0000 7f0f4fe00700 1 -- start start 2024-05-14T15:26:25.986 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.985+0000 7f0f4fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f481045f0 0x7f0f481a07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:25.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.985+0000 7f0f4fe00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48108f20 0x7f0f481a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:25.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.985+0000 7f0f4fe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f48109870 0x7f0f4819aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:25.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.985+0000 7f0f4fe00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0f481143a0 con 0x7f0f481045f0 2024-05-14T15:26:25.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.985+0000 7f0f4fe00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48114220 con 0x7f0f48108f20 2024-05-14T15:26:25.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.985+0000 7f0f4fe00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0f48114520 con 0x7f0f48109870 2024-05-14T15:26:25.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.986+0000 7f0f4d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f481045f0 0x7f0f481a07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:25.987 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.986+0000 7f0f4ca00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48108f20 0x7f0f481a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:25.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.986+0000 7f0f4d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f481045f0 0x7f0f481a07e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60644/0 (socket says 172.21.15.69:60644) 2024-05-14T15:26:25.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.986+0000 7f0f4d400700 1 -- 172.21.15.69:0/4161079247 learned_addr learned my addr 172.21.15.69:0/4161079247 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:25.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.986+0000 7f0f4de00700 1 --2- 172.21.15.69:0/4161079247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f48109870 0x7f0f4819aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:25.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.987+0000 7f0f4d400700 1 -- 172.21.15.69:0/4161079247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f48109870 msgr2=0x7f0f4819aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:25.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.987+0000 7f0f4d400700 1 --2- 172.21.15.69:0/4161079247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f48109870 0x7f0f4819aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:25.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.987+0000 7f0f4d400700 1 -- 172.21.15.69:0/4161079247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48108f20 msgr2=0x7f0f481a0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:25.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.987+0000 7f0f4d400700 1 --2- 172.21.15.69:0/4161079247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48108f20 0x7f0f481a0d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:25.989 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.987+0000 7f0f4d400700 1 -- 172.21.15.69:0/4161079247 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f4819b040 con 0x7f0f481045f0 2024-05-14T15:26:25.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.987+0000 7f0f4d400700 1 --2- 172.21.15.69:0/4161079247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f481045f0 0x7f0f481a07e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0098e0 tx=0x7f0f3c00f740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:25.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.988+0000 7f0f46000700 1 -- 172.21.15.69:0/4161079247 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c027070 con 0x7f0f481045f0 2024-05-14T15:26:25.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.988+0000 7f0f46000700 1 -- 172.21.15.69:0/4161079247 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f3c00fbf0 con 0x7f0f481045f0 2024-05-14T15:26:25.990 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.988+0000 7f0f46000700 1 -- 172.21.15.69:0/4161079247 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c022e60 con 0x7f0f481045f0 2024-05-14T15:26:25.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.988+0000 7f0f4fe00700 1 -- 172.21.15.69:0/4161079247 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f4819b2d0 con 0x7f0f481045f0 2024-05-14T15:26:25.991 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.988+0000 7f0f4fe00700 1 -- 172.21.15.69:0/4161079247 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f4819b760 con 0x7f0f481045f0 2024-05-14T15:26:25.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.993+0000 7f0f46000700 1 -- 172.21.15.69:0/4161079247 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f0f3c0050d0 con 0x7f0f481045f0 2024-05-14T15:26:25.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.995+0000 7f0f46000700 1 --2- 172.21.15.69:0/4161079247 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f300b2a70 0x7f0f300b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:25.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.995+0000 7f0f46000700 1 -- 172.21.15.69:0/4161079247 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f0f3c0e3cc0 con 0x7f0f481045f0 2024-05-14T15:26:25.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.997+0000 7f0f4ca00700 1 --2- 172.21.15.69:0/4161079247 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f300b2a70 0x7f0f300b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:25.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:25.997+0000 7f0f4ca00700 1 --2- 172.21.15.69:0/4161079247 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f300b2a70 0x7f0f300b4f80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f34005950 tx=0x7f0f340058e0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:26.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.000+0000 7f0f5e90eb80 1 Processor -- start 2024-05-14T15:26:26.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.001+0000 7f0f5e90eb80 1 -- start start 2024-05-14T15:26:26.002 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.002+0000 7f0f5e90eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 0x55bd9d6732f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.002+0000 7f0f5e90eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d673830 0x55bd9d66d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.003+0000 7f0f5e90eb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d66d9f0 0x55bd9d66de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.003+0000 7f0f5e90eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55bd9d58fa20 con 0x55bd9d673830 2024-05-14T15:26:26.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.003+0000 7f0f5e90eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bd9d52d760 con 0x55bd9d4efe40 2024-05-14T15:26:26.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.003+0000 7f0f5e90eb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bd9d58b9e0 con 0x55bd9d66d9f0 2024-05-14T15:26:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.003+0000 7f0f4d400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 0x55bd9d6732f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.003+0000 7f0f4ca00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d673830 0x55bd9d66d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.003+0000 7f0f4ca00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d673830 0x55bd9d66d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60654/0 (socket says 172.21.15.69:60654) 2024-05-14T15:26:26.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.003+0000 7f0f4ca00700 1 -- 172.21.15.69:0/3277650076 learned_addr learned my addr 172.21.15.69:0/3277650076 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.004+0000 7f0f4de00700 1 --2- 172.21.15.69:0/3277650076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d66d9f0 0x55bd9d66de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.004+0000 7f0f4ca00700 1 -- 172.21.15.69:0/3277650076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d66d9f0 msgr2=0x55bd9d66de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.004+0000 7f0f4ca00700 1 --2- 172.21.15.69:0/3277650076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d66d9f0 0x55bd9d66de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.004+0000 7f0f4ca00700 1 -- 172.21.15.69:0/3277650076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 msgr2=0x55bd9d6732f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.004+0000 7f0f4ca00700 1 --2- 172.21.15.69:0/3277650076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 0x55bd9d6732f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.004+0000 7f0f4ca00700 1 -- 172.21.15.69:0/3277650076 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd9d4dc8d0 con 0x55bd9d673830 2024-05-14T15:26:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.004+0000 7f0f4ca00700 1 --2- 172.21.15.69:0/3277650076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d673830 0x55bd9d66d4b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400fce0 tx=0x7f0f34012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9c4e296f2df9064 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.005+0000 7f0f3aa00700 1 -- 172.21.15.69:0/3277650076 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f34022070 con 0x55bd9d673830 2024-05-14T15:26:26.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.006+0000 7f0f3aa00700 1 -- 172.21.15.69:0/3277650076 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f34011c40 con 0x55bd9d673830 2024-05-14T15:26:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.006+0000 7f0f3aa00700 1 -- 172.21.15.69:0/3277650076 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3401d610 con 0x55bd9d673830 2024-05-14T15:26:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.007+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3277650076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d673830 msgr2=0x55bd9d66d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.007+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/3277650076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d673830 0x55bd9d66d4b0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f0f3400fce0 tx=0x7f0f34012000 comp rx=0 tx=0).stop 2024-05-14T15:26:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.007+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3277650076 shutdown_connections 2024-05-14T15:26:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.007+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/3277650076 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d66d9f0 0x55bd9d66de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.007+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/3277650076 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 0x55bd9d6732f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.007+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/3277650076 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d673830 0x55bd9d66d4b0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.007+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3277650076 >> 172.21.15.69:0/3277650076 conn(0x55bd9d534f70 msgr2=0x55bd9d6682d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.008+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3277650076 shutdown_connections 2024-05-14T15:26:26.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.008+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3277650076 wait complete. 2024-05-14T15:26:26.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.009+0000 7f0f5e90eb80 1 -- start start 2024-05-14T15:26:26.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.010+0000 7f0f5e90eb80 1 Processor -- start 2024-05-14T15:26:26.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.010+0000 7f0f5e90eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 0x55bd9d677040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.010+0000 7f0f5e90eb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d66d9f0 0x55bd9d677580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.010+0000 7f0f5e90eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d673830 0x55bd9d677ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.010+0000 7f0f5e90eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55bd9d67a310 con 0x55bd9d673830 2024-05-14T15:26:26.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.010+0000 7f0f5e90eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55bd9d4f5b20 con 0x55bd9d4efe40 2024-05-14T15:26:26.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.010+0000 7f0f5e90eb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55bd9d67a490 con 0x55bd9d66d9f0 2024-05-14T15:26:26.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.010+0000 7f0f5e90eb80 10 client.0 _ll_register_callbacks cb 0x55bd9d536c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:26.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.011+0000 7f0f4de00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d673830 0x55bd9d677ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.012+0000 7f0f4d400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 0x55bd9d677040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.012+0000 7f0f4ca00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d66d9f0 0x55bd9d677580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.012+0000 7f0f4ca00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d66d9f0 0x55bd9d677580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:44122/0 (socket says 172.21.15.69:44122) 2024-05-14T15:26:26.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.012+0000 7f0f4ca00700 1 -- 172.21.15.69:0/3594270377 learned_addr learned my addr 172.21.15.69:0/3594270377 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:26.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.013+0000 7f0f4d400700 1 -- 172.21.15.69:0/3594270377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d66d9f0 msgr2=0x55bd9d677580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:26.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.013+0000 7f0f4d400700 1 --2- 172.21.15.69:0/3594270377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d66d9f0 0x55bd9d677580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.013+0000 7f0f4d400700 1 -- 172.21.15.69:0/3594270377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d673830 msgr2=0x55bd9d677ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:26.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.013+0000 7f0f4d400700 1 --2- 172.21.15.69:0/3594270377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d673830 0x55bd9d677ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.013+0000 7f0f4d400700 1 -- 172.21.15.69:0/3594270377 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd9d555420 con 0x55bd9d4efe40 2024-05-14T15:26:26.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.013+0000 7f0f4d400700 1 --2- 172.21.15.69:0/3594270377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 0x55bd9d677040 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0e1060 tx=0x7f0f3c0b38a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce23fe4e018cd07c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:26.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.013+0000 7f0f2f400700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:26:26.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.014+0000 7f0f2f400700 1 -- 172.21.15.69:0/3594270377 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f3c0aa5d0 con 0x55bd9d4efe40 2024-05-14T15:26:26.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.014+0000 7f0f2f400700 1 -- 172.21.15.69:0/3594270377 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f0f3c0b1440 con 0x55bd9d4efe40 2024-05-14T15:26:26.016 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.015+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3594270377 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f34011c40 con 0x55bd9d4efe40 2024-05-14T15:26:26.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.016+0000 7f0f2f400700 1 -- 172.21.15.69:0/3594270377 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f0f3c0a6410 con 0x55bd9d4efe40 2024-05-14T15:26:26.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.016+0000 7f0f5e90eb80 10 client.35849 fetch_fsmap learned FSMap version 46 2024-05-14T15:26:26.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.016+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3594270377 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55bd9d68d6b0 con 0x55bd9d4efe40 2024-05-14T15:26:26.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.016+0000 7f0f2f400700 1 -- 172.21.15.69:0/3594270377 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f34011c40 con 0x55bd9d4efe40 2024-05-14T15:26:26.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.017+0000 7f0f2f400700 1 -- 172.21.15.69:0/3594270377 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 46) ==== 8410+0+0 (secure 0 0 0) 0x7f0f3c02a020 con 0x55bd9d4efe40 2024-05-14T15:26:26.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.017+0000 7f0f5e90eb80 10 client.35849 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T15:26:26.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.017+0000 7f0f5e90eb80 10 client.35849 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-05-14T15:26:26.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.017+0000 7f0f5e90eb80 20 client.35849 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:26.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.017+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/3594270377 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55bd9d68fef0 0x55bd9d692360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.017+0000 7f0f5e90eb80 4 client.35849 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:26:26.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.017+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3594270377 --> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd9d63a1c0 con 0x55bd9d68fef0 2024-05-14T15:26:26.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.018+0000 7f0f4ca00700 1 --2- 172.21.15.69:0/3594270377 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55bd9d68fef0 0x55bd9d692360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.019+0000 7f0f4ca00700 1 --2- 172.21.15.69:0/3594270377 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55bd9d68fef0 0x55bd9d692360 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=213f9c8d298113d server_cookie=aea87d2f34c5fcee in_seq=0 out_seq=0 2024-05-14T15:26:26.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.019+0000 7f0f2f400700 10 client.35849 ms_handle_connect on v2:172.21.15.92:6834/360295917 2024-05-14T15:26:26.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.022+0000 7f0f2f400700 1 -- 172.21.15.69:0/3594270377 <== mds.2 v2:172.21.15.92:6834/360295917 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55bd9d63a1c0 con 0x55bd9d68fef0 2024-05-14T15:26:26.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.022+0000 7f0f2f400700 10 client.35849 handle_command_reply: tid=0 2024-05-14T15:26:26.023 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.022+0000 7f0f5e90eb80 1 client.35849 shutdown 2024-05-14T15:26:26.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.025+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3594270377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 msgr2=0x55bd9d677040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:26.026 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.025+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/3594270377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 0x55bd9d677040 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0e1060 tx=0x7f0f3c0b38a0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.025+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3594270377 shutdown_connections 2024-05-14T15:26:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.025+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/3594270377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d673830 0x55bd9d677ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.025+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/3594270377 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55bd9d68fef0 0x55bd9d692360 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.025+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/3594270377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 0x55bd9d677040 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.025+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/3594270377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d66d9f0 0x55bd9d677580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.025+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3594270377 >> 172.21.15.69:0/3594270377 conn(0x55bd9d534f70 msgr2=0x55bd9d66c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.025+0000 7f0f2f400700 0 client.35849 ms_handle_reset on v2:172.21.15.92:6834/360295917 2024-05-14T15:26:26.027 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.025+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3594270377 shutdown_connections 2024-05-14T15:26:26.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.026+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3594270377 wait complete. 2024-05-14T15:26:26.028 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.027+0000 7f0f5e90eb80 20 client.35849 trim_cache size 0 max 16384 2024-05-14T15:26:26.062 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.061+0000 7f0f5e90eb80 1 Processor -- start 2024-05-14T15:26:26.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.061+0000 7f0f5e90eb80 1 -- start start 2024-05-14T15:26:26.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.062+0000 7f0f5e90eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 0x55bd9d66d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.062+0000 7f0f5e90eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d66d9f0 0x55bd9d668340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.062+0000 7f0f5e90eb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d673830 0x55bd9d683360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.063 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.062+0000 7f0f5e90eb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0f481ae0b0 con 0x55bd9d66d9f0 2024-05-14T15:26:26.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.062+0000 7f0f5e90eb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f481afe00 con 0x55bd9d4efe40 2024-05-14T15:26:26.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.062+0000 7f0f5e90eb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0f481ae840 con 0x55bd9d673830 2024-05-14T15:26:26.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.062+0000 7f0f4d400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 0x55bd9d66d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.064 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.062+0000 7f0f4d400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 0x55bd9d66d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:34806/0 (socket says 172.21.15.69:34806) 2024-05-14T15:26:26.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.062+0000 7f0f4d400700 1 -- 172.21.15.69:0/4203677781 learned_addr learned my addr 172.21.15.69:0/4203677781 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:26.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.062+0000 7f0f4de00700 1 --2- 172.21.15.69:0/4203677781 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d673830 0x55bd9d683360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.063+0000 7f0f4de00700 1 -- 172.21.15.69:0/4203677781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 msgr2=0x55bd9d66d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:26.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.063+0000 7f0f4de00700 1 --2- 172.21.15.69:0/4203677781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 0x55bd9d66d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.063+0000 7f0f4de00700 1 -- 172.21.15.69:0/4203677781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d66d9f0 msgr2=0x55bd9d668340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:26.065 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.064+0000 7f0f4ca00700 1 --2- 172.21.15.69:0/4203677781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d66d9f0 0x55bd9d668340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.065+0000 7f0f4de00700 1 --2- 172.21.15.69:0/4203677781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d66d9f0 0x55bd9d668340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.067 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.065+0000 7f0f4de00700 1 -- 172.21.15.69:0/4203677781 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd9d67a440 con 0x55bd9d673830 2024-05-14T15:26:26.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.067+0000 7f0f4de00700 1 --2- 172.21.15.69:0/4203677781 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d673830 0x55bd9d683360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f40007ed0 tx=0x7f0f40012540 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f4a0bc2ff6c6c2f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:26.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.068+0000 7f0f3a000700 1 -- 172.21.15.69:0/4203677781 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4001a070 con 0x55bd9d673830 2024-05-14T15:26:26.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.068+0000 7f0f3a000700 1 -- 172.21.15.69:0/4203677781 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f40016440 con 0x55bd9d673830 2024-05-14T15:26:26.069 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.068+0000 7f0f3a000700 1 -- 172.21.15.69:0/4203677781 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f40015640 con 0x55bd9d673830 2024-05-14T15:26:26.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.070+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/4203677781 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d673830 msgr2=0x55bd9d683360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:26.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.070+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/4203677781 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d673830 0x55bd9d683360 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0f40007ed0 tx=0x7f0f40012540 comp rx=0 tx=0).stop 2024-05-14T15:26:26.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.070+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/4203677781 shutdown_connections 2024-05-14T15:26:26.071 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.070+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/4203677781 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d673830 0x55bd9d683360 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.070+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/4203677781 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d4efe40 0x55bd9d66d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.070+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/4203677781 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d66d9f0 0x55bd9d668340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.070+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/4203677781 >> 172.21.15.69:0/4203677781 conn(0x55bd9d534f70 msgr2=0x55bd9d667c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:26.072 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.070+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/4203677781 shutdown_connections 2024-05-14T15:26:26.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.071+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/4203677781 wait complete. 2024-05-14T15:26:26.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.071+0000 7f0f5e90eb80 1 -- start start 2024-05-14T15:26:26.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.073+0000 7f0f5e90eb80 1 Processor -- start 2024-05-14T15:26:26.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.075+0000 7f0f5e90eb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d4efe40 0x55bd9d67f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.075+0000 7f0f5e90eb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d66d9f0 0x55bd9d67fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.075+0000 7f0f4d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d4efe40 0x55bd9d67f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.075+0000 7f0f4d400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d4efe40 0x55bd9d67f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60680/0 (socket says 172.21.15.69:60680) 2024-05-14T15:26:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.075+0000 7f0f5e90eb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d673830 0x55bd9d696b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.076+0000 7f0f4d400700 1 -- 172.21.15.69:0/3827948657 learned_addr learned my addr 172.21.15.69:0/3827948657 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.076+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3827948657 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0f481af6d0 con 0x55bd9d4efe40 2024-05-14T15:26:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.076+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3827948657 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f481aef40 con 0x55bd9d66d9f0 2024-05-14T15:26:26.077 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.076+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3827948657 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0f481ac010 con 0x55bd9d673830 2024-05-14T15:26:26.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.076+0000 7f0f4de00700 1 --2- 172.21.15.69:0/3827948657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d673830 0x55bd9d696b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.076+0000 7f0f4ca00700 1 --2- 172.21.15.69:0/3827948657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d66d9f0 0x55bd9d67fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.077+0000 7f0f4de00700 1 -- 172.21.15.69:0/3827948657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d66d9f0 msgr2=0x55bd9d67fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:26.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.077+0000 7f0f5e90eb80 10 client.0 _ll_register_callbacks cb 0x55bd9d536c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:26.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.078+0000 7f0f4de00700 1 --2- 172.21.15.69:0/3827948657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d66d9f0 0x55bd9d67fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.078+0000 7f0f4de00700 1 -- 172.21.15.69:0/3827948657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d4efe40 msgr2=0x55bd9d67f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:26.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.078+0000 7f0f4de00700 1 --2- 172.21.15.69:0/3827948657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d4efe40 0x55bd9d67f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.078+0000 7f0f4de00700 1 -- 172.21.15.69:0/3827948657 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd9d6983a0 con 0x55bd9d673830 2024-05-14T15:26:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.078+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3827948657 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f40016440 con 0x55bd9d673830 2024-05-14T15:26:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.078+0000 7f0f4ca00700 1 --2- 172.21.15.69:0/3827948657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d66d9f0 0x55bd9d67fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:26:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.078+0000 7f0f4de00700 1 --2- 172.21.15.69:0/3827948657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d673830 0x55bd9d696b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0f40007ed0 tx=0x7f0f400165f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6a9db9b387cd602 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.079+0000 7f0f2f400700 10 client.25843 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:26:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.079+0000 7f0f2f400700 1 -- 172.21.15.69:0/3827948657 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4001a040 con 0x55bd9d673830 2024-05-14T15:26:26.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.079+0000 7f0f2f400700 1 -- 172.21.15.69:0/3827948657 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f0f4001f450 con 0x55bd9d673830 2024-05-14T15:26:26.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.091+0000 7f0f2f400700 1 -- 172.21.15.69:0/3827948657 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f0f4001f6b0 con 0x55bd9d673830 2024-05-14T15:26:26.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.091+0000 7f0f5e90eb80 10 client.25843 fetch_fsmap learned FSMap version 46 2024-05-14T15:26:26.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.091+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3827948657 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({fsmap=46}) -- 0x55bd9d6f9990 con 0x55bd9d673830 2024-05-14T15:26:26.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.092+0000 7f0f2f400700 1 -- 172.21.15.69:0/3827948657 <== mon.1 v2:172.21.15.203:3300/0 4 ==== fsmap(e 46) ==== 8410+0+0 (secure 0 0 0) 0x7f0f4001f850 con 0x55bd9d673830 2024-05-14T15:26:26.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.092+0000 7f0f5e90eb80 10 client.25843 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T15:26:26.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.092+0000 7f0f5e90eb80 10 client.25843 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-05-14T15:26:26.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.092+0000 7f0f5e90eb80 20 client.25843 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:26.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.092+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/3827948657 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55bd9d6f9f60 0x55bd9d6fc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.092+0000 7f0f5e90eb80 4 client.25843 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:26:26.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.092+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3827948657 --> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bd9d59d400 con 0x55bd9d6f9f60 2024-05-14T15:26:26.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.093+0000 7f0f4d400700 1 --2- 172.21.15.69:0/3827948657 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55bd9d6f9f60 0x55bd9d6fc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.096+0000 7f0f4d400700 1 --2- 172.21.15.69:0/3827948657 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55bd9d6f9f60 0x55bd9d6fc3a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=51907490ff693f2d server_cookie=245e62decfe1186b in_seq=0 out_seq=0 2024-05-14T15:26:26.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.096+0000 7f0f2f400700 10 client.25843 ms_handle_connect on v2:172.21.15.92:6834/360295917 2024-05-14T15:26:26.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.097+0000 7f0f2f400700 1 -- 172.21.15.69:0/3827948657 <== mds.2 v2:172.21.15.92:6834/360295917 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bd9d59d400 con 0x55bd9d6f9f60 2024-05-14T15:26:26.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.097+0000 7f0f2f400700 10 client.25843 handle_command_reply: tid=0 2024-05-14T15:26:26.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.097+0000 7f0f5e90eb80 1 client.25843 shutdown 2024-05-14T15:26:26.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.098+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3827948657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d673830 msgr2=0x55bd9d696b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:26.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.098+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/3827948657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d673830 0x55bd9d696b50 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0f40007ed0 tx=0x7f0f400165f0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.098+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3827948657 shutdown_connections 2024-05-14T15:26:26.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.098+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/3827948657 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55bd9d4efe40 0x55bd9d67f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.098+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/3827948657 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55bd9d6f9f60 0x55bd9d6fc3a0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.098+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/3827948657 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55bd9d673830 0x55bd9d696b50 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.098+0000 7f0f5e90eb80 1 --2- 172.21.15.69:0/3827948657 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55bd9d66d9f0 0x55bd9d67fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.098+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3827948657 >> 172.21.15.69:0/3827948657 conn(0x55bd9d534f70 msgr2=0x55bd9d670cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:26.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.098+0000 7f0f2f400700 0 client.25843 ms_handle_reset on v2:172.21.15.92:6834/360295917 2024-05-14T15:26:26.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.098+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3827948657 shutdown_connections 2024-05-14T15:26:26.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.098+0000 7f0f5e90eb80 1 -- 172.21.15.69:0/3827948657 wait complete. 2024-05-14T15:26:26.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.099+0000 7f0f5e90eb80 20 client.25843 trim_cache size 0 max 16384 2024-05-14T15:26:26.100 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:26:26.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.100+0000 7f0f4fe00700 1 -- 172.21.15.69:0/4161079247 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f300b2a70 msgr2=0x7f0f300b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:26.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.100+0000 7f0f4fe00700 1 --2- 172.21.15.69:0/4161079247 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f300b2a70 0x7f0f300b4f80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f34005950 tx=0x7f0f340058e0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.100+0000 7f0f4fe00700 1 -- 172.21.15.69:0/4161079247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f481045f0 msgr2=0x7f0f481a07e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:26.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.100+0000 7f0f4fe00700 1 --2- 172.21.15.69:0/4161079247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f481045f0 0x7f0f481a07e0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0098e0 tx=0x7f0f3c00f740 comp rx=0 tx=0).stop 2024-05-14T15:26:26.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.100+0000 7f0f4fe00700 1 -- 172.21.15.69:0/4161079247 shutdown_connections 2024-05-14T15:26:26.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.100+0000 7f0f4fe00700 1 --2- 172.21.15.69:0/4161079247 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f300b2a70 0x7f0f300b4f80 secure :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0f34005950 tx=0x7f0f340058e0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.100+0000 7f0f4fe00700 1 --2- 172.21.15.69:0/4161079247 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f481045f0 0x7f0f481a07e0 secure :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0098e0 tx=0x7f0f3c00f740 comp rx=0 tx=0).stop 2024-05-14T15:26:26.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.100+0000 7f0f4fe00700 1 --2- 172.21.15.69:0/4161079247 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f48109870 0x7f0f4819aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.100+0000 7f0f4fe00700 1 --2- 172.21.15.69:0/4161079247 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f48108f20 0x7f0f481a0d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.100+0000 7f0f4fe00700 1 -- 172.21.15.69:0/4161079247 >> 172.21.15.69:0/4161079247 conn(0x7f0f48100040 msgr2=0x7f0f481085a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:26.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.101+0000 7f0f4fe00700 1 -- 172.21.15.69:0/4161079247 shutdown_connections 2024-05-14T15:26:26.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:26.101+0000 7f0f4fe00700 1 -- 172.21.15.69:0/4161079247 wait complete. 2024-05-14T15:26:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.285+0000 7f85efe00640 1 -- 172.21.15.69:0/1947555333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85f010e940 msgr2=0x7f85f010ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.285+0000 7f85efe00640 1 --2- 172.21.15.69:0/1947555333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85f010e940 0x7f85f010ed70 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f85d8009900 tx=0x7f85d802a400 comp rx=0 tx=0).stop 2024-05-14T15:26:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.286+0000 7f85efe00640 1 -- 172.21.15.69:0/1947555333 shutdown_connections 2024-05-14T15:26:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.286+0000 7f85efe00640 1 --2- 172.21.15.69:0/1947555333 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85f010f400 0x7f85f0116b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.286+0000 7f85efe00640 1 --2- 172.21.15.69:0/1947555333 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85f010e940 0x7f85f010ed70 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.286+0000 7f85efe00640 1 --2- 172.21.15.69:0/1947555333 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85f007bbf0 0x7f85f007c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.286+0000 7f85efe00640 1 -- 172.21.15.69:0/1947555333 >> 172.21.15.69:0/1947555333 conn(0x7f85f00770f0 msgr2=0x7f85f0079510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.286+0000 7f85efe00640 1 -- 172.21.15.69:0/1947555333 shutdown_connections 2024-05-14T15:26:26.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.286+0000 7f85efe00640 1 -- 172.21.15.69:0/1947555333 wait complete. 2024-05-14T15:26:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.287+0000 7f85efe00640 1 Processor -- start 2024-05-14T15:26:26.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.287+0000 7f85efe00640 1 -- start start 2024-05-14T15:26:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.288+0000 7f85efe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85f007bbf0 0x7f85f01a6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.288+0000 7f85efe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85f010e940 0x7f85f01a6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.288+0000 7f85efe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85f010f400 0x7f85f01a07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.288+0000 7f85efe00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f85f011a140 con 0x7f85f010e940 2024-05-14T15:26:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.288+0000 7f85efe00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f85f0119fc0 con 0x7f85f007bbf0 2024-05-14T15:26:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.288+0000 7f85efe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f85f011a2c0 con 0x7f85f010f400 2024-05-14T15:26:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.289+0000 7f85ee000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85f010e940 0x7f85f01a6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.289+0000 7f85ee000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85f010e940 0x7f85f01a6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60704/0 (socket says 172.21.15.69:60704) 2024-05-14T15:26:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.289+0000 7f85ee000640 1 -- 172.21.15.69:0/1277501465 learned_addr learned my addr 172.21.15.69:0/1277501465 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.289+0000 7f85eea00640 1 --2- 172.21.15.69:0/1277501465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85f007bbf0 0x7f85f01a6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.289+0000 7f85ef400640 1 --2- 172.21.15.69:0/1277501465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85f010f400 0x7f85f01a07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.289+0000 7f85ee000640 1 -- 172.21.15.69:0/1277501465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85f010f400 msgr2=0x7f85f01a07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.289+0000 7f85ee000640 1 --2- 172.21.15.69:0/1277501465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85f010f400 0x7f85f01a07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.289+0000 7f85ee000640 1 -- 172.21.15.69:0/1277501465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85f007bbf0 msgr2=0x7f85f01a6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.289+0000 7f85ee000640 1 --2- 172.21.15.69:0/1277501465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85f007bbf0 0x7f85f01a6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.289+0000 7f85ee000640 1 -- 172.21.15.69:0/1277501465 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f01a0e90 con 0x7f85f010e940 2024-05-14T15:26:26.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.290+0000 7f85ee000640 1 --2- 172.21.15.69:0/1277501465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85f010e940 0x7f85f01a6ac0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f85d80057c0 tx=0x7f85d8030630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.290+0000 7f85f4a00640 1 -- 172.21.15.69:0/1277501465 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d803f070 con 0x7f85f010e940 2024-05-14T15:26:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.290+0000 7f85f4a00640 1 -- 172.21.15.69:0/1277501465 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85d8004460 con 0x7f85f010e940 2024-05-14T15:26:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.290+0000 7f85f4a00640 1 -- 172.21.15.69:0/1277501465 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d8035030 con 0x7f85f010e940 2024-05-14T15:26:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.290+0000 7f85efe00640 1 -- 172.21.15.69:0/1277501465 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f01a1120 con 0x7f85f010e940 2024-05-14T15:26:26.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.290+0000 7f85efe00640 1 -- 172.21.15.69:0/1277501465 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f01a15c0 con 0x7f85f010e940 2024-05-14T15:26:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.294+0000 7f85fcd99740 1 Processor -- start 2024-05-14T15:26:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.294+0000 7f85fcd99740 1 -- start start 2024-05-14T15:26:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.294+0000 7f85fcd99740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23ff1b0 0x5578d27a0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.294+0000 7f85fcd99740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23d62f0 0x5578d27a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.294+0000 7f85fcd99740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23de4d0 0x5578d27a0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.294+0000 7f85fcd99740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5578d2705550 con 0x5578d23ff1b0 2024-05-14T15:26:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.294+0000 7f85fcd99740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5578d26aabc0 con 0x5578d23de4d0 2024-05-14T15:26:26.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.294+0000 7f85fcd99740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5578d2701510 con 0x5578d23d62f0 2024-05-14T15:26:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.294+0000 7f85ef400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23ff1b0 0x5578d27a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.294+0000 7f85ef400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23ff1b0 0x5578d27a0480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60716/0 (socket says 172.21.15.69:60716) 2024-05-14T15:26:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.294+0000 7f85ef400640 1 -- 172.21.15.69:0/4141305171 learned_addr learned my addr 172.21.15.69:0/4141305171 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.294+0000 7f85f4a00640 1 -- 172.21.15.69:0/1277501465 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f85d8042070 con 0x7f85f010e940 2024-05-14T15:26:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.294+0000 7f85eea00640 1 --2- 172.21.15.69:0/4141305171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23d62f0 0x5578d27a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.295+0000 7f85ef400640 1 -- 172.21.15.69:0/4141305171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23d62f0 msgr2=0x5578d27a09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.295+0000 7f85ef400640 1 --2- 172.21.15.69:0/4141305171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23d62f0 0x5578d27a09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.295+0000 7f85ef400640 1 -- 172.21.15.69:0/4141305171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23de4d0 msgr2=0x5578d27a0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.295+0000 7f85ef400640 1 --2- 172.21.15.69:0/4141305171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23de4d0 0x5578d27a0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.295+0000 7f85ef400640 1 -- 172.21.15.69:0/4141305171 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578d2417210 con 0x5578d23ff1b0 2024-05-14T15:26:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.295+0000 7f85ef400640 1 --2- 172.21.15.69:0/4141305171 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23ff1b0 0x5578d27a0480 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009ca0 tx=0x7f85e0011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b87f51c67bbc3d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.295+0000 7f85dfe00640 1 -- 172.21.15.69:0/4141305171 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e001e070 con 0x5578d23ff1b0 2024-05-14T15:26:26.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.295+0000 7f85dfe00640 1 -- 172.21.15.69:0/4141305171 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85e0009e50 con 0x5578d23ff1b0 2024-05-14T15:26:26.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.296+0000 7f85dfe00640 1 -- 172.21.15.69:0/4141305171 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e000e900 con 0x5578d23ff1b0 2024-05-14T15:26:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.296+0000 7f85f4a00640 1 --2- 172.21.15.69:0/1277501465 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f85d40b2950 0x7f85d40b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.296+0000 7f85fcd99740 1 -- 172.21.15.69:0/4141305171 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23ff1b0 msgr2=0x5578d27a0480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.296+0000 7f85fcd99740 1 --2- 172.21.15.69:0/4141305171 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23ff1b0 0x5578d27a0480 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009ca0 tx=0x7f85e0011810 comp rx=0 tx=0).stop 2024-05-14T15:26:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.296+0000 7f85f4a00640 1 -- 172.21.15.69:0/1277501465 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f85d81034e0 con 0x7f85f010e940 2024-05-14T15:26:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.297+0000 7f85fcd99740 1 -- 172.21.15.69:0/4141305171 shutdown_connections 2024-05-14T15:26:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.297+0000 7f85fcd99740 1 --2- 172.21.15.69:0/4141305171 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23de4d0 0x5578d27a0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.297+0000 7f85fcd99740 1 --2- 172.21.15.69:0/4141305171 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23d62f0 0x5578d27a09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.297+0000 7f85eea00640 1 --2- 172.21.15.69:0/1277501465 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f85d40b2950 0x7f85d40b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.297+0000 7f85fcd99740 1 --2- 172.21.15.69:0/4141305171 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23ff1b0 0x5578d27a0480 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.297+0000 7f85fcd99740 1 -- 172.21.15.69:0/4141305171 >> 172.21.15.69:0/4141305171 conn(0x5578d23f3300 msgr2=0x5578d279cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.297+0000 7f85fcd99740 1 -- 172.21.15.69:0/4141305171 shutdown_connections 2024-05-14T15:26:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.297+0000 7f85fcd99740 1 -- 172.21.15.69:0/4141305171 wait complete. 2024-05-14T15:26:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.297+0000 7f85fcd99740 1 -- start start 2024-05-14T15:26:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.297+0000 7f85eea00640 1 --2- 172.21.15.69:0/1277501465 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f85d40b2950 0x7f85d40b4e60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x5578d27a1830 tx=0x7f85e8009500 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.297+0000 7f85fcd99740 1 Processor -- start 2024-05-14T15:26:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.298+0000 7f85fcd99740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23d62f0 0x5578d27aa9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.298+0000 7f85fcd99740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23de4d0 0x5578d27aaf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.298+0000 7f85fcd99740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23ff1b0 0x5578d27b6a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.298+0000 7f85fcd99740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5578d27ad5b0 con 0x5578d23de4d0 2024-05-14T15:26:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.298+0000 7f85fcd99740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5578d26be660 con 0x5578d23d62f0 2024-05-14T15:26:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.298+0000 7f85fcd99740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5578d27ad730 con 0x5578d23ff1b0 2024-05-14T15:26:26.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.298+0000 7f85fcd99740 10 client.0 _ll_register_callbacks cb 0x5578d2688400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.298+0000 7f85ee000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23de4d0 0x5578d27aaf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.298+0000 7f85ee000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23de4d0 0x5578d27aaf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60718/0 (socket says 172.21.15.69:60718) 2024-05-14T15:26:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.298+0000 7f85ee000640 1 -- 172.21.15.69:0/1615283348 learned_addr learned my addr 172.21.15.69:0/1615283348 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.298+0000 7f85ef400640 1 --2- 172.21.15.69:0/1615283348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23ff1b0 0x5578d27b6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.299+0000 7f85eea00640 1 --2- 172.21.15.69:0/1615283348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23d62f0 0x5578d27aa9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.299+0000 7f85ee000640 1 -- 172.21.15.69:0/1615283348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23ff1b0 msgr2=0x5578d27b6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.299+0000 7f85ee000640 1 --2- 172.21.15.69:0/1615283348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23ff1b0 0x5578d27b6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.299+0000 7f85ee000640 1 -- 172.21.15.69:0/1615283348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23d62f0 msgr2=0x5578d27aa9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.299+0000 7f85ee000640 1 --2- 172.21.15.69:0/1615283348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23d62f0 0x5578d27aa9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.299+0000 7f85ee000640 1 -- 172.21.15.69:0/1615283348 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578d24e3620 con 0x5578d23de4d0 2024-05-14T15:26:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.299+0000 7f85ef400640 1 --2- 172.21.15.69:0/1615283348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23ff1b0 0x5578d27b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:26:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.299+0000 7f85ee000640 1 --2- 172.21.15.69:0/1615283348 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23de4d0 0x5578d27aaf10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f85d80ca340 tx=0x7f85d80c9dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a72d8e66a3102e9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.299+0000 7f85dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:26:26.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.299+0000 7f85dcc00640 1 -- 172.21.15.69:0/1615283348 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d8100cb0 con 0x5578d23de4d0 2024-05-14T15:26:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.299+0000 7f85fcd99740 1 -- 172.21.15.69:0/1615283348 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85e0009e50 con 0x5578d23de4d0 2024-05-14T15:26:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.299+0000 7f85dcc00640 1 -- 172.21.15.69:0/1615283348 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f85d8103170 con 0x5578d23de4d0 2024-05-14T15:26:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.300+0000 7f85dcc00640 1 -- 172.21.15.69:0/1615283348 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f85d80caab0 con 0x5578d23de4d0 2024-05-14T15:26:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.300+0000 7f85fcd99740 10 client.16362 fetch_fsmap learned FSMap version 46 2024-05-14T15:26:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.300+0000 7f85fcd99740 1 -- 172.21.15.69:0/1615283348 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5578d27b9880 con 0x5578d23de4d0 2024-05-14T15:26:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.300+0000 7f85dcc00640 1 -- 172.21.15.69:0/1615283348 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85e0009e50 con 0x5578d23de4d0 2024-05-14T15:26:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.300+0000 7f85dcc00640 1 -- 172.21.15.69:0/1615283348 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 46) ==== 8410+0+0 (secure 0 0 0) 0x7f85d80c9610 con 0x5578d23de4d0 2024-05-14T15:26:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.300+0000 7f85fcd99740 10 client.16362 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T15:26:26.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.300+0000 7f85fcd99740 10 client.16362 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:26:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.300+0000 7f85fcd99740 20 client.16362 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.300+0000 7f85fcd99740 1 --2- 172.21.15.69:0/1615283348 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578d23bdd80 0x5578d27bcc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.300+0000 7f85fcd99740 4 client.16362 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:26:26.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.300+0000 7f85fcd99740 1 -- 172.21.15.69:0/1615283348 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578d2713160 con 0x5578d23bdd80 2024-05-14T15:26:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.301+0000 7f85eea00640 1 --2- 172.21.15.69:0/1615283348 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578d23bdd80 0x5578d27bcc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.302+0000 7f85eea00640 1 --2- 172.21.15.69:0/1615283348 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578d23bdd80 0x5578d27bcc50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eda0cb9a78aeb00b server_cookie=32ac821bec72a75f in_seq=0 out_seq=0 2024-05-14T15:26:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.302+0000 7f85dcc00640 10 client.16362 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:26.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.304+0000 7f85dcc00640 1 -- 172.21.15.69:0/1615283348 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5578d2713160 con 0x5578d23bdd80 2024-05-14T15:26:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.304+0000 7f85dcc00640 10 client.16362 handle_command_reply: tid=0 2024-05-14T15:26:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.304+0000 7f85fcd99740 1 client.16362 shutdown 2024-05-14T15:26:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.304+0000 7f85fcd99740 1 -- 172.21.15.69:0/1615283348 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23de4d0 msgr2=0x5578d27aaf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.304+0000 7f85fcd99740 1 --2- 172.21.15.69:0/1615283348 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23de4d0 0x5578d27aaf10 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f85d80ca340 tx=0x7f85d80c9dc0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.304+0000 7f85fcd99740 1 -- 172.21.15.69:0/1615283348 shutdown_connections 2024-05-14T15:26:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.304+0000 7f85fcd99740 1 --2- 172.21.15.69:0/1615283348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23ff1b0 0x5578d27b6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.304+0000 7f85fcd99740 1 --2- 172.21.15.69:0/1615283348 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578d23bdd80 0x5578d27bcc50 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.304+0000 7f85fcd99740 1 --2- 172.21.15.69:0/1615283348 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23de4d0 0x5578d27aaf10 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.304+0000 7f85fcd99740 1 --2- 172.21.15.69:0/1615283348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23d62f0 0x5578d27aa9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.304+0000 7f85fcd99740 1 -- 172.21.15.69:0/1615283348 >> 172.21.15.69:0/1615283348 conn(0x5578d23f3300 msgr2=0x5578d27a21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.304+0000 7f85dcc00640 0 client.16362 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.304+0000 7f85fcd99740 1 -- 172.21.15.69:0/1615283348 shutdown_connections 2024-05-14T15:26:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.304+0000 7f85fcd99740 1 -- 172.21.15.69:0/1615283348 wait complete. 2024-05-14T15:26:26.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.305+0000 7f85fcd99740 20 client.16362 trim_cache size 0 max 16384 2024-05-14T15:26:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.320+0000 7f85fcd99740 1 Processor -- start 2024-05-14T15:26:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.321+0000 7f85fcd99740 1 -- start start 2024-05-14T15:26:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.321+0000 7f85fcd99740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23d62f0 0x5578d27a27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.321+0000 7f85fcd99740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23de4d0 0x5578d27c2450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.321+0000 7f85fcd99740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23ff1b0 0x5578d27c2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.321+0000 7f85fcd99740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f85f01b7440 con 0x5578d23d62f0 2024-05-14T15:26:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.321+0000 7f85fcd99740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f85f01b9190 con 0x5578d23ff1b0 2024-05-14T15:26:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.321+0000 7f85fcd99740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f85f01b7bd0 con 0x5578d23de4d0 2024-05-14T15:26:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.321+0000 7f85eea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23d62f0 0x5578d27a27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.321+0000 7f85eea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23d62f0 0x5578d27a27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60732/0 (socket says 172.21.15.69:60732) 2024-05-14T15:26:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.321+0000 7f85eea00640 1 -- 172.21.15.69:0/2245749838 learned_addr learned my addr 172.21.15.69:0/2245749838 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.321+0000 7f85eea00640 1 -- 172.21.15.69:0/2245749838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23de4d0 msgr2=0x5578d27c2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.321+0000 7f85eea00640 1 --2- 172.21.15.69:0/2245749838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23de4d0 0x5578d27c2450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.321+0000 7f85ef400640 1 --2- 172.21.15.69:0/2245749838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23ff1b0 0x5578d27c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.321+0000 7f85eea00640 1 -- 172.21.15.69:0/2245749838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23ff1b0 msgr2=0x5578d27c2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.321+0000 7f85eea00640 1 --2- 172.21.15.69:0/2245749838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23ff1b0 0x5578d27c2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.321+0000 7f85eea00640 1 -- 172.21.15.69:0/2245749838 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578d27a1860 con 0x5578d23d62f0 2024-05-14T15:26:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.322+0000 7f85eea00640 1 --2- 172.21.15.69:0/2245749838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23d62f0 0x5578d27a27d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f85f010adc0 tx=0x7f85e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad27ba6be1e3e606 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.322+0000 7f85df400640 1 -- 172.21.15.69:0/2245749838 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e8030070 con 0x5578d23d62f0 2024-05-14T15:26:26.326 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.322+0000 7f85df400640 1 -- 172.21.15.69:0/2245749838 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85e800fce0 con 0x5578d23d62f0 2024-05-14T15:26:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.322+0000 7f85df400640 1 -- 172.21.15.69:0/2245749838 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e801e970 con 0x5578d23d62f0 2024-05-14T15:26:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.323+0000 7f85fcd99740 1 -- 172.21.15.69:0/2245749838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23d62f0 msgr2=0x5578d27a27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.323+0000 7f85fcd99740 1 --2- 172.21.15.69:0/2245749838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23d62f0 0x5578d27a27d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f85f010adc0 tx=0x7f85e8016000 comp rx=0 tx=0).stop 2024-05-14T15:26:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.323+0000 7f85fcd99740 1 -- 172.21.15.69:0/2245749838 shutdown_connections 2024-05-14T15:26:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.323+0000 7f85fcd99740 1 --2- 172.21.15.69:0/2245749838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23ff1b0 0x5578d27c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.323+0000 7f85fcd99740 1 --2- 172.21.15.69:0/2245749838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23de4d0 0x5578d27c2450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.323+0000 7f85fcd99740 1 --2- 172.21.15.69:0/2245749838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23d62f0 0x5578d27a27d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.323+0000 7f85fcd99740 1 -- 172.21.15.69:0/2245749838 >> 172.21.15.69:0/2245749838 conn(0x5578d23f3300 msgr2=0x5578d27a20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.323+0000 7f85fcd99740 1 -- 172.21.15.69:0/2245749838 shutdown_connections 2024-05-14T15:26:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.323+0000 7f85fcd99740 1 -- 172.21.15.69:0/2245749838 wait complete. 2024-05-14T15:26:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.323+0000 7f85fcd99740 1 -- start start 2024-05-14T15:26:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.324+0000 7f85fcd99740 1 Processor -- start 2024-05-14T15:26:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.324+0000 7f85fcd99740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23d62f0 0x5578d27ae510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.324+0000 7f85fcd99740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23de4d0 0x5578d27aea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.324+0000 7f85fcd99740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23ff1b0 0x5578d27aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.324+0000 7f85fcd99740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f85f01b8a60 con 0x5578d23d62f0 2024-05-14T15:26:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.324+0000 7f85fcd99740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f85f01b82d0 con 0x5578d23de4d0 2024-05-14T15:26:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.324+0000 7f85fcd99740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f85f01b5420 con 0x5578d23ff1b0 2024-05-14T15:26:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.324+0000 7f85fcd99740 10 client.0 _ll_register_callbacks cb 0x7f85d8005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.324+0000 7f85eea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23d62f0 0x5578d27ae510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.324+0000 7f85eea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23d62f0 0x5578d27ae510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60740/0 (socket says 172.21.15.69:60740) 2024-05-14T15:26:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.324+0000 7f85eea00640 1 -- 172.21.15.69:0/811323071 learned_addr learned my addr 172.21.15.69:0/811323071 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.325+0000 7f85eea00640 1 -- 172.21.15.69:0/811323071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23ff1b0 msgr2=0x5578d27aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.325+0000 7f85eea00640 1 --2- 172.21.15.69:0/811323071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23ff1b0 0x5578d27aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.325+0000 7f85eea00640 1 -- 172.21.15.69:0/811323071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23de4d0 msgr2=0x5578d27aea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.325+0000 7f85eea00640 1 --2- 172.21.15.69:0/811323071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23de4d0 0x5578d27aea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.325+0000 7f85eea00640 1 -- 172.21.15.69:0/811323071 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578d2824000 con 0x5578d23d62f0 2024-05-14T15:26:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.325+0000 7f85eea00640 1 --2- 172.21.15.69:0/811323071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23d62f0 0x5578d27ae510 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f85e8018040 tx=0x7f85e8004ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a056fe16dd2da7a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:26.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.325+0000 7f85dcc00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:26:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.325+0000 7f85dcc00640 1 -- 172.21.15.69:0/811323071 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e8039060 con 0x5578d23d62f0 2024-05-14T15:26:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.325+0000 7f85dcc00640 1 -- 172.21.15.69:0/811323071 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f85e802a430 con 0x5578d23d62f0 2024-05-14T15:26:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.325+0000 7f85fcd99740 1 -- 172.21.15.69:0/811323071 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85e800fce0 con 0x5578d23d62f0 2024-05-14T15:26:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.325+0000 7f85dcc00640 1 -- 172.21.15.69:0/811323071 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f85e8040050 con 0x5578d23d62f0 2024-05-14T15:26:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.325+0000 7f85fcd99740 10 client.16368 fetch_fsmap learned FSMap version 46 2024-05-14T15:26:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.326+0000 7f85fcd99740 1 -- 172.21.15.69:0/811323071 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x5578d2825140 con 0x5578d23d62f0 2024-05-14T15:26:26.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.326+0000 7f85dcc00640 1 -- 172.21.15.69:0/811323071 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f85e800fce0 con 0x5578d23d62f0 2024-05-14T15:26:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.326+0000 7f85dcc00640 1 -- 172.21.15.69:0/811323071 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 46) ==== 8410+0+0 (secure 0 0 0) 0x7f85e801ea90 con 0x5578d23d62f0 2024-05-14T15:26:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.326+0000 7f85fcd99740 10 client.16368 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T15:26:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.326+0000 7f85fcd99740 10 client.16368 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:26:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.326+0000 7f85fcd99740 20 client.16368 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.326+0000 7f85fcd99740 1 --2- 172.21.15.69:0/811323071 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578d23931c0 0x5578d28278e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.326+0000 7f85fcd99740 4 client.16368 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:26:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.326+0000 7f85fcd99740 1 -- 172.21.15.69:0/811323071 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5578d270cfd0 con 0x5578d23931c0 2024-05-14T15:26:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.327+0000 7f85ee000640 1 --2- 172.21.15.69:0/811323071 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578d23931c0 0x5578d28278e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.328+0000 7f85dcc00640 10 client.16368 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:26.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.328+0000 7f85ee000640 1 --2- 172.21.15.69:0/811323071 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578d23931c0 0x5578d28278e0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d632265f142520a9 server_cookie=a4aadf35899f9c10 in_seq=0 out_seq=0 2024-05-14T15:26:26.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 40.0 s, 553.6 tps, lat 371.435 ms stddev 1674.279 2024-05-14T15:26:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.398+0000 7f85dcc00640 1 -- 172.21.15.69:0/811323071 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5578d270cfd0 con 0x5578d23931c0 2024-05-14T15:26:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.398+0000 7f85dcc00640 10 client.16368 handle_command_reply: tid=0 2024-05-14T15:26:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.398+0000 7f85fcd99740 1 client.16368 shutdown 2024-05-14T15:26:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.398+0000 7f85fcd99740 1 -- 172.21.15.69:0/811323071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23d62f0 msgr2=0x5578d27ae510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:26.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.398+0000 7f85fcd99740 1 --2- 172.21.15.69:0/811323071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23d62f0 0x5578d27ae510 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f85e8018040 tx=0x7f85e8004ad0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.399+0000 7f85fcd99740 1 -- 172.21.15.69:0/811323071 shutdown_connections 2024-05-14T15:26:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.399+0000 7f85fcd99740 1 --2- 172.21.15.69:0/811323071 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578d23ff1b0 0x5578d27aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.399+0000 7f85fcd99740 1 --2- 172.21.15.69:0/811323071 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578d23de4d0 0x5578d27aea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.399+0000 7f85fcd99740 1 --2- 172.21.15.69:0/811323071 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578d23931c0 0x5578d28278e0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.399+0000 7f85fcd99740 1 --2- 172.21.15.69:0/811323071 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578d23d62f0 0x5578d27ae510 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.399+0000 7f85dcc00640 0 client.16368 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.399+0000 7f85fcd99740 1 -- 172.21.15.69:0/811323071 >> 172.21.15.69:0/811323071 conn(0x5578d23f3300 msgr2=0x5578d27a0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.399+0000 7f85fcd99740 1 -- 172.21.15.69:0/811323071 shutdown_connections 2024-05-14T15:26:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.399+0000 7f85fcd99740 1 -- 172.21.15.69:0/811323071 wait complete. 2024-05-14T15:26:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.399+0000 7f85fcd99740 20 client.16368 trim_cache size 0 max 16384 2024-05-14T15:26:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:26:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:26:26.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:26:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:26:26.402 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.400+0000 7f85efe00640 1 -- 172.21.15.69:0/1277501465 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f85d40b2950 msgr2=0x7f85d40b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.400+0000 7f85efe00640 1 --2- 172.21.15.69:0/1277501465 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f85d40b2950 0x7f85d40b4e60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x5578d27a1830 tx=0x7f85e8009500 comp rx=0 tx=0).stop 2024-05-14T15:26:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.400+0000 7f85efe00640 1 -- 172.21.15.69:0/1277501465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85f010e940 msgr2=0x7f85f01a6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.400+0000 7f85efe00640 1 --2- 172.21.15.69:0/1277501465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85f010e940 0x7f85f01a6ac0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f85d80057c0 tx=0x7f85d8030630 comp rx=0 tx=0).stop 2024-05-14T15:26:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.401+0000 7f85efe00640 1 -- 172.21.15.69:0/1277501465 shutdown_connections 2024-05-14T15:26:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.401+0000 7f85efe00640 1 --2- 172.21.15.69:0/1277501465 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f85d40b2950 0x7f85d40b4e60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.401+0000 7f85efe00640 1 --2- 172.21.15.69:0/1277501465 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f85f010f400 0x7f85f01a07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.401+0000 7f85efe00640 1 --2- 172.21.15.69:0/1277501465 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f85f010e940 0x7f85f01a6ac0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.401+0000 7f85efe00640 1 --2- 172.21.15.69:0/1277501465 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f85f007bbf0 0x7f85f01a6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.401+0000 7f85efe00640 1 -- 172.21.15.69:0/1277501465 >> 172.21.15.69:0/1277501465 conn(0x7f85f00770f0 msgr2=0x7f85f0115a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:26.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.401+0000 7f85efe00640 1 -- 172.21.15.69:0/1277501465 shutdown_connections 2024-05-14T15:26:26.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:26.401+0000 7f85efe00640 1 -- 172.21.15.69:0/1277501465 wait complete. 2024-05-14T15:26:27.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:27 smithi203 ceph-mon[34567]: pgmap v147: 129 pgs: 129 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.7 MiB/s wr, 777 op/s 2024-05-14T15:26:27.352 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:27 smithi069 ceph-mon[31270]: pgmap v147: 129 pgs: 129 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.7 MiB/s wr, 777 op/s 2024-05-14T15:26:27.359 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-14T15:26:27.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:27 smithi092 ceph-mon[34729]: pgmap v147: 129 pgs: 129 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.7 MiB/s wr, 777 op/s 2024-05-14T15:26:28.175 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:26:29.425 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:29 smithi069 ceph-mon[31270]: pgmap v148: 129 pgs: 129 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.7 MiB/s wr, 777 op/s 2024-05-14T15:26:29.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:29 smithi092 ceph-mon[34729]: pgmap v148: 129 pgs: 129 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.7 MiB/s wr, 777 op/s 2024-05-14T15:26:29.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:29 smithi203 ceph-mon[34567]: pgmap v148: 129 pgs: 129 active+clean; 1.5 GiB data, 3.7 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.7 MiB/s wr, 777 op/s 2024-05-14T15:26:31.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 45.0 s, 611.6 tps, lat 165.943 ms stddev 61.618 2024-05-14T15:26:31.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:31 smithi092 ceph-mon[34729]: pgmap v149: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.9 MiB/s wr, 1.04k op/s 2024-05-14T15:26:31.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:31 smithi069 ceph-mon[31270]: pgmap v149: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.9 MiB/s wr, 1.04k op/s 2024-05-14T15:26:31.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:31 smithi203 ceph-mon[34567]: pgmap v149: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.9 MiB/s wr, 1.04k op/s 2024-05-14T15:26:32.799 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.651+0000 7f3818800700 1 -- 172.21.15.69:0/2192628469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3810110990 msgr2=0x7f3810110da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:32.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.651+0000 7f3818800700 1 --2- 172.21.15.69:0/2192628469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3810110990 0x7f3810110da0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f38040098f0 tx=0x7f3804009c00 comp rx=0 tx=0).stop 2024-05-14T15:26:32.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.651+0000 7f3818800700 1 -- 172.21.15.69:0/2192628469 shutdown_connections 2024-05-14T15:26:32.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.651+0000 7f3818800700 1 --2- 172.21.15.69:0/2192628469 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f381010b2b0 0x7f3810117830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.651+0000 7f3818800700 1 --2- 172.21.15.69:0/2192628469 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3810110990 0x7f3810110da0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.651+0000 7f3818800700 1 --2- 172.21.15.69:0/2192628469 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381010a960 0x7f381010ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.651+0000 7f3818800700 1 -- 172.21.15.69:0/2192628469 >> 172.21.15.69:0/2192628469 conn(0x7f3810076d30 msgr2=0x7f3810077140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:32.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.652+0000 7f3818800700 1 -- 172.21.15.69:0/2192628469 shutdown_connections 2024-05-14T15:26:32.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.652+0000 7f3818800700 1 -- 172.21.15.69:0/2192628469 wait complete. 2024-05-14T15:26:32.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.654+0000 7f3818800700 1 Processor -- start 2024-05-14T15:26:32.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.655+0000 7f3818800700 1 -- start start 2024-05-14T15:26:32.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.655+0000 7f3818800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f381010a960 0x7f38100842b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.655+0000 7f3818800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381010b2b0 0x7f381007d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.655+0000 7f3818800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3810110990 0x7f381007daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.656+0000 7f3818800700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f381011a9a0 con 0x7f381010b2b0 2024-05-14T15:26:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.656+0000 7f3818800700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f381011a820 con 0x7f3810110990 2024-05-14T15:26:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.656+0000 7f3818800700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f381011ab20 con 0x7f381010a960 2024-05-14T15:26:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.656+0000 7f3816800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3810110990 0x7f381007daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.657+0000 7f3816800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3810110990 0x7f381007daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:34898/0 (socket says 172.21.15.69:34898) 2024-05-14T15:26:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.657+0000 7f3816800700 1 -- 172.21.15.69:0/2612830914 learned_addr learned my addr 172.21.15.69:0/2612830914 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.657+0000 7f3815400700 1 --2- 172.21.15.69:0/2612830914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381010b2b0 0x7f381007d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.657+0000 7f3815e00700 1 --2- 172.21.15.69:0/2612830914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f381010a960 0x7f38100842b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.658+0000 7f3815e00700 1 -- 172.21.15.69:0/2612830914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3810110990 msgr2=0x7f381007daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.658+0000 7f3815e00700 1 --2- 172.21.15.69:0/2612830914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3810110990 0x7f381007daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.658+0000 7f3815e00700 1 -- 172.21.15.69:0/2612830914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381010b2b0 msgr2=0x7f381007d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.658+0000 7f3815e00700 1 --2- 172.21.15.69:0/2612830914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381010b2b0 0x7f381007d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.658+0000 7f3815e00700 1 -- 172.21.15.69:0/2612830914 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3810081de0 con 0x7f381010a960 2024-05-14T15:26:32.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.658+0000 7f3815400700 1 --2- 172.21.15.69:0/2612830914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381010b2b0 0x7f381007d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:26:32.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.659+0000 7f3815e00700 1 --2- 172.21.15.69:0/2612830914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f381010a960 0x7f38100842b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3804000c00 tx=0x7f380400fa40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:32.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.660+0000 7f380aa00700 1 -- 172.21.15.69:0/2612830914 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380400b6e0 con 0x7f381010a960 2024-05-14T15:26:32.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.660+0000 7f380aa00700 1 -- 172.21.15.69:0/2612830914 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3804005040 con 0x7f381010a960 2024-05-14T15:26:32.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.660+0000 7f380aa00700 1 -- 172.21.15.69:0/2612830914 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3804003970 con 0x7f381010a960 2024-05-14T15:26:32.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.661+0000 7f3818800700 1 -- 172.21.15.69:0/2612830914 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3810082070 con 0x7f381010a960 2024-05-14T15:26:32.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.661+0000 7f3818800700 1 -- 172.21.15.69:0/2612830914 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38100824d0 con 0x7f381010a960 2024-05-14T15:26:32.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.673+0000 7f380aa00700 1 -- 172.21.15.69:0/2612830914 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f38040051f0 con 0x7f381010a960 2024-05-14T15:26:32.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.673+0000 7f3827396b80 1 Processor -- start 2024-05-14T15:26:32.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.674+0000 7f3827396b80 1 -- start start 2024-05-14T15:26:32.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.674+0000 7f3827396b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5613609ace40 0x561360b306b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.674+0000 7f3827396b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561360b30bf0 0x561360b2a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.674+0000 7f3827396b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b2ac50 0x561360b2b060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.674+0000 7f3827396b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x561360a4ca20 con 0x561360b2ac50 2024-05-14T15:26:32.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.674+0000 7f3827396b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5613609ea760 con 0x5613609ace40 2024-05-14T15:26:32.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.674+0000 7f3827396b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561360a489e0 con 0x561360b30bf0 2024-05-14T15:26:32.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.675+0000 7f3815400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b2ac50 0x561360b2b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.675+0000 7f3815400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b2ac50 0x561360b2b060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60766/0 (socket says 172.21.15.69:60766) 2024-05-14T15:26:32.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.675+0000 7f3815400700 1 -- 172.21.15.69:0/2808330593 learned_addr learned my addr 172.21.15.69:0/2808330593 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:32.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.675+0000 7f3816800700 1 --2- 172.21.15.69:0/2808330593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5613609ace40 0x561360b306b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.675+0000 7f3815e00700 1 --2- 172.21.15.69:0/2808330593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561360b30bf0 0x561360b2a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.675+0000 7f3815400700 1 -- 172.21.15.69:0/2808330593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561360b30bf0 msgr2=0x561360b2a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:32.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.677+0000 7f380aa00700 1 --2- 172.21.15.69:0/2612830914 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f37f80b2bc0 0x7f37f80b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.677+0000 7f3815400700 1 --2- 172.21.15.69:0/2808330593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561360b30bf0 0x561360b2a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.677+0000 7f3815400700 1 -- 172.21.15.69:0/2808330593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5613609ace40 msgr2=0x561360b306b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:32.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.677+0000 7f3815400700 1 --2- 172.21.15.69:0/2808330593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5613609ace40 0x561360b306b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.677+0000 7f3815400700 1 -- 172.21.15.69:0/2808330593 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613609998d0 con 0x561360b2ac50 2024-05-14T15:26:32.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.677+0000 7f380aa00700 1 -- 172.21.15.69:0/2612830914 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f38040e37e0 con 0x7f381010a960 2024-05-14T15:26:32.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.677+0000 7f3815400700 1 --2- 172.21.15.69:0/2808330593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b2ac50 0x561360b2b060 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3800011540 tx=0x7f3800011850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83937b1e80defcb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:32.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.678+0000 7f3815e00700 1 --2- 172.21.15.69:0/2808330593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561360b30bf0 0x561360b2a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:26:32.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.678+0000 7f3816800700 1 --2- 172.21.15.69:0/2808330593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5613609ace40 0x561360b306b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:26:32.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.678+0000 7f37ff400700 1 -- 172.21.15.69:0/2808330593 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380001e070 con 0x561360b2ac50 2024-05-14T15:26:32.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.678+0000 7f37ff400700 1 -- 172.21.15.69:0/2808330593 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f380000eb00 con 0x561360b2ac50 2024-05-14T15:26:32.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.678+0000 7f37ff400700 1 -- 172.21.15.69:0/2808330593 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3800019af0 con 0x561360b2ac50 2024-05-14T15:26:32.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.678+0000 7f3816800700 1 --2- 172.21.15.69:0/2612830914 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f37f80b2bc0 0x7f37f80b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.679+0000 7f3827396b80 1 -- 172.21.15.69:0/2808330593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b2ac50 msgr2=0x561360b2b060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:32.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.679+0000 7f3827396b80 1 --2- 172.21.15.69:0/2808330593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b2ac50 0x561360b2b060 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f3800011540 tx=0x7f3800011850 comp rx=0 tx=0).stop 2024-05-14T15:26:32.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.680+0000 7f3816800700 1 --2- 172.21.15.69:0/2612830914 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f37f80b2bc0 0x7f37f80b50d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f380c009fd0 tx=0x7f380c004ad0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:32.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.680+0000 7f3827396b80 1 -- 172.21.15.69:0/2808330593 shutdown_connections 2024-05-14T15:26:32.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.680+0000 7f3827396b80 1 --2- 172.21.15.69:0/2808330593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b2ac50 0x561360b2b060 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.680+0000 7f3827396b80 1 --2- 172.21.15.69:0/2808330593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5613609ace40 0x561360b306b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.680+0000 7f3827396b80 1 --2- 172.21.15.69:0/2808330593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561360b30bf0 0x561360b2a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.680+0000 7f3827396b80 1 -- 172.21.15.69:0/2808330593 >> 172.21.15.69:0/2808330593 conn(0x5613609eba80 msgr2=0x561360b25790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:32.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.680+0000 7f3827396b80 1 -- 172.21.15.69:0/2808330593 shutdown_connections 2024-05-14T15:26:32.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.680+0000 7f3827396b80 1 -- 172.21.15.69:0/2808330593 wait complete. 2024-05-14T15:26:32.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.681+0000 7f3827396b80 1 -- start start 2024-05-14T15:26:32.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.682+0000 7f3827396b80 1 Processor -- start 2024-05-14T15:26:32.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.683+0000 7f3827396b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613609ace40 0x561360b34490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.683+0000 7f3827396b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561360b2ac50 0x561360b349d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.683+0000 7f3827396b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 0x561360b34f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.684+0000 7f3827396b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x561360b376c0 con 0x561360b30bf0 2024-05-14T15:26:32.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.684+0000 7f3827396b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5613609b2b20 con 0x561360b2ac50 2024-05-14T15:26:32.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.684+0000 7f3827396b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561360b37840 con 0x5613609ace40 2024-05-14T15:26:32.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.684+0000 7f3815e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613609ace40 0x561360b34490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.684+0000 7f3827396b80 10 client.0 _ll_register_callbacks cb 0x5613609e0380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:32.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.684+0000 7f3815e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613609ace40 0x561360b34490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:44246/0 (socket says 172.21.15.69:44246) 2024-05-14T15:26:32.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.684+0000 7f3815e00700 1 -- 172.21.15.69:0/1518602722 learned_addr learned my addr 172.21.15.69:0/1518602722 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:32.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.685+0000 7f3815400700 1 --2- 172.21.15.69:0/1518602722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561360b2ac50 0x561360b349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.685+0000 7f3816800700 1 --2- 172.21.15.69:0/1518602722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 0x561360b34f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.685+0000 7f3815400700 1 -- 172.21.15.69:0/1518602722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613609ace40 msgr2=0x561360b34490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:32.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.685+0000 7f3815400700 1 --2- 172.21.15.69:0/1518602722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613609ace40 0x561360b34490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.686+0000 7f3815400700 1 -- 172.21.15.69:0/1518602722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 msgr2=0x561360b34f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:32.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.686+0000 7f3815400700 1 --2- 172.21.15.69:0/1518602722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 0x561360b34f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.686+0000 7f3815400700 1 -- 172.21.15.69:0/1518602722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561360a12420 con 0x561360b2ac50 2024-05-14T15:26:32.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.686+0000 7f3816800700 1 --2- 172.21.15.69:0/1518602722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 0x561360b34f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:26:32.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.686+0000 7f3815400700 1 --2- 172.21.15.69:0/1518602722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561360b2ac50 0x561360b349d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3800011540 tx=0x7f380000e6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8586357bc62bfcb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:32.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.686+0000 7f37f3e00700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:26:32.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.687+0000 7f37f3e00700 1 -- 172.21.15.69:0/1518602722 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380001e070 con 0x561360b2ac50 2024-05-14T15:26:32.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.687+0000 7f3827396b80 1 -- 172.21.15.69:0/1518602722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f380000eb00 con 0x561360b2ac50 2024-05-14T15:26:32.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.687+0000 7f37f3e00700 1 -- 172.21.15.69:0/1518602722 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f3800004040 con 0x561360b2ac50 2024-05-14T15:26:32.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.688+0000 7f37f3e00700 1 -- 172.21.15.69:0/1518602722 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f3800030050 con 0x561360b2ac50 2024-05-14T15:26:32.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.688+0000 7f3827396b80 10 client.35876 fetch_fsmap learned FSMap version 46 2024-05-14T15:26:32.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.688+0000 7f3827396b80 1 -- 172.21.15.69:0/1518602722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x561360b42300 con 0x561360b2ac50 2024-05-14T15:26:32.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.688+0000 7f37f3e00700 1 -- 172.21.15.69:0/1518602722 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f380000eb00 con 0x561360b2ac50 2024-05-14T15:26:32.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.690+0000 7f37f3e00700 1 -- 172.21.15.69:0/1518602722 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 46) ==== 8410+0+0 (secure 0 0 0) 0x7f380002b030 con 0x561360b2ac50 2024-05-14T15:26:32.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.690+0000 7f3827396b80 10 client.35876 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T15:26:32.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.690+0000 7f3827396b80 10 client.35876 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-14T15:26:32.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.690+0000 7f3827396b80 20 client.35876 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:32.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.690+0000 7f3827396b80 1 --2- 172.21.15.69:0/1518602722 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x561360b44c30 0x561360b47080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.690+0000 7f3827396b80 4 client.35876 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:26:32.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.690+0000 7f3827396b80 1 -- 172.21.15.69:0/1518602722 --> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561360af7070 con 0x561360b44c30 2024-05-14T15:26:32.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.692+0000 7f3815e00700 1 --2- 172.21.15.69:0/1518602722 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x561360b44c30 0x561360b47080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.694+0000 7f3815e00700 1 --2- 172.21.15.69:0/1518602722 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x561360b44c30 0x561360b47080 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=97028bf3745c7554 server_cookie=a875dac801084fcd in_seq=0 out_seq=0 2024-05-14T15:26:32.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.694+0000 7f37f3e00700 10 client.35876 ms_handle_connect on v2:172.21.15.92:6836/1669439322 2024-05-14T15:26:32.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.696+0000 7f37f3e00700 1 -- 172.21.15.69:0/1518602722 <== mds.1 v2:172.21.15.92:6836/1669439322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561360af7070 con 0x561360b44c30 2024-05-14T15:26:32.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.696+0000 7f37f3e00700 10 client.35876 handle_command_reply: tid=0 2024-05-14T15:26:32.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.696+0000 7f3827396b80 1 client.35876 shutdown 2024-05-14T15:26:32.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.697+0000 7f3827396b80 1 -- 172.21.15.69:0/1518602722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561360b2ac50 msgr2=0x561360b349d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:32.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.697+0000 7f3827396b80 1 --2- 172.21.15.69:0/1518602722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561360b2ac50 0x561360b349d0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3800011540 tx=0x7f380000e6a0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.698+0000 7f3827396b80 1 -- 172.21.15.69:0/1518602722 shutdown_connections 2024-05-14T15:26:32.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.698+0000 7f3827396b80 1 --2- 172.21.15.69:0/1518602722 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x561360b44c30 0x561360b47080 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.698+0000 7f3827396b80 1 --2- 172.21.15.69:0/1518602722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 0x561360b34f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.698+0000 7f3827396b80 1 --2- 172.21.15.69:0/1518602722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613609ace40 0x561360b34490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.698+0000 7f3827396b80 1 --2- 172.21.15.69:0/1518602722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561360b2ac50 0x561360b349d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.698+0000 7f37f3e00700 0 client.35876 ms_handle_reset on v2:172.21.15.92:6836/1669439322 2024-05-14T15:26:32.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.698+0000 7f3827396b80 1 -- 172.21.15.69:0/1518602722 >> 172.21.15.69:0/1518602722 conn(0x5613609eba80 msgr2=0x561360b29700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:32.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.699+0000 7f3827396b80 1 -- 172.21.15.69:0/1518602722 shutdown_connections 2024-05-14T15:26:32.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.699+0000 7f3827396b80 1 -- 172.21.15.69:0/1518602722 wait complete. 2024-05-14T15:26:32.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.699+0000 7f3827396b80 20 client.35876 trim_cache size 0 max 16384 2024-05-14T15:26:32.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.735+0000 7f3827396b80 1 Processor -- start 2024-05-14T15:26:32.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.735+0000 7f3827396b80 1 -- start start 2024-05-14T15:26:32.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.735+0000 7f3827396b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5613609ace40 0x561360b258c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.735+0000 7f3827396b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561360b2ac50 0x561360b32010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.735+0000 7f3827396b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 0x561360b2fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.735+0000 7f3827396b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f38101bf2b0 con 0x561360b30bf0 2024-05-14T15:26:32.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.735+0000 7f3827396b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f38101c1000 con 0x5613609ace40 2024-05-14T15:26:32.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.735+0000 7f3827396b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f38101bfa40 con 0x561360b2ac50 2024-05-14T15:26:32.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.736+0000 7f3816800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 0x561360b2fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.736+0000 7f3815400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561360b2ac50 0x561360b32010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.736+0000 7f3815e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5613609ace40 0x561360b258c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.736+0000 7f3815400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561360b2ac50 0x561360b32010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:44252/0 (socket says 172.21.15.69:44252) 2024-05-14T15:26:32.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.736+0000 7f3815400700 1 -- 172.21.15.69:0/3289631055 learned_addr learned my addr 172.21.15.69:0/3289631055 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:32.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.737+0000 7f3816800700 1 -- 172.21.15.69:0/3289631055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561360b2ac50 msgr2=0x561360b32010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:32.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.737+0000 7f3816800700 1 --2- 172.21.15.69:0/3289631055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561360b2ac50 0x561360b32010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.737+0000 7f3816800700 1 -- 172.21.15.69:0/3289631055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5613609ace40 msgr2=0x561360b258c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:32.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.737+0000 7f3816800700 1 --2- 172.21.15.69:0/3289631055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5613609ace40 0x561360b258c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.811 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:26:32.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.737+0000 7f3816800700 1 -- 172.21.15.69:0/3289631055 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561360b200e0 con 0x561360b30bf0 2024-05-14T15:26:32.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.738+0000 7f3816800700 1 --2- 172.21.15.69:0/3289631055 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 0x561360b2fbf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f380c009c10 tx=0x7f380c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43e739faf3b6464 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:32.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.738+0000 7f37fea00700 1 -- 172.21.15.69:0/3289631055 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c016bf0 con 0x561360b30bf0 2024-05-14T15:26:32.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.739+0000 7f37fea00700 1 -- 172.21.15.69:0/3289631055 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f380c027030 con 0x561360b30bf0 2024-05-14T15:26:32.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.739+0000 7f37fea00700 1 -- 172.21.15.69:0/3289631055 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f380c022420 con 0x561360b30bf0 2024-05-14T15:26:32.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.740+0000 7f3827396b80 1 -- 172.21.15.69:0/3289631055 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 msgr2=0x561360b2fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:32.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.740+0000 7f3827396b80 1 --2- 172.21.15.69:0/3289631055 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 0x561360b2fbf0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f380c009c10 tx=0x7f380c016000 comp rx=0 tx=0).stop 2024-05-14T15:26:32.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.740+0000 7f3827396b80 1 -- 172.21.15.69:0/3289631055 shutdown_connections 2024-05-14T15:26:32.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.740+0000 7f3827396b80 1 --2- 172.21.15.69:0/3289631055 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 0x561360b2fbf0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.740+0000 7f3827396b80 1 --2- 172.21.15.69:0/3289631055 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5613609ace40 0x561360b258c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.740+0000 7f3827396b80 1 --2- 172.21.15.69:0/3289631055 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561360b2ac50 0x561360b32010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.740+0000 7f3827396b80 1 -- 172.21.15.69:0/3289631055 >> 172.21.15.69:0/3289631055 conn(0x5613609eba80 msgr2=0x561360b35b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:32.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.741+0000 7f3827396b80 1 -- 172.21.15.69:0/3289631055 shutdown_connections 2024-05-14T15:26:32.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.741+0000 7f3827396b80 1 -- 172.21.15.69:0/3289631055 wait complete. 2024-05-14T15:26:32.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.743+0000 7f3827396b80 1 -- start start 2024-05-14T15:26:32.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.743+0000 7f3827396b80 1 Processor -- start 2024-05-14T15:26:32.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.744+0000 7f3827396b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613609ace40 0x561360b3ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.744+0000 7f3827396b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561360b2ac50 0x561360b3cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.744+0000 7f3827396b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 0x561360b3f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.744+0000 7f3827396b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f38101c08d0 con 0x561360b30bf0 2024-05-14T15:26:32.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.744+0000 7f3827396b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f38101c0140 con 0x561360b2ac50 2024-05-14T15:26:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.744+0000 7f3827396b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f38101bd250 con 0x5613609ace40 2024-05-14T15:26:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.744+0000 7f3827396b80 10 client.0 _ll_register_callbacks cb 0x5613609e0380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.744+0000 7f3815e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613609ace40 0x561360b3ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.745+0000 7f3815e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613609ace40 0x561360b3ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:44256/0 (socket says 172.21.15.69:44256) 2024-05-14T15:26:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.745+0000 7f3815e00700 1 -- 172.21.15.69:0/1990341137 learned_addr learned my addr 172.21.15.69:0/1990341137 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.745+0000 7f3815400700 1 --2- 172.21.15.69:0/1990341137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561360b2ac50 0x561360b3cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.745+0000 7f3816800700 1 --2- 172.21.15.69:0/1990341137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 0x561360b3f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.745+0000 7f3815e00700 1 -- 172.21.15.69:0/1990341137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561360b2ac50 msgr2=0x561360b3cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.745+0000 7f3815e00700 1 --2- 172.21.15.69:0/1990341137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561360b2ac50 0x561360b3cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.745+0000 7f3815e00700 1 -- 172.21.15.69:0/1990341137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 msgr2=0x561360b3f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.745+0000 7f3815e00700 1 --2- 172.21.15.69:0/1990341137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 0x561360b3f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.745+0000 7f3815e00700 1 -- 172.21.15.69:0/1990341137 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561360b377f0 con 0x5613609ace40 2024-05-14T15:26:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.747+0000 7f37f3e00700 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:26:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.747+0000 7f3815e00700 1 --2- 172.21.15.69:0/1990341137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613609ace40 0x561360b3ca90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f38040a67c0 tx=0x7f3804009810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1f72d2b7d9057319 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:32.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.748+0000 7f37f3e00700 1 -- 172.21.15.69:0/1990341137 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38040c4060 con 0x5613609ace40 2024-05-14T15:26:32.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.748+0000 7f37f3e00700 1 -- 172.21.15.69:0/1990341137 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f38040a69d0 con 0x5613609ace40 2024-05-14T15:26:32.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.748+0000 7f3827396b80 1 -- 172.21.15.69:0/1990341137 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f380c027030 con 0x5613609ace40 2024-05-14T15:26:32.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.748+0000 7f37f3e00700 1 -- 172.21.15.69:0/1990341137 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f38040a4e60 con 0x5613609ace40 2024-05-14T15:26:32.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.748+0000 7f3827396b80 10 client.25870 fetch_fsmap learned FSMap version 46 2024-05-14T15:26:32.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.749+0000 7f3827396b80 1 -- 172.21.15.69:0/1990341137 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x561360bae9f0 con 0x5613609ace40 2024-05-14T15:26:32.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.749+0000 7f37f3e00700 1 -- 172.21.15.69:0/1990341137 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f380c027030 con 0x5613609ace40 2024-05-14T15:26:32.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.749+0000 7f37f3e00700 1 -- 172.21.15.69:0/1990341137 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 46) ==== 8410+0+0 (secure 0 0 0) 0x7f38040e3380 con 0x5613609ace40 2024-05-14T15:26:32.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.749+0000 7f3827396b80 10 client.25870 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T15:26:32.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.749+0000 7f3827396b80 10 client.25870 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-14T15:26:32.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.749+0000 7f3827396b80 20 client.25870 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:32.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.749+0000 7f3827396b80 1 --2- 172.21.15.69:0/1990341137 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x561360baf1a0 0x561360bb15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:32.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.749+0000 7f3827396b80 4 client.25870 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:26:32.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.749+0000 7f3827396b80 1 -- 172.21.15.69:0/1990341137 --> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561360a5a400 con 0x561360baf1a0 2024-05-14T15:26:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.750+0000 7f3815400700 1 --2- 172.21.15.69:0/1990341137 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x561360baf1a0 0x561360bb15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.751+0000 7f37f3e00700 10 client.25870 ms_handle_connect on v2:172.21.15.92:6836/1669439322 2024-05-14T15:26:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.751+0000 7f3815400700 1 --2- 172.21.15.69:0/1990341137 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x561360baf1a0 0x561360bb15c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=52921e1fa3a82ee6 server_cookie=2205a6ffba17aa8d in_seq=0 out_seq=0 2024-05-14T15:26:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.752+0000 7f37f3e00700 1 -- 172.21.15.69:0/1990341137 <== mds.1 v2:172.21.15.92:6836/1669439322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561360a5a400 con 0x561360baf1a0 2024-05-14T15:26:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.752+0000 7f37f3e00700 10 client.25870 handle_command_reply: tid=0 2024-05-14T15:26:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.752+0000 7f3827396b80 1 client.25870 shutdown 2024-05-14T15:26:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.753+0000 7f3827396b80 1 -- 172.21.15.69:0/1990341137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613609ace40 msgr2=0x561360b3ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.753+0000 7f3827396b80 1 --2- 172.21.15.69:0/1990341137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613609ace40 0x561360b3ca90 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f38040a67c0 tx=0x7f3804009810 comp rx=0 tx=0).stop 2024-05-14T15:26:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.753+0000 7f3827396b80 1 -- 172.21.15.69:0/1990341137 shutdown_connections 2024-05-14T15:26:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.753+0000 7f3827396b80 1 --2- 172.21.15.69:0/1990341137 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x561360baf1a0 0x561360bb15c0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.753+0000 7f3827396b80 1 --2- 172.21.15.69:0/1990341137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561360b30bf0 0x561360b3f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.753+0000 7f3827396b80 1 --2- 172.21.15.69:0/1990341137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5613609ace40 0x561360b3ca90 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.753+0000 7f3827396b80 1 --2- 172.21.15.69:0/1990341137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561360b2ac50 0x561360b3cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.753+0000 7f3827396b80 1 -- 172.21.15.69:0/1990341137 >> 172.21.15.69:0/1990341137 conn(0x5613609eba80 msgr2=0x561360b25620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:32.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.754+0000 7f37f3e00700 0 client.25870 ms_handle_reset on v2:172.21.15.92:6836/1669439322 2024-05-14T15:26:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.754+0000 7f3827396b80 1 -- 172.21.15.69:0/1990341137 shutdown_connections 2024-05-14T15:26:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.754+0000 7f3827396b80 1 -- 172.21.15.69:0/1990341137 wait complete. 2024-05-14T15:26:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.754+0000 7f3827396b80 20 client.25870 trim_cache size 0 max 16384 2024-05-14T15:26:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.756+0000 7f3818800700 1 -- 172.21.15.69:0/2612830914 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f37f80b2bc0 msgr2=0x7f37f80b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.756+0000 7f3818800700 1 --2- 172.21.15.69:0/2612830914 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f37f80b2bc0 0x7f37f80b50d0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f380c009fd0 tx=0x7f380c004ad0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.756+0000 7f3818800700 1 -- 172.21.15.69:0/2612830914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f381010a960 msgr2=0x7f38100842b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.756+0000 7f3818800700 1 --2- 172.21.15.69:0/2612830914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f381010a960 0x7f38100842b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f3804000c00 tx=0x7f380400fa40 comp rx=0 tx=0).stop 2024-05-14T15:26:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.756+0000 7f3818800700 1 -- 172.21.15.69:0/2612830914 shutdown_connections 2024-05-14T15:26:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.756+0000 7f3818800700 1 --2- 172.21.15.69:0/2612830914 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f37f80b2bc0 0x7f37f80b50d0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.756+0000 7f3818800700 1 --2- 172.21.15.69:0/2612830914 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3810110990 0x7f381007daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.756+0000 7f3818800700 1 --2- 172.21.15.69:0/2612830914 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f381010a960 0x7f38100842b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.756+0000 7f3818800700 1 --2- 172.21.15.69:0/2612830914 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f381010b2b0 0x7f381007d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.756+0000 7f3818800700 1 -- 172.21.15.69:0/2612830914 >> 172.21.15.69:0/2612830914 conn(0x7f3810076d30 msgr2=0x7f3810109370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.757+0000 7f3818800700 1 -- 172.21.15.69:0/2612830914 shutdown_connections 2024-05-14T15:26:32.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:32.757+0000 7f3818800700 1 -- 172.21.15.69:0/2612830914 wait complete. 2024-05-14T15:26:33.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:33 smithi092 ceph-mon[34729]: pgmap v150: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 639 op/s 2024-05-14T15:26:33.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:33 smithi069 ceph-mon[31270]: pgmap v150: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 639 op/s 2024-05-14T15:26:33.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:33 smithi203 ceph-mon[34567]: pgmap v150: 129 pgs: 129 active+clean; 1.5 GiB data, 3.8 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.4 MiB/s wr, 639 op/s 2024-05-14T15:26:33.752 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-14T15:26:34.472 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:26:35.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:35 smithi069 ceph-mon[31270]: pgmap v151: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 917 op/s 2024-05-14T15:26:35.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:35 smithi092 ceph-mon[34729]: pgmap v151: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 917 op/s 2024-05-14T15:26:35.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:35 smithi203 ceph-mon[34567]: pgmap v151: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 917 op/s 2024-05-14T15:26:36.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 50.0 s, 494.0 tps, lat 203.601 ms stddev 252.151 2024-05-14T15:26:37.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:37 smithi092 ceph-mon[34729]: pgmap v152: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.6 MiB/s wr, 540 op/s 2024-05-14T15:26:37.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:37 smithi069 ceph-mon[31270]: pgmap v152: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.6 MiB/s wr, 540 op/s 2024-05-14T15:26:37.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:37 smithi203 ceph-mon[34567]: pgmap v152: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.6 MiB/s wr, 540 op/s 2024-05-14T15:26:39.323 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:39 smithi069 ceph-mon[31270]: pgmap v153: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.6 MiB/s wr, 541 op/s 2024-05-14T15:26:39.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:39 smithi092 ceph-mon[34729]: pgmap v153: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.6 MiB/s wr, 541 op/s 2024-05-14T15:26:39.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:39 smithi203 ceph-mon[34567]: pgmap v153: 129 pgs: 129 active+clean; 1.5 GiB data, 3.9 GiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 4.6 MiB/s wr, 541 op/s 2024-05-14T15:26:39.650 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.648+0000 7f5256200700 1 -- 172.21.15.69:0/2103419357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5250103a60 msgr2=0x7f52501106f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.710 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.648+0000 7f5256200700 1 --2- 172.21.15.69:0/2103419357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5250103a60 0x7f52501106f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5240009990 tx=0x7f5240009ca0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.648+0000 7f5256200700 1 -- 172.21.15.69:0/2103419357 shutdown_connections 2024-05-14T15:26:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.648+0000 7f5256200700 1 --2- 172.21.15.69:0/2103419357 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5250110c30 0x7f5250113050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.648+0000 7f5256200700 1 --2- 172.21.15.69:0/2103419357 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5250103080 0x7f5250103490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.648+0000 7f5256200700 1 --2- 172.21.15.69:0/2103419357 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5250103a60 0x7f52501106f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.648+0000 7f5256200700 1 -- 172.21.15.69:0/2103419357 >> 172.21.15.69:0/2103419357 conn(0x7f52500fedc0 msgr2=0x7f52501011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.649+0000 7f5256200700 1 -- 172.21.15.69:0/2103419357 shutdown_connections 2024-05-14T15:26:39.711 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.649+0000 7f5256200700 1 -- 172.21.15.69:0/2103419357 wait complete. 2024-05-14T15:26:39.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.651+0000 7f5256200700 1 Processor -- start 2024-05-14T15:26:39.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.652+0000 7f5256200700 1 -- start start 2024-05-14T15:26:39.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.653+0000 7f5256200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5250103080 0x7f525010dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.715 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.654+0000 7f5256200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5250103a60 0x7f525010e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.654+0000 7f5256200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5250110c30 0x7f525010e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.654+0000 7f5256200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f5250116560 con 0x7f5250103a60 2024-05-14T15:26:39.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.654+0000 7f5256200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f52501163e0 con 0x7f5250110c30 2024-05-14T15:26:39.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.654+0000 7f5256200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f52501166e0 con 0x7f5250103080 2024-05-14T15:26:39.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.654+0000 7f524f400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5250103080 0x7f525010dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.654+0000 7f524fe00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5250110c30 0x7f525010e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.654+0000 7f524fe00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5250110c30 0x7f525010e640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:57362/0 (socket says 172.21.15.69:57362) 2024-05-14T15:26:39.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.654+0000 7f524fe00700 1 -- 172.21.15.69:0/1434556366 learned_addr learned my addr 172.21.15.69:0/1434556366 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:39.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.654+0000 7f524ea00700 1 --2- 172.21.15.69:0/1434556366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5250103a60 0x7f525010e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.655+0000 7f524fe00700 1 -- 172.21.15.69:0/1434556366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5250103080 msgr2=0x7f525010dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.655+0000 7f524fe00700 1 --2- 172.21.15.69:0/1434556366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5250103080 0x7f525010dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.655+0000 7f524fe00700 1 -- 172.21.15.69:0/1434556366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5250103a60 msgr2=0x7f525010e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.716 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.655+0000 7f524fe00700 1 --2- 172.21.15.69:0/1434556366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5250103a60 0x7f525010e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.655+0000 7f524fe00700 1 -- 172.21.15.69:0/1434556366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52501ad4f0 con 0x7f5250110c30 2024-05-14T15:26:39.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.656+0000 7f524f400700 1 --2- 172.21.15.69:0/1434556366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5250103080 0x7f525010dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:26:39.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.658+0000 7f524fe00700 1 --2- 172.21.15.69:0/1434556366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5250110c30 0x7f525010e640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f524800ef30 tx=0x7f524800c450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:39.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.658+0000 7f5247e00700 1 -- 172.21.15.69:0/1434556366 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52480092e0 con 0x7f5250110c30 2024-05-14T15:26:39.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.658+0000 7f5247e00700 1 -- 172.21.15.69:0/1434556366 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5248004bb0 con 0x7f5250110c30 2024-05-14T15:26:39.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.658+0000 7f5256200700 1 -- 172.21.15.69:0/1434556366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52501ad780 con 0x7f5250110c30 2024-05-14T15:26:39.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.658+0000 7f5256200700 1 -- 172.21.15.69:0/1434556366 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52501adc90 con 0x7f5250110c30 2024-05-14T15:26:39.717 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.658+0000 7f5247e00700 1 -- 172.21.15.69:0/1434556366 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5248004080 con 0x7f5250110c30 2024-05-14T15:26:39.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.666+0000 7f5247e00700 1 -- 172.21.15.69:0/1434556366 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f524801b030 con 0x7f5250110c30 2024-05-14T15:26:39.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.667+0000 7f5264cb9b80 1 Processor -- start 2024-05-14T15:26:39.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.667+0000 7f5264cb9b80 1 -- start start 2024-05-14T15:26:39.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.669+0000 7f5264cb9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7929e40 0x55c1d7aad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.669+0000 7f5247e00700 1 --2- 172.21.15.69:0/1434556366 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f52340b2bc0 0x7f52340b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.669+0000 7f5264cb9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7aadbf0 0x55c1d7aa7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.669+0000 7f5264cb9b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7aa7c50 0x55c1d7aa8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.669+0000 7f5247e00700 1 -- 172.21.15.69:0/1434556366 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f52480e2500 con 0x7f5250110c30 2024-05-14T15:26:39.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.669+0000 7f5264cb9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55c1d79c9a20 con 0x55c1d7929e40 2024-05-14T15:26:39.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.670+0000 7f5264cb9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c1d7967760 con 0x55c1d7aadbf0 2024-05-14T15:26:39.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.670+0000 7f5264cb9b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c1d79c59e0 con 0x55c1d7aa7c50 2024-05-14T15:26:39.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.670+0000 7f524ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7929e40 0x55c1d7aad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.670+0000 7f524ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7929e40 0x55c1d7aad6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41842/0 (socket says 172.21.15.69:41842) 2024-05-14T15:26:39.718 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.670+0000 7f524ea00700 1 -- 172.21.15.69:0/2265191118 learned_addr learned my addr 172.21.15.69:0/2265191118 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:39.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.670+0000 7f524fe00700 1 --2- 172.21.15.69:0/2265191118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7aa7c50 0x55c1d7aa8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.670+0000 7f524ea00700 1 --2- 172.21.15.69:0/2265191118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7aadbf0 0x55c1d7aa7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.672+0000 7f524f400700 1 --2- 172.21.15.69:0/1434556366 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f52340b2bc0 0x7f52340b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.672+0000 7f524fe00700 1 -- 172.21.15.69:0/2265191118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7aadbf0 msgr2=0x55c1d7aa7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:39.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.672+0000 7f524fe00700 1 --2- 172.21.15.69:0/2265191118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7aadbf0 0x55c1d7aa7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.672+0000 7f524fe00700 1 -- 172.21.15.69:0/2265191118 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7929e40 msgr2=0x55c1d7aad6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:39.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.672+0000 7f524fe00700 1 --2- 172.21.15.69:0/2265191118 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7929e40 0x55c1d7aad6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.672+0000 7f524fe00700 1 -- 172.21.15.69:0/2265191118 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1d79168d0 con 0x55c1d7aa7c50 2024-05-14T15:26:39.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.672+0000 7f524fe00700 1 --2- 172.21.15.69:0/2265191118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7aa7c50 0x55c1d7aa8060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f52480df840 tx=0x7f5248003a80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e172cbbc6973d1bb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:39.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.673+0000 7f5244c00700 1 -- 172.21.15.69:0/2265191118 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52480a8f70 con 0x55c1d7aa7c50 2024-05-14T15:26:39.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.673+0000 7f5244c00700 1 -- 172.21.15.69:0/2265191118 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52480a9b60 con 0x55c1d7aa7c50 2024-05-14T15:26:39.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.674+0000 7f5244c00700 1 -- 172.21.15.69:0/2265191118 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52480a8f70 con 0x55c1d7aa7c50 2024-05-14T15:26:39.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.675+0000 7f5264cb9b80 1 -- 172.21.15.69:0/2265191118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7aa7c50 msgr2=0x55c1d7aa8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.675+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/2265191118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7aa7c50 0x55c1d7aa8060 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f52480df840 tx=0x7f5248003a80 comp rx=0 tx=0).stop 2024-05-14T15:26:39.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.675+0000 7f5264cb9b80 1 -- 172.21.15.69:0/2265191118 shutdown_connections 2024-05-14T15:26:39.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.675+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/2265191118 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7929e40 0x55c1d7aad6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.675+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/2265191118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7aa7c50 0x55c1d7aa8060 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.675+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/2265191118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7aadbf0 0x55c1d7aa7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.675+0000 7f5264cb9b80 1 -- 172.21.15.69:0/2265191118 >> 172.21.15.69:0/2265191118 conn(0x55c1d7968a80 msgr2=0x55c1d7aa2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:39.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.676+0000 7f5264cb9b80 1 -- 172.21.15.69:0/2265191118 shutdown_connections 2024-05-14T15:26:39.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.676+0000 7f5264cb9b80 1 -- 172.21.15.69:0/2265191118 wait complete. 2024-05-14T15:26:39.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.676+0000 7f5264cb9b80 1 -- start start 2024-05-14T15:26:39.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.677+0000 7f524f400700 1 --2- 172.21.15.69:0/1434556366 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f52340b2bc0 0x7f52340b50d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f523c005fd0 tx=0x7f523c005dc0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:39.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.677+0000 7f5264cb9b80 1 Processor -- start 2024-05-14T15:26:39.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.679+0000 7f5264cb9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7929e40 0x55c1d7ab1400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.679+0000 7f5264cb9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 0x55c1d7ab1940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.680+0000 7f5264cb9b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7aadbf0 0x55c1d7ab1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.680+0000 7f524ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 0x55c1d7ab1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.680+0000 7f524f400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7929e40 0x55c1d7ab1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.680+0000 7f524f400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7929e40 0x55c1d7ab1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:57390/0 (socket says 172.21.15.69:57390) 2024-05-14T15:26:39.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.680+0000 7f524ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 0x55c1d7ab1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41844/0 (socket says 172.21.15.69:41844) 2024-05-14T15:26:39.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.681+0000 7f5264cb9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55c1d7ab46c0 con 0x55c1d7aa7c50 2024-05-14T15:26:39.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.681+0000 7f5264cb9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c1d792fb20 con 0x55c1d7929e40 2024-05-14T15:26:39.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.681+0000 7f5264cb9b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c1d7ab4840 con 0x55c1d7aadbf0 2024-05-14T15:26:39.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.681+0000 7f5264cb9b80 10 client.0 _ll_register_callbacks cb 0x55c1d795d380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:39.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.681+0000 7f524f400700 1 -- 172.21.15.69:0/2706860780 learned_addr learned my addr 172.21.15.69:0/2706860780 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:39.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.681+0000 7f524fe00700 1 --2- 172.21.15.69:0/2706860780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7aadbf0 0x55c1d7ab1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.682+0000 7f524f400700 1 -- 172.21.15.69:0/2706860780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7aadbf0 msgr2=0x55c1d7ab1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:39.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.682+0000 7f524f400700 1 --2- 172.21.15.69:0/2706860780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7aadbf0 0x55c1d7ab1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.721 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.682+0000 7f524f400700 1 -- 172.21.15.69:0/2706860780 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 msgr2=0x55c1d7ab1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:39.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.682+0000 7f524f400700 1 --2- 172.21.15.69:0/2706860780 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 0x55c1d7ab1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.682+0000 7f524f400700 1 -- 172.21.15.69:0/2706860780 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1d798f420 con 0x55c1d7929e40 2024-05-14T15:26:39.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.683+0000 7f524f400700 1 --2- 172.21.15.69:0/2706860780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7929e40 0x55c1d7ab1400 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f523c00f7a0 tx=0x7f523c004750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=80633444e06e7889 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:39.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.683+0000 7f5239600700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:26:39.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.684+0000 7f5239600700 1 -- 172.21.15.69:0/2706860780 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f523c020070 con 0x55c1d7929e40 2024-05-14T15:26:39.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.684+0000 7f5239600700 1 -- 172.21.15.69:0/2706860780 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f523c01c650 con 0x55c1d7929e40 2024-05-14T15:26:39.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.684+0000 7f5264cb9b80 1 -- 172.21.15.69:0/2706860780 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f52480a9b60 con 0x55c1d7929e40 2024-05-14T15:26:39.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.685+0000 7f5239600700 1 -- 172.21.15.69:0/2706860780 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f523c02a050 con 0x55c1d7929e40 2024-05-14T15:26:39.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.685+0000 7f5264cb9b80 10 client.35894 fetch_fsmap learned FSMap version 46 2024-05-14T15:26:39.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.685+0000 7f5264cb9b80 1 -- 172.21.15.69:0/2706860780 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55c1d7abf370 con 0x55c1d7929e40 2024-05-14T15:26:39.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.686+0000 7f5239600700 1 -- 172.21.15.69:0/2706860780 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f52480a9b60 con 0x55c1d7929e40 2024-05-14T15:26:39.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.686+0000 7f5239600700 1 -- 172.21.15.69:0/2706860780 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 46) ==== 8410+0+0 (secure 0 0 0) 0x7f523c025970 con 0x55c1d7929e40 2024-05-14T15:26:39.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.686+0000 7f5264cb9b80 10 client.35894 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T15:26:39.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.686+0000 7f5264cb9b80 10 client.35894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:26:39.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.686+0000 7f5264cb9b80 20 client.35894 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:39.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.686+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/2706860780 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c1d7ac19b0 0x55c1d7ac3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.686+0000 7f5264cb9b80 4 client.35894 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:26:39.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.686+0000 7f5264cb9b80 1 -- 172.21.15.69:0/2706860780 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c1d7a74070 con 0x55c1d7ac19b0 2024-05-14T15:26:39.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.689+0000 7f524ea00700 1 --2- 172.21.15.69:0/2706860780 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c1d7ac19b0 0x55c1d7ac3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.690+0000 7f524ea00700 1 --2- 172.21.15.69:0/2706860780 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c1d7ac19b0 0x55c1d7ac3e30 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8033d9da1779d610 server_cookie=158cbd153f72072 in_seq=0 out_seq=0 2024-05-14T15:26:39.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.690+0000 7f5239600700 10 client.35894 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:39.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.692+0000 7f5239600700 1 -- 172.21.15.69:0/2706860780 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c1d7a74070 con 0x55c1d7ac19b0 2024-05-14T15:26:39.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.692+0000 7f5239600700 10 client.35894 handle_command_reply: tid=0 2024-05-14T15:26:39.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.693+0000 7f5264cb9b80 1 client.35894 shutdown 2024-05-14T15:26:39.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.693+0000 7f5264cb9b80 1 -- 172.21.15.69:0/2706860780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7929e40 msgr2=0x55c1d7ab1400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.693+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/2706860780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7929e40 0x55c1d7ab1400 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f523c00f7a0 tx=0x7f523c004750 comp rx=0 tx=0).stop 2024-05-14T15:26:39.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.694+0000 7f5264cb9b80 1 -- 172.21.15.69:0/2706860780 shutdown_connections 2024-05-14T15:26:39.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.694+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/2706860780 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c1d7ac19b0 0x55c1d7ac3e30 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.694+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/2706860780 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7aadbf0 0x55c1d7ab1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.694+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/2706860780 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7929e40 0x55c1d7ab1400 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.694+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/2706860780 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 0x55c1d7ab1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.694+0000 7f5264cb9b80 1 -- 172.21.15.69:0/2706860780 >> 172.21.15.69:0/2706860780 conn(0x55c1d7968a80 msgr2=0x55c1d7aa6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:39.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.694+0000 7f5239600700 0 client.35894 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:39.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.694+0000 7f5264cb9b80 1 -- 172.21.15.69:0/2706860780 shutdown_connections 2024-05-14T15:26:39.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.694+0000 7f5264cb9b80 1 -- 172.21.15.69:0/2706860780 wait complete. 2024-05-14T15:26:39.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.695+0000 7f5264cb9b80 20 client.35894 trim_cache size 0 max 16384 2024-05-14T15:26:39.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.726+0000 7f5264cb9b80 1 Processor -- start 2024-05-14T15:26:39.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.726+0000 7f5264cb9b80 1 -- start start 2024-05-14T15:26:39.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.727+0000 7f5264cb9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7929e40 0x55c1d7aa7710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.727+0000 7f5264cb9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 0x55c1d7aacc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.727+0000 7f5264cb9b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7aadbf0 0x55c1d7abd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.727+0000 7f5264cb9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f52501b6cd0 con 0x55c1d7aa7c50 2024-05-14T15:26:39.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.727+0000 7f5264cb9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f52501b8a20 con 0x55c1d7929e40 2024-05-14T15:26:39.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.727+0000 7f5264cb9b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f52501b7460 con 0x55c1d7aadbf0 2024-05-14T15:26:39.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.727+0000 7f524ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 0x55c1d7aacc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.727+0000 7f524ea00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 0x55c1d7aacc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41858/0 (socket says 172.21.15.69:41858) 2024-05-14T15:26:39.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.727+0000 7f524ea00700 1 -- 172.21.15.69:0/3311812749 learned_addr learned my addr 172.21.15.69:0/3311812749 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:39.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.728+0000 7f524f400700 1 --2- 172.21.15.69:0/3311812749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7929e40 0x55c1d7aa7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.728+0000 7f524ea00700 1 -- 172.21.15.69:0/3311812749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7aadbf0 msgr2=0x55c1d7abd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:39.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.728+0000 7f524ea00700 1 --2- 172.21.15.69:0/3311812749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7aadbf0 0x55c1d7abd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.728+0000 7f524ea00700 1 -- 172.21.15.69:0/3311812749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7929e40 msgr2=0x55c1d7aa7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:39.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.728+0000 7f524ea00700 1 --2- 172.21.15.69:0/3311812749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7929e40 0x55c1d7aa7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.728+0000 7f524ea00700 1 -- 172.21.15.69:0/3311812749 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c1d7aa8820 con 0x55c1d7aa7c50 2024-05-14T15:26:39.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.729+0000 7f524f400700 1 --2- 172.21.15.69:0/3311812749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7929e40 0x55c1d7aa7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:26:39.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.729+0000 7f524ea00700 1 --2- 172.21.15.69:0/3311812749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 0x55c1d7aacc00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5240009990 tx=0x7f5240005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e946b0651ab66d9d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:39.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.731+0000 7f523be00700 1 -- 172.21.15.69:0/3311812749 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f524000b810 con 0x55c1d7aa7c50 2024-05-14T15:26:39.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.732+0000 7f523be00700 1 -- 172.21.15.69:0/3311812749 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5240022040 con 0x55c1d7aa7c50 2024-05-14T15:26:39.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.732+0000 7f523be00700 1 -- 172.21.15.69:0/3311812749 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240003da0 con 0x55c1d7aa7c50 2024-05-14T15:26:39.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.735+0000 7f5264cb9b80 1 -- 172.21.15.69:0/3311812749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 msgr2=0x55c1d7aacc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.735+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/3311812749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 0x55c1d7aacc00 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f5240009990 tx=0x7f5240005f10 comp rx=0 tx=0).stop 2024-05-14T15:26:39.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.735+0000 7f5264cb9b80 1 -- 172.21.15.69:0/3311812749 shutdown_connections 2024-05-14T15:26:39.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.735+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/3311812749 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7aadbf0 0x55c1d7abd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.735+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/3311812749 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7929e40 0x55c1d7aa7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.735+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/3311812749 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 0x55c1d7aacc00 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.735+0000 7f5264cb9b80 1 -- 172.21.15.69:0/3311812749 >> 172.21.15.69:0/3311812749 conn(0x55c1d7968a80 msgr2=0x55c1d7aac4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:39.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.735+0000 7f5264cb9b80 1 -- 172.21.15.69:0/3311812749 shutdown_connections 2024-05-14T15:26:39.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.735+0000 7f5264cb9b80 1 -- 172.21.15.69:0/3311812749 wait complete. 2024-05-14T15:26:39.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.736+0000 7f5264cb9b80 1 -- start start 2024-05-14T15:26:39.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.736+0000 7f5264cb9b80 1 Processor -- start 2024-05-14T15:26:39.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.738+0000 7f5264cb9b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7929e40 0x55c1d7ab9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.738+0000 7f5264cb9b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 0x55c1d7ab9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.738+0000 7f5264cb9b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7aadbf0 0x55c1d7b273c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.739+0000 7f5264cb9b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f52501b82f0 con 0x55c1d7aa7c50 2024-05-14T15:26:39.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.739+0000 7f5264cb9b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f52501b7b60 con 0x55c1d7aadbf0 2024-05-14T15:26:39.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.739+0000 7f524fe00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7aadbf0 0x55c1d7b273c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.739+0000 7f524fe00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7aadbf0 0x55c1d7b273c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:57406/0 (socket says 172.21.15.69:57406) 2024-05-14T15:26:39.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.739+0000 7f524fe00700 1 -- 172.21.15.69:0/505394002 learned_addr learned my addr 172.21.15.69:0/505394002 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:39.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.739+0000 7f5264cb9b80 1 -- 172.21.15.69:0/505394002 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f52501b4c70 con 0x55c1d7929e40 2024-05-14T15:26:39.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.739+0000 7f5264cb9b80 10 client.0 _ll_register_callbacks cb 0x55c1d795d380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:39.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.739+0000 7f524f400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7929e40 0x55c1d7ab9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.740+0000 7f524ea00700 1 --2- 172.21.15.69:0/505394002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 0x55c1d7ab9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.741+0000 7f524ea00700 1 -- 172.21.15.69:0/505394002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7929e40 msgr2=0x55c1d7ab9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:39.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.741+0000 7f524ea00700 1 --2- 172.21.15.69:0/505394002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7929e40 0x55c1d7ab9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.741+0000 7f524ea00700 1 -- 172.21.15.69:0/505394002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7aadbf0 msgr2=0x55c1d7b273c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:39.742 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.741+0000 7f524ea00700 1 --2- 172.21.15.69:0/505394002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7aadbf0 0x55c1d7b273c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.741+0000 7f524ea00700 1 -- 172.21.15.69:0/505394002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c1d7b27a70 con 0x55c1d7aa7c50 2024-05-14T15:26:39.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.741+0000 7f524fe00700 1 --2- 172.21.15.69:0/505394002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7aadbf0 0x55c1d7b273c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:26:39.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.742+0000 7f524ea00700 1 --2- 172.21.15.69:0/505394002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 0x55c1d7ab9fd0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x55c1d7ab4660 tx=0x7f524000b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0778d356fdd920 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:39.743 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.742+0000 7f5239600700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:26:39.744 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.743+0000 7f5239600700 1 -- 172.21.15.69:0/505394002 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5240035020 con 0x55c1d7aa7c50 2024-05-14T15:26:39.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.744+0000 7f5264cb9b80 1 -- 172.21.15.69:0/505394002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5240022040 con 0x55c1d7aa7c50 2024-05-14T15:26:39.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.744+0000 7f5239600700 1 -- 172.21.15.69:0/505394002 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f524002e040 con 0x55c1d7aa7c50 2024-05-14T15:26:39.745 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.744+0000 7f5239600700 1 -- 172.21.15.69:0/505394002 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f524000be30 con 0x55c1d7aa7c50 2024-05-14T15:26:39.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.745+0000 7f5264cb9b80 10 client.16404 fetch_fsmap learned FSMap version 46 2024-05-14T15:26:39.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.745+0000 7f5264cb9b80 1 -- 172.21.15.69:0/505394002 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55c1d7ac91d0 con 0x55c1d7aa7c50 2024-05-14T15:26:39.746 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.746+0000 7f5239600700 1 -- 172.21.15.69:0/505394002 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f5240022040 con 0x55c1d7aa7c50 2024-05-14T15:26:39.747 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.746+0000 7f5239600700 1 -- 172.21.15.69:0/505394002 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 46) ==== 8410+0+0 (secure 0 0 0) 0x7f524000f850 con 0x55c1d7aa7c50 2024-05-14T15:26:39.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.747+0000 7f5264cb9b80 10 client.16404 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T15:26:39.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.747+0000 7f5264cb9b80 10 client.16404 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:26:39.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.747+0000 7f5264cb9b80 20 client.16404 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:39.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.747+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/505394002 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c1d7b3d310 0x55c1d7b3f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.747+0000 7f5264cb9b80 4 client.16404 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:26:39.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.747+0000 7f5264cb9b80 1 -- 172.21.15.69:0/505394002 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c1d79d7400 con 0x55c1d7b3d310 2024-05-14T15:26:39.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.747+0000 7f524f400700 1 --2- 172.21.15.69:0/505394002 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c1d7b3d310 0x55c1d7b3f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.750+0000 7f5239600700 10 client.16404 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:39.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.750+0000 7f524f400700 1 --2- 172.21.15.69:0/505394002 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c1d7b3d310 0x55c1d7b3f730 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dd2bbc635019d98 server_cookie=90fc8e3325c79401 in_seq=0 out_seq=0 2024-05-14T15:26:39.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.751+0000 7f5239600700 1 -- 172.21.15.69:0/505394002 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c1d79d7400 con 0x55c1d7b3d310 2024-05-14T15:26:39.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.751+0000 7f5239600700 10 client.16404 handle_command_reply: tid=0 2024-05-14T15:26:39.752 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.751+0000 7f5264cb9b80 1 client.16404 shutdown 2024-05-14T15:26:39.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.752+0000 7f5264cb9b80 1 -- 172.21.15.69:0/505394002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 msgr2=0x55c1d7ab9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.752+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/505394002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 0x55c1d7ab9fd0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x55c1d7ab4660 tx=0x7f524000b970 comp rx=0 tx=0).stop 2024-05-14T15:26:39.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.752+0000 7f5264cb9b80 1 -- 172.21.15.69:0/505394002 shutdown_connections 2024-05-14T15:26:39.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.752+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/505394002 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c1d7b3d310 0x55c1d7b3f730 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.753+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/505394002 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c1d7aadbf0 0x55c1d7b273c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.753+0000 7f5239600700 0 client.16404 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:39.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.753+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/505394002 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c1d7929e40 0x55c1d7ab9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.753+0000 7f5264cb9b80 1 --2- 172.21.15.69:0/505394002 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c1d7aa7c50 0x55c1d7ab9fd0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.753+0000 7f5264cb9b80 1 -- 172.21.15.69:0/505394002 >> 172.21.15.69:0/505394002 conn(0x55c1d7968a80 msgr2=0x55c1d7aa1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:39.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.753+0000 7f5264cb9b80 1 -- 172.21.15.69:0/505394002 shutdown_connections 2024-05-14T15:26:39.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.753+0000 7f5264cb9b80 1 -- 172.21.15.69:0/505394002 wait complete. 2024-05-14T15:26:39.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.753+0000 7f5264cb9b80 20 client.16404 trim_cache size 0 max 16384 2024-05-14T15:26:39.755 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:26:39.756 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.755+0000 7f5256200700 1 -- 172.21.15.69:0/1434556366 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f52340b2bc0 msgr2=0x7f52340b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.755+0000 7f5256200700 1 --2- 172.21.15.69:0/1434556366 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f52340b2bc0 0x7f52340b50d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f523c005fd0 tx=0x7f523c005dc0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.755+0000 7f5256200700 1 -- 172.21.15.69:0/1434556366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5250110c30 msgr2=0x7f525010e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.755+0000 7f5256200700 1 --2- 172.21.15.69:0/1434556366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5250110c30 0x7f525010e640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f524800ef30 tx=0x7f524800c450 comp rx=0 tx=0).stop 2024-05-14T15:26:39.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.756+0000 7f5256200700 1 -- 172.21.15.69:0/1434556366 shutdown_connections 2024-05-14T15:26:39.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.756+0000 7f5256200700 1 --2- 172.21.15.69:0/1434556366 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f52340b2bc0 0x7f52340b50d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.756+0000 7f5256200700 1 --2- 172.21.15.69:0/1434556366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f5250110c30 0x7f525010e640 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.756+0000 7f5256200700 1 --2- 172.21.15.69:0/1434556366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f5250103080 0x7f525010dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.756+0000 7f5256200700 1 --2- 172.21.15.69:0/1434556366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f5250103a60 0x7f525010e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.756+0000 7f5256200700 1 -- 172.21.15.69:0/1434556366 >> 172.21.15.69:0/1434556366 conn(0x7f52500fedc0 msgr2=0x7f5250112860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:39.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.756+0000 7f5256200700 1 -- 172.21.15.69:0/1434556366 shutdown_connections 2024-05-14T15:26:39.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:39.756+0000 7f5256200700 1 -- 172.21.15.69:0/1434556366 wait complete. 2024-05-14T15:26:39.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.809+0000 7f6d0a400640 1 -- 172.21.15.69:0/4118442236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cfc09b900 msgr2=0x7f6cfc0954e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.809+0000 7f6d0a400640 1 --2- 172.21.15.69:0/4118442236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cfc09b900 0x7f6cfc0954e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009900 tx=0x7f6cf802a410 comp rx=0 tx=0).stop 2024-05-14T15:26:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.809+0000 7f6d0a400640 1 -- 172.21.15.69:0/4118442236 shutdown_connections 2024-05-14T15:26:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.809+0000 7f6d0a400640 1 --2- 172.21.15.69:0/4118442236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cfc0a0260 0x7f6cfc0a2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.809+0000 7f6d0a400640 1 --2- 172.21.15.69:0/4118442236 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cfc095a20 0x7f6cfc095e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.809+0000 7f6d0a400640 1 --2- 172.21.15.69:0/4118442236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cfc09b900 0x7f6cfc0954e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.809+0000 7f6d0a400640 1 -- 172.21.15.69:0/4118442236 >> 172.21.15.69:0/4118442236 conn(0x7f6cfc00afc0 msgr2=0x7f6cfc00b400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.809+0000 7f6d0a400640 1 -- 172.21.15.69:0/4118442236 shutdown_connections 2024-05-14T15:26:39.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.809+0000 7f6d0a400640 1 -- 172.21.15.69:0/4118442236 wait complete. 2024-05-14T15:26:39.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.811+0000 7f6d0a400640 1 Processor -- start 2024-05-14T15:26:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.811+0000 7f6d0a400640 1 -- start start 2024-05-14T15:26:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.812+0000 7f6d0a400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cfc095a20 0x7f6cfc0a6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.812+0000 7f6d0a400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cfc09b900 0x7f6cfc0a6940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.812+0000 7f6d0a400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cfc0a0260 0x7f6cfc0a6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.812+0000 7f6d0a400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc0a4810 con 0x7f6cfc09b900 2024-05-14T15:26:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.812+0000 7f6d0a400640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc0a4690 con 0x7f6cfc0a0260 2024-05-14T15:26:39.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.812+0000 7f6d0a400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc0a4990 con 0x7f6cfc095a20 2024-05-14T15:26:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.812+0000 7f6d03e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cfc09b900 0x7f6cfc0a6940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.812+0000 7f6d09000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cfc095a20 0x7f6cfc0a6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.812+0000 7f6d09a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cfc0a0260 0x7f6cfc0a6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.812+0000 7f6d03e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cfc09b900 0x7f6cfc0a6940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41874/0 (socket says 172.21.15.69:41874) 2024-05-14T15:26:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.812+0000 7f6d03e00640 1 -- 172.21.15.69:0/3553822270 learned_addr learned my addr 172.21.15.69:0/3553822270 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.813+0000 7f6d09000640 1 -- 172.21.15.69:0/3553822270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cfc0a0260 msgr2=0x7f6cfc0a6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.813+0000 7f6d09000640 1 --2- 172.21.15.69:0/3553822270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cfc0a0260 0x7f6cfc0a6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.813+0000 7f6d09000640 1 -- 172.21.15.69:0/3553822270 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cfc09b900 msgr2=0x7f6cfc0a6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.813+0000 7f6d09000640 1 --2- 172.21.15.69:0/3553822270 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cfc09b900 0x7f6cfc0a6940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.813+0000 7f6d09000640 1 -- 172.21.15.69:0/3553822270 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc150be0 con 0x7f6cfc095a20 2024-05-14T15:26:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.814+0000 7f6d09000640 1 --2- 172.21.15.69:0/3553822270 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cfc095a20 0x7f6cfc0a6400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009230 tx=0x7f6cf8005e10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.814+0000 7f6d01600640 1 -- 172.21.15.69:0/3553822270 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf803f070 con 0x7f6cfc095a20 2024-05-14T15:26:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.815+0000 7f6d01600640 1 -- 172.21.15.69:0/3553822270 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6cf8003a80 con 0x7f6cfc095a20 2024-05-14T15:26:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.815+0000 7f6d01600640 1 -- 172.21.15.69:0/3553822270 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf803f070 con 0x7f6cfc095a20 2024-05-14T15:26:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.815+0000 7f6d0a400640 1 -- 172.21.15.69:0/3553822270 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cfc150e70 con 0x7f6cfc095a20 2024-05-14T15:26:39.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.815+0000 7f6d0a400640 1 -- 172.21.15.69:0/3553822270 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cfc151220 con 0x7f6cfc095a20 2024-05-14T15:26:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.822+0000 7f6d12b7b740 1 Processor -- start 2024-05-14T15:26:39.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.823+0000 7f6d12b7b740 1 -- start start 2024-05-14T15:26:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.823+0000 7f6d12b7b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bef1b0 0x55a1d6f90470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.824+0000 7f6d12b7b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f909b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.824+0000 7f6d12b7b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bce4d0 0x55a1d6f90ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.824+0000 7f6d12b7b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55a1d6ef5550 con 0x55a1d6bef1b0 2024-05-14T15:26:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.824+0000 7f6d12b7b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a1d6e9abc0 con 0x55a1d6bce4d0 2024-05-14T15:26:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.824+0000 7f6d12b7b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a1d6ef1510 con 0x55a1d6bc62f0 2024-05-14T15:26:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.824+0000 7f6d09a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bef1b0 0x55a1d6f90470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.824+0000 7f6d09a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bef1b0 0x55a1d6f90470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41890/0 (socket says 172.21.15.69:41890) 2024-05-14T15:26:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.824+0000 7f6d09a00640 1 -- 172.21.15.69:0/3056482579 learned_addr learned my addr 172.21.15.69:0/3056482579 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:39.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.824+0000 7f6d03e00640 1 --2- 172.21.15.69:0/3056482579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bce4d0 0x55a1d6f90ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.825+0000 7f6d01600640 1 -- 172.21.15.69:0/3553822270 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6cf8043400 con 0x7f6cfc095a20 2024-05-14T15:26:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.825+0000 7f6d03e00640 1 -- 172.21.15.69:0/3056482579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bc62f0 msgr2=0x55a1d6f909b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:26:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.825+0000 7f6d03e00640 1 --2- 172.21.15.69:0/3056482579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f909b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.825+0000 7f6d03e00640 1 -- 172.21.15.69:0/3056482579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bef1b0 msgr2=0x55a1d6f90470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.825+0000 7f6d03e00640 1 --2- 172.21.15.69:0/3056482579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bef1b0 0x55a1d6f90470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.825+0000 7f6d03e00640 1 -- 172.21.15.69:0/3056482579 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1d6c07210 con 0x55a1d6bce4d0 2024-05-14T15:26:39.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.826+0000 7f6d03e00640 1 --2- 172.21.15.69:0/3056482579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bce4d0 0x55a1d6f90ef0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d04052170 tx=0x7f6d04068de0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acdfc95ffcbf1444 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.826+0000 7f6cf6000640 1 -- 172.21.15.69:0/3056482579 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0406b1d0 con 0x55a1d6bce4d0 2024-05-14T15:26:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.827+0000 7f6cf6000640 1 -- 172.21.15.69:0/3056482579 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d0407a8d0 con 0x55a1d6bce4d0 2024-05-14T15:26:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.827+0000 7f6d01600640 1 --2- 172.21.15.69:0/3553822270 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6cec0b2c60 0x7f6cec0b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.827+0000 7f6cf6000640 1 -- 172.21.15.69:0/3056482579 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d04069c70 con 0x55a1d6bce4d0 2024-05-14T15:26:39.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.828+0000 7f6d09a00640 1 --2- 172.21.15.69:0/3553822270 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6cec0b2c60 0x7f6cec0b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.828+0000 7f6d12b7b740 1 -- 172.21.15.69:0/3056482579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bce4d0 msgr2=0x55a1d6f90ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.828+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/3056482579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bce4d0 0x55a1d6f90ef0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6d04052170 tx=0x7f6d04068de0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.829+0000 7f6d12b7b740 1 -- 172.21.15.69:0/3056482579 shutdown_connections 2024-05-14T15:26:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.829+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/3056482579 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bce4d0 0x55a1d6f90ef0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.829+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/3056482579 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f909b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.829+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/3056482579 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bef1b0 0x55a1d6f90470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.831 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.829+0000 7f6d12b7b740 1 -- 172.21.15.69:0/3056482579 >> 172.21.15.69:0/3056482579 conn(0x55a1d6be3300 msgr2=0x55a1d6f8cc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.829+0000 7f6d01600640 1 -- 172.21.15.69:0/3553822270 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f6cf81026c0 con 0x7f6cfc095a20 2024-05-14T15:26:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.830+0000 7f6d12b7b740 1 -- 172.21.15.69:0/3056482579 shutdown_connections 2024-05-14T15:26:39.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.830+0000 7f6d09a00640 1 --2- 172.21.15.69:0/3553822270 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6cec0b2c60 0x7f6cec0b5170 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55a1d6f8d5e0 tx=0x7f6cf0005f90 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.830+0000 7f6d12b7b740 1 -- 172.21.15.69:0/3056482579 wait complete. 2024-05-14T15:26:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.831+0000 7f6d12b7b740 1 -- start start 2024-05-14T15:26:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.831+0000 7f6d12b7b740 1 Processor -- start 2024-05-14T15:26:39.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.833+0000 7f6d12b7b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f9a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.833+0000 7f6d12b7b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bce4d0 0x55a1d6f9ae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.833+0000 7f6d12b7b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bef1b0 0x55a1d6fa6a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.833+0000 7f6d12b7b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55a1d6f9d5a0 con 0x55a1d6bc62f0 2024-05-14T15:26:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.833+0000 7f6d12b7b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a1d6eae660 con 0x55a1d6bce4d0 2024-05-14T15:26:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.833+0000 7f6d12b7b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a1d6f9d720 con 0x55a1d6bef1b0 2024-05-14T15:26:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.834+0000 7f6d03e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bce4d0 0x55a1d6f9ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.834+0000 7f6d09000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f9a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.834+0000 7f6d03e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bce4d0 0x55a1d6f9ae20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:57450/0 (socket says 172.21.15.69:57450) 2024-05-14T15:26:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.834+0000 7f6d03e00640 1 -- 172.21.15.69:0/1040627405 learned_addr learned my addr 172.21.15.69:0/1040627405 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:39.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.834+0000 7f6d12b7b740 10 client.0 _ll_register_callbacks cb 0x55a1d6e78400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.834+0000 7f6d09000640 1 -- 172.21.15.69:0/1040627405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bef1b0 msgr2=0x55a1d6fa6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.834+0000 7f6d09000640 1 --2- 172.21.15.69:0/1040627405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bef1b0 0x55a1d6fa6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.834+0000 7f6d09000640 1 -- 172.21.15.69:0/1040627405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bce4d0 msgr2=0x55a1d6f9ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.834+0000 7f6d09000640 1 --2- 172.21.15.69:0/1040627405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bce4d0 0x55a1d6f9ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.834+0000 7f6d09000640 1 -- 172.21.15.69:0/1040627405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1d6cd3620 con 0x55a1d6bc62f0 2024-05-14T15:26:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.835+0000 7f6ceaa00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:26:39.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.835+0000 7f6d09000640 1 --2- 172.21.15.69:0/1040627405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f9a8e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80ffa00 tx=0x7f6cf80c55c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43566895ae800762 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:39.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.836+0000 7f6ceaa00640 1 -- 172.21.15.69:0/1040627405 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8035050 con 0x55a1d6bc62f0 2024-05-14T15:26:39.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.836+0000 7f6ceaa00640 1 -- 172.21.15.69:0/1040627405 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f6cf80c58d0 con 0x55a1d6bc62f0 2024-05-14T15:26:39.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.837+0000 7f6d12b7b740 1 -- 172.21.15.69:0/1040627405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d0407a8d0 con 0x55a1d6bc62f0 2024-05-14T15:26:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.838+0000 7f6ceaa00640 1 -- 172.21.15.69:0/1040627405 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f6cf8048070 con 0x55a1d6bc62f0 2024-05-14T15:26:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.838+0000 7f6d12b7b740 10 client.16416 fetch_fsmap learned FSMap version 46 2024-05-14T15:26:39.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.838+0000 7f6d12b7b740 1 -- 172.21.15.69:0/1040627405 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55a1d6fa9760 con 0x55a1d6bc62f0 2024-05-14T15:26:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.839+0000 7f6ceaa00640 1 -- 172.21.15.69:0/1040627405 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6d0407a8d0 con 0x55a1d6bc62f0 2024-05-14T15:26:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.839+0000 7f6ceaa00640 1 -- 172.21.15.69:0/1040627405 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 46) ==== 8410+0+0 (secure 0 0 0) 0x7f6cf804b060 con 0x55a1d6bc62f0 2024-05-14T15:26:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.839+0000 7f6d12b7b740 10 client.16416 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T15:26:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.839+0000 7f6d12b7b740 10 client.16416 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:26:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.839+0000 7f6d12b7b740 20 client.16416 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.839+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/1040627405 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a1d6badd80 0x55a1d6facce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.839+0000 7f6d12b7b740 4 client.16416 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:26:39.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.839+0000 7f6d12b7b740 1 -- 172.21.15.69:0/1040627405 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1d6f03160 con 0x55a1d6badd80 2024-05-14T15:26:39.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.841+0000 7f6d03e00640 1 --2- 172.21.15.69:0/1040627405 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a1d6badd80 0x55a1d6facce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.842+0000 7f6ceaa00640 10 client.16416 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:39.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.842+0000 7f6d03e00640 1 --2- 172.21.15.69:0/1040627405 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a1d6badd80 0x55a1d6facce0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57ee06623813a0c4 server_cookie=5c2421b59fb345b9 in_seq=0 out_seq=0 2024-05-14T15:26:39.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.844+0000 7f6ceaa00640 1 -- 172.21.15.69:0/1040627405 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a1d6f03160 con 0x55a1d6badd80 2024-05-14T15:26:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.844+0000 7f6ceaa00640 10 client.16416 handle_command_reply: tid=0 2024-05-14T15:26:39.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.844+0000 7f6d12b7b740 1 client.16416 shutdown 2024-05-14T15:26:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.845+0000 7f6d12b7b740 1 -- 172.21.15.69:0/1040627405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bc62f0 msgr2=0x55a1d6f9a8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.845+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/1040627405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f9a8e0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80ffa00 tx=0x7f6cf80c55c0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.847+0000 7f6d12b7b740 1 -- 172.21.15.69:0/1040627405 shutdown_connections 2024-05-14T15:26:39.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.847+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/1040627405 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bef1b0 0x55a1d6fa6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.847+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/1040627405 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bce4d0 0x55a1d6f9ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.847+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/1040627405 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a1d6badd80 0x55a1d6facce0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.847+0000 7f6ceaa00640 0 client.16416 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:39.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.847+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/1040627405 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f9a8e0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.847+0000 7f6d12b7b740 1 -- 172.21.15.69:0/1040627405 >> 172.21.15.69:0/1040627405 conn(0x55a1d6be3300 msgr2=0x55a1d6f92190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:39.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.848+0000 7f6d12b7b740 1 -- 172.21.15.69:0/1040627405 shutdown_connections 2024-05-14T15:26:39.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.848+0000 7f6d12b7b740 1 -- 172.21.15.69:0/1040627405 wait complete. 2024-05-14T15:26:39.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.849+0000 7f6d12b7b740 20 client.16416 trim_cache size 0 max 16384 2024-05-14T15:26:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.890+0000 7f6d12b7b740 1 Processor -- start 2024-05-14T15:26:39.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.891+0000 7f6d12b7b740 1 -- start start 2024-05-14T15:26:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.892+0000 7f6d12b7b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f91210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.892+0000 7f6d12b7b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bce4d0 0x55a1d6fb24e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.892+0000 7f6d12b7b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bef1b0 0x55a1d6fb2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.892+0000 7f6d12b7b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc15b540 con 0x55a1d6bce4d0 2024-05-14T15:26:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.892+0000 7f6d12b7b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc15d290 con 0x55a1d6bc62f0 2024-05-14T15:26:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.892+0000 7f6d12b7b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc15bcd0 con 0x55a1d6bef1b0 2024-05-14T15:26:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.893+0000 7f6d09000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f91210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.893+0000 7f6d09000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f91210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:57458/0 (socket says 172.21.15.69:57458) 2024-05-14T15:26:39.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.893+0000 7f6d09000640 1 -- 172.21.15.69:0/3902272314 learned_addr learned my addr 172.21.15.69:0/3902272314 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.893+0000 7f6d09000640 1 -- 172.21.15.69:0/3902272314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bef1b0 msgr2=0x55a1d6fb2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.893+0000 7f6d09000640 1 --2- 172.21.15.69:0/3902272314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bef1b0 0x55a1d6fb2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.894+0000 7f6d09000640 1 -- 172.21.15.69:0/3902272314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bce4d0 msgr2=0x55a1d6fb24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.894+0000 7f6d09000640 1 --2- 172.21.15.69:0/3902272314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bce4d0 0x55a1d6fb24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.894+0000 7f6d09000640 1 -- 172.21.15.69:0/3902272314 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1d6f99770 con 0x55a1d6bc62f0 2024-05-14T15:26:39.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.895+0000 7f6d09000640 1 --2- 172.21.15.69:0/3902272314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f91210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80c56c0 tx=0x7f6cf8009560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=84de3b5e20a09701 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:39.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.896+0000 7f6cf5600640 1 -- 172.21.15.69:0/3902272314 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8035070 con 0x55a1d6bc62f0 2024-05-14T15:26:39.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.896+0000 7f6cf5600640 1 -- 172.21.15.69:0/3902272314 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6cf80c9b00 con 0x55a1d6bc62f0 2024-05-14T15:26:39.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.896+0000 7f6cf5600640 1 -- 172.21.15.69:0/3902272314 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf80c9640 con 0x55a1d6bc62f0 2024-05-14T15:26:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.897+0000 7f6d12b7b740 1 -- 172.21.15.69:0/3902272314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bc62f0 msgr2=0x55a1d6f91210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.897+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/3902272314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f91210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6cf80c56c0 tx=0x7f6cf8009560 comp rx=0 tx=0).stop 2024-05-14T15:26:39.899 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.898+0000 7f6d12b7b740 1 -- 172.21.15.69:0/3902272314 shutdown_connections 2024-05-14T15:26:39.899 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.898+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/3902272314 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bef1b0 0x55a1d6fb2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.898+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/3902272314 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bce4d0 0x55a1d6fb24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.898+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/3902272314 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f91210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.898+0000 7f6d12b7b740 1 -- 172.21.15.69:0/3902272314 >> 172.21.15.69:0/3902272314 conn(0x55a1d6be3300 msgr2=0x55a1d6f8bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:39.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.898+0000 7f6d12b7b740 1 -- 172.21.15.69:0/3902272314 shutdown_connections 2024-05-14T15:26:39.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.898+0000 7f6d12b7b740 1 -- 172.21.15.69:0/3902272314 wait complete. 2024-05-14T15:26:39.900 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.899+0000 7f6d12b7b740 1 -- start start 2024-05-14T15:26:39.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.901+0000 7f6d12b7b740 1 Processor -- start 2024-05-14T15:26:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.902+0000 7f6d12b7b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f9d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.902+0000 7f6d12b7b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bce4d0 0x55a1d6f9deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.902+0000 7f6d12b7b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bef1b0 0x55a1d7013080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.902+0000 7f6d12b7b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc15cb60 con 0x55a1d6bce4d0 2024-05-14T15:26:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.902+0000 7f6d12b7b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc15c3d0 con 0x55a1d6bef1b0 2024-05-14T15:26:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.902+0000 7f6d12b7b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc159520 con 0x55a1d6bc62f0 2024-05-14T15:26:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.903+0000 7f6d12b7b740 10 client.0 _ll_register_callbacks cb 0x7f6cf8003ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:39.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.903+0000 7f6d09a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bef1b0 0x55a1d7013080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.903+0000 7f6d09000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f9d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.903+0000 7f6d09a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bef1b0 0x55a1d7013080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:57470/0 (socket says 172.21.15.69:57470) 2024-05-14T15:26:39.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.903+0000 7f6d09a00640 1 -- 172.21.15.69:0/49483856 learned_addr learned my addr 172.21.15.69:0/49483856 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:39.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.904+0000 7f6d03e00640 1 --2- 172.21.15.69:0/49483856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bce4d0 0x55a1d6f9deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.904+0000 7f6d09000640 1 -- 172.21.15.69:0/49483856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bef1b0 msgr2=0x55a1d7013080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:39.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.904+0000 7f6d09000640 1 --2- 172.21.15.69:0/49483856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bef1b0 0x55a1d7013080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.904+0000 7f6d09000640 1 -- 172.21.15.69:0/49483856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bce4d0 msgr2=0x55a1d6f9deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:39.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.905+0000 7f6d09000640 1 --2- 172.21.15.69:0/49483856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bce4d0 0x55a1d6f9deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.905+0000 7f6d09000640 1 -- 172.21.15.69:0/49483856 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1d6f9e7a0 con 0x55a1d6bc62f0 2024-05-14T15:26:39.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.905+0000 7f6d03e00640 1 --2- 172.21.15.69:0/49483856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bce4d0 0x55a1d6f9deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:26:39.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.905+0000 7f6d09000640 1 --2- 172.21.15.69:0/49483856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f9d970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8045040 tx=0x7f6cf80b1340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5dffe8159fbdbf61 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:39.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.905+0000 7f6ceaa00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:26:39.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.906+0000 7f6ceaa00640 1 -- 172.21.15.69:0/49483856 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8035070 con 0x55a1d6bc62f0 2024-05-14T15:26:39.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.906+0000 7f6ceaa00640 1 -- 172.21.15.69:0/49483856 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f6cf80d1f60 con 0x55a1d6bc62f0 2024-05-14T15:26:39.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.906+0000 7f6d12b7b740 1 -- 172.21.15.69:0/49483856 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6cf80c9b00 con 0x55a1d6bc62f0 2024-05-14T15:26:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.907+0000 7f6ceaa00640 1 -- 172.21.15.69:0/49483856 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f6cf80cd940 con 0x55a1d6bc62f0 2024-05-14T15:26:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.907+0000 7f6d12b7b740 10 client.25888 fetch_fsmap learned FSMap version 46 2024-05-14T15:26:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.907+0000 7f6d12b7b740 1 -- 172.21.15.69:0/49483856 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x55a1d7014680 con 0x55a1d6bc62f0 2024-05-14T15:26:39.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.908+0000 7f6ceaa00640 1 -- 172.21.15.69:0/49483856 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6cf80c9b00 con 0x55a1d6bc62f0 2024-05-14T15:26:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.909+0000 7f6ceaa00640 1 -- 172.21.15.69:0/49483856 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 46) ==== 8410+0+0 (secure 0 0 0) 0x7f6cf80afb60 con 0x55a1d6bc62f0 2024-05-14T15:26:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.909+0000 7f6d12b7b740 10 client.25888 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T15:26:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.909+0000 7f6d12b7b740 10 client.25888 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:26:39.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.909+0000 7f6d12b7b740 20 client.25888 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.909+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/49483856 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a1d6b831c0 0x55a1d7016b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.909+0000 7f6d12b7b740 4 client.25888 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:26:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.909+0000 7f6d12b7b740 1 -- 172.21.15.69:0/49483856 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a1d6efcfd0 con 0x55a1d6b831c0 2024-05-14T15:26:39.911 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.910+0000 7f6d03e00640 1 --2- 172.21.15.69:0/49483856 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a1d6b831c0 0x55a1d7016b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.911+0000 7f6d03e00640 1 --2- 172.21.15.69:0/49483856 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a1d6b831c0 0x55a1d7016b10 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db025a5682ebd1a4 server_cookie=c16f8650fbfb9d52 in_seq=0 out_seq=0 2024-05-14T15:26:39.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.911+0000 7f6ceaa00640 10 client.25888 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:39.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.930+0000 7f6ceaa00640 1 -- 172.21.15.69:0/49483856 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a1d6efcfd0 con 0x55a1d6b831c0 2024-05-14T15:26:39.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.930+0000 7f6ceaa00640 10 client.25888 handle_command_reply: tid=0 2024-05-14T15:26:39.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.930+0000 7f6d12b7b740 1 client.25888 shutdown 2024-05-14T15:26:39.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.931+0000 7f6d12b7b740 1 -- 172.21.15.69:0/49483856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bc62f0 msgr2=0x55a1d6f9d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.931+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/49483856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f9d970 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8045040 tx=0x7f6cf80b1340 comp rx=0 tx=0).stop 2024-05-14T15:26:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.931+0000 7f6d12b7b740 1 -- 172.21.15.69:0/49483856 shutdown_connections 2024-05-14T15:26:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.931+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/49483856 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a1d6bef1b0 0x55a1d7013080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.931+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/49483856 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a1d6b831c0 0x55a1d7016b10 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.931+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/49483856 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a1d6bce4d0 0x55a1d6f9deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.931+0000 7f6d12b7b740 1 --2- 172.21.15.69:0/49483856 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a1d6bc62f0 0x55a1d6f9d970 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.931+0000 7f6ceaa00640 0 client.25888 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.931+0000 7f6d12b7b740 1 -- 172.21.15.69:0/49483856 >> 172.21.15.69:0/49483856 conn(0x55a1d6be3300 msgr2=0x55a1d6f8b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.932+0000 7f6d12b7b740 1 -- 172.21.15.69:0/49483856 shutdown_connections 2024-05-14T15:26:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.932+0000 7f6d12b7b740 1 -- 172.21.15.69:0/49483856 wait complete. 2024-05-14T15:26:39.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.932+0000 7f6d12b7b740 20 client.25888 trim_cache size 0 max 16384 2024-05-14T15:26:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:26:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:26:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:26:39.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:26:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.933+0000 7f6d0a400640 1 -- 172.21.15.69:0/3553822270 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6cec0b2c60 msgr2=0x7f6cec0b5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.933+0000 7f6d0a400640 1 --2- 172.21.15.69:0/3553822270 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6cec0b2c60 0x7f6cec0b5170 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x55a1d6f8d5e0 tx=0x7f6cf0005f90 comp rx=0 tx=0).stop 2024-05-14T15:26:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.933+0000 7f6d0a400640 1 -- 172.21.15.69:0/3553822270 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cfc095a20 msgr2=0x7f6cfc0a6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.933+0000 7f6d0a400640 1 --2- 172.21.15.69:0/3553822270 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cfc095a20 0x7f6cfc0a6400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6cf8009230 tx=0x7f6cf8005e10 comp rx=0 tx=0).stop 2024-05-14T15:26:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.934+0000 7f6d0a400640 1 -- 172.21.15.69:0/3553822270 shutdown_connections 2024-05-14T15:26:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.934+0000 7f6d0a400640 1 --2- 172.21.15.69:0/3553822270 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6cec0b2c60 0x7f6cec0b5170 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.934+0000 7f6d0a400640 1 --2- 172.21.15.69:0/3553822270 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6cfc0a0260 0x7f6cfc0a6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.934+0000 7f6d0a400640 1 --2- 172.21.15.69:0/3553822270 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6cfc09b900 0x7f6cfc0a6940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.934+0000 7f6d0a400640 1 --2- 172.21.15.69:0/3553822270 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6cfc095a20 0x7f6cfc0a6400 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.934+0000 7f6d0a400640 1 -- 172.21.15.69:0/3553822270 >> 172.21.15.69:0/3553822270 conn(0x7f6cfc00afc0 msgr2=0x7f6cfc09c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.934+0000 7f6d0a400640 1 -- 172.21.15.69:0/3553822270 shutdown_connections 2024-05-14T15:26:39.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:39.935+0000 7f6d0a400640 1 -- 172.21.15.69:0/3553822270 wait complete. 2024-05-14T15:26:41.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 55.0 s, 686.6 tps, lat 145.961 ms stddev 64.704 2024-05-14T15:26:41.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:41 smithi092 ceph-mon[34729]: pgmap v154: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.2 MiB/s wr, 819 op/s 2024-05-14T15:26:41.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:41 smithi069 ceph-mon[31270]: pgmap v154: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.2 MiB/s wr, 819 op/s 2024-05-14T15:26:41.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:41 smithi203 ceph-mon[34567]: pgmap v154: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.2 MiB/s wr, 819 op/s 2024-05-14T15:26:41.795 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-14T15:26:41.796 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-14T15:26:42.458 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:26:43.398 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:43 smithi203 ceph-mon[34567]: pgmap v155: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 555 op/s 2024-05-14T15:26:43.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:43 smithi092 ceph-mon[34729]: pgmap v155: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 555 op/s 2024-05-14T15:26:43.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:43 smithi069 ceph-mon[31270]: pgmap v155: 129 pgs: 129 active+clean; 1.6 GiB data, 4.0 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 555 op/s 2024-05-14T15:26:45.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.207+0000 7fdb4c200700 1 -- 172.21.15.69:0/3420401408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb44108f20 msgr2=0x7fdb44109330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:45.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.207+0000 7fdb4c200700 1 --2- 172.21.15.69:0/3420401408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb44108f20 0x7fdb44109330 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdb30009990 tx=0x7fdb30009ca0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.207+0000 7fdb4c200700 1 -- 172.21.15.69:0/3420401408 shutdown_connections 2024-05-14T15:26:45.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.207+0000 7fdb4c200700 1 --2- 172.21.15.69:0/3420401408 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb44109870 0x7fdb441111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.207+0000 7fdb4c200700 1 --2- 172.21.15.69:0/3420401408 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb441045f0 0x7fdb44104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.207+0000 7fdb4c200700 1 --2- 172.21.15.69:0/3420401408 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb44108f20 0x7fdb44109330 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.209 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.207+0000 7fdb4c200700 1 -- 172.21.15.69:0/3420401408 >> 172.21.15.69:0/3420401408 conn(0x7fdb44100040 msgr2=0x7fdb44102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:45.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.207+0000 7fdb4c200700 1 -- 172.21.15.69:0/3420401408 shutdown_connections 2024-05-14T15:26:45.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.207+0000 7fdb4c200700 1 -- 172.21.15.69:0/3420401408 wait complete. 2024-05-14T15:26:45.210 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.209+0000 7fdb4c200700 1 Processor -- start 2024-05-14T15:26:45.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.211+0000 7fdb4c200700 1 -- start start 2024-05-14T15:26:45.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.211+0000 7fdb4c200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb441045f0 0x7fdb4410f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.211+0000 7fdb4c200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb44108f20 0x7fdb4410fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.211+0000 7fdb4c200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb44109870 0x7fdb441ad280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.211+0000 7fdb4c200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441121f0 con 0x7fdb441045f0 2024-05-14T15:26:45.213 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.211+0000 7fdb4c200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdb44112070 con 0x7fdb44108f20 2024-05-14T15:26:45.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.211+0000 7fdb4c200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdb44112370 con 0x7fdb44109870 2024-05-14T15:26:45.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.212+0000 7fdb48e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb44108f20 0x7fdb4410fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.212+0000 7fdb49800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb441045f0 0x7fdb4410f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.212+0000 7fdb48e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb44108f20 0x7fdb4410fd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:41030/0 (socket says 172.21.15.69:41030) 2024-05-14T15:26:45.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.212+0000 7fdb49800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb441045f0 0x7fdb4410f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55672/0 (socket says 172.21.15.69:55672) 2024-05-14T15:26:45.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.212+0000 7fdb48e00700 1 -- 172.21.15.69:0/2994780562 learned_addr learned my addr 172.21.15.69:0/2994780562 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:45.214 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.212+0000 7fdb4a200700 1 --2- 172.21.15.69:0/2994780562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb44109870 0x7fdb441ad280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.213+0000 7fdb4a200700 1 -- 172.21.15.69:0/2994780562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb44108f20 msgr2=0x7fdb4410fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:45.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.213+0000 7fdb4a200700 1 --2- 172.21.15.69:0/2994780562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb44108f20 0x7fdb4410fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.213+0000 7fdb4a200700 1 -- 172.21.15.69:0/2994780562 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb441045f0 msgr2=0x7fdb4410f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:45.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.213+0000 7fdb4a200700 1 --2- 172.21.15.69:0/2994780562 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb441045f0 0x7fdb4410f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.213+0000 7fdb4a200700 1 -- 172.21.15.69:0/2994780562 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb44115cf0 con 0x7fdb44109870 2024-05-14T15:26:45.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.213+0000 7fdb48e00700 1 --2- 172.21.15.69:0/2994780562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb44108f20 0x7fdb4410fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:26:45.215 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.213+0000 7fdb49800700 1 --2- 172.21.15.69:0/2994780562 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb441045f0 0x7fdb4410f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:26:45.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.214+0000 7fdb4a200700 1 --2- 172.21.15.69:0/2994780562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb44109870 0x7fdb441ad280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800be20 tx=0x7fdb38009ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:45.216 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.216+0000 7fdb42000700 1 -- 172.21.15.69:0/2994780562 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb38019070 con 0x7fdb44109870 2024-05-14T15:26:45.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.216+0000 7fdb42000700 1 -- 172.21.15.69:0/2994780562 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb3800cc10 con 0x7fdb44109870 2024-05-14T15:26:45.217 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.216+0000 7fdb42000700 1 -- 172.21.15.69:0/2994780562 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb380125a0 con 0x7fdb44109870 2024-05-14T15:26:45.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.216+0000 7fdb4c200700 1 -- 172.21.15.69:0/2994780562 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb44115f80 con 0x7fdb44109870 2024-05-14T15:26:45.218 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.216+0000 7fdb4c200700 1 -- 172.21.15.69:0/2994780562 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb44116470 con 0x7fdb44109870 2024-05-14T15:26:45.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.224+0000 7fdb42000700 1 -- 172.21.15.69:0/2994780562 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fdb3801c070 con 0x7fdb44109870 2024-05-14T15:26:45.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.226+0000 7fdb42000700 1 --2- 172.21.15.69:0/2994780562 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdb2c0b2bc0 0x7fdb2c0b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.227+0000 7fdb42000700 1 -- 172.21.15.69:0/2994780562 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fdb380e2010 con 0x7fdb44109870 2024-05-14T15:26:45.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.227+0000 7fdb49800700 1 --2- 172.21.15.69:0/2994780562 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdb2c0b2bc0 0x7fdb2c0b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.231+0000 7fdb49800700 1 --2- 172.21.15.69:0/2994780562 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdb2c0b2bc0 0x7fdb2c0b50d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c005950 tx=0x7fdb3c00b410 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:45.234 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.233+0000 7fdb5ad74b80 1 Processor -- start 2024-05-14T15:26:45.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.234+0000 7fdb5ad74b80 1 -- start start 2024-05-14T15:26:45.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.235+0000 7fdb5ad74b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9ce33ec0 0x564e9cfb7370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.235+0000 7fdb5ad74b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9cfb78b0 0x564e9cfb1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.235+0000 7fdb5ad74b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb1a70 0x564e9cfb1e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.235+0000 7fdb5ad74b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564e9ced3aa0 con 0x564e9ce33ec0 2024-05-14T15:26:45.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.235+0000 7fdb5ad74b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564e9ce717e0 con 0x564e9cfb78b0 2024-05-14T15:26:45.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.235+0000 7fdb5ad74b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564e9cecfa60 con 0x564e9cfb1a70 2024-05-14T15:26:45.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.235+0000 7fdb48e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9cfb78b0 0x564e9cfb1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.236+0000 7fdb49800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9ce33ec0 0x564e9cfb7370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.236+0000 7fdb4a200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb1a70 0x564e9cfb1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.236+0000 7fdb48e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9cfb78b0 0x564e9cfb1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:41036/0 (socket says 172.21.15.69:41036) 2024-05-14T15:26:45.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.236+0000 7fdb48e00700 1 -- 172.21.15.69:0/485110746 learned_addr learned my addr 172.21.15.69:0/485110746 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:45.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.237+0000 7fdb48e00700 1 -- 172.21.15.69:0/485110746 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb1a70 msgr2=0x564e9cfb1e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:45.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.237+0000 7fdb48e00700 1 --2- 172.21.15.69:0/485110746 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb1a70 0x564e9cfb1e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.238 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.237+0000 7fdb48e00700 1 -- 172.21.15.69:0/485110746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9ce33ec0 msgr2=0x564e9cfb7370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:45.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.237+0000 7fdb48e00700 1 --2- 172.21.15.69:0/485110746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9ce33ec0 0x564e9cfb7370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.237+0000 7fdb48e00700 1 -- 172.21.15.69:0/485110746 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e9ce20950 con 0x564e9cfb78b0 2024-05-14T15:26:45.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.237+0000 7fdb49800700 1 --2- 172.21.15.69:0/485110746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9ce33ec0 0x564e9cfb7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:26:45.239 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.237+0000 7fdb48e00700 1 --2- 172.21.15.69:0/485110746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9cfb78b0 0x564e9cfb1530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdb30005da0 tx=0x7fdb30005dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0fa4987dbfeb9b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:45.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.238+0000 7fdb36a00700 1 -- 172.21.15.69:0/485110746 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3000b910 con 0x564e9cfb78b0 2024-05-14T15:26:45.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.238+0000 7fdb36a00700 1 -- 172.21.15.69:0/485110746 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb30004830 con 0x564e9cfb78b0 2024-05-14T15:26:45.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.238+0000 7fdb36a00700 1 -- 172.21.15.69:0/485110746 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb30005280 con 0x564e9cfb78b0 2024-05-14T15:26:45.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.239+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/485110746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9cfb78b0 msgr2=0x564e9cfb1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:45.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.239+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/485110746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9cfb78b0 0x564e9cfb1530 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdb30005da0 tx=0x7fdb30005dd0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.240+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/485110746 shutdown_connections 2024-05-14T15:26:45.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.240+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/485110746 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9ce33ec0 0x564e9cfb7370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.240+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/485110746 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb1a70 0x564e9cfb1e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.241+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/485110746 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9cfb78b0 0x564e9cfb1530 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.241+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/485110746 >> 172.21.15.69:0/485110746 conn(0x564e9ce78ff0 msgr2=0x564e9cfac350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:45.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.242+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/485110746 shutdown_connections 2024-05-14T15:26:45.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.242+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/485110746 wait complete. 2024-05-14T15:26:45.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.242+0000 7fdb5ad74b80 1 -- start start 2024-05-14T15:26:45.244 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.243+0000 7fdb5ad74b80 1 Processor -- start 2024-05-14T15:26:45.245 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.244+0000 7fdb5ad74b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9ce33ec0 0x564e9cfbb050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.245+0000 7fdb5ad74b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9cfb1a70 0x564e9cfbb590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.245+0000 7fdb5ad74b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb78b0 0x564e9cfbbad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.245+0000 7fdb5ad74b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564e9cfbe2d0 con 0x564e9cfb1a70 2024-05-14T15:26:45.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.245+0000 7fdb48e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9cfb1a70 0x564e9cfbb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.246+0000 7fdb5ad74b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564e9ce39ba0 con 0x564e9ce33ec0 2024-05-14T15:26:45.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.246+0000 7fdb48e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9cfb1a70 0x564e9cfbb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55688/0 (socket says 172.21.15.69:55688) 2024-05-14T15:26:45.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.246+0000 7fdb48e00700 1 -- 172.21.15.69:0/43792097 learned_addr learned my addr 172.21.15.69:0/43792097 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:45.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.246+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/43792097 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564e9cfbe450 con 0x564e9cfb78b0 2024-05-14T15:26:45.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.246+0000 7fdb4a200700 1 --2- 172.21.15.69:0/43792097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb78b0 0x564e9cfbbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.246+0000 7fdb49800700 1 --2- 172.21.15.69:0/43792097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9ce33ec0 0x564e9cfbb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.246+0000 7fdb5ad74b80 10 client.0 _ll_register_callbacks cb 0x564e9ce7acf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:45.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.247+0000 7fdb48e00700 1 -- 172.21.15.69:0/43792097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb78b0 msgr2=0x564e9cfbbad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:45.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.247+0000 7fdb48e00700 1 --2- 172.21.15.69:0/43792097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb78b0 0x564e9cfbbad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.247+0000 7fdb48e00700 1 -- 172.21.15.69:0/43792097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9ce33ec0 msgr2=0x564e9cfbb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:45.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.247+0000 7fdb48e00700 1 --2- 172.21.15.69:0/43792097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9ce33ec0 0x564e9cfbb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.247+0000 7fdb48e00700 1 -- 172.21.15.69:0/43792097 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e9ce994a0 con 0x564e9cfb1a70 2024-05-14T15:26:45.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.248+0000 7fdb48e00700 1 --2- 172.21.15.69:0/43792097 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9cfb1a70 0x564e9cfbb590 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fdb30003730 tx=0x7fdb3000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef5bc84b280a0e56 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:45.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.248+0000 7fdb2b400700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:26:45.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.249+0000 7fdb2b400700 1 -- 172.21.15.69:0/43792097 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb30032060 con 0x564e9cfb1a70 2024-05-14T15:26:45.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.249+0000 7fdb2b400700 1 -- 172.21.15.69:0/43792097 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fdb3000bd50 con 0x564e9cfb1a70 2024-05-14T15:26:45.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.249+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/43792097 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb30004830 con 0x564e9cfb1a70 2024-05-14T15:26:45.252 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.250+0000 7fdb2b400700 1 -- 172.21.15.69:0/43792097 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fdb30039050 con 0x564e9cfb1a70 2024-05-14T15:26:45.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.250+0000 7fdb5ad74b80 10 client.16428 fetch_fsmap learned FSMap version 46 2024-05-14T15:26:45.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.250+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/43792097 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x564e9cfc8e10 con 0x564e9cfb1a70 2024-05-14T15:26:45.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.251+0000 7fdb2b400700 1 -- 172.21.15.69:0/43792097 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb30004830 con 0x564e9cfb1a70 2024-05-14T15:26:45.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.252+0000 7fdb2b400700 1 -- 172.21.15.69:0/43792097 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 46) ==== 8410+0+0 (secure 0 0 0) 0x7fdb3000f8b0 con 0x564e9cfb1a70 2024-05-14T15:26:45.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.252+0000 7fdb5ad74b80 10 client.16428 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T15:26:45.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.252+0000 7fdb5ad74b80 10 client.16428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:26:45.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.252+0000 7fdb5ad74b80 20 client.16428 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:45.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.252+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/43792097 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564e9cfcb2e0 0x564e9cfcd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.252+0000 7fdb5ad74b80 4 client.16428 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:26:45.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.252+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/43792097 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e9cf7e240 con 0x564e9cfcb2e0 2024-05-14T15:26:45.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.253+0000 7fdb49800700 1 --2- 172.21.15.69:0/43792097 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564e9cfcb2e0 0x564e9cfcd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.254+0000 7fdb2b400700 10 client.16428 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:45.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.254+0000 7fdb49800700 1 --2- 172.21.15.69:0/43792097 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564e9cfcb2e0 0x564e9cfcd700 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f315dd5e749d244c server_cookie=bf6dde498e84f0f1 in_seq=0 out_seq=0 2024-05-14T15:26:45.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.255+0000 7fdb2b400700 1 -- 172.21.15.69:0/43792097 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564e9cf7e240 con 0x564e9cfcb2e0 2024-05-14T15:26:45.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.255+0000 7fdb2b400700 10 client.16428 handle_command_reply: tid=0 2024-05-14T15:26:45.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.255+0000 7fdb5ad74b80 1 client.16428 shutdown 2024-05-14T15:26:45.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.256+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/43792097 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9cfb1a70 msgr2=0x564e9cfbb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:45.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.256+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/43792097 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9cfb1a70 0x564e9cfbb590 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fdb30003730 tx=0x7fdb3000b910 comp rx=0 tx=0).stop 2024-05-14T15:26:45.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.256+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/43792097 shutdown_connections 2024-05-14T15:26:45.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.256+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/43792097 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564e9cfcb2e0 0x564e9cfcd700 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.256+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/43792097 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb78b0 0x564e9cfbbad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.256+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/43792097 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9ce33ec0 0x564e9cfbb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.256+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/43792097 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9cfb1a70 0x564e9cfbb590 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.256+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/43792097 >> 172.21.15.69:0/43792097 conn(0x564e9ce78ff0 msgr2=0x564e9cfb0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:45.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.257+0000 7fdb2b400700 0 client.16428 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:45.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.257+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/43792097 shutdown_connections 2024-05-14T15:26:45.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.257+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/43792097 wait complete. 2024-05-14T15:26:45.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.257+0000 7fdb5ad74b80 20 client.16428 trim_cache size 0 max 16384 2024-05-14T15:26:45.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.296+0000 7fdb5ad74b80 1 Processor -- start 2024-05-14T15:26:45.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.296+0000 7fdb5ad74b80 1 -- start start 2024-05-14T15:26:45.298 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:45 smithi069 ceph-mon[31270]: pgmap v156: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.8 MiB/s wr, 888 op/s 2024-05-14T15:26:45.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.297+0000 7fdb5ad74b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9ce33ec0 0x564e9cfc76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.297+0000 7fdb5ad74b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb1a70 0x564e9cfa6b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.297+0000 7fdb5ad74b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9cfb78b0 0x564e9cfb8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.297+0000 7fdb5ad74b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441bf3b0 con 0x564e9cfb78b0 2024-05-14T15:26:45.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.297+0000 7fdb5ad74b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441c1100 con 0x564e9ce33ec0 2024-05-14T15:26:45.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.297+0000 7fdb5ad74b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441bfb40 con 0x564e9cfb1a70 2024-05-14T15:26:45.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.297+0000 7fdb4a200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9cfb78b0 0x564e9cfb8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.297+0000 7fdb4a200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9cfb78b0 0x564e9cfb8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55700/0 (socket says 172.21.15.69:55700) 2024-05-14T15:26:45.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.297+0000 7fdb4a200700 1 -- 172.21.15.69:0/1879777394 learned_addr learned my addr 172.21.15.69:0/1879777394 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:45.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.297+0000 7fdb48e00700 1 --2- 172.21.15.69:0/1879777394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb1a70 0x564e9cfa6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.298+0000 7fdb4a200700 1 -- 172.21.15.69:0/1879777394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb1a70 msgr2=0x564e9cfa6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:45.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.298+0000 7fdb4a200700 1 --2- 172.21.15.69:0/1879777394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb1a70 0x564e9cfa6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.298+0000 7fdb4a200700 1 -- 172.21.15.69:0/1879777394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9ce33ec0 msgr2=0x564e9cfc76e0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:26:45.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.298+0000 7fdb4a200700 1 --2- 172.21.15.69:0/1879777394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9ce33ec0 0x564e9cfc76e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.298+0000 7fdb4a200700 1 -- 172.21.15.69:0/1879777394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e9cfb95c0 con 0x564e9cfb78b0 2024-05-14T15:26:45.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.298+0000 7fdb4a200700 1 --2- 172.21.15.69:0/1879777394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9cfb78b0 0x564e9cfb8cd0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fdb380a6260 tx=0x7fdb3800e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f757353b1f8bacc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:45.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.299+0000 7fdb36000700 1 -- 172.21.15.69:0/1879777394 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb380c8070 con 0x564e9cfb78b0 2024-05-14T15:26:45.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.299+0000 7fdb36000700 1 -- 172.21.15.69:0/1879777394 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb380c2070 con 0x564e9cfb78b0 2024-05-14T15:26:45.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.299+0000 7fdb36000700 1 -- 172.21.15.69:0/1879777394 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb380b19c0 con 0x564e9cfb78b0 2024-05-14T15:26:45.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.300+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/1879777394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9cfb78b0 msgr2=0x564e9cfb8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:45.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.300+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/1879777394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9cfb78b0 0x564e9cfb8cd0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fdb380a6260 tx=0x7fdb3800e040 comp rx=0 tx=0).stop 2024-05-14T15:26:45.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.300+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/1879777394 shutdown_connections 2024-05-14T15:26:45.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.300+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/1879777394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9cfb78b0 0x564e9cfb8cd0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.300+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/1879777394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9ce33ec0 0x564e9cfc76e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.300+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/1879777394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb1a70 0x564e9cfa6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.300+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/1879777394 >> 172.21.15.69:0/1879777394 conn(0x564e9ce78ff0 msgr2=0x564e9cfbb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:45.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.300+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/1879777394 shutdown_connections 2024-05-14T15:26:45.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.301+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/1879777394 wait complete. 2024-05-14T15:26:45.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.301+0000 7fdb5ad74b80 1 -- start start 2024-05-14T15:26:45.303 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.301+0000 7fdb5ad74b80 1 Processor -- start 2024-05-14T15:26:45.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.302+0000 7fdb5ad74b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9ce33ec0 0x564e9cfd06c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.304 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.303+0000 7fdb5ad74b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9cfb1a70 0x564e9cfd0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.303+0000 7fdb5ad74b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb78b0 0x564e9cfceb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.303+0000 7fdb5ad74b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441c09d0 con 0x564e9ce33ec0 2024-05-14T15:26:45.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.303+0000 7fdb5ad74b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdb441c0240 con 0x564e9cfb1a70 2024-05-14T15:26:45.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.303+0000 7fdb5ad74b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4411d080 con 0x564e9cfb78b0 2024-05-14T15:26:45.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.303+0000 7fdb5ad74b80 10 client.0 _ll_register_callbacks cb 0x564e9ce7acf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:45.305 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.304+0000 7fdb4a200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb78b0 0x564e9cfceb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.304+0000 7fdb4a200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb78b0 0x564e9cfceb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:33644/0 (socket says 172.21.15.69:33644) 2024-05-14T15:26:45.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.304+0000 7fdb4a200700 1 -- 172.21.15.69:0/293456596 learned_addr learned my addr 172.21.15.69:0/293456596 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:45.306 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.304+0000 7fdb49800700 1 --2- 172.21.15.69:0/293456596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9ce33ec0 0x564e9cfd06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.305+0000 7fdb4a200700 1 -- 172.21.15.69:0/293456596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9cfb1a70 msgr2=0x564e9cfd0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:45.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.305+0000 7fdb48e00700 1 --2- 172.21.15.69:0/293456596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9cfb1a70 0x564e9cfd0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.305+0000 7fdb4a200700 1 --2- 172.21.15.69:0/293456596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9cfb1a70 0x564e9cfd0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.305+0000 7fdb4a200700 1 -- 172.21.15.69:0/293456596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9ce33ec0 msgr2=0x564e9cfd06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:45.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.305+0000 7fdb4a200700 1 --2- 172.21.15.69:0/293456596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9ce33ec0 0x564e9cfd06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.305+0000 7fdb4a200700 1 -- 172.21.15.69:0/293456596 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e9cfcf200 con 0x564e9cfb78b0 2024-05-14T15:26:45.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.305+0000 7fdb48e00700 1 --2- 172.21.15.69:0/293456596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9cfb1a70 0x564e9cfd0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:26:45.307 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.306+0000 7fdb4a200700 1 --2- 172.21.15.69:0/293456596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb78b0 0x564e9cfceb00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdb380a8cf0 tx=0x7fdb380a4fe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48e4251350ecc1db server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:45.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.306+0000 7fdb2b400700 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:26:45.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.306+0000 7fdb2b400700 1 -- 172.21.15.69:0/293456596 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb380c8070 con 0x564e9cfb78b0 2024-05-14T15:26:45.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.306+0000 7fdb2b400700 1 -- 172.21.15.69:0/293456596 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fdb380b1bd0 con 0x564e9cfb78b0 2024-05-14T15:26:45.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.306+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/293456596 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb380c2070 con 0x564e9cfb78b0 2024-05-14T15:26:45.308 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.307+0000 7fdb2b400700 1 -- 172.21.15.69:0/293456596 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fdb380ad3a0 con 0x564e9cfb78b0 2024-05-14T15:26:45.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.307+0000 7fdb5ad74b80 10 client.25906 fetch_fsmap learned FSMap version 46 2024-05-14T15:26:45.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.307+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/293456596 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x564e9d036270 con 0x564e9cfb78b0 2024-05-14T15:26:45.309 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.308+0000 7fdb2b400700 1 -- 172.21.15.69:0/293456596 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb380c2070 con 0x564e9cfb78b0 2024-05-14T15:26:45.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.308+0000 7fdb2b400700 1 -- 172.21.15.69:0/293456596 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 46) ==== 8410+0+0 (secure 0 0 0) 0x7fdb380b8020 con 0x564e9cfb78b0 2024-05-14T15:26:45.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.308+0000 7fdb5ad74b80 10 client.25906 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T15:26:45.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.308+0000 7fdb5ad74b80 10 client.25906 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:26:45.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.308+0000 7fdb5ad74b80 20 client.25906 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:45.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.309+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/293456596 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564e9d036980 0x564e9d038da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:45.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.309+0000 7fdb5ad74b80 4 client.25906 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-14T15:26:45.310 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.309+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/293456596 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x564e9cee1480 con 0x564e9d036980 2024-05-14T15:26:45.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.309+0000 7fdb49800700 1 --2- 172.21.15.69:0/293456596 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564e9d036980 0x564e9d038da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:45.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.310+0000 7fdb2b400700 10 client.25906 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:45.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.311+0000 7fdb49800700 1 --2- 172.21.15.69:0/293456596 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564e9d036980 0x564e9d038da0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=402f144aa501111 server_cookie=cfe4f0673f359882 in_seq=0 out_seq=0 2024-05-14T15:26:45.313 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.312+0000 7fdb2b400700 1 -- 172.21.15.69:0/293456596 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x564e9cee1480 con 0x564e9d036980 2024-05-14T15:26:45.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.312+0000 7fdb2b400700 10 client.25906 handle_command_reply: tid=0 2024-05-14T15:26:45.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.312+0000 7fdb5ad74b80 1 client.25906 shutdown 2024-05-14T15:26:45.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.313+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/293456596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb78b0 msgr2=0x564e9cfceb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:45.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.313+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/293456596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb78b0 0x564e9cfceb00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdb380a8cf0 tx=0x7fdb380a4fe0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.314+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/293456596 shutdown_connections 2024-05-14T15:26:45.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.314+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/293456596 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564e9d036980 0x564e9d038da0 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.314+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/293456596 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e9ce33ec0 0x564e9cfd06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.314+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/293456596 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e9cfb78b0 0x564e9cfceb00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.314+0000 7fdb2b400700 0 client.25906 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:45.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.314+0000 7fdb5ad74b80 1 --2- 172.21.15.69:0/293456596 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e9cfb1a70 0x564e9cfd0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.314+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/293456596 >> 172.21.15.69:0/293456596 conn(0x564e9ce78ff0 msgr2=0x564e9cfbb950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:45.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.314+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/293456596 shutdown_connections 2024-05-14T15:26:45.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.314+0000 7fdb5ad74b80 1 -- 172.21.15.69:0/293456596 wait complete. 2024-05-14T15:26:45.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.314+0000 7fdb5ad74b80 20 client.25906 trim_cache size 0 max 16384 2024-05-14T15:26:45.317 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:26:45.318 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2024-05-14T15:26:45.318 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "64003853-50c5-4266-8bef-aea8918a14ba", 2024-05-14T15:26:45.318 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2024-05-14T15:26:45.318 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:26:45.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.317+0000 7fdb4c200700 1 -- 172.21.15.69:0/2994780562 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdb2c0b2bc0 msgr2=0x7fdb2c0b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:45.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.317+0000 7fdb4c200700 1 --2- 172.21.15.69:0/2994780562 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdb2c0b2bc0 0x7fdb2c0b50d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c005950 tx=0x7fdb3c00b410 comp rx=0 tx=0).stop 2024-05-14T15:26:45.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.317+0000 7fdb4c200700 1 -- 172.21.15.69:0/2994780562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb44109870 msgr2=0x7fdb441ad280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:45.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.317+0000 7fdb4c200700 1 --2- 172.21.15.69:0/2994780562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb44109870 0x7fdb441ad280 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800be20 tx=0x7fdb38009ed0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.317+0000 7fdb4c200700 1 -- 172.21.15.69:0/2994780562 shutdown_connections 2024-05-14T15:26:45.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.317+0000 7fdb4c200700 1 --2- 172.21.15.69:0/2994780562 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdb2c0b2bc0 0x7fdb2c0b50d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.317+0000 7fdb4c200700 1 --2- 172.21.15.69:0/2994780562 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb441045f0 0x7fdb4410f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.317+0000 7fdb4c200700 1 --2- 172.21.15.69:0/2994780562 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb44109870 0x7fdb441ad280 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.317+0000 7fdb4c200700 1 --2- 172.21.15.69:0/2994780562 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb44108f20 0x7fdb4410fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:45.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.317+0000 7fdb4c200700 1 -- 172.21.15.69:0/2994780562 >> 172.21.15.69:0/2994780562 conn(0x7fdb44100040 msgr2=0x7fdb4410a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:45.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.318+0000 7fdb4c200700 1 -- 172.21.15.69:0/2994780562 shutdown_connections 2024-05-14T15:26:45.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:45.318+0000 7fdb4c200700 1 -- 172.21.15.69:0/2994780562 wait complete. 2024-05-14T15:26:45.443 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:26:45 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b[64556]: 2024-05-14T15:26:45.330+0000 7f1329000700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001b [...3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical/ auth{2=1,3=1,4=1} v634 ap=2 f(v10 m2024-05-14T15:22:33.427523+0000 3=1+2) n(v3 rc2024-05-14T15:22:33.427523+0000 b8 4=1+3) (inest sync->mix g=2,3,4) caps={25000=pAsLsXsFs/-@53} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55799700a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001b:[<0x10000000006/pg_logical v46>,<0x10000000005/data v96>,<0x10000000003/postgres v21>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v37>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v46>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000001b:[<0x10000000006/pg_logical v634>,<0x10000000005/data v801>,<0x10000000003/postgres v301>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v314>,<0x10000000001/sv_0 v336>,<0x10000000000/qa v325>,<0x1/volumes v311>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-14T15:22:33.396239+0000 4=2+2)","ondisk_value.rstat":"n(v0 rc2024-05-14T15:22:33.427523+0000 b8 4=1+3)","memory_value.dirstat":"f(v10 m2024-05-14T15:22:33.427523+0000 3=1+2)","memory_value.rstat":"n(v3 rc2024-05-14T15:22:33.427523+0000 b8 4=1+3)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-14T15:26:45.443 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:26:45 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b[64556]: 2024-05-14T15:26:45.334+0000 7f1329000700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000019 [...7,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_stat_tmp/ auth{1=1,2=1,3=1,4=1} v1132 ap=2 f(v66 m2024-05-14T15:25:55.159952+0000 3=3+0) n(v5 rc2024-05-14T15:25:55.159952+0000 b14082 4=3+1) old_inodes=4 (inest sync->mix g=1,2,3,4) caps={25000=pAsLsXsFs/-@199} | dirtyscattered=0 request=0 lock=0 importing=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x557997009b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x10000000019:[<0x10000000006/pg_stat_tmp v38>,<0x10000000005/data v96>,<0x10000000003/postgres v21>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v37>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v46>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000019:[<0x10000000006/pg_stat_tmp v1132>,<0x10000000005/data v801>,<0x10000000003/postgres v301>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v314>,<0x10000000001/sv_0 v336>,<0x10000000000/qa v325>,<0x1/volumes v311>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-14T15:25:55.116735+0000 4=4+0)","ondisk_value.rstat":"n(v0 rc2024-05-14T15:25:55.159952+0000 b14082 4=3+1)","memory_value.dirstat":"f(v66 m2024-05-14T15:25:55.159952+0000 3=3+0)","memory_value.rstat":"n(v5 rc2024-05-14T15:25:55.159952+0000 b14082 4=3+1)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-14T15:26:45.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:45 smithi092 ceph-mon[34729]: pgmap v156: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.8 MiB/s wr, 888 op/s 2024-05-14T15:26:45.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:45 smithi203 ceph-mon[34567]: pgmap v156: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 8.8 MiB/s wr, 888 op/s 2024-05-14T15:26:46.247 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T15:26:46.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 60.0 s, 614.6 tps, lat 161.624 ms stddev 45.002 2024-05-14T15:26:46.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub queued for path: / 2024-05-14T15:26:46.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:26:46.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:26:46.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:26:46.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2024-05-14T15:26:46.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:26:46.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000019 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_stat_tmp) see mds.b log and `damage ls` output for details 2024-05-14T15:26:46.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:26:46.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:26:46.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:26:46.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:26:46.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.445 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:46 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub queued for path: / 2024-05-14T15:26:46.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:26:46.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:26:46.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:26:46.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2024-05-14T15:26:46.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:26:46.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000019 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_stat_tmp) see mds.b log and `damage ls` output for details 2024-05-14T15:26:46.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:26:46.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:26:46.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:26:46.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:26:46.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:46 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub queued for path: / 2024-05-14T15:26:46.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:26:46.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:26:46.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:26:46.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2024-05-14T15:26:46.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:26:46.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000019 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_stat_tmp) see mds.b log and `damage ls` output for details 2024-05-14T15:26:46.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:26:46.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:26:46.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:26:46.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:26:46.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:46 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:46.955 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:26:47.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:47 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:26:47.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:47 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:47.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:47 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:26:47.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:47 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:47.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:47 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:26:47.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:47 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:47.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:47 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:26:47.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:47 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:47.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:47 smithi092 ceph-mon[34729]: pgmap v157: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.5 MiB/s wr, 610 op/s 2024-05-14T15:26:47.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:47 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:26:47.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:47 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:47.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:47 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:26:47.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:47 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:47.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:47 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:26:47.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:47 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:47.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:47 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:26:47.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:47 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:47.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:47 smithi069 ceph-mon[31270]: pgmap v157: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.5 MiB/s wr, 610 op/s 2024-05-14T15:26:47.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:47 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:26:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:47 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:47 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:26:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:47 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:47 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:26:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:47 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:47 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:26:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:47 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:26:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:47 smithi203 ceph-mon[34567]: pgmap v157: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.5 MiB/s wr, 610 op/s 2024-05-14T15:26:49.182 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:49 smithi069 ceph-mon[31270]: pgmap v158: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.5 MiB/s wr, 610 op/s 2024-05-14T15:26:49.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:49 smithi092 ceph-mon[34729]: pgmap v158: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.5 MiB/s wr, 610 op/s 2024-05-14T15:26:49.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:49 smithi203 ceph-mon[34567]: pgmap v158: 129 pgs: 129 active+clean; 1.6 GiB data, 4.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.5 MiB/s wr, 610 op/s 2024-05-14T15:26:51.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.126+0000 7f181c200700 1 -- 172.21.15.69:0/2554694770 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18140764b0 msgr2=0x7f1814114e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:51.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.126+0000 7f181c200700 1 --2- 172.21.15.69:0/2554694770 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18140764b0 0x7f1814114e30 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f1800009990 tx=0x7f1800009ca0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.127+0000 7f181c200700 1 -- 172.21.15.69:0/2554694770 shutdown_connections 2024-05-14T15:26:51.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.127+0000 7f181c200700 1 --2- 172.21.15.69:0/2554694770 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814115370 0x7f1814117790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.127+0000 7f181c200700 1 --2- 172.21.15.69:0/2554694770 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f1814075b60 0x7f1814075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.246 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.127+0000 7f181c200700 1 --2- 172.21.15.69:0/2554694770 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f18140764b0 0x7f1814114e30 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.127+0000 7f181c200700 1 -- 172.21.15.69:0/2554694770 >> 172.21.15.69:0/2554694770 conn(0x7f1814100040 msgr2=0x7f1814102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:51.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.128+0000 7f181c200700 1 -- 172.21.15.69:0/2554694770 shutdown_connections 2024-05-14T15:26:51.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.128+0000 7f181c200700 1 -- 172.21.15.69:0/2554694770 wait complete. 2024-05-14T15:26:51.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.130+0000 7f181c200700 1 Processor -- start 2024-05-14T15:26:51.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.130+0000 7f181c200700 1 -- start start 2024-05-14T15:26:51.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.131+0000 7f181c200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1814075b60 0x7f18141a1380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.131+0000 7f181c200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18140764b0 0x7f18141a1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.131+0000 7f181c200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814115370 0x7f18141a5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.131+0000 7f181c200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f181411a970 con 0x7f1814075b60 2024-05-14T15:26:51.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.131+0000 7f181c200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f181411a7f0 con 0x7f1814115370 2024-05-14T15:26:51.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.131+0000 7f181c200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f181411aaf0 con 0x7f18140764b0 2024-05-14T15:26:51.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.131+0000 7f1819800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1814075b60 0x7f18141a1380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:51.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.131+0000 7f1818e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18140764b0 0x7f18141a1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:51.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.131+0000 7f1819800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1814075b60 0x7f18141a1380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55732/0 (socket says 172.21.15.69:55732) 2024-05-14T15:26:51.247 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.131+0000 7f1819800700 1 -- 172.21.15.69:0/991571529 learned_addr learned my addr 172.21.15.69:0/991571529 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:51.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.131+0000 7f1818e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18140764b0 0x7f18141a1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:33660/0 (socket says 172.21.15.69:33660) 2024-05-14T15:26:51.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.131+0000 7f181a200700 1 --2- 172.21.15.69:0/991571529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814115370 0x7f18141a5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:51.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.132+0000 7f1818e00700 1 -- 172.21.15.69:0/991571529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814115370 msgr2=0x7f18141a5bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:51.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.132+0000 7f1818e00700 1 --2- 172.21.15.69:0/991571529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814115370 0x7f18141a5bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.132+0000 7f1818e00700 1 -- 172.21.15.69:0/991571529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1814075b60 msgr2=0x7f18141a1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:51.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.132+0000 7f1818e00700 1 --2- 172.21.15.69:0/991571529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1814075b60 0x7f18141a1380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.132+0000 7f1818e00700 1 -- 172.21.15.69:0/991571529 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18141a6250 con 0x7f18140764b0 2024-05-14T15:26:51.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.132+0000 7f1818e00700 1 --2- 172.21.15.69:0/991571529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18140764b0 0x7f18141a1920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f18000098e0 tx=0x7f18000047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:51.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.133+0000 7f1812000700 1 -- 172.21.15.69:0/991571529 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1800026070 con 0x7f18140764b0 2024-05-14T15:26:51.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.133+0000 7f181c200700 1 -- 172.21.15.69:0/991571529 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18141a64e0 con 0x7f18140764b0 2024-05-14T15:26:51.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.133+0000 7f1812000700 1 -- 172.21.15.69:0/991571529 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1800021410 con 0x7f18140764b0 2024-05-14T15:26:51.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.133+0000 7f181c200700 1 -- 172.21.15.69:0/991571529 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1814108600 con 0x7f18140764b0 2024-05-14T15:26:51.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.133+0000 7f1812000700 1 -- 172.21.15.69:0/991571529 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1800017650 con 0x7f18140764b0 2024-05-14T15:26:51.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.137+0000 7f1812000700 1 -- 172.21.15.69:0/991571529 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1800029070 con 0x7f18140764b0 2024-05-14T15:26:51.248 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.139+0000 7f1812000700 1 --2- 172.21.15.69:0/991571529 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f17fc0b2a70 0x7f17fc0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.139+0000 7f1812000700 1 -- 172.21.15.69:0/991571529 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f18000e34a0 con 0x7f18140764b0 2024-05-14T15:26:51.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.139+0000 7f182ada0b80 1 Processor -- start 2024-05-14T15:26:51.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.140+0000 7f182ada0b80 1 -- start start 2024-05-14T15:26:51.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.140+0000 7f1819800700 1 --2- 172.21.15.69:0/991571529 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f17fc0b2a70 0x7f17fc0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:51.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.141+0000 7f182ada0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a413eee40 0x555a415722f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.141+0000 7f182ada0b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a41572830 0x555a4156c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.141+0000 7f182ada0b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a4156c9f0 0x555a4156ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.141+0000 7f182ada0b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x555a4148ea20 con 0x555a4156c9f0 2024-05-14T15:26:51.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.141+0000 7f182ada0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555a4142c760 con 0x555a413eee40 2024-05-14T15:26:51.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.141+0000 7f182ada0b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555a4148a9e0 con 0x555a41572830 2024-05-14T15:26:51.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.141+0000 7f1818e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a41572830 0x555a4156c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:51.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.142+0000 7f1819800700 1 --2- 172.21.15.69:0/991571529 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f17fc0b2a70 0x7f17fc0b4f80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1808009c10 tx=0x7f180800b040 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:51.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.142+0000 7f1819800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a413eee40 0x555a415722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:51.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.142+0000 7f1819800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a413eee40 0x555a415722f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:41110/0 (socket says 172.21.15.69:41110) 2024-05-14T15:26:51.249 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.142+0000 7f1819800700 1 -- 172.21.15.69:0/428696901 learned_addr learned my addr 172.21.15.69:0/428696901 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:51.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.142+0000 7f1819800700 1 -- 172.21.15.69:0/428696901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a41572830 msgr2=0x555a4156c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:51.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.142+0000 7f1819800700 1 --2- 172.21.15.69:0/428696901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a41572830 0x555a4156c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.142+0000 7f1819800700 1 -- 172.21.15.69:0/428696901 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a4156c9f0 msgr2=0x555a4156ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:51.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.142+0000 7f1819800700 1 --2- 172.21.15.69:0/428696901 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a4156c9f0 0x555a4156ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.142+0000 7f1819800700 1 -- 172.21.15.69:0/428696901 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a413db8d0 con 0x555a413eee40 2024-05-14T15:26:51.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.142+0000 7f1818e00700 1 --2- 172.21.15.69:0/428696901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a41572830 0x555a4156c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:26:51.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.143+0000 7f1819800700 1 --2- 172.21.15.69:0/428696901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a413eee40 0x555a415722f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1808003e20 tx=0x7f1808014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa88d426501f8119 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:51.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.143+0000 7f1806a00700 1 -- 172.21.15.69:0/428696901 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180801b070 con 0x555a413eee40 2024-05-14T15:26:51.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.144+0000 7f1806a00700 1 -- 172.21.15.69:0/428696901 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1808003e50 con 0x555a413eee40 2024-05-14T15:26:51.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.144+0000 7f1806a00700 1 -- 172.21.15.69:0/428696901 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808017440 con 0x555a413eee40 2024-05-14T15:26:51.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.145+0000 7f182ada0b80 1 -- 172.21.15.69:0/428696901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a413eee40 msgr2=0x555a415722f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:51.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.145+0000 7f182ada0b80 1 --2- 172.21.15.69:0/428696901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a413eee40 0x555a415722f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f1808003e20 tx=0x7f1808014000 comp rx=0 tx=0).stop 2024-05-14T15:26:51.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.146+0000 7f182ada0b80 1 -- 172.21.15.69:0/428696901 shutdown_connections 2024-05-14T15:26:51.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.146+0000 7f182ada0b80 1 --2- 172.21.15.69:0/428696901 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a4156c9f0 0x555a4156ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.250 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.146+0000 7f182ada0b80 1 --2- 172.21.15.69:0/428696901 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a413eee40 0x555a415722f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.146+0000 7f182ada0b80 1 --2- 172.21.15.69:0/428696901 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a41572830 0x555a4156c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.146+0000 7f182ada0b80 1 -- 172.21.15.69:0/428696901 >> 172.21.15.69:0/428696901 conn(0x555a41433f70 msgr2=0x555a415672d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:51.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.146+0000 7f182ada0b80 1 -- 172.21.15.69:0/428696901 shutdown_connections 2024-05-14T15:26:51.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.146+0000 7f182ada0b80 1 -- 172.21.15.69:0/428696901 wait complete. 2024-05-14T15:26:51.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.147+0000 7f182ada0b80 1 -- start start 2024-05-14T15:26:51.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.148+0000 7f182ada0b80 1 Processor -- start 2024-05-14T15:26:51.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.149+0000 7f182ada0b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a413eee40 0x555a41576040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.149+0000 7f182ada0b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a4156c9f0 0x555a41576580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.149+0000 7f182ada0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a41572830 0x555a41576ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.251 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.149+0000 7f182ada0b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x555a41579310 con 0x555a413eee40 2024-05-14T15:26:51.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.149+0000 7f182ada0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555a413f4b20 con 0x555a41572830 2024-05-14T15:26:51.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.149+0000 7f182ada0b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555a41579490 con 0x555a4156c9f0 2024-05-14T15:26:51.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.149+0000 7f182ada0b80 10 client.0 _ll_register_callbacks cb 0x555a41435c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:51.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.149+0000 7f1818e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a4156c9f0 0x555a41576580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:51.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.149+0000 7f1818e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a4156c9f0 0x555a41576580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:33668/0 (socket says 172.21.15.69:33668) 2024-05-14T15:26:51.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.149+0000 7f1818e00700 1 -- 172.21.15.69:0/1058508912 learned_addr learned my addr 172.21.15.69:0/1058508912 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:51.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.150+0000 7f1818e00700 1 -- 172.21.15.69:0/1058508912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a41572830 msgr2=0x555a41576ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:51.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.150+0000 7f181a200700 1 --2- 172.21.15.69:0/1058508912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a41572830 0x555a41576ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:51.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.150+0000 7f1818e00700 1 --2- 172.21.15.69:0/1058508912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a41572830 0x555a41576ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.253 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.150+0000 7f1819800700 1 --2- 172.21.15.69:0/1058508912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a413eee40 0x555a41576040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.150+0000 7f1818e00700 1 -- 172.21.15.69:0/1058508912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a413eee40 msgr2=0x555a41576040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.150+0000 7f1818e00700 1 --2- 172.21.15.69:0/1058508912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a413eee40 0x555a41576040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.150+0000 7f1818e00700 1 -- 172.21.15.69:0/1058508912 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a41454420 con 0x555a4156c9f0 2024-05-14T15:26:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.150+0000 7f181a200700 1 --2- 172.21.15.69:0/1058508912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a41572830 0x555a41576ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:26:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.151+0000 7f1819800700 1 --2- 172.21.15.69:0/1058508912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a413eee40 0x555a41576040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:26:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.152+0000 7f1818e00700 1 --2- 172.21.15.69:0/1058508912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a4156c9f0 0x555a41576580 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f18000e0a70 tx=0x7f1800021bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bb9a9f1fda222ce0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.152+0000 7f17fb400700 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:26:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.152+0000 7f17fb400700 1 -- 172.21.15.69:0/1058508912 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18000aad10 con 0x555a4156c9f0 2024-05-14T15:26:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.152+0000 7f17fb400700 1 -- 172.21.15.69:0/1058508912 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f18000e31b0 con 0x555a4156c9f0 2024-05-14T15:26:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.152+0000 7f182ada0b80 1 -- 172.21.15.69:0/1058508912 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1808003e50 con 0x555a4156c9f0 2024-05-14T15:26:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.153+0000 7f17fb400700 1 -- 172.21.15.69:0/1058508912 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f18000aa610 con 0x555a4156c9f0 2024-05-14T15:26:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.153+0000 7f182ada0b80 10 client.25918 fetch_fsmap learned FSMap version 46 2024-05-14T15:26:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.153+0000 7f182ada0b80 1 -- 172.21.15.69:0/1058508912 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x555a41579370 con 0x555a4156c9f0 2024-05-14T15:26:51.254 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.153+0000 7f17fb400700 1 -- 172.21.15.69:0/1058508912 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1808003e50 con 0x555a4156c9f0 2024-05-14T15:26:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.155+0000 7f17fb400700 1 -- 172.21.15.69:0/1058508912 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 46) ==== 8410+0+0 (secure 0 0 0) 0x7f1800090b30 con 0x555a4156c9f0 2024-05-14T15:26:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.155+0000 7f182ada0b80 10 client.25918 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T15:26:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.155+0000 7f182ada0b80 10 client.25918 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:26:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.155+0000 7f182ada0b80 20 client.25918 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.155+0000 7f182ada0b80 1 --2- 172.21.15.69:0/1058508912 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555a41586510 0x555a415889a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.156+0000 7f182ada0b80 4 client.25918 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:26:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.156+0000 7f182ada0b80 1 -- 172.21.15.69:0/1058508912 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555a415391c0 con 0x555a41586510 2024-05-14T15:26:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.156+0000 7f1819800700 1 --2- 172.21.15.69:0/1058508912 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555a41586510 0x555a415889a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.157+0000 7f17fb400700 10 client.25918 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.157+0000 7f1819800700 1 --2- 172.21.15.69:0/1058508912 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555a41586510 0x555a415889a0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a769649dd2f666f0 server_cookie=c4e261e3c18b10b4 in_seq=0 out_seq=0 2024-05-14T15:26:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.160+0000 7f17fb400700 1 -- 172.21.15.69:0/1058508912 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555a415391c0 con 0x555a41586510 2024-05-14T15:26:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.160+0000 7f17fb400700 10 client.25918 handle_command_reply: tid=0 2024-05-14T15:26:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.161+0000 7f182ada0b80 1 client.25918 shutdown 2024-05-14T15:26:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.162+0000 7f182ada0b80 1 -- 172.21.15.69:0/1058508912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a4156c9f0 msgr2=0x555a41576580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:51.255 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.162+0000 7f182ada0b80 1 --2- 172.21.15.69:0/1058508912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a4156c9f0 0x555a41576580 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f18000e0a70 tx=0x7f1800021bc0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.163+0000 7f182ada0b80 1 -- 172.21.15.69:0/1058508912 shutdown_connections 2024-05-14T15:26:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.163+0000 7f182ada0b80 1 --2- 172.21.15.69:0/1058508912 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555a41586510 0x555a415889a0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.163+0000 7f182ada0b80 1 --2- 172.21.15.69:0/1058508912 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a413eee40 0x555a41576040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.163+0000 7f182ada0b80 1 --2- 172.21.15.69:0/1058508912 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a41572830 0x555a41576ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.163+0000 7f182ada0b80 1 --2- 172.21.15.69:0/1058508912 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a4156c9f0 0x555a41576580 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.163+0000 7f17fb400700 0 client.25918 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.163+0000 7f182ada0b80 1 -- 172.21.15.69:0/1058508912 >> 172.21.15.69:0/1058508912 conn(0x555a41433f70 msgr2=0x555a4156b4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.163+0000 7f182ada0b80 1 -- 172.21.15.69:0/1058508912 shutdown_connections 2024-05-14T15:26:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.165+0000 7f182ada0b80 1 -- 172.21.15.69:0/1058508912 wait complete. 2024-05-14T15:26:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.165+0000 7f182ada0b80 20 client.25918 trim_cache size 0 max 16384 2024-05-14T15:26:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.208+0000 7f182ada0b80 1 Processor -- start 2024-05-14T15:26:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.208+0000 7f182ada0b80 1 -- start start 2024-05-14T15:26:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.209+0000 7f182ada0b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a413eee40 0x555a4156c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.256 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.209+0000 7f182ada0b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a4156c9f0 0x555a41561ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.209+0000 7f182ada0b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a41572830 0x555a41574ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.209+0000 7f182ada0b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f18141ae3c0 con 0x555a4156c9f0 2024-05-14T15:26:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.209+0000 7f182ada0b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f18141b0110 con 0x555a413eee40 2024-05-14T15:26:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.209+0000 7f182ada0b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f18141aeb50 con 0x555a41572830 2024-05-14T15:26:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.210+0000 7f1819800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a413eee40 0x555a4156c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.210+0000 7f181a200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a41572830 0x555a41574ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.210+0000 7f1819800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a413eee40 0x555a4156c4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:41120/0 (socket says 172.21.15.69:41120) 2024-05-14T15:26:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.210+0000 7f1819800700 1 -- 172.21.15.69:0/2547807961 learned_addr learned my addr 172.21.15.69:0/2547807961 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.210+0000 7f1818e00700 1 --2- 172.21.15.69:0/2547807961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a4156c9f0 0x555a41561ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.211+0000 7f1819800700 1 -- 172.21.15.69:0/2547807961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a41572830 msgr2=0x555a41574ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.211+0000 7f1819800700 1 --2- 172.21.15.69:0/2547807961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a41572830 0x555a41574ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.211+0000 7f1819800700 1 -- 172.21.15.69:0/2547807961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a4156c9f0 msgr2=0x555a41561ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.211+0000 7f1819800700 1 --2- 172.21.15.69:0/2547807961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a4156c9f0 0x555a41561ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.211+0000 7f1819800700 1 -- 172.21.15.69:0/2547807961 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555a415788e0 con 0x555a413eee40 2024-05-14T15:26:51.257 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.212+0000 7f1819800700 1 --2- 172.21.15.69:0/2547807961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a413eee40 0x555a4156c4b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f18080046b0 tx=0x7f1808004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4792a402ba7bccf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:51.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.213+0000 7f1806000700 1 -- 172.21.15.69:0/2547807961 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808037070 con 0x555a413eee40 2024-05-14T15:26:51.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.213+0000 7f1806000700 1 -- 172.21.15.69:0/2547807961 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1808022980 con 0x555a413eee40 2024-05-14T15:26:51.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.213+0000 7f1806000700 1 -- 172.21.15.69:0/2547807961 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f180801b040 con 0x555a413eee40 2024-05-14T15:26:51.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.214+0000 7f182ada0b80 1 -- 172.21.15.69:0/2547807961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a413eee40 msgr2=0x555a4156c4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:51.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.214+0000 7f182ada0b80 1 --2- 172.21.15.69:0/2547807961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a413eee40 0x555a4156c4b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f18080046b0 tx=0x7f1808004ab0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.215+0000 7f182ada0b80 1 -- 172.21.15.69:0/2547807961 shutdown_connections 2024-05-14T15:26:51.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.215+0000 7f182ada0b80 1 --2- 172.21.15.69:0/2547807961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a41572830 0x555a41574ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.215+0000 7f182ada0b80 1 --2- 172.21.15.69:0/2547807961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a413eee40 0x555a4156c4b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.215+0000 7f182ada0b80 1 --2- 172.21.15.69:0/2547807961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a4156c9f0 0x555a41561ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.215+0000 7f182ada0b80 1 -- 172.21.15.69:0/2547807961 >> 172.21.15.69:0/2547807961 conn(0x555a41433f70 msgr2=0x555a41576000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:51.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.215+0000 7f182ada0b80 1 -- 172.21.15.69:0/2547807961 shutdown_connections 2024-05-14T15:26:51.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.216+0000 7f182ada0b80 1 -- 172.21.15.69:0/2547807961 wait complete. 2024-05-14T15:26:51.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.217+0000 7f182ada0b80 1 -- start start 2024-05-14T15:26:51.258 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.217+0000 7f182ada0b80 1 Processor -- start 2024-05-14T15:26:51.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.219+0000 7f182ada0b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a413eee40 0x555a4157e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.219+0000 7f182ada0b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a4156c9f0 0x555a4157ec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.220+0000 7f1819800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a413eee40 0x555a4157e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:51.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.220+0000 7f1819800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a413eee40 0x555a4157e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:33682/0 (socket says 172.21.15.69:33682) 2024-05-14T15:26:51.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.220+0000 7f1819800700 1 -- 172.21.15.69:0/1468881264 learned_addr learned my addr 172.21.15.69:0/1468881264 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:51.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.220+0000 7f182ada0b80 1 --2- 172.21.15.69:0/1468881264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a41572830 0x555a4157b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.220+0000 7f182ada0b80 1 -- 172.21.15.69:0/1468881264 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f18141af9e0 con 0x555a4156c9f0 2024-05-14T15:26:51.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.220+0000 7f182ada0b80 1 -- 172.21.15.69:0/1468881264 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f18141af250 con 0x555a41572830 2024-05-14T15:26:51.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.220+0000 7f182ada0b80 1 -- 172.21.15.69:0/1468881264 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f181410f310 con 0x555a413eee40 2024-05-14T15:26:51.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.221+0000 7f181a200700 1 --2- 172.21.15.69:0/1468881264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a41572830 0x555a4157b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:51.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.221+0000 7f1819800700 1 -- 172.21.15.69:0/1468881264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a41572830 msgr2=0x555a4157b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:51.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.222+0000 7f1819800700 1 --2- 172.21.15.69:0/1468881264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a41572830 0x555a4157b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.222+0000 7f1819800700 1 -- 172.21.15.69:0/1468881264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a4156c9f0 msgr2=0x555a4157ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:51.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.222+0000 7f1819800700 1 --2- 172.21.15.69:0/1468881264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a4156c9f0 0x555a4157ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.259 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.222+0000 7f1819800700 1 -- 172.21.15.69:0/1468881264 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555a4157bca0 con 0x555a413eee40 2024-05-14T15:26:51.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.223+0000 7f182ada0b80 10 client.0 _ll_register_callbacks cb 0x555a4156d490 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:51.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.223+0000 7f182ada0b80 1 -- 172.21.15.69:0/1468881264 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1808022980 con 0x555a413eee40 2024-05-14T15:26:51.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.223+0000 7f1819800700 1 --2- 172.21.15.69:0/1468881264 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a413eee40 0x555a4157e6e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f18080095b0 tx=0x7f1808003ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c3188557f168e7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:51.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.223+0000 7f17fb400700 10 client.25924 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:26:51.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.224+0000 7f17fb400700 1 -- 172.21.15.69:0/1468881264 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1808037070 con 0x555a413eee40 2024-05-14T15:26:51.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.224+0000 7f17fb400700 1 -- 172.21.15.69:0/1468881264 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f1808022700 con 0x555a413eee40 2024-05-14T15:26:51.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.225+0000 7f17fb400700 1 -- 172.21.15.69:0/1468881264 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7f180801b040 con 0x555a413eee40 2024-05-14T15:26:51.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.226+0000 7f182ada0b80 10 client.25924 fetch_fsmap learned FSMap version 46 2024-05-14T15:26:51.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.226+0000 7f182ada0b80 1 -- 172.21.15.69:0/1468881264 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({fsmap=46}) -- 0x555a415f1360 con 0x555a413eee40 2024-05-14T15:26:51.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.227+0000 7f17fb400700 1 -- 172.21.15.69:0/1468881264 <== mon.1 v2:172.21.15.203:3300/0 4 ==== fsmap(e 46) ==== 8410+0+0 (secure 0 0 0) 0x7f1808031290 con 0x555a413eee40 2024-05-14T15:26:51.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.228+0000 7f182ada0b80 10 client.25924 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T15:26:51.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.228+0000 7f182ada0b80 10 client.25924 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:26:51.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.228+0000 7f182ada0b80 20 client.25924 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:51.260 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.228+0000 7f182ada0b80 1 --2- 172.21.15.69:0/1468881264 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555a415f1850 0x555a415f3cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.228+0000 7f182ada0b80 4 client.25924 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T15:26:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.228+0000 7f182ada0b80 1 -- 172.21.15.69:0/1468881264 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555a4149c400 con 0x555a415f1850 2024-05-14T15:26:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.229+0000 7f1818e00700 1 --2- 172.21.15.69:0/1468881264 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555a415f1850 0x555a415f3cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.230+0000 7f1818e00700 1 --2- 172.21.15.69:0/1468881264 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555a415f1850 0x555a415f3cb0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=397a4143acbd67ea server_cookie=bfa503045640fe92 in_seq=0 out_seq=0 2024-05-14T15:26:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.230+0000 7f17fb400700 10 client.25924 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.231+0000 7f17fb400700 1 -- 172.21.15.69:0/1468881264 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x555a4149c400 con 0x555a415f1850 2024-05-14T15:26:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.231+0000 7f17fb400700 10 client.25924 handle_command_reply: tid=0 2024-05-14T15:26:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.231+0000 7f182ada0b80 1 client.25924 shutdown 2024-05-14T15:26:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.231+0000 7f182ada0b80 1 -- 172.21.15.69:0/1468881264 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a413eee40 msgr2=0x555a4157e6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.231+0000 7f182ada0b80 1 --2- 172.21.15.69:0/1468881264 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a413eee40 0x555a4157e6e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f18080095b0 tx=0x7f1808003ee0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.232+0000 7f182ada0b80 1 -- 172.21.15.69:0/1468881264 shutdown_connections 2024-05-14T15:26:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.232+0000 7f182ada0b80 1 --2- 172.21.15.69:0/1468881264 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555a415f1850 0x555a415f3cb0 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.232+0000 7f182ada0b80 1 --2- 172.21.15.69:0/1468881264 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555a41572830 0x555a4157b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.232+0000 7f182ada0b80 1 --2- 172.21.15.69:0/1468881264 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555a413eee40 0x555a4157e6e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.261 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.232+0000 7f182ada0b80 1 --2- 172.21.15.69:0/1468881264 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555a4156c9f0 0x555a4157ec20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.232+0000 7f182ada0b80 1 -- 172.21.15.69:0/1468881264 >> 172.21.15.69:0/1468881264 conn(0x555a41433f70 msgr2=0x555a41561830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.232+0000 7f17fb400700 0 client.25924 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:51.262 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.232+0000 7f182ada0b80 1 -- 172.21.15.69:0/1468881264 shutdown_connections 2024-05-14T15:26:51.262 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:26:51.262 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-14T15:26:51.262 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2024-05-14T15:26:51.262 INFO:teuthology.orchestra.run.smithi069.stdout: "64003853-50c5-4266-8bef-aea8918a14ba": { 2024-05-14T15:26:51.262 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2024-05-14T15:26:51.262 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "64003853-50c5-4266-8bef-aea8918a14ba", 2024-05-14T15:26:51.262 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2024-05-14T15:26:51.263 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:26:51.263 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:26:51.263 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:26:51.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.232+0000 7f182ada0b80 1 -- 172.21.15.69:0/1468881264 wait complete. 2024-05-14T15:26:51.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.232+0000 7f182ada0b80 20 client.25924 trim_cache size 0 max 16384 2024-05-14T15:26:51.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.233+0000 7f181c200700 1 -- 172.21.15.69:0/991571529 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f17fc0b2a70 msgr2=0x7f17fc0b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:51.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.234+0000 7f181c200700 1 --2- 172.21.15.69:0/991571529 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f17fc0b2a70 0x7f17fc0b4f80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1808009c10 tx=0x7f180800b040 comp rx=0 tx=0).stop 2024-05-14T15:26:51.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.234+0000 7f181c200700 1 -- 172.21.15.69:0/991571529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18140764b0 msgr2=0x7f18141a1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:51.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.234+0000 7f181c200700 1 --2- 172.21.15.69:0/991571529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18140764b0 0x7f18141a1920 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f18000098e0 tx=0x7f18000047b0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.263 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.234+0000 7f181c200700 1 -- 172.21.15.69:0/991571529 shutdown_connections 2024-05-14T15:26:51.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.234+0000 7f181c200700 1 --2- 172.21.15.69:0/991571529 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f17fc0b2a70 0x7f17fc0b4f80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.234+0000 7f181c200700 1 --2- 172.21.15.69:0/991571529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f1814075b60 0x7f18141a1380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.234+0000 7f181c200700 1 --2- 172.21.15.69:0/991571529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f1814115370 0x7f18141a5bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.234+0000 7f181c200700 1 --2- 172.21.15.69:0/991571529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f18140764b0 0x7f18141a1920 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:51.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.234+0000 7f181c200700 1 -- 172.21.15.69:0/991571529 >> 172.21.15.69:0/991571529 conn(0x7f1814100040 msgr2=0x7f1814100840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:51.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.235+0000 7f181c200700 1 -- 172.21.15.69:0/991571529 shutdown_connections 2024-05-14T15:26:51.264 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:26:51.235+0000 7f181c200700 1 -- 172.21.15.69:0/991571529 wait complete. 2024-05-14T15:26:51.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 65.0 s, 605.2 tps, lat 165.060 ms stddev 43.546 2024-05-14T15:26:51.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:51 smithi092 ceph-mon[34729]: pgmap v159: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 9.2 MiB/s wr, 1.01k op/s 2024-05-14T15:26:51.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:51 smithi069 ceph-mon[31270]: pgmap v159: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 9.2 MiB/s wr, 1.01k op/s 2024-05-14T15:26:51.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:51 smithi203 ceph-mon[34567]: pgmap v159: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 9.2 MiB/s wr, 1.01k op/s 2024-05-14T15:26:52.235 INFO:tasks.cephfs.filesystem:scrub status for tag:64003853-50c5-4266-8bef-aea8918a14ba - {'path': '/', 'tag': '64003853-50c5-4266-8bef-aea8918a14ba', 'options': 'recursive,force'} 2024-05-14T15:26:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.309+0000 7fae4e000640 1 -- 172.21.15.69:0/2052662766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae4806ad90 msgr2=0x7fae4810f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:53.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.309+0000 7fae4e000640 1 --2- 172.21.15.69:0/2052662766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae4806ad90 0x7fae4810f720 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fae34009900 tx=0x7fae3402a400 comp rx=0 tx=0).stop 2024-05-14T15:26:53.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.310+0000 7fae4e000640 1 -- 172.21.15.69:0/2052662766 shutdown_connections 2024-05-14T15:26:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.310+0000 7fae4e000640 1 --2- 172.21.15.69:0/2052662766 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae4810ee90 0x7fae481181c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.310+0000 7fae4e000640 1 --2- 172.21.15.69:0/2052662766 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae4806ad90 0x7fae4810f720 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.310+0000 7fae4e000640 1 --2- 172.21.15.69:0/2052662766 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae4810a900 0x7fae4810ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.310+0000 7fae4e000640 1 -- 172.21.15.69:0/2052662766 >> 172.21.15.69:0/2052662766 conn(0x7fae4806edb0 msgr2=0x7fae4806f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.311+0000 7fae4e000640 1 -- 172.21.15.69:0/2052662766 shutdown_connections 2024-05-14T15:26:53.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.311+0000 7fae4e000640 1 -- 172.21.15.69:0/2052662766 wait complete. 2024-05-14T15:26:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.312+0000 7fae4e000640 1 Processor -- start 2024-05-14T15:26:53.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.312+0000 7fae4e000640 1 -- start start 2024-05-14T15:26:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.313+0000 7fae4e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae4806ad90 0x7fae481a5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.313+0000 7fae4e000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae4810a900 0x7fae481a5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.313+0000 7fae4e000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae4810ee90 0x7fae481a9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.313+0000 7fae4e000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fae4811a320 con 0x7fae4806ad90 2024-05-14T15:26:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.313+0000 7fae4e000640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fae4811a1a0 con 0x7fae4810ee90 2024-05-14T15:26:53.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.313+0000 7fae4e000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fae4811a4a0 con 0x7fae4810a900 2024-05-14T15:26:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.314+0000 7fae46a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae4810a900 0x7fae481a5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.314+0000 7fae47e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae4810ee90 0x7fae481a9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.314+0000 7fae47e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae4810ee90 0x7fae481a9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:33044/0 (socket says 172.21.15.69:33044) 2024-05-14T15:26:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.314+0000 7fae47e00640 1 -- 172.21.15.69:0/2994369884 learned_addr learned my addr 172.21.15.69:0/2994369884 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.314+0000 7fae47400640 1 --2- 172.21.15.69:0/2994369884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae4806ad90 0x7fae481a5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:53.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.314+0000 7fae46a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae4810a900 0x7fae481a5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:60626/0 (socket says 172.21.15.69:60626) 2024-05-14T15:26:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.314+0000 7fae47e00640 1 -- 172.21.15.69:0/2994369884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae4810a900 msgr2=0x7fae481a5760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.314+0000 7fae47e00640 1 --2- 172.21.15.69:0/2994369884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae4810a900 0x7fae481a5760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.314+0000 7fae47e00640 1 -- 172.21.15.69:0/2994369884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae4806ad90 msgr2=0x7fae481a5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.314+0000 7fae47e00640 1 --2- 172.21.15.69:0/2994369884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae4806ad90 0x7fae481a5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.314+0000 7fae47e00640 1 -- 172.21.15.69:0/2994369884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae481aa060 con 0x7fae4810ee90 2024-05-14T15:26:53.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.315+0000 7fae47e00640 1 --2- 172.21.15.69:0/2994369884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae4810ee90 0x7fae481a9a20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fae4000eb10 tx=0x7fae4000c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.316+0000 7fae3fe00640 1 -- 172.21.15.69:0/2994369884 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae40004b20 con 0x7fae4810ee90 2024-05-14T15:26:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.316+0000 7fae3fe00640 1 -- 172.21.15.69:0/2994369884 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae40004cc0 con 0x7fae4810ee90 2024-05-14T15:26:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.316+0000 7fae4e000640 1 -- 172.21.15.69:0/2994369884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae481aa350 con 0x7fae4810ee90 2024-05-14T15:26:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.316+0000 7fae3fe00640 1 -- 172.21.15.69:0/2994369884 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae40010690 con 0x7fae4810ee90 2024-05-14T15:26:53.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.316+0000 7fae4e000640 1 -- 172.21.15.69:0/2994369884 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae481aa820 con 0x7fae4810ee90 2024-05-14T15:26:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.324+0000 7fae3fe00640 1 -- 172.21.15.69:0/2994369884 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fae40005020 con 0x7fae4810ee90 2024-05-14T15:26:53.326 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.324+0000 7fae55174740 1 Processor -- start 2024-05-14T15:26:53.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.325+0000 7fae55174740 1 -- start start 2024-05-14T15:26:53.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.326+0000 7fae55174740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25801b0 0x560ad2921170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.326+0000 7fae55174740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad25572f0 0x560ad29216b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.326+0000 7fae55174740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad255f4d0 0x560ad2921bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.326+0000 7fae55174740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560ad2886550 con 0x560ad25801b0 2024-05-14T15:26:53.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.326+0000 7fae55174740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560ad282bbc0 con 0x560ad255f4d0 2024-05-14T15:26:53.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.326+0000 7fae55174740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560ad2882510 con 0x560ad25572f0 2024-05-14T15:26:53.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.326+0000 7fae47400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad25572f0 0x560ad29216b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:53.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.326+0000 7fae47400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad25572f0 0x560ad29216b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:60628/0 (socket says 172.21.15.69:60628) 2024-05-14T15:26:53.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.326+0000 7fae47400640 1 -- 172.21.15.69:0/2287702017 learned_addr learned my addr 172.21.15.69:0/2287702017 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:53.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.326+0000 7fae46a00640 1 --2- 172.21.15.69:0/2287702017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad255f4d0 0x560ad2921bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:53.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.327+0000 7fae46a00640 1 --2- 172.21.15.69:0/2287702017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25801b0 0x560ad2921170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:53.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.327+0000 7fae3fe00640 1 --2- 172.21.15.69:0/2994369884 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fae2c0b29d0 0x7fae2c0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.327+0000 7fae3fe00640 1 -- 172.21.15.69:0/2994369884 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fae400e2ff0 con 0x7fae4810ee90 2024-05-14T15:26:53.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.327+0000 7fae47e00640 1 --2- 172.21.15.69:0/2994369884 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fae2c0b29d0 0x7fae2c0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:53.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.328+0000 7fae47400640 1 -- 172.21.15.69:0/2287702017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad255f4d0 msgr2=0x560ad2921bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:53.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.328+0000 7fae47400640 1 --2- 172.21.15.69:0/2287702017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad255f4d0 0x560ad2921bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.328+0000 7fae47400640 1 -- 172.21.15.69:0/2287702017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25801b0 msgr2=0x560ad2921170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:53.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.328+0000 7fae47400640 1 --2- 172.21.15.69:0/2287702017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25801b0 0x560ad2921170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.328+0000 7fae47400640 1 -- 172.21.15.69:0/2287702017 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ad2598210 con 0x560ad25572f0 2024-05-14T15:26:53.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.328+0000 7fae46a00640 1 --2- 172.21.15.69:0/2287702017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25801b0 0x560ad2921170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:26:53.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.328+0000 7fae47e00640 1 --2- 172.21.15.69:0/2994369884 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fae2c0b29d0 0x7fae2c0b4ee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fae400a9e50 tx=0x7fae4000cf70 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:53.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.329+0000 7fae47400640 1 --2- 172.21.15.69:0/2287702017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad25572f0 0x560ad29216b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fae3800bd10 tx=0x7fae380107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2fc215489efef4be server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:53.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.329+0000 7fae33e00640 1 -- 172.21.15.69:0/2287702017 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38004030 con 0x560ad25572f0 2024-05-14T15:26:53.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.330+0000 7fae33e00640 1 -- 172.21.15.69:0/2287702017 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae380035f0 con 0x560ad25572f0 2024-05-14T15:26:53.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.330+0000 7fae33e00640 1 -- 172.21.15.69:0/2287702017 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38011660 con 0x560ad25572f0 2024-05-14T15:26:53.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.331+0000 7fae55174740 1 -- 172.21.15.69:0/2287702017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad25572f0 msgr2=0x560ad29216b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:53.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.331+0000 7fae55174740 1 --2- 172.21.15.69:0/2287702017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad25572f0 0x560ad29216b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fae3800bd10 tx=0x7fae380107a0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.332+0000 7fae55174740 1 -- 172.21.15.69:0/2287702017 shutdown_connections 2024-05-14T15:26:53.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.332+0000 7fae55174740 1 --2- 172.21.15.69:0/2287702017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad255f4d0 0x560ad2921bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.332+0000 7fae55174740 1 --2- 172.21.15.69:0/2287702017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad25572f0 0x560ad29216b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.332+0000 7fae55174740 1 --2- 172.21.15.69:0/2287702017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25801b0 0x560ad2921170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.332+0000 7fae55174740 1 -- 172.21.15.69:0/2287702017 >> 172.21.15.69:0/2287702017 conn(0x560ad2574300 msgr2=0x560ad291da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:53.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.333+0000 7fae55174740 1 -- 172.21.15.69:0/2287702017 shutdown_connections 2024-05-14T15:26:53.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.333+0000 7fae55174740 1 -- 172.21.15.69:0/2287702017 wait complete. 2024-05-14T15:26:53.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.334+0000 7fae55174740 1 -- start start 2024-05-14T15:26:53.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.334+0000 7fae55174740 1 Processor -- start 2024-05-14T15:26:53.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.335+0000 7fae55174740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25572f0 0x560ad2933f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.335+0000 7fae55174740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad255f4d0 0x560ad2934480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.335+0000 7fae55174740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad25801b0 0x560ad2940070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.335+0000 7fae55174740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560ad2936bc0 con 0x560ad25572f0 2024-05-14T15:26:53.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.335+0000 7fae55174740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560ad283f660 con 0x560ad25801b0 2024-05-14T15:26:53.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.335+0000 7fae55174740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560ad2936d40 con 0x560ad255f4d0 2024-05-14T15:26:53.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.336+0000 7fae55174740 10 client.0 _ll_register_callbacks cb 0x560ad2809400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:53.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.336+0000 7fae47400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad255f4d0 0x560ad2934480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:53.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.336+0000 7fae47400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad255f4d0 0x560ad2934480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:60630/0 (socket says 172.21.15.69:60630) 2024-05-14T15:26:53.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.336+0000 7fae47400640 1 -- 172.21.15.69:0/2305449330 learned_addr learned my addr 172.21.15.69:0/2305449330 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:53.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.337+0000 7fae46a00640 1 --2- 172.21.15.69:0/2305449330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25572f0 0x560ad2933f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:53.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.338+0000 7fae47400640 1 -- 172.21.15.69:0/2305449330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad25801b0 msgr2=0x560ad2940070 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:26:53.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.338+0000 7fae47400640 1 --2- 172.21.15.69:0/2305449330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad25801b0 0x560ad2940070 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.338+0000 7fae47400640 1 -- 172.21.15.69:0/2305449330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25572f0 msgr2=0x560ad2933f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:53.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.338+0000 7fae47400640 1 --2- 172.21.15.69:0/2305449330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25572f0 0x560ad2933f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.338+0000 7fae47400640 1 -- 172.21.15.69:0/2305449330 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ad2664620 con 0x560ad255f4d0 2024-05-14T15:26:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.338+0000 7fae46a00640 1 --2- 172.21.15.69:0/2305449330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25572f0 0x560ad2933f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:26:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.340+0000 7fae30c00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:26:53.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.340+0000 7fae47400640 1 --2- 172.21.15.69:0/2305449330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad255f4d0 0x560ad2934480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fae38003d90 tx=0x7fae38003dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9ef3bc70ac1de9e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:53.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.340+0000 7fae30c00640 1 -- 172.21.15.69:0/2305449330 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38029060 con 0x560ad255f4d0 2024-05-14T15:26:53.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.340+0000 7fae55174740 1 -- 172.21.15.69:0/2305449330 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae380035f0 con 0x560ad255f4d0 2024-05-14T15:26:53.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.341+0000 7fae30c00640 1 -- 172.21.15.69:0/2305449330 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fae38004200 con 0x560ad255f4d0 2024-05-14T15:26:53.343 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.341+0000 7fae30c00640 1 -- 172.21.15.69:0/2305449330 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fae38030050 con 0x560ad255f4d0 2024-05-14T15:26:53.343 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.341+0000 7fae55174740 10 client.25936 fetch_fsmap learned FSMap version 46 2024-05-14T15:26:53.343 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.341+0000 7fae55174740 1 -- 172.21.15.69:0/2305449330 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x560ad2924200 con 0x560ad255f4d0 2024-05-14T15:26:53.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.342+0000 7fae30c00640 1 -- 172.21.15.69:0/2305449330 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae380035f0 con 0x560ad255f4d0 2024-05-14T15:26:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.344+0000 7fae30c00640 1 -- 172.21.15.69:0/2305449330 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 46) ==== 8410+0+0 (secure 0 0 0) 0x7fae38023030 con 0x560ad255f4d0 2024-05-14T15:26:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.344+0000 7fae55174740 10 client.25936 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T15:26:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.344+0000 7fae55174740 10 client.25936 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:26:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.344+0000 7fae55174740 20 client.25936 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.344+0000 7fae55174740 1 --2- 172.21.15.69:0/2305449330 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560ad253ed80 0x560ad2927620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.344+0000 7fae55174740 4 client.25936 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:26:53.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.344+0000 7fae55174740 1 -- 172.21.15.69:0/2305449330 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560ad2894160 con 0x560ad253ed80 2024-05-14T15:26:53.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.346+0000 7fae46a00640 1 --2- 172.21.15.69:0/2305449330 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560ad253ed80 0x560ad2927620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:53.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.348+0000 7fae30c00640 10 client.25936 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:53.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.348+0000 7fae46a00640 1 --2- 172.21.15.69:0/2305449330 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560ad253ed80 0x560ad2927620 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d6d2efd109b4b242 server_cookie=43b13757c08d11d3 in_seq=0 out_seq=0 2024-05-14T15:26:53.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.350+0000 7fae30c00640 1 -- 172.21.15.69:0/2305449330 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560ad2894160 con 0x560ad253ed80 2024-05-14T15:26:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.351+0000 7fae30c00640 10 client.25936 handle_command_reply: tid=0 2024-05-14T15:26:53.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.351+0000 7fae55174740 1 client.25936 shutdown 2024-05-14T15:26:53.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.353+0000 7fae55174740 1 -- 172.21.15.69:0/2305449330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad255f4d0 msgr2=0x560ad2934480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:53.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.353+0000 7fae55174740 1 --2- 172.21.15.69:0/2305449330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad255f4d0 0x560ad2934480 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fae38003d90 tx=0x7fae38003dc0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.353+0000 7fae55174740 1 -- 172.21.15.69:0/2305449330 shutdown_connections 2024-05-14T15:26:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.353+0000 7fae55174740 1 --2- 172.21.15.69:0/2305449330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad25801b0 0x560ad2940070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.353+0000 7fae55174740 1 --2- 172.21.15.69:0/2305449330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad255f4d0 0x560ad2934480 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.353+0000 7fae55174740 1 --2- 172.21.15.69:0/2305449330 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560ad253ed80 0x560ad2927620 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.353+0000 7fae55174740 1 --2- 172.21.15.69:0/2305449330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25572f0 0x560ad2933f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.354+0000 7fae55174740 1 -- 172.21.15.69:0/2305449330 >> 172.21.15.69:0/2305449330 conn(0x560ad2574300 msgr2=0x560ad2922f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:53.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.354+0000 7fae30c00640 0 client.25936 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.354+0000 7fae55174740 1 -- 172.21.15.69:0/2305449330 shutdown_connections 2024-05-14T15:26:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.354+0000 7fae55174740 1 -- 172.21.15.69:0/2305449330 wait complete. 2024-05-14T15:26:53.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.354+0000 7fae55174740 20 client.25936 trim_cache size 0 max 16384 2024-05-14T15:26:53.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.398+0000 7fae55174740 1 Processor -- start 2024-05-14T15:26:53.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.398+0000 7fae55174740 1 -- start start 2024-05-14T15:26:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.399+0000 7fae55174740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad25572f0 0x560ad291c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.399+0000 7fae55174740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25801b0 0x560ad293ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.399+0000 7fae55174740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad25141c0 0x560ad2958c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.399+0000 7fae55174740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fae481b7930 con 0x560ad25801b0 2024-05-14T15:26:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.399+0000 7fae55174740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fae481b9680 con 0x560ad25572f0 2024-05-14T15:26:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.399+0000 7fae55174740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fae481b80c0 con 0x560ad25141c0 2024-05-14T15:26:53.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.399+0000 7fae47400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25801b0 0x560ad293ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:53.402 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.399+0000 7fae47400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25801b0 0x560ad293ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57640/0 (socket says 172.21.15.69:57640) 2024-05-14T15:26:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.399+0000 7fae47400640 1 -- 172.21.15.69:0/1667633145 learned_addr learned my addr 172.21.15.69:0/1667633145 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.400+0000 7fae47400640 1 -- 172.21.15.69:0/1667633145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad25141c0 msgr2=0x560ad2958c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.400+0000 7fae47400640 1 --2- 172.21.15.69:0/1667633145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad25141c0 0x560ad2958c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.400+0000 7fae46a00640 1 --2- 172.21.15.69:0/1667633145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad25572f0 0x560ad291c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.400+0000 7fae47400640 1 -- 172.21.15.69:0/1667633145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad25572f0 msgr2=0x560ad291c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.400+0000 7fae47400640 1 --2- 172.21.15.69:0/1667633145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad25572f0 0x560ad291c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.400+0000 7fae47400640 1 -- 172.21.15.69:0/1667633145 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ad291eb40 con 0x560ad25801b0 2024-05-14T15:26:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.400+0000 7fae46a00640 1 --2- 172.21.15.69:0/1667633145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad25572f0 0x560ad291c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:26:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.401+0000 7fae47400640 1 --2- 172.21.15.69:0/1667633145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25801b0 0x560ad293ffe0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fae3800bc30 tx=0x7fae380107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d6b8e55cb0a1e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:53.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.401+0000 7fae33400640 1 -- 172.21.15.69:0/1667633145 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38039070 con 0x560ad25801b0 2024-05-14T15:26:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.402+0000 7fae33400640 1 -- 172.21.15.69:0/1667633145 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae38004d70 con 0x560ad25801b0 2024-05-14T15:26:53.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.402+0000 7fae33400640 1 -- 172.21.15.69:0/1667633145 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae38039070 con 0x560ad25801b0 2024-05-14T15:26:53.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.404+0000 7fae55174740 1 -- 172.21.15.69:0/1667633145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25801b0 msgr2=0x560ad293ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:53.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.404+0000 7fae55174740 1 --2- 172.21.15.69:0/1667633145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25801b0 0x560ad293ffe0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fae3800bc30 tx=0x7fae380107a0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.405+0000 7fae55174740 1 -- 172.21.15.69:0/1667633145 shutdown_connections 2024-05-14T15:26:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.405+0000 7fae55174740 1 --2- 172.21.15.69:0/1667633145 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad25141c0 0x560ad2958c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.405+0000 7fae55174740 1 --2- 172.21.15.69:0/1667633145 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25801b0 0x560ad293ffe0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.405+0000 7fae55174740 1 --2- 172.21.15.69:0/1667633145 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad25572f0 0x560ad291c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.405+0000 7fae55174740 1 -- 172.21.15.69:0/1667633145 >> 172.21.15.69:0/1667633145 conn(0x560ad2574300 msgr2=0x560ad291c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.405+0000 7fae55174740 1 -- 172.21.15.69:0/1667633145 shutdown_connections 2024-05-14T15:26:53.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.405+0000 7fae55174740 1 -- 172.21.15.69:0/1667633145 wait complete. 2024-05-14T15:26:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.406+0000 7fae55174740 1 -- start start 2024-05-14T15:26:53.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.406+0000 7fae55174740 1 Processor -- start 2024-05-14T15:26:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.407+0000 7fae55174740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25141c0 0x560ad292e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.409 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.408+0000 7fae55174740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad25572f0 0x560ad2928520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.408+0000 7fae55174740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad25801b0 0x560ad2928a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.408+0000 7fae55174740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fae481b8f50 con 0x560ad25141c0 2024-05-14T15:26:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.408+0000 7fae55174740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fae481b87c0 con 0x560ad25572f0 2024-05-14T15:26:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.408+0000 7fae55174740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fae481b5950 con 0x560ad25801b0 2024-05-14T15:26:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.408+0000 7fae55174740 10 client.0 _ll_register_callbacks cb 0x7fae3800bb60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:26:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.408+0000 7fae47400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad25572f0 0x560ad2928520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:53.410 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.409+0000 7fae47400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad25572f0 0x560ad2928520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:33084/0 (socket says 172.21.15.69:33084) 2024-05-14T15:26:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.409+0000 7fae47400640 1 -- 172.21.15.69:0/3310570058 learned_addr learned my addr 172.21.15.69:0/3310570058 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:26:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.409+0000 7fae46a00640 1 --2- 172.21.15.69:0/3310570058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25141c0 0x560ad292e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.409+0000 7fae46a00640 1 -- 172.21.15.69:0/3310570058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad25801b0 msgr2=0x560ad2928a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.409+0000 7fae46a00640 1 --2- 172.21.15.69:0/3310570058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad25801b0 0x560ad2928a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.409+0000 7fae46a00640 1 -- 172.21.15.69:0/3310570058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad25572f0 msgr2=0x560ad2928520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:26:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.409+0000 7fae46a00640 1 --2- 172.21.15.69:0/3310570058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad25572f0 0x560ad2928520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.409+0000 7fae46a00640 1 -- 172.21.15.69:0/3310570058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ad2928fa0 con 0x560ad25141c0 2024-05-14T15:26:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.409+0000 7fae46a00640 1 --2- 172.21.15.69:0/3310570058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25141c0 0x560ad292e1e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fae3402a9f0 tx=0x7fae34004440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b1540b5d4438cb2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:26:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.409+0000 7fae30c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:26:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.410+0000 7fae30c00640 1 -- 172.21.15.69:0/3310570058 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae34047030 con 0x560ad25141c0 2024-05-14T15:26:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.410+0000 7fae30c00640 1 -- 172.21.15.69:0/3310570058 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fae34043050 con 0x560ad25141c0 2024-05-14T15:26:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.410+0000 7fae55174740 1 -- 172.21.15.69:0/3310570058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae38004d70 con 0x560ad25141c0 2024-05-14T15:26:53.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.410+0000 7fae30c00640 1 -- 172.21.15.69:0/3310570058 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=46) ==== 24+0+0 (secure 0 0 0) 0x7fae34035040 con 0x560ad25141c0 2024-05-14T15:26:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.411+0000 7fae55174740 10 client.16455 fetch_fsmap learned FSMap version 46 2024-05-14T15:26:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.411+0000 7fae55174740 1 -- 172.21.15.69:0/3310570058 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=46,monmap=4+}) -- 0x560ad29b6420 con 0x560ad25141c0 2024-05-14T15:26:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.411+0000 7fae30c00640 1 -- 172.21.15.69:0/3310570058 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fae38004d70 con 0x560ad25141c0 2024-05-14T15:26:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.411+0000 7fae30c00640 1 -- 172.21.15.69:0/3310570058 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 46) ==== 8410+0+0 (secure 0 0 0) 0x7fae34043ce0 con 0x560ad25141c0 2024-05-14T15:26:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.411+0000 7fae55174740 10 client.16455 fetch_fsmap finished waiting for FSMap version 46 2024-05-14T15:26:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.411+0000 7fae55174740 10 client.16455 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:26:53.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.411+0000 7fae55174740 20 client.16455 populate_metadata read hostname 'smithi069' 2024-05-14T15:26:53.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.411+0000 7fae55174740 1 --2- 172.21.15.69:0/3310570058 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560ad29b6c80 0x560ad29b90a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:26:53.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.411+0000 7fae55174740 4 client.16455 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:26:53.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.411+0000 7fae55174740 1 -- 172.21.15.69:0/3310570058 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560ad288dfd0 con 0x560ad29b6c80 2024-05-14T15:26:53.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.412+0000 7fae47400640 1 --2- 172.21.15.69:0/3310570058 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560ad29b6c80 0x560ad29b90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:26:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.413+0000 7fae47400640 1 --2- 172.21.15.69:0/3310570058 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560ad29b6c80 0x560ad29b90a0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=680331bf3362d125 server_cookie=6889926c9db40fb in_seq=0 out_seq=0 2024-05-14T15:26:53.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.413+0000 7fae30c00640 10 client.16455 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.437+0000 7fae30c00640 1 -- 172.21.15.69:0/3310570058 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560ad288dfd0 con 0x560ad29b6c80 2024-05-14T15:26:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.437+0000 7fae30c00640 10 client.16455 handle_command_reply: tid=0 2024-05-14T15:26:53.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.438+0000 7fae55174740 1 client.16455 shutdown 2024-05-14T15:26:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.439+0000 7fae55174740 1 -- 172.21.15.69:0/3310570058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25141c0 msgr2=0x560ad292e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.439+0000 7fae55174740 1 --2- 172.21.15.69:0/3310570058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25141c0 0x560ad292e1e0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7fae3402a9f0 tx=0x7fae34004440 comp rx=0 tx=0).stop 2024-05-14T15:26:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.440+0000 7fae55174740 1 -- 172.21.15.69:0/3310570058 shutdown_connections 2024-05-14T15:26:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.440+0000 7fae55174740 1 --2- 172.21.15.69:0/3310570058 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560ad25801b0 0x560ad2928a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.440+0000 7fae55174740 1 --2- 172.21.15.69:0/3310570058 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560ad25572f0 0x560ad2928520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.440+0000 7fae55174740 1 --2- 172.21.15.69:0/3310570058 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560ad29b6c80 0x560ad29b90a0 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.440+0000 7fae55174740 1 --2- 172.21.15.69:0/3310570058 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560ad25141c0 0x560ad292e1e0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.440+0000 7fae55174740 1 -- 172.21.15.69:0/3310570058 >> 172.21.15.69:0/3310570058 conn(0x560ad2574300 msgr2=0x560ad291c000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:53.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.440+0000 7fae30c00640 0 client.16455 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:26:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.440+0000 7fae55174740 1 -- 172.21.15.69:0/3310570058 shutdown_connections 2024-05-14T15:26:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.441+0000 7fae55174740 1 -- 172.21.15.69:0/3310570058 wait complete. 2024-05-14T15:26:53.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.441+0000 7fae55174740 20 client.16455 trim_cache size 0 max 16384 2024-05-14T15:26:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:26:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:26:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:26:53.444 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:26:53.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.443+0000 7fae4e000640 1 -- 172.21.15.69:0/2994369884 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fae2c0b29d0 msgr2=0x7fae2c0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.443+0000 7fae4e000640 1 --2- 172.21.15.69:0/2994369884 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fae2c0b29d0 0x7fae2c0b4ee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fae400a9e50 tx=0x7fae4000cf70 comp rx=0 tx=0).stop 2024-05-14T15:26:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.443+0000 7fae4e000640 1 -- 172.21.15.69:0/2994369884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae4810ee90 msgr2=0x7fae481a9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:26:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.443+0000 7fae4e000640 1 --2- 172.21.15.69:0/2994369884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae4810ee90 0x7fae481a9a20 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fae4000eb10 tx=0x7fae4000c2d0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.444+0000 7fae4e000640 1 -- 172.21.15.69:0/2994369884 shutdown_connections 2024-05-14T15:26:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.444+0000 7fae4e000640 1 --2- 172.21.15.69:0/2994369884 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fae2c0b29d0 0x7fae2c0b4ee0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.444+0000 7fae4e000640 1 --2- 172.21.15.69:0/2994369884 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fae4810ee90 0x7fae481a9a20 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.444+0000 7fae4e000640 1 --2- 172.21.15.69:0/2994369884 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fae4810a900 0x7fae481a5760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.444+0000 7fae4e000640 1 --2- 172.21.15.69:0/2994369884 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fae4806ad90 0x7fae481a5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:26:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.444+0000 7fae4e000640 1 -- 172.21.15.69:0/2994369884 >> 172.21.15.69:0/2994369884 conn(0x7fae4806edb0 msgr2=0x7fae4810dde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:26:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.445+0000 7fae4e000640 1 -- 172.21.15.69:0/2994369884 shutdown_connections 2024-05-14T15:26:53.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:26:53.445+0000 7fae4e000640 1 -- 172.21.15.69:0/2994369884 wait complete. 2024-05-14T15:26:53.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:53 smithi069 ceph-mon[31270]: pgmap v160: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 5.5 MiB/s wr, 730 op/s 2024-05-14T15:26:53.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:53 smithi203 ceph-mon[34567]: pgmap v160: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 5.5 MiB/s wr, 730 op/s 2024-05-14T15:26:53.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:53 smithi092 ceph-mon[34729]: pgmap v160: 129 pgs: 129 active+clean; 1.6 GiB data, 4.4 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 5.5 MiB/s wr, 730 op/s 2024-05-14T15:26:55.477 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:55 smithi069 ceph-mon[31270]: pgmap v161: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 7.9 MiB/s wr, 1.02k op/s 2024-05-14T15:26:55.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:55 smithi203 ceph-mon[34567]: pgmap v161: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 7.9 MiB/s wr, 1.02k op/s 2024-05-14T15:26:55.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:55 smithi092 ceph-mon[34729]: pgmap v161: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 7.9 MiB/s wr, 1.02k op/s 2024-05-14T15:26:56.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 70.0 s, 575.1 tps, lat 173.506 ms stddev 59.702 2024-05-14T15:26:57.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:57 smithi069 ceph-mon[31270]: pgmap v162: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.1 MiB/s wr, 684 op/s 2024-05-14T15:26:57.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:57 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:26:57.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:57 smithi203 ceph-mon[34567]: pgmap v162: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.1 MiB/s wr, 684 op/s 2024-05-14T15:26:57.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:57 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:26:57.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:57 smithi092 ceph-mon[34729]: pgmap v162: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.1 MiB/s wr, 684 op/s 2024-05-14T15:26:57.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:57 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:26:58.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:58 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:26:58.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:58 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:26:58.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:58 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:26:58.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:58 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:26:58.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:58 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:26:58.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:58 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:26:58.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:58 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:26:58.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:58 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:26:58.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:58 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:26:58.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:58 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:26:58.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:58 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:26:58.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:58 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:26:59.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:26:59 smithi203 ceph-mon[34567]: pgmap v163: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.1 MiB/s wr, 684 op/s 2024-05-14T15:26:59.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:26:59 smithi092 ceph-mon[34729]: pgmap v163: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.1 MiB/s wr, 684 op/s 2024-05-14T15:26:59.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:26:59 smithi069 ceph-mon[31270]: pgmap v163: 129 pgs: 129 active+clean; 1.6 GiB data, 4.5 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.1 MiB/s wr, 684 op/s 2024-05-14T15:27:01.370 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 75.0 s, 567.1 tps, lat 177.539 ms stddev 76.157 2024-05-14T15:27:01.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:01 smithi203 ceph-mon[34567]: pgmap v164: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 7.6 MiB/s wr, 986 op/s 2024-05-14T15:27:01.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:01 smithi092 ceph-mon[34729]: pgmap v164: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 7.6 MiB/s wr, 986 op/s 2024-05-14T15:27:01.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:01 smithi069 ceph-mon[31270]: pgmap v164: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 7.6 MiB/s wr, 986 op/s 2024-05-14T15:27:03.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:03 smithi203 ceph-mon[34567]: pgmap v165: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.8 MiB/s wr, 588 op/s 2024-05-14T15:27:03.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:03 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:27:03.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:03 smithi092 ceph-mon[34729]: pgmap v165: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.8 MiB/s wr, 588 op/s 2024-05-14T15:27:03.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:03 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:27:03.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:03 smithi069 ceph-mon[31270]: pgmap v165: 129 pgs: 129 active+clean; 1.6 GiB data, 4.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 4.8 MiB/s wr, 588 op/s 2024-05-14T15:27:03.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:03 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:27:04.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:04 smithi203 ceph-mon[34567]: pgmap v166: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.4 MiB/s wr, 907 op/s 2024-05-14T15:27:04.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:04 smithi092 ceph-mon[34729]: pgmap v166: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.4 MiB/s wr, 907 op/s 2024-05-14T15:27:04.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:04 smithi069 ceph-mon[31270]: pgmap v166: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.4 MiB/s wr, 907 op/s 2024-05-14T15:27:06.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 80.0 s, 608.2 tps, lat 163.591 ms stddev 79.066 2024-05-14T15:27:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.790+0000 7fd47d200640 1 -- 172.21.15.69:0/3388687394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd478075490 msgr2=0x7fd4780758a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.790+0000 7fd47d200640 1 --2- 172.21.15.69:0/3388687394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd478075490 0x7fd4780758a0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd468009900 tx=0x7fd46802a490 comp rx=0 tx=0).stop 2024-05-14T15:27:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.790+0000 7fd47d200640 1 -- 172.21.15.69:0/3388687394 shutdown_connections 2024-05-14T15:27:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.790+0000 7fd47d200640 1 --2- 172.21.15.69:0/3388687394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd478114ad0 0x7fd478116ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.791+0000 7fd47d200640 1 --2- 172.21.15.69:0/3388687394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd478112170 0x7fd478114590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.791+0000 7fd47d200640 1 --2- 172.21.15.69:0/3388687394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd478075490 0x7fd4780758a0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.791+0000 7fd47d200640 1 -- 172.21.15.69:0/3388687394 >> 172.21.15.69:0/3388687394 conn(0x7fd478079250 msgr2=0x7fd478079690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.792+0000 7fd47d200640 1 -- 172.21.15.69:0/3388687394 shutdown_connections 2024-05-14T15:27:06.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.792+0000 7fd47d200640 1 -- 172.21.15.69:0/3388687394 wait complete. 2024-05-14T15:27:06.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.795+0000 7fd47d200640 1 Processor -- start 2024-05-14T15:27:06.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.795+0000 7fd47d200640 1 -- start start 2024-05-14T15:27:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.795+0000 7fd47d200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd478075490 0x7fd47806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.795+0000 7fd47d200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd478112170 0x7fd47806e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.796+0000 7fd47d200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd478114ad0 0x7fd47806e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.796+0000 7fd47d200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd47811a100 con 0x7fd478114ad0 2024-05-14T15:27:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.796+0000 7fd476a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd478112170 0x7fd47806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.796+0000 7fd47d200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd478119f80 con 0x7fd478075490 2024-05-14T15:27:06.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.796+0000 7fd476a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd478112170 0x7fd47806e160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:57582/0 (socket says 172.21.15.69:57582) 2024-05-14T15:27:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.796+0000 7fd47d200640 1 -- 172.21.15.69:0/1921571684 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd47811a280 con 0x7fd478112170 2024-05-14T15:27:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.796+0000 7fd476a00640 1 -- 172.21.15.69:0/1921571684 learned_addr learned my addr 172.21.15.69:0/1921571684 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.796+0000 7fd477e00640 1 --2- 172.21.15.69:0/1921571684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd478114ad0 0x7fd47806e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.797+0000 7fd477400640 1 --2- 172.21.15.69:0/1921571684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd478075490 0x7fd47806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.797+0000 7fd476a00640 1 -- 172.21.15.69:0/1921571684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd478075490 msgr2=0x7fd47806dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.797+0000 7fd476a00640 1 --2- 172.21.15.69:0/1921571684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd478075490 0x7fd47806dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.797+0000 7fd476a00640 1 -- 172.21.15.69:0/1921571684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd478114ad0 msgr2=0x7fd47806e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.797+0000 7fd476a00640 1 --2- 172.21.15.69:0/1921571684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd478114ad0 0x7fd47806e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.797+0000 7fd476a00640 1 -- 172.21.15.69:0/1921571684 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd478072620 con 0x7fd478112170 2024-05-14T15:27:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.799+0000 7fd476a00640 1 --2- 172.21.15.69:0/1921571684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd478112170 0x7fd47806e160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd46400e990 tx=0x7fd46400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.799+0000 7fd46fe00640 1 -- 172.21.15.69:0/1921571684 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46400cbe0 con 0x7fd478112170 2024-05-14T15:27:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.800+0000 7fd47d200640 1 -- 172.21.15.69:0/1921571684 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd478072910 con 0x7fd478112170 2024-05-14T15:27:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.800+0000 7fd47d200640 1 -- 172.21.15.69:0/1921571684 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd478072e60 con 0x7fd478112170 2024-05-14T15:27:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.800+0000 7fd46fe00640 1 -- 172.21.15.69:0/1921571684 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd46400cd80 con 0x7fd478112170 2024-05-14T15:27:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.800+0000 7fd46fe00640 1 -- 172.21.15.69:0/1921571684 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd464011470 con 0x7fd478112170 2024-05-14T15:27:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.805+0000 7fd485801740 1 Processor -- start 2024-05-14T15:27:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.806+0000 7fd485801740 1 -- start start 2024-05-14T15:27:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.808+0000 7fd485801740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55938730a1b0 0x5593876ab470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.808+0000 7fd485801740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593872e12f0 0x5593876ab9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.809+0000 7fd485801740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e94d0 0x5593876abef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.809+0000 7fd485801740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x559387610550 con 0x55938730a1b0 2024-05-14T15:27:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.809+0000 7fd485801740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5593875b5bc0 con 0x5593872e94d0 2024-05-14T15:27:06.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.809+0000 7fd485801740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55938760c510 con 0x5593872e12f0 2024-05-14T15:27:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.809+0000 7fd477400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593872e12f0 0x5593876ab9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:06.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.810+0000 7fd477e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55938730a1b0 0x5593876ab470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.810+0000 7fd477400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593872e12f0 0x5593876ab9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:57592/0 (socket says 172.21.15.69:57592) 2024-05-14T15:27:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.810+0000 7fd477400640 1 -- 172.21.15.69:0/690427972 learned_addr learned my addr 172.21.15.69:0/690427972 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.811+0000 7fd477400640 1 -- 172.21.15.69:0/690427972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e94d0 msgr2=0x5593876abef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:27:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.811+0000 7fd477400640 1 --2- 172.21.15.69:0/690427972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e94d0 0x5593876abef0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.811+0000 7fd477400640 1 -- 172.21.15.69:0/690427972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55938730a1b0 msgr2=0x5593876ab470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.811+0000 7fd477400640 1 --2- 172.21.15.69:0/690427972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55938730a1b0 0x5593876ab470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.812+0000 7fd477400640 1 -- 172.21.15.69:0/690427972 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559387322210 con 0x5593872e12f0 2024-05-14T15:27:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.812+0000 7fd477400640 1 --2- 172.21.15.69:0/690427972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593872e12f0 0x5593876ab9b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd46802a9b0 tx=0x7fd468005350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=268fbca3b314dc9d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.813+0000 7fd46fe00640 1 -- 172.21.15.69:0/1921571684 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd464011610 con 0x7fd478112170 2024-05-14T15:27:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.813+0000 7fd46cc00640 1 -- 172.21.15.69:0/690427972 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd468035020 con 0x5593872e12f0 2024-05-14T15:27:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.813+0000 7fd46cc00640 1 -- 172.21.15.69:0/690427972 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd468041070 con 0x5593872e12f0 2024-05-14T15:27:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.813+0000 7fd46cc00640 1 -- 172.21.15.69:0/690427972 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd468031600 con 0x5593872e12f0 2024-05-14T15:27:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.815+0000 7fd46fe00640 1 --2- 172.21.15.69:0/1921571684 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd45c0b2b20 0x7fd45c0b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.815+0000 7fd46fe00640 1 -- 172.21.15.69:0/1921571684 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fd4640e27c0 con 0x7fd478112170 2024-05-14T15:27:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.818+0000 7fd485801740 1 -- 172.21.15.69:0/690427972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593872e12f0 msgr2=0x5593876ab9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:06.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.818+0000 7fd485801740 1 --2- 172.21.15.69:0/690427972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593872e12f0 0x5593876ab9b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd46802a9b0 tx=0x7fd468005350 comp rx=0 tx=0).stop 2024-05-14T15:27:06.820 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.818+0000 7fd477e00640 1 --2- 172.21.15.69:0/1921571684 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd45c0b2b20 0x7fd45c0b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.820+0000 7fd485801740 1 -- 172.21.15.69:0/690427972 shutdown_connections 2024-05-14T15:27:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.820+0000 7fd485801740 1 --2- 172.21.15.69:0/690427972 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e94d0 0x5593876abef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.820+0000 7fd485801740 1 --2- 172.21.15.69:0/690427972 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593872e12f0 0x5593876ab9b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.820+0000 7fd485801740 1 --2- 172.21.15.69:0/690427972 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55938730a1b0 0x5593876ab470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.820+0000 7fd485801740 1 -- 172.21.15.69:0/690427972 >> 172.21.15.69:0/690427972 conn(0x5593872fe300 msgr2=0x5593876a7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:06.822 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.821+0000 7fd477e00640 1 --2- 172.21.15.69:0/1921571684 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd45c0b2b20 0x7fd45c0b5030 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x5593876a85e0 tx=0x7fd470007520 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.821+0000 7fd485801740 1 -- 172.21.15.69:0/690427972 shutdown_connections 2024-05-14T15:27:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.821+0000 7fd485801740 1 -- 172.21.15.69:0/690427972 wait complete. 2024-05-14T15:27:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.822+0000 7fd485801740 1 -- start start 2024-05-14T15:27:06.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.823+0000 7fd485801740 1 Processor -- start 2024-05-14T15:27:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.824+0000 7fd485801740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e12f0 0x5593876b5930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.824+0000 7fd485801740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593872e94d0 0x5593876b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.824+0000 7fd476a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593872e94d0 0x5593876b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.825+0000 7fd476a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593872e94d0 0x5593876b5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48488/0 (socket says 172.21.15.69:48488) 2024-05-14T15:27:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.825+0000 7fd476a00640 1 -- 172.21.15.69:0/934317484 learned_addr learned my addr 172.21.15.69:0/934317484 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.825+0000 7fd485801740 1 --2- 172.21.15.69:0/934317484 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55938730a1b0 0x5593876c1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.825+0000 7fd485801740 1 -- 172.21.15.69:0/934317484 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5593876b8540 con 0x5593872e94d0 2024-05-14T15:27:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.825+0000 7fd485801740 1 -- 172.21.15.69:0/934317484 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5593875c9660 con 0x5593872e12f0 2024-05-14T15:27:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.825+0000 7fd485801740 1 -- 172.21.15.69:0/934317484 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5593876b86c0 con 0x55938730a1b0 2024-05-14T15:27:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.825+0000 7fd477e00640 1 --2- 172.21.15.69:0/934317484 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55938730a1b0 0x5593876c1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.826+0000 7fd485801740 10 client.0 _ll_register_callbacks cb 0x559387593400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.826+0000 7fd477400640 1 --2- 172.21.15.69:0/934317484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e12f0 0x5593876b5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:06.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.826+0000 7fd476a00640 1 -- 172.21.15.69:0/934317484 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55938730a1b0 msgr2=0x5593876c1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.826+0000 7fd476a00640 1 --2- 172.21.15.69:0/934317484 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55938730a1b0 0x5593876c1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.826+0000 7fd476a00640 1 -- 172.21.15.69:0/934317484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e12f0 msgr2=0x5593876b5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.826+0000 7fd476a00640 1 --2- 172.21.15.69:0/934317484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e12f0 0x5593876b5930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.826+0000 7fd476a00640 1 -- 172.21.15.69:0/934317484 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593873ee620 con 0x5593872e94d0 2024-05-14T15:27:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.827+0000 7fd476a00640 1 --2- 172.21.15.69:0/934317484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593872e94d0 0x5593876b5e70 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd46400e960 tx=0x7fd4640a9310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195943f58194a11e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:06.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.827+0000 7fd461600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:27:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.827+0000 7fd461600640 1 -- 172.21.15.69:0/934317484 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46401f040 con 0x5593872e94d0 2024-05-14T15:27:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.828+0000 7fd485801740 1 -- 172.21.15.69:0/934317484 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd468041070 con 0x5593872e94d0 2024-05-14T15:27:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.828+0000 7fd461600640 1 -- 172.21.15.69:0/934317484 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fd4640e2360 con 0x5593872e94d0 2024-05-14T15:27:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.828+0000 7fd461600640 1 -- 172.21.15.69:0/934317484 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fd4640c8050 con 0x5593872e94d0 2024-05-14T15:27:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.828+0000 7fd485801740 10 client.16467 fetch_fsmap learned FSMap version 47 2024-05-14T15:27:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.828+0000 7fd485801740 1 -- 172.21.15.69:0/934317484 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x5593876c4820 con 0x5593872e94d0 2024-05-14T15:27:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.829+0000 7fd461600640 1 -- 172.21.15.69:0/934317484 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd468041070 con 0x5593872e94d0 2024-05-14T15:27:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.829+0000 7fd461600640 1 -- 172.21.15.69:0/934317484 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 47) ==== 8414+0+0 (secure 0 0 0) 0x7fd46400f040 con 0x5593872e94d0 2024-05-14T15:27:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.829+0000 7fd485801740 10 client.16467 fetch_fsmap finished waiting for FSMap version 47 2024-05-14T15:27:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.829+0000 7fd485801740 10 client.16467 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:27:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.829+0000 7fd485801740 20 client.16467 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.830+0000 7fd485801740 1 --2- 172.21.15.69:0/934317484 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5593872c8d80 0x5593876c7d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.830+0000 7fd485801740 4 client.16467 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:27:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.830+0000 7fd485801740 1 -- 172.21.15.69:0/934317484 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55938761e160 con 0x5593872c8d80 2024-05-14T15:27:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.832+0000 7fd477400640 1 --2- 172.21.15.69:0/934317484 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5593872c8d80 0x5593876c7d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.835+0000 7fd477400640 1 --2- 172.21.15.69:0/934317484 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5593872c8d80 0x5593876c7d80 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9501078e99568d7 server_cookie=7080d906744ecb06 in_seq=0 out_seq=0 2024-05-14T15:27:06.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.835+0000 7fd461600640 10 client.16467 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:06.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.838+0000 7fd461600640 1 -- 172.21.15.69:0/934317484 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55938761e160 con 0x5593872c8d80 2024-05-14T15:27:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.838+0000 7fd461600640 10 client.16467 handle_command_reply: tid=0 2024-05-14T15:27:06.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.839+0000 7fd485801740 1 client.16467 shutdown 2024-05-14T15:27:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.841+0000 7fd485801740 1 -- 172.21.15.69:0/934317484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593872e94d0 msgr2=0x5593876b5e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.841+0000 7fd485801740 1 --2- 172.21.15.69:0/934317484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593872e94d0 0x5593876b5e70 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fd46400e960 tx=0x7fd4640a9310 comp rx=0 tx=0).stop 2024-05-14T15:27:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.842+0000 7fd485801740 1 -- 172.21.15.69:0/934317484 shutdown_connections 2024-05-14T15:27:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.842+0000 7fd485801740 1 --2- 172.21.15.69:0/934317484 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55938730a1b0 0x5593876c1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.842+0000 7fd485801740 1 --2- 172.21.15.69:0/934317484 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5593872c8d80 0x5593876c7d80 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.842+0000 7fd485801740 1 --2- 172.21.15.69:0/934317484 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593872e94d0 0x5593876b5e70 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.842+0000 7fd485801740 1 --2- 172.21.15.69:0/934317484 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e12f0 0x5593876b5930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.842+0000 7fd461600640 0 client.16467 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.842+0000 7fd485801740 1 -- 172.21.15.69:0/934317484 >> 172.21.15.69:0/934317484 conn(0x5593872fe300 msgr2=0x5593876ad190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.843+0000 7fd485801740 1 -- 172.21.15.69:0/934317484 shutdown_connections 2024-05-14T15:27:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.843+0000 7fd485801740 1 -- 172.21.15.69:0/934317484 wait complete. 2024-05-14T15:27:06.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.844+0000 7fd485801740 20 client.16467 trim_cache size 0 max 16384 2024-05-14T15:27:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.888+0000 7fd485801740 1 Processor -- start 2024-05-14T15:27:06.889 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.888+0000 7fd485801740 1 -- start start 2024-05-14T15:27:06.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.888+0000 7fd485801740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593872e12f0 0x5593876aba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.888+0000 7fd485801740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e94d0 0x5593876cd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.888+0000 7fd485801740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55938730a1b0 0x5593876cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.888+0000 7fd485801740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd45800ff60 con 0x5593872e12f0 2024-05-14T15:27:06.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.888+0000 7fd485801740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd458011ce0 con 0x5593872e94d0 2024-05-14T15:27:06.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.888+0000 7fd485801740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd4580106f0 con 0x55938730a1b0 2024-05-14T15:27:06.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.889+0000 7fd477e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55938730a1b0 0x5593876cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:06.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.889+0000 7fd477e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55938730a1b0 0x5593876cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:57612/0 (socket says 172.21.15.69:57612) 2024-05-14T15:27:06.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.889+0000 7fd477e00640 1 -- 172.21.15.69:0/2140269983 learned_addr learned my addr 172.21.15.69:0/2140269983 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.890+0000 7fd477e00640 1 -- 172.21.15.69:0/2140269983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e94d0 msgr2=0x5593876cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.890+0000 7fd477e00640 1 --2- 172.21.15.69:0/2140269983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e94d0 0x5593876cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.890+0000 7fd477e00640 1 -- 172.21.15.69:0/2140269983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593872e12f0 msgr2=0x5593876aba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.890+0000 7fd477e00640 1 --2- 172.21.15.69:0/2140269983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593872e12f0 0x5593876aba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.890+0000 7fd477e00640 1 -- 172.21.15.69:0/2140269983 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5593876ac850 con 0x55938730a1b0 2024-05-14T15:27:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.891+0000 7fd477e00640 1 --2- 172.21.15.69:0/2140269983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55938730a1b0 0x5593876cdac0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd47001e890 tx=0x7fd470015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=87855fe86ca6168 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.892+0000 7fd463e00640 1 -- 172.21.15.69:0/2140269983 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47001e0f0 con 0x55938730a1b0 2024-05-14T15:27:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.893+0000 7fd463e00640 1 -- 172.21.15.69:0/2140269983 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd47001e290 con 0x55938730a1b0 2024-05-14T15:27:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.893+0000 7fd463e00640 1 -- 172.21.15.69:0/2140269983 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd470005020 con 0x55938730a1b0 2024-05-14T15:27:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.895+0000 7fd485801740 1 -- 172.21.15.69:0/2140269983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55938730a1b0 msgr2=0x5593876cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.895+0000 7fd485801740 1 --2- 172.21.15.69:0/2140269983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55938730a1b0 0x5593876cdac0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd47001e890 tx=0x7fd470015000 comp rx=0 tx=0).stop 2024-05-14T15:27:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.895+0000 7fd485801740 1 -- 172.21.15.69:0/2140269983 shutdown_connections 2024-05-14T15:27:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.895+0000 7fd485801740 1 --2- 172.21.15.69:0/2140269983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55938730a1b0 0x5593876cdac0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.895+0000 7fd485801740 1 --2- 172.21.15.69:0/2140269983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e94d0 0x5593876cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.895+0000 7fd485801740 1 --2- 172.21.15.69:0/2140269983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5593872e12f0 0x5593876aba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.895+0000 7fd485801740 1 -- 172.21.15.69:0/2140269983 >> 172.21.15.69:0/2140269983 conn(0x5593872fe300 msgr2=0x5593876ab340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.896+0000 7fd485801740 1 -- 172.21.15.69:0/2140269983 shutdown_connections 2024-05-14T15:27:06.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.896+0000 7fd485801740 1 -- 172.21.15.69:0/2140269983 wait complete. 2024-05-14T15:27:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.897+0000 7fd485801740 1 -- start start 2024-05-14T15:27:06.898 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.898+0000 7fd485801740 1 Processor -- start 2024-05-14T15:27:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.899+0000 7fd485801740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e12f0 0x5593876bdd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.899+0000 7fd485801740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593872e94d0 0x5593876b90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.900+0000 7fd485801740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55938730a1b0 0x5593876b9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.900+0000 7fd485801740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd458011580 con 0x55938730a1b0 2024-05-14T15:27:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.900+0000 7fd485801740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd458010df0 con 0x5593872e12f0 2024-05-14T15:27:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.900+0000 7fd485801740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd45800df40 con 0x5593872e94d0 2024-05-14T15:27:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.900+0000 7fd485801740 10 client.0 _ll_register_callbacks cb 0x7fd4640a5600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:06.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.900+0000 7fd476a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593872e94d0 0x5593876b90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.900+0000 7fd476a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593872e94d0 0x5593876b90c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:57628/0 (socket says 172.21.15.69:57628) 2024-05-14T15:27:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.900+0000 7fd476a00640 1 -- 172.21.15.69:0/3768819761 learned_addr learned my addr 172.21.15.69:0/3768819761 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.900+0000 7fd477400640 1 --2- 172.21.15.69:0/3768819761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e12f0 0x5593876bdd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.901+0000 7fd477e00640 1 --2- 172.21.15.69:0/3768819761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55938730a1b0 0x5593876b9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:06.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.901+0000 7fd476a00640 1 -- 172.21.15.69:0/3768819761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e12f0 msgr2=0x5593876bdd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.901+0000 7fd476a00640 1 --2- 172.21.15.69:0/3768819761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e12f0 0x5593876bdd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.901+0000 7fd476a00640 1 -- 172.21.15.69:0/3768819761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55938730a1b0 msgr2=0x5593876b9600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.901+0000 7fd476a00640 1 --2- 172.21.15.69:0/3768819761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55938730a1b0 0x5593876b9600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.901+0000 7fd476a00640 1 -- 172.21.15.69:0/3768819761 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5593876b9b40 con 0x5593872e94d0 2024-05-14T15:27:06.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.902+0000 7fd477e00640 1 --2- 172.21.15.69:0/3768819761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55938730a1b0 0x5593876b9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:27:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.903+0000 7fd476a00640 1 --2- 172.21.15.69:0/3768819761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593872e94d0 0x5593876b90c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd4640bef00 tx=0x7fd4640adb00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56ed768da4504ed0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:06.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.903+0000 7fd461600640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:27:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.904+0000 7fd461600640 1 -- 172.21.15.69:0/3768819761 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46401f070 con 0x5593872e94d0 2024-05-14T15:27:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.904+0000 7fd461600640 1 -- 172.21.15.69:0/3768819761 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fd4640a89a0 con 0x5593872e94d0 2024-05-14T15:27:06.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.904+0000 7fd485801740 1 -- 172.21.15.69:0/3768819761 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd47001e290 con 0x5593872e94d0 2024-05-14T15:27:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.905+0000 7fd461600640 1 -- 172.21.15.69:0/3768819761 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=47) ==== 24+0+0 (secure 0 0 0) 0x7fd4640b6070 con 0x5593872e94d0 2024-05-14T15:27:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.905+0000 7fd485801740 10 client.25951 fetch_fsmap learned FSMap version 47 2024-05-14T15:27:06.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.905+0000 7fd485801740 1 -- 172.21.15.69:0/3768819761 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=47,monmap=4+}) -- 0x55938772fe30 con 0x5593872e94d0 2024-05-14T15:27:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.906+0000 7fd461600640 1 -- 172.21.15.69:0/3768819761 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd47001e290 con 0x5593872e94d0 2024-05-14T15:27:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.906+0000 7fd461600640 1 -- 172.21.15.69:0/3768819761 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 47) ==== 8414+0+0 (secure 0 0 0) 0x7fd4640aebd0 con 0x5593872e94d0 2024-05-14T15:27:06.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.906+0000 7fd485801740 10 client.25951 fetch_fsmap finished waiting for FSMap version 47 2024-05-14T15:27:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.907+0000 7fd485801740 10 client.25951 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:27:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.907+0000 7fd485801740 20 client.25951 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.907+0000 7fd485801740 1 --2- 172.21.15.69:0/3768819761 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55938729e1c0 0x5593877325f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.907+0000 7fd485801740 4 client.25951 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:27:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.907+0000 7fd485801740 1 -- 172.21.15.69:0/3768819761 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559387617fd0 con 0x55938729e1c0 2024-05-14T15:27:06.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.908+0000 7fd477400640 1 --2- 172.21.15.69:0/3768819761 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55938729e1c0 0x5593877325f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:06.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.909+0000 7fd461600640 10 client.25951 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:06.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.909+0000 7fd477400640 1 --2- 172.21.15.69:0/3768819761 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55938729e1c0 0x5593877325f0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ec6828c3a316c66 server_cookie=c97b17843aa0b750 in_seq=0 out_seq=0 2024-05-14T15:27:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.959+0000 7fd461600640 1 -- 172.21.15.69:0/3768819761 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559387617fd0 con 0x55938729e1c0 2024-05-14T15:27:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.960+0000 7fd461600640 10 client.25951 handle_command_reply: tid=0 2024-05-14T15:27:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.960+0000 7fd485801740 1 client.25951 shutdown 2024-05-14T15:27:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.961+0000 7fd485801740 1 -- 172.21.15.69:0/3768819761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593872e94d0 msgr2=0x5593876b90c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:06.962 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.961+0000 7fd485801740 1 --2- 172.21.15.69:0/3768819761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593872e94d0 0x5593876b90c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd4640bef00 tx=0x7fd4640adb00 comp rx=0 tx=0).stop 2024-05-14T15:27:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.962+0000 7fd485801740 1 -- 172.21.15.69:0/3768819761 shutdown_connections 2024-05-14T15:27:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.962+0000 7fd485801740 1 --2- 172.21.15.69:0/3768819761 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55938729e1c0 0x5593877325f0 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.962+0000 7fd485801740 1 --2- 172.21.15.69:0/3768819761 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55938730a1b0 0x5593876b9600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.962+0000 7fd485801740 1 --2- 172.21.15.69:0/3768819761 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5593872e94d0 0x5593876b90c0 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd4640bef00 tx=0x7fd4640adb00 comp rx=0 tx=0).stop 2024-05-14T15:27:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.962+0000 7fd485801740 1 --2- 172.21.15.69:0/3768819761 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5593872e12f0 0x5593876bdd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.962+0000 7fd485801740 1 -- 172.21.15.69:0/3768819761 >> 172.21.15.69:0/3768819761 conn(0x5593872fe300 msgr2=0x5593876a7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.962+0000 7fd461600640 0 client.25951 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.963+0000 7fd485801740 1 -- 172.21.15.69:0/3768819761 shutdown_connections 2024-05-14T15:27:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.963+0000 7fd485801740 1 -- 172.21.15.69:0/3768819761 wait complete. 2024-05-14T15:27:06.964 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.963+0000 7fd485801740 20 client.25951 trim_cache size 0 max 16384 2024-05-14T15:27:06.965 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:27:06.965 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:27:06.965 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:27:06.965 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:27:06.965 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.964+0000 7fd47d200640 1 -- 172.21.15.69:0/1921571684 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd45c0b2b20 msgr2=0x7fd45c0b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:06.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.964+0000 7fd47d200640 1 --2- 172.21.15.69:0/1921571684 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd45c0b2b20 0x7fd45c0b5030 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x5593876a85e0 tx=0x7fd470007520 comp rx=0 tx=0).stop 2024-05-14T15:27:06.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.964+0000 7fd47d200640 1 -- 172.21.15.69:0/1921571684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd478112170 msgr2=0x7fd47806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:06.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.964+0000 7fd47d200640 1 --2- 172.21.15.69:0/1921571684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd478112170 0x7fd47806e160 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd46400e990 tx=0x7fd46400ee50 comp rx=0 tx=0).stop 2024-05-14T15:27:06.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.965+0000 7fd47d200640 1 -- 172.21.15.69:0/1921571684 shutdown_connections 2024-05-14T15:27:06.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.965+0000 7fd47d200640 1 --2- 172.21.15.69:0/1921571684 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd45c0b2b20 0x7fd45c0b5030 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.965+0000 7fd47d200640 1 --2- 172.21.15.69:0/1921571684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd478114ad0 0x7fd47806e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.965+0000 7fd47d200640 1 --2- 172.21.15.69:0/1921571684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd478112170 0x7fd47806e160 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.965+0000 7fd47d200640 1 --2- 172.21.15.69:0/1921571684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd478075490 0x7fd47806dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.965+0000 7fd47d200640 1 -- 172.21.15.69:0/1921571684 >> 172.21.15.69:0/1921571684 conn(0x7fd478079250 msgr2=0x7fd478112680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.966+0000 7fd47d200640 1 -- 172.21.15.69:0/1921571684 shutdown_connections 2024-05-14T15:27:06.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:06.967+0000 7fd47d200640 1 -- 172.21.15.69:0/1921571684 wait complete. 2024-05-14T15:27:07.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:07 smithi203 ceph-mon[34567]: pgmap v167: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 5.1 MiB/s wr, 621 op/s 2024-05-14T15:27:07.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:07 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:27:07.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:07 smithi092 ceph-mon[34729]: pgmap v167: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 5.1 MiB/s wr, 621 op/s 2024-05-14T15:27:07.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:07 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:27:07.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:07 smithi069 ceph-mon[31270]: pgmap v167: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 5.1 MiB/s wr, 621 op/s 2024-05-14T15:27:07.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:07 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:27:09.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:09 smithi203 ceph-mon[34567]: pgmap v168: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 5.1 MiB/s wr, 621 op/s 2024-05-14T15:27:09.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:09 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:27:09.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:09 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:27:09.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:09 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:27:09.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:09 smithi092 ceph-mon[34729]: pgmap v168: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 5.1 MiB/s wr, 621 op/s 2024-05-14T15:27:09.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:09 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:27:09.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:09 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:27:09.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:09 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:27:09.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:09 smithi069 ceph-mon[31270]: pgmap v168: 129 pgs: 129 active+clean; 1.6 GiB data, 4.7 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 5.1 MiB/s wr, 621 op/s 2024-05-14T15:27:09.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:09 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:27:09.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:09 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:27:09.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:09 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:27:11.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 85.0 s, 581.4 tps, lat 172.084 ms stddev 66.370 2024-05-14T15:27:11.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:11 smithi092 ceph-mon[34729]: pgmap v169: 129 pgs: 129 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 7.4 MiB/s wr, 904 op/s 2024-05-14T15:27:11.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:11 smithi069 ceph-mon[31270]: pgmap v169: 129 pgs: 129 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 7.4 MiB/s wr, 904 op/s 2024-05-14T15:27:11.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:11 smithi203 ceph-mon[34567]: pgmap v169: 129 pgs: 129 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 7.4 MiB/s wr, 904 op/s 2024-05-14T15:27:13.397 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:13 smithi203 ceph-mon[34567]: pgmap v170: 129 pgs: 129 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 601 op/s 2024-05-14T15:27:13.397 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:13 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:27:13.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:13 smithi092 ceph-mon[34729]: pgmap v170: 129 pgs: 129 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 601 op/s 2024-05-14T15:27:13.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:13 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:27:13.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:13 smithi069 ceph-mon[31270]: pgmap v170: 129 pgs: 129 active+clean; 1.7 GiB data, 4.9 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 4.9 MiB/s wr, 601 op/s 2024-05-14T15:27:13.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:13 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:27:15.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:15 smithi092 ceph-mon[34729]: pgmap v171: 129 pgs: 129 active+clean; 1.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.5 MiB/s wr, 913 op/s 2024-05-14T15:27:15.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:15 smithi069 ceph-mon[31270]: pgmap v171: 129 pgs: 129 active+clean; 1.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.5 MiB/s wr, 913 op/s 2024-05-14T15:27:15.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:15 smithi203 ceph-mon[34567]: pgmap v171: 129 pgs: 129 active+clean; 1.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.5 MiB/s wr, 913 op/s 2024-05-14T15:27:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 90.0 s, 657.0 tps, lat 152.432 ms stddev 39.202 2024-05-14T15:27:17.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:17 smithi092 ceph-mon[34729]: pgmap v172: 129 pgs: 129 active+clean; 1.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 594 op/s 2024-05-14T15:27:17.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:17 smithi069 ceph-mon[31270]: pgmap v172: 129 pgs: 129 active+clean; 1.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 594 op/s 2024-05-14T15:27:17.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:17 smithi203 ceph-mon[34567]: pgmap v172: 129 pgs: 129 active+clean; 1.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 594 op/s 2024-05-14T15:27:19.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:19 smithi092 ceph-mon[34729]: pgmap v173: 129 pgs: 129 active+clean; 1.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 594 op/s 2024-05-14T15:27:19.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:19 smithi069 ceph-mon[31270]: pgmap v173: 129 pgs: 129 active+clean; 1.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 594 op/s 2024-05-14T15:27:19.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:19 smithi203 ceph-mon[34567]: pgmap v173: 129 pgs: 129 active+clean; 1.7 GiB data, 5.0 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.0 MiB/s wr, 594 op/s 2024-05-14T15:27:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.361+0000 7f0f3ac00640 1 -- 172.21.15.69:0/1902289712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c0a0280 msgr2=0x7f0f2c0a26a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.361+0000 7f0f3ac00640 1 --2- 172.21.15.69:0/1902289712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c0a0280 0x7f0f2c0a26a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0f340687c0 tx=0x7f0f34097980 comp rx=0 tx=0).stop 2024-05-14T15:27:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.361+0000 7f0f3ac00640 1 -- 172.21.15.69:0/1902289712 shutdown_connections 2024-05-14T15:27:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.361+0000 7f0f3ac00640 1 --2- 172.21.15.69:0/1902289712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c0a0280 0x7f0f2c0a26a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.361+0000 7f0f3ac00640 1 --2- 172.21.15.69:0/1902289712 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f2c095a40 0x7f0f2c095e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.361+0000 7f0f3ac00640 1 --2- 172.21.15.69:0/1902289712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f2c09b920 0x7f0f2c095500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.361+0000 7f0f3ac00640 1 -- 172.21.15.69:0/1902289712 >> 172.21.15.69:0/1902289712 conn(0x7f0f2c00afe0 msgr2=0x7f0f2c00b420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.361+0000 7f0f3ac00640 1 -- 172.21.15.69:0/1902289712 shutdown_connections 2024-05-14T15:27:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.361+0000 7f0f3ac00640 1 -- 172.21.15.69:0/1902289712 wait complete. 2024-05-14T15:27:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.363+0000 7f0f3ac00640 1 Processor -- start 2024-05-14T15:27:20.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.363+0000 7f0f3ac00640 1 -- start start 2024-05-14T15:27:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.364+0000 7f0f3ac00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f2c095a40 0x7f0f2c13e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.364+0000 7f0f3ac00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f2c09b920 0x7f0f2c13e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.364+0000 7f0f3ac00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c0a0280 0x7f0f2c142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.365+0000 7f0f39800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f2c095a40 0x7f0f2c13e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.365+0000 7f0f39800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f2c095a40 0x7f0f2c13e430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:58188/0 (socket says 172.21.15.69:58188) 2024-05-14T15:27:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.366+0000 7f0f3ac00640 1 -- 172.21.15.69:0/2599367971 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c0a6980 con 0x7f0f2c09b920 2024-05-14T15:27:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.366+0000 7f0f39800640 1 -- 172.21.15.69:0/2599367971 learned_addr learned my addr 172.21.15.69:0/2599367971 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.366+0000 7f0f3ac00640 1 -- 172.21.15.69:0/2599367971 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c0a6800 con 0x7f0f2c0a0280 2024-05-14T15:27:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.366+0000 7f0f3ac00640 1 -- 172.21.15.69:0/2599367971 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c0a6b00 con 0x7f0f2c095a40 2024-05-14T15:27:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.366+0000 7f0f38e00640 1 --2- 172.21.15.69:0/2599367971 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f2c09b920 0x7f0f2c13e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:20.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.366+0000 7f0f3a200640 1 --2- 172.21.15.69:0/2599367971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c0a0280 0x7f0f2c142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.367+0000 7f0f38e00640 1 -- 172.21.15.69:0/2599367971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f2c095a40 msgr2=0x7f0f2c13e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.367+0000 7f0f38e00640 1 --2- 172.21.15.69:0/2599367971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f2c095a40 0x7f0f2c13e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.367+0000 7f0f38e00640 1 -- 172.21.15.69:0/2599367971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c0a0280 msgr2=0x7f0f2c142c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.367+0000 7f0f38e00640 1 --2- 172.21.15.69:0/2599367971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c0a0280 0x7f0f2c142c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.367+0000 7f0f38e00640 1 -- 172.21.15.69:0/2599367971 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f2c143290 con 0x7f0f2c09b920 2024-05-14T15:27:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.367+0000 7f0f3a200640 1 --2- 172.21.15.69:0/2599367971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c0a0280 0x7f0f2c142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:27:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.368+0000 7f0f38e00640 1 --2- 172.21.15.69:0/2599367971 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f2c09b920 0x7f0f2c13e990 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c008bd0 tx=0x7f0f2000db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:20.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.369+0000 7f0f32000640 1 -- 172.21.15.69:0/2599367971 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f20018070 con 0x7f0f2c09b920 2024-05-14T15:27:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.369+0000 7f0f32000640 1 -- 172.21.15.69:0/2599367971 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f20009cb0 con 0x7f0f2c09b920 2024-05-14T15:27:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.369+0000 7f0f32000640 1 -- 172.21.15.69:0/2599367971 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f20012bd0 con 0x7f0f2c09b920 2024-05-14T15:27:20.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.369+0000 7f0f3ac00640 1 -- 172.21.15.69:0/2599367971 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f2c143580 con 0x7f0f2c09b920 2024-05-14T15:27:20.371 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.369+0000 7f0f3ac00640 1 -- 172.21.15.69:0/2599367971 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f2c143a80 con 0x7f0f2c09b920 2024-05-14T15:27:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.376+0000 7f0f431d7740 1 Processor -- start 2024-05-14T15:27:20.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.376+0000 7f0f431d7740 1 -- start start 2024-05-14T15:27:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.377+0000 7f0f431d7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588c11b0 0x558958c624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.377+0000 7f0f431d7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588982f0 0x558958c629f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.377+0000 7f0f431d7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588a04d0 0x558958c62f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.377+0000 7f0f431d7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x558958bc7550 con 0x5589588c11b0 2024-05-14T15:27:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.377+0000 7f0f431d7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558958b6cbc0 con 0x5589588982f0 2024-05-14T15:27:20.378 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.377+0000 7f0f431d7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558958bc3510 con 0x5589588a04d0 2024-05-14T15:27:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.378+0000 7f0f3a200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588c11b0 0x558958c624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.378+0000 7f0f3a200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588c11b0 0x558958c624b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48040/0 (socket says 172.21.15.69:48040) 2024-05-14T15:27:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.378+0000 7f0f3a200640 1 -- 172.21.15.69:0/4160972857 learned_addr learned my addr 172.21.15.69:0/4160972857 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.378+0000 7f0f39800640 1 --2- 172.21.15.69:0/4160972857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588982f0 0x558958c629f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:20.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.378+0000 7f0f3a200640 1 -- 172.21.15.69:0/4160972857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588a04d0 msgr2=0x558958c62f30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:27:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.378+0000 7f0f3a200640 1 --2- 172.21.15.69:0/4160972857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588a04d0 0x558958c62f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.378+0000 7f0f3a200640 1 -- 172.21.15.69:0/4160972857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588982f0 msgr2=0x558958c629f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.378+0000 7f0f3a200640 1 --2- 172.21.15.69:0/4160972857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588982f0 0x558958c629f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.378+0000 7f0f3a200640 1 -- 172.21.15.69:0/4160972857 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589588d9210 con 0x5589588c11b0 2024-05-14T15:27:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.378+0000 7f0f32000640 1 -- 172.21.15.69:0/2599367971 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f0f20004220 con 0x7f0f2c09b920 2024-05-14T15:27:20.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.379+0000 7f0f3a200640 1 --2- 172.21.15.69:0/4160972857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588c11b0 0x558958c624b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0f34052220 tx=0x7f0f34064250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aaff72d4a59cab84 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.379+0000 7f0f26a00640 1 -- 172.21.15.69:0/4160972857 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f340a2070 con 0x5589588c11b0 2024-05-14T15:27:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.380+0000 7f0f26a00640 1 -- 172.21.15.69:0/4160972857 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f3409d990 con 0x5589588c11b0 2024-05-14T15:27:20.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.380+0000 7f0f26a00640 1 -- 172.21.15.69:0/4160972857 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f34069bf0 con 0x5589588c11b0 2024-05-14T15:27:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.380+0000 7f0f32000640 1 --2- 172.21.15.69:0/2599367971 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f1c0b2b30 0x7f0f1c0b5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.381+0000 7f0f431d7740 1 -- 172.21.15.69:0/4160972857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588c11b0 msgr2=0x558958c624b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.381+0000 7f0f431d7740 1 --2- 172.21.15.69:0/4160972857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588c11b0 0x558958c624b0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f0f34052220 tx=0x7f0f34064250 comp rx=0 tx=0).stop 2024-05-14T15:27:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.381+0000 7f0f32000640 1 -- 172.21.15.69:0/2599367971 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f0f200e6410 con 0x7f0f2c09b920 2024-05-14T15:27:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.381+0000 7f0f431d7740 1 -- 172.21.15.69:0/4160972857 shutdown_connections 2024-05-14T15:27:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.381+0000 7f0f431d7740 1 --2- 172.21.15.69:0/4160972857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588a04d0 0x558958c62f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.381+0000 7f0f431d7740 1 --2- 172.21.15.69:0/4160972857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588982f0 0x558958c629f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.381+0000 7f0f431d7740 1 --2- 172.21.15.69:0/4160972857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588c11b0 0x558958c624b0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.381+0000 7f0f431d7740 1 -- 172.21.15.69:0/4160972857 >> 172.21.15.69:0/4160972857 conn(0x5589588b5300 msgr2=0x558958c5ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.381+0000 7f0f39800640 1 --2- 172.21.15.69:0/2599367971 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f1c0b2b30 0x7f0f1c0b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:20.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.381+0000 7f0f431d7740 1 -- 172.21.15.69:0/4160972857 shutdown_connections 2024-05-14T15:27:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.382+0000 7f0f431d7740 1 -- 172.21.15.69:0/4160972857 wait complete. 2024-05-14T15:27:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.382+0000 7f0f39800640 1 --2- 172.21.15.69:0/2599367971 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f1c0b2b30 0x7f0f1c0b5040 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x558958c63860 tx=0x7f0f28005f90 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:20.384 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.383+0000 7f0f431d7740 1 -- start start 2024-05-14T15:27:20.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.383+0000 7f0f431d7740 1 Processor -- start 2024-05-14T15:27:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.384+0000 7f0f431d7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588982f0 0x558958c6c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.384+0000 7f0f431d7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588a04d0 0x558958c6cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.384+0000 7f0f431d7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588c11b0 0x558958c78a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.384+0000 7f0f431d7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x558958c6f580 con 0x5589588c11b0 2024-05-14T15:27:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.384+0000 7f0f431d7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558958b80660 con 0x5589588982f0 2024-05-14T15:27:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.384+0000 7f0f431d7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558958c6f700 con 0x5589588a04d0 2024-05-14T15:27:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.384+0000 7f0f431d7740 10 client.0 _ll_register_callbacks cb 0x558958b4a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.385+0000 7f0f39800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588982f0 0x558958c6c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.385+0000 7f0f39800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588982f0 0x558958c6c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:50824/0 (socket says 172.21.15.69:50824) 2024-05-14T15:27:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.385+0000 7f0f39800640 1 -- 172.21.15.69:0/4276621253 learned_addr learned my addr 172.21.15.69:0/4276621253 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:20.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.385+0000 7f0f3a200640 1 --2- 172.21.15.69:0/4276621253 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588c11b0 0x558958c78a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.385+0000 7f0f38e00640 1 --2- 172.21.15.69:0/4276621253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588a04d0 0x558958c6cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:20.387 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.385+0000 7f0f3a200640 1 -- 172.21.15.69:0/4276621253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588a04d0 msgr2=0x558958c6cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.385+0000 7f0f3a200640 1 --2- 172.21.15.69:0/4276621253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588a04d0 0x558958c6cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.385+0000 7f0f3a200640 1 -- 172.21.15.69:0/4276621253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588982f0 msgr2=0x558958c6c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.385+0000 7f0f3a200640 1 --2- 172.21.15.69:0/4276621253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588982f0 0x558958c6c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.385+0000 7f0f3a200640 1 -- 172.21.15.69:0/4276621253 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589589a5620 con 0x5589588c11b0 2024-05-14T15:27:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.387+0000 7f0f3a200640 1 --2- 172.21.15.69:0/4276621253 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588c11b0 0x558958c78a90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0f34052220 tx=0x7f0f3409ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f3daad3763ef384 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:20.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.387+0000 7f0f1b400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:27:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.388+0000 7f0f1b400640 1 -- 172.21.15.69:0/4276621253 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f340a2040 con 0x5589588c11b0 2024-05-14T15:27:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.388+0000 7f0f1b400640 1 -- 172.21.15.69:0/4276621253 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f0f3409d550 con 0x5589588c11b0 2024-05-14T15:27:20.389 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.388+0000 7f0f431d7740 1 -- 172.21.15.69:0/4276621253 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f3409d990 con 0x5589588c11b0 2024-05-14T15:27:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.389+0000 7f0f1b400640 1 -- 172.21.15.69:0/4276621253 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f0f340b7050 con 0x5589588c11b0 2024-05-14T15:27:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.389+0000 7f0f431d7740 10 client.16482 fetch_fsmap learned FSMap version 48 2024-05-14T15:27:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.389+0000 7f0f431d7740 1 -- 172.21.15.69:0/4276621253 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x558958c7b840 con 0x5589588c11b0 2024-05-14T15:27:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.389+0000 7f0f1b400640 1 -- 172.21.15.69:0/4276621253 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f34069dc0 con 0x5589588c11b0 2024-05-14T15:27:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.390+0000 7f0f1b400640 1 -- 172.21.15.69:0/4276621253 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 48) ==== 8418+0+0 (secure 0 0 0) 0x7f0f3406cc80 con 0x5589588c11b0 2024-05-14T15:27:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.390+0000 7f0f431d7740 10 client.16482 fetch_fsmap finished waiting for FSMap version 48 2024-05-14T15:27:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.390+0000 7f0f431d7740 10 client.16482 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:27:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.390+0000 7f0f431d7740 20 client.16482 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.390+0000 7f0f431d7740 1 --2- 172.21.15.69:0/4276621253 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55895887fd80 0x558958c7f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.390+0000 7f0f431d7740 4 client.16482 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:27:20.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.390+0000 7f0f431d7740 1 -- 172.21.15.69:0/4276621253 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f0f3409d990 con 0x55895887fd80 2024-05-14T15:27:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.390+0000 7f0f39800640 1 --2- 172.21.15.69:0/4276621253 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55895887fd80 0x558958c7f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.391+0000 7f0f39800640 1 --2- 172.21.15.69:0/4276621253 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55895887fd80 0x558958c7f0f0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f7b980e588bced3 server_cookie=c8536ed119d65963 in_seq=0 out_seq=0 2024-05-14T15:27:20.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.392+0000 7f0f1b400640 10 client.16482 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.392+0000 7f0f1b400640 1 -- 172.21.15.69:0/4276621253 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f0f3409d990 con 0x55895887fd80 2024-05-14T15:27:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.392+0000 7f0f1b400640 10 client.16482 handle_command_reply: tid=0 2024-05-14T15:27:20.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.393+0000 7f0f431d7740 1 client.16482 shutdown 2024-05-14T15:27:20.394 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.393+0000 7f0f431d7740 1 -- 172.21.15.69:0/4276621253 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588c11b0 msgr2=0x558958c78a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.393+0000 7f0f431d7740 1 --2- 172.21.15.69:0/4276621253 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588c11b0 0x558958c78a90 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f0f34052220 tx=0x7f0f3409ee00 comp rx=0 tx=0).stop 2024-05-14T15:27:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.393+0000 7f0f431d7740 1 -- 172.21.15.69:0/4276621253 shutdown_connections 2024-05-14T15:27:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.393+0000 7f0f431d7740 1 --2- 172.21.15.69:0/4276621253 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55895887fd80 0x558958c7f0f0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.393+0000 7f0f431d7740 1 --2- 172.21.15.69:0/4276621253 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588c11b0 0x558958c78a90 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.393+0000 7f0f431d7740 1 --2- 172.21.15.69:0/4276621253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588a04d0 0x558958c6cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.393+0000 7f0f431d7740 1 --2- 172.21.15.69:0/4276621253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588982f0 0x558958c6c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.393+0000 7f0f431d7740 1 -- 172.21.15.69:0/4276621253 >> 172.21.15.69:0/4276621253 conn(0x5589588b5300 msgr2=0x558958c622e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.393+0000 7f0f1b400640 0 client.16482 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.393+0000 7f0f431d7740 1 -- 172.21.15.69:0/4276621253 shutdown_connections 2024-05-14T15:27:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.393+0000 7f0f431d7740 1 -- 172.21.15.69:0/4276621253 wait complete. 2024-05-14T15:27:20.395 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.393+0000 7f0f431d7740 20 client.16482 trim_cache size 0 max 16384 2024-05-14T15:27:20.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.428+0000 7f0f431d7740 1 Processor -- start 2024-05-14T15:27:20.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.428+0000 7f0f431d7740 1 -- start start 2024-05-14T15:27:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.429+0000 7f0f431d7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588982f0 0x558958c6d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.429+0000 7f0f431d7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588a04d0 0x558958c62c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.429+0000 7f0f431d7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588c11b0 0x558958c848b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.429+0000 7f0f431d7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c152b80 con 0x5589588982f0 2024-05-14T15:27:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.429+0000 7f0f431d7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c154900 con 0x5589588c11b0 2024-05-14T15:27:20.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.429+0000 7f0f431d7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c153310 con 0x5589588a04d0 2024-05-14T15:27:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.429+0000 7f0f39800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588982f0 0x558958c6d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.430+0000 7f0f39800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588982f0 0x558958c6d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48058/0 (socket says 172.21.15.69:48058) 2024-05-14T15:27:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.430+0000 7f0f39800640 1 -- 172.21.15.69:0/3103354140 learned_addr learned my addr 172.21.15.69:0/3103354140 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:20.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.429+0000 7f0f38e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588a04d0 0x558958c62c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.430+0000 7f0f39800640 1 -- 172.21.15.69:0/3103354140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588a04d0 msgr2=0x558958c62c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.430+0000 7f0f3a200640 1 --2- 172.21.15.69:0/3103354140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588c11b0 0x558958c848b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.430+0000 7f0f39800640 1 --2- 172.21.15.69:0/3103354140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588a04d0 0x558958c62c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.430+0000 7f0f39800640 1 -- 172.21.15.69:0/3103354140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588c11b0 msgr2=0x558958c848b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.430+0000 7f0f39800640 1 --2- 172.21.15.69:0/3103354140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588c11b0 0x558958c848b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.430+0000 7f0f39800640 1 -- 172.21.15.69:0/3103354140 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558958c63890 con 0x5589588982f0 2024-05-14T15:27:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.430+0000 7f0f38e00640 1 --2- 172.21.15.69:0/3103354140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588a04d0 0x558958c62c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:27:20.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.430+0000 7f0f3a200640 1 --2- 172.21.15.69:0/3103354140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588c11b0 0x558958c848b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:27:20.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.431+0000 7f0f39800640 1 --2- 172.21.15.69:0/3103354140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588982f0 0x558958c6d030 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x558958c7f820 tx=0x7f0f2801b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1557ed99aa00926a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:20.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.432+0000 7f0f26000640 1 -- 172.21.15.69:0/3103354140 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f28031070 con 0x5589588982f0 2024-05-14T15:27:20.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.432+0000 7f0f26000640 1 -- 172.21.15.69:0/3103354140 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f2801dce0 con 0x5589588982f0 2024-05-14T15:27:20.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.432+0000 7f0f26000640 1 -- 172.21.15.69:0/3103354140 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f280299a0 con 0x5589588982f0 2024-05-14T15:27:20.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.434+0000 7f0f431d7740 1 -- 172.21.15.69:0/3103354140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588982f0 msgr2=0x558958c6d030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:20.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.434+0000 7f0f431d7740 1 --2- 172.21.15.69:0/3103354140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588982f0 0x558958c6d030 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x558958c7f820 tx=0x7f0f2801b000 comp rx=0 tx=0).stop 2024-05-14T15:27:20.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.435+0000 7f0f431d7740 1 -- 172.21.15.69:0/3103354140 shutdown_connections 2024-05-14T15:27:20.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.435+0000 7f0f431d7740 1 --2- 172.21.15.69:0/3103354140 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588c11b0 0x558958c848b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.435+0000 7f0f431d7740 1 --2- 172.21.15.69:0/3103354140 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588a04d0 0x558958c62c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.435+0000 7f0f431d7740 1 --2- 172.21.15.69:0/3103354140 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588982f0 0x558958c6d030 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.435+0000 7f0f431d7740 1 -- 172.21.15.69:0/3103354140 >> 172.21.15.69:0/3103354140 conn(0x5589588b5300 msgr2=0x558958c5dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:20.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.435+0000 7f0f431d7740 1 -- 172.21.15.69:0/3103354140 shutdown_connections 2024-05-14T15:27:20.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.435+0000 7f0f431d7740 1 -- 172.21.15.69:0/3103354140 wait complete. 2024-05-14T15:27:20.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.435+0000 7f0f431d7740 1 -- start start 2024-05-14T15:27:20.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.435+0000 7f0f431d7740 1 Processor -- start 2024-05-14T15:27:20.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.436+0000 7f0f431d7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588982f0 0x558958cdf810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.436+0000 7f0f431d7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588a04d0 0x558958cdfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.436+0000 7f0f431d7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588c11b0 0x558958c6ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.436+0000 7f0f431d7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c1541a0 con 0x5589588982f0 2024-05-14T15:27:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.436+0000 7f0f431d7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c153a10 con 0x5589588a04d0 2024-05-14T15:27:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.436+0000 7f0f431d7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0f2c150b60 con 0x5589588c11b0 2024-05-14T15:27:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.437+0000 7f0f431d7740 10 client.0 _ll_register_callbacks cb 0x7f0f34069570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.437+0000 7f0f39800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588982f0 0x558958cdf810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.437+0000 7f0f39800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588982f0 0x558958cdf810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48068/0 (socket says 172.21.15.69:48068) 2024-05-14T15:27:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.437+0000 7f0f38e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588a04d0 0x558958cdfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:20.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.437+0000 7f0f39800640 1 -- 172.21.15.69:0/3233918016 learned_addr learned my addr 172.21.15.69:0/3233918016 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:20.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.437+0000 7f0f39800640 1 -- 172.21.15.69:0/3233918016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588c11b0 msgr2=0x558958c6ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.437+0000 7f0f39800640 1 --2- 172.21.15.69:0/3233918016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588c11b0 0x558958c6ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.437+0000 7f0f39800640 1 -- 172.21.15.69:0/3233918016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588a04d0 msgr2=0x558958cdfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.437+0000 7f0f39800640 1 --2- 172.21.15.69:0/3233918016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588a04d0 0x558958cdfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.437+0000 7f0f39800640 1 -- 172.21.15.69:0/3233918016 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558958c705a0 con 0x5589588982f0 2024-05-14T15:27:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.438+0000 7f0f39800640 1 --2- 172.21.15.69:0/3233918016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588982f0 0x558958cdf810 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800a010 tx=0x7f0f28005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4f24de24c15124 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.438+0000 7f0f1b400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:27:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.438+0000 7f0f1b400640 1 -- 172.21.15.69:0/3233918016 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f28039060 con 0x5589588982f0 2024-05-14T15:27:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.438+0000 7f0f1b400640 1 -- 172.21.15.69:0/3233918016 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f0f280053b0 con 0x5589588982f0 2024-05-14T15:27:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.438+0000 7f0f431d7740 1 -- 172.21.15.69:0/3233918016 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f2801dce0 con 0x5589588982f0 2024-05-14T15:27:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.439+0000 7f0f1b400640 1 -- 172.21.15.69:0/3233918016 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f0f28040050 con 0x5589588982f0 2024-05-14T15:27:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.439+0000 7f0f431d7740 10 client.16488 fetch_fsmap learned FSMap version 48 2024-05-14T15:27:20.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.439+0000 7f0f431d7740 1 -- 172.21.15.69:0/3233918016 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x558958ce6dd0 con 0x5589588982f0 2024-05-14T15:27:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.439+0000 7f0f1b400640 1 -- 172.21.15.69:0/3233918016 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f2801dce0 con 0x5589588982f0 2024-05-14T15:27:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.439+0000 7f0f1b400640 1 -- 172.21.15.69:0/3233918016 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 48) ==== 8418+0+0 (secure 0 0 0) 0x7f0f28029bb0 con 0x5589588982f0 2024-05-14T15:27:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.439+0000 7f0f431d7740 10 client.16488 fetch_fsmap finished waiting for FSMap version 48 2024-05-14T15:27:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.439+0000 7f0f431d7740 10 client.16488 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:27:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.439+0000 7f0f431d7740 20 client.16488 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:20.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.439+0000 7f0f431d7740 1 --2- 172.21.15.69:0/3233918016 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5589588551c0 0x558958ce93f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.439+0000 7f0f431d7740 4 client.16488 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:27:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.439+0000 7f0f431d7740 1 -- 172.21.15.69:0/3233918016 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558958bd5160 con 0x5589588551c0 2024-05-14T15:27:20.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.440+0000 7f0f38e00640 1 --2- 172.21.15.69:0/3233918016 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5589588551c0 0x558958ce93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.442+0000 7f0f38e00640 1 --2- 172.21.15.69:0/3233918016 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5589588551c0 0x558958ce93f0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73c6a49a1da82184 server_cookie=af88c44eb9ffab6f in_seq=0 out_seq=0 2024-05-14T15:27:20.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.442+0000 7f0f1b400640 10 client.16488 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.466+0000 7f0f1b400640 1 -- 172.21.15.69:0/3233918016 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558958bd5160 con 0x5589588551c0 2024-05-14T15:27:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.466+0000 7f0f1b400640 10 client.16488 handle_command_reply: tid=0 2024-05-14T15:27:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.467+0000 7f0f431d7740 1 client.16488 shutdown 2024-05-14T15:27:20.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.467+0000 7f0f431d7740 1 -- 172.21.15.69:0/3233918016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588982f0 msgr2=0x558958cdf810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.467+0000 7f0f431d7740 1 --2- 172.21.15.69:0/3233918016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588982f0 0x558958cdf810 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800a010 tx=0x7f0f28005040 comp rx=0 tx=0).stop 2024-05-14T15:27:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.467+0000 7f0f431d7740 1 -- 172.21.15.69:0/3233918016 shutdown_connections 2024-05-14T15:27:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.467+0000 7f0f431d7740 1 --2- 172.21.15.69:0/3233918016 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5589588c11b0 0x558958c6ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.467+0000 7f0f431d7740 1 --2- 172.21.15.69:0/3233918016 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5589588a04d0 0x558958cdfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.467+0000 7f0f431d7740 1 --2- 172.21.15.69:0/3233918016 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5589588551c0 0x558958ce93f0 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.467+0000 7f0f431d7740 1 --2- 172.21.15.69:0/3233918016 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5589588982f0 0x558958cdf810 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.467+0000 7f0f1b400640 0 client.16488 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:20.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.467+0000 7f0f431d7740 1 -- 172.21.15.69:0/3233918016 >> 172.21.15.69:0/3233918016 conn(0x5589588b5300 msgr2=0x558958c5dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.468+0000 7f0f431d7740 1 -- 172.21.15.69:0/3233918016 shutdown_connections 2024-05-14T15:27:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.468+0000 7f0f431d7740 1 -- 172.21.15.69:0/3233918016 wait complete. 2024-05-14T15:27:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.469+0000 7f0f431d7740 20 client.16488 trim_cache size 0 max 16384 2024-05-14T15:27:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:27:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:27:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:27:20.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:27:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.470+0000 7f0f3ac00640 1 -- 172.21.15.69:0/2599367971 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f1c0b2b30 msgr2=0x7f0f1c0b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.470+0000 7f0f3ac00640 1 --2- 172.21.15.69:0/2599367971 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f1c0b2b30 0x7f0f1c0b5040 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x558958c63860 tx=0x7f0f28005f90 comp rx=0 tx=0).stop 2024-05-14T15:27:20.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.470+0000 7f0f3ac00640 1 -- 172.21.15.69:0/2599367971 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f2c09b920 msgr2=0x7f0f2c13e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:20.472 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.471+0000 7f0f3ac00640 1 --2- 172.21.15.69:0/2599367971 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f2c09b920 0x7f0f2c13e990 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c008bd0 tx=0x7f0f2000db30 comp rx=0 tx=0).stop 2024-05-14T15:27:20.472 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.471+0000 7f0f3ac00640 1 -- 172.21.15.69:0/2599367971 shutdown_connections 2024-05-14T15:27:20.472 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.471+0000 7f0f3ac00640 1 --2- 172.21.15.69:0/2599367971 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f1c0b2b30 0x7f0f1c0b5040 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.472 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.471+0000 7f0f3ac00640 1 --2- 172.21.15.69:0/2599367971 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f2c0a0280 0x7f0f2c142c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.472 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.471+0000 7f0f3ac00640 1 --2- 172.21.15.69:0/2599367971 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f2c09b920 0x7f0f2c13e990 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.471+0000 7f0f3ac00640 1 --2- 172.21.15.69:0/2599367971 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f2c095a40 0x7f0f2c13e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.471+0000 7f0f3ac00640 1 -- 172.21.15.69:0/2599367971 >> 172.21.15.69:0/2599367971 conn(0x7f0f2c00afe0 msgr2=0x7f0f2c09c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.471+0000 7f0f3ac00640 1 -- 172.21.15.69:0/2599367971 shutdown_connections 2024-05-14T15:27:20.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:20.471+0000 7f0f3ac00640 1 -- 172.21.15.69:0/2599367971 wait complete. 2024-05-14T15:27:21.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 95.0 s, 640.2 tps, lat 156.464 ms stddev 69.409 2024-05-14T15:27:21.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:21 smithi092 ceph-mon[34729]: pgmap v174: 129 pgs: 129 active+clean; 1.7 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.6 MiB/s wr, 902 op/s 2024-05-14T15:27:21.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:21 smithi069 ceph-mon[31270]: pgmap v174: 129 pgs: 129 active+clean; 1.7 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.6 MiB/s wr, 902 op/s 2024-05-14T15:27:21.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:21 smithi203 ceph-mon[34567]: pgmap v174: 129 pgs: 129 active+clean; 1.7 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.6 MiB/s wr, 902 op/s 2024-05-14T15:27:22.236 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T15:27:22.942 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:27:23.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:23 smithi092 ceph-mon[34729]: pgmap v175: 129 pgs: 129 active+clean; 1.7 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.2 MiB/s wr, 620 op/s 2024-05-14T15:27:23.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:23 smithi069 ceph-mon[31270]: pgmap v175: 129 pgs: 129 active+clean; 1.7 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.2 MiB/s wr, 620 op/s 2024-05-14T15:27:23.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:23 smithi203 ceph-mon[34567]: pgmap v175: 129 pgs: 129 active+clean; 1.7 GiB data, 5.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.2 MiB/s wr, 620 op/s 2024-05-14T15:27:25.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:25 smithi092 ceph-mon[34729]: pgmap v176: 129 pgs: 129 active+clean; 1.7 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.9 MiB/s wr, 940 op/s 2024-05-14T15:27:25.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:25 smithi069 ceph-mon[31270]: pgmap v176: 129 pgs: 129 active+clean; 1.7 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.9 MiB/s wr, 940 op/s 2024-05-14T15:27:25.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:25 smithi203 ceph-mon[34567]: pgmap v176: 129 pgs: 129 active+clean; 1.7 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 7.9 MiB/s wr, 940 op/s 2024-05-14T15:27:26.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 100.0 s, 620.0 tps, lat 160.871 ms stddev 84.217 2024-05-14T15:27:26.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.855+0000 7f6c3be00700 1 -- 172.21.15.69:0/2515440550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3c108d40 msgr2=0x7f6c3c109150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:26.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.855+0000 7f6c3be00700 1 --2- 172.21.15.69:0/2515440550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3c108d40 0x7f6c3c109150 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6c240099c0 tx=0x7f6c24009cd0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.857+0000 7f6c3be00700 1 -- 172.21.15.69:0/2515440550 shutdown_connections 2024-05-14T15:27:26.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.857+0000 7f6c3be00700 1 --2- 172.21.15.69:0/2515440550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c3c104410 0x7f6c3c104820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.857+0000 7f6c3be00700 1 --2- 172.21.15.69:0/2515440550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c109690 0x7f6c3c110ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.857+0000 7f6c3be00700 1 --2- 172.21.15.69:0/2515440550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3c108d40 0x7f6c3c109150 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.857+0000 7f6c3be00700 1 -- 172.21.15.69:0/2515440550 >> 172.21.15.69:0/2515440550 conn(0x7f6c3c079c20 msgr2=0x7f6c3c07a080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:26.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.857+0000 7f6c3be00700 1 -- 172.21.15.69:0/2515440550 shutdown_connections 2024-05-14T15:27:26.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.857+0000 7f6c3be00700 1 -- 172.21.15.69:0/2515440550 wait complete. 2024-05-14T15:27:26.860 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.859+0000 7f6c3be00700 1 Processor -- start 2024-05-14T15:27:26.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.859+0000 7f6c3be00700 1 -- start start 2024-05-14T15:27:26.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.860+0000 7f6c3be00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c104410 0x7f6c3c1a0790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.860+0000 7f6c3be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c3c108d40 0x7f6c3c1a0cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.860+0000 7f6c3be00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3c109690 0x7f6c3c19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.860+0000 7f6c3be00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c114150 con 0x7f6c3c108d40 2024-05-14T15:27:26.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.860+0000 7f6c3be00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c113fd0 con 0x7f6c3c104410 2024-05-14T15:27:26.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.860+0000 7f6c3be00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c1142d0 con 0x7f6c3c109690 2024-05-14T15:27:26.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.861+0000 7f6c3aa00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c104410 0x7f6c3c1a0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:26.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.861+0000 7f6c3aa00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c104410 0x7f6c3c1a0790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:56572/0 (socket says 172.21.15.69:56572) 2024-05-14T15:27:26.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.861+0000 7f6c3aa00700 1 -- 172.21.15.69:0/654640363 learned_addr learned my addr 172.21.15.69:0/654640363 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:26.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.861+0000 7f6c33e00700 1 --2- 172.21.15.69:0/654640363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c3c108d40 0x7f6c3c1a0cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:26.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.862+0000 7f6c3aa00700 1 -- 172.21.15.69:0/654640363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3c109690 msgr2=0x7f6c3c19a9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-14T15:27:26.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.862+0000 7f6c3aa00700 1 --2- 172.21.15.69:0/654640363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3c109690 0x7f6c3c19a9b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.862+0000 7f6c3aa00700 1 -- 172.21.15.69:0/654640363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c3c108d40 msgr2=0x7f6c3c1a0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:26.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.862+0000 7f6c3aa00700 1 --2- 172.21.15.69:0/654640363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c3c108d40 0x7f6c3c1a0cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.862+0000 7f6c3aa00700 1 -- 172.21.15.69:0/654640363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3c19b060 con 0x7f6c3c104410 2024-05-14T15:27:26.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.863+0000 7f6c3aa00700 1 --2- 172.21.15.69:0/654640363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c104410 0x7f6c3c1a0790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0060b0 tx=0x7f6c2c007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:26.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.864+0000 7f6c33400700 1 -- 172.21.15.69:0/654640363 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c01a070 con 0x7f6c3c104410 2024-05-14T15:27:26.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.864+0000 7f6c33400700 1 -- 172.21.15.69:0/654640363 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c2c00de20 con 0x7f6c3c104410 2024-05-14T15:27:26.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.864+0000 7f6c33400700 1 -- 172.21.15.69:0/654640363 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c014690 con 0x7f6c3c104410 2024-05-14T15:27:26.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.864+0000 7f6c3be00700 1 -- 172.21.15.69:0/654640363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3c19b350 con 0x7f6c3c104410 2024-05-14T15:27:26.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.865+0000 7f6c3be00700 1 -- 172.21.15.69:0/654640363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c3c0759f0 con 0x7f6c3c104410 2024-05-14T15:27:26.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.876+0000 7f6c5028cb80 1 Processor -- start 2024-05-14T15:27:26.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.876+0000 7f6c5028cb80 1 -- start start 2024-05-14T15:27:26.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.877+0000 7f6c33400700 1 -- 172.21.15.69:0/654640363 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6c2c01d070 con 0x7f6c3c104410 2024-05-14T15:27:26.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.878+0000 7f6c5028cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af5cee40 0x5576af752540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.878+0000 7f6c5028cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af752a80 0x5576af74c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.879+0000 7f6c3b400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af5cee40 0x5576af752540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:26.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.879+0000 7f6c3b400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af5cee40 0x5576af752540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:56584/0 (socket says 172.21.15.69:56584) 2024-05-14T15:27:26.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.879+0000 7f6c5028cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af74cc40 0x5576af74d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.879+0000 7f6c3b400700 1 -- 172.21.15.69:0/3377974957 learned_addr learned my addr 172.21.15.69:0/3377974957 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:26.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.879+0000 7f6c5028cb80 1 -- 172.21.15.69:0/3377974957 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5576af66ea20 con 0x5576af752a80 2024-05-14T15:27:26.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.879+0000 7f6c5028cb80 1 -- 172.21.15.69:0/3377974957 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5576af60c760 con 0x5576af5cee40 2024-05-14T15:27:26.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.879+0000 7f6c5028cb80 1 -- 172.21.15.69:0/3377974957 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5576af66a9e0 con 0x5576af74cc40 2024-05-14T15:27:26.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.880+0000 7f6c3b400700 1 -- 172.21.15.69:0/3377974957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af74cc40 msgr2=0x5576af74d050 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:27:26.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.880+0000 7f6c3b400700 1 --2- 172.21.15.69:0/3377974957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af74cc40 0x5576af74d050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.880+0000 7f6c33400700 1 --2- 172.21.15.69:0/654640363 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6c200b6f00 0x7f6c200b9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.880+0000 7f6c3b400700 1 -- 172.21.15.69:0/3377974957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af752a80 msgr2=0x5576af74c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:26.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.880+0000 7f6c3aa00700 1 --2- 172.21.15.69:0/3377974957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af752a80 0x5576af74c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:26.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.881+0000 7f6c3b400700 1 --2- 172.21.15.69:0/3377974957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af752a80 0x5576af74c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.881+0000 7f6c3b400700 1 -- 172.21.15.69:0/3377974957 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576af5bb8d0 con 0x5576af5cee40 2024-05-14T15:27:26.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.881+0000 7f6c33400700 1 -- 172.21.15.69:0/654640363 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f6c2c0e22a0 con 0x7f6c3c104410 2024-05-14T15:27:26.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.881+0000 7f6c3aa00700 1 --2- 172.21.15.69:0/3377974957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af752a80 0x5576af74c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:27:26.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.882+0000 7f6c3b400700 1 --2- 172.21.15.69:0/3377974957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af5cee40 0x5576af752540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009be0 tx=0x7f6c34009ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=30450f0a4aa96d59 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:26.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.882+0000 7f6c3b400700 1 --2- 172.21.15.69:0/654640363 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6c200b6f00 0x7f6c200b9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:26.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.882+0000 7f6c2be00700 1 -- 172.21.15.69:0/3377974957 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3400ecb0 con 0x5576af5cee40 2024-05-14T15:27:26.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.883+0000 7f6c2be00700 1 -- 172.21.15.69:0/3377974957 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c3400ee50 con 0x5576af5cee40 2024-05-14T15:27:26.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.883+0000 7f6c2be00700 1 -- 172.21.15.69:0/3377974957 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34018920 con 0x5576af5cee40 2024-05-14T15:27:26.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.884+0000 7f6c3b400700 1 --2- 172.21.15.69:0/654640363 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6c200b6f00 0x7f6c200b9410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6c34019000 tx=0x7f6c34018ba0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:26.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.884+0000 7f6c5028cb80 1 -- 172.21.15.69:0/3377974957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af5cee40 msgr2=0x5576af752540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:26.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.884+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/3377974957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af5cee40 0x5576af752540 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f6c34009be0 tx=0x7f6c34009ef0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.885+0000 7f6c5028cb80 1 -- 172.21.15.69:0/3377974957 shutdown_connections 2024-05-14T15:27:26.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.885+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/3377974957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af74cc40 0x5576af74d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.885+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/3377974957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af5cee40 0x5576af752540 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.885+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/3377974957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af752a80 0x5576af74c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.885+0000 7f6c5028cb80 1 -- 172.21.15.69:0/3377974957 >> 172.21.15.69:0/3377974957 conn(0x5576af613f70 msgr2=0x5576af747400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:26.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.885+0000 7f6c5028cb80 1 -- 172.21.15.69:0/3377974957 shutdown_connections 2024-05-14T15:27:26.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.885+0000 7f6c5028cb80 1 -- 172.21.15.69:0/3377974957 wait complete. 2024-05-14T15:27:26.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.886+0000 7f6c5028cb80 1 -- start start 2024-05-14T15:27:26.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.886+0000 7f6c5028cb80 1 Processor -- start 2024-05-14T15:27:26.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.887+0000 7f6c5028cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af5cee40 0x5576af756170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.887+0000 7f6c5028cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af74cc40 0x5576af7566b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.887+0000 7f6c5028cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af752a80 0x5576af756bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.888+0000 7f6c5028cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5576af759490 con 0x5576af752a80 2024-05-14T15:27:26.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.888+0000 7f6c5028cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5576af5d4b20 con 0x5576af5cee40 2024-05-14T15:27:26.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.888+0000 7f6c5028cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5576af759610 con 0x5576af74cc40 2024-05-14T15:27:26.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.888+0000 7f6c5028cb80 10 client.0 _ll_register_callbacks cb 0x5576af615c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:26.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.889+0000 7f6c3aa00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af5cee40 0x5576af756170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:26.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.889+0000 7f6c3b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af752a80 0x5576af756bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:26.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.889+0000 7f6c3b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af752a80 0x5576af756bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51710/0 (socket says 172.21.15.69:51710) 2024-05-14T15:27:26.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.889+0000 7f6c3b400700 1 -- 172.21.15.69:0/942917063 learned_addr learned my addr 172.21.15.69:0/942917063 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:26.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.889+0000 7f6c3b400700 1 -- 172.21.15.69:0/942917063 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af74cc40 msgr2=0x5576af7566b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:27:26.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.889+0000 7f6c3b400700 1 --2- 172.21.15.69:0/942917063 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af74cc40 0x5576af7566b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.892 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.890+0000 7f6c3b400700 1 -- 172.21.15.69:0/942917063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af5cee40 msgr2=0x5576af756170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:26.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.890+0000 7f6c3b400700 1 --2- 172.21.15.69:0/942917063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af5cee40 0x5576af756170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.890+0000 7f6c3b400700 1 -- 172.21.15.69:0/942917063 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576af634420 con 0x5576af752a80 2024-05-14T15:27:26.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.890+0000 7f6c3b400700 1 --2- 172.21.15.69:0/942917063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af752a80 0x5576af756bf0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400fe10 tx=0x7f6c3401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9a3cfd07cedbf0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:26.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.890+0000 7f6c28c00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:27:26.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.892+0000 7f6c28c00700 1 -- 172.21.15.69:0/942917063 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34033020 con 0x5576af752a80 2024-05-14T15:27:26.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.892+0000 7f6c28c00700 1 -- 172.21.15.69:0/942917063 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f6c34018770 con 0x5576af752a80 2024-05-14T15:27:26.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.893+0000 7f6c5028cb80 1 -- 172.21.15.69:0/942917063 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c3400ee50 con 0x5576af752a80 2024-05-14T15:27:26.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.894+0000 7f6c28c00700 1 -- 172.21.15.69:0/942917063 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f6c34010430 con 0x5576af752a80 2024-05-14T15:27:26.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.894+0000 7f6c5028cb80 10 client.16497 fetch_fsmap learned FSMap version 48 2024-05-14T15:27:26.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.894+0000 7f6c5028cb80 1 -- 172.21.15.69:0/942917063 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5576af762970 con 0x5576af752a80 2024-05-14T15:27:26.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.895+0000 7f6c28c00700 1 -- 172.21.15.69:0/942917063 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c3400ee50 con 0x5576af752a80 2024-05-14T15:27:26.897 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.896+0000 7f6c28c00700 1 -- 172.21.15.69:0/942917063 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 48) ==== 8418+0+0 (secure 0 0 0) 0x7f6c34023440 con 0x5576af752a80 2024-05-14T15:27:26.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.896+0000 7f6c5028cb80 10 client.16497 fetch_fsmap finished waiting for FSMap version 48 2024-05-14T15:27:26.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.896+0000 7f6c5028cb80 10 client.16497 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:27:26.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.896+0000 7f6c5028cb80 20 client.16497 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:26.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.896+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/942917063 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5576af764f00 0x5576af767320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.896+0000 7f6c5028cb80 4 client.16497 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:27:26.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.896+0000 7f6c5028cb80 1 -- 172.21.15.69:0/942917063 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5576af7191c0 con 0x5576af764f00 2024-05-14T15:27:26.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.897+0000 7f6c3aa00700 1 --2- 172.21.15.69:0/942917063 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5576af764f00 0x5576af767320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:26.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.897+0000 7f6c28c00700 10 client.16497 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:26.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.897+0000 7f6c3aa00700 1 --2- 172.21.15.69:0/942917063 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5576af764f00 0x5576af767320 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b5538037a4c23dba server_cookie=7a71cdbba12e7230 in_seq=0 out_seq=0 2024-05-14T15:27:26.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.898+0000 7f6c28c00700 1 -- 172.21.15.69:0/942917063 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5576af7191c0 con 0x5576af764f00 2024-05-14T15:27:26.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.898+0000 7f6c28c00700 10 client.16497 handle_command_reply: tid=0 2024-05-14T15:27:26.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.898+0000 7f6c5028cb80 1 client.16497 shutdown 2024-05-14T15:27:26.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.899+0000 7f6c5028cb80 1 -- 172.21.15.69:0/942917063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af752a80 msgr2=0x5576af756bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:26.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.899+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/942917063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af752a80 0x5576af756bf0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400fe10 tx=0x7f6c3401a000 comp rx=0 tx=0).stop 2024-05-14T15:27:26.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.899+0000 7f6c5028cb80 1 -- 172.21.15.69:0/942917063 shutdown_connections 2024-05-14T15:27:26.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.899+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/942917063 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5576af764f00 0x5576af767320 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.899+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/942917063 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af752a80 0x5576af756bf0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.899+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/942917063 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af5cee40 0x5576af756170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.899+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/942917063 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af74cc40 0x5576af7566b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.900+0000 7f6c5028cb80 1 -- 172.21.15.69:0/942917063 >> 172.21.15.69:0/942917063 conn(0x5576af613f70 msgr2=0x5576af74b6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:26.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.900+0000 7f6c28c00700 0 client.16497 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:26.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.900+0000 7f6c5028cb80 1 -- 172.21.15.69:0/942917063 shutdown_connections 2024-05-14T15:27:26.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.900+0000 7f6c5028cb80 1 -- 172.21.15.69:0/942917063 wait complete. 2024-05-14T15:27:26.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.900+0000 7f6c5028cb80 20 client.16497 trim_cache size 0 max 16384 2024-05-14T15:27:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.936+0000 7f6c5028cb80 1 Processor -- start 2024-05-14T15:27:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.936+0000 7f6c5028cb80 1 -- start start 2024-05-14T15:27:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.936+0000 7f6c5028cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af5cee40 0x5576af74c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.936+0000 7f6c5028cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af74cc40 0x5576af756840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.936+0000 7f6c5028cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af752a80 0x5576af76a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.936+0000 7f6c5028cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c1ae2a0 con 0x5576af5cee40 2024-05-14T15:27:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.936+0000 7f6c5028cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c1b0020 con 0x5576af74cc40 2024-05-14T15:27:26.941 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.936+0000 7f6c5028cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c1aea30 con 0x5576af752a80 2024-05-14T15:27:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.938+0000 7f6c3aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af5cee40 0x5576af74c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.938+0000 7f6c3aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af5cee40 0x5576af74c700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51718/0 (socket says 172.21.15.69:51718) 2024-05-14T15:27:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.938+0000 7f6c3aa00700 1 -- 172.21.15.69:0/2801532007 learned_addr learned my addr 172.21.15.69:0/2801532007 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.938+0000 7f6c33e00700 1 --2- 172.21.15.69:0/2801532007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af74cc40 0x5576af756840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.938+0000 7f6c3b400700 1 --2- 172.21.15.69:0/2801532007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af752a80 0x5576af76a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:26.942 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.939+0000 7f6c3aa00700 1 -- 172.21.15.69:0/2801532007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af752a80 msgr2=0x5576af76a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.939+0000 7f6c3aa00700 1 --2- 172.21.15.69:0/2801532007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af752a80 0x5576af76a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.939+0000 7f6c3aa00700 1 -- 172.21.15.69:0/2801532007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af74cc40 msgr2=0x5576af756840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.939+0000 7f6c3aa00700 1 --2- 172.21.15.69:0/2801532007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af74cc40 0x5576af756840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.939+0000 7f6c3aa00700 1 -- 172.21.15.69:0/2801532007 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5576af755f40 con 0x5576af5cee40 2024-05-14T15:27:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.940+0000 7f6c3aa00700 1 --2- 172.21.15.69:0/2801532007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af5cee40 0x5576af74c700 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009990 tx=0x7f6c2c0096c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c89235cccf5477 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.940+0000 7f6c2b400700 1 -- 172.21.15.69:0/2801532007 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0ad520 con 0x5576af5cee40 2024-05-14T15:27:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.940+0000 7f6c2b400700 1 -- 172.21.15.69:0/2801532007 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c2c0b1fd0 con 0x5576af5cee40 2024-05-14T15:27:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.940+0000 7f6c2b400700 1 -- 172.21.15.69:0/2801532007 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0a93d0 con 0x5576af5cee40 2024-05-14T15:27:26.943 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.942+0000 7f6c5028cb80 1 -- 172.21.15.69:0/2801532007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af5cee40 msgr2=0x5576af74c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.942+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/2801532007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af5cee40 0x5576af74c700 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009990 tx=0x7f6c2c0096c0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.942+0000 7f6c5028cb80 1 -- 172.21.15.69:0/2801532007 shutdown_connections 2024-05-14T15:27:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.942+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/2801532007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af5cee40 0x5576af74c700 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.942+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/2801532007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af752a80 0x5576af76a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.943+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/2801532007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af74cc40 0x5576af756840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.943+0000 7f6c5028cb80 1 -- 172.21.15.69:0/2801532007 >> 172.21.15.69:0/2801532007 conn(0x5576af613f70 msgr2=0x5576af756130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:26.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.943+0000 7f6c5028cb80 1 -- 172.21.15.69:0/2801532007 shutdown_connections 2024-05-14T15:27:26.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.944+0000 7f6c5028cb80 1 -- 172.21.15.69:0/2801532007 wait complete. 2024-05-14T15:27:26.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.944+0000 7f6c5028cb80 1 -- start start 2024-05-14T15:27:26.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.945+0000 7f6c5028cb80 1 Processor -- start 2024-05-14T15:27:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.945+0000 7f6c5028cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af5cee40 0x5576af7716c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.945+0000 7f6c5028cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af74cc40 0x5576af771c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.945+0000 7f6c5028cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af752a80 0x5576af76e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.945+0000 7f6c5028cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c1af8c0 con 0x5576af5cee40 2024-05-14T15:27:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.945+0000 7f6c5028cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c1af130 con 0x5576af74cc40 2024-05-14T15:27:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.945+0000 7f6c5028cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c3c1ac240 con 0x5576af752a80 2024-05-14T15:27:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.946+0000 7f6c5028cb80 10 client.0 _ll_register_callbacks cb 0x5576af615c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.946+0000 7f6c3aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af5cee40 0x5576af7716c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.946+0000 7f6c33e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af74cc40 0x5576af771c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.946+0000 7f6c3aa00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af5cee40 0x5576af7716c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51720/0 (socket says 172.21.15.69:51720) 2024-05-14T15:27:26.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.946+0000 7f6c3aa00700 1 -- 172.21.15.69:0/3220572275 learned_addr learned my addr 172.21.15.69:0/3220572275 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:26.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.947+0000 7f6c33e00700 1 -- 172.21.15.69:0/3220572275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af752a80 msgr2=0x5576af76e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:26.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.947+0000 7f6c33e00700 1 --2- 172.21.15.69:0/3220572275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af752a80 0x5576af76e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.947+0000 7f6c33e00700 1 -- 172.21.15.69:0/3220572275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af5cee40 msgr2=0x5576af7716c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:26.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.947+0000 7f6c33e00700 1 --2- 172.21.15.69:0/3220572275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af5cee40 0x5576af7716c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.947+0000 7f6c33e00700 1 -- 172.21.15.69:0/3220572275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5576af76ebd0 con 0x5576af74cc40 2024-05-14T15:27:26.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.948+0000 7f6c33e00700 1 --2- 172.21.15.69:0/3220572275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af74cc40 0x5576af771c00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6c240098e0 tx=0x7f6c240057e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=db8e115329f22e56 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:26.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.948+0000 7f6c28c00700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:27:26.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.949+0000 7f6c28c00700 1 -- 172.21.15.69:0/3220572275 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c240039c0 con 0x5576af74cc40 2024-05-14T15:27:26.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.949+0000 7f6c28c00700 1 -- 172.21.15.69:0/3220572275 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f6c24003b60 con 0x5576af74cc40 2024-05-14T15:27:26.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.949+0000 7f6c5028cb80 1 -- 172.21.15.69:0/3220572275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c2c0b1fd0 con 0x5576af74cc40 2024-05-14T15:27:26.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.952+0000 7f6c28c00700 1 -- 172.21.15.69:0/3220572275 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7f6c24009e60 con 0x5576af74cc40 2024-05-14T15:27:26.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.952+0000 7f6c5028cb80 10 client.35996 fetch_fsmap learned FSMap version 48 2024-05-14T15:27:26.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.952+0000 7f6c5028cb80 1 -- 172.21.15.69:0/3220572275 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=4+}) -- 0x5576af7d09c0 con 0x5576af74cc40 2024-05-14T15:27:26.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.953+0000 7f6c28c00700 1 -- 172.21.15.69:0/3220572275 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c2c0b1fd0 con 0x5576af74cc40 2024-05-14T15:27:26.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.953+0000 7f6c28c00700 1 -- 172.21.15.69:0/3220572275 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 48) ==== 8418+0+0 (secure 0 0 0) 0x7f6c24023550 con 0x5576af74cc40 2024-05-14T15:27:26.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.953+0000 7f6c5028cb80 10 client.35996 fetch_fsmap finished waiting for FSMap version 48 2024-05-14T15:27:26.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.953+0000 7f6c5028cb80 10 client.35996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:27:26.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.953+0000 7f6c5028cb80 20 client.35996 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:26.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.953+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/3220572275 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5576af7d1150 0x5576af7d3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:26.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.953+0000 7f6c5028cb80 4 client.35996 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T15:27:26.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.953+0000 7f6c5028cb80 1 -- 172.21.15.69:0/3220572275 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5576af67c400 con 0x5576af7d1150 2024-05-14T15:27:26.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.954+0000 7f6c3aa00700 1 --2- 172.21.15.69:0/3220572275 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5576af7d1150 0x5576af7d3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:26.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.955+0000 7f6c28c00700 10 client.35996 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:26.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.955+0000 7f6c3aa00700 1 --2- 172.21.15.69:0/3220572275 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5576af7d1150 0x5576af7d3570 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a11f800fb1bf8bf server_cookie=2065f2d588bc16bf in_seq=0 out_seq=0 2024-05-14T15:27:26.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.956+0000 7f6c28c00700 1 -- 172.21.15.69:0/3220572275 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5576af67c400 con 0x5576af7d1150 2024-05-14T15:27:26.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.956+0000 7f6c28c00700 10 client.35996 handle_command_reply: tid=0 2024-05-14T15:27:26.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.956+0000 7f6c5028cb80 1 client.35996 shutdown 2024-05-14T15:27:26.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.956+0000 7f6c5028cb80 1 -- 172.21.15.69:0/3220572275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af74cc40 msgr2=0x5576af771c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:26.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.956+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/3220572275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af74cc40 0x5576af771c00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6c240098e0 tx=0x7f6c240057e0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.957+0000 7f6c5028cb80 1 -- 172.21.15.69:0/3220572275 shutdown_connections 2024-05-14T15:27:26.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.957+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/3220572275 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5576af7d1150 0x5576af7d3570 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.957+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/3220572275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5576af5cee40 0x5576af7716c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.957+0000 7f6c28c00700 0 client.35996 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:26.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.958+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/3220572275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5576af752a80 0x5576af76e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.958+0000 7f6c5028cb80 1 --2- 172.21.15.69:0/3220572275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5576af74cc40 0x5576af771c00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.958+0000 7f6c5028cb80 1 -- 172.21.15.69:0/3220572275 >> 172.21.15.69:0/3220572275 conn(0x5576af613f70 msgr2=0x5576af754df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:26.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.959+0000 7f6c5028cb80 1 -- 172.21.15.69:0/3220572275 shutdown_connections 2024-05-14T15:27:26.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.959+0000 7f6c5028cb80 1 -- 172.21.15.69:0/3220572275 wait complete. 2024-05-14T15:27:26.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.959+0000 7f6c5028cb80 20 client.35996 trim_cache size 0 max 16384 2024-05-14T15:27:26.960 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:27:26.960 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2024-05-14T15:27:26.961 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2024-05-14T15:27:26.961 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:27:26.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.960+0000 7f6c3be00700 1 -- 172.21.15.69:0/654640363 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6c200b6f00 msgr2=0x7f6c200b9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:26.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.960+0000 7f6c3be00700 1 --2- 172.21.15.69:0/654640363 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6c200b6f00 0x7f6c200b9410 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6c34019000 tx=0x7f6c34018ba0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.960+0000 7f6c3be00700 1 -- 172.21.15.69:0/654640363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c104410 msgr2=0x7f6c3c1a0790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:26.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.960+0000 7f6c3be00700 1 --2- 172.21.15.69:0/654640363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c104410 0x7f6c3c1a0790 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c0060b0 tx=0x7f6c2c007f90 comp rx=0 tx=0).stop 2024-05-14T15:27:26.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.961+0000 7f6c3be00700 1 -- 172.21.15.69:0/654640363 shutdown_connections 2024-05-14T15:27:26.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.961+0000 7f6c3be00700 1 --2- 172.21.15.69:0/654640363 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6c200b6f00 0x7f6c200b9410 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.961+0000 7f6c3be00700 1 --2- 172.21.15.69:0/654640363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c3c109690 0x7f6c3c19a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.961+0000 7f6c3be00700 1 --2- 172.21.15.69:0/654640363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c3c104410 0x7f6c3c1a0790 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.961+0000 7f6c3be00700 1 --2- 172.21.15.69:0/654640363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c3c108d40 0x7f6c3c1a0cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:26.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.961+0000 7f6c3be00700 1 -- 172.21.15.69:0/654640363 >> 172.21.15.69:0/654640363 conn(0x7f6c3c079c20 msgr2=0x7f6c3c101970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:26.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.961+0000 7f6c3be00700 1 -- 172.21.15.69:0/654640363 shutdown_connections 2024-05-14T15:27:26.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:26.962+0000 7f6c3be00700 1 -- 172.21.15.69:0/654640363 wait complete. 2024-05-14T15:27:27.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:27 smithi092 ceph-mon[34729]: pgmap v177: 129 pgs: 129 active+clean; 1.7 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.2 MiB/s wr, 629 op/s 2024-05-14T15:27:27.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:27 smithi069 ceph-mon[31270]: pgmap v177: 129 pgs: 129 active+clean; 1.7 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.2 MiB/s wr, 629 op/s 2024-05-14T15:27:27.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:27 smithi203 ceph-mon[34567]: pgmap v177: 129 pgs: 129 active+clean; 1.7 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.2 MiB/s wr, 629 op/s 2024-05-14T15:27:28.012 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-14T15:27:28.012 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:27:28.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:28 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:27:28.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:28 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:27:28.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:28 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:27:28.743 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:27:29.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:29 smithi069 ceph-mon[31270]: pgmap v178: 129 pgs: 129 active+clean; 1.7 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.2 MiB/s wr, 629 op/s 2024-05-14T15:27:29.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:29 smithi203 ceph-mon[34567]: pgmap v178: 129 pgs: 129 active+clean; 1.7 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.2 MiB/s wr, 629 op/s 2024-05-14T15:27:29.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:29 smithi092 ceph-mon[34729]: pgmap v178: 129 pgs: 129 active+clean; 1.7 GiB data, 5.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 5.2 MiB/s wr, 629 op/s 2024-05-14T15:27:31.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 105.0 s, 521.0 tps, lat 172.862 ms stddev 92.285 2024-05-14T15:27:31.385 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:31 smithi069 ceph-mon[31270]: pgmap v179: 129 pgs: 129 active+clean; 1.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 917 op/s 2024-05-14T15:27:31.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:31 smithi203 ceph-mon[34567]: pgmap v179: 129 pgs: 129 active+clean; 1.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 917 op/s 2024-05-14T15:27:31.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:31 smithi092 ceph-mon[34729]: pgmap v179: 129 pgs: 129 active+clean; 1.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 7.7 MiB/s wr, 917 op/s 2024-05-14T15:27:31.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.839+0000 7fb5e9a00700 1 -- 172.21.15.69:0/2232168446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5e4105be0 msgr2=0x7fb5e410e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:31.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.839+0000 7fb5e9a00700 1 --2- 172.21.15.69:0/2232168446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5e4105be0 0x7fb5e410e130 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fb5d0009990 tx=0x7fb5d0009ca0 comp rx=0 tx=0).stop 2024-05-14T15:27:31.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.839+0000 7fb5e9a00700 1 -- 172.21.15.69:0/2232168446 shutdown_connections 2024-05-14T15:27:31.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.840+0000 7fb5e9a00700 1 --2- 172.21.15.69:0/2232168446 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5e410e700 0x7fb5e4110be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:31.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.840+0000 7fb5e9a00700 1 --2- 172.21.15.69:0/2232168446 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e4105290 0x7fb5e41056a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:31.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.840+0000 7fb5e9a00700 1 --2- 172.21.15.69:0/2232168446 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5e4105be0 0x7fb5e410e130 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:31.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.840+0000 7fb5e9a00700 1 -- 172.21.15.69:0/2232168446 >> 172.21.15.69:0/2232168446 conn(0x7fb5e4078ac0 msgr2=0x7fb5e4078f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:31.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.840+0000 7fb5e9a00700 1 -- 172.21.15.69:0/2232168446 shutdown_connections 2024-05-14T15:27:31.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.840+0000 7fb5e9a00700 1 -- 172.21.15.69:0/2232168446 wait complete. 2024-05-14T15:27:31.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.841+0000 7fb5e9a00700 1 Processor -- start 2024-05-14T15:27:31.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.841+0000 7fb5e9a00700 1 -- start start 2024-05-14T15:27:31.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.842+0000 7fb5e9a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5e4105290 0x7fb5e41a0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:31.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.842+0000 7fb5e9a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e4105be0 0x7fb5e41a0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:31.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.842+0000 7fb5e9a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5e410e700 0x7fb5e419a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:31.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.842+0000 7fb5e9a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4114160 con 0x7fb5e4105290 2024-05-14T15:27:31.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.842+0000 7fb5e9a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e4113fe0 con 0x7fb5e4105be0 2024-05-14T15:27:31.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.842+0000 7fb5e9a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb5e41142e0 con 0x7fb5e410e700 2024-05-14T15:27:31.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.842+0000 7fb5e3e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5e4105290 0x7fb5e41a0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:31.844 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.842+0000 7fb5e3e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5e4105290 0x7fb5e41a0780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:51750/0 (socket says 172.21.15.69:51750) 2024-05-14T15:27:31.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.842+0000 7fb5e3e00700 1 -- 172.21.15.69:0/1168616305 learned_addr learned my addr 172.21.15.69:0/1168616305 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:31.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.842+0000 7fb5e3400700 1 --2- 172.21.15.69:0/1168616305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e4105be0 0x7fb5e41a0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:31.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.843+0000 7fb5e9000700 1 --2- 172.21.15.69:0/1168616305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5e410e700 0x7fb5e419a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:31.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.843+0000 7fb5e3e00700 1 -- 172.21.15.69:0/1168616305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5e410e700 msgr2=0x7fb5e419a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:31.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.843+0000 7fb5e3e00700 1 --2- 172.21.15.69:0/1168616305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5e410e700 0x7fb5e419a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:31.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.843+0000 7fb5e3e00700 1 -- 172.21.15.69:0/1168616305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e4105be0 msgr2=0x7fb5e41a0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:31.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.843+0000 7fb5e3e00700 1 --2- 172.21.15.69:0/1168616305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e4105be0 0x7fb5e41a0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:31.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.843+0000 7fb5e3e00700 1 -- 172.21.15.69:0/1168616305 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5e419b050 con 0x7fb5e4105290 2024-05-14T15:27:31.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.843+0000 7fb5e9000700 1 --2- 172.21.15.69:0/1168616305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5e410e700 0x7fb5e419a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:27:31.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.843+0000 7fb5e3e00700 1 --2- 172.21.15.69:0/1168616305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5e4105290 0x7fb5e41a0780 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400d950 tx=0x7fb5d400dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:31.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.844+0000 7fb5e0c00700 1 -- 172.21.15.69:0/1168616305 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d4016070 con 0x7fb5e4105290 2024-05-14T15:27:31.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.844+0000 7fb5e9a00700 1 -- 172.21.15.69:0/1168616305 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5e419b340 con 0x7fb5e4105290 2024-05-14T15:27:31.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.844+0000 7fb5e0c00700 1 -- 172.21.15.69:0/1168616305 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb5d4009dd0 con 0x7fb5e4105290 2024-05-14T15:27:31.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.844+0000 7fb5e0c00700 1 -- 172.21.15.69:0/1168616305 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5d400f3c0 con 0x7fb5e4105290 2024-05-14T15:27:31.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.844+0000 7fb5e9a00700 1 -- 172.21.15.69:0/1168616305 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5e4102eb0 con 0x7fb5e4105290 2024-05-14T15:27:31.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.845+0000 7fb5e9a00700 1 -- 172.21.15.69:0/1168616305 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5e40512c0 con 0x7fb5e4105290 2024-05-14T15:27:31.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.848+0000 7fb5e0c00700 1 -- 172.21.15.69:0/1168616305 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb5d4019070 con 0x7fb5e4105290 2024-05-14T15:27:31.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.850+0000 7fb5e0c00700 1 --2- 172.21.15.69:0/1168616305 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb5c80b6e80 0x7fb5c80b9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:31.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.851+0000 7fb5e0c00700 1 -- 172.21.15.69:0/1168616305 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fb5d40e25f0 con 0x7fb5e4105290 2024-05-14T15:27:31.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.851+0000 7fb5e3400700 1 --2- 172.21.15.69:0/1168616305 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb5c80b6e80 0x7fb5c80b9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:31.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.852+0000 7fb5e3400700 1 --2- 172.21.15.69:0/1168616305 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb5c80b6e80 0x7fb5c80b9390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4102740 tx=0x7fb5d0005fb0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:31.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:31.853+0000 7fb5e0c00700 1 -- 172.21.15.69:0/1168616305 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fb5d40a9bc0 con 0x7fb5e4105290 2024-05-14T15:27:32.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:32.233+0000 7fb5e9a00700 1 -- 172.21.15.69:0/1168616305 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb5e419bed0 con 0x7fb5e4105290 2024-05-14T15:27:32.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:32.234+0000 7fb5e0c00700 1 -- 172.21.15.69:0/1168616305 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) ==== 94+0+11957 (secure 0 0 0) 0x7fb5d40a94c0 con 0x7fb5e4105290 2024-05-14T15:27:32.237 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:27:32.237 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":49,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":49,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T15:16:11.716543+0000","modified":"2024-05-14T15:27:27.017469+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34490,"mds_1":34460,"mds_2":34433,"mds_3":34409,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":31,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[0,1,2,3],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":35,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[0],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34490":{"gid":34490,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34490,"qdb_cluster":[24451,34433,34409,34460,34490]},"id":1}]} 2024-05-14T15:27:32.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:32.238+0000 7fb5e9a00700 1 -- 172.21.15.69:0/1168616305 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb5c80b6e80 msgr2=0x7fb5c80b9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:32.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:32.238+0000 7fb5e9a00700 1 --2- 172.21.15.69:0/1168616305 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb5c80b6e80 0x7fb5c80b9390 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5e4102740 tx=0x7fb5d0005fb0 comp rx=0 tx=0).stop 2024-05-14T15:27:32.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:32.238+0000 7fb5e9a00700 1 -- 172.21.15.69:0/1168616305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5e4105290 msgr2=0x7fb5e41a0780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:32.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:32.238+0000 7fb5e9a00700 1 --2- 172.21.15.69:0/1168616305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5e4105290 0x7fb5e41a0780 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fb5d400d950 tx=0x7fb5d400dc60 comp rx=0 tx=0).stop 2024-05-14T15:27:32.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:32.238+0000 7fb5e9a00700 1 -- 172.21.15.69:0/1168616305 shutdown_connections 2024-05-14T15:27:32.241 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:32.238+0000 7fb5e9a00700 1 --2- 172.21.15.69:0/1168616305 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb5c80b6e80 0x7fb5c80b9390 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:32.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:32.238+0000 7fb5e9a00700 1 --2- 172.21.15.69:0/1168616305 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb5e4105290 0x7fb5e41a0780 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:32.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:32.238+0000 7fb5e9a00700 1 --2- 172.21.15.69:0/1168616305 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb5e410e700 0x7fb5e419a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:32.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:32.238+0000 7fb5e9a00700 1 --2- 172.21.15.69:0/1168616305 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb5e4105be0 0x7fb5e41a0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:32.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:32.239+0000 7fb5e9a00700 1 -- 172.21.15.69:0/1168616305 >> 172.21.15.69:0/1168616305 conn(0x7fb5e4078ac0 msgr2=0x7fb5e40fff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:32.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:32.239+0000 7fb5e9a00700 1 -- 172.21.15.69:0/1168616305 shutdown_connections 2024-05-14T15:27:32.242 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:32.239+0000 7fb5e9a00700 1 -- 172.21.15.69:0/1168616305 wait complete. 2024-05-14T15:27:32.247 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 49 2024-05-14T15:27:33.093 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-14T15:27:33.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:33 smithi069 ceph-mon[31270]: pgmap v180: 129 pgs: 129 active+clean; 1.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.1 MiB/s wr, 608 op/s 2024-05-14T15:27:33.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:33 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1168616305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:27:33.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:33 smithi203 ceph-mon[34567]: pgmap v180: 129 pgs: 129 active+clean; 1.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.1 MiB/s wr, 608 op/s 2024-05-14T15:27:33.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:33 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1168616305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:27:33.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:33 smithi092 ceph-mon[34729]: pgmap v180: 129 pgs: 129 active+clean; 1.8 GiB data, 5.5 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.1 MiB/s wr, 608 op/s 2024-05-14T15:27:33.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:33 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1168616305' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:27:33.762 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:27:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.855+0000 7f3c9fe00640 1 -- 172.21.15.69:0/1134805854 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c98114c90 msgr2=0x7f3c981170b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.855+0000 7f3c9fe00640 1 --2- 172.21.15.69:0/1134805854 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c98114c90 0x7f3c981170b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f3c90009ca0 tx=0x7f3c9002a950 comp rx=0 tx=0).stop 2024-05-14T15:27:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.855+0000 7f3c9fe00640 1 -- 172.21.15.69:0/1134805854 shutdown_connections 2024-05-14T15:27:33.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.855+0000 7f3c9fe00640 1 --2- 172.21.15.69:0/1134805854 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c98114c90 0x7f3c981170b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.855+0000 7f3c9fe00640 1 --2- 172.21.15.69:0/1134805854 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c98112330 0x7f3c98114750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.855+0000 7f3c9fe00640 1 --2- 172.21.15.69:0/1134805854 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c98075490 0x7f3c980758a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.855+0000 7f3c9fe00640 1 -- 172.21.15.69:0/1134805854 >> 172.21.15.69:0/1134805854 conn(0x7f3c980793d0 msgr2=0x7f3c98079810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:33.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.856+0000 7f3c9fe00640 1 -- 172.21.15.69:0/1134805854 shutdown_connections 2024-05-14T15:27:33.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.857+0000 7f3c9fe00640 1 -- 172.21.15.69:0/1134805854 wait complete. 2024-05-14T15:27:33.860 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.858+0000 7f3c9fe00640 1 Processor -- start 2024-05-14T15:27:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.860+0000 7f3c9fe00640 1 -- start start 2024-05-14T15:27:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.860+0000 7f3c9fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c98075490 0x7f3c981a0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.860+0000 7f3c9fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c98112330 0x7f3c981a12c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.860+0000 7f3c9fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c98114c90 0x7f3c981a5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.860+0000 7f3c9fe00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9811a320 con 0x7f3c98075490 2024-05-14T15:27:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.860+0000 7f3c9fe00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9811a1a0 con 0x7f3c98114c90 2024-05-14T15:27:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.860+0000 7f3c9fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3c9811a4a0 con 0x7f3c98112330 2024-05-14T15:27:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.861+0000 7f3c9d400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c98075490 0x7f3c981a0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.861+0000 7f3c9de00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c98114c90 0x7f3c981a5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.861+0000 7f3c9de00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c98114c90 0x7f3c981a5580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:59602/0 (socket says 172.21.15.69:59602) 2024-05-14T15:27:33.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.861+0000 7f3c9de00640 1 -- 172.21.15.69:0/3799334453 learned_addr learned my addr 172.21.15.69:0/3799334453 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.862+0000 7f3c9d400640 1 -- 172.21.15.69:0/3799334453 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c98112330 msgr2=0x7f3c981a12c0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-14T15:27:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.862+0000 7f3c9d400640 1 --2- 172.21.15.69:0/3799334453 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c98112330 0x7f3c981a12c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.862+0000 7f3c9d400640 1 -- 172.21.15.69:0/3799334453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c98114c90 msgr2=0x7f3c981a5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.862+0000 7f3c9d400640 1 --2- 172.21.15.69:0/3799334453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c98114c90 0x7f3c981a5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.862+0000 7f3c9d400640 1 -- 172.21.15.69:0/3799334453 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c981a5b40 con 0x7f3c98075490 2024-05-14T15:27:33.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.862+0000 7f3c9d400640 1 --2- 172.21.15.69:0/3799334453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c98075490 0x7f3c981a0d60 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400c9a0 tx=0x7f3c8400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:33.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.863+0000 7f3c96000640 1 -- 172.21.15.69:0/3799334453 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c84007bb0 con 0x7f3c98075490 2024-05-14T15:27:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.863+0000 7f3c96000640 1 -- 172.21.15.69:0/3799334453 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c84007d50 con 0x7f3c98075490 2024-05-14T15:27:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.863+0000 7f3c96000640 1 -- 172.21.15.69:0/3799334453 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c840186f0 con 0x7f3c98075490 2024-05-14T15:27:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.863+0000 7f3c9fe00640 1 -- 172.21.15.69:0/3799334453 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c981a5e30 con 0x7f3c98075490 2024-05-14T15:27:33.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.864+0000 7f3c9fe00640 1 -- 172.21.15.69:0/3799334453 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c981a6330 con 0x7f3c98075490 2024-05-14T15:27:33.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.870+0000 7f3c96000640 1 -- 172.21.15.69:0/3799334453 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3c8400f450 con 0x7f3c98075490 2024-05-14T15:27:33.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.873+0000 7f3ca6dfc740 1 Processor -- start 2024-05-14T15:27:33.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.874+0000 7f3ca6dfc740 1 -- start start 2024-05-14T15:27:33.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.875+0000 7f3c96000640 1 --2- 172.21.15.69:0/3799334453 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3c800b2ae0 0x7f3c800b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.875+0000 7f3c96000640 1 -- 172.21.15.69:0/3799334453 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f3c840e2a00 con 0x7f3c98075490 2024-05-14T15:27:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.876+0000 7f3c9de00640 1 --2- 172.21.15.69:0/3799334453 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3c800b2ae0 0x7f3c800b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.876+0000 7f3ca6dfc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2be1b0 0x55952d65f280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.876+0000 7f3ca6dfc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2952f0 0x55952d65f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.876+0000 7f3ca6dfc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d29d4d0 0x55952d65fd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.876+0000 7f3ca6dfc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55952d5c4550 con 0x55952d2952f0 2024-05-14T15:27:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.876+0000 7f3ca6dfc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55952d569bc0 con 0x55952d2be1b0 2024-05-14T15:27:33.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.876+0000 7f3ca6dfc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55952d5c0510 con 0x55952d29d4d0 2024-05-14T15:27:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.877+0000 7f3c9ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2952f0 0x55952d65f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.877+0000 7f3c9d400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2be1b0 0x55952d65f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.877+0000 7f3c9ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2952f0 0x55952d65f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33018/0 (socket says 172.21.15.69:33018) 2024-05-14T15:27:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.877+0000 7f3c9ca00640 1 -- 172.21.15.69:0/89091425 learned_addr learned my addr 172.21.15.69:0/89091425 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.877+0000 7f3c9d400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2be1b0 0x55952d65f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:59618/0 (socket says 172.21.15.69:59618) 2024-05-14T15:27:33.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.878+0000 7f3c9d400640 1 -- 172.21.15.69:0/89091425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d29d4d0 msgr2=0x55952d65fd00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:27:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.879+0000 7f3c9d400640 1 --2- 172.21.15.69:0/89091425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d29d4d0 0x55952d65fd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.879+0000 7f3c9d400640 1 -- 172.21.15.69:0/89091425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2952f0 msgr2=0x55952d65f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.879+0000 7f3c9d400640 1 --2- 172.21.15.69:0/89091425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2952f0 0x55952d65f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.879+0000 7f3c9d400640 1 -- 172.21.15.69:0/89091425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55952d2d6210 con 0x55952d2be1b0 2024-05-14T15:27:33.882 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.879+0000 7f3c9ca00640 1 --2- 172.21.15.69:0/89091425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2952f0 0x55952d65f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:27:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.880+0000 7f3c9d400640 1 --2- 172.21.15.69:0/89091425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2be1b0 0x55952d65f280 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3c840dfda0 tx=0x7f3c840b2200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3bc0d494f28672a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.880+0000 7f3c9de00640 1 --2- 172.21.15.69:0/3799334453 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3c800b2ae0 0x7f3c800b4ff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3c90009a60 tx=0x7f3c9002ae50 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.880+0000 7f3c8a600640 1 -- 172.21.15.69:0/89091425 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c840a9930 con 0x55952d2be1b0 2024-05-14T15:27:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.881+0000 7f3c8a600640 1 -- 172.21.15.69:0/89091425 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c840adce0 con 0x55952d2be1b0 2024-05-14T15:27:33.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.881+0000 7f3c8a600640 1 -- 172.21.15.69:0/89091425 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c840a5bc0 con 0x55952d2be1b0 2024-05-14T15:27:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.882+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/89091425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2be1b0 msgr2=0x55952d65f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.882+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/89091425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2be1b0 0x55952d65f280 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3c840dfda0 tx=0x7f3c840b2200 comp rx=0 tx=0).stop 2024-05-14T15:27:33.884 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.882+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/89091425 shutdown_connections 2024-05-14T15:27:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.882+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/89091425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d29d4d0 0x55952d65fd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.882+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/89091425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2952f0 0x55952d65f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.882+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/89091425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2be1b0 0x55952d65f280 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.882+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/89091425 >> 172.21.15.69:0/89091425 conn(0x55952d2b2300 msgr2=0x55952d65ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:33.885 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.883+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/89091425 shutdown_connections 2024-05-14T15:27:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.883+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/89091425 wait complete. 2024-05-14T15:27:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.883+0000 7f3ca6dfc740 1 -- start start 2024-05-14T15:27:33.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.884+0000 7f3ca6dfc740 1 Processor -- start 2024-05-14T15:27:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.885+0000 7f3ca6dfc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d2952f0 0x55952d669790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.885+0000 7f3ca6dfc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d29d4d0 0x55952d669cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.885+0000 7f3ca6dfc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2be1b0 0x55952d675890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.885+0000 7f3c9d400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d2952f0 0x55952d669790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:33.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.886+0000 7f3c9d400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d2952f0 0x55952d669790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:47830/0 (socket says 172.21.15.69:47830) 2024-05-14T15:27:33.888 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.886+0000 7f3c9de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2be1b0 0x55952d675890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:33.888 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.886+0000 7f3ca6dfc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55952d66c3b0 con 0x55952d2be1b0 2024-05-14T15:27:33.888 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.886+0000 7f3ca6dfc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55952d57d660 con 0x55952d29d4d0 2024-05-14T15:27:33.888 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.886+0000 7f3ca6dfc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55952d66c530 con 0x55952d2952f0 2024-05-14T15:27:33.888 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.886+0000 7f3c9de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2be1b0 0x55952d675890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33026/0 (socket says 172.21.15.69:33026) 2024-05-14T15:27:33.888 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.886+0000 7f3c9de00640 1 -- 172.21.15.69:0/292775719 learned_addr learned my addr 172.21.15.69:0/292775719 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:33.888 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.886+0000 7f3c9ca00640 1 --2- 172.21.15.69:0/292775719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d29d4d0 0x55952d669cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:33.888 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.886+0000 7f3ca6dfc740 10 client.0 _ll_register_callbacks cb 0x55952d547400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:33.889 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.886+0000 7f3c9de00640 1 -- 172.21.15.69:0/292775719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d2952f0 msgr2=0x55952d669790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:33.889 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.886+0000 7f3c9de00640 1 --2- 172.21.15.69:0/292775719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d2952f0 0x55952d669790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.889 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.886+0000 7f3c9de00640 1 -- 172.21.15.69:0/292775719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d29d4d0 msgr2=0x55952d669cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:33.889 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.886+0000 7f3c9de00640 1 --2- 172.21.15.69:0/292775719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d29d4d0 0x55952d669cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.889 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.887+0000 7f3c9de00640 1 -- 172.21.15.69:0/292775719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55952d3a2620 con 0x55952d2be1b0 2024-05-14T15:27:33.889 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.887+0000 7f3c9de00640 1 --2- 172.21.15.69:0/292775719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2be1b0 0x55952d675890 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3c90009dc0 tx=0x7f3c900095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=245c95c76368c91e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:33.889 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.887+0000 7f3c7ea00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:27:33.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.887+0000 7f3c7ea00640 1 -- 172.21.15.69:0/292775719 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c90034040 con 0x55952d2be1b0 2024-05-14T15:27:33.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.887+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/292775719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c840adce0 con 0x55952d2be1b0 2024-05-14T15:27:33.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.888+0000 7f3c7ea00640 1 -- 172.21.15.69:0/292775719 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f3c90004030 con 0x55952d2be1b0 2024-05-14T15:27:33.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.888+0000 7f3c7ea00640 1 -- 172.21.15.69:0/292775719 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f3c9005a050 con 0x55952d2be1b0 2024-05-14T15:27:33.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.888+0000 7f3ca6dfc740 10 client.16518 fetch_fsmap learned FSMap version 49 2024-05-14T15:27:33.890 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.888+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/292775719 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55952d6786a0 con 0x55952d2be1b0 2024-05-14T15:27:33.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.888+0000 7f3c7ea00640 1 -- 172.21.15.69:0/292775719 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c840adce0 con 0x55952d2be1b0 2024-05-14T15:27:33.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.889+0000 7f3c7ea00640 1 -- 172.21.15.69:0/292775719 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7f3c90044030 con 0x55952d2be1b0 2024-05-14T15:27:33.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.889+0000 7f3ca6dfc740 10 client.16518 fetch_fsmap finished waiting for FSMap version 49 2024-05-14T15:27:33.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.889+0000 7f3ca6dfc740 10 client.16518 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:27:33.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.889+0000 7f3ca6dfc740 20 client.16518 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:33.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.889+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/292775719 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55952d27cd80 0x55952d67bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.889+0000 7f3ca6dfc740 4 client.16518 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:27:33.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.889+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/292775719 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55952d5d2160 con 0x55952d27cd80 2024-05-14T15:27:33.892 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.890+0000 7f3c9d400640 1 --2- 172.21.15.69:0/292775719 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55952d27cd80 0x55952d67bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:33.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.891+0000 7f3c9d400640 1 --2- 172.21.15.69:0/292775719 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55952d27cd80 0x55952d67bc60 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=544732d9cb9b9e10 server_cookie=156369740db32f1f in_seq=0 out_seq=0 2024-05-14T15:27:33.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.891+0000 7f3c7ea00640 10 client.16518 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:33.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.892+0000 7f3c7ea00640 1 -- 172.21.15.69:0/292775719 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55952d5d2160 con 0x55952d27cd80 2024-05-14T15:27:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.892+0000 7f3c7ea00640 10 client.16518 handle_command_reply: tid=0 2024-05-14T15:27:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.892+0000 7f3ca6dfc740 1 client.16518 shutdown 2024-05-14T15:27:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.893+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/292775719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2be1b0 msgr2=0x55952d675890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:33.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.893+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/292775719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2be1b0 0x55952d675890 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3c90009dc0 tx=0x7f3c900095c0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.894+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/292775719 shutdown_connections 2024-05-14T15:27:33.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.894+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/292775719 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55952d27cd80 0x55952d67bc60 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.894+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/292775719 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2be1b0 0x55952d675890 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.894+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/292775719 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d29d4d0 0x55952d669cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.896 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.894+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/292775719 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d2952f0 0x55952d669790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.894+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/292775719 >> 172.21.15.69:0/292775719 conn(0x55952d2b2300 msgr2=0x55952d660fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:33.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.894+0000 7f3c7ea00640 0 client.16518 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:33.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.894+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/292775719 shutdown_connections 2024-05-14T15:27:33.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.894+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/292775719 wait complete. 2024-05-14T15:27:33.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.895+0000 7f3ca6dfc740 20 client.16518 trim_cache size 0 max 16384 2024-05-14T15:27:33.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.925+0000 7f3ca6dfc740 1 Processor -- start 2024-05-14T15:27:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.925+0000 7f3ca6dfc740 1 -- start start 2024-05-14T15:27:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.926+0000 7f3ca6dfc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2952f0 0x55952d65bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.926+0000 7f3ca6dfc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d29d4d0 0x55952d681420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.926+0000 7f3ca6dfc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2be1b0 0x55952d681960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.926+0000 7f3ca6dfc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3c981b7700 con 0x55952d2be1b0 2024-05-14T15:27:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.926+0000 7f3ca6dfc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3c981b94b0 con 0x55952d2952f0 2024-05-14T15:27:33.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.926+0000 7f3ca6dfc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3c981b7e90 con 0x55952d29d4d0 2024-05-14T15:27:33.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.927+0000 7f3c9de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2be1b0 0x55952d681960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:33.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.927+0000 7f3c9de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2be1b0 0x55952d681960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33032/0 (socket says 172.21.15.69:33032) 2024-05-14T15:27:33.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.927+0000 7f3c9de00640 1 -- 172.21.15.69:0/3667581895 learned_addr learned my addr 172.21.15.69:0/3667581895 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:33.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.927+0000 7f3c9ca00640 1 --2- 172.21.15.69:0/3667581895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d29d4d0 0x55952d681420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:33.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.928+0000 7f3c9de00640 1 -- 172.21.15.69:0/3667581895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d29d4d0 msgr2=0x55952d681420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:33.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.928+0000 7f3c9de00640 1 --2- 172.21.15.69:0/3667581895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d29d4d0 0x55952d681420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.928+0000 7f3c9de00640 1 -- 172.21.15.69:0/3667581895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2952f0 msgr2=0x55952d65bb00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:27:33.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.928+0000 7f3c9de00640 1 --2- 172.21.15.69:0/3667581895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2952f0 0x55952d65bb00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.928+0000 7f3c9de00640 1 -- 172.21.15.69:0/3667581895 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55952d660660 con 0x55952d2be1b0 2024-05-14T15:27:33.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.929+0000 7f3c9de00640 1 --2- 172.21.15.69:0/3667581895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2be1b0 0x55952d681960 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3c90030ae0 tx=0x7f3c9002f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a878780258459ec server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:33.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.930+0000 7f3c89c00640 1 -- 172.21.15.69:0/3667581895 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c90034070 con 0x55952d2be1b0 2024-05-14T15:27:33.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.930+0000 7f3c89c00640 1 -- 172.21.15.69:0/3667581895 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c9004c070 con 0x55952d2be1b0 2024-05-14T15:27:33.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.930+0000 7f3c89c00640 1 -- 172.21.15.69:0/3667581895 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c90004720 con 0x55952d2be1b0 2024-05-14T15:27:33.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.931+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/3667581895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2be1b0 msgr2=0x55952d681960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:33.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.931+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/3667581895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2be1b0 0x55952d681960 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f3c90030ae0 tx=0x7f3c9002f3a0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.932+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/3667581895 shutdown_connections 2024-05-14T15:27:33.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.932+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/3667581895 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d2be1b0 0x55952d681960 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.932+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/3667581895 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d29d4d0 0x55952d681420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.932+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/3667581895 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2952f0 0x55952d65bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.932+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/3667581895 >> 172.21.15.69:0/3667581895 conn(0x55952d2b2300 msgr2=0x55952d65b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:33.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.933+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/3667581895 shutdown_connections 2024-05-14T15:27:33.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.933+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/3667581895 wait complete. 2024-05-14T15:27:33.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.933+0000 7f3ca6dfc740 1 -- start start 2024-05-14T15:27:33.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.934+0000 7f3ca6dfc740 1 Processor -- start 2024-05-14T15:27:33.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.935+0000 7f3ca6dfc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2952f0 0x55952d66c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.935+0000 7f3ca6dfc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d29d4d0 0x55952d66ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.935+0000 7f3ca6dfc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d2be1b0 0x55952d66d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.935+0000 7f3ca6dfc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3c981b8d20 con 0x55952d29d4d0 2024-05-14T15:27:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.935+0000 7f3ca6dfc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3c981b8590 con 0x55952d2952f0 2024-05-14T15:27:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.935+0000 7f3ca6dfc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3c981b56e0 con 0x55952d2be1b0 2024-05-14T15:27:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.935+0000 7f3ca6dfc740 10 client.0 _ll_register_callbacks cb 0x7f3c900093e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.935+0000 7f3c9ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d29d4d0 0x55952d66ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.935+0000 7f3c9d400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2952f0 0x55952d66c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.936+0000 7f3c9de00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d2be1b0 0x55952d66d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.936+0000 7f3c9d400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2952f0 0x55952d66c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:59658/0 (socket says 172.21.15.69:59658) 2024-05-14T15:27:33.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.936+0000 7f3c9d400640 1 -- 172.21.15.69:0/2392437866 learned_addr learned my addr 172.21.15.69:0/2392437866 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.936+0000 7f3c9d400640 1 -- 172.21.15.69:0/2392437866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d2be1b0 msgr2=0x55952d66d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.936+0000 7f3c9d400640 1 --2- 172.21.15.69:0/2392437866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d2be1b0 0x55952d66d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.936+0000 7f3c9d400640 1 -- 172.21.15.69:0/2392437866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d29d4d0 msgr2=0x55952d66ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.936+0000 7f3c9d400640 1 --2- 172.21.15.69:0/2392437866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d29d4d0 0x55952d66ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.936+0000 7f3c9d400640 1 -- 172.21.15.69:0/2392437866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55952d6e1fc0 con 0x55952d2952f0 2024-05-14T15:27:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.936+0000 7f3c9ca00640 1 --2- 172.21.15.69:0/2392437866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d29d4d0 0x55952d66ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:27:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.937+0000 7f3c9d400640 1 --2- 172.21.15.69:0/2392437866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2952f0 0x55952d66c7b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3c840e03a0 tx=0x7f3c84007f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8b2a62d6eb3823 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.937+0000 7f3c7ea00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:27:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.937+0000 7f3c7ea00640 1 -- 172.21.15.69:0/2392437866 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c840b6070 con 0x55952d2952f0 2024-05-14T15:27:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.938+0000 7f3c7ea00640 1 -- 172.21.15.69:0/2392437866 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f3c840e0020 con 0x55952d2952f0 2024-05-14T15:27:33.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.938+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/2392437866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c9004c070 con 0x55952d2952f0 2024-05-14T15:27:33.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.939+0000 7f3c7ea00640 1 -- 172.21.15.69:0/2392437866 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f3c840adce0 con 0x55952d2952f0 2024-05-14T15:27:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.939+0000 7f3ca6dfc740 10 client.36017 fetch_fsmap learned FSMap version 49 2024-05-14T15:27:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.939+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/2392437866 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55952d6e30f0 con 0x55952d2952f0 2024-05-14T15:27:33.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.940+0000 7f3c7ea00640 1 -- 172.21.15.69:0/2392437866 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3c9004c070 con 0x55952d2952f0 2024-05-14T15:27:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.941+0000 7f3c7ea00640 1 -- 172.21.15.69:0/2392437866 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7f3c840b9020 con 0x55952d2952f0 2024-05-14T15:27:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.941+0000 7f3ca6dfc740 10 client.36017 fetch_fsmap finished waiting for FSMap version 49 2024-05-14T15:27:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.941+0000 7f3ca6dfc740 10 client.36017 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:27:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.941+0000 7f3ca6dfc740 20 client.36017 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.941+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/2392437866 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55952d2521c0 0x55952d6e54c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.941+0000 7f3ca6dfc740 4 client.36017 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:27:33.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.941+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/2392437866 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55952d5cbfd0 con 0x55952d2521c0 2024-05-14T15:27:33.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.942+0000 7f3c9ca00640 1 --2- 172.21.15.69:0/2392437866 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55952d2521c0 0x55952d6e54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.943+0000 7f3c7ea00640 10 client.36017 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:33.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.943+0000 7f3c9ca00640 1 --2- 172.21.15.69:0/2392437866 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55952d2521c0 0x55952d6e54c0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f94887faac909165 server_cookie=8e8f69d6189f77a2 in_seq=0 out_seq=0 2024-05-14T15:27:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.973+0000 7f3c7ea00640 1 -- 172.21.15.69:0/2392437866 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55952d5cbfd0 con 0x55952d2521c0 2024-05-14T15:27:33.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.973+0000 7f3c7ea00640 10 client.36017 handle_command_reply: tid=0 2024-05-14T15:27:33.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.973+0000 7f3ca6dfc740 1 client.36017 shutdown 2024-05-14T15:27:33.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.975+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/2392437866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2952f0 msgr2=0x55952d66c7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:33.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.975+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/2392437866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2952f0 0x55952d66c7b0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f3c840e03a0 tx=0x7f3c84007f20 comp rx=0 tx=0).stop 2024-05-14T15:27:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.976+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/2392437866 shutdown_connections 2024-05-14T15:27:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.976+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/2392437866 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55952d2be1b0 0x55952d66d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.976+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/2392437866 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55952d2521c0 0x55952d6e54c0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.976+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/2392437866 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55952d29d4d0 0x55952d66ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.976+0000 7f3ca6dfc740 1 --2- 172.21.15.69:0/2392437866 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55952d2952f0 0x55952d66c7b0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.976+0000 7f3c7ea00640 0 client.36017 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.976+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/2392437866 >> 172.21.15.69:0/2392437866 conn(0x55952d2b2300 msgr2=0x55952d65f220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.977+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/2392437866 shutdown_connections 2024-05-14T15:27:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.977+0000 7f3ca6dfc740 1 -- 172.21.15.69:0/2392437866 wait complete. 2024-05-14T15:27:33.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.977+0000 7f3ca6dfc740 20 client.36017 trim_cache size 0 max 16384 2024-05-14T15:27:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:27:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:27:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:27:33.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:27:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.978+0000 7f3c9fe00640 1 -- 172.21.15.69:0/3799334453 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3c800b2ae0 msgr2=0x7f3c800b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.978+0000 7f3c9fe00640 1 --2- 172.21.15.69:0/3799334453 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3c800b2ae0 0x7f3c800b4ff0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3c90009a60 tx=0x7f3c9002ae50 comp rx=0 tx=0).stop 2024-05-14T15:27:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.978+0000 7f3c9fe00640 1 -- 172.21.15.69:0/3799334453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c98075490 msgr2=0x7f3c981a0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.978+0000 7f3c9fe00640 1 --2- 172.21.15.69:0/3799334453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c98075490 0x7f3c981a0d60 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3c8400c9a0 tx=0x7f3c8400ce60 comp rx=0 tx=0).stop 2024-05-14T15:27:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.979+0000 7f3c9fe00640 1 -- 172.21.15.69:0/3799334453 shutdown_connections 2024-05-14T15:27:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.979+0000 7f3c9fe00640 1 --2- 172.21.15.69:0/3799334453 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3c800b2ae0 0x7f3c800b4ff0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.979+0000 7f3c9fe00640 1 --2- 172.21.15.69:0/3799334453 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3c98114c90 0x7f3c981a5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.979+0000 7f3c9fe00640 1 --2- 172.21.15.69:0/3799334453 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3c98112330 0x7f3c981a12c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.979+0000 7f3c9fe00640 1 --2- 172.21.15.69:0/3799334453 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3c98075490 0x7f3c981a0d60 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.979+0000 7f3c9fe00640 1 -- 172.21.15.69:0/3799334453 >> 172.21.15.69:0/3799334453 conn(0x7f3c980793d0 msgr2=0x7f3c98112740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:33.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.979+0000 7f3c9fe00640 1 -- 172.21.15.69:0/3799334453 shutdown_connections 2024-05-14T15:27:33.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:33.979+0000 7f3c9fe00640 1 -- 172.21.15.69:0/3799334453 wait complete. 2024-05-14T15:27:35.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:35 smithi203 ceph-mon[34567]: pgmap v181: 129 pgs: 129 active+clean; 1.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.8 MiB/s wr, 817 op/s 2024-05-14T15:27:35.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:35 smithi092 ceph-mon[34729]: pgmap v181: 129 pgs: 129 active+clean; 1.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.8 MiB/s wr, 817 op/s 2024-05-14T15:27:35.721 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:35 smithi069 ceph-mon[31270]: pgmap v181: 129 pgs: 129 active+clean; 1.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.8 MiB/s wr, 817 op/s 2024-05-14T15:27:36.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 110.0 s, 664.2 tps, lat 164.766 ms stddev 228.694 2024-05-14T15:27:36.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.479+0000 7fd6e2600700 1 -- 172.21.15.69:0/1151166234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6dc1030e0 msgr2=0x7fd6dc1034f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:36.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.479+0000 7fd6e2600700 1 --2- 172.21.15.69:0/1151166234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6dc1030e0 0x7fd6dc1034f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd6c40098f0 tx=0x7fd6c4009c00 comp rx=0 tx=0).stop 2024-05-14T15:27:36.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.479+0000 7fd6e2600700 1 -- 172.21.15.69:0/1151166234 shutdown_connections 2024-05-14T15:27:36.481 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.479+0000 7fd6e2600700 1 --2- 172.21.15.69:0/1151166234 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6dc110c90 0x7fd6dc1130b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.479+0000 7fd6e2600700 1 --2- 172.21.15.69:0/1151166234 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6dc1030e0 0x7fd6dc1034f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.479+0000 7fd6e2600700 1 --2- 172.21.15.69:0/1151166234 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6dc103a30 0x7fd6dc110750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.482 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.479+0000 7fd6e2600700 1 -- 172.21.15.69:0/1151166234 >> 172.21.15.69:0/1151166234 conn(0x7fd6dc0fedc0 msgr2=0x7fd6dc1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:36.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.480+0000 7fd6e2600700 1 -- 172.21.15.69:0/1151166234 shutdown_connections 2024-05-14T15:27:36.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.480+0000 7fd6e2600700 1 -- 172.21.15.69:0/1151166234 wait complete. 2024-05-14T15:27:36.484 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.482+0000 7fd6e2600700 1 Processor -- start 2024-05-14T15:27:36.485 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.483+0000 7fd6e2600700 1 -- start start 2024-05-14T15:27:36.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.484+0000 7fd6e2600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6dc1030e0 0x7fd6dc110650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.484+0000 7fd6e2600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6dc103a30 0x7fd6dc10d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.484+0000 7fd6e2600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6dc110c90 0x7fd6dc10d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.486 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.484+0000 7fd6e2600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc106d60 con 0x7fd6dc103a30 2024-05-14T15:27:36.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.484+0000 7fd6e2600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc106be0 con 0x7fd6dc110c90 2024-05-14T15:27:36.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.484+0000 7fd6e2600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc106ee0 con 0x7fd6dc1030e0 2024-05-14T15:27:36.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.485+0000 7fd6dbe00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6dc110c90 0x7fd6dc10d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:36.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.485+0000 7fd6d2a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6dc103a30 0x7fd6dc10d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:36.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.485+0000 7fd6dbe00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6dc110c90 0x7fd6dc10d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:59682/0 (socket says 172.21.15.69:59682) 2024-05-14T15:27:36.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.485+0000 7fd6dbe00700 1 -- 172.21.15.69:0/3453113091 learned_addr learned my addr 172.21.15.69:0/3453113091 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:36.487 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.485+0000 7fd6db400700 1 --2- 172.21.15.69:0/3453113091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6dc1030e0 0x7fd6dc110650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:36.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.486+0000 7fd6dbe00700 1 -- 172.21.15.69:0/3453113091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6dc1030e0 msgr2=0x7fd6dc110650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:36.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.486+0000 7fd6dbe00700 1 --2- 172.21.15.69:0/3453113091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6dc1030e0 0x7fd6dc110650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.486+0000 7fd6dbe00700 1 -- 172.21.15.69:0/3453113091 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6dc103a30 msgr2=0x7fd6dc10d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:36.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.486+0000 7fd6dbe00700 1 --2- 172.21.15.69:0/3453113091 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6dc103a30 0x7fd6dc10d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.486+0000 7fd6dbe00700 1 -- 172.21.15.69:0/3453113091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6dc10e020 con 0x7fd6dc110c90 2024-05-14T15:27:36.488 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.486+0000 7fd6d2a00700 1 --2- 172.21.15.69:0/3453113091 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6dc103a30 0x7fd6dc10d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:27:36.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.486+0000 7fd6dbe00700 1 --2- 172.21.15.69:0/3453113091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6dc110c90 0x7fd6dc10d7c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400c110 tx=0x7fd6d400c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:36.489 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.487+0000 7fd6d8c00700 1 -- 172.21.15.69:0/3453113091 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40092e0 con 0x7fd6dc110c90 2024-05-14T15:27:36.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.487+0000 7fd6d8c00700 1 -- 172.21.15.69:0/3453113091 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6d4004bb0 con 0x7fd6dc110c90 2024-05-14T15:27:36.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.487+0000 7fd6d8c00700 1 -- 172.21.15.69:0/3453113091 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d4007b20 con 0x7fd6dc110c90 2024-05-14T15:27:36.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.489+0000 7fd6e2600700 1 -- 172.21.15.69:0/3453113091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6dc10c110 con 0x7fd6dc110c90 2024-05-14T15:27:36.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.489+0000 7fd6e2600700 1 -- 172.21.15.69:0/3453113091 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6dc10c5d0 con 0x7fd6dc110c90 2024-05-14T15:27:36.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.499+0000 7fd6f1082b80 1 Processor -- start 2024-05-14T15:27:36.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.500+0000 7fd6d8c00700 1 -- 172.21.15.69:0/3453113091 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd6d401a070 con 0x7fd6dc110c90 2024-05-14T15:27:36.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.500+0000 7fd6f1082b80 1 -- start start 2024-05-14T15:27:36.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.502+0000 7fd6f1082b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e5236b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.502+0000 7fd6f1082b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e523bf0 0x56383e51d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.502+0000 7fd6d2a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e5236b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:36.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.502+0000 7fd6d2a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e5236b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:47884/0 (socket says 172.21.15.69:47884) 2024-05-14T15:27:36.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.503+0000 7fd6d8c00700 1 --2- 172.21.15.69:0/3453113091 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd6c00b2a70 0x7fd6c00b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.503+0000 7fd6d8c00700 1 -- 172.21.15.69:0/3453113091 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fd6d40e1cd0 con 0x7fd6dc110c90 2024-05-14T15:27:36.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.503+0000 7fd6d2a00700 1 -- 172.21.15.69:0/3519555215 learned_addr learned my addr 172.21.15.69:0/3519555215 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:36.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.503+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/3519555215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e51dc50 0x56383e51e060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.503+0000 7fd6f1082b80 1 -- 172.21.15.69:0/3519555215 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56383e43fa20 con 0x56383e51dc50 2024-05-14T15:27:36.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.503+0000 7fd6f1082b80 1 -- 172.21.15.69:0/3519555215 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56383e3dd760 con 0x56383e523bf0 2024-05-14T15:27:36.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.503+0000 7fd6f1082b80 1 -- 172.21.15.69:0/3519555215 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56383e43b9e0 con 0x56383e39fe40 2024-05-14T15:27:36.506 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.504+0000 7fd6d2a00700 1 --2- 172.21.15.69:0/3453113091 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd6c00b2a70 0x7fd6c00b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:36.507 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.505+0000 7fd6d2a00700 1 -- 172.21.15.69:0/3519555215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e523bf0 msgr2=0x56383e51d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:36.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.505+0000 7fd6d2a00700 1 --2- 172.21.15.69:0/3519555215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e523bf0 0x56383e51d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.505+0000 7fd6d2a00700 1 -- 172.21.15.69:0/3519555215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e51dc50 msgr2=0x56383e51e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:36.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.505+0000 7fd6d2a00700 1 --2- 172.21.15.69:0/3519555215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e51dc50 0x56383e51e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.505+0000 7fd6d2a00700 1 -- 172.21.15.69:0/3519555215 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383e38c8d0 con 0x56383e39fe40 2024-05-14T15:27:36.510 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.507+0000 7fd6d2a00700 1 --2- 172.21.15.69:0/3519555215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e5236b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc013c20 tx=0x7fd6cc013f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fc0fad8562574dc7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:36.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.508+0000 7fd6d2a00700 1 --2- 172.21.15.69:0/3453113091 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd6c00b2a70 0x7fd6c00b4f80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc01e000 tx=0x7fd6cc020000 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:36.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.508+0000 7fd6d0c00700 1 -- 172.21.15.69:0/3519555215 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc013120 con 0x56383e39fe40 2024-05-14T15:27:36.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.509+0000 7fd6d0c00700 1 -- 172.21.15.69:0/3519555215 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6cc023030 con 0x56383e39fe40 2024-05-14T15:27:36.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.510+0000 7fd6f1082b80 1 -- 172.21.15.69:0/3519555215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 msgr2=0x56383e5236b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:36.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.510+0000 7fd6d0c00700 1 -- 172.21.15.69:0/3519555215 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6cc010a00 con 0x56383e39fe40 2024-05-14T15:27:36.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.510+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/3519555215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e5236b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc013c20 tx=0x7fd6cc013f30 comp rx=0 tx=0).stop 2024-05-14T15:27:36.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.510+0000 7fd6f1082b80 1 -- 172.21.15.69:0/3519555215 shutdown_connections 2024-05-14T15:27:36.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.510+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/3519555215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e51dc50 0x56383e51e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.510+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/3519555215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e5236b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.510+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/3519555215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e523bf0 0x56383e51d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.510+0000 7fd6f1082b80 1 -- 172.21.15.69:0/3519555215 >> 172.21.15.69:0/3519555215 conn(0x56383e3dea80 msgr2=0x56383e518790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:36.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.510+0000 7fd6f1082b80 1 -- 172.21.15.69:0/3519555215 shutdown_connections 2024-05-14T15:27:36.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.510+0000 7fd6f1082b80 1 -- 172.21.15.69:0/3519555215 wait complete. 2024-05-14T15:27:36.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.511+0000 7fd6f1082b80 1 -- start start 2024-05-14T15:27:36.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.511+0000 7fd6f1082b80 1 Processor -- start 2024-05-14T15:27:36.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.512+0000 7fd6f1082b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e39fe40 0x56383e5274f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.514 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.512+0000 7fd6f1082b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e51dc50 0x56383e527a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.512+0000 7fd6f1082b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e523bf0 0x56383e527f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.512+0000 7fd6f1082b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56383e52a660 con 0x56383e39fe40 2024-05-14T15:27:36.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.512+0000 7fd6f1082b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56383e3a5b20 con 0x56383e51dc50 2024-05-14T15:27:36.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.512+0000 7fd6f1082b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56383e52a7e0 con 0x56383e523bf0 2024-05-14T15:27:36.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.512+0000 7fd6f1082b80 10 client.0 _ll_register_callbacks cb 0x56383e3d3380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:36.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.513+0000 7fd6dbe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e523bf0 0x56383e527f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:36.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.513+0000 7fd6dbe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e523bf0 0x56383e527f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:47890/0 (socket says 172.21.15.69:47890) 2024-05-14T15:27:36.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.513+0000 7fd6dbe00700 1 -- 172.21.15.69:0/4131859885 learned_addr learned my addr 172.21.15.69:0/4131859885 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:36.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.513+0000 7fd6d2a00700 1 --2- 172.21.15.69:0/4131859885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e51dc50 0x56383e527a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:36.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.513+0000 7fd6dbe00700 1 -- 172.21.15.69:0/4131859885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e51dc50 msgr2=0x56383e527a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:36.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.513+0000 7fd6dbe00700 1 --2- 172.21.15.69:0/4131859885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e51dc50 0x56383e527a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.513+0000 7fd6dbe00700 1 -- 172.21.15.69:0/4131859885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e39fe40 msgr2=0x56383e5274f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:27:36.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.513+0000 7fd6db400700 1 --2- 172.21.15.69:0/4131859885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e39fe40 0x56383e5274f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:36.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.513+0000 7fd6dbe00700 1 --2- 172.21.15.69:0/4131859885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e39fe40 0x56383e5274f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.513+0000 7fd6dbe00700 1 -- 172.21.15.69:0/4131859885 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56383e405420 con 0x56383e523bf0 2024-05-14T15:27:36.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.514+0000 7fd6dbe00700 1 --2- 172.21.15.69:0/4131859885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e523bf0 0x56383e527f70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40a4c80 tx=0x7fd6d40a8ae0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9aa42d0eb688efb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:36.517 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.514+0000 7fd6c9600700 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:27:36.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.515+0000 7fd6c9600700 1 -- 172.21.15.69:0/4131859885 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40a9300 con 0x56383e523bf0 2024-05-14T15:27:36.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.515+0000 7fd6c9600700 1 -- 172.21.15.69:0/4131859885 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fd6d40b17e0 con 0x56383e523bf0 2024-05-14T15:27:36.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.515+0000 7fd6f1082b80 1 -- 172.21.15.69:0/4131859885 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6cc023030 con 0x56383e523bf0 2024-05-14T15:27:36.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.515+0000 7fd6c9600700 1 -- 172.21.15.69:0/4131859885 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fd6d40a8c00 con 0x56383e523bf0 2024-05-14T15:27:36.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.516+0000 7fd6f1082b80 10 client.25996 fetch_fsmap learned FSMap version 49 2024-05-14T15:27:36.518 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.516+0000 7fd6f1082b80 1 -- 172.21.15.69:0/4131859885 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x56383e535460 con 0x56383e523bf0 2024-05-14T15:27:36.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.516+0000 7fd6c9600700 1 -- 172.21.15.69:0/4131859885 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6cc023030 con 0x56383e523bf0 2024-05-14T15:27:36.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.516+0000 7fd6c9600700 1 -- 172.21.15.69:0/4131859885 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7fd6d40a4570 con 0x56383e523bf0 2024-05-14T15:27:36.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.517+0000 7fd6f1082b80 10 client.25996 fetch_fsmap finished waiting for FSMap version 49 2024-05-14T15:27:36.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.517+0000 7fd6f1082b80 10 client.25996 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.i 2024-05-14T15:27:36.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.517+0000 7fd6f1082b80 20 client.25996 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:36.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.517+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/4131859885 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x56383e537af0 0x56383e539f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.517+0000 7fd6f1082b80 4 client.25996 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:27:36.519 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.517+0000 7fd6f1082b80 1 -- 172.21.15.69:0/4131859885 --> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56383e4ea070 con 0x56383e537af0 2024-05-14T15:27:36.520 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.518+0000 7fd6db400700 1 --2- 172.21.15.69:0/4131859885 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x56383e537af0 0x56383e539f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:36.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.519+0000 7fd6db400700 1 --2- 172.21.15.69:0/4131859885 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x56383e537af0 0x56383e539f10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=d8420316caad17f7 server_cookie=277097cd843ab5a8 in_seq=0 out_seq=0 2024-05-14T15:27:36.521 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.519+0000 7fd6c9600700 10 client.25996 ms_handle_connect on v2:172.21.15.203:6838/3167469844 2024-05-14T15:27:36.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.520+0000 7fd6c9600700 1 -- 172.21.15.69:0/4131859885 <== mds.4 v2:172.21.15.203:6838/3167469844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56383e4ea070 con 0x56383e537af0 2024-05-14T15:27:36.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.520+0000 7fd6c9600700 10 client.25996 handle_command_reply: tid=0 2024-05-14T15:27:36.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.521+0000 7fd6f1082b80 1 client.25996 shutdown 2024-05-14T15:27:36.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.521+0000 7fd6f1082b80 1 -- 172.21.15.69:0/4131859885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e523bf0 msgr2=0x56383e527f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:36.523 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.521+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/4131859885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e523bf0 0x56383e527f70 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40a4c80 tx=0x7fd6d40a8ae0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.524 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.521+0000 7fd6f1082b80 1 -- 172.21.15.69:0/4131859885 shutdown_connections 2024-05-14T15:27:36.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.521+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/4131859885 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x56383e537af0 0x56383e539f10 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.521+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/4131859885 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e39fe40 0x56383e5274f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.521+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/4131859885 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e523bf0 0x56383e527f70 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.521+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/4131859885 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e51dc50 0x56383e527a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.521+0000 7fd6f1082b80 1 -- 172.21.15.69:0/4131859885 >> 172.21.15.69:0/4131859885 conn(0x56383e3dea80 msgr2=0x56383e51c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:36.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.521+0000 7fd6c9600700 0 client.25996 ms_handle_reset on v2:172.21.15.203:6838/3167469844 2024-05-14T15:27:36.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.522+0000 7fd6f1082b80 1 -- 172.21.15.69:0/4131859885 shutdown_connections 2024-05-14T15:27:36.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.522+0000 7fd6f1082b80 1 -- 172.21.15.69:0/4131859885 wait complete. 2024-05-14T15:27:36.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.522+0000 7fd6f1082b80 20 client.25996 trim_cache size 0 max 16384 2024-05-14T15:27:36.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.553+0000 7fd6f1082b80 1 Processor -- start 2024-05-14T15:27:36.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.554+0000 7fd6f1082b80 1 -- start start 2024-05-14T15:27:36.556 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.554+0000 7fd6f1082b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e51d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.554+0000 7fd6f1082b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e51dc50 0x56383e512aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.554+0000 7fd6f1082b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e523bf0 0x56383e527bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.554+0000 7fd6f1082b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc1bf340 con 0x56383e523bf0 2024-05-14T15:27:36.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.554+0000 7fd6f1082b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc1c10f0 con 0x56383e51dc50 2024-05-14T15:27:36.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.554+0000 7fd6f1082b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc1bfad0 con 0x56383e39fe40 2024-05-14T15:27:36.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.555+0000 7fd6dbe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e523bf0 0x56383e527bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:36.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.555+0000 7fd6db400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e51d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:36.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.555+0000 7fd6db400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e51d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:47898/0 (socket says 172.21.15.69:47898) 2024-05-14T15:27:36.557 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.555+0000 7fd6db400700 1 -- 172.21.15.69:0/1677909323 learned_addr learned my addr 172.21.15.69:0/1677909323 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:36.558 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.555+0000 7fd6d2a00700 1 --2- 172.21.15.69:0/1677909323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e51dc50 0x56383e512aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:36.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.556+0000 7fd6dbe00700 1 -- 172.21.15.69:0/1677909323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 msgr2=0x56383e51d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:36.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.556+0000 7fd6dbe00700 1 --2- 172.21.15.69:0/1677909323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e51d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.556+0000 7fd6dbe00700 1 -- 172.21.15.69:0/1677909323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e51dc50 msgr2=0x56383e512aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:36.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.556+0000 7fd6dbe00700 1 --2- 172.21.15.69:0/1677909323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e51dc50 0x56383e512aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.556+0000 7fd6dbe00700 1 -- 172.21.15.69:0/1677909323 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56383e5130e0 con 0x56383e523bf0 2024-05-14T15:27:36.559 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.557+0000 7fd6dbe00700 1 --2- 172.21.15.69:0/1677909323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e523bf0 0x56383e527bc0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40a5e70 tx=0x7fd6d40094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46f15dc784c38189 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:36.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.558+0000 7fd6cbe00700 1 -- 172.21.15.69:0/1677909323 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40a9300 con 0x56383e523bf0 2024-05-14T15:27:36.560 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.558+0000 7fd6cbe00700 1 -- 172.21.15.69:0/1677909323 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6d40c32b0 con 0x56383e523bf0 2024-05-14T15:27:36.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.559+0000 7fd6f1082b80 1 -- 172.21.15.69:0/1677909323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e523bf0 msgr2=0x56383e527bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:36.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.560+0000 7fd6cbe00700 1 -- 172.21.15.69:0/1677909323 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6d40a9300 con 0x56383e523bf0 2024-05-14T15:27:36.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.560+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/1677909323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e523bf0 0x56383e527bc0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fd6d40a5e70 tx=0x7fd6d40094f0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.561+0000 7fd6f1082b80 1 -- 172.21.15.69:0/1677909323 shutdown_connections 2024-05-14T15:27:36.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.561+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/1677909323 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e523bf0 0x56383e527bc0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.561+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/1677909323 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e51d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.561+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/1677909323 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e51dc50 0x56383e512aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.561+0000 7fd6f1082b80 1 -- 172.21.15.69:0/1677909323 >> 172.21.15.69:0/1677909323 conn(0x56383e3dea80 msgr2=0x56383e5274b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:36.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.562+0000 7fd6f1082b80 1 -- 172.21.15.69:0/1677909323 shutdown_connections 2024-05-14T15:27:36.564 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.562+0000 7fd6f1082b80 1 -- 172.21.15.69:0/1677909323 wait complete. 2024-05-14T15:27:36.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.563+0000 7fd6f1082b80 1 -- start start 2024-05-14T15:27:36.565 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.563+0000 7fd6f1082b80 1 Processor -- start 2024-05-14T15:27:36.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.564+0000 7fd6f1082b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e52fe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.564+0000 7fd6f1082b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e51dc50 0x56383e53eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.567 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.564+0000 7fd6f1082b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e523bf0 0x56383e53f020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.564+0000 7fd6f1082b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc1c0960 con 0x56383e523bf0 2024-05-14T15:27:36.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.564+0000 7fd6f1082b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc1c01d0 con 0x56383e51dc50 2024-05-14T15:27:36.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.564+0000 7fd6f1082b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd6dc1bd2e0 con 0x56383e39fe40 2024-05-14T15:27:36.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.564+0000 7fd6f1082b80 10 client.0 _ll_register_callbacks cb 0x56383e3d3380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:36.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.565+0000 7fd6d2a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e51dc50 0x56383e53eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:36.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.565+0000 7fd6db400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e52fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:36.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.565+0000 7fd6db400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e52fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:47900/0 (socket says 172.21.15.69:47900) 2024-05-14T15:27:36.568 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.565+0000 7fd6db400700 1 -- 172.21.15.69:0/1239739426 learned_addr learned my addr 172.21.15.69:0/1239739426 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:36.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.567+0000 7fd6db400700 1 -- 172.21.15.69:0/1239739426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e51dc50 msgr2=0x56383e53eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:36.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.567+0000 7fd6db400700 1 --2- 172.21.15.69:0/1239739426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e51dc50 0x56383e53eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.567+0000 7fd6db400700 1 -- 172.21.15.69:0/1239739426 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e523bf0 msgr2=0x56383e53f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:36.569 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.566+0000 7fd6dbe00700 1 --2- 172.21.15.69:0/1239739426 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e523bf0 0x56383e53f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:36.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.567+0000 7fd6db400700 1 --2- 172.21.15.69:0/1239739426 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e523bf0 0x56383e53f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.567+0000 7fd6db400700 1 -- 172.21.15.69:0/1239739426 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56383e53f5e0 con 0x56383e39fe40 2024-05-14T15:27:36.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.568+0000 7fd6dbe00700 1 --2- 172.21.15.69:0/1239739426 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e523bf0 0x56383e53f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:27:36.570 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.568+0000 7fd6db400700 1 --2- 172.21.15.69:0/1239739426 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e52fe70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400c010 tx=0x7fd6c400f460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c61eaf4af8b63b7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:36.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.568+0000 7fd6d2a00700 1 --2- 172.21.15.69:0/1239739426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e51dc50 0x56383e53eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:27:36.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.568+0000 7fd6c9600700 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:27:36.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.569+0000 7fd6c9600700 1 -- 172.21.15.69:0/1239739426 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6c4005240 con 0x56383e39fe40 2024-05-14T15:27:36.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.569+0000 7fd6c9600700 1 -- 172.21.15.69:0/1239739426 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fd6c40053e0 con 0x56383e39fe40 2024-05-14T15:27:36.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.569+0000 7fd6f1082b80 1 -- 172.21.15.69:0/1239739426 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd6d40c32b0 con 0x56383e39fe40 2024-05-14T15:27:36.571 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.569+0000 7fd6c9600700 1 -- 172.21.15.69:0/1239739426 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fd6c4035050 con 0x56383e39fe40 2024-05-14T15:27:36.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.570+0000 7fd6f1082b80 10 client.26002 fetch_fsmap learned FSMap version 49 2024-05-14T15:27:36.572 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.570+0000 7fd6f1082b80 1 -- 172.21.15.69:0/1239739426 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x56383e5a2010 con 0x56383e39fe40 2024-05-14T15:27:36.573 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.570+0000 7fd6c9600700 1 -- 172.21.15.69:0/1239739426 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd6d40c32b0 con 0x56383e39fe40 2024-05-14T15:27:36.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.571+0000 7fd6c9600700 1 -- 172.21.15.69:0/1239739426 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7fd6c400b560 con 0x56383e39fe40 2024-05-14T15:27:36.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.571+0000 7fd6f1082b80 10 client.26002 fetch_fsmap finished waiting for FSMap version 49 2024-05-14T15:27:36.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.571+0000 7fd6f1082b80 10 client.26002 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.i 2024-05-14T15:27:36.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.571+0000 7fd6f1082b80 20 client.26002 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:36.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.571+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/1239739426 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x56383e5a2830 0x56383e5a4c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:36.574 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.571+0000 7fd6f1082b80 4 client.26002 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:27:36.575 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.571+0000 7fd6f1082b80 1 -- 172.21.15.69:0/1239739426 --> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56383e44d400 con 0x56383e5a2830 2024-05-14T15:27:36.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.573+0000 7fd6d2a00700 1 --2- 172.21.15.69:0/1239739426 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x56383e5a2830 0x56383e5a4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:36.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.574+0000 7fd6d2a00700 1 --2- 172.21.15.69:0/1239739426 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x56383e5a2830 0x56383e5a4c50 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c512eeb027a06983 server_cookie=c13b56a1b87f05e1 in_seq=0 out_seq=0 2024-05-14T15:27:36.576 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.574+0000 7fd6c9600700 10 client.26002 ms_handle_connect on v2:172.21.15.203:6838/3167469844 2024-05-14T15:27:36.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.575+0000 7fd6c9600700 1 -- 172.21.15.69:0/1239739426 <== mds.4 v2:172.21.15.203:6838/3167469844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56383e44d400 con 0x56383e5a2830 2024-05-14T15:27:36.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.575+0000 7fd6c9600700 10 client.26002 handle_command_reply: tid=0 2024-05-14T15:27:36.577 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.575+0000 7fd6f1082b80 1 client.26002 shutdown 2024-05-14T15:27:36.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.576+0000 7fd6f1082b80 1 -- 172.21.15.69:0/1239739426 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 msgr2=0x56383e52fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:36.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.576+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/1239739426 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e52fe70 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400c010 tx=0x7fd6c400f460 comp rx=0 tx=0).stop 2024-05-14T15:27:36.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.576+0000 7fd6f1082b80 1 -- 172.21.15.69:0/1239739426 shutdown_connections 2024-05-14T15:27:36.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.576+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/1239739426 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x56383e5a2830 0x56383e5a4c50 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.576+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/1239739426 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56383e523bf0 0x56383e53f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.578 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.576+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/1239739426 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56383e39fe40 0x56383e52fe70 secure :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400c010 tx=0x7fd6c400f460 comp rx=0 tx=0).stop 2024-05-14T15:27:36.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.576+0000 7fd6f1082b80 1 --2- 172.21.15.69:0/1239739426 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56383e51dc50 0x56383e53eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.576+0000 7fd6f1082b80 1 -- 172.21.15.69:0/1239739426 >> 172.21.15.69:0/1239739426 conn(0x56383e3dea80 msgr2=0x56383e5210d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:36.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.577+0000 7fd6c9600700 0 client.26002 ms_handle_reset on v2:172.21.15.203:6838/3167469844 2024-05-14T15:27:36.579 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.577+0000 7fd6f1082b80 1 -- 172.21.15.69:0/1239739426 shutdown_connections 2024-05-14T15:27:36.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.578+0000 7fd6f1082b80 1 -- 172.21.15.69:0/1239739426 wait complete. 2024-05-14T15:27:36.580 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.578+0000 7fd6f1082b80 20 client.26002 trim_cache size 0 max 16384 2024-05-14T15:27:36.581 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:27:36.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.580+0000 7fd6e2600700 1 -- 172.21.15.69:0/3453113091 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd6c00b2a70 msgr2=0x7fd6c00b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:36.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.580+0000 7fd6e2600700 1 --2- 172.21.15.69:0/3453113091 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd6c00b2a70 0x7fd6c00b4f80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd6cc01e000 tx=0x7fd6cc020000 comp rx=0 tx=0).stop 2024-05-14T15:27:36.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.580+0000 7fd6e2600700 1 -- 172.21.15.69:0/3453113091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6dc110c90 msgr2=0x7fd6dc10d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:36.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.580+0000 7fd6e2600700 1 --2- 172.21.15.69:0/3453113091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6dc110c90 0x7fd6dc10d7c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd6d400c110 tx=0x7fd6d400c420 comp rx=0 tx=0).stop 2024-05-14T15:27:36.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.580+0000 7fd6e2600700 1 -- 172.21.15.69:0/3453113091 shutdown_connections 2024-05-14T15:27:36.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.580+0000 7fd6e2600700 1 --2- 172.21.15.69:0/3453113091 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd6c00b2a70 0x7fd6c00b4f80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.580+0000 7fd6e2600700 1 --2- 172.21.15.69:0/3453113091 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6dc110c90 0x7fd6dc10d7c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.580+0000 7fd6e2600700 1 --2- 172.21.15.69:0/3453113091 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd6dc1030e0 0x7fd6dc110650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.580+0000 7fd6e2600700 1 --2- 172.21.15.69:0/3453113091 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6dc103a30 0x7fd6dc10d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:36.583 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.580+0000 7fd6e2600700 1 -- 172.21.15.69:0/3453113091 >> 172.21.15.69:0/3453113091 conn(0x7fd6dc0fedc0 msgr2=0x7fd6dc112830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:36.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.581+0000 7fd6e2600700 1 -- 172.21.15.69:0/3453113091 shutdown_connections 2024-05-14T15:27:36.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:36.581+0000 7fd6e2600700 1 -- 172.21.15.69:0/3453113091 wait complete. 2024-05-14T15:27:37.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:37 smithi069 ceph-mon[31270]: pgmap v182: 129 pgs: 129 active+clean; 1.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.2 MiB/s wr, 577 op/s 2024-05-14T15:27:37.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:37 smithi203 ceph-mon[34567]: pgmap v182: 129 pgs: 129 active+clean; 1.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.2 MiB/s wr, 577 op/s 2024-05-14T15:27:37.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:37 smithi092 ceph-mon[34729]: pgmap v182: 129 pgs: 129 active+clean; 1.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.2 MiB/s wr, 577 op/s 2024-05-14T15:27:39.548 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:39 smithi069 ceph-mon[31270]: pgmap v183: 129 pgs: 129 active+clean; 1.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.2 MiB/s wr, 577 op/s 2024-05-14T15:27:39.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:39 smithi203 ceph-mon[34567]: pgmap v183: 129 pgs: 129 active+clean; 1.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.2 MiB/s wr, 577 op/s 2024-05-14T15:27:39.625 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-14T15:27:39.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:39 smithi092 ceph-mon[34729]: pgmap v183: 129 pgs: 129 active+clean; 1.8 GiB data, 5.6 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.2 MiB/s wr, 577 op/s 2024-05-14T15:27:40.328 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:27:41.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 115.0 s, 572.8 tps, lat 175.299 ms stddev 104.660 2024-05-14T15:27:41.556 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:41 smithi069 ceph-mon[31270]: pgmap v184: 129 pgs: 129 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.7 MiB/s wr, 883 op/s 2024-05-14T15:27:41.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:41 smithi203 ceph-mon[34567]: pgmap v184: 129 pgs: 129 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.7 MiB/s wr, 883 op/s 2024-05-14T15:27:41.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:41 smithi092 ceph-mon[34729]: pgmap v184: 129 pgs: 129 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.7 MiB/s wr, 883 op/s 2024-05-14T15:27:42.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.842+0000 7fd608c00700 1 -- 172.21.15.69:0/1677494245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd604103250 msgr2=0x7fd604103660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:42.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.842+0000 7fd608c00700 1 --2- 172.21.15.69:0/1677494245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd604103250 0x7fd604103660 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4009990 tx=0x7fd5f4009ca0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.843+0000 7fd608c00700 1 -- 172.21.15.69:0/1677494245 shutdown_connections 2024-05-14T15:27:42.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.843+0000 7fd608c00700 1 --2- 172.21.15.69:0/1677494245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd6041086a0 0x7fd604108b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.843+0000 7fd608c00700 1 --2- 172.21.15.69:0/1677494245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd604103250 0x7fd604103660 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.843+0000 7fd608c00700 1 --2- 172.21.15.69:0/1677494245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd604103ba0 0x7fd6041080d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.843+0000 7fd608c00700 1 -- 172.21.15.69:0/1677494245 >> 172.21.15.69:0/1677494245 conn(0x7fd6040fedc0 msgr2=0x7fd6041011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:42.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.844+0000 7fd608c00700 1 -- 172.21.15.69:0/1677494245 shutdown_connections 2024-05-14T15:27:42.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.844+0000 7fd608c00700 1 -- 172.21.15.69:0/1677494245 wait complete. 2024-05-14T15:27:42.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.846+0000 7fd608c00700 1 Processor -- start 2024-05-14T15:27:42.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.846+0000 7fd608c00700 1 -- start start 2024-05-14T15:27:42.848 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.847+0000 7fd608c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd604103250 0x7fd6041a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.847+0000 7fd608c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd604103ba0 0x7fd6041a1900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.847+0000 7fd608c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6041086a0 0x7fd6041a5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.847+0000 7fd608c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd60411a970 con 0x7fd6041086a0 2024-05-14T15:27:42.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.847+0000 7fd608c00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd60411a7f0 con 0x7fd604103ba0 2024-05-14T15:27:42.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.847+0000 7fd608c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd60411aaf0 con 0x7fd604103250 2024-05-14T15:27:42.849 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.847+0000 7fd601400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd604103ba0 0x7fd6041a1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.848+0000 7fd601e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd604103250 0x7fd6041a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.848+0000 7fd601400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd604103ba0 0x7fd6041a1900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:37976/0 (socket says 172.21.15.69:37976) 2024-05-14T15:27:42.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.848+0000 7fd601400700 1 -- 172.21.15.69:0/1541750861 learned_addr learned my addr 172.21.15.69:0/1541750861 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:42.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.848+0000 7fd602800700 1 --2- 172.21.15.69:0/1541750861 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6041086a0 0x7fd6041a5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.849+0000 7fd601400700 1 -- 172.21.15.69:0/1541750861 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd604103250 msgr2=0x7fd6041a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:42.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.849+0000 7fd601400700 1 --2- 172.21.15.69:0/1541750861 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd604103250 0x7fd6041a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.849+0000 7fd601400700 1 -- 172.21.15.69:0/1541750861 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6041086a0 msgr2=0x7fd6041a5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:42.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.849+0000 7fd601400700 1 --2- 172.21.15.69:0/1541750861 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6041086a0 0x7fd6041a5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.849+0000 7fd601400700 1 -- 172.21.15.69:0/1541750861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6041a6180 con 0x7fd604103ba0 2024-05-14T15:27:42.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.849+0000 7fd601400700 1 --2- 172.21.15.69:0/1541750861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd604103ba0 0x7fd6041a1900 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000d950 tx=0x7fd5f000dc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:42.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.850+0000 7fd5faa00700 1 -- 172.21.15.69:0/1541750861 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0016070 con 0x7fd604103ba0 2024-05-14T15:27:42.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.850+0000 7fd5faa00700 1 -- 172.21.15.69:0/1541750861 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5f0009dd0 con 0x7fd604103ba0 2024-05-14T15:27:42.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.850+0000 7fd5faa00700 1 -- 172.21.15.69:0/1541750861 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f000f3c0 con 0x7fd604103ba0 2024-05-14T15:27:42.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.850+0000 7fd608c00700 1 -- 172.21.15.69:0/1541750861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6041a6470 con 0x7fd604103ba0 2024-05-14T15:27:42.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.851+0000 7fd608c00700 1 -- 172.21.15.69:0/1541750861 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6041a6960 con 0x7fd604103ba0 2024-05-14T15:27:42.861 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.858+0000 7fd617798b80 1 Processor -- start 2024-05-14T15:27:42.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.859+0000 7fd617798b80 1 -- start start 2024-05-14T15:27:42.862 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.860+0000 7fd617798b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558966eb7e40 0x55896703b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.860+0000 7fd617798b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55896703bbf0 0x558967035710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.860+0000 7fd617798b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 0x558967036060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.860+0000 7fd617798b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x558966f57a20 con 0x558966eb7e40 2024-05-14T15:27:42.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.860+0000 7fd617798b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558966ef5760 con 0x558967035c50 2024-05-14T15:27:42.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.860+0000 7fd617798b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558966f539e0 con 0x55896703bbf0 2024-05-14T15:27:42.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.860+0000 7fd601e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55896703bbf0 0x558967035710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.863 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.860+0000 7fd601e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55896703bbf0 0x558967035710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:43022/0 (socket says 172.21.15.69:43022) 2024-05-14T15:27:42.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.861+0000 7fd601e00700 1 -- 172.21.15.69:0/2045125627 learned_addr learned my addr 172.21.15.69:0/2045125627 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:42.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.861+0000 7fd5faa00700 1 -- 172.21.15.69:0/1541750861 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd5f0019070 con 0x7fd604103ba0 2024-05-14T15:27:42.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.861+0000 7fd601e00700 1 -- 172.21.15.69:0/2045125627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 msgr2=0x558967036060 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:27:42.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.861+0000 7fd601e00700 1 --2- 172.21.15.69:0/2045125627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 0x558967036060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.861+0000 7fd601e00700 1 -- 172.21.15.69:0/2045125627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558966eb7e40 msgr2=0x55896703b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:42.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.860+0000 7fd602800700 1 --2- 172.21.15.69:0/2045125627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558966eb7e40 0x55896703b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.862+0000 7fd601e00700 1 --2- 172.21.15.69:0/2045125627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558966eb7e40 0x55896703b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.862+0000 7fd601e00700 1 -- 172.21.15.69:0/2045125627 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558966ea48d0 con 0x55896703bbf0 2024-05-14T15:27:42.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.862+0000 7fd602800700 1 --2- 172.21.15.69:0/2045125627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558966eb7e40 0x55896703b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:27:42.865 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.863+0000 7fd601e00700 1 --2- 172.21.15.69:0/2045125627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55896703bbf0 0x558967035710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4015000 tx=0x7fd5f4009f20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=15e3d9a1ec3df92 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:42.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.863+0000 7fd5faa00700 1 --2- 172.21.15.69:0/1541750861 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5e80b2aa0 0x7fd5e80b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.864+0000 7fd5ef400700 1 -- 172.21.15.69:0/2045125627 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f4005400 con 0x55896703bbf0 2024-05-14T15:27:42.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.864+0000 7fd5faa00700 1 -- 172.21.15.69:0/1541750861 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fd5f00e22f0 con 0x7fd604103ba0 2024-05-14T15:27:42.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.864+0000 7fd5ef400700 1 -- 172.21.15.69:0/2045125627 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5f40055a0 con 0x55896703bbf0 2024-05-14T15:27:42.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.864+0000 7fd5ef400700 1 -- 172.21.15.69:0/2045125627 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f400bcd0 con 0x55896703bbf0 2024-05-14T15:27:42.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.864+0000 7fd602800700 1 --2- 172.21.15.69:0/1541750861 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5e80b2aa0 0x7fd5e80b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.866+0000 7fd617798b80 1 -- 172.21.15.69:0/2045125627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55896703bbf0 msgr2=0x558967035710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:42.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.866+0000 7fd602800700 1 --2- 172.21.15.69:0/1541750861 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5e80b2aa0 0x7fd5e80b4fb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x558967036a30 tx=0x7fd5fc009040 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:42.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.866+0000 7fd617798b80 1 --2- 172.21.15.69:0/2045125627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55896703bbf0 0x558967035710 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd5f4015000 tx=0x7fd5f4009f20 comp rx=0 tx=0).stop 2024-05-14T15:27:42.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.866+0000 7fd617798b80 1 -- 172.21.15.69:0/2045125627 shutdown_connections 2024-05-14T15:27:42.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.866+0000 7fd617798b80 1 --2- 172.21.15.69:0/2045125627 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558966eb7e40 0x55896703b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.866+0000 7fd617798b80 1 --2- 172.21.15.69:0/2045125627 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 0x558967036060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.869 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.866+0000 7fd617798b80 1 --2- 172.21.15.69:0/2045125627 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55896703bbf0 0x558967035710 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.866+0000 7fd617798b80 1 -- 172.21.15.69:0/2045125627 >> 172.21.15.69:0/2045125627 conn(0x558966ef6a80 msgr2=0x558967030790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:42.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.867+0000 7fd617798b80 1 -- 172.21.15.69:0/2045125627 shutdown_connections 2024-05-14T15:27:42.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.867+0000 7fd617798b80 1 -- 172.21.15.69:0/2045125627 wait complete. 2024-05-14T15:27:42.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.867+0000 7fd617798b80 1 -- start start 2024-05-14T15:27:42.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.868+0000 7fd617798b80 1 Processor -- start 2024-05-14T15:27:42.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.869+0000 7fd617798b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558966eb7e40 0x55896703f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.869+0000 7fd617798b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558967035c50 0x55896703fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.869+0000 7fd617798b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55896703ff50 0x55896704bab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.869+0000 7fd617798b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x558967042600 con 0x558967035c50 2024-05-14T15:27:42.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.869+0000 7fd617798b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558966ebdb20 con 0x55896703ff50 2024-05-14T15:27:42.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.869+0000 7fd617798b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558967042780 con 0x558966eb7e40 2024-05-14T15:27:42.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.869+0000 7fd617798b80 10 client.0 _ll_register_callbacks cb 0x558966eeb380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:42.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.869+0000 7fd601e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558966eb7e40 0x55896703f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.870+0000 7fd602800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55896703ff50 0x55896704bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.870+0000 7fd602800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55896703ff50 0x55896704bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:38008/0 (socket says 172.21.15.69:38008) 2024-05-14T15:27:42.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.870+0000 7fd602800700 1 -- 172.21.15.69:0/63172724 learned_addr learned my addr 172.21.15.69:0/63172724 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:42.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.870+0000 7fd601400700 1 --2- 172.21.15.69:0/63172724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558967035c50 0x55896703fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.870+0000 7fd601e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558966eb7e40 0x55896703f4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:43032/0 (socket says 172.21.15.69:43032) 2024-05-14T15:27:42.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.870+0000 7fd602800700 1 -- 172.21.15.69:0/63172724 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558966eb7e40 msgr2=0x55896703f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:42.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.870+0000 7fd602800700 1 --2- 172.21.15.69:0/63172724 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558966eb7e40 0x55896703f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.870+0000 7fd602800700 1 -- 172.21.15.69:0/63172724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558967035c50 msgr2=0x55896703fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:42.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.870+0000 7fd602800700 1 --2- 172.21.15.69:0/63172724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558967035c50 0x55896703fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.871+0000 7fd602800700 1 -- 172.21.15.69:0/63172724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558966f1d420 con 0x55896703ff50 2024-05-14T15:27:42.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.873+0000 7fd602800700 1 --2- 172.21.15.69:0/63172724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55896703ff50 0x55896704bab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0166c0 tx=0x7fd5fc004b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d48a19b01b13e760 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:42.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.873+0000 7fd5e3e00700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:27:42.877 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.873+0000 7fd5e3e00700 1 -- 172.21.15.69:0/63172724 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc026060 con 0x55896703ff50 2024-05-14T15:27:42.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.873+0000 7fd617798b80 1 -- 172.21.15.69:0/63172724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5f40055a0 con 0x55896703ff50 2024-05-14T15:27:42.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.874+0000 7fd5e3e00700 1 -- 172.21.15.69:0/63172724 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fd5fc014800 con 0x55896703ff50 2024-05-14T15:27:42.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.874+0000 7fd5e3e00700 1 -- 172.21.15.69:0/63172724 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fd5fc010040 con 0x55896703ff50 2024-05-14T15:27:42.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.874+0000 7fd617798b80 10 client.36035 fetch_fsmap learned FSMap version 49 2024-05-14T15:27:42.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.874+0000 7fd617798b80 1 -- 172.21.15.69:0/63172724 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55896704d810 con 0x55896703ff50 2024-05-14T15:27:42.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.875+0000 7fd5e3e00700 1 -- 172.21.15.69:0/63172724 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5f40055a0 con 0x55896703ff50 2024-05-14T15:27:42.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.875+0000 7fd5e3e00700 1 -- 172.21.15.69:0/63172724 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7fd5fc013030 con 0x55896703ff50 2024-05-14T15:27:42.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.876+0000 7fd617798b80 10 client.36035 fetch_fsmap finished waiting for FSMap version 49 2024-05-14T15:27:42.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.876+0000 7fd617798b80 10 client.36035 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-05-14T15:27:42.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.876+0000 7fd617798b80 20 client.36035 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:42.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.876+0000 7fd617798b80 1 --2- 172.21.15.69:0/63172724 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55896704fda0 0x558967052240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.876+0000 7fd617798b80 4 client.36035 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:27:42.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.876+0000 7fd617798b80 1 -- 172.21.15.69:0/63172724 --> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558967002070 con 0x55896704fda0 2024-05-14T15:27:42.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.877+0000 7fd601e00700 1 --2- 172.21.15.69:0/63172724 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55896704fda0 0x558967052240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.878+0000 7fd5e3e00700 10 client.36035 ms_handle_connect on v2:172.21.15.92:6832/1997000798 2024-05-14T15:27:42.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.879+0000 7fd601e00700 1 --2- 172.21.15.69:0/63172724 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55896704fda0 0x558967052240 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=aa0161e9d983c737 server_cookie=429fce3188b639bf in_seq=0 out_seq=0 2024-05-14T15:27:42.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.880+0000 7fd5e3e00700 1 -- 172.21.15.69:0/63172724 <== mds.3 v2:172.21.15.92:6832/1997000798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558967002070 con 0x55896704fda0 2024-05-14T15:27:42.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.880+0000 7fd5e3e00700 10 client.36035 handle_command_reply: tid=0 2024-05-14T15:27:42.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.880+0000 7fd617798b80 1 client.36035 shutdown 2024-05-14T15:27:42.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.882+0000 7fd617798b80 1 -- 172.21.15.69:0/63172724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55896703ff50 msgr2=0x55896704bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:42.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.882+0000 7fd617798b80 1 --2- 172.21.15.69:0/63172724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55896703ff50 0x55896704bab0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc0166c0 tx=0x7fd5fc004b40 comp rx=0 tx=0).stop 2024-05-14T15:27:42.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.882+0000 7fd617798b80 1 -- 172.21.15.69:0/63172724 shutdown_connections 2024-05-14T15:27:42.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.882+0000 7fd617798b80 1 --2- 172.21.15.69:0/63172724 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55896704fda0 0x558967052240 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.882+0000 7fd617798b80 1 --2- 172.21.15.69:0/63172724 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55896703ff50 0x55896704bab0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.882+0000 7fd617798b80 1 --2- 172.21.15.69:0/63172724 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558966eb7e40 0x55896703f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.882+0000 7fd617798b80 1 --2- 172.21.15.69:0/63172724 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558967035c50 0x55896703fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.882+0000 7fd5e3e00700 0 client.36035 ms_handle_reset on v2:172.21.15.92:6832/1997000798 2024-05-14T15:27:42.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.882+0000 7fd617798b80 1 -- 172.21.15.69:0/63172724 >> 172.21.15.69:0/63172724 conn(0x558966ef6a80 msgr2=0x558967034700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:42.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.883+0000 7fd617798b80 1 -- 172.21.15.69:0/63172724 shutdown_connections 2024-05-14T15:27:42.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.883+0000 7fd617798b80 1 -- 172.21.15.69:0/63172724 wait complete. 2024-05-14T15:27:42.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.883+0000 7fd617798b80 20 client.36035 trim_cache size 0 max 16384 2024-05-14T15:27:42.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.914+0000 7fd617798b80 1 Processor -- start 2024-05-14T15:27:42.917 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.915+0000 7fd617798b80 1 -- start start 2024-05-14T15:27:42.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.915+0000 7fd617798b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558966eb7e40 0x558967035710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.915+0000 7fd617798b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 0x55896702ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.915+0000 7fd617798b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55896703ff50 0x558967057a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.915+0000 7fd617798b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd6041b6bc0 con 0x558966eb7e40 2024-05-14T15:27:42.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.915+0000 7fd617798b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd6041b8970 con 0x558967035c50 2024-05-14T15:27:42.918 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.915+0000 7fd617798b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd6041b7350 con 0x55896703ff50 2024-05-14T15:27:42.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.917+0000 7fd601e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558966eb7e40 0x558967035710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.917+0000 7fd602800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55896703ff50 0x558967057a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.917+0000 7fd602800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55896703ff50 0x558967057a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:43044/0 (socket says 172.21.15.69:43044) 2024-05-14T15:27:42.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.917+0000 7fd602800700 1 -- 172.21.15.69:0/1490206127 learned_addr learned my addr 172.21.15.69:0/1490206127 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:42.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.917+0000 7fd601400700 1 --2- 172.21.15.69:0/1490206127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 0x55896702ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.918+0000 7fd602800700 1 -- 172.21.15.69:0/1490206127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 msgr2=0x55896702ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:42.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.918+0000 7fd602800700 1 --2- 172.21.15.69:0/1490206127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 0x55896702ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.918+0000 7fd602800700 1 -- 172.21.15.69:0/1490206127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558966eb7e40 msgr2=0x558967035710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:42.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.918+0000 7fd602800700 1 --2- 172.21.15.69:0/1490206127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558966eb7e40 0x558967035710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.920 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.918+0000 7fd602800700 1 -- 172.21.15.69:0/1490206127 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55896703e810 con 0x55896703ff50 2024-05-14T15:27:42.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.918+0000 7fd602800700 1 --2- 172.21.15.69:0/1490206127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55896703ff50 0x558967057a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc014040 tx=0x7fd5fc02acc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a8fcec5046259e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:42.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.918+0000 7fd601400700 1 --2- 172.21.15.69:0/1490206127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 0x55896702ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:27:42.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.919+0000 7fd5eea00700 1 -- 172.21.15.69:0/1490206127 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc039070 con 0x55896703ff50 2024-05-14T15:27:42.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.919+0000 7fd5eea00700 1 -- 172.21.15.69:0/1490206127 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5fc004db0 con 0x55896703ff50 2024-05-14T15:27:42.921 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.919+0000 7fd5eea00700 1 -- 172.21.15.69:0/1490206127 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5fc039070 con 0x55896703ff50 2024-05-14T15:27:42.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.919+0000 7fd617798b80 1 -- 172.21.15.69:0/1490206127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55896703ff50 msgr2=0x558967057a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:42.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.919+0000 7fd617798b80 1 --2- 172.21.15.69:0/1490206127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55896703ff50 0x558967057a00 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd5fc014040 tx=0x7fd5fc02acc0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.919+0000 7fd617798b80 1 -- 172.21.15.69:0/1490206127 shutdown_connections 2024-05-14T15:27:42.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.919+0000 7fd617798b80 1 --2- 172.21.15.69:0/1490206127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558966eb7e40 0x558967035710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.919+0000 7fd617798b80 1 --2- 172.21.15.69:0/1490206127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55896703ff50 0x558967057a00 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.919+0000 7fd617798b80 1 --2- 172.21.15.69:0/1490206127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 0x55896702ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.922 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.919+0000 7fd617798b80 1 -- 172.21.15.69:0/1490206127 >> 172.21.15.69:0/1490206127 conn(0x558966ef6a80 msgr2=0x55896702a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:42.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.921+0000 7fd617798b80 1 -- 172.21.15.69:0/1490206127 shutdown_connections 2024-05-14T15:27:42.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.921+0000 7fd617798b80 1 -- 172.21.15.69:0/1490206127 wait complete. 2024-05-14T15:27:42.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.921+0000 7fd617798b80 1 -- start start 2024-05-14T15:27:42.923 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.922+0000 7fd617798b80 1 Processor -- start 2024-05-14T15:27:42.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.922+0000 7fd617798b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558966eb7e40 0x5589670435d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.924 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.922+0000 7fd617798b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 0x558967043b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.922+0000 7fd617798b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55896703ff50 0x558967044050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.922+0000 7fd601e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558966eb7e40 0x5589670435d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.923+0000 7fd601400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 0x558967043b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.923+0000 7fd601e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558966eb7e40 0x5589670435d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:43058/0 (socket says 172.21.15.69:43058) 2024-05-14T15:27:42.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.923+0000 7fd617798b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd6041b81e0 con 0x55896703ff50 2024-05-14T15:27:42.925 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.923+0000 7fd601400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 0x558967043b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:38024/0 (socket says 172.21.15.69:38024) 2024-05-14T15:27:42.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.923+0000 7fd617798b80 1 -- 172.21.15.69:0/322923760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd6041b7a50 con 0x558967035c50 2024-05-14T15:27:42.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.923+0000 7fd601400700 1 -- 172.21.15.69:0/322923760 learned_addr learned my addr 172.21.15.69:0/322923760 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:42.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.923+0000 7fd617798b80 1 -- 172.21.15.69:0/322923760 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd6041b4b60 con 0x558966eb7e40 2024-05-14T15:27:42.926 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.923+0000 7fd617798b80 10 client.0 _ll_register_callbacks cb 0x558966eeb380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:42.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.923+0000 7fd602800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55896703ff50 0x558967044050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.923+0000 7fd601400700 1 -- 172.21.15.69:0/322923760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558966eb7e40 msgr2=0x5589670435d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:42.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.923+0000 7fd601400700 1 --2- 172.21.15.69:0/322923760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558966eb7e40 0x5589670435d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.923+0000 7fd601400700 1 -- 172.21.15.69:0/322923760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55896703ff50 msgr2=0x558967044050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:42.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.923+0000 7fd601400700 1 --2- 172.21.15.69:0/322923760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55896703ff50 0x558967044050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.923+0000 7fd601400700 1 -- 172.21.15.69:0/322923760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589670b95b0 con 0x558967035c50 2024-05-14T15:27:42.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.925+0000 7fd601400700 1 --2- 172.21.15.69:0/322923760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 0x558967043b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd5f00a8ec0 tx=0x7fd5f00108d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b58b7106d5412a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:42.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.925+0000 7fd5e3e00700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:27:42.927 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.925+0000 7fd5e3e00700 1 -- 172.21.15.69:0/322923760 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5f0020050 con 0x558967035c50 2024-05-14T15:27:42.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.925+0000 7fd5e3e00700 1 -- 172.21.15.69:0/322923760 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7fd5f00a57b0 con 0x558967035c50 2024-05-14T15:27:42.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.925+0000 7fd617798b80 1 -- 172.21.15.69:0/322923760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5fc004db0 con 0x558967035c50 2024-05-14T15:27:42.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.925+0000 7fd5e3e00700 1 -- 172.21.15.69:0/322923760 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7fd5f0020050 con 0x558967035c50 2024-05-14T15:27:42.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.925+0000 7fd617798b80 10 client.36041 fetch_fsmap learned FSMap version 49 2024-05-14T15:27:42.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.925+0000 7fd617798b80 1 -- 172.21.15.69:0/322923760 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5589670ba7a0 con 0x558967035c50 2024-05-14T15:27:42.929 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.926+0000 7fd5e3e00700 1 -- 172.21.15.69:0/322923760 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd5fc004db0 con 0x558967035c50 2024-05-14T15:27:42.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.928+0000 7fd5e3e00700 1 -- 172.21.15.69:0/322923760 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7fd5f0023060 con 0x558967035c50 2024-05-14T15:27:42.930 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.929+0000 7fd617798b80 10 client.36041 fetch_fsmap finished waiting for FSMap version 49 2024-05-14T15:27:42.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.929+0000 7fd617798b80 10 client.36041 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-05-14T15:27:42.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.929+0000 7fd617798b80 20 client.36041 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:42.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.929+0000 7fd617798b80 1 --2- 172.21.15.69:0/322923760 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x5589670baee0 0x5589670bd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:42.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.929+0000 7fd617798b80 4 client.36041 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:27:42.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.929+0000 7fd617798b80 1 -- 172.21.15.69:0/322923760 --> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558966f65400 con 0x5589670baee0 2024-05-14T15:27:42.931 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.930+0000 7fd601e00700 1 --2- 172.21.15.69:0/322923760 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x5589670baee0 0x5589670bd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:42.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.931+0000 7fd601e00700 1 --2- 172.21.15.69:0/322923760 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x5589670baee0 0x5589670bd300 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=ca8ee7b72de50029 server_cookie=412858bcfb13656b in_seq=0 out_seq=0 2024-05-14T15:27:42.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.931+0000 7fd5e3e00700 10 client.36041 ms_handle_connect on v2:172.21.15.92:6832/1997000798 2024-05-14T15:27:42.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.932+0000 7fd5e3e00700 1 -- 172.21.15.69:0/322923760 <== mds.3 v2:172.21.15.92:6832/1997000798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558966f65400 con 0x5589670baee0 2024-05-14T15:27:42.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.932+0000 7fd5e3e00700 10 client.36041 handle_command_reply: tid=0 2024-05-14T15:27:42.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.932+0000 7fd617798b80 1 client.36041 shutdown 2024-05-14T15:27:42.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.932+0000 7fd617798b80 1 -- 172.21.15.69:0/322923760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 msgr2=0x558967043b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:42.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.932+0000 7fd617798b80 1 --2- 172.21.15.69:0/322923760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 0x558967043b10 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd5f00a8ec0 tx=0x7fd5f00108d0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.933+0000 7fd617798b80 1 -- 172.21.15.69:0/322923760 shutdown_connections 2024-05-14T15:27:42.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.933+0000 7fd617798b80 1 --2- 172.21.15.69:0/322923760 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x5589670baee0 0x5589670bd300 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.933+0000 7fd617798b80 1 --2- 172.21.15.69:0/322923760 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55896703ff50 0x558967044050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.933+0000 7fd617798b80 1 --2- 172.21.15.69:0/322923760 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558966eb7e40 0x5589670435d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.933+0000 7fd617798b80 1 --2- 172.21.15.69:0/322923760 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558967035c50 0x558967043b10 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.933+0000 7fd5e3e00700 0 client.36041 ms_handle_reset on v2:172.21.15.92:6832/1997000798 2024-05-14T15:27:42.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.933+0000 7fd617798b80 1 -- 172.21.15.69:0/322923760 >> 172.21.15.69:0/322923760 conn(0x558966ef6a80 msgr2=0x55896702fe90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:42.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.934+0000 7fd617798b80 1 -- 172.21.15.69:0/322923760 shutdown_connections 2024-05-14T15:27:42.936 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:27:42.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.934+0000 7fd617798b80 1 -- 172.21.15.69:0/322923760 wait complete. 2024-05-14T15:27:42.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.934+0000 7fd617798b80 20 client.36041 trim_cache size 0 max 16384 2024-05-14T15:27:42.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.935+0000 7fd608c00700 1 -- 172.21.15.69:0/1541750861 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5e80b2aa0 msgr2=0x7fd5e80b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:42.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.935+0000 7fd608c00700 1 --2- 172.21.15.69:0/1541750861 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5e80b2aa0 0x7fd5e80b4fb0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x558967036a30 tx=0x7fd5fc009040 comp rx=0 tx=0).stop 2024-05-14T15:27:42.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.935+0000 7fd608c00700 1 -- 172.21.15.69:0/1541750861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd604103ba0 msgr2=0x7fd6041a1900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:42.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.935+0000 7fd608c00700 1 --2- 172.21.15.69:0/1541750861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd604103ba0 0x7fd6041a1900 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd5f000d950 tx=0x7fd5f000dc60 comp rx=0 tx=0).stop 2024-05-14T15:27:42.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.936+0000 7fd608c00700 1 -- 172.21.15.69:0/1541750861 shutdown_connections 2024-05-14T15:27:42.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.936+0000 7fd608c00700 1 --2- 172.21.15.69:0/1541750861 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5e80b2aa0 0x7fd5e80b4fb0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.936+0000 7fd608c00700 1 --2- 172.21.15.69:0/1541750861 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd6041086a0 0x7fd6041a5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.936+0000 7fd608c00700 1 --2- 172.21.15.69:0/1541750861 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd604103250 0x7fd6041a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.936+0000 7fd608c00700 1 --2- 172.21.15.69:0/1541750861 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd604103ba0 0x7fd6041a1900 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:42.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.936+0000 7fd608c00700 1 -- 172.21.15.69:0/1541750861 >> 172.21.15.69:0/1541750861 conn(0x7fd6040fedc0 msgr2=0x7fd6041060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:42.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.936+0000 7fd608c00700 1 -- 172.21.15.69:0/1541750861 shutdown_connections 2024-05-14T15:27:42.938 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:42.936+0000 7fd608c00700 1 -- 172.21.15.69:0/1541750861 wait complete. 2024-05-14T15:27:43.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:43 smithi203 ceph-mon[34567]: pgmap v185: 129 pgs: 129 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.3 MiB/s wr, 595 op/s 2024-05-14T15:27:43.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:43 smithi092 ceph-mon[34729]: pgmap v185: 129 pgs: 129 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.3 MiB/s wr, 595 op/s 2024-05-14T15:27:43.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:43 smithi069 ceph-mon[31270]: pgmap v185: 129 pgs: 129 active+clean; 1.8 GiB data, 5.8 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.3 MiB/s wr, 595 op/s 2024-05-14T15:27:45.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:45 smithi203 ceph-mon[34567]: pgmap v186: 129 pgs: 129 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.1 MiB/s wr, 815 op/s 2024-05-14T15:27:45.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:45 smithi092 ceph-mon[34729]: pgmap v186: 129 pgs: 129 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.1 MiB/s wr, 815 op/s 2024-05-14T15:27:45.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:45 smithi069 ceph-mon[31270]: pgmap v186: 129 pgs: 129 active+clean; 1.8 GiB data, 5.9 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.1 MiB/s wr, 815 op/s 2024-05-14T15:27:46.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 120.0 s, 578.8 tps, lat 172.704 ms stddev 90.387 2024-05-14T15:27:46.372 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-14T15:27:47.125 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:27:47.410 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.409+0000 7ff156800640 1 -- 172.21.15.69:0/3580291826 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff150106400 msgr2=0x7ff1501127d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:47.410 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.409+0000 7ff156800640 1 --2- 172.21.15.69:0/3580291826 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff150106400 0x7ff1501127d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7ff148009900 tx=0x7ff14802a3f0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.409+0000 7ff156800640 1 -- 172.21.15.69:0/3580291826 shutdown_connections 2024-05-14T15:27:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.409+0000 7ff156800640 1 --2- 172.21.15.69:0/3580291826 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff150106400 0x7ff1501127d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.409+0000 7ff156800640 1 --2- 172.21.15.69:0/3580291826 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff15010c150 0x7ff150105d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.409+0000 7ff156800640 1 --2- 172.21.15.69:0/3580291826 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff15010bcb0 0x7ff150105850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.409+0000 7ff156800640 1 -- 172.21.15.69:0/3580291826 >> 172.21.15.69:0/3580291826 conn(0x7ff1501013c0 msgr2=0x7ff1501037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.410+0000 7ff156800640 1 -- 172.21.15.69:0/3580291826 shutdown_connections 2024-05-14T15:27:47.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.410+0000 7ff156800640 1 -- 172.21.15.69:0/3580291826 wait complete. 2024-05-14T15:27:47.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.412+0000 7ff156800640 1 Processor -- start 2024-05-14T15:27:47.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.413+0000 7ff156800640 1 -- start start 2024-05-14T15:27:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.415+0000 7ff156800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff150106400 0x7ff15019c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.415+0000 7ff156800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff15010bcb0 0x7ff15019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.415+0000 7ff156800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff15010c150 0x7ff1501a0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.415+0000 7ff156800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff150115dc0 con 0x7ff15010bcb0 2024-05-14T15:27:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.415+0000 7ff156800640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff150115c40 con 0x7ff15010c150 2024-05-14T15:27:47.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.415+0000 7ff156800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff150115f40 con 0x7ff150106400 2024-05-14T15:27:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.415+0000 7ff155400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff150106400 0x7ff15019c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.415+0000 7ff155400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff150106400 0x7ff15019c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:43076/0 (socket says 172.21.15.69:43076) 2024-05-14T15:27:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.415+0000 7ff155400640 1 -- 172.21.15.69:0/3585674877 learned_addr learned my addr 172.21.15.69:0/3585674877 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:47.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.416+0000 7ff154a00640 1 --2- 172.21.15.69:0/3585674877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff15010bcb0 0x7ff15019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.416+0000 7ff155400640 1 -- 172.21.15.69:0/3585674877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff15010c150 msgr2=0x7ff1501a0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.416+0000 7ff155400640 1 --2- 172.21.15.69:0/3585674877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff15010c150 0x7ff1501a0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.416+0000 7ff155400640 1 -- 172.21.15.69:0/3585674877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff15010bcb0 msgr2=0x7ff15019cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.416+0000 7ff155400640 1 --2- 172.21.15.69:0/3585674877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff15010bcb0 0x7ff15019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.416+0000 7ff155400640 1 -- 172.21.15.69:0/3585674877 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1501a1600 con 0x7ff150106400 2024-05-14T15:27:47.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.417+0000 7ff155400640 1 --2- 172.21.15.69:0/3585674877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff150106400 0x7ff15019c7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff14400ea80 tx=0x7ff14400ef40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:47.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.418+0000 7ff14e000640 1 -- 172.21.15.69:0/3585674877 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14400ce40 con 0x7ff150106400 2024-05-14T15:27:47.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.418+0000 7ff14e000640 1 -- 172.21.15.69:0/3585674877 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff144011900 con 0x7ff150106400 2024-05-14T15:27:47.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.418+0000 7ff14e000640 1 -- 172.21.15.69:0/3585674877 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14401a9c0 con 0x7ff150106400 2024-05-14T15:27:47.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.419+0000 7ff156800640 1 -- 172.21.15.69:0/3585674877 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1501a18f0 con 0x7ff150106400 2024-05-14T15:27:47.421 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.420+0000 7ff156800640 1 -- 172.21.15.69:0/3585674877 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1501a1df0 con 0x7ff150106400 2024-05-14T15:27:47.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.432+0000 7ff14e000640 1 -- 172.21.15.69:0/3585674877 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ff144011470 con 0x7ff150106400 2024-05-14T15:27:47.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.432+0000 7ff15ef64740 1 Processor -- start 2024-05-14T15:27:47.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.434+0000 7ff15ef64740 1 -- start start 2024-05-14T15:27:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.435+0000 7ff15ef64740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e901b0 0x55ca58231480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.435+0000 7ff14e000640 1 --2- 172.21.15.69:0/3585674877 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff1380b2aa0 0x7ff1380b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.436+0000 7ff14e000640 1 -- 172.21.15.69:0/3585674877 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7ff1440e2fb0 con 0x7ff150106400 2024-05-14T15:27:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.437+0000 7ff15ef64740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 0x55ca582319c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.437+0000 7ff15ef64740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e6f4d0 0x55ca58231f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.437+0000 7ff15ef64740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ca58196550 con 0x55ca57e901b0 2024-05-14T15:27:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.437+0000 7ff15ef64740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ca5813bbc0 con 0x55ca57e672f0 2024-05-14T15:27:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.437+0000 7ff15ef64740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ca58192510 con 0x55ca57e6f4d0 2024-05-14T15:27:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.437+0000 7ff155400640 1 --2- 172.21.15.69:0/3585674877 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff1380b2aa0 0x7ff1380b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.437+0000 7ff155e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e901b0 0x55ca58231480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.438+0000 7ff155e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e901b0 0x55ca58231480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48870/0 (socket says 172.21.15.69:48870) 2024-05-14T15:27:47.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.438+0000 7ff155e00640 1 -- 172.21.15.69:0/1900724477 learned_addr learned my addr 172.21.15.69:0/1900724477 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.438+0000 7ff154a00640 1 --2- 172.21.15.69:0/1900724477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 0x55ca582319c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.438+0000 7ff155e00640 1 -- 172.21.15.69:0/1900724477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e6f4d0 msgr2=0x55ca58231f00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:27:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.438+0000 7ff155e00640 1 --2- 172.21.15.69:0/1900724477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e6f4d0 0x55ca58231f00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.438+0000 7ff155e00640 1 -- 172.21.15.69:0/1900724477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 msgr2=0x55ca582319c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.438+0000 7ff155e00640 1 --2- 172.21.15.69:0/1900724477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 0x55ca582319c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.439+0000 7ff155e00640 1 -- 172.21.15.69:0/1900724477 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca57ea8210 con 0x55ca57e901b0 2024-05-14T15:27:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.439+0000 7ff155400640 1 --2- 172.21.15.69:0/3585674877 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff1380b2aa0 0x7ff1380b4fb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff1440e0950 tx=0x7ff14401a400 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.439+0000 7ff155e00640 1 --2- 172.21.15.69:0/1900724477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e901b0 0x55ca58231480 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ff14802a910 tx=0x7ff148004180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebcf0ce19d74e1b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.440+0000 7ff142600640 1 -- 172.21.15.69:0/1900724477 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14803e030 con 0x55ca57e901b0 2024-05-14T15:27:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.440+0000 7ff142600640 1 -- 172.21.15.69:0/1900724477 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff148004330 con 0x55ca57e901b0 2024-05-14T15:27:47.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.441+0000 7ff142600640 1 -- 172.21.15.69:0/1900724477 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff148035040 con 0x55ca57e901b0 2024-05-14T15:27:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.442+0000 7ff15ef64740 1 -- 172.21.15.69:0/1900724477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e901b0 msgr2=0x55ca58231480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:47.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.442+0000 7ff15ef64740 1 --2- 172.21.15.69:0/1900724477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e901b0 0x55ca58231480 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7ff14802a910 tx=0x7ff148004180 comp rx=0 tx=0).stop 2024-05-14T15:27:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.443+0000 7ff15ef64740 1 -- 172.21.15.69:0/1900724477 shutdown_connections 2024-05-14T15:27:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.443+0000 7ff15ef64740 1 --2- 172.21.15.69:0/1900724477 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e6f4d0 0x55ca58231f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.443+0000 7ff15ef64740 1 --2- 172.21.15.69:0/1900724477 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 0x55ca582319c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.443+0000 7ff15ef64740 1 --2- 172.21.15.69:0/1900724477 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e901b0 0x55ca58231480 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.443+0000 7ff15ef64740 1 -- 172.21.15.69:0/1900724477 >> 172.21.15.69:0/1900724477 conn(0x55ca57e84300 msgr2=0x55ca5822dc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.443+0000 7ff15ef64740 1 -- 172.21.15.69:0/1900724477 shutdown_connections 2024-05-14T15:27:47.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.444+0000 7ff15ef64740 1 -- 172.21.15.69:0/1900724477 wait complete. 2024-05-14T15:27:47.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.446+0000 7ff15ef64740 1 -- start start 2024-05-14T15:27:47.448 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.447+0000 7ff15ef64740 1 Processor -- start 2024-05-14T15:27:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.449+0000 7ff15ef64740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 0x55ca5823ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.449+0000 7ff15ef64740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 0x55ca5823bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.449+0000 7ff15ef64740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e901b0 0x55ca58247a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.449+0000 7ff15ef64740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ca5823e550 con 0x55ca57e6f4d0 2024-05-14T15:27:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.449+0000 7ff15ef64740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ca5814f660 con 0x55ca57e672f0 2024-05-14T15:27:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.449+0000 7ff15ef64740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ca5823e6d0 con 0x55ca57e901b0 2024-05-14T15:27:47.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.449+0000 7ff15ef64740 10 client.0 _ll_register_callbacks cb 0x55ca58119400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:47.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.449+0000 7ff155e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 0x55ca5823ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:47.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.450+0000 7ff154a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 0x55ca5823bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:47.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.450+0000 7ff154a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 0x55ca5823bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48878/0 (socket says 172.21.15.69:48878) 2024-05-14T15:27:47.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.450+0000 7ff154a00640 1 -- 172.21.15.69:0/203320456 learned_addr learned my addr 172.21.15.69:0/203320456 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:47.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.450+0000 7ff155e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 0x55ca5823ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:38076/0 (socket says 172.21.15.69:38076) 2024-05-14T15:27:47.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.450+0000 7ff155e00640 1 --2- 172.21.15.69:0/203320456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e901b0 0x55ca58247a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:47.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.450+0000 7ff154a00640 1 -- 172.21.15.69:0/203320456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e901b0 msgr2=0x55ca58247a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:47.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.450+0000 7ff154a00640 1 --2- 172.21.15.69:0/203320456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e901b0 0x55ca58247a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.450+0000 7ff154a00640 1 -- 172.21.15.69:0/203320456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 msgr2=0x55ca5823ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:47.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.450+0000 7ff154a00640 1 --2- 172.21.15.69:0/203320456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 0x55ca5823ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.450+0000 7ff154a00640 1 -- 172.21.15.69:0/203320456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca57f74620 con 0x55ca57e6f4d0 2024-05-14T15:27:47.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.451+0000 7ff154a00640 1 --2- 172.21.15.69:0/203320456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 0x55ca5823bf50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7ff15006c3f0 tx=0x7ff13c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbf528414879f56c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:47.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.452+0000 7ff136a00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:27:47.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.452+0000 7ff136a00640 1 -- 172.21.15.69:0/203320456 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff13c012860 con 0x55ca57e6f4d0 2024-05-14T15:27:47.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.452+0000 7ff15ef64740 1 -- 172.21.15.69:0/203320456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff148004330 con 0x55ca57e6f4d0 2024-05-14T15:27:47.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.452+0000 7ff136a00640 1 -- 172.21.15.69:0/203320456 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7ff13c012660 con 0x55ca57e6f4d0 2024-05-14T15:27:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.453+0000 7ff136a00640 1 -- 172.21.15.69:0/203320456 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7ff13c025050 con 0x55ca57e6f4d0 2024-05-14T15:27:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.453+0000 7ff15ef64740 10 client.16554 fetch_fsmap learned FSMap version 49 2024-05-14T15:27:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.453+0000 7ff15ef64740 1 -- 172.21.15.69:0/203320456 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55ca5824a8f0 con 0x55ca57e6f4d0 2024-05-14T15:27:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.454+0000 7ff136a00640 1 -- 172.21.15.69:0/203320456 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff148004330 con 0x55ca57e6f4d0 2024-05-14T15:27:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.454+0000 7ff136a00640 1 -- 172.21.15.69:0/203320456 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7ff13c00f040 con 0x55ca57e6f4d0 2024-05-14T15:27:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.454+0000 7ff15ef64740 10 client.16554 fetch_fsmap finished waiting for FSMap version 49 2024-05-14T15:27:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.454+0000 7ff15ef64740 10 client.16554 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:27:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.454+0000 7ff15ef64740 20 client.16554 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:47.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.454+0000 7ff15ef64740 1 --2- 172.21.15.69:0/203320456 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ca57e4ed80 0x55ca5824de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.454+0000 7ff15ef64740 4 client.16554 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:27:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.454+0000 7ff15ef64740 1 -- 172.21.15.69:0/203320456 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ca581a4160 con 0x55ca57e4ed80 2024-05-14T15:27:47.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.454+0000 7ff155e00640 1 --2- 172.21.15.69:0/203320456 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ca57e4ed80 0x55ca5824de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.456+0000 7ff155e00640 1 --2- 172.21.15.69:0/203320456 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ca57e4ed80 0x55ca5824de30 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dfe1b4c636c34b04 server_cookie=58e17c4a93c96ecd in_seq=0 out_seq=0 2024-05-14T15:27:47.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.456+0000 7ff136a00640 10 client.16554 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.458+0000 7ff136a00640 1 -- 172.21.15.69:0/203320456 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ca581a4160 con 0x55ca57e4ed80 2024-05-14T15:27:47.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.458+0000 7ff136a00640 10 client.16554 handle_command_reply: tid=0 2024-05-14T15:27:47.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.459+0000 7ff15ef64740 1 client.16554 shutdown 2024-05-14T15:27:47.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.461+0000 7ff15ef64740 1 -- 172.21.15.69:0/203320456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 msgr2=0x55ca5823bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:47.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.461+0000 7ff15ef64740 1 --2- 172.21.15.69:0/203320456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 0x55ca5823bf50 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7ff15006c3f0 tx=0x7ff13c0117b0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.461+0000 7ff15ef64740 1 -- 172.21.15.69:0/203320456 shutdown_connections 2024-05-14T15:27:47.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.461+0000 7ff15ef64740 1 --2- 172.21.15.69:0/203320456 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e901b0 0x55ca58247a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.461+0000 7ff15ef64740 1 --2- 172.21.15.69:0/203320456 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ca57e4ed80 0x55ca5824de30 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.461+0000 7ff15ef64740 1 --2- 172.21.15.69:0/203320456 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 0x55ca5823bf50 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.461+0000 7ff15ef64740 1 --2- 172.21.15.69:0/203320456 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 0x55ca5823ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.461+0000 7ff15ef64740 1 -- 172.21.15.69:0/203320456 >> 172.21.15.69:0/203320456 conn(0x55ca57e84300 msgr2=0x55ca58231250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.462+0000 7ff136a00640 0 client.16554 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:47.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.462+0000 7ff15ef64740 1 -- 172.21.15.69:0/203320456 shutdown_connections 2024-05-14T15:27:47.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.462+0000 7ff15ef64740 1 -- 172.21.15.69:0/203320456 wait complete. 2024-05-14T15:27:47.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.462+0000 7ff15ef64740 20 client.16554 trim_cache size 0 max 16384 2024-05-14T15:27:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.508+0000 7ff15ef64740 1 Processor -- start 2024-05-14T15:27:47.509 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.508+0000 7ff15ef64740 1 -- start start 2024-05-14T15:27:47.510 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.509+0000 7ff15ef64740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e672f0 0x55ca58231c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.510+0000 7ff15ef64740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 0x55ca5823b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.510+0000 7ff155e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e672f0 0x55ca58231c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.511+0000 7ff155e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e672f0 0x55ca58231c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:43100/0 (socket says 172.21.15.69:43100) 2024-05-14T15:27:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.511+0000 7ff155e00640 1 -- 172.21.15.69:0/1904161871 learned_addr learned my addr 172.21.15.69:0/1904161871 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.511+0000 7ff15ef64740 1 --2- 172.21.15.69:0/1904161871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e901b0 0x55ca58253630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.511+0000 7ff15ef64740 1 -- 172.21.15.69:0/1904161871 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501b76b0 con 0x55ca57e6f4d0 2024-05-14T15:27:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.511+0000 7ff15ef64740 1 -- 172.21.15.69:0/1904161871 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501b9460 con 0x55ca57e901b0 2024-05-14T15:27:47.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.511+0000 7ff15ef64740 1 -- 172.21.15.69:0/1904161871 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501b7e40 con 0x55ca57e672f0 2024-05-14T15:27:47.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.512+0000 7ff154a00640 1 --2- 172.21.15.69:0/1904161871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 0x55ca5823b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.513+0000 7ff155e00640 1 --2- 172.21.15.69:0/1904161871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e901b0 0x55ca58253630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.513+0000 7ff155e00640 1 -- 172.21.15.69:0/1904161871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e901b0 msgr2=0x55ca58253630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.513+0000 7ff155e00640 1 --2- 172.21.15.69:0/1904161871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e901b0 0x55ca58253630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.513+0000 7ff155e00640 1 -- 172.21.15.69:0/1904161871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 msgr2=0x55ca5823b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.513+0000 7ff155e00640 1 --2- 172.21.15.69:0/1904161871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 0x55ca5823b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.514+0000 7ff155e00640 1 -- 172.21.15.69:0/1904161871 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ca5823e6a0 con 0x55ca57e672f0 2024-05-14T15:27:47.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.516+0000 7ff155e00640 1 --2- 172.21.15.69:0/1904161871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e672f0 0x55ca58231c40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff148005ab0 tx=0x7ff148000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc14e6c13022d89d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:47.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.517+0000 7ff141c00640 1 -- 172.21.15.69:0/1904161871 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff148035040 con 0x55ca57e672f0 2024-05-14T15:27:47.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.519+0000 7ff141c00640 1 -- 172.21.15.69:0/1904161871 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff148004330 con 0x55ca57e672f0 2024-05-14T15:27:47.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.519+0000 7ff141c00640 1 -- 172.21.15.69:0/1904161871 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff14803e040 con 0x55ca57e672f0 2024-05-14T15:27:47.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.521+0000 7ff15ef64740 1 -- 172.21.15.69:0/1904161871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e672f0 msgr2=0x55ca58231c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:47.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.521+0000 7ff15ef64740 1 --2- 172.21.15.69:0/1904161871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e672f0 0x55ca58231c40 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7ff148005ab0 tx=0x7ff148000bc0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.522+0000 7ff15ef64740 1 -- 172.21.15.69:0/1904161871 shutdown_connections 2024-05-14T15:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.522+0000 7ff15ef64740 1 --2- 172.21.15.69:0/1904161871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e901b0 0x55ca58253630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.522+0000 7ff15ef64740 1 --2- 172.21.15.69:0/1904161871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 0x55ca5823b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.522+0000 7ff15ef64740 1 --2- 172.21.15.69:0/1904161871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e672f0 0x55ca58231c40 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.522+0000 7ff15ef64740 1 -- 172.21.15.69:0/1904161871 >> 172.21.15.69:0/1904161871 conn(0x55ca57e84300 msgr2=0x55ca5822db50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:47.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.522+0000 7ff15ef64740 1 -- 172.21.15.69:0/1904161871 shutdown_connections 2024-05-14T15:27:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.522+0000 7ff15ef64740 1 -- 172.21.15.69:0/1904161871 wait complete. 2024-05-14T15:27:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.523+0000 7ff15ef64740 1 -- start start 2024-05-14T15:27:47.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.523+0000 7ff15ef64740 1 Processor -- start 2024-05-14T15:27:47.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.525+0000 7ff15ef64740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 0x55ca58243de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.527 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.526+0000 7ff15ef64740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 0x55ca5823e920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.526+0000 7ff15ef64740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e901b0 0x55ca5823ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.526+0000 7ff15ef64740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501b8cd0 con 0x55ca57e6f4d0 2024-05-14T15:27:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.526+0000 7ff15ef64740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501b8540 con 0x55ca57e672f0 2024-05-14T15:27:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.526+0000 7ff15ef64740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff1501b5690 con 0x55ca57e901b0 2024-05-14T15:27:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.526+0000 7ff15ef64740 10 client.0 _ll_register_callbacks cb 0x7ff13c009670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.526+0000 7ff155e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 0x55ca58243de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.526+0000 7ff154a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 0x55ca5823e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.527+0000 7ff155e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 0x55ca58243de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:38096/0 (socket says 172.21.15.69:38096) 2024-05-14T15:27:47.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.527+0000 7ff155e00640 1 -- 172.21.15.69:0/3253051962 learned_addr learned my addr 172.21.15.69:0/3253051962 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.527+0000 7ff155e00640 1 --2- 172.21.15.69:0/3253051962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e901b0 0x55ca5823ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.528+0000 7ff155e00640 1 -- 172.21.15.69:0/3253051962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e901b0 msgr2=0x55ca5823ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.528+0000 7ff155e00640 1 --2- 172.21.15.69:0/3253051962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e901b0 0x55ca5823ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.528+0000 7ff155e00640 1 -- 172.21.15.69:0/3253051962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 msgr2=0x55ca5823e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.528+0000 7ff155e00640 1 --2- 172.21.15.69:0/3253051962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 0x55ca5823e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.528+0000 7ff155e00640 1 -- 172.21.15.69:0/3253051962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ca5823f4a0 con 0x55ca57e672f0 2024-05-14T15:27:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.529+0000 7ff155e00640 1 --2- 172.21.15.69:0/3253051962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 0x55ca58243de0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff148009900 tx=0x7ff148004200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5eb69cc853055335 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.529+0000 7ff136a00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:27:47.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.529+0000 7ff136a00640 1 -- 172.21.15.69:0/3253051962 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff148035030 con 0x55ca57e672f0 2024-05-14T15:27:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.529+0000 7ff136a00640 1 -- 172.21.15.69:0/3253051962 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7ff148005270 con 0x55ca57e672f0 2024-05-14T15:27:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.529+0000 7ff15ef64740 1 -- 172.21.15.69:0/3253051962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff148004330 con 0x55ca57e672f0 2024-05-14T15:27:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.530+0000 7ff136a00640 1 -- 172.21.15.69:0/3253051962 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7ff14803e070 con 0x55ca57e672f0 2024-05-14T15:27:47.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.530+0000 7ff15ef64740 10 client.36056 fetch_fsmap learned FSMap version 49 2024-05-14T15:27:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.531+0000 7ff15ef64740 1 -- 172.21.15.69:0/3253051962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x55ca582b4f90 con 0x55ca57e672f0 2024-05-14T15:27:47.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.531+0000 7ff136a00640 1 -- 172.21.15.69:0/3253051962 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff148004330 con 0x55ca57e672f0 2024-05-14T15:27:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.532+0000 7ff136a00640 1 -- 172.21.15.69:0/3253051962 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7ff1480512f0 con 0x55ca57e672f0 2024-05-14T15:27:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.533+0000 7ff15ef64740 10 client.36056 fetch_fsmap finished waiting for FSMap version 49 2024-05-14T15:27:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.533+0000 7ff15ef64740 10 client.36056 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:27:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.533+0000 7ff15ef64740 20 client.36056 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.533+0000 7ff15ef64740 1 --2- 172.21.15.69:0/3253051962 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ca57e241c0 0x55ca582b7220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.533+0000 7ff15ef64740 4 client.36056 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:27:47.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.533+0000 7ff15ef64740 1 -- 172.21.15.69:0/3253051962 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ca5819dfd0 con 0x55ca57e241c0 2024-05-14T15:27:47.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.534+0000 7ff154a00640 1 --2- 172.21.15.69:0/3253051962 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ca57e241c0 0x55ca582b7220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:47.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.536+0000 7ff154a00640 1 --2- 172.21.15.69:0/3253051962 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ca57e241c0 0x55ca582b7220 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f50734dd04262c5b server_cookie=1e5a9e1f251c3465 in_seq=0 out_seq=0 2024-05-14T15:27:47.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.537+0000 7ff136a00640 10 client.36056 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:47.542 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:47 smithi069 ceph-mon[31270]: pgmap v187: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.9 MiB/s wr, 668 op/s 2024-05-14T15:27:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.568+0000 7ff136a00640 1 -- 172.21.15.69:0/3253051962 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ca5819dfd0 con 0x55ca57e241c0 2024-05-14T15:27:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.568+0000 7ff136a00640 10 client.36056 handle_command_reply: tid=0 2024-05-14T15:27:47.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.568+0000 7ff15ef64740 1 client.36056 shutdown 2024-05-14T15:27:47.570 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.569+0000 7ff15ef64740 1 -- 172.21.15.69:0/3253051962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 msgr2=0x55ca58243de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:47.570 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.569+0000 7ff15ef64740 1 --2- 172.21.15.69:0/3253051962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 0x55ca58243de0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff148009900 tx=0x7ff148004200 comp rx=0 tx=0).stop 2024-05-14T15:27:47.570 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.569+0000 7ff15ef64740 1 -- 172.21.15.69:0/3253051962 shutdown_connections 2024-05-14T15:27:47.570 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.569+0000 7ff15ef64740 1 --2- 172.21.15.69:0/3253051962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ca57e901b0 0x55ca5823ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.569+0000 7ff15ef64740 1 --2- 172.21.15.69:0/3253051962 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ca57e241c0 0x55ca582b7220 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.569+0000 7ff136a00640 0 client.36056 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.569+0000 7ff15ef64740 1 --2- 172.21.15.69:0/3253051962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ca57e6f4d0 0x55ca5823e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.569+0000 7ff15ef64740 1 --2- 172.21.15.69:0/3253051962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ca57e672f0 0x55ca58243de0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.569+0000 7ff15ef64740 1 -- 172.21.15.69:0/3253051962 >> 172.21.15.69:0/3253051962 conn(0x55ca57e84300 msgr2=0x55ca5822c250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.570+0000 7ff15ef64740 1 -- 172.21.15.69:0/3253051962 shutdown_connections 2024-05-14T15:27:47.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.570+0000 7ff15ef64740 1 -- 172.21.15.69:0/3253051962 wait complete. 2024-05-14T15:27:47.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.570+0000 7ff15ef64740 20 client.36056 trim_cache size 0 max 16384 2024-05-14T15:27:47.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:27:47.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:27:47.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:27:47.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:27:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.574+0000 7ff156800640 1 -- 172.21.15.69:0/3585674877 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff1380b2aa0 msgr2=0x7ff1380b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:47.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.574+0000 7ff156800640 1 --2- 172.21.15.69:0/3585674877 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff1380b2aa0 0x7ff1380b4fb0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff1440e0950 tx=0x7ff14401a400 comp rx=0 tx=0).stop 2024-05-14T15:27:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.575+0000 7ff156800640 1 -- 172.21.15.69:0/3585674877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff150106400 msgr2=0x7ff15019c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:47.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.575+0000 7ff156800640 1 --2- 172.21.15.69:0/3585674877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff150106400 0x7ff15019c7a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff14400ea80 tx=0x7ff14400ef40 comp rx=0 tx=0).stop 2024-05-14T15:27:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.575+0000 7ff156800640 1 -- 172.21.15.69:0/3585674877 shutdown_connections 2024-05-14T15:27:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.575+0000 7ff156800640 1 --2- 172.21.15.69:0/3585674877 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff1380b2aa0 0x7ff1380b4fb0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.575+0000 7ff156800640 1 --2- 172.21.15.69:0/3585674877 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff15010c150 0x7ff1501a0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.575+0000 7ff156800640 1 --2- 172.21.15.69:0/3585674877 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff15010bcb0 0x7ff15019cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.575+0000 7ff156800640 1 --2- 172.21.15.69:0/3585674877 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff150106400 0x7ff15019c7a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.575+0000 7ff156800640 1 -- 172.21.15.69:0/3585674877 >> 172.21.15.69:0/3585674877 conn(0x7ff1501013c0 msgr2=0x7ff150103bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.576+0000 7ff156800640 1 -- 172.21.15.69:0/3585674877 shutdown_connections 2024-05-14T15:27:47.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:27:47.576+0000 7ff156800640 1 -- 172.21.15.69:0/3585674877 wait complete. 2024-05-14T15:27:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:47 smithi203 ceph-mon[34567]: pgmap v187: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.9 MiB/s wr, 668 op/s 2024-05-14T15:27:47.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:47 smithi092 ceph-mon[34729]: pgmap v187: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.9 MiB/s wr, 668 op/s 2024-05-14T15:27:48.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:48 smithi203 ceph-mon[34567]: pgmap v188: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.9 MiB/s wr, 588 op/s 2024-05-14T15:27:48.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:48 smithi092 ceph-mon[34729]: pgmap v188: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.9 MiB/s wr, 588 op/s 2024-05-14T15:27:48.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:48 smithi069 ceph-mon[31270]: pgmap v188: 129 pgs: 129 active+clean; 1.8 GiB data, 6.0 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.9 MiB/s wr, 588 op/s 2024-05-14T15:27:50.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.892+0000 7f362dc00700 1 -- 172.21.15.69:0/548904772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3628106ec0 msgr2=0x7f3628113350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:50.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.892+0000 7f362dc00700 1 --2- 172.21.15.69:0/548904772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3628106ec0 0x7f3628113350 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f3620009f90 tx=0x7f362000b330 comp rx=0 tx=0).stop 2024-05-14T15:27:50.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.893+0000 7f362dc00700 1 -- 172.21.15.69:0/548904772 shutdown_connections 2024-05-14T15:27:50.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.893+0000 7f362dc00700 1 --2- 172.21.15.69:0/548904772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3628106ec0 0x7f3628113350 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.893+0000 7f362dc00700 1 --2- 172.21.15.69:0/548904772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362810c5b0 0x7f362810c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.893+0000 7f362dc00700 1 --2- 172.21.15.69:0/548904772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3628106570 0x7f3628106980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.893+0000 7f362dc00700 1 -- 172.21.15.69:0/548904772 >> 172.21.15.69:0/548904772 conn(0x7f3628102050 msgr2=0x7f36281044a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:50.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.894+0000 7f362dc00700 1 -- 172.21.15.69:0/548904772 shutdown_connections 2024-05-14T15:27:50.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.894+0000 7f362dc00700 1 -- 172.21.15.69:0/548904772 wait complete. 2024-05-14T15:27:50.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.896+0000 7f362dc00700 1 Processor -- start 2024-05-14T15:27:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.896+0000 7f362dc00700 1 -- start start 2024-05-14T15:27:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.896+0000 7f362dc00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3628106570 0x7f36281107b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.896+0000 7f362dc00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3628106ec0 0x7f3628110cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.896+0000 7f362dc00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362810c5b0 0x7f3628111230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.896+0000 7f362dc00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f36281165e0 con 0x7f3628106ec0 2024-05-14T15:27:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.896+0000 7f362dc00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3628116460 con 0x7f362810c5b0 2024-05-14T15:27:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.896+0000 7f362dc00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3628116760 con 0x7f3628106570 2024-05-14T15:27:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.897+0000 7f3626a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3628106570 0x7f36281107b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.897+0000 7f3626000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3628106ec0 0x7f3628110cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.897+0000 7f3626a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3628106570 0x7f36281107b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:43140/0 (socket says 172.21.15.69:43140) 2024-05-14T15:27:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.897+0000 7f3626a00700 1 -- 172.21.15.69:0/2890182143 learned_addr learned my addr 172.21.15.69:0/2890182143 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.897+0000 7f3627400700 1 --2- 172.21.15.69:0/2890182143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362810c5b0 0x7f3628111230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.898+0000 7f3627400700 1 -- 172.21.15.69:0/2890182143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3628106570 msgr2=0x7f36281107b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.898+0000 7f3627400700 1 --2- 172.21.15.69:0/2890182143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3628106570 0x7f36281107b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.898+0000 7f3627400700 1 -- 172.21.15.69:0/2890182143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3628106ec0 msgr2=0x7f3628110cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:50.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.898+0000 7f3627400700 1 --2- 172.21.15.69:0/2890182143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3628106ec0 0x7f3628110cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.898+0000 7f3627400700 1 -- 172.21.15.69:0/2890182143 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36281ad4f0 con 0x7f362810c5b0 2024-05-14T15:27:50.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.898+0000 7f3626000700 1 --2- 172.21.15.69:0/2890182143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3628106ec0 0x7f3628110cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:27:50.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.898+0000 7f3626a00700 1 --2- 172.21.15.69:0/2890182143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3628106570 0x7f36281107b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:27:50.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.899+0000 7f3627400700 1 --2- 172.21.15.69:0/2890182143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362810c5b0 0x7f3628111230 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3620009f90 tx=0x7f362000ce20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:50.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.899+0000 7f361f400700 1 -- 172.21.15.69:0/2890182143 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620021070 con 0x7f362810c5b0 2024-05-14T15:27:50.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.899+0000 7f362dc00700 1 -- 172.21.15.69:0/2890182143 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36281ad780 con 0x7f362810c5b0 2024-05-14T15:27:50.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.900+0000 7f361f400700 1 -- 172.21.15.69:0/2890182143 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3620007ac0 con 0x7f362810c5b0 2024-05-14T15:27:50.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.900+0000 7f362dc00700 1 -- 172.21.15.69:0/2890182143 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36281adc80 con 0x7f362810c5b0 2024-05-14T15:27:50.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.901+0000 7f361f400700 1 -- 172.21.15.69:0/2890182143 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36200052a0 con 0x7f362810c5b0 2024-05-14T15:27:50.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.909+0000 7f361f400700 1 -- 172.21.15.69:0/2890182143 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3620024070 con 0x7f362810c5b0 2024-05-14T15:27:50.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.912+0000 7f363c7adb80 1 Processor -- start 2024-05-14T15:27:50.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.912+0000 7f363c7adb80 1 -- start start 2024-05-14T15:27:50.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.912+0000 7f361f400700 1 --2- 172.21.15.69:0/2890182143 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f360c0b2aa0 0x7f360c0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.913+0000 7f361f400700 1 -- 172.21.15.69:0/2890182143 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f362000f020 con 0x7f362810c5b0 2024-05-14T15:27:50.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.913+0000 7f363c7adb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 0x5568575c72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.913+0000 7f363c7adb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568575c7830 0x5568575c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.913+0000 7f363c7adb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 0x5568575c1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.913+0000 7f363c7adb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5568574e3a20 con 0x556857443e40 2024-05-14T15:27:50.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.913+0000 7f363c7adb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556857481760 con 0x5568575c7830 2024-05-14T15:27:50.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.913+0000 7f363c7adb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5568574df9e0 con 0x5568575c19f0 2024-05-14T15:27:50.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.914+0000 7f3627400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 0x5568575c1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.914+0000 7f3627400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 0x5568575c1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:43156/0 (socket says 172.21.15.69:43156) 2024-05-14T15:27:50.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.914+0000 7f3627400700 1 -- 172.21.15.69:0/1053970714 learned_addr learned my addr 172.21.15.69:0/1053970714 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:50.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.914+0000 7f3626a00700 1 --2- 172.21.15.69:0/1053970714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 0x5568575c72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.915+0000 7f3627400700 1 -- 172.21.15.69:0/1053970714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568575c7830 msgr2=0x5568575c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:50.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.915+0000 7f3626000700 1 --2- 172.21.15.69:0/1053970714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568575c7830 0x5568575c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.915+0000 7f3626000700 1 --2- 172.21.15.69:0/2890182143 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f360c0b2aa0 0x7f360c0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.729 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.915+0000 7f3627400700 1 --2- 172.21.15.69:0/1053970714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568575c7830 0x5568575c14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.916+0000 7f3627400700 1 -- 172.21.15.69:0/1053970714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 msgr2=0x5568575c72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.916+0000 7f3627400700 1 --2- 172.21.15.69:0/1053970714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 0x5568575c72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.916+0000 7f3627400700 1 -- 172.21.15.69:0/1053970714 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568574308d0 con 0x5568575c19f0 2024-05-14T15:27:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.916+0000 7f3626a00700 1 --2- 172.21.15.69:0/1053970714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 0x5568575c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:27:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.916+0000 7f3627400700 1 --2- 172.21.15.69:0/1053970714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 0x5568575c1e00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f362000b6c0 tx=0x7f36200aaa30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cda51730eca0523 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.917+0000 7f3613e00700 1 -- 172.21.15.69:0/1053970714 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36200b3bf0 con 0x5568575c19f0 2024-05-14T15:27:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.917+0000 7f3613e00700 1 -- 172.21.15.69:0/1053970714 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3620024360 con 0x5568575c19f0 2024-05-14T15:27:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.917+0000 7f3613e00700 1 -- 172.21.15.69:0/1053970714 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36200b3760 con 0x5568575c19f0 2024-05-14T15:27:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.919+0000 7f3626000700 1 --2- 172.21.15.69:0/2890182143 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f360c0b2aa0 0x7f360c0b4fb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x5568575bdab0 tx=0x7f36140058e0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.919+0000 7f363c7adb80 1 -- 172.21.15.69:0/1053970714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 msgr2=0x5568575c1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.919+0000 7f363c7adb80 1 --2- 172.21.15.69:0/1053970714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 0x5568575c1e00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f362000b6c0 tx=0x7f36200aaa30 comp rx=0 tx=0).stop 2024-05-14T15:27:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.919+0000 7f363c7adb80 1 -- 172.21.15.69:0/1053970714 shutdown_connections 2024-05-14T15:27:50.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.919+0000 7f363c7adb80 1 --2- 172.21.15.69:0/1053970714 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 0x5568575c72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.919+0000 7f363c7adb80 1 --2- 172.21.15.69:0/1053970714 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 0x5568575c1e00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.919+0000 7f363c7adb80 1 --2- 172.21.15.69:0/1053970714 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568575c7830 0x5568575c14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.919+0000 7f363c7adb80 1 -- 172.21.15.69:0/1053970714 >> 172.21.15.69:0/1053970714 conn(0x556857488f70 msgr2=0x5568575bc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:50.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.920+0000 7f363c7adb80 1 -- 172.21.15.69:0/1053970714 shutdown_connections 2024-05-14T15:27:50.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.920+0000 7f363c7adb80 1 -- 172.21.15.69:0/1053970714 wait complete. 2024-05-14T15:27:50.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.922+0000 7f363c7adb80 1 -- start start 2024-05-14T15:27:50.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.923+0000 7f363c7adb80 1 Processor -- start 2024-05-14T15:27:50.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.924+0000 7f363c7adb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 0x5568575cb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.924+0000 7f363c7adb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568575c19f0 0x5568575cb550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.924+0000 7f363c7adb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c7830 0x5568575cba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.924+0000 7f363c7adb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5568574df9e0 con 0x556857443e40 2024-05-14T15:27:50.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.924+0000 7f363c7adb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556857449b20 con 0x5568575c19f0 2024-05-14T15:27:50.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.924+0000 7f363c7adb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5568575ce0d0 con 0x5568575c7830 2024-05-14T15:27:50.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.925+0000 7f3627400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c7830 0x5568575cba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.731 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.925+0000 7f3627400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c7830 0x5568575cba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:43162/0 (socket says 172.21.15.69:43162) 2024-05-14T15:27:50.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.925+0000 7f3627400700 1 -- 172.21.15.69:0/1292826794 learned_addr learned my addr 172.21.15.69:0/1292826794 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:50.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.926+0000 7f3626000700 1 --2- 172.21.15.69:0/1292826794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568575c19f0 0x5568575cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.926+0000 7f363c7adb80 10 client.0 _ll_register_callbacks cb 0x55685748ac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:50.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.926+0000 7f3627400700 1 -- 172.21.15.69:0/1292826794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568575c19f0 msgr2=0x5568575cb550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:50.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.926+0000 7f3627400700 1 --2- 172.21.15.69:0/1292826794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568575c19f0 0x5568575cb550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.926+0000 7f3626a00700 1 --2- 172.21.15.69:0/1292826794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 0x5568575cb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.926+0000 7f3627400700 1 -- 172.21.15.69:0/1292826794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 msgr2=0x5568575cb010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:50.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.926+0000 7f3627400700 1 --2- 172.21.15.69:0/1292826794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 0x5568575cb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.926+0000 7f3627400700 1 -- 172.21.15.69:0/1292826794 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568574a9420 con 0x5568575c7830 2024-05-14T15:27:50.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.927+0000 7f3627400700 1 --2- 172.21.15.69:0/1292826794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c7830 0x5568575cba90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f36200e1780 tx=0x7f3620009c40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35d434a7264967c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:50.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.927+0000 7f3610c00700 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:27:50.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.928+0000 7f3610c00700 1 -- 172.21.15.69:0/1292826794 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36200b3bf0 con 0x5568575c7830 2024-05-14T15:27:50.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.928+0000 7f363c7adb80 1 -- 172.21.15.69:0/1292826794 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3620024360 con 0x5568575c7830 2024-05-14T15:27:50.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.928+0000 7f3610c00700 1 -- 172.21.15.69:0/1292826794 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f3620024510 con 0x5568575c7830 2024-05-14T15:27:50.732 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.929+0000 7f3610c00700 1 -- 172.21.15.69:0/1292826794 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f36200b3970 con 0x5568575c7830 2024-05-14T15:27:50.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.929+0000 7f363c7adb80 10 client.26047 fetch_fsmap learned FSMap version 49 2024-05-14T15:27:50.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.929+0000 7f363c7adb80 1 -- 172.21.15.69:0/1292826794 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x5568575e99d0 con 0x5568575c7830 2024-05-14T15:27:50.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.929+0000 7f3610c00700 1 -- 172.21.15.69:0/1292826794 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3620024360 con 0x5568575c7830 2024-05-14T15:27:50.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.931+0000 7f3610c00700 1 -- 172.21.15.69:0/1292826794 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7f3620011070 con 0x5568575c7830 2024-05-14T15:27:50.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.931+0000 7f363c7adb80 10 client.26047 fetch_fsmap finished waiting for FSMap version 49 2024-05-14T15:27:50.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.931+0000 7f363c7adb80 10 client.26047 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-05-14T15:27:50.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.931+0000 7f363c7adb80 20 client.26047 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:50.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.931+0000 7f363c7adb80 1 --2- 172.21.15.69:0/1292826794 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x5568575ebf40 0x5568575ee3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.932+0000 7f363c7adb80 4 client.26047 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:27:50.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.932+0000 7f363c7adb80 1 -- 172.21.15.69:0/1292826794 --> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55685758e1c0 con 0x5568575ebf40 2024-05-14T15:27:50.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.932+0000 7f3626a00700 1 --2- 172.21.15.69:0/1292826794 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x5568575ebf40 0x5568575ee3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.934+0000 7f3610c00700 10 client.26047 ms_handle_connect on v2:172.21.15.92:6834/360295917 2024-05-14T15:27:50.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.934+0000 7f3626a00700 1 --2- 172.21.15.69:0/1292826794 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x5568575ebf40 0x5568575ee3e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7ae3f8b1ae2abfc1 server_cookie=17af73a8a0e70227 in_seq=0 out_seq=0 2024-05-14T15:27:50.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.936+0000 7f3610c00700 1 -- 172.21.15.69:0/1292826794 <== mds.2 v2:172.21.15.92:6834/360295917 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55685758e1c0 con 0x5568575ebf40 2024-05-14T15:27:50.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.936+0000 7f3610c00700 10 client.26047 handle_command_reply: tid=0 2024-05-14T15:27:50.733 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.936+0000 7f363c7adb80 1 client.26047 shutdown 2024-05-14T15:27:50.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.937+0000 7f363c7adb80 1 -- 172.21.15.69:0/1292826794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c7830 msgr2=0x5568575cba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:50.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.937+0000 7f363c7adb80 1 --2- 172.21.15.69:0/1292826794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c7830 0x5568575cba90 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f36200e1780 tx=0x7f3620009c40 comp rx=0 tx=0).stop 2024-05-14T15:27:50.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.937+0000 7f363c7adb80 1 -- 172.21.15.69:0/1292826794 shutdown_connections 2024-05-14T15:27:50.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.937+0000 7f363c7adb80 1 --2- 172.21.15.69:0/1292826794 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 0x5568575cb010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.937+0000 7f363c7adb80 1 --2- 172.21.15.69:0/1292826794 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x5568575ebf40 0x5568575ee3e0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.937+0000 7f363c7adb80 1 --2- 172.21.15.69:0/1292826794 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c7830 0x5568575cba90 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.937+0000 7f363c7adb80 1 --2- 172.21.15.69:0/1292826794 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568575c19f0 0x5568575cb550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.937+0000 7f363c7adb80 1 -- 172.21.15.69:0/1292826794 >> 172.21.15.69:0/1292826794 conn(0x556857488f70 msgr2=0x5568575c04a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:50.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.937+0000 7f3610c00700 0 client.26047 ms_handle_reset on v2:172.21.15.92:6834/360295917 2024-05-14T15:27:50.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.937+0000 7f363c7adb80 1 -- 172.21.15.69:0/1292826794 shutdown_connections 2024-05-14T15:27:50.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.937+0000 7f363c7adb80 1 -- 172.21.15.69:0/1292826794 wait complete. 2024-05-14T15:27:50.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.938+0000 7f363c7adb80 20 client.26047 trim_cache size 0 max 16384 2024-05-14T15:27:50.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.962+0000 7f363c7adb80 1 Processor -- start 2024-05-14T15:27:50.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.963+0000 7f363c7adb80 1 -- start start 2024-05-14T15:27:50.734 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.963+0000 7f363c7adb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556857443e40 0x5568575c14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.963+0000 7f363c7adb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 0x5568575ca010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.963+0000 7f363c7adb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568575c7830 0x5568575f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.963+0000 7f363c7adb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f36281ae2b0 con 0x5568575c7830 2024-05-14T15:27:50.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.963+0000 7f363c7adb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f36281b0060 con 0x556857443e40 2024-05-14T15:27:50.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.963+0000 7f363c7adb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f36281aea40 con 0x5568575c19f0 2024-05-14T15:27:50.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.964+0000 7f3627400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568575c7830 0x5568575f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.964+0000 7f3626a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556857443e40 0x5568575c14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.965+0000 7f3626000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 0x5568575ca010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.965+0000 7f3626000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 0x5568575ca010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:43172/0 (socket says 172.21.15.69:43172) 2024-05-14T15:27:50.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.965+0000 7f3626000700 1 -- 172.21.15.69:0/1431702936 learned_addr learned my addr 172.21.15.69:0/1431702936 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:50.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.966+0000 7f3626000700 1 -- 172.21.15.69:0/1431702936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556857443e40 msgr2=0x5568575c14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:50.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.966+0000 7f3626000700 1 --2- 172.21.15.69:0/1431702936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556857443e40 0x5568575c14b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.966+0000 7f3626000700 1 -- 172.21.15.69:0/1431702936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568575c7830 msgr2=0x5568575f3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:50.735 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.966+0000 7f3626000700 1 --2- 172.21.15.69:0/1431702936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568575c7830 0x5568575f3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.966+0000 7f3626000700 1 -- 172.21.15.69:0/1431702936 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568575bd0d0 con 0x5568575c19f0 2024-05-14T15:27:50.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.966+0000 7f3627400700 1 --2- 172.21.15.69:0/1431702936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568575c7830 0x5568575f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:27:50.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.966+0000 7f3626000700 1 --2- 172.21.15.69:0/1431702936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 0x5568575ca010 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f362806c620 tx=0x7f3614005ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6436155fa493bb24 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:50.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.967+0000 7f3613400700 1 -- 172.21.15.69:0/1431702936 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3614025030 con 0x5568575c19f0 2024-05-14T15:27:50.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.967+0000 7f3613400700 1 -- 172.21.15.69:0/1431702936 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3614019070 con 0x5568575c19f0 2024-05-14T15:27:50.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.967+0000 7f3613400700 1 -- 172.21.15.69:0/1431702936 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3614003cb0 con 0x5568575c19f0 2024-05-14T15:27:50.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.969+0000 7f363c7adb80 1 -- 172.21.15.69:0/1431702936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 msgr2=0x5568575ca010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:50.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.969+0000 7f363c7adb80 1 --2- 172.21.15.69:0/1431702936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 0x5568575ca010 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f362806c620 tx=0x7f3614005ee0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.969+0000 7f363c7adb80 1 -- 172.21.15.69:0/1431702936 shutdown_connections 2024-05-14T15:27:50.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.969+0000 7f363c7adb80 1 --2- 172.21.15.69:0/1431702936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5568575c7830 0x5568575f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.969+0000 7f363c7adb80 1 --2- 172.21.15.69:0/1431702936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556857443e40 0x5568575c14b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.969+0000 7f363c7adb80 1 --2- 172.21.15.69:0/1431702936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 0x5568575ca010 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.969+0000 7f363c7adb80 1 -- 172.21.15.69:0/1431702936 >> 172.21.15.69:0/1431702936 conn(0x556857488f70 msgr2=0x5568575c9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:50.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.970+0000 7f363c7adb80 1 -- 172.21.15.69:0/1431702936 shutdown_connections 2024-05-14T15:27:50.736 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.970+0000 7f363c7adb80 1 -- 172.21.15.69:0/1431702936 wait complete. 2024-05-14T15:27:50.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.970+0000 7f363c7adb80 1 -- start start 2024-05-14T15:27:50.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.971+0000 7f363c7adb80 1 Processor -- start 2024-05-14T15:27:50.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.971+0000 7f363c7adb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 0x5568575d3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.971+0000 7f363c7adb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 0x5568575c04a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.971+0000 7f363c7adb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568575c7830 0x5568575c09e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.971+0000 7f363c7adb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f36281af8d0 con 0x556857443e40 2024-05-14T15:27:50.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.971+0000 7f363c7adb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f36281af140 con 0x5568575c7830 2024-05-14T15:27:50.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.971+0000 7f363c7adb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f36281a2760 con 0x5568575c19f0 2024-05-14T15:27:50.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.971+0000 7f363c7adb80 10 client.0 _ll_register_callbacks cb 0x55685748ac70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:50.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.972+0000 7f3626a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 0x5568575d3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.972+0000 7f3626a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 0x5568575d3580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48962/0 (socket says 172.21.15.69:48962) 2024-05-14T15:27:50.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.972+0000 7f3626a00700 1 -- 172.21.15.69:0/3624526803 learned_addr learned my addr 172.21.15.69:0/3624526803 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:50.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.972+0000 7f3626000700 1 --2- 172.21.15.69:0/3624526803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 0x5568575c04a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.972+0000 7f3627400700 1 --2- 172.21.15.69:0/3624526803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568575c7830 0x5568575c09e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.737 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.973+0000 7f3626a00700 1 -- 172.21.15.69:0/3624526803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 msgr2=0x5568575c04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:50.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.973+0000 7f3626a00700 1 --2- 172.21.15.69:0/3624526803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 0x5568575c04a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.973+0000 7f3626a00700 1 -- 172.21.15.69:0/3624526803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568575c7830 msgr2=0x5568575c09e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:50.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.973+0000 7f3626a00700 1 --2- 172.21.15.69:0/3624526803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568575c7830 0x5568575c09e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.973+0000 7f3626a00700 1 -- 172.21.15.69:0/3624526803 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568575c0f20 con 0x556857443e40 2024-05-14T15:27:50.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.973+0000 7f3626a00700 1 --2- 172.21.15.69:0/3624526803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 0x5568575d3580 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3618004790 tx=0x7f36180127e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1077520bd1b2571 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:50.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.973+0000 7f3610c00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:27:50.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.974+0000 7f3610c00700 1 -- 172.21.15.69:0/3624526803 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f361801e800 con 0x556857443e40 2024-05-14T15:27:50.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.974+0000 7f3610c00700 1 -- 172.21.15.69:0/3624526803 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f361801e9a0 con 0x556857443e40 2024-05-14T15:27:50.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.974+0000 7f363c7adb80 1 -- 172.21.15.69:0/3624526803 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3614019070 con 0x556857443e40 2024-05-14T15:27:50.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.974+0000 7f3610c00700 1 -- 172.21.15.69:0/3624526803 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) ==== 24+0+0 (secure 0 0 0) 0x7f3618004030 con 0x556857443e40 2024-05-14T15:27:50.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.975+0000 7f363c7adb80 10 client.16572 fetch_fsmap learned FSMap version 49 2024-05-14T15:27:50.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.975+0000 7f363c7adb80 1 -- 172.21.15.69:0/3624526803 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=4+}) -- 0x556857667340 con 0x556857443e40 2024-05-14T15:27:50.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.976+0000 7f3610c00700 1 -- 172.21.15.69:0/3624526803 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3614019070 con 0x556857443e40 2024-05-14T15:27:50.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.976+0000 7f3610c00700 1 -- 172.21.15.69:0/3624526803 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 49) ==== 8422+0+0 (secure 0 0 0) 0x7f3618003cb0 con 0x556857443e40 2024-05-14T15:27:50.738 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.976+0000 7f363c7adb80 10 client.16572 fetch_fsmap finished waiting for FSMap version 49 2024-05-14T15:27:50.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.976+0000 7f363c7adb80 10 client.16572 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-05-14T15:27:50.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.976+0000 7f363c7adb80 20 client.16572 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:50.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.976+0000 7f363c7adb80 1 --2- 172.21.15.69:0/3624526803 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x556857667ab0 0x556857669ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:50.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.976+0000 7f363c7adb80 4 client.16572 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:27:50.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.976+0000 7f363c7adb80 1 -- 172.21.15.69:0/3624526803 --> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5568574f1400 con 0x556857667ab0 2024-05-14T15:27:50.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.977+0000 7f3626000700 1 --2- 172.21.15.69:0/3624526803 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x556857667ab0 0x556857669ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:50.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.979+0000 7f3626000700 1 --2- 172.21.15.69:0/3624526803 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x556857667ab0 0x556857669ed0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9cfc54bc804f608f server_cookie=552329d09a9125b2 in_seq=0 out_seq=0 2024-05-14T15:27:50.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.979+0000 7f3610c00700 10 client.16572 ms_handle_connect on v2:172.21.15.92:6834/360295917 2024-05-14T15:27:50.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.980+0000 7f3610c00700 1 -- 172.21.15.69:0/3624526803 <== mds.2 v2:172.21.15.92:6834/360295917 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5568574f1400 con 0x556857667ab0 2024-05-14T15:27:50.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.980+0000 7f3610c00700 10 client.16572 handle_command_reply: tid=0 2024-05-14T15:27:50.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.980+0000 7f363c7adb80 1 client.16572 shutdown 2024-05-14T15:27:50.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.981+0000 7f363c7adb80 1 -- 172.21.15.69:0/3624526803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 msgr2=0x5568575d3580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:50.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.981+0000 7f363c7adb80 1 --2- 172.21.15.69:0/3624526803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 0x5568575d3580 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f3618004790 tx=0x7f36180127e0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.982+0000 7f363c7adb80 1 -- 172.21.15.69:0/3624526803 shutdown_connections 2024-05-14T15:27:50.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.982+0000 7f363c7adb80 1 --2- 172.21.15.69:0/3624526803 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556857443e40 0x5568575d3580 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.739 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.982+0000 7f363c7adb80 1 --2- 172.21.15.69:0/3624526803 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x556857667ab0 0x556857669ed0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.982+0000 7f363c7adb80 1 --2- 172.21.15.69:0/3624526803 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5568575c7830 0x5568575c09e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.982+0000 7f363c7adb80 1 --2- 172.21.15.69:0/3624526803 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5568575c19f0 0x5568575c04a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.982+0000 7f363c7adb80 1 -- 172.21.15.69:0/3624526803 >> 172.21.15.69:0/3624526803 conn(0x556857488f70 msgr2=0x5568575b60a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:50.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.982+0000 7f3610c00700 0 client.16572 ms_handle_reset on v2:172.21.15.92:6834/360295917 2024-05-14T15:27:50.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.982+0000 7f363c7adb80 1 -- 172.21.15.69:0/3624526803 shutdown_connections 2024-05-14T15:27:50.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.983+0000 7f363c7adb80 1 -- 172.21.15.69:0/3624526803 wait complete. 2024-05-14T15:27:50.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.983+0000 7f363c7adb80 20 client.16572 trim_cache size 0 max 16384 2024-05-14T15:27:50.740 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:27:50.740 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.984+0000 7f362dc00700 1 -- 172.21.15.69:0/2890182143 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f360c0b2aa0 msgr2=0x7f360c0b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.984+0000 7f362dc00700 1 --2- 172.21.15.69:0/2890182143 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f360c0b2aa0 0x7f360c0b4fb0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x5568575bdab0 tx=0x7f36140058e0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.984+0000 7f362dc00700 1 -- 172.21.15.69:0/2890182143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362810c5b0 msgr2=0x7f3628111230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.984+0000 7f362dc00700 1 --2- 172.21.15.69:0/2890182143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362810c5b0 0x7f3628111230 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3620009f90 tx=0x7f362000ce20 comp rx=0 tx=0).stop 2024-05-14T15:27:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.984+0000 7f362dc00700 1 -- 172.21.15.69:0/2890182143 shutdown_connections 2024-05-14T15:27:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.984+0000 7f362dc00700 1 --2- 172.21.15.69:0/2890182143 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f360c0b2aa0 0x7f360c0b4fb0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.984+0000 7f362dc00700 1 --2- 172.21.15.69:0/2890182143 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f362810c5b0 0x7f3628111230 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.984+0000 7f362dc00700 1 --2- 172.21.15.69:0/2890182143 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3628106570 0x7f36281107b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.984+0000 7f362dc00700 1 --2- 172.21.15.69:0/2890182143 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3628106ec0 0x7f3628110cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.984+0000 7f362dc00700 1 -- 172.21.15.69:0/2890182143 >> 172.21.15.69:0/2890182143 conn(0x7f3628102050 msgr2=0x7f36281036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.984+0000 7f362dc00700 1 -- 172.21.15.69:0/2890182143 shutdown_connections 2024-05-14T15:27:50.741 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:49.985+0000 7f362dc00700 1 -- 172.21.15.69:0/2890182143 wait complete. 2024-05-14T15:27:51.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:51 smithi203 ceph-mon[34567]: pgmap v189: 129 pgs: 129 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.4 MiB/s wr, 899 op/s 2024-05-14T15:27:51.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 125.0 s, 592.0 tps, lat 168.669 ms stddev 46.261 2024-05-14T15:27:51.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:51 smithi092 ceph-mon[34729]: pgmap v189: 129 pgs: 129 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.4 MiB/s wr, 899 op/s 2024-05-14T15:27:51.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:51 smithi069 ceph-mon[31270]: pgmap v189: 129 pgs: 129 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 7.4 MiB/s wr, 899 op/s 2024-05-14T15:27:51.795 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-14T15:27:52.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:52 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:27:52.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:52 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:27:52.504 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:27:52.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:52 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:27:53.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:53 smithi092 ceph-mon[34729]: pgmap v190: 129 pgs: 129 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.9 MiB/s wr, 592 op/s 2024-05-14T15:27:53.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:53 smithi069 ceph-mon[31270]: pgmap v190: 129 pgs: 129 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.9 MiB/s wr, 592 op/s 2024-05-14T15:27:53.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:53 smithi203 ceph-mon[34567]: pgmap v190: 129 pgs: 129 active+clean; 1.9 GiB data, 6.1 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.9 MiB/s wr, 592 op/s 2024-05-14T15:27:55.134 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:55 smithi069 ceph-mon[31270]: pgmap v191: 129 pgs: 129 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.9 MiB/s wr, 814 op/s 2024-05-14T15:27:55.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:55 smithi092 ceph-mon[34729]: pgmap v191: 129 pgs: 129 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.9 MiB/s wr, 814 op/s 2024-05-14T15:27:55.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:55 smithi203 ceph-mon[34567]: pgmap v191: 129 pgs: 129 active+clean; 1.9 GiB data, 6.2 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.9 MiB/s wr, 814 op/s 2024-05-14T15:27:56.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 130.0 s, 422.7 tps, lat 162.492 ms stddev 46.122 2024-05-14T15:27:56.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.810+0000 7f4303a00700 1 -- 172.21.15.69:0/4113776364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f42fc109870 msgr2=0x7f42fc1111d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:56.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.810+0000 7f4303a00700 1 --2- 172.21.15.69:0/4113776364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f42fc109870 0x7f42fc1111d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009920 tx=0x7f42ec009c30 comp rx=0 tx=0).stop 2024-05-14T15:27:56.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.810+0000 7f4303a00700 1 -- 172.21.15.69:0/4113776364 shutdown_connections 2024-05-14T15:27:56.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.810+0000 7f4303a00700 1 --2- 172.21.15.69:0/4113776364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42fc1045f0 0x7f42fc104a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.810+0000 7f4303a00700 1 --2- 172.21.15.69:0/4113776364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f42fc109870 0x7f42fc1111d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.810+0000 7f4303a00700 1 --2- 172.21.15.69:0/4113776364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42fc108f20 0x7f42fc109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.810+0000 7f4303a00700 1 -- 172.21.15.69:0/4113776364 >> 172.21.15.69:0/4113776364 conn(0x7f42fc100040 msgr2=0x7f42fc102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:56.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.811+0000 7f4303a00700 1 -- 172.21.15.69:0/4113776364 shutdown_connections 2024-05-14T15:27:56.813 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.812+0000 7f4303a00700 1 -- 172.21.15.69:0/4113776364 wait complete. 2024-05-14T15:27:56.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.813+0000 7f4303a00700 1 Processor -- start 2024-05-14T15:27:56.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.814+0000 7f4303a00700 1 -- start start 2024-05-14T15:27:56.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.814+0000 7f4303a00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42fc1045f0 0x7f42fc1a2030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.814+0000 7f4303a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f42fc108f20 0x7f42fc1a25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.814+0000 7f4303a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42fc109870 0x7f42fc1ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.814+0000 7f4303a00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc114350 con 0x7f42fc109870 2024-05-14T15:27:56.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.815+0000 7f4303a00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc1141d0 con 0x7f42fc1045f0 2024-05-14T15:27:56.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.815+0000 7f4303a00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc1144d0 con 0x7f42fc108f20 2024-05-14T15:27:56.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.815+0000 7f42fbe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f42fc108f20 0x7f42fc1a25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:56.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.815+0000 7f42fbe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f42fc108f20 0x7f42fc1a25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:49520/0 (socket says 172.21.15.69:49520) 2024-05-14T15:27:56.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.815+0000 7f42fbe00700 1 -- 172.21.15.69:0/4109617366 learned_addr learned my addr 172.21.15.69:0/4109617366 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:56.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.815+0000 7f4301000700 1 --2- 172.21.15.69:0/4109617366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42fc1045f0 0x7f42fc1a2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:56.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.815+0000 7f4301a00700 1 --2- 172.21.15.69:0/4109617366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42fc109870 0x7f42fc1ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:56.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.816+0000 7f4301a00700 1 -- 172.21.15.69:0/4109617366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f42fc108f20 msgr2=0x7f42fc1a25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:56.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.818+0000 7f4301a00700 1 --2- 172.21.15.69:0/4109617366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f42fc108f20 0x7f42fc1a25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.818+0000 7f4301a00700 1 -- 172.21.15.69:0/4109617366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42fc1045f0 msgr2=0x7f42fc1a2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:56.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.818+0000 7f4301a00700 1 --2- 172.21.15.69:0/4109617366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42fc1045f0 0x7f42fc1a2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.818+0000 7f4301a00700 1 -- 172.21.15.69:0/4109617366 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42fc199820 con 0x7f42fc109870 2024-05-14T15:27:56.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.818+0000 7f4301000700 1 --2- 172.21.15.69:0/4109617366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42fc1045f0 0x7f42fc1a2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:27:56.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.818+0000 7f4301a00700 1 --2- 172.21.15.69:0/4109617366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42fc109870 0x7f42fc1ad0b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009230 tx=0x7f42ec00fa00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:56.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.819+0000 7f42f9600700 1 -- 172.21.15.69:0/4109617366 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec027070 con 0x7f42fc109870 2024-05-14T15:27:56.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.819+0000 7f42f9600700 1 -- 172.21.15.69:0/4109617366 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42ec00ba70 con 0x7f42fc109870 2024-05-14T15:27:56.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.819+0000 7f42f9600700 1 -- 172.21.15.69:0/4109617366 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42ec004930 con 0x7f42fc109870 2024-05-14T15:27:56.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.819+0000 7f4303a00700 1 -- 172.21.15.69:0/4109617366 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42fc199ab0 con 0x7f42fc109870 2024-05-14T15:27:56.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.819+0000 7f4303a00700 1 -- 172.21.15.69:0/4109617366 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42fc199f40 con 0x7f42fc109870 2024-05-14T15:27:56.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.826+0000 7f43124b7b80 1 Processor -- start 2024-05-14T15:27:56.828 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.826+0000 7f42f9600700 1 -- 172.21.15.69:0/4109617366 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f42ec02a070 con 0x7f42fc109870 2024-05-14T15:27:56.829 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.827+0000 7f43124b7b80 1 -- start start 2024-05-14T15:27:56.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.827+0000 7f43124b7b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04abde40 0x560d04c416b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.828+0000 7f43124b7b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04c41bf0 0x560d04c3b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.828+0000 7f43124b7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 0x560d04c3c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.828+0000 7f43124b7b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560d04b5da20 con 0x560d04abde40 2024-05-14T15:27:56.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.828+0000 7f43124b7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560d04afb760 con 0x560d04c3bc50 2024-05-14T15:27:56.830 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.828+0000 7f43124b7b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560d04b599e0 con 0x560d04c41bf0 2024-05-14T15:27:56.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.829+0000 7f4301000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04c41bf0 0x560d04c3b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:56.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.829+0000 7f4301000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04c41bf0 0x560d04c3b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:49522/0 (socket says 172.21.15.69:49522) 2024-05-14T15:27:56.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.829+0000 7f42f9600700 1 --2- 172.21.15.69:0/4109617366 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f42e00b2bc0 0x7f42e00b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.830+0000 7f4301000700 1 -- 172.21.15.69:0/4100720777 learned_addr learned my addr 172.21.15.69:0/4100720777 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:56.831 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.830+0000 7f42fbe00700 1 --2- 172.21.15.69:0/4100720777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04abde40 0x560d04c416b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:56.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.831+0000 7f4301000700 1 -- 172.21.15.69:0/4100720777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 msgr2=0x560d04c3c060 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:27:56.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.831+0000 7f4301000700 1 --2- 172.21.15.69:0/4100720777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 0x560d04c3c060 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.832 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.831+0000 7f4301000700 1 -- 172.21.15.69:0/4100720777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04abde40 msgr2=0x560d04c416b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:56.833 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.831+0000 7f4301a00700 1 --2- 172.21.15.69:0/4109617366 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f42e00b2bc0 0x7f42e00b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:56.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.831+0000 7f4301000700 1 --2- 172.21.15.69:0/4100720777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04abde40 0x560d04c416b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.831+0000 7f4301000700 1 -- 172.21.15.69:0/4100720777 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d04aaa8d0 con 0x560d04c41bf0 2024-05-14T15:27:56.834 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.831+0000 7f42fbe00700 1 --2- 172.21.15.69:0/4100720777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04abde40 0x560d04c416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:27:56.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.832+0000 7f42f9600700 1 -- 172.21.15.69:0/4109617366 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f42ec0e33b0 con 0x7f42fc109870 2024-05-14T15:27:56.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.832+0000 7f4301000700 1 --2- 172.21.15.69:0/4100720777 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04c41bf0 0x560d04c3b710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f42f40093c0 tx=0x7f42f40099e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a12b075b1b3663d0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:56.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.833+0000 7f42f2000700 1 -- 172.21.15.69:0/4100720777 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f401b020 con 0x560d04c41bf0 2024-05-14T15:27:56.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.833+0000 7f42f2000700 1 -- 172.21.15.69:0/4100720777 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42f4007c50 con 0x560d04c41bf0 2024-05-14T15:27:56.835 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.833+0000 7f42f2000700 1 -- 172.21.15.69:0/4100720777 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f4017d40 con 0x560d04c41bf0 2024-05-14T15:27:56.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.835+0000 7f4301a00700 1 --2- 172.21.15.69:0/4109617366 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f42e00b2bc0 0x7f42e00b50d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0a6390 tx=0x7f42ec009c30 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:56.836 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.835+0000 7f43124b7b80 1 -- 172.21.15.69:0/4100720777 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04c41bf0 msgr2=0x560d04c3b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:56.837 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.835+0000 7f43124b7b80 1 --2- 172.21.15.69:0/4100720777 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04c41bf0 0x560d04c3b710 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f42f40093c0 tx=0x7f42f40099e0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.836+0000 7f43124b7b80 1 -- 172.21.15.69:0/4100720777 shutdown_connections 2024-05-14T15:27:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.836+0000 7f43124b7b80 1 --2- 172.21.15.69:0/4100720777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04abde40 0x560d04c416b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.836+0000 7f43124b7b80 1 --2- 172.21.15.69:0/4100720777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 0x560d04c3c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.836+0000 7f43124b7b80 1 --2- 172.21.15.69:0/4100720777 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04c41bf0 0x560d04c3b710 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.836+0000 7f43124b7b80 1 -- 172.21.15.69:0/4100720777 >> 172.21.15.69:0/4100720777 conn(0x560d04afca80 msgr2=0x560d04c36790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.836+0000 7f43124b7b80 1 -- 172.21.15.69:0/4100720777 shutdown_connections 2024-05-14T15:27:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.836+0000 7f43124b7b80 1 -- 172.21.15.69:0/4100720777 wait complete. 2024-05-14T15:27:56.838 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.837+0000 7f43124b7b80 1 -- start start 2024-05-14T15:27:56.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.837+0000 7f43124b7b80 1 Processor -- start 2024-05-14T15:27:56.839 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.838+0000 7f43124b7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04abde40 0x560d04c45420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.838+0000 7f43124b7b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04c3bc50 0x560d04c45960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.838+0000 7f43124b7b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04c41bf0 0x560d04c45ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.838+0000 7f43124b7b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560d04c486c0 con 0x560d04c41bf0 2024-05-14T15:27:56.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.838+0000 7f43124b7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560d04ac3b20 con 0x560d04abde40 2024-05-14T15:27:56.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.838+0000 7f43124b7b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560d04c48840 con 0x560d04c3bc50 2024-05-14T15:27:56.840 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.838+0000 7f43124b7b80 10 client.0 _ll_register_callbacks cb 0x560d04af1380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:56.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.839+0000 7f42fbe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04c41bf0 0x560d04c45ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:56.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.839+0000 7f42fbe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04c41bf0 0x560d04c45ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49636/0 (socket says 172.21.15.69:49636) 2024-05-14T15:27:56.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.839+0000 7f42fbe00700 1 -- 172.21.15.69:0/1439106177 learned_addr learned my addr 172.21.15.69:0/1439106177 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:56.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.839+0000 7f4301000700 1 --2- 172.21.15.69:0/1439106177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04c3bc50 0x560d04c45960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:56.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.839+0000 7f42fbe00700 1 --2- 172.21.15.69:0/1439106177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04abde40 0x560d04c45420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:56.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.840+0000 7f42fbe00700 1 -- 172.21.15.69:0/1439106177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04c3bc50 msgr2=0x560d04c45960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:56.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.840+0000 7f42fbe00700 1 --2- 172.21.15.69:0/1439106177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04c3bc50 0x560d04c45960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.841 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.840+0000 7f42fbe00700 1 -- 172.21.15.69:0/1439106177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04abde40 msgr2=0x560d04c45420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:56.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.840+0000 7f42fbe00700 1 --2- 172.21.15.69:0/1439106177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04abde40 0x560d04c45420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.840+0000 7f42fbe00700 1 -- 172.21.15.69:0/1439106177 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d04b23420 con 0x560d04c41bf0 2024-05-14T15:27:56.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.840+0000 7f42fbe00700 1 --2- 172.21.15.69:0/1439106177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04c41bf0 0x560d04c45ea0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009eb0 tx=0x7f42e4009770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26ba53010a562c50 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:56.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.840+0000 7f42eaa00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:27:56.842 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.840+0000 7f42eaa00700 1 -- 172.21.15.69:0/1439106177 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4010b70 con 0x560d04c41bf0 2024-05-14T15:27:56.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.841+0000 7f42eaa00700 1 -- 172.21.15.69:0/1439106177 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f42e4010d10 con 0x560d04c41bf0 2024-05-14T15:27:56.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.841+0000 7f43124b7b80 1 -- 172.21.15.69:0/1439106177 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42f4007c50 con 0x560d04c41bf0 2024-05-14T15:27:56.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.841+0000 7f42eaa00700 1 -- 172.21.15.69:0/1439106177 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f42e4004020 con 0x560d04c41bf0 2024-05-14T15:27:56.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.841+0000 7f43124b7b80 10 client.16584 fetch_fsmap learned FSMap version 50 2024-05-14T15:27:56.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.841+0000 7f43124b7b80 1 -- 172.21.15.69:0/1439106177 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x560d04c53380 con 0x560d04c41bf0 2024-05-14T15:27:56.843 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.842+0000 7f42eaa00700 1 -- 172.21.15.69:0/1439106177 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42f4007c50 con 0x560d04c41bf0 2024-05-14T15:27:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.842+0000 7f42eaa00700 1 -- 172.21.15.69:0/1439106177 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 50) ==== 8418+0+0 (secure 0 0 0) 0x7f42e4029020 con 0x560d04c41bf0 2024-05-14T15:27:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.842+0000 7f43124b7b80 10 client.16584 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T15:27:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.843+0000 7f43124b7b80 10 client.16584 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-14T15:27:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.843+0000 7f43124b7b80 20 client.16584 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.843+0000 7f43124b7b80 1 --2- 172.21.15.69:0/1439106177 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x560d04c55a10 0x560d04c57ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.843+0000 7f43124b7b80 4 client.16584 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:27:56.845 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.843+0000 7f43124b7b80 1 -- 172.21.15.69:0/1439106177 --> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d04c08070 con 0x560d04c55a10 2024-05-14T15:27:56.846 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.844+0000 7f4301000700 1 --2- 172.21.15.69:0/1439106177 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x560d04c55a10 0x560d04c57ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:56.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.846+0000 7f42eaa00700 10 client.16584 ms_handle_connect on v2:172.21.15.92:6836/1669439322 2024-05-14T15:27:56.847 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.846+0000 7f4301000700 1 --2- 172.21.15.69:0/1439106177 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x560d04c55a10 0x560d04c57ec0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4168b34ffc070ed1 server_cookie=7c78e166564a630d in_seq=0 out_seq=0 2024-05-14T15:27:56.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.849+0000 7f42eaa00700 1 -- 172.21.15.69:0/1439106177 <== mds.1 v2:172.21.15.92:6836/1669439322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560d04c08070 con 0x560d04c55a10 2024-05-14T15:27:56.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.849+0000 7f42eaa00700 10 client.16584 handle_command_reply: tid=0 2024-05-14T15:27:56.850 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.849+0000 7f43124b7b80 1 client.16584 shutdown 2024-05-14T15:27:56.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.849+0000 7f43124b7b80 1 -- 172.21.15.69:0/1439106177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04c41bf0 msgr2=0x560d04c45ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:56.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.849+0000 7f43124b7b80 1 --2- 172.21.15.69:0/1439106177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04c41bf0 0x560d04c45ea0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009eb0 tx=0x7f42e4009770 comp rx=0 tx=0).stop 2024-05-14T15:27:56.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.849+0000 7f43124b7b80 1 -- 172.21.15.69:0/1439106177 shutdown_connections 2024-05-14T15:27:56.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.849+0000 7f43124b7b80 1 --2- 172.21.15.69:0/1439106177 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x560d04c55a10 0x560d04c57ec0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.850+0000 7f43124b7b80 1 --2- 172.21.15.69:0/1439106177 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04c41bf0 0x560d04c45ea0 secure :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f42e4009eb0 tx=0x7f42e4009770 comp rx=0 tx=0).stop 2024-05-14T15:27:56.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.850+0000 7f43124b7b80 1 --2- 172.21.15.69:0/1439106177 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04abde40 0x560d04c45420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.850+0000 7f43124b7b80 1 --2- 172.21.15.69:0/1439106177 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04c3bc50 0x560d04c45960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.850+0000 7f43124b7b80 1 -- 172.21.15.69:0/1439106177 >> 172.21.15.69:0/1439106177 conn(0x560d04afca80 msgr2=0x560d04c3a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:56.851 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.850+0000 7f42eaa00700 0 client.16584 ms_handle_reset on v2:172.21.15.92:6836/1669439322 2024-05-14T15:27:56.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.851+0000 7f43124b7b80 1 -- 172.21.15.69:0/1439106177 shutdown_connections 2024-05-14T15:27:56.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.851+0000 7f43124b7b80 1 -- 172.21.15.69:0/1439106177 wait complete. 2024-05-14T15:27:56.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.851+0000 7f43124b7b80 20 client.16584 trim_cache size 0 max 16384 2024-05-14T15:27:56.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.878+0000 7f43124b7b80 1 Processor -- start 2024-05-14T15:27:56.880 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.878+0000 7f43124b7b80 1 -- start start 2024-05-14T15:27:56.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.879+0000 7f43124b7b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04abde40 0x560d04c3b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.879+0000 7f43124b7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 0x560d04c45e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.880+0000 7f43124b7b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04c44d20 0x560d04c3f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.880+0000 7f43124b7b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc1bf350 con 0x560d04abde40 2024-05-14T15:27:56.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.880+0000 7f43124b7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc1c10d0 con 0x560d04c3bc50 2024-05-14T15:27:56.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.880+0000 7f43124b7b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc1bfae0 con 0x560d04c44d20 2024-05-14T15:27:56.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.880+0000 7f4301000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 0x560d04c45e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:56.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.880+0000 7f42fbe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04abde40 0x560d04c3b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:56.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.880+0000 7f4301000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 0x560d04c45e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:60500/0 (socket says 172.21.15.69:60500) 2024-05-14T15:27:56.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.880+0000 7f4301000700 1 -- 172.21.15.69:0/1492011755 learned_addr learned my addr 172.21.15.69:0/1492011755 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:56.882 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.881+0000 7f42fbe00700 1 -- 172.21.15.69:0/1492011755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04c44d20 msgr2=0x560d04c3f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:56.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.881+0000 7f42fbe00700 1 --2- 172.21.15.69:0/1492011755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04c44d20 0x560d04c3f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.881+0000 7f42fbe00700 1 -- 172.21.15.69:0/1492011755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 msgr2=0x560d04c45e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:56.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.881+0000 7f42fbe00700 1 --2- 172.21.15.69:0/1492011755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 0x560d04c45e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.881+0000 7f42fbe00700 1 -- 172.21.15.69:0/1492011755 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d04c43990 con 0x560d04abde40 2024-05-14T15:27:56.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.881+0000 7f4301000700 1 --2- 172.21.15.69:0/1492011755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 0x560d04c45e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:27:56.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.881+0000 7f42fbe00700 1 --2- 172.21.15.69:0/1492011755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04abde40 0x560d04c3b710 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f42e4013040 tx=0x7f42e4003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ced1d8c72a99e328 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:56.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.882+0000 7f42f1600700 1 -- 172.21.15.69:0/1492011755 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4000e60 con 0x560d04abde40 2024-05-14T15:27:56.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.882+0000 7f42f1600700 1 -- 172.21.15.69:0/1492011755 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42e4014170 con 0x560d04abde40 2024-05-14T15:27:56.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.882+0000 7f42f1600700 1 -- 172.21.15.69:0/1492011755 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42e4004020 con 0x560d04abde40 2024-05-14T15:27:56.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.883+0000 7f43124b7b80 1 -- 172.21.15.69:0/1492011755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04abde40 msgr2=0x560d04c3b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:56.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.883+0000 7f43124b7b80 1 --2- 172.21.15.69:0/1492011755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04abde40 0x560d04c3b710 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f42e4013040 tx=0x7f42e4003f80 comp rx=0 tx=0).stop 2024-05-14T15:27:56.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.884+0000 7f43124b7b80 1 -- 172.21.15.69:0/1492011755 shutdown_connections 2024-05-14T15:27:56.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.884+0000 7f43124b7b80 1 --2- 172.21.15.69:0/1492011755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04abde40 0x560d04c3b710 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.884+0000 7f43124b7b80 1 --2- 172.21.15.69:0/1492011755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04c44d20 0x560d04c3f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.884+0000 7f43124b7b80 1 --2- 172.21.15.69:0/1492011755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 0x560d04c45e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.884+0000 7f43124b7b80 1 -- 172.21.15.69:0/1492011755 >> 172.21.15.69:0/1492011755 conn(0x560d04afca80 msgr2=0x560d04c3f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:56.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.884+0000 7f43124b7b80 1 -- 172.21.15.69:0/1492011755 shutdown_connections 2024-05-14T15:27:56.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.884+0000 7f43124b7b80 1 -- 172.21.15.69:0/1492011755 wait complete. 2024-05-14T15:27:56.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.885+0000 7f43124b7b80 1 -- start start 2024-05-14T15:27:56.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.885+0000 7f43124b7b80 1 Processor -- start 2024-05-14T15:27:56.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.886+0000 7f43124b7b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04abde40 0x560d04c4dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.886+0000 7f43124b7b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 0x560d04c5cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.886+0000 7f43124b7b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04c44d20 0x560d04c5d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.886+0000 7f43124b7b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc1c0940 con 0x560d04c44d20 2024-05-14T15:27:56.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.886+0000 7f43124b7b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc1c01b0 con 0x560d04c3bc50 2024-05-14T15:27:56.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.886+0000 7f43124b7b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f42fc1a0ce0 con 0x560d04abde40 2024-05-14T15:27:56.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.886+0000 7f43124b7b80 10 client.0 _ll_register_callbacks cb 0x560d04af1380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:27:56.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.887+0000 7f4301000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 0x560d04c5cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:56.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.887+0000 7f4301000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 0x560d04c5cc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:60506/0 (socket says 172.21.15.69:60506) 2024-05-14T15:27:56.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.887+0000 7f4301000700 1 -- 172.21.15.69:0/2742502986 learned_addr learned my addr 172.21.15.69:0/2742502986 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:27:56.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.887+0000 7f42fbe00700 1 --2- 172.21.15.69:0/2742502986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04abde40 0x560d04c4dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:56.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.887+0000 7f42fbe00700 1 --2- 172.21.15.69:0/2742502986 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04c44d20 0x560d04c5d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:56.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.888+0000 7f4301000700 1 -- 172.21.15.69:0/2742502986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04abde40 msgr2=0x560d04c4dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:56.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.888+0000 7f4301000700 1 --2- 172.21.15.69:0/2742502986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04abde40 0x560d04c4dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.888+0000 7f4301000700 1 -- 172.21.15.69:0/2742502986 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04c44d20 msgr2=0x560d04c5d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:27:56.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.888+0000 7f4301000700 1 --2- 172.21.15.69:0/2742502986 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04c44d20 0x560d04c5d190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.888+0000 7f4301000700 1 -- 172.21.15.69:0/2742502986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d04c5d840 con 0x560d04c3bc50 2024-05-14T15:27:56.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.888+0000 7f42fbe00700 1 --2- 172.21.15.69:0/2742502986 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04c44d20 0x560d04c5d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:27:56.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.888+0000 7f4301000700 1 --2- 172.21.15.69:0/2742502986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 0x560d04c5cc50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009fd0 tx=0x7f42f4004d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34c4c94cf3e550af server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:27:56.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.888+0000 7f42eaa00700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:27:56.890 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.889+0000 7f42eaa00700 1 -- 172.21.15.69:0/2742502986 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42f401b040 con 0x560d04c3bc50 2024-05-14T15:27:56.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.889+0000 7f42eaa00700 1 -- 172.21.15.69:0/2742502986 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f42f4007890 con 0x560d04c3bc50 2024-05-14T15:27:56.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.889+0000 7f43124b7b80 1 -- 172.21.15.69:0/2742502986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42e4014170 con 0x560d04c3bc50 2024-05-14T15:27:56.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.890+0000 7f42eaa00700 1 -- 172.21.15.69:0/2742502986 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f42f4035050 con 0x560d04c3bc50 2024-05-14T15:27:56.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.890+0000 7f43124b7b80 10 client.36086 fetch_fsmap learned FSMap version 50 2024-05-14T15:27:56.891 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.890+0000 7f43124b7b80 1 -- 172.21.15.69:0/2742502986 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x560d04cc00c0 con 0x560d04c3bc50 2024-05-14T15:27:56.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.891+0000 7f42eaa00700 1 -- 172.21.15.69:0/2742502986 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f42e4014170 con 0x560d04c3bc50 2024-05-14T15:27:56.893 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.891+0000 7f42eaa00700 1 -- 172.21.15.69:0/2742502986 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 50) ==== 8418+0+0 (secure 0 0 0) 0x7f42f402a610 con 0x560d04c3bc50 2024-05-14T15:27:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.892+0000 7f43124b7b80 10 client.36086 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T15:27:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.892+0000 7f43124b7b80 10 client.36086 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-14T15:27:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.892+0000 7f43124b7b80 20 client.36086 populate_metadata read hostname 'smithi069' 2024-05-14T15:27:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.892+0000 7f43124b7b80 1 --2- 172.21.15.69:0/2742502986 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x560d04cc05f0 0x560d04cc2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:27:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.892+0000 7f43124b7b80 4 client.36086 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:27:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.892+0000 7f43124b7b80 1 -- 172.21.15.69:0/2742502986 --> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] -- command(tid 0: {"prefix": "damage ls"}) -- 0x560d04b6b400 con 0x560d04cc05f0 2024-05-14T15:27:56.894 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.893+0000 7f42fbe00700 1 --2- 172.21.15.69:0/2742502986 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x560d04cc05f0 0x560d04cc2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:27:56.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.894+0000 7f42fbe00700 1 --2- 172.21.15.69:0/2742502986 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x560d04cc05f0 0x560d04cc2a10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=63a3fecfb8cd84ee server_cookie=9a05e3f3895be86b in_seq=0 out_seq=0 2024-05-14T15:27:56.895 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.894+0000 7f42eaa00700 10 client.36086 ms_handle_connect on v2:172.21.15.92:6836/1669439322 2024-05-14T15:27:56.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.895+0000 7f42eaa00700 1 -- 172.21.15.69:0/2742502986 <== mds.1 v2:172.21.15.92:6836/1669439322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x560d04b6b400 con 0x560d04cc05f0 2024-05-14T15:27:56.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.895+0000 7f42eaa00700 10 client.36086 handle_command_reply: tid=0 2024-05-14T15:27:56.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.895+0000 7f43124b7b80 1 client.36086 shutdown 2024-05-14T15:27:56.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.896+0000 7f43124b7b80 1 -- 172.21.15.69:0/2742502986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 msgr2=0x560d04c5cc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:56.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.896+0000 7f43124b7b80 1 --2- 172.21.15.69:0/2742502986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 0x560d04c5cc50 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f42f4009fd0 tx=0x7f42f4004d90 comp rx=0 tx=0).stop 2024-05-14T15:27:56.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.896+0000 7f43124b7b80 1 -- 172.21.15.69:0/2742502986 shutdown_connections 2024-05-14T15:27:56.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.896+0000 7f43124b7b80 1 --2- 172.21.15.69:0/2742502986 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x560d04cc05f0 0x560d04cc2a10 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.896+0000 7f43124b7b80 1 --2- 172.21.15.69:0/2742502986 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d04c44d20 0x560d04c5d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.896+0000 7f43124b7b80 1 --2- 172.21.15.69:0/2742502986 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d04abde40 0x560d04c4dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.896+0000 7f43124b7b80 1 --2- 172.21.15.69:0/2742502986 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d04c3bc50 0x560d04c5cc50 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.896+0000 7f43124b7b80 1 -- 172.21.15.69:0/2742502986 >> 172.21.15.69:0/2742502986 conn(0x560d04afca80 msgr2=0x560d04c45b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:56.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.896+0000 7f42eaa00700 0 client.36086 ms_handle_reset on v2:172.21.15.92:6836/1669439322 2024-05-14T15:27:56.898 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.896+0000 7f43124b7b80 1 -- 172.21.15.69:0/2742502986 shutdown_connections 2024-05-14T15:27:56.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.896+0000 7f43124b7b80 1 -- 172.21.15.69:0/2742502986 wait complete. 2024-05-14T15:27:56.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.897+0000 7f43124b7b80 20 client.36086 trim_cache size 0 max 16384 2024-05-14T15:27:56.899 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:27:56.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.898+0000 7f4303a00700 1 -- 172.21.15.69:0/4109617366 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f42e00b2bc0 msgr2=0x7f42e00b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:56.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.898+0000 7f4303a00700 1 --2- 172.21.15.69:0/4109617366 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f42e00b2bc0 0x7f42e00b50d0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0a6390 tx=0x7f42ec009c30 comp rx=0 tx=0).stop 2024-05-14T15:27:56.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.898+0000 7f4303a00700 1 -- 172.21.15.69:0/4109617366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42fc109870 msgr2=0x7f42fc1ad0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:27:56.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.898+0000 7f4303a00700 1 --2- 172.21.15.69:0/4109617366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42fc109870 0x7f42fc1ad0b0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f42ec009230 tx=0x7f42ec00fa00 comp rx=0 tx=0).stop 2024-05-14T15:27:56.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.899+0000 7f4303a00700 1 -- 172.21.15.69:0/4109617366 shutdown_connections 2024-05-14T15:27:56.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.899+0000 7f4303a00700 1 --2- 172.21.15.69:0/4109617366 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f42e00b2bc0 0x7f42e00b50d0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.899+0000 7f4303a00700 1 --2- 172.21.15.69:0/4109617366 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f42fc109870 0x7f42fc1ad0b0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.899+0000 7f4303a00700 1 --2- 172.21.15.69:0/4109617366 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f42fc1045f0 0x7f42fc1a2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.899+0000 7f4303a00700 1 --2- 172.21.15.69:0/4109617366 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f42fc108f20 0x7f42fc1a25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:27:56.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.899+0000 7f4303a00700 1 -- 172.21.15.69:0/4109617366 >> 172.21.15.69:0/4109617366 conn(0x7f42fc100040 msgr2=0x7f42fc10a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:27:56.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.900+0000 7f4303a00700 1 -- 172.21.15.69:0/4109617366 shutdown_connections 2024-05-14T15:27:56.901 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:27:56.900+0000 7f4303a00700 1 -- 172.21.15.69:0/4109617366 wait complete. 2024-05-14T15:27:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:57 smithi092 ceph-mon[34729]: pgmap v192: 129 pgs: 129 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 666 op/s 2024-05-14T15:27:57.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:57 smithi069 ceph-mon[31270]: pgmap v192: 129 pgs: 129 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 666 op/s 2024-05-14T15:27:57.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:57 smithi203 ceph-mon[34567]: pgmap v192: 129 pgs: 129 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 6.0 MiB/s wr, 666 op/s 2024-05-14T15:27:57.816 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-14T15:27:58.473 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:27:59.402 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:27:59 smithi069 ceph-mon[31270]: pgmap v193: 129 pgs: 129 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.5 MiB/s wr, 604 op/s 2024-05-14T15:27:59.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:27:59 smithi092 ceph-mon[34729]: pgmap v193: 129 pgs: 129 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.5 MiB/s wr, 604 op/s 2024-05-14T15:27:59.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:27:59 smithi203 ceph-mon[34567]: pgmap v193: 129 pgs: 129 active+clean; 1.9 GiB data, 6.3 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.5 MiB/s wr, 604 op/s 2024-05-14T15:28:00.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.898+0000 7f30d7200640 1 -- 172.21.15.69:0/3642516750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30d0109ac0 msgr2=0x7f30d01036b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:00.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.898+0000 7f30d7200640 1 --2- 172.21.15.69:0/3642516750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30d0109ac0 0x7f30d01036b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009900 tx=0x7f30c402a3f0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.901+0000 7f30d7200640 1 -- 172.21.15.69:0/3642516750 shutdown_connections 2024-05-14T15:28:00.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.901+0000 7f30d7200640 1 --2- 172.21.15.69:0/3642516750 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30d0104260 0x7f30d01105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.901+0000 7f30d7200640 1 --2- 172.21.15.69:0/3642516750 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d0109f60 0x7f30d0103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.901+0000 7f30d7200640 1 --2- 172.21.15.69:0/3642516750 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30d0109ac0 0x7f30d01036b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.901+0000 7f30d7200640 1 -- 172.21.15.69:0/3642516750 >> 172.21.15.69:0/3642516750 conn(0x7f30d0079250 msgr2=0x7f30d0079690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.901+0000 7f30d7200640 1 -- 172.21.15.69:0/3642516750 shutdown_connections 2024-05-14T15:28:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.901+0000 7f30d7200640 1 -- 172.21.15.69:0/3642516750 wait complete. 2024-05-14T15:28:00.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.903+0000 7f30d7200640 1 Processor -- start 2024-05-14T15:28:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.907+0000 7f30d7200640 1 -- start start 2024-05-14T15:28:00.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.907+0000 7f30d7200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30d0104260 0x7f30d019d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.907+0000 7f30d7200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30d0109ac0 0x7f30d019db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.907+0000 7f30d7200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d0109f60 0x7f30d01a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.907+0000 7f30d7200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f30d0113bb0 con 0x7f30d0104260 2024-05-14T15:28:00.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.907+0000 7f30d7200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f30d0113a30 con 0x7f30d0109f60 2024-05-14T15:28:00.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.907+0000 7f30d7200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f30d0113d30 con 0x7f30d0109ac0 2024-05-14T15:28:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.908+0000 7f30d5e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30d0104260 0x7f30d019d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.908+0000 7f30d6800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d0109f60 0x7f30d01a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.908+0000 7f30d6800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d0109f60 0x7f30d01a84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:60518/0 (socket says 172.21.15.69:60518) 2024-05-14T15:28:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.908+0000 7f30d6800640 1 -- 172.21.15.69:0/371292962 learned_addr learned my addr 172.21.15.69:0/371292962 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.908+0000 7f30d5400640 1 --2- 172.21.15.69:0/371292962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30d0109ac0 0x7f30d019db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.909+0000 7f30d6800640 1 -- 172.21.15.69:0/371292962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30d0109ac0 msgr2=0x7f30d019db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:00.910 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.909+0000 7f30d6800640 1 --2- 172.21.15.69:0/371292962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30d0109ac0 0x7f30d019db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.909+0000 7f30d6800640 1 -- 172.21.15.69:0/371292962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30d0104260 msgr2=0x7f30d019d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:00.911 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.909+0000 7f30d6800640 1 --2- 172.21.15.69:0/371292962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30d0104260 0x7f30d019d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.909+0000 7f30d6800640 1 -- 172.21.15.69:0/371292962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d01a8a30 con 0x7f30d0109f60 2024-05-14T15:28:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.910+0000 7f30d6800640 1 --2- 172.21.15.69:0/371292962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d0109f60 0x7f30d01a84f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00cad0 tx=0x7f30cc00cf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.910+0000 7f30caa00640 1 -- 172.21.15.69:0/371292962 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc00ae20 con 0x7f30d0109f60 2024-05-14T15:28:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.910+0000 7f30d7200640 1 -- 172.21.15.69:0/371292962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d01a8c60 con 0x7f30d0109f60 2024-05-14T15:28:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.910+0000 7f30caa00640 1 -- 172.21.15.69:0/371292962 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30cc005020 con 0x7f30d0109f60 2024-05-14T15:28:00.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.910+0000 7f30caa00640 1 -- 172.21.15.69:0/371292962 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc00f6b0 con 0x7f30d0109f60 2024-05-14T15:28:00.914 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.911+0000 7f30d7200640 1 -- 172.21.15.69:0/371292962 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d01a9180 con 0x7f30d0109f60 2024-05-14T15:28:00.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.916+0000 7f30df82a740 1 Processor -- start 2024-05-14T15:28:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.917+0000 7f30caa00640 1 -- 172.21.15.69:0/371292962 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f30cc00f910 con 0x7f30d0109f60 2024-05-14T15:28:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.918+0000 7f30df82a740 1 -- start start 2024-05-14T15:28:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.918+0000 7f30df82a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f791b0 0x55990331a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.918+0000 7f30df82a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f502f0 0x55990331a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.918+0000 7f30df82a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f584d0 0x55990331add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.918+0000 7f30df82a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55990327f550 con 0x559902f584d0 2024-05-14T15:28:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.918+0000 7f30df82a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559903224bc0 con 0x559902f502f0 2024-05-14T15:28:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.918+0000 7f30df82a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55990327b510 con 0x559902f791b0 2024-05-14T15:28:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.920+0000 7f30d5e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f502f0 0x55990331a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.920+0000 7f30d5400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f791b0 0x55990331a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.920+0000 7f30d5400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f791b0 0x55990331a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:49586/0 (socket says 172.21.15.69:49586) 2024-05-14T15:28:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.920+0000 7f30d5400640 1 -- 172.21.15.69:0/432045041 learned_addr learned my addr 172.21.15.69:0/432045041 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.920+0000 7f30caa00640 1 --2- 172.21.15.69:0/371292962 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f30b80b2a20 0x7f30b80b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.921+0000 7f30d6800640 1 --2- 172.21.15.69:0/371292962 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f30b80b2a20 0x7f30b80b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.921+0000 7f30d5e00640 1 -- 172.21.15.69:0/432045041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f791b0 msgr2=0x55990331a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.921+0000 7f30d5e00640 1 --2- 172.21.15.69:0/432045041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f791b0 0x55990331a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.921+0000 7f30d5e00640 1 -- 172.21.15.69:0/432045041 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f584d0 msgr2=0x55990331add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.921+0000 7f30d5e00640 1 --2- 172.21.15.69:0/432045041 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f584d0 0x55990331add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.921+0000 7f30d5e00640 1 -- 172.21.15.69:0/432045041 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559902f91210 con 0x559902f502f0 2024-05-14T15:28:00.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.921+0000 7f30caa00640 1 -- 172.21.15.69:0/371292962 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f30cc0e28f0 con 0x7f30d0109f60 2024-05-14T15:28:00.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.922+0000 7f30d6800640 1 --2- 172.21.15.69:0/371292962 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f30b80b2a20 0x7f30b80b4f30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0dfd40 tx=0x7f30cc0a9780 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:00.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.923+0000 7f30d5e00640 1 --2- 172.21.15.69:0/432045041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f502f0 0x55990331a890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009230 tx=0x7f30c4004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=14805b359bc714a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:00.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.924+0000 7f30bf000640 1 -- 172.21.15.69:0/432045041 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4035030 con 0x559902f502f0 2024-05-14T15:28:00.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.924+0000 7f30bf000640 1 -- 172.21.15.69:0/432045041 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30c4040070 con 0x559902f502f0 2024-05-14T15:28:00.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.924+0000 7f30bf000640 1 -- 172.21.15.69:0/432045041 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4045ac0 con 0x559902f502f0 2024-05-14T15:28:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.926+0000 7f30df82a740 1 -- 172.21.15.69:0/432045041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f502f0 msgr2=0x55990331a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.926+0000 7f30df82a740 1 --2- 172.21.15.69:0/432045041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f502f0 0x55990331a890 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009230 tx=0x7f30c4004360 comp rx=0 tx=0).stop 2024-05-14T15:28:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.926+0000 7f30df82a740 1 -- 172.21.15.69:0/432045041 shutdown_connections 2024-05-14T15:28:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.926+0000 7f30df82a740 1 --2- 172.21.15.69:0/432045041 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f584d0 0x55990331add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.926+0000 7f30df82a740 1 --2- 172.21.15.69:0/432045041 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f502f0 0x55990331a890 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.926+0000 7f30df82a740 1 --2- 172.21.15.69:0/432045041 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f791b0 0x55990331a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.926+0000 7f30df82a740 1 -- 172.21.15.69:0/432045041 >> 172.21.15.69:0/432045041 conn(0x559902f6d300 msgr2=0x559903316c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.927+0000 7f30df82a740 1 -- 172.21.15.69:0/432045041 shutdown_connections 2024-05-14T15:28:00.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.927+0000 7f30df82a740 1 -- 172.21.15.69:0/432045041 wait complete. 2024-05-14T15:28:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.927+0000 7f30df82a740 1 -- start start 2024-05-14T15:28:00.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.928+0000 7f30df82a740 1 Processor -- start 2024-05-14T15:28:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.929+0000 7f30df82a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f502f0 0x559903329a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.929+0000 7f30df82a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x559903329fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.929+0000 7f30df82a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f791b0 0x559903324e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.929+0000 7f30df82a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55990331d5c0 con 0x559902f791b0 2024-05-14T15:28:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.929+0000 7f30df82a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559903238660 con 0x559902f584d0 2024-05-14T15:28:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.929+0000 7f30df82a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55990331d740 con 0x559902f502f0 2024-05-14T15:28:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.929+0000 7f30df82a740 10 client.0 _ll_register_callbacks cb 0x559903202400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.930+0000 7f30d5e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x559903329fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.930+0000 7f30d5e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x559903329fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:60532/0 (socket says 172.21.15.69:60532) 2024-05-14T15:28:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.930+0000 7f30d5e00640 1 -- 172.21.15.69:0/4072403599 learned_addr learned my addr 172.21.15.69:0/4072403599 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.930+0000 7f30d5e00640 1 -- 172.21.15.69:0/4072403599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f502f0 msgr2=0x559903329a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.930+0000 7f30d5e00640 1 --2- 172.21.15.69:0/4072403599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f502f0 0x559903329a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.930+0000 7f30d5e00640 1 -- 172.21.15.69:0/4072403599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f791b0 msgr2=0x559903324e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.930+0000 7f30d5e00640 1 --2- 172.21.15.69:0/4072403599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f791b0 0x559903324e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.930+0000 7f30d5e00640 1 -- 172.21.15.69:0/4072403599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55990305d620 con 0x559902f584d0 2024-05-14T15:28:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.931+0000 7f30d5e00640 1 --2- 172.21.15.69:0/4072403599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x559903329fd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f30c40057c0 tx=0x7f30c402ab90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=21b46b319101f6ae server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.931+0000 7f30b3400640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:28:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.932+0000 7f30b3400640 1 -- 172.21.15.69:0/4072403599 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4035050 con 0x559902f584d0 2024-05-14T15:28:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.932+0000 7f30b3400640 1 -- 172.21.15.69:0/4072403599 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f30c40037f0 con 0x559902f584d0 2024-05-14T15:28:00.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.932+0000 7f30df82a740 1 -- 172.21.15.69:0/4072403599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30c4040070 con 0x559902f584d0 2024-05-14T15:28:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.932+0000 7f30b3400640 1 -- 172.21.15.69:0/4072403599 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f30c405b050 con 0x559902f584d0 2024-05-14T15:28:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.932+0000 7f30df82a740 10 client.36095 fetch_fsmap learned FSMap version 50 2024-05-14T15:28:00.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.932+0000 7f30df82a740 1 -- 172.21.15.69:0/4072403599 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x559903344860 con 0x559902f584d0 2024-05-14T15:28:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.933+0000 7f30b3400640 1 -- 172.21.15.69:0/4072403599 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30c4040070 con 0x559902f584d0 2024-05-14T15:28:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.933+0000 7f30b3400640 1 -- 172.21.15.69:0/4072403599 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 50) ==== 8418+0+0 (secure 0 0 0) 0x7f30c4056030 con 0x559902f584d0 2024-05-14T15:28:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.933+0000 7f30df82a740 10 client.36095 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T15:28:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.933+0000 7f30df82a740 10 client.36095 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:00.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.933+0000 7f30df82a740 20 client.36095 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.933+0000 7f30df82a740 1 --2- 172.21.15.69:0/4072403599 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559902f37d80 0x559903347bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.933+0000 7f30df82a740 4 client.36095 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:28:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.933+0000 7f30df82a740 1 -- 172.21.15.69:0/4072403599 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55990328d160 con 0x559902f37d80 2024-05-14T15:28:00.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.934+0000 7f30d5400640 1 --2- 172.21.15.69:0/4072403599 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559902f37d80 0x559903347bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.936+0000 7f30d5400640 1 --2- 172.21.15.69:0/4072403599 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559902f37d80 0x559903347bc0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fc1d4f59e017d2c2 server_cookie=7cdd0e3fb632a6d3 in_seq=0 out_seq=0 2024-05-14T15:28:00.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.936+0000 7f30b3400640 10 client.36095 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:00.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.937+0000 7f30b3400640 1 -- 172.21.15.69:0/4072403599 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55990328d160 con 0x559902f37d80 2024-05-14T15:28:00.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.937+0000 7f30b3400640 10 client.36095 handle_command_reply: tid=0 2024-05-14T15:28:00.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.937+0000 7f30df82a740 1 client.36095 shutdown 2024-05-14T15:28:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.937+0000 7f30df82a740 1 -- 172.21.15.69:0/4072403599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 msgr2=0x559903329fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.937+0000 7f30df82a740 1 --2- 172.21.15.69:0/4072403599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x559903329fd0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f30c40057c0 tx=0x7f30c402ab90 comp rx=0 tx=0).stop 2024-05-14T15:28:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.937+0000 7f30df82a740 1 -- 172.21.15.69:0/4072403599 shutdown_connections 2024-05-14T15:28:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.937+0000 7f30df82a740 1 --2- 172.21.15.69:0/4072403599 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559902f37d80 0x559903347bc0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.938+0000 7f30df82a740 1 --2- 172.21.15.69:0/4072403599 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f791b0 0x559903324e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.938+0000 7f30b3400640 0 client.36095 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.938+0000 7f30df82a740 1 --2- 172.21.15.69:0/4072403599 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x559903329fd0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.938+0000 7f30df82a740 1 --2- 172.21.15.69:0/4072403599 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f502f0 0x559903329a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.938+0000 7f30df82a740 1 -- 172.21.15.69:0/4072403599 >> 172.21.15.69:0/4072403599 conn(0x559902f6d300 msgr2=0x55990331cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:00.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.938+0000 7f30df82a740 1 -- 172.21.15.69:0/4072403599 shutdown_connections 2024-05-14T15:28:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.938+0000 7f30df82a740 1 -- 172.21.15.69:0/4072403599 wait complete. 2024-05-14T15:28:00.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.939+0000 7f30df82a740 20 client.36095 trim_cache size 0 max 16384 2024-05-14T15:28:00.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.971+0000 7f30df82a740 1 Processor -- start 2024-05-14T15:28:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.971+0000 7f30df82a740 1 -- start start 2024-05-14T15:28:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.971+0000 7f30df82a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f502f0 0x55990331ac40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.971+0000 7f30df82a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x55990331e990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.972+0000 7f30df82a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f791b0 0x559903324df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.972+0000 7f30df82a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f30d01aeec0 con 0x559902f791b0 2024-05-14T15:28:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.972+0000 7f30df82a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f30d01b0c40 con 0x559902f584d0 2024-05-14T15:28:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.972+0000 7f30df82a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f30d01af650 con 0x559902f502f0 2024-05-14T15:28:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.973+0000 7f30d5e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x55990331e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.973+0000 7f30d5e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x55990331e990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:60540/0 (socket says 172.21.15.69:60540) 2024-05-14T15:28:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.973+0000 7f30d5e00640 1 -- 172.21.15.69:0/2308752852 learned_addr learned my addr 172.21.15.69:0/2308752852 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.973+0000 7f30d5400640 1 --2- 172.21.15.69:0/2308752852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f502f0 0x55990331ac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:00.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.974+0000 7f30d5400640 1 --2- 172.21.15.69:0/2308752852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f791b0 0x559903324df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:00.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.975+0000 7f30d5e00640 1 -- 172.21.15.69:0/2308752852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f502f0 msgr2=0x55990331ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:00.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.975+0000 7f30d5e00640 1 --2- 172.21.15.69:0/2308752852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f502f0 0x55990331ac40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.975+0000 7f30d5e00640 1 -- 172.21.15.69:0/2308752852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f791b0 msgr2=0x559903324df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:00.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.975+0000 7f30d5e00640 1 --2- 172.21.15.69:0/2308752852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f791b0 0x559903324df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.975+0000 7f30d5e00640 1 -- 172.21.15.69:0/2308752852 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55990332f6c0 con 0x559902f584d0 2024-05-14T15:28:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.975+0000 7f30d5400640 1 --2- 172.21.15.69:0/2308752852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f502f0 0x55990331ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:28:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.975+0000 7f30d5e00640 1 --2- 172.21.15.69:0/2308752852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x55990331e990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009230 tx=0x7f30c4045750 comp rx=0 tx=0).ready entity=mon.2 client_cookie=48cd05f57551aabd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.976+0000 7f30be600640 1 -- 172.21.15.69:0/2308752852 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4035040 con 0x559902f584d0 2024-05-14T15:28:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.976+0000 7f30be600640 1 -- 172.21.15.69:0/2308752852 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30c4040040 con 0x559902f584d0 2024-05-14T15:28:00.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.976+0000 7f30be600640 1 -- 172.21.15.69:0/2308752852 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c40035f0 con 0x559902f584d0 2024-05-14T15:28:00.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.977+0000 7f30df82a740 1 -- 172.21.15.69:0/2308752852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 msgr2=0x55990331e990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:00.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.977+0000 7f30df82a740 1 --2- 172.21.15.69:0/2308752852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x55990331e990 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f30c4009230 tx=0x7f30c4045750 comp rx=0 tx=0).stop 2024-05-14T15:28:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.978+0000 7f30df82a740 1 -- 172.21.15.69:0/2308752852 shutdown_connections 2024-05-14T15:28:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.978+0000 7f30df82a740 1 --2- 172.21.15.69:0/2308752852 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f791b0 0x559903324df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.978+0000 7f30df82a740 1 --2- 172.21.15.69:0/2308752852 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x55990331e990 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.978+0000 7f30df82a740 1 --2- 172.21.15.69:0/2308752852 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f502f0 0x55990331ac40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.978+0000 7f30df82a740 1 -- 172.21.15.69:0/2308752852 >> 172.21.15.69:0/2308752852 conn(0x559902f6d300 msgr2=0x5599033246e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:00.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.979+0000 7f30df82a740 1 -- 172.21.15.69:0/2308752852 shutdown_connections 2024-05-14T15:28:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.979+0000 7f30df82a740 1 -- 172.21.15.69:0/2308752852 wait complete. 2024-05-14T15:28:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.980+0000 7f30df82a740 1 -- start start 2024-05-14T15:28:00.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.980+0000 7f30df82a740 1 Processor -- start 2024-05-14T15:28:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.982+0000 7f30df82a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f502f0 0x55990334a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.982+0000 7f30df82a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x55990334a650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.982+0000 7f30df82a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f791b0 0x5599033a7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.982+0000 7f30df82a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f30d01b04b0 con 0x559902f791b0 2024-05-14T15:28:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.982+0000 7f30d5e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x55990334a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.983+0000 7f30d5e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x55990334a650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:60548/0 (socket says 172.21.15.69:60548) 2024-05-14T15:28:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.983+0000 7f30d5e00640 1 -- 172.21.15.69:0/2202646823 learned_addr learned my addr 172.21.15.69:0/2202646823 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.983+0000 7f30df82a740 1 -- 172.21.15.69:0/2202646823 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f30d01afd20 con 0x559902f584d0 2024-05-14T15:28:00.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.983+0000 7f30df82a740 1 -- 172.21.15.69:0/2202646823 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f30d01acf20 con 0x559902f502f0 2024-05-14T15:28:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.983+0000 7f30df82a740 10 client.0 _ll_register_callbacks cb 0x7f30c4009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.982+0000 7f30d5400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f791b0 0x5599033a7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:00.985 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.983+0000 7f30d5400640 1 --2- 172.21.15.69:0/2202646823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f502f0 0x55990334a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.984+0000 7f30d5400640 1 -- 172.21.15.69:0/2202646823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f502f0 msgr2=0x55990334a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.984+0000 7f30d5400640 1 --2- 172.21.15.69:0/2202646823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f502f0 0x55990334a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.984+0000 7f30d5400640 1 -- 172.21.15.69:0/2202646823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 msgr2=0x55990334a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.984+0000 7f30d5400640 1 --2- 172.21.15.69:0/2202646823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x55990334a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.984+0000 7f30d5400640 1 -- 172.21.15.69:0/2202646823 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599033a82a0 con 0x559902f791b0 2024-05-14T15:28:00.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.985+0000 7f30d5400640 1 --2- 172.21.15.69:0/2202646823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f791b0 0x5599033a7d30 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x559903224ce0 tx=0x7f30c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=688b8cdaa16c3a24 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:00.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.985+0000 7f30b3400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:28:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.987+0000 7f30b3400640 1 -- 172.21.15.69:0/2202646823 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c0010e30 con 0x559902f791b0 2024-05-14T15:28:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.987+0000 7f30b3400640 1 -- 172.21.15.69:0/2202646823 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f30c0023040 con 0x559902f791b0 2024-05-14T15:28:00.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.987+0000 7f30df82a740 1 -- 172.21.15.69:0/2202646823 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30c4040040 con 0x559902f791b0 2024-05-14T15:28:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.988+0000 7f30b3400640 1 -- 172.21.15.69:0/2202646823 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f30c000f630 con 0x559902f791b0 2024-05-14T15:28:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.988+0000 7f30df82a740 10 client.16599 fetch_fsmap learned FSMap version 50 2024-05-14T15:28:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.988+0000 7f30df82a740 1 -- 172.21.15.69:0/2202646823 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5599033af630 con 0x559902f791b0 2024-05-14T15:28:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.988+0000 7f30b3400640 1 -- 172.21.15.69:0/2202646823 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f30c4040040 con 0x559902f791b0 2024-05-14T15:28:00.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.989+0000 7f30b3400640 1 -- 172.21.15.69:0/2202646823 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 50) ==== 8418+0+0 (secure 0 0 0) 0x7f30c0027670 con 0x559902f791b0 2024-05-14T15:28:00.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.989+0000 7f30df82a740 10 client.16599 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T15:28:00.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.989+0000 7f30df82a740 10 client.16599 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:00.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.989+0000 7f30df82a740 20 client.16599 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:00.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.989+0000 7f30df82a740 1 --2- 172.21.15.69:0/2202646823 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559902f0d1c0 0x5599033b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:00.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.989+0000 7f30df82a740 4 client.16599 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:28:00.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.989+0000 7f30df82a740 1 -- 172.21.15.69:0/2202646823 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559903286fd0 con 0x559902f0d1c0 2024-05-14T15:28:00.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.989+0000 7f30d5e00640 1 --2- 172.21.15.69:0/2202646823 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559902f0d1c0 0x5599033b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:00.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.991+0000 7f30b3400640 10 client.16599 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:00.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:00.992+0000 7f30d5e00640 1 --2- 172.21.15.69:0/2202646823 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559902f0d1c0 0x5599033b1d80 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e0851364ff8ba7d server_cookie=1cd83bb77d1088c8 in_seq=0 out_seq=0 2024-05-14T15:28:01.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.016+0000 7f30b3400640 1 -- 172.21.15.69:0/2202646823 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559903286fd0 con 0x559902f0d1c0 2024-05-14T15:28:01.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.016+0000 7f30b3400640 10 client.16599 handle_command_reply: tid=0 2024-05-14T15:28:01.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.016+0000 7f30df82a740 1 client.16599 shutdown 2024-05-14T15:28:01.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.016+0000 7f30df82a740 1 -- 172.21.15.69:0/2202646823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f791b0 msgr2=0x5599033a7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:01.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.016+0000 7f30df82a740 1 --2- 172.21.15.69:0/2202646823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f791b0 0x5599033a7d30 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x559903224ce0 tx=0x7f30c00046c0 comp rx=0 tx=0).stop 2024-05-14T15:28:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.017+0000 7f30df82a740 1 -- 172.21.15.69:0/2202646823 shutdown_connections 2024-05-14T15:28:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.017+0000 7f30df82a740 1 --2- 172.21.15.69:0/2202646823 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559902f0d1c0 0x5599033b1d80 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.017+0000 7f30df82a740 1 --2- 172.21.15.69:0/2202646823 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559902f791b0 0x5599033a7d30 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.017+0000 7f30df82a740 1 --2- 172.21.15.69:0/2202646823 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559902f584d0 0x55990334a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.017+0000 7f30df82a740 1 --2- 172.21.15.69:0/2202646823 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559902f502f0 0x55990334a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.017+0000 7f30df82a740 1 -- 172.21.15.69:0/2202646823 >> 172.21.15.69:0/2202646823 conn(0x559902f6d300 msgr2=0x55990331a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.017+0000 7f30b3400640 0 client.16599 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.017+0000 7f30df82a740 1 -- 172.21.15.69:0/2202646823 shutdown_connections 2024-05-14T15:28:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.017+0000 7f30df82a740 1 -- 172.21.15.69:0/2202646823 wait complete. 2024-05-14T15:28:01.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.018+0000 7f30df82a740 20 client.16599 trim_cache size 0 max 16384 2024-05-14T15:28:01.020 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:28:01.020 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:28:01.020 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:28:01.020 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:28:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.019+0000 7f30d7200640 1 -- 172.21.15.69:0/371292962 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f30b80b2a20 msgr2=0x7f30b80b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.019+0000 7f30d7200640 1 --2- 172.21.15.69:0/371292962 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f30b80b2a20 0x7f30b80b4f30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0dfd40 tx=0x7f30cc0a9780 comp rx=0 tx=0).stop 2024-05-14T15:28:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.019+0000 7f30d7200640 1 -- 172.21.15.69:0/371292962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d0109f60 msgr2=0x7f30d01a84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.019+0000 7f30d7200640 1 --2- 172.21.15.69:0/371292962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d0109f60 0x7f30d01a84f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f30cc00cad0 tx=0x7f30cc00cf90 comp rx=0 tx=0).stop 2024-05-14T15:28:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.019+0000 7f30d7200640 1 -- 172.21.15.69:0/371292962 shutdown_connections 2024-05-14T15:28:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.019+0000 7f30d7200640 1 --2- 172.21.15.69:0/371292962 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f30b80b2a20 0x7f30b80b4f30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.019+0000 7f30d7200640 1 --2- 172.21.15.69:0/371292962 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f30d0109f60 0x7f30d01a84f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.019+0000 7f30d7200640 1 --2- 172.21.15.69:0/371292962 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f30d0109ac0 0x7f30d019db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.019+0000 7f30d7200640 1 --2- 172.21.15.69:0/371292962 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f30d0104260 0x7f30d019d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:01.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.019+0000 7f30d7200640 1 -- 172.21.15.69:0/371292962 >> 172.21.15.69:0/371292962 conn(0x7f30d0079250 msgr2=0x7f30d0102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:01.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.020+0000 7f30d7200640 1 -- 172.21.15.69:0/371292962 shutdown_connections 2024-05-14T15:28:01.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:01.020+0000 7f30d7200640 1 -- 172.21.15.69:0/371292962 wait complete. 2024-05-14T15:28:01.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 135.0 s, 450.1 tps, lat 293.338 ms stddev 487.015 2024-05-14T15:28:01.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:01 smithi092 ceph-mon[34729]: pgmap v194: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 11 MiB/s wr, 896 op/s 2024-05-14T15:28:01.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:01 smithi069 ceph-mon[31270]: pgmap v194: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 11 MiB/s wr, 896 op/s 2024-05-14T15:28:01.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:01 smithi203 ceph-mon[34567]: pgmap v194: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 11 MiB/s wr, 896 op/s 2024-05-14T15:28:03.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:03 smithi092 ceph-mon[34729]: pgmap v195: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.2 MiB/s wr, 585 op/s 2024-05-14T15:28:03.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:03 smithi069 ceph-mon[31270]: pgmap v195: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.2 MiB/s wr, 585 op/s 2024-05-14T15:28:03.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:03 smithi203 ceph-mon[34567]: pgmap v195: 129 pgs: 129 active+clean; 1.9 GiB data, 6.5 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 8.2 MiB/s wr, 585 op/s 2024-05-14T15:28:04.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.314+0000 7f20a5e00700 1 -- 172.21.15.69:0/1425546127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20a0109680 msgr2=0x7f20a0110fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:04.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.314+0000 7f20a5e00700 1 --2- 172.21.15.69:0/1425546127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20a0109680 0x7f20a0110fe0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f209800b0d0 tx=0x7f209800b3e0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.314+0000 7f20a5e00700 1 -- 172.21.15.69:0/1425546127 shutdown_connections 2024-05-14T15:28:04.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.314+0000 7f20a5e00700 1 --2- 172.21.15.69:0/1425546127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20a0109680 0x7f20a0110fe0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.314+0000 7f20a5e00700 1 --2- 172.21.15.69:0/1425546127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20a0104400 0x7f20a0104810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.314+0000 7f20a5e00700 1 --2- 172.21.15.69:0/1425546127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20a0108d30 0x7f20a0109140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.314+0000 7f20a5e00700 1 -- 172.21.15.69:0/1425546127 >> 172.21.15.69:0/1425546127 conn(0x7f20a0079d50 msgr2=0x7f20a007a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:04.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.314+0000 7f20a5e00700 1 -- 172.21.15.69:0/1425546127 shutdown_connections 2024-05-14T15:28:04.317 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.314+0000 7f20a5e00700 1 -- 172.21.15.69:0/1425546127 wait complete. 2024-05-14T15:28:04.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.316+0000 7f20a5e00700 1 Processor -- start 2024-05-14T15:28:04.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.316+0000 7f20a5e00700 1 -- start start 2024-05-14T15:28:04.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.317+0000 7f20a5e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20a0104400 0x7f20a01a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.317+0000 7f20a5e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20a0108d30 0x7f20a01a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.317+0000 7f20a5e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20a0109680 0x7f20a01a5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.317+0000 7f20a5e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f20a0112030 con 0x7f20a0109680 2024-05-14T15:28:04.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.317+0000 7f20a5e00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f20a0111eb0 con 0x7f20a0108d30 2024-05-14T15:28:04.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.317+0000 7f20a5e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f20a01121b0 con 0x7f20a0104400 2024-05-14T15:28:04.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.317+0000 7f20a5400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20a0109680 0x7f20a01a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.317+0000 7f20a5400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20a0109680 0x7f20a01a5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56788/0 (socket says 172.21.15.69:56788) 2024-05-14T15:28:04.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.317+0000 7f20a5400700 1 -- 172.21.15.69:0/85176796 learned_addr learned my addr 172.21.15.69:0/85176796 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:04.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.318+0000 7f20a4a00700 1 --2- 172.21.15.69:0/85176796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20a0104400 0x7f20a01a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.318+0000 7f209fe00700 1 --2- 172.21.15.69:0/85176796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20a0108d30 0x7f20a01a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.318+0000 7f20a5400700 1 -- 172.21.15.69:0/85176796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20a0104400 msgr2=0x7f20a01a1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:04.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.318+0000 7f20a5400700 1 --2- 172.21.15.69:0/85176796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20a0104400 0x7f20a01a1130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.318+0000 7f20a5400700 1 -- 172.21.15.69:0/85176796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20a0108d30 msgr2=0x7f20a01a16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:04.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.318+0000 7f20a5400700 1 --2- 172.21.15.69:0/85176796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20a0108d30 0x7f20a01a16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.318+0000 7f20a5400700 1 -- 172.21.15.69:0/85176796 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a01a6000 con 0x7f20a0109680 2024-05-14T15:28:04.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.318+0000 7f20a4a00700 1 --2- 172.21.15.69:0/85176796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20a0104400 0x7f20a01a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:28:04.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.319+0000 7f209fe00700 1 --2- 172.21.15.69:0/85176796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20a0108d30 0x7f20a01a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:28:04.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.320+0000 7f20a5400700 1 --2- 172.21.15.69:0/85176796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20a0109680 0x7f20a01a5960 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2098007d10 tx=0x7f2098007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:04.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.322+0000 7f209d600700 1 -- 172.21.15.69:0/85176796 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209801f070 con 0x7f20a0109680 2024-05-14T15:28:04.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.322+0000 7f209d600700 1 -- 172.21.15.69:0/85176796 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2098003e10 con 0x7f20a0109680 2024-05-14T15:28:04.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.322+0000 7f209d600700 1 -- 172.21.15.69:0/85176796 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f209801b820 con 0x7f20a0109680 2024-05-14T15:28:04.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.322+0000 7f20a5e00700 1 -- 172.21.15.69:0/85176796 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a01a6290 con 0x7f20a0109680 2024-05-14T15:28:04.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.322+0000 7f20a5e00700 1 -- 172.21.15.69:0/85176796 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a01a6720 con 0x7f20a0109680 2024-05-14T15:28:04.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.328+0000 7f209d600700 1 -- 172.21.15.69:0/85176796 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2098022070 con 0x7f20a0109680 2024-05-14T15:28:04.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.329+0000 7f20b6017b80 1 Processor -- start 2024-05-14T15:28:04.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.329+0000 7f20b6017b80 1 -- start start 2024-05-14T15:28:04.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.330+0000 7f20b6017b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a3465e40 0x5556a35e3d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.330+0000 7f20b6017b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a35e4280 0x5556a35ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.330+0000 7f20b6017b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a35e4690 0x5556a35efe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.330+0000 7f20b6017b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5556a3505a20 con 0x5556a3465e40 2024-05-14T15:28:04.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.330+0000 7f20b6017b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5556a34a3760 con 0x5556a35e4690 2024-05-14T15:28:04.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.330+0000 7f20b6017b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5556a35019e0 con 0x5556a35e4280 2024-05-14T15:28:04.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.330+0000 7f209fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a3465e40 0x5556a35e3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.330+0000 7f209fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a3465e40 0x5556a35e3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56796/0 (socket says 172.21.15.69:56796) 2024-05-14T15:28:04.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.330+0000 7f209fe00700 1 -- 172.21.15.69:0/1479810059 learned_addr learned my addr 172.21.15.69:0/1479810059 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:04.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.330+0000 7f209d600700 1 --2- 172.21.15.69:0/85176796 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f20880b2b20 0x7f20880b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.331+0000 7f209d600700 1 -- 172.21.15.69:0/85176796 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f209800f020 con 0x7f20a0109680 2024-05-14T15:28:04.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.331+0000 7f209fe00700 1 --2- 172.21.15.69:0/1479810059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a35e4690 0x5556a35efe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.331+0000 7f20a4a00700 1 --2- 172.21.15.69:0/1479810059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a35e4280 0x5556a35ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.331+0000 7f209fe00700 1 -- 172.21.15.69:0/1479810059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a35e4280 msgr2=0x5556a35ed8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:04.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.331+0000 7f209fe00700 1 --2- 172.21.15.69:0/1479810059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a35e4280 0x5556a35ed8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.331+0000 7f209fe00700 1 -- 172.21.15.69:0/1479810059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a35e4690 msgr2=0x5556a35efe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:04.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.331+0000 7f209fe00700 1 --2- 172.21.15.69:0/1479810059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a35e4690 0x5556a35efe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.331+0000 7f209fe00700 1 -- 172.21.15.69:0/1479810059 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556a34528d0 con 0x5556a3465e40 2024-05-14T15:28:04.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.331+0000 7f20a5400700 1 --2- 172.21.15.69:0/85176796 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f20880b2b20 0x7f20880b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.332+0000 7f209fe00700 1 --2- 172.21.15.69:0/1479810059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a3465e40 0x5556a35e3d40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f208c005fd0 tx=0x7f208c009630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eab8d08c6c4195e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:04.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.333+0000 7f2092000700 1 -- 172.21.15.69:0/1479810059 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c015e40 con 0x5556a3465e40 2024-05-14T15:28:04.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.333+0000 7f2092000700 1 -- 172.21.15.69:0/1479810059 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f208c0044b0 con 0x5556a3465e40 2024-05-14T15:28:04.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.333+0000 7f20a5400700 1 --2- 172.21.15.69:0/85176796 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f20880b2b20 0x7f20880b5030 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f20980e1270 tx=0x7f209800b3e0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:04.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.333+0000 7f2092000700 1 -- 172.21.15.69:0/1479810059 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c003d20 con 0x5556a3465e40 2024-05-14T15:28:04.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.334+0000 7f20b6017b80 1 -- 172.21.15.69:0/1479810059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a3465e40 msgr2=0x5556a35e3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:04.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.334+0000 7f20b6017b80 1 --2- 172.21.15.69:0/1479810059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a3465e40 0x5556a35e3d40 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f208c005fd0 tx=0x7f208c009630 comp rx=0 tx=0).stop 2024-05-14T15:28:04.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.335+0000 7f20b6017b80 1 -- 172.21.15.69:0/1479810059 shutdown_connections 2024-05-14T15:28:04.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.335+0000 7f20b6017b80 1 --2- 172.21.15.69:0/1479810059 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a3465e40 0x5556a35e3d40 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.335+0000 7f20b6017b80 1 --2- 172.21.15.69:0/1479810059 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a35e4690 0x5556a35efe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.335+0000 7f20b6017b80 1 --2- 172.21.15.69:0/1479810059 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a35e4280 0x5556a35ed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.335+0000 7f20b6017b80 1 -- 172.21.15.69:0/1479810059 >> 172.21.15.69:0/1479810059 conn(0x5556a34a4a80 msgr2=0x5556a35deb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:04.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.335+0000 7f20b6017b80 1 -- 172.21.15.69:0/1479810059 shutdown_connections 2024-05-14T15:28:04.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.335+0000 7f20b6017b80 1 -- 172.21.15.69:0/1479810059 wait complete. 2024-05-14T15:28:04.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.336+0000 7f20b6017b80 1 -- start start 2024-05-14T15:28:04.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.337+0000 7f20b6017b80 1 Processor -- start 2024-05-14T15:28:04.338 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.337+0000 7f20b6017b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a3465e40 0x5556a35ed3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.337+0000 7f20b6017b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a35e4280 0x5556a35ed8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.337+0000 7f20b6017b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4690 0x5556a35ede20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.337+0000 7f20b6017b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5556a35f07a0 con 0x5556a35e4690 2024-05-14T15:28:04.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.337+0000 7f20b6017b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5556a346bb20 con 0x5556a3465e40 2024-05-14T15:28:04.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.337+0000 7f20b6017b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5556a35f0920 con 0x5556a35e4280 2024-05-14T15:28:04.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.337+0000 7f20b6017b80 10 client.0 _ll_register_callbacks cb 0x5556a3499380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:04.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.338+0000 7f209fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4690 0x5556a35ede20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.338+0000 7f209fe00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4690 0x5556a35ede20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56812/0 (socket says 172.21.15.69:56812) 2024-05-14T15:28:04.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.338+0000 7f209fe00700 1 -- 172.21.15.69:0/2226211646 learned_addr learned my addr 172.21.15.69:0/2226211646 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:04.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.338+0000 7f20a4a00700 1 --2- 172.21.15.69:0/2226211646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a35e4280 0x5556a35ed8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.339+0000 7f209fe00700 1 -- 172.21.15.69:0/2226211646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a35e4280 msgr2=0x5556a35ed8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:04.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.339+0000 7f209fe00700 1 --2- 172.21.15.69:0/2226211646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a35e4280 0x5556a35ed8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.339+0000 7f209fe00700 1 -- 172.21.15.69:0/2226211646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a3465e40 msgr2=0x5556a35ed3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:04.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.339+0000 7f209fe00700 1 --2- 172.21.15.69:0/2226211646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a3465e40 0x5556a35ed3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.339+0000 7f209fe00700 1 -- 172.21.15.69:0/2226211646 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556a34cb420 con 0x5556a35e4690 2024-05-14T15:28:04.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.340+0000 7f209fe00700 1 --2- 172.21.15.69:0/2226211646 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4690 0x5556a35ede20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f208c009920 tx=0x7f208c015f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761265e30b765df9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:04.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.340+0000 7f2086a00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:28:04.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.341+0000 7f2086a00700 1 -- 172.21.15.69:0/2226211646 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c005050 con 0x5556a35e4690 2024-05-14T15:28:04.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.341+0000 7f2086a00700 1 -- 172.21.15.69:0/2226211646 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f208c0051f0 con 0x5556a35e4690 2024-05-14T15:28:04.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.341+0000 7f20b6017b80 1 -- 172.21.15.69:0/2226211646 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f208c0044b0 con 0x5556a35e4690 2024-05-14T15:28:04.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.342+0000 7f2086a00700 1 -- 172.21.15.69:0/2226211646 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f208c0053f0 con 0x5556a35e4690 2024-05-14T15:28:04.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.342+0000 7f20b6017b80 10 client.16611 fetch_fsmap learned FSMap version 50 2024-05-14T15:28:04.344 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.342+0000 7f20b6017b80 1 -- 172.21.15.69:0/2226211646 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5556a35fb470 con 0x5556a35e4690 2024-05-14T15:28:04.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.343+0000 7f2086a00700 1 -- 172.21.15.69:0/2226211646 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f208c0044b0 con 0x5556a35e4690 2024-05-14T15:28:04.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.343+0000 7f2086a00700 1 -- 172.21.15.69:0/2226211646 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 50) ==== 8418+0+0 (secure 0 0 0) 0x7f208c02a030 con 0x5556a35e4690 2024-05-14T15:28:04.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.343+0000 7f20b6017b80 10 client.16611 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T15:28:04.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.343+0000 7f20b6017b80 10 client.16611 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:04.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.343+0000 7f20b6017b80 20 client.16611 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:04.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.343+0000 7f20b6017b80 1 --2- 172.21.15.69:0/2226211646 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5556a35fde30 0x5556a36002e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.343+0000 7f20b6017b80 4 client.16611 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:28:04.345 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.343+0000 7f20b6017b80 1 -- 172.21.15.69:0/2226211646 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556a35b0070 con 0x5556a35fde30 2024-05-14T15:28:04.346 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.344+0000 7f20a4a00700 1 --2- 172.21.15.69:0/2226211646 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5556a35fde30 0x5556a36002e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.346+0000 7f20a4a00700 1 --2- 172.21.15.69:0/2226211646 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5556a35fde30 0x5556a36002e0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a254483b8d560766 server_cookie=41bdcfd8a23b281d in_seq=0 out_seq=0 2024-05-14T15:28:04.347 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.346+0000 7f2086a00700 10 client.16611 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:04.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.348+0000 7f2086a00700 1 -- 172.21.15.69:0/2226211646 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5556a35b0070 con 0x5556a35fde30 2024-05-14T15:28:04.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.348+0000 7f2086a00700 10 client.16611 handle_command_reply: tid=0 2024-05-14T15:28:04.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.348+0000 7f20b6017b80 1 client.16611 shutdown 2024-05-14T15:28:04.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.349+0000 7f20b6017b80 1 -- 172.21.15.69:0/2226211646 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4690 msgr2=0x5556a35ede20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:04.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.349+0000 7f20b6017b80 1 --2- 172.21.15.69:0/2226211646 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4690 0x5556a35ede20 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f208c009920 tx=0x7f208c015f80 comp rx=0 tx=0).stop 2024-05-14T15:28:04.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.349+0000 7f20b6017b80 1 -- 172.21.15.69:0/2226211646 shutdown_connections 2024-05-14T15:28:04.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.349+0000 7f20b6017b80 1 --2- 172.21.15.69:0/2226211646 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5556a35fde30 0x5556a36002e0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.349+0000 7f2086a00700 0 client.16611 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:04.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.349+0000 7f20b6017b80 1 --2- 172.21.15.69:0/2226211646 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4690 0x5556a35ede20 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.349+0000 7f20b6017b80 1 --2- 172.21.15.69:0/2226211646 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a3465e40 0x5556a35ed3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.349+0000 7f20b6017b80 1 --2- 172.21.15.69:0/2226211646 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a35e4280 0x5556a35ed8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.349+0000 7f20b6017b80 1 -- 172.21.15.69:0/2226211646 >> 172.21.15.69:0/2226211646 conn(0x5556a34a4a80 msgr2=0x5556a35e2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:04.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.350+0000 7f20b6017b80 1 -- 172.21.15.69:0/2226211646 shutdown_connections 2024-05-14T15:28:04.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.350+0000 7f20b6017b80 1 -- 172.21.15.69:0/2226211646 wait complete. 2024-05-14T15:28:04.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.350+0000 7f20b6017b80 20 client.16611 trim_cache size 0 max 16384 2024-05-14T15:28:04.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.373+0000 7f20b6017b80 1 Processor -- start 2024-05-14T15:28:04.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.373+0000 7f20b6017b80 1 -- start start 2024-05-14T15:28:04.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.374+0000 7f20b6017b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a3465e40 0x5556a35ec300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.374+0000 7f20b6017b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4280 0x5556a35eda70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.374+0000 7f20b6017b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a35e87c0 0x5556a35e8bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.374+0000 7f20b6017b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f20a01b69b0 con 0x5556a35e4280 2024-05-14T15:28:04.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.374+0000 7f20b6017b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f20a01b8730 con 0x5556a3465e40 2024-05-14T15:28:04.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.374+0000 7f20b6017b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f20a01b7140 con 0x5556a35e87c0 2024-05-14T15:28:04.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.375+0000 7f209fe00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a3465e40 0x5556a35ec300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.375+0000 7f209fe00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a3465e40 0x5556a35ec300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:35616/0 (socket says 172.21.15.69:35616) 2024-05-14T15:28:04.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.375+0000 7f209fe00700 1 -- 172.21.15.69:0/3304879863 learned_addr learned my addr 172.21.15.69:0/3304879863 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:04.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.375+0000 7f209fe00700 1 --2- 172.21.15.69:0/3304879863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a35e87c0 0x5556a35e8bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.376+0000 7f20a4a00700 1 --2- 172.21.15.69:0/3304879863 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4280 0x5556a35eda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.376+0000 7f209fe00700 1 -- 172.21.15.69:0/3304879863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a3465e40 msgr2=0x5556a35ec300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:04.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.376+0000 7f209fe00700 1 --2- 172.21.15.69:0/3304879863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a3465e40 0x5556a35ec300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.376+0000 7f209fe00700 1 -- 172.21.15.69:0/3304879863 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4280 msgr2=0x5556a35eda70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:04.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.376+0000 7f209fe00700 1 --2- 172.21.15.69:0/3304879863 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4280 0x5556a35eda70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.376+0000 7f209fe00700 1 -- 172.21.15.69:0/3304879863 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556a35eb910 con 0x5556a35e87c0 2024-05-14T15:28:04.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.376+0000 7f209fe00700 1 --2- 172.21.15.69:0/3304879863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a35e87c0 0x5556a35e8bd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f208c015d50 tx=0x7f208c0058e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a992fc883bb95271 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:04.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.377+0000 7f2091600700 1 -- 172.21.15.69:0/3304879863 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c004100 con 0x5556a35e87c0 2024-05-14T15:28:04.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.377+0000 7f2091600700 1 -- 172.21.15.69:0/3304879863 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f208c0042a0 con 0x5556a35e87c0 2024-05-14T15:28:04.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.377+0000 7f2091600700 1 -- 172.21.15.69:0/3304879863 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f208c037420 con 0x5556a35e87c0 2024-05-14T15:28:04.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.380+0000 7f20b6017b80 1 -- 172.21.15.69:0/3304879863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a35e87c0 msgr2=0x5556a35e8bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.380+0000 7f20b6017b80 1 --2- 172.21.15.69:0/3304879863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a35e87c0 0x5556a35e8bd0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f208c015d50 tx=0x7f208c0058e0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.380+0000 7f20b6017b80 1 -- 172.21.15.69:0/3304879863 shutdown_connections 2024-05-14T15:28:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.380+0000 7f20b6017b80 1 --2- 172.21.15.69:0/3304879863 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a35e87c0 0x5556a35e8bd0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.380+0000 7f20b6017b80 1 --2- 172.21.15.69:0/3304879863 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a3465e40 0x5556a35ec300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.380+0000 7f20b6017b80 1 --2- 172.21.15.69:0/3304879863 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4280 0x5556a35eda70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.380+0000 7f20b6017b80 1 -- 172.21.15.69:0/3304879863 >> 172.21.15.69:0/3304879863 conn(0x5556a34a4a80 msgr2=0x5556a35ed360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:04.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.380+0000 7f20b6017b80 1 -- 172.21.15.69:0/3304879863 shutdown_connections 2024-05-14T15:28:04.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.381+0000 7f20b6017b80 1 -- 172.21.15.69:0/3304879863 wait complete. 2024-05-14T15:28:04.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.381+0000 7f20b6017b80 1 -- start start 2024-05-14T15:28:04.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.382+0000 7f20b6017b80 1 Processor -- start 2024-05-14T15:28:04.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.383+0000 7f20b6017b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a3465e40 0x5556a35f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.383+0000 7f20b6017b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4280 0x5556a35f10e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.383+0000 7f20b6017b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a35e87c0 0x5556a35f1620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.383+0000 7f20b6017b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f20a01b7fa0 con 0x5556a35e4280 2024-05-14T15:28:04.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.383+0000 7f20b6017b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f20a01b7810 con 0x5556a35e87c0 2024-05-14T15:28:04.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.383+0000 7f20b6017b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f20a01b4950 con 0x5556a3465e40 2024-05-14T15:28:04.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.383+0000 7f20b6017b80 10 client.0 _ll_register_callbacks cb 0x5556a3499380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:04.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.384+0000 7f209fe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a3465e40 0x5556a35f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.385 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.384+0000 7f209fe00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a3465e40 0x5556a35f0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:60264/0 (socket says 172.21.15.69:60264) 2024-05-14T15:28:04.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.384+0000 7f209fe00700 1 -- 172.21.15.69:0/1089957022 learned_addr learned my addr 172.21.15.69:0/1089957022 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:04.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.384+0000 7f20a4a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4280 0x5556a35f10e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.385+0000 7f209fe00700 1 --2- 172.21.15.69:0/1089957022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a35e87c0 0x5556a35f1620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.385+0000 7f20a4a00700 1 -- 172.21.15.69:0/1089957022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a3465e40 msgr2=0x5556a35f0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:04.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.385+0000 7f20a4a00700 1 --2- 172.21.15.69:0/1089957022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a3465e40 0x5556a35f0ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.385+0000 7f20a4a00700 1 -- 172.21.15.69:0/1089957022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a35e87c0 msgr2=0x5556a35f1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:04.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.385+0000 7f20a4a00700 1 --2- 172.21.15.69:0/1089957022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a35e87c0 0x5556a35f1620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.386+0000 7f20a4a00700 1 -- 172.21.15.69:0/1089957022 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556a3666640 con 0x5556a35e4280 2024-05-14T15:28:04.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.386+0000 7f209fe00700 1 --2- 172.21.15.69:0/1089957022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a35e87c0 0x5556a35f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:28:04.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.387+0000 7f20a4a00700 1 --2- 172.21.15.69:0/1089957022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4280 0x5556a35f10e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x5556a3600a10 tx=0x7f209400be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2a827c7112293a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:04.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.387+0000 7f2086a00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:28:04.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.387+0000 7f2086a00700 1 -- 172.21.15.69:0/1089957022 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2094003f90 con 0x5556a35e4280 2024-05-14T15:28:04.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.387+0000 7f20b6017b80 1 -- 172.21.15.69:0/1089957022 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f208c0042a0 con 0x5556a35e4280 2024-05-14T15:28:04.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.387+0000 7f2086a00700 1 -- 172.21.15.69:0/1089957022 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 9466+0+0 (secure 0 0 0) 0x7f209401d3f0 con 0x5556a35e4280 2024-05-14T15:28:04.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.388+0000 7f2086a00700 1 -- 172.21.15.69:0/1089957022 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f209402f050 con 0x5556a35e4280 2024-05-14T15:28:04.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.388+0000 7f20b6017b80 10 client.16617 fetch_fsmap learned FSMap version 50 2024-05-14T15:28:04.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.388+0000 7f20b6017b80 1 -- 172.21.15.69:0/1089957022 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x5556a36678b0 con 0x5556a35e4280 2024-05-14T15:28:04.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.389+0000 7f2086a00700 1 -- 172.21.15.69:0/1089957022 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f208c0042a0 con 0x5556a35e4280 2024-05-14T15:28:04.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.389+0000 7f2086a00700 1 -- 172.21.15.69:0/1089957022 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 50) ==== 8418+0+0 (secure 0 0 0) 0x7f2094026bb0 con 0x5556a35e4280 2024-05-14T15:28:04.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.389+0000 7f20b6017b80 10 client.16617 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T15:28:04.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.389+0000 7f20b6017b80 10 client.16617 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:04.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.389+0000 7f20b6017b80 20 client.16617 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:04.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.389+0000 7f20b6017b80 1 --2- 172.21.15.69:0/1089957022 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5556a3668030 0x5556a366a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:04.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.390+0000 7f20b6017b80 4 client.16617 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:28:04.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.390+0000 7f20b6017b80 1 -- 172.21.15.69:0/1089957022 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5556a3513400 con 0x5556a3668030 2024-05-14T15:28:04.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.390+0000 7f209fe00700 1 --2- 172.21.15.69:0/1089957022 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5556a3668030 0x5556a366a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:04.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.391+0000 7f2086a00700 10 client.16617 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:04.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.391+0000 7f209fe00700 1 --2- 172.21.15.69:0/1089957022 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5556a3668030 0x5556a366a450 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=464dc1579c6af881 server_cookie=786a303ca562ec65 in_seq=0 out_seq=0 2024-05-14T15:28:04.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.392+0000 7f2086a00700 1 -- 172.21.15.69:0/1089957022 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5556a3513400 con 0x5556a3668030 2024-05-14T15:28:04.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.392+0000 7f2086a00700 10 client.16617 handle_command_reply: tid=0 2024-05-14T15:28:04.393 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.392+0000 7f20b6017b80 1 client.16617 shutdown 2024-05-14T15:28:04.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.393+0000 7f20b6017b80 1 -- 172.21.15.69:0/1089957022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4280 msgr2=0x5556a35f10e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:04.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.393+0000 7f20b6017b80 1 --2- 172.21.15.69:0/1089957022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4280 0x5556a35f10e0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x5556a3600a10 tx=0x7f209400be20 comp rx=0 tx=0).stop 2024-05-14T15:28:04.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.393+0000 7f20b6017b80 1 -- 172.21.15.69:0/1089957022 shutdown_connections 2024-05-14T15:28:04.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.393+0000 7f20b6017b80 1 --2- 172.21.15.69:0/1089957022 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5556a3668030 0x5556a366a450 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.394 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.393+0000 7f20b6017b80 1 --2- 172.21.15.69:0/1089957022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5556a35e87c0 0x5556a35f1620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.393+0000 7f20b6017b80 1 --2- 172.21.15.69:0/1089957022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5556a3465e40 0x5556a35f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.393+0000 7f20b6017b80 1 --2- 172.21.15.69:0/1089957022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5556a35e4280 0x5556a35f10e0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.393+0000 7f20b6017b80 1 -- 172.21.15.69:0/1089957022 >> 172.21.15.69:0/1089957022 conn(0x5556a34a4a80 msgr2=0x5556a35ee830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:04.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.393+0000 7f2086a00700 0 client.16617 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:04.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.393+0000 7f20b6017b80 1 -- 172.21.15.69:0/1089957022 shutdown_connections 2024-05-14T15:28:04.395 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.393+0000 7f20b6017b80 1 -- 172.21.15.69:0/1089957022 wait complete. 2024-05-14T15:28:04.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.394+0000 7f20b6017b80 20 client.16617 trim_cache size 0 max 16384 2024-05-14T15:28:04.396 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:28:04.396 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.395+0000 7f20a5e00700 1 -- 172.21.15.69:0/85176796 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f20880b2b20 msgr2=0x7f20880b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:04.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.395+0000 7f20a5e00700 1 --2- 172.21.15.69:0/85176796 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f20880b2b20 0x7f20880b5030 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f20980e1270 tx=0x7f209800b3e0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.395+0000 7f20a5e00700 1 -- 172.21.15.69:0/85176796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20a0109680 msgr2=0x7f20a01a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:04.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.395+0000 7f20a5e00700 1 --2- 172.21.15.69:0/85176796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20a0109680 0x7f20a01a5960 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f2098007d10 tx=0x7f2098007df0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.395+0000 7f20a5e00700 1 -- 172.21.15.69:0/85176796 shutdown_connections 2024-05-14T15:28:04.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.395+0000 7f20a5e00700 1 --2- 172.21.15.69:0/85176796 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f20880b2b20 0x7f20880b5030 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.395+0000 7f20a5e00700 1 --2- 172.21.15.69:0/85176796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f20a0109680 0x7f20a01a5960 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.396+0000 7f20a5e00700 1 --2- 172.21.15.69:0/85176796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f20a0104400 0x7f20a01a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.396+0000 7f20a5e00700 1 --2- 172.21.15.69:0/85176796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f20a0108d30 0x7f20a01a16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:04.397 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.396+0000 7f20a5e00700 1 -- 172.21.15.69:0/85176796 >> 172.21.15.69:0/85176796 conn(0x7f20a0079d50 msgr2=0x7f20a0101780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:04.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.396+0000 7f20a5e00700 1 -- 172.21.15.69:0/85176796 shutdown_connections 2024-05-14T15:28:04.398 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:04.396+0000 7f20a5e00700 1 -- 172.21.15.69:0/85176796 wait complete. 2024-05-14T15:28:05.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:05 smithi069 ceph-mon[31270]: pgmap v196: 129 pgs: 129 active+clean; 1.9 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 13 MiB/s wr, 838 op/s 2024-05-14T15:28:05.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:05 smithi092 ceph-mon[34729]: pgmap v196: 129 pgs: 129 active+clean; 1.9 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 13 MiB/s wr, 838 op/s 2024-05-14T15:28:05.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:05 smithi203 ceph-mon[34567]: pgmap v196: 129 pgs: 129 active+clean; 1.9 GiB data, 6.7 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 13 MiB/s wr, 838 op/s 2024-05-14T15:28:06.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 140.0 s, 602.3 tps, lat 150.130 ms stddev 261.592 2024-05-14T15:28:06.484 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-05-14T15:28:06.484 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-05-14T15:28:07.031 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:28:07.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:07 smithi092 ceph-mon[34729]: pgmap v197: 129 pgs: 129 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 13 MiB/s wr, 698 op/s 2024-05-14T15:28:07.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:07 smithi069 ceph-mon[31270]: pgmap v197: 129 pgs: 129 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 13 MiB/s wr, 698 op/s 2024-05-14T15:28:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:07 smithi203 ceph-mon[34567]: pgmap v197: 129 pgs: 129 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 13 MiB/s wr, 698 op/s 2024-05-14T15:28:08.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:08 smithi069 ceph-mon[31270]: osdmap e93: 12 total, 12 up, 12 in 2024-05-14T15:28:08.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:08 smithi203 ceph-mon[34567]: osdmap e93: 12 total, 12 up, 12 in 2024-05-14T15:28:08.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:08 smithi092 ceph-mon[34729]: osdmap e93: 12 total, 12 up, 12 in 2024-05-14T15:28:09.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:09 smithi069 ceph-mon[31270]: pgmap v199: 129 pgs: 129 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 14 MiB/s wr, 753 op/s 2024-05-14T15:28:09.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:09 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:28:09.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:09 smithi203 ceph-mon[34567]: pgmap v199: 129 pgs: 129 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 14 MiB/s wr, 753 op/s 2024-05-14T15:28:09.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:09 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:28:09.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:09 smithi092 ceph-mon[34729]: pgmap v199: 129 pgs: 129 active+clean; 2.0 GiB data, 6.8 GiB used, 1.0 TiB / 1.0 TiB avail; 118 KiB/s rd, 14 MiB/s wr, 753 op/s 2024-05-14T15:28:09.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:09 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:28:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.756+0000 7f1752c00700 1 -- 172.21.15.69:0/3521119940 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f174c10a930 msgr2=0x7f174c10ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.756+0000 7f1752c00700 1 --2- 172.21.15.69:0/3521119940 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f174c10a930 0x7f174c10ad40 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1744009990 tx=0x7f1744009ca0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.756+0000 7f1752c00700 1 -- 172.21.15.69:0/3521119940 shutdown_connections 2024-05-14T15:28:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.756+0000 7f1752c00700 1 --2- 172.21.15.69:0/3521119940 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f174c11d930 0x7f174c11fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.756+0000 7f1752c00700 1 --2- 172.21.15.69:0/3521119940 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f174c10a930 0x7f174c10ad40 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.756+0000 7f1752c00700 1 --2- 172.21.15.69:0/3521119940 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c10b280 0x7f174c11d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.756+0000 7f1752c00700 1 -- 172.21.15.69:0/3521119940 >> 172.21.15.69:0/3521119940 conn(0x7f174c06f4d0 msgr2=0x7f174c06f910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:09.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.758+0000 7f1752c00700 1 -- 172.21.15.69:0/3521119940 shutdown_connections 2024-05-14T15:28:09.761 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.758+0000 7f1752c00700 1 -- 172.21.15.69:0/3521119940 wait complete. 2024-05-14T15:28:09.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.762+0000 7f1752c00700 1 Processor -- start 2024-05-14T15:28:09.764 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.762+0000 7f1752c00700 1 -- start start 2024-05-14T15:28:09.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.770+0000 7f1752c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c10a930 0x7f174c1af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.770+0000 7f1752c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f174c10b280 0x7f174c1afd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.770+0000 7f1752c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f174c11d930 0x7f174c1a9a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.770+0000 7f1752c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f174c123250 con 0x7f174c11d930 2024-05-14T15:28:09.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.770+0000 7f1752c00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1230d0 con 0x7f174c10a930 2024-05-14T15:28:09.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.770+0000 7f1752c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1233d0 con 0x7f174c10b280 2024-05-14T15:28:09.772 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.770+0000 7f174be00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c10a930 0x7f174c1af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.770+0000 7f174b400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f174c10b280 0x7f174c1afd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.770+0000 7f174be00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c10a930 0x7f174c1af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:35660/0 (socket says 172.21.15.69:35660) 2024-05-14T15:28:09.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.770+0000 7f174be00700 1 -- 172.21.15.69:0/895449650 learned_addr learned my addr 172.21.15.69:0/895449650 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:09.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.770+0000 7f1750c00700 1 --2- 172.21.15.69:0/895449650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f174c11d930 0x7f174c1a9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.773 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.771+0000 7f174b400700 1 -- 172.21.15.69:0/895449650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c10a930 msgr2=0x7f174c1af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:09.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.771+0000 7f174b400700 1 --2- 172.21.15.69:0/895449650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c10a930 0x7f174c1af7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.771+0000 7f174b400700 1 -- 172.21.15.69:0/895449650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f174c11d930 msgr2=0x7f174c1a9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:09.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.771+0000 7f174b400700 1 --2- 172.21.15.69:0/895449650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f174c11d930 0x7f174c1a9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.771+0000 7f174b400700 1 -- 172.21.15.69:0/895449650 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c1aa0c0 con 0x7f174c10b280 2024-05-14T15:28:09.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.771+0000 7f174be00700 1 --2- 172.21.15.69:0/895449650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c10a930 0x7f174c1af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:28:09.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.771+0000 7f174b400700 1 --2- 172.21.15.69:0/895449650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f174c10b280 0x7f174c1afd30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f173400c970 tx=0x7f173400cc80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:09.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.772+0000 7f1748c00700 1 -- 172.21.15.69:0/895449650 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173400ce60 con 0x7f174c10b280 2024-05-14T15:28:09.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.772+0000 7f1748c00700 1 -- 172.21.15.69:0/895449650 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1734004830 con 0x7f174c10b280 2024-05-14T15:28:09.774 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.772+0000 7f1748c00700 1 -- 172.21.15.69:0/895449650 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734005350 con 0x7f174c10b280 2024-05-14T15:28:09.775 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.773+0000 7f1752c00700 1 -- 172.21.15.69:0/895449650 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174c1aa3b0 con 0x7f174c10b280 2024-05-14T15:28:09.777 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.775+0000 7f1752c00700 1 -- 172.21.15.69:0/895449650 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174c1aa840 con 0x7f174c10b280 2024-05-14T15:28:09.784 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.781+0000 7f1748c00700 1 -- 172.21.15.69:0/895449650 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1734004c70 con 0x7f174c10b280 2024-05-14T15:28:09.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.784+0000 7f1748c00700 1 --2- 172.21.15.69:0/895449650 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f17300b2b20 0x7f17300b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.787 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.785+0000 7f1748c00700 1 -- 172.21.15.69:0/895449650 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9642+0+0 (secure 0 0 0) 0x7f17340e1ac0 con 0x7f174c10b280 2024-05-14T15:28:09.788 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.785+0000 7f174be00700 1 --2- 172.21.15.69:0/895449650 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f17300b2b20 0x7f17300b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.789 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.788+0000 7f174be00700 1 --2- 172.21.15.69:0/895449650 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f17300b2b20 0x7f17300b5030 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1744003760 tx=0x7f1744003680 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:09.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.789+0000 7f1761786b80 1 Processor -- start 2024-05-14T15:28:09.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.789+0000 7f1761786b80 1 -- start start 2024-05-14T15:28:09.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.790+0000 7f1761786b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a462ec0 0x555f0a5e6370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.790+0000 7f1761786b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a5e68b0 0x555f0a5e0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.790+0000 7f1761786b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e0a70 0x555f0a5e0e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.790+0000 7f1761786b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x555f0a502aa0 con 0x555f0a5e68b0 2024-05-14T15:28:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.790+0000 7f174b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a5e68b0 0x555f0a5e0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.790+0000 7f1761786b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555f0a4a07e0 con 0x555f0a5e0a70 2024-05-14T15:28:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.790+0000 7f1761786b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555f0a4fea60 con 0x555f0a462ec0 2024-05-14T15:28:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.790+0000 7f174be00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a462ec0 0x555f0a5e6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.790+0000 7f1750c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e0a70 0x555f0a5e0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.791+0000 7f1750c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e0a70 0x555f0a5e0e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:35664/0 (socket says 172.21.15.69:35664) 2024-05-14T15:28:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.791+0000 7f1750c00700 1 -- 172.21.15.69:0/2057256387 learned_addr learned my addr 172.21.15.69:0/2057256387 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:09.792 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.791+0000 7f174b400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a5e68b0 0x555f0a5e0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56838/0 (socket says 172.21.15.69:56838) 2024-05-14T15:28:09.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.791+0000 7f174b400700 1 -- 172.21.15.69:0/2057256387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a462ec0 msgr2=0x555f0a5e6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:09.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.791+0000 7f174b400700 1 --2- 172.21.15.69:0/2057256387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a462ec0 0x555f0a5e6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.791+0000 7f174b400700 1 -- 172.21.15.69:0/2057256387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e0a70 msgr2=0x555f0a5e0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:09.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.791+0000 7f174b400700 1 --2- 172.21.15.69:0/2057256387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e0a70 0x555f0a5e0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.791+0000 7f174b400700 1 -- 172.21.15.69:0/2057256387 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f0a44f950 con 0x555f0a5e68b0 2024-05-14T15:28:09.793 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.792+0000 7f174b400700 1 --2- 172.21.15.69:0/2057256387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a5e68b0 0x555f0a5e0530 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f17340ded50 tx=0x7f17340a8180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=431b1707429e8874 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:09.795 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.793+0000 7f1741600700 1 -- 172.21.15.69:0/2057256387 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17340c2070 con 0x555f0a5e68b0 2024-05-14T15:28:09.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.793+0000 7f1741600700 1 -- 172.21.15.69:0/2057256387 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17340a88e0 con 0x555f0a5e68b0 2024-05-14T15:28:09.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.794+0000 7f1741600700 1 -- 172.21.15.69:0/2057256387 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17340c2070 con 0x555f0a5e68b0 2024-05-14T15:28:09.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.795+0000 7f1761786b80 1 -- 172.21.15.69:0/2057256387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a5e68b0 msgr2=0x555f0a5e0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:09.796 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.795+0000 7f1761786b80 1 --2- 172.21.15.69:0/2057256387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a5e68b0 0x555f0a5e0530 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f17340ded50 tx=0x7f17340a8180 comp rx=0 tx=0).stop 2024-05-14T15:28:09.797 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.796+0000 7f1761786b80 1 -- 172.21.15.69:0/2057256387 shutdown_connections 2024-05-14T15:28:09.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.796+0000 7f1761786b80 1 --2- 172.21.15.69:0/2057256387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e0a70 0x555f0a5e0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.796+0000 7f1761786b80 1 --2- 172.21.15.69:0/2057256387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a462ec0 0x555f0a5e6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.798 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.797+0000 7f1761786b80 1 --2- 172.21.15.69:0/2057256387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a5e68b0 0x555f0a5e0530 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.800 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.797+0000 7f1761786b80 1 -- 172.21.15.69:0/2057256387 >> 172.21.15.69:0/2057256387 conn(0x555f0a4a7ff0 msgr2=0x555f0a5db350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:09.801 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.800+0000 7f1761786b80 1 -- 172.21.15.69:0/2057256387 shutdown_connections 2024-05-14T15:28:09.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.800+0000 7f1761786b80 1 -- 172.21.15.69:0/2057256387 wait complete. 2024-05-14T15:28:09.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.801+0000 7f1761786b80 1 -- start start 2024-05-14T15:28:09.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.801+0000 7f1761786b80 1 Processor -- start 2024-05-14T15:28:09.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.802+0000 7f1761786b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a462ec0 0x555f0a5ea090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.802+0000 7f1761786b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e0a70 0x555f0a5ea5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.802+0000 7f1761786b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e68b0 0x555f0a5eab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.803+0000 7f174b400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e0a70 0x555f0a5ea5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.803+0000 7f174b400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e0a70 0x555f0a5ea5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:35674/0 (socket says 172.21.15.69:35674) 2024-05-14T15:28:09.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.803+0000 7f174be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a462ec0 0x555f0a5ea090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.803+0000 7f174be00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a462ec0 0x555f0a5ea090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56840/0 (socket says 172.21.15.69:56840) 2024-05-14T15:28:09.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.804+0000 7f174b400700 1 -- 172.21.15.69:0/1295561924 learned_addr learned my addr 172.21.15.69:0/1295561924 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:09.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.804+0000 7f1761786b80 1 -- 172.21.15.69:0/1295561924 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x555f0a5ed390 con 0x555f0a462ec0 2024-05-14T15:28:09.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.804+0000 7f1761786b80 1 -- 172.21.15.69:0/1295561924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555f0a468ba0 con 0x555f0a5e0a70 2024-05-14T15:28:09.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.804+0000 7f1761786b80 1 -- 172.21.15.69:0/1295561924 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555f0a5ed510 con 0x555f0a5e68b0 2024-05-14T15:28:09.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.804+0000 7f1761786b80 10 client.0 _ll_register_callbacks cb 0x555f0a4a9cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:09.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.805+0000 7f1750c00700 1 --2- 172.21.15.69:0/1295561924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e68b0 0x555f0a5eab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.805+0000 7f174b400700 1 -- 172.21.15.69:0/1295561924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e68b0 msgr2=0x555f0a5eab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:09.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.805+0000 7f174b400700 1 --2- 172.21.15.69:0/1295561924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e68b0 0x555f0a5eab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.805+0000 7f174b400700 1 -- 172.21.15.69:0/1295561924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a462ec0 msgr2=0x555f0a5ea090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:09.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.806+0000 7f174b400700 1 --2- 172.21.15.69:0/1295561924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a462ec0 0x555f0a5ea090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.806+0000 7f174b400700 1 -- 172.21.15.69:0/1295561924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f0a4c84a0 con 0x555f0a5e0a70 2024-05-14T15:28:09.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.806+0000 7f174be00700 1 --2- 172.21.15.69:0/1295561924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a462ec0 0x555f0a5ea090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:28:09.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.807+0000 7f174b400700 1 --2- 172.21.15.69:0/1295561924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e0a70 0x555f0a5ea5d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f17340a5b50 tx=0x7f17340057a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93af2e055532811f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:09.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.808+0000 7f173a000700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:28:09.809 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.808+0000 7f173a000700 1 -- 172.21.15.69:0/1295561924 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17340c2040 con 0x555f0a5e0a70 2024-05-14T15:28:09.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.809+0000 7f173a000700 1 -- 172.21.15.69:0/1295561924 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9642+0+0 (secure 0 0 0) 0x7f17340a4ed0 con 0x555f0a5e0a70 2024-05-14T15:28:09.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.810+0000 7f1761786b80 1 -- 172.21.15.69:0/1295561924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f17340a88e0 con 0x555f0a5e0a70 2024-05-14T15:28:09.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.810+0000 7f173a000700 1 -- 172.21.15.69:0/1295561924 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f17340b1060 con 0x555f0a5e0a70 2024-05-14T15:28:09.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.811+0000 7f1761786b80 10 client.36122 fetch_fsmap learned FSMap version 50 2024-05-14T15:28:09.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.811+0000 7f1761786b80 1 -- 172.21.15.69:0/1295561924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x555f0a5f7ed0 con 0x555f0a5e0a70 2024-05-14T15:28:09.812 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.811+0000 7f173a000700 1 -- 172.21.15.69:0/1295561924 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f17340acc90 con 0x555f0a5e0a70 2024-05-14T15:28:09.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.811+0000 7f173a000700 1 -- 172.21.15.69:0/1295561924 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 50) ==== 8418+0+0 (secure 0 0 0) 0x7f17340c9c00 con 0x555f0a5e0a70 2024-05-14T15:28:09.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.812+0000 7f1761786b80 10 client.36122 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T15:28:09.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.812+0000 7f1761786b80 10 client.36122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:09.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.812+0000 7f1761786b80 20 client.36122 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:09.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.812+0000 7f1761786b80 1 --2- 172.21.15.69:0/1295561924 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555f0a5fa3a0 0x555f0a5fc7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.812+0000 7f1761786b80 4 client.36122 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:28:09.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.812+0000 7f1761786b80 1 -- 172.21.15.69:0/1295561924 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f17340a88e0 con 0x555f0a5fa3a0 2024-05-14T15:28:09.815 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.813+0000 7f174be00700 1 --2- 172.21.15.69:0/1295561924 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555f0a5fa3a0 0x555f0a5fc7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.816 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.814+0000 7f173a000700 10 client.36122 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:09.818 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.815+0000 7f174be00700 1 --2- 172.21.15.69:0/1295561924 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555f0a5fa3a0 0x555f0a5fc7c0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfa5c023d73f5be4 server_cookie=12ce7e6f1a63ae07 in_seq=0 out_seq=0 2024-05-14T15:28:09.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.817+0000 7f173a000700 1 -- 172.21.15.69:0/1295561924 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f17340a88e0 con 0x555f0a5fa3a0 2024-05-14T15:28:09.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.817+0000 7f173a000700 10 client.36122 handle_command_reply: tid=0 2024-05-14T15:28:09.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.817+0000 7f1761786b80 1 client.36122 shutdown 2024-05-14T15:28:09.819 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.817+0000 7f1761786b80 1 -- 172.21.15.69:0/1295561924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e0a70 msgr2=0x555f0a5ea5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:09.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.817+0000 7f1761786b80 1 --2- 172.21.15.69:0/1295561924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e0a70 0x555f0a5ea5d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f17340a5b50 tx=0x7f17340057a0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.818+0000 7f1761786b80 1 -- 172.21.15.69:0/1295561924 shutdown_connections 2024-05-14T15:28:09.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.818+0000 7f1761786b80 1 --2- 172.21.15.69:0/1295561924 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555f0a5fa3a0 0x555f0a5fc7c0 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.818+0000 7f1761786b80 1 --2- 172.21.15.69:0/1295561924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a462ec0 0x555f0a5ea090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.818+0000 7f1761786b80 1 --2- 172.21.15.69:0/1295561924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e68b0 0x555f0a5eab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.818+0000 7f1761786b80 1 --2- 172.21.15.69:0/1295561924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e0a70 0x555f0a5ea5d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.818+0000 7f173a000700 0 client.36122 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:09.820 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.818+0000 7f1761786b80 1 -- 172.21.15.69:0/1295561924 >> 172.21.15.69:0/1295561924 conn(0x555f0a4a7ff0 msgr2=0x555f0a5df520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:09.821 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.818+0000 7f1761786b80 1 -- 172.21.15.69:0/1295561924 shutdown_connections 2024-05-14T15:28:09.822 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.821+0000 7f1761786b80 1 -- 172.21.15.69:0/1295561924 wait complete. 2024-05-14T15:28:09.823 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.821+0000 7f1761786b80 20 client.36122 trim_cache size 0 max 16384 2024-05-14T15:28:09.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.868+0000 7f1761786b80 1 Processor -- start 2024-05-14T15:28:09.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.869+0000 7f1761786b80 1 -- start start 2024-05-14T15:28:09.871 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.870+0000 7f1761786b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a462ec0 0x555f0a5e0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.870+0000 7f1761786b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e0a70 0x555f0a5f6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.870+0000 7f1761786b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a5e68b0 0x555f0a5e5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.870+0000 7f1761786b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1bf7e0 con 0x555f0a5e68b0 2024-05-14T15:28:09.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.870+0000 7f1761786b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1c1560 con 0x555f0a462ec0 2024-05-14T15:28:09.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.870+0000 7f1761786b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1bff70 con 0x555f0a5e0a70 2024-05-14T15:28:09.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.871+0000 7f174be00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a462ec0 0x555f0a5e0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.872 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.871+0000 7f174be00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a462ec0 0x555f0a5e0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:35680/0 (socket says 172.21.15.69:35680) 2024-05-14T15:28:09.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.871+0000 7f174be00700 1 -- 172.21.15.69:0/3464121982 learned_addr learned my addr 172.21.15.69:0/3464121982 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:09.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.871+0000 7f1750c00700 1 --2- 172.21.15.69:0/3464121982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a5e68b0 0x555f0a5e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.872+0000 7f174b400700 1 --2- 172.21.15.69:0/3464121982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e0a70 0x555f0a5f6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.873 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.872+0000 7f1750c00700 1 -- 172.21.15.69:0/3464121982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e0a70 msgr2=0x555f0a5f6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:09.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.872+0000 7f1750c00700 1 --2- 172.21.15.69:0/3464121982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e0a70 0x555f0a5f6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.872+0000 7f1750c00700 1 -- 172.21.15.69:0/3464121982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a462ec0 msgr2=0x555f0a5e0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:09.874 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.872+0000 7f1750c00700 1 --2- 172.21.15.69:0/3464121982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a462ec0 0x555f0a5e0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.872+0000 7f1750c00700 1 -- 172.21.15.69:0/3464121982 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f0a5e1730 con 0x555f0a5e68b0 2024-05-14T15:28:09.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.873+0000 7f1750c00700 1 --2- 172.21.15.69:0/3464121982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a5e68b0 0x555f0a5e5900 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f173c00a540 tx=0x7f173c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7d75d85b9201909 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:09.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.874+0000 7f1740c00700 1 -- 172.21.15.69:0/3464121982 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c01c020 con 0x555f0a5e68b0 2024-05-14T15:28:09.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.874+0000 7f1740c00700 1 -- 172.21.15.69:0/3464121982 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f173c0188d0 con 0x555f0a5e68b0 2024-05-14T15:28:09.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.874+0000 7f1740c00700 1 -- 172.21.15.69:0/3464121982 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c017840 con 0x555f0a5e68b0 2024-05-14T15:28:09.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.875+0000 7f1761786b80 1 -- 172.21.15.69:0/3464121982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a5e68b0 msgr2=0x555f0a5e5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:09.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.875+0000 7f1761786b80 1 --2- 172.21.15.69:0/3464121982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a5e68b0 0x555f0a5e5900 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f173c00a540 tx=0x7f173c009840 comp rx=0 tx=0).stop 2024-05-14T15:28:09.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.876+0000 7f1761786b80 1 -- 172.21.15.69:0/3464121982 shutdown_connections 2024-05-14T15:28:09.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.876+0000 7f1761786b80 1 --2- 172.21.15.69:0/3464121982 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a5e68b0 0x555f0a5e5900 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.876+0000 7f1761786b80 1 --2- 172.21.15.69:0/3464121982 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a462ec0 0x555f0a5e0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.876+0000 7f1761786b80 1 --2- 172.21.15.69:0/3464121982 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e0a70 0x555f0a5f6770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.876+0000 7f1761786b80 1 -- 172.21.15.69:0/3464121982 >> 172.21.15.69:0/3464121982 conn(0x555f0a4a7ff0 msgr2=0x555f0a5e51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:09.878 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.876+0000 7f1761786b80 1 -- 172.21.15.69:0/3464121982 shutdown_connections 2024-05-14T15:28:09.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.876+0000 7f1761786b80 1 -- 172.21.15.69:0/3464121982 wait complete. 2024-05-14T15:28:09.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.877+0000 7f1761786b80 1 -- start start 2024-05-14T15:28:09.879 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.877+0000 7f1761786b80 1 Processor -- start 2024-05-14T15:28:09.881 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.880+0000 7f1761786b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a462ec0 0x555f0a5fd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.880+0000 7f1761786b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e0a70 0x555f0a5fd870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.881+0000 7f1761786b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e68b0 0x555f0a5fddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.881+0000 7f1761786b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1c0dd0 con 0x555f0a462ec0 2024-05-14T15:28:09.883 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.881+0000 7f1761786b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1c0640 con 0x555f0a5e68b0 2024-05-14T15:28:09.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.881+0000 7f1761786b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1bd7a0 con 0x555f0a5e0a70 2024-05-14T15:28:09.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.881+0000 7f1761786b80 10 client.0 _ll_register_callbacks cb 0x555f0a4a9cf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:09.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.882+0000 7f174b400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e0a70 0x555f0a5fd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.882+0000 7f1750c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e68b0 0x555f0a5fddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.882+0000 7f1750c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e68b0 0x555f0a5fddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:35692/0 (socket says 172.21.15.69:35692) 2024-05-14T15:28:09.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.882+0000 7f1750c00700 1 -- 172.21.15.69:0/91847538 learned_addr learned my addr 172.21.15.69:0/91847538 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:09.884 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.882+0000 7f1750c00700 1 -- 172.21.15.69:0/91847538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e0a70 msgr2=0x555f0a5fd870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:09.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.882+0000 7f174b400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e0a70 0x555f0a5fd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:60322/0 (socket says 172.21.15.69:60322) 2024-05-14T15:28:09.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.883+0000 7f1750c00700 1 --2- 172.21.15.69:0/91847538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e0a70 0x555f0a5fd870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.883+0000 7f1750c00700 1 -- 172.21.15.69:0/91847538 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a462ec0 msgr2=0x555f0a5fd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:09.885 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.883+0000 7f1750c00700 1 --2- 172.21.15.69:0/91847538 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a462ec0 0x555f0a5fd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.883+0000 7f1750c00700 1 -- 172.21.15.69:0/91847538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f0a6638f0 con 0x555f0a5e68b0 2024-05-14T15:28:09.886 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.884+0000 7f174b400700 1 --2- 172.21.15.69:0/91847538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e0a70 0x555f0a5fd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:28:09.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.885+0000 7f1750c00700 1 --2- 172.21.15.69:0/91847538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e68b0 0x555f0a5fddb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f173c004c20 tx=0x7f173c018d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bfc9b7e1a98757e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:09.887 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.885+0000 7f173a000700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:28:09.888 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.887+0000 7f173a000700 1 -- 172.21.15.69:0/91847538 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f173c01c030 con 0x555f0a5e68b0 2024-05-14T15:28:09.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.887+0000 7f173a000700 1 -- 172.21.15.69:0/91847538 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9642+0+0 (secure 0 0 0) 0x7f173c021630 con 0x555f0a5e68b0 2024-05-14T15:28:09.889 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.888+0000 7f1761786b80 1 -- 172.21.15.69:0/91847538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f173c0188d0 con 0x555f0a5e68b0 2024-05-14T15:28:09.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.894+0000 7f173a000700 1 -- 172.21.15.69:0/91847538 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=50) ==== 24+0+0 (secure 0 0 0) 0x7f173c030050 con 0x555f0a5e68b0 2024-05-14T15:28:09.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.895+0000 7f1761786b80 10 client.36128 fetch_fsmap learned FSMap version 50 2024-05-14T15:28:09.896 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.895+0000 7f1761786b80 1 -- 172.21.15.69:0/91847538 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=50,monmap=4+}) -- 0x555f0a664a80 con 0x555f0a5e68b0 2024-05-14T15:28:09.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.896+0000 7f173a000700 1 -- 172.21.15.69:0/91847538 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f173c0188d0 con 0x555f0a5e68b0 2024-05-14T15:28:09.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.896+0000 7f173a000700 1 -- 172.21.15.69:0/91847538 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 50) ==== 8418+0+0 (secure 0 0 0) 0x7f173c02b8f0 con 0x555f0a5e68b0 2024-05-14T15:28:09.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.896+0000 7f1761786b80 10 client.36128 fetch_fsmap finished waiting for FSMap version 50 2024-05-14T15:28:09.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.896+0000 7f1761786b80 10 client.36128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:09.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.896+0000 7f1761786b80 20 client.36128 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:09.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.896+0000 7f1761786b80 1 --2- 172.21.15.69:0/91847538 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555f0a665140 0x555f0a6675a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:09.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.896+0000 7f1761786b80 4 client.36128 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-05-14T15:28:09.899 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.896+0000 7f1761786b80 1 -- 172.21.15.69:0/91847538 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x555f0a5ad240 con 0x555f0a665140 2024-05-14T15:28:09.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.897+0000 7f174be00700 1 --2- 172.21.15.69:0/91847538 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555f0a665140 0x555f0a6675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:09.900 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.898+0000 7f173a000700 10 client.36128 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:09.902 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.900+0000 7f174be00700 1 --2- 172.21.15.69:0/91847538 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555f0a665140 0x555f0a6675a0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98e6ac0a3cba899 server_cookie=ede671ee30ed7ef5 in_seq=0 out_seq=0 2024-05-14T15:28:09.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.902+0000 7f173a000700 1 -- 172.21.15.69:0/91847538 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x555f0a5ad240 con 0x555f0a665140 2024-05-14T15:28:09.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.902+0000 7f173a000700 10 client.36128 handle_command_reply: tid=0 2024-05-14T15:28:09.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.902+0000 7f1761786b80 1 client.36128 shutdown 2024-05-14T15:28:09.904 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.903+0000 7f1761786b80 1 -- 172.21.15.69:0/91847538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e68b0 msgr2=0x555f0a5fddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:09.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.903+0000 7f1761786b80 1 --2- 172.21.15.69:0/91847538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e68b0 0x555f0a5fddb0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f173c004c20 tx=0x7f173c018d60 comp rx=0 tx=0).stop 2024-05-14T15:28:09.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.903+0000 7f1761786b80 1 -- 172.21.15.69:0/91847538 shutdown_connections 2024-05-14T15:28:09.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.903+0000 7f1761786b80 1 --2- 172.21.15.69:0/91847538 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555f0a665140 0x555f0a6675a0 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.903+0000 7f1761786b80 1 --2- 172.21.15.69:0/91847538 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555f0a462ec0 0x555f0a5fd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.903+0000 7f1761786b80 1 --2- 172.21.15.69:0/91847538 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555f0a5e68b0 0x555f0a5fddb0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.903+0000 7f1761786b80 1 --2- 172.21.15.69:0/91847538 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555f0a5e0a70 0x555f0a5fd870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.905 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.903+0000 7f1761786b80 1 -- 172.21.15.69:0/91847538 >> 172.21.15.69:0/91847538 conn(0x555f0a4a7ff0 msgr2=0x555f0a5e3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:09.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.903+0000 7f173a000700 0 client.36128 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:09.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.904+0000 7f1761786b80 1 -- 172.21.15.69:0/91847538 shutdown_connections 2024-05-14T15:28:09.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.904+0000 7f1761786b80 1 -- 172.21.15.69:0/91847538 wait complete. 2024-05-14T15:28:09.906 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.905+0000 7f1761786b80 20 client.36128 trim_cache size 0 max 16384 2024-05-14T15:28:09.906 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:28:09.907 INFO:teuthology.orchestra.run.smithi069.stdout: "return_code": 0, 2024-05-14T15:28:09.907 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_tag": "4f200d60-3ad5-46f1-905b-a53e956c4b96", 2024-05-14T15:28:09.907 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": "asynchronous" 2024-05-14T15:28:09.907 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:28:09.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.906+0000 7f1752c00700 1 -- 172.21.15.69:0/895449650 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f17300b2b20 msgr2=0x7f17300b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:09.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.906+0000 7f1752c00700 1 --2- 172.21.15.69:0/895449650 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f17300b2b20 0x7f17300b5030 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1744003760 tx=0x7f1744003680 comp rx=0 tx=0).stop 2024-05-14T15:28:09.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.906+0000 7f1752c00700 1 -- 172.21.15.69:0/895449650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f174c10b280 msgr2=0x7f174c1afd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:09.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.906+0000 7f1752c00700 1 --2- 172.21.15.69:0/895449650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f174c10b280 0x7f174c1afd30 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f173400c970 tx=0x7f173400cc80 comp rx=0 tx=0).stop 2024-05-14T15:28:09.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.907+0000 7f1752c00700 1 -- 172.21.15.69:0/895449650 shutdown_connections 2024-05-14T15:28:09.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.907+0000 7f1752c00700 1 --2- 172.21.15.69:0/895449650 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f17300b2b20 0x7f17300b5030 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.907+0000 7f1752c00700 1 --2- 172.21.15.69:0/895449650 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f174c11d930 0x7f174c1a9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.907+0000 7f1752c00700 1 --2- 172.21.15.69:0/895449650 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f174c10a930 0x7f174c1af7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.907+0000 7f1752c00700 1 --2- 172.21.15.69:0/895449650 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f174c10b280 0x7f174c1afd30 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:09.909 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.907+0000 7f1752c00700 1 -- 172.21.15.69:0/895449650 >> 172.21.15.69:0/895449650 conn(0x7f174c06f4d0 msgr2=0x7f174c11b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:09.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.908+0000 7f1752c00700 1 -- 172.21.15.69:0/895449650 shutdown_connections 2024-05-14T15:28:09.910 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:09.908+0000 7f1752c00700 1 -- 172.21.15.69:0/895449650 wait complete. 2024-05-14T15:28:10.193 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:28:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b[64556]: 2024-05-14T15:28:09.940+0000 7f1329000700 -1 mds.0.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000001b [...3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical/ auth{1=1,2=1,3=1,4=1} v634 ap=2 f(v10 m2024-05-14T15:22:33.427523+0000 3=1+2) n(v3 rc2024-05-14T15:22:33.427523+0000 b8 4=1+3) (inest sync->mix g=1,2,3,4) caps={25000=pAsLsXsFs/-@55} | dirtyscattered=0 request=0 lock=0 dirfrag=1 caps=1 dirtyparent=0 replicated=1 dirty=0 waiter=0 authpin=1 scrubqueue=0 0x55799700a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value":"(2)0x1000000001b:[<0x10000000006/pg_logical v46>,<0x10000000005/data v96>,<0x10000000003/postgres v21>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v37>,<0x10000000001/sv_0 v58>,<0x10000000000/qa v46>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000001b:[<0x10000000006/pg_logical v634>,<0x10000000005/data v1025>,<0x10000000003/postgres v365>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v380>,<0x10000000001/sv_0 v394>,<0x10000000000/qa v385>,<0x1/volumes v370>]//[]","error_str":""},"raw_stats":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-05-14T15:22:33.396239+0000 4=2+2)","ondisk_value.rstat":"n(v0 rc2024-05-14T15:22:33.427523+0000 b8 4=1+3)","memory_value.dirstat":"f(v10 m2024-05-14T15:22:33.427523+0000 3=1+2)","memory_value.rstat":"n(v3 rc2024-05-14T15:22:33.427523+0000 b8 4=1+3)","error_str":"freshly-calculated rstats don't match existing ones"},"return_code":0} 2024-05-14T15:28:10.195 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:09.993+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x20000000203 [8,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/13494/16396 auth v967 ap=1 s=436117504 n(v0 rc2024-05-14T15:28:00.810373+0000 b436117504 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={25000=0-872415232@8} caps={25000=pAsxLsXsxFsxcrwb/pAsxXsxFsxcrwb@2},l=25000 | ptrwaiter=0 request=0 lock=0 importingcaps=0 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x560dec100680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x20000000203:[<0x10000000498/16396 v889>,<0x10000000014/13494 v7402>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x20000000203:[<0x10000000498/16396 v967>,<0x10000000014/13494 v7466>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.195 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.008+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000369 [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3079_vm auth v670 ap=1 s=8192 n(v0 rc2024-05-14T15:22:22.904232+0000 b8192 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560debffb600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000369:[<0x10000000015/3079_vm v670>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x10000000369:[<0x10000000015/3079_vm v670>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.195 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.008+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032a [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/pg_filenode.map auth v678 ap=1 s=512 n(v0 rc2024-05-14T15:22:13.583458+0000 b512 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560debffab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000032a:[<0x10000000015/pg_filenode.map v678>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x1000000032a:[<0x10000000015/pg_filenode.map v678>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.195 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.009+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000344 [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2840_fsm auth v682 ap=1 s=24576 n(v0 rc2024-05-14T15:22:22.878793+0000 b24576 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560debffa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000344:[<0x10000000015/2840_fsm v682>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x10000000344:[<0x10000000015/2840_fsm v682>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.195 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.009+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034b [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2606_vm auth v690 ap=1 s=8192 n(v0 rc2024-05-14T15:22:22.191890+0000 b8192 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec006100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000034b:[<0x10000000015/2606_vm v690>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x1000000034b:[<0x10000000015/2606_vm v690>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.195 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.010+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000358 [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2618_vm auth v710 ap=1 s=8192 n(v0 rc2024-05-14T15:22:22.468586+0000 b8192 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec004580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000358:[<0x10000000015/2618_vm v710>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x10000000358:[<0x10000000015/2618_vm v710>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.195 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.013+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036e [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3541_fsm auth v722 ap=1 s=24576 n(v0 rc2024-05-14T15:22:22.985005+0000 b24576 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec007180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000036e:[<0x10000000015/3541_fsm v722>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x1000000036e:[<0x10000000015/3541_fsm v722>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.195 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.014+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000345 [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2619_vm auth v762 ap=1 s=8192 n(v0 rc2024-05-14T15:22:22.502432+0000 b8192 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec02fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000345:[<0x10000000015/2619_vm v762>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x10000000345:[<0x10000000015/2619_vm v762>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.195 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.016+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033c [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13354 auth v774 ap=1 s=8192 n(v0 rc2024-05-14T15:22:23.056611+0000 b8192 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec030c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000033c:[<0x10000000015/13354 v774>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x1000000033c:[<0x10000000015/13354 v774>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.196 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.016+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000340 [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13361 auth v782 ap=1 s=0 n(v0 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec031700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000340:[<0x10000000015/13361 v782>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x10000000340:[<0x10000000015/13361 v782>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.196 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.017+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000375 [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13344_vm auth v802 ap=1 s=8192 n(v0 rc2024-05-14T15:22:23.049360+0000 b8192 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec037600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000375:[<0x10000000015/13344_vm v802>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x10000000375:[<0x10000000015/13344_vm v802>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.196 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.040+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000333 [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3456_fsm auth v696 ap=1 s=24576 n(v0 rc2024-05-14T15:22:22.976139+0000 b24576 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec07f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000333:[<0x10000000015/3456_fsm v696>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x10000000333:[<0x10000000015/3456_fsm v696>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.196 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.040+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000368 [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3764_fsm auth v708 ap=1 s=24576 n(v0 rc2024-05-14T15:22:23.033256+0000 b24576 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec084b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000368:[<0x10000000015/3764_fsm v708>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x10000000368:[<0x10000000015/3764_fsm v708>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.196 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.040+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000347 [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/1247_vm auth v700 ap=1 s=8192 n(v0 rc2024-05-14T15:22:21.894662+0000 b8192 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec084000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000347:[<0x10000000015/1247_vm v700>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x10000000347:[<0x10000000015/1247_vm v700>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.196 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.041+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035f [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2608_vm auth v712 ap=1 s=8192 n(v0 rc2024-05-14T15:22:22.283529+0000 b8192 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec085080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000035f:[<0x10000000015/2608_vm v712>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x1000000035f:[<0x10000000015/2608_vm v712>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.196 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.041+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036c [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3456_vm auth v720 ap=1 s=8192 n(v0 rc2024-05-14T15:22:22.977898+0000 b8192 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec085b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000036c:[<0x10000000015/3456_vm v720>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x1000000036c:[<0x10000000015/3456_vm v720>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.196 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.042+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000355 [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2612_vm auth v752 ap=1 s=8192 n(v0 rc2024-05-14T15:22:22.368404+0000 b8192 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec08cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000355:[<0x10000000015/2612_vm v752>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x10000000355:[<0x10000000015/2612_vm v752>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.196 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.043+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000350 [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2616_vm auth v764 ap=1 s=8192 n(v0 rc2024-05-14T15:22:22.407648+0000 b8192 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec08db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000350:[<0x10000000015/2616_vm v764>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x10000000350:[<0x10000000015/2616_vm v764>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.196 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.043+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000354 [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2603_vm auth v780 ap=1 s=8192 n(v0 rc2024-05-14T15:22:22.159172+0000 b8192 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec08f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000354:[<0x10000000015/2603_vm v780>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x10000000354:[<0x10000000015/2603_vm v780>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.196 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.044+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000351 [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2601_vm auth v792 ap=1 s=8192 n(v0 rc2024-05-14T15:22:22.104110+0000 b8192 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec094580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000351:[<0x10000000015/2601_vm v792>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x10000000351:[<0x10000000015/2601_vm v792>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.197 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.044+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034e [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2617_vm auth v788 ap=1 s=8192 n(v0 rc2024-05-14T15:22:22.440087+0000 b8192 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec094000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000034e:[<0x10000000015/2617_vm v788>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x1000000034e:[<0x10000000015/2617_vm v788>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.197 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.046+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033e [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13358 auth v848 ap=1 s=8192 n(v0 rc2024-05-14T15:22:17.435739+0000 b8192 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec0a3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000033e:[<0x10000000015/13358 v848>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x1000000033e:[<0x10000000015/13358 v848>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.197 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.047+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000370 [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13349_fsm auth v852 ap=1 s=24576 n(v0 rc2024-05-14T15:22:23.053327+0000 b24576 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec0a3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000370:[<0x10000000015/13349_fsm v852>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x10000000370:[<0x10000000015/13349_fsm v852>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:10.197 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:28:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:28:10.047+0000 7f8a11e00700 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000373 [3,head] /volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13359_vm auth v864 ap=1 s=8192 n(v0 rc2024-05-14T15:22:23.066994+0000 b8192 1=1+0) caps={25000=pAsLsXsFscr/-@1} | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x560dec0a4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000373:[<0x10000000015/13359_vm v864>,<0x10000000014/1 v7269>,<0x10000000006/base v1144>,<0x10000000005/data v785>,<0x10000000003/postgres v291>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v304>,<0x10000000001/sv_0 v326>,<0x10000000000/qa v315>,<0x1/volumes v300>]//[3]","memoryvalue":"(4)0x10000000373:[<0x10000000015/13359_vm v864>,<0x10000000014/1 v7269>,<0x10000000006/base v1384>,<0x10000000005/data v886>,<0x10000000003/postgres v361>,<0x10000000002/29d788fd-95ff-4078-b97d-da43ceeacd66 v343>,<0x10000000001/sv_0 v392>,<0x10000000000/qa v307>,<0x1/volumes v351>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-05-14T15:28:11.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:28:11.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: scrub queued for path: / 2024-05-14T15:28:11.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:28:11.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:28:11.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:28:11.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:28:11.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:28:11.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:28:11.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: scrub summary: active paths [/] 2024-05-14T15:28:11.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2024-05-14T15:28:11.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:28:11.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:28:11.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x20000000203 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/13494/16396) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000369 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3079_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x1000000032a (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/pg_filenode.map) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000344 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2840_fsm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x1000000034b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2606_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000358 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2618_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x1000000036e (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3541_fsm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000345 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2619_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x1000000033c (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13354) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000340 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13361) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000375 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13344_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.197 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: pgmap v200: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 15 MiB/s wr, 632 op/s 2024-05-14T15:28:11.197 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.197 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000333 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3456_fsm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.197 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000368 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3764_fsm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.197 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000347 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/1247_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.197 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x1000000035f (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2608_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.197 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x1000000036c (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3456_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.197 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000355 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2612_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.197 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000350 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2616_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.197 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000354 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2603_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.197 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000351 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2601_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.197 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x1000000034e (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2617_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.197 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13358) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.198 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000370 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13349_fsm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.198 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: Scrub error on inode 0x10000000373 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13359_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.198 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:10 smithi092 ceph-mon[34729]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:28:11.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: scrub queued for path: / 2024-05-14T15:28:11.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:28:11.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:28:11.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:28:11.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:28:11.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:28:11.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:28:11.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: scrub summary: active paths [/] 2024-05-14T15:28:11.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2024-05-14T15:28:11.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:28:11.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:28:11.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x20000000203 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/13494/16396) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000369 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3079_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x1000000032a (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/pg_filenode.map) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000344 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2840_fsm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x1000000034b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2606_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000358 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2618_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x1000000036e (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3541_fsm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000345 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2619_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x1000000033c (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13354) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000340 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13361) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000375 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13344_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: pgmap v200: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 15 MiB/s wr, 632 op/s 2024-05-14T15:28:11.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000333 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3456_fsm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000368 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3764_fsm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000347 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/1247_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x1000000035f (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2608_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x1000000036c (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3456_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000355 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2612_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000350 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2616_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000354 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2603_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000351 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2601_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x1000000034e (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2617_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13358) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000370 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13349_fsm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: Scrub error on inode 0x10000000373 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13359_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.228 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:10 smithi069 ceph-mon[31270]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:28:11.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: scrub queued for path: / 2024-05-14T15:28:11.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:28:11.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:28:11.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:28:11.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:28:11.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:28:11.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:28:11.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: scrub summary: active paths [/] 2024-05-14T15:28:11.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2024-05-14T15:28:11.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:28:11.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:28:11.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x20000000203 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/13494/16396) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000369 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3079_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x1000000032a (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/pg_filenode.map) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000344 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2840_fsm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x1000000034b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2606_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000358 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2618_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x1000000036e (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3541_fsm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000345 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2619_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x1000000033c (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13354) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000340 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13361) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000375 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13344_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: pgmap v200: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 15 MiB/s wr, 632 op/s 2024-05-14T15:28:11.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000333 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3456_fsm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000368 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3764_fsm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000347 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/1247_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x1000000035f (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2608_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x1000000036c (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3456_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000355 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2612_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000350 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2616_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.349 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000354 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2603_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.350 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000351 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2601_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.350 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x1000000034e (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2617_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.350 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13358) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.350 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000370 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13349_fsm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.350 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: Scrub error on inode 0x10000000373 (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13359_vm) see mds.e log and `damage ls` output for details 2024-05-14T15:28:11.350 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:10 smithi203 ceph-mon[34567]: scrub summary: idle+waiting paths [/] 2024-05-14T15:28:11.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 145.0 s, 579.5 tps, lat 189.144 ms stddev 380.704 2024-05-14T15:28:11.467 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T15:28:12.079 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:28:12.244 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:11 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a[31265]: 2024-05-14T15:28:11.974+0000 7f22e0a00700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-14T15:28:12.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:11 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:28:12.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:11 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:28:12.245 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:11 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:28:12.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:11 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:28:12.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:11 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:28:12.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:11 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:28:12.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:11 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:28:12.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:11 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:28:12.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:11 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:28:13.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:12 smithi069 ceph-mon[31270]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-14T15:28:13.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:12 smithi069 ceph-mon[31270]: mds.? [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] up:active 2024-05-14T15:28:13.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:12 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:28:13.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:12 smithi069 ceph-mon[31270]: pgmap v201: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 15 MiB/s wr, 632 op/s 2024-05-14T15:28:13.247 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:12 smithi203 ceph-mon[34567]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-14T15:28:13.247 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:12 smithi203 ceph-mon[34567]: mds.? [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] up:active 2024-05-14T15:28:13.247 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:12 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:28:13.247 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:12 smithi203 ceph-mon[34567]: pgmap v201: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 15 MiB/s wr, 632 op/s 2024-05-14T15:28:13.345 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:12 smithi092 ceph-mon[34729]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-05-14T15:28:13.345 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:12 smithi092 ceph-mon[34729]: mds.? [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] up:active 2024-05-14T15:28:13.345 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:12 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:28:13.345 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:12 smithi092 ceph-mon[34729]: pgmap v201: 129 pgs: 129 active+clean; 2.0 GiB data, 7.0 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 15 MiB/s wr, 632 op/s 2024-05-14T15:28:14.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:14 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:28:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.336+0000 7fdb4cc00640 1 -- 172.21.15.69:0/845367380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb48106620 msgr2=0x7fdb481129f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.336+0000 7fdb4cc00640 1 --2- 172.21.15.69:0/845367380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb48106620 0x7fdb481129f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fdb40009ca0 tx=0x7fdb4002a8d0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.337+0000 7fdb4cc00640 1 -- 172.21.15.69:0/845367380 shutdown_connections 2024-05-14T15:28:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.337+0000 7fdb4cc00640 1 --2- 172.21.15.69:0/845367380 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb48106620 0x7fdb481129f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.337+0000 7fdb4cc00640 1 --2- 172.21.15.69:0/845367380 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb4810c370 0x7fdb48105fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.337+0000 7fdb4cc00640 1 --2- 172.21.15.69:0/845367380 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb4810bed0 0x7fdb48105a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.337+0000 7fdb4cc00640 1 -- 172.21.15.69:0/845367380 >> 172.21.15.69:0/845367380 conn(0x7fdb481016c0 msgr2=0x7fdb48103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.337+0000 7fdb4cc00640 1 -- 172.21.15.69:0/845367380 shutdown_connections 2024-05-14T15:28:14.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.337+0000 7fdb4cc00640 1 -- 172.21.15.69:0/845367380 wait complete. 2024-05-14T15:28:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.340+0000 7fdb4cc00640 1 Processor -- start 2024-05-14T15:28:14.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.340+0000 7fdb4cc00640 1 -- start start 2024-05-14T15:28:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.341+0000 7fdb4cc00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb48106620 0x7fdb480749a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.341+0000 7fdb4cc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb4810bed0 0x7fdb4806dae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.341+0000 7fdb4cc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb4810c370 0x7fdb4806e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.342+0000 7fdb4cc00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fdb48115fa0 con 0x7fdb4810c370 2024-05-14T15:28:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.342+0000 7fdb4cc00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdb48115e20 con 0x7fdb48106620 2024-05-14T15:28:14.343 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.342+0000 7fdb4cc00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdb48116120 con 0x7fdb4810bed0 2024-05-14T15:28:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.342+0000 7fdb46800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb4810c370 0x7fdb4806e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.342+0000 7fdb46800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb4810c370 0x7fdb4806e1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34000/0 (socket says 172.21.15.69:34000) 2024-05-14T15:28:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.342+0000 7fdb46800640 1 -- 172.21.15.69:0/4256350964 learned_addr learned my addr 172.21.15.69:0/4256350964 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.343+0000 7fdb45400640 1 --2- 172.21.15.69:0/4256350964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb4810bed0 0x7fdb4806dae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.343+0000 7fdb46800640 1 -- 172.21.15.69:0/4256350964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb4810bed0 msgr2=0x7fdb4806dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.343+0000 7fdb46800640 1 --2- 172.21.15.69:0/4256350964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb4810bed0 0x7fdb4806dae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.343+0000 7fdb46800640 1 -- 172.21.15.69:0/4256350964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb48106620 msgr2=0x7fdb480749a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-14T15:28:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.343+0000 7fdb46800640 1 --2- 172.21.15.69:0/4256350964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb48106620 0x7fdb480749a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.343+0000 7fdb46800640 1 -- 172.21.15.69:0/4256350964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb480724c0 con 0x7fdb4810c370 2024-05-14T15:28:14.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.343+0000 7fdb46800640 1 --2- 172.21.15.69:0/4256350964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb4810c370 0x7fdb4806e1a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdb400098d0 tx=0x7fdb40032bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:14.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:14 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:28:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.344+0000 7fdb3ea00640 1 -- 172.21.15.69:0/4256350964 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40004040 con 0x7fdb4810c370 2024-05-14T15:28:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.344+0000 7fdb3ea00640 1 -- 172.21.15.69:0/4256350964 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb40004670 con 0x7fdb4810c370 2024-05-14T15:28:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.344+0000 7fdb3ea00640 1 -- 172.21.15.69:0/4256350964 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb40030b90 con 0x7fdb4810c370 2024-05-14T15:28:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.344+0000 7fdb4cc00640 1 -- 172.21.15.69:0/4256350964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb48072750 con 0x7fdb4810c370 2024-05-14T15:28:14.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.344+0000 7fdb4cc00640 1 -- 172.21.15.69:0/4256350964 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb48072c50 con 0x7fdb4810c370 2024-05-14T15:28:14.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.349+0000 7fdb53c06740 1 Processor -- start 2024-05-14T15:28:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.352+0000 7fdb3ea00640 1 -- 172.21.15.69:0/4256350964 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fdb40030d50 con 0x7fdb4810c370 2024-05-14T15:28:14.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.352+0000 7fdb53c06740 1 -- start start 2024-05-14T15:28:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.353+0000 7fdb53c06740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274b11b0 0x55af2785aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.353+0000 7fdb53c06740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274882f0 0x55af2785afd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.353+0000 7fdb53c06740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274904d0 0x55af2785b510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.353+0000 7fdb53c06740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55af277b7550 con 0x55af274b11b0 2024-05-14T15:28:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.353+0000 7fdb53c06740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55af2775cbc0 con 0x55af274904d0 2024-05-14T15:28:14.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.353+0000 7fdb53c06740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55af277b3510 con 0x55af274882f0 2024-05-14T15:28:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.353+0000 7fdb45400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274b11b0 0x55af2785aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.353+0000 7fdb45400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274b11b0 0x55af2785aa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34014/0 (socket says 172.21.15.69:34014) 2024-05-14T15:28:14.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.353+0000 7fdb45400640 1 -- 172.21.15.69:0/4188805860 learned_addr learned my addr 172.21.15.69:0/4188805860 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.354+0000 7fdb45e00640 1 --2- 172.21.15.69:0/4188805860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274882f0 0x55af2785afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.354+0000 7fdb3ea00640 1 --2- 172.21.15.69:0/4256350964 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdb2c0b2a20 0x7fdb2c0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.354+0000 7fdb3ea00640 1 -- 172.21.15.69:0/4256350964 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9642+0+0 (secure 0 0 0) 0x7fdb40104030 con 0x7fdb4810c370 2024-05-14T15:28:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.354+0000 7fdb46800640 1 --2- 172.21.15.69:0/4256350964 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdb2c0b2a20 0x7fdb2c0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.355+0000 7fdb45400640 1 -- 172.21.15.69:0/4188805860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274882f0 msgr2=0x55af2785afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.355+0000 7fdb45400640 1 --2- 172.21.15.69:0/4188805860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274882f0 0x55af2785afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.355+0000 7fdb45400640 1 -- 172.21.15.69:0/4188805860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274904d0 msgr2=0x55af2785b510 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:28:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.355+0000 7fdb45400640 1 --2- 172.21.15.69:0/4188805860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274904d0 0x55af2785b510 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.355+0000 7fdb45400640 1 -- 172.21.15.69:0/4188805860 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af274c9210 con 0x55af274b11b0 2024-05-14T15:28:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.356+0000 7fdb45400640 1 --2- 172.21.15.69:0/4188805860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274b11b0 0x55af2785aa90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400b730 tx=0x7fdb3400bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dab000ff4778ae4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.356+0000 7fdb46800640 1 --2- 172.21.15.69:0/4256350964 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdb2c0b2a20 0x7fdb2c0b4f30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdb40101430 tx=0x7fdb40003f30 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:14.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.356+0000 7fdb33000640 1 -- 172.21.15.69:0/4188805860 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3400be40 con 0x55af274b11b0 2024-05-14T15:28:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.356+0000 7fdb33000640 1 -- 172.21.15.69:0/4188805860 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb34018070 con 0x55af274b11b0 2024-05-14T15:28:14.358 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.356+0000 7fdb33000640 1 -- 172.21.15.69:0/4188805860 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3400be40 con 0x55af274b11b0 2024-05-14T15:28:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.358+0000 7fdb53c06740 1 -- 172.21.15.69:0/4188805860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274b11b0 msgr2=0x55af2785aa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.358+0000 7fdb53c06740 1 --2- 172.21.15.69:0/4188805860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274b11b0 0x55af2785aa90 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400b730 tx=0x7fdb3400bbf0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.359 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.358+0000 7fdb53c06740 1 -- 172.21.15.69:0/4188805860 shutdown_connections 2024-05-14T15:28:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.358+0000 7fdb53c06740 1 --2- 172.21.15.69:0/4188805860 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274904d0 0x55af2785b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.358+0000 7fdb53c06740 1 --2- 172.21.15.69:0/4188805860 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274882f0 0x55af2785afd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.358+0000 7fdb53c06740 1 --2- 172.21.15.69:0/4188805860 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274b11b0 0x55af2785aa90 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.358+0000 7fdb53c06740 1 -- 172.21.15.69:0/4188805860 >> 172.21.15.69:0/4188805860 conn(0x55af274a5300 msgr2=0x55af27857240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.358+0000 7fdb53c06740 1 -- 172.21.15.69:0/4188805860 shutdown_connections 2024-05-14T15:28:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.358+0000 7fdb53c06740 1 -- 172.21.15.69:0/4188805860 wait complete. 2024-05-14T15:28:14.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.359+0000 7fdb53c06740 1 -- start start 2024-05-14T15:28:14.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.360+0000 7fdb53c06740 1 Processor -- start 2024-05-14T15:28:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.361+0000 7fdb53c06740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274882f0 0x55af27865020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.361+0000 7fdb53c06740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274904d0 0x55af27865560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.361+0000 7fdb53c06740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274b11b0 0x55af27871070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.361+0000 7fdb53c06740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55af27867bc0 con 0x55af274b11b0 2024-05-14T15:28:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.361+0000 7fdb53c06740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55af27770660 con 0x55af274882f0 2024-05-14T15:28:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.361+0000 7fdb53c06740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55af27867d40 con 0x55af274904d0 2024-05-14T15:28:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.361+0000 7fdb53c06740 10 client.0 _ll_register_callbacks cb 0x55af2773a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.362+0000 7fdb45400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274882f0 0x55af27865020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.362+0000 7fdb45400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274882f0 0x55af27865020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:56068/0 (socket says 172.21.15.69:56068) 2024-05-14T15:28:14.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.362+0000 7fdb45400640 1 -- 172.21.15.69:0/265565160 learned_addr learned my addr 172.21.15.69:0/265565160 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.362+0000 7fdb45400640 1 --2- 172.21.15.69:0/265565160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274b11b0 0x55af27871070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.362+0000 7fdb45e00640 1 --2- 172.21.15.69:0/265565160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274904d0 0x55af27865560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.363+0000 7fdb45400640 1 -- 172.21.15.69:0/265565160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274904d0 msgr2=0x55af27865560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.364+0000 7fdb45400640 1 --2- 172.21.15.69:0/265565160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274904d0 0x55af27865560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.364+0000 7fdb45400640 1 -- 172.21.15.69:0/265565160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274882f0 msgr2=0x55af27865020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.364+0000 7fdb45400640 1 --2- 172.21.15.69:0/265565160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274882f0 0x55af27865020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.364+0000 7fdb45400640 1 -- 172.21.15.69:0/265565160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af27595620 con 0x55af274b11b0 2024-05-14T15:28:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.364+0000 7fdb45e00640 1 --2- 172.21.15.69:0/265565160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274904d0 0x55af27865560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:28:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.365+0000 7fdb45400640 1 --2- 172.21.15.69:0/265565160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274b11b0 0x55af27871070 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400b540 tx=0x7fdb34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9cc60dcaac8220 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:14.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.365+0000 7fdb27400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:28:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.365+0000 7fdb27400640 1 -- 172.21.15.69:0/265565160 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb34013c60 con 0x55af274b11b0 2024-05-14T15:28:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.365+0000 7fdb27400640 1 -- 172.21.15.69:0/265565160 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9642+0+0 (secure 0 0 0) 0x7fdb34013e00 con 0x55af274b11b0 2024-05-14T15:28:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.366+0000 7fdb53c06740 1 -- 172.21.15.69:0/265565160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb34018070 con 0x55af274b11b0 2024-05-14T15:28:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.366+0000 7fdb27400640 1 -- 172.21.15.69:0/265565160 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fdb340059c0 con 0x55af274b11b0 2024-05-14T15:28:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.366+0000 7fdb53c06740 10 client.16641 fetch_fsmap learned FSMap version 52 2024-05-14T15:28:14.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.366+0000 7fdb53c06740 1 -- 172.21.15.69:0/265565160 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55af27873eb0 con 0x55af274b11b0 2024-05-14T15:28:14.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.367+0000 7fdb27400640 1 -- 172.21.15.69:0/265565160 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb34018070 con 0x55af274b11b0 2024-05-14T15:28:14.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.367+0000 7fdb27400640 1 -- 172.21.15.69:0/265565160 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 52) ==== 8414+0+0 (secure 0 0 0) 0x7fdb3401c420 con 0x55af274b11b0 2024-05-14T15:28:14.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.367+0000 7fdb53c06740 10 client.16641 fetch_fsmap finished waiting for FSMap version 52 2024-05-14T15:28:14.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.367+0000 7fdb53c06740 10 client.16641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:14.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.367+0000 7fdb53c06740 20 client.16641 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:14.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.367+0000 7fdb53c06740 1 --2- 172.21.15.69:0/265565160 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55af2746fd80 0x55af27877320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.367+0000 7fdb53c06740 4 client.16641 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:28:14.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.367+0000 7fdb53c06740 1 -- 172.21.15.69:0/265565160 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55af277c5160 con 0x55af2746fd80 2024-05-14T15:28:14.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.368+0000 7fdb45e00640 1 --2- 172.21.15.69:0/265565160 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55af2746fd80 0x55af27877320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.369+0000 7fdb45e00640 1 --2- 172.21.15.69:0/265565160 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55af2746fd80 0x55af27877320 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe309c50da0e7949 server_cookie=35b8e79625f56dc3 in_seq=0 out_seq=0 2024-05-14T15:28:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.369+0000 7fdb27400640 10 client.16641 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.370+0000 7fdb27400640 1 -- 172.21.15.69:0/265565160 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55af277c5160 con 0x55af2746fd80 2024-05-14T15:28:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.370+0000 7fdb27400640 10 client.16641 handle_command_reply: tid=0 2024-05-14T15:28:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.370+0000 7fdb53c06740 1 client.16641 shutdown 2024-05-14T15:28:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.370+0000 7fdb53c06740 1 -- 172.21.15.69:0/265565160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274b11b0 msgr2=0x55af27871070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.371 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.370+0000 7fdb53c06740 1 --2- 172.21.15.69:0/265565160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274b11b0 0x55af27871070 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fdb3400b540 tx=0x7fdb34008040 comp rx=0 tx=0).stop 2024-05-14T15:28:14.372 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:14 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.371+0000 7fdb53c06740 1 -- 172.21.15.69:0/265565160 shutdown_connections 2024-05-14T15:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.371+0000 7fdb53c06740 1 --2- 172.21.15.69:0/265565160 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55af2746fd80 0x55af27877320 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.371+0000 7fdb53c06740 1 --2- 172.21.15.69:0/265565160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274b11b0 0x55af27871070 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.371+0000 7fdb53c06740 1 --2- 172.21.15.69:0/265565160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274904d0 0x55af27865560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.371+0000 7fdb53c06740 1 --2- 172.21.15.69:0/265565160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274882f0 0x55af27865020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.371+0000 7fdb53c06740 1 -- 172.21.15.69:0/265565160 >> 172.21.15.69:0/265565160 conn(0x55af274a5300 msgr2=0x55af2785a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.371+0000 7fdb27400640 0 client.16641 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.371+0000 7fdb53c06740 1 -- 172.21.15.69:0/265565160 shutdown_connections 2024-05-14T15:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.371+0000 7fdb53c06740 1 -- 172.21.15.69:0/265565160 wait complete. 2024-05-14T15:28:14.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.372+0000 7fdb53c06740 20 client.16641 trim_cache size 0 max 16384 2024-05-14T15:28:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.403+0000 7fdb53c06740 1 Processor -- start 2024-05-14T15:28:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.404+0000 7fdb53c06740 1 -- start start 2024-05-14T15:28:14.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.404+0000 7fdb53c06740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274882f0 0x55af2785f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.404+0000 7fdb53c06740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274904d0 0x55af278646f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.405+0000 7fdb53c06740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274b11b0 0x55af27866f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.405+0000 7fdb53c06740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fdb481b7ba0 con 0x55af274882f0 2024-05-14T15:28:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.405+0000 7fdb53c06740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdb481b98f0 con 0x55af274904d0 2024-05-14T15:28:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.405+0000 7fdb53c06740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdb481b8300 con 0x55af274b11b0 2024-05-14T15:28:14.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.405+0000 7fdb45e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274904d0 0x55af278646f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.405+0000 7fdb45e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274904d0 0x55af278646f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:56082/0 (socket says 172.21.15.69:56082) 2024-05-14T15:28:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.405+0000 7fdb45e00640 1 -- 172.21.15.69:0/4256923589 learned_addr learned my addr 172.21.15.69:0/4256923589 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.405+0000 7fdb45400640 1 --2- 172.21.15.69:0/4256923589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274882f0 0x55af2785f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.406+0000 7fdb45e00640 1 -- 172.21.15.69:0/4256923589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274b11b0 msgr2=0x55af27866f60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:28:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.406+0000 7fdb45e00640 1 --2- 172.21.15.69:0/4256923589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274b11b0 0x55af27866f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.406+0000 7fdb45e00640 1 -- 172.21.15.69:0/4256923589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274882f0 msgr2=0x55af2785f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.406+0000 7fdb45e00640 1 --2- 172.21.15.69:0/4256923589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274882f0 0x55af2785f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.406+0000 7fdb45e00640 1 -- 172.21.15.69:0/4256923589 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55af2785be70 con 0x55af274904d0 2024-05-14T15:28:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.406+0000 7fdb45400640 1 --2- 172.21.15.69:0/4256923589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274882f0 0x55af2785f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:28:14.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.407+0000 7fdb45e00640 1 --2- 172.21.15.69:0/4256923589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274904d0 0x55af278646f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800ba10 tx=0x7fdb3800b3a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12cb0b85d5973baa server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.408+0000 7fdb32600640 1 -- 172.21.15.69:0/4256923589 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb3801e020 con 0x55af274904d0 2024-05-14T15:28:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.408+0000 7fdb32600640 1 -- 172.21.15.69:0/4256923589 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb38003d00 con 0x55af274904d0 2024-05-14T15:28:14.409 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.408+0000 7fdb32600640 1 -- 172.21.15.69:0/4256923589 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb380117c0 con 0x55af274904d0 2024-05-14T15:28:14.410 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.409+0000 7fdb53c06740 1 -- 172.21.15.69:0/4256923589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274904d0 msgr2=0x55af278646f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.409+0000 7fdb53c06740 1 --2- 172.21.15.69:0/4256923589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274904d0 0x55af278646f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdb3800ba10 tx=0x7fdb3800b3a0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.410+0000 7fdb53c06740 1 -- 172.21.15.69:0/4256923589 shutdown_connections 2024-05-14T15:28:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.410+0000 7fdb53c06740 1 --2- 172.21.15.69:0/4256923589 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274b11b0 0x55af27866f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.410+0000 7fdb53c06740 1 --2- 172.21.15.69:0/4256923589 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274904d0 0x55af278646f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.410+0000 7fdb53c06740 1 --2- 172.21.15.69:0/4256923589 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274882f0 0x55af2785f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.411 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.410+0000 7fdb53c06740 1 -- 172.21.15.69:0/4256923589 >> 172.21.15.69:0/4256923589 conn(0x55af274a5300 msgr2=0x55af2784dad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.410+0000 7fdb53c06740 1 -- 172.21.15.69:0/4256923589 shutdown_connections 2024-05-14T15:28:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.410+0000 7fdb53c06740 1 -- 172.21.15.69:0/4256923589 wait complete. 2024-05-14T15:28:14.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.411+0000 7fdb53c06740 1 -- start start 2024-05-14T15:28:14.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.412+0000 7fdb53c06740 1 Processor -- start 2024-05-14T15:28:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.413+0000 7fdb53c06740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274882f0 0x55af27867f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.413+0000 7fdb53c06740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274904d0 0x55af278684d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.413+0000 7fdb53c06740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274b11b0 0x55af27868a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.413+0000 7fdb53c06740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fdb481b9160 con 0x55af274904d0 2024-05-14T15:28:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.413+0000 7fdb53c06740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fdb481b89d0 con 0x55af274882f0 2024-05-14T15:28:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.413+0000 7fdb53c06740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fdb481b5be0 con 0x55af274b11b0 2024-05-14T15:28:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.413+0000 7fdb53c06740 10 client.0 _ll_register_callbacks cb 0x7fdb34013480 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.414+0000 7fdb45400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274882f0 0x55af27867f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.414+0000 7fdb45e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274904d0 0x55af278684d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.414+0000 7fdb45e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274904d0 0x55af278684d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34028/0 (socket says 172.21.15.69:34028) 2024-05-14T15:28:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.414+0000 7fdb45400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274882f0 0x55af27867f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:56092/0 (socket says 172.21.15.69:56092) 2024-05-14T15:28:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.414+0000 7fdb45400640 1 -- 172.21.15.69:0/1692055536 learned_addr learned my addr 172.21.15.69:0/1692055536 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.414+0000 7fdb45400640 1 -- 172.21.15.69:0/1692055536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274b11b0 msgr2=0x55af27868a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.414+0000 7fdb45400640 1 --2- 172.21.15.69:0/1692055536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274b11b0 0x55af27868a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.414+0000 7fdb45400640 1 -- 172.21.15.69:0/1692055536 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274904d0 msgr2=0x55af278684d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:14.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.414+0000 7fdb45400640 1 --2- 172.21.15.69:0/1692055536 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274904d0 0x55af278684d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.414+0000 7fdb45400640 1 -- 172.21.15.69:0/1692055536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55af278dd490 con 0x55af274882f0 2024-05-14T15:28:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.415+0000 7fdb45400640 1 --2- 172.21.15.69:0/1692055536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274882f0 0x55af27867f90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdb3401c820 tx=0x7fdb3401ca10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8505214c1387d7f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.415+0000 7fdb27400640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:28:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.415+0000 7fdb27400640 1 -- 172.21.15.69:0/1692055536 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb34038060 con 0x55af274882f0 2024-05-14T15:28:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.416+0000 7fdb53c06740 1 -- 172.21.15.69:0/1692055536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdb38003d00 con 0x55af274882f0 2024-05-14T15:28:14.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.416+0000 7fdb27400640 1 -- 172.21.15.69:0/1692055536 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9642+0+0 (secure 0 0 0) 0x7fdb3400be40 con 0x55af274882f0 2024-05-14T15:28:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.417+0000 7fdb27400640 1 -- 172.21.15.69:0/1692055536 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fdb3403f050 con 0x55af274882f0 2024-05-14T15:28:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.417+0000 7fdb53c06740 10 client.36140 fetch_fsmap learned FSMap version 52 2024-05-14T15:28:14.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.417+0000 7fdb53c06740 1 -- 172.21.15.69:0/1692055536 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55af278de680 con 0x55af274882f0 2024-05-14T15:28:14.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.417+0000 7fdb27400640 1 -- 172.21.15.69:0/1692055536 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fdb38003d00 con 0x55af274882f0 2024-05-14T15:28:14.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.418+0000 7fdb27400640 1 -- 172.21.15.69:0/1692055536 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 52) ==== 8414+0+0 (secure 0 0 0) 0x7fdb34033900 con 0x55af274882f0 2024-05-14T15:28:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.418+0000 7fdb53c06740 10 client.36140 fetch_fsmap finished waiting for FSMap version 52 2024-05-14T15:28:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.418+0000 7fdb53c06740 10 client.36140 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.418+0000 7fdb53c06740 20 client.36140 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.418+0000 7fdb53c06740 1 --2- 172.21.15.69:0/1692055536 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55af274451c0 0x55af278e0e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.419+0000 7fdb53c06740 4 client.36140 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:28:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.419+0000 7fdb53c06740 1 -- 172.21.15.69:0/1692055536 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55af277befd0 con 0x55af274451c0 2024-05-14T15:28:14.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.419+0000 7fdb45e00640 1 --2- 172.21.15.69:0/1692055536 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55af274451c0 0x55af278e0e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.420+0000 7fdb27400640 10 client.36140 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:14.421 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.420+0000 7fdb45e00640 1 --2- 172.21.15.69:0/1692055536 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55af274451c0 0x55af278e0e70 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93efb666eda3d210 server_cookie=1ade879623b59238 in_seq=0 out_seq=0 2024-05-14T15:28:14.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.451+0000 7fdb27400640 1 -- 172.21.15.69:0/1692055536 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55af277befd0 con 0x55af274451c0 2024-05-14T15:28:14.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.451+0000 7fdb27400640 10 client.36140 handle_command_reply: tid=0 2024-05-14T15:28:14.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.452+0000 7fdb53c06740 1 client.36140 shutdown 2024-05-14T15:28:14.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.452+0000 7fdb53c06740 1 -- 172.21.15.69:0/1692055536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274882f0 msgr2=0x55af27867f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.452+0000 7fdb53c06740 1 --2- 172.21.15.69:0/1692055536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274882f0 0x55af27867f90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdb3401c820 tx=0x7fdb3401ca10 comp rx=0 tx=0).stop 2024-05-14T15:28:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.452+0000 7fdb53c06740 1 -- 172.21.15.69:0/1692055536 shutdown_connections 2024-05-14T15:28:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.452+0000 7fdb53c06740 1 --2- 172.21.15.69:0/1692055536 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55af274b11b0 0x55af27868a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.453+0000 7fdb53c06740 1 --2- 172.21.15.69:0/1692055536 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55af274451c0 0x55af278e0e70 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.453+0000 7fdb53c06740 1 --2- 172.21.15.69:0/1692055536 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55af274904d0 0x55af278684d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.453+0000 7fdb53c06740 1 --2- 172.21.15.69:0/1692055536 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55af274882f0 0x55af27867f90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.453+0000 7fdb53c06740 1 -- 172.21.15.69:0/1692055536 >> 172.21.15.69:0/1692055536 conn(0x55af274a5300 msgr2=0x55af27866ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:14.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.453+0000 7fdb27400640 0 client.36140 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:14.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.453+0000 7fdb53c06740 1 -- 172.21.15.69:0/1692055536 shutdown_connections 2024-05-14T15:28:14.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.453+0000 7fdb53c06740 1 -- 172.21.15.69:0/1692055536 wait complete. 2024-05-14T15:28:14.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.453+0000 7fdb53c06740 20 client.36140 trim_cache size 0 max 16384 2024-05-14T15:28:14.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:28:14.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:28:14.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:28:14.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:28:14.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.456+0000 7fdb4cc00640 1 -- 172.21.15.69:0/4256350964 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdb2c0b2a20 msgr2=0x7fdb2c0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.456+0000 7fdb4cc00640 1 --2- 172.21.15.69:0/4256350964 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdb2c0b2a20 0x7fdb2c0b4f30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fdb40101430 tx=0x7fdb40003f30 comp rx=0 tx=0).stop 2024-05-14T15:28:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.456+0000 7fdb4cc00640 1 -- 172.21.15.69:0/4256350964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb4810c370 msgr2=0x7fdb4806e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.456+0000 7fdb4cc00640 1 --2- 172.21.15.69:0/4256350964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb4810c370 0x7fdb4806e1a0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdb400098d0 tx=0x7fdb40032bd0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.456+0000 7fdb4cc00640 1 -- 172.21.15.69:0/4256350964 shutdown_connections 2024-05-14T15:28:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.456+0000 7fdb4cc00640 1 --2- 172.21.15.69:0/4256350964 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fdb2c0b2a20 0x7fdb2c0b4f30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.456+0000 7fdb4cc00640 1 --2- 172.21.15.69:0/4256350964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fdb4810c370 0x7fdb4806e1a0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.456+0000 7fdb4cc00640 1 --2- 172.21.15.69:0/4256350964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fdb4810bed0 0x7fdb4806dae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.456+0000 7fdb4cc00640 1 --2- 172.21.15.69:0/4256350964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fdb48106620 0x7fdb480749a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.456+0000 7fdb4cc00640 1 -- 172.21.15.69:0/4256350964 >> 172.21.15.69:0/4256350964 conn(0x7fdb481016c0 msgr2=0x7fdb48103f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.457+0000 7fdb4cc00640 1 -- 172.21.15.69:0/4256350964 shutdown_connections 2024-05-14T15:28:14.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:14.457+0000 7fdb4cc00640 1 -- 172.21.15.69:0/4256350964 wait complete. 2024-05-14T15:28:14.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.601+0000 7f3009e00700 1 -- 172.21.15.69:0/937083983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3004076450 msgr2=0x7f30041106c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.601+0000 7f3009e00700 1 --2- 172.21.15.69:0/937083983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3004076450 0x7f30041106c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009990 tx=0x7f2ff0009ca0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.601+0000 7f3009e00700 1 -- 172.21.15.69:0/937083983 shutdown_connections 2024-05-14T15:28:14.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.601+0000 7f3009e00700 1 --2- 172.21.15.69:0/937083983 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3004110c00 0x7f3004113020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.602+0000 7f3009e00700 1 --2- 172.21.15.69:0/937083983 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3004075b00 0x7f3004075f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.605 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.602+0000 7f3009e00700 1 --2- 172.21.15.69:0/937083983 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3004076450 0x7f30041106c0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.602+0000 7f3009e00700 1 -- 172.21.15.69:0/937083983 >> 172.21.15.69:0/937083983 conn(0x7f3004100040 msgr2=0x7f3004102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:14.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.602+0000 7f3009e00700 1 -- 172.21.15.69:0/937083983 shutdown_connections 2024-05-14T15:28:14.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.602+0000 7f3009e00700 1 -- 172.21.15.69:0/937083983 wait complete. 2024-05-14T15:28:14.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.603+0000 7f3009e00700 1 Processor -- start 2024-05-14T15:28:14.606 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.604+0000 7f3009e00700 1 -- start start 2024-05-14T15:28:14.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.604+0000 7f3009e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3004075b00 0x7f300419cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.604+0000 7f3009e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3004076450 0x7f300419d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.604+0000 7f3009e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3004110c00 0x7f30041a17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.604+0000 7f3009e00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f30041165c0 con 0x7f3004075b00 2024-05-14T15:28:14.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.604+0000 7f3009e00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3004116440 con 0x7f3004110c00 2024-05-14T15:28:14.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.604+0000 7f3009e00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3004116740 con 0x7f3004076450 2024-05-14T15:28:14.607 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.605+0000 7f3003400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3004110c00 0x7f30041a17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.605+0000 7f3003400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3004110c00 0x7f30041a17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:56112/0 (socket says 172.21.15.69:56112) 2024-05-14T15:28:14.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.605+0000 7f3003400700 1 -- 172.21.15.69:0/2257428395 learned_addr learned my addr 172.21.15.69:0/2257428395 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:14.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.605+0000 7f3002a00700 1 --2- 172.21.15.69:0/2257428395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3004075b00 0x7f300419cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.605+0000 7f3002000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3004076450 0x7f300419d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.606+0000 7f3002000700 1 -- 172.21.15.69:0/2257428395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3004110c00 msgr2=0x7f30041a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.606+0000 7f3002000700 1 --2- 172.21.15.69:0/2257428395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3004110c00 0x7f30041a17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.606+0000 7f3002000700 1 -- 172.21.15.69:0/2257428395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3004075b00 msgr2=0x7f300419cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.606+0000 7f3002000700 1 --2- 172.21.15.69:0/2257428395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3004075b00 0x7f300419cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.608 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.606+0000 7f3002000700 1 -- 172.21.15.69:0/2257428395 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30041a1e80 con 0x7f3004076450 2024-05-14T15:28:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.606+0000 7f3002a00700 1 --2- 172.21.15.69:0/2257428395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3004075b00 0x7f300419cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:28:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.606+0000 7f3003400700 1 --2- 172.21.15.69:0/2257428395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3004110c00 0x7f30041a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:28:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.607+0000 7f3002000700 1 --2- 172.21.15.69:0/2257428395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3004076450 0x7f300419d550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00098e0 tx=0x7f2ff00047b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.607+0000 7f3008a00700 1 -- 172.21.15.69:0/2257428395 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0026070 con 0x7f3004076450 2024-05-14T15:28:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.607+0000 7f3008a00700 1 -- 172.21.15.69:0/2257428395 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ff0021410 con 0x7f3004076450 2024-05-14T15:28:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.607+0000 7f3008a00700 1 -- 172.21.15.69:0/2257428395 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0017650 con 0x7f3004076450 2024-05-14T15:28:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.607+0000 7f3009e00700 1 -- 172.21.15.69:0/2257428395 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30041a2110 con 0x7f3004076450 2024-05-14T15:28:14.609 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.608+0000 7f3009e00700 1 -- 172.21.15.69:0/2257428395 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30041a25a0 con 0x7f3004076450 2024-05-14T15:28:14.615 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.613+0000 7f3008a00700 1 -- 172.21.15.69:0/2257428395 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2ff0029070 con 0x7f3004076450 2024-05-14T15:28:14.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.614+0000 7f30189d2b80 1 Processor -- start 2024-05-14T15:28:14.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.614+0000 7f30189d2b80 1 -- start start 2024-05-14T15:28:14.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.615+0000 7f30189d2b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e89b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.615+0000 7f30189d2b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4e83cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.615+0000 7f30189d2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e84610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.616 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.615+0000 7f30189d2b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55d0a4d9da20 con 0x55d0a4cfde40 2024-05-14T15:28:14.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.615+0000 7f30189d2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d0a4d3b760 con 0x55d0a4e84200 2024-05-14T15:28:14.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.615+0000 7f30189d2b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d0a4d999e0 con 0x55d0a4e8a040 2024-05-14T15:28:14.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.616+0000 7f3003400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e89b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.616+0000 7f3008a00700 1 --2- 172.21.15.69:0/2257428395 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2fe80b2af0 0x7f2fe80b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.616+0000 7f3002a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4e83cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.616+0000 7f3002a00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4e83cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:50270/0 (socket says 172.21.15.69:50270) 2024-05-14T15:28:14.617 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.616+0000 7f3002a00700 1 -- 172.21.15.69:0/3575924126 learned_addr learned my addr 172.21.15.69:0/3575924126 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:14.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.616+0000 7f3008a00700 1 -- 172.21.15.69:0/2257428395 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 9642+0+0 (secure 0 0 0) 0x7f2ff00e3900 con 0x7f3004076450 2024-05-14T15:28:14.618 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.617+0000 7f3002000700 1 --2- 172.21.15.69:0/3575924126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e84610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.617+0000 7f3003400700 1 -- 172.21.15.69:0/3575924126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 msgr2=0x55d0a4e83cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:14.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.617+0000 7f3003400700 1 --2- 172.21.15.69:0/3575924126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4e83cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.617+0000 7f3003400700 1 -- 172.21.15.69:0/3575924126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 msgr2=0x55d0a4e84610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:14.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.617+0000 7f3003400700 1 --2- 172.21.15.69:0/3575924126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e84610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.617+0000 7f3003400700 1 -- 172.21.15.69:0/3575924126 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0a4cea8d0 con 0x55d0a4cfde40 2024-05-14T15:28:14.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.618+0000 7f3003400700 1 --2- 172.21.15.69:0/2257428395 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2fe80b2af0 0x7f2fe80b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.619 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.618+0000 7f3002a00700 1 --2- 172.21.15.69:0/3575924126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4e83cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:28:14.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.618+0000 7f3002000700 1 --2- 172.21.15.69:0/3575924126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e84610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:28:14.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.618+0000 7f3003400700 1 --2- 172.21.15.69:0/3575924126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e89b00 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc004a10 tx=0x7f2ffc0077e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5af526033d522b69 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:14.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.619+0000 7f3003400700 1 --2- 172.21.15.69:0/2257428395 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2fe80b2af0 0x7f2fe80b5000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc022000 tx=0x7f2ffc01b000 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:14.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.619+0000 7f2ff8c00700 1 -- 172.21.15.69:0/3575924126 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc017820 con 0x55d0a4cfde40 2024-05-14T15:28:14.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.619+0000 7f2ff8c00700 1 -- 172.21.15.69:0/3575924126 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ffc017e50 con 0x55d0a4cfde40 2024-05-14T15:28:14.622 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.619+0000 7f2ff8c00700 1 -- 172.21.15.69:0/3575924126 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc022d10 con 0x55d0a4cfde40 2024-05-14T15:28:14.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.620+0000 7f30189d2b80 1 -- 172.21.15.69:0/3575924126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 msgr2=0x55d0a4e89b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.620+0000 7f30189d2b80 1 --2- 172.21.15.69:0/3575924126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e89b00 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc004a10 tx=0x7f2ffc0077e0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.621+0000 7f30189d2b80 1 -- 172.21.15.69:0/3575924126 shutdown_connections 2024-05-14T15:28:14.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.621+0000 7f30189d2b80 1 --2- 172.21.15.69:0/3575924126 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e89b00 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.621+0000 7f30189d2b80 1 --2- 172.21.15.69:0/3575924126 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e84610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.621+0000 7f30189d2b80 1 --2- 172.21.15.69:0/3575924126 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4e83cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.621+0000 7f30189d2b80 1 -- 172.21.15.69:0/3575924126 >> 172.21.15.69:0/3575924126 conn(0x55d0a4d42f70 msgr2=0x55d0a4e762d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:14.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.621+0000 7f30189d2b80 1 -- 172.21.15.69:0/3575924126 shutdown_connections 2024-05-14T15:28:14.623 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.621+0000 7f30189d2b80 1 -- 172.21.15.69:0/3575924126 wait complete. 2024-05-14T15:28:14.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.622+0000 7f30189d2b80 1 -- start start 2024-05-14T15:28:14.624 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.622+0000 7f30189d2b80 1 Processor -- start 2024-05-14T15:28:14.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.623+0000 7f30189d2b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e8d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.623+0000 7f30189d2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e8dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.623+0000 7f30189d2b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4e8e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.623+0000 7f30189d2b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55d0a4e90b20 con 0x55d0a4cfde40 2024-05-14T15:28:14.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.623+0000 7f30189d2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d0a4d03b20 con 0x55d0a4e84200 2024-05-14T15:28:14.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.623+0000 7f30189d2b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d0a4e90ca0 con 0x55d0a4e8a040 2024-05-14T15:28:14.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.623+0000 7f30189d2b80 10 client.0 _ll_register_callbacks cb 0x55d0a4d44c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:14.625 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.624+0000 7f3002000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e8dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.624+0000 7f3003400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4e8e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.624+0000 7f3002000700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e8dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:56142/0 (socket says 172.21.15.69:56142) 2024-05-14T15:28:14.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.624+0000 7f3002000700 1 -- 172.21.15.69:0/2371695187 learned_addr learned my addr 172.21.15.69:0/2371695187 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:14.626 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.624+0000 7f3002a00700 1 --2- 172.21.15.69:0/2371695187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e8d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.625+0000 7f3002000700 1 -- 172.21.15.69:0/2371695187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 msgr2=0x55d0a4e8e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:14.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.625+0000 7f3002000700 1 --2- 172.21.15.69:0/2371695187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4e8e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.625+0000 7f3002000700 1 -- 172.21.15.69:0/2371695187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 msgr2=0x55d0a4e8d820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:14.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.625+0000 7f3002000700 1 --2- 172.21.15.69:0/2371695187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e8d820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.625+0000 7f3002000700 1 -- 172.21.15.69:0/2371695187 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0a4d63420 con 0x55d0a4e84200 2024-05-14T15:28:14.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.625+0000 7f3002a00700 1 --2- 172.21.15.69:0/2371695187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e8d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:28:14.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.626+0000 7f3002000700 1 --2- 172.21.15.69:0/2371695187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e8dd60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000b650 tx=0x7f2ff00095d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3b3e69c41062862 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:14.627 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.626+0000 7f2fed600700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:28:14.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.626+0000 7f2fed600700 1 -- 172.21.15.69:0/2371695187 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff00aa7b0 con 0x55d0a4e84200 2024-05-14T15:28:14.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.626+0000 7f2fed600700 1 -- 172.21.15.69:0/2371695187 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 9642+0+0 (secure 0 0 0) 0x7f2ff00e0e10 con 0x55d0a4e84200 2024-05-14T15:28:14.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.626+0000 7f30189d2b80 1 -- 172.21.15.69:0/2371695187 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ffc017e50 con 0x55d0a4e84200 2024-05-14T15:28:14.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.627+0000 7f2fed600700 1 -- 172.21.15.69:0/2371695187 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f2ff00e1010 con 0x55d0a4e84200 2024-05-14T15:28:14.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.627+0000 7f30189d2b80 10 client.36149 fetch_fsmap learned FSMap version 52 2024-05-14T15:28:14.628 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.627+0000 7f30189d2b80 1 -- 172.21.15.69:0/2371695187 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55d0a4eac630 con 0x55d0a4e84200 2024-05-14T15:28:14.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.627+0000 7f2fed600700 1 -- 172.21.15.69:0/2371695187 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ff00c9030 con 0x55d0a4e84200 2024-05-14T15:28:14.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.628+0000 7f2fed600700 1 -- 172.21.15.69:0/2371695187 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 52) ==== 8414+0+0 (secure 0 0 0) 0x7f2ff00aaa10 con 0x55d0a4e84200 2024-05-14T15:28:14.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.628+0000 7f30189d2b80 10 client.36149 fetch_fsmap finished waiting for FSMap version 52 2024-05-14T15:28:14.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.628+0000 7f30189d2b80 10 client.36149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:14.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.628+0000 7f30189d2b80 20 client.36149 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:14.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.628+0000 7f30189d2b80 1 --2- 172.21.15.69:0/2371695187 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d0a4eaec60 0x55d0a4eb10b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.629 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.628+0000 7f30189d2b80 4 client.36149 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:28:14.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.628+0000 7f30189d2b80 1 -- 172.21.15.69:0/2371695187 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0a4e481c0 con 0x55d0a4eaec60 2024-05-14T15:28:14.630 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.629+0000 7f3002a00700 1 --2- 172.21.15.69:0/2371695187 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d0a4eaec60 0x55d0a4eb10b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.630+0000 7f3002a00700 1 --2- 172.21.15.69:0/2371695187 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d0a4eaec60 0x55d0a4eb10b0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=889b3f86ee64c9b1 server_cookie=2af8d71dc202f667 in_seq=0 out_seq=0 2024-05-14T15:28:14.631 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.630+0000 7f2fed600700 10 client.36149 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:14.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.632+0000 7f2fed600700 1 -- 172.21.15.69:0/2371695187 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d0a4e481c0 con 0x55d0a4eaec60 2024-05-14T15:28:14.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.632+0000 7f2fed600700 10 client.36149 handle_command_reply: tid=0 2024-05-14T15:28:14.633 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.632+0000 7f30189d2b80 1 client.36149 shutdown 2024-05-14T15:28:14.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.632+0000 7f30189d2b80 1 -- 172.21.15.69:0/2371695187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 msgr2=0x55d0a4e8dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.632+0000 7f30189d2b80 1 --2- 172.21.15.69:0/2371695187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e8dd60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f2ff000b650 tx=0x7f2ff00095d0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.632+0000 7f30189d2b80 1 -- 172.21.15.69:0/2371695187 shutdown_connections 2024-05-14T15:28:14.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.632+0000 7f30189d2b80 1 --2- 172.21.15.69:0/2371695187 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d0a4eaec60 0x55d0a4eb10b0 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.633+0000 7f2fed600700 0 client.36149 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:14.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.633+0000 7f30189d2b80 1 --2- 172.21.15.69:0/2371695187 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e8d820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.633+0000 7f30189d2b80 1 --2- 172.21.15.69:0/2371695187 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4e8e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.633+0000 7f30189d2b80 1 --2- 172.21.15.69:0/2371695187 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e8dd60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.634 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.633+0000 7f30189d2b80 1 -- 172.21.15.69:0/2371695187 >> 172.21.15.69:0/2371695187 conn(0x55d0a4d42f70 msgr2=0x55d0a4e82cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:14.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.633+0000 7f30189d2b80 1 -- 172.21.15.69:0/2371695187 shutdown_connections 2024-05-14T15:28:14.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.633+0000 7f30189d2b80 1 -- 172.21.15.69:0/2371695187 wait complete. 2024-05-14T15:28:14.635 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.634+0000 7f30189d2b80 20 client.36149 trim_cache size 0 max 16384 2024-05-14T15:28:14.671 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.670+0000 7f30189d2b80 1 Processor -- start 2024-05-14T15:28:14.672 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.670+0000 7f30189d2b80 1 -- start start 2024-05-14T15:28:14.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.671+0000 7f30189d2b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e83cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.671+0000 7f30189d2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e70ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.671+0000 7f30189d2b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4eb6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.671+0000 7f30189d2b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3004071cf0 con 0x55d0a4cfde40 2024-05-14T15:28:14.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.671+0000 7f30189d2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3004073a40 con 0x55d0a4e84200 2024-05-14T15:28:14.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.671+0000 7f30189d2b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3004072450 con 0x55d0a4e8a040 2024-05-14T15:28:14.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.671+0000 7f3002a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e83cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.673 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.671+0000 7f3002a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e83cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34066/0 (socket says 172.21.15.69:34066) 2024-05-14T15:28:14.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.671+0000 7f3002a00700 1 -- 172.21.15.69:0/2884221026 learned_addr learned my addr 172.21.15.69:0/2884221026 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:14.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.671+0000 7f3003400700 1 --2- 172.21.15.69:0/2884221026 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4eb6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.672+0000 7f3002000700 1 --2- 172.21.15.69:0/2884221026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e70ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.672+0000 7f3002a00700 1 -- 172.21.15.69:0/2884221026 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 msgr2=0x55d0a4eb6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:14.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.672+0000 7f3002a00700 1 --2- 172.21.15.69:0/2884221026 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4eb6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.672+0000 7f3002a00700 1 -- 172.21.15.69:0/2884221026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 msgr2=0x55d0a4e70ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:14.674 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.672+0000 7f3002a00700 1 --2- 172.21.15.69:0/2884221026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e70ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.672+0000 7f3002a00700 1 -- 172.21.15.69:0/2884221026 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0a4e900c0 con 0x55d0a4cfde40 2024-05-14T15:28:14.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.672+0000 7f3003400700 1 --2- 172.21.15.69:0/2884221026 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4eb6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:28:14.675 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.673+0000 7f3002a00700 1 --2- 172.21.15.69:0/2884221026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e83cc0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x55d0a4e77ab0 tx=0x7f2ff4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e8ddbdc0c84db3d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:14.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.673+0000 7f2fefe00700 1 -- 172.21.15.69:0/2884221026 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4004830 con 0x55d0a4cfde40 2024-05-14T15:28:14.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.673+0000 7f2fefe00700 1 -- 172.21.15.69:0/2884221026 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ff4005020 con 0x55d0a4cfde40 2024-05-14T15:28:14.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.673+0000 7f2fefe00700 1 -- 172.21.15.69:0/2884221026 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4004e60 con 0x55d0a4cfde40 2024-05-14T15:28:14.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.675+0000 7f30189d2b80 1 -- 172.21.15.69:0/2884221026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 msgr2=0x55d0a4e83cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.675+0000 7f30189d2b80 1 --2- 172.21.15.69:0/2884221026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e83cc0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x55d0a4e77ab0 tx=0x7f2ff4009260 comp rx=0 tx=0).stop 2024-05-14T15:28:14.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.675+0000 7f30189d2b80 1 -- 172.21.15.69:0/2884221026 shutdown_connections 2024-05-14T15:28:14.676 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.675+0000 7f30189d2b80 1 --2- 172.21.15.69:0/2884221026 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e83cc0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.675+0000 7f30189d2b80 1 --2- 172.21.15.69:0/2884221026 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4eb6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.675+0000 7f30189d2b80 1 --2- 172.21.15.69:0/2884221026 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e70ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.675+0000 7f30189d2b80 1 -- 172.21.15.69:0/2884221026 >> 172.21.15.69:0/2884221026 conn(0x55d0a4d42f70 msgr2=0x55d0a4e87bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:14.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.675+0000 7f30189d2b80 1 -- 172.21.15.69:0/2884221026 shutdown_connections 2024-05-14T15:28:14.677 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.675+0000 7f30189d2b80 1 -- 172.21.15.69:0/2884221026 wait complete. 2024-05-14T15:28:14.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.676+0000 7f30189d2b80 1 -- start start 2024-05-14T15:28:14.678 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.676+0000 7f30189d2b80 1 Processor -- start 2024-05-14T15:28:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.677+0000 7f30189d2b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e93b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.677+0000 7f30189d2b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e94080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.677+0000 7f30189d2b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4e945c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.678+0000 7f30189d2b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f30040732b0 con 0x55d0a4cfde40 2024-05-14T15:28:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.678+0000 7f30189d2b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3004072b20 con 0x55d0a4e84200 2024-05-14T15:28:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.678+0000 7f30189d2b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f300406fcb0 con 0x55d0a4e8a040 2024-05-14T15:28:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.678+0000 7f30189d2b80 10 client.0 _ll_register_callbacks cb 0x55d0a4d44c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:14.680 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.678+0000 7f3002a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e93b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.678+0000 7f3002a00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e93b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34076/0 (socket says 172.21.15.69:34076) 2024-05-14T15:28:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.678+0000 7f3003400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4e945c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.679+0000 7f3003400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4e945c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:50304/0 (socket says 172.21.15.69:50304) 2024-05-14T15:28:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.679+0000 7f3003400700 1 -- 172.21.15.69:0/2788162804 learned_addr learned my addr 172.21.15.69:0/2788162804 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.679+0000 7f3002000700 1 --2- 172.21.15.69:0/2788162804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e94080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.680+0000 7f3003400700 1 -- 172.21.15.69:0/2788162804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 msgr2=0x55d0a4e94080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:14.681 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.680+0000 7f3003400700 1 --2- 172.21.15.69:0/2788162804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e94080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.680+0000 7f3003400700 1 -- 172.21.15.69:0/2788162804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 msgr2=0x55d0a4e93b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:14.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.680+0000 7f3003400700 1 --2- 172.21.15.69:0/2788162804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e93b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.680+0000 7f3003400700 1 -- 172.21.15.69:0/2788162804 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0a4f18410 con 0x55d0a4e8a040 2024-05-14T15:28:14.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.680+0000 7f3002000700 1 --2- 172.21.15.69:0/2788162804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e94080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:28:14.682 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.680+0000 7f3002a00700 1 --2- 172.21.15.69:0/2788162804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e93b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:28:14.683 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.681+0000 7f3003400700 1 --2- 172.21.15.69:0/2788162804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4e945c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00ef60 tx=0x7f2ffc00ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c4fcbe5dc67c3a13 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:14.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.681+0000 7f2fed600700 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:28:14.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.681+0000 7f2fed600700 1 -- 172.21.15.69:0/2788162804 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ffc022b60 con 0x55d0a4e8a040 2024-05-14T15:28:14.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.681+0000 7f2fed600700 1 -- 172.21.15.69:0/2788162804 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7f2ffc022d00 con 0x55d0a4e8a040 2024-05-14T15:28:14.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.681+0000 7f30189d2b80 1 -- 172.21.15.69:0/2788162804 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ff4005020 con 0x55d0a4e8a040 2024-05-14T15:28:14.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.682+0000 7f2fed600700 1 -- 172.21.15.69:0/2788162804 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7f2ffc03d050 con 0x55d0a4e8a040 2024-05-14T15:28:14.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.682+0000 7f30189d2b80 10 client.26131 fetch_fsmap learned FSMap version 52 2024-05-14T15:28:14.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.682+0000 7f30189d2b80 1 -- 172.21.15.69:0/2788162804 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x55d0a4f195c0 con 0x55d0a4e8a040 2024-05-14T15:28:14.684 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.683+0000 7f2fed600700 1 -- 172.21.15.69:0/2788162804 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2ff4005020 con 0x55d0a4e8a040 2024-05-14T15:28:14.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.683+0000 7f2fed600700 1 -- 172.21.15.69:0/2788162804 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 52) ==== 8414+0+0 (secure 0 0 0) 0x7f2ffc02c8e0 con 0x55d0a4e8a040 2024-05-14T15:28:14.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.683+0000 7f30189d2b80 10 client.26131 fetch_fsmap finished waiting for FSMap version 52 2024-05-14T15:28:14.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.683+0000 7f30189d2b80 10 client.26131 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:14.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.683+0000 7f30189d2b80 20 client.26131 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:14.685 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.683+0000 7f30189d2b80 1 --2- 172.21.15.69:0/2788162804 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d0a4f199f0 0x55d0a4f1be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:14.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.684+0000 7f30189d2b80 4 client.26131 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T15:28:14.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.684+0000 7f30189d2b80 1 -- 172.21.15.69:0/2788162804 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d0a4dab400 con 0x55d0a4f199f0 2024-05-14T15:28:14.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.684+0000 7f3002a00700 1 --2- 172.21.15.69:0/2788162804 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d0a4f199f0 0x55d0a4f1be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:14.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.685+0000 7f3002a00700 1 --2- 172.21.15.69:0/2788162804 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d0a4f199f0 0x55d0a4f1be10 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad499c7ec261893 server_cookie=74bca1f8c56afcf7 in_seq=0 out_seq=0 2024-05-14T15:28:14.686 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.685+0000 7f2fed600700 10 client.26131 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:14.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.686+0000 7f2fed600700 1 -- 172.21.15.69:0/2788162804 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d0a4dab400 con 0x55d0a4f199f0 2024-05-14T15:28:14.687 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.686+0000 7f2fed600700 10 client.26131 handle_command_reply: tid=0 2024-05-14T15:28:14.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.686+0000 7f30189d2b80 1 client.26131 shutdown 2024-05-14T15:28:14.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.686+0000 7f30189d2b80 1 -- 172.21.15.69:0/2788162804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 msgr2=0x55d0a4e945c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.688 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.686+0000 7f30189d2b80 1 --2- 172.21.15.69:0/2788162804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4e945c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc00ef60 tx=0x7f2ffc00ef90 comp rx=0 tx=0).stop 2024-05-14T15:28:14.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.687+0000 7f30189d2b80 1 -- 172.21.15.69:0/2788162804 shutdown_connections 2024-05-14T15:28:14.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.687+0000 7f30189d2b80 1 --2- 172.21.15.69:0/2788162804 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d0a4f199f0 0x55d0a4f1be10 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.687+0000 7f30189d2b80 1 --2- 172.21.15.69:0/2788162804 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d0a4cfde40 0x55d0a4e93b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.687+0000 7f30189d2b80 1 --2- 172.21.15.69:0/2788162804 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d0a4e8a040 0x55d0a4e945c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.687+0000 7f2fed600700 0 client.26131 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:14.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.687+0000 7f30189d2b80 1 --2- 172.21.15.69:0/2788162804 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d0a4e84200 0x55d0a4e94080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.687+0000 7f30189d2b80 1 -- 172.21.15.69:0/2788162804 >> 172.21.15.69:0/2788162804 conn(0x55d0a4d42f70 msgr2=0x55d0a4e8a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:14.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.687+0000 7f30189d2b80 1 -- 172.21.15.69:0/2788162804 shutdown_connections 2024-05-14T15:28:14.689 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.687+0000 7f30189d2b80 1 -- 172.21.15.69:0/2788162804 wait complete. 2024-05-14T15:28:14.690 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.687+0000 7f30189d2b80 20 client.26131 trim_cache size 0 max 16384 2024-05-14T15:28:14.690 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:28:14.690 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "IDLE (waiting for more scrubs)", 2024-05-14T15:28:14.690 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": { 2024-05-14T15:28:14.690 INFO:teuthology.orchestra.run.smithi069.stdout: "4f200d60-3ad5-46f1-905b-a53e956c4b96": { 2024-05-14T15:28:14.690 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/", 2024-05-14T15:28:14.690 INFO:teuthology.orchestra.run.smithi069.stdout: "tag": "4f200d60-3ad5-46f1-905b-a53e956c4b96", 2024-05-14T15:28:14.690 INFO:teuthology.orchestra.run.smithi069.stdout: "options": "recursive,force" 2024-05-14T15:28:14.690 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:28:14.690 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:28:14.691 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:28:14.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.689+0000 7f3009e00700 1 -- 172.21.15.69:0/2257428395 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2fe80b2af0 msgr2=0x7f2fe80b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.691 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.689+0000 7f3009e00700 1 --2- 172.21.15.69:0/2257428395 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2fe80b2af0 0x7f2fe80b5000 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc022000 tx=0x7f2ffc01b000 comp rx=0 tx=0).stop 2024-05-14T15:28:14.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.689+0000 7f3009e00700 1 -- 172.21.15.69:0/2257428395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3004076450 msgr2=0x7f300419d550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:14.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.689+0000 7f3009e00700 1 --2- 172.21.15.69:0/2257428395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3004076450 0x7f300419d550 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f2ff00098e0 tx=0x7f2ff00047b0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.689+0000 7f3009e00700 1 -- 172.21.15.69:0/2257428395 shutdown_connections 2024-05-14T15:28:14.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.689+0000 7f3009e00700 1 --2- 172.21.15.69:0/2257428395 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2fe80b2af0 0x7f2fe80b5000 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.689+0000 7f3009e00700 1 --2- 172.21.15.69:0/2257428395 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3004075b00 0x7f300419cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.689+0000 7f3009e00700 1 --2- 172.21.15.69:0/2257428395 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3004110c00 0x7f30041a17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.689+0000 7f3009e00700 1 --2- 172.21.15.69:0/2257428395 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3004076450 0x7f300419d550 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:14.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.689+0000 7f3009e00700 1 -- 172.21.15.69:0/2257428395 >> 172.21.15.69:0/2257428395 conn(0x7f3004100040 msgr2=0x7f30041006f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:14.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.689+0000 7f3009e00700 1 -- 172.21.15.69:0/2257428395 shutdown_connections 2024-05-14T15:28:14.692 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:14.690+0000 7f3009e00700 1 -- 172.21.15.69:0/2257428395 wait complete. 2024-05-14T15:28:15.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:15 smithi203 ceph-mon[34567]: pgmap v202: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 15 MiB/s wr, 638 op/s 2024-05-14T15:28:15.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:15 smithi203 ceph-mon[34567]: osdmap e94: 12 total, 12 up, 12 in 2024-05-14T15:28:15.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:15 smithi092 ceph-mon[34729]: pgmap v202: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 15 MiB/s wr, 638 op/s 2024-05-14T15:28:15.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:15 smithi092 ceph-mon[34729]: osdmap e94: 12 total, 12 up, 12 in 2024-05-14T15:28:15.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:15 smithi069 ceph-mon[31270]: pgmap v202: 129 pgs: 129 active+clean; 2.0 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 142 KiB/s rd, 15 MiB/s wr, 638 op/s 2024-05-14T15:28:15.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:15 smithi069 ceph-mon[31270]: osdmap e94: 12 total, 12 up, 12 in 2024-05-14T15:28:15.625 INFO:tasks.cephfs.filesystem:scrub status for tag:4f200d60-3ad5-46f1-905b-a53e956c4b96 - {'path': '/', 'tag': '4f200d60-3ad5-46f1-905b-a53e956c4b96', 'options': 'recursive,force'} 2024-05-14T15:28:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 150.0 s, 620.2 tps, lat 154.501 ms stddev 254.298 2024-05-14T15:28:17.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:17 smithi092 ceph-mon[34729]: pgmap v204: 129 pgs: 129 active+clean; 2.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 16 MiB/s wr, 735 op/s 2024-05-14T15:28:17.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:17 smithi069 ceph-mon[31270]: pgmap v204: 129 pgs: 129 active+clean; 2.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 16 MiB/s wr, 735 op/s 2024-05-14T15:28:17.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:17 smithi203 ceph-mon[34567]: pgmap v204: 129 pgs: 129 active+clean; 2.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 184 KiB/s rd, 16 MiB/s wr, 735 op/s 2024-05-14T15:28:19.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:19 smithi092 ceph-mon[34729]: pgmap v205: 129 pgs: 129 active+clean; 2.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 14 MiB/s wr, 651 op/s 2024-05-14T15:28:19.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:19 smithi069 ceph-mon[31270]: pgmap v205: 129 pgs: 129 active+clean; 2.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 14 MiB/s wr, 651 op/s 2024-05-14T15:28:19.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:19 smithi203 ceph-mon[34567]: pgmap v205: 129 pgs: 129 active+clean; 2.1 GiB data, 7.1 GiB used, 1.0 TiB / 1.0 TiB avail; 163 KiB/s rd, 14 MiB/s wr, 651 op/s 2024-05-14T15:28:21.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 155.0 s, 491.4 tps, lat 211.039 ms stddev 361.811 2024-05-14T15:28:21.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:21 smithi092 ceph-mon[34729]: pgmap v206: 129 pgs: 129 active+clean; 2.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 14 MiB/s wr, 689 op/s 2024-05-14T15:28:21.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:21 smithi069 ceph-mon[31270]: pgmap v206: 129 pgs: 129 active+clean; 2.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 14 MiB/s wr, 689 op/s 2024-05-14T15:28:21.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:21 smithi203 ceph-mon[34567]: pgmap v206: 129 pgs: 129 active+clean; 2.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 14 MiB/s wr, 689 op/s 2024-05-14T15:28:23.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:23 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:28:23.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:23 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:28:23.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:23 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:28:23.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:23 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:28:23.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:23 smithi092 ceph-mon[34729]: scrub summary: idle 2024-05-14T15:28:23.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:23 smithi092 ceph-mon[34729]: pgmap v207: 129 pgs: 129 active+clean; 2.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 14 MiB/s wr, 689 op/s 2024-05-14T15:28:23.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:23 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:28:23.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:23 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:28:23.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:23 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:28:23.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:23 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:28:23.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:23 smithi069 ceph-mon[31270]: scrub summary: idle 2024-05-14T15:28:23.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:23 smithi069 ceph-mon[31270]: pgmap v207: 129 pgs: 129 active+clean; 2.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 14 MiB/s wr, 689 op/s 2024-05-14T15:28:23.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:23 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:28:23.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:23 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:28:23.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:23 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:28:23.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:23 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:28:23.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:23 smithi203 ceph-mon[34567]: scrub summary: idle 2024-05-14T15:28:23.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:23 smithi203 ceph-mon[34567]: pgmap v207: 129 pgs: 129 active+clean; 2.1 GiB data, 7.3 GiB used, 1.0 TiB / 1.0 TiB avail; 165 KiB/s rd, 14 MiB/s wr, 689 op/s 2024-05-14T15:28:25.442 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:25 smithi092 ceph-mon[34729]: pgmap v208: 129 pgs: 129 active+clean; 2.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 13 MiB/s wr, 655 op/s 2024-05-14T15:28:25.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:25 smithi069 ceph-mon[31270]: pgmap v208: 129 pgs: 129 active+clean; 2.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 13 MiB/s wr, 655 op/s 2024-05-14T15:28:25.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:25 smithi203 ceph-mon[34567]: pgmap v208: 129 pgs: 129 active+clean; 2.1 GiB data, 7.4 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 13 MiB/s wr, 655 op/s 2024-05-14T15:28:26.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 160.0 s, 696.0 tps, lat 143.301 ms stddev 225.041 2024-05-14T15:28:27.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:27 smithi092 ceph-mon[34729]: pgmap v209: 129 pgs: 129 active+clean; 2.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 568 op/s 2024-05-14T15:28:27.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:27 smithi069 ceph-mon[31270]: pgmap v209: 129 pgs: 129 active+clean; 2.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 568 op/s 2024-05-14T15:28:27.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:27 smithi203 ceph-mon[34567]: pgmap v209: 129 pgs: 129 active+clean; 2.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 11 MiB/s wr, 568 op/s 2024-05-14T15:28:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.804+0000 7fac7d600640 1 -- 172.21.15.69:0/439181848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac781032f0 msgr2=0x7fac7810f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.804+0000 7fac7d600640 1 --2- 172.21.15.69:0/439181848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac781032f0 0x7fac7810f6c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fac70009ca0 tx=0x7fac7002a8d0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.804+0000 7fac7d600640 1 -- 172.21.15.69:0/439181848 shutdown_connections 2024-05-14T15:28:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.804+0000 7fac7d600640 1 --2- 172.21.15.69:0/439181848 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac781032f0 0x7fac7810f6c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.804+0000 7fac7d600640 1 --2- 172.21.15.69:0/439181848 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac78109040 0x7fac78102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.804+0000 7fac7d600640 1 --2- 172.21.15.69:0/439181848 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac78108ba0 0x7fac78102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.804+0000 7fac7d600640 1 -- 172.21.15.69:0/439181848 >> 172.21.15.69:0/439181848 conn(0x7fac780782e0 msgr2=0x7fac78078720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.804+0000 7fac7d600640 1 -- 172.21.15.69:0/439181848 shutdown_connections 2024-05-14T15:28:27.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.806+0000 7fac7d600640 1 -- 172.21.15.69:0/439181848 wait complete. 2024-05-14T15:28:27.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.806+0000 7fac7d600640 1 Processor -- start 2024-05-14T15:28:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.806+0000 7fac7d600640 1 -- start start 2024-05-14T15:28:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.810+0000 7fac7d600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac781032f0 0x7fac78109670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.810+0000 7fac7d600640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78108ba0 0x7fac78109bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.810+0000 7fac7d600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac78109040 0x7fac7810a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.810+0000 7fac7d600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fac78113d00 con 0x7fac781032f0 2024-05-14T15:28:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.810+0000 7fac7d600640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fac78113b80 con 0x7fac78108ba0 2024-05-14T15:28:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.810+0000 7fac7d600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fac78113e80 con 0x7fac78109040 2024-05-14T15:28:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.810+0000 7fac76000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78108ba0 0x7fac78109bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.810+0000 7fac76000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78108ba0 0x7fac78109bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:35136/0 (socket says 172.21.15.69:35136) 2024-05-14T15:28:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.810+0000 7fac76000640 1 -- 172.21.15.69:0/1059641762 learned_addr learned my addr 172.21.15.69:0/1059641762 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.811+0000 7fac76a00640 1 --2- 172.21.15.69:0/1059641762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac781032f0 0x7fac78109670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.811+0000 7fac77400640 1 --2- 172.21.15.69:0/1059641762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac78109040 0x7fac7810a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.811+0000 7fac76000640 1 -- 172.21.15.69:0/1059641762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac78109040 msgr2=0x7fac7810a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.811+0000 7fac76000640 1 --2- 172.21.15.69:0/1059641762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac78109040 0x7fac7810a0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.811+0000 7fac76000640 1 -- 172.21.15.69:0/1059641762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac781032f0 msgr2=0x7fac78109670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.811+0000 7fac76000640 1 --2- 172.21.15.69:0/1059641762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac781032f0 0x7fac78109670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.811+0000 7fac76000640 1 -- 172.21.15.69:0/1059641762 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac781acff0 con 0x7fac78108ba0 2024-05-14T15:28:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.812+0000 7fac76000640 1 --2- 172.21.15.69:0/1059641762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78108ba0 0x7fac78109bb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac6800e9f0 tx=0x7fac6800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.812+0000 7fac6f400640 1 -- 172.21.15.69:0/1059641762 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac6800ccc0 con 0x7fac78108ba0 2024-05-14T15:28:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.812+0000 7fac6f400640 1 -- 172.21.15.69:0/1059641762 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac680044b0 con 0x7fac78108ba0 2024-05-14T15:28:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.812+0000 7fac6f400640 1 -- 172.21.15.69:0/1059641762 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac68010430 con 0x7fac78108ba0 2024-05-14T15:28:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.813+0000 7fac7d600640 1 -- 172.21.15.69:0/1059641762 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac781ad280 con 0x7fac78108ba0 2024-05-14T15:28:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.813+0000 7fac7d600640 1 -- 172.21.15.69:0/1059641762 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac781ad780 con 0x7fac78108ba0 2024-05-14T15:28:27.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.818+0000 7fac84587740 1 Processor -- start 2024-05-14T15:28:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.819+0000 7fac84587740 1 -- start start 2024-05-14T15:28:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.819+0000 7fac84587740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200ea51b0 0x560201246280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.819+0000 7fac84587740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200e7c2f0 0x5602012467c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.819+0000 7fac84587740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200e844d0 0x560201246d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.819+0000 7fac84587740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5602011ab550 con 0x560200e7c2f0 2024-05-14T15:28:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.819+0000 7fac84587740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560201150bc0 con 0x560200ea51b0 2024-05-14T15:28:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.819+0000 7fac84587740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5602011a7510 con 0x560200e844d0 2024-05-14T15:28:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.820+0000 7fac77400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200ea51b0 0x560201246280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.820+0000 7fac77400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200ea51b0 0x560201246280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:35152/0 (socket says 172.21.15.69:35152) 2024-05-14T15:28:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.820+0000 7fac77400640 1 -- 172.21.15.69:0/4253899748 learned_addr learned my addr 172.21.15.69:0/4253899748 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:27.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.821+0000 7fac77400640 1 -- 172.21.15.69:0/4253899748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200e844d0 msgr2=0x560201246d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:28:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.821+0000 7fac77400640 1 --2- 172.21.15.69:0/4253899748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200e844d0 0x560201246d00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.821+0000 7fac6f400640 1 -- 172.21.15.69:0/1059641762 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fac68003f90 con 0x7fac78108ba0 2024-05-14T15:28:27.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.821+0000 7fac77400640 1 -- 172.21.15.69:0/4253899748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200e7c2f0 msgr2=0x5602012467c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.821+0000 7fac77400640 1 --2- 172.21.15.69:0/4253899748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200e7c2f0 0x5602012467c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.821+0000 7fac77400640 1 -- 172.21.15.69:0/4253899748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560200ebd210 con 0x560200ea51b0 2024-05-14T15:28:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.823+0000 7fac77400640 1 --2- 172.21.15.69:0/4253899748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200ea51b0 0x560201246280 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fac70009ca0 tx=0x7fac700094a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54647062ca8c82c8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.823+0000 7fac6f400640 1 --2- 172.21.15.69:0/1059641762 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fac5c0b2aa0 0x7fac5c0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.824+0000 7fac67400640 1 -- 172.21.15.69:0/4253899748 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70031660 con 0x560200ea51b0 2024-05-14T15:28:27.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.824+0000 7fac67400640 1 -- 172.21.15.69:0/4253899748 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac70036040 con 0x560200ea51b0 2024-05-14T15:28:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.824+0000 7fac6f400640 1 -- 172.21.15.69:0/1059641762 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7fac680e2e10 con 0x7fac78108ba0 2024-05-14T15:28:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.824+0000 7fac67400640 1 -- 172.21.15.69:0/4253899748 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70004040 con 0x560200ea51b0 2024-05-14T15:28:27.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.825+0000 7fac76a00640 1 --2- 172.21.15.69:0/1059641762 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fac5c0b2aa0 0x7fac5c0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.826+0000 7fac84587740 1 -- 172.21.15.69:0/4253899748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200ea51b0 msgr2=0x560201246280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.826+0000 7fac84587740 1 --2- 172.21.15.69:0/4253899748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200ea51b0 0x560201246280 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fac70009ca0 tx=0x7fac700094a0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.826+0000 7fac84587740 1 -- 172.21.15.69:0/4253899748 shutdown_connections 2024-05-14T15:28:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.826+0000 7fac84587740 1 --2- 172.21.15.69:0/4253899748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200e844d0 0x560201246d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.826+0000 7fac84587740 1 --2- 172.21.15.69:0/4253899748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200e7c2f0 0x5602012467c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.826+0000 7fac84587740 1 --2- 172.21.15.69:0/4253899748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200ea51b0 0x560201246280 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.826+0000 7fac84587740 1 -- 172.21.15.69:0/4253899748 >> 172.21.15.69:0/4253899748 conn(0x560200e99300 msgr2=0x560201242a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.826+0000 7fac76a00640 1 --2- 172.21.15.69:0/1059641762 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fac5c0b2aa0 0x7fac5c0b4fb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x560201247630 tx=0x7fac600097d0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.826+0000 7fac84587740 1 -- 172.21.15.69:0/4253899748 shutdown_connections 2024-05-14T15:28:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.826+0000 7fac84587740 1 -- 172.21.15.69:0/4253899748 wait complete. 2024-05-14T15:28:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.827+0000 7fac84587740 1 -- start start 2024-05-14T15:28:27.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.827+0000 7fac84587740 1 Processor -- start 2024-05-14T15:28:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac84587740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200e7c2f0 0x560201250800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac84587740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e844d0 0x560201250d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac84587740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200ea51b0 0x56020126d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac84587740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560201264360 con 0x560200e7c2f0 2024-05-14T15:28:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac84587740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560201164660 con 0x560200e844d0 2024-05-14T15:28:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac84587740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5602012644e0 con 0x560200ea51b0 2024-05-14T15:28:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac84587740 10 client.0 _ll_register_callbacks cb 0x56020112e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac77400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200ea51b0 0x56020126d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac77400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200ea51b0 0x56020126d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:37240/0 (socket says 172.21.15.69:37240) 2024-05-14T15:28:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac77400640 1 -- 172.21.15.69:0/1396915277 learned_addr learned my addr 172.21.15.69:0/1396915277 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac76a00640 1 --2- 172.21.15.69:0/1396915277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200e7c2f0 0x560201250800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:27.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac76000640 1 --2- 172.21.15.69:0/1396915277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e844d0 0x560201250d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac76000640 1 -- 172.21.15.69:0/1396915277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200ea51b0 msgr2=0x56020126d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac76000640 1 --2- 172.21.15.69:0/1396915277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200ea51b0 0x56020126d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac76000640 1 -- 172.21.15.69:0/1396915277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200e7c2f0 msgr2=0x560201250800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac76000640 1 --2- 172.21.15.69:0/1396915277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200e7c2f0 0x560201250800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac76000640 1 -- 172.21.15.69:0/1396915277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560200f89620 con 0x560200e844d0 2024-05-14T15:28:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.829+0000 7fac76a00640 1 --2- 172.21.15.69:0/1396915277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200e7c2f0 0x560201250800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:28:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.830+0000 7fac76000640 1 --2- 172.21.15.69:0/1396915277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e844d0 0x560201250d40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac680e00f0 tx=0x7fac680a93f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=daa56c71da531fb8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.830+0000 7fac5be00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:28:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.830+0000 7fac5be00640 1 -- 172.21.15.69:0/1396915277 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac680c1030 con 0x560200e844d0 2024-05-14T15:28:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.830+0000 7fac5be00640 1 -- 172.21.15.69:0/1396915277 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7fac680a6270 con 0x560200e844d0 2024-05-14T15:28:27.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.830+0000 7fac84587740 1 -- 172.21.15.69:0/1396915277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac70036040 con 0x560200e844d0 2024-05-14T15:28:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.831+0000 7fac5be00640 1 -- 172.21.15.69:0/1396915277 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fac680c4350 con 0x560200e844d0 2024-05-14T15:28:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.831+0000 7fac84587740 10 client.36167 fetch_fsmap learned FSMap version 52 2024-05-14T15:28:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.831+0000 7fac84587740 1 -- 172.21.15.69:0/1396915277 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x560201270750 con 0x560200e844d0 2024-05-14T15:28:27.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.833+0000 7fac5be00640 1 -- 172.21.15.69:0/1396915277 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac70036040 con 0x560200e844d0 2024-05-14T15:28:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.833+0000 7fac5be00640 1 -- 172.21.15.69:0/1396915277 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 52) ==== 8414+0+0 (secure 0 0 0) 0x7fac680e0370 con 0x560200e844d0 2024-05-14T15:28:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.833+0000 7fac84587740 10 client.36167 fetch_fsmap finished waiting for FSMap version 52 2024-05-14T15:28:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.833+0000 7fac84587740 10 client.36167 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.833+0000 7fac84587740 20 client.36167 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.833+0000 7fac84587740 1 --2- 172.21.15.69:0/1396915277 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560200e63d80 0x560201273cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.833+0000 7fac84587740 4 client.36167 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:28:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.833+0000 7fac84587740 1 -- 172.21.15.69:0/1396915277 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602011b9160 con 0x560200e63d80 2024-05-14T15:28:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.835+0000 7fac76a00640 1 --2- 172.21.15.69:0/1396915277 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560200e63d80 0x560201273cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:27.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.835+0000 7fac76a00640 1 --2- 172.21.15.69:0/1396915277 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560200e63d80 0x560201273cc0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52c452a5630befd6 server_cookie=63b7c4fcdcedd504 in_seq=0 out_seq=0 2024-05-14T15:28:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.835+0000 7fac5be00640 10 client.36167 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.836+0000 7fac5be00640 1 -- 172.21.15.69:0/1396915277 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5602011b9160 con 0x560200e63d80 2024-05-14T15:28:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.836+0000 7fac5be00640 10 client.36167 handle_command_reply: tid=0 2024-05-14T15:28:27.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.836+0000 7fac84587740 1 client.36167 shutdown 2024-05-14T15:28:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.838+0000 7fac84587740 1 -- 172.21.15.69:0/1396915277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e844d0 msgr2=0x560201250d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.838+0000 7fac84587740 1 --2- 172.21.15.69:0/1396915277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e844d0 0x560201250d40 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac680e00f0 tx=0x7fac680a93f0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.838+0000 7fac84587740 1 -- 172.21.15.69:0/1396915277 shutdown_connections 2024-05-14T15:28:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.838+0000 7fac84587740 1 --2- 172.21.15.69:0/1396915277 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200ea51b0 0x56020126d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.838+0000 7fac84587740 1 --2- 172.21.15.69:0/1396915277 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e844d0 0x560201250d40 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.838+0000 7fac84587740 1 --2- 172.21.15.69:0/1396915277 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560200e63d80 0x560201273cc0 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.838+0000 7fac84587740 1 --2- 172.21.15.69:0/1396915277 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200e7c2f0 0x560201250800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.838+0000 7fac5be00640 0 client.36167 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.838+0000 7fac84587740 1 -- 172.21.15.69:0/1396915277 >> 172.21.15.69:0/1396915277 conn(0x560200e99300 msgr2=0x560201247fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.838+0000 7fac84587740 1 -- 172.21.15.69:0/1396915277 shutdown_connections 2024-05-14T15:28:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.838+0000 7fac84587740 1 -- 172.21.15.69:0/1396915277 wait complete. 2024-05-14T15:28:27.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.839+0000 7fac84587740 20 client.36167 trim_cache size 0 max 16384 2024-05-14T15:28:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.871+0000 7fac84587740 1 Processor -- start 2024-05-14T15:28:27.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.871+0000 7fac84587740 1 -- start start 2024-05-14T15:28:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.872+0000 7fac84587740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200e7c2f0 0x560201241710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.872+0000 7fac84587740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e844d0 0x560201241c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.872+0000 7fac84587740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200ea51b0 0x560201279460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.872+0000 7fac84587740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fac781af1b0 con 0x560200ea51b0 2024-05-14T15:28:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.872+0000 7fac84587740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fac781b0f00 con 0x560200e844d0 2024-05-14T15:28:27.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.872+0000 7fac84587740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fac781af910 con 0x560200e7c2f0 2024-05-14T15:28:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.873+0000 7fac77400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200ea51b0 0x560201279460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.873+0000 7fac76a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200e7c2f0 0x560201241710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.873+0000 7fac77400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200ea51b0 0x560201279460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37472/0 (socket says 172.21.15.69:37472) 2024-05-14T15:28:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.873+0000 7fac76000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e844d0 0x560201241c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:27.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.873+0000 7fac77400640 1 -- 172.21.15.69:0/1433470757 learned_addr learned my addr 172.21.15.69:0/1433470757 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:27.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.874+0000 7fac77400640 1 -- 172.21.15.69:0/1433470757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200e7c2f0 msgr2=0x560201241710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:27.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.874+0000 7fac77400640 1 --2- 172.21.15.69:0/1433470757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200e7c2f0 0x560201241710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.874+0000 7fac77400640 1 -- 172.21.15.69:0/1433470757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e844d0 msgr2=0x560201241c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.874+0000 7fac77400640 1 --2- 172.21.15.69:0/1433470757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e844d0 0x560201241c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.874+0000 7fac77400640 1 -- 172.21.15.69:0/1433470757 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560201247380 con 0x560200ea51b0 2024-05-14T15:28:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.875+0000 7fac77400640 1 --2- 172.21.15.69:0/1433470757 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200ea51b0 0x560201279460 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fac70009bf0 tx=0x7fac70031460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7064e6b21f73b73 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.875+0000 7fac66a00640 1 -- 172.21.15.69:0/1433470757 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70052070 con 0x560200ea51b0 2024-05-14T15:28:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.875+0000 7fac66a00640 1 -- 172.21.15.69:0/1433470757 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac70036040 con 0x560200ea51b0 2024-05-14T15:28:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.875+0000 7fac66a00640 1 -- 172.21.15.69:0/1433470757 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac70004040 con 0x560200ea51b0 2024-05-14T15:28:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.877+0000 7fac84587740 1 -- 172.21.15.69:0/1433470757 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200ea51b0 msgr2=0x560201279460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.877+0000 7fac84587740 1 --2- 172.21.15.69:0/1433470757 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200ea51b0 0x560201279460 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fac70009bf0 tx=0x7fac70031460 comp rx=0 tx=0).stop 2024-05-14T15:28:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.877+0000 7fac76000640 1 --2- 172.21.15.69:0/1433470757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e844d0 0x560201241c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:28:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.877+0000 7fac84587740 1 -- 172.21.15.69:0/1433470757 shutdown_connections 2024-05-14T15:28:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.877+0000 7fac84587740 1 --2- 172.21.15.69:0/1433470757 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200ea51b0 0x560201279460 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.877+0000 7fac84587740 1 --2- 172.21.15.69:0/1433470757 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e844d0 0x560201241c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.877+0000 7fac84587740 1 --2- 172.21.15.69:0/1433470757 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200e7c2f0 0x560201241710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.877+0000 7fac84587740 1 -- 172.21.15.69:0/1433470757 >> 172.21.15.69:0/1433470757 conn(0x560200e99300 msgr2=0x560201241000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.877+0000 7fac84587740 1 -- 172.21.15.69:0/1433470757 shutdown_connections 2024-05-14T15:28:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.878+0000 7fac84587740 1 -- 172.21.15.69:0/1433470757 wait complete. 2024-05-14T15:28:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.878+0000 7fac84587740 1 -- start start 2024-05-14T15:28:27.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.879+0000 7fac84587740 1 Processor -- start 2024-05-14T15:28:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.879+0000 7fac84587740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e7c2f0 0x5602012647b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.879+0000 7fac84587740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200e844d0 0x560201264cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.879+0000 7fac84587740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200ea51b0 0x560201265230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.880+0000 7fac84587740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fac781b0770 con 0x560200e844d0 2024-05-14T15:28:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.880+0000 7fac84587740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fac781affe0 con 0x560200e7c2f0 2024-05-14T15:28:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.880+0000 7fac84587740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fac7810aba0 con 0x560200ea51b0 2024-05-14T15:28:27.882 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.880+0000 7fac84587740 10 client.0 _ll_register_callbacks cb 0x7fac680a9a50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.880+0000 7fac76a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e7c2f0 0x5602012647b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.880+0000 7fac76a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e7c2f0 0x5602012647b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:35176/0 (socket says 172.21.15.69:35176) 2024-05-14T15:28:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.880+0000 7fac76a00640 1 -- 172.21.15.69:0/1908006244 learned_addr learned my addr 172.21.15.69:0/1908006244 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.880+0000 7fac77400640 1 --2- 172.21.15.69:0/1908006244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200ea51b0 0x560201265230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.880+0000 7fac76000640 1 --2- 172.21.15.69:0/1908006244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200e844d0 0x560201264cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.881+0000 7fac77400640 1 -- 172.21.15.69:0/1908006244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e7c2f0 msgr2=0x5602012647b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.881+0000 7fac77400640 1 --2- 172.21.15.69:0/1908006244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e7c2f0 0x5602012647b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.881+0000 7fac77400640 1 -- 172.21.15.69:0/1908006244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200e844d0 msgr2=0x560201264cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.881+0000 7fac77400640 1 --2- 172.21.15.69:0/1908006244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200e844d0 0x560201264cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.881+0000 7fac77400640 1 -- 172.21.15.69:0/1908006244 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602012da200 con 0x560200ea51b0 2024-05-14T15:28:27.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.881+0000 7fac76a00640 1 --2- 172.21.15.69:0/1908006244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e7c2f0 0x5602012647b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:28:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.883+0000 7fac77400640 1 --2- 172.21.15.69:0/1908006244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200ea51b0 0x560201265230 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fac70009bf0 tx=0x7fac70003ad0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f476c54d7169a5f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:27.884 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.883+0000 7fac5be00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:28:27.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.884+0000 7fac5be00640 1 -- 172.21.15.69:0/1908006244 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac7005b060 con 0x560200ea51b0 2024-05-14T15:28:27.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.884+0000 7fac5be00640 1 -- 172.21.15.69:0/1908006244 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7fac70003b80 con 0x560200ea51b0 2024-05-14T15:28:27.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.885+0000 7fac84587740 1 -- 172.21.15.69:0/1908006244 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fac70036040 con 0x560200ea51b0 2024-05-14T15:28:27.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.886+0000 7fac5be00640 1 -- 172.21.15.69:0/1908006244 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=52) ==== 24+0+0 (secure 0 0 0) 0x7fac70052050 con 0x560200ea51b0 2024-05-14T15:28:27.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.886+0000 7fac84587740 10 client.26143 fetch_fsmap learned FSMap version 52 2024-05-14T15:28:27.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.886+0000 7fac84587740 1 -- 172.21.15.69:0/1908006244 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=52,monmap=4+}) -- 0x5602012db470 con 0x560200ea51b0 2024-05-14T15:28:27.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.886+0000 7fac5be00640 1 -- 172.21.15.69:0/1908006244 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fac70036040 con 0x560200ea51b0 2024-05-14T15:28:27.889 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.888+0000 7fac5be00640 1 -- 172.21.15.69:0/1908006244 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 52) ==== 8414+0+0 (secure 0 0 0) 0x7fac700042d0 con 0x560200ea51b0 2024-05-14T15:28:27.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.890+0000 7fac84587740 10 client.26143 fetch_fsmap finished waiting for FSMap version 52 2024-05-14T15:28:27.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.890+0000 7fac84587740 10 client.26143 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:27.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.890+0000 7fac84587740 20 client.26143 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:27.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.890+0000 7fac84587740 1 --2- 172.21.15.69:0/1908006244 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560200e391c0 0x5602012dd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:27.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.890+0000 7fac84587740 4 client.26143 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:28:27.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.890+0000 7fac84587740 1 -- 172.21.15.69:0/1908006244 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5602011b2fd0 con 0x560200e391c0 2024-05-14T15:28:27.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.890+0000 7fac76a00640 1 --2- 172.21.15.69:0/1908006244 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560200e391c0 0x5602012dd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.892+0000 7fac76a00640 1 --2- 172.21.15.69:0/1908006244 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560200e391c0 0x5602012dd6b0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=abcf9696e4138a13 server_cookie=fcc33b42f7c63fc6 in_seq=0 out_seq=0 2024-05-14T15:28:27.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.892+0000 7fac5be00640 10 client.26143 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:27.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.976+0000 7fac5be00640 1 -- 172.21.15.69:0/1908006244 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5602011b2fd0 con 0x560200e391c0 2024-05-14T15:28:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.976+0000 7fac5be00640 10 client.26143 handle_command_reply: tid=0 2024-05-14T15:28:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.976+0000 7fac84587740 1 client.26143 shutdown 2024-05-14T15:28:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.976+0000 7fac84587740 1 -- 172.21.15.69:0/1908006244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200ea51b0 msgr2=0x560201265230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.976+0000 7fac84587740 1 --2- 172.21.15.69:0/1908006244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200ea51b0 0x560201265230 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fac70009bf0 tx=0x7fac70003ad0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.977+0000 7fac84587740 1 -- 172.21.15.69:0/1908006244 shutdown_connections 2024-05-14T15:28:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.977+0000 7fac84587740 1 --2- 172.21.15.69:0/1908006244 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560200ea51b0 0x560201265230 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.977+0000 7fac84587740 1 --2- 172.21.15.69:0/1908006244 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560200e391c0 0x5602012dd6b0 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.977+0000 7fac84587740 1 --2- 172.21.15.69:0/1908006244 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560200e844d0 0x560201264cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.977+0000 7fac84587740 1 --2- 172.21.15.69:0/1908006244 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560200e7c2f0 0x5602012647b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.977+0000 7fac84587740 1 -- 172.21.15.69:0/1908006244 >> 172.21.15.69:0/1908006244 conn(0x560200e99300 msgr2=0x560201241a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.977+0000 7fac5be00640 0 client.26143 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.977+0000 7fac84587740 1 -- 172.21.15.69:0/1908006244 shutdown_connections 2024-05-14T15:28:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.977+0000 7fac84587740 1 -- 172.21.15.69:0/1908006244 wait complete. 2024-05-14T15:28:27.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.978+0000 7fac84587740 20 client.26143 trim_cache size 0 max 16384 2024-05-14T15:28:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:28:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:28:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:28:27.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:28:27.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.980+0000 7fac7d600640 1 -- 172.21.15.69:0/1059641762 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fac5c0b2aa0 msgr2=0x7fac5c0b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:27.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.980+0000 7fac7d600640 1 --2- 172.21.15.69:0/1059641762 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fac5c0b2aa0 0x7fac5c0b4fb0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x560201247630 tx=0x7fac600097d0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.980+0000 7fac7d600640 1 -- 172.21.15.69:0/1059641762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78108ba0 msgr2=0x7fac78109bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:27.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.980+0000 7fac7d600640 1 --2- 172.21.15.69:0/1059641762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78108ba0 0x7fac78109bb0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fac6800e9f0 tx=0x7fac6800eeb0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.981+0000 7fac7d600640 1 -- 172.21.15.69:0/1059641762 shutdown_connections 2024-05-14T15:28:27.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.981+0000 7fac7d600640 1 --2- 172.21.15.69:0/1059641762 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fac5c0b2aa0 0x7fac5c0b4fb0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.981+0000 7fac7d600640 1 --2- 172.21.15.69:0/1059641762 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fac78109040 0x7fac7810a0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.981+0000 7fac7d600640 1 --2- 172.21.15.69:0/1059641762 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fac78108ba0 0x7fac78109bb0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.981+0000 7fac7d600640 1 --2- 172.21.15.69:0/1059641762 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fac781032f0 0x7fac78109670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:27.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.981+0000 7fac7d600640 1 -- 172.21.15.69:0/1059641762 >> 172.21.15.69:0/1059641762 conn(0x7fac780782e0 msgr2=0x7fac78111ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:27.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.981+0000 7fac7d600640 1 -- 172.21.15.69:0/1059641762 shutdown_connections 2024-05-14T15:28:27.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:27.981+0000 7fac7d600640 1 -- 172.21.15.69:0/1059641762 wait complete. 2024-05-14T15:28:29.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:29 smithi092 ceph-mon[34729]: pgmap v210: 129 pgs: 129 active+clean; 2.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 11 MiB/s wr, 539 op/s 2024-05-14T15:28:29.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:29 smithi069 ceph-mon[31270]: pgmap v210: 129 pgs: 129 active+clean; 2.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 11 MiB/s wr, 539 op/s 2024-05-14T15:28:29.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:29 smithi203 ceph-mon[34567]: pgmap v210: 129 pgs: 129 active+clean; 2.1 GiB data, 7.5 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 11 MiB/s wr, 539 op/s 2024-05-14T15:28:31.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 165.0 s, 510.8 tps, lat 173.993 ms stddev 274.036 2024-05-14T15:28:31.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:31 smithi092 ceph-mon[34729]: pgmap v211: 129 pgs: 129 active+clean; 2.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 17 MiB/s wr, 813 op/s 2024-05-14T15:28:31.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:31 smithi069 ceph-mon[31270]: pgmap v211: 129 pgs: 129 active+clean; 2.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 17 MiB/s wr, 813 op/s 2024-05-14T15:28:31.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:31 smithi203 ceph-mon[34567]: pgmap v211: 129 pgs: 129 active+clean; 2.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 17 MiB/s wr, 813 op/s 2024-05-14T15:28:33.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:33 smithi092 ceph-mon[34729]: pgmap v212: 129 pgs: 129 active+clean; 2.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 589 op/s 2024-05-14T15:28:33.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:33 smithi069 ceph-mon[31270]: pgmap v212: 129 pgs: 129 active+clean; 2.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 589 op/s 2024-05-14T15:28:33.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:33 smithi203 ceph-mon[34567]: pgmap v212: 129 pgs: 129 active+clean; 2.2 GiB data, 7.8 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 12 MiB/s wr, 589 op/s 2024-05-14T15:28:34.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:34 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:28:34.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:34 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:28:34.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:34 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:28:35.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:35 smithi069 ceph-mon[31270]: pgmap v213: 129 pgs: 129 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 16 MiB/s wr, 796 op/s 2024-05-14T15:28:35.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:35 smithi203 ceph-mon[34567]: pgmap v213: 129 pgs: 129 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 16 MiB/s wr, 796 op/s 2024-05-14T15:28:35.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:35 smithi092 ceph-mon[34729]: pgmap v213: 129 pgs: 129 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 16 MiB/s wr, 796 op/s 2024-05-14T15:28:36.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 170.0 s, 616.7 tps, lat 179.441 ms stddev 254.838 2024-05-14T15:28:37.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:37 smithi069 ceph-mon[31270]: pgmap v214: 129 pgs: 129 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 13 MiB/s wr, 629 op/s 2024-05-14T15:28:37.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:37 smithi203 ceph-mon[34567]: pgmap v214: 129 pgs: 129 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 13 MiB/s wr, 629 op/s 2024-05-14T15:28:37.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:37 smithi092 ceph-mon[34729]: pgmap v214: 129 pgs: 129 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 13 MiB/s wr, 629 op/s 2024-05-14T15:28:39.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:39 smithi069 ceph-mon[31270]: pgmap v215: 129 pgs: 129 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 543 op/s 2024-05-14T15:28:39.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:39 smithi203 ceph-mon[34567]: pgmap v215: 129 pgs: 129 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 543 op/s 2024-05-14T15:28:39.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:39 smithi092 ceph-mon[34729]: pgmap v215: 129 pgs: 129 active+clean; 2.2 GiB data, 8.0 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 11 MiB/s wr, 543 op/s 2024-05-14T15:28:41.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 175.0 s, 557.8 tps, lat 173.416 ms stddev 269.994 2024-05-14T15:28:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.381+0000 7faa97000640 1 -- 172.21.15.69:0/1416662191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa9011a8f0 msgr2=0x7faa9011cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:41.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.382+0000 7faa97000640 1 --2- 172.21.15.69:0/1416662191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa9011a8f0 0x7faa9011cd10 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7faa7c009860 tx=0x7faa7c02a3d0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.383+0000 7faa97000640 1 -- 172.21.15.69:0/1416662191 shutdown_connections 2024-05-14T15:28:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.383+0000 7faa97000640 1 --2- 172.21.15.69:0/1416662191 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa9011d250 0x7faa9011f670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.383+0000 7faa97000640 1 --2- 172.21.15.69:0/1416662191 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa9011a8f0 0x7faa9011cd10 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.383+0000 7faa97000640 1 --2- 172.21.15.69:0/1416662191 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa9010a200 0x7faa9010a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.383+0000 7faa97000640 1 -- 172.21.15.69:0/1416662191 >> 172.21.15.69:0/1416662191 conn(0x7faa9006e900 msgr2=0x7faa9006ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.383+0000 7faa97000640 1 -- 172.21.15.69:0/1416662191 shutdown_connections 2024-05-14T15:28:41.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.383+0000 7faa97000640 1 -- 172.21.15.69:0/1416662191 wait complete. 2024-05-14T15:28:41.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.386+0000 7faa97000640 1 Processor -- start 2024-05-14T15:28:41.389 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.388+0000 7faa97000640 1 -- start start 2024-05-14T15:28:41.390 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.389+0000 7faa97000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa9010a200 0x7faa901a9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.390 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.389+0000 7faa97000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa9011a8f0 0x7faa901a9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.390 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.389+0000 7faa97000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa9011d250 0x7faa901addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.390 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.389+0000 7faa97000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7faa90122b30 con 0x7faa9010a200 2024-05-14T15:28:41.390 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.389+0000 7faa97000640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa901229b0 con 0x7faa9011d250 2024-05-14T15:28:41.390 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.389+0000 7faa97000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faa90122cb0 con 0x7faa9011a8f0 2024-05-14T15:28:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.389+0000 7faa8f400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa9011a8f0 0x7faa901a9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.389+0000 7faa8fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa9010a200 0x7faa901a9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.389+0000 7faa8f400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa9011a8f0 0x7faa901a9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35106/0 (socket says 172.21.15.69:35106) 2024-05-14T15:28:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.389+0000 7faa8f400640 1 -- 172.21.15.69:0/4258115295 learned_addr learned my addr 172.21.15.69:0/4258115295 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:41.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.390+0000 7faa95000640 1 --2- 172.21.15.69:0/4258115295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa9011d250 0x7faa901addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.390+0000 7faa8f400640 1 -- 172.21.15.69:0/4258115295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa9011d250 msgr2=0x7faa901addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.390+0000 7faa8f400640 1 --2- 172.21.15.69:0/4258115295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa9011d250 0x7faa901addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.390+0000 7faa8f400640 1 -- 172.21.15.69:0/4258115295 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa9010a200 msgr2=0x7faa901a9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.390+0000 7faa8f400640 1 --2- 172.21.15.69:0/4258115295 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa9010a200 0x7faa901a9590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.390+0000 7faa8f400640 1 -- 172.21.15.69:0/4258115295 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa901ae3f0 con 0x7faa9011a8f0 2024-05-14T15:28:41.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.391+0000 7faa8f400640 1 --2- 172.21.15.69:0/4258115295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa9011a8f0 0x7faa901a9af0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faa7c005cd0 tx=0x7faa7c0319a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:41.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.392+0000 7faa8cc00640 1 -- 172.21.15.69:0/4258115295 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c040070 con 0x7faa9011a8f0 2024-05-14T15:28:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.392+0000 7faa8cc00640 1 -- 172.21.15.69:0/4258115295 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa7c03c420 con 0x7faa9011a8f0 2024-05-14T15:28:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.392+0000 7faa97000640 1 -- 172.21.15.69:0/4258115295 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa901ae680 con 0x7faa9011a8f0 2024-05-14T15:28:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.392+0000 7faa97000640 1 -- 172.21.15.69:0/4258115295 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa901aeb70 con 0x7faa9011a8f0 2024-05-14T15:28:41.394 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.393+0000 7faa8cc00640 1 -- 172.21.15.69:0/4258115295 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa7c040070 con 0x7faa9011a8f0 2024-05-14T15:28:41.402 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.401+0000 7faa9dfd2740 1 Processor -- start 2024-05-14T15:28:41.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.401+0000 7faa8cc00640 1 -- 172.21.15.69:0/4258115295 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7faa7c039040 con 0x7faa9011a8f0 2024-05-14T15:28:41.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.403+0000 7faa9dfd2740 1 -- start start 2024-05-14T15:28:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.404+0000 7faa9dfd2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754fad21b0 0x55754fe73280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.404+0000 7faa9dfd2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 0x55754fe737c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.404+0000 7faa9dfd2740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fab14d0 0x55754fe73d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.404+0000 7faa9dfd2740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55754fdd8550 con 0x55754fab14d0 2024-05-14T15:28:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.404+0000 7faa9dfd2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55754fd7dbc0 con 0x55754fad21b0 2024-05-14T15:28:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.404+0000 7faa9dfd2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55754fdd4510 con 0x55754faa92f0 2024-05-14T15:28:41.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.405+0000 7faa8cc00640 1 --2- 172.21.15.69:0/4258115295 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7faa740b2c10 0x7faa740b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.405+0000 7faa95000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754fad21b0 0x55754fe73280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.405+0000 7faa95000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754fad21b0 0x55754fe73280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:60058/0 (socket says 172.21.15.69:60058) 2024-05-14T15:28:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.405+0000 7faa95000640 1 -- 172.21.15.69:0/2966154807 learned_addr learned my addr 172.21.15.69:0/2966154807 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.405+0000 7faa8f400640 1 --2- 172.21.15.69:0/2966154807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fab14d0 0x55754fe73d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.405+0000 7faa8fe00640 1 --2- 172.21.15.69:0/2966154807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 0x55754fe737c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.406+0000 7faa95000640 1 -- 172.21.15.69:0/2966154807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 msgr2=0x55754fe737c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.406+0000 7faa95000640 1 --2- 172.21.15.69:0/2966154807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 0x55754fe737c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.406+0000 7faa95000640 1 -- 172.21.15.69:0/2966154807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fab14d0 msgr2=0x55754fe73d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.406+0000 7faa95000640 1 --2- 172.21.15.69:0/2966154807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fab14d0 0x55754fe73d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.406+0000 7faa95000640 1 -- 172.21.15.69:0/2966154807 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754faea210 con 0x55754fad21b0 2024-05-14T15:28:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.406+0000 7faa95000640 1 --2- 172.21.15.69:0/4258115295 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7faa740b2c10 0x7faa740b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.407+0000 7faa8cc00640 1 -- 172.21.15.69:0/4258115295 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7faa7c1036e0 con 0x7faa9011a8f0 2024-05-14T15:28:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.409+0000 7faa95000640 1 --2- 172.21.15.69:0/2966154807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754fad21b0 0x55754fe73280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faa88009f80 tx=0x7faa88012820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=664c3d11954b4cbc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.409+0000 7faa85600640 1 -- 172.21.15.69:0/2966154807 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa88021070 con 0x55754fad21b0 2024-05-14T15:28:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.410+0000 7faa85600640 1 -- 172.21.15.69:0/2966154807 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa8801b3c0 con 0x55754fad21b0 2024-05-14T15:28:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.410+0000 7faa85600640 1 -- 172.21.15.69:0/2966154807 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa88021070 con 0x55754fad21b0 2024-05-14T15:28:41.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.410+0000 7faa95000640 1 --2- 172.21.15.69:0/4258115295 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7faa740b2c10 0x7faa740b5120 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faa8801e000 tx=0x7faa8801c000 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:41.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.418+0000 7faa9dfd2740 1 -- 172.21.15.69:0/2966154807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754fad21b0 msgr2=0x55754fe73280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:41.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.418+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/2966154807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754fad21b0 0x55754fe73280 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7faa88009f80 tx=0x7faa88012820 comp rx=0 tx=0).stop 2024-05-14T15:28:41.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.419+0000 7faa9dfd2740 1 -- 172.21.15.69:0/2966154807 shutdown_connections 2024-05-14T15:28:41.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.419+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/2966154807 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fab14d0 0x55754fe73d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.419+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/2966154807 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 0x55754fe737c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.419+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/2966154807 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754fad21b0 0x55754fe73280 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.419+0000 7faa9dfd2740 1 -- 172.21.15.69:0/2966154807 >> 172.21.15.69:0/2966154807 conn(0x55754fac6300 msgr2=0x55754fe6fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.421+0000 7faa9dfd2740 1 -- 172.21.15.69:0/2966154807 shutdown_connections 2024-05-14T15:28:41.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.421+0000 7faa9dfd2740 1 -- 172.21.15.69:0/2966154807 wait complete. 2024-05-14T15:28:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.422+0000 7faa9dfd2740 1 -- start start 2024-05-14T15:28:41.424 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.423+0000 7faa9dfd2740 1 Processor -- start 2024-05-14T15:28:41.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.424+0000 7faa9dfd2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754faa92f0 0x55754fe7d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.424+0000 7faa9dfd2740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fab14d0 0x55754fe7dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.424+0000 7faa9dfd2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754fad21b0 0x55754fe89890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.424+0000 7faa9dfd2740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55754fe803b0 con 0x55754fab14d0 2024-05-14T15:28:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.424+0000 7faa9dfd2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55754fd91660 con 0x55754faa92f0 2024-05-14T15:28:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.424+0000 7faa9dfd2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55754fe80530 con 0x55754fad21b0 2024-05-14T15:28:41.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.424+0000 7faa8fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754faa92f0 0x55754fe7d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.424+0000 7faa95000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754fad21b0 0x55754fe89890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.424+0000 7faa95000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754fad21b0 0x55754fe89890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35122/0 (socket says 172.21.15.69:35122) 2024-05-14T15:28:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.424+0000 7faa95000640 1 -- 172.21.15.69:0/717999022 learned_addr learned my addr 172.21.15.69:0/717999022 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.425+0000 7faa9dfd2740 10 client.0 _ll_register_callbacks cb 0x55754fd5b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:41.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.425+0000 7faa8f400640 1 --2- 172.21.15.69:0/717999022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fab14d0 0x55754fe7dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.425+0000 7faa95000640 1 -- 172.21.15.69:0/717999022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754faa92f0 msgr2=0x55754fe7d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.425+0000 7faa95000640 1 --2- 172.21.15.69:0/717999022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754faa92f0 0x55754fe7d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.425+0000 7faa95000640 1 -- 172.21.15.69:0/717999022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fab14d0 msgr2=0x55754fe7dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.425+0000 7faa95000640 1 --2- 172.21.15.69:0/717999022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fab14d0 0x55754fe7dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.425+0000 7faa95000640 1 -- 172.21.15.69:0/717999022 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55754fbb6620 con 0x55754fad21b0 2024-05-14T15:28:41.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.427+0000 7faa95000640 1 --2- 172.21.15.69:0/717999022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754fad21b0 0x55754fe89890 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faa88005bd0 tx=0x7faa88013e90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cc70e7625f0dac2b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:41.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.427+0000 7faa7a000640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:28:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.428+0000 7faa7a000640 1 -- 172.21.15.69:0/717999022 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa88021050 con 0x55754fad21b0 2024-05-14T15:28:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.428+0000 7faa7a000640 1 -- 172.21.15.69:0/717999022 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7faa8801b980 con 0x55754fad21b0 2024-05-14T15:28:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.428+0000 7faa9dfd2740 1 -- 172.21.15.69:0/717999022 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa8801b3c0 con 0x55754fad21b0 2024-05-14T15:28:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.429+0000 7faa7a000640 1 -- 172.21.15.69:0/717999022 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7faa8803c050 con 0x55754fad21b0 2024-05-14T15:28:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.429+0000 7faa9dfd2740 10 client.26155 fetch_fsmap learned FSMap version 53 2024-05-14T15:28:41.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.429+0000 7faa9dfd2740 1 -- 172.21.15.69:0/717999022 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55754fe8c640 con 0x55754fad21b0 2024-05-14T15:28:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.430+0000 7faa7a000640 1 -- 172.21.15.69:0/717999022 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa8801b3c0 con 0x55754fad21b0 2024-05-14T15:28:41.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.430+0000 7faa7a000640 1 -- 172.21.15.69:0/717999022 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 53) ==== 8406+0+0 (secure 0 0 0) 0x7faa8800f040 con 0x55754fad21b0 2024-05-14T15:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.430+0000 7faa9dfd2740 10 client.26155 fetch_fsmap finished waiting for FSMap version 53 2024-05-14T15:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.430+0000 7faa9dfd2740 10 client.26155 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.430+0000 7faa9dfd2740 20 client.26155 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.431+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/717999022 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55754fa90d80 0x55754fe8f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.431+0000 7faa9dfd2740 4 client.26155 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.431+0000 7faa9dfd2740 1 -- 172.21.15.69:0/717999022 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55754fde6160 con 0x55754fa90d80 2024-05-14T15:28:41.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.431+0000 7faa8fe00640 1 --2- 172.21.15.69:0/717999022 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55754fa90d80 0x55754fe8f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.432+0000 7faa8fe00640 1 --2- 172.21.15.69:0/717999022 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55754fa90d80 0x55754fe8f9f0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28b7b28a4576e6f4 server_cookie=fd2297565f74d84b in_seq=0 out_seq=0 2024-05-14T15:28:41.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.433+0000 7faa7a000640 10 client.26155 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.433+0000 7faa7a000640 1 -- 172.21.15.69:0/717999022 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55754fde6160 con 0x55754fa90d80 2024-05-14T15:28:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.433+0000 7faa7a000640 10 client.26155 handle_command_reply: tid=0 2024-05-14T15:28:41.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.434+0000 7faa9dfd2740 1 client.26155 shutdown 2024-05-14T15:28:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.434+0000 7faa9dfd2740 1 -- 172.21.15.69:0/717999022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754fad21b0 msgr2=0x55754fe89890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.434+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/717999022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754fad21b0 0x55754fe89890 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7faa88005bd0 tx=0x7faa88013e90 comp rx=0 tx=0).stop 2024-05-14T15:28:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.434+0000 7faa9dfd2740 1 -- 172.21.15.69:0/717999022 shutdown_connections 2024-05-14T15:28:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.434+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/717999022 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754fad21b0 0x55754fe89890 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.434+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/717999022 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55754fa90d80 0x55754fe8f9f0 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.434+0000 7faa7a000640 0 client.26155 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.434+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/717999022 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fab14d0 0x55754fe7dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.434+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/717999022 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754faa92f0 0x55754fe7d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.434+0000 7faa9dfd2740 1 -- 172.21.15.69:0/717999022 >> 172.21.15.69:0/717999022 conn(0x55754fac6300 msgr2=0x55754fe730b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:41.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.435+0000 7faa9dfd2740 1 -- 172.21.15.69:0/717999022 shutdown_connections 2024-05-14T15:28:41.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.435+0000 7faa9dfd2740 1 -- 172.21.15.69:0/717999022 wait complete. 2024-05-14T15:28:41.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.435+0000 7faa9dfd2740 20 client.26155 trim_cache size 0 max 16384 2024-05-14T15:28:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.463+0000 7faa9dfd2740 1 Processor -- start 2024-05-14T15:28:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.464+0000 7faa9dfd2740 1 -- start start 2024-05-14T15:28:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.464+0000 7faa9dfd2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 0x55754fe74020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.464+0000 7faa9dfd2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754fab14d0 0x55754fe95140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.464+0000 7faa9dfd2740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fad21b0 0x55754fe95680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.464+0000 7faa9dfd2740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7faa901c0180 con 0x55754fad21b0 2024-05-14T15:28:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.464+0000 7faa9dfd2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa901c1e70 con 0x55754fab14d0 2024-05-14T15:28:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.464+0000 7faa9dfd2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faa901c0880 con 0x55754faa92f0 2024-05-14T15:28:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.465+0000 7faa8f400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754fab14d0 0x55754fe95140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.465+0000 7faa8fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 0x55754fe74020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.465+0000 7faa95000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fad21b0 0x55754fe95680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.465+0000 7faa95000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fad21b0 0x55754fe95680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33732/0 (socket says 172.21.15.69:33732) 2024-05-14T15:28:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.465+0000 7faa95000640 1 -- 172.21.15.69:0/1051419220 learned_addr learned my addr 172.21.15.69:0/1051419220 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.466+0000 7faa95000640 1 -- 172.21.15.69:0/1051419220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 msgr2=0x55754fe74020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.466+0000 7faa95000640 1 --2- 172.21.15.69:0/1051419220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 0x55754fe74020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.466+0000 7faa95000640 1 -- 172.21.15.69:0/1051419220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754fab14d0 msgr2=0x55754fe95140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.466+0000 7faa95000640 1 --2- 172.21.15.69:0/1051419220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754fab14d0 0x55754fe95140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.466+0000 7faa95000640 1 -- 172.21.15.69:0/1051419220 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55754fe74660 con 0x55754fad21b0 2024-05-14T15:28:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.467+0000 7faa95000640 1 --2- 172.21.15.69:0/1051419220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fad21b0 0x55754fe95680 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7faa88005cc0 tx=0x7faa88012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f87699a68310557 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:41.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.467+0000 7faa84c00640 1 -- 172.21.15.69:0/1051419220 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa88021040 con 0x55754fad21b0 2024-05-14T15:28:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.468+0000 7faa84c00640 1 -- 172.21.15.69:0/1051419220 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa88033070 con 0x55754fad21b0 2024-05-14T15:28:41.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.468+0000 7faa84c00640 1 -- 172.21.15.69:0/1051419220 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8801c830 con 0x55754fad21b0 2024-05-14T15:28:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.469+0000 7faa9dfd2740 1 -- 172.21.15.69:0/1051419220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fad21b0 msgr2=0x55754fe95680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.469+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/1051419220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fad21b0 0x55754fe95680 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7faa88005cc0 tx=0x7faa88012820 comp rx=0 tx=0).stop 2024-05-14T15:28:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.469+0000 7faa9dfd2740 1 -- 172.21.15.69:0/1051419220 shutdown_connections 2024-05-14T15:28:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.469+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/1051419220 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fad21b0 0x55754fe95680 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.469+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/1051419220 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754fab14d0 0x55754fe95140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.469+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/1051419220 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 0x55754fe74020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.469+0000 7faa9dfd2740 1 -- 172.21.15.69:0/1051419220 >> 172.21.15.69:0/1051419220 conn(0x55754fac6300 msgr2=0x55754fe6ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.470+0000 7faa9dfd2740 1 -- 172.21.15.69:0/1051419220 shutdown_connections 2024-05-14T15:28:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.470+0000 7faa9dfd2740 1 -- 172.21.15.69:0/1051419220 wait complete. 2024-05-14T15:28:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.470+0000 7faa9dfd2740 1 -- start start 2024-05-14T15:28:41.472 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.471+0000 7faa9dfd2740 1 Processor -- start 2024-05-14T15:28:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.472+0000 7faa9dfd2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 0x55754fe81410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.472+0000 7faa9dfd2740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fab14d0 0x55754fe81950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.472+0000 7faa9dfd2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754fad21b0 0x55754fe81e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.472+0000 7faa9dfd2740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7faa901c16e0 con 0x55754fab14d0 2024-05-14T15:28:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.472+0000 7faa9dfd2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7faa901c0f50 con 0x55754fad21b0 2024-05-14T15:28:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.472+0000 7faa9dfd2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7faa901be180 con 0x55754faa92f0 2024-05-14T15:28:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.473+0000 7faa8fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 0x55754fe81410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.473+0000 7faa9dfd2740 10 client.0 _ll_register_callbacks cb 0x7faa8801f070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.473+0000 7faa8fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 0x55754fe81410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35140/0 (socket says 172.21.15.69:35140) 2024-05-14T15:28:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.473+0000 7faa8fe00640 1 -- 172.21.15.69:0/4201591693 learned_addr learned my addr 172.21.15.69:0/4201591693 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:41.475 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.473+0000 7faa8f400640 1 --2- 172.21.15.69:0/4201591693 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fab14d0 0x55754fe81950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.474+0000 7faa8fe00640 1 -- 172.21.15.69:0/4201591693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754fad21b0 msgr2=0x55754fe81e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.474+0000 7faa8fe00640 1 --2- 172.21.15.69:0/4201591693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754fad21b0 0x55754fe81e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.474+0000 7faa8fe00640 1 -- 172.21.15.69:0/4201591693 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fab14d0 msgr2=0x55754fe81950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.474+0000 7faa8fe00640 1 --2- 172.21.15.69:0/4201591693 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fab14d0 0x55754fe81950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.474+0000 7faa8fe00640 1 -- 172.21.15.69:0/4201591693 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55754fe69ca0 con 0x55754faa92f0 2024-05-14T15:28:41.476 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.474+0000 7faa8fe00640 1 --2- 172.21.15.69:0/4201591693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 0x55754fe81410 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55754fe70d70 tx=0x7faa80009bd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a9750716de778ca9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:41.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.474+0000 7faa7a000640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:28:41.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.475+0000 7faa7a000640 1 -- 172.21.15.69:0/4201591693 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa8001fac0 con 0x55754faa92f0 2024-05-14T15:28:41.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.475+0000 7faa7a000640 1 -- 172.21.15.69:0/4201591693 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7faa80005030 con 0x55754faa92f0 2024-05-14T15:28:41.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.475+0000 7faa9dfd2740 1 -- 172.21.15.69:0/4201591693 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faa88033070 con 0x55754faa92f0 2024-05-14T15:28:41.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.475+0000 7faa7a000640 1 -- 172.21.15.69:0/4201591693 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7faa8002d050 con 0x55754faa92f0 2024-05-14T15:28:41.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.476+0000 7faa9dfd2740 10 client.26161 fetch_fsmap learned FSMap version 53 2024-05-14T15:28:41.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.476+0000 7faa9dfd2740 1 -- 172.21.15.69:0/4201591693 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x55754fef7dc0 con 0x55754faa92f0 2024-05-14T15:28:41.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.477+0000 7faa7a000640 1 -- 172.21.15.69:0/4201591693 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7faa88033070 con 0x55754faa92f0 2024-05-14T15:28:41.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.479+0000 7faa7a000640 1 -- 172.21.15.69:0/4201591693 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 53) ==== 8406+0+0 (secure 0 0 0) 0x7faa80004730 con 0x55754faa92f0 2024-05-14T15:28:41.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.479+0000 7faa9dfd2740 10 client.26161 fetch_fsmap finished waiting for FSMap version 53 2024-05-14T15:28:41.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.479+0000 7faa9dfd2740 10 client.26161 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:41.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.479+0000 7faa9dfd2740 20 client.26161 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:41.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.479+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/4201591693 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55754fa661c0 0x55754fefa720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:41.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.479+0000 7faa9dfd2740 4 client.26161 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:28:41.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.479+0000 7faa9dfd2740 1 -- 172.21.15.69:0/4201591693 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55754fddffd0 con 0x55754fa661c0 2024-05-14T15:28:41.481 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.480+0000 7faa8f400640 1 --2- 172.21.15.69:0/4201591693 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55754fa661c0 0x55754fefa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.481+0000 7faa7a000640 10 client.26161 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:41.482 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.481+0000 7faa8f400640 1 --2- 172.21.15.69:0/4201591693 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55754fa661c0 0x55754fefa720 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4699283ec815087 server_cookie=20d4bca65a08a25 in_seq=0 out_seq=0 2024-05-14T15:28:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.535+0000 7faa7a000640 1 -- 172.21.15.69:0/4201591693 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55754fddffd0 con 0x55754fa661c0 2024-05-14T15:28:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.537+0000 7faa7a000640 10 client.26161 handle_command_reply: tid=0 2024-05-14T15:28:41.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.537+0000 7faa9dfd2740 1 client.26161 shutdown 2024-05-14T15:28:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.537+0000 7faa9dfd2740 1 -- 172.21.15.69:0/4201591693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 msgr2=0x55754fe81410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.537+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/4201591693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 0x55754fe81410 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x55754fe70d70 tx=0x7faa80009bd0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.538+0000 7faa9dfd2740 1 -- 172.21.15.69:0/4201591693 shutdown_connections 2024-05-14T15:28:41.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.538+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/4201591693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55754fad21b0 0x55754fe81e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.538+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/4201591693 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55754fa661c0 0x55754fefa720 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.538+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/4201591693 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55754fab14d0 0x55754fe81950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.538+0000 7faa9dfd2740 1 --2- 172.21.15.69:0/4201591693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55754faa92f0 0x55754fe81410 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.538+0000 7faa9dfd2740 1 -- 172.21.15.69:0/4201591693 >> 172.21.15.69:0/4201591693 conn(0x55754fac6300 msgr2=0x55754fe76f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.538+0000 7faa7a000640 0 client.26161 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.539+0000 7faa9dfd2740 1 -- 172.21.15.69:0/4201591693 shutdown_connections 2024-05-14T15:28:41.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.539+0000 7faa9dfd2740 1 -- 172.21.15.69:0/4201591693 wait complete. 2024-05-14T15:28:41.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.539+0000 7faa9dfd2740 20 client.26161 trim_cache size 0 max 16384 2024-05-14T15:28:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:28:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:28:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:28:41.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:28:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.543+0000 7faa97000640 1 -- 172.21.15.69:0/4258115295 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7faa740b2c10 msgr2=0x7faa740b5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.543+0000 7faa97000640 1 --2- 172.21.15.69:0/4258115295 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7faa740b2c10 0x7faa740b5120 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faa8801e000 tx=0x7faa8801c000 comp rx=0 tx=0).stop 2024-05-14T15:28:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.543+0000 7faa97000640 1 -- 172.21.15.69:0/4258115295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa9011a8f0 msgr2=0x7faa901a9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.543+0000 7faa97000640 1 --2- 172.21.15.69:0/4258115295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa9011a8f0 0x7faa901a9af0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7faa7c005cd0 tx=0x7faa7c0319a0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.544+0000 7faa97000640 1 -- 172.21.15.69:0/4258115295 shutdown_connections 2024-05-14T15:28:41.545 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.544+0000 7faa97000640 1 --2- 172.21.15.69:0/4258115295 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7faa740b2c10 0x7faa740b5120 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.544+0000 7faa97000640 1 --2- 172.21.15.69:0/4258115295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7faa9011d250 0x7faa901addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.544+0000 7faa97000640 1 --2- 172.21.15.69:0/4258115295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7faa9011a8f0 0x7faa901a9af0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.544+0000 7faa97000640 1 --2- 172.21.15.69:0/4258115295 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7faa9010a200 0x7faa901a9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.544+0000 7faa97000640 1 -- 172.21.15.69:0/4258115295 >> 172.21.15.69:0/4258115295 conn(0x7faa9006e900 msgr2=0x7faa9011ad00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.544+0000 7faa97000640 1 -- 172.21.15.69:0/4258115295 shutdown_connections 2024-05-14T15:28:41.546 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:41.544+0000 7faa97000640 1 -- 172.21.15.69:0/4258115295 wait complete. 2024-05-14T15:28:41.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:41 smithi203 ceph-mon[34567]: pgmap v216: 129 pgs: 129 active+clean; 2.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 17 MiB/s wr, 798 op/s 2024-05-14T15:28:41.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:41 smithi092 ceph-mon[34729]: pgmap v216: 129 pgs: 129 active+clean; 2.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 17 MiB/s wr, 798 op/s 2024-05-14T15:28:41.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:41 smithi069 ceph-mon[31270]: pgmap v216: 129 pgs: 129 active+clean; 2.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 17 MiB/s wr, 798 op/s 2024-05-14T15:28:43.496 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:43 smithi092 ceph-mon[34729]: pgmap v217: 129 pgs: 129 active+clean; 2.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 10 MiB/s wr, 524 op/s 2024-05-14T15:28:43.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:43 smithi203 ceph-mon[34567]: pgmap v217: 129 pgs: 129 active+clean; 2.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 10 MiB/s wr, 524 op/s 2024-05-14T15:28:43.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:43 smithi069 ceph-mon[31270]: pgmap v217: 129 pgs: 129 active+clean; 2.3 GiB data, 8.2 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 10 MiB/s wr, 524 op/s 2024-05-14T15:28:45.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:45 smithi203 ceph-mon[34567]: pgmap v218: 129 pgs: 129 active+clean; 2.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 14 MiB/s wr, 710 op/s 2024-05-14T15:28:45.626 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-05-14T15:28:45.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:45 smithi092 ceph-mon[34729]: pgmap v218: 129 pgs: 129 active+clean; 2.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 14 MiB/s wr, 710 op/s 2024-05-14T15:28:45.720 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:45 smithi069 ceph-mon[31270]: pgmap v218: 129 pgs: 129 active+clean; 2.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 14 MiB/s wr, 710 op/s 2024-05-14T15:28:46.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 180.0 s, 577.0 tps, lat 173.585 ms stddev 262.125 2024-05-14T15:28:46.389 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:28:47.491 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:47 smithi069 ceph-mon[31270]: pgmap v219: 129 pgs: 129 active+clean; 2.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 11 MiB/s wr, 565 op/s 2024-05-14T15:28:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:47 smithi203 ceph-mon[34567]: pgmap v219: 129 pgs: 129 active+clean; 2.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 11 MiB/s wr, 565 op/s 2024-05-14T15:28:47.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:47 smithi092 ceph-mon[34729]: pgmap v219: 129 pgs: 129 active+clean; 2.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 11 MiB/s wr, 565 op/s 2024-05-14T15:28:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.072+0000 7fc234200700 1 -- 172.21.15.69:0/4041581385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc22c108740 msgr2=0x7fc22c06b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:49.074 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.072+0000 7fc234200700 1 --2- 172.21.15.69:0/4041581385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc22c108740 0x7fc22c06b610 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc224009f90 tx=0x7fc22400b330 comp rx=0 tx=0).stop 2024-05-14T15:28:49.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.072+0000 7fc234200700 1 -- 172.21.15.69:0/4041581385 shutdown_connections 2024-05-14T15:28:49.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.072+0000 7fc234200700 1 --2- 172.21.15.69:0/4041581385 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc22c1034c0 0x7fc22c1038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.072+0000 7fc234200700 1 --2- 172.21.15.69:0/4041581385 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc22c108740 0x7fc22c06b610 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.072+0000 7fc234200700 1 --2- 172.21.15.69:0/4041581385 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc22c107df0 0x7fc22c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.072+0000 7fc234200700 1 -- 172.21.15.69:0/4041581385 >> 172.21.15.69:0/4041581385 conn(0x7fc22c0fedc0 msgr2=0x7fc22c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:49.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.072+0000 7fc234200700 1 -- 172.21.15.69:0/4041581385 shutdown_connections 2024-05-14T15:28:49.075 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.073+0000 7fc234200700 1 -- 172.21.15.69:0/4041581385 wait complete. 2024-05-14T15:28:49.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.074+0000 7fc234200700 1 Processor -- start 2024-05-14T15:28:49.076 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.074+0000 7fc234200700 1 -- start start 2024-05-14T15:28:49.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.075+0000 7fc234200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc22c1034c0 0x7fc22c1133a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.075+0000 7fc234200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc22c107df0 0x7fc22c1138e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.075+0000 7fc234200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc22c108740 0x7fc22c113e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.075+0000 7fc234200700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c1166c0 con 0x7fc22c107df0 2024-05-14T15:28:49.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.075+0000 7fc234200700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c10c010 con 0x7fc22c108740 2024-05-14T15:28:49.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.075+0000 7fc234200700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc22c116840 con 0x7fc22c1034c0 2024-05-14T15:28:49.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.076+0000 7fc232200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc22c108740 0x7fc22c113e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:49.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.076+0000 7fc232200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc22c108740 0x7fc22c113e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:57302/0 (socket says 172.21.15.69:57302) 2024-05-14T15:28:49.078 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.076+0000 7fc232200700 1 -- 172.21.15.69:0/3319002677 learned_addr learned my addr 172.21.15.69:0/3319002677 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:49.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.076+0000 7fc232200700 1 -- 172.21.15.69:0/3319002677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc22c1034c0 msgr2=0x7fc22c1133a0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-14T15:28:49.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.076+0000 7fc231800700 1 --2- 172.21.15.69:0/3319002677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc22c1034c0 0x7fc22c1133a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:49.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.077+0000 7fc230e00700 1 --2- 172.21.15.69:0/3319002677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc22c107df0 0x7fc22c1138e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:49.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.077+0000 7fc232200700 1 --2- 172.21.15.69:0/3319002677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc22c1034c0 0x7fc22c1133a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.077+0000 7fc232200700 1 -- 172.21.15.69:0/3319002677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc22c107df0 msgr2=0x7fc22c1138e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:49.079 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.077+0000 7fc232200700 1 --2- 172.21.15.69:0/3319002677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc22c107df0 0x7fc22c1138e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.077+0000 7fc232200700 1 -- 172.21.15.69:0/3319002677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc22c1ad2d0 con 0x7fc22c108740 2024-05-14T15:28:49.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.077+0000 7fc230e00700 1 --2- 172.21.15.69:0/3319002677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc22c107df0 0x7fc22c1138e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:28:49.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.078+0000 7fc231800700 1 --2- 172.21.15.69:0/3319002677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc22c1034c0 0x7fc22c1133a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:28:49.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.078+0000 7fc232200700 1 --2- 172.21.15.69:0/3319002677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc22c108740 0x7fc22c113e20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc22400cfa0 tx=0x7fc22400cfd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:49.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.078+0000 7fc22a000700 1 -- 172.21.15.69:0/3319002677 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc224021070 con 0x7fc22c108740 2024-05-14T15:28:49.080 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.079+0000 7fc234200700 1 -- 172.21.15.69:0/3319002677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc22c1ad500 con 0x7fc22c108740 2024-05-14T15:28:49.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.079+0000 7fc234200700 1 -- 172.21.15.69:0/3319002677 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc22c1ada10 con 0x7fc22c108740 2024-05-14T15:28:49.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.079+0000 7fc22a000700 1 -- 172.21.15.69:0/3319002677 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc22401d8e0 con 0x7fc22c108740 2024-05-14T15:28:49.081 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.079+0000 7fc22a000700 1 -- 172.21.15.69:0/3319002677 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc224005420 con 0x7fc22c108740 2024-05-14T15:28:49.087 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.086+0000 7fc242c66b80 1 Processor -- start 2024-05-14T15:28:49.088 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.086+0000 7fc22a000700 1 -- 172.21.15.69:0/3319002677 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc224024070 con 0x7fc22c108740 2024-05-14T15:28:49.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.086+0000 7fc242c66b80 1 -- start start 2024-05-14T15:28:49.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.087+0000 7fc242c66b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x5641273216b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.088+0000 7fc242c66b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564127321bf0 0x56412731b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.088+0000 7fc242c66b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 0x56412731c060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.088+0000 7fc242c66b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56412723da20 con 0x56412719de40 2024-05-14T15:28:49.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.088+0000 7fc242c66b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5641271db760 con 0x56412731bc50 2024-05-14T15:28:49.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.089+0000 7fc242c66b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5641272399e0 con 0x564127321bf0 2024-05-14T15:28:49.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.089+0000 7fc230e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x5641273216b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:49.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.089+0000 7fc230e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x5641273216b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42868/0 (socket says 172.21.15.69:42868) 2024-05-14T15:28:49.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.089+0000 7fc230e00700 1 -- 172.21.15.69:0/2926583755 learned_addr learned my addr 172.21.15.69:0/2926583755 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:49.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.088+0000 7fc231800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564127321bf0 0x56412731b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:49.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.089+0000 7fc22a000700 1 --2- 172.21.15.69:0/3319002677 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc2140b2af0 0x7fc2140b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.090+0000 7fc22a000700 1 -- 172.21.15.69:0/3319002677 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7fc2240e3d00 con 0x7fc22c108740 2024-05-14T15:28:49.091 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.090+0000 7fc230e00700 1 --2- 172.21.15.69:0/2926583755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 0x56412731c060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:49.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.090+0000 7fc232200700 1 --2- 172.21.15.69:0/3319002677 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc2140b2af0 0x7fc2140b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:49.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.091+0000 7fc231800700 1 -- 172.21.15.69:0/2926583755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 msgr2=0x56412731c060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:49.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.091+0000 7fc231800700 1 --2- 172.21.15.69:0/2926583755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 0x56412731c060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.092 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.091+0000 7fc231800700 1 -- 172.21.15.69:0/2926583755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 msgr2=0x5641273216b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:49.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.091+0000 7fc231800700 1 --2- 172.21.15.69:0/2926583755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x5641273216b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.091+0000 7fc231800700 1 -- 172.21.15.69:0/2926583755 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56412718a8d0 con 0x564127321bf0 2024-05-14T15:28:49.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.091+0000 7fc230e00700 1 --2- 172.21.15.69:0/2926583755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x5641273216b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:28:49.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.091+0000 7fc231800700 1 --2- 172.21.15.69:0/2926583755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564127321bf0 0x56412731b710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc218009c00 tx=0x7fc218009f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1fad44cbd24aa91d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:49.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.092+0000 7fc232200700 1 --2- 172.21.15.69:0/3319002677 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc2140b2af0 0x7fc2140b5000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc224009840 tx=0x7fc224009040 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:49.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.092+0000 7fc21ea00700 1 -- 172.21.15.69:0/2926583755 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218010bb0 con 0x564127321bf0 2024-05-14T15:28:49.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.092+0000 7fc21ea00700 1 -- 172.21.15.69:0/2926583755 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2180044c0 con 0x564127321bf0 2024-05-14T15:28:49.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.092+0000 7fc21ea00700 1 -- 172.21.15.69:0/2926583755 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218012450 con 0x564127321bf0 2024-05-14T15:28:49.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.093+0000 7fc242c66b80 1 -- 172.21.15.69:0/2926583755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564127321bf0 msgr2=0x56412731b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:49.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.093+0000 7fc242c66b80 1 --2- 172.21.15.69:0/2926583755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564127321bf0 0x56412731b710 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc218009c00 tx=0x7fc218009f10 comp rx=0 tx=0).stop 2024-05-14T15:28:49.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.093+0000 7fc242c66b80 1 -- 172.21.15.69:0/2926583755 shutdown_connections 2024-05-14T15:28:49.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.093+0000 7fc242c66b80 1 --2- 172.21.15.69:0/2926583755 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x5641273216b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.093+0000 7fc242c66b80 1 --2- 172.21.15.69:0/2926583755 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 0x56412731c060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.093+0000 7fc242c66b80 1 --2- 172.21.15.69:0/2926583755 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564127321bf0 0x56412731b710 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.093+0000 7fc242c66b80 1 -- 172.21.15.69:0/2926583755 >> 172.21.15.69:0/2926583755 conn(0x5641271dca80 msgr2=0x564127316790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:49.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.094+0000 7fc242c66b80 1 -- 172.21.15.69:0/2926583755 shutdown_connections 2024-05-14T15:28:49.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.094+0000 7fc242c66b80 1 -- 172.21.15.69:0/2926583755 wait complete. 2024-05-14T15:28:49.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.095+0000 7fc242c66b80 1 -- start start 2024-05-14T15:28:49.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.095+0000 7fc242c66b80 1 Processor -- start 2024-05-14T15:28:49.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.096+0000 7fc242c66b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x564127325350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.096+0000 7fc242c66b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56412731bc50 0x564127325890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.096+0000 7fc242c66b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564127321bf0 0x564127325dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.096+0000 7fc242c66b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5641273286c0 con 0x56412719de40 2024-05-14T15:28:49.098 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.096+0000 7fc242c66b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5641271a3b20 con 0x564127321bf0 2024-05-14T15:28:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.096+0000 7fc242c66b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564127328840 con 0x56412731bc50 2024-05-14T15:28:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.096+0000 7fc242c66b80 10 client.0 _ll_register_callbacks cb 0x5641271d1380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.096+0000 7fc231800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56412731bc50 0x564127325890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.096+0000 7fc231800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56412731bc50 0x564127325890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35680/0 (socket says 172.21.15.69:35680) 2024-05-14T15:28:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.097+0000 7fc231800700 1 -- 172.21.15.69:0/462082904 learned_addr learned my addr 172.21.15.69:0/462082904 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.097+0000 7fc230e00700 1 --2- 172.21.15.69:0/462082904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564127321bf0 0x564127325dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.097+0000 7fc231800700 1 -- 172.21.15.69:0/462082904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564127321bf0 msgr2=0x564127325dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:49.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.097+0000 7fc231800700 1 --2- 172.21.15.69:0/462082904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564127321bf0 0x564127325dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.097+0000 7fc231800700 1 -- 172.21.15.69:0/462082904 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 msgr2=0x564127325350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:49.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.097+0000 7fc231800700 1 --2- 172.21.15.69:0/462082904 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x564127325350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.097+0000 7fc231800700 1 -- 172.21.15.69:0/462082904 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564127203420 con 0x56412731bc50 2024-05-14T15:28:49.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.098+0000 7fc231800700 1 --2- 172.21.15.69:0/462082904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56412731bc50 0x564127325890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc218000c00 tx=0x7fc218003d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dae7e143ef4fd77 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:49.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.098+0000 7fc213400700 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:28:49.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.098+0000 7fc213400700 1 -- 172.21.15.69:0/462082904 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218003680 con 0x56412731bc50 2024-05-14T15:28:49.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.098+0000 7fc242c66b80 1 -- 172.21.15.69:0/462082904 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2180044c0 con 0x56412731bc50 2024-05-14T15:28:49.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.099+0000 7fc213400700 1 -- 172.21.15.69:0/462082904 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7fc218005020 con 0x56412731bc50 2024-05-14T15:28:49.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.099+0000 7fc213400700 1 -- 172.21.15.69:0/462082904 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fc218005220 con 0x56412731bc50 2024-05-14T15:28:49.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.099+0000 7fc242c66b80 10 client.26170 fetch_fsmap learned FSMap version 53 2024-05-14T15:28:49.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.100+0000 7fc242c66b80 1 -- 172.21.15.69:0/462082904 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5641273332b0 con 0x56412731bc50 2024-05-14T15:28:49.101 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.100+0000 7fc213400700 1 -- 172.21.15.69:0/462082904 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2180044c0 con 0x56412731bc50 2024-05-14T15:28:49.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.101+0000 7fc213400700 1 -- 172.21.15.69:0/462082904 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 53) ==== 8406+0+0 (secure 0 0 0) 0x7fc21800f040 con 0x56412731bc50 2024-05-14T15:28:49.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.101+0000 7fc242c66b80 10 client.26170 fetch_fsmap finished waiting for FSMap version 53 2024-05-14T15:28:49.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.101+0000 7fc242c66b80 10 client.26170 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:49.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.101+0000 7fc242c66b80 20 client.26170 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:49.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.101+0000 7fc242c66b80 1 --2- 172.21.15.69:0/462082904 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564127335830 0x564127337c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.101+0000 7fc242c66b80 4 client.26170 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:28:49.103 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.101+0000 7fc242c66b80 1 -- 172.21.15.69:0/462082904 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641272e8070 con 0x564127335830 2024-05-14T15:28:49.104 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.103+0000 7fc230e00700 1 --2- 172.21.15.69:0/462082904 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564127335830 0x564127337c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:49.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.106+0000 7fc213400700 10 client.26170 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:49.107 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.106+0000 7fc230e00700 1 --2- 172.21.15.69:0/462082904 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564127335830 0x564127337c50 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ff0bcfd2c4e2542 server_cookie=d8c89a99d11ced5f in_seq=0 out_seq=0 2024-05-14T15:28:49.111 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.110+0000 7fc213400700 1 -- 172.21.15.69:0/462082904 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5641272e8070 con 0x564127335830 2024-05-14T15:28:49.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.110+0000 7fc213400700 10 client.26170 handle_command_reply: tid=0 2024-05-14T15:28:49.112 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.110+0000 7fc242c66b80 1 client.26170 shutdown 2024-05-14T15:28:49.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.111+0000 7fc242c66b80 1 -- 172.21.15.69:0/462082904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56412731bc50 msgr2=0x564127325890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:49.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.111+0000 7fc242c66b80 1 --2- 172.21.15.69:0/462082904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56412731bc50 0x564127325890 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fc218000c00 tx=0x7fc218003d90 comp rx=0 tx=0).stop 2024-05-14T15:28:49.113 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.111+0000 7fc242c66b80 1 -- 172.21.15.69:0/462082904 shutdown_connections 2024-05-14T15:28:49.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.112+0000 7fc242c66b80 1 --2- 172.21.15.69:0/462082904 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564127335830 0x564127337c50 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.112+0000 7fc242c66b80 1 --2- 172.21.15.69:0/462082904 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x564127325350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.112+0000 7fc242c66b80 1 --2- 172.21.15.69:0/462082904 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564127321bf0 0x564127325dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.112+0000 7fc242c66b80 1 --2- 172.21.15.69:0/462082904 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56412731bc50 0x564127325890 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.112+0000 7fc242c66b80 1 -- 172.21.15.69:0/462082904 >> 172.21.15.69:0/462082904 conn(0x5641271dca80 msgr2=0x56412731a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:49.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.112+0000 7fc213400700 0 client.26170 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:49.114 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.112+0000 7fc242c66b80 1 -- 172.21.15.69:0/462082904 shutdown_connections 2024-05-14T15:28:49.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.113+0000 7fc242c66b80 1 -- 172.21.15.69:0/462082904 wait complete. 2024-05-14T15:28:49.115 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.113+0000 7fc242c66b80 20 client.26170 trim_cache size 0 max 16384 2024-05-14T15:28:49.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.148+0000 7fc242c66b80 1 Processor -- start 2024-05-14T15:28:49.149 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.148+0000 7fc242c66b80 1 -- start start 2024-05-14T15:28:49.150 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.148+0000 7fc242c66b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x56412731b710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.148+0000 7fc242c66b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 0x5641273168c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.149+0000 7fc242c66b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564127321bf0 0x564127320b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.149+0000 7fc242c66b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c00eec0 con 0x56412719de40 2024-05-14T15:28:49.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.149+0000 7fc242c66b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c010bb0 con 0x56412731bc50 2024-05-14T15:28:49.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.149+0000 7fc242c66b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c00f5c0 con 0x564127321bf0 2024-05-14T15:28:49.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.149+0000 7fc230e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x56412731b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:49.151 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.149+0000 7fc230e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x56412731b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42878/0 (socket says 172.21.15.69:42878) 2024-05-14T15:28:49.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.149+0000 7fc230e00700 1 -- 172.21.15.69:0/2478063252 learned_addr learned my addr 172.21.15.69:0/2478063252 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:49.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.149+0000 7fc230e00700 1 --2- 172.21.15.69:0/2478063252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564127321bf0 0x564127320b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:49.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.150+0000 7fc231800700 1 --2- 172.21.15.69:0/2478063252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 0x5641273168c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:49.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.150+0000 7fc230e00700 1 -- 172.21.15.69:0/2478063252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 msgr2=0x5641273168c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:49.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.150+0000 7fc230e00700 1 --2- 172.21.15.69:0/2478063252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 0x5641273168c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.150+0000 7fc230e00700 1 -- 172.21.15.69:0/2478063252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 msgr2=0x56412731b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:49.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.150+0000 7fc230e00700 1 --2- 172.21.15.69:0/2478063252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x56412731b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.150+0000 7fc230e00700 1 -- 172.21.15.69:0/2478063252 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564127312d90 con 0x564127321bf0 2024-05-14T15:28:49.152 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.151+0000 7fc230e00700 1 --2- 172.21.15.69:0/2478063252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564127321bf0 0x564127320b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc220000c00 tx=0x7fc220009410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c9d483d617011ef server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:49.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.151+0000 7fc21e000700 1 -- 172.21.15.69:0/2478063252 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220004a30 con 0x564127321bf0 2024-05-14T15:28:49.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.151+0000 7fc21e000700 1 -- 172.21.15.69:0/2478063252 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2200054b0 con 0x564127321bf0 2024-05-14T15:28:49.153 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.151+0000 7fc21e000700 1 -- 172.21.15.69:0/2478063252 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc220013b20 con 0x564127321bf0 2024-05-14T15:28:49.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.152+0000 7fc242c66b80 1 -- 172.21.15.69:0/2478063252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564127321bf0 msgr2=0x564127320b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:49.154 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.152+0000 7fc242c66b80 1 --2- 172.21.15.69:0/2478063252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564127321bf0 0x564127320b60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc220000c00 tx=0x7fc220009410 comp rx=0 tx=0).stop 2024-05-14T15:28:49.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.153+0000 7fc242c66b80 1 -- 172.21.15.69:0/2478063252 shutdown_connections 2024-05-14T15:28:49.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.153+0000 7fc242c66b80 1 --2- 172.21.15.69:0/2478063252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x56412731b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.153+0000 7fc242c66b80 1 --2- 172.21.15.69:0/2478063252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564127321bf0 0x564127320b60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.153+0000 7fc242c66b80 1 --2- 172.21.15.69:0/2478063252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 0x5641273168c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.155 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.153+0000 7fc242c66b80 1 -- 172.21.15.69:0/2478063252 >> 172.21.15.69:0/2478063252 conn(0x5641271dca80 msgr2=0x56412731f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:49.157 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.155+0000 7fc242c66b80 1 -- 172.21.15.69:0/2478063252 shutdown_connections 2024-05-14T15:28:49.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.156+0000 7fc242c66b80 1 -- 172.21.15.69:0/2478063252 wait complete. 2024-05-14T15:28:49.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.156+0000 7fc242c66b80 1 -- start start 2024-05-14T15:28:49.158 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.157+0000 7fc242c66b80 1 Processor -- start 2024-05-14T15:28:49.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.157+0000 7fc242c66b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x56412732e190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.157+0000 7fc242c66b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 0x56412733c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.157+0000 7fc242c66b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564127321bf0 0x56412733cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.157+0000 7fc242c66b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c010420 con 0x56412719de40 2024-05-14T15:28:49.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.157+0000 7fc242c66b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c00fc90 con 0x56412731bc50 2024-05-14T15:28:49.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.157+0000 7fc242c66b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc20c00ce80 con 0x564127321bf0 2024-05-14T15:28:49.159 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.157+0000 7fc242c66b80 10 client.0 _ll_register_callbacks cb 0x5641271d1380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:49.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.158+0000 7fc231800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 0x56412733c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:49.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.158+0000 7fc231800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 0x56412733c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:57354/0 (socket says 172.21.15.69:57354) 2024-05-14T15:28:49.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.158+0000 7fc231800700 1 -- 172.21.15.69:0/3083617251 learned_addr learned my addr 172.21.15.69:0/3083617251 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:49.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.159+0000 7fc230e00700 1 --2- 172.21.15.69:0/3083617251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x56412732e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:49.160 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.159+0000 7fc231800700 1 -- 172.21.15.69:0/3083617251 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564127321bf0 msgr2=0x56412733cea0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:28:49.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.159+0000 7fc231800700 1 --2- 172.21.15.69:0/3083617251 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564127321bf0 0x56412733cea0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.159+0000 7fc231800700 1 -- 172.21.15.69:0/3083617251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 msgr2=0x56412732e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:49.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.159+0000 7fc231800700 1 --2- 172.21.15.69:0/3083617251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x56412732e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.160+0000 7fc231800700 1 -- 172.21.15.69:0/3083617251 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56412733d640 con 0x56412731bc50 2024-05-14T15:28:49.161 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.160+0000 7fc230e00700 1 --2- 172.21.15.69:0/3083617251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x56412732e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:28:49.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.161+0000 7fc231800700 1 --2- 172.21.15.69:0/3083617251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 0x56412733c8a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc218009350 tx=0x7fc218003eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d29dc2719c29bf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:49.162 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.161+0000 7fc213400700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:28:49.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.161+0000 7fc213400700 1 -- 172.21.15.69:0/3083617251 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc218005000 con 0x56412731bc50 2024-05-14T15:28:49.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.161+0000 7fc213400700 1 -- 172.21.15.69:0/3083617251 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7fc2180055d0 con 0x56412731bc50 2024-05-14T15:28:49.163 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.162+0000 7fc242c66b80 1 -- 172.21.15.69:0/3083617251 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2200054b0 con 0x56412731bc50 2024-05-14T15:28:49.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.163+0000 7fc213400700 1 -- 172.21.15.69:0/3083617251 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=53) ==== 24+0+0 (secure 0 0 0) 0x7fc218003680 con 0x56412731bc50 2024-05-14T15:28:49.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.163+0000 7fc242c66b80 10 client.36203 fetch_fsmap learned FSMap version 53 2024-05-14T15:28:49.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.163+0000 7fc242c66b80 1 -- 172.21.15.69:0/3083617251 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=53,monmap=4+}) -- 0x5641273b0eb0 con 0x56412731bc50 2024-05-14T15:28:49.164 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.163+0000 7fc213400700 1 -- 172.21.15.69:0/3083617251 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2200054b0 con 0x56412731bc50 2024-05-14T15:28:49.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.164+0000 7fc213400700 1 -- 172.21.15.69:0/3083617251 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 53) ==== 8406+0+0 (secure 0 0 0) 0x7fc218012450 con 0x56412731bc50 2024-05-14T15:28:49.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.164+0000 7fc242c66b80 10 client.36203 fetch_fsmap finished waiting for FSMap version 53 2024-05-14T15:28:49.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.164+0000 7fc242c66b80 10 client.36203 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:49.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.164+0000 7fc242c66b80 20 client.36203 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:49.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.164+0000 7fc242c66b80 1 --2- 172.21.15.69:0/3083617251 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5641273b15a0 0x5641273b39c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:49.166 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.164+0000 7fc242c66b80 4 client.36203 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-05-14T15:28:49.167 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.165+0000 7fc242c66b80 1 -- 172.21.15.69:0/3083617251 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56412724b400 con 0x5641273b15a0 2024-05-14T15:28:49.168 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.167+0000 7fc230e00700 1 --2- 172.21.15.69:0/3083617251 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5641273b15a0 0x5641273b39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:49.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.169+0000 7fc213400700 10 client.36203 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:49.170 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.169+0000 7fc230e00700 1 --2- 172.21.15.69:0/3083617251 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5641273b15a0 0x5641273b39c0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75af0ff619c74011 server_cookie=55646c471270ffb6 in_seq=0 out_seq=0 2024-05-14T15:28:49.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.170+0000 7fc213400700 1 -- 172.21.15.69:0/3083617251 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56412724b400 con 0x5641273b15a0 2024-05-14T15:28:49.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.170+0000 7fc213400700 10 client.36203 handle_command_reply: tid=0 2024-05-14T15:28:49.171 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.170+0000 7fc242c66b80 1 client.36203 shutdown 2024-05-14T15:28:49.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.170+0000 7fc242c66b80 1 -- 172.21.15.69:0/3083617251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 msgr2=0x56412733c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:49.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.170+0000 7fc242c66b80 1 --2- 172.21.15.69:0/3083617251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 0x56412733c8a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fc218009350 tx=0x7fc218003eb0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.171+0000 7fc242c66b80 1 -- 172.21.15.69:0/3083617251 shutdown_connections 2024-05-14T15:28:49.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.171+0000 7fc242c66b80 1 --2- 172.21.15.69:0/3083617251 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5641273b15a0 0x5641273b39c0 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.172 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.171+0000 7fc242c66b80 1 --2- 172.21.15.69:0/3083617251 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56412719de40 0x56412732e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.171+0000 7fc242c66b80 1 --2- 172.21.15.69:0/3083617251 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564127321bf0 0x56412733cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.171+0000 7fc242c66b80 1 --2- 172.21.15.69:0/3083617251 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56412731bc50 0x56412733c8a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.171+0000 7fc213400700 0 client.36203 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:49.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.171+0000 7fc242c66b80 1 -- 172.21.15.69:0/3083617251 >> 172.21.15.69:0/3083617251 conn(0x5641271dca80 msgr2=0x56412731f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:49.173 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.171+0000 7fc242c66b80 1 -- 172.21.15.69:0/3083617251 shutdown_connections 2024-05-14T15:28:49.173 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:28:49.173 INFO:teuthology.orchestra.run.smithi069.stdout: "status": "no active scrubs running", 2024-05-14T15:28:49.173 INFO:teuthology.orchestra.run.smithi069.stdout: "scrubs": {} 2024-05-14T15:28:49.174 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:28:49.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.171+0000 7fc242c66b80 1 -- 172.21.15.69:0/3083617251 wait complete. 2024-05-14T15:28:49.174 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.172+0000 7fc242c66b80 20 client.36203 trim_cache size 0 max 16384 2024-05-14T15:28:49.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.173+0000 7fc234200700 1 -- 172.21.15.69:0/3319002677 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc2140b2af0 msgr2=0x7fc2140b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:49.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.173+0000 7fc234200700 1 --2- 172.21.15.69:0/3319002677 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc2140b2af0 0x7fc2140b5000 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fc224009840 tx=0x7fc224009040 comp rx=0 tx=0).stop 2024-05-14T15:28:49.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.173+0000 7fc234200700 1 -- 172.21.15.69:0/3319002677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc22c108740 msgr2=0x7fc22c113e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:49.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.173+0000 7fc234200700 1 --2- 172.21.15.69:0/3319002677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc22c108740 0x7fc22c113e20 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fc22400cfa0 tx=0x7fc22400cfd0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.173+0000 7fc234200700 1 -- 172.21.15.69:0/3319002677 shutdown_connections 2024-05-14T15:28:49.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.173+0000 7fc234200700 1 --2- 172.21.15.69:0/3319002677 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc2140b2af0 0x7fc2140b5000 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.173+0000 7fc234200700 1 --2- 172.21.15.69:0/3319002677 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc22c108740 0x7fc22c113e20 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.173+0000 7fc234200700 1 --2- 172.21.15.69:0/3319002677 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc22c1034c0 0x7fc22c1133a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.173+0000 7fc234200700 1 --2- 172.21.15.69:0/3319002677 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc22c107df0 0x7fc22c1138e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:49.175 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.173+0000 7fc234200700 1 -- 172.21.15.69:0/3319002677 >> 172.21.15.69:0/3319002677 conn(0x7fc22c0fedc0 msgr2=0x7fc22c105c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:49.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.175+0000 7fc234200700 1 -- 172.21.15.69:0/3319002677 shutdown_connections 2024-05-14T15:28:49.176 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:49.175+0000 7fc234200700 1 -- 172.21.15.69:0/3319002677 wait complete. 2024-05-14T15:28:49.293 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:49 smithi069 ceph-mon[31270]: pgmap v220: 129 pgs: 129 active+clean; 2.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.7 MiB/s wr, 502 op/s 2024-05-14T15:28:49.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:49 smithi203 ceph-mon[34567]: pgmap v220: 129 pgs: 129 active+clean; 2.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.7 MiB/s wr, 502 op/s 2024-05-14T15:28:49.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:49 smithi092 ceph-mon[34729]: pgmap v220: 129 pgs: 129 active+clean; 2.3 GiB data, 8.4 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 9.7 MiB/s wr, 502 op/s 2024-05-14T15:28:50.290 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-05-14T15:28:50.290 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph fs dump --format=json 2024-05-14T15:28:51.010 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:28:51.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 185.0 s, 555.5 tps, lat 176.019 ms stddev 261.842 2024-05-14T15:28:51.451 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:51 smithi069 ceph-mon[31270]: pgmap v221: 129 pgs: 129 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 14 MiB/s wr, 752 op/s 2024-05-14T15:28:51.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:51 smithi203 ceph-mon[34567]: pgmap v221: 129 pgs: 129 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 14 MiB/s wr, 752 op/s 2024-05-14T15:28:51.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:51 smithi092 ceph-mon[34729]: pgmap v221: 129 pgs: 129 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 14 MiB/s wr, 752 op/s 2024-05-14T15:28:53.537 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:53 smithi069 ceph-mon[31270]: pgmap v222: 129 pgs: 129 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.2 MiB/s wr, 497 op/s 2024-05-14T15:28:53.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:53 smithi203 ceph-mon[34567]: pgmap v222: 129 pgs: 129 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.2 MiB/s wr, 497 op/s 2024-05-14T15:28:53.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:53 smithi092 ceph-mon[34729]: pgmap v222: 129 pgs: 129 active+clean; 2.3 GiB data, 8.6 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.2 MiB/s wr, 497 op/s 2024-05-14T15:28:53.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.850+0000 7f719b600700 1 -- 172.21.15.69:0/3367174053 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71941045f0 msgr2=0x7f7194104a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:53.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.850+0000 7f719b600700 1 --2- 172.21.15.69:0/3367174053 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71941045f0 0x7f7194104a00 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f71880099c0 tx=0x7f7188009cd0 comp rx=0 tx=0).stop 2024-05-14T15:28:53.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.850+0000 7f719b600700 1 -- 172.21.15.69:0/3367174053 shutdown_connections 2024-05-14T15:28:53.852 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.850+0000 7f719b600700 1 --2- 172.21.15.69:0/3367174053 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f71941045f0 0x7f7194104a00 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:53.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.850+0000 7f719b600700 1 --2- 172.21.15.69:0/3367174053 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7194109870 0x7f71941111d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:53.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.850+0000 7f719b600700 1 --2- 172.21.15.69:0/3367174053 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7194108f20 0x7f7194109330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:53.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.850+0000 7f719b600700 1 -- 172.21.15.69:0/3367174053 >> 172.21.15.69:0/3367174053 conn(0x7f7194100040 msgr2=0x7f7194102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:53.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.851+0000 7f719b600700 1 -- 172.21.15.69:0/3367174053 shutdown_connections 2024-05-14T15:28:53.853 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.851+0000 7f719b600700 1 -- 172.21.15.69:0/3367174053 wait complete. 2024-05-14T15:28:53.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.852+0000 7f719b600700 1 Processor -- start 2024-05-14T15:28:53.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.853+0000 7f719b600700 1 -- start start 2024-05-14T15:28:53.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.853+0000 7f719b600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71941045f0 0x7f71941a1390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:53.854 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.853+0000 7f719b600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7194108f20 0x7f71941a1930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:53.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.853+0000 7f719b600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7194109870 0x7f71941a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:53.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.853+0000 7f719b600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7194112270 con 0x7f7194109870 2024-05-14T15:28:53.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.853+0000 7f719b600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f71941120f0 con 0x7f71941045f0 2024-05-14T15:28:53.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.853+0000 7f719b600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f71941123f0 con 0x7f7194108f20 2024-05-14T15:28:53.855 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.854+0000 7f7193e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7194108f20 0x7f71941a1930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:53.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.854+0000 7f7193e00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7194108f20 0x7f71941a1930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:55164/0 (socket says 172.21.15.69:55164) 2024-05-14T15:28:53.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.854+0000 7f7193e00700 1 -- 172.21.15.69:0/1915904047 learned_addr learned my addr 172.21.15.69:0/1915904047 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:53.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.854+0000 7f7199600700 1 --2- 172.21.15.69:0/1915904047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7194109870 0x7f71941a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:53.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.854+0000 7f7198c00700 1 --2- 172.21.15.69:0/1915904047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71941045f0 0x7f71941a1390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:53.856 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.855+0000 7f7193e00700 1 -- 172.21.15.69:0/1915904047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71941045f0 msgr2=0x7f71941a1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:53.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.855+0000 7f7193e00700 1 --2- 172.21.15.69:0/1915904047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71941045f0 0x7f71941a1390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:53.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.855+0000 7f7193e00700 1 -- 172.21.15.69:0/1915904047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7194109870 msgr2=0x7f71941a5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:53.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.855+0000 7f7193e00700 1 --2- 172.21.15.69:0/1915904047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7194109870 0x7f71941a5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:53.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.855+0000 7f7193e00700 1 -- 172.21.15.69:0/1915904047 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71941a61b0 con 0x7f7194108f20 2024-05-14T15:28:53.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.855+0000 7f7193e00700 1 --2- 172.21.15.69:0/1915904047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7194108f20 0x7f71941a1930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f718000d950 tx=0x7f718000dc60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:53.857 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.856+0000 7f7191600700 1 -- 172.21.15.69:0/1915904047 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180017070 con 0x7f7194108f20 2024-05-14T15:28:53.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.856+0000 7f7191600700 1 -- 172.21.15.69:0/1915904047 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7180005020 con 0x7f7194108f20 2024-05-14T15:28:53.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.856+0000 7f7191600700 1 -- 172.21.15.69:0/1915904047 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f718000f8f0 con 0x7f7194108f20 2024-05-14T15:28:53.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.856+0000 7f719b600700 1 -- 172.21.15.69:0/1915904047 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71941a64a0 con 0x7f7194108f20 2024-05-14T15:28:53.858 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.856+0000 7f719b600700 1 -- 172.21.15.69:0/1915904047 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71941a6990 con 0x7f7194108f20 2024-05-14T15:28:53.859 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.857+0000 7f719b600700 1 -- 172.21.15.69:0/1915904047 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71940512c0 con 0x7f7194108f20 2024-05-14T15:28:53.864 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.862+0000 7f7191600700 1 -- 172.21.15.69:0/1915904047 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f7180048d10 con 0x7f7194108f20 2024-05-14T15:28:53.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.865+0000 7f7191600700 1 --2- 172.21.15.69:0/1915904047 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f717c0b2ab0 0x7f717c0b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:53.866 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.865+0000 7f7191600700 1 -- 172.21.15.69:0/1915904047 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7f71800e21d0 con 0x7f7194108f20 2024-05-14T15:28:53.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.866+0000 7f7198c00700 1 --2- 172.21.15.69:0/1915904047 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f717c0b2ab0 0x7f717c0b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:53.867 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.866+0000 7f7191600700 1 -- 172.21.15.69:0/1915904047 <== mon.1 v2:172.21.15.203:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f71800a97c0 con 0x7f7194108f20 2024-05-14T15:28:53.870 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:53.868+0000 7f7198c00700 1 --2- 172.21.15.69:0/1915904047 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f717c0b2ab0 0x7f717c0b4fc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7188000c00 tx=0x7f7188009f10 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:54.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:54.346+0000 7f719b600700 1 -- 172.21.15.69:0/1915904047 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f71941a26f0 con 0x7f7194108f20 2024-05-14T15:28:54.351 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:28:54.351 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":54,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14541,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6835/2193159926","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6834","nonce":2193159926},{"type":"v1","addr":"172.21.15.69:6835","nonce":2193159926}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14547,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.69:6837/2968592361","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6836","nonce":2968592361},{"type":"v1","addr":"172.21.15.69:6837","nonce":2968592361}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5}],"filesystems":[{"mdsmap":{"epoch":54,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-05-14T15:16:11.716543+0000","modified":"2024-05-14T15:28:52.623866+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":34490,"mds_1":34460,"mds_2":34433,"mds_3":34409,"mds_4":24451},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14607":{"gid":14607,"name":"g","rank":4,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6839/561211426","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6838","nonce":561211426},{"type":"v1","addr":"172.21.15.69:6839","nonce":561211426}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_14613":{"gid":14613,"name":"a","rank":3,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.69:6841/2134585816","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6840","nonce":2134585816},{"type":"v1","addr":"172.21.15.69:6841","nonce":2134585816}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24391":{"gid":24391,"name":"l","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6833/3479394720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6832","nonce":3479394720},{"type":"v1","addr":"172.21.15.203:6833","nonce":3479394720}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24430":{"gid":24430,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6835/2407601401","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6834","nonce":2407601401},{"type":"v1","addr":"172.21.15.203:6835","nonce":2407601401}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"c","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.203:6837/3006378390","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6836","nonce":3006378390},{"type":"v1","addr":"172.21.15.203:6837","nonce":3006378390}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24451":{"gid":24451,"name":"i","rank":4,"incarnation":26,"state":"up:active","state_seq":31,"addr":"172.21.15.203:6839/3167469844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6838","nonce":3167469844},{"type":"v1","addr":"172.21.15.203:6839","nonce":3167469844}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34409":{"gid":34409,"name":"k","rank":3,"incarnation":24,"state":"up:active","state_seq":39,"addr":"172.21.15.92:6833/1997000798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6832","nonce":1997000798},{"type":"v1","addr":"172.21.15.92:6833","nonce":1997000798}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34433":{"gid":34433,"name":"e","rank":2,"incarnation":22,"state":"up:active","state_seq":194,"addr":"172.21.15.92:6835/360295917","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6834","nonce":360295917},{"type":"v1","addr":"172.21.15.92:6835","nonce":360295917}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34460":{"gid":34460,"name":"h","rank":1,"incarnation":20,"state":"up:active","state_seq":32,"addr":"172.21.15.92:6837/1669439322","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6836","nonce":1669439322},{"type":"v1","addr":"172.21.15.92:6837","nonce":1669439322}]},"join_fscid":-1,"export_targets":[0,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34490":{"gid":34490,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.92:6839/2029564385","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6838","nonce":2029564385},{"type":"v1","addr":"172.21.15.92:6839","nonce":2029564385}]},"join_fscid":-1,"export_targets":[1,2,3,4],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":34490,"qdb_cluster":[34490,34460,34409,24451,34433]},"id":1}]} 2024-05-14T15:28:54.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:54.349+0000 7f7191600700 1 -- 172.21.15.69:0/1915904047 <== mon.1 v2:172.21.15.203:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+11950 (secure 0 0 0) 0x7f71800a90c0 con 0x7f7194108f20 2024-05-14T15:28:54.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:54.353+0000 7f719b600700 1 -- 172.21.15.69:0/1915904047 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f717c0b2ab0 msgr2=0x7f717c0b4fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:54.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:54.353+0000 7f719b600700 1 --2- 172.21.15.69:0/1915904047 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f717c0b2ab0 0x7f717c0b4fc0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7188000c00 tx=0x7f7188009f10 comp rx=0 tx=0).stop 2024-05-14T15:28:54.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:54.353+0000 7f719b600700 1 -- 172.21.15.69:0/1915904047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7194108f20 msgr2=0x7f71941a1930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:54.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:54.353+0000 7f719b600700 1 --2- 172.21.15.69:0/1915904047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7194108f20 0x7f71941a1930 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f718000d950 tx=0x7f718000dc60 comp rx=0 tx=0).stop 2024-05-14T15:28:54.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:54.354+0000 7f719b600700 1 -- 172.21.15.69:0/1915904047 shutdown_connections 2024-05-14T15:28:54.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:54.354+0000 7f719b600700 1 --2- 172.21.15.69:0/1915904047 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f717c0b2ab0 0x7f717c0b4fc0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:54.354+0000 7f719b600700 1 --2- 172.21.15.69:0/1915904047 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7194109870 0x7f71941a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:54.354+0000 7f719b600700 1 --2- 172.21.15.69:0/1915904047 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f71941045f0 0x7f71941a1390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:54.354+0000 7f719b600700 1 --2- 172.21.15.69:0/1915904047 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7194108f20 0x7f71941a1930 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:54.354+0000 7f719b600700 1 -- 172.21.15.69:0/1915904047 >> 172.21.15.69:0/1915904047 conn(0x7f7194100040 msgr2=0x7f7194102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:54.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:54.354+0000 7f719b600700 1 -- 172.21.15.69:0/1915904047 shutdown_connections 2024-05-14T15:28:54.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:54.355+0000 7f719b600700 1 -- 172.21.15.69:0/1915904047 wait complete. 2024-05-14T15:28:54.358 INFO:teuthology.orchestra.run.smithi069.stderr:dumped fsmap epoch 54 2024-05-14T15:28:54.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:54 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:28:54.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:54 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:28:54.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:54 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:28:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.923+0000 7fc2e5a00640 1 -- 172.21.15.69:0/1804166256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2e0102580 msgr2=0x7fc2e0102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.923+0000 7fc2e5a00640 1 --2- 172.21.15.69:0/1804166256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2e0102580 0x7fc2e0102990 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009be0 tx=0x7fc2d802a6c0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.924+0000 7fc2e5a00640 1 -- 172.21.15.69:0/1804166256 shutdown_connections 2024-05-14T15:28:54.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.924+0000 7fc2e5a00640 1 --2- 172.21.15.69:0/1804166256 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2e01075d0 0x7fc2e010ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.924+0000 7fc2e5a00640 1 --2- 172.21.15.69:0/1804166256 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2e0106b10 0x7fc2e0106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.924+0000 7fc2e5a00640 1 --2- 172.21.15.69:0/1804166256 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2e0102580 0x7fc2e0102990 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.924+0000 7fc2e5a00640 1 -- 172.21.15.69:0/1804166256 >> 172.21.15.69:0/1804166256 conn(0x7fc2e00779e0 msgr2=0x7fc2e0077e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:54.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.925+0000 7fc2e5a00640 1 -- 172.21.15.69:0/1804166256 shutdown_connections 2024-05-14T15:28:54.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.925+0000 7fc2e5a00640 1 -- 172.21.15.69:0/1804166256 wait complete. 2024-05-14T15:28:54.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.927+0000 7fc2e5a00640 1 Processor -- start 2024-05-14T15:28:54.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.927+0000 7fc2e5a00640 1 -- start start 2024-05-14T15:28:54.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.928+0000 7fc2e5a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2e0102580 0x7fc2e0113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:54.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.928+0000 7fc2e5a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2e0106b10 0x7fc2e0113c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:54.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.928+0000 7fc2e5a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2e01075d0 0x7fc2e0114190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.929+0000 7fc2de000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2e0106b10 0x7fc2e0113c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.929+0000 7fc2dea00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2e0102580 0x7fc2e0113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.929+0000 7fc2de000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2e0106b10 0x7fc2e0113c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56508/0 (socket says 172.21.15.69:56508) 2024-05-14T15:28:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.929+0000 7fc2e5a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e0111b60 con 0x7fc2e0106b10 2024-05-14T15:28:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.929+0000 7fc2e5a00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e01119e0 con 0x7fc2e0102580 2024-05-14T15:28:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.929+0000 7fc2e5a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e0111ce0 con 0x7fc2e01075d0 2024-05-14T15:28:54.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.929+0000 7fc2de000640 1 -- 172.21.15.69:0/1341436116 learned_addr learned my addr 172.21.15.69:0/1341436116 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.930+0000 7fc2df400640 1 --2- 172.21.15.69:0/1341436116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2e01075d0 0x7fc2e0114190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.930+0000 7fc2de000640 1 -- 172.21.15.69:0/1341436116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2e01075d0 msgr2=0x7fc2e0114190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.930+0000 7fc2de000640 1 --2- 172.21.15.69:0/1341436116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2e01075d0 0x7fc2e0114190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.930+0000 7fc2de000640 1 -- 172.21.15.69:0/1341436116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2e0102580 msgr2=0x7fc2e0113710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.930+0000 7fc2de000640 1 --2- 172.21.15.69:0/1341436116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2e0102580 0x7fc2e0113710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.930+0000 7fc2de000640 1 -- 172.21.15.69:0/1341436116 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2e01a2700 con 0x7fc2e0106b10 2024-05-14T15:28:54.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.930+0000 7fc2dea00640 1 --2- 172.21.15.69:0/1341436116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2e0102580 0x7fc2e0113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:28:54.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.931+0000 7fc2de000640 1 --2- 172.21.15.69:0/1341436116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2e0106b10 0x7fc2e0113c50 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00e9c0 tx=0x7fc2cc00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:54.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.932+0000 7fc2d7400640 1 -- 172.21.15.69:0/1341436116 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc00ccc0 con 0x7fc2e0106b10 2024-05-14T15:28:54.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.932+0000 7fc2e5a00640 1 -- 172.21.15.69:0/1341436116 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2e01a29f0 con 0x7fc2e0106b10 2024-05-14T15:28:54.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.932+0000 7fc2d7400640 1 -- 172.21.15.69:0/1341436116 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2cc0054b0 con 0x7fc2e0106b10 2024-05-14T15:28:54.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.932+0000 7fc2d7400640 1 -- 172.21.15.69:0/1341436116 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc00ccc0 con 0x7fc2e0106b10 2024-05-14T15:28:54.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.934+0000 7fc2e5a00640 1 -- 172.21.15.69:0/1341436116 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2e01a2f90 con 0x7fc2e0106b10 2024-05-14T15:28:54.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.945+0000 7fc2d7400640 1 -- 172.21.15.69:0/1341436116 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc2cc004c70 con 0x7fc2e0106b10 2024-05-14T15:28:54.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.945+0000 7fc2eca0c740 1 Processor -- start 2024-05-14T15:28:54.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.945+0000 7fc2eca0c740 1 -- start start 2024-05-14T15:28:54.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.946+0000 7fc2eca0c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c79e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:54.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.947+0000 7fc2df400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c79e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:54.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.947+0000 7fc2eca0c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3d42f0 0x55ce7c79e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:54.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.947+0000 7fc2df400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c79e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:55190/0 (socket says 172.21.15.69:55190) 2024-05-14T15:28:54.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.947+0000 7fc2df400640 1 -- 172.21.15.69:0/4050254081 learned_addr learned my addr 172.21.15.69:0/4050254081 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:54.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.947+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/4050254081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c79ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:54.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.947+0000 7fc2eca0c740 1 -- 172.21.15.69:0/4050254081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ce7c703550 con 0x55ce7c3dc4d0 2024-05-14T15:28:54.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.947+0000 7fc2eca0c740 1 -- 172.21.15.69:0/4050254081 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ce7c6a8bc0 con 0x55ce7c3d42f0 2024-05-14T15:28:54.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.947+0000 7fc2eca0c740 1 -- 172.21.15.69:0/4050254081 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ce7c6ff510 con 0x55ce7c3fd1b0 2024-05-14T15:28:54.950 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.947+0000 7fc2dea00640 1 --2- 172.21.15.69:0/4050254081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3d42f0 0x55ce7c79e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:54.950 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.948+0000 7fc2de000640 1 --2- 172.21.15.69:0/4050254081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c79ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:54.950 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.948+0000 7fc2d7400640 1 --2- 172.21.15.69:0/1341436116 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc2c40b2c10 0x7fc2c40b5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:54.950 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.949+0000 7fc2d7400640 1 -- 172.21.15.69:0/1341436116 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7fc2cc0e6060 con 0x7fc2e0106b10 2024-05-14T15:28:54.950 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.949+0000 7fc2df400640 1 -- 172.21.15.69:0/4050254081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3d42f0 msgr2=0x55ce7c79e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:54.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.949+0000 7fc2df400640 1 --2- 172.21.15.69:0/4050254081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3d42f0 0x55ce7c79e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.949+0000 7fc2df400640 1 -- 172.21.15.69:0/4050254081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3dc4d0 msgr2=0x55ce7c79ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:54.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.949+0000 7fc2df400640 1 --2- 172.21.15.69:0/4050254081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c79ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.949+0000 7fc2df400640 1 -- 172.21.15.69:0/4050254081 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7c415210 con 0x55ce7c3fd1b0 2024-05-14T15:28:54.952 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.951+0000 7fc2df400640 1 --2- 172.21.15.69:0/1341436116 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc2c40b2c10 0x7fc2c40b5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:54.954 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.953+0000 7fc2df400640 1 --2- 172.21.15.69:0/4050254081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c79e280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000ac30 tx=0x7fc2d000a370 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4b2e4f88ee176c51 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.953+0000 7fc2cbe00640 1 -- 172.21.15.69:0/4050254081 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d000d3e0 con 0x55ce7c3fd1b0 2024-05-14T15:28:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.954+0000 7fc2cbe00640 1 -- 172.21.15.69:0/4050254081 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2d000da10 con 0x55ce7c3fd1b0 2024-05-14T15:28:54.955 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.954+0000 7fc2cbe00640 1 -- 172.21.15.69:0/4050254081 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0019820 con 0x55ce7c3fd1b0 2024-05-14T15:28:54.956 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.954+0000 7fc2df400640 1 --2- 172.21.15.69:0/1341436116 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc2c40b2c10 0x7fc2c40b5120 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0022000 tx=0x7fc2d0025000 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:54.957 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.956+0000 7fc2eca0c740 1 -- 172.21.15.69:0/4050254081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3fd1b0 msgr2=0x55ce7c79e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:54.957 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.956+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/4050254081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c79e280 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fc2d000ac30 tx=0x7fc2d000a370 comp rx=0 tx=0).stop 2024-05-14T15:28:54.958 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.957+0000 7fc2eca0c740 1 -- 172.21.15.69:0/4050254081 shutdown_connections 2024-05-14T15:28:54.958 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.957+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/4050254081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c79ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.959 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.957+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/4050254081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3d42f0 0x55ce7c79e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.959 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.957+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/4050254081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c79e280 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.959 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.957+0000 7fc2eca0c740 1 -- 172.21.15.69:0/4050254081 >> 172.21.15.69:0/4050254081 conn(0x55ce7c3f1300 msgr2=0x55ce7c79aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:54.959 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.958+0000 7fc2eca0c740 1 -- 172.21.15.69:0/4050254081 shutdown_connections 2024-05-14T15:28:54.959 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.958+0000 7fc2eca0c740 1 -- 172.21.15.69:0/4050254081 wait complete. 2024-05-14T15:28:54.960 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.959+0000 7fc2eca0c740 1 -- start start 2024-05-14T15:28:54.960 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.959+0000 7fc2eca0c740 1 Processor -- start 2024-05-14T15:28:54.962 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.961+0000 7fc2eca0c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3d42f0 0x55ce7c7a8710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:54.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.961+0000 7fc2eca0c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c7a8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:54.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.961+0000 7fc2eca0c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c7b4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:54.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.962+0000 7fc2eca0c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ce7c7ab3b0 con 0x55ce7c3d42f0 2024-05-14T15:28:54.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.962+0000 7fc2eca0c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ce7c6bc660 con 0x55ce7c3fd1b0 2024-05-14T15:28:54.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.962+0000 7fc2eca0c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ce7c7ab530 con 0x55ce7c3dc4d0 2024-05-14T15:28:54.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.962+0000 7fc2eca0c740 10 client.0 _ll_register_callbacks cb 0x55ce7c686400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:54.964 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.962+0000 7fc2df400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c7b4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:54.964 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.962+0000 7fc2df400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c7b4860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:38362/0 (socket says 172.21.15.69:38362) 2024-05-14T15:28:54.964 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.962+0000 7fc2df400640 1 -- 172.21.15.69:0/1719942488 learned_addr learned my addr 172.21.15.69:0/1719942488 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:54.965 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.964+0000 7fc2dea00640 1 --2- 172.21.15.69:0/1719942488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3d42f0 0x55ce7c7a8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.964+0000 7fc2de000640 1 --2- 172.21.15.69:0/1719942488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c7a8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.964+0000 7fc2df400640 1 -- 172.21.15.69:0/1719942488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3dc4d0 msgr2=0x55ce7c7a8c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.964+0000 7fc2df400640 1 --2- 172.21.15.69:0/1719942488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c7a8c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.964+0000 7fc2df400640 1 -- 172.21.15.69:0/1719942488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3d42f0 msgr2=0x55ce7c7a8710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.964+0000 7fc2df400640 1 --2- 172.21.15.69:0/1719942488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3d42f0 0x55ce7c7a8710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.964+0000 7fc2df400640 1 -- 172.21.15.69:0/1719942488 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce7c4e1620 con 0x55ce7c3fd1b0 2024-05-14T15:28:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.964+0000 7fc2de000640 1 --2- 172.21.15.69:0/1719942488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c7a8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:28:54.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.964+0000 7fc2dea00640 1 --2- 172.21.15.69:0/1719942488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3d42f0 0x55ce7c7a8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:28:54.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.965+0000 7fc2df400640 1 --2- 172.21.15.69:0/1719942488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c7b4860 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc2d001a4b0 tx=0x7fc2d00194e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c51f730e12fac6bc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:54.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.966+0000 7fc2c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:28:54.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.966+0000 7fc2c8c00640 1 -- 172.21.15.69:0/1719942488 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d0034020 con 0x55ce7c3fd1b0 2024-05-14T15:28:54.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.966+0000 7fc2c8c00640 1 -- 172.21.15.69:0/1719942488 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7fc2d000dbc0 con 0x55ce7c3fd1b0 2024-05-14T15:28:54.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.967+0000 7fc2eca0c740 1 -- 172.21.15.69:0/1719942488 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2d000da10 con 0x55ce7c3fd1b0 2024-05-14T15:28:54.969 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.968+0000 7fc2c8c00640 1 -- 172.21.15.69:0/1719942488 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fc2d0029030 con 0x55ce7c3fd1b0 2024-05-14T15:28:54.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.969+0000 7fc2eca0c740 10 client.36218 fetch_fsmap learned FSMap version 54 2024-05-14T15:28:54.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.969+0000 7fc2eca0c740 1 -- 172.21.15.69:0/1719942488 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55ce7c7b7590 con 0x55ce7c3fd1b0 2024-05-14T15:28:54.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.970+0000 7fc2c8c00640 1 -- 172.21.15.69:0/1719942488 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2d000da10 con 0x55ce7c3fd1b0 2024-05-14T15:28:54.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.971+0000 7fc2c8c00640 1 -- 172.21.15.69:0/1719942488 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7fc2d002f070 con 0x55ce7c3fd1b0 2024-05-14T15:28:54.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.971+0000 7fc2eca0c740 10 client.36218 fetch_fsmap finished waiting for FSMap version 54 2024-05-14T15:28:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.971+0000 7fc2eca0c740 10 client.36218 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.971+0000 7fc2eca0c740 20 client.36218 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.971+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/1719942488 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ce7c3bbd80 0x55ce7c7ba990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.971+0000 7fc2eca0c740 4 client.36218 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:28:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.971+0000 7fc2eca0c740 1 -- 172.21.15.69:0/1719942488 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce7c711160 con 0x55ce7c3bbd80 2024-05-14T15:28:54.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.973+0000 7fc2dea00640 1 --2- 172.21.15.69:0/1719942488 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ce7c3bbd80 0x55ce7c7ba990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:54.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.976+0000 7fc2dea00640 1 --2- 172.21.15.69:0/1719942488 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ce7c3bbd80 0x55ce7c7ba990 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5b21da14aa63b08 server_cookie=2395aff9e252326b in_seq=0 out_seq=0 2024-05-14T15:28:54.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.976+0000 7fc2c8c00640 10 client.36218 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.978+0000 7fc2c8c00640 1 -- 172.21.15.69:0/1719942488 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ce7c711160 con 0x55ce7c3bbd80 2024-05-14T15:28:54.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.978+0000 7fc2c8c00640 10 client.36218 handle_command_reply: tid=0 2024-05-14T15:28:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.979+0000 7fc2eca0c740 1 client.36218 shutdown 2024-05-14T15:28:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.980+0000 7fc2eca0c740 1 -- 172.21.15.69:0/1719942488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3fd1b0 msgr2=0x55ce7c7b4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:54.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.980+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/1719942488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c7b4860 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fc2d001a4b0 tx=0x7fc2d00194e0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.981+0000 7fc2eca0c740 1 -- 172.21.15.69:0/1719942488 shutdown_connections 2024-05-14T15:28:54.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.981+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/1719942488 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c7b4860 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.981+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/1719942488 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c7a8c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.981+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/1719942488 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ce7c3bbd80 0x55ce7c7ba990 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.981+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/1719942488 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3d42f0 0x55ce7c7a8710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:54.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.981+0000 7fc2c8c00640 0 client.36218 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:54.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.981+0000 7fc2eca0c740 1 -- 172.21.15.69:0/1719942488 >> 172.21.15.69:0/1719942488 conn(0x55ce7c3f1300 msgr2=0x55ce7c79e0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:54.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.981+0000 7fc2eca0c740 1 -- 172.21.15.69:0/1719942488 shutdown_connections 2024-05-14T15:28:54.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.981+0000 7fc2eca0c740 1 -- 172.21.15.69:0/1719942488 wait complete. 2024-05-14T15:28:54.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:54.981+0000 7fc2eca0c740 20 client.36218 trim_cache size 0 max 16384 2024-05-14T15:28:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.009+0000 7fc2eca0c740 1 Processor -- start 2024-05-14T15:28:55.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.009+0000 7fc2eca0c740 1 -- start start 2024-05-14T15:28:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.010+0000 7fc2eca0c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3d42f0 0x55ce7c79a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:55.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.010+0000 7fc2eca0c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c7c0150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.010+0000 7fc2eca0c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c7c0690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.010+0000 7fc2eca0c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e01c03c0 con 0x55ce7c3dc4d0 2024-05-14T15:28:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.010+0000 7fc2eca0c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e01c2080 con 0x55ce7c3d42f0 2024-05-14T15:28:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.010+0000 7fc2eca0c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e01c0a90 con 0x55ce7c3fd1b0 2024-05-14T15:28:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.011+0000 7fc2de000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c7c0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.011+0000 7fc2df400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c7c0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.011+0000 7fc2de000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c7c0150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56536/0 (socket says 172.21.15.69:56536) 2024-05-14T15:28:55.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.011+0000 7fc2de000640 1 -- 172.21.15.69:0/2676009118 learned_addr learned my addr 172.21.15.69:0/2676009118 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.011+0000 7fc2dea00640 1 --2- 172.21.15.69:0/2676009118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3d42f0 0x55ce7c79a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.011+0000 7fc2de000640 1 -- 172.21.15.69:0/2676009118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3fd1b0 msgr2=0x55ce7c7c0690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.011+0000 7fc2de000640 1 --2- 172.21.15.69:0/2676009118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c7c0690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.011+0000 7fc2de000640 1 -- 172.21.15.69:0/2676009118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3d42f0 msgr2=0x55ce7c79a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.012+0000 7fc2de000640 1 --2- 172.21.15.69:0/2676009118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3d42f0 0x55ce7c79a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:55.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.012+0000 7fc2de000640 1 -- 172.21.15.69:0/2676009118 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7c7a7800 con 0x55ce7c3dc4d0 2024-05-14T15:28:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.012+0000 7fc2de000640 1 --2- 172.21.15.69:0/2676009118 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c7c0150 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0a8df0 tx=0x7fc2cc009700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3dc2a3ae76aca7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.013+0000 7fc2cb400640 1 -- 172.21.15.69:0/2676009118 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc00ce60 con 0x55ce7c3dc4d0 2024-05-14T15:28:55.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.013+0000 7fc2cb400640 1 -- 172.21.15.69:0/2676009118 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2cc0e5020 con 0x55ce7c3dc4d0 2024-05-14T15:28:55.015 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.013+0000 7fc2cb400640 1 -- 172.21.15.69:0/2676009118 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2cc0ad4a0 con 0x55ce7c3dc4d0 2024-05-14T15:28:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.014+0000 7fc2eca0c740 1 -- 172.21.15.69:0/2676009118 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3dc4d0 msgr2=0x55ce7c7c0150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.014+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/2676009118 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c7c0150 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc0a8df0 tx=0x7fc2cc009700 comp rx=0 tx=0).stop 2024-05-14T15:28:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.014+0000 7fc2eca0c740 1 -- 172.21.15.69:0/2676009118 shutdown_connections 2024-05-14T15:28:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.014+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/2676009118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c7c0690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.014+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/2676009118 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c7c0150 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.014+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/2676009118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3d42f0 0x55ce7c79a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.014+0000 7fc2eca0c740 1 -- 172.21.15.69:0/2676009118 >> 172.21.15.69:0/2676009118 conn(0x55ce7c3f1300 msgr2=0x55ce7c79a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:55.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.015+0000 7fc2eca0c740 1 -- 172.21.15.69:0/2676009118 shutdown_connections 2024-05-14T15:28:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.015+0000 7fc2eca0c740 1 -- 172.21.15.69:0/2676009118 wait complete. 2024-05-14T15:28:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.015+0000 7fc2eca0c740 1 -- start start 2024-05-14T15:28:55.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.015+0000 7fc2eca0c740 1 Processor -- start 2024-05-14T15:28:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.016+0000 7fc2eca0c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3d42f0 0x55ce7c7aba30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.016+0000 7fc2eca0c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c7abf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.016+0000 7fc2eca0c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c820cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.016+0000 7fc2eca0c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e01c18f0 con 0x55ce7c3fd1b0 2024-05-14T15:28:55.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.016+0000 7fc2eca0c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e01c1160 con 0x55ce7c3d42f0 2024-05-14T15:28:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.017+0000 7fc2df400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c820cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.017+0000 7fc2df400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c820cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56540/0 (socket says 172.21.15.69:56540) 2024-05-14T15:28:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.017+0000 7fc2df400640 1 -- 172.21.15.69:0/767220529 learned_addr learned my addr 172.21.15.69:0/767220529 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.017+0000 7fc2de000640 1 --2- 172.21.15.69:0/767220529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c7abf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.017+0000 7fc2dea00640 1 --2- 172.21.15.69:0/767220529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3d42f0 0x55ce7c7aba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.017+0000 7fc2eca0c740 1 -- 172.21.15.69:0/767220529 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc2e01be3c0 con 0x55ce7c3dc4d0 2024-05-14T15:28:55.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.018+0000 7fc2eca0c740 10 client.0 _ll_register_callbacks cb 0x7fc2cc0e3030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.018+0000 7fc2dea00640 1 -- 172.21.15.69:0/767220529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3dc4d0 msgr2=0x55ce7c7abf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.018+0000 7fc2dea00640 1 --2- 172.21.15.69:0/767220529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c7abf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.018+0000 7fc2dea00640 1 -- 172.21.15.69:0/767220529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3fd1b0 msgr2=0x55ce7c820cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.018+0000 7fc2dea00640 1 --2- 172.21.15.69:0/767220529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c820cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.018+0000 7fc2dea00640 1 -- 172.21.15.69:0/767220529 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce7c832240 con 0x55ce7c3d42f0 2024-05-14T15:28:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.018+0000 7fc2df400640 1 --2- 172.21.15.69:0/767220529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c820cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:28:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.019+0000 7fc2dea00640 1 --2- 172.21.15.69:0/767220529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3d42f0 0x55ce7c7aba30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc2d802acb0 tx=0x7fc2d8030900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d63965e4cbbf0f6d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:55.020 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.019+0000 7fc2c8c00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:28:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.020+0000 7fc2c8c00640 1 -- 172.21.15.69:0/767220529 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8036040 con 0x55ce7c3d42f0 2024-05-14T15:28:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.020+0000 7fc2c8c00640 1 -- 172.21.15.69:0/767220529 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7fc2d8003970 con 0x55ce7c3d42f0 2024-05-14T15:28:55.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.021+0000 7fc2eca0c740 1 -- 172.21.15.69:0/767220529 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2cc0e5020 con 0x55ce7c3d42f0 2024-05-14T15:28:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.022+0000 7fc2c8c00640 1 -- 172.21.15.69:0/767220529 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fc2d8003b70 con 0x55ce7c3d42f0 2024-05-14T15:28:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.022+0000 7fc2eca0c740 10 client.36224 fetch_fsmap learned FSMap version 54 2024-05-14T15:28:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.022+0000 7fc2eca0c740 1 -- 172.21.15.69:0/767220529 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55ce7c833370 con 0x55ce7c3d42f0 2024-05-14T15:28:55.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.023+0000 7fc2c8c00640 1 -- 172.21.15.69:0/767220529 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc2cc0e5020 con 0x55ce7c3d42f0 2024-05-14T15:28:55.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.024+0000 7fc2c8c00640 1 -- 172.21.15.69:0/767220529 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7fc2d803c050 con 0x55ce7c3d42f0 2024-05-14T15:28:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.024+0000 7fc2eca0c740 10 client.36224 fetch_fsmap finished waiting for FSMap version 54 2024-05-14T15:28:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.024+0000 7fc2eca0c740 10 client.36224 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:28:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.024+0000 7fc2eca0c740 20 client.36224 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.024+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/767220529 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ce7c3911c0 0x55ce7c835b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.024+0000 7fc2eca0c740 4 client.36224 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:28:55.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.024+0000 7fc2eca0c740 1 -- 172.21.15.69:0/767220529 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ce7c70afd0 con 0x55ce7c3911c0 2024-05-14T15:28:55.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.026+0000 7fc2de000640 1 --2- 172.21.15.69:0/767220529 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ce7c3911c0 0x55ce7c835b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.028+0000 7fc2de000640 1 --2- 172.21.15.69:0/767220529 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ce7c3911c0 0x55ce7c835b50 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90c5f432a530ce24 server_cookie=d3134d5ae42d564e in_seq=0 out_seq=0 2024-05-14T15:28:55.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.028+0000 7fc2c8c00640 10 client.36224 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.083+0000 7fc2c8c00640 1 -- 172.21.15.69:0/767220529 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ce7c70afd0 con 0x55ce7c3911c0 2024-05-14T15:28:55.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.083+0000 7fc2c8c00640 10 client.36224 handle_command_reply: tid=0 2024-05-14T15:28:55.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.083+0000 7fc2eca0c740 1 client.36224 shutdown 2024-05-14T15:28:55.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.085+0000 7fc2eca0c740 1 -- 172.21.15.69:0/767220529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3d42f0 msgr2=0x55ce7c7aba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:55.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.085+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/767220529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3d42f0 0x55ce7c7aba30 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc2d802acb0 tx=0x7fc2d8030900 comp rx=0 tx=0).stop 2024-05-14T15:28:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.085+0000 7fc2eca0c740 1 -- 172.21.15.69:0/767220529 shutdown_connections 2024-05-14T15:28:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.085+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/767220529 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ce7c3911c0 0x55ce7c835b50 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.085+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/767220529 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ce7c3fd1b0 0x55ce7c820cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.085+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/767220529 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ce7c3dc4d0 0x55ce7c7abf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.085+0000 7fc2eca0c740 1 --2- 172.21.15.69:0/767220529 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ce7c3d42f0 0x55ce7c7aba30 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.085+0000 7fc2eca0c740 1 -- 172.21.15.69:0/767220529 >> 172.21.15.69:0/767220529 conn(0x55ce7c3f1300 msgr2=0x55ce7c79a100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:55.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.085+0000 7fc2c8c00640 0 client.36224 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:28:55.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:28:55.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:28:55.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:28:55.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:28:55.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.086+0000 7fc2eca0c740 1 -- 172.21.15.69:0/767220529 shutdown_connections 2024-05-14T15:28:55.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.086+0000 7fc2eca0c740 1 -- 172.21.15.69:0/767220529 wait complete. 2024-05-14T15:28:55.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.086+0000 7fc2eca0c740 20 client.36224 trim_cache size 0 max 16384 2024-05-14T15:28:55.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.088+0000 7fc2e5a00640 1 -- 172.21.15.69:0/1341436116 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc2c40b2c10 msgr2=0x7fc2c40b5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:55.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.088+0000 7fc2e5a00640 1 --2- 172.21.15.69:0/1341436116 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc2c40b2c10 0x7fc2c40b5120 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fc2d0022000 tx=0x7fc2d0025000 comp rx=0 tx=0).stop 2024-05-14T15:28:55.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.088+0000 7fc2e5a00640 1 -- 172.21.15.69:0/1341436116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2e0106b10 msgr2=0x7fc2e0113c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:55.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.088+0000 7fc2e5a00640 1 --2- 172.21.15.69:0/1341436116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2e0106b10 0x7fc2e0113c50 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7fc2cc00e9c0 tx=0x7fc2cc00edc0 comp rx=0 tx=0).stop 2024-05-14T15:28:55.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.089+0000 7fc2e5a00640 1 -- 172.21.15.69:0/1341436116 shutdown_connections 2024-05-14T15:28:55.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.089+0000 7fc2e5a00640 1 --2- 172.21.15.69:0/1341436116 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc2c40b2c10 0x7fc2c40b5120 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:55.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.089+0000 7fc2e5a00640 1 --2- 172.21.15.69:0/1341436116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc2e01075d0 0x7fc2e0114190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:55.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.089+0000 7fc2e5a00640 1 --2- 172.21.15.69:0/1341436116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc2e0106b10 0x7fc2e0113c50 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:55.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.089+0000 7fc2e5a00640 1 --2- 172.21.15.69:0/1341436116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc2e0102580 0x7fc2e0113710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:55.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.089+0000 7fc2e5a00640 1 -- 172.21.15.69:0/1341436116 >> 172.21.15.69:0/1341436116 conn(0x7fc2e00779e0 msgr2=0x7fc2e0100a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:55.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.089+0000 7fc2e5a00640 1 -- 172.21.15.69:0/1341436116 shutdown_connections 2024-05-14T15:28:55.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:28:55.089+0000 7fc2e5a00640 1 -- 172.21.15.69:0/1341436116 wait complete. 2024-05-14T15:28:55.416 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:4 damage ls 2024-05-14T15:28:55.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:55 smithi203 ceph-mon[34567]: pgmap v223: 129 pgs: 129 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 13 MiB/s wr, 723 op/s 2024-05-14T15:28:55.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:55 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1915904047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:28:55.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:55 smithi092 ceph-mon[34729]: pgmap v223: 129 pgs: 129 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 13 MiB/s wr, 723 op/s 2024-05-14T15:28:55.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:55 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1915904047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:28:55.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:55 smithi069 ceph-mon[31270]: pgmap v223: 129 pgs: 129 active+clean; 2.3 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 13 MiB/s wr, 723 op/s 2024-05-14T15:28:55.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:55 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1915904047' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-05-14T15:28:56.166 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:28:56.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 190.0 s, 517.5 tps, lat 203.748 ms stddev 363.988 2024-05-14T15:28:56.554 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:56 smithi069 ceph-mon[31270]: pgmap v224: 129 pgs: 129 active+clean; 2.4 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 612 op/s 2024-05-14T15:28:56.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:56 smithi203 ceph-mon[34567]: pgmap v224: 129 pgs: 129 active+clean; 2.4 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 612 op/s 2024-05-14T15:28:56.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:56 smithi092 ceph-mon[34729]: pgmap v224: 129 pgs: 129 active+clean; 2.4 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 10 MiB/s wr, 612 op/s 2024-05-14T15:28:59.283 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:28:59 smithi069 ceph-mon[31270]: pgmap v225: 129 pgs: 129 active+clean; 2.4 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.5 MiB/s wr, 550 op/s 2024-05-14T15:28:59.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:28:59 smithi092 ceph-mon[34729]: pgmap v225: 129 pgs: 129 active+clean; 2.4 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.5 MiB/s wr, 550 op/s 2024-05-14T15:28:59.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:28:59 smithi203 ceph-mon[34567]: pgmap v225: 129 pgs: 129 active+clean; 2.4 GiB data, 8.8 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 9.5 MiB/s wr, 550 op/s 2024-05-14T15:28:59.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.928+0000 7fc3fd400700 1 -- 172.21.15.69:0/3517654049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f80764b0 msgr2=0x7fc3f8114e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:59.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.928+0000 7fc3fd400700 1 --2- 172.21.15.69:0/3517654049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f80764b0 0x7fc3f8114e30 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fc3e000b0a0 tx=0x7fc3e000b3b0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.929+0000 7fc3fd400700 1 -- 172.21.15.69:0/3517654049 shutdown_connections 2024-05-14T15:28:59.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.929+0000 7fc3fd400700 1 --2- 172.21.15.69:0/3517654049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f8115370 0x7fc3f8117790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.933 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.929+0000 7fc3fd400700 1 --2- 172.21.15.69:0/3517654049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3f8075b60 0x7fc3f8075f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.929+0000 7fc3fd400700 1 --2- 172.21.15.69:0/3517654049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f80764b0 0x7fc3f8114e30 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.929+0000 7fc3fd400700 1 -- 172.21.15.69:0/3517654049 >> 172.21.15.69:0/3517654049 conn(0x7fc3f8100040 msgr2=0x7fc3f8102460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:59.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.929+0000 7fc3fd400700 1 -- 172.21.15.69:0/3517654049 shutdown_connections 2024-05-14T15:28:59.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.929+0000 7fc3fd400700 1 -- 172.21.15.69:0/3517654049 wait complete. 2024-05-14T15:28:59.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.930+0000 7fc3fd400700 1 Processor -- start 2024-05-14T15:28:59.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.931+0000 7fc3fd400700 1 -- start start 2024-05-14T15:28:59.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.931+0000 7fc3fd400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f8075b60 0x7fc3f81a13b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:59.934 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.931+0000 7fc3fd400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3f80764b0 0x7fc3f81a1950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:59.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.931+0000 7fc3fd400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f8115370 0x7fc3f81a5be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:59.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.931+0000 7fc3fd400700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f811a9c0 con 0x7fc3f8115370 2024-05-14T15:28:59.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.931+0000 7fc3fd400700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f811a840 con 0x7fc3f80764b0 2024-05-14T15:28:59.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.931+0000 7fc3fd400700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc3f811ab40 con 0x7fc3f8075b60 2024-05-14T15:28:59.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.932+0000 7fc3f6800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f8075b60 0x7fc3f81a13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:59.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.932+0000 7fc3f6800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f8075b60 0x7fc3f81a13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:55232/0 (socket says 172.21.15.69:55232) 2024-05-14T15:28:59.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.932+0000 7fc3f6800700 1 -- 172.21.15.69:0/2862994158 learned_addr learned my addr 172.21.15.69:0/2862994158 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:59.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.932+0000 7fc3ede00700 1 --2- 172.21.15.69:0/2862994158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3f80764b0 0x7fc3f81a1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:59.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.932+0000 7fc3f7200700 1 --2- 172.21.15.69:0/2862994158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f8115370 0x7fc3f81a5be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:59.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.933+0000 7fc3f6800700 1 -- 172.21.15.69:0/2862994158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3f80764b0 msgr2=0x7fc3f81a1950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:59.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.933+0000 7fc3f6800700 1 --2- 172.21.15.69:0/2862994158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3f80764b0 0x7fc3f81a1950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.933+0000 7fc3f6800700 1 -- 172.21.15.69:0/2862994158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f8115370 msgr2=0x7fc3f81a5be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:59.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.933+0000 7fc3f6800700 1 --2- 172.21.15.69:0/2862994158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f8115370 0x7fc3f81a5be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.933+0000 7fc3f6800700 1 -- 172.21.15.69:0/2862994158 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3f81a6280 con 0x7fc3f8075b60 2024-05-14T15:28:59.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.933+0000 7fc3f7200700 1 --2- 172.21.15.69:0/2862994158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f8115370 0x7fc3f81a5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:28:59.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.934+0000 7fc3f6800700 1 --2- 172.21.15.69:0/2862994158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f8075b60 0x7fc3f81a13b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc3e800c920 tx=0x7fc3e800cc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:59.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.935+0000 7fc3efe00700 1 -- 172.21.15.69:0/2862994158 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8004a30 con 0x7fc3f8075b60 2024-05-14T15:28:59.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.935+0000 7fc3efe00700 1 -- 172.21.15.69:0/2862994158 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3e80054b0 con 0x7fc3f8075b60 2024-05-14T15:28:59.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.935+0000 7fc3fd400700 1 -- 172.21.15.69:0/2862994158 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3f81a6510 con 0x7fc3f8075b60 2024-05-14T15:28:59.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.935+0000 7fc3fd400700 1 -- 172.21.15.69:0/2862994158 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3f81ade90 con 0x7fc3f8075b60 2024-05-14T15:28:59.937 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.935+0000 7fc3efe00700 1 -- 172.21.15.69:0/2862994158 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8007b70 con 0x7fc3f8075b60 2024-05-14T15:28:59.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.943+0000 7fc40bea6b80 1 Processor -- start 2024-05-14T15:28:59.944 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.943+0000 7fc40bea6b80 1 -- start start 2024-05-14T15:28:59.945 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.943+0000 7fc3efe00700 1 -- 172.21.15.69:0/2862994158 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fc3e8004bd0 con 0x7fc3f8075b60 2024-05-14T15:28:59.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.944+0000 7fc40bea6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 0x55e598e156b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:59.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.944+0000 7fc40bea6b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598e15bf0 0x55e598e0f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:59.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.944+0000 7fc40bea6b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e0fc50 0x55e598e10060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:59.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.944+0000 7fc40bea6b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55e598d31a20 con 0x55e598e0fc50 2024-05-14T15:28:59.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.944+0000 7fc40bea6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e598ccf760 con 0x55e598c91e40 2024-05-14T15:28:59.946 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.944+0000 7fc40bea6b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e598d2d9e0 con 0x55e598e15bf0 2024-05-14T15:28:59.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.945+0000 7fc3f6800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598e15bf0 0x55e598e0f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:59.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.945+0000 7fc3ede00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e0fc50 0x55e598e10060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:59.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.945+0000 7fc3f7200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 0x55e598e156b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:59.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.945+0000 7fc3f7200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 0x55e598e156b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:38400/0 (socket says 172.21.15.69:38400) 2024-05-14T15:28:59.948 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.945+0000 7fc3f7200700 1 -- 172.21.15.69:0/2985495745 learned_addr learned my addr 172.21.15.69:0/2985495745 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:59.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.946+0000 7fc3ede00700 1 -- 172.21.15.69:0/2985495745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598e15bf0 msgr2=0x55e598e0f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:59.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.946+0000 7fc3ede00700 1 --2- 172.21.15.69:0/2985495745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598e15bf0 0x55e598e0f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.946+0000 7fc3ede00700 1 -- 172.21.15.69:0/2985495745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 msgr2=0x55e598e156b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:59.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.946+0000 7fc3efe00700 1 --2- 172.21.15.69:0/2862994158 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc3dc0b2a20 0x7fc3dc0b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:59.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.946+0000 7fc3ede00700 1 --2- 172.21.15.69:0/2985495745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 0x55e598e156b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.949 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.947+0000 7fc3ede00700 1 -- 172.21.15.69:0/2985495745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e598c7e8d0 con 0x55e598e0fc50 2024-05-14T15:28:59.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.947+0000 7fc3f6800700 1 --2- 172.21.15.69:0/2985495745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598e15bf0 0x55e598e0f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:28:59.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.948+0000 7fc3f7200700 1 --2- 172.21.15.69:0/2862994158 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc3dc0b2a20 0x7fc3dc0b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:59.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.948+0000 7fc3ede00700 1 --2- 172.21.15.69:0/2985495745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e0fc50 0x55e598e10060 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0009fd0 tx=0x7fc3e0009180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=938f0325d5f5bde3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:59.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.948+0000 7fc3efe00700 1 -- 172.21.15.69:0/2862994158 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7fc3e80e2450 con 0x7fc3f8075b60 2024-05-14T15:28:59.950 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.949+0000 7fc3e7e00700 1 -- 172.21.15.69:0/2985495745 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0003a00 con 0x55e598e0fc50 2024-05-14T15:28:59.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.949+0000 7fc3e7e00700 1 -- 172.21.15.69:0/2985495745 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3e0003ba0 con 0x55e598e0fc50 2024-05-14T15:28:59.951 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.949+0000 7fc3e7e00700 1 -- 172.21.15.69:0/2985495745 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e00052a0 con 0x55e598e0fc50 2024-05-14T15:28:59.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.950+0000 7fc40bea6b80 1 -- 172.21.15.69:0/2985495745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e0fc50 msgr2=0x55e598e10060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:59.952 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.950+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/2985495745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e0fc50 0x55e598e10060 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0009fd0 tx=0x7fc3e0009180 comp rx=0 tx=0).stop 2024-05-14T15:28:59.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.952+0000 7fc40bea6b80 1 -- 172.21.15.69:0/2985495745 shutdown_connections 2024-05-14T15:28:59.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.952+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/2985495745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e0fc50 0x55e598e10060 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.952+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/2985495745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 0x55e598e156b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.952+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/2985495745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598e15bf0 0x55e598e0f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.952+0000 7fc40bea6b80 1 -- 172.21.15.69:0/2985495745 >> 172.21.15.69:0/2985495745 conn(0x55e598cd0a80 msgr2=0x55e598e0a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:59.953 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.952+0000 7fc40bea6b80 1 -- 172.21.15.69:0/2985495745 shutdown_connections 2024-05-14T15:28:59.954 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.952+0000 7fc3f7200700 1 --2- 172.21.15.69:0/2862994158 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc3dc0b2a20 0x7fc3dc0b4f30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55e598e10a30 tx=0x7fc3f0004750 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:59.955 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.953+0000 7fc40bea6b80 1 -- 172.21.15.69:0/2985495745 wait complete. 2024-05-14T15:28:59.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.953+0000 7fc40bea6b80 1 -- start start 2024-05-14T15:28:59.956 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.955+0000 7fc40bea6b80 1 Processor -- start 2024-05-14T15:28:59.957 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.956+0000 7fc40bea6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 0x55e598e19310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:59.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.956+0000 7fc40bea6b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598e0fc50 0x55e598e19850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:59.958 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.956+0000 7fc40bea6b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e15bf0 0x55e598e19d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:59.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.957+0000 7fc40bea6b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55e598e1c660 con 0x55e598e15bf0 2024-05-14T15:28:59.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.957+0000 7fc40bea6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e598c97b20 con 0x55e598c91e40 2024-05-14T15:28:59.959 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.957+0000 7fc3f6800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 0x55e598e19310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.957+0000 7fc40bea6b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e598e1c7e0 con 0x55e598e0fc50 2024-05-14T15:28:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.957+0000 7fc3f6800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 0x55e598e19310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:38416/0 (socket says 172.21.15.69:38416) 2024-05-14T15:28:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.957+0000 7fc3f6800700 1 -- 172.21.15.69:0/2674394316 learned_addr learned my addr 172.21.15.69:0/2674394316 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:28:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.957+0000 7fc40bea6b80 10 client.0 _ll_register_callbacks cb 0x55e598cc5380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:28:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.957+0000 7fc3ede00700 1 --2- 172.21.15.69:0/2674394316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598e0fc50 0x55e598e19850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.957+0000 7fc3f7200700 1 --2- 172.21.15.69:0/2674394316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e15bf0 0x55e598e19d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.957+0000 7fc3f6800700 1 -- 172.21.15.69:0/2674394316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598e0fc50 msgr2=0x55e598e19850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.957+0000 7fc3f6800700 1 --2- 172.21.15.69:0/2674394316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598e0fc50 0x55e598e19850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.957+0000 7fc3f6800700 1 -- 172.21.15.69:0/2674394316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e15bf0 msgr2=0x55e598e19d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:28:59.960 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.958+0000 7fc3f6800700 1 --2- 172.21.15.69:0/2674394316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e15bf0 0x55e598e19d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.958+0000 7fc3f6800700 1 -- 172.21.15.69:0/2674394316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e598cf7420 con 0x55e598c91e40 2024-05-14T15:28:59.961 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.958+0000 7fc3f7200700 1 --2- 172.21.15.69:0/2674394316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e15bf0 0x55e598e19d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:28:59.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.959+0000 7fc3f6800700 1 --2- 172.21.15.69:0/2674394316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 0x55e598e19310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80dfd90 tx=0x7fc3e8007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54c6f2d5cfc7116b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:28:59.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.959+0000 7fc3e4c00700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:28:59.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.959+0000 7fc3e4c00700 1 -- 172.21.15.69:0/2674394316 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e801d040 con 0x55e598c91e40 2024-05-14T15:28:59.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.960+0000 7fc40bea6b80 1 -- 172.21.15.69:0/2674394316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc3e0003ba0 con 0x55e598c91e40 2024-05-14T15:28:59.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.960+0000 7fc3e4c00700 1 -- 172.21.15.69:0/2674394316 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7fc3e80a9790 con 0x55e598c91e40 2024-05-14T15:28:59.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.960+0000 7fc3e4c00700 1 -- 172.21.15.69:0/2674394316 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fc3e80a8a90 con 0x55e598c91e40 2024-05-14T15:28:59.962 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.960+0000 7fc40bea6b80 10 client.36233 fetch_fsmap learned FSMap version 54 2024-05-14T15:28:59.963 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.961+0000 7fc40bea6b80 1 -- 172.21.15.69:0/2674394316 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55e598e27250 con 0x55e598c91e40 2024-05-14T15:28:59.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.961+0000 7fc3e4c00700 1 -- 172.21.15.69:0/2674394316 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fc3e0003ba0 con 0x55e598c91e40 2024-05-14T15:28:59.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.962+0000 7fc3e4c00700 1 -- 172.21.15.69:0/2674394316 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7fc3e80b1cf0 con 0x55e598c91e40 2024-05-14T15:28:59.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.962+0000 7fc40bea6b80 10 client.36233 fetch_fsmap finished waiting for FSMap version 54 2024-05-14T15:28:59.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.962+0000 7fc40bea6b80 10 client.36233 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.i 2024-05-14T15:28:59.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.962+0000 7fc40bea6b80 20 client.36233 populate_metadata read hostname 'smithi069' 2024-05-14T15:28:59.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.962+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/2674394316 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55e598e297e0 0x55e598e2bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:59.964 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.962+0000 7fc40bea6b80 4 client.36233 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:28:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.962+0000 7fc40bea6b80 1 -- 172.21.15.69:0/2674394316 --> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e598ddc070 con 0x55e598e297e0 2024-05-14T15:28:59.965 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.963+0000 7fc3ede00700 1 --2- 172.21.15.69:0/2674394316 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55e598e297e0 0x55e598e2bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:59.966 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.965+0000 7fc3ede00700 1 --2- 172.21.15.69:0/2674394316 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55e598e297e0 0x55e598e2bc00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=4db3ff0511889cbf server_cookie=1c8b99e4b01b0a21 in_seq=0 out_seq=0 2024-05-14T15:28:59.967 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.965+0000 7fc3e4c00700 10 client.36233 ms_handle_connect on v2:172.21.15.203:6838/3167469844 2024-05-14T15:28:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.967+0000 7fc3e4c00700 1 -- 172.21.15.69:0/2674394316 <== mds.4 v2:172.21.15.203:6838/3167469844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e598ddc070 con 0x55e598e297e0 2024-05-14T15:28:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.967+0000 7fc3e4c00700 10 client.36233 handle_command_reply: tid=0 2024-05-14T15:28:59.968 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.967+0000 7fc40bea6b80 1 client.36233 shutdown 2024-05-14T15:28:59.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.967+0000 7fc40bea6b80 1 -- 172.21.15.69:0/2674394316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 msgr2=0x55e598e19310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:28:59.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.967+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/2674394316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 0x55e598e19310 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80dfd90 tx=0x7fc3e8007f90 comp rx=0 tx=0).stop 2024-05-14T15:28:59.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.968+0000 7fc40bea6b80 1 -- 172.21.15.69:0/2674394316 shutdown_connections 2024-05-14T15:28:59.969 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.968+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/2674394316 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55e598e297e0 0x55e598e2bc00 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.968+0000 7fc3e4c00700 0 client.36233 ms_handle_reset on v2:172.21.15.203:6838/3167469844 2024-05-14T15:28:59.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.968+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/2674394316 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e15bf0 0x55e598e19d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.968+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/2674394316 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 0x55e598e19310 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.968+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/2674394316 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598e0fc50 0x55e598e19850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:28:59.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.968+0000 7fc40bea6b80 1 -- 172.21.15.69:0/2674394316 >> 172.21.15.69:0/2674394316 conn(0x55e598cd0a80 msgr2=0x55e598e0e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:28:59.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.968+0000 7fc40bea6b80 1 -- 172.21.15.69:0/2674394316 shutdown_connections 2024-05-14T15:28:59.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.968+0000 7fc40bea6b80 1 -- 172.21.15.69:0/2674394316 wait complete. 2024-05-14T15:28:59.970 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.969+0000 7fc40bea6b80 20 client.36233 trim_cache size 0 max 16384 2024-05-14T15:28:59.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.995+0000 7fc40bea6b80 1 Processor -- start 2024-05-14T15:28:59.997 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.995+0000 7fc40bea6b80 1 -- start start 2024-05-14T15:28:59.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.996+0000 7fc40bea6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 0x55e598e0f710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:59.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.996+0000 7fc40bea6b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e0fc50 0x55e598e14b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:59.998 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.996+0000 7fc40bea6b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598e15bf0 0x55e598e25720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:28:59.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.996+0000 7fc40bea6b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d400eec0 con 0x55e598e0fc50 2024-05-14T15:28:59.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.996+0000 7fc40bea6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d4010b80 con 0x55e598c91e40 2024-05-14T15:28:59.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.996+0000 7fc40bea6b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d400f590 con 0x55e598e15bf0 2024-05-14T15:28:59.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.997+0000 7fc3ede00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e0fc50 0x55e598e14b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:28:59.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.997+0000 7fc3ede00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e0fc50 0x55e598e14b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56590/0 (socket says 172.21.15.69:56590) 2024-05-14T15:28:59.999 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.997+0000 7fc3ede00700 1 -- 172.21.15.69:0/1038664130 learned_addr learned my addr 172.21.15.69:0/1038664130 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:00.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.997+0000 7fc3f6800700 1 --2- 172.21.15.69:0/1038664130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 0x55e598e0f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:00.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.997+0000 7fc3f7200700 1 --2- 172.21.15.69:0/1038664130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598e15bf0 0x55e598e25720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:00.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.997+0000 7fc3ede00700 1 -- 172.21.15.69:0/1038664130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598e15bf0 msgr2=0x55e598e25720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:00.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.998+0000 7fc3ede00700 1 --2- 172.21.15.69:0/1038664130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598e15bf0 0x55e598e25720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:00.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.998+0000 7fc3ede00700 1 -- 172.21.15.69:0/1038664130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 msgr2=0x55e598e0f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:00.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.998+0000 7fc3ede00700 1 --2- 172.21.15.69:0/1038664130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 0x55e598e0f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:00.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.998+0000 7fc3ede00700 1 -- 172.21.15.69:0/1038664130 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e598e0b5e0 con 0x55e598e0fc50 2024-05-14T15:29:00.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.998+0000 7fc3f6800700 1 --2- 172.21.15.69:0/1038664130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 0x55e598e0f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:29:00.000 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.998+0000 7fc3ede00700 1 --2- 172.21.15.69:0/1038664130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e0fc50 0x55e598e14b80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0000f80 tx=0x7fc3e0009180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c91415f167229a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:00.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.999+0000 7fc3e7400700 1 -- 172.21.15.69:0/1038664130 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0032070 con 0x55e598e0fc50 2024-05-14T15:29:00.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.999+0000 7fc3e7400700 1 -- 172.21.15.69:0/1038664130 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55e598ddc070 con 0x55e598e0fc50 2024-05-14T15:29:00.001 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:28:59.999+0000 7fc3e7400700 1 -- 172.21.15.69:0/1038664130 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3e0007940 con 0x55e598e0fc50 2024-05-14T15:29:00.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.000+0000 7fc40bea6b80 1 -- 172.21.15.69:0/1038664130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e0fc50 msgr2=0x55e598e14b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:00.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.000+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/1038664130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e0fc50 0x55e598e14b80 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fc3e0000f80 tx=0x7fc3e0009180 comp rx=0 tx=0).stop 2024-05-14T15:29:00.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.001+0000 7fc40bea6b80 1 -- 172.21.15.69:0/1038664130 shutdown_connections 2024-05-14T15:29:00.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.001+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/1038664130 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598e15bf0 0x55e598e25720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:00.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.001+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/1038664130 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598c91e40 0x55e598e0f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:00.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.001+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/1038664130 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e0fc50 0x55e598e14b80 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:00.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.001+0000 7fc40bea6b80 1 -- 172.21.15.69:0/1038664130 >> 172.21.15.69:0/1038664130 conn(0x55e598cd0a80 msgr2=0x55e598e14470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:00.003 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.001+0000 7fc40bea6b80 1 -- 172.21.15.69:0/1038664130 shutdown_connections 2024-05-14T15:29:00.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.001+0000 7fc40bea6b80 1 -- 172.21.15.69:0/1038664130 wait complete. 2024-05-14T15:29:00.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.002+0000 7fc40bea6b80 1 -- start start 2024-05-14T15:29:00.004 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.002+0000 7fc40bea6b80 1 Processor -- start 2024-05-14T15:29:00.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.003+0000 7fc40bea6b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598c91e40 0x55e598e21f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:00.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.003+0000 7fc40bea6b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598e0fc50 0x55e598e307d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:00.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.004+0000 7fc40bea6b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e15bf0 0x55e598e30d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:00.005 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.004+0000 7fc40bea6b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d40103f0 con 0x55e598e15bf0 2024-05-14T15:29:00.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.004+0000 7fc40bea6b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d400fc60 con 0x55e598e0fc50 2024-05-14T15:29:00.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.004+0000 7fc40bea6b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d400ce80 con 0x55e598c91e40 2024-05-14T15:29:00.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.004+0000 7fc3f6800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598c91e40 0x55e598e21f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:00.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.004+0000 7fc3f6800700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598c91e40 0x55e598e21f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:55278/0 (socket says 172.21.15.69:55278) 2024-05-14T15:29:00.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.004+0000 7fc40bea6b80 10 client.0 _ll_register_callbacks cb 0x55e598cc5380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:00.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.004+0000 7fc3f7200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e15bf0 0x55e598e30d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:00.006 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.005+0000 7fc3f6800700 1 -- 172.21.15.69:0/144830486 learned_addr learned my addr 172.21.15.69:0/144830486 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:00.007 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.005+0000 7fc3ede00700 1 --2- 172.21.15.69:0/144830486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598e0fc50 0x55e598e307d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:00.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.007+0000 7fc3f7200700 1 -- 172.21.15.69:0/144830486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598c91e40 msgr2=0x55e598e21f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:00.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.007+0000 7fc3f7200700 1 --2- 172.21.15.69:0/144830486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598c91e40 0x55e598e21f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:00.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.007+0000 7fc3f7200700 1 -- 172.21.15.69:0/144830486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598e0fc50 msgr2=0x55e598e307d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:00.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.007+0000 7fc3f7200700 1 --2- 172.21.15.69:0/144830486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598e0fc50 0x55e598e307d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:00.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.007+0000 7fc3f7200700 1 -- 172.21.15.69:0/144830486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e598e31380 con 0x55e598e15bf0 2024-05-14T15:29:00.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.007+0000 7fc3f6800700 1 --2- 172.21.15.69:0/144830486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598c91e40 0x55e598e21f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:29:00.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.008+0000 7fc3f7200700 1 --2- 172.21.15.69:0/144830486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e15bf0 0x55e598e30d10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000bfa0 tx=0x7fc3f0014040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0806463387f7672 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:00.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.008+0000 7fc3e4c00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:29:00.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.009+0000 7fc3e4c00700 1 -- 172.21.15.69:0/144830486 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3f001ee60 con 0x55e598e15bf0 2024-05-14T15:29:00.010 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.009+0000 7fc3e4c00700 1 -- 172.21.15.69:0/144830486 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 9554+0+0 (secure 0 0 0) 0x7fc3f0004440 con 0x55e598e15bf0 2024-05-14T15:29:00.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.009+0000 7fc40bea6b80 1 -- 172.21.15.69:0/144830486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e598ddc070 con 0x55e598e15bf0 2024-05-14T15:29:00.011 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.009+0000 7fc3e4c00700 1 -- 172.21.15.69:0/144830486 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=54) ==== 24+0+0 (secure 0 0 0) 0x7fc3f0010880 con 0x55e598e15bf0 2024-05-14T15:29:00.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.010+0000 7fc40bea6b80 10 client.16743 fetch_fsmap learned FSMap version 54 2024-05-14T15:29:00.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.010+0000 7fc40bea6b80 1 -- 172.21.15.69:0/144830486 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=54,monmap=4+}) -- 0x55e598e93dc0 con 0x55e598e15bf0 2024-05-14T15:29:00.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.011+0000 7fc3e4c00700 1 -- 172.21.15.69:0/144830486 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55e598ddc070 con 0x55e598e15bf0 2024-05-14T15:29:00.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.012+0000 7fc3e4c00700 1 -- 172.21.15.69:0/144830486 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 54) ==== 8402+0+0 (secure 0 0 0) 0x7fc3f0028430 con 0x55e598e15bf0 2024-05-14T15:29:00.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.012+0000 7fc40bea6b80 10 client.16743 fetch_fsmap finished waiting for FSMap version 54 2024-05-14T15:29:00.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.012+0000 7fc40bea6b80 10 client.16743 resolve_mds: resolved 1:4 to role '1:4' aka daemon mds.i 2024-05-14T15:29:00.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.012+0000 7fc40bea6b80 20 client.16743 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:00.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.012+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/144830486 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55e598e297e0 0x55e598e96530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:00.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.012+0000 7fc40bea6b80 4 client.16743 mds_command: new command op to 24451 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:29:00.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.012+0000 7fc40bea6b80 1 -- 172.21.15.69:0/144830486 --> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e598d3f400 con 0x55e598e297e0 2024-05-14T15:29:00.014 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.013+0000 7fc3f6800700 1 --2- 172.21.15.69:0/144830486 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55e598e297e0 0x55e598e96530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:00.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.014+0000 7fc3e4c00700 10 client.16743 ms_handle_connect on v2:172.21.15.203:6838/3167469844 2024-05-14T15:29:00.015 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.014+0000 7fc3f6800700 1 --2- 172.21.15.69:0/144830486 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55e598e297e0 0x55e598e96530 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=8345f2abbd683a45 server_cookie=265bcf1691830aa6 in_seq=0 out_seq=0 2024-05-14T15:29:00.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.015+0000 7fc3e4c00700 1 -- 172.21.15.69:0/144830486 <== mds.4 v2:172.21.15.203:6838/3167469844 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e598d3f400 con 0x55e598e297e0 2024-05-14T15:29:00.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.015+0000 7fc3e4c00700 10 client.16743 handle_command_reply: tid=0 2024-05-14T15:29:00.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.015+0000 7fc40bea6b80 1 client.16743 shutdown 2024-05-14T15:29:00.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.015+0000 7fc40bea6b80 1 -- 172.21.15.69:0/144830486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e15bf0 msgr2=0x55e598e30d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:00.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.015+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/144830486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e15bf0 0x55e598e30d10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000bfa0 tx=0x7fc3f0014040 comp rx=0 tx=0).stop 2024-05-14T15:29:00.017 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.016+0000 7fc40bea6b80 1 -- 172.21.15.69:0/144830486 shutdown_connections 2024-05-14T15:29:00.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.016+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/144830486 >> [v2:172.21.15.203:6838/3167469844,v1:172.21.15.203:6839/3167469844] conn(0x55e598e297e0 0x55e598e96530 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:00.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.016+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/144830486 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e598e15bf0 0x55e598e30d10 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:00.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.016+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/144830486 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e598c91e40 0x55e598e21f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:00.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.016+0000 7fc40bea6b80 1 --2- 172.21.15.69:0/144830486 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e598e0fc50 0x55e598e307d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:00.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.016+0000 7fc40bea6b80 1 -- 172.21.15.69:0/144830486 >> 172.21.15.69:0/144830486 conn(0x55e598cd0a80 msgr2=0x55e598e192d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:00.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.016+0000 7fc3e4c00700 0 client.16743 ms_handle_reset on v2:172.21.15.203:6838/3167469844 2024-05-14T15:29:00.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.016+0000 7fc40bea6b80 1 -- 172.21.15.69:0/144830486 shutdown_connections 2024-05-14T15:29:00.018 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.016+0000 7fc40bea6b80 1 -- 172.21.15.69:0/144830486 wait complete. 2024-05-14T15:29:00.019 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.016+0000 7fc40bea6b80 20 client.16743 trim_cache size 0 max 16384 2024-05-14T15:29:00.019 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:29:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.017+0000 7fc3fd400700 1 -- 172.21.15.69:0/2862994158 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc3dc0b2a20 msgr2=0x7fc3dc0b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.017+0000 7fc3fd400700 1 --2- 172.21.15.69:0/2862994158 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc3dc0b2a20 0x7fc3dc0b4f30 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x55e598e10a30 tx=0x7fc3f0004750 comp rx=0 tx=0).stop 2024-05-14T15:29:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.017+0000 7fc3fd400700 1 -- 172.21.15.69:0/2862994158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f8075b60 msgr2=0x7fc3f81a13b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.017+0000 7fc3fd400700 1 --2- 172.21.15.69:0/2862994158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f8075b60 0x7fc3f81a13b0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc3e800c920 tx=0x7fc3e800cc30 comp rx=0 tx=0).stop 2024-05-14T15:29:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.017+0000 7fc3fd400700 1 -- 172.21.15.69:0/2862994158 shutdown_connections 2024-05-14T15:29:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.018+0000 7fc3fd400700 1 --2- 172.21.15.69:0/2862994158 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fc3dc0b2a20 0x7fc3dc0b4f30 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.018+0000 7fc3fd400700 1 --2- 172.21.15.69:0/2862994158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fc3f8115370 0x7fc3f81a5be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.018+0000 7fc3fd400700 1 --2- 172.21.15.69:0/2862994158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fc3f8075b60 0x7fc3f81a13b0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.018+0000 7fc3fd400700 1 --2- 172.21.15.69:0/2862994158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fc3f80764b0 0x7fc3f81a1950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.018+0000 7fc3fd400700 1 -- 172.21.15.69:0/2862994158 >> 172.21.15.69:0/2862994158 conn(0x7fc3f8100040 msgr2=0x7fc3f8100830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.018+0000 7fc3fd400700 1 -- 172.21.15.69:0/2862994158 shutdown_connections 2024-05-14T15:29:00.020 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:00.018+0000 7fc3fd400700 1 -- 172.21.15.69:0/2862994158 wait complete. 2024-05-14T15:29:01.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 195.0 s, 550.8 tps, lat 182.641 ms stddev 250.364 2024-05-14T15:29:01.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:01 smithi092 ceph-mon[34729]: pgmap v226: 129 pgs: 129 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 14 MiB/s wr, 861 op/s 2024-05-14T15:29:01.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:01 smithi069 ceph-mon[31270]: pgmap v226: 129 pgs: 129 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 14 MiB/s wr, 861 op/s 2024-05-14T15:29:01.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:01 smithi203 ceph-mon[34567]: pgmap v226: 129 pgs: 129 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 14 MiB/s wr, 861 op/s 2024-05-14T15:29:01.699 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:3 damage ls 2024-05-14T15:29:02.459 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:29:03.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:03 smithi069 ceph-mon[31270]: pgmap v227: 129 pgs: 129 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 9.3 MiB/s wr, 611 op/s 2024-05-14T15:29:03.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:03 smithi069 ceph-mon[31270]: osdmap e95: 12 total, 12 up, 12 in 2024-05-14T15:29:03.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:03 smithi092 ceph-mon[34729]: pgmap v227: 129 pgs: 129 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 9.3 MiB/s wr, 611 op/s 2024-05-14T15:29:03.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:03 smithi092 ceph-mon[34729]: osdmap e95: 12 total, 12 up, 12 in 2024-05-14T15:29:03.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:03 smithi203 ceph-mon[34567]: pgmap v227: 129 pgs: 129 active+clean; 2.4 GiB data, 9.0 GiB used, 1.0 TiB / 1.0 TiB avail; 74 KiB/s rd, 9.3 MiB/s wr, 611 op/s 2024-05-14T15:29:03.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:03 smithi203 ceph-mon[34567]: osdmap e95: 12 total, 12 up, 12 in 2024-05-14T15:29:05.418 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:05 smithi069 ceph-mon[31270]: pgmap v229: 129 pgs: 129 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 9.2 MiB/s wr, 624 op/s 2024-05-14T15:29:05.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:05 smithi092 ceph-mon[34729]: pgmap v229: 129 pgs: 129 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 9.2 MiB/s wr, 624 op/s 2024-05-14T15:29:05.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:05 smithi203 ceph-mon[34567]: pgmap v229: 129 pgs: 129 active+clean; 2.4 GiB data, 9.1 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 9.2 MiB/s wr, 624 op/s 2024-05-14T15:29:06.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 200.0 s, 409.8 tps, lat 243.961 ms stddev 316.524 2024-05-14T15:29:07.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:07 smithi092 ceph-mon[34729]: pgmap v230: 129 pgs: 129 active+clean; 2.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 9.4 MiB/s wr, 658 op/s 2024-05-14T15:29:07.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:07 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:29:07.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:07 smithi069 ceph-mon[31270]: pgmap v230: 129 pgs: 129 active+clean; 2.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 9.4 MiB/s wr, 658 op/s 2024-05-14T15:29:07.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:07 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:29:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:07 smithi203 ceph-mon[34567]: pgmap v230: 129 pgs: 129 active+clean; 2.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 9.4 MiB/s wr, 658 op/s 2024-05-14T15:29:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:07 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:29:08.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.327+0000 7f04d5400700 1 -- 172.21.15.69:0/3115485812 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d000bab0 con 0x7f04d81102a0 2024-05-14T15:29:08.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.328+0000 7f04dca00700 1 -- 172.21.15.69:0/3115485812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04d81102a0 msgr2=0x7f04d8117c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.328+0000 7f04dca00700 1 --2- 172.21.15.69:0/3115485812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04d81102a0 0x7f04d8117c00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009990 tx=0x7f04d0009ca0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.328+0000 7f04dca00700 1 -- 172.21.15.69:0/3115485812 shutdown_connections 2024-05-14T15:29:08.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.328+0000 7f04dca00700 1 --2- 172.21.15.69:0/3115485812 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04d81102a0 0x7f04d8117c00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.328+0000 7f04dca00700 1 --2- 172.21.15.69:0/3115485812 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d810b020 0x7f04d810b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.328+0000 7f04dca00700 1 --2- 172.21.15.69:0/3115485812 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d810f950 0x7f04d810fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.328+0000 7f04dca00700 1 -- 172.21.15.69:0/3115485812 >> 172.21.15.69:0/3115485812 conn(0x7f04d806f990 msgr2=0x7f04d806fda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:08.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.328+0000 7f04dca00700 1 -- 172.21.15.69:0/3115485812 shutdown_connections 2024-05-14T15:29:08.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.329+0000 7f04dca00700 1 -- 172.21.15.69:0/3115485812 wait complete. 2024-05-14T15:29:08.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.330+0000 7f04dca00700 1 Processor -- start 2024-05-14T15:29:08.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.331+0000 7f04dca00700 1 -- start start 2024-05-14T15:29:08.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.332+0000 7f04dca00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d810b020 0x7f04d81a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.332+0000 7f04dca00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04d810f950 0x7f04d81a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.332+0000 7f04dca00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d81102a0 0x7f04d81a5b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.333+0000 7f04dca00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f04d811aa10 con 0x7f04d810b020 2024-05-14T15:29:08.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.333+0000 7f04dca00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f04d811a890 con 0x7f04d81102a0 2024-05-14T15:29:08.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.333+0000 7f04dca00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f04d811ab90 con 0x7f04d810f950 2024-05-14T15:29:08.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.334+0000 7f04cd400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04d810f950 0x7f04d81a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.334+0000 7f04d6800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d81102a0 0x7f04d81a5b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.334+0000 7f04d6800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d81102a0 0x7f04d81a5b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:60156/0 (socket says 172.21.15.69:60156) 2024-05-14T15:29:08.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.334+0000 7f04d6800700 1 -- 172.21.15.69:0/3180589638 learned_addr learned my addr 172.21.15.69:0/3180589638 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:08.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.334+0000 7f04cd400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04d810f950 0x7f04d81a18c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:34792/0 (socket says 172.21.15.69:34792) 2024-05-14T15:29:08.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.334+0000 7f04d5e00700 1 --2- 172.21.15.69:0/3180589638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d810b020 0x7f04d81a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.335+0000 7f04cd400700 1 -- 172.21.15.69:0/3180589638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d81102a0 msgr2=0x7f04d81a5b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.335+0000 7f04cd400700 1 --2- 172.21.15.69:0/3180589638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d81102a0 0x7f04d81a5b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.335+0000 7f04cd400700 1 -- 172.21.15.69:0/3180589638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d810b020 msgr2=0x7f04d81a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.335+0000 7f04cd400700 1 --2- 172.21.15.69:0/3180589638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d810b020 0x7f04d81a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.335+0000 7f04cd400700 1 -- 172.21.15.69:0/3180589638 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04d81a61f0 con 0x7f04d810f950 2024-05-14T15:29:08.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.336+0000 7f04d5e00700 1 --2- 172.21.15.69:0/3180589638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d810b020 0x7f04d81a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:29:08.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.336+0000 7f04cd400700 1 --2- 172.21.15.69:0/3180589638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04d810f950 0x7f04d81a18c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f04c00123c0 tx=0x7f04c00126d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:08.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.336+0000 7f04cf400700 1 -- 172.21.15.69:0/3180589638 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c00092d0 con 0x7f04d810f950 2024-05-14T15:29:08.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.336+0000 7f04dca00700 1 -- 172.21.15.69:0/3180589638 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04d81a6480 con 0x7f04d810f950 2024-05-14T15:29:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.337+0000 7f04dca00700 1 -- 172.21.15.69:0/3180589638 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04d81ade00 con 0x7f04d810f950 2024-05-14T15:29:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.337+0000 7f04cf400700 1 -- 172.21.15.69:0/3180589638 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04c001d070 con 0x7f04d810f950 2024-05-14T15:29:08.340 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.337+0000 7f04cf400700 1 -- 172.21.15.69:0/3180589638 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c0018780 con 0x7f04d810f950 2024-05-14T15:29:08.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.345+0000 7f04eb588b80 1 Processor -- start 2024-05-14T15:29:08.349 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.346+0000 7f04eb588b80 1 -- start start 2024-05-14T15:29:08.350 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.346+0000 7f04eb588b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7daa4ae40 0x55f7dabd6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.346+0000 7f04eb588b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd7010 0x55f7dabd0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.346+0000 7f04eb588b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7dabd1200 0x55f7dabd1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.346+0000 7f04eb588b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55f7daaeaa20 con 0x55f7dabd1200 2024-05-14T15:29:08.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.346+0000 7f04eb588b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f7daa88760 con 0x55f7daa4ae40 2024-05-14T15:29:08.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.346+0000 7f04eb588b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f7daae69e0 con 0x55f7dabd7010 2024-05-14T15:29:08.351 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.348+0000 7f04cf400700 1 -- 172.21.15.69:0/3180589638 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f04c0017070 con 0x7f04d810f950 2024-05-14T15:29:08.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.349+0000 7f04d6800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7daa4ae40 0x55f7dabd6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.349+0000 7f04d6800700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7daa4ae40 0x55f7dabd6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:60172/0 (socket says 172.21.15.69:60172) 2024-05-14T15:29:08.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.349+0000 7f04d6800700 1 -- 172.21.15.69:0/2902008936 learned_addr learned my addr 172.21.15.69:0/2902008936 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:08.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.349+0000 7f04cd400700 1 --2- 172.21.15.69:0/2902008936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7dabd1200 0x55f7dabd1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.352 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.349+0000 7f04d5e00700 1 --2- 172.21.15.69:0/2902008936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd7010 0x55f7dabd0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.353 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.349+0000 7f04d6800700 1 -- 172.21.15.69:0/2902008936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd7010 msgr2=0x55f7dabd0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:08.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.349+0000 7f04d6800700 1 --2- 172.21.15.69:0/2902008936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd7010 0x55f7dabd0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.349+0000 7f04d6800700 1 -- 172.21.15.69:0/2902008936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7dabd1200 msgr2=0x55f7dabd1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:08.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.349+0000 7f04d6800700 1 --2- 172.21.15.69:0/2902008936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7dabd1200 0x55f7dabd1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.349+0000 7f04d6800700 1 -- 172.21.15.69:0/2902008936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7daa378d0 con 0x55f7daa4ae40 2024-05-14T15:29:08.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.350+0000 7f04d6800700 1 --2- 172.21.15.69:0/2902008936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7daa4ae40 0x55f7dabd6ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009750 tx=0x7f04d0005050 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9deafaa2e43049a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:08.354 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.350+0000 7f04c7400700 1 -- 172.21.15.69:0/2902008936 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d0027070 con 0x55f7daa4ae40 2024-05-14T15:29:08.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.351+0000 7f04c7400700 1 -- 172.21.15.69:0/2902008936 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04d0003b10 con 0x55f7daa4ae40 2024-05-14T15:29:08.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.351+0000 7f04c7400700 1 -- 172.21.15.69:0/2902008936 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d000bcf0 con 0x55f7daa4ae40 2024-05-14T15:29:08.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.352+0000 7f04cf400700 1 --2- 172.21.15.69:0/3180589638 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f04bc0b2af0 0x7f04bc0b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.353+0000 7f04eb588b80 1 -- 172.21.15.69:0/2902008936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7daa4ae40 msgr2=0x55f7dabd6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.353+0000 7f04eb588b80 1 --2- 172.21.15.69:0/2902008936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7daa4ae40 0x55f7dabd6ad0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f04d0009750 tx=0x7f04d0005050 comp rx=0 tx=0).stop 2024-05-14T15:29:08.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.353+0000 7f04cf400700 1 -- 172.21.15.69:0/3180589638 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9642+0+0 (secure 0 0 0) 0x7f04c00e2260 con 0x7f04d810f950 2024-05-14T15:29:08.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.353+0000 7f04d5e00700 1 --2- 172.21.15.69:0/3180589638 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f04bc0b2af0 0x7f04bc0b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.353+0000 7f04eb588b80 1 -- 172.21.15.69:0/2902008936 shutdown_connections 2024-05-14T15:29:08.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.353+0000 7f04eb588b80 1 --2- 172.21.15.69:0/2902008936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7dabd1200 0x55f7dabd1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.353+0000 7f04eb588b80 1 --2- 172.21.15.69:0/2902008936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7daa4ae40 0x55f7dabd6ad0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.353+0000 7f04eb588b80 1 --2- 172.21.15.69:0/2902008936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd7010 0x55f7dabd0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.356 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.353+0000 7f04eb588b80 1 -- 172.21.15.69:0/2902008936 >> 172.21.15.69:0/2902008936 conn(0x55f7daa8ff70 msgr2=0x55f7dabc32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:08.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.354+0000 7f04eb588b80 1 -- 172.21.15.69:0/2902008936 shutdown_connections 2024-05-14T15:29:08.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.354+0000 7f04eb588b80 1 -- 172.21.15.69:0/2902008936 wait complete. 2024-05-14T15:29:08.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.354+0000 7f04d5e00700 1 --2- 172.21.15.69:0/3180589638 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f04bc0b2af0 0x7f04bc0b5000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55f7dabc4ab0 tx=0x7f04c8009260 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:08.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.355+0000 7f04eb588b80 1 -- start start 2024-05-14T15:29:08.360 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.358+0000 7f04eb588b80 1 Processor -- start 2024-05-14T15:29:08.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.360+0000 7f04eb588b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7daa4ae40 0x55f7dabda720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.362 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.360+0000 7f04eb588b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd1200 0x55f7dabdac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.360+0000 7f04eb588b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd7010 0x55f7dabdb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.363 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.360+0000 7f04eb588b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55f7dabddab0 con 0x55f7daa4ae40 2024-05-14T15:29:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.361+0000 7f04d5e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7daa4ae40 0x55f7dabda720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.361+0000 7f04eb588b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f7daa50b20 con 0x55f7dabd1200 2024-05-14T15:29:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.361+0000 7f04eb588b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f7dabddc30 con 0x55f7dabd7010 2024-05-14T15:29:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.361+0000 7f04cd400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd1200 0x55f7dabdac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.361+0000 7f04eb588b80 10 client.0 _ll_register_callbacks cb 0x55f7daa91c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.361+0000 7f04d5e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7daa4ae40 0x55f7dabda720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60462/0 (socket says 172.21.15.69:60462) 2024-05-14T15:29:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.361+0000 7f04d5e00700 1 -- 172.21.15.69:0/1262580632 learned_addr learned my addr 172.21.15.69:0/1262580632 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:08.364 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.361+0000 7f04d6800700 1 --2- 172.21.15.69:0/1262580632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd7010 0x55f7dabdb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.365 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.362+0000 7f04d5e00700 1 -- 172.21.15.69:0/1262580632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd7010 msgr2=0x55f7dabdb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:08.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.362+0000 7f04d5e00700 1 --2- 172.21.15.69:0/1262580632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd7010 0x55f7dabdb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.362+0000 7f04d5e00700 1 -- 172.21.15.69:0/1262580632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd1200 msgr2=0x55f7dabdac60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:08.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.362+0000 7f04d5e00700 1 --2- 172.21.15.69:0/1262580632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd1200 0x55f7dabdac60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.362+0000 7f04d5e00700 1 -- 172.21.15.69:0/1262580632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7daab0420 con 0x55f7daa4ae40 2024-05-14T15:29:08.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.363+0000 7f04d5e00700 1 --2- 172.21.15.69:0/1262580632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7daa4ae40 0x55f7dabda720 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f04c801cbb0 tx=0x7f04c8004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c1b9f96e2a7174 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:08.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.363+0000 7f04bbe00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:29:08.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.366+0000 7f04bbe00700 1 -- 172.21.15.69:0/1262580632 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8010ca0 con 0x55f7daa4ae40 2024-05-14T15:29:08.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.366+0000 7f04bbe00700 1 -- 172.21.15.69:0/1262580632 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9642+0+0 (secure 0 0 0) 0x7f04c8010e40 con 0x55f7daa4ae40 2024-05-14T15:29:08.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.366+0000 7f04eb588b80 1 -- 172.21.15.69:0/1262580632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04d0003b10 con 0x55f7daa4ae40 2024-05-14T15:29:08.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.368+0000 7f04bbe00700 1 -- 172.21.15.69:0/1262580632 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f04c80099d0 con 0x55f7daa4ae40 2024-05-14T15:29:08.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.368+0000 7f04eb588b80 10 client.16752 fetch_fsmap learned FSMap version 55 2024-05-14T15:29:08.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.368+0000 7f04eb588b80 1 -- 172.21.15.69:0/1262580632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55f7dabe8620 con 0x55f7daa4ae40 2024-05-14T15:29:08.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.369+0000 7f04bbe00700 1 -- 172.21.15.69:0/1262580632 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04d0003b10 con 0x55f7daa4ae40 2024-05-14T15:29:08.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.369+0000 7f04bbe00700 1 -- 172.21.15.69:0/1262580632 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 55) ==== 8398+0+0 (secure 0 0 0) 0x7f04c8019040 con 0x55f7daa4ae40 2024-05-14T15:29:08.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.369+0000 7f04eb588b80 10 client.16752 fetch_fsmap finished waiting for FSMap version 55 2024-05-14T15:29:08.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.369+0000 7f04eb588b80 10 client.16752 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-05-14T15:29:08.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.369+0000 7f04eb588b80 20 client.16752 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:08.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.370+0000 7f04eb588b80 1 --2- 172.21.15.69:0/1262580632 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55f7dabead00 0x55f7dabed1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.370+0000 7f04eb588b80 4 client.16752 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:29:08.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.370+0000 7f04eb588b80 1 -- 172.21.15.69:0/1262580632 --> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f7dab951c0 con 0x55f7dabead00 2024-05-14T15:29:08.376 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.373+0000 7f04cd400700 1 --2- 172.21.15.69:0/1262580632 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55f7dabead00 0x55f7dabed1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.376+0000 7f04bbe00700 10 client.16752 ms_handle_connect on v2:172.21.15.92:6832/1997000798 2024-05-14T15:29:08.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.376+0000 7f04cd400700 1 --2- 172.21.15.69:0/1262580632 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55f7dabead00 0x55f7dabed1d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=8f97a8451cf451c7 server_cookie=a83c79b013c2f6a2 in_seq=0 out_seq=0 2024-05-14T15:29:08.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.378+0000 7f04bbe00700 1 -- 172.21.15.69:0/1262580632 <== mds.3 v2:172.21.15.92:6832/1997000798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55f7dab951c0 con 0x55f7dabead00 2024-05-14T15:29:08.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.378+0000 7f04bbe00700 10 client.16752 handle_command_reply: tid=0 2024-05-14T15:29:08.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.378+0000 7f04eb588b80 1 client.16752 shutdown 2024-05-14T15:29:08.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.378+0000 7f04eb588b80 1 -- 172.21.15.69:0/1262580632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7daa4ae40 msgr2=0x55f7dabda720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.378+0000 7f04eb588b80 1 --2- 172.21.15.69:0/1262580632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7daa4ae40 0x55f7dabda720 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f04c801cbb0 tx=0x7f04c8004750 comp rx=0 tx=0).stop 2024-05-14T15:29:08.382 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.379+0000 7f04eb588b80 1 -- 172.21.15.69:0/1262580632 shutdown_connections 2024-05-14T15:29:08.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.379+0000 7f04eb588b80 1 --2- 172.21.15.69:0/1262580632 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55f7dabead00 0x55f7dabed1d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.379+0000 7f04eb588b80 1 --2- 172.21.15.69:0/1262580632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7daa4ae40 0x55f7dabda720 secure :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f04c801cbb0 tx=0x7f04c8004750 comp rx=0 tx=0).stop 2024-05-14T15:29:08.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.379+0000 7f04eb588b80 1 --2- 172.21.15.69:0/1262580632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd7010 0x55f7dabdb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.379+0000 7f04eb588b80 1 --2- 172.21.15.69:0/1262580632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd1200 0x55f7dabdac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.379+0000 7f04eb588b80 1 -- 172.21.15.69:0/1262580632 >> 172.21.15.69:0/1262580632 conn(0x55f7daa8ff70 msgr2=0x55f7dabc74a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:08.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.379+0000 7f04bbe00700 0 client.16752 ms_handle_reset on v2:172.21.15.92:6832/1997000798 2024-05-14T15:29:08.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.380+0000 7f04eb588b80 1 -- 172.21.15.69:0/1262580632 shutdown_connections 2024-05-14T15:29:08.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.380+0000 7f04eb588b80 1 -- 172.21.15.69:0/1262580632 wait complete. 2024-05-14T15:29:08.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.380+0000 7f04eb588b80 20 client.16752 trim_cache size 0 max 16384 2024-05-14T15:29:08.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.409+0000 7f04eb588b80 1 Processor -- start 2024-05-14T15:29:08.412 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.409+0000 7f04eb588b80 1 -- start start 2024-05-14T15:29:08.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.410+0000 7f04eb588b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd1200 0x55f7dabdb010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.410+0000 7f04eb588b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd7010 0x55f7dabe6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.410+0000 7f04eb588b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7dabd6250 0x55f7dabf2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.410+0000 7f04eb588b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f04b400f0c0 con 0x55f7dabd6250 2024-05-14T15:29:08.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.410+0000 7f04eb588b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f04b4010d80 con 0x55f7dabd1200 2024-05-14T15:29:08.413 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.410+0000 7f04eb588b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f04b400f790 con 0x55f7dabd7010 2024-05-14T15:29:08.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.411+0000 7f04d5e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd1200 0x55f7dabdb010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.411+0000 7f04d5e00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd1200 0x55f7dabdb010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:60194/0 (socket says 172.21.15.69:60194) 2024-05-14T15:29:08.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.411+0000 7f04d5e00700 1 -- 172.21.15.69:0/1944522501 learned_addr learned my addr 172.21.15.69:0/1944522501 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:08.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.411+0000 7f04cd400700 1 --2- 172.21.15.69:0/1944522501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd7010 0x55f7dabe6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.411+0000 7f04d6800700 1 --2- 172.21.15.69:0/1944522501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7dabd6250 0x55f7dabf2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.414 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.411+0000 7f04d5e00700 1 -- 172.21.15.69:0/1944522501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd7010 msgr2=0x55f7dabe6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:08.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.411+0000 7f04d5e00700 1 --2- 172.21.15.69:0/1944522501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd7010 0x55f7dabe6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.411+0000 7f04d5e00700 1 -- 172.21.15.69:0/1944522501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7dabd6250 msgr2=0x55f7dabf2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:08.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.411+0000 7f04d5e00700 1 --2- 172.21.15.69:0/1944522501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7dabd6250 0x55f7dabf2990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.411+0000 7f04d5e00700 1 -- 172.21.15.69:0/1944522501 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f7dabbb3e0 con 0x55f7dabd1200 2024-05-14T15:29:08.415 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.412+0000 7f04d5e00700 1 --2- 172.21.15.69:0/1944522501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd1200 0x55f7dabdb010 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f04c8017040 tx=0x7f04c80092d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62b4864ee8ee42d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:08.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.412+0000 7f04c6a00700 1 -- 172.21.15.69:0/1944522501 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c801acc0 con 0x55f7dabd1200 2024-05-14T15:29:08.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.412+0000 7f04c6a00700 1 -- 172.21.15.69:0/1944522501 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04c801c0b0 con 0x55f7dabd1200 2024-05-14T15:29:08.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.412+0000 7f04c6a00700 1 -- 172.21.15.69:0/1944522501 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c8004020 con 0x55f7dabd1200 2024-05-14T15:29:08.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.414+0000 7f04eb588b80 1 -- 172.21.15.69:0/1944522501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd1200 msgr2=0x55f7dabdb010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.414+0000 7f04eb588b80 1 --2- 172.21.15.69:0/1944522501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd1200 0x55f7dabdb010 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f04c8017040 tx=0x7f04c80092d0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.416 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.414+0000 7f04eb588b80 1 -- 172.21.15.69:0/1944522501 shutdown_connections 2024-05-14T15:29:08.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.414+0000 7f04eb588b80 1 --2- 172.21.15.69:0/1944522501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7dabd6250 0x55f7dabf2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.414+0000 7f04eb588b80 1 --2- 172.21.15.69:0/1944522501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd1200 0x55f7dabdb010 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.414+0000 7f04eb588b80 1 --2- 172.21.15.69:0/1944522501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd7010 0x55f7dabe6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.414+0000 7f04eb588b80 1 -- 172.21.15.69:0/1944522501 >> 172.21.15.69:0/1944522501 conn(0x55f7daa8ff70 msgr2=0x55f7dabd4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:08.417 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.415+0000 7f04eb588b80 1 -- 172.21.15.69:0/1944522501 shutdown_connections 2024-05-14T15:29:08.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.415+0000 7f04eb588b80 1 -- 172.21.15.69:0/1944522501 wait complete. 2024-05-14T15:29:08.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.416+0000 7f04eb588b80 1 -- start start 2024-05-14T15:29:08.419 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.416+0000 7f04eb588b80 1 Processor -- start 2024-05-14T15:29:08.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.422+0000 7f04eb588b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7dabd1200 0x55f7dabf2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.422+0000 7f04eb588b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd6250 0x55f7dabf27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.422+0000 7f04eb588b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd7010 0x55f7dabf2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.422+0000 7f04eb588b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f04b40105f0 con 0x55f7dabd1200 2024-05-14T15:29:08.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.422+0000 7f04eb588b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f04b400fe60 con 0x55f7dabd7010 2024-05-14T15:29:08.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.422+0000 7f04eb588b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f04b400d080 con 0x55f7dabd6250 2024-05-14T15:29:08.425 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.423+0000 7f04eb588b80 10 client.0 _ll_register_callbacks cb 0x55f7daa91c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:08.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.423+0000 7f04cd400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd6250 0x55f7dabf27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.423+0000 7f04cd400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd6250 0x55f7dabf27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:34818/0 (socket says 172.21.15.69:34818) 2024-05-14T15:29:08.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.423+0000 7f04cd400700 1 -- 172.21.15.69:0/3375711753 learned_addr learned my addr 172.21.15.69:0/3375711753 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:08.426 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.424+0000 7f04d5e00700 1 --2- 172.21.15.69:0/3375711753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7dabd1200 0x55f7dabf2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.424+0000 7f04cd400700 1 -- 172.21.15.69:0/3375711753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd7010 msgr2=0x55f7dabf2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:08.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.424+0000 7f04d6800700 1 --2- 172.21.15.69:0/3375711753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd7010 0x55f7dabf2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.425+0000 7f04cd400700 1 --2- 172.21.15.69:0/3375711753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd7010 0x55f7dabf2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.425+0000 7f04cd400700 1 -- 172.21.15.69:0/3375711753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7dabd1200 msgr2=0x55f7dabf2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:08.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.425+0000 7f04cd400700 1 --2- 172.21.15.69:0/3375711753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7dabd1200 0x55f7dabf2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.427 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.425+0000 7f04cd400700 1 -- 172.21.15.69:0/3375711753 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f7dac54590 con 0x55f7dabd6250 2024-05-14T15:29:08.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.425+0000 7f04d5e00700 1 --2- 172.21.15.69:0/3375711753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7dabd1200 0x55f7dabf2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:29:08.428 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.425+0000 7f04d6800700 1 --2- 172.21.15.69:0/3375711753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd7010 0x55f7dabf2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:29:08.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.426+0000 7f04cd400700 1 --2- 172.21.15.69:0/3375711753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd6250 0x55f7dabf27c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f04c00a62f0 tx=0x7f04c00e2190 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52ed12fbc93fcc81 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:08.429 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.426+0000 7f04bbe00700 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:29:08.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.428+0000 7f04bbe00700 1 -- 172.21.15.69:0/3375711753 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04c00a87f0 con 0x55f7dabd6250 2024-05-14T15:29:08.431 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.429+0000 7f04bbe00700 1 -- 172.21.15.69:0/3375711753 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9642+0+0 (secure 0 0 0) 0x7f04c00b1c60 con 0x55f7dabd6250 2024-05-14T15:29:08.432 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.429+0000 7f04eb588b80 1 -- 172.21.15.69:0/3375711753 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f04c801c0b0 con 0x55f7dabd6250 2024-05-14T15:29:08.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.432+0000 7f04bbe00700 1 -- 172.21.15.69:0/3375711753 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f04c00a8b90 con 0x55f7dabd6250 2024-05-14T15:29:08.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.432+0000 7f04eb588b80 10 client.26230 fetch_fsmap learned FSMap version 55 2024-05-14T15:29:08.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.432+0000 7f04eb588b80 1 -- 172.21.15.69:0/3375711753 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55f7dac557f0 con 0x55f7dabd6250 2024-05-14T15:29:08.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.433+0000 7f04bbe00700 1 -- 172.21.15.69:0/3375711753 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f04c801c0b0 con 0x55f7dabd6250 2024-05-14T15:29:08.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.433+0000 7f04bbe00700 1 -- 172.21.15.69:0/3375711753 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 55) ==== 8398+0+0 (secure 0 0 0) 0x7f04c00ad020 con 0x55f7dabd6250 2024-05-14T15:29:08.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.433+0000 7f04eb588b80 10 client.26230 fetch_fsmap finished waiting for FSMap version 55 2024-05-14T15:29:08.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.433+0000 7f04eb588b80 10 client.26230 resolve_mds: resolved 1:3 to role '1:3' aka daemon mds.k 2024-05-14T15:29:08.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.433+0000 7f04eb588b80 20 client.26230 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:08.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.433+0000 7f04eb588b80 1 --2- 172.21.15.69:0/3375711753 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55f7dac55e90 0x55f7dac582b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.433+0000 7f04eb588b80 4 client.26230 mds_command: new command op to 34409 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:29:08.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.433+0000 7f04eb588b80 1 -- 172.21.15.69:0/3375711753 --> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f7daaf8400 con 0x55f7dac55e90 2024-05-14T15:29:08.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.434+0000 7f04d5e00700 1 --2- 172.21.15.69:0/3375711753 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55f7dac55e90 0x55f7dac582b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.435+0000 7f04d5e00700 1 --2- 172.21.15.69:0/3375711753 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55f7dac55e90 0x55f7dac582b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=2527e22626417a65 server_cookie=fbd2de78b2d00e6c in_seq=0 out_seq=0 2024-05-14T15:29:08.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.435+0000 7f04bbe00700 10 client.26230 ms_handle_connect on v2:172.21.15.92:6832/1997000798 2024-05-14T15:29:08.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.436+0000 7f04bbe00700 1 -- 172.21.15.69:0/3375711753 <== mds.3 v2:172.21.15.92:6832/1997000798 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f7daaf8400 con 0x55f7dac55e90 2024-05-14T15:29:08.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.436+0000 7f04bbe00700 10 client.26230 handle_command_reply: tid=0 2024-05-14T15:29:08.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.436+0000 7f04eb588b80 1 client.26230 shutdown 2024-05-14T15:29:08.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.436+0000 7f04eb588b80 1 -- 172.21.15.69:0/3375711753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd6250 msgr2=0x55f7dabf27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.436+0000 7f04eb588b80 1 --2- 172.21.15.69:0/3375711753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd6250 0x55f7dabf27c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f04c00a62f0 tx=0x7f04c00e2190 comp rx=0 tx=0).stop 2024-05-14T15:29:08.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.436+0000 7f04eb588b80 1 -- 172.21.15.69:0/3375711753 shutdown_connections 2024-05-14T15:29:08.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.437+0000 7f04eb588b80 1 --2- 172.21.15.69:0/3375711753 >> [v2:172.21.15.92:6832/1997000798,v1:172.21.15.92:6833/1997000798] conn(0x55f7dac55e90 0x55f7dac582b0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.437+0000 7f04eb588b80 1 --2- 172.21.15.69:0/3375711753 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f7dabd1200 0x55f7dabf2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.439 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.437+0000 7f04eb588b80 1 --2- 172.21.15.69:0/3375711753 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f7dabd7010 0x55f7dabf2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.437+0000 7f04eb588b80 1 --2- 172.21.15.69:0/3375711753 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f7dabd6250 0x55f7dabf27c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.437+0000 7f04eb588b80 1 -- 172.21.15.69:0/3375711753 >> 172.21.15.69:0/3375711753 conn(0x55f7daa8ff70 msgr2=0x55f7dabd4bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:08.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.437+0000 7f04bbe00700 0 client.26230 ms_handle_reset on v2:172.21.15.92:6832/1997000798 2024-05-14T15:29:08.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.438+0000 7f04eb588b80 1 -- 172.21.15.69:0/3375711753 shutdown_connections 2024-05-14T15:29:08.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.438+0000 7f04eb588b80 1 -- 172.21.15.69:0/3375711753 wait complete. 2024-05-14T15:29:08.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.440+0000 7f04eb588b80 20 client.26230 trim_cache size 0 max 16384 2024-05-14T15:29:08.447 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:29:08.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.443+0000 7f04dca00700 1 -- 172.21.15.69:0/3180589638 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f04bc0b2af0 msgr2=0x7f04bc0b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.443+0000 7f04dca00700 1 --2- 172.21.15.69:0/3180589638 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f04bc0b2af0 0x7f04bc0b5000 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55f7dabc4ab0 tx=0x7f04c8009260 comp rx=0 tx=0).stop 2024-05-14T15:29:08.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.443+0000 7f04dca00700 1 -- 172.21.15.69:0/3180589638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04d810f950 msgr2=0x7f04d81a18c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.443+0000 7f04dca00700 1 --2- 172.21.15.69:0/3180589638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04d810f950 0x7f04d81a18c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f04c00123c0 tx=0x7f04c00126d0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.443+0000 7f04dca00700 1 -- 172.21.15.69:0/3180589638 shutdown_connections 2024-05-14T15:29:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.443+0000 7f04dca00700 1 --2- 172.21.15.69:0/3180589638 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f04bc0b2af0 0x7f04bc0b5000 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.443+0000 7f04dca00700 1 --2- 172.21.15.69:0/3180589638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f04d810b020 0x7f04d81a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.443+0000 7f04dca00700 1 --2- 172.21.15.69:0/3180589638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f04d81102a0 0x7f04d81a5b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.443+0000 7f04dca00700 1 --2- 172.21.15.69:0/3180589638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f04d810f950 0x7f04d81a18c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.443+0000 7f04dca00700 1 -- 172.21.15.69:0/3180589638 >> 172.21.15.69:0/3180589638 conn(0x7f04d806f990 msgr2=0x7f04d810d3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.443+0000 7f04dca00700 1 -- 172.21.15.69:0/3180589638 shutdown_connections 2024-05-14T15:29:08.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:08.443+0000 7f04dca00700 1 -- 172.21.15.69:0/3180589638 wait complete. 2024-05-14T15:29:08.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.520+0000 7f4370600640 1 -- 172.21.15.69:0/4187006943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f436810db50 msgr2=0x7f436810ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.520+0000 7f4370600640 1 --2- 172.21.15.69:0/4187006943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f436810db50 0x7f436810ff70 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4354009900 tx=0x7f435402a480 comp rx=0 tx=0).stop 2024-05-14T15:29:08.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.521+0000 7f4370600640 1 -- 172.21.15.69:0/4187006943 shutdown_connections 2024-05-14T15:29:08.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.521+0000 7f4370600640 1 --2- 172.21.15.69:0/4187006943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f43681104b0 0x7f4368112910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.521+0000 7f4370600640 1 --2- 172.21.15.69:0/4187006943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f436810db50 0x7f436810ff70 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.521+0000 7f4370600640 1 --2- 172.21.15.69:0/4187006943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4368075670 0x7f4368075a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.521+0000 7f4370600640 1 -- 172.21.15.69:0/4187006943 >> 172.21.15.69:0/4187006943 conn(0x7f43680ff490 msgr2=0x7f43681018b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:08.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.522+0000 7f4370600640 1 -- 172.21.15.69:0/4187006943 shutdown_connections 2024-05-14T15:29:08.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.522+0000 7f4370600640 1 -- 172.21.15.69:0/4187006943 wait complete. 2024-05-14T15:29:08.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.523+0000 7f4370600640 1 Processor -- start 2024-05-14T15:29:08.527 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.524+0000 7f4370600640 1 -- start start 2024-05-14T15:29:08.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.525+0000 7f4370600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4368075670 0x7f4368103770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.525+0000 7f4370600640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f436810db50 0x7f4368103cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.525+0000 7f4370600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43681104b0 0x7f43681041f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.525+0000 7f4370600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4368115fe0 con 0x7f4368075670 2024-05-14T15:29:08.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.525+0000 7f4370600640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4368115e60 con 0x7f436810db50 2024-05-14T15:29:08.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.525+0000 7f4370600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4368116160 con 0x7f43681104b0 2024-05-14T15:29:08.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.526+0000 7f436dc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4368075670 0x7f4368103770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.526+0000 7f436dc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4368075670 0x7f4368103770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60490/0 (socket says 172.21.15.69:60490) 2024-05-14T15:29:08.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.526+0000 7f436dc00640 1 -- 172.21.15.69:0/2380852779 learned_addr learned my addr 172.21.15.69:0/2380852779 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:08.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.526+0000 7f436d200640 1 --2- 172.21.15.69:0/2380852779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f436810db50 0x7f4368103cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.526+0000 7f436e600640 1 --2- 172.21.15.69:0/2380852779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43681104b0 0x7f43681041f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.527+0000 7f436dc00640 1 -- 172.21.15.69:0/2380852779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43681104b0 msgr2=0x7f43681041f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.527+0000 7f436dc00640 1 --2- 172.21.15.69:0/2380852779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43681104b0 0x7f43681041f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.527+0000 7f436dc00640 1 -- 172.21.15.69:0/2380852779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f436810db50 msgr2=0x7f4368103cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.527+0000 7f436dc00640 1 --2- 172.21.15.69:0/2380852779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f436810db50 0x7f4368103cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.527+0000 7f436dc00640 1 -- 172.21.15.69:0/2380852779 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4368073a50 con 0x7f4368075670 2024-05-14T15:29:08.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.527+0000 7f436dc00640 1 --2- 172.21.15.69:0/2380852779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4368075670 0x7f4368103770 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f435c00d770 tx=0x7f435c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:08.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.528+0000 7f4366000640 1 -- 172.21.15.69:0/2380852779 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c017070 con 0x7f4368075670 2024-05-14T15:29:08.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.528+0000 7f4366000640 1 -- 172.21.15.69:0/2380852779 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f435c0054b0 con 0x7f4368075670 2024-05-14T15:29:08.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.528+0000 7f4366000640 1 -- 172.21.15.69:0/2380852779 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c017070 con 0x7f4368075670 2024-05-14T15:29:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.529+0000 7f4370600640 1 -- 172.21.15.69:0/2380852779 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4368073d40 con 0x7f4368075670 2024-05-14T15:29:08.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.529+0000 7f4370600640 1 -- 172.21.15.69:0/2380852779 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4368074210 con 0x7f4368075670 2024-05-14T15:29:08.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.539+0000 7f4366000640 1 -- 172.21.15.69:0/2380852779 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f435c004960 con 0x7f4368075670 2024-05-14T15:29:08.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.540+0000 7f4377595740 1 Processor -- start 2024-05-14T15:29:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.542+0000 7f4377595740 1 -- start start 2024-05-14T15:29:08.545 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.543+0000 7f4377595740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 0x55cb388c4280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.543+0000 7f4377595740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb384fa2f0 0x55cb388c47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.543+0000 7f4377595740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb385024d0 0x55cb388c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.543+0000 7f4377595740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cb38829550 con 0x55cb385024d0 2024-05-14T15:29:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.543+0000 7f4377595740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cb387cebc0 con 0x55cb384fa2f0 2024-05-14T15:29:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.543+0000 7f4377595740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cb38825510 con 0x55cb385231b0 2024-05-14T15:29:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.544+0000 7f4366000640 1 --2- 172.21.15.69:0/2380852779 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f43500b2bd0 0x7f43500b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.546 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.544+0000 7f436d200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb385024d0 0x55cb388c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.544+0000 7f436d200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb385024d0 0x55cb388c4d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60502/0 (socket says 172.21.15.69:60502) 2024-05-14T15:29:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.544+0000 7f4366000640 1 -- 172.21.15.69:0/2380852779 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 9642+0+0 (secure 0 0 0) 0x7f435c0e21c0 con 0x7f4368075670 2024-05-14T15:29:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.544+0000 7f436dc00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb384fa2f0 0x55cb388c47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.544+0000 7f436dc00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb384fa2f0 0x55cb388c47c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:60218/0 (socket says 172.21.15.69:60218) 2024-05-14T15:29:08.547 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.545+0000 7f436dc00640 1 -- 172.21.15.69:0/542862061 learned_addr learned my addr 172.21.15.69:0/542862061 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.545+0000 7f436e600640 1 --2- 172.21.15.69:0/542862061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 0x55cb388c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.545+0000 7f436d200640 1 -- 172.21.15.69:0/542862061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 msgr2=0x55cb388c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.545+0000 7f436d200640 1 --2- 172.21.15.69:0/542862061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 0x55cb388c4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.545+0000 7f436d200640 1 -- 172.21.15.69:0/542862061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb384fa2f0 msgr2=0x55cb388c47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.545+0000 7f436d200640 1 --2- 172.21.15.69:0/542862061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb384fa2f0 0x55cb388c47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.545+0000 7f436d200640 1 -- 172.21.15.69:0/542862061 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb3853b210 con 0x55cb385024d0 2024-05-14T15:29:08.548 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.545+0000 7f436e600640 1 --2- 172.21.15.69:0/542862061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 0x55cb388c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:29:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.546+0000 7f436e600640 1 --2- 172.21.15.69:0/2380852779 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f43500b2bd0 0x7f43500b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.546+0000 7f436d200640 1 --2- 172.21.15.69:0/542862061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb385024d0 0x55cb388c4d00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f435402a9a0 tx=0x7f4354004390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7797627909516e5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.547+0000 7f435aa00640 1 -- 172.21.15.69:0/542862061 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354035030 con 0x55cb385024d0 2024-05-14T15:29:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.547+0000 7f436e600640 1 --2- 172.21.15.69:0/2380852779 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f43500b2bd0 0x7f43500b50e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55cb388c13f0 tx=0x7f4360004b50 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:08.549 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.547+0000 7f435aa00640 1 -- 172.21.15.69:0/542862061 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4354005de0 con 0x55cb385024d0 2024-05-14T15:29:08.550 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.547+0000 7f435aa00640 1 -- 172.21.15.69:0/542862061 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354003850 con 0x55cb385024d0 2024-05-14T15:29:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.549+0000 7f4377595740 1 -- 172.21.15.69:0/542862061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb385024d0 msgr2=0x55cb388c4d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.551 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.549+0000 7f4377595740 1 --2- 172.21.15.69:0/542862061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb385024d0 0x55cb388c4d00 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f435402a9a0 tx=0x7f4354004390 comp rx=0 tx=0).stop 2024-05-14T15:29:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.549+0000 7f4377595740 1 -- 172.21.15.69:0/542862061 shutdown_connections 2024-05-14T15:29:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.549+0000 7f4377595740 1 --2- 172.21.15.69:0/542862061 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb385024d0 0x55cb388c4d00 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.550+0000 7f4377595740 1 --2- 172.21.15.69:0/542862061 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb384fa2f0 0x55cb388c47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.550+0000 7f4377595740 1 --2- 172.21.15.69:0/542862061 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 0x55cb388c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.552 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.550+0000 7f4377595740 1 -- 172.21.15.69:0/542862061 >> 172.21.15.69:0/542862061 conn(0x55cb38517300 msgr2=0x55cb388c0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.550+0000 7f4377595740 1 -- 172.21.15.69:0/542862061 shutdown_connections 2024-05-14T15:29:08.553 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.551+0000 7f4377595740 1 -- 172.21.15.69:0/542862061 wait complete. 2024-05-14T15:29:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.552+0000 7f4377595740 1 -- start start 2024-05-14T15:29:08.554 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.553+0000 7f4377595740 1 Processor -- start 2024-05-14T15:29:08.557 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.554+0000 7f4377595740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb384fa2f0 0x55cb388ce780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.555+0000 7f4377595740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385024d0 0x55cb388cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.555+0000 7f4377595740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb385231b0 0x55cb388da800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.555+0000 7f4377595740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cb388d1350 con 0x55cb384fa2f0 2024-05-14T15:29:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.555+0000 7f4377595740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cb387e2660 con 0x55cb385231b0 2024-05-14T15:29:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.555+0000 7f4377595740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cb388d14d0 con 0x55cb385024d0 2024-05-14T15:29:08.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.555+0000 7f4377595740 10 client.0 _ll_register_callbacks cb 0x55cb387ac400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.556+0000 7f436dc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb384fa2f0 0x55cb388ce780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.556+0000 7f436dc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb384fa2f0 0x55cb388ce780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60504/0 (socket says 172.21.15.69:60504) 2024-05-14T15:29:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.556+0000 7f436dc00640 1 -- 172.21.15.69:0/2310918252 learned_addr learned my addr 172.21.15.69:0/2310918252 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.557+0000 7f436d200640 1 --2- 172.21.15.69:0/2310918252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385024d0 0x55cb388cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.557+0000 7f436dc00640 1 -- 172.21.15.69:0/2310918252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385024d0 msgr2=0x55cb388cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.557+0000 7f436e600640 1 --2- 172.21.15.69:0/2310918252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb385231b0 0x55cb388da800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.557+0000 7f436dc00640 1 --2- 172.21.15.69:0/2310918252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385024d0 0x55cb388cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.557+0000 7f436dc00640 1 -- 172.21.15.69:0/2310918252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb385231b0 msgr2=0x55cb388da800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:08.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.558+0000 7f436dc00640 1 --2- 172.21.15.69:0/2310918252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb385231b0 0x55cb388da800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.558+0000 7f436dc00640 1 -- 172.21.15.69:0/2310918252 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb38607620 con 0x55cb384fa2f0 2024-05-14T15:29:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.558+0000 7f436e600640 1 --2- 172.21.15.69:0/2310918252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb385231b0 0x55cb388da800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:29:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.558+0000 7f436dc00640 1 --2- 172.21.15.69:0/2310918252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb384fa2f0 0x55cb388ce780 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f435c0a8d40 tx=0x7f435c0a8ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a693d8d7cec96bd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:08.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.558+0000 7f434f400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:29:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.559+0000 7f434f400640 1 -- 172.21.15.69:0/2310918252 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c0c3060 con 0x55cb384fa2f0 2024-05-14T15:29:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.559+0000 7f434f400640 1 -- 172.21.15.69:0/2310918252 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9642+0+0 (secure 0 0 0) 0x7f435c0a82a0 con 0x55cb384fa2f0 2024-05-14T15:29:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.560+0000 7f4377595740 1 -- 172.21.15.69:0/2310918252 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cb38837160 con 0x55cb384fa2f0 2024-05-14T15:29:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.560+0000 7f434f400640 1 -- 172.21.15.69:0/2310918252 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f435c0ca050 con 0x55cb384fa2f0 2024-05-14T15:29:08.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.560+0000 7f4377595740 10 client.16764 fetch_fsmap learned FSMap version 55 2024-05-14T15:29:08.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.561+0000 7f4377595740 1 -- 172.21.15.69:0/2310918252 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55cb388dd580 con 0x55cb384fa2f0 2024-05-14T15:29:08.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.561+0000 7f434f400640 1 -- 172.21.15.69:0/2310918252 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55cb38837160 con 0x55cb384fa2f0 2024-05-14T15:29:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.562+0000 7f434f400640 1 -- 172.21.15.69:0/2310918252 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 55) ==== 8398+0+0 (secure 0 0 0) 0x7f435c0cb040 con 0x55cb384fa2f0 2024-05-14T15:29:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.562+0000 7f4377595740 10 client.16764 fetch_fsmap finished waiting for FSMap version 55 2024-05-14T15:29:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.562+0000 7f4377595740 10 client.16764 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:29:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.562+0000 7f4377595740 20 client.16764 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.562+0000 7f4377595740 1 --2- 172.21.15.69:0/2310918252 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cb384e1d80 0x55cb388e0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.563+0000 7f4377595740 4 client.16764 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:29:08.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.563+0000 7f4377595740 1 -- 172.21.15.69:0/2310918252 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb38830fd0 con 0x55cb384e1d80 2024-05-14T15:29:08.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.563+0000 7f436d200640 1 --2- 172.21.15.69:0/2310918252 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cb384e1d80 0x55cb388e0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.565+0000 7f436d200640 1 --2- 172.21.15.69:0/2310918252 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cb384e1d80 0x55cb388e0bc0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=18fe4f4e5c18737b server_cookie=92767304f31b3039 in_seq=0 out_seq=0 2024-05-14T15:29:08.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.565+0000 7f434f400640 10 client.16764 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.569+0000 7f434f400640 1 -- 172.21.15.69:0/2310918252 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cb38830fd0 con 0x55cb384e1d80 2024-05-14T15:29:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.569+0000 7f434f400640 10 client.16764 handle_command_reply: tid=0 2024-05-14T15:29:08.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.569+0000 7f4377595740 1 client.16764 shutdown 2024-05-14T15:29:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.570+0000 7f4377595740 1 -- 172.21.15.69:0/2310918252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb384fa2f0 msgr2=0x55cb388ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.570+0000 7f4377595740 1 --2- 172.21.15.69:0/2310918252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb384fa2f0 0x55cb388ce780 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f435c0a8d40 tx=0x7f435c0a8ab0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.570+0000 7f4377595740 1 -- 172.21.15.69:0/2310918252 shutdown_connections 2024-05-14T15:29:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.571+0000 7f4377595740 1 --2- 172.21.15.69:0/2310918252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb385231b0 0x55cb388da800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.571+0000 7f4377595740 1 --2- 172.21.15.69:0/2310918252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385024d0 0x55cb388cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.571+0000 7f4377595740 1 --2- 172.21.15.69:0/2310918252 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cb384e1d80 0x55cb388e0bc0 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.571+0000 7f4377595740 1 --2- 172.21.15.69:0/2310918252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb384fa2f0 0x55cb388ce780 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.571+0000 7f4377595740 1 -- 172.21.15.69:0/2310918252 >> 172.21.15.69:0/2310918252 conn(0x55cb38517300 msgr2=0x55cb388c5fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:08.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.571+0000 7f434f400640 0 client.16764 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:08.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.571+0000 7f4377595740 1 -- 172.21.15.69:0/2310918252 shutdown_connections 2024-05-14T15:29:08.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.572+0000 7f4377595740 1 -- 172.21.15.69:0/2310918252 wait complete. 2024-05-14T15:29:08.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.572+0000 7f4377595740 20 client.16764 trim_cache size 0 max 16384 2024-05-14T15:29:08.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.601+0000 7f4377595740 1 Processor -- start 2024-05-14T15:29:08.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.601+0000 7f4377595740 1 -- start start 2024-05-14T15:29:08.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.601+0000 7f4377595740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb384fa2f0 0x55cb388c68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.601+0000 7f4377595740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb385024d0 0x55cb388c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.602+0000 7f4377595740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 0x55cb388bf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.602+0000 7f4377595740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f43681c0310 con 0x55cb384fa2f0 2024-05-14T15:29:08.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.602+0000 7f4377595740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f43681c1fd0 con 0x55cb385024d0 2024-05-14T15:29:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.602+0000 7f4377595740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f43681c09e0 con 0x55cb385231b0 2024-05-14T15:29:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.602+0000 7f436dc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb384fa2f0 0x55cb388c68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.602+0000 7f436dc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb384fa2f0 0x55cb388c68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60518/0 (socket says 172.21.15.69:60518) 2024-05-14T15:29:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.602+0000 7f436dc00640 1 -- 172.21.15.69:0/3941085734 learned_addr learned my addr 172.21.15.69:0/3941085734 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.602+0000 7f436d200640 1 --2- 172.21.15.69:0/3941085734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb385024d0 0x55cb388c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.603+0000 7f436e600640 1 --2- 172.21.15.69:0/3941085734 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 0x55cb388bf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.603+0000 7f436dc00640 1 -- 172.21.15.69:0/3941085734 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 msgr2=0x55cb388bf710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.603+0000 7f436dc00640 1 --2- 172.21.15.69:0/3941085734 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 0x55cb388bf710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.603+0000 7f436dc00640 1 -- 172.21.15.69:0/3941085734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb385024d0 msgr2=0x55cb388c50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:08.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.603+0000 7f436dc00640 1 --2- 172.21.15.69:0/3941085734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb385024d0 0x55cb388c50e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.604+0000 7f436dc00640 1 -- 172.21.15.69:0/3941085734 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb388baca0 con 0x55cb384fa2f0 2024-05-14T15:29:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.604+0000 7f436d200640 1 --2- 172.21.15.69:0/3941085734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb385024d0 0x55cb388c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:29:08.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.605+0000 7f436dc00640 1 --2- 172.21.15.69:0/3941085734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb384fa2f0 0x55cb388c68f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f435c0df560 tx=0x7f435c0a4f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8d734160e0343a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.606+0000 7f435a000640 1 -- 172.21.15.69:0/3941085734 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c020050 con 0x55cb384fa2f0 2024-05-14T15:29:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.606+0000 7f435a000640 1 -- 172.21.15.69:0/3941085734 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f435c0a9040 con 0x55cb384fa2f0 2024-05-14T15:29:08.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.606+0000 7f435a000640 1 -- 172.21.15.69:0/3941085734 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f435c0ae580 con 0x55cb384fa2f0 2024-05-14T15:29:08.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.607+0000 7f4377595740 1 -- 172.21.15.69:0/3941085734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb384fa2f0 msgr2=0x55cb388c68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.607+0000 7f4377595740 1 --2- 172.21.15.69:0/3941085734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb384fa2f0 0x55cb388c68f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f435c0df560 tx=0x7f435c0a4f00 comp rx=0 tx=0).stop 2024-05-14T15:29:08.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.608+0000 7f4377595740 1 -- 172.21.15.69:0/3941085734 shutdown_connections 2024-05-14T15:29:08.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.608+0000 7f4377595740 1 --2- 172.21.15.69:0/3941085734 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 0x55cb388bf710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.608+0000 7f4377595740 1 --2- 172.21.15.69:0/3941085734 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb385024d0 0x55cb388c50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.608+0000 7f4377595740 1 --2- 172.21.15.69:0/3941085734 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb384fa2f0 0x55cb388c68f0 secure :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f435c0df560 tx=0x7f435c0a4f00 comp rx=0 tx=0).stop 2024-05-14T15:29:08.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.608+0000 7f4377595740 1 -- 172.21.15.69:0/3941085734 >> 172.21.15.69:0/3941085734 conn(0x55cb38517300 msgr2=0x55cb388bf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:08.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.609+0000 7f4377595740 1 -- 172.21.15.69:0/3941085734 shutdown_connections 2024-05-14T15:29:08.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.609+0000 7f4377595740 1 -- 172.21.15.69:0/3941085734 wait complete. 2024-05-14T15:29:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.609+0000 7f4377595740 1 -- start start 2024-05-14T15:29:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.609+0000 7f4377595740 1 Processor -- start 2024-05-14T15:29:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.610+0000 7f4377595740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb385024d0 0x55cb388d1720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.610+0000 7f4377595740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 0x55cb388d1c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.611+0000 7f4377595740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb384b71c0 0x55cb388d21a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.613 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.611+0000 7f436dc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb385024d0 0x55cb388d1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.611+0000 7f436dc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb385024d0 0x55cb388d1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:60520/0 (socket says 172.21.15.69:60520) 2024-05-14T15:29:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.611+0000 7f4377595740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f43681c1840 con 0x55cb385024d0 2024-05-14T15:29:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.611+0000 7f436dc00640 1 -- 172.21.15.69:0/1749979549 learned_addr learned my addr 172.21.15.69:0/1749979549 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.611+0000 7f436d200640 1 --2- 172.21.15.69:0/1749979549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 0x55cb388d1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.611+0000 7f4377595740 1 -- 172.21.15.69:0/1749979549 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f43681c10b0 con 0x55cb384b71c0 2024-05-14T15:29:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.611+0000 7f4377595740 1 -- 172.21.15.69:0/1749979549 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f43681be310 con 0x55cb385231b0 2024-05-14T15:29:08.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.611+0000 7f4377595740 10 client.0 _ll_register_callbacks cb 0x7f435c0a8b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.612+0000 7f436e600640 1 --2- 172.21.15.69:0/1749979549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb384b71c0 0x55cb388d21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.612+0000 7f436d200640 1 -- 172.21.15.69:0/1749979549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb384b71c0 msgr2=0x55cb388d21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.612+0000 7f436d200640 1 --2- 172.21.15.69:0/1749979549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb384b71c0 0x55cb388d21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.612+0000 7f436d200640 1 -- 172.21.15.69:0/1749979549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb385024d0 msgr2=0x55cb388d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:08.615 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.612+0000 7f436d200640 1 --2- 172.21.15.69:0/1749979549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb385024d0 0x55cb388d1720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.612+0000 7f436d200640 1 -- 172.21.15.69:0/1749979549 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb38947110 con 0x55cb385231b0 2024-05-14T15:29:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.612+0000 7f436e600640 1 --2- 172.21.15.69:0/1749979549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb384b71c0 0x55cb388d21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:29:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.613+0000 7f436dc00640 1 --2- 172.21.15.69:0/1749979549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb385024d0 0x55cb388d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:29:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.613+0000 7f436d200640 1 --2- 172.21.15.69:0/1749979549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 0x55cb388d1c60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f43540096c0 tx=0x7f4354005a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f75c2c13ab56d7c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.613+0000 7f434f400640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:29:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.614+0000 7f434f400640 1 -- 172.21.15.69:0/1749979549 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4354057060 con 0x55cb385231b0 2024-05-14T15:29:08.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.614+0000 7f434f400640 1 -- 172.21.15.69:0/1749979549 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(95..95 src has 1..95) ==== 9642+0+0 (secure 0 0 0) 0x7f4354004e80 con 0x55cb385231b0 2024-05-14T15:29:08.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.614+0000 7f4377595740 1 -- 172.21.15.69:0/1749979549 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f435c0a9040 con 0x55cb385231b0 2024-05-14T15:29:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.615+0000 7f434f400640 1 -- 172.21.15.69:0/1749979549 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f4354035030 con 0x55cb385231b0 2024-05-14T15:29:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.616+0000 7f4377595740 10 client.26239 fetch_fsmap learned FSMap version 55 2024-05-14T15:29:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.616+0000 7f4377595740 1 -- 172.21.15.69:0/1749979549 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55cb38948380 con 0x55cb385231b0 2024-05-14T15:29:08.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.616+0000 7f434f400640 1 -- 172.21.15.69:0/1749979549 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f435c0a9040 con 0x55cb385231b0 2024-05-14T15:29:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.619+0000 7f434f400640 1 -- 172.21.15.69:0/1749979549 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 55) ==== 8398+0+0 (secure 0 0 0) 0x7f435404e040 con 0x55cb385231b0 2024-05-14T15:29:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.620+0000 7f4377595740 10 client.26239 fetch_fsmap finished waiting for FSMap version 55 2024-05-14T15:29:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.620+0000 7f4377595740 10 client.26239 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:29:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.620+0000 7f4377595740 20 client.26239 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.620+0000 7f4377595740 1 --2- 172.21.15.69:0/1749979549 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cb389486b0 0x55cb3894aad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.620+0000 7f4377595740 4 client.26239 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:29:08.622 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.620+0000 7f4377595740 1 -- 172.21.15.69:0/1749979549 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cb388ca150 con 0x55cb389486b0 2024-05-14T15:29:08.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.621+0000 7f436dc00640 1 --2- 172.21.15.69:0/1749979549 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cb389486b0 0x55cb3894aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:08.626 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.623+0000 7f436dc00640 1 --2- 172.21.15.69:0/1749979549 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cb389486b0 0x55cb3894aad0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=14ba32f9c5e9012e server_cookie=a109ce3b1160806e in_seq=0 out_seq=0 2024-05-14T15:29:08.627 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.624+0000 7f434f400640 10 client.26239 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:08.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.674+0000 7f434f400640 1 -- 172.21.15.69:0/1749979549 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cb388ca150 con 0x55cb389486b0 2024-05-14T15:29:08.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.674+0000 7f434f400640 10 client.26239 handle_command_reply: tid=0 2024-05-14T15:29:08.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.674+0000 7f4377595740 1 client.26239 shutdown 2024-05-14T15:29:08.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.675+0000 7f4377595740 1 -- 172.21.15.69:0/1749979549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 msgr2=0x55cb388d1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.675+0000 7f4377595740 1 --2- 172.21.15.69:0/1749979549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 0x55cb388d1c60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f43540096c0 tx=0x7f4354005a20 comp rx=0 tx=0).stop 2024-05-14T15:29:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.677+0000 7f4377595740 1 -- 172.21.15.69:0/1749979549 shutdown_connections 2024-05-14T15:29:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.677+0000 7f4377595740 1 --2- 172.21.15.69:0/1749979549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cb384b71c0 0x55cb388d21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.677+0000 7f4377595740 1 --2- 172.21.15.69:0/1749979549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cb385231b0 0x55cb388d1c60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.677+0000 7f4377595740 1 --2- 172.21.15.69:0/1749979549 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cb389486b0 0x55cb3894aad0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.677+0000 7f4377595740 1 --2- 172.21.15.69:0/1749979549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cb385024d0 0x55cb388d1720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.677+0000 7f434f400640 0 client.26239 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:08.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.677+0000 7f4377595740 1 -- 172.21.15.69:0/1749979549 >> 172.21.15.69:0/1749979549 conn(0x55cb38517300 msgr2=0x55cb388c6650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.679+0000 7f4377595740 1 -- 172.21.15.69:0/1749979549 shutdown_connections 2024-05-14T15:29:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.680+0000 7f4377595740 1 -- 172.21.15.69:0/1749979549 wait complete. 2024-05-14T15:29:08.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.680+0000 7f4377595740 20 client.26239 trim_cache size 0 max 16384 2024-05-14T15:29:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:29:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:29:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:29:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:29:08.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.682+0000 7f4370600640 1 -- 172.21.15.69:0/2380852779 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f43500b2bd0 msgr2=0x7f43500b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.682+0000 7f4370600640 1 --2- 172.21.15.69:0/2380852779 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f43500b2bd0 0x7f43500b50e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x55cb388c13f0 tx=0x7f4360004b50 comp rx=0 tx=0).stop 2024-05-14T15:29:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.682+0000 7f4370600640 1 -- 172.21.15.69:0/2380852779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4368075670 msgr2=0x7f4368103770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.682+0000 7f4370600640 1 --2- 172.21.15.69:0/2380852779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4368075670 0x7f4368103770 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f435c00d770 tx=0x7f435c00dc30 comp rx=0 tx=0).stop 2024-05-14T15:29:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.683+0000 7f4370600640 1 -- 172.21.15.69:0/2380852779 shutdown_connections 2024-05-14T15:29:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.683+0000 7f4370600640 1 --2- 172.21.15.69:0/2380852779 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f43500b2bd0 0x7f43500b50e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.683+0000 7f4370600640 1 --2- 172.21.15.69:0/2380852779 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f43681104b0 0x7f43681041f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.683+0000 7f4370600640 1 --2- 172.21.15.69:0/2380852779 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f436810db50 0x7f4368103cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.683+0000 7f4370600640 1 --2- 172.21.15.69:0/2380852779 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4368075670 0x7f4368103770 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:08.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.683+0000 7f4370600640 1 -- 172.21.15.69:0/2380852779 >> 172.21.15.69:0/2380852779 conn(0x7f43680ff490 msgr2=0x7f43681108c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:08.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.683+0000 7f4370600640 1 -- 172.21.15.69:0/2380852779 shutdown_connections 2024-05-14T15:29:08.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:08.683+0000 7f4370600640 1 -- 172.21.15.69:0/2380852779 wait complete. 2024-05-14T15:29:09.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:09 smithi069 ceph-mon[31270]: pgmap v231: 129 pgs: 129 active+clean; 2.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 9.4 MiB/s wr, 658 op/s 2024-05-14T15:29:09.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:09 smithi092 ceph-mon[34729]: pgmap v231: 129 pgs: 129 active+clean; 2.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 9.4 MiB/s wr, 658 op/s 2024-05-14T15:29:09.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:09 smithi203 ceph-mon[34567]: pgmap v231: 129 pgs: 129 active+clean; 2.4 GiB data, 9.2 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 9.4 MiB/s wr, 658 op/s 2024-05-14T15:29:10.259 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-05-14T15:29:10.914 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:29:10.945 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:10 smithi092 ceph-mon[34729]: osdmap e96: 12 total, 12 up, 12 in 2024-05-14T15:29:10.945 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:10 smithi092 ceph-mon[34729]: pgmap v233: 129 pgs: 129 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 11 MiB/s wr, 701 op/s 2024-05-14T15:29:10.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:10 smithi069 ceph-mon[31270]: osdmap e96: 12 total, 12 up, 12 in 2024-05-14T15:29:10.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:10 smithi069 ceph-mon[31270]: pgmap v233: 129 pgs: 129 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 11 MiB/s wr, 701 op/s 2024-05-14T15:29:11.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:10 smithi203 ceph-mon[34567]: osdmap e96: 12 total, 12 up, 12 in 2024-05-14T15:29:11.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:10 smithi203 ceph-mon[34567]: pgmap v233: 129 pgs: 129 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 11 MiB/s wr, 701 op/s 2024-05-14T15:29:11.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 205.0 s, 650.3 tps, lat 137.303 ms stddev 48.068 2024-05-14T15:29:12.167 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:11 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:29:12.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:11 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:29:12.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:11 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:29:13.089 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:12 smithi069 ceph-mon[31270]: pgmap v234: 129 pgs: 129 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 9.1 MiB/s wr, 566 op/s 2024-05-14T15:29:13.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:12 smithi092 ceph-mon[34729]: pgmap v234: 129 pgs: 129 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 9.1 MiB/s wr, 566 op/s 2024-05-14T15:29:13.246 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:12 smithi203 ceph-mon[34567]: pgmap v234: 129 pgs: 129 active+clean; 2.4 GiB data, 9.4 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 9.1 MiB/s wr, 566 op/s 2024-05-14T15:29:13.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.431+0000 7f6fc5c00700 1 -- 172.21.15.69:0/1610288763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0108740 msgr2=0x7f6fc01100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:13.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.431+0000 7f6fc5c00700 1 --2- 172.21.15.69:0/1610288763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0108740 0x7f6fc01100a0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800b0d0 tx=0x7f6fb800b3e0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.431+0000 7f6fc5c00700 1 -- 172.21.15.69:0/1610288763 shutdown_connections 2024-05-14T15:29:13.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.431+0000 7f6fc5c00700 1 --2- 172.21.15.69:0/1610288763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0108740 0x7f6fc01100a0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.433 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.431+0000 7f6fc5c00700 1 --2- 172.21.15.69:0/1610288763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fc01034c0 0x7f6fc01038d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.431+0000 7f6fc5c00700 1 --2- 172.21.15.69:0/1610288763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fc0107df0 0x7f6fc0108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.431+0000 7f6fc5c00700 1 -- 172.21.15.69:0/1610288763 >> 172.21.15.69:0/1610288763 conn(0x7f6fc00fedc0 msgr2=0x7f6fc01011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:13.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.431+0000 7f6fc5c00700 1 -- 172.21.15.69:0/1610288763 shutdown_connections 2024-05-14T15:29:13.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.431+0000 7f6fc5c00700 1 -- 172.21.15.69:0/1610288763 wait complete. 2024-05-14T15:29:13.434 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.433+0000 7f6fc5c00700 1 Processor -- start 2024-05-14T15:29:13.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.433+0000 7f6fc5c00700 1 -- start start 2024-05-14T15:29:13.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.433+0000 7f6fc5c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fc01034c0 0x7f6fc010c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.433+0000 7f6fc5c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0107df0 0x7f6fc010c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.433+0000 7f6fc5c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fc0108740 0x7f6fc010ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.433+0000 7f6fc5c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc0112190 con 0x7f6fc0107df0 2024-05-14T15:29:13.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.434+0000 7f6fc5c00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc0112010 con 0x7f6fc01034c0 2024-05-14T15:29:13.435 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.434+0000 7f6fc5c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc0112310 con 0x7f6fc0108740 2024-05-14T15:29:13.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.434+0000 7f6fbe000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0107df0 0x7f6fc010c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.434+0000 7f6fbe000700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0107df0 0x7f6fc010c900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43148/0 (socket says 172.21.15.69:43148) 2024-05-14T15:29:13.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.434+0000 7f6fbe000700 1 -- 172.21.15.69:0/2801219007 learned_addr learned my addr 172.21.15.69:0/2801219007 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:13.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.434+0000 7f6fbf400700 1 --2- 172.21.15.69:0/2801219007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fc0108740 0x7f6fc010ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.436 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.434+0000 7f6fbea00700 1 --2- 172.21.15.69:0/2801219007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fc01034c0 0x7f6fc010c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.435+0000 7f6fbea00700 1 -- 172.21.15.69:0/2801219007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fc0108740 msgr2=0x7f6fc010ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:13.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.435+0000 7f6fbea00700 1 --2- 172.21.15.69:0/2801219007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fc0108740 0x7f6fc010ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.435+0000 7f6fbea00700 1 -- 172.21.15.69:0/2801219007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0107df0 msgr2=0x7f6fc010c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:13.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.435+0000 7f6fbea00700 1 --2- 172.21.15.69:0/2801219007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0107df0 0x7f6fc010c900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.437 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.435+0000 7f6fbea00700 1 -- 172.21.15.69:0/2801219007 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fc006d290 con 0x7f6fc01034c0 2024-05-14T15:29:13.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.436+0000 7f6fbea00700 1 --2- 172.21.15.69:0/2801219007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fc01034c0 0x7f6fc010c3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000b450 tx=0x7f6fb000b760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:13.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.436+0000 7f6fb7400700 1 -- 172.21.15.69:0/2801219007 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0015020 con 0x7f6fc01034c0 2024-05-14T15:29:13.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.436+0000 7f6fb7400700 1 -- 172.21.15.69:0/2801219007 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fb0011cc0 con 0x7f6fc01034c0 2024-05-14T15:29:13.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.437+0000 7f6fb7400700 1 -- 172.21.15.69:0/2801219007 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0010b70 con 0x7f6fc01034c0 2024-05-14T15:29:13.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.437+0000 7f6fc5c00700 1 -- 172.21.15.69:0/2801219007 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fc006d520 con 0x7f6fc01034c0 2024-05-14T15:29:13.438 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.437+0000 7f6fc5c00700 1 -- 172.21.15.69:0/2801219007 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fc006d950 con 0x7f6fc01034c0 2024-05-14T15:29:13.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.444+0000 7f6fd46eab80 1 Processor -- start 2024-05-14T15:29:13.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.444+0000 7f6fb7400700 1 -- 172.21.15.69:0/2801219007 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6fb0018020 con 0x7f6fc01034c0 2024-05-14T15:29:13.446 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.444+0000 7f6fd46eab80 1 -- start start 2024-05-14T15:29:13.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.446+0000 7f6fd46eab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e662fe6e40 0x55e66316a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.446+0000 7f6fd46eab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e66316abf0 0x55e663164710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.446+0000 7f6fd46eab80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663164c50 0x55e663165060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.446+0000 7f6fd46eab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55e663086a20 con 0x55e66316abf0 2024-05-14T15:29:13.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.446+0000 7f6fd46eab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e663024760 con 0x55e662fe6e40 2024-05-14T15:29:13.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.446+0000 7f6fd46eab80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e6630829e0 con 0x55e663164c50 2024-05-14T15:29:13.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.446+0000 7f6fb7400700 1 --2- 172.21.15.69:0/2801219007 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6fa40b2a70 0x7f6fa40b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.446+0000 7f6fb7400700 1 -- 172.21.15.69:0/2801219007 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7f6fb00e1c20 con 0x7f6fc01034c0 2024-05-14T15:29:13.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.446+0000 7f6fbf400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e662fe6e40 0x55e66316a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.447+0000 7f6fbf400700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e662fe6e40 0x55e66316a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:48582/0 (socket says 172.21.15.69:48582) 2024-05-14T15:29:13.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.447+0000 7f6fbf400700 1 -- 172.21.15.69:0/964708967 learned_addr learned my addr 172.21.15.69:0/964708967 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:13.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.447+0000 7f6fbf400700 1 --2- 172.21.15.69:0/2801219007 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6fa40b2a70 0x7f6fa40b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.448+0000 7f6fbe000700 1 --2- 172.21.15.69:0/964708967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663164c50 0x55e663165060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.448+0000 7f6fbea00700 1 --2- 172.21.15.69:0/964708967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e66316abf0 0x55e663164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.448+0000 7f6fbea00700 1 -- 172.21.15.69:0/964708967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663164c50 msgr2=0x55e663165060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:13.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.448+0000 7f6fbea00700 1 --2- 172.21.15.69:0/964708967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663164c50 0x55e663165060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.448+0000 7f6fbea00700 1 -- 172.21.15.69:0/964708967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e662fe6e40 msgr2=0x55e66316a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:13.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.448+0000 7f6fbea00700 1 --2- 172.21.15.69:0/964708967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e662fe6e40 0x55e66316a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.448+0000 7f6fbea00700 1 -- 172.21.15.69:0/964708967 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e662fd38d0 con 0x55e66316abf0 2024-05-14T15:29:13.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.449+0000 7f6fbf400700 1 --2- 172.21.15.69:0/2801219007 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6fa40b2a70 0x7f6fa40b4f80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8005bd0 tx=0x7f6fb8005a20 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:13.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.449+0000 7f6fbea00700 1 --2- 172.21.15.69:0/964708967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e66316abf0 0x55e663164710 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00df070 tx=0x7f6fb00a83f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da0207780e7efad server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:13.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.449+0000 7f6fabe00700 1 -- 172.21.15.69:0/964708967 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb00a8710 con 0x55e66316abf0 2024-05-14T15:29:13.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.450+0000 7f6fabe00700 1 -- 172.21.15.69:0/964708967 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fb00a9300 con 0x55e66316abf0 2024-05-14T15:29:13.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.450+0000 7f6fabe00700 1 -- 172.21.15.69:0/964708967 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb0010d10 con 0x55e66316abf0 2024-05-14T15:29:13.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.451+0000 7f6fd46eab80 1 -- 172.21.15.69:0/964708967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e66316abf0 msgr2=0x55e663164710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:13.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.451+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/964708967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e66316abf0 0x55e663164710 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00df070 tx=0x7f6fb00a83f0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.452+0000 7f6fd46eab80 1 -- 172.21.15.69:0/964708967 shutdown_connections 2024-05-14T15:29:13.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.452+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/964708967 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663164c50 0x55e663165060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.453 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.452+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/964708967 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e662fe6e40 0x55e66316a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.452+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/964708967 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e66316abf0 0x55e663164710 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.452+0000 7f6fd46eab80 1 -- 172.21.15.69:0/964708967 >> 172.21.15.69:0/964708967 conn(0x55e663025a80 msgr2=0x55e66315f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:13.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.453+0000 7f6fd46eab80 1 -- 172.21.15.69:0/964708967 shutdown_connections 2024-05-14T15:29:13.454 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.453+0000 7f6fd46eab80 1 -- 172.21.15.69:0/964708967 wait complete. 2024-05-14T15:29:13.455 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.454+0000 7f6fd46eab80 1 -- start start 2024-05-14T15:29:13.456 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.454+0000 7f6fd46eab80 1 Processor -- start 2024-05-14T15:29:13.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.455+0000 7f6fd46eab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e662fe6e40 0x55e66316e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.455+0000 7f6fd46eab80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663164c50 0x55e66316e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.455+0000 7f6fd46eab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e66316abf0 0x55e66316ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.455+0000 7f6fd46eab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55e6631716c0 con 0x55e66316abf0 2024-05-14T15:29:13.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.455+0000 7f6fd46eab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e662fecb20 con 0x55e662fe6e40 2024-05-14T15:29:13.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.455+0000 7f6fd46eab80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e663171840 con 0x55e663164c50 2024-05-14T15:29:13.457 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.455+0000 7f6fd46eab80 10 client.0 _ll_register_callbacks cb 0x55e66301a380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:13.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.456+0000 7f6fbea00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e662fe6e40 0x55e66316e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.456+0000 7f6fbe000700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663164c50 0x55e66316e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.456+0000 7f6fbea00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e662fe6e40 0x55e66316e3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:48590/0 (socket says 172.21.15.69:48590) 2024-05-14T15:29:13.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.456+0000 7f6fbea00700 1 -- 172.21.15.69:0/3318367813 learned_addr learned my addr 172.21.15.69:0/3318367813 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:13.458 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.457+0000 7f6fbf400700 1 --2- 172.21.15.69:0/3318367813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e66316abf0 0x55e66316ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.457+0000 7f6fbea00700 1 -- 172.21.15.69:0/3318367813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663164c50 msgr2=0x55e66316e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:13.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.457+0000 7f6fbea00700 1 --2- 172.21.15.69:0/3318367813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663164c50 0x55e66316e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.457+0000 7f6fbea00700 1 -- 172.21.15.69:0/3318367813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e66316abf0 msgr2=0x55e66316ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:13.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.457+0000 7f6fbea00700 1 --2- 172.21.15.69:0/3318367813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e66316abf0 0x55e66316ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.457+0000 7f6fbea00700 1 -- 172.21.15.69:0/3318367813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e66304c420 con 0x55e662fe6e40 2024-05-14T15:29:13.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.457+0000 7f6fbea00700 1 --2- 172.21.15.69:0/3318367813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e662fe6e40 0x55e66316e3d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000bfd0 tx=0x7f6fb00df010 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63431ba5088d1ac2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:13.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.457+0000 7f6fbf400700 1 --2- 172.21.15.69:0/3318367813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e66316abf0 0x55e66316ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:29:13.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.457+0000 7f6fbe000700 1 --2- 172.21.15.69:0/3318367813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663164c50 0x55e66316e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:29:13.459 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.458+0000 7f6fa8c00700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:29:13.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.458+0000 7f6fa8c00700 1 -- 172.21.15.69:0/3318367813 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb00c7020 con 0x55e662fe6e40 2024-05-14T15:29:13.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.458+0000 7f6fa8c00700 1 -- 172.21.15.69:0/3318367813 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7f6fb0010d10 con 0x55e662fe6e40 2024-05-14T15:29:13.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.458+0000 7f6fd46eab80 1 -- 172.21.15.69:0/3318367813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fb00a9300 con 0x55e662fe6e40 2024-05-14T15:29:13.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.459+0000 7f6fa8c00700 1 -- 172.21.15.69:0/3318367813 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f6fb008c050 con 0x55e662fe6e40 2024-05-14T15:29:13.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.459+0000 7f6fd46eab80 10 client.36278 fetch_fsmap learned FSMap version 55 2024-05-14T15:29:13.460 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.459+0000 7f6fd46eab80 1 -- 172.21.15.69:0/3318367813 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55e6631716c0 con 0x55e662fe6e40 2024-05-14T15:29:13.461 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.459+0000 7f6fa8c00700 1 -- 172.21.15.69:0/3318367813 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fb00a9300 con 0x55e662fe6e40 2024-05-14T15:29:13.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.460+0000 7f6fa8c00700 1 -- 172.21.15.69:0/3318367813 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 55) ==== 8398+0+0 (secure 0 0 0) 0x7f6fb00a8e60 con 0x55e662fe6e40 2024-05-14T15:29:13.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.460+0000 7f6fd46eab80 10 client.36278 fetch_fsmap finished waiting for FSMap version 55 2024-05-14T15:29:13.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.460+0000 7f6fd46eab80 10 client.36278 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-05-14T15:29:13.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.460+0000 7f6fd46eab80 20 client.36278 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:13.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.460+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/3318367813 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55e66317e5e0 0x55e663180a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.460+0000 7f6fd46eab80 4 client.36278 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:29:13.462 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.460+0000 7f6fd46eab80 1 -- 172.21.15.69:0/3318367813 --> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e663131070 con 0x55e66317e5e0 2024-05-14T15:29:13.463 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.461+0000 7f6fbe000700 1 --2- 172.21.15.69:0/3318367813 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55e66317e5e0 0x55e663180a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.463+0000 7f6fbe000700 1 --2- 172.21.15.69:0/3318367813 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55e66317e5e0 0x55e663180a00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=17158d243374d362 server_cookie=20b5ec090c5f7a74 in_seq=0 out_seq=0 2024-05-14T15:29:13.464 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.463+0000 7f6fa8c00700 10 client.36278 ms_handle_connect on v2:172.21.15.92:6834/360295917 2024-05-14T15:29:13.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.465+0000 7f6fa8c00700 1 -- 172.21.15.69:0/3318367813 <== mds.2 v2:172.21.15.92:6834/360295917 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e663131070 con 0x55e66317e5e0 2024-05-14T15:29:13.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.465+0000 7f6fa8c00700 10 client.36278 handle_command_reply: tid=0 2024-05-14T15:29:13.467 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.465+0000 7f6fd46eab80 1 client.36278 shutdown 2024-05-14T15:29:13.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.466+0000 7f6fd46eab80 1 -- 172.21.15.69:0/3318367813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e662fe6e40 msgr2=0x55e66316e3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:13.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.466+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/3318367813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e662fe6e40 0x55e66316e3d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000bfd0 tx=0x7f6fb00df010 comp rx=0 tx=0).stop 2024-05-14T15:29:13.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.466+0000 7f6fd46eab80 1 -- 172.21.15.69:0/3318367813 shutdown_connections 2024-05-14T15:29:13.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.466+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/3318367813 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e66316abf0 0x55e66316ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.466+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/3318367813 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55e66317e5e0 0x55e663180a00 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.468 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.466+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/3318367813 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e662fe6e40 0x55e66316e3d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.466+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/3318367813 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663164c50 0x55e66316e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.466+0000 7f6fa8c00700 0 client.36278 ms_handle_reset on v2:172.21.15.92:6834/360295917 2024-05-14T15:29:13.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.466+0000 7f6fd46eab80 1 -- 172.21.15.69:0/3318367813 >> 172.21.15.69:0/3318367813 conn(0x55e663025a80 msgr2=0x55e663163700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:13.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.467+0000 7f6fd46eab80 1 -- 172.21.15.69:0/3318367813 shutdown_connections 2024-05-14T15:29:13.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.467+0000 7f6fd46eab80 1 -- 172.21.15.69:0/3318367813 wait complete. 2024-05-14T15:29:13.469 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.467+0000 7f6fd46eab80 20 client.36278 trim_cache size 0 max 16384 2024-05-14T15:29:13.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.489+0000 7f6fd46eab80 1 Processor -- start 2024-05-14T15:29:13.491 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.490+0000 7f6fd46eab80 1 -- start start 2024-05-14T15:29:13.492 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.491+0000 7f6fd46eab80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e662fe6e40 0x55e663164710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.491+0000 7f6fd46eab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e663164c50 0x55e66316d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.491+0000 7f6fd46eab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e66316abf0 0x55e663159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.491+0000 7f6fd46eab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc01bf570 con 0x55e663164c50 2024-05-14T15:29:13.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.491+0000 7f6fd46eab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc01c1230 con 0x55e66316abf0 2024-05-14T15:29:13.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.491+0000 7f6fd46eab80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc01bfc40 con 0x55e662fe6e40 2024-05-14T15:29:13.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.491+0000 7f6fbea00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e662fe6e40 0x55e663164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.492+0000 7f6fbea00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e662fe6e40 0x55e663164710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:36182/0 (socket says 172.21.15.69:36182) 2024-05-14T15:29:13.494 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.492+0000 7f6fbea00700 1 -- 172.21.15.69:0/1986461587 learned_addr learned my addr 172.21.15.69:0/1986461587 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:13.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.492+0000 7f6fbe000700 1 --2- 172.21.15.69:0/1986461587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e663164c50 0x55e66316d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.493+0000 7f6fbf400700 1 --2- 172.21.15.69:0/1986461587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e66316abf0 0x55e663159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.493+0000 7f6fbea00700 1 -- 172.21.15.69:0/1986461587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e66316abf0 msgr2=0x55e663159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:13.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.493+0000 7f6fbea00700 1 --2- 172.21.15.69:0/1986461587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e66316abf0 0x55e663159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.495 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.493+0000 7f6fbea00700 1 -- 172.21.15.69:0/1986461587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e663164c50 msgr2=0x55e66316d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:13.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.493+0000 7f6fbea00700 1 --2- 172.21.15.69:0/1986461587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e663164c50 0x55e66316d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.493+0000 7f6fbea00700 1 -- 172.21.15.69:0/1986461587 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e663158fd0 con 0x55e662fe6e40 2024-05-14T15:29:13.496 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.494+0000 7f6fbf400700 1 --2- 172.21.15.69:0/1986461587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e66316abf0 0x55e663159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:29:13.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.494+0000 7f6fbea00700 1 --2- 172.21.15.69:0/1986461587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e662fe6e40 0x55e663164710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00a4c80 tx=0x7f6fb00a4bf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfa33cb1ed417337 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:13.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.494+0000 7f6fab400700 1 -- 172.21.15.69:0/1986461587 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb00c7070 con 0x55e662fe6e40 2024-05-14T15:29:13.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.495+0000 7f6fab400700 1 -- 172.21.15.69:0/1986461587 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fb00a9300 con 0x55e662fe6e40 2024-05-14T15:29:13.497 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.495+0000 7f6fab400700 1 -- 172.21.15.69:0/1986461587 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb00b1a60 con 0x55e662fe6e40 2024-05-14T15:29:13.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.497+0000 7f6fd46eab80 1 -- 172.21.15.69:0/1986461587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e662fe6e40 msgr2=0x55e663164710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:13.498 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.497+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/1986461587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e662fe6e40 0x55e663164710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00a4c80 tx=0x7f6fb00a4bf0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.497+0000 7f6fd46eab80 1 -- 172.21.15.69:0/1986461587 shutdown_connections 2024-05-14T15:29:13.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.497+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/1986461587 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e66316abf0 0x55e663159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.497+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/1986461587 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e662fe6e40 0x55e663164710 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.497+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/1986461587 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e663164c50 0x55e66316d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.499 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.497+0000 7f6fd46eab80 1 -- 172.21.15.69:0/1986461587 >> 172.21.15.69:0/1986461587 conn(0x55e663025a80 msgr2=0x55e6631680d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:13.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.498+0000 7f6fd46eab80 1 -- 172.21.15.69:0/1986461587 shutdown_connections 2024-05-14T15:29:13.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.498+0000 7f6fd46eab80 1 -- 172.21.15.69:0/1986461587 wait complete. 2024-05-14T15:29:13.500 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.499+0000 7f6fd46eab80 1 -- start start 2024-05-14T15:29:13.501 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.499+0000 7f6fd46eab80 1 Processor -- start 2024-05-14T15:29:13.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.501+0000 7f6fd46eab80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e663164c50 0x55e6631805f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.501+0000 7f6fd46eab80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e66316abf0 0x55e663180b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.501+0000 7f6fd46eab80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663181070 0x55e6631e6b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.501+0000 7f6fd46eab80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc01c0aa0 con 0x55e663164c50 2024-05-14T15:29:13.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.501+0000 7f6fd46eab80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc01c0310 con 0x55e66316abf0 2024-05-14T15:29:13.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.501+0000 7f6fd46eab80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6fc0074b10 con 0x55e663181070 2024-05-14T15:29:13.502 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.501+0000 7f6fd46eab80 10 client.0 _ll_register_callbacks cb 0x55e66301a380 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:13.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.502+0000 7f6fbf400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663181070 0x55e6631e6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.502+0000 7f6fbf400700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663181070 0x55e6631e6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:36198/0 (socket says 172.21.15.69:36198) 2024-05-14T15:29:13.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.502+0000 7f6fbf400700 1 -- 172.21.15.69:0/2590672871 learned_addr learned my addr 172.21.15.69:0/2590672871 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:13.503 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.502+0000 7f6fbe000700 1 --2- 172.21.15.69:0/2590672871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e66316abf0 0x55e663180b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.502+0000 7f6fbea00700 1 --2- 172.21.15.69:0/2590672871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e663164c50 0x55e6631805f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.503+0000 7f6fbf400700 1 -- 172.21.15.69:0/2590672871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e66316abf0 msgr2=0x55e663180b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:13.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.503+0000 7f6fbf400700 1 --2- 172.21.15.69:0/2590672871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e66316abf0 0x55e663180b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.503+0000 7f6fbf400700 1 -- 172.21.15.69:0/2590672871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e663164c50 msgr2=0x55e6631805f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:13.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.503+0000 7f6fbf400700 1 --2- 172.21.15.69:0/2590672871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e663164c50 0x55e6631805f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.503+0000 7f6fbf400700 1 -- 172.21.15.69:0/2590672871 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e663184060 con 0x55e663181070 2024-05-14T15:29:13.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.503+0000 7f6fbea00700 1 --2- 172.21.15.69:0/2590672871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e663164c50 0x55e6631805f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:29:13.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.504+0000 7f6fbf400700 1 --2- 172.21.15.69:0/2590672871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663181070 0x55e6631e6b20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800d010 tx=0x7f6fb8025000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60989339ff72e818 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:13.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.504+0000 7f6fa8c00700 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:29:13.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.505+0000 7f6fa8c00700 1 -- 172.21.15.69:0/2590672871 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fb80075c0 con 0x55e663181070 2024-05-14T15:29:13.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.505+0000 7f6fa8c00700 1 -- 172.21.15.69:0/2590672871 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7f6fb8007760 con 0x55e663181070 2024-05-14T15:29:13.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.505+0000 7f6fd46eab80 1 -- 172.21.15.69:0/2590672871 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6fb00a9300 con 0x55e663181070 2024-05-14T15:29:13.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.507+0000 7f6fa8c00700 1 -- 172.21.15.69:0/2590672871 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f6fb8007960 con 0x55e663181070 2024-05-14T15:29:13.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.507+0000 7f6fd46eab80 10 client.26254 fetch_fsmap learned FSMap version 55 2024-05-14T15:29:13.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.507+0000 7f6fd46eab80 1 -- 172.21.15.69:0/2590672871 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55e6631e8010 con 0x55e663181070 2024-05-14T15:29:13.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.508+0000 7f6fa8c00700 1 -- 172.21.15.69:0/2590672871 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6fb00a9300 con 0x55e663181070 2024-05-14T15:29:13.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.508+0000 7f6fa8c00700 1 -- 172.21.15.69:0/2590672871 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 55) ==== 8398+0+0 (secure 0 0 0) 0x7f6fb8011070 con 0x55e663181070 2024-05-14T15:29:13.511 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.508+0000 7f6fd46eab80 10 client.26254 fetch_fsmap finished waiting for FSMap version 55 2024-05-14T15:29:13.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.508+0000 7f6fd46eab80 10 client.26254 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.e 2024-05-14T15:29:13.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.508+0000 7f6fd46eab80 20 client.26254 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:13.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.508+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/2590672871 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55e6631e86f0 0x55e6631eab10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:13.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.508+0000 7f6fd46eab80 4 client.26254 mds_command: new command op to 34433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:29:13.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.508+0000 7f6fd46eab80 1 -- 172.21.15.69:0/2590672871 --> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e663094400 con 0x55e6631e86f0 2024-05-14T15:29:13.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.509+0000 7f6fbea00700 1 --2- 172.21.15.69:0/2590672871 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55e6631e86f0 0x55e6631eab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:13.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.510+0000 7f6fbea00700 1 --2- 172.21.15.69:0/2590672871 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55e6631e86f0 0x55e6631eab10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b77462a71622c2a4 server_cookie=8f745cfe833b7bc2 in_seq=0 out_seq=0 2024-05-14T15:29:13.512 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.510+0000 7f6fa8c00700 10 client.26254 ms_handle_connect on v2:172.21.15.92:6834/360295917 2024-05-14T15:29:13.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.511+0000 7f6fa8c00700 1 -- 172.21.15.69:0/2590672871 <== mds.2 v2:172.21.15.92:6834/360295917 1 ==== command_reply(tid 0: 0 ) ==== 8+0+4955 (crc 0 0 0) 0x55e663094400 con 0x55e6631e86f0 2024-05-14T15:29:13.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.511+0000 7f6fa8c00700 10 client.26254 handle_command_reply: tid=0 2024-05-14T15:29:13.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.511+0000 7f6fd46eab80 1 client.26254 shutdown 2024-05-14T15:29:13.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.512+0000 7f6fd46eab80 1 -- 172.21.15.69:0/2590672871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663181070 msgr2=0x55e6631e6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:13.513 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.512+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/2590672871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663181070 0x55e6631e6b20 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6fb800d010 tx=0x7f6fb8025000 comp rx=0 tx=0).stop 2024-05-14T15:29:13.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.513+0000 7f6fd46eab80 1 -- 172.21.15.69:0/2590672871 shutdown_connections 2024-05-14T15:29:13.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.513+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/2590672871 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e663164c50 0x55e6631805f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.513+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/2590672871 >> [v2:172.21.15.92:6834/360295917,v1:172.21.15.92:6835/360295917] conn(0x55e6631e86f0 0x55e6631eab10 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.513+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/2590672871 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e663181070 0x55e6631e6b20 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.513+0000 7f6fd46eab80 1 --2- 172.21.15.69:0/2590672871 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e66316abf0 0x55e663180b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.513+0000 7f6fa8c00700 0 client.26254 ms_handle_reset on v2:172.21.15.92:6834/360295917 2024-05-14T15:29:13.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.513+0000 7f6fd46eab80 1 -- 172.21.15.69:0/2590672871 >> 172.21.15.69:0/2590672871 conn(0x55e663025a80 msgr2=0x55e66316d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:13.515 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.513+0000 7f6fd46eab80 1 -- 172.21.15.69:0/2590672871 shutdown_connections 2024-05-14T15:29:13.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.513+0000 7f6fd46eab80 1 -- 172.21.15.69:0/2590672871 wait complete. 2024-05-14T15:29:13.516 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.514+0000 7f6fd46eab80 20 client.26254 trim_cache size 0 max 16384 2024-05-14T15:29:13.518 INFO:teuthology.orchestra.run.smithi069.stdout:[ 2024-05-14T15:29:13.518 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.518 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.518 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 283872478, 2024-05-14T15:29:13.518 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628619, 2024-05-14T15:29:13.518 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2606_vm" 2024-05-14T15:29:13.518 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.519 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.519 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.519 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 288388844, 2024-05-14T15:29:13.519 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628622, 2024-05-14T15:29:13.519 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2617_vm" 2024-05-14T15:29:13.519 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.519 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.519 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.519 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 567370234, 2024-05-14T15:29:13.519 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628586, 2024-05-14T15:29:13.519 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/pg_filenode.map" 2024-05-14T15:29:13.519 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.520 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.520 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.520 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 996832245, 2024-05-14T15:29:13.520 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628595, 2024-05-14T15:29:13.520 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3456_fsm" 2024-05-14T15:29:13.520 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.520 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.520 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.520 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1258532013, 2024-05-14T15:29:13.520 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628629, 2024-05-14T15:29:13.520 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2612_vm" 2024-05-14T15:29:13.520 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.521 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.521 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.521 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1430870010, 2024-05-14T15:29:13.521 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628604, 2024-05-14T15:29:13.521 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13354" 2024-05-14T15:29:13.521 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.521 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.521 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.521 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1617683992, 2024-05-14T15:29:13.521 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628624, 2024-05-14T15:29:13.521 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2616_vm" 2024-05-14T15:29:13.521 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.522 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.522 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.522 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1670035353, 2024-05-14T15:29:13.522 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628652, 2024-05-14T15:29:13.522 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3456_vm" 2024-05-14T15:29:13.522 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.522 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.522 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.522 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1710389994, 2024-05-14T15:29:13.522 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628606, 2024-05-14T15:29:13.522 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13358" 2024-05-14T15:29:13.522 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.522 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.523 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.523 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1727653102, 2024-05-14T15:29:13.523 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628656, 2024-05-14T15:29:13.523 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13349_fsm" 2024-05-14T15:29:13.523 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.523 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.523 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.523 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 1819558097, 2024-05-14T15:29:13.523 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628659, 2024-05-14T15:29:13.523 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13359_vm" 2024-05-14T15:29:13.523 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.523 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.523 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.524 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2154304664, 2024-05-14T15:29:13.524 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 2199023256067, 2024-05-14T15:29:13.524 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/13494/16396" 2024-05-14T15:29:13.524 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.524 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.524 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.524 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2196398844, 2024-05-14T15:29:13.524 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628632, 2024-05-14T15:29:13.524 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2618_vm" 2024-05-14T15:29:13.524 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.524 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.524 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.525 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2434061586, 2024-05-14T15:29:13.525 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628615, 2024-05-14T15:29:13.525 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/1247_vm" 2024-05-14T15:29:13.525 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.525 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.525 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.525 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2517101269, 2024-05-14T15:29:13.525 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628654, 2024-05-14T15:29:13.525 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3541_fsm" 2024-05-14T15:29:13.525 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.525 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.525 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.526 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2584629795, 2024-05-14T15:29:13.526 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628613, 2024-05-14T15:29:13.526 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2619_vm" 2024-05-14T15:29:13.526 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.526 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.526 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.526 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2907317524, 2024-05-14T15:29:13.526 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628628, 2024-05-14T15:29:13.526 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2603_vm" 2024-05-14T15:29:13.526 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.526 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.526 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.527 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 2936314412, 2024-05-14T15:29:13.527 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628608, 2024-05-14T15:29:13.527 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13361" 2024-05-14T15:29:13.527 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.527 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.527 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.527 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3105262353, 2024-05-14T15:29:13.527 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628639, 2024-05-14T15:29:13.527 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2608_vm" 2024-05-14T15:29:13.527 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.527 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.527 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.528 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3762697389, 2024-05-14T15:29:13.528 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628649, 2024-05-14T15:29:13.528 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3079_vm" 2024-05-14T15:29:13.528 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.528 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.528 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.528 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3801407785, 2024-05-14T15:29:13.528 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628612, 2024-05-14T15:29:13.528 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2840_fsm" 2024-05-14T15:29:13.528 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.528 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.529 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.529 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 3841042023, 2024-05-14T15:29:13.529 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628648, 2024-05-14T15:29:13.529 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3764_fsm" 2024-05-14T15:29:13.529 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.529 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.529 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.529 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4059510004, 2024-05-14T15:29:13.529 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628625, 2024-05-14T15:29:13.529 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2601_vm" 2024-05-14T15:29:13.529 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:29:13.529 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:29:13.530 INFO:teuthology.orchestra.run.smithi069.stdout: "damage_type": "backtrace", 2024-05-14T15:29:13.530 INFO:teuthology.orchestra.run.smithi069.stdout: "id": 4064936195, 2024-05-14T15:29:13.530 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 1099511628661, 2024-05-14T15:29:13.530 INFO:teuthology.orchestra.run.smithi069.stdout: "path": "/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13344_vm" 2024-05-14T15:29:13.530 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:29:13.530 INFO:teuthology.orchestra.run.smithi069.stdout:] 2024-05-14T15:29:13.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.515+0000 7f6fc5c00700 1 -- 172.21.15.69:0/2801219007 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6fa40b2a70 msgr2=0x7f6fa40b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:13.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.515+0000 7f6fc5c00700 1 --2- 172.21.15.69:0/2801219007 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6fa40b2a70 0x7f6fa40b4f80 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8005bd0 tx=0x7f6fb8005a20 comp rx=0 tx=0).stop 2024-05-14T15:29:13.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.515+0000 7f6fc5c00700 1 -- 172.21.15.69:0/2801219007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fc01034c0 msgr2=0x7f6fc010c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:13.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.515+0000 7f6fc5c00700 1 --2- 172.21.15.69:0/2801219007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fc01034c0 0x7f6fc010c3c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000b450 tx=0x7f6fb000b760 comp rx=0 tx=0).stop 2024-05-14T15:29:13.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.515+0000 7f6fc5c00700 1 -- 172.21.15.69:0/2801219007 shutdown_connections 2024-05-14T15:29:13.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.515+0000 7f6fc5c00700 1 --2- 172.21.15.69:0/2801219007 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6fa40b2a70 0x7f6fa40b4f80 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.515+0000 7f6fc5c00700 1 --2- 172.21.15.69:0/2801219007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6fc0108740 0x7f6fc010ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.515+0000 7f6fc5c00700 1 --2- 172.21.15.69:0/2801219007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6fc01034c0 0x7f6fc010c3c0 secure :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f6fb000b450 tx=0x7f6fb000b760 comp rx=0 tx=0).stop 2024-05-14T15:29:13.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.515+0000 7f6fc5c00700 1 --2- 172.21.15.69:0/2801219007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6fc0107df0 0x7f6fc010c900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:13.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.515+0000 7f6fc5c00700 1 -- 172.21.15.69:0/2801219007 >> 172.21.15.69:0/2801219007 conn(0x7f6fc00fedc0 msgr2=0x7f6fc01075d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:13.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.516+0000 7f6fc5c00700 1 -- 172.21.15.69:0/2801219007 shutdown_connections 2024-05-14T15:29:13.531 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:13.516+0000 7f6fc5c00700 1 -- 172.21.15.69:0/2801219007 wait complete. 2024-05-14T15:29:14.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:13 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:29:14.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:13 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:29:14.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:13 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:29:14.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:13 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:29:14.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:13 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:29:14.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:13 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:29:14.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:13 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:29:14.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:13 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:29:14.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:13 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:29:14.564 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-05-14T15:29:15.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:14 smithi092 ceph-mon[34729]: pgmap v235: 129 pgs: 129 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 9.6 MiB/s wr, 604 op/s 2024-05-14T15:29:15.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:14 smithi069 ceph-mon[31270]: pgmap v235: 129 pgs: 129 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 9.6 MiB/s wr, 604 op/s 2024-05-14T15:29:15.301 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:29:15.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:14 smithi203 ceph-mon[34567]: pgmap v235: 129 pgs: 129 active+clean; 2.4 GiB data, 9.5 GiB used, 1.0 TiB / 1.0 TiB avail; 102 KiB/s rd, 9.6 MiB/s wr, 604 op/s 2024-05-14T15:29:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 210.0 s, 589.2 tps, lat 186.577 ms stddev 281.284 2024-05-14T15:29:17.132 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:17 smithi069 ceph-mon[31270]: pgmap v236: 129 pgs: 129 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 10 MiB/s wr, 589 op/s 2024-05-14T15:29:17.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:17 smithi092 ceph-mon[34729]: pgmap v236: 129 pgs: 129 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 10 MiB/s wr, 589 op/s 2024-05-14T15:29:17.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:17 smithi203 ceph-mon[34567]: pgmap v236: 129 pgs: 129 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 10 MiB/s wr, 589 op/s 2024-05-14T15:29:18.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.869+0000 7f695b600700 1 -- 172.21.15.69:0/2161861645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f695410b2e0 msgr2=0x7f6954117810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:18.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.869+0000 7f695b600700 1 --2- 172.21.15.69:0/2161861645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f695410b2e0 0x7f6954117810 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f694c00b0a0 tx=0x7f694c00b3b0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.869+0000 7f695b600700 1 -- 172.21.15.69:0/2161861645 shutdown_connections 2024-05-14T15:29:18.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.869+0000 7f695b600700 1 --2- 172.21.15.69:0/2161861645 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f695410b2e0 0x7f6954117810 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.869+0000 7f695b600700 1 --2- 172.21.15.69:0/2161861645 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6954110970 0x7f6954110d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.869+0000 7f695b600700 1 --2- 172.21.15.69:0/2161861645 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f695410a990 0x7f695410ada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.869+0000 7f695b600700 1 -- 172.21.15.69:0/2161861645 >> 172.21.15.69:0/2161861645 conn(0x7f6954077c80 msgr2=0x7f69540780e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:18.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.869+0000 7f695b600700 1 -- 172.21.15.69:0/2161861645 shutdown_connections 2024-05-14T15:29:18.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.869+0000 7f695b600700 1 -- 172.21.15.69:0/2161861645 wait complete. 2024-05-14T15:29:18.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.870+0000 7f695b600700 1 Processor -- start 2024-05-14T15:29:18.121 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.870+0000 7f695b600700 1 -- start start 2024-05-14T15:29:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.870+0000 7f695b600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f695410a990 0x7f69541a13c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.870+0000 7f695b600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f695410b2e0 0x7f69541a1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.871+0000 7f695b600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6954110970 0x7f69541a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.871+0000 7f695b600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f695411aa10 con 0x7f695410b2e0 2024-05-14T15:29:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.871+0000 7f695b600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f695411a890 con 0x7f6954110970 2024-05-14T15:29:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.871+0000 7f695b600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f695411ab90 con 0x7f695410a990 2024-05-14T15:29:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.871+0000 7f6953e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f695410b2e0 0x7f69541a1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.871+0000 7f6953e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f695410b2e0 0x7f69541a1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43198/0 (socket says 172.21.15.69:43198) 2024-05-14T15:29:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.871+0000 7f6953e00700 1 -- 172.21.15.69:0/3598486772 learned_addr learned my addr 172.21.15.69:0/3598486772 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.871+0000 7f6959600700 1 --2- 172.21.15.69:0/3598486772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6954110970 0x7f69541a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.871+0000 7f6958c00700 1 --2- 172.21.15.69:0/3598486772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f695410a990 0x7f69541a13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:18.122 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.871+0000 7f6953e00700 1 -- 172.21.15.69:0/3598486772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f695410a990 msgr2=0x7f69541a13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:18.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.871+0000 7f6953e00700 1 --2- 172.21.15.69:0/3598486772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f695410a990 0x7f69541a13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.871+0000 7f6953e00700 1 -- 172.21.15.69:0/3598486772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6954110970 msgr2=0x7f69541a5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:18.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.871+0000 7f6953e00700 1 --2- 172.21.15.69:0/3598486772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6954110970 0x7f69541a5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.871+0000 7f6953e00700 1 -- 172.21.15.69:0/3598486772 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69541a6290 con 0x7f695410b2e0 2024-05-14T15:29:18.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.871+0000 7f6958c00700 1 --2- 172.21.15.69:0/3598486772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f695410a990 0x7f69541a13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:29:18.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.872+0000 7f6953e00700 1 --2- 172.21.15.69:0/3598486772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f695410b2e0 0x7f69541a1960 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f694000b500 tx=0x7f694000b8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:18.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.872+0000 7f6951600700 1 -- 172.21.15.69:0/3598486772 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940015020 con 0x7f695410b2e0 2024-05-14T15:29:18.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.872+0000 7f6951600700 1 -- 172.21.15.69:0/3598486772 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6940011cc0 con 0x7f695410b2e0 2024-05-14T15:29:18.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.872+0000 7f6951600700 1 -- 172.21.15.69:0/3598486772 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6940010c80 con 0x7f695410b2e0 2024-05-14T15:29:18.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.872+0000 7f695b600700 1 -- 172.21.15.69:0/3598486772 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69541a6580 con 0x7f695410b2e0 2024-05-14T15:29:18.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.872+0000 7f695b600700 1 -- 172.21.15.69:0/3598486772 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69541adea0 con 0x7f695410b2e0 2024-05-14T15:29:18.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.876+0000 7f6951600700 1 -- 172.21.15.69:0/3598486772 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6940018020 con 0x7f695410b2e0 2024-05-14T15:29:18.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.877+0000 7f696a108b80 1 Processor -- start 2024-05-14T15:29:18.123 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.877+0000 7f696a108b80 1 -- start start 2024-05-14T15:29:18.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.877+0000 7f696a108b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119a6de40 0x556119bf12f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.877+0000 7f696a108b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119bf1830 0x556119beb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.877+0000 7f696a108b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119beb9f0 0x556119bebe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.877+0000 7f696a108b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x556119b0da20 con 0x556119beb9f0 2024-05-14T15:29:18.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.877+0000 7f696a108b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556119aab760 con 0x556119bf1830 2024-05-14T15:29:18.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.877+0000 7f696a108b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556119b099e0 con 0x556119a6de40 2024-05-14T15:29:18.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.877+0000 7f6951600700 1 --2- 172.21.15.69:0/3598486772 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f693c0b29f0 0x7f693c0b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.878+0000 7f6951600700 1 -- 172.21.15.69:0/3598486772 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7f69400e2100 con 0x7f695410b2e0 2024-05-14T15:29:18.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.878+0000 7f6953e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119beb9f0 0x556119bebe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:18.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.878+0000 7f6959600700 1 --2- 172.21.15.69:0/3598486772 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f693c0b29f0 0x7f693c0b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:18.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.878+0000 7f6953e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119beb9f0 0x556119bebe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43214/0 (socket says 172.21.15.69:43214) 2024-05-14T15:29:18.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.878+0000 7f6953e00700 1 -- 172.21.15.69:0/2556152917 learned_addr learned my addr 172.21.15.69:0/2556152917 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:18.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.878+0000 7f6958c00700 1 --2- 172.21.15.69:0/2556152917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119bf1830 0x556119beb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:18.124 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.878+0000 7f6959600700 1 --2- 172.21.15.69:0/2556152917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119a6de40 0x556119bf12f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:18.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.878+0000 7f6953e00700 1 -- 172.21.15.69:0/2556152917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119a6de40 msgr2=0x556119bf12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:18.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.878+0000 7f6953e00700 1 --2- 172.21.15.69:0/2556152917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119a6de40 0x556119bf12f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.878+0000 7f6953e00700 1 -- 172.21.15.69:0/2556152917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119bf1830 msgr2=0x556119beb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:18.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.878+0000 7f6953e00700 1 --2- 172.21.15.69:0/2556152917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119bf1830 0x556119beb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.878+0000 7f6953e00700 1 -- 172.21.15.69:0/2556152917 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556119a5a8d0 con 0x556119beb9f0 2024-05-14T15:29:18.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.879+0000 7f6953e00700 1 --2- 172.21.15.69:0/2556152917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119beb9f0 0x556119bebe00 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f69400df550 tx=0x7f69400a88f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a84641d2980c85a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:18.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.879+0000 7f6959600700 1 --2- 172.21.15.69:0/3598486772 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f693c0b29f0 0x7f693c0b4f00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f694c00b830 tx=0x7f694c009ce0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:18.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.879+0000 7f6946000700 1 -- 172.21.15.69:0/2556152917 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69400c3070 con 0x556119beb9f0 2024-05-14T15:29:18.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.879+0000 7f6946000700 1 -- 172.21.15.69:0/2556152917 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69400a9780 con 0x556119beb9f0 2024-05-14T15:29:18.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.879+0000 7f6946000700 1 -- 172.21.15.69:0/2556152917 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69400df660 con 0x556119beb9f0 2024-05-14T15:29:18.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.880+0000 7f696a108b80 1 -- 172.21.15.69:0/2556152917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119beb9f0 msgr2=0x556119bebe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:18.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.880+0000 7f696a108b80 1 --2- 172.21.15.69:0/2556152917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119beb9f0 0x556119bebe00 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f69400df550 tx=0x7f69400a88f0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.125 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.880+0000 7f696a108b80 1 -- 172.21.15.69:0/2556152917 shutdown_connections 2024-05-14T15:29:18.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.880+0000 7f696a108b80 1 --2- 172.21.15.69:0/2556152917 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119beb9f0 0x556119bebe00 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.880+0000 7f696a108b80 1 --2- 172.21.15.69:0/2556152917 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119a6de40 0x556119bf12f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.880+0000 7f696a108b80 1 --2- 172.21.15.69:0/2556152917 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119bf1830 0x556119beb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.880+0000 7f696a108b80 1 -- 172.21.15.69:0/2556152917 >> 172.21.15.69:0/2556152917 conn(0x556119ab2f70 msgr2=0x556119be62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:18.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.880+0000 7f696a108b80 1 -- 172.21.15.69:0/2556152917 shutdown_connections 2024-05-14T15:29:18.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.880+0000 7f696a108b80 1 -- 172.21.15.69:0/2556152917 wait complete. 2024-05-14T15:29:18.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.881+0000 7f696a108b80 1 -- start start 2024-05-14T15:29:18.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.881+0000 7f696a108b80 1 Processor -- start 2024-05-14T15:29:18.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.881+0000 7f696a108b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119a6de40 0x556119bf4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.881+0000 7f696a108b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119beb9f0 0x556119bf5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.881+0000 7f696a108b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119bf1830 0x556119bf5a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.881+0000 7f696a108b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x556119bf8310 con 0x556119bf1830 2024-05-14T15:29:18.126 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.881+0000 7f696a108b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x556119a73b20 con 0x556119beb9f0 2024-05-14T15:29:18.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.881+0000 7f696a108b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x556119bf8490 con 0x556119a6de40 2024-05-14T15:29:18.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.881+0000 7f696a108b80 10 client.0 _ll_register_callbacks cb 0x556119ab4c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:18.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.882+0000 7f6959600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119bf1830 0x556119bf5a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:18.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.882+0000 7f6959600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119bf1830 0x556119bf5a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43228/0 (socket says 172.21.15.69:43228) 2024-05-14T15:29:18.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.882+0000 7f6959600700 1 -- 172.21.15.69:0/729873591 learned_addr learned my addr 172.21.15.69:0/729873591 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:18.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.882+0000 7f6958c00700 1 --2- 172.21.15.69:0/729873591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119a6de40 0x556119bf4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:18.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.882+0000 7f6953e00700 1 --2- 172.21.15.69:0/729873591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119beb9f0 0x556119bf5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:18.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.882+0000 7f6959600700 1 -- 172.21.15.69:0/729873591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119a6de40 msgr2=0x556119bf4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:18.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.882+0000 7f6959600700 1 --2- 172.21.15.69:0/729873591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119a6de40 0x556119bf4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.882+0000 7f6959600700 1 -- 172.21.15.69:0/729873591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119beb9f0 msgr2=0x556119bf5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:18.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.882+0000 7f6959600700 1 --2- 172.21.15.69:0/729873591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119beb9f0 0x556119bf5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.127 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.882+0000 7f6959600700 1 -- 172.21.15.69:0/729873591 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556119ad3420 con 0x556119bf1830 2024-05-14T15:29:18.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.882+0000 7f6958c00700 1 --2- 172.21.15.69:0/729873591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119a6de40 0x556119bf4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:29:18.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.882+0000 7f6953e00700 1 --2- 172.21.15.69:0/729873591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119beb9f0 0x556119bf5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:29:18.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.882+0000 7f6959600700 1 --2- 172.21.15.69:0/729873591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119bf1830 0x556119bf5a60 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f694c015000 tx=0x7f694c009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e1f5a04202167e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:18.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.882+0000 7f693aa00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:29:18.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.883+0000 7f693aa00700 1 -- 172.21.15.69:0/729873591 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c02f020 con 0x556119bf1830 2024-05-14T15:29:18.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.883+0000 7f693aa00700 1 -- 172.21.15.69:0/729873591 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7f694c020450 con 0x556119bf1830 2024-05-14T15:29:18.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.883+0000 7f696a108b80 1 -- 172.21.15.69:0/729873591 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69400a9780 con 0x556119bf1830 2024-05-14T15:29:18.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.883+0000 7f693aa00700 1 -- 172.21.15.69:0/729873591 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f694c007da0 con 0x556119bf1830 2024-05-14T15:29:18.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.883+0000 7f696a108b80 10 client.16797 fetch_fsmap learned FSMap version 55 2024-05-14T15:29:18.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.883+0000 7f696a108b80 1 -- 172.21.15.69:0/729873591 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x556119c02e40 con 0x556119bf1830 2024-05-14T15:29:18.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.883+0000 7f693aa00700 1 -- 172.21.15.69:0/729873591 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69400a9780 con 0x556119bf1830 2024-05-14T15:29:18.128 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.883+0000 7f693aa00700 1 -- 172.21.15.69:0/729873591 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 55) ==== 8398+0+0 (secure 0 0 0) 0x7f694c011070 con 0x556119bf1830 2024-05-14T15:29:18.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.884+0000 7f696a108b80 10 client.16797 fetch_fsmap finished waiting for FSMap version 55 2024-05-14T15:29:18.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.884+0000 7f696a108b80 10 client.16797 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-14T15:29:18.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.884+0000 7f696a108b80 20 client.16797 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:18.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.884+0000 7f696a108b80 1 --2- 172.21.15.69:0/729873591 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x556119c05480 0x556119c078a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.884+0000 7f696a108b80 4 client.16797 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:29:18.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.884+0000 7f696a108b80 1 -- 172.21.15.69:0/729873591 --> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556119bb81c0 con 0x556119c05480 2024-05-14T15:29:18.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.884+0000 7f6958c00700 1 --2- 172.21.15.69:0/729873591 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x556119c05480 0x556119c078a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:18.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.885+0000 7f693aa00700 10 client.16797 ms_handle_connect on v2:172.21.15.92:6836/1669439322 2024-05-14T15:29:18.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.885+0000 7f6958c00700 1 --2- 172.21.15.69:0/729873591 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x556119c05480 0x556119c078a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=307ac1f754be6d12 server_cookie=ce1a9fbbb3728299 in_seq=0 out_seq=0 2024-05-14T15:29:18.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.887+0000 7f693aa00700 1 -- 172.21.15.69:0/729873591 <== mds.1 v2:172.21.15.92:6836/1669439322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x556119bb81c0 con 0x556119c05480 2024-05-14T15:29:18.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.887+0000 7f693aa00700 10 client.16797 handle_command_reply: tid=0 2024-05-14T15:29:18.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.888+0000 7f696a108b80 1 client.16797 shutdown 2024-05-14T15:29:18.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.888+0000 7f696a108b80 1 -- 172.21.15.69:0/729873591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119bf1830 msgr2=0x556119bf5a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:18.129 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.888+0000 7f696a108b80 1 --2- 172.21.15.69:0/729873591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119bf1830 0x556119bf5a60 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f694c015000 tx=0x7f694c009880 comp rx=0 tx=0).stop 2024-05-14T15:29:18.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.888+0000 7f696a108b80 1 -- 172.21.15.69:0/729873591 shutdown_connections 2024-05-14T15:29:18.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.888+0000 7f696a108b80 1 --2- 172.21.15.69:0/729873591 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x556119c05480 0x556119c078a0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.888+0000 7f696a108b80 1 --2- 172.21.15.69:0/729873591 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119bf1830 0x556119bf5a60 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.888+0000 7f696a108b80 1 --2- 172.21.15.69:0/729873591 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119a6de40 0x556119bf4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.888+0000 7f696a108b80 1 --2- 172.21.15.69:0/729873591 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119beb9f0 0x556119bf5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.888+0000 7f696a108b80 1 -- 172.21.15.69:0/729873591 >> 172.21.15.69:0/729873591 conn(0x556119ab2f70 msgr2=0x556119bea4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:18.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.888+0000 7f693aa00700 0 client.16797 ms_handle_reset on v2:172.21.15.92:6836/1669439322 2024-05-14T15:29:18.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.888+0000 7f696a108b80 1 -- 172.21.15.69:0/729873591 shutdown_connections 2024-05-14T15:29:18.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.888+0000 7f696a108b80 1 -- 172.21.15.69:0/729873591 wait complete. 2024-05-14T15:29:18.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.888+0000 7f696a108b80 20 client.16797 trim_cache size 0 max 16384 2024-05-14T15:29:18.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.903+0000 7f696a108b80 1 Processor -- start 2024-05-14T15:29:18.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.904+0000 7f696a108b80 1 -- start start 2024-05-14T15:29:18.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.904+0000 7f696a108b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119a6de40 0x556119beb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.130 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.904+0000 7f696a108b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119beb9f0 0x556119bf48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.904+0000 7f696a108b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119bf1830 0x556119bf56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.904+0000 7f696a108b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f69541b6d90 con 0x556119beb9f0 2024-05-14T15:29:18.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.904+0000 7f696a108b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f69541b8a50 con 0x556119bf1830 2024-05-14T15:29:18.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.904+0000 7f696a108b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f69541b7460 con 0x556119a6de40 2024-05-14T15:29:18.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.904+0000 7f6953e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119beb9f0 0x556119bf48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:18.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.904+0000 7f6953e00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119beb9f0 0x556119bf48e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43234/0 (socket says 172.21.15.69:43234) 2024-05-14T15:29:18.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.904+0000 7f6953e00700 1 -- 172.21.15.69:0/715429209 learned_addr learned my addr 172.21.15.69:0/715429209 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:18.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.904+0000 7f6953e00700 1 -- 172.21.15.69:0/715429209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119a6de40 msgr2=0x556119beb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:18.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.904+0000 7f6953e00700 1 --2- 172.21.15.69:0/715429209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119a6de40 0x556119beb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.131 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.904+0000 7f6953e00700 1 -- 172.21.15.69:0/715429209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119bf1830 msgr2=0x556119bf56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:18.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.904+0000 7f6953e00700 1 --2- 172.21.15.69:0/715429209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119bf1830 0x556119bf56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.905+0000 7f6953e00700 1 -- 172.21.15.69:0/715429209 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556119bde3e0 con 0x556119beb9f0 2024-05-14T15:29:18.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.905+0000 7f6953e00700 1 --2- 172.21.15.69:0/715429209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119beb9f0 0x556119bf48e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6940010660 tx=0x7f6940004860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=731ea7d576c0828b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:18.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.905+0000 7f6945600700 1 -- 172.21.15.69:0/715429209 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69400c3040 con 0x556119beb9f0 2024-05-14T15:29:18.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.905+0000 7f6945600700 1 -- 172.21.15.69:0/715429209 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69400c8070 con 0x556119beb9f0 2024-05-14T15:29:18.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.905+0000 7f6945600700 1 -- 172.21.15.69:0/715429209 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69400a92e0 con 0x556119beb9f0 2024-05-14T15:29:18.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.906+0000 7f696a108b80 1 -- 172.21.15.69:0/715429209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119beb9f0 msgr2=0x556119bf48e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:18.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.906+0000 7f696a108b80 1 --2- 172.21.15.69:0/715429209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119beb9f0 0x556119bf48e0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6940010660 tx=0x7f6940004860 comp rx=0 tx=0).stop 2024-05-14T15:29:18.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.906+0000 7f696a108b80 1 -- 172.21.15.69:0/715429209 shutdown_connections 2024-05-14T15:29:18.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.906+0000 7f696a108b80 1 --2- 172.21.15.69:0/715429209 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119bf1830 0x556119bf56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.906+0000 7f696a108b80 1 --2- 172.21.15.69:0/715429209 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119a6de40 0x556119beb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.906+0000 7f696a108b80 1 --2- 172.21.15.69:0/715429209 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119beb9f0 0x556119bf48e0 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.132 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.906+0000 7f696a108b80 1 -- 172.21.15.69:0/715429209 >> 172.21.15.69:0/715429209 conn(0x556119ab2f70 msgr2=0x556119bf4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:18.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.906+0000 7f696a108b80 1 -- 172.21.15.69:0/715429209 shutdown_connections 2024-05-14T15:29:18.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.906+0000 7f696a108b80 1 -- 172.21.15.69:0/715429209 wait complete. 2024-05-14T15:29:18.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.906+0000 7f696a108b80 1 -- start start 2024-05-14T15:29:18.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.907+0000 7f696a108b80 1 Processor -- start 2024-05-14T15:29:18.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.907+0000 7f696a108b80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119a6de40 0x556119bfd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.907+0000 7f696a108b80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119beb9f0 0x556119bfdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.907+0000 7f696a108b80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119bf1830 0x556119c0c010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.907+0000 7f696a108b80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f69541b82c0 con 0x556119bf1830 2024-05-14T15:29:18.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.907+0000 7f696a108b80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f69541b7b30 con 0x556119a6de40 2024-05-14T15:29:18.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.907+0000 7f696a108b80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f69541b4d50 con 0x556119beb9f0 2024-05-14T15:29:18.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.907+0000 7f696a108b80 10 client.0 _ll_register_callbacks cb 0x556119ab4c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:18.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.907+0000 7f6959600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119bf1830 0x556119c0c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:18.133 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.907+0000 7f6959600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119bf1830 0x556119c0c010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43238/0 (socket says 172.21.15.69:43238) 2024-05-14T15:29:18.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.907+0000 7f6959600700 1 -- 172.21.15.69:0/897926364 learned_addr learned my addr 172.21.15.69:0/897926364 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:18.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.908+0000 7f6959600700 1 -- 172.21.15.69:0/897926364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119beb9f0 msgr2=0x556119bfdc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:18.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.908+0000 7f6959600700 1 --2- 172.21.15.69:0/897926364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119beb9f0 0x556119bfdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.908+0000 7f6959600700 1 -- 172.21.15.69:0/897926364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119a6de40 msgr2=0x556119bfd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:18.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.908+0000 7f6959600700 1 --2- 172.21.15.69:0/897926364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119a6de40 0x556119bfd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.908+0000 7f6959600700 1 -- 172.21.15.69:0/897926364 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556119c0c710 con 0x556119bf1830 2024-05-14T15:29:18.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.908+0000 7f6959600700 1 --2- 172.21.15.69:0/897926364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119bf1830 0x556119c0c010 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f694c0062a0 tx=0x7f694c00b970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50667b5eaec25de2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:18.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.908+0000 7f693aa00700 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:29:18.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.908+0000 7f693aa00700 1 -- 172.21.15.69:0/897926364 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f694c02f040 con 0x556119bf1830 2024-05-14T15:29:18.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.908+0000 7f693aa00700 1 -- 172.21.15.69:0/897926364 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7f694c02be00 con 0x556119bf1830 2024-05-14T15:29:18.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.908+0000 7f696a108b80 1 -- 172.21.15.69:0/897926364 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69400c8070 con 0x556119bf1830 2024-05-14T15:29:18.134 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.908+0000 7f693aa00700 1 -- 172.21.15.69:0/897926364 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f694c046050 con 0x556119bf1830 2024-05-14T15:29:18.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.908+0000 7f696a108b80 10 client.16803 fetch_fsmap learned FSMap version 55 2024-05-14T15:29:18.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.908+0000 7f696a108b80 1 -- 172.21.15.69:0/897926364 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x556119c6f550 con 0x556119bf1830 2024-05-14T15:29:18.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.908+0000 7f693aa00700 1 -- 172.21.15.69:0/897926364 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f69400c8070 con 0x556119bf1830 2024-05-14T15:29:18.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.909+0000 7f693aa00700 1 -- 172.21.15.69:0/897926364 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 55) ==== 8398+0+0 (secure 0 0 0) 0x7f694c011040 con 0x556119bf1830 2024-05-14T15:29:18.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.909+0000 7f696a108b80 10 client.16803 fetch_fsmap finished waiting for FSMap version 55 2024-05-14T15:29:18.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.909+0000 7f696a108b80 10 client.16803 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-05-14T15:29:18.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.909+0000 7f696a108b80 20 client.16803 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:18.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.909+0000 7f696a108b80 1 --2- 172.21.15.69:0/897926364 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x556119c6fc60 0x556119c72080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:18.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.909+0000 7f696a108b80 4 client.16803 mds_command: new command op to 34460 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:29:18.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.909+0000 7f696a108b80 1 -- 172.21.15.69:0/897926364 --> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556119b1b400 con 0x556119c6fc60 2024-05-14T15:29:18.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.909+0000 7f6958c00700 1 --2- 172.21.15.69:0/897926364 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x556119c6fc60 0x556119c72080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:18.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.910+0000 7f693aa00700 10 client.16803 ms_handle_connect on v2:172.21.15.92:6836/1669439322 2024-05-14T15:29:18.135 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.910+0000 7f6958c00700 1 --2- 172.21.15.69:0/897926364 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x556119c6fc60 0x556119c72080 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cfa684113bba4566 server_cookie=d68843edbe29d958 in_seq=0 out_seq=0 2024-05-14T15:29:18.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.911+0000 7f693aa00700 1 -- 172.21.15.69:0/897926364 <== mds.1 v2:172.21.15.92:6836/1669439322 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556119b1b400 con 0x556119c6fc60 2024-05-14T15:29:18.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.911+0000 7f693aa00700 10 client.16803 handle_command_reply: tid=0 2024-05-14T15:29:18.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.911+0000 7f696a108b80 1 client.16803 shutdown 2024-05-14T15:29:18.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.911+0000 7f696a108b80 1 -- 172.21.15.69:0/897926364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119bf1830 msgr2=0x556119c0c010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:18.136 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.911+0000 7f696a108b80 1 --2- 172.21.15.69:0/897926364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119bf1830 0x556119c0c010 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f694c0062a0 tx=0x7f694c00b970 comp rx=0 tx=0).stop 2024-05-14T15:29:18.136 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:29:18.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.911+0000 7f696a108b80 1 -- 172.21.15.69:0/897926364 shutdown_connections 2024-05-14T15:29:18.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.911+0000 7f696a108b80 1 --2- 172.21.15.69:0/897926364 >> [v2:172.21.15.92:6836/1669439322,v1:172.21.15.92:6837/1669439322] conn(0x556119c6fc60 0x556119c72080 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.911+0000 7f696a108b80 1 --2- 172.21.15.69:0/897926364 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x556119bf1830 0x556119c0c010 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.911+0000 7f696a108b80 1 --2- 172.21.15.69:0/897926364 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x556119a6de40 0x556119bfd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.911+0000 7f696a108b80 1 --2- 172.21.15.69:0/897926364 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x556119beb9f0 0x556119bfdc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.911+0000 7f696a108b80 1 -- 172.21.15.69:0/897926364 >> 172.21.15.69:0/897926364 conn(0x556119ab2f70 msgr2=0x556119bf4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:18.137 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.911+0000 7f693aa00700 0 client.16803 ms_handle_reset on v2:172.21.15.92:6836/1669439322 2024-05-14T15:29:18.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.911+0000 7f696a108b80 1 -- 172.21.15.69:0/897926364 shutdown_connections 2024-05-14T15:29:18.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.911+0000 7f696a108b80 1 -- 172.21.15.69:0/897926364 wait complete. 2024-05-14T15:29:18.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.911+0000 7f696a108b80 20 client.16803 trim_cache size 0 max 16384 2024-05-14T15:29:18.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.912+0000 7f695b600700 1 -- 172.21.15.69:0/3598486772 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f693c0b29f0 msgr2=0x7f693c0b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:18.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.912+0000 7f695b600700 1 --2- 172.21.15.69:0/3598486772 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f693c0b29f0 0x7f693c0b4f00 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f694c00b830 tx=0x7f694c009ce0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.912+0000 7f695b600700 1 -- 172.21.15.69:0/3598486772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f695410b2e0 msgr2=0x7f69541a1960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:18.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.912+0000 7f695b600700 1 --2- 172.21.15.69:0/3598486772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f695410b2e0 0x7f69541a1960 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f694000b500 tx=0x7f694000b8c0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.912+0000 7f695b600700 1 -- 172.21.15.69:0/3598486772 shutdown_connections 2024-05-14T15:29:18.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.912+0000 7f695b600700 1 --2- 172.21.15.69:0/3598486772 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f693c0b29f0 0x7f693c0b4f00 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.912+0000 7f695b600700 1 --2- 172.21.15.69:0/3598486772 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6954110970 0x7f69541a5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.912+0000 7f695b600700 1 --2- 172.21.15.69:0/3598486772 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f695410a990 0x7f69541a13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.912+0000 7f695b600700 1 --2- 172.21.15.69:0/3598486772 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f695410b2e0 0x7f69541a1960 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:18.138 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.912+0000 7f695b600700 1 -- 172.21.15.69:0/3598486772 >> 172.21.15.69:0/3598486772 conn(0x7f6954077c80 msgr2=0x7f695407b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:18.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.912+0000 7f695b600700 1 -- 172.21.15.69:0/3598486772 shutdown_connections 2024-05-14T15:29:18.139 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:17.912+0000 7f695b600700 1 -- 172.21.15.69:0/3598486772 wait complete. 2024-05-14T15:29:19.124 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-05-14T15:29:19.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:19 smithi092 ceph-mon[34729]: pgmap v237: 129 pgs: 129 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 10 MiB/s wr, 589 op/s 2024-05-14T15:29:19.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:19 smithi069 ceph-mon[31270]: pgmap v237: 129 pgs: 129 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 10 MiB/s wr, 589 op/s 2024-05-14T15:29:19.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:19 smithi203 ceph-mon[34567]: pgmap v237: 129 pgs: 129 active+clean; 2.5 GiB data, 9.6 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 10 MiB/s wr, 589 op/s 2024-05-14T15:29:19.679 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:29:21.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 215.0 s, 461.6 tps, lat 217.781 ms stddev 289.235 2024-05-14T15:29:21.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:21 smithi092 ceph-mon[34729]: pgmap v238: 129 pgs: 129 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.9 MiB/s wr, 671 op/s 2024-05-14T15:29:21.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:21 smithi069 ceph-mon[31270]: pgmap v238: 129 pgs: 129 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.9 MiB/s wr, 671 op/s 2024-05-14T15:29:21.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:21 smithi203 ceph-mon[34567]: pgmap v238: 129 pgs: 129 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 8.9 MiB/s wr, 671 op/s 2024-05-14T15:29:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.024+0000 7fd740400640 1 -- 172.21.15.69:0/341535098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd738109ce0 msgr2=0x7fd738103880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.024+0000 7fd740400640 1 --2- 172.21.15.69:0/341535098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd738109ce0 0x7fd738103880 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd72c009860 tx=0x7fd72c02a340 comp rx=0 tx=0).stop 2024-05-14T15:29:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.025+0000 7fd740400640 1 -- 172.21.15.69:0/341535098 shutdown_connections 2024-05-14T15:29:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.025+0000 7fd740400640 1 --2- 172.21.15.69:0/341535098 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd738104430 0x7fd738110800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.025+0000 7fd740400640 1 --2- 172.21.15.69:0/341535098 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd73810a180 0x7fd738103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.025+0000 7fd740400640 1 --2- 172.21.15.69:0/341535098 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd738109ce0 0x7fd738103880 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.025+0000 7fd740400640 1 -- 172.21.15.69:0/341535098 >> 172.21.15.69:0/341535098 conn(0x7fd738079450 msgr2=0x7fd738079890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.027+0000 7fd740400640 1 -- 172.21.15.69:0/341535098 shutdown_connections 2024-05-14T15:29:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.027+0000 7fd740400640 1 -- 172.21.15.69:0/341535098 wait complete. 2024-05-14T15:29:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.029+0000 7fd740400640 1 Processor -- start 2024-05-14T15:29:22.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.029+0000 7fd740400640 1 -- start start 2024-05-14T15:29:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.030+0000 7fd740400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd738104430 0x7fd738118570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.030+0000 7fd740400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd738109ce0 0x7fd738118ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.030+0000 7fd740400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd73810a180 0x7fd73811e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.030+0000 7fd740400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd738076a90 con 0x7fd738104430 2024-05-14T15:29:22.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.030+0000 7fd740400640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd738076910 con 0x7fd73810a180 2024-05-14T15:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.030+0000 7fd740400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd738076c10 con 0x7fd738109ce0 2024-05-14T15:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.031+0000 7fd73e400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd73810a180 0x7fd73811e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.031+0000 7fd73e400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd73810a180 0x7fd73811e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:48664/0 (socket says 172.21.15.69:48664) 2024-05-14T15:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.031+0000 7fd73e400640 1 -- 172.21.15.69:0/2596627763 learned_addr learned my addr 172.21.15.69:0/2596627763 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.031+0000 7fd73d000640 1 --2- 172.21.15.69:0/2596627763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd738109ce0 0x7fd738118ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.031+0000 7fd73e400640 1 -- 172.21.15.69:0/2596627763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd738109ce0 msgr2=0x7fd738118ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.031+0000 7fd73e400640 1 --2- 172.21.15.69:0/2596627763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd738109ce0 0x7fd738118ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.031+0000 7fd73e400640 1 -- 172.21.15.69:0/2596627763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd738104430 msgr2=0x7fd738118570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-14T15:29:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.032+0000 7fd73da00640 1 --2- 172.21.15.69:0/2596627763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd738104430 0x7fd738118570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.032+0000 7fd73e400640 1 --2- 172.21.15.69:0/2596627763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd738104430 0x7fd738118570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.032+0000 7fd73e400640 1 -- 172.21.15.69:0/2596627763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd73811ea80 con 0x7fd73810a180 2024-05-14T15:29:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.032+0000 7fd73da00640 1 --2- 172.21.15.69:0/2596627763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd738104430 0x7fd738118570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:29:22.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.033+0000 7fd73e400640 1 --2- 172.21.15.69:0/2596627763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd73810a180 0x7fd73811e280 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd73000eda0 tx=0x7fd73000c6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.034+0000 7fd736000640 1 -- 172.21.15.69:0/2596627763 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730003b70 con 0x7fd73810a180 2024-05-14T15:29:22.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.034+0000 7fd736000640 1 -- 172.21.15.69:0/2596627763 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd730003d10 con 0x7fd73810a180 2024-05-14T15:29:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.034+0000 7fd736000640 1 -- 172.21.15.69:0/2596627763 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd730017860 con 0x7fd73810a180 2024-05-14T15:29:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.034+0000 7fd740400640 1 -- 172.21.15.69:0/2596627763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd738113720 con 0x7fd73810a180 2024-05-14T15:29:22.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.035+0000 7fd740400640 1 -- 172.21.15.69:0/2596627763 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd738113c20 con 0x7fd73810a180 2024-05-14T15:29:22.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.044+0000 7fd74745d740 1 Processor -- start 2024-05-14T15:29:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.046+0000 7fd736000640 1 -- 172.21.15.69:0/2596627763 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd730004540 con 0x7fd73810a180 2024-05-14T15:29:22.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.046+0000 7fd74745d740 1 -- start start 2024-05-14T15:29:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.047+0000 7fd74745d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e46181b0 0x5626e49b9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.047+0000 7fd74745d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e45ef2f0 0x5626e49b97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.047+0000 7fd74745d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e45f74d0 0x5626e49b9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.047+0000 7fd74745d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5626e491e550 con 0x5626e45f74d0 2024-05-14T15:29:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.047+0000 7fd74745d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5626e48c3bc0 con 0x5626e45ef2f0 2024-05-14T15:29:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.047+0000 7fd74745d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5626e491a510 con 0x5626e46181b0 2024-05-14T15:29:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.047+0000 7fd73d000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e45f74d0 0x5626e49b9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.047+0000 7fd73d000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e45f74d0 0x5626e49b9d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43268/0 (socket says 172.21.15.69:43268) 2024-05-14T15:29:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.047+0000 7fd73d000640 1 -- 172.21.15.69:0/1208807180 learned_addr learned my addr 172.21.15.69:0/1208807180 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:22.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.047+0000 7fd73d000640 1 --2- 172.21.15.69:0/1208807180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e46181b0 0x5626e49b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.048+0000 7fd73d000640 1 -- 172.21.15.69:0/1208807180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e46181b0 msgr2=0x5626e49b9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.048+0000 7fd73d000640 1 --2- 172.21.15.69:0/1208807180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e46181b0 0x5626e49b9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.049+0000 7fd73d000640 1 -- 172.21.15.69:0/1208807180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e45ef2f0 msgr2=0x5626e49b97c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:29:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.049+0000 7fd73d000640 1 --2- 172.21.15.69:0/1208807180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e45ef2f0 0x5626e49b97c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.049+0000 7fd73d000640 1 -- 172.21.15.69:0/1208807180 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626e4630210 con 0x5626e45f74d0 2024-05-14T15:29:22.051 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.049+0000 7fd73d000640 1 --2- 172.21.15.69:0/1208807180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e45f74d0 0x5626e49b9d00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd7240058c0 tx=0x7fd72400b3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99005ed36aa40c1f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.050+0000 7fd736000640 1 --2- 172.21.15.69:0/2596627763 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd7200b2aa0 0x7fd7200b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.050+0000 7fd736000640 1 -- 172.21.15.69:0/2596627763 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7fd7300e2a20 con 0x7fd73810a180 2024-05-14T15:29:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.050+0000 7fd72aa00640 1 -- 172.21.15.69:0/1208807180 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724014e40 con 0x5626e45f74d0 2024-05-14T15:29:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.051+0000 7fd72aa00640 1 -- 172.21.15.69:0/1208807180 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd72400d6b0 con 0x5626e45f74d0 2024-05-14T15:29:22.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.051+0000 7fd72aa00640 1 -- 172.21.15.69:0/1208807180 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd724003850 con 0x5626e45f74d0 2024-05-14T15:29:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.051+0000 7fd73da00640 1 --2- 172.21.15.69:0/2596627763 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd7200b2aa0 0x7fd7200b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.052+0000 7fd74745d740 1 -- 172.21.15.69:0/1208807180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e45f74d0 msgr2=0x5626e49b9d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:22.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.052+0000 7fd74745d740 1 --2- 172.21.15.69:0/1208807180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e45f74d0 0x5626e49b9d00 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fd7240058c0 tx=0x7fd72400b3a0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.052+0000 7fd74745d740 1 -- 172.21.15.69:0/1208807180 shutdown_connections 2024-05-14T15:29:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.052+0000 7fd73da00640 1 --2- 172.21.15.69:0/2596627763 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd7200b2aa0 0x7fd7200b4fb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5626e49b6d70 tx=0x7fd72c000bc0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.052+0000 7fd74745d740 1 --2- 172.21.15.69:0/1208807180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e45f74d0 0x5626e49b9d00 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.052+0000 7fd74745d740 1 --2- 172.21.15.69:0/1208807180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e45ef2f0 0x5626e49b97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.052+0000 7fd74745d740 1 --2- 172.21.15.69:0/1208807180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e46181b0 0x5626e49b9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.052+0000 7fd74745d740 1 -- 172.21.15.69:0/1208807180 >> 172.21.15.69:0/1208807180 conn(0x5626e460c300 msgr2=0x5626e49b5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.053+0000 7fd74745d740 1 -- 172.21.15.69:0/1208807180 shutdown_connections 2024-05-14T15:29:22.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.053+0000 7fd74745d740 1 -- 172.21.15.69:0/1208807180 wait complete. 2024-05-14T15:29:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.053+0000 7fd74745d740 1 -- start start 2024-05-14T15:29:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.053+0000 7fd74745d740 1 Processor -- start 2024-05-14T15:29:22.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.054+0000 7fd74745d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e45ef2f0 0x5626e49c3820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.054+0000 7fd74745d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45f74d0 0x5626e49c3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.054+0000 7fd74745d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e46181b0 0x5626e49cf860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.054+0000 7fd74745d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5626e49c63b0 con 0x5626e46181b0 2024-05-14T15:29:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.054+0000 7fd74745d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5626e48d7660 con 0x5626e45ef2f0 2024-05-14T15:29:22.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.054+0000 7fd74745d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5626e49c6530 con 0x5626e45f74d0 2024-05-14T15:29:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.054+0000 7fd74745d740 10 client.0 _ll_register_callbacks cb 0x5626e48a1400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.055+0000 7fd73da00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e45ef2f0 0x5626e49c3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.055+0000 7fd73e400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e46181b0 0x5626e49cf860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.055+0000 7fd73da00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e45ef2f0 0x5626e49c3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:48682/0 (socket says 172.21.15.69:48682) 2024-05-14T15:29:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.055+0000 7fd73da00640 1 -- 172.21.15.69:0/546090204 learned_addr learned my addr 172.21.15.69:0/546090204 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.055+0000 7fd73d000640 1 --2- 172.21.15.69:0/546090204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45f74d0 0x5626e49c3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.056+0000 7fd73e400640 1 -- 172.21.15.69:0/546090204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45f74d0 msgr2=0x5626e49c3d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.056+0000 7fd73e400640 1 --2- 172.21.15.69:0/546090204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45f74d0 0x5626e49c3d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.056+0000 7fd73e400640 1 -- 172.21.15.69:0/546090204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e45ef2f0 msgr2=0x5626e49c3820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.056+0000 7fd73e400640 1 --2- 172.21.15.69:0/546090204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e45ef2f0 0x5626e49c3820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.056+0000 7fd73e400640 1 -- 172.21.15.69:0/546090204 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626e46fc620 con 0x5626e46181b0 2024-05-14T15:29:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.060+0000 7fd73e400640 1 --2- 172.21.15.69:0/546090204 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e46181b0 0x5626e49cf860 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd7300dfe70 tx=0x7fd7300a95d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4831bfde539160e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:22.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.060+0000 7fd71f400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:29:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.060+0000 7fd71f400640 1 -- 172.21.15.69:0/546090204 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7300addb0 con 0x5626e46181b0 2024-05-14T15:29:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.060+0000 7fd71f400640 1 -- 172.21.15.69:0/546090204 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7fd7300cc2f0 con 0x5626e46181b0 2024-05-14T15:29:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.061+0000 7fd74745d740 1 -- 172.21.15.69:0/546090204 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd72400d6b0 con 0x5626e46181b0 2024-05-14T15:29:22.062 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.061+0000 7fd71f400640 1 -- 172.21.15.69:0/546090204 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fd7300b2860 con 0x5626e46181b0 2024-05-14T15:29:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.061+0000 7fd74745d740 10 client.16812 fetch_fsmap learned FSMap version 55 2024-05-14T15:29:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.061+0000 7fd74745d740 1 -- 172.21.15.69:0/546090204 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5626e49d24f0 con 0x5626e46181b0 2024-05-14T15:29:22.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.062+0000 7fd71f400640 1 -- 172.21.15.69:0/546090204 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd7300bee50 con 0x5626e46181b0 2024-05-14T15:29:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.062+0000 7fd71f400640 1 -- 172.21.15.69:0/546090204 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 55) ==== 8398+0+0 (secure 0 0 0) 0x7fd73000b030 con 0x5626e46181b0 2024-05-14T15:29:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.062+0000 7fd74745d740 10 client.16812 fetch_fsmap finished waiting for FSMap version 55 2024-05-14T15:29:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.062+0000 7fd74745d740 10 client.16812 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:29:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.062+0000 7fd74745d740 20 client.16812 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.063+0000 7fd74745d740 1 --2- 172.21.15.69:0/546090204 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5626e45d6d80 0x5626e49d5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.063+0000 7fd74745d740 4 client.16812 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:29:22.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.063+0000 7fd74745d740 1 -- 172.21.15.69:0/546090204 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5626e492c160 con 0x5626e45d6d80 2024-05-14T15:29:22.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.065+0000 7fd73da00640 1 --2- 172.21.15.69:0/546090204 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5626e45d6d80 0x5626e49d5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.067 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.066+0000 7fd73da00640 1 --2- 172.21.15.69:0/546090204 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5626e45d6d80 0x5626e49d5ac0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9032e86cbba91451 server_cookie=2099979104f5a7a7 in_seq=0 out_seq=0 2024-05-14T15:29:22.067 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.066+0000 7fd71f400640 10 client.16812 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:22.068 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.067+0000 7fd71f400640 1 -- 172.21.15.69:0/546090204 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5626e492c160 con 0x5626e45d6d80 2024-05-14T15:29:22.068 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.067+0000 7fd71f400640 10 client.16812 handle_command_reply: tid=0 2024-05-14T15:29:22.068 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.067+0000 7fd74745d740 1 client.16812 shutdown 2024-05-14T15:29:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.068+0000 7fd74745d740 1 -- 172.21.15.69:0/546090204 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e46181b0 msgr2=0x5626e49cf860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:22.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.068+0000 7fd74745d740 1 --2- 172.21.15.69:0/546090204 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e46181b0 0x5626e49cf860 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd7300dfe70 tx=0x7fd7300a95d0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.068+0000 7fd74745d740 1 -- 172.21.15.69:0/546090204 shutdown_connections 2024-05-14T15:29:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.068+0000 7fd74745d740 1 --2- 172.21.15.69:0/546090204 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5626e45d6d80 0x5626e49d5ac0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.068+0000 7fd74745d740 1 --2- 172.21.15.69:0/546090204 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e46181b0 0x5626e49cf860 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.068+0000 7fd74745d740 1 --2- 172.21.15.69:0/546090204 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45f74d0 0x5626e49c3d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.068+0000 7fd74745d740 1 --2- 172.21.15.69:0/546090204 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e45ef2f0 0x5626e49c3820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.068+0000 7fd74745d740 1 -- 172.21.15.69:0/546090204 >> 172.21.15.69:0/546090204 conn(0x5626e460c300 msgr2=0x5626e49bafa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.068+0000 7fd71f400640 0 client.16812 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.068+0000 7fd74745d740 1 -- 172.21.15.69:0/546090204 shutdown_connections 2024-05-14T15:29:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.068+0000 7fd74745d740 1 -- 172.21.15.69:0/546090204 wait complete. 2024-05-14T15:29:22.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.069+0000 7fd74745d740 20 client.16812 trim_cache size 0 max 16384 2024-05-14T15:29:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.104+0000 7fd74745d740 1 Processor -- start 2024-05-14T15:29:22.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.104+0000 7fd74745d740 1 -- start start 2024-05-14T15:29:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.104+0000 7fd74745d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45ef2f0 0x5626e49bdf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.104+0000 7fd74745d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e45f74d0 0x5626e49c2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.104+0000 7fd74745d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e46181b0 0x5626e49b9860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.104+0000 7fd74745d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd7381c01f0 con 0x5626e45f74d0 2024-05-14T15:29:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.104+0000 7fd74745d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd7381c1eb0 con 0x5626e46181b0 2024-05-14T15:29:22.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.104+0000 7fd74745d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd7381c08c0 con 0x5626e45ef2f0 2024-05-14T15:29:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.105+0000 7fd73d000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e45f74d0 0x5626e49c2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.105+0000 7fd73d000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e45f74d0 0x5626e49c2910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:43296/0 (socket says 172.21.15.69:43296) 2024-05-14T15:29:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.105+0000 7fd73d000640 1 -- 172.21.15.69:0/2066946381 learned_addr learned my addr 172.21.15.69:0/2066946381 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.105+0000 7fd73e400640 1 --2- 172.21.15.69:0/2066946381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e46181b0 0x5626e49b9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.105+0000 7fd73da00640 1 --2- 172.21.15.69:0/2066946381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45ef2f0 0x5626e49bdf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.105+0000 7fd73d000640 1 -- 172.21.15.69:0/2066946381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45ef2f0 msgr2=0x5626e49bdf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.105+0000 7fd73d000640 1 --2- 172.21.15.69:0/2066946381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45ef2f0 0x5626e49bdf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.105+0000 7fd73d000640 1 -- 172.21.15.69:0/2066946381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e46181b0 msgr2=0x5626e49b9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.105+0000 7fd73d000640 1 --2- 172.21.15.69:0/2066946381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e46181b0 0x5626e49b9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.105+0000 7fd73d000640 1 -- 172.21.15.69:0/2066946381 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626e49b0eb0 con 0x5626e45f74d0 2024-05-14T15:29:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.105+0000 7fd73e400640 1 --2- 172.21.15.69:0/2066946381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e46181b0 0x5626e49b9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:29:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.105+0000 7fd73da00640 1 --2- 172.21.15.69:0/2066946381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45ef2f0 0x5626e49bdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:29:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.106+0000 7fd73d000640 1 --2- 172.21.15.69:0/2066946381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e45f74d0 0x5626e49c2910 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd724014800 tx=0x7fd72400dfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4863a2ffe93a82b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:22.108 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.106+0000 7fd72a000640 1 -- 172.21.15.69:0/2066946381 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72400ba90 con 0x5626e45f74d0 2024-05-14T15:29:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.106+0000 7fd72a000640 1 -- 172.21.15.69:0/2066946381 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd724024070 con 0x5626e45f74d0 2024-05-14T15:29:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.106+0000 7fd72a000640 1 -- 172.21.15.69:0/2066946381 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7240052a0 con 0x5626e45f74d0 2024-05-14T15:29:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.107+0000 7fd74745d740 1 -- 172.21.15.69:0/2066946381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e45f74d0 msgr2=0x5626e49c2910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.107+0000 7fd74745d740 1 --2- 172.21.15.69:0/2066946381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e45f74d0 0x5626e49c2910 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd724014800 tx=0x7fd72400dfd0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.107+0000 7fd74745d740 1 -- 172.21.15.69:0/2066946381 shutdown_connections 2024-05-14T15:29:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.107+0000 7fd74745d740 1 --2- 172.21.15.69:0/2066946381 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e46181b0 0x5626e49b9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.107+0000 7fd74745d740 1 --2- 172.21.15.69:0/2066946381 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e45f74d0 0x5626e49c2910 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.107+0000 7fd74745d740 1 --2- 172.21.15.69:0/2066946381 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45ef2f0 0x5626e49bdf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.107+0000 7fd74745d740 1 -- 172.21.15.69:0/2066946381 >> 172.21.15.69:0/2066946381 conn(0x5626e460c300 msgr2=0x5626e49b9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.107+0000 7fd74745d740 1 -- 172.21.15.69:0/2066946381 shutdown_connections 2024-05-14T15:29:22.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.107+0000 7fd74745d740 1 -- 172.21.15.69:0/2066946381 wait complete. 2024-05-14T15:29:22.110 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.108+0000 7fd74745d740 1 -- start start 2024-05-14T15:29:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.108+0000 7fd74745d740 1 Processor -- start 2024-05-14T15:29:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.109+0000 7fd74745d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45ef2f0 0x5626e4a361e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.109+0000 7fd74745d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e45f74d0 0x5626e4a36720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.109+0000 7fd74745d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e46181b0 0x5626e49c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.109+0000 7fd74745d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd7381c1720 con 0x5626e46181b0 2024-05-14T15:29:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.109+0000 7fd74745d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd7381c0f90 con 0x5626e45f74d0 2024-05-14T15:29:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.109+0000 7fd74745d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd7381be1f0 con 0x5626e45ef2f0 2024-05-14T15:29:22.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.109+0000 7fd74745d740 10 client.0 _ll_register_callbacks cb 0x7fd7300a58c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.109+0000 7fd73da00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45ef2f0 0x5626e4a361e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.109+0000 7fd73da00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45ef2f0 0x5626e4a361e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:36302/0 (socket says 172.21.15.69:36302) 2024-05-14T15:29:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.110+0000 7fd73da00640 1 -- 172.21.15.69:0/2617603259 learned_addr learned my addr 172.21.15.69:0/2617603259 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.110+0000 7fd73e400640 1 --2- 172.21.15.69:0/2617603259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e46181b0 0x5626e49c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.110+0000 7fd73d000640 1 --2- 172.21.15.69:0/2617603259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e45f74d0 0x5626e4a36720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.110+0000 7fd73da00640 1 -- 172.21.15.69:0/2617603259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e45f74d0 msgr2=0x5626e4a36720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.110+0000 7fd73da00640 1 --2- 172.21.15.69:0/2617603259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e45f74d0 0x5626e4a36720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.110+0000 7fd73da00640 1 -- 172.21.15.69:0/2617603259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e46181b0 msgr2=0x5626e49c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.110+0000 7fd73da00640 1 --2- 172.21.15.69:0/2617603259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e46181b0 0x5626e49c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.110+0000 7fd73da00640 1 -- 172.21.15.69:0/2617603259 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626e49c7180 con 0x5626e45ef2f0 2024-05-14T15:29:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.110+0000 7fd73e400640 1 --2- 172.21.15.69:0/2617603259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e46181b0 0x5626e49c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:29:22.115 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.111+0000 7fd73da00640 1 --2- 172.21.15.69:0/2617603259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45ef2f0 0x5626e4a361e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5626e49d6220 tx=0x7fd72c005f90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3e7d32ce2167bdc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.111+0000 7fd71f400640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:29:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.111+0000 7fd71f400640 1 -- 172.21.15.69:0/2617603259 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd72c037040 con 0x5626e45ef2f0 2024-05-14T15:29:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.111+0000 7fd74745d740 1 -- 172.21.15.69:0/2617603259 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd724024070 con 0x5626e45ef2f0 2024-05-14T15:29:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.111+0000 7fd71f400640 1 -- 172.21.15.69:0/2617603259 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7fd72c005040 con 0x5626e45ef2f0 2024-05-14T15:29:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.112+0000 7fd71f400640 1 -- 172.21.15.69:0/2617603259 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7fd72c062050 con 0x5626e45ef2f0 2024-05-14T15:29:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.112+0000 7fd74745d740 10 client.26278 fetch_fsmap learned FSMap version 55 2024-05-14T15:29:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.112+0000 7fd74745d740 1 -- 172.21.15.69:0/2617603259 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x5626e4a3d000 con 0x5626e45ef2f0 2024-05-14T15:29:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.112+0000 7fd71f400640 1 -- 172.21.15.69:0/2617603259 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd724024070 con 0x5626e45ef2f0 2024-05-14T15:29:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.112+0000 7fd71f400640 1 -- 172.21.15.69:0/2617603259 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 55) ==== 8398+0+0 (secure 0 0 0) 0x7fd72c047040 con 0x5626e45ef2f0 2024-05-14T15:29:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.112+0000 7fd74745d740 10 client.26278 fetch_fsmap finished waiting for FSMap version 55 2024-05-14T15:29:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.112+0000 7fd74745d740 10 client.26278 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:29:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.112+0000 7fd74745d740 20 client.26278 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.112+0000 7fd74745d740 1 --2- 172.21.15.69:0/2617603259 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5626e45ac1c0 0x5626e4a3f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.113+0000 7fd74745d740 4 client.26278 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:29:22.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.113+0000 7fd74745d740 1 -- 172.21.15.69:0/2617603259 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5626e4925fd0 con 0x5626e45ac1c0 2024-05-14T15:29:22.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.113+0000 7fd73d000640 1 --2- 172.21.15.69:0/2617603259 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5626e45ac1c0 0x5626e4a3f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:22.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.114+0000 7fd71f400640 10 client.26278 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:22.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.114+0000 7fd73d000640 1 --2- 172.21.15.69:0/2617603259 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5626e45ac1c0 0x5626e4a3f830 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28b5da48d348350 server_cookie=46078c099ad8a5ad in_seq=0 out_seq=0 2024-05-14T15:29:22.148 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:29:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:29:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:29:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:29:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.144+0000 7fd71f400640 1 -- 172.21.15.69:0/2617603259 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5626e4925fd0 con 0x5626e45ac1c0 2024-05-14T15:29:22.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.144+0000 7fd71f400640 10 client.26278 handle_command_reply: tid=0 2024-05-14T15:29:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.144+0000 7fd74745d740 1 client.26278 shutdown 2024-05-14T15:29:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.145+0000 7fd74745d740 1 -- 172.21.15.69:0/2617603259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45ef2f0 msgr2=0x5626e4a361e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.145+0000 7fd74745d740 1 --2- 172.21.15.69:0/2617603259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45ef2f0 0x5626e4a361e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5626e49d6220 tx=0x7fd72c005f90 comp rx=0 tx=0).stop 2024-05-14T15:29:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.145+0000 7fd74745d740 1 -- 172.21.15.69:0/2617603259 shutdown_connections 2024-05-14T15:29:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.145+0000 7fd74745d740 1 --2- 172.21.15.69:0/2617603259 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5626e45ac1c0 0x5626e4a3f830 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.145+0000 7fd74745d740 1 --2- 172.21.15.69:0/2617603259 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5626e46181b0 0x5626e49c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.145+0000 7fd74745d740 1 --2- 172.21.15.69:0/2617603259 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5626e45f74d0 0x5626e4a36720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.145+0000 7fd74745d740 1 --2- 172.21.15.69:0/2617603259 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5626e45ef2f0 0x5626e4a361e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.145+0000 7fd74745d740 1 -- 172.21.15.69:0/2617603259 >> 172.21.15.69:0/2617603259 conn(0x5626e460c300 msgr2=0x5626e49b9b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.145+0000 7fd71f400640 0 client.26278 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.146+0000 7fd74745d740 1 -- 172.21.15.69:0/2617603259 shutdown_connections 2024-05-14T15:29:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.146+0000 7fd74745d740 1 -- 172.21.15.69:0/2617603259 wait complete. 2024-05-14T15:29:22.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.146+0000 7fd74745d740 20 client.26278 trim_cache size 0 max 16384 2024-05-14T15:29:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.147+0000 7fd740400640 1 -- 172.21.15.69:0/2596627763 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd7200b2aa0 msgr2=0x7fd7200b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.147+0000 7fd740400640 1 --2- 172.21.15.69:0/2596627763 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd7200b2aa0 0x7fd7200b4fb0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x5626e49b6d70 tx=0x7fd72c000bc0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.147+0000 7fd740400640 1 -- 172.21.15.69:0/2596627763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd73810a180 msgr2=0x7fd73811e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.147+0000 7fd740400640 1 --2- 172.21.15.69:0/2596627763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd73810a180 0x7fd73811e280 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fd73000eda0 tx=0x7fd73000c6e0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.147+0000 7fd740400640 1 -- 172.21.15.69:0/2596627763 shutdown_connections 2024-05-14T15:29:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.147+0000 7fd740400640 1 --2- 172.21.15.69:0/2596627763 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd7200b2aa0 0x7fd7200b4fb0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.147+0000 7fd740400640 1 --2- 172.21.15.69:0/2596627763 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd73810a180 0x7fd73811e280 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.147+0000 7fd740400640 1 --2- 172.21.15.69:0/2596627763 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd738109ce0 0x7fd738118ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.147+0000 7fd740400640 1 --2- 172.21.15.69:0/2596627763 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd738104430 0x7fd738118570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.147+0000 7fd740400640 1 -- 172.21.15.69:0/2596627763 >> 172.21.15.69:0/2596627763 conn(0x7fd738079450 msgr2=0x7fd738105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.148+0000 7fd740400640 1 -- 172.21.15.69:0/2596627763 shutdown_connections 2024-05-14T15:29:22.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:22.148+0000 7fd740400640 1 -- 172.21.15.69:0/2596627763 wait complete. 2024-05-14T15:29:23.364 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:23 smithi069 ceph-mon[31270]: pgmap v239: 129 pgs: 129 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.7 MiB/s wr, 581 op/s 2024-05-14T15:29:23.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:23 smithi092 ceph-mon[34729]: pgmap v239: 129 pgs: 129 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.7 MiB/s wr, 581 op/s 2024-05-14T15:29:23.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:23 smithi203 ceph-mon[34567]: pgmap v239: 129 pgs: 129 active+clean; 2.5 GiB data, 9.7 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 7.7 MiB/s wr, 581 op/s 2024-05-14T15:29:24.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.288+0000 7f8d33c00700 1 -- 172.21.15.69:0/425319693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d2c1034c0 msgr2=0x7f8d2c1038d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:24.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.288+0000 7f8d33c00700 1 --2- 172.21.15.69:0/425319693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d2c1034c0 0x7f8d2c1038d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8d18009990 tx=0x7f8d18009ca0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.291+0000 7f8d33c00700 1 -- 172.21.15.69:0/425319693 shutdown_connections 2024-05-14T15:29:24.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.291+0000 7f8d33c00700 1 --2- 172.21.15.69:0/425319693 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d2c108740 0x7f8d2c1100a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.291+0000 7f8d33c00700 1 --2- 172.21.15.69:0/425319693 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d2c1034c0 0x7f8d2c1038d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.291+0000 7f8d33c00700 1 --2- 172.21.15.69:0/425319693 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d2c107df0 0x7f8d2c108200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.291+0000 7f8d33c00700 1 -- 172.21.15.69:0/425319693 >> 172.21.15.69:0/425319693 conn(0x7f8d2c0fedc0 msgr2=0x7f8d2c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:24.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.291+0000 7f8d33c00700 1 -- 172.21.15.69:0/425319693 shutdown_connections 2024-05-14T15:29:24.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.291+0000 7f8d33c00700 1 -- 172.21.15.69:0/425319693 wait complete. 2024-05-14T15:29:24.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.293+0000 7f8d33c00700 1 Processor -- start 2024-05-14T15:29:24.295 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.293+0000 7f8d33c00700 1 -- start start 2024-05-14T15:29:24.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.295+0000 7f8d33c00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d2c1034c0 0x7f8d2c19d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.295+0000 7f8d33c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d2c107df0 0x7f8d2c19d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.295+0000 7f8d33c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d2c108740 0x7f8d2c1a1870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.295+0000 7f8d33c00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c114430 con 0x7f8d2c1034c0 2024-05-14T15:29:24.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.295+0000 7f8d33c00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c1142b0 con 0x7f8d2c108740 2024-05-14T15:29:24.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.295+0000 7f8d33c00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c1145b0 con 0x7f8d2c107df0 2024-05-14T15:29:24.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.295+0000 7f8d31200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d2c1034c0 0x7f8d2c19d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:24.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.295+0000 7f8d2be00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d2c107df0 0x7f8d2c19d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:24.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.295+0000 7f8d31200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d2c1034c0 0x7f8d2c19d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34184/0 (socket says 172.21.15.69:34184) 2024-05-14T15:29:24.297 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.295+0000 7f8d31200700 1 -- 172.21.15.69:0/695429712 learned_addr learned my addr 172.21.15.69:0/695429712 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:24.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.296+0000 7f8d31200700 1 -- 172.21.15.69:0/695429712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d2c107df0 msgr2=0x7f8d2c19d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:24.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.296+0000 7f8d31200700 1 --2- 172.21.15.69:0/695429712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d2c107df0 0x7f8d2c19d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.298 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.296+0000 7f8d31200700 1 -- 172.21.15.69:0/695429712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d2c108740 msgr2=0x7f8d2c1a1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:24.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.296+0000 7f8d31200700 1 --2- 172.21.15.69:0/695429712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d2c108740 0x7f8d2c1a1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.296+0000 7f8d31200700 1 -- 172.21.15.69:0/695429712 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d2c1a1f10 con 0x7f8d2c1034c0 2024-05-14T15:29:24.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.296+0000 7f8d31200700 1 --2- 172.21.15.69:0/695429712 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d2c1034c0 0x7f8d2c19d040 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800b650 tx=0x7f8d180057c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:24.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.298+0000 7f8d29600700 1 -- 172.21.15.69:0/695429712 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18026070 con 0x7f8d2c1034c0 2024-05-14T15:29:24.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.298+0000 7f8d29600700 1 -- 172.21.15.69:0/695429712 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d18021410 con 0x7f8d2c1034c0 2024-05-14T15:29:24.301 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.298+0000 7f8d29600700 1 -- 172.21.15.69:0/695429712 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d18017650 con 0x7f8d2c1034c0 2024-05-14T15:29:24.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.298+0000 7f8d33c00700 1 -- 172.21.15.69:0/695429712 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d2c1a21a0 con 0x7f8d2c1034c0 2024-05-14T15:29:24.302 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.298+0000 7f8d33c00700 1 -- 172.21.15.69:0/695429712 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d2c1a2630 con 0x7f8d2c1034c0 2024-05-14T15:29:24.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.308+0000 7f8d29600700 1 -- 172.21.15.69:0/695429712 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f8d18029070 con 0x7f8d2c1034c0 2024-05-14T15:29:24.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.312+0000 7f8d4280cb80 1 Processor -- start 2024-05-14T15:29:24.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.313+0000 7f8d29600700 1 --2- 172.21.15.69:0/695429712 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f8d140b2aa0 0x7f8d140b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.314+0000 7f8d29600700 1 -- 172.21.15.69:0/695429712 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7f8d180e37e0 con 0x7f8d2c1034c0 2024-05-14T15:29:24.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.315+0000 7f8d4280cb80 1 -- start start 2024-05-14T15:29:24.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.315+0000 7f8d31c00700 1 --2- 172.21.15.69:0/695429712 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f8d140b2aa0 0x7f8d140b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:24.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.316+0000 7f8d4280cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79b8fe40 0x55cc79d1bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.316+0000 7f8d4280cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 0x55cc79d15cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.316+0000 7f8d4280cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 0x55cc79d16610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.316+0000 7f8d4280cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cc79c2fa20 con 0x55cc79b8fe40 2024-05-14T15:29:24.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.316+0000 7f8d4280cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cc79bcd760 con 0x55cc79d16200 2024-05-14T15:29:24.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.316+0000 7f8d4280cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cc79c2b9e0 con 0x55cc79d1c040 2024-05-14T15:29:24.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.317+0000 7f8d2be00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 0x55cc79d15cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:24.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.317+0000 7f8d31c00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 0x55cc79d16610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:24.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.317+0000 7f8d2be00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 0x55cc79d15cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:44622/0 (socket says 172.21.15.69:44622) 2024-05-14T15:29:24.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.317+0000 7f8d2be00700 1 -- 172.21.15.69:0/546732875 learned_addr learned my addr 172.21.15.69:0/546732875 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:24.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.318+0000 7f8d31200700 1 --2- 172.21.15.69:0/546732875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79b8fe40 0x55cc79d1bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:24.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.318+0000 7f8d31c00700 1 --2- 172.21.15.69:0/695429712 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f8d140b2aa0 0x7f8d140b4fb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400e4d0 tx=0x7f8d2400e890 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:24.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.318+0000 7f8d2be00700 1 -- 172.21.15.69:0/546732875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 msgr2=0x55cc79d16610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:24.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.318+0000 7f8d2be00700 1 --2- 172.21.15.69:0/546732875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 0x55cc79d16610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.318+0000 7f8d2be00700 1 -- 172.21.15.69:0/546732875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79b8fe40 msgr2=0x55cc79d1bb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:24.321 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.318+0000 7f8d2be00700 1 --2- 172.21.15.69:0/546732875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79b8fe40 0x55cc79d1bb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.318+0000 7f8d2be00700 1 -- 172.21.15.69:0/546732875 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc79b7c8d0 con 0x55cc79d1c040 2024-05-14T15:29:24.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.319+0000 7f8d31200700 1 --2- 172.21.15.69:0/546732875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79b8fe40 0x55cc79d1bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:29:24.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.319+0000 7f8d2be00700 1 --2- 172.21.15.69:0/546732875 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 0x55cc79d15cc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009a80 tx=0x7f8d20009d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d527895c58bb755f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:24.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.319+0000 7f8d1e000700 1 -- 172.21.15.69:0/546732875 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20017070 con 0x55cc79d1c040 2024-05-14T15:29:24.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.320+0000 7f8d1e000700 1 -- 172.21.15.69:0/546732875 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d2000ed60 con 0x55cc79d1c040 2024-05-14T15:29:24.322 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.320+0000 7f8d1e000700 1 -- 172.21.15.69:0/546732875 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20013d90 con 0x55cc79d1c040 2024-05-14T15:29:24.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.321+0000 7f8d4280cb80 1 -- 172.21.15.69:0/546732875 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 msgr2=0x55cc79d15cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:24.323 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.321+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/546732875 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 0x55cc79d15cc0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8d20009a80 tx=0x7f8d20009d90 comp rx=0 tx=0).stop 2024-05-14T15:29:24.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.323+0000 7f8d4280cb80 1 -- 172.21.15.69:0/546732875 shutdown_connections 2024-05-14T15:29:24.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.323+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/546732875 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79b8fe40 0x55cc79d1bb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.323+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/546732875 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 0x55cc79d16610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.323+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/546732875 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 0x55cc79d15cc0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.323+0000 7f8d4280cb80 1 -- 172.21.15.69:0/546732875 >> 172.21.15.69:0/546732875 conn(0x55cc79bd4f70 msgr2=0x55cc79d082d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:24.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.323+0000 7f8d4280cb80 1 -- 172.21.15.69:0/546732875 shutdown_connections 2024-05-14T15:29:24.325 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.323+0000 7f8d4280cb80 1 -- 172.21.15.69:0/546732875 wait complete. 2024-05-14T15:29:24.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.324+0000 7f8d4280cb80 1 -- start start 2024-05-14T15:29:24.327 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.325+0000 7f8d4280cb80 1 Processor -- start 2024-05-14T15:29:24.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.326+0000 7f8d4280cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79b8fe40 0x55cc79d1f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.326+0000 7f8d4280cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79d16200 0x55cc79d1fd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.326+0000 7f8d4280cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 0x55cc79d202d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.326+0000 7f8d4280cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cc79d22b20 con 0x55cc79d16200 2024-05-14T15:29:24.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.326+0000 7f8d4280cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cc79b95b20 con 0x55cc79b8fe40 2024-05-14T15:29:24.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.326+0000 7f8d4280cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cc79d22ca0 con 0x55cc79d1c040 2024-05-14T15:29:24.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.327+0000 7f8d31200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79b8fe40 0x55cc79d1f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:24.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.328+0000 7f8d4280cb80 10 client.0 _ll_register_callbacks cb 0x55cc79bd6c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:24.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.327+0000 7f8d31200700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79b8fe40 0x55cc79d1f850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:45082/0 (socket says 172.21.15.69:45082) 2024-05-14T15:29:24.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.328+0000 7f8d31c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 0x55cc79d202d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:24.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.328+0000 7f8d31200700 1 -- 172.21.15.69:0/3035224416 learned_addr learned my addr 172.21.15.69:0/3035224416 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:24.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.328+0000 7f8d2be00700 1 --2- 172.21.15.69:0/3035224416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79d16200 0x55cc79d1fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:24.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.329+0000 7f8d31200700 1 -- 172.21.15.69:0/3035224416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 msgr2=0x55cc79d202d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:24.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.329+0000 7f8d31200700 1 --2- 172.21.15.69:0/3035224416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 0x55cc79d202d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.329+0000 7f8d31200700 1 -- 172.21.15.69:0/3035224416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79d16200 msgr2=0x55cc79d1fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:24.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.329+0000 7f8d31200700 1 --2- 172.21.15.69:0/3035224416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79d16200 0x55cc79d1fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.329+0000 7f8d31200700 1 -- 172.21.15.69:0/3035224416 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc79bf5420 con 0x55cc79b8fe40 2024-05-14T15:29:24.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.329+0000 7f8d31c00700 1 --2- 172.21.15.69:0/3035224416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 0x55cc79d202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:29:24.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.330+0000 7f8d31200700 1 --2- 172.21.15.69:0/3035224416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79b8fe40 0x55cc79d1f850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d180a67c0 tx=0x7f8d180095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3478d89081c14464 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:24.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.330+0000 7f8d12a00700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:29:24.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.330+0000 7f8d12a00700 1 -- 172.21.15.69:0/3035224416 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d180a4e60 con 0x55cc79b8fe40 2024-05-14T15:29:24.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.330+0000 7f8d12a00700 1 -- 172.21.15.69:0/3035224416 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7f8d180aabb0 con 0x55cc79b8fe40 2024-05-14T15:29:24.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.331+0000 7f8d4280cb80 1 -- 172.21.15.69:0/3035224416 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d2000ed60 con 0x55cc79b8fe40 2024-05-14T15:29:24.333 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.332+0000 7f8d12a00700 1 -- 172.21.15.69:0/3035224416 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f8d180aa740 con 0x55cc79b8fe40 2024-05-14T15:29:24.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.333+0000 7f8d4280cb80 10 client.36311 fetch_fsmap learned FSMap version 55 2024-05-14T15:29:24.334 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.333+0000 7f8d4280cb80 1 -- 172.21.15.69:0/3035224416 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55cc79d2d440 con 0x55cc79b8fe40 2024-05-14T15:29:24.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.334+0000 7f8d12a00700 1 -- 172.21.15.69:0/3035224416 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d2000ed60 con 0x55cc79b8fe40 2024-05-14T15:29:24.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.334+0000 7f8d12a00700 1 -- 172.21.15.69:0/3035224416 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 55) ==== 8398+0+0 (secure 0 0 0) 0x7f8d18092070 con 0x55cc79b8fe40 2024-05-14T15:29:24.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.334+0000 7f8d4280cb80 10 client.36311 fetch_fsmap finished waiting for FSMap version 55 2024-05-14T15:29:24.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.334+0000 7f8d4280cb80 10 client.36311 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:29:24.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.334+0000 7f8d4280cb80 20 client.36311 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:24.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.334+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/3035224416 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cc79d2fa30 0x55cc79d31ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.334+0000 7f8d4280cb80 4 client.36311 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:29:24.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.334+0000 7f8d4280cb80 1 -- 172.21.15.69:0/3035224416 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc79cda1c0 con 0x55cc79d2fa30 2024-05-14T15:29:24.341 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.335+0000 7f8d2be00700 1 --2- 172.21.15.69:0/3035224416 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cc79d2fa30 0x55cc79d31ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:24.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.336+0000 7f8d2be00700 1 --2- 172.21.15.69:0/3035224416 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cc79d2fa30 0x55cc79d31ec0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e492fb05c8f41caf server_cookie=76740c039fb30542 in_seq=0 out_seq=0 2024-05-14T15:29:24.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.336+0000 7f8d12a00700 10 client.36311 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:24.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.338+0000 7f8d12a00700 1 -- 172.21.15.69:0/3035224416 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cc79cda1c0 con 0x55cc79d2fa30 2024-05-14T15:29:24.342 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.338+0000 7f8d12a00700 10 client.36311 handle_command_reply: tid=0 2024-05-14T15:29:24.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.338+0000 7f8d4280cb80 1 client.36311 shutdown 2024-05-14T15:29:24.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.339+0000 7f8d4280cb80 1 -- 172.21.15.69:0/3035224416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79b8fe40 msgr2=0x55cc79d1f850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:24.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.339+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/3035224416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79b8fe40 0x55cc79d1f850 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8d180a67c0 tx=0x7f8d180095c0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.339+0000 7f8d4280cb80 1 -- 172.21.15.69:0/3035224416 shutdown_connections 2024-05-14T15:29:24.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.339+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/3035224416 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cc79d2fa30 0x55cc79d31ec0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.339+0000 7f8d12a00700 0 client.36311 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:24.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.339+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/3035224416 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 0x55cc79d202d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.339+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/3035224416 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79b8fe40 0x55cc79d1f850 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.339+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/3035224416 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79d16200 0x55cc79d1fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.339+0000 7f8d4280cb80 1 -- 172.21.15.69:0/3035224416 >> 172.21.15.69:0/3035224416 conn(0x55cc79bd4f70 msgr2=0x55cc79d14cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:24.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.340+0000 7f8d4280cb80 1 -- 172.21.15.69:0/3035224416 shutdown_connections 2024-05-14T15:29:24.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.340+0000 7f8d4280cb80 1 -- 172.21.15.69:0/3035224416 wait complete. 2024-05-14T15:29:24.343 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.340+0000 7f8d4280cb80 20 client.36311 trim_cache size 0 max 16384 2024-05-14T15:29:24.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.364+0000 7f8d4280cb80 1 Processor -- start 2024-05-14T15:29:24.366 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.364+0000 7f8d4280cb80 1 -- start start 2024-05-14T15:29:24.367 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.365+0000 7f8d4280cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79b8fe40 0x55cc79d15cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.365+0000 7f8d4280cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 0x55cc79d1eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.366+0000 7f8d4280cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79d1c040 0x55cc79d20110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.366+0000 7f8d4280cb80 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c1ae440 con 0x55cc79d1c040 2024-05-14T15:29:24.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.366+0000 7f8d4280cb80 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c1b0100 con 0x55cc79d16200 2024-05-14T15:29:24.368 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.366+0000 7f8d4280cb80 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c1aeb10 con 0x55cc79b8fe40 2024-05-14T15:29:24.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.366+0000 7f8d2be00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 0x55cc79d1eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:24.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.366+0000 7f8d31200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79b8fe40 0x55cc79d15cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:24.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.367+0000 7f8d31200700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79b8fe40 0x55cc79d15cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:44646/0 (socket says 172.21.15.69:44646) 2024-05-14T15:29:24.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.367+0000 7f8d31200700 1 -- 172.21.15.69:0/3673511955 learned_addr learned my addr 172.21.15.69:0/3673511955 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:24.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.368+0000 7f8d31200700 1 -- 172.21.15.69:0/3673511955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 msgr2=0x55cc79d1eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:24.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.368+0000 7f8d31200700 1 --2- 172.21.15.69:0/3673511955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 0x55cc79d1eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.368+0000 7f8d31200700 1 -- 172.21.15.69:0/3673511955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79d1c040 msgr2=0x55cc79d20110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:24.369 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.368+0000 7f8d31200700 1 --2- 172.21.15.69:0/3673511955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79d1c040 0x55cc79d20110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.368+0000 7f8d31200700 1 -- 172.21.15.69:0/3673511955 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc79d1a310 con 0x55cc79b8fe40 2024-05-14T15:29:24.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.368+0000 7f8d31200700 1 --2- 172.21.15.69:0/3673511955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79b8fe40 0x55cc79d15cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800b520 tx=0x7f8d18009ca0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c7cffb272fb0271 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:24.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.369+0000 7f8d1d600700 1 -- 172.21.15.69:0/3673511955 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d180a4e60 con 0x55cc79b8fe40 2024-05-14T15:29:24.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.369+0000 7f8d1d600700 1 -- 172.21.15.69:0/3673511955 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d180aeaf0 con 0x55cc79b8fe40 2024-05-14T15:29:24.370 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.369+0000 7f8d1d600700 1 -- 172.21.15.69:0/3673511955 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d180b3080 con 0x55cc79b8fe40 2024-05-14T15:29:24.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.371+0000 7f8d4280cb80 1 -- 172.21.15.69:0/3673511955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79b8fe40 msgr2=0x55cc79d15cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:24.372 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.371+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/3673511955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79b8fe40 0x55cc79d15cc0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800b520 tx=0x7f8d18009ca0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.371+0000 7f8d4280cb80 1 -- 172.21.15.69:0/3673511955 shutdown_connections 2024-05-14T15:29:24.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.371+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/3673511955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79d1c040 0x55cc79d20110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.371+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/3673511955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79b8fe40 0x55cc79d15cc0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.371+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/3673511955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 0x55cc79d1eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.373 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.371+0000 7f8d4280cb80 1 -- 172.21.15.69:0/3673511955 >> 172.21.15.69:0/3673511955 conn(0x55cc79bd4f70 msgr2=0x55cc79d19c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:24.374 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.372+0000 7f8d4280cb80 1 -- 172.21.15.69:0/3673511955 shutdown_connections 2024-05-14T15:29:24.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.372+0000 7f8d4280cb80 1 -- 172.21.15.69:0/3673511955 wait complete. 2024-05-14T15:29:24.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.373+0000 7f8d4280cb80 1 -- start start 2024-05-14T15:29:24.375 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.373+0000 7f8d4280cb80 1 Processor -- start 2024-05-14T15:29:24.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.375+0000 7f8d4280cb80 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79b8fe40 0x55cc79d28440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.375+0000 7f8d4280cb80 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 0x55cc79d23810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.377 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.376+0000 7f8d4280cb80 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 0x55cc79d23d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.376+0000 7f8d2be00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 0x55cc79d23810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:24.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.376+0000 7f8d2be00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 0x55cc79d23810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:45100/0 (socket says 172.21.15.69:45100) 2024-05-14T15:29:24.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.376+0000 7f8d31200700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79b8fe40 0x55cc79d28440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:24.378 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.376+0000 7f8d31c00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 0x55cc79d23d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:24.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.377+0000 7f8d2be00700 1 -- 172.21.15.69:0/808811897 learned_addr learned my addr 172.21.15.69:0/808811897 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:24.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.377+0000 7f8d4280cb80 1 -- 172.21.15.69:0/808811897 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c1af970 con 0x55cc79b8fe40 2024-05-14T15:29:24.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.377+0000 7f8d4280cb80 1 -- 172.21.15.69:0/808811897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c1af1e0 con 0x55cc79d16200 2024-05-14T15:29:24.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.377+0000 7f8d4280cb80 1 -- 172.21.15.69:0/808811897 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8d2c1ac420 con 0x55cc79d1c040 2024-05-14T15:29:24.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.377+0000 7f8d4280cb80 10 client.0 _ll_register_callbacks cb 0x55cc79bd6c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:24.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.377+0000 7f8d2be00700 1 -- 172.21.15.69:0/808811897 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 msgr2=0x55cc79d23d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:24.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.377+0000 7f8d2be00700 1 --2- 172.21.15.69:0/808811897 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 0x55cc79d23d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.379 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.377+0000 7f8d2be00700 1 -- 172.21.15.69:0/808811897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79b8fe40 msgr2=0x55cc79d28440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:24.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.377+0000 7f8d2be00700 1 --2- 172.21.15.69:0/808811897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79b8fe40 0x55cc79d28440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.380 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.377+0000 7f8d2be00700 1 -- 172.21.15.69:0/808811897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc79d244d0 con 0x55cc79d16200 2024-05-14T15:29:24.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.379+0000 7f8d2be00700 1 --2- 172.21.15.69:0/808811897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 0x55cc79d23810 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000e4b0 tx=0x7f8d20000bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6744bcf886937b81 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:24.381 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.379+0000 7f8d12a00700 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:29:24.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.381+0000 7f8d12a00700 1 -- 172.21.15.69:0/808811897 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d20017040 con 0x55cc79d16200 2024-05-14T15:29:24.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.381+0000 7f8d12a00700 1 -- 172.21.15.69:0/808811897 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7f8d20025570 con 0x55cc79d16200 2024-05-14T15:29:24.383 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.382+0000 7f8d4280cb80 1 -- 172.21.15.69:0/808811897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d180aeaf0 con 0x55cc79d16200 2024-05-14T15:29:24.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.382+0000 7f8d12a00700 1 -- 172.21.15.69:0/808811897 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=55) ==== 24+0+0 (secure 0 0 0) 0x7f8d20025770 con 0x55cc79d16200 2024-05-14T15:29:24.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.382+0000 7f8d4280cb80 10 client.36317 fetch_fsmap learned FSMap version 55 2024-05-14T15:29:24.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.382+0000 7f8d4280cb80 1 -- 172.21.15.69:0/808811897 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=55,monmap=4+}) -- 0x55cc79d9a0e0 con 0x55cc79d16200 2024-05-14T15:29:24.384 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.383+0000 7f8d12a00700 1 -- 172.21.15.69:0/808811897 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8d180aeaf0 con 0x55cc79d16200 2024-05-14T15:29:24.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.383+0000 7f8d12a00700 1 -- 172.21.15.69:0/808811897 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 55) ==== 8398+0+0 (secure 0 0 0) 0x7f8d180215c0 con 0x55cc79d16200 2024-05-14T15:29:24.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.383+0000 7f8d4280cb80 10 client.36317 fetch_fsmap finished waiting for FSMap version 55 2024-05-14T15:29:24.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.383+0000 7f8d4280cb80 10 client.36317 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-05-14T15:29:24.386 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.383+0000 7f8d4280cb80 20 client.36317 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:24.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.384+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/808811897 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cc79d9a5c0 0x55cc79d9c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:24.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.384+0000 7f8d4280cb80 4 client.36317 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-05-14T15:29:24.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.384+0000 7f8d4280cb80 1 -- 172.21.15.69:0/808811897 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cc79c3d400 con 0x55cc79d9a5c0 2024-05-14T15:29:24.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.384+0000 7f8d31200700 1 --2- 172.21.15.69:0/808811897 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cc79d9a5c0 0x55cc79d9c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:24.387 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.385+0000 7f8d31200700 1 --2- 172.21.15.69:0/808811897 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cc79d9a5c0 0x55cc79d9c9e0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60da3467a7e5c802 server_cookie=123d3bf89b63d3b1 in_seq=0 out_seq=0 2024-05-14T15:29:24.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.385+0000 7f8d12a00700 10 client.36317 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:24.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.386+0000 7f8d12a00700 1 -- 172.21.15.69:0/808811897 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cc79c3d400 con 0x55cc79d9a5c0 2024-05-14T15:29:24.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.386+0000 7f8d12a00700 10 client.36317 handle_command_reply: tid=0 2024-05-14T15:29:24.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.386+0000 7f8d4280cb80 1 client.36317 shutdown 2024-05-14T15:29:24.388 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.386+0000 7f8d4280cb80 1 -- 172.21.15.69:0/808811897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 msgr2=0x55cc79d23810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:24.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.386+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/808811897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 0x55cc79d23810 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8d2000e4b0 tx=0x7f8d20000bc0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.387+0000 7f8d4280cb80 1 -- 172.21.15.69:0/808811897 shutdown_connections 2024-05-14T15:29:24.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.387+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/808811897 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cc79d9a5c0 0x55cc79d9c9e0 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.387+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/808811897 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc79b8fe40 0x55cc79d28440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.387+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/808811897 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc79d1c040 0x55cc79d23d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.387+0000 7f8d12a00700 0 client.36317 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:24.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.387+0000 7f8d4280cb80 1 --2- 172.21.15.69:0/808811897 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc79d16200 0x55cc79d23810 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.387+0000 7f8d4280cb80 1 -- 172.21.15.69:0/808811897 >> 172.21.15.69:0/808811897 conn(0x55cc79bd4f70 msgr2=0x55cc79d1c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:24.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.387+0000 7f8d4280cb80 1 -- 172.21.15.69:0/808811897 shutdown_connections 2024-05-14T15:29:24.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.387+0000 7f8d4280cb80 1 -- 172.21.15.69:0/808811897 wait complete. 2024-05-14T15:29:24.389 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.387+0000 7f8d4280cb80 20 client.36317 trim_cache size 0 max 16384 2024-05-14T15:29:24.390 INFO:teuthology.orchestra.run.smithi069.stdout:[] 2024-05-14T15:29:24.390 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.389+0000 7f8d33c00700 1 -- 172.21.15.69:0/695429712 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f8d140b2aa0 msgr2=0x7f8d140b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:24.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.389+0000 7f8d33c00700 1 --2- 172.21.15.69:0/695429712 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f8d140b2aa0 0x7f8d140b4fb0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8d2400e4d0 tx=0x7f8d2400e890 comp rx=0 tx=0).stop 2024-05-14T15:29:24.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.389+0000 7f8d33c00700 1 -- 172.21.15.69:0/695429712 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d2c1034c0 msgr2=0x7f8d2c19d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:24.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.389+0000 7f8d33c00700 1 --2- 172.21.15.69:0/695429712 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d2c1034c0 0x7f8d2c19d040 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f8d1800b650 tx=0x7f8d180057c0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.389+0000 7f8d33c00700 1 -- 172.21.15.69:0/695429712 shutdown_connections 2024-05-14T15:29:24.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.389+0000 7f8d33c00700 1 --2- 172.21.15.69:0/695429712 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f8d140b2aa0 0x7f8d140b4fb0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.391 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.389+0000 7f8d33c00700 1 --2- 172.21.15.69:0/695429712 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8d2c1034c0 0x7f8d2c19d040 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.389+0000 7f8d33c00700 1 --2- 172.21.15.69:0/695429712 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8d2c108740 0x7f8d2c1a1870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.389+0000 7f8d33c00700 1 --2- 172.21.15.69:0/695429712 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8d2c107df0 0x7f8d2c19d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:24.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.389+0000 7f8d33c00700 1 -- 172.21.15.69:0/695429712 >> 172.21.15.69:0/695429712 conn(0x7f8d2c0fedc0 msgr2=0x7f8d2c1011e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:24.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.390+0000 7f8d33c00700 1 -- 172.21.15.69:0/695429712 shutdown_connections 2024-05-14T15:29:24.392 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:29:24.390+0000 7f8d33c00700 1 -- 172.21.15.69:0/695429712 wait complete. 2024-05-14T15:29:25.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:25 smithi092 ceph-mon[34729]: pgmap v240: 129 pgs: 129 active+clean; 2.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 9.8 MiB/s wr, 692 op/s 2024-05-14T15:29:25.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:25 smithi069 ceph-mon[31270]: pgmap v240: 129 pgs: 129 active+clean; 2.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 9.8 MiB/s wr, 692 op/s 2024-05-14T15:29:25.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:25 smithi203 ceph-mon[34567]: pgmap v240: 129 pgs: 129 active+clean; 2.5 GiB data, 9.8 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 9.8 MiB/s wr, 692 op/s 2024-05-14T15:29:26.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 220.0 s, 536.8 tps, lat 181.368 ms stddev 104.907 2024-05-14T15:29:27.448 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:27 smithi092 ceph-mon[34729]: pgmap v241: 129 pgs: 129 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.5 MiB/s wr, 593 op/s 2024-05-14T15:29:27.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:27 smithi069 ceph-mon[31270]: pgmap v241: 129 pgs: 129 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.5 MiB/s wr, 593 op/s 2024-05-14T15:29:27.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:27 smithi203 ceph-mon[34567]: pgmap v241: 129 pgs: 129 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 8.5 MiB/s wr, 593 op/s 2024-05-14T15:29:28.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:28 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:29:28.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:28 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:29:28.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:28 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:29:28.739 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 283872478, 'ino': 1099511628619, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2606_vm'}, {'damage_type': 'backtrace', 'id': 288388844, 'ino': 1099511628622, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2617_vm'}, {'damage_type': 'backtrace', 'id': 567370234, 'ino': 1099511628586, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/pg_filenode.map'}, {'damage_type': 'backtrace', 'id': 996832245, 'ino': 1099511628595, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3456_fsm'}, {'damage_type': 'backtrace', 'id': 1258532013, 'ino': 1099511628629, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2612_vm'}, {'damage_type': 'backtrace', 'id': 1430870010, 'ino': 1099511628604, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13354'}, {'damage_type': 'backtrace', 'id': 1617683992, 'ino': 1099511628624, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2616_vm'}, {'damage_type': 'backtrace', 'id': 1670035353, 'ino': 1099511628652, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3456_vm'}, {'damage_type': 'backtrace', 'id': 1710389994, 'ino': 1099511628606, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13358'}, {'damage_type': 'backtrace', 'id': 1727653102, 'ino': 1099511628656, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13349_fsm'}, {'damage_type': 'backtrace', 'id': 1819558097, 'ino': 1099511628659, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13359_vm'}, {'damage_type': 'backtrace', 'id': 2154304664, 'ino': 2199023256067, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/13494/16396'}, {'damage_type': 'backtrace', 'id': 2196398844, 'ino': 1099511628632, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2618_vm'}, {'damage_type': 'backtrace', 'id': 2434061586, 'ino': 1099511628615, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/1247_vm'}, {'damage_type': 'backtrace', 'id': 2517101269, 'ino': 1099511628654, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3541_fsm'}, {'damage_type': 'backtrace', 'id': 2584629795, 'ino': 1099511628613, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2619_vm'}, {'damage_type': 'backtrace', 'id': 2907317524, 'ino': 1099511628628, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2603_vm'}, {'damage_type': 'backtrace', 'id': 2936314412, 'ino': 1099511628608, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13361'}, {'damage_type': 'backtrace', 'id': 3105262353, 'ino': 1099511628639, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2608_vm'}, {'damage_type': 'backtrace', 'id': 3762697389, 'ino': 1099511628649, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3079_vm'}, {'damage_type': 'backtrace', 'id': 3801407785, 'ino': 1099511628612, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2840_fsm'}, {'damage_type': 'backtrace', 'id': 3841042023, 'ino': 1099511628648, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/3764_fsm'}, {'damage_type': 'backtrace', 'id': 4059510004, 'ino': 1099511628625, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/2601_vm'}, {'damage_type': 'backtrace', 'id': 4064936195, 'ino': 1099511628661, 'path': '/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/base/1/13344_vm'}] 2024-05-14T15:29:28.739 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 48, in do_scrub self._scrub() File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 70, in _scrub self._check_damage() File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 81, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-05-14T15:29:29.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:29 smithi069 ceph-mon[31270]: pgmap v242: 129 pgs: 129 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 502 op/s 2024-05-14T15:29:29.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:29 smithi203 ceph-mon[34567]: pgmap v242: 129 pgs: 129 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 502 op/s 2024-05-14T15:29:29.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:29 smithi092 ceph-mon[34729]: pgmap v242: 129 pgs: 129 active+clean; 2.5 GiB data, 9.9 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 502 op/s 2024-05-14T15:29:31.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 225.0 s, 517.1 tps, lat 197.876 ms stddev 302.970 2024-05-14T15:29:31.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:31 smithi069 ceph-mon[31270]: pgmap v243: 129 pgs: 129 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 751 op/s 2024-05-14T15:29:31.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:31 smithi203 ceph-mon[34567]: pgmap v243: 129 pgs: 129 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 751 op/s 2024-05-14T15:29:31.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:31 smithi092 ceph-mon[34729]: pgmap v243: 129 pgs: 129 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 11 MiB/s wr, 751 op/s 2024-05-14T15:29:33.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:33 smithi069 ceph-mon[31270]: pgmap v244: 129 pgs: 129 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.6 MiB/s wr, 431 op/s 2024-05-14T15:29:33.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:33 smithi203 ceph-mon[34567]: pgmap v244: 129 pgs: 129 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.6 MiB/s wr, 431 op/s 2024-05-14T15:29:33.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:33 smithi092 ceph-mon[34729]: pgmap v244: 129 pgs: 129 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.6 MiB/s wr, 431 op/s 2024-05-14T15:29:35.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.515+0000 7fa128c00640 1 -- 172.21.15.69:0/3821984224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa124105720 msgr2=0x7fa124105b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.515+0000 7fa120a00640 1 -- 172.21.15.69:0/3821984224 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110035020 con 0x7fa124105720 2024-05-14T15:29:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.515+0000 7fa128c00640 1 --2- 172.21.15.69:0/3821984224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa124105720 0x7fa124105b30 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa110009900 tx=0x7fa11002a480 comp rx=0 tx=0).stop 2024-05-14T15:29:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.515+0000 7fa128c00640 1 -- 172.21.15.69:0/3821984224 shutdown_connections 2024-05-14T15:29:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.515+0000 7fa128c00640 1 --2- 172.21.15.69:0/3821984224 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa124106070 0x7fa124106480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.515+0000 7fa128c00640 1 --2- 172.21.15.69:0/3821984224 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa124105720 0x7fa124105b30 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.515+0000 7fa128c00640 1 --2- 172.21.15.69:0/3821984224 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa124076540 0x7fa124076950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.515+0000 7fa128c00640 1 -- 172.21.15.69:0/3821984224 >> 172.21.15.69:0/3821984224 conn(0x7fa1240ff360 msgr2=0x7fa1241017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:35.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.515+0000 7fa128c00640 1 -- 172.21.15.69:0/3821984224 shutdown_connections 2024-05-14T15:29:35.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.518+0000 7fa128c00640 1 -- 172.21.15.69:0/3821984224 wait complete. 2024-05-14T15:29:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.519+0000 7fa128c00640 1 Processor -- start 2024-05-14T15:29:35.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.519+0000 7fa128c00640 1 -- start start 2024-05-14T15:29:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.519+0000 7fa128c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa124076540 0x7fa1241a6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.519+0000 7fa128c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa124105720 0x7fa1241a6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.520+0000 7fa121400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa124105720 0x7fa1241a6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.520+0000 7fa128c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa124106070 0x7fa1241a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.520+0000 7fa121400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa124105720 0x7fa1241a6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35676/0 (socket says 172.21.15.69:35676) 2024-05-14T15:29:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.520+0000 7fa121400640 1 -- 172.21.15.69:0/1954572822 learned_addr learned my addr 172.21.15.69:0/1954572822 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.520+0000 7fa128c00640 1 -- 172.21.15.69:0/1954572822 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa12411a340 con 0x7fa124076540 2024-05-14T15:29:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.520+0000 7fa121e00640 1 --2- 172.21.15.69:0/1954572822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa124076540 0x7fa1241a6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.520+0000 7fa122800640 1 --2- 172.21.15.69:0/1954572822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa124106070 0x7fa1241a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.520+0000 7fa128c00640 1 -- 172.21.15.69:0/1954572822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa12411a1c0 con 0x7fa124106070 2024-05-14T15:29:35.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.520+0000 7fa128c00640 1 -- 172.21.15.69:0/1954572822 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa12411a4c0 con 0x7fa124105720 2024-05-14T15:29:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.521+0000 7fa122800640 1 -- 172.21.15.69:0/1954572822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa124105720 msgr2=0x7fa1241a6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.521+0000 7fa122800640 1 --2- 172.21.15.69:0/1954572822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa124105720 0x7fa1241a6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.521+0000 7fa122800640 1 -- 172.21.15.69:0/1954572822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa124076540 msgr2=0x7fa1241a6850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:35.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.521+0000 7fa122800640 1 --2- 172.21.15.69:0/1954572822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa124076540 0x7fa1241a6850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.521+0000 7fa122800640 1 -- 172.21.15.69:0/1954572822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1241a1050 con 0x7fa124106070 2024-05-14T15:29:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.522+0000 7fa121e00640 1 --2- 172.21.15.69:0/1954572822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa124076540 0x7fa1241a6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:29:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.523+0000 7fa122800640 1 --2- 172.21.15.69:0/1954572822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa124106070 0x7fa1241a0a60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00cab0 tx=0x7fa11c00cf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:35.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.523+0000 7fa11aa00640 1 -- 172.21.15.69:0/1954572822 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c00ae20 con 0x7fa124106070 2024-05-14T15:29:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.523+0000 7fa11aa00640 1 -- 172.21.15.69:0/1954572822 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa11c00f8e0 con 0x7fa124106070 2024-05-14T15:29:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.523+0000 7fa11aa00640 1 -- 172.21.15.69:0/1954572822 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11c0189a0 con 0x7fa124106070 2024-05-14T15:29:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.523+0000 7fa128c00640 1 -- 172.21.15.69:0/1954572822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1241a1340 con 0x7fa124106070 2024-05-14T15:29:35.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.523+0000 7fa128c00640 1 -- 172.21.15.69:0/1954572822 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1241a1890 con 0x7fa124106070 2024-05-14T15:29:35.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.531+0000 7fa12fd85740 1 Processor -- start 2024-05-14T15:29:35.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.533+0000 7fa11aa00640 1 -- 172.21.15.69:0/1954572822 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa11c0213f0 con 0x7fa124106070 2024-05-14T15:29:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.533+0000 7fa12fd85740 1 -- start start 2024-05-14T15:29:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.534+0000 7fa12fd85740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21fd1b0 0x5594a259e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.534+0000 7fa12fd85740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21d42f0 0x5594a259e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.534+0000 7fa12fd85740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21dc4d0 0x5594a259ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.534+0000 7fa12fd85740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5594a2503550 con 0x5594a21fd1b0 2024-05-14T15:29:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.534+0000 7fa12fd85740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5594a24a8bc0 con 0x5594a21dc4d0 2024-05-14T15:29:35.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.534+0000 7fa12fd85740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5594a24ff510 con 0x5594a21d42f0 2024-05-14T15:29:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.535+0000 7fa121400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21dc4d0 0x5594a259ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.535+0000 7fa121400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21fd1b0 0x5594a259e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.536+0000 7fa121400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21fd1b0 0x5594a259e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44686/0 (socket says 172.21.15.69:44686) 2024-05-14T15:29:35.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.536+0000 7fa121400640 1 -- 172.21.15.69:0/1946066197 learned_addr learned my addr 172.21.15.69:0/1946066197 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.537+0000 7fa11aa00640 1 --2- 172.21.15.69:0/1954572822 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1080b2a20 0x7fa1080b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.537+0000 7fa121400640 1 -- 172.21.15.69:0/1946066197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21d42f0 msgr2=0x5594a259e7c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:29:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.537+0000 7fa121400640 1 --2- 172.21.15.69:0/1946066197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21d42f0 0x5594a259e7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.537+0000 7fa121400640 1 -- 172.21.15.69:0/1946066197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21dc4d0 msgr2=0x5594a259ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.537+0000 7fa121400640 1 --2- 172.21.15.69:0/1946066197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21dc4d0 0x5594a259ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.537+0000 7fa121400640 1 -- 172.21.15.69:0/1946066197 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594a2215210 con 0x5594a21fd1b0 2024-05-14T15:29:35.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.539+0000 7fa122800640 1 --2- 172.21.15.69:0/1954572822 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1080b2a20 0x7fa1080b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.539+0000 7fa11aa00640 1 -- 172.21.15.69:0/1954572822 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7fa11c0e2d20 con 0x7fa124106070 2024-05-14T15:29:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.540+0000 7fa122800640 1 --2- 172.21.15.69:0/1954572822 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1080b2a20 0x7fa1080b4f30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0a9b20 tx=0x7fa11c012000 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:35.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.540+0000 7fa121400640 1 --2- 172.21.15.69:0/1946066197 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21fd1b0 0x5594a259e280 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa110032ca0 tx=0x7fa110005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8b5ba60e2eb544a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:35.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.542+0000 7fa10f000640 1 -- 172.21.15.69:0/1946066197 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110035050 con 0x5594a21fd1b0 2024-05-14T15:29:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.542+0000 7fa10f000640 1 -- 172.21.15.69:0/1946066197 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa110005040 con 0x5594a21fd1b0 2024-05-14T15:29:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.542+0000 7fa10f000640 1 -- 172.21.15.69:0/1946066197 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1100049a0 con 0x5594a21fd1b0 2024-05-14T15:29:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.543+0000 7fa12fd85740 1 -- 172.21.15.69:0/1946066197 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21fd1b0 msgr2=0x5594a259e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:35.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.543+0000 7fa12fd85740 1 --2- 172.21.15.69:0/1946066197 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21fd1b0 0x5594a259e280 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa110032ca0 tx=0x7fa110005d50 comp rx=0 tx=0).stop 2024-05-14T15:29:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.544+0000 7fa12fd85740 1 -- 172.21.15.69:0/1946066197 shutdown_connections 2024-05-14T15:29:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.544+0000 7fa12fd85740 1 --2- 172.21.15.69:0/1946066197 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21dc4d0 0x5594a259ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.544+0000 7fa12fd85740 1 --2- 172.21.15.69:0/1946066197 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21d42f0 0x5594a259e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.544+0000 7fa12fd85740 1 --2- 172.21.15.69:0/1946066197 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21fd1b0 0x5594a259e280 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.545 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.544+0000 7fa12fd85740 1 -- 172.21.15.69:0/1946066197 >> 172.21.15.69:0/1946066197 conn(0x5594a21f1300 msgr2=0x5594a259aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.544+0000 7fa12fd85740 1 -- 172.21.15.69:0/1946066197 shutdown_connections 2024-05-14T15:29:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.545+0000 7fa12fd85740 1 -- 172.21.15.69:0/1946066197 wait complete. 2024-05-14T15:29:35.546 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.545+0000 7fa12fd85740 1 -- start start 2024-05-14T15:29:35.553 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.548+0000 7fa12fd85740 1 Processor -- start 2024-05-14T15:29:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.549+0000 7fa12fd85740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21d42f0 0x5594a25a8830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.549+0000 7fa12fd85740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 0x5594a25a8d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.549+0000 7fa12fd85740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21fd1b0 0x5594a25c5840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.549+0000 7fa12fd85740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5594a25bc360 con 0x5594a21d42f0 2024-05-14T15:29:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.549+0000 7fa12fd85740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5594a24bc660 con 0x5594a21fd1b0 2024-05-14T15:29:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.549+0000 7fa12fd85740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5594a25bc4e0 con 0x5594a21dc4d0 2024-05-14T15:29:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.549+0000 7fa12fd85740 10 client.0 _ll_register_callbacks cb 0x5594a2486400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.549+0000 7fa121400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21d42f0 0x5594a25a8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.549+0000 7fa121400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21d42f0 0x5594a25a8830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44702/0 (socket says 172.21.15.69:44702) 2024-05-14T15:29:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.549+0000 7fa121400640 1 -- 172.21.15.69:0/40848141 learned_addr learned my addr 172.21.15.69:0/40848141 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.549+0000 7fa121e00640 1 --2- 172.21.15.69:0/40848141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 0x5594a25a8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:35.554 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.550+0000 7fa121400640 1 --2- 172.21.15.69:0/40848141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21fd1b0 0x5594a25c5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.552+0000 7fa121400640 1 -- 172.21.15.69:0/40848141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 msgr2=0x5594a25a8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.552+0000 7fa121400640 1 --2- 172.21.15.69:0/40848141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 0x5594a25a8d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.552+0000 7fa121400640 1 -- 172.21.15.69:0/40848141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21d42f0 msgr2=0x5594a25a8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.552+0000 7fa121400640 1 --2- 172.21.15.69:0/40848141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21d42f0 0x5594a25a8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.552+0000 7fa121400640 1 -- 172.21.15.69:0/40848141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594a22e1620 con 0x5594a21fd1b0 2024-05-14T15:29:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.554+0000 7fa121400640 1 --2- 172.21.15.69:0/40848141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21fd1b0 0x5594a25c5840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa110005ec0 tx=0x7fa110005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=954401ee72a7ff18 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:35.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.554+0000 7fa103400640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:29:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.554+0000 7fa103400640 1 -- 172.21.15.69:0/40848141 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110035040 con 0x5594a21fd1b0 2024-05-14T15:29:35.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.554+0000 7fa103400640 1 -- 172.21.15.69:0/40848141 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7fa110004740 con 0x5594a21fd1b0 2024-05-14T15:29:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.555+0000 7fa12fd85740 1 -- 172.21.15.69:0/40848141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa110005040 con 0x5594a21fd1b0 2024-05-14T15:29:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.556+0000 7fa103400640 1 -- 172.21.15.69:0/40848141 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fa11005c050 con 0x5594a21fd1b0 2024-05-14T15:29:35.557 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.556+0000 7fa12fd85740 10 client.36329 fetch_fsmap learned FSMap version 56 2024-05-14T15:29:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.556+0000 7fa12fd85740 1 -- 172.21.15.69:0/40848141 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5594a25c5d80 con 0x5594a21fd1b0 2024-05-14T15:29:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.557+0000 7fa103400640 1 -- 172.21.15.69:0/40848141 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa110005040 con 0x5594a21fd1b0 2024-05-14T15:29:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.557+0000 7fa103400640 1 -- 172.21.15.69:0/40848141 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 56) ==== 8390+0+0 (secure 0 0 0) 0x7fa110031920 con 0x5594a21fd1b0 2024-05-14T15:29:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.558+0000 7fa12fd85740 10 client.36329 fetch_fsmap finished waiting for FSMap version 56 2024-05-14T15:29:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.558+0000 7fa12fd85740 10 client.36329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:29:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.558+0000 7fa12fd85740 20 client.36329 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.558+0000 7fa12fd85740 1 --2- 172.21.15.69:0/40848141 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5594a21bbd80 0x5594a25c9200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.558+0000 7fa12fd85740 4 client.36329 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:29:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.558+0000 7fa12fd85740 1 -- 172.21.15.69:0/40848141 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5594a2511160 con 0x5594a21bbd80 2024-05-14T15:29:35.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.559+0000 7fa121e00640 1 --2- 172.21.15.69:0/40848141 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5594a21bbd80 0x5594a25c9200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.563+0000 7fa103400640 10 client.36329 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.563+0000 7fa121e00640 1 --2- 172.21.15.69:0/40848141 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5594a21bbd80 0x5594a25c9200 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=110197edbb34c63f server_cookie=1da761a5b95a8c0e in_seq=0 out_seq=0 2024-05-14T15:29:35.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.564+0000 7fa103400640 1 -- 172.21.15.69:0/40848141 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5594a2511160 con 0x5594a21bbd80 2024-05-14T15:29:35.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.564+0000 7fa103400640 10 client.36329 handle_command_reply: tid=0 2024-05-14T15:29:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.564+0000 7fa12fd85740 1 client.36329 shutdown 2024-05-14T15:29:35.570 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.569+0000 7fa12fd85740 1 -- 172.21.15.69:0/40848141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21fd1b0 msgr2=0x5594a25c5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.569+0000 7fa12fd85740 1 --2- 172.21.15.69:0/40848141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21fd1b0 0x5594a25c5840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fa110005ec0 tx=0x7fa110005fd0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.569+0000 7fa12fd85740 1 -- 172.21.15.69:0/40848141 shutdown_connections 2024-05-14T15:29:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.569+0000 7fa12fd85740 1 --2- 172.21.15.69:0/40848141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21fd1b0 0x5594a25c5840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.569+0000 7fa12fd85740 1 --2- 172.21.15.69:0/40848141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 0x5594a25a8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.569+0000 7fa12fd85740 1 --2- 172.21.15.69:0/40848141 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5594a21bbd80 0x5594a25c9200 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.569+0000 7fa12fd85740 1 --2- 172.21.15.69:0/40848141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21d42f0 0x5594a25a8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.569+0000 7fa12fd85740 1 -- 172.21.15.69:0/40848141 >> 172.21.15.69:0/40848141 conn(0x5594a21f1300 msgr2=0x5594a259e050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:35.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.569+0000 7fa103400640 0 client.36329 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:35.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.571+0000 7fa12fd85740 1 -- 172.21.15.69:0/40848141 shutdown_connections 2024-05-14T15:29:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.573+0000 7fa12fd85740 1 -- 172.21.15.69:0/40848141 wait complete. 2024-05-14T15:29:35.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.573+0000 7fa12fd85740 20 client.36329 trim_cache size 0 max 16384 2024-05-14T15:29:35.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:35 smithi203 ceph-mon[34567]: pgmap v245: 129 pgs: 129 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.6 MiB/s wr, 552 op/s 2024-05-14T15:29:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.624+0000 7fa12fd85740 1 Processor -- start 2024-05-14T15:29:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.625+0000 7fa12fd85740 1 -- start start 2024-05-14T15:29:35.626 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.625+0000 7fa12fd85740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21d42f0 0x5594a25a2ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.625+0000 7fa12fd85740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 0x5594a25c57b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.625+0000 7fa12fd85740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21fd1b0 0x5594a259ab00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.625+0000 7fa12fd85740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa12406de20 con 0x5594a21fd1b0 2024-05-14T15:29:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.625+0000 7fa12fd85740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa12406fa80 con 0x5594a21d42f0 2024-05-14T15:29:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.625+0000 7fa12fd85740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa12406e4f0 con 0x5594a21dc4d0 2024-05-14T15:29:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.626+0000 7fa121400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21d42f0 0x5594a25a2ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.626+0000 7fa121400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21d42f0 0x5594a25a2ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:60576/0 (socket says 172.21.15.69:60576) 2024-05-14T15:29:35.627 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.626+0000 7fa121400640 1 -- 172.21.15.69:0/2020621595 learned_addr learned my addr 172.21.15.69:0/2020621595 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.626+0000 7fa121400640 1 --2- 172.21.15.69:0/2020621595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21fd1b0 0x5594a259ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.627+0000 7fa121400640 1 -- 172.21.15.69:0/2020621595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 msgr2=0x5594a25c57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:35.628 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.626+0000 7fa121e00640 1 --2- 172.21.15.69:0/2020621595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 0x5594a25c57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.627+0000 7fa121400640 1 --2- 172.21.15.69:0/2020621595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 0x5594a25c57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.627+0000 7fa121400640 1 -- 172.21.15.69:0/2020621595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21fd1b0 msgr2=0x5594a259ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.627+0000 7fa121400640 1 --2- 172.21.15.69:0/2020621595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21fd1b0 0x5594a259ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.627+0000 7fa121400640 1 -- 172.21.15.69:0/2020621595 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594a259f410 con 0x5594a21d42f0 2024-05-14T15:29:35.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.628+0000 7fa121e00640 1 --2- 172.21.15.69:0/2020621595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 0x5594a25c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:29:35.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.630+0000 7fa121400640 1 --2- 172.21.15.69:0/2020621595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21d42f0 0x5594a25a2ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa11003b610 tx=0x7fa110005d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab2477c921d937d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.631+0000 7fa10e600640 1 -- 172.21.15.69:0/2020621595 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110035070 con 0x5594a21d42f0 2024-05-14T15:29:35.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.631+0000 7fa10e600640 1 -- 172.21.15.69:0/2020621595 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa110050030 con 0x5594a21d42f0 2024-05-14T15:29:35.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.631+0000 7fa10e600640 1 -- 172.21.15.69:0/2020621595 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11003b990 con 0x5594a21d42f0 2024-05-14T15:29:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.633+0000 7fa12fd85740 1 -- 172.21.15.69:0/2020621595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21d42f0 msgr2=0x5594a25a2ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.633+0000 7fa12fd85740 1 --2- 172.21.15.69:0/2020621595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21d42f0 0x5594a25a2ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa11003b610 tx=0x7fa110005d50 comp rx=0 tx=0).stop 2024-05-14T15:29:35.634 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.633+0000 7fa12fd85740 1 -- 172.21.15.69:0/2020621595 shutdown_connections 2024-05-14T15:29:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.633+0000 7fa12fd85740 1 --2- 172.21.15.69:0/2020621595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21fd1b0 0x5594a259ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.633+0000 7fa12fd85740 1 --2- 172.21.15.69:0/2020621595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 0x5594a25c57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.633+0000 7fa12fd85740 1 --2- 172.21.15.69:0/2020621595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21d42f0 0x5594a25a2ee0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.633+0000 7fa12fd85740 1 -- 172.21.15.69:0/2020621595 >> 172.21.15.69:0/2020621595 conn(0x5594a21f1300 msgr2=0x5594a259a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.634+0000 7fa12fd85740 1 -- 172.21.15.69:0/2020621595 shutdown_connections 2024-05-14T15:29:35.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.634+0000 7fa12fd85740 1 -- 172.21.15.69:0/2020621595 wait complete. 2024-05-14T15:29:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.635+0000 7fa12fd85740 1 -- start start 2024-05-14T15:29:35.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.635+0000 7fa12fd85740 1 Processor -- start 2024-05-14T15:29:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.639+0000 7fa12fd85740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21d42f0 0x5594a25cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.639+0000 7fa12fd85740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 0x5594a25cc910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.639+0000 7fa12fd85740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21fd1b0 0x5594a25c9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.639+0000 7fa12fd85740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa12406f350 con 0x5594a21d42f0 2024-05-14T15:29:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.639+0000 7fa12fd85740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa12406ebc0 con 0x5594a21fd1b0 2024-05-14T15:29:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.639+0000 7fa12fd85740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa124113aa0 con 0x5594a21dc4d0 2024-05-14T15:29:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.639+0000 7fa12fd85740 10 client.0 _ll_register_callbacks cb 0x7fa1100326e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.639+0000 7fa121e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 0x5594a25cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:35.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.639+0000 7fa121e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 0x5594a25cc910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35716/0 (socket says 172.21.15.69:35716) 2024-05-14T15:29:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.639+0000 7fa121e00640 1 -- 172.21.15.69:0/1601469688 learned_addr learned my addr 172.21.15.69:0/1601469688 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:35.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.640+0000 7fa121e00640 1 -- 172.21.15.69:0/1601469688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21fd1b0 msgr2=0x5594a25c9880 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:29:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.640+0000 7fa121e00640 1 --2- 172.21.15.69:0/1601469688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21fd1b0 0x5594a25c9880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.640+0000 7fa121e00640 1 -- 172.21.15.69:0/1601469688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21d42f0 msgr2=0x5594a25cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.640+0000 7fa121e00640 1 --2- 172.21.15.69:0/1601469688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21d42f0 0x5594a25cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.640+0000 7fa121e00640 1 -- 172.21.15.69:0/1601469688 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594a25ca010 con 0x5594a21dc4d0 2024-05-14T15:29:35.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.641+0000 7fa121e00640 1 --2- 172.21.15.69:0/1601469688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 0x5594a25cc910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa114033560 tx=0x7fa1140056a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bfeca04a906f88bd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.641+0000 7fa103400640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:29:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.642+0000 7fa103400640 1 -- 172.21.15.69:0/1601469688 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa114033800 con 0x5594a21dc4d0 2024-05-14T15:29:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.642+0000 7fa103400640 1 -- 172.21.15.69:0/1601469688 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7fa1140339a0 con 0x5594a21dc4d0 2024-05-14T15:29:35.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.643+0000 7fa12fd85740 1 -- 172.21.15.69:0/1601469688 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa110050030 con 0x5594a21dc4d0 2024-05-14T15:29:35.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.644+0000 7fa103400640 1 -- 172.21.15.69:0/1601469688 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=56) ==== 24+0+0 (secure 0 0 0) 0x7fa11404d050 con 0x5594a21dc4d0 2024-05-14T15:29:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.645+0000 7fa12fd85740 10 client.26305 fetch_fsmap learned FSMap version 56 2024-05-14T15:29:35.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.645+0000 7fa12fd85740 1 -- 172.21.15.69:0/1601469688 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=56,monmap=4+}) -- 0x5594a2633340 con 0x5594a21dc4d0 2024-05-14T15:29:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.646+0000 7fa103400640 1 -- 172.21.15.69:0/1601469688 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa110050030 con 0x5594a21dc4d0 2024-05-14T15:29:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.646+0000 7fa103400640 1 -- 172.21.15.69:0/1601469688 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 56) ==== 8390+0+0 (secure 0 0 0) 0x7fa11403e410 con 0x5594a21dc4d0 2024-05-14T15:29:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.646+0000 7fa12fd85740 10 client.26305 fetch_fsmap finished waiting for FSMap version 56 2024-05-14T15:29:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.646+0000 7fa12fd85740 10 client.26305 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:29:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.646+0000 7fa12fd85740 20 client.26305 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.646+0000 7fa12fd85740 1 --2- 172.21.15.69:0/1601469688 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5594a21911c0 0x5594a2635bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.646+0000 7fa12fd85740 4 client.26305 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:29:35.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.646+0000 7fa12fd85740 1 -- 172.21.15.69:0/1601469688 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5594a250afd0 con 0x5594a21911c0 2024-05-14T15:29:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.647+0000 7fa121400640 1 --2- 172.21.15.69:0/1601469688 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5594a21911c0 0x5594a2635bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.648+0000 7fa121400640 1 --2- 172.21.15.69:0/1601469688 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5594a21911c0 0x5594a2635bb0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d74337d79f04d816 server_cookie=aceb3ab2db0b4f4e in_seq=0 out_seq=0 2024-05-14T15:29:35.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.648+0000 7fa103400640 10 client.26305 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:35.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:35 smithi092 ceph-mon[34729]: pgmap v245: 129 pgs: 129 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.6 MiB/s wr, 552 op/s 2024-05-14T15:29:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.703+0000 7fa103400640 1 -- 172.21.15.69:0/1601469688 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5594a250afd0 con 0x5594a21911c0 2024-05-14T15:29:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.703+0000 7fa103400640 10 client.26305 handle_command_reply: tid=0 2024-05-14T15:29:35.705 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.704+0000 7fa12fd85740 1 client.26305 shutdown 2024-05-14T15:29:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.704+0000 7fa12fd85740 1 -- 172.21.15.69:0/1601469688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 msgr2=0x5594a25cc910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.704+0000 7fa12fd85740 1 --2- 172.21.15.69:0/1601469688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 0x5594a25cc910 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa114033560 tx=0x7fa1140056a0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.704+0000 7fa12fd85740 1 -- 172.21.15.69:0/1601469688 shutdown_connections 2024-05-14T15:29:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.704+0000 7fa12fd85740 1 --2- 172.21.15.69:0/1601469688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5594a21fd1b0 0x5594a25c9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.704+0000 7fa12fd85740 1 --2- 172.21.15.69:0/1601469688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5594a21dc4d0 0x5594a25cc910 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.704+0000 7fa12fd85740 1 --2- 172.21.15.69:0/1601469688 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5594a21911c0 0x5594a2635bb0 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.704+0000 7fa12fd85740 1 --2- 172.21.15.69:0/1601469688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5594a21d42f0 0x5594a25cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.704+0000 7fa12fd85740 1 -- 172.21.15.69:0/1601469688 >> 172.21.15.69:0/1601469688 conn(0x5594a21f1300 msgr2=0x5594a259e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:35.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.704+0000 7fa103400640 0 client.26305 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:35.709 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.707+0000 7fa12fd85740 1 -- 172.21.15.69:0/1601469688 shutdown_connections 2024-05-14T15:29:35.709 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.707+0000 7fa12fd85740 1 -- 172.21.15.69:0/1601469688 wait complete. 2024-05-14T15:29:35.709 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.708+0000 7fa12fd85740 20 client.26305 trim_cache size 0 max 16384 2024-05-14T15:29:35.710 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:29:35.710 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:29:35.710 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:29:35.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:29:35.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.709+0000 7fa128c00640 1 -- 172.21.15.69:0/1954572822 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1080b2a20 msgr2=0x7fa1080b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:35.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.709+0000 7fa128c00640 1 --2- 172.21.15.69:0/1954572822 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1080b2a20 0x7fa1080b4f30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa11c0a9b20 tx=0x7fa11c012000 comp rx=0 tx=0).stop 2024-05-14T15:29:35.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.709+0000 7fa128c00640 1 -- 172.21.15.69:0/1954572822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa124106070 msgr2=0x7fa1241a0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:35.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.709+0000 7fa128c00640 1 --2- 172.21.15.69:0/1954572822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa124106070 0x7fa1241a0a60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00cab0 tx=0x7fa11c00cf70 comp rx=0 tx=0).stop 2024-05-14T15:29:35.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.710+0000 7fa128c00640 1 -- 172.21.15.69:0/1954572822 shutdown_connections 2024-05-14T15:29:35.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.710+0000 7fa128c00640 1 --2- 172.21.15.69:0/1954572822 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1080b2a20 0x7fa1080b4f30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.710+0000 7fa128c00640 1 --2- 172.21.15.69:0/1954572822 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa124106070 0x7fa1241a0a60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.710+0000 7fa128c00640 1 --2- 172.21.15.69:0/1954572822 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa124105720 0x7fa1241a6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.710+0000 7fa128c00640 1 --2- 172.21.15.69:0/1954572822 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa124076540 0x7fa1241a6850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.710+0000 7fa128c00640 1 -- 172.21.15.69:0/1954572822 >> 172.21.15.69:0/1954572822 conn(0x7fa1240ff360 msgr2=0x7fa124114370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.710+0000 7fa128c00640 1 -- 172.21.15.69:0/1954572822 shutdown_connections 2024-05-14T15:29:35.712 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:35.710+0000 7fa128c00640 1 -- 172.21.15.69:0/1954572822 wait complete. 2024-05-14T15:29:35.728 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:35 smithi069 ceph-mon[31270]: pgmap v245: 129 pgs: 129 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.6 MiB/s wr, 552 op/s 2024-05-14T15:29:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 230.0 s, 493.6 tps, lat 158.959 ms stddev 88.851 2024-05-14T15:29:37.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:37 smithi203 ceph-mon[34567]: pgmap v246: 129 pgs: 129 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 548 op/s 2024-05-14T15:29:37.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:37 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:29:37.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:37 smithi092 ceph-mon[34729]: pgmap v246: 129 pgs: 129 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 548 op/s 2024-05-14T15:29:37.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:37 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:29:37.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:37 smithi069 ceph-mon[31270]: pgmap v246: 129 pgs: 129 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 8.1 MiB/s wr, 548 op/s 2024-05-14T15:29:37.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:37 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:29:38.598 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:38 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:29:38.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:38 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:29:38.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:38 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:29:39.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:39 smithi203 ceph-mon[34567]: pgmap v247: 129 pgs: 129 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 MiB/s wr, 477 op/s 2024-05-14T15:29:39.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:39 smithi092 ceph-mon[34729]: pgmap v247: 129 pgs: 129 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 MiB/s wr, 477 op/s 2024-05-14T15:29:39.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:39 smithi069 ceph-mon[31270]: pgmap v247: 129 pgs: 129 active+clean; 2.6 GiB data, 10 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.6 MiB/s wr, 477 op/s 2024-05-14T15:29:41.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 235.0 s, 786.3 tps, lat 154.747 ms stddev 214.092 2024-05-14T15:29:41.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:41 smithi203 ceph-mon[34567]: pgmap v248: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 11 MiB/s wr, 810 op/s 2024-05-14T15:29:41.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:41 smithi092 ceph-mon[34729]: pgmap v248: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 11 MiB/s wr, 810 op/s 2024-05-14T15:29:41.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:41 smithi069 ceph-mon[31270]: pgmap v248: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 11 MiB/s wr, 810 op/s 2024-05-14T15:29:43.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:43 smithi203 ceph-mon[34567]: pgmap v249: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.5 MiB/s wr, 561 op/s 2024-05-14T15:29:43.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:43 smithi092 ceph-mon[34729]: pgmap v249: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.5 MiB/s wr, 561 op/s 2024-05-14T15:29:43.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:43 smithi069 ceph-mon[31270]: pgmap v249: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 7.5 MiB/s wr, 561 op/s 2024-05-14T15:29:44.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:44 smithi203 ceph-mon[34567]: pgmap v250: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 9.1 MiB/s wr, 721 op/s 2024-05-14T15:29:44.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:44 smithi092 ceph-mon[34729]: pgmap v250: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 9.1 MiB/s wr, 721 op/s 2024-05-14T15:29:44.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:44 smithi069 ceph-mon[31270]: pgmap v250: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 9.1 MiB/s wr, 721 op/s 2024-05-14T15:29:46.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 240.0 s, 633.2 tps, lat 157.113 ms stddev 56.861 2024-05-14T15:29:47.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:47 smithi092 ceph-mon[34729]: pgmap v251: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 9.2 MiB/s wr, 690 op/s 2024-05-14T15:29:47.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:47 smithi069 ceph-mon[31270]: pgmap v251: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 9.2 MiB/s wr, 690 op/s 2024-05-14T15:29:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:47 smithi203 ceph-mon[34567]: pgmap v251: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 146 KiB/s rd, 9.2 MiB/s wr, 690 op/s 2024-05-14T15:29:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.061+0000 7fecef600640 1 -- 172.21.15.69:0/324200702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fece8109ce0 msgr2=0x7fece8103880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:49.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.061+0000 7fecef600640 1 --2- 172.21.15.69:0/324200702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fece8109ce0 0x7fece8103880 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009900 tx=0x7fecdc02a440 comp rx=0 tx=0).stop 2024-05-14T15:29:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.062+0000 7fecef600640 1 -- 172.21.15.69:0/324200702 shutdown_connections 2024-05-14T15:29:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.062+0000 7fecef600640 1 --2- 172.21.15.69:0/324200702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fece8104430 0x7fece8110800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.062+0000 7fecef600640 1 --2- 172.21.15.69:0/324200702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fece810a180 0x7fece8103dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.062+0000 7fecef600640 1 --2- 172.21.15.69:0/324200702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fece8109ce0 0x7fece8103880 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.062+0000 7fecef600640 1 -- 172.21.15.69:0/324200702 >> 172.21.15.69:0/324200702 conn(0x7fece8079450 msgr2=0x7fece8079890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:49.065 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.063+0000 7fecef600640 1 -- 172.21.15.69:0/324200702 shutdown_connections 2024-05-14T15:29:49.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.063+0000 7fecef600640 1 -- 172.21.15.69:0/324200702 wait complete. 2024-05-14T15:29:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.065+0000 7fecef600640 1 Processor -- start 2024-05-14T15:29:49.068 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.065+0000 7fecef600640 1 -- start start 2024-05-14T15:29:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.066+0000 7fecef600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fece8104430 0x7fece8198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.066+0000 7fecef600640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fece8109ce0 0x7fece8198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.066+0000 7fecef600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fece810a180 0x7fece819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.066+0000 7fecef600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fece8111bf0 con 0x7fece8104430 2024-05-14T15:29:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.066+0000 7fecef600640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fece8111a70 con 0x7fece8109ce0 2024-05-14T15:29:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.066+0000 7fecef600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fece8111d70 con 0x7fece810a180 2024-05-14T15:29:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.067+0000 7feced600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fece810a180 0x7fece819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.067+0000 7feced600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fece810a180 0x7fece819ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35404/0 (socket says 172.21.15.69:35404) 2024-05-14T15:29:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.067+0000 7feced600640 1 -- 172.21.15.69:0/2341010700 learned_addr learned my addr 172.21.15.69:0/2341010700 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:49.070 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.067+0000 7fece7e00640 1 --2- 172.21.15.69:0/2341010700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fece8109ce0 0x7fece8198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.067+0000 7fececc00640 1 --2- 172.21.15.69:0/2341010700 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fece8104430 0x7fece8198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.068+0000 7feced600640 1 -- 172.21.15.69:0/2341010700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fece8109ce0 msgr2=0x7fece8198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.068+0000 7feced600640 1 --2- 172.21.15.69:0/2341010700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fece8109ce0 0x7fece8198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.068+0000 7feced600640 1 -- 172.21.15.69:0/2341010700 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fece8104430 msgr2=0x7fece8198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.068+0000 7feced600640 1 --2- 172.21.15.69:0/2341010700 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fece8104430 0x7fece8198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.068+0000 7feced600640 1 -- 172.21.15.69:0/2341010700 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fece819d460 con 0x7fece810a180 2024-05-14T15:29:49.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.068+0000 7fececc00640 1 --2- 172.21.15.69:0/2341010700 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fece8104430 0x7fece8198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:29:49.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.069+0000 7feced600640 1 --2- 172.21.15.69:0/2341010700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fece810a180 0x7fece819ce20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fece000efd0 tx=0x7fece000c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:49.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.070+0000 7fece5600640 1 -- 172.21.15.69:0/2341010700 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece0003b70 con 0x7fece810a180 2024-05-14T15:29:49.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.070+0000 7fecef600640 1 -- 172.21.15.69:0/2341010700 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fece819d750 con 0x7fece810a180 2024-05-14T15:29:49.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.071+0000 7fecef600640 1 -- 172.21.15.69:0/2341010700 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fece81a50d0 con 0x7fece810a180 2024-05-14T15:29:49.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.071+0000 7fece5600640 1 -- 172.21.15.69:0/2341010700 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fece0009820 con 0x7fece810a180 2024-05-14T15:29:49.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.071+0000 7fece5600640 1 -- 172.21.15.69:0/2341010700 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece0010720 con 0x7fece810a180 2024-05-14T15:29:49.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.077+0000 7fecf65f9740 1 Processor -- start 2024-05-14T15:29:49.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.080+0000 7fece5600640 1 -- 172.21.15.69:0/2341010700 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fece00108c0 con 0x7fece810a180 2024-05-14T15:29:49.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.081+0000 7fecf65f9740 1 -- start start 2024-05-14T15:29:49.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.083+0000 7fecf65f9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43ebb61b0 0x55e43ef57280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.083+0000 7fecf65f9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb8d2f0 0x55e43ef577c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.083+0000 7fecf65f9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 0x55e43ef57d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.083+0000 7fecf65f9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55e43eebc550 con 0x55e43eb8d2f0 2024-05-14T15:29:49.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.083+0000 7fecf65f9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e43ee61bc0 con 0x55e43eb954d0 2024-05-14T15:29:49.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.083+0000 7fecf65f9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e43eeb8510 con 0x55e43ebb61b0 2024-05-14T15:29:49.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.084+0000 7fececc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb8d2f0 0x55e43ef577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.084+0000 7fececc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb8d2f0 0x55e43ef577c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52176/0 (socket says 172.21.15.69:52176) 2024-05-14T15:29:49.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.084+0000 7fececc00640 1 -- 172.21.15.69:0/1673963702 learned_addr learned my addr 172.21.15.69:0/1673963702 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:49.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.084+0000 7fece5600640 1 --2- 172.21.15.69:0/2341010700 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fecd0003830 0x7fecd0005d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.084+0000 7fece7e00640 1 --2- 172.21.15.69:0/1673963702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43ebb61b0 0x55e43ef57280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.084+0000 7fececc00640 1 -- 172.21.15.69:0/1673963702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43ebb61b0 msgr2=0x55e43ef57280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:49.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.084+0000 7fececc00640 1 --2- 172.21.15.69:0/1673963702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43ebb61b0 0x55e43ef57280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.084+0000 7fececc00640 1 -- 172.21.15.69:0/1673963702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 msgr2=0x55e43ef57d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.084+0000 7fececc00640 1 --2- 172.21.15.69:0/1673963702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 0x55e43ef57d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.084+0000 7fececc00640 1 -- 172.21.15.69:0/1673963702 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e43ebce210 con 0x55e43eb8d2f0 2024-05-14T15:29:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.085+0000 7fece5600640 1 -- 172.21.15.69:0/2341010700 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7fece00e2e30 con 0x7fece810a180 2024-05-14T15:29:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.085+0000 7fece7e00640 1 --2- 172.21.15.69:0/1673963702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43ebb61b0 0x55e43ef57280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:29:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.085+0000 7fececc00640 1 --2- 172.21.15.69:0/1673963702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb8d2f0 0x55e43ef577c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fecdc000c00 tx=0x7fecdc0037e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f29e9c514bf1c37 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:49.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.085+0000 7feced600640 1 --2- 172.21.15.69:0/2341010700 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fecd0003830 0x7fecd0005d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.086+0000 7feced600640 1 --2- 172.21.15.69:0/2341010700 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fecd0003830 0x7fecd0005d40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fece00a99a0 tx=0x7fece00e3080 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.087+0000 7fecd9c00640 1 -- 172.21.15.69:0/1673963702 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc041070 con 0x55e43eb8d2f0 2024-05-14T15:29:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.087+0000 7fecd9c00640 1 -- 172.21.15.69:0/1673963702 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fecdc0468f0 con 0x55e43eb8d2f0 2024-05-14T15:29:49.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.087+0000 7fecd9c00640 1 -- 172.21.15.69:0/1673963702 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc0317c0 con 0x55e43eb8d2f0 2024-05-14T15:29:49.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.088+0000 7fecf65f9740 1 -- 172.21.15.69:0/1673963702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb8d2f0 msgr2=0x55e43ef577c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:49.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.088+0000 7fecf65f9740 1 --2- 172.21.15.69:0/1673963702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb8d2f0 0x55e43ef577c0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fecdc000c00 tx=0x7fecdc0037e0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.089+0000 7fecf65f9740 1 -- 172.21.15.69:0/1673963702 shutdown_connections 2024-05-14T15:29:49.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.089+0000 7fecf65f9740 1 --2- 172.21.15.69:0/1673963702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 0x55e43ef57d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.089+0000 7fecf65f9740 1 --2- 172.21.15.69:0/1673963702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb8d2f0 0x55e43ef577c0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.089+0000 7fecf65f9740 1 --2- 172.21.15.69:0/1673963702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43ebb61b0 0x55e43ef57280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.089+0000 7fecf65f9740 1 -- 172.21.15.69:0/1673963702 >> 172.21.15.69:0/1673963702 conn(0x55e43ebaa300 msgr2=0x55e43ef53a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:49.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.089+0000 7fecf65f9740 1 -- 172.21.15.69:0/1673963702 shutdown_connections 2024-05-14T15:29:49.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.089+0000 7fecf65f9740 1 -- 172.21.15.69:0/1673963702 wait complete. 2024-05-14T15:29:49.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.090+0000 7fecf65f9740 1 -- start start 2024-05-14T15:29:49.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.091+0000 7fecf65f9740 1 Processor -- start 2024-05-14T15:29:49.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.092+0000 7fecf65f9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43eb8d2f0 0x55e43ef61750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.092+0000 7fecf65f9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 0x55e43ef61c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.092+0000 7fecf65f9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43ebb61b0 0x55e43ef760a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.092+0000 7fecf65f9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55e43ef6cb60 con 0x55e43ebb61b0 2024-05-14T15:29:49.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.092+0000 7fecf65f9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55e43ee75660 con 0x55e43eb954d0 2024-05-14T15:29:49.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.092+0000 7fecf65f9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55e43ef6cce0 con 0x55e43eb8d2f0 2024-05-14T15:29:49.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.092+0000 7fecf65f9740 10 client.0 _ll_register_callbacks cb 0x55e43ee3f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:49.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.093+0000 7fece7e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43eb8d2f0 0x55e43ef61750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.093+0000 7fece7e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43eb8d2f0 0x55e43ef61750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35420/0 (socket says 172.21.15.69:35420) 2024-05-14T15:29:49.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.093+0000 7fece7e00640 1 -- 172.21.15.69:0/532323741 learned_addr learned my addr 172.21.15.69:0/532323741 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:49.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.093+0000 7fece7e00640 1 --2- 172.21.15.69:0/532323741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43ebb61b0 0x55e43ef760a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.093+0000 7fececc00640 1 --2- 172.21.15.69:0/532323741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 0x55e43ef61c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.094+0000 7fececc00640 1 -- 172.21.15.69:0/532323741 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43eb8d2f0 msgr2=0x55e43ef61750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.094+0000 7fececc00640 1 --2- 172.21.15.69:0/532323741 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43eb8d2f0 0x55e43ef61750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.094+0000 7fececc00640 1 -- 172.21.15.69:0/532323741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43ebb61b0 msgr2=0x55e43ef760a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.094+0000 7fececc00640 1 --2- 172.21.15.69:0/532323741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43ebb61b0 0x55e43ef760a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.094+0000 7fececc00640 1 -- 172.21.15.69:0/532323741 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e43ec9a620 con 0x55e43eb954d0 2024-05-14T15:29:49.097 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.094+0000 7fece7e00640 1 --2- 172.21.15.69:0/532323741 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43eb8d2f0 0x55e43ef61750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:29:49.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.095+0000 7fececc00640 1 --2- 172.21.15.69:0/532323741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 0x55e43ef61c90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x55e43ef549c0 tx=0x7fecdc046690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aed6a5f260f9d021 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:49.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.095+0000 7fecce000640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:29:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.096+0000 7fecce000640 1 -- 172.21.15.69:0/532323741 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc054060 con 0x55e43eb954d0 2024-05-14T15:29:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.097+0000 7fecce000640 1 -- 172.21.15.69:0/532323741 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7fecdc046d70 con 0x55e43eb954d0 2024-05-14T15:29:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.097+0000 7fecf65f9740 1 -- 172.21.15.69:0/532323741 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecdc0468f0 con 0x55e43eb954d0 2024-05-14T15:29:49.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.098+0000 7fecce000640 1 -- 172.21.15.69:0/532323741 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fecdc041070 con 0x55e43eb954d0 2024-05-14T15:29:49.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.099+0000 7fecf65f9740 10 client.36341 fetch_fsmap learned FSMap version 58 2024-05-14T15:29:49.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.099+0000 7fecf65f9740 1 -- 172.21.15.69:0/532323741 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x55e43ef78d90 con 0x55e43eb954d0 2024-05-14T15:29:49.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.099+0000 7fecce000640 1 -- 172.21.15.69:0/532323741 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fecdc0468f0 con 0x55e43eb954d0 2024-05-14T15:29:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.101+0000 7fecce000640 1 -- 172.21.15.69:0/532323741 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 58) ==== 8382+0+0 (secure 0 0 0) 0x7fecdc031540 con 0x55e43eb954d0 2024-05-14T15:29:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.101+0000 7fecf65f9740 10 client.36341 fetch_fsmap finished waiting for FSMap version 58 2024-05-14T15:29:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.101+0000 7fecf65f9740 10 client.36341 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:29:49.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.101+0000 7fecf65f9740 20 client.36341 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:49.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.101+0000 7fecf65f9740 1 --2- 172.21.15.69:0/532323741 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55e43eb74d80 0x55e43ef7c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.101+0000 7fecf65f9740 4 client.36341 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:29:49.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.101+0000 7fecf65f9740 1 -- 172.21.15.69:0/532323741 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e43eeca160 con 0x55e43eb74d80 2024-05-14T15:29:49.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.103+0000 7fece7e00640 1 --2- 172.21.15.69:0/532323741 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55e43eb74d80 0x55e43ef7c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.105+0000 7fecce000640 10 client.36341 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:49.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.105+0000 7fece7e00640 1 --2- 172.21.15.69:0/532323741 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55e43eb74d80 0x55e43ef7c0f0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f1bd6677cc4bb0b server_cookie=fa5146f0f2cfa790 in_seq=0 out_seq=0 2024-05-14T15:29:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.108+0000 7fecce000640 1 -- 172.21.15.69:0/532323741 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55e43eeca160 con 0x55e43eb74d80 2024-05-14T15:29:49.110 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.108+0000 7fecce000640 10 client.36341 handle_command_reply: tid=0 2024-05-14T15:29:49.111 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.109+0000 7fecf65f9740 1 client.36341 shutdown 2024-05-14T15:29:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.110+0000 7fecf65f9740 1 -- 172.21.15.69:0/532323741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 msgr2=0x55e43ef61c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.110+0000 7fecf65f9740 1 --2- 172.21.15.69:0/532323741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 0x55e43ef61c90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x55e43ef549c0 tx=0x7fecdc046690 comp rx=0 tx=0).stop 2024-05-14T15:29:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.111+0000 7fecf65f9740 1 -- 172.21.15.69:0/532323741 shutdown_connections 2024-05-14T15:29:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.111+0000 7fecf65f9740 1 --2- 172.21.15.69:0/532323741 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55e43eb74d80 0x55e43ef7c0f0 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.111+0000 7fecf65f9740 1 --2- 172.21.15.69:0/532323741 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43ebb61b0 0x55e43ef760a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.113 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.111+0000 7fecf65f9740 1 --2- 172.21.15.69:0/532323741 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 0x55e43ef61c90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.111+0000 7fecf65f9740 1 --2- 172.21.15.69:0/532323741 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43eb8d2f0 0x55e43ef61750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.111+0000 7fecf65f9740 1 -- 172.21.15.69:0/532323741 >> 172.21.15.69:0/532323741 conn(0x55e43ebaa300 msgr2=0x55e43ef57050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.111+0000 7fecce000640 0 client.36341 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.111+0000 7fecf65f9740 1 -- 172.21.15.69:0/532323741 shutdown_connections 2024-05-14T15:29:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.111+0000 7fecf65f9740 1 -- 172.21.15.69:0/532323741 wait complete. 2024-05-14T15:29:49.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.111+0000 7fecf65f9740 20 client.36341 trim_cache size 0 max 16384 2024-05-14T15:29:49.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.157+0000 7fecf65f9740 1 Processor -- start 2024-05-14T15:29:49.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.157+0000 7fecf65f9740 1 -- start start 2024-05-14T15:29:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.157+0000 7fecf65f9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb8d2f0 0x55e43ef76010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.157+0000 7fecf65f9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 0x55e43ef76550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.157+0000 7fecf65f9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43ebb61b0 0x55e43ef52710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.157+0000 7fecf65f9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fecc8010150 con 0x55e43eb8d2f0 2024-05-14T15:29:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.157+0000 7fecf65f9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fecc8011d80 con 0x55e43eb954d0 2024-05-14T15:29:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.157+0000 7fecf65f9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fecc8010820 con 0x55e43ebb61b0 2024-05-14T15:29:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.158+0000 7fececc00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 0x55e43ef76550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.158+0000 7fececc00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 0x55e43ef76550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:34470/0 (socket says 172.21.15.69:34470) 2024-05-14T15:29:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.158+0000 7fececc00640 1 -- 172.21.15.69:0/3213259581 learned_addr learned my addr 172.21.15.69:0/3213259581 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.158+0000 7fece7e00640 1 --2- 172.21.15.69:0/3213259581 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb8d2f0 0x55e43ef76010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.158+0000 7fece7e00640 1 --2- 172.21.15.69:0/3213259581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43ebb61b0 0x55e43ef52710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.162 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.159+0000 7fececc00640 1 -- 172.21.15.69:0/3213259581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43ebb61b0 msgr2=0x55e43ef52710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:49.162 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.159+0000 7fececc00640 1 --2- 172.21.15.69:0/3213259581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43ebb61b0 0x55e43ef52710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.162 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.159+0000 7fececc00640 1 -- 172.21.15.69:0/3213259581 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb8d2f0 msgr2=0x55e43ef76010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:49.163 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.159+0000 7fececc00640 1 --2- 172.21.15.69:0/3213259581 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb8d2f0 0x55e43ef76010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.163 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.159+0000 7fececc00640 1 -- 172.21.15.69:0/3213259581 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e43ef4eeb0 con 0x55e43eb954d0 2024-05-14T15:29:49.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.161+0000 7fececc00640 1 --2- 172.21.15.69:0/3213259581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 0x55e43ef76550 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009900 tx=0x7fecdc005a20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9d81c9bbf1c1f173 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.162+0000 7fecd9200640 1 -- 172.21.15.69:0/3213259581 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc054070 con 0x55e43eb954d0 2024-05-14T15:29:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.163+0000 7fecd9200640 1 -- 172.21.15.69:0/3213259581 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fecdc0468d0 con 0x55e43eb954d0 2024-05-14T15:29:49.165 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.163+0000 7fecd9200640 1 -- 172.21.15.69:0/3213259581 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc05e080 con 0x55e43eb954d0 2024-05-14T15:29:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.165+0000 7fecf65f9740 1 -- 172.21.15.69:0/3213259581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 msgr2=0x55e43ef76550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:49.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.165+0000 7fecf65f9740 1 --2- 172.21.15.69:0/3213259581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 0x55e43ef76550 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009900 tx=0x7fecdc005a20 comp rx=0 tx=0).stop 2024-05-14T15:29:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.166+0000 7fecf65f9740 1 -- 172.21.15.69:0/3213259581 shutdown_connections 2024-05-14T15:29:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.166+0000 7fecf65f9740 1 --2- 172.21.15.69:0/3213259581 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43ebb61b0 0x55e43ef52710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.166+0000 7fecf65f9740 1 --2- 172.21.15.69:0/3213259581 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43eb954d0 0x55e43ef76550 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.166+0000 7fecf65f9740 1 --2- 172.21.15.69:0/3213259581 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb8d2f0 0x55e43ef76010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.166+0000 7fecf65f9740 1 -- 172.21.15.69:0/3213259581 >> 172.21.15.69:0/3213259581 conn(0x55e43ebaa300 msgr2=0x55e43ef52000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:49.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.167+0000 7fecf65f9740 1 -- 172.21.15.69:0/3213259581 shutdown_connections 2024-05-14T15:29:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.167+0000 7fecf65f9740 1 -- 172.21.15.69:0/3213259581 wait complete. 2024-05-14T15:29:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.168+0000 7fecf65f9740 1 -- start start 2024-05-14T15:29:49.170 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.168+0000 7fecf65f9740 1 Processor -- start 2024-05-14T15:29:49.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.170+0000 7fecf65f9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43eb8d2f0 0x55e43efdc540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.170+0000 7fecf65f9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb954d0 0x55e43efdca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.170+0000 7fecf65f9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43ebb61b0 0x55e43ef7e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.171+0000 7fece7e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43eb8d2f0 0x55e43efdc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.171+0000 7fece7e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43eb8d2f0 0x55e43efdc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35442/0 (socket says 172.21.15.69:35442) 2024-05-14T15:29:49.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.171+0000 7fece7e00640 1 -- 172.21.15.69:0/1950124136 learned_addr learned my addr 172.21.15.69:0/1950124136 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:29:49.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.171+0000 7fecf65f9740 1 -- 172.21.15.69:0/1950124136 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fecc8011680 con 0x55e43eb954d0 2024-05-14T15:29:49.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.171+0000 7fecf65f9740 1 -- 172.21.15.69:0/1950124136 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fecc8010ef0 con 0x55e43ebb61b0 2024-05-14T15:29:49.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.171+0000 7fecf65f9740 1 -- 172.21.15.69:0/1950124136 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fecc800e150 con 0x55e43eb8d2f0 2024-05-14T15:29:49.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.171+0000 7fecf65f9740 10 client.0 _ll_register_callbacks cb 0x7fecd4005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:29:49.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.171+0000 7fececc00640 1 --2- 172.21.15.69:0/1950124136 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb954d0 0x55e43efdca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.175 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.172+0000 7fece7e00640 1 --2- 172.21.15.69:0/1950124136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43ebb61b0 0x55e43ef7e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.173+0000 7fececc00640 1 -- 172.21.15.69:0/1950124136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43eb8d2f0 msgr2=0x55e43efdc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:49.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.173+0000 7fececc00640 1 --2- 172.21.15.69:0/1950124136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43eb8d2f0 0x55e43efdc540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.173+0000 7fececc00640 1 -- 172.21.15.69:0/1950124136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43ebb61b0 msgr2=0x55e43ef7e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:29:49.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.173+0000 7fececc00640 1 --2- 172.21.15.69:0/1950124136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43ebb61b0 0x55e43ef7e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.173+0000 7fececc00640 1 -- 172.21.15.69:0/1950124136 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e43efdd320 con 0x55e43eb954d0 2024-05-14T15:29:49.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.173+0000 7fece7e00640 1 --2- 172.21.15.69:0/1950124136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43ebb61b0 0x55e43ef7e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:29:49.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.175+0000 7fececc00640 1 --2- 172.21.15.69:0/1950124136 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb954d0 0x55e43efdca80 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fecdc02aa30 tx=0x7fecdc046670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=622c8407a86fad9d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:29:49.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.175+0000 7fecce000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:29:49.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.176+0000 7fecce000640 1 -- 172.21.15.69:0/1950124136 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecdc05e070 con 0x55e43eb954d0 2024-05-14T15:29:49.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.176+0000 7fecce000640 1 -- 172.21.15.69:0/1950124136 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(96..96 src has 1..96) ==== 9554+0+0 (secure 0 0 0) 0x7fecdc059630 con 0x55e43eb954d0 2024-05-14T15:29:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.176+0000 7fecf65f9740 1 -- 172.21.15.69:0/1950124136 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fecdc0468d0 con 0x55e43eb954d0 2024-05-14T15:29:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.177+0000 7fecce000640 1 -- 172.21.15.69:0/1950124136 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) ==== 24+0+0 (secure 0 0 0) 0x7fecdc054040 con 0x55e43eb954d0 2024-05-14T15:29:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.177+0000 7fecf65f9740 10 client.16860 fetch_fsmap learned FSMap version 58 2024-05-14T15:29:49.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.177+0000 7fecf65f9740 1 -- 172.21.15.69:0/1950124136 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=4+}) -- 0x55e43ef7f6c0 con 0x55e43eb954d0 2024-05-14T15:29:49.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.178+0000 7fecce000640 1 -- 172.21.15.69:0/1950124136 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fecdc0468d0 con 0x55e43eb954d0 2024-05-14T15:29:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.178+0000 7fecce000640 1 -- 172.21.15.69:0/1950124136 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 58) ==== 8382+0+0 (secure 0 0 0) 0x7fecdc0506c0 con 0x55e43eb954d0 2024-05-14T15:29:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.178+0000 7fecf65f9740 10 client.16860 fetch_fsmap finished waiting for FSMap version 58 2024-05-14T15:29:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.178+0000 7fecf65f9740 10 client.16860 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:29:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.178+0000 7fecf65f9740 20 client.16860 populate_metadata read hostname 'smithi069' 2024-05-14T15:29:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.178+0000 7fecf65f9740 1 --2- 172.21.15.69:0/1950124136 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55e43eb4a1c0 0x55e43ef6c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:29:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.178+0000 7fecf65f9740 4 client.16860 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:29:49.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.178+0000 7fecf65f9740 1 -- 172.21.15.69:0/1950124136 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55e43eec3fd0 con 0x55e43eb4a1c0 2024-05-14T15:29:49.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.179+0000 7fece7e00640 1 --2- 172.21.15.69:0/1950124136 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55e43eb4a1c0 0x55e43ef6c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:29:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.181+0000 7fece7e00640 1 --2- 172.21.15.69:0/1950124136 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55e43eb4a1c0 0x55e43ef6c0f0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebdcc29b256955e0 server_cookie=f1ec6c5e69cf791b in_seq=0 out_seq=0 2024-05-14T15:29:49.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.181+0000 7fecce000640 10 client.16860 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:49.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.212+0000 7fecce000640 1 -- 172.21.15.69:0/1950124136 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55e43eec3fd0 con 0x55e43eb4a1c0 2024-05-14T15:29:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.212+0000 7fecce000640 10 client.16860 handle_command_reply: tid=0 2024-05-14T15:29:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.212+0000 7fecf65f9740 1 client.16860 shutdown 2024-05-14T15:29:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.212+0000 7fecf65f9740 1 -- 172.21.15.69:0/1950124136 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb954d0 msgr2=0x55e43efdca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.212+0000 7fecf65f9740 1 --2- 172.21.15.69:0/1950124136 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb954d0 0x55e43efdca80 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fecdc02aa30 tx=0x7fecdc046670 comp rx=0 tx=0).stop 2024-05-14T15:29:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.213+0000 7fecf65f9740 1 -- 172.21.15.69:0/1950124136 shutdown_connections 2024-05-14T15:29:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.213+0000 7fecf65f9740 1 --2- 172.21.15.69:0/1950124136 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55e43ebb61b0 0x55e43ef7e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.213+0000 7fecf65f9740 1 --2- 172.21.15.69:0/1950124136 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55e43eb4a1c0 0x55e43ef6c0f0 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.213+0000 7fecf65f9740 1 --2- 172.21.15.69:0/1950124136 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55e43eb954d0 0x55e43efdca80 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.213+0000 7fecf65f9740 1 --2- 172.21.15.69:0/1950124136 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55e43eb8d2f0 0x55e43efdc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.213+0000 7fecf65f9740 1 -- 172.21.15.69:0/1950124136 >> 172.21.15.69:0/1950124136 conn(0x55e43ebaa300 msgr2=0x55e43ef62bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.213+0000 7fecce000640 0 client.16860 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:29:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.214+0000 7fecf65f9740 1 -- 172.21.15.69:0/1950124136 shutdown_connections 2024-05-14T15:29:49.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.214+0000 7fecf65f9740 1 -- 172.21.15.69:0/1950124136 wait complete. 2024-05-14T15:29:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.215+0000 7fecf65f9740 20 client.16860 trim_cache size 0 max 16384 2024-05-14T15:29:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:29:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:29:49.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:29:49.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:29:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.216+0000 7fecef600640 1 -- 172.21.15.69:0/2341010700 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fecd0003830 msgr2=0x7fecd0005d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.216+0000 7fecef600640 1 --2- 172.21.15.69:0/2341010700 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fecd0003830 0x7fecd0005d40 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fece00a99a0 tx=0x7fece00e3080 comp rx=0 tx=0).stop 2024-05-14T15:29:49.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.216+0000 7fecef600640 1 -- 172.21.15.69:0/2341010700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fece810a180 msgr2=0x7fece819ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:29:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.216+0000 7fecef600640 1 --2- 172.21.15.69:0/2341010700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fece810a180 0x7fece819ce20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fece000efd0 tx=0x7fece000c6a0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.217+0000 7fecef600640 1 -- 172.21.15.69:0/2341010700 shutdown_connections 2024-05-14T15:29:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.217+0000 7fecef600640 1 --2- 172.21.15.69:0/2341010700 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fecd0003830 0x7fecd0005d40 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.217+0000 7fecef600640 1 --2- 172.21.15.69:0/2341010700 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fece810a180 0x7fece819ce20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.217+0000 7fecef600640 1 --2- 172.21.15.69:0/2341010700 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fece8109ce0 0x7fece8198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.217+0000 7fecef600640 1 --2- 172.21.15.69:0/2341010700 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fece8104430 0x7fece8198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:29:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.217+0000 7fecef600640 1 -- 172.21.15.69:0/2341010700 >> 172.21.15.69:0/2341010700 conn(0x7fece8079450 msgr2=0x7fece8105380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:29:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.217+0000 7fecef600640 1 -- 172.21.15.69:0/2341010700 shutdown_connections 2024-05-14T15:29:49.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:29:49.217+0000 7fecef600640 1 -- 172.21.15.69:0/2341010700 wait complete. 2024-05-14T15:29:49.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:49 smithi092 ceph-mon[34729]: pgmap v252: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 7.5 MiB/s wr, 583 op/s 2024-05-14T15:29:49.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:49 smithi069 ceph-mon[31270]: pgmap v252: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 7.5 MiB/s wr, 583 op/s 2024-05-14T15:29:49.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:49 smithi203 ceph-mon[34567]: pgmap v252: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 145 KiB/s rd, 7.5 MiB/s wr, 583 op/s 2024-05-14T15:29:51.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 245.0 s, 689.6 tps, lat 146.083 ms stddev 56.556 2024-05-14T15:29:51.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:51 smithi092 ceph-mon[34729]: pgmap v253: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 11 MiB/s wr, 892 op/s 2024-05-14T15:29:51.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:51 smithi069 ceph-mon[31270]: pgmap v253: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 11 MiB/s wr, 892 op/s 2024-05-14T15:29:51.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:51 smithi203 ceph-mon[34567]: pgmap v253: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 158 KiB/s rd, 11 MiB/s wr, 892 op/s 2024-05-14T15:29:53.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:53 smithi092 ceph-mon[34729]: pgmap v254: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 6.0 MiB/s wr, 558 op/s 2024-05-14T15:29:53.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:53 smithi069 ceph-mon[31270]: pgmap v254: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 6.0 MiB/s wr, 558 op/s 2024-05-14T15:29:53.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:53 smithi203 ceph-mon[34567]: pgmap v254: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 6.0 MiB/s wr, 558 op/s 2024-05-14T15:29:55.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:55 smithi092 ceph-mon[34729]: pgmap v255: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 8.5 MiB/s wr, 779 op/s 2024-05-14T15:29:55.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:55 smithi069 ceph-mon[31270]: pgmap v255: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 8.5 MiB/s wr, 779 op/s 2024-05-14T15:29:55.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:55 smithi203 ceph-mon[34567]: pgmap v255: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 8.5 MiB/s wr, 779 op/s 2024-05-14T15:29:56.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 250.0 s, 662.8 tps, lat 150.126 ms stddev 47.857 2024-05-14T15:29:57.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:57 smithi092 ceph-mon[34729]: pgmap v256: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.7 MiB/s wr, 723 op/s 2024-05-14T15:29:57.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:57 smithi069 ceph-mon[31270]: pgmap v256: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.7 MiB/s wr, 723 op/s 2024-05-14T15:29:57.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:57 smithi203 ceph-mon[34567]: pgmap v256: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.7 MiB/s wr, 723 op/s 2024-05-14T15:29:58.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:58 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:29:58.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:58 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:29:58.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:58 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:29:59.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:29:59 smithi069 ceph-mon[31270]: pgmap v257: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.7 MiB/s wr, 633 op/s 2024-05-14T15:29:59.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:29:59 smithi203 ceph-mon[34567]: pgmap v257: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.7 MiB/s wr, 633 op/s 2024-05-14T15:29:59.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:29:59 smithi092 ceph-mon[34729]: pgmap v257: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 6.7 MiB/s wr, 633 op/s 2024-05-14T15:30:00.392 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a[31265]: 2024-05-14T15:29:59.999+0000 7f22e0a00700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-05-14T15:30:00.393 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a[31265]: 2024-05-14T15:29:59.999+0000 7f22e0a00700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-05-14T15:30:00.393 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a[31265]: 2024-05-14T15:29:59.999+0000 7f22e0a00700 -1 log_channel(cluster) log [ERR] : mds.e(mds.2): Metadata damage detected 2024-05-14T15:30:00.393 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:00 smithi069 ceph-mon[31270]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-05-14T15:30:00.393 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:00 smithi069 ceph-mon[31270]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-05-14T15:30:00.393 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:00 smithi069 ceph-mon[31270]: mds.e(mds.2): Metadata damage detected 2024-05-14T15:30:00.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:00 smithi203 ceph-mon[34567]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-05-14T15:30:00.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:00 smithi203 ceph-mon[34567]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-05-14T15:30:00.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:00 smithi203 ceph-mon[34567]: mds.e(mds.2): Metadata damage detected 2024-05-14T15:30:00.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:00 smithi092 ceph-mon[34729]: Health detail: HEALTH_ERR 1 MDSs report damaged metadata 2024-05-14T15:30:00.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:00 smithi092 ceph-mon[34729]: [ERR] MDS_DAMAGE: 1 MDSs report damaged metadata 2024-05-14T15:30:00.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:00 smithi092 ceph-mon[34729]: mds.e(mds.2): Metadata damage detected 2024-05-14T15:30:01.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 255.0 s, 600.6 tps, lat 165.412 ms stddev 73.553 2024-05-14T15:30:01.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:01 smithi203 ceph-mon[34567]: pgmap v258: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 9.8 MiB/s wr, 945 op/s 2024-05-14T15:30:01.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:01 smithi092 ceph-mon[34729]: pgmap v258: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 9.8 MiB/s wr, 945 op/s 2024-05-14T15:30:01.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:01 smithi069 ceph-mon[31270]: pgmap v258: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 9.8 MiB/s wr, 945 op/s 2024-05-14T15:30:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.574+0000 7ff002200640 1 -- 172.21.15.69:0/1313647260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feffc111df0 msgr2=0x7feffc112280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.574+0000 7ff002200640 1 --2- 172.21.15.69:0/1313647260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feffc111df0 0x7feffc112280 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fefec009900 tx=0x7fefec02a480 comp rx=0 tx=0).stop 2024-05-14T15:30:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.574+0000 7ff002200640 1 -- 172.21.15.69:0/1313647260 shutdown_connections 2024-05-14T15:30:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.574+0000 7ff002200640 1 --2- 172.21.15.69:0/1313647260 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feffc112910 0x7feffc118ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.574+0000 7ff002200640 1 --2- 172.21.15.69:0/1313647260 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feffc111df0 0x7feffc112280 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.574+0000 7ff002200640 1 --2- 172.21.15.69:0/1313647260 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feffc10a4a0 0x7feffc10a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.574+0000 7ff002200640 1 -- 172.21.15.69:0/1313647260 >> 172.21.15.69:0/1313647260 conn(0x7feffc06e900 msgr2=0x7feffc06ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.575+0000 7ff002200640 1 -- 172.21.15.69:0/1313647260 shutdown_connections 2024-05-14T15:30:02.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.576+0000 7ff002200640 1 -- 172.21.15.69:0/1313647260 wait complete. 2024-05-14T15:30:02.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.578+0000 7ff002200640 1 Processor -- start 2024-05-14T15:30:02.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.579+0000 7ff002200640 1 -- start start 2024-05-14T15:30:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.581+0000 7ff002200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feffc10a4a0 0x7feffc1a2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.581+0000 7ff002200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feffc111df0 0x7feffc1a3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.581+0000 7ff002200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feffc112910 0x7feffc1a77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.581+0000 7ff002200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7feffc11c540 con 0x7feffc111df0 2024-05-14T15:30:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.581+0000 7ff002200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feffc11c3c0 con 0x7feffc112910 2024-05-14T15:30:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.581+0000 7ff002200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feffc11c6c0 con 0x7feffc10a4a0 2024-05-14T15:30:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.581+0000 7feffb400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feffc10a4a0 0x7feffc1a2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:02.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.581+0000 7feffb400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feffc10a4a0 0x7feffc1a2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:52102/0 (socket says 172.21.15.69:52102) 2024-05-14T15:30:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.581+0000 7feffb400640 1 -- 172.21.15.69:0/3108830829 learned_addr learned my addr 172.21.15.69:0/3108830829 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.582+0000 7feffbe00640 1 --2- 172.21.15.69:0/3108830829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feffc112910 0x7feffc1a77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.582+0000 7feffb400640 1 -- 172.21.15.69:0/3108830829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feffc112910 msgr2=0x7feffc1a77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.582+0000 7feffb400640 1 --2- 172.21.15.69:0/3108830829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feffc112910 0x7feffc1a77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.582+0000 7feffaa00640 1 --2- 172.21.15.69:0/3108830829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feffc111df0 0x7feffc1a3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.582+0000 7feffb400640 1 -- 172.21.15.69:0/3108830829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feffc111df0 msgr2=0x7feffc1a3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.582+0000 7feffb400640 1 --2- 172.21.15.69:0/3108830829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feffc111df0 0x7feffc1a3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.582+0000 7feffb400640 1 -- 172.21.15.69:0/3108830829 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feffc1a7e00 con 0x7feffc10a4a0 2024-05-14T15:30:02.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.585+0000 7feffaa00640 1 --2- 172.21.15.69:0/3108830829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feffc111df0 0x7feffc1a3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:30:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.586+0000 7feffb400640 1 --2- 172.21.15.69:0/3108830829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feffc10a4a0 0x7feffc1a2fa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7feff400eab0 tx=0x7feff400ef70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:02.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.586+0000 7feff3e00640 1 -- 172.21.15.69:0/3108830829 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff400ce40 con 0x7feffc10a4a0 2024-05-14T15:30:02.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.586+0000 7feff3e00640 1 -- 172.21.15.69:0/3108830829 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7feff4011900 con 0x7feffc10a4a0 2024-05-14T15:30:02.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.586+0000 7feff3e00640 1 -- 172.21.15.69:0/3108830829 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff4010990 con 0x7feffc10a4a0 2024-05-14T15:30:02.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.586+0000 7ff002200640 1 -- 172.21.15.69:0/3108830829 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feffc1a80f0 con 0x7feffc10a4a0 2024-05-14T15:30:02.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.587+0000 7ff002200640 1 -- 172.21.15.69:0/3108830829 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feffc1a85f0 con 0x7feffc10a4a0 2024-05-14T15:30:02.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.592+0000 7ff00921b740 1 Processor -- start 2024-05-14T15:30:02.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.592+0000 7ff00921b740 1 -- start start 2024-05-14T15:30:02.594 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.593+0000 7ff00921b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a2582771b0 0x55a258618280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.594 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.593+0000 7ff00921b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a25824e2f0 0x55a2586187c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.594 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.593+0000 7ff00921b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582564d0 0x55a258618d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.594 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.593+0000 7ff00921b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55a25857d550 con 0x55a2582771b0 2024-05-14T15:30:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.593+0000 7ff00921b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a258522bc0 con 0x55a2582564d0 2024-05-14T15:30:02.595 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.593+0000 7ff00921b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a258579510 con 0x55a25824e2f0 2024-05-14T15:30:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.593+0000 7feff3e00640 1 -- 172.21.15.69:0/3108830829 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7feff4011470 con 0x7feffc10a4a0 2024-05-14T15:30:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.593+0000 7feffaa00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582564d0 0x55a258618d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.593+0000 7feffaa00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582564d0 0x55a258618d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:53430/0 (socket says 172.21.15.69:53430) 2024-05-14T15:30:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.593+0000 7feffaa00640 1 -- 172.21.15.69:0/820748342 learned_addr learned my addr 172.21.15.69:0/820748342 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.594+0000 7feffaa00640 1 -- 172.21.15.69:0/820748342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a25824e2f0 msgr2=0x55a2586187c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:30:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.594+0000 7feffaa00640 1 --2- 172.21.15.69:0/820748342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a25824e2f0 0x55a2586187c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.594+0000 7feffaa00640 1 -- 172.21.15.69:0/820748342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a2582771b0 msgr2=0x55a258618280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.594+0000 7feffaa00640 1 --2- 172.21.15.69:0/820748342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a2582771b0 0x55a258618280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.595+0000 7feffaa00640 1 -- 172.21.15.69:0/820748342 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a25828f210 con 0x55a2582564d0 2024-05-14T15:30:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.595+0000 7feffaa00640 1 --2- 172.21.15.69:0/820748342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582564d0 0x55a258618d00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fefec006010 tx=0x7fefec0095a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c3b7c0599a94a59 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:02.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.596+0000 7fefe7e00640 1 -- 172.21.15.69:0/820748342 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec035030 con 0x55a2582564d0 2024-05-14T15:30:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.596+0000 7fefe7e00640 1 -- 172.21.15.69:0/820748342 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fefec045070 con 0x55a2582564d0 2024-05-14T15:30:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.596+0000 7fefe7e00640 1 -- 172.21.15.69:0/820748342 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec004a40 con 0x55a2582564d0 2024-05-14T15:30:02.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.598+0000 7ff00921b740 1 -- 172.21.15.69:0/820748342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582564d0 msgr2=0x55a258618d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.598+0000 7ff00921b740 1 --2- 172.21.15.69:0/820748342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582564d0 0x55a258618d00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fefec006010 tx=0x7fefec0095a0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.599+0000 7ff00921b740 1 -- 172.21.15.69:0/820748342 shutdown_connections 2024-05-14T15:30:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.599+0000 7ff00921b740 1 --2- 172.21.15.69:0/820748342 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582564d0 0x55a258618d00 secure :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fefec006010 tx=0x7fefec0095a0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.599+0000 7ff00921b740 1 --2- 172.21.15.69:0/820748342 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a25824e2f0 0x55a2586187c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.599+0000 7ff00921b740 1 --2- 172.21.15.69:0/820748342 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a2582771b0 0x55a258618280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.599+0000 7ff00921b740 1 -- 172.21.15.69:0/820748342 >> 172.21.15.69:0/820748342 conn(0x55a25826b300 msgr2=0x55a258614a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:02.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.599+0000 7feff3e00640 1 --2- 172.21.15.69:0/3108830829 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fefe00b2a20 0x7fefe00b4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.603+0000 7ff00921b740 1 -- 172.21.15.69:0/820748342 shutdown_connections 2024-05-14T15:30:02.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.604+0000 7ff00921b740 1 -- 172.21.15.69:0/820748342 wait complete. 2024-05-14T15:30:02.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.604+0000 7feff3e00640 1 -- 172.21.15.69:0/3108830829 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 9642+0+0 (secure 0 0 0) 0x7feff40e30d0 con 0x7feffc10a4a0 2024-05-14T15:30:02.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.604+0000 7ff00921b740 1 -- start start 2024-05-14T15:30:02.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.605+0000 7ff00921b740 1 Processor -- start 2024-05-14T15:30:02.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.606+0000 7feffbe00640 1 --2- 172.21.15.69:0/3108830829 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fefe00b2a20 0x7fefe00b4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:02.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.608+0000 7ff00921b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a25824e2f0 0x55a2586227c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.608+0000 7ff00921b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2582771b0 0x55a258622d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.609+0000 7ff00921b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a258235d80 0x55a25862e840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.609+0000 7ff00921b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55a258625350 con 0x55a25824e2f0 2024-05-14T15:30:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.609+0000 7ff00921b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a258536660 con 0x55a258235d80 2024-05-14T15:30:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.609+0000 7ff00921b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a2586254d0 con 0x55a2582771b0 2024-05-14T15:30:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.609+0000 7ff00921b740 10 client.0 _ll_register_callbacks cb 0x55a258500400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:30:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.609+0000 7feffbe00640 1 --2- 172.21.15.69:0/3108830829 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fefe00b2a20 0x7fefe00b4f30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55a2586153f0 tx=0x7fefe80046c0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.609+0000 7feffaa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2582771b0 0x55a258622d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.609+0000 7feffaa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2582771b0 0x55a258622d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:52124/0 (socket says 172.21.15.69:52124) 2024-05-14T15:30:02.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.609+0000 7feffaa00640 1 -- 172.21.15.69:0/3955441765 learned_addr learned my addr 172.21.15.69:0/3955441765 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:02.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.610+0000 7feffbe00640 1 --2- 172.21.15.69:0/3955441765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a258235d80 0x55a25862e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.610+0000 7feffaa00640 1 -- 172.21.15.69:0/3955441765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a258235d80 msgr2=0x55a25862e840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.610+0000 7feffb400640 1 --2- 172.21.15.69:0/3955441765 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a25824e2f0 0x55a2586227c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.611+0000 7feffaa00640 1 --2- 172.21.15.69:0/3955441765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a258235d80 0x55a25862e840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.611+0000 7feffaa00640 1 -- 172.21.15.69:0/3955441765 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a25824e2f0 msgr2=0x55a2586227c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.611+0000 7feffaa00640 1 --2- 172.21.15.69:0/3955441765 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a25824e2f0 0x55a2586227c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.611+0000 7feffaa00640 1 -- 172.21.15.69:0/3955441765 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a25835b620 con 0x55a2582771b0 2024-05-14T15:30:02.613 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.611+0000 7feffbe00640 1 --2- 172.21.15.69:0/3955441765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a258235d80 0x55a25862e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:30:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.611+0000 7feffb400640 1 --2- 172.21.15.69:0/3955441765 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a25824e2f0 0x55a2586227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:30:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.611+0000 7feffaa00640 1 --2- 172.21.15.69:0/3955441765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2582771b0 0x55a258622d00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fefec0092a0 tx=0x7fefec041d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a6bf43be131b749 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.612+0000 7fefe4c00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:30:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.612+0000 7fefe4c00640 1 -- 172.21.15.69:0/3955441765 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefec05b060 con 0x55a2582771b0 2024-05-14T15:30:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.613+0000 7fefe4c00640 1 -- 172.21.15.69:0/3955441765 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9642+0+0 (secure 0 0 0) 0x7fefec04a680 con 0x55a2582771b0 2024-05-14T15:30:02.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.613+0000 7ff00921b740 1 -- 172.21.15.69:0/3955441765 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefec045070 con 0x55a2582771b0 2024-05-14T15:30:02.615 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.613+0000 7fefe4c00640 1 -- 172.21.15.69:0/3955441765 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fefec05b060 con 0x55a2582771b0 2024-05-14T15:30:02.615 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.614+0000 7ff00921b740 10 client.26329 fetch_fsmap learned FSMap version 59 2024-05-14T15:30:02.615 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.614+0000 7ff00921b740 1 -- 172.21.15.69:0/3955441765 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x55a258625350 con 0x55a2582771b0 2024-05-14T15:30:02.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.614+0000 7fefe4c00640 1 -- 172.21.15.69:0/3955441765 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fefec04ad10 con 0x55a2582771b0 2024-05-14T15:30:02.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.615+0000 7fefe4c00640 1 -- 172.21.15.69:0/3955441765 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 59) ==== 8378+0+0 (secure 0 0 0) 0x7fefec056a10 con 0x55a2582771b0 2024-05-14T15:30:02.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.615+0000 7ff00921b740 10 client.26329 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T15:30:02.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.615+0000 7ff00921b740 10 client.26329 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:30:02.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.615+0000 7ff00921b740 20 client.26329 populate_metadata read hostname 'smithi069' 2024-05-14T15:30:02.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.615+0000 7ff00921b740 1 --2- 172.21.15.69:0/3955441765 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a25820b1c0 0x55a2586347b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.615+0000 7ff00921b740 4 client.26329 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:30:02.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.615+0000 7ff00921b740 1 -- 172.21.15.69:0/3955441765 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fefec045070 con 0x55a25820b1c0 2024-05-14T15:30:02.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.617+0000 7feffb400640 1 --2- 172.21.15.69:0/3955441765 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a25820b1c0 0x55a2586347b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:02.620 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.618+0000 7fefe4c00640 10 client.26329 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:02.620 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.618+0000 7feffb400640 1 --2- 172.21.15.69:0/3955441765 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a25820b1c0 0x55a2586347b0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc7b50da5608a14f server_cookie=1c8388c28d016e9f in_seq=0 out_seq=0 2024-05-14T15:30:02.621 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.620+0000 7fefe4c00640 1 -- 172.21.15.69:0/3955441765 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7fefec045070 con 0x55a25820b1c0 2024-05-14T15:30:02.621 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.620+0000 7fefe4c00640 10 client.26329 handle_command_reply: tid=0 2024-05-14T15:30:02.621 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.620+0000 7ff00921b740 1 client.26329 shutdown 2024-05-14T15:30:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.622+0000 7ff00921b740 1 -- 172.21.15.69:0/3955441765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2582771b0 msgr2=0x55a258622d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:02.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.622+0000 7ff00921b740 1 --2- 172.21.15.69:0/3955441765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2582771b0 0x55a258622d00 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fefec0092a0 tx=0x7fefec041d90 comp rx=0 tx=0).stop 2024-05-14T15:30:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.623+0000 7ff00921b740 1 -- 172.21.15.69:0/3955441765 shutdown_connections 2024-05-14T15:30:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.623+0000 7ff00921b740 1 --2- 172.21.15.69:0/3955441765 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a258235d80 0x55a25862e840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.623+0000 7ff00921b740 1 --2- 172.21.15.69:0/3955441765 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a2582771b0 0x55a258622d00 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.624 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.623+0000 7ff00921b740 1 --2- 172.21.15.69:0/3955441765 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a25820b1c0 0x55a2586347b0 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.623+0000 7ff00921b740 1 --2- 172.21.15.69:0/3955441765 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a25824e2f0 0x55a2586227c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.623+0000 7fefe4c00640 0 client.26329 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.623+0000 7ff00921b740 1 -- 172.21.15.69:0/3955441765 >> 172.21.15.69:0/3955441765 conn(0x55a25826b300 msgr2=0x55a258619fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.623+0000 7ff00921b740 1 -- 172.21.15.69:0/3955441765 shutdown_connections 2024-05-14T15:30:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.623+0000 7ff00921b740 1 -- 172.21.15.69:0/3955441765 wait complete. 2024-05-14T15:30:02.625 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.623+0000 7ff00921b740 20 client.26329 trim_cache size 0 max 16384 2024-05-14T15:30:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.665+0000 7ff00921b740 1 Processor -- start 2024-05-14T15:30:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.666+0000 7ff00921b740 1 -- start start 2024-05-14T15:30:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.666+0000 7ff00921b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a258235d80 0x55a25861cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.666+0000 7ff00921b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a25824e2f0 0x55a2586247c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.666+0000 7ff00921b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582771b0 0x55a25862e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.666+0000 7ff00921b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7feffc1b7c80 con 0x55a258235d80 2024-05-14T15:30:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.666+0000 7ff00921b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feffc1b9880 con 0x55a2582771b0 2024-05-14T15:30:02.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.666+0000 7ff00921b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feffc1b8350 con 0x55a25824e2f0 2024-05-14T15:30:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.667+0000 7feffaa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a25824e2f0 0x55a2586247c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.667+0000 7feffbe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582771b0 0x55a25862e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.667+0000 7feffbe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582771b0 0x55a25862e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:53446/0 (socket says 172.21.15.69:53446) 2024-05-14T15:30:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.667+0000 7feffb400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a258235d80 0x55a25861cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:02.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.668+0000 7feffb400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a258235d80 0x55a25861cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58342/0 (socket says 172.21.15.69:58342) 2024-05-14T15:30:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.668+0000 7feffb400640 1 -- 172.21.15.69:0/2197573810 learned_addr learned my addr 172.21.15.69:0/2197573810 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:02.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.667+0000 7feffaa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a25824e2f0 0x55a2586247c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:52132/0 (socket says 172.21.15.69:52132) 2024-05-14T15:30:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.669+0000 7feffbe00640 1 -- 172.21.15.69:0/2197573810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a25824e2f0 msgr2=0x55a2586247c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.669+0000 7feffbe00640 1 --2- 172.21.15.69:0/2197573810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a25824e2f0 0x55a2586247c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.669+0000 7feffbe00640 1 -- 172.21.15.69:0/2197573810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a258235d80 msgr2=0x55a25861cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:02.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.669+0000 7feffbe00640 1 --2- 172.21.15.69:0/2197573810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a258235d80 0x55a25861cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.670+0000 7feffbe00640 1 -- 172.21.15.69:0/2197573810 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a258617c10 con 0x55a2582771b0 2024-05-14T15:30:02.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.670+0000 7feffb400640 1 --2- 172.21.15.69:0/2197573810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a258235d80 0x55a25861cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:30:02.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.674+0000 7feffbe00640 1 --2- 172.21.15.69:0/2197573810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582771b0 0x55a25862e7b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feffc112dd0 tx=0x7fefe8014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49da0317e89e932 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:02.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.675+0000 7fefe7400640 1 -- 172.21.15.69:0/2197573810 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe8028470 con 0x55a2582771b0 2024-05-14T15:30:02.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.675+0000 7fefe7400640 1 -- 172.21.15.69:0/2197573810 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fefe8023070 con 0x55a2582771b0 2024-05-14T15:30:02.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.675+0000 7fefe7400640 1 -- 172.21.15.69:0/2197573810 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe801f7e0 con 0x55a2582771b0 2024-05-14T15:30:02.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.676+0000 7ff00921b740 1 -- 172.21.15.69:0/2197573810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582771b0 msgr2=0x55a25862e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:02.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.676+0000 7ff00921b740 1 --2- 172.21.15.69:0/2197573810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582771b0 0x55a25862e7b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7feffc112dd0 tx=0x7fefe8014000 comp rx=0 tx=0).stop 2024-05-14T15:30:02.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.677+0000 7ff00921b740 1 -- 172.21.15.69:0/2197573810 shutdown_connections 2024-05-14T15:30:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.677+0000 7ff00921b740 1 --2- 172.21.15.69:0/2197573810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582771b0 0x55a25862e7b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.677+0000 7ff00921b740 1 --2- 172.21.15.69:0/2197573810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a25824e2f0 0x55a2586247c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.677+0000 7ff00921b740 1 --2- 172.21.15.69:0/2197573810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a258235d80 0x55a25861cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.677+0000 7ff00921b740 1 -- 172.21.15.69:0/2197573810 >> 172.21.15.69:0/2197573810 conn(0x55a25826b300 msgr2=0x55a258618a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:02.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.677+0000 7ff00921b740 1 -- 172.21.15.69:0/2197573810 shutdown_connections 2024-05-14T15:30:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.677+0000 7ff00921b740 1 -- 172.21.15.69:0/2197573810 wait complete. 2024-05-14T15:30:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.678+0000 7ff00921b740 1 -- start start 2024-05-14T15:30:02.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.678+0000 7ff00921b740 1 Processor -- start 2024-05-14T15:30:02.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.680+0000 7ff00921b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a258235d80 0x55a258635780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.680+0000 7ff00921b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a25824e2f0 0x55a258635cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.681+0000 7ff00921b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582771b0 0x55a25869b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.681+0000 7feffb400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a258235d80 0x55a258635780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.682+0000 7ff00921b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7feffc1b91b0 con 0x55a25824e2f0 2024-05-14T15:30:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.682+0000 7ff00921b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7feffc1b8a20 con 0x55a2582771b0 2024-05-14T15:30:02.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.682+0000 7ff00921b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7feffc1b5c40 con 0x55a258235d80 2024-05-14T15:30:02.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.682+0000 7ff00921b740 10 client.0 _ll_register_callbacks cb 0x7fefec009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:30:02.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.683+0000 7feffb400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a258235d80 0x55a258635780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:52146/0 (socket says 172.21.15.69:52146) 2024-05-14T15:30:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.683+0000 7feffbe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582771b0 0x55a25869b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.683+0000 7feffbe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582771b0 0x55a25869b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:53462/0 (socket says 172.21.15.69:53462) 2024-05-14T15:30:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.683+0000 7feffbe00640 1 -- 172.21.15.69:0/1693906777 learned_addr learned my addr 172.21.15.69:0/1693906777 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:02.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.683+0000 7feffaa00640 1 --2- 172.21.15.69:0/1693906777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a25824e2f0 0x55a258635cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:02.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.684+0000 7feffbe00640 1 -- 172.21.15.69:0/1693906777 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a258235d80 msgr2=0x55a258635780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:02.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.685+0000 7feffbe00640 1 --2- 172.21.15.69:0/1693906777 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a258235d80 0x55a258635780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.685+0000 7feffbe00640 1 -- 172.21.15.69:0/1693906777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a25824e2f0 msgr2=0x55a258635cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.685+0000 7feffbe00640 1 --2- 172.21.15.69:0/1693906777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a25824e2f0 0x55a258635cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.685+0000 7feffbe00640 1 -- 172.21.15.69:0/1693906777 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a258636560 con 0x55a2582771b0 2024-05-14T15:30:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.685+0000 7feffb400640 1 --2- 172.21.15.69:0/1693906777 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a258235d80 0x55a258635780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:30:02.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.686+0000 7feffaa00640 1 --2- 172.21.15.69:0/1693906777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a25824e2f0 0x55a258635cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:30:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.686+0000 7feffbe00640 1 --2- 172.21.15.69:0/1693906777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582771b0 0x55a25869b8e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009960 tx=0x7fefe8028b90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bae2dd949cfa18f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.687+0000 7fefe4c00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:30:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.687+0000 7fefe4c00640 1 -- 172.21.15.69:0/1693906777 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefe80119f0 con 0x55a2582771b0 2024-05-14T15:30:02.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.687+0000 7fefe4c00640 1 -- 172.21.15.69:0/1693906777 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(97..97 src has 1..97) ==== 9642+0+0 (secure 0 0 0) 0x7fefe8004020 con 0x55a2582771b0 2024-05-14T15:30:02.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.687+0000 7ff00921b740 1 -- 172.21.15.69:0/1693906777 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefe8023070 con 0x55a2582771b0 2024-05-14T15:30:02.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.688+0000 7fefe4c00640 1 -- 172.21.15.69:0/1693906777 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fefe803d050 con 0x55a2582771b0 2024-05-14T15:30:02.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.688+0000 7ff00921b740 10 client.36362 fetch_fsmap learned FSMap version 59 2024-05-14T15:30:02.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.688+0000 7ff00921b740 1 -- 172.21.15.69:0/1693906777 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x55a25869ce80 con 0x55a2582771b0 2024-05-14T15:30:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.689+0000 7fefe4c00640 1 -- 172.21.15.69:0/1693906777 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fefe8004220 con 0x55a2582771b0 2024-05-14T15:30:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.689+0000 7fefe4c00640 1 -- 172.21.15.69:0/1693906777 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 59) ==== 8378+0+0 (secure 0 0 0) 0x7fefe8031030 con 0x55a2582771b0 2024-05-14T15:30:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.689+0000 7ff00921b740 10 client.36362 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T15:30:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.689+0000 7ff00921b740 10 client.36362 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:30:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.689+0000 7ff00921b740 20 client.36362 populate_metadata read hostname 'smithi069' 2024-05-14T15:30:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.689+0000 7ff00921b740 1 --2- 172.21.15.69:0/1693906777 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a25869d5a0 0x55a25869f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.689+0000 7ff00921b740 4 client.36362 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:30:02.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.689+0000 7ff00921b740 1 -- 172.21.15.69:0/1693906777 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7fefe8023070 con 0x55a25869d5a0 2024-05-14T15:30:02.692 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.689+0000 7feffb400640 1 --2- 172.21.15.69:0/1693906777 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a25869d5a0 0x55a25869f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.691+0000 7feffb400640 1 --2- 172.21.15.69:0/1693906777 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a25869d5a0 0x55a25869f9c0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cab949e8ea64f8c9 server_cookie=c45282657896fbb5 in_seq=0 out_seq=0 2024-05-14T15:30:02.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.692+0000 7fefe4c00640 10 client.36362 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:02.789 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.787+0000 7fefe4c00640 1 -- 172.21.15.69:0/1693906777 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7fefe8023070 con 0x55a25869d5a0 2024-05-14T15:30:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.787+0000 7fefe4c00640 10 client.36362 handle_command_reply: tid=0 2024-05-14T15:30:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.787+0000 7ff00921b740 1 client.36362 shutdown 2024-05-14T15:30:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.787+0000 7ff00921b740 1 -- 172.21.15.69:0/1693906777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582771b0 msgr2=0x55a25869b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.787+0000 7ff00921b740 1 --2- 172.21.15.69:0/1693906777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582771b0 0x55a25869b8e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fefe8009960 tx=0x7fefe8028b90 comp rx=0 tx=0).stop 2024-05-14T15:30:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.787+0000 7ff00921b740 1 -- 172.21.15.69:0/1693906777 shutdown_connections 2024-05-14T15:30:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.787+0000 7ff00921b740 1 --2- 172.21.15.69:0/1693906777 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a2582771b0 0x55a25869b8e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.787+0000 7ff00921b740 1 --2- 172.21.15.69:0/1693906777 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a25869d5a0 0x55a25869f9c0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.787+0000 7ff00921b740 1 --2- 172.21.15.69:0/1693906777 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a25824e2f0 0x55a258635cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.787+0000 7ff00921b740 1 --2- 172.21.15.69:0/1693906777 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a258235d80 0x55a258635780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.787+0000 7ff00921b740 1 -- 172.21.15.69:0/1693906777 >> 172.21.15.69:0/1693906777 conn(0x55a25826b300 msgr2=0x55a258618a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.788+0000 7fefe4c00640 0 client.36362 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:02.790 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.788+0000 7ff00921b740 1 -- 172.21.15.69:0/1693906777 shutdown_connections 2024-05-14T15:30:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.788+0000 7ff00921b740 1 -- 172.21.15.69:0/1693906777 wait complete. 2024-05-14T15:30:02.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.788+0000 7ff00921b740 20 client.36362 trim_cache size 0 max 16384 2024-05-14T15:30:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:30:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:30:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:30:02.793 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:30:02.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.794+0000 7ff002200640 1 -- 172.21.15.69:0/3108830829 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fefe00b2a20 msgr2=0x7fefe00b4f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:02.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.794+0000 7ff002200640 1 --2- 172.21.15.69:0/3108830829 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fefe00b2a20 0x7fefe00b4f30 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x55a2586153f0 tx=0x7fefe80046c0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.794+0000 7ff002200640 1 -- 172.21.15.69:0/3108830829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feffc10a4a0 msgr2=0x7feffc1a2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.794+0000 7ff002200640 1 --2- 172.21.15.69:0/3108830829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feffc10a4a0 0x7feffc1a2fa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7feff400eab0 tx=0x7feff400ef70 comp rx=0 tx=0).stop 2024-05-14T15:30:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.794+0000 7ff002200640 1 -- 172.21.15.69:0/3108830829 shutdown_connections 2024-05-14T15:30:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.794+0000 7ff002200640 1 --2- 172.21.15.69:0/3108830829 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fefe00b2a20 0x7fefe00b4f30 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.794+0000 7ff002200640 1 --2- 172.21.15.69:0/3108830829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7feffc112910 0x7feffc1a77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.794+0000 7ff002200640 1 --2- 172.21.15.69:0/3108830829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7feffc111df0 0x7feffc1a3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.794+0000 7ff002200640 1 --2- 172.21.15.69:0/3108830829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7feffc10a4a0 0x7feffc1a2fa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:02.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.794+0000 7ff002200640 1 -- 172.21.15.69:0/3108830829 >> 172.21.15.69:0/3108830829 conn(0x7feffc06e900 msgr2=0x7feffc073b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.794+0000 7ff002200640 1 -- 172.21.15.69:0/3108830829 shutdown_connections 2024-05-14T15:30:02.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:02.795+0000 7ff002200640 1 -- 172.21.15.69:0/3108830829 wait complete. 2024-05-14T15:30:03.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:03 smithi203 ceph-mon[34567]: pgmap v259: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 6.5 MiB/s wr, 636 op/s 2024-05-14T15:30:03.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:03 smithi203 ceph-mon[34567]: osdmap e97: 12 total, 12 up, 12 in 2024-05-14T15:30:03.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:03 smithi092 ceph-mon[34729]: pgmap v259: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 6.5 MiB/s wr, 636 op/s 2024-05-14T15:30:03.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:03 smithi092 ceph-mon[34729]: osdmap e97: 12 total, 12 up, 12 in 2024-05-14T15:30:03.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:03 smithi069 ceph-mon[31270]: pgmap v259: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 6.5 MiB/s wr, 636 op/s 2024-05-14T15:30:03.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:03 smithi069 ceph-mon[31270]: osdmap e97: 12 total, 12 up, 12 in 2024-05-14T15:30:05.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:05 smithi203 ceph-mon[34567]: pgmap v261: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 7.4 MiB/s wr, 722 op/s 2024-05-14T15:30:05.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:05 smithi092 ceph-mon[34729]: pgmap v261: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 7.4 MiB/s wr, 722 op/s 2024-05-14T15:30:05.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:05 smithi069 ceph-mon[31270]: pgmap v261: 129 pgs: 129 active+clean; 2.7 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 7.4 MiB/s wr, 722 op/s 2024-05-14T15:30:06.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 260.0 s, 589.2 tps, lat 171.000 ms stddev 93.249 2024-05-14T15:30:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:07 smithi203 ceph-mon[34567]: pgmap v262: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 7.2 MiB/s wr, 717 op/s 2024-05-14T15:30:07.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:07 smithi092 ceph-mon[34729]: pgmap v262: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 7.2 MiB/s wr, 717 op/s 2024-05-14T15:30:07.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:07 smithi069 ceph-mon[31270]: pgmap v262: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 7.2 MiB/s wr, 717 op/s 2024-05-14T15:30:09.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:09 smithi203 ceph-mon[34567]: pgmap v263: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 7.2 MiB/s wr, 717 op/s 2024-05-14T15:30:09.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:09 smithi092 ceph-mon[34729]: pgmap v263: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 7.2 MiB/s wr, 717 op/s 2024-05-14T15:30:09.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:09 smithi069 ceph-mon[31270]: pgmap v263: 129 pgs: 129 active+clean; 2.6 GiB data, 11 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 7.2 MiB/s wr, 717 op/s 2024-05-14T15:30:10.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:10 smithi069 ceph-mon[31270]: osdmap e98: 12 total, 12 up, 12 in 2024-05-14T15:30:10.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:10 smithi069 ceph-mon[31270]: pgmap v265: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.9 MiB/s wr, 861 op/s 2024-05-14T15:30:11.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:10 smithi203 ceph-mon[34567]: osdmap e98: 12 total, 12 up, 12 in 2024-05-14T15:30:11.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:10 smithi203 ceph-mon[34567]: pgmap v265: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.9 MiB/s wr, 861 op/s 2024-05-14T15:30:11.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:10 smithi092 ceph-mon[34729]: osdmap e98: 12 total, 12 up, 12 in 2024-05-14T15:30:11.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:10 smithi092 ceph-mon[34729]: pgmap v265: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.9 MiB/s wr, 861 op/s 2024-05-14T15:30:11.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 265.0 s, 686.9 tps, lat 145.863 ms stddev 42.854 2024-05-14T15:30:13.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:13 smithi092 ceph-mon[34729]: pgmap v266: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 7.2 MiB/s wr, 700 op/s 2024-05-14T15:30:13.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:13 smithi069 ceph-mon[31270]: pgmap v266: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 7.2 MiB/s wr, 700 op/s 2024-05-14T15:30:13.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:13 smithi203 ceph-mon[34567]: pgmap v266: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 7.2 MiB/s wr, 700 op/s 2024-05-14T15:30:14.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:14 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:30:14.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:14 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:30:14.523 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:14 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:30:15.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:15 smithi092 ceph-mon[34729]: pgmap v267: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.9 MiB/s wr, 647 op/s 2024-05-14T15:30:15.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:15 smithi069 ceph-mon[31270]: pgmap v267: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.9 MiB/s wr, 647 op/s 2024-05-14T15:30:15.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:15 smithi203 ceph-mon[34567]: pgmap v267: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.9 MiB/s wr, 647 op/s 2024-05-14T15:30:16.197 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.195+0000 7fe546400640 1 -- 172.21.15.69:0/1056662726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe540110bb0 msgr2=0x7fe54010a150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:16.197 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.195+0000 7fe546400640 1 --2- 172.21.15.69:0/1056662726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe540110bb0 0x7fe54010a150 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fe528009900 tx=0x7fe52802a510 comp rx=0 tx=0).stop 2024-05-14T15:30:16.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.197+0000 7fe546400640 1 -- 172.21.15.69:0/1056662726 shutdown_connections 2024-05-14T15:30:16.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.197+0000 7fe546400640 1 --2- 172.21.15.69:0/1056662726 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe540111e40 0x7fe54010a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.197+0000 7fe546400640 1 --2- 172.21.15.69:0/1056662726 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5401114f0 0x7fe540111900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.197+0000 7fe546400640 1 --2- 172.21.15.69:0/1056662726 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe540110bb0 0x7fe54010a150 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.197+0000 7fe546400640 1 -- 172.21.15.69:0/1056662726 >> 172.21.15.69:0/1056662726 conn(0x7fe54006edb0 msgr2=0x7fe54006f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:16.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.198+0000 7fe546400640 1 -- 172.21.15.69:0/1056662726 shutdown_connections 2024-05-14T15:30:16.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.199+0000 7fe546400640 1 -- 172.21.15.69:0/1056662726 wait complete. 2024-05-14T15:30:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.201+0000 7fe546400640 1 Processor -- start 2024-05-14T15:30:16.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.202+0000 7fe546400640 1 -- start start 2024-05-14T15:30:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.203+0000 7fe546400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe540110bb0 0x7fe540117e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.203+0000 7fe546400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5401114f0 0x7fe5401183e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.203+0000 7fe546400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe540111e40 0x7fe5401b51d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.203+0000 7fe546400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe540116360 con 0x7fe5401114f0 2024-05-14T15:30:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.204+0000 7fe546400640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5401161e0 con 0x7fe540110bb0 2024-05-14T15:30:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.204+0000 7fe53f400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe540110bb0 0x7fe540117e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.204+0000 7fe53fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe540111e40 0x7fe5401b51d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.204+0000 7fe53f400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe540110bb0 0x7fe540117e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:54112/0 (socket says 172.21.15.69:54112) 2024-05-14T15:30:16.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.204+0000 7fe53f400640 1 -- 172.21.15.69:0/2044914682 learned_addr learned my addr 172.21.15.69:0/2044914682 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:16.206 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.204+0000 7fe546400640 1 -- 172.21.15.69:0/2044914682 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe5401164e0 con 0x7fe540111e40 2024-05-14T15:30:16.206 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.204+0000 7fe53ea00640 1 --2- 172.21.15.69:0/2044914682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5401114f0 0x7fe5401183e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.206+0000 7fe53f400640 1 -- 172.21.15.69:0/2044914682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe540111e40 msgr2=0x7fe5401b51d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.206+0000 7fe53f400640 1 --2- 172.21.15.69:0/2044914682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe540111e40 0x7fe5401b51d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.206+0000 7fe53f400640 1 -- 172.21.15.69:0/2044914682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5401114f0 msgr2=0x7fe5401183e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.206+0000 7fe53f400640 1 --2- 172.21.15.69:0/2044914682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5401114f0 0x7fe5401183e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.206+0000 7fe53f400640 1 -- 172.21.15.69:0/2044914682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5401b5810 con 0x7fe540110bb0 2024-05-14T15:30:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.206+0000 7fe53fe00640 1 --2- 172.21.15.69:0/2044914682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe540111e40 0x7fe5401b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:30:16.208 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.206+0000 7fe53ea00640 1 --2- 172.21.15.69:0/2044914682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5401114f0 0x7fe5401183e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:30:16.209 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.207+0000 7fe53f400640 1 --2- 172.21.15.69:0/2044914682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe540110bb0 0x7fe540117e80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe52802aa30 tx=0x7fe528003d60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.208+0000 7fe537e00640 1 -- 172.21.15.69:0/2044914682 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe52803f070 con 0x7fe540110bb0 2024-05-14T15:30:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.208+0000 7fe537e00640 1 -- 172.21.15.69:0/2044914682 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe52803bdc0 con 0x7fe540110bb0 2024-05-14T15:30:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.208+0000 7fe537e00640 1 -- 172.21.15.69:0/2044914682 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe528035030 con 0x7fe540110bb0 2024-05-14T15:30:16.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.209+0000 7fe546400640 1 -- 172.21.15.69:0/2044914682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5401b5aa0 con 0x7fe540110bb0 2024-05-14T15:30:16.211 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.209+0000 7fe546400640 1 -- 172.21.15.69:0/2044914682 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5401b5f40 con 0x7fe540110bb0 2024-05-14T15:30:16.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.218+0000 7fe537e00640 1 -- 172.21.15.69:0/2044914682 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe528042070 con 0x7fe540110bb0 2024-05-14T15:30:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.219+0000 7fe54d3a3740 1 Processor -- start 2024-05-14T15:30:16.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.220+0000 7fe54d3a3740 1 -- start start 2024-05-14T15:30:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.222+0000 7fe54d3a3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e622d1b0 0x5630e65ce280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.222+0000 7fe54d3a3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 0x5630e65ce7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.222+0000 7fe54d3a3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e620c4d0 0x5630e65ced00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.222+0000 7fe54d3a3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5630e6533550 con 0x5630e620c4d0 2024-05-14T15:30:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.222+0000 7fe54d3a3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5630e64d8bc0 con 0x5630e622d1b0 2024-05-14T15:30:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.222+0000 7fe54d3a3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5630e652f510 con 0x5630e62042f0 2024-05-14T15:30:16.224 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.223+0000 7fe53fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e622d1b0 0x5630e65ce280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.223+0000 7fe53fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e622d1b0 0x5630e65ce280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:54120/0 (socket says 172.21.15.69:54120) 2024-05-14T15:30:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.223+0000 7fe53fe00640 1 -- 172.21.15.69:0/1392527943 learned_addr learned my addr 172.21.15.69:0/1392527943 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.224+0000 7fe53ea00640 1 --2- 172.21.15.69:0/1392527943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e620c4d0 0x5630e65ced00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.224+0000 7fe53fe00640 1 -- 172.21.15.69:0/1392527943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 msgr2=0x5630e65ce7c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:30:16.225 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.224+0000 7fe53fe00640 1 --2- 172.21.15.69:0/1392527943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 0x5630e65ce7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.224+0000 7fe53fe00640 1 -- 172.21.15.69:0/1392527943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e620c4d0 msgr2=0x5630e65ced00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:16.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.224+0000 7fe53fe00640 1 --2- 172.21.15.69:0/1392527943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e620c4d0 0x5630e65ced00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.224+0000 7fe53fe00640 1 -- 172.21.15.69:0/1392527943 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e6245210 con 0x5630e622d1b0 2024-05-14T15:30:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.225+0000 7fe537e00640 1 --2- 172.21.15.69:0/2044914682 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe5240b2b20 0x7fe5240b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.225+0000 7fe537e00640 1 -- 172.21.15.69:0/2044914682 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9554+0+0 (secure 0 0 0) 0x7fe528103340 con 0x7fe540110bb0 2024-05-14T15:30:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.225+0000 7fe53fe00640 1 --2- 172.21.15.69:0/1392527943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e622d1b0 0x5630e65ce280 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe538009de0 tx=0x7fe53800e5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16c957249dcb3713 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:16.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.226+0000 7fe53f400640 1 --2- 172.21.15.69:0/2044914682 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe5240b2b20 0x7fe5240b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.226+0000 7fe534c00640 1 -- 172.21.15.69:0/1392527943 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538017070 con 0x5630e622d1b0 2024-05-14T15:30:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.226+0000 7fe534c00640 1 -- 172.21.15.69:0/1392527943 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe538013900 con 0x5630e622d1b0 2024-05-14T15:30:16.228 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.227+0000 7fe534c00640 1 -- 172.21.15.69:0/1392527943 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538017070 con 0x5630e622d1b0 2024-05-14T15:30:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.228+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1392527943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e622d1b0 msgr2=0x5630e65ce280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.228+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/1392527943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e622d1b0 0x5630e65ce280 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe538009de0 tx=0x7fe53800e5a0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.228+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1392527943 shutdown_connections 2024-05-14T15:30:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.228+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/1392527943 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e620c4d0 0x5630e65ced00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.228+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/1392527943 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 0x5630e65ce7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.228+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/1392527943 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e622d1b0 0x5630e65ce280 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.228+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1392527943 >> 172.21.15.69:0/1392527943 conn(0x5630e6221300 msgr2=0x5630e65caa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.228+0000 7fe53f400640 1 --2- 172.21.15.69:0/2044914682 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe5240b2b20 0x7fe5240b5030 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5630e65cbd70 tx=0x7fe528009260 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.228+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1392527943 shutdown_connections 2024-05-14T15:30:16.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.228+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1392527943 wait complete. 2024-05-14T15:30:16.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.229+0000 7fe54d3a3740 1 -- start start 2024-05-14T15:30:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.230+0000 7fe54d3a3740 1 Processor -- start 2024-05-14T15:30:16.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.232+0000 7fe54d3a3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e62042f0 0x5630e65d8490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.232+0000 7fe54d3a3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e620c4d0 0x5630e65d89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.233+0000 7fe53fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e62042f0 0x5630e65d8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.233+0000 7fe53fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e62042f0 0x5630e65d8490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:54136/0 (socket says 172.21.15.69:54136) 2024-05-14T15:30:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.233+0000 7fe53ea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e620c4d0 0x5630e65d89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.234+0000 7fe53ea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e620c4d0 0x5630e65d89d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:58056/0 (socket says 172.21.15.69:58056) 2024-05-14T15:30:16.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.234+0000 7fe53fe00640 1 -- 172.21.15.69:0/3799512543 learned_addr learned my addr 172.21.15.69:0/3799512543 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.234+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/3799512543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e622d1b0 0x5630e65e4900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.234+0000 7fe54d3a3740 1 -- 172.21.15.69:0/3799512543 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5630e65db450 con 0x5630e622d1b0 2024-05-14T15:30:16.236 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.235+0000 7fe54d3a3740 1 -- 172.21.15.69:0/3799512543 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5630e64ec660 con 0x5630e62042f0 2024-05-14T15:30:16.237 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.235+0000 7fe54d3a3740 1 -- 172.21.15.69:0/3799512543 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5630e65db5d0 con 0x5630e620c4d0 2024-05-14T15:30:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.236+0000 7fe54d3a3740 10 client.0 _ll_register_callbacks cb 0x5630e64b6400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:30:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.236+0000 7fe53ea00640 1 -- 172.21.15.69:0/3799512543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e62042f0 msgr2=0x5630e65d8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.236+0000 7fe53ea00640 1 --2- 172.21.15.69:0/3799512543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e62042f0 0x5630e65d8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.236+0000 7fe53fe00640 1 --2- 172.21.15.69:0/3799512543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e622d1b0 0x5630e65e4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.237+0000 7fe53ea00640 1 -- 172.21.15.69:0/3799512543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e622d1b0 msgr2=0x5630e65e4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.237+0000 7fe53ea00640 1 --2- 172.21.15.69:0/3799512543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e622d1b0 0x5630e65e4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.237+0000 7fe53ea00640 1 -- 172.21.15.69:0/3799512543 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630e6311620 con 0x5630e620c4d0 2024-05-14T15:30:16.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.237+0000 7fe53fe00640 1 --2- 172.21.15.69:0/3799512543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e622d1b0 0x5630e65e4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:30:16.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.239+0000 7fe53ea00640 1 --2- 172.21.15.69:0/3799512543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e620c4d0 0x5630e65d89d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe530005fd0 tx=0x7fe53000fec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6aa06a5be8cd8836 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:16.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.239+0000 7fe52d600640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:30:16.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.239+0000 7fe52d600640 1 -- 172.21.15.69:0/3799512543 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53000ddc0 con 0x5630e620c4d0 2024-05-14T15:30:16.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.240+0000 7fe52d600640 1 -- 172.21.15.69:0/3799512543 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9554+0+0 (secure 0 0 0) 0x7fe53001b480 con 0x5630e620c4d0 2024-05-14T15:30:16.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.241+0000 7fe54d3a3740 1 -- 172.21.15.69:0/3799512543 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe538013900 con 0x5630e620c4d0 2024-05-14T15:30:16.243 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.241+0000 7fe52d600640 1 -- 172.21.15.69:0/3799512543 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fe53001b680 con 0x5630e620c4d0 2024-05-14T15:30:16.243 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.242+0000 7fe54d3a3740 10 client.26341 fetch_fsmap learned FSMap version 59 2024-05-14T15:30:16.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.242+0000 7fe54d3a3740 1 -- 172.21.15.69:0/3799512543 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x5630e65e75f0 con 0x5630e620c4d0 2024-05-14T15:30:16.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.244+0000 7fe52d600640 1 -- 172.21.15.69:0/3799512543 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe538013900 con 0x5630e620c4d0 2024-05-14T15:30:16.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.244+0000 7fe52d600640 1 -- 172.21.15.69:0/3799512543 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 59) ==== 8378+0+0 (secure 0 0 0) 0x7fe530010870 con 0x5630e620c4d0 2024-05-14T15:30:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.244+0000 7fe54d3a3740 10 client.26341 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T15:30:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.244+0000 7fe54d3a3740 10 client.26341 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:30:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.244+0000 7fe54d3a3740 20 client.26341 populate_metadata read hostname 'smithi069' 2024-05-14T15:30:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.244+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/3799512543 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5630e61ebd80 0x5630e65eaab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.244+0000 7fe54d3a3740 4 client.26341 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:30:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.244+0000 7fe54d3a3740 1 -- 172.21.15.69:0/3799512543 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630e6541160 con 0x5630e61ebd80 2024-05-14T15:30:16.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.245+0000 7fe53fe00640 1 --2- 172.21.15.69:0/3799512543 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5630e61ebd80 0x5630e65eaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.248+0000 7fe52d600640 10 client.26341 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:16.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.248+0000 7fe53fe00640 1 --2- 172.21.15.69:0/3799512543 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5630e61ebd80 0x5630e65eaab0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb037a9356bdb628 server_cookie=18093328a7d71f29 in_seq=0 out_seq=0 2024-05-14T15:30:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.251+0000 7fe52d600640 1 -- 172.21.15.69:0/3799512543 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5630e6541160 con 0x5630e61ebd80 2024-05-14T15:30:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.252+0000 7fe52d600640 10 client.26341 handle_command_reply: tid=0 2024-05-14T15:30:16.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.252+0000 7fe54d3a3740 1 client.26341 shutdown 2024-05-14T15:30:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.253+0000 7fe54d3a3740 1 -- 172.21.15.69:0/3799512543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e620c4d0 msgr2=0x5630e65d89d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:16.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.253+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/3799512543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e620c4d0 0x5630e65d89d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fe530005fd0 tx=0x7fe53000fec0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.254+0000 7fe54d3a3740 1 -- 172.21.15.69:0/3799512543 shutdown_connections 2024-05-14T15:30:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.254+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/3799512543 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5630e61ebd80 0x5630e65eaab0 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.254+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/3799512543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e622d1b0 0x5630e65e4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.254+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/3799512543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e620c4d0 0x5630e65d89d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.254+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/3799512543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e62042f0 0x5630e65d8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.254+0000 7fe54d3a3740 1 -- 172.21.15.69:0/3799512543 >> 172.21.15.69:0/3799512543 conn(0x5630e6221300 msgr2=0x5630e65ce0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.254+0000 7fe52d600640 0 client.26341 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.254+0000 7fe54d3a3740 1 -- 172.21.15.69:0/3799512543 shutdown_connections 2024-05-14T15:30:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.254+0000 7fe54d3a3740 1 -- 172.21.15.69:0/3799512543 wait complete. 2024-05-14T15:30:16.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.255+0000 7fe54d3a3740 20 client.26341 trim_cache size 0 max 16384 2024-05-14T15:30:16.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.290+0000 7fe54d3a3740 1 Processor -- start 2024-05-14T15:30:16.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.290+0000 7fe54d3a3740 1 -- start start 2024-05-14T15:30:16.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.291+0000 7fe54d3a3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 0x5630e65c9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.291+0000 7fe54d3a3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e620c4d0 0x5630e65cf020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.291+0000 7fe54d3a3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e622d1b0 0x5630e65f02b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.291+0000 7fe54d3a3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe5401c0360 con 0x5630e622d1b0 2024-05-14T15:30:16.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.291+0000 7fe54d3a3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5401c1f60 con 0x5630e620c4d0 2024-05-14T15:30:16.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.291+0000 7fe54d3a3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe5401c0a30 con 0x5630e62042f0 2024-05-14T15:30:16.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.291+0000 7fe53fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 0x5630e65c9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.292+0000 7fe53fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 0x5630e65c9ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:58058/0 (socket says 172.21.15.69:58058) 2024-05-14T15:30:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.292+0000 7fe53fe00640 1 -- 172.21.15.69:0/1463578435 learned_addr learned my addr 172.21.15.69:0/1463578435 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.292+0000 7fe53fe00640 1 --2- 172.21.15.69:0/1463578435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e622d1b0 0x5630e65f02b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.292+0000 7fe53ea00640 1 --2- 172.21.15.69:0/1463578435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e620c4d0 0x5630e65cf020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.293+0000 7fe53fe00640 1 -- 172.21.15.69:0/1463578435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e620c4d0 msgr2=0x5630e65cf020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.293+0000 7fe53fe00640 1 --2- 172.21.15.69:0/1463578435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e620c4d0 0x5630e65cf020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.293+0000 7fe53fe00640 1 -- 172.21.15.69:0/1463578435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e622d1b0 msgr2=0x5630e65f02b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.293+0000 7fe53fe00640 1 --2- 172.21.15.69:0/1463578435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e622d1b0 0x5630e65f02b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.293+0000 7fe53fe00640 1 -- 172.21.15.69:0/1463578435 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e65c61e0 con 0x5630e62042f0 2024-05-14T15:30:16.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.293+0000 7fe53fe00640 1 --2- 172.21.15.69:0/1463578435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 0x5630e65c9ad0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe538009b70 tx=0x7fe53801e040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb181666c870b069 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:16.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.294+0000 7fe52fe00640 1 -- 172.21.15.69:0/1463578435 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538017040 con 0x5630e62042f0 2024-05-14T15:30:16.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.294+0000 7fe52fe00640 1 -- 172.21.15.69:0/1463578435 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5380268d0 con 0x5630e62042f0 2024-05-14T15:30:16.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.294+0000 7fe52fe00640 1 -- 172.21.15.69:0/1463578435 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5380127b0 con 0x5630e62042f0 2024-05-14T15:30:16.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.295+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1463578435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 msgr2=0x5630e65c9ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:16.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.295+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/1463578435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 0x5630e65c9ad0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fe538009b70 tx=0x7fe53801e040 comp rx=0 tx=0).stop 2024-05-14T15:30:16.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.295+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1463578435 shutdown_connections 2024-05-14T15:30:16.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.295+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/1463578435 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e622d1b0 0x5630e65f02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.295+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/1463578435 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e620c4d0 0x5630e65cf020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.295+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/1463578435 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 0x5630e65c9ad0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.295+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1463578435 >> 172.21.15.69:0/1463578435 conn(0x5630e6221300 msgr2=0x5630e65d8750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:16.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.296+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1463578435 shutdown_connections 2024-05-14T15:30:16.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.296+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1463578435 wait complete. 2024-05-14T15:30:16.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.297+0000 7fe54d3a3740 1 -- start start 2024-05-14T15:30:16.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.297+0000 7fe54d3a3740 1 Processor -- start 2024-05-14T15:30:16.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.297+0000 7fe54d3a3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 0x5630e65e0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.297+0000 7fe54d3a3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e620c4d0 0x5630e65dbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.298+0000 7fe54d3a3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e622d1b0 0x5630e65dc4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.298+0000 7fe54d3a3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe5401c1890 con 0x5630e620c4d0 2024-05-14T15:30:16.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.298+0000 7fe54d3a3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5401c1100 con 0x5630e622d1b0 2024-05-14T15:30:16.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.298+0000 7fe54d3a3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe5401be360 con 0x5630e62042f0 2024-05-14T15:30:16.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.298+0000 7fe54d3a3740 10 client.0 _ll_register_callbacks cb 0x7fe5300085f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:30:16.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.298+0000 7fe53ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e620c4d0 0x5630e65dbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.298+0000 7fe53ea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e620c4d0 0x5630e65dbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:49640/0 (socket says 172.21.15.69:49640) 2024-05-14T15:30:16.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.298+0000 7fe53ea00640 1 -- 172.21.15.69:0/1436798695 learned_addr learned my addr 172.21.15.69:0/1436798695 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:16.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.298+0000 7fe53fe00640 1 --2- 172.21.15.69:0/1436798695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 0x5630e65e0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.298+0000 7fe53fe00640 1 --2- 172.21.15.69:0/1436798695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e622d1b0 0x5630e65dc4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.299+0000 7fe53fe00640 1 -- 172.21.15.69:0/1436798695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e622d1b0 msgr2=0x5630e65dc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.299+0000 7fe53fe00640 1 --2- 172.21.15.69:0/1436798695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e622d1b0 0x5630e65dc4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.299+0000 7fe53fe00640 1 -- 172.21.15.69:0/1436798695 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e620c4d0 msgr2=0x5630e65dbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.299+0000 7fe53fe00640 1 --2- 172.21.15.69:0/1436798695 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e620c4d0 0x5630e65dbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.299+0000 7fe53fe00640 1 -- 172.21.15.69:0/1436798695 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630e65dc9e0 con 0x5630e62042f0 2024-05-14T15:30:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.299+0000 7fe53ea00640 1 --2- 172.21.15.69:0/1436798695 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e620c4d0 0x5630e65dbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:30:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.299+0000 7fe53fe00640 1 --2- 172.21.15.69:0/1436798695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 0x5630e65e0bc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe53800b010 tx=0x7fe5380090e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=63a287daf88204c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:16.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.299+0000 7fe52d600640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:30:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.300+0000 7fe52d600640 1 -- 172.21.15.69:0/1436798695 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe538037060 con 0x5630e62042f0 2024-05-14T15:30:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.300+0000 7fe52d600640 1 -- 172.21.15.69:0/1436798695 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9554+0+0 (secure 0 0 0) 0x7fe538005bc0 con 0x5630e62042f0 2024-05-14T15:30:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.300+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1436798695 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5380268d0 con 0x5630e62042f0 2024-05-14T15:30:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.301+0000 7fe52d600640 1 -- 172.21.15.69:0/1436798695 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=59) ==== 24+0+0 (secure 0 0 0) 0x7fe538017040 con 0x5630e62042f0 2024-05-14T15:30:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.301+0000 7fe54d3a3740 10 client.26347 fetch_fsmap learned FSMap version 59 2024-05-14T15:30:16.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.301+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1436798695 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=59,monmap=4+}) -- 0x5630e6652b30 con 0x5630e62042f0 2024-05-14T15:30:16.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.302+0000 7fe52d600640 1 -- 172.21.15.69:0/1436798695 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5380268d0 con 0x5630e62042f0 2024-05-14T15:30:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.302+0000 7fe52d600640 1 -- 172.21.15.69:0/1436798695 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 59) ==== 8378+0+0 (secure 0 0 0) 0x7fe5380137e0 con 0x5630e62042f0 2024-05-14T15:30:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.302+0000 7fe54d3a3740 10 client.26347 fetch_fsmap finished waiting for FSMap version 59 2024-05-14T15:30:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.302+0000 7fe54d3a3740 10 client.26347 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:30:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.302+0000 7fe54d3a3740 20 client.26347 populate_metadata read hostname 'smithi069' 2024-05-14T15:30:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.302+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/1436798695 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5630e61c11c0 0x5630e6654db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.302+0000 7fe54d3a3740 4 client.26347 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:30:16.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.302+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1436798695 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5630e653afd0 con 0x5630e61c11c0 2024-05-14T15:30:16.305 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.304+0000 7fe53ea00640 1 --2- 172.21.15.69:0/1436798695 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5630e61c11c0 0x5630e6654db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:16.306 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.305+0000 7fe52d600640 10 client.26347 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:16.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.307+0000 7fe53ea00640 1 --2- 172.21.15.69:0/1436798695 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5630e61c11c0 0x5630e6654db0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13775fdcb6902281 server_cookie=43002426f08b71f3 in_seq=0 out_seq=0 2024-05-14T15:30:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.349+0000 7fe52d600640 1 -- 172.21.15.69:0/1436798695 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5630e653afd0 con 0x5630e61c11c0 2024-05-14T15:30:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.349+0000 7fe52d600640 10 client.26347 handle_command_reply: tid=0 2024-05-14T15:30:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.349+0000 7fe54d3a3740 1 client.26347 shutdown 2024-05-14T15:30:16.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.350+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1436798695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 msgr2=0x5630e65e0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.350+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/1436798695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 0x5630e65e0bc0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe53800b010 tx=0x7fe5380090e0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.351+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1436798695 shutdown_connections 2024-05-14T15:30:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.351+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/1436798695 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5630e622d1b0 0x5630e65dc4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.351+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/1436798695 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5630e61c11c0 0x5630e6654db0 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.351+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/1436798695 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5630e620c4d0 0x5630e65dbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.351+0000 7fe54d3a3740 1 --2- 172.21.15.69:0/1436798695 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5630e62042f0 0x5630e65e0bc0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.351+0000 7fe52d600640 0 client.26347 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.351+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1436798695 >> 172.21.15.69:0/1436798695 conn(0x5630e6221300 msgr2=0x5630e65d2900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.351+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1436798695 shutdown_connections 2024-05-14T15:30:16.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.352+0000 7fe54d3a3740 1 -- 172.21.15.69:0/1436798695 wait complete. 2024-05-14T15:30:16.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.353+0000 7fe54d3a3740 20 client.26347 trim_cache size 0 max 16384 2024-05-14T15:30:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:30:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:30:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:30:16.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:30:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.355+0000 7fe546400640 1 -- 172.21.15.69:0/2044914682 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe5240b2b20 msgr2=0x7fe5240b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.355+0000 7fe546400640 1 --2- 172.21.15.69:0/2044914682 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe5240b2b20 0x7fe5240b5030 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x5630e65cbd70 tx=0x7fe528009260 comp rx=0 tx=0).stop 2024-05-14T15:30:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.355+0000 7fe546400640 1 -- 172.21.15.69:0/2044914682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe540110bb0 msgr2=0x7fe540117e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.355+0000 7fe546400640 1 --2- 172.21.15.69:0/2044914682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe540110bb0 0x7fe540117e80 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fe52802aa30 tx=0x7fe528003d60 comp rx=0 tx=0).stop 2024-05-14T15:30:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.355+0000 7fe546400640 1 -- 172.21.15.69:0/2044914682 shutdown_connections 2024-05-14T15:30:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.355+0000 7fe546400640 1 --2- 172.21.15.69:0/2044914682 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe5240b2b20 0x7fe5240b5030 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.355+0000 7fe546400640 1 --2- 172.21.15.69:0/2044914682 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe540111e40 0x7fe5401b51d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.355+0000 7fe546400640 1 --2- 172.21.15.69:0/2044914682 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe5401114f0 0x7fe5401183e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.355+0000 7fe546400640 1 --2- 172.21.15.69:0/2044914682 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe540110bb0 0x7fe540117e80 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:16.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.355+0000 7fe546400640 1 -- 172.21.15.69:0/2044914682 >> 172.21.15.69:0/2044914682 conn(0x7fe54006edb0 msgr2=0x7fe54010e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.356+0000 7fe546400640 1 -- 172.21.15.69:0/2044914682 shutdown_connections 2024-05-14T15:30:16.358 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:16.356+0000 7fe546400640 1 -- 172.21.15.69:0/2044914682 wait complete. 2024-05-14T15:30:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 270.0 s, 608.6 tps, lat 163.515 ms stddev 46.268 2024-05-14T15:30:16.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:16 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:30:16.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:16 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:30:16.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:16 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:30:16.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:16 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:30:16.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:16 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:30:16.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:16 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:30:16.597 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:16 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:30:16.598 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:16 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:30:16.598 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:16 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:30:17.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:17 smithi092 ceph-mon[34729]: pgmap v268: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.1 MiB/s wr, 691 op/s 2024-05-14T15:30:17.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:17 smithi069 ceph-mon[31270]: pgmap v268: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.1 MiB/s wr, 691 op/s 2024-05-14T15:30:17.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:17 smithi203 ceph-mon[34567]: pgmap v268: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.1 MiB/s wr, 691 op/s 2024-05-14T15:30:19.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:19 smithi069 ceph-mon[31270]: pgmap v269: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.1 MiB/s wr, 691 op/s 2024-05-14T15:30:19.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:19 smithi203 ceph-mon[34567]: pgmap v269: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.1 MiB/s wr, 691 op/s 2024-05-14T15:30:19.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:19 smithi092 ceph-mon[34729]: pgmap v269: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 7.1 MiB/s wr, 691 op/s 2024-05-14T15:30:21.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 275.0 s, 650.4 tps, lat 153.587 ms stddev 42.504 2024-05-14T15:30:21.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:21 smithi069 ceph-mon[31270]: pgmap v270: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.3 MiB/s wr, 641 op/s 2024-05-14T15:30:21.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:21 smithi203 ceph-mon[34567]: pgmap v270: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.3 MiB/s wr, 641 op/s 2024-05-14T15:30:21.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:21 smithi092 ceph-mon[34729]: pgmap v270: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.3 MiB/s wr, 641 op/s 2024-05-14T15:30:23.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:23 smithi069 ceph-mon[31270]: pgmap v271: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.5 MiB/s wr, 555 op/s 2024-05-14T15:30:23.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:23 smithi203 ceph-mon[34567]: pgmap v271: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.5 MiB/s wr, 555 op/s 2024-05-14T15:30:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:23 smithi092 ceph-mon[34729]: pgmap v271: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 5.5 MiB/s wr, 555 op/s 2024-05-14T15:30:25.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:25 smithi203 ceph-mon[34567]: pgmap v272: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.1 MiB/s wr, 723 op/s 2024-05-14T15:30:25.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:25 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:30:25.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:25 smithi092 ceph-mon[34729]: pgmap v272: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.1 MiB/s wr, 723 op/s 2024-05-14T15:30:25.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:25 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:30:25.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:25 smithi069 ceph-mon[31270]: pgmap v272: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.1 MiB/s wr, 723 op/s 2024-05-14T15:30:25.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:25 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:30:26.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 280.0 s, 630.0 tps, lat 158.563 ms stddev 41.220 2024-05-14T15:30:27.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:27 smithi203 ceph-mon[34567]: pgmap v273: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.1 MiB/s wr, 688 op/s 2024-05-14T15:30:27.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:27 smithi092 ceph-mon[34729]: pgmap v273: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.1 MiB/s wr, 688 op/s 2024-05-14T15:30:27.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:27 smithi069 ceph-mon[31270]: pgmap v273: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 7.1 MiB/s wr, 688 op/s 2024-05-14T15:30:29.528 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:29 smithi069 ceph-mon[31270]: pgmap v274: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.4 MiB/s wr, 551 op/s 2024-05-14T15:30:29.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:29 smithi203 ceph-mon[34567]: pgmap v274: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.4 MiB/s wr, 551 op/s 2024-05-14T15:30:29.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:29 smithi092 ceph-mon[34729]: pgmap v274: 129 pgs: 129 active+clean; 2.7 GiB data, 12 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.4 MiB/s wr, 551 op/s 2024-05-14T15:30:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.714+0000 7f4e7a200640 1 -- 172.21.15.69:0/2806962387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e7410a530 msgr2=0x7f4e7410a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:29.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.714+0000 7f4e7a200640 1 --2- 172.21.15.69:0/2806962387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e7410a530 0x7f4e7410a940 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c009ca0 tx=0x7f4e6c02a8c0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.715+0000 7f4e7a200640 1 -- 172.21.15.69:0/2806962387 shutdown_connections 2024-05-14T15:30:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.715+0000 7f4e7a200640 1 --2- 172.21.15.69:0/2806962387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e7410f580 0x7f4e74116d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.715+0000 7f4e7a200640 1 --2- 172.21.15.69:0/2806962387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e7410eac0 0x7f4e7410eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.715+0000 7f4e7a200640 1 --2- 172.21.15.69:0/2806962387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e7410a530 0x7f4e7410a940 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.715+0000 7f4e7a200640 1 -- 172.21.15.69:0/2806962387 >> 172.21.15.69:0/2806962387 conn(0x7f4e740761d0 msgr2=0x7f4e740765e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.715+0000 7f4e7a200640 1 -- 172.21.15.69:0/2806962387 shutdown_connections 2024-05-14T15:30:29.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.715+0000 7f4e7a200640 1 -- 172.21.15.69:0/2806962387 wait complete. 2024-05-14T15:30:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.717+0000 7f4e7a200640 1 Processor -- start 2024-05-14T15:30:29.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.717+0000 7f4e7a200640 1 -- start start 2024-05-14T15:30:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.717+0000 7f4e7a200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e7410a530 0x7f4e741a0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.718+0000 7f4e7a200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e7410eac0 0x7f4e741a1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.718+0000 7f4e7a200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e7410f580 0x7f4e741a5630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.718+0000 7f4e7a200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7411a3b0 con 0x7f4e7410a530 2024-05-14T15:30:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.718+0000 7f4e7a200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7411a230 con 0x7f4e7410eac0 2024-05-14T15:30:29.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.718+0000 7f4e7a200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7411a530 con 0x7f4e7410f580 2024-05-14T15:30:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.718+0000 7f4e73400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e7410a530 0x7f4e741a0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.718+0000 7f4e72a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e7410eac0 0x7f4e741a1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.718+0000 7f4e73400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e7410a530 0x7f4e741a0e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41586/0 (socket says 172.21.15.69:41586) 2024-05-14T15:30:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.718+0000 7f4e73400640 1 -- 172.21.15.69:0/3856995012 learned_addr learned my addr 172.21.15.69:0/3856995012 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:29.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.719+0000 7f4e73e00640 1 --2- 172.21.15.69:0/3856995012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e7410f580 0x7f4e741a5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.719+0000 7f4e73400640 1 -- 172.21.15.69:0/3856995012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e7410f580 msgr2=0x7f4e741a5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.719+0000 7f4e73400640 1 --2- 172.21.15.69:0/3856995012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e7410f580 0x7f4e741a5630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.719+0000 7f4e73400640 1 -- 172.21.15.69:0/3856995012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e7410eac0 msgr2=0x7f4e741a1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.719+0000 7f4e73400640 1 --2- 172.21.15.69:0/3856995012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e7410eac0 0x7f4e741a1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.719+0000 7f4e73400640 1 -- 172.21.15.69:0/3856995012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e741a5c70 con 0x7f4e7410a530 2024-05-14T15:30:29.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.719+0000 7f4e72a00640 1 --2- 172.21.15.69:0/3856995012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e7410eac0 0x7f4e741a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:30:29.722 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.720+0000 7f4e73400640 1 --2- 172.21.15.69:0/3856995012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e7410a530 0x7f4e741a0e10 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c031040 tx=0x7f4e6c031680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.721+0000 7f4e6be00640 1 -- 172.21.15.69:0/3856995012 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c031a70 con 0x7f4e7410a530 2024-05-14T15:30:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.721+0000 7f4e6be00640 1 -- 172.21.15.69:0/3856995012 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e6c0044d0 con 0x7f4e7410a530 2024-05-14T15:30:29.723 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.721+0000 7f4e6be00640 1 -- 172.21.15.69:0/3856995012 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c030a70 con 0x7f4e7410a530 2024-05-14T15:30:29.724 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.722+0000 7f4e7a200640 1 -- 172.21.15.69:0/3856995012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e741a5f00 con 0x7f4e7410a530 2024-05-14T15:30:29.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.723+0000 7f4e7a200640 1 -- 172.21.15.69:0/3856995012 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e741a6400 con 0x7f4e7410a530 2024-05-14T15:30:29.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.733+0000 7f4e811e7740 1 Processor -- start 2024-05-14T15:30:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.734+0000 7f4e811e7740 1 -- start start 2024-05-14T15:30:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.734+0000 7f4e811e7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c811e1b0 0x5631c84bf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.735+0000 7f4e811e7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c80f52f0 0x5631c84bf7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.735+0000 7f4e811e7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80fd4d0 0x5631c84bfd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.735+0000 7f4e811e7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5631c8424550 con 0x5631c80f52f0 2024-05-14T15:30:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.735+0000 7f4e811e7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5631c83c9bc0 con 0x5631c80fd4d0 2024-05-14T15:30:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.735+0000 7f4e811e7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5631c8420510 con 0x5631c811e1b0 2024-05-14T15:30:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.735+0000 7f4e6be00640 1 -- 172.21.15.69:0/3856995012 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4e6c030c10 con 0x7f4e7410a530 2024-05-14T15:30:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.736+0000 7f4e73400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c80f52f0 0x5631c84bf7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.736+0000 7f4e73400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c80f52f0 0x5631c84bf7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41596/0 (socket says 172.21.15.69:41596) 2024-05-14T15:30:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.736+0000 7f4e73400640 1 -- 172.21.15.69:0/1695691545 learned_addr learned my addr 172.21.15.69:0/1695691545 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:29.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.737+0000 7f4e73e00640 1 --2- 172.21.15.69:0/1695691545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c811e1b0 0x5631c84bf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.737+0000 7f4e73400640 1 -- 172.21.15.69:0/1695691545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c811e1b0 msgr2=0x5631c84bf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:29.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.737+0000 7f4e73400640 1 --2- 172.21.15.69:0/1695691545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c811e1b0 0x5631c84bf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.737+0000 7f4e73400640 1 -- 172.21.15.69:0/1695691545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80fd4d0 msgr2=0x5631c84bfd00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:30:29.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.737+0000 7f4e73400640 1 --2- 172.21.15.69:0/1695691545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80fd4d0 0x5631c84bfd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.737+0000 7f4e73400640 1 -- 172.21.15.69:0/1695691545 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c8136210 con 0x5631c80f52f0 2024-05-14T15:30:29.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.737+0000 7f4e6be00640 1 --2- 172.21.15.69:0/3856995012 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f4e580b2b20 0x7f4e580b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.738+0000 7f4e73400640 1 --2- 172.21.15.69:0/1695691545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c80f52f0 0x5631c84bf7c0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c101130 tx=0x7f4e6c107db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ee453ad84d2fe1c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:29.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.738+0000 7f4e73e00640 1 --2- 172.21.15.69:0/3856995012 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f4e580b2b20 0x7f4e580b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.741 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.738+0000 7f4e6be00640 1 -- 172.21.15.69:0/3856995012 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9554+0+0 (secure 0 0 0) 0x7f4e6c103e00 con 0x7f4e7410a530 2024-05-14T15:30:29.741 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.739+0000 7f4e5fe00640 1 -- 172.21.15.69:0/1695691545 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c0c6c40 con 0x5631c80f52f0 2024-05-14T15:30:29.741 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.739+0000 7f4e5fe00640 1 -- 172.21.15.69:0/1695691545 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e6c036030 con 0x5631c80f52f0 2024-05-14T15:30:29.741 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.739+0000 7f4e5fe00640 1 -- 172.21.15.69:0/1695691545 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c0ca4f0 con 0x5631c80f52f0 2024-05-14T15:30:29.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.740+0000 7f4e73e00640 1 --2- 172.21.15.69:0/3856995012 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f4e580b2b20 0x7f4e580b5030 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5631c84bc3f0 tx=0x7f4e64005f90 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.742+0000 7f4e811e7740 1 -- 172.21.15.69:0/1695691545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c80f52f0 msgr2=0x5631c84bf7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.742+0000 7f4e811e7740 1 --2- 172.21.15.69:0/1695691545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c80f52f0 0x5631c84bf7c0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c101130 tx=0x7f4e6c107db0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.742+0000 7f4e811e7740 1 -- 172.21.15.69:0/1695691545 shutdown_connections 2024-05-14T15:30:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.742+0000 7f4e811e7740 1 --2- 172.21.15.69:0/1695691545 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80fd4d0 0x5631c84bfd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.742+0000 7f4e811e7740 1 --2- 172.21.15.69:0/1695691545 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c80f52f0 0x5631c84bf7c0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.742+0000 7f4e811e7740 1 --2- 172.21.15.69:0/1695691545 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c811e1b0 0x5631c84bf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.743+0000 7f4e811e7740 1 -- 172.21.15.69:0/1695691545 >> 172.21.15.69:0/1695691545 conn(0x5631c8112300 msgr2=0x5631c84bba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.744+0000 7f4e811e7740 1 -- 172.21.15.69:0/1695691545 shutdown_connections 2024-05-14T15:30:29.746 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.745+0000 7f4e811e7740 1 -- 172.21.15.69:0/1695691545 wait complete. 2024-05-14T15:30:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.746+0000 7f4e811e7740 1 -- start start 2024-05-14T15:30:29.747 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.746+0000 7f4e811e7740 1 Processor -- start 2024-05-14T15:30:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.748+0000 7f4e811e7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80f52f0 0x5631c84c9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.748+0000 7f4e811e7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c80fd4d0 0x5631c84c9cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.748+0000 7f4e811e7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c811e1b0 0x5631c84e63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.748+0000 7f4e811e7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5631c8424550 con 0x5631c811e1b0 2024-05-14T15:30:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.748+0000 7f4e811e7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5631c83dd660 con 0x5631c80f52f0 2024-05-14T15:30:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.748+0000 7f4e811e7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5631c84dd180 con 0x5631c80fd4d0 2024-05-14T15:30:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.748+0000 7f4e811e7740 10 client.0 _ll_register_callbacks cb 0x5631c83a7400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:30:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.749+0000 7f4e72a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c80fd4d0 0x5631c84c9cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.749+0000 7f4e73400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80f52f0 0x5631c84c9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.750+0000 7f4e72a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c80fd4d0 0x5631c84c9cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:47734/0 (socket says 172.21.15.69:47734) 2024-05-14T15:30:29.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.750+0000 7f4e72a00640 1 -- 172.21.15.69:0/4110029079 learned_addr learned my addr 172.21.15.69:0/4110029079 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:29.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.750+0000 7f4e73e00640 1 --2- 172.21.15.69:0/4110029079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c811e1b0 0x5631c84e63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.751+0000 7f4e73400640 1 -- 172.21.15.69:0/4110029079 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c80fd4d0 msgr2=0x5631c84c9cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:29.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.751+0000 7f4e73400640 1 --2- 172.21.15.69:0/4110029079 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c80fd4d0 0x5631c84c9cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.751+0000 7f4e73400640 1 -- 172.21.15.69:0/4110029079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c811e1b0 msgr2=0x5631c84e63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.751+0000 7f4e73400640 1 --2- 172.21.15.69:0/4110029079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c811e1b0 0x5631c84e63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.751+0000 7f4e73400640 1 -- 172.21.15.69:0/4110029079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c8202620 con 0x5631c80f52f0 2024-05-14T15:30:29.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.752+0000 7f4e73e00640 1 --2- 172.21.15.69:0/4110029079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c811e1b0 0x5631c84e63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:30:29.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.752+0000 7f4e73400640 1 --2- 172.21.15.69:0/4110029079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80f52f0 0x5631c84c9780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c107440 tx=0x7f4e6c0048b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3983b73806d55c7b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:29.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.752+0000 7f4e5cc00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:30:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.753+0000 7f4e5cc00640 1 -- 172.21.15.69:0/4110029079 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c0ca6d0 con 0x5631c80f52f0 2024-05-14T15:30:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.753+0000 7f4e5cc00640 1 -- 172.21.15.69:0/4110029079 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9554+0+0 (secure 0 0 0) 0x7f4e6c0c7370 con 0x5631c80f52f0 2024-05-14T15:30:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.753+0000 7f4e811e7740 1 -- 172.21.15.69:0/4110029079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e6c036030 con 0x5631c80f52f0 2024-05-14T15:30:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.753+0000 7f4e5cc00640 1 -- 172.21.15.69:0/4110029079 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f4e6c0cab50 con 0x5631c80f52f0 2024-05-14T15:30:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.753+0000 7f4e811e7740 10 client.36386 fetch_fsmap learned FSMap version 61 2024-05-14T15:30:29.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.753+0000 7f4e811e7740 1 -- 172.21.15.69:0/4110029079 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5631c84fa1a0 con 0x5631c80f52f0 2024-05-14T15:30:29.756 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.754+0000 7f4e5cc00640 1 -- 172.21.15.69:0/4110029079 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e6c036030 con 0x5631c80f52f0 2024-05-14T15:30:29.756 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.755+0000 7f4e5cc00640 1 -- 172.21.15.69:0/4110029079 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 61) ==== 8366+0+0 (secure 0 0 0) 0x7f4e6c0cafe0 con 0x5631c80f52f0 2024-05-14T15:30:29.756 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.755+0000 7f4e811e7740 10 client.36386 fetch_fsmap finished waiting for FSMap version 61 2024-05-14T15:30:29.756 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.755+0000 7f4e811e7740 10 client.36386 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:30:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.755+0000 7f4e811e7740 20 client.36386 populate_metadata read hostname 'smithi069' 2024-05-14T15:30:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.755+0000 7f4e811e7740 1 --2- 172.21.15.69:0/4110029079 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5631c80dcd80 0x5631c84fd380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.755+0000 7f4e811e7740 4 client.36386 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:30:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.755+0000 7f4e811e7740 1 -- 172.21.15.69:0/4110029079 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631c8432160 con 0x5631c80dcd80 2024-05-14T15:30:29.757 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.755+0000 7f4e72a00640 1 --2- 172.21.15.69:0/4110029079 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5631c80dcd80 0x5631c84fd380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.757+0000 7f4e72a00640 1 --2- 172.21.15.69:0/4110029079 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5631c80dcd80 0x5631c84fd380 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa1643900f04f348 server_cookie=9efd9c1bbc33e2b9 in_seq=0 out_seq=0 2024-05-14T15:30:29.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.757+0000 7f4e5cc00640 10 client.36386 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.759+0000 7f4e5cc00640 1 -- 172.21.15.69:0/4110029079 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5631c8432160 con 0x5631c80dcd80 2024-05-14T15:30:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.759+0000 7f4e5cc00640 10 client.36386 handle_command_reply: tid=0 2024-05-14T15:30:29.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.759+0000 7f4e811e7740 1 client.36386 shutdown 2024-05-14T15:30:29.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.759+0000 7f4e811e7740 1 -- 172.21.15.69:0/4110029079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80f52f0 msgr2=0x5631c84c9780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:29.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.759+0000 7f4e811e7740 1 --2- 172.21.15.69:0/4110029079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80f52f0 0x5631c84c9780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c107440 tx=0x7f4e6c0048b0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.759+0000 7f4e811e7740 1 -- 172.21.15.69:0/4110029079 shutdown_connections 2024-05-14T15:30:29.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.759+0000 7f4e811e7740 1 --2- 172.21.15.69:0/4110029079 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5631c80dcd80 0x5631c84fd380 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.759+0000 7f4e811e7740 1 --2- 172.21.15.69:0/4110029079 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c811e1b0 0x5631c84e63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.759+0000 7f4e811e7740 1 --2- 172.21.15.69:0/4110029079 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c80fd4d0 0x5631c84c9cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.759+0000 7f4e811e7740 1 --2- 172.21.15.69:0/4110029079 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80f52f0 0x5631c84c9780 secure :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c107440 tx=0x7f4e6c0048b0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.759+0000 7f4e811e7740 1 -- 172.21.15.69:0/4110029079 >> 172.21.15.69:0/4110029079 conn(0x5631c8112300 msgr2=0x5631c84bf220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:29.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.760+0000 7f4e5cc00640 0 client.36386 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.762+0000 7f4e811e7740 1 -- 172.21.15.69:0/4110029079 shutdown_connections 2024-05-14T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.762+0000 7f4e811e7740 1 -- 172.21.15.69:0/4110029079 wait complete. 2024-05-14T15:30:29.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.763+0000 7f4e811e7740 20 client.36386 trim_cache size 0 max 16384 2024-05-14T15:30:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.793+0000 7f4e811e7740 1 Processor -- start 2024-05-14T15:30:29.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.793+0000 7f4e811e7740 1 -- start start 2024-05-14T15:30:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.794+0000 7f4e811e7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80fd4d0 0x5631c8502b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.794+0000 7f4e811e7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c811e1b0 0x5631c8503040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.794+0000 7f4e811e7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c80b21c0 0x5631c84c9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.794+0000 7f4e811e7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7407ce50 con 0x5631c80b21c0 2024-05-14T15:30:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.794+0000 7f4e811e7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7407e9c0 con 0x5631c80fd4d0 2024-05-14T15:30:29.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.794+0000 7f4e811e7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7407d520 con 0x5631c811e1b0 2024-05-14T15:30:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.795+0000 7f4e72a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c811e1b0 0x5631c8503040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.795+0000 7f4e73400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80fd4d0 0x5631c8502b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.795+0000 7f4e73400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80fd4d0 0x5631c8502b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:57076/0 (socket says 172.21.15.69:57076) 2024-05-14T15:30:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.795+0000 7f4e73400640 1 -- 172.21.15.69:0/3057819352 learned_addr learned my addr 172.21.15.69:0/3057819352 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:29.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.795+0000 7f4e73e00640 1 --2- 172.21.15.69:0/3057819352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c80b21c0 0x5631c84c9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.796+0000 7f4e73400640 1 -- 172.21.15.69:0/3057819352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c811e1b0 msgr2=0x5631c8503040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.796+0000 7f4e73400640 1 --2- 172.21.15.69:0/3057819352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c811e1b0 0x5631c8503040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.796+0000 7f4e73400640 1 -- 172.21.15.69:0/3057819352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c80b21c0 msgr2=0x5631c84c9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.796+0000 7f4e73400640 1 --2- 172.21.15.69:0/3057819352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c80b21c0 0x5631c84c9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.796+0000 7f4e73400640 1 -- 172.21.15.69:0/3057819352 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631c84b5d30 con 0x5631c80fd4d0 2024-05-14T15:30:29.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.796+0000 7f4e73e00640 1 --2- 172.21.15.69:0/3057819352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c80b21c0 0x5631c84c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:30:29.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.797+0000 7f4e73400640 1 --2- 172.21.15.69:0/3057819352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80fd4d0 0x5631c8502b00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c0ed040 tx=0x7f4e6c0305c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=252934cad3ed8b73 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.798+0000 7f4e5f400640 1 -- 172.21.15.69:0/3057819352 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c0ca6d0 con 0x5631c80fd4d0 2024-05-14T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.798+0000 7f4e5f400640 1 -- 172.21.15.69:0/3057819352 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e6c036030 con 0x5631c80fd4d0 2024-05-14T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.798+0000 7f4e5f400640 1 -- 172.21.15.69:0/3057819352 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6c10a7d0 con 0x5631c80fd4d0 2024-05-14T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.799+0000 7f4e811e7740 1 -- 172.21.15.69:0/3057819352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80fd4d0 msgr2=0x5631c8502b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.799+0000 7f4e811e7740 1 --2- 172.21.15.69:0/3057819352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80fd4d0 0x5631c8502b00 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c0ed040 tx=0x7f4e6c0305c0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.799+0000 7f4e811e7740 1 -- 172.21.15.69:0/3057819352 shutdown_connections 2024-05-14T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.799+0000 7f4e811e7740 1 --2- 172.21.15.69:0/3057819352 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c80b21c0 0x5631c84c9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.799+0000 7f4e811e7740 1 --2- 172.21.15.69:0/3057819352 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c811e1b0 0x5631c8503040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.799+0000 7f4e811e7740 1 --2- 172.21.15.69:0/3057819352 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80fd4d0 0x5631c8502b00 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.799+0000 7f4e811e7740 1 -- 172.21.15.69:0/3057819352 >> 172.21.15.69:0/3057819352 conn(0x5631c8112300 msgr2=0x5631c84c8e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:29.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.800+0000 7f4e811e7740 1 -- 172.21.15.69:0/3057819352 shutdown_connections 2024-05-14T15:30:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.801+0000 7f4e811e7740 1 -- 172.21.15.69:0/3057819352 wait complete. 2024-05-14T15:30:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.802+0000 7f4e811e7740 1 -- start start 2024-05-14T15:30:29.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.802+0000 7f4e811e7740 1 Processor -- start 2024-05-14T15:30:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.804+0000 7f4e811e7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80b21c0 0x5631c84e2620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.806 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.804+0000 7f4e811e7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c80fd4d0 0x5631c84dd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.805+0000 7f4e811e7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c811e1b0 0x5631c84ddf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.805+0000 7f4e811e7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7407e2f0 con 0x5631c811e1b0 2024-05-14T15:30:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.805+0000 7f4e72a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c80fd4d0 0x5631c84dd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.805+0000 7f4e811e7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7407dbf0 con 0x5631c80b21c0 2024-05-14T15:30:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.805+0000 7f4e72a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c80fd4d0 0x5631c84dd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:47744/0 (socket says 172.21.15.69:47744) 2024-05-14T15:30:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.805+0000 7f4e72a00640 1 -- 172.21.15.69:0/367127531 learned_addr learned my addr 172.21.15.69:0/367127531 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:29.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.806+0000 7f4e73400640 1 --2- 172.21.15.69:0/367127531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80b21c0 0x5631c84e2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.808+0000 7f4e811e7740 1 -- 172.21.15.69:0/367127531 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7406a240 con 0x5631c80fd4d0 2024-05-14T15:30:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.808+0000 7f4e73e00640 1 --2- 172.21.15.69:0/367127531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c811e1b0 0x5631c84ddf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.808+0000 7f4e811e7740 10 client.0 _ll_register_callbacks cb 0x7f4e6c107bf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:30:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.809+0000 7f4e72a00640 1 -- 172.21.15.69:0/367127531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80b21c0 msgr2=0x5631c84e2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:29.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.809+0000 7f4e72a00640 1 --2- 172.21.15.69:0/367127531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80b21c0 0x5631c84e2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.809+0000 7f4e72a00640 1 -- 172.21.15.69:0/367127531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c811e1b0 msgr2=0x5631c84ddf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.809+0000 7f4e72a00640 1 --2- 172.21.15.69:0/367127531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c811e1b0 0x5631c84ddf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.809+0000 7f4e72a00640 1 -- 172.21.15.69:0/367127531 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631c84de440 con 0x5631c80fd4d0 2024-05-14T15:30:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.809+0000 7f4e73400640 1 --2- 172.21.15.69:0/367127531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80b21c0 0x5631c84e2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:30:29.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.810+0000 7f4e72a00640 1 --2- 172.21.15.69:0/367127531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c80fd4d0 0x5631c84dd9c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x5631c84fda40 tx=0x7f4e6001e9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f70779b23b7354a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.810+0000 7f4e5cc00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:30:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.810+0000 7f4e5cc00640 1 -- 172.21.15.69:0/367127531 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60014ba0 con 0x5631c80fd4d0 2024-05-14T15:30:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.810+0000 7f4e811e7740 1 -- 172.21.15.69:0/367127531 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e6c036030 con 0x5631c80fd4d0 2024-05-14T15:30:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.810+0000 7f4e5cc00640 1 -- 172.21.15.69:0/367127531 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9554+0+0 (secure 0 0 0) 0x7f4e60014d40 con 0x5631c80fd4d0 2024-05-14T15:30:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.811+0000 7f4e5cc00640 1 -- 172.21.15.69:0/367127531 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f4e60012450 con 0x5631c80fd4d0 2024-05-14T15:30:29.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.811+0000 7f4e811e7740 10 client.26362 fetch_fsmap learned FSMap version 61 2024-05-14T15:30:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.811+0000 7f4e811e7740 1 -- 172.21.15.69:0/367127531 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x5631c85653b0 con 0x5631c80fd4d0 2024-05-14T15:30:29.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.811+0000 7f4e5cc00640 1 -- 172.21.15.69:0/367127531 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4e6c036030 con 0x5631c80fd4d0 2024-05-14T15:30:29.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.812+0000 7f4e5cc00640 1 -- 172.21.15.69:0/367127531 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 61) ==== 8366+0+0 (secure 0 0 0) 0x7f4e60025070 con 0x5631c80fd4d0 2024-05-14T15:30:29.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.812+0000 7f4e811e7740 10 client.26362 fetch_fsmap finished waiting for FSMap version 61 2024-05-14T15:30:29.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.812+0000 7f4e811e7740 10 client.26362 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:30:29.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.812+0000 7f4e811e7740 20 client.26362 populate_metadata read hostname 'smithi069' 2024-05-14T15:30:29.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.812+0000 7f4e811e7740 1 --2- 172.21.15.69:0/367127531 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5631c8565b60 0x5631c8567f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:29.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.812+0000 7f4e811e7740 4 client.26362 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:30:29.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.812+0000 7f4e811e7740 1 -- 172.21.15.69:0/367127531 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5631c842bfd0 con 0x5631c8565b60 2024-05-14T15:30:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.813+0000 7f4e73400640 1 --2- 172.21.15.69:0/367127531 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5631c8565b60 0x5631c8567f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.814+0000 7f4e73400640 1 --2- 172.21.15.69:0/367127531 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5631c8565b60 0x5631c8567f80 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=660e8af7f152c49e server_cookie=cc855b0cdc275b09 in_seq=0 out_seq=0 2024-05-14T15:30:29.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.814+0000 7f4e5cc00640 10 client.26362 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.839+0000 7f4e5cc00640 1 -- 172.21.15.69:0/367127531 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5631c842bfd0 con 0x5631c8565b60 2024-05-14T15:30:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.839+0000 7f4e5cc00640 10 client.26362 handle_command_reply: tid=0 2024-05-14T15:30:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.840+0000 7f4e811e7740 1 client.26362 shutdown 2024-05-14T15:30:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.840+0000 7f4e811e7740 1 -- 172.21.15.69:0/367127531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c80fd4d0 msgr2=0x5631c84dd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:29.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.840+0000 7f4e811e7740 1 --2- 172.21.15.69:0/367127531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c80fd4d0 0x5631c84dd9c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x5631c84fda40 tx=0x7f4e6001e9e0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.840+0000 7f4e811e7740 1 -- 172.21.15.69:0/367127531 shutdown_connections 2024-05-14T15:30:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.840+0000 7f4e811e7740 1 --2- 172.21.15.69:0/367127531 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5631c8565b60 0x5631c8567f80 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.840+0000 7f4e811e7740 1 --2- 172.21.15.69:0/367127531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631c811e1b0 0x5631c84ddf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.840+0000 7f4e811e7740 1 --2- 172.21.15.69:0/367127531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631c80fd4d0 0x5631c84dd9c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.840+0000 7f4e811e7740 1 --2- 172.21.15.69:0/367127531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631c80b21c0 0x5631c84e2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.840+0000 7f4e811e7740 1 -- 172.21.15.69:0/367127531 >> 172.21.15.69:0/367127531 conn(0x5631c8112300 msgr2=0x5631c84c9830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.840+0000 7f4e5cc00640 0 client.26362 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.841+0000 7f4e811e7740 1 -- 172.21.15.69:0/367127531 shutdown_connections 2024-05-14T15:30:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.841+0000 7f4e811e7740 1 -- 172.21.15.69:0/367127531 wait complete. 2024-05-14T15:30:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.841+0000 7f4e811e7740 20 client.26362 trim_cache size 0 max 16384 2024-05-14T15:30:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:30:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:30:29.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:30:29.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:30:29.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.842+0000 7f4e7a200640 1 -- 172.21.15.69:0/3856995012 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f4e580b2b20 msgr2=0x7f4e580b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:29.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.842+0000 7f4e7a200640 1 --2- 172.21.15.69:0/3856995012 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f4e580b2b20 0x7f4e580b5030 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x5631c84bc3f0 tx=0x7f4e64005f90 comp rx=0 tx=0).stop 2024-05-14T15:30:29.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.842+0000 7f4e7a200640 1 -- 172.21.15.69:0/3856995012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e7410a530 msgr2=0x7f4e741a0e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:29.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.842+0000 7f4e7a200640 1 --2- 172.21.15.69:0/3856995012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e7410a530 0x7f4e741a0e10 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f4e6c031040 tx=0x7f4e6c031680 comp rx=0 tx=0).stop 2024-05-14T15:30:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.843+0000 7f4e7a200640 1 -- 172.21.15.69:0/3856995012 shutdown_connections 2024-05-14T15:30:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.843+0000 7f4e7a200640 1 --2- 172.21.15.69:0/3856995012 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f4e580b2b20 0x7f4e580b5030 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.843+0000 7f4e7a200640 1 --2- 172.21.15.69:0/3856995012 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4e7410f580 0x7f4e741a5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.843+0000 7f4e7a200640 1 --2- 172.21.15.69:0/3856995012 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4e7410eac0 0x7f4e741a1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.843+0000 7f4e7a200640 1 --2- 172.21.15.69:0/3856995012 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4e7410a530 0x7f4e741a0e10 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.843+0000 7f4e7a200640 1 -- 172.21.15.69:0/3856995012 >> 172.21.15.69:0/3856995012 conn(0x7f4e740761d0 msgr2=0x7f4e74107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:29.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.844+0000 7f4e7a200640 1 -- 172.21.15.69:0/3856995012 shutdown_connections 2024-05-14T15:30:29.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:29.844+0000 7f4e7a200640 1 -- 172.21.15.69:0/3856995012 wait complete. 2024-05-14T15:30:30.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:30 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:30:30.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:30 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:30:30.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:30 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:30:31.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 285.0 s, 685.6 tps, lat 146.108 ms stddev 40.149 2024-05-14T15:30:31.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:31 smithi203 ceph-mon[34567]: pgmap v275: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.2 MiB/s wr, 835 op/s 2024-05-14T15:30:31.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:31 smithi092 ceph-mon[34729]: pgmap v275: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.2 MiB/s wr, 835 op/s 2024-05-14T15:30:31.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:31 smithi069 ceph-mon[31270]: pgmap v275: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.2 MiB/s wr, 835 op/s 2024-05-14T15:30:32.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:32 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:30:32.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:32 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:30:32.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:32 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:30:32.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:32 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:30:32.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:32 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:30:32.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:32 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:30:32.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:32 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:30:32.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:32 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:30:32.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:32 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:30:32.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:32 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:30:32.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:32 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:30:32.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:32 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:30:32.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:32 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:30:32.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:32 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:30:32.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:32 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-14T15:30:32.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:32 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-14T15:30:32.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:32 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-14T15:30:32.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:32 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:30:32.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:32 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:30:32.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:32 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:30:32.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:32 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:30:36.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:35 smithi092 ceph-mon[34729]: pgmap v276: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.6 MiB/s wr, 568 op/s 2024-05-14T15:30:36.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:35 smithi092 ceph-mon[34729]: pgmap v277: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 7.9 MiB/s wr, 786 op/s 2024-05-14T15:30:36.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:35 smithi069 ceph-mon[31270]: pgmap v276: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.6 MiB/s wr, 568 op/s 2024-05-14T15:30:36.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:35 smithi069 ceph-mon[31270]: pgmap v277: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 7.9 MiB/s wr, 786 op/s 2024-05-14T15:30:36.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:35 smithi203 ceph-mon[34567]: pgmap v276: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 5.6 MiB/s wr, 568 op/s 2024-05-14T15:30:36.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:35 smithi203 ceph-mon[34567]: pgmap v277: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 7.9 MiB/s wr, 786 op/s 2024-05-14T15:30:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 290.0 s, 676.2 tps, lat 148.095 ms stddev 44.490 2024-05-14T15:30:37.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:36 smithi092 ceph-mon[34729]: pgmap v278: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 716 op/s 2024-05-14T15:30:37.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:36 smithi069 ceph-mon[31270]: pgmap v278: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 716 op/s 2024-05-14T15:30:37.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:36 smithi203 ceph-mon[34567]: pgmap v278: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 7.1 MiB/s wr, 716 op/s 2024-05-14T15:30:39.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:39 smithi092 ceph-mon[34729]: pgmap v279: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.8 MiB/s wr, 599 op/s 2024-05-14T15:30:39.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:39 smithi069 ceph-mon[31270]: pgmap v279: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.8 MiB/s wr, 599 op/s 2024-05-14T15:30:39.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:39 smithi203 ceph-mon[34567]: pgmap v279: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.8 MiB/s wr, 599 op/s 2024-05-14T15:30:41.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 295.0 s, 692.4 tps, lat 144.261 ms stddev 55.964 2024-05-14T15:30:41.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:41 smithi092 ceph-mon[34729]: pgmap v280: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.7 MiB/s wr, 908 op/s 2024-05-14T15:30:41.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:41 smithi069 ceph-mon[31270]: pgmap v280: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.7 MiB/s wr, 908 op/s 2024-05-14T15:30:41.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:41 smithi203 ceph-mon[34567]: pgmap v280: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 8.7 MiB/s wr, 908 op/s 2024-05-14T15:30:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.224+0000 7fd517000640 1 -- 172.21.15.69:0/843805148 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd51011d2c0 msgr2=0x7fd51011f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.224+0000 7fd517000640 1 --2- 172.21.15.69:0/843805148 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd51011d2c0 0x7fd51011f6e0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd508009be0 tx=0x7fd50802a710 comp rx=0 tx=0).stop 2024-05-14T15:30:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.224+0000 7fd517000640 1 -- 172.21.15.69:0/843805148 shutdown_connections 2024-05-14T15:30:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.224+0000 7fd517000640 1 --2- 172.21.15.69:0/843805148 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd51011d2c0 0x7fd51011f6e0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.224+0000 7fd517000640 1 --2- 172.21.15.69:0/843805148 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd51011a960 0x7fd51011cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.224+0000 7fd517000640 1 --2- 172.21.15.69:0/843805148 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd51006f0c0 0x7fd51006f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.224+0000 7fd517000640 1 -- 172.21.15.69:0/843805148 >> 172.21.15.69:0/843805148 conn(0x7fd510109eb0 msgr2=0x7fd51010c2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:43.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.225+0000 7fd517000640 1 -- 172.21.15.69:0/843805148 shutdown_connections 2024-05-14T15:30:43.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.226+0000 7fd517000640 1 -- 172.21.15.69:0/843805148 wait complete. 2024-05-14T15:30:43.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.228+0000 7fd517000640 1 Processor -- start 2024-05-14T15:30:43.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.228+0000 7fd517000640 1 -- start start 2024-05-14T15:30:43.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.228+0000 7fd517000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd51006f0c0 0x7fd51011a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.228+0000 7fd517000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd51011a960 0x7fd510113300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.228+0000 7fd517000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd51011d2c0 0x7fd510113840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.229+0000 7fd50fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd51006f0c0 0x7fd51011a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.229+0000 7fd50fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd51006f0c0 0x7fd51011a1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:45174/0 (socket says 172.21.15.69:45174) 2024-05-14T15:30:43.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.229+0000 7fd50fe00640 1 -- 172.21.15.69:0/2508936240 learned_addr learned my addr 172.21.15.69:0/2508936240 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:43.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.229+0000 7fd517000640 1 -- 172.21.15.69:0/2508936240 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd510122af0 con 0x7fd51011a960 2024-05-14T15:30:43.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.229+0000 7fd517000640 1 -- 172.21.15.69:0/2508936240 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd510122970 con 0x7fd51006f0c0 2024-05-14T15:30:43.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.229+0000 7fd517000640 1 -- 172.21.15.69:0/2508936240 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd510122c70 con 0x7fd51011d2c0 2024-05-14T15:30:43.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.230+0000 7fd515000640 1 --2- 172.21.15.69:0/2508936240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd51011d2c0 0x7fd510113840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.230+0000 7fd50f400640 1 --2- 172.21.15.69:0/2508936240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd51011a960 0x7fd510113300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.231+0000 7fd515000640 1 -- 172.21.15.69:0/2508936240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd51006f0c0 msgr2=0x7fd51011a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:43.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.231+0000 7fd515000640 1 --2- 172.21.15.69:0/2508936240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd51006f0c0 0x7fd51011a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.231+0000 7fd515000640 1 -- 172.21.15.69:0/2508936240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd51011a960 msgr2=0x7fd510113300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:43.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.231+0000 7fd515000640 1 --2- 172.21.15.69:0/2508936240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd51011a960 0x7fd510113300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.231+0000 7fd515000640 1 -- 172.21.15.69:0/2508936240 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd510114010 con 0x7fd51011d2c0 2024-05-14T15:30:43.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.231+0000 7fd515000640 1 --2- 172.21.15.69:0/2508936240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd51011d2c0 0x7fd510113840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd50802ac30 tx=0x7fd508003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.232+0000 7fd50cc00640 1 -- 172.21.15.69:0/2508936240 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508041020 con 0x7fd51011d2c0 2024-05-14T15:30:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.232+0000 7fd517000640 1 -- 172.21.15.69:0/2508936240 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd510117d00 con 0x7fd51011d2c0 2024-05-14T15:30:43.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.232+0000 7fd517000640 1 -- 172.21.15.69:0/2508936240 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd510118210 con 0x7fd51011d2c0 2024-05-14T15:30:43.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.234+0000 7fd50cc00640 1 -- 172.21.15.69:0/2508936240 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd508037040 con 0x7fd51011d2c0 2024-05-14T15:30:43.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.234+0000 7fd50cc00640 1 -- 172.21.15.69:0/2508936240 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508041020 con 0x7fd51011d2c0 2024-05-14T15:30:43.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.237+0000 7fd51dfa9740 1 Processor -- start 2024-05-14T15:30:43.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.240+0000 7fd51dfa9740 1 -- start start 2024-05-14T15:30:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.241+0000 7fd51dfa9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7411b0 0x55972dae2280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.241+0000 7fd51dfa9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7182f0 0x55972dae27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.241+0000 7fd51dfa9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7204d0 0x55972dae2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.241+0000 7fd51dfa9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55972da47550 con 0x55972d7182f0 2024-05-14T15:30:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.241+0000 7fd51dfa9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55972d9ecbc0 con 0x55972d7204d0 2024-05-14T15:30:43.243 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.241+0000 7fd51dfa9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55972da43510 con 0x55972d7411b0 2024-05-14T15:30:43.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.242+0000 7fd50fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7182f0 0x55972dae27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.242+0000 7fd50fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7182f0 0x55972dae27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41376/0 (socket says 172.21.15.69:41376) 2024-05-14T15:30:43.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.242+0000 7fd50fe00640 1 -- 172.21.15.69:0/2871556908 learned_addr learned my addr 172.21.15.69:0/2871556908 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:43.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.242+0000 7fd50f400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7411b0 0x55972dae2280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.243+0000 7fd50f400640 1 --2- 172.21.15.69:0/2871556908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7204d0 0x55972dae2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.243+0000 7fd50cc00640 1 -- 172.21.15.69:0/2508936240 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd508044020 con 0x7fd51011d2c0 2024-05-14T15:30:43.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.244+0000 7fd50fe00640 1 -- 172.21.15.69:0/2871556908 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7411b0 msgr2=0x55972dae2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:43.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.244+0000 7fd50fe00640 1 --2- 172.21.15.69:0/2871556908 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7411b0 0x55972dae2280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.244+0000 7fd50fe00640 1 -- 172.21.15.69:0/2871556908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7204d0 msgr2=0x55972dae2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:43.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.244+0000 7fd50fe00640 1 --2- 172.21.15.69:0/2871556908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7204d0 0x55972dae2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.244+0000 7fd50fe00640 1 -- 172.21.15.69:0/2871556908 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55972d759210 con 0x55972d7182f0 2024-05-14T15:30:43.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.245+0000 7fd50fe00640 1 --2- 172.21.15.69:0/2871556908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7182f0 0x55972dae27c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd500009d50 tx=0x7fd500011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6251aae8363b98e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:43.247 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.246+0000 7fd505600640 1 -- 172.21.15.69:0/2871556908 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50001e070 con 0x55972d7182f0 2024-05-14T15:30:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.247+0000 7fd505600640 1 -- 172.21.15.69:0/2871556908 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd500019ac0 con 0x55972d7182f0 2024-05-14T15:30:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.247+0000 7fd505600640 1 -- 172.21.15.69:0/2871556908 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50000e990 con 0x55972d7182f0 2024-05-14T15:30:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.247+0000 7fd50cc00640 1 --2- 172.21.15.69:0/2508936240 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd4f40b2c50 0x7fd4f40b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.248+0000 7fd50cc00640 1 -- 172.21.15.69:0/2508936240 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9554+0+0 (secure 0 0 0) 0x7fd5081032b0 con 0x7fd51011d2c0 2024-05-14T15:30:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.248+0000 7fd51dfa9740 1 -- 172.21.15.69:0/2871556908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7182f0 msgr2=0x55972dae27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.248+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/2871556908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7182f0 0x55972dae27c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd500009d50 tx=0x7fd500011810 comp rx=0 tx=0).stop 2024-05-14T15:30:43.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.249+0000 7fd50f400640 1 --2- 172.21.15.69:0/2508936240 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd4f40b2c50 0x7fd4f40b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.249+0000 7fd51dfa9740 1 -- 172.21.15.69:0/2871556908 shutdown_connections 2024-05-14T15:30:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.249+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/2871556908 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7204d0 0x55972dae2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.249+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/2871556908 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7182f0 0x55972dae27c0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.249+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/2871556908 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7411b0 0x55972dae2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.249+0000 7fd51dfa9740 1 -- 172.21.15.69:0/2871556908 >> 172.21.15.69:0/2871556908 conn(0x55972d735300 msgr2=0x55972dadea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.250+0000 7fd50f400640 1 --2- 172.21.15.69:0/2508936240 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd4f40b2c50 0x7fd4f40b5160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55972dadf3f0 tx=0x7fd4fc0046c0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.250+0000 7fd51dfa9740 1 -- 172.21.15.69:0/2871556908 shutdown_connections 2024-05-14T15:30:43.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.251+0000 7fd51dfa9740 1 -- 172.21.15.69:0/2871556908 wait complete. 2024-05-14T15:30:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.251+0000 7fd51dfa9740 1 -- start start 2024-05-14T15:30:43.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.251+0000 7fd51dfa9740 1 Processor -- start 2024-05-14T15:30:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.252+0000 7fd51dfa9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7182f0 0x55972daec780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.252+0000 7fd51dfa9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 0x55972daeccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.252+0000 7fd51dfa9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7411b0 0x55972daf88f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.252+0000 7fd51dfa9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55972daef3b0 con 0x55972d7182f0 2024-05-14T15:30:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.252+0000 7fd51dfa9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55972da00660 con 0x55972d7411b0 2024-05-14T15:30:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.252+0000 7fd51dfa9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55972daef530 con 0x55972d7204d0 2024-05-14T15:30:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.252+0000 7fd51dfa9740 10 client.0 _ll_register_callbacks cb 0x55972d9ca400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:30:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.253+0000 7fd50fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7182f0 0x55972daec780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.253+0000 7fd50f400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 0x55972daeccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.253+0000 7fd515000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7411b0 0x55972daf88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.253+0000 7fd515000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7411b0 0x55972daf88f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:45196/0 (socket says 172.21.15.69:45196) 2024-05-14T15:30:43.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.253+0000 7fd50f400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 0x55972daeccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:42644/0 (socket says 172.21.15.69:42644) 2024-05-14T15:30:43.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.253+0000 7fd50fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7182f0 0x55972daec780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41380/0 (socket says 172.21.15.69:41380) 2024-05-14T15:30:43.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.253+0000 7fd515000640 1 -- 172.21.15.69:0/2918548062 learned_addr learned my addr 172.21.15.69:0/2918548062 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:43.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.254+0000 7fd515000640 1 -- 172.21.15.69:0/2918548062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 msgr2=0x55972daeccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:43.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.254+0000 7fd515000640 1 --2- 172.21.15.69:0/2918548062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 0x55972daeccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.254+0000 7fd515000640 1 -- 172.21.15.69:0/2918548062 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7182f0 msgr2=0x55972daec780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:43.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.255+0000 7fd515000640 1 --2- 172.21.15.69:0/2918548062 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7182f0 0x55972daec780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.255+0000 7fd515000640 1 -- 172.21.15.69:0/2918548062 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55972d825620 con 0x55972d7411b0 2024-05-14T15:30:43.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.255+0000 7fd50fe00640 1 --2- 172.21.15.69:0/2918548062 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7182f0 0x55972daec780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:30:43.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.255+0000 7fd515000640 1 --2- 172.21.15.69:0/2918548062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7411b0 0x55972daf88f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd5080c9eb0 tx=0x7fd5080c99e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7f01d8eaa8bd444 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.255+0000 7fd4fa000640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:30:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.256+0000 7fd4fa000640 1 -- 172.21.15.69:0/2918548062 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd508036040 con 0x55972d7411b0 2024-05-14T15:30:43.258 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.256+0000 7fd4fa000640 1 -- 172.21.15.69:0/2918548062 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9554+0+0 (secure 0 0 0) 0x7fd5080ce120 con 0x55972d7411b0 2024-05-14T15:30:43.259 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.258+0000 7fd51dfa9740 1 -- 172.21.15.69:0/2918548062 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd500019ac0 con 0x55972d7411b0 2024-05-14T15:30:43.259 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.258+0000 7fd4fa000640 1 -- 172.21.15.69:0/2918548062 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fd508100a20 con 0x55972d7411b0 2024-05-14T15:30:43.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.258+0000 7fd51dfa9740 10 client.36404 fetch_fsmap learned FSMap version 61 2024-05-14T15:30:43.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.258+0000 7fd51dfa9740 1 -- 172.21.15.69:0/2918548062 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55972dafb6a0 con 0x55972d7411b0 2024-05-14T15:30:43.260 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.259+0000 7fd4fa000640 1 -- 172.21.15.69:0/2918548062 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd500019ac0 con 0x55972d7411b0 2024-05-14T15:30:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.259+0000 7fd4fa000640 1 -- 172.21.15.69:0/2918548062 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 61) ==== 8366+0+0 (secure 0 0 0) 0x7fd508100ce0 con 0x55972d7411b0 2024-05-14T15:30:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.259+0000 7fd51dfa9740 10 client.36404 fetch_fsmap finished waiting for FSMap version 61 2024-05-14T15:30:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.259+0000 7fd51dfa9740 10 client.36404 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:30:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.259+0000 7fd51dfa9740 20 client.36404 populate_metadata read hostname 'smithi069' 2024-05-14T15:30:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.259+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/2918548062 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55972d6ffd80 0x55972dafed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.261 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.259+0000 7fd51dfa9740 4 client.36404 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:30:43.262 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.259+0000 7fd51dfa9740 1 -- 172.21.15.69:0/2918548062 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55972da55160 con 0x55972d6ffd80 2024-05-14T15:30:43.263 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.260+0000 7fd50fe00640 1 --2- 172.21.15.69:0/2918548062 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55972d6ffd80 0x55972dafed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.264 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.262+0000 7fd50fe00640 1 --2- 172.21.15.69:0/2918548062 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55972d6ffd80 0x55972dafed10 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3048e001bfb27b68 server_cookie=aaa1c9619cd3d6e6 in_seq=0 out_seq=0 2024-05-14T15:30:43.264 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.263+0000 7fd4fa000640 10 client.36404 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.265+0000 7fd4fa000640 1 -- 172.21.15.69:0/2918548062 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55972da55160 con 0x55972d6ffd80 2024-05-14T15:30:43.266 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.265+0000 7fd4fa000640 10 client.36404 handle_command_reply: tid=0 2024-05-14T15:30:43.267 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.265+0000 7fd51dfa9740 1 client.36404 shutdown 2024-05-14T15:30:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.266+0000 7fd51dfa9740 1 -- 172.21.15.69:0/2918548062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7411b0 msgr2=0x55972daf88f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.266+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/2918548062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7411b0 0x55972daf88f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fd5080c9eb0 tx=0x7fd5080c99e0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.268+0000 7fd51dfa9740 1 -- 172.21.15.69:0/2918548062 shutdown_connections 2024-05-14T15:30:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.268+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/2918548062 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7411b0 0x55972daf88f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.269 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.268+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/2918548062 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 0x55972daeccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.268+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/2918548062 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55972d6ffd80 0x55972dafed10 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.268+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/2918548062 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7182f0 0x55972daec780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.268+0000 7fd51dfa9740 1 -- 172.21.15.69:0/2918548062 >> 172.21.15.69:0/2918548062 conn(0x55972d735300 msgr2=0x55972dae2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.268+0000 7fd4fa000640 0 client.36404 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.268+0000 7fd51dfa9740 1 -- 172.21.15.69:0/2918548062 shutdown_connections 2024-05-14T15:30:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.269+0000 7fd51dfa9740 1 -- 172.21.15.69:0/2918548062 wait complete. 2024-05-14T15:30:43.270 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.269+0000 7fd51dfa9740 20 client.36404 trim_cache size 0 max 16384 2024-05-14T15:30:43.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.306+0000 7fd51dfa9740 1 Processor -- start 2024-05-14T15:30:43.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.306+0000 7fd51dfa9740 1 -- start start 2024-05-14T15:30:43.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.307+0000 7fd51dfa9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7182f0 0x55972daeb870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.307+0000 7fd51dfa9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 0x55972db044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.307+0000 7fd51dfa9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7411b0 0x55972db04a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.307+0000 7fd51dfa9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0010080 con 0x55972d7411b0 2024-05-14T15:30:43.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.307+0000 7fd51dfa9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0011bf0 con 0x55972d7182f0 2024-05-14T15:30:43.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.307+0000 7fd51dfa9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0010750 con 0x55972d7204d0 2024-05-14T15:30:43.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.307+0000 7fd515000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7411b0 0x55972db04a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.307+0000 7fd50f400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 0x55972db044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.307+0000 7fd50fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7182f0 0x55972daeb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.307+0000 7fd50f400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 0x55972db044d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:42660/0 (socket says 172.21.15.69:42660) 2024-05-14T15:30:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.307+0000 7fd50f400640 1 -- 172.21.15.69:0/1421496631 learned_addr learned my addr 172.21.15.69:0/1421496631 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.308+0000 7fd50fe00640 1 -- 172.21.15.69:0/1421496631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 msgr2=0x55972db044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.308+0000 7fd50fe00640 1 --2- 172.21.15.69:0/1421496631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 0x55972db044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.308+0000 7fd50fe00640 1 -- 172.21.15.69:0/1421496631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7411b0 msgr2=0x55972db04a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.309+0000 7fd50fe00640 1 --2- 172.21.15.69:0/1421496631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7411b0 0x55972db04a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.309+0000 7fd50fe00640 1 -- 172.21.15.69:0/1421496631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55972dada270 con 0x55972d7182f0 2024-05-14T15:30:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.309+0000 7fd515000640 1 --2- 172.21.15.69:0/1421496631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7411b0 0x55972db04a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:30:43.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.310+0000 7fd50fe00640 1 --2- 172.21.15.69:0/1421496631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7182f0 0x55972daeb870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55972dae3630 tx=0x7fd500009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6561745a2ce0266 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.310+0000 7fd504c00640 1 -- 172.21.15.69:0/1421496631 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd50001e040 con 0x55972d7182f0 2024-05-14T15:30:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.310+0000 7fd504c00640 1 -- 172.21.15.69:0/1421496631 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55972da55160 con 0x55972d7182f0 2024-05-14T15:30:43.312 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.310+0000 7fd504c00640 1 -- 172.21.15.69:0/1421496631 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd500019ab0 con 0x55972d7182f0 2024-05-14T15:30:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.311+0000 7fd51dfa9740 1 -- 172.21.15.69:0/1421496631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7182f0 msgr2=0x55972daeb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.311+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/1421496631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7182f0 0x55972daeb870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55972dae3630 tx=0x7fd500009260 comp rx=0 tx=0).stop 2024-05-14T15:30:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.312+0000 7fd51dfa9740 1 -- 172.21.15.69:0/1421496631 shutdown_connections 2024-05-14T15:30:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.312+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/1421496631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7411b0 0x55972db04a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.312+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/1421496631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 0x55972db044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.312+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/1421496631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7182f0 0x55972daeb870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.312+0000 7fd51dfa9740 1 -- 172.21.15.69:0/1421496631 >> 172.21.15.69:0/1421496631 conn(0x55972d735300 msgr2=0x55972dade960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.312+0000 7fd51dfa9740 1 -- 172.21.15.69:0/1421496631 shutdown_connections 2024-05-14T15:30:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.312+0000 7fd51dfa9740 1 -- 172.21.15.69:0/1421496631 wait complete. 2024-05-14T15:30:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.313+0000 7fd51dfa9740 1 -- start start 2024-05-14T15:30:43.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.313+0000 7fd51dfa9740 1 Processor -- start 2024-05-14T15:30:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.313+0000 7fd51dfa9740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7182f0 0x55972daef810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.313+0000 7fd51dfa9740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 0x55972daefd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.313+0000 7fd51dfa9740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7411b0 0x55972daf0290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.313+0000 7fd51dfa9740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0011520 con 0x55972d7411b0 2024-05-14T15:30:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.313+0000 7fd51dfa9740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f0010e20 con 0x55972d7182f0 2024-05-14T15:30:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.313+0000 7fd51dfa9740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd4f000e080 con 0x55972d7204d0 2024-05-14T15:30:43.315 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.314+0000 7fd51dfa9740 10 client.0 _ll_register_callbacks cb 0x7fd508031910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:30:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.314+0000 7fd515000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7411b0 0x55972daf0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.314+0000 7fd515000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7411b0 0x55972daf0290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41402/0 (socket says 172.21.15.69:41402) 2024-05-14T15:30:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.314+0000 7fd515000640 1 -- 172.21.15.69:0/617261431 learned_addr learned my addr 172.21.15.69:0/617261431 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.315+0000 7fd50f400640 1 --2- 172.21.15.69:0/617261431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 0x55972daefd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.315+0000 7fd50fe00640 1 --2- 172.21.15.69:0/617261431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7182f0 0x55972daef810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.315+0000 7fd515000640 1 -- 172.21.15.69:0/617261431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 msgr2=0x55972daefd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.315+0000 7fd515000640 1 --2- 172.21.15.69:0/617261431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 0x55972daefd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.315+0000 7fd515000640 1 -- 172.21.15.69:0/617261431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7182f0 msgr2=0x55972daef810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:43.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.315+0000 7fd515000640 1 --2- 172.21.15.69:0/617261431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7182f0 0x55972daef810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.315+0000 7fd515000640 1 -- 172.21.15.69:0/617261431 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55972db65070 con 0x55972d7411b0 2024-05-14T15:30:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.315+0000 7fd50fe00640 1 --2- 172.21.15.69:0/617261431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7182f0 0x55972daef810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:30:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.316+0000 7fd515000640 1 --2- 172.21.15.69:0/617261431 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7411b0 0x55972daf0290 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd508009b30 tx=0x7fd508004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=911981a0feb73beb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:43.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.316+0000 7fd4fa000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:30:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.317+0000 7fd4fa000640 1 -- 172.21.15.69:0/617261431 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5080e8030 con 0x55972d7411b0 2024-05-14T15:30:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.317+0000 7fd4fa000640 1 -- 172.21.15.69:0/617261431 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9554+0+0 (secure 0 0 0) 0x7fd5080c67a0 con 0x55972d7411b0 2024-05-14T15:30:43.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.318+0000 7fd51dfa9740 1 -- 172.21.15.69:0/617261431 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55972da55160 con 0x55972d7411b0 2024-05-14T15:30:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.320+0000 7fd4fa000640 1 -- 172.21.15.69:0/617261431 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7fd508036070 con 0x55972d7411b0 2024-05-14T15:30:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.320+0000 7fd51dfa9740 10 client.16911 fetch_fsmap learned FSMap version 61 2024-05-14T15:30:43.321 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.320+0000 7fd51dfa9740 1 -- 172.21.15.69:0/617261431 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x55972db661e0 con 0x55972d7411b0 2024-05-14T15:30:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.320+0000 7fd4fa000640 1 -- 172.21.15.69:0/617261431 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55972da55160 con 0x55972d7411b0 2024-05-14T15:30:43.322 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.320+0000 7fd4fa000640 1 -- 172.21.15.69:0/617261431 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 61) ==== 8366+0+0 (secure 0 0 0) 0x7fd508100ce0 con 0x55972d7411b0 2024-05-14T15:30:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.321+0000 7fd51dfa9740 10 client.16911 fetch_fsmap finished waiting for FSMap version 61 2024-05-14T15:30:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.321+0000 7fd51dfa9740 10 client.16911 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:30:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.321+0000 7fd51dfa9740 20 client.16911 populate_metadata read hostname 'smithi069' 2024-05-14T15:30:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.321+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/617261431 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55972d6d51c0 0x55972db68840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:43.323 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.321+0000 7fd51dfa9740 4 client.16911 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:30:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.321+0000 7fd51dfa9740 1 -- 172.21.15.69:0/617261431 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55972da4efd0 con 0x55972d6d51c0 2024-05-14T15:30:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.321+0000 7fd50fe00640 1 --2- 172.21.15.69:0/617261431 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55972d6d51c0 0x55972db68840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.322+0000 7fd50fe00640 1 --2- 172.21.15.69:0/617261431 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55972d6d51c0 0x55972db68840 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1390f33cd45edc5b server_cookie=5ef099cc10418299 in_seq=0 out_seq=0 2024-05-14T15:30:43.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.323+0000 7fd4fa000640 10 client.16911 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.348+0000 7fd4fa000640 1 -- 172.21.15.69:0/617261431 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55972da4efd0 con 0x55972d6d51c0 2024-05-14T15:30:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.348+0000 7fd4fa000640 10 client.16911 handle_command_reply: tid=0 2024-05-14T15:30:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.348+0000 7fd51dfa9740 1 client.16911 shutdown 2024-05-14T15:30:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.348+0000 7fd51dfa9740 1 -- 172.21.15.69:0/617261431 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7411b0 msgr2=0x55972daf0290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:43.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.348+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/617261431 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7411b0 0x55972daf0290 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fd508009b30 tx=0x7fd508004d70 comp rx=0 tx=0).stop 2024-05-14T15:30:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.349+0000 7fd51dfa9740 1 -- 172.21.15.69:0/617261431 shutdown_connections 2024-05-14T15:30:43.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.349+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/617261431 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55972d6d51c0 0x55972db68840 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.349+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/617261431 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55972d7411b0 0x55972daf0290 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.349+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/617261431 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55972d7204d0 0x55972daefd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.349+0000 7fd4fa000640 0 client.16911 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.349+0000 7fd51dfa9740 1 --2- 172.21.15.69:0/617261431 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55972d7182f0 0x55972daef810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.349+0000 7fd51dfa9740 1 -- 172.21.15.69:0/617261431 >> 172.21.15.69:0/617261431 conn(0x55972d735300 msgr2=0x55972dae2010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.350+0000 7fd51dfa9740 1 -- 172.21.15.69:0/617261431 shutdown_connections 2024-05-14T15:30:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.350+0000 7fd51dfa9740 1 -- 172.21.15.69:0/617261431 wait complete. 2024-05-14T15:30:43.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.350+0000 7fd51dfa9740 20 client.16911 trim_cache size 0 max 16384 2024-05-14T15:30:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:30:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:30:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:30:43.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:30:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.352+0000 7fd517000640 1 -- 172.21.15.69:0/2508936240 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd4f40b2c50 msgr2=0x7fd4f40b5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.352+0000 7fd517000640 1 --2- 172.21.15.69:0/2508936240 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd4f40b2c50 0x7fd4f40b5160 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x55972dadf3f0 tx=0x7fd4fc0046c0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.352+0000 7fd517000640 1 -- 172.21.15.69:0/2508936240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd51011d2c0 msgr2=0x7fd510113840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.352+0000 7fd517000640 1 --2- 172.21.15.69:0/2508936240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd51011d2c0 0x7fd510113840 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd50802ac30 tx=0x7fd508003f10 comp rx=0 tx=0).stop 2024-05-14T15:30:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.352+0000 7fd517000640 1 -- 172.21.15.69:0/2508936240 shutdown_connections 2024-05-14T15:30:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.352+0000 7fd517000640 1 --2- 172.21.15.69:0/2508936240 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd4f40b2c50 0x7fd4f40b5160 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.352+0000 7fd517000640 1 --2- 172.21.15.69:0/2508936240 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd51011d2c0 0x7fd510113840 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.352+0000 7fd517000640 1 --2- 172.21.15.69:0/2508936240 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd51011a960 0x7fd510113300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.352+0000 7fd517000640 1 --2- 172.21.15.69:0/2508936240 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd51006f0c0 0x7fd51011a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:43.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.352+0000 7fd517000640 1 -- 172.21.15.69:0/2508936240 >> 172.21.15.69:0/2508936240 conn(0x7fd510109eb0 msgr2=0x7fd51011b310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.353+0000 7fd517000640 1 -- 172.21.15.69:0/2508936240 shutdown_connections 2024-05-14T15:30:43.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:43.353+0000 7fd517000640 1 -- 172.21.15.69:0/2508936240 wait complete. 2024-05-14T15:30:43.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:43 smithi092 ceph-mon[34729]: pgmap v281: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.0 MiB/s wr, 624 op/s 2024-05-14T15:30:43.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:43 smithi069 ceph-mon[31270]: pgmap v281: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.0 MiB/s wr, 624 op/s 2024-05-14T15:30:43.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:43 smithi203 ceph-mon[34567]: pgmap v281: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 6.0 MiB/s wr, 624 op/s 2024-05-14T15:30:45.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:45 smithi069 ceph-mon[31270]: pgmap v282: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.0 MiB/s wr, 820 op/s 2024-05-14T15:30:45.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:45 smithi203 ceph-mon[34567]: pgmap v282: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.0 MiB/s wr, 820 op/s 2024-05-14T15:30:45.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:45 smithi092 ceph-mon[34729]: pgmap v282: 129 pgs: 129 active+clean; 2.8 GiB data, 13 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 8.0 MiB/s wr, 820 op/s 2024-05-14T15:30:46.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 300.0 s, 559.2 tps, lat 178.418 ms stddev 101.909 2024-05-14T15:30:47.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:47 smithi069 ceph-mon[31270]: pgmap v283: 129 pgs: 129 active+clean; 2.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 692 op/s 2024-05-14T15:30:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:47 smithi203 ceph-mon[34567]: pgmap v283: 129 pgs: 129 active+clean; 2.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 692 op/s 2024-05-14T15:30:47.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:47 smithi092 ceph-mon[34729]: pgmap v283: 129 pgs: 129 active+clean; 2.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.4 MiB/s wr, 692 op/s 2024-05-14T15:30:49.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:49 smithi069 ceph-mon[31270]: pgmap v284: 129 pgs: 129 active+clean; 2.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.6 MiB/s wr, 595 op/s 2024-05-14T15:30:49.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:49 smithi203 ceph-mon[34567]: pgmap v284: 129 pgs: 129 active+clean; 2.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.6 MiB/s wr, 595 op/s 2024-05-14T15:30:49.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:49 smithi092 ceph-mon[34729]: pgmap v284: 129 pgs: 129 active+clean; 2.8 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 5.6 MiB/s wr, 595 op/s 2024-05-14T15:30:51.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 305.0 s, 536.0 tps, lat 186.378 ms stddev 161.497 2024-05-14T15:30:51.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:51 smithi203 ceph-mon[34567]: pgmap v285: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 839 op/s 2024-05-14T15:30:51.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:51 smithi092 ceph-mon[34729]: pgmap v285: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 839 op/s 2024-05-14T15:30:51.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:51 smithi069 ceph-mon[31270]: pgmap v285: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 8.0 MiB/s wr, 839 op/s 2024-05-14T15:30:53.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:53 smithi203 ceph-mon[34567]: pgmap v286: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.1 MiB/s wr, 530 op/s 2024-05-14T15:30:53.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:53 smithi092 ceph-mon[34729]: pgmap v286: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.1 MiB/s wr, 530 op/s 2024-05-14T15:30:53.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:53 smithi069 ceph-mon[31270]: pgmap v286: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.1 MiB/s wr, 530 op/s 2024-05-14T15:30:55.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:55 smithi203 ceph-mon[34567]: pgmap v287: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.5 MiB/s wr, 677 op/s 2024-05-14T15:30:55.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:55 smithi092 ceph-mon[34729]: pgmap v287: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.5 MiB/s wr, 677 op/s 2024-05-14T15:30:55.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:55 smithi069 ceph-mon[31270]: pgmap v287: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.5 MiB/s wr, 677 op/s 2024-05-14T15:30:56.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 310.0 s, 639.2 tps, lat 156.916 ms stddev 49.092 2024-05-14T15:30:57.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:57 smithi203 ceph-mon[34567]: pgmap v288: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.9 MiB/s wr, 607 op/s 2024-05-14T15:30:57.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:57 smithi092 ceph-mon[34729]: pgmap v288: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.9 MiB/s wr, 607 op/s 2024-05-14T15:30:57.794 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:57 smithi069 ceph-mon[31270]: pgmap v288: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 5.9 MiB/s wr, 607 op/s 2024-05-14T15:30:58.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.388+0000 7f0902400640 1 -- 172.21.15.69:0/406240348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08fc10beb0 msgr2=0x7f08fc105a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:58.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.388+0000 7f0902400640 1 --2- 172.21.15.69:0/406240348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08fc10beb0 0x7f08fc105a50 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f08ec009900 tx=0x7f08ec02a400 comp rx=0 tx=0).stop 2024-05-14T15:30:58.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.390+0000 7f0902400640 1 -- 172.21.15.69:0/406240348 shutdown_connections 2024-05-14T15:30:58.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.390+0000 7f0902400640 1 --2- 172.21.15.69:0/406240348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08fc106600 0x7f08fc1129d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.390+0000 7f0902400640 1 --2- 172.21.15.69:0/406240348 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08fc10c350 0x7f08fc105f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.390+0000 7f0902400640 1 --2- 172.21.15.69:0/406240348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08fc10beb0 0x7f08fc105a50 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.390+0000 7f0902400640 1 -- 172.21.15.69:0/406240348 >> 172.21.15.69:0/406240348 conn(0x7f08fc101530 msgr2=0x7f08fc103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.390+0000 7f0902400640 1 -- 172.21.15.69:0/406240348 shutdown_connections 2024-05-14T15:30:58.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.391+0000 7f0902400640 1 -- 172.21.15.69:0/406240348 wait complete. 2024-05-14T15:30:58.395 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.392+0000 7f0902400640 1 Processor -- start 2024-05-14T15:30:58.397 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.395+0000 7f0902400640 1 -- start start 2024-05-14T15:30:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.397+0000 7f0902400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08fc106600 0x7f08fc1a26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.398 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.397+0000 7f0902400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08fc10beb0 0x7f08fc1a2c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.397+0000 7f0902400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08fc10c350 0x7f08fc19c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.397+0000 7f0902400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc115f90 con 0x7f08fc10beb0 2024-05-14T15:30:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.397+0000 7f0902400640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc115e10 con 0x7f08fc10c350 2024-05-14T15:30:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.397+0000 7f0902400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc116110 con 0x7f08fc106600 2024-05-14T15:30:58.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.397+0000 7f08faa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08fc10beb0 0x7f08fc1a2c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.398+0000 7f08fb400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08fc106600 0x7f08fc1a26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.398+0000 7f08fb400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08fc106600 0x7f08fc1a26e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:51498/0 (socket says 172.21.15.69:51498) 2024-05-14T15:30:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.398+0000 7f08fb400640 1 -- 172.21.15.69:0/3233102120 learned_addr learned my addr 172.21.15.69:0/3233102120 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.398+0000 7f08fbe00640 1 --2- 172.21.15.69:0/3233102120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08fc10c350 0x7f08fc19c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.399+0000 7f08fb400640 1 -- 172.21.15.69:0/3233102120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08fc10c350 msgr2=0x7f08fc19c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:58.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.399+0000 7f08fb400640 1 --2- 172.21.15.69:0/3233102120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08fc10c350 0x7f08fc19c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.399+0000 7f08fb400640 1 -- 172.21.15.69:0/3233102120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08fc10beb0 msgr2=0x7f08fc1a2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:58.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.399+0000 7f08fb400640 1 --2- 172.21.15.69:0/3233102120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08fc10beb0 0x7f08fc1a2c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.399+0000 7f08fb400640 1 -- 172.21.15.69:0/3233102120 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08fc19cf90 con 0x7f08fc106600 2024-05-14T15:30:58.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.399+0000 7f08fbe00640 1 --2- 172.21.15.69:0/3233102120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08fc10c350 0x7f08fc19c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:30:58.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.399+0000 7f08fb400640 1 --2- 172.21.15.69:0/3233102120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08fc106600 0x7f08fc1a26e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f08ec004770 tx=0x7f08ec003bb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.403+0000 7f08f3e00640 1 -- 172.21.15.69:0/3233102120 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec03f070 con 0x7f08fc106600 2024-05-14T15:30:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.403+0000 7f08f3e00640 1 -- 172.21.15.69:0/3233102120 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08ec03baf0 con 0x7f08fc106600 2024-05-14T15:30:58.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.403+0000 7f08f3e00640 1 -- 172.21.15.69:0/3233102120 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec035030 con 0x7f08fc106600 2024-05-14T15:30:58.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.403+0000 7f0902400640 1 -- 172.21.15.69:0/3233102120 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08fc19d220 con 0x7f08fc106600 2024-05-14T15:30:58.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.406+0000 7f0902400640 1 -- 172.21.15.69:0/3233102120 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08fc19d6c0 con 0x7f08fc106600 2024-05-14T15:30:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.410+0000 7f08f3e00640 1 -- 172.21.15.69:0/3233102120 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f08ec042070 con 0x7f08fc106600 2024-05-14T15:30:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.412+0000 7f08f3e00640 1 --2- 172.21.15.69:0/3233102120 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f08e00b2aa0 0x7f08e00b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.413+0000 7f08faa00640 1 --2- 172.21.15.69:0/3233102120 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f08e00b2aa0 0x7f08e00b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.413+0000 7f08f3e00640 1 -- 172.21.15.69:0/3233102120 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9554+0+0 (secure 0 0 0) 0x7f08ec0c5a70 con 0x7f08fc106600 2024-05-14T15:30:58.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.414+0000 7f08faa00640 1 --2- 172.21.15.69:0/3233102120 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f08e00b2aa0 0x7f08e00b4fb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f08fc102390 tx=0x7f08e800a2d0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.450+0000 7f09093f7740 1 Processor -- start 2024-05-14T15:30:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.450+0000 7f09093f7740 1 -- start start 2024-05-14T15:30:58.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.451+0000 7f09093f7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9ad1b0 0x562d8cd4dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.451+0000 7f09093f7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c9842f0 0x562d8cd4e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.451+0000 7f09093f7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c98c4d0 0x562d8cd4e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.451+0000 7f09093f7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x562d8ccb3550 con 0x562d8c9ad1b0 2024-05-14T15:30:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.451+0000 7f09093f7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562d8cc58bc0 con 0x562d8c9842f0 2024-05-14T15:30:58.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.451+0000 7f09093f7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562d8ccaf510 con 0x562d8c98c4d0 2024-05-14T15:30:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.452+0000 7f08fb400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9ad1b0 0x562d8cd4dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.452+0000 7f08fb400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9ad1b0 0x562d8cd4dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33970/0 (socket says 172.21.15.69:33970) 2024-05-14T15:30:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.452+0000 7f08fb400640 1 -- 172.21.15.69:0/3079352178 learned_addr learned my addr 172.21.15.69:0/3079352178 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.452+0000 7f08faa00640 1 --2- 172.21.15.69:0/3079352178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c9842f0 0x562d8cd4e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.452+0000 7f08fb400640 1 -- 172.21.15.69:0/3079352178 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c98c4d0 msgr2=0x562d8cd4e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:58.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.452+0000 7f08fb400640 1 --2- 172.21.15.69:0/3079352178 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c98c4d0 0x562d8cd4e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.452+0000 7f08fb400640 1 -- 172.21.15.69:0/3079352178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c9842f0 msgr2=0x562d8cd4e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:58.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.452+0000 7f08fb400640 1 --2- 172.21.15.69:0/3079352178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c9842f0 0x562d8cd4e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.452+0000 7f08fb400640 1 -- 172.21.15.69:0/3079352178 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d8c9c5210 con 0x562d8c9ad1b0 2024-05-14T15:30:58.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.453+0000 7f08fb400640 1 --2- 172.21.15.69:0/3079352178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9ad1b0 0x562d8cd4dec0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0c5500 tx=0x7f08ec0c8bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7729ce6ad6e5923 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:58.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.454+0000 7f08f0c00640 1 -- 172.21.15.69:0/3079352178 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec0c9480 con 0x562d8c9ad1b0 2024-05-14T15:30:58.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.454+0000 7f08f0c00640 1 -- 172.21.15.69:0/3079352178 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08ec0cd830 con 0x562d8c9ad1b0 2024-05-14T15:30:58.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.454+0000 7f08f0c00640 1 -- 172.21.15.69:0/3079352178 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ec0d1e50 con 0x562d8c9ad1b0 2024-05-14T15:30:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.457+0000 7f09093f7740 1 -- 172.21.15.69:0/3079352178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9ad1b0 msgr2=0x562d8cd4dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:58.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.457+0000 7f09093f7740 1 --2- 172.21.15.69:0/3079352178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9ad1b0 0x562d8cd4dec0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f08ec0c5500 tx=0x7f08ec0c8bf0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.459+0000 7f09093f7740 1 -- 172.21.15.69:0/3079352178 shutdown_connections 2024-05-14T15:30:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.459+0000 7f09093f7740 1 --2- 172.21.15.69:0/3079352178 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c98c4d0 0x562d8cd4e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.459+0000 7f09093f7740 1 --2- 172.21.15.69:0/3079352178 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c9842f0 0x562d8cd4e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.459+0000 7f09093f7740 1 --2- 172.21.15.69:0/3079352178 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9ad1b0 0x562d8cd4dec0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.459+0000 7f09093f7740 1 -- 172.21.15.69:0/3079352178 >> 172.21.15.69:0/3079352178 conn(0x562d8c9a1300 msgr2=0x562d8cd4a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.460+0000 7f09093f7740 1 -- 172.21.15.69:0/3079352178 shutdown_connections 2024-05-14T15:30:58.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.460+0000 7f09093f7740 1 -- 172.21.15.69:0/3079352178 wait complete. 2024-05-14T15:30:58.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.461+0000 7f09093f7740 1 -- start start 2024-05-14T15:30:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.462+0000 7f09093f7740 1 Processor -- start 2024-05-14T15:30:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.463+0000 7f09093f7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9842f0 0x562d8cd60fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.463+0000 7f09093f7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c98c4d0 0x562d8cd61520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.463+0000 7f08fb400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9842f0 0x562d8cd60fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.464+0000 7f08fb400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9842f0 0x562d8cd60fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33974/0 (socket says 172.21.15.69:33974) 2024-05-14T15:30:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.464+0000 7f08fb400640 1 -- 172.21.15.69:0/639968955 learned_addr learned my addr 172.21.15.69:0/639968955 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.464+0000 7f09093f7740 1 --2- 172.21.15.69:0/639968955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9ad1b0 0x562d8cd6cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.464+0000 7f09093f7740 1 -- 172.21.15.69:0/639968955 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x562d8cd63980 con 0x562d8c9842f0 2024-05-14T15:30:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.464+0000 7f09093f7740 1 -- 172.21.15.69:0/639968955 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562d8cc6c660 con 0x562d8c98c4d0 2024-05-14T15:30:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.464+0000 7f09093f7740 1 -- 172.21.15.69:0/639968955 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562d8cd63b00 con 0x562d8c9ad1b0 2024-05-14T15:30:58.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.465+0000 7f08faa00640 1 --2- 172.21.15.69:0/639968955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c98c4d0 0x562d8cd61520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.465+0000 7f09093f7740 10 client.0 _ll_register_callbacks cb 0x562d8cc36400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:30:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.465+0000 7f08fbe00640 1 --2- 172.21.15.69:0/639968955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9ad1b0 0x562d8cd6cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.466+0000 7f08faa00640 1 -- 172.21.15.69:0/639968955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9ad1b0 msgr2=0x562d8cd6cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.466+0000 7f08faa00640 1 --2- 172.21.15.69:0/639968955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9ad1b0 0x562d8cd6cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.466+0000 7f08faa00640 1 -- 172.21.15.69:0/639968955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9842f0 msgr2=0x562d8cd60fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:58.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.466+0000 7f08faa00640 1 --2- 172.21.15.69:0/639968955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9842f0 0x562d8cd60fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.466+0000 7f08faa00640 1 -- 172.21.15.69:0/639968955 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d8ca91620 con 0x562d8c98c4d0 2024-05-14T15:30:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.466+0000 7f09093f7740 1 -- 172.21.15.69:0/639968955 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08ec0cd830 con 0x562d8c98c4d0 2024-05-14T15:30:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.468+0000 7f08faa00640 1 --2- 172.21.15.69:0/639968955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c98c4d0 0x562d8cd61520 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x562d8cd4bd70 tx=0x7f08e8004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e9a9873bcb384b83 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:58.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.468+0000 7f08e5600640 10 client.36416 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:30:58.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.469+0000 7f08e5600640 1 -- 172.21.15.69:0/639968955 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e802a060 con 0x562d8c98c4d0 2024-05-14T15:30:58.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.469+0000 7f08e5600640 1 -- 172.21.15.69:0/639968955 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9554+0+0 (secure 0 0 0) 0x7f08e8022070 con 0x562d8c98c4d0 2024-05-14T15:30:58.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.470+0000 7f08e5600640 1 -- 172.21.15.69:0/639968955 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f08e802a060 con 0x562d8c98c4d0 2024-05-14T15:30:58.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.470+0000 7f09093f7740 10 client.36416 fetch_fsmap learned FSMap version 61 2024-05-14T15:30:58.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.470+0000 7f09093f7740 1 -- 172.21.15.69:0/639968955 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({fsmap=61}) -- 0x562d8cd6fb20 con 0x562d8c98c4d0 2024-05-14T15:30:58.472 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.471+0000 7f08e5600640 1 -- 172.21.15.69:0/639968955 <== mon.2 v2:172.21.15.92:3300/0 4 ==== fsmap(e 61) ==== 8366+0+0 (secure 0 0 0) 0x7f08e801c7b0 con 0x562d8c98c4d0 2024-05-14T15:30:58.472 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.471+0000 7f09093f7740 10 client.36416 fetch_fsmap finished waiting for FSMap version 61 2024-05-14T15:30:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.471+0000 7f09093f7740 10 client.36416 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:30:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.471+0000 7f09093f7740 20 client.36416 populate_metadata read hostname 'smithi069' 2024-05-14T15:30:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.471+0000 7f09093f7740 1 --2- 172.21.15.69:0/639968955 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562d8c96bd80 0x562d8cd72ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.471+0000 7f09093f7740 4 client.36416 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:30:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.471+0000 7f09093f7740 1 -- 172.21.15.69:0/639968955 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562d8ccc1160 con 0x562d8c96bd80 2024-05-14T15:30:58.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.472+0000 7f08fb400640 1 --2- 172.21.15.69:0/639968955 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562d8c96bd80 0x562d8cd72ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.475 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.474+0000 7f08fb400640 1 --2- 172.21.15.69:0/639968955 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562d8c96bd80 0x562d8cd72ee0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=982f1a751829ec77 server_cookie=cba34d8f6de83b5a in_seq=0 out_seq=0 2024-05-14T15:30:58.475 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.474+0000 7f08e5600640 10 client.36416 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.475+0000 7f08e5600640 1 -- 172.21.15.69:0/639968955 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562d8ccc1160 con 0x562d8c96bd80 2024-05-14T15:30:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.475+0000 7f08e5600640 10 client.36416 handle_command_reply: tid=0 2024-05-14T15:30:58.477 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.476+0000 7f09093f7740 1 client.36416 shutdown 2024-05-14T15:30:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.477+0000 7f09093f7740 1 -- 172.21.15.69:0/639968955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c98c4d0 msgr2=0x562d8cd61520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.477+0000 7f09093f7740 1 --2- 172.21.15.69:0/639968955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c98c4d0 0x562d8cd61520 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x562d8cd4bd70 tx=0x7f08e8004730 comp rx=0 tx=0).stop 2024-05-14T15:30:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.477+0000 7f09093f7740 1 -- 172.21.15.69:0/639968955 shutdown_connections 2024-05-14T15:30:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.477+0000 7f09093f7740 1 --2- 172.21.15.69:0/639968955 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9ad1b0 0x562d8cd6cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.477+0000 7f09093f7740 1 --2- 172.21.15.69:0/639968955 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c98c4d0 0x562d8cd61520 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.478+0000 7f09093f7740 1 --2- 172.21.15.69:0/639968955 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562d8c96bd80 0x562d8cd72ee0 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.478+0000 7f09093f7740 1 --2- 172.21.15.69:0/639968955 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9842f0 0x562d8cd60fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.479 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.478+0000 7f09093f7740 1 -- 172.21.15.69:0/639968955 >> 172.21.15.69:0/639968955 conn(0x562d8c9a1300 msgr2=0x562d8cd4ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.478+0000 7f08e5600640 0 client.36416 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.478+0000 7f09093f7740 1 -- 172.21.15.69:0/639968955 shutdown_connections 2024-05-14T15:30:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.478+0000 7f09093f7740 1 -- 172.21.15.69:0/639968955 wait complete. 2024-05-14T15:30:58.480 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.479+0000 7f09093f7740 20 client.36416 trim_cache size 0 max 16384 2024-05-14T15:30:58.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.518+0000 7f09093f7740 1 Processor -- start 2024-05-14T15:30:58.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.519+0000 7f09093f7740 1 -- start start 2024-05-14T15:30:58.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.520+0000 7f09093f7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9842f0 0x562d8cd78670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.520+0000 7f09093f7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c98c4d0 0x562d8cd78bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.520+0000 7f09093f7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9ad1b0 0x562d8cd6c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.520+0000 7f09093f7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc1af270 con 0x562d8c9ad1b0 2024-05-14T15:30:58.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.520+0000 7f09093f7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc1b0de0 con 0x562d8c98c4d0 2024-05-14T15:30:58.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.520+0000 7f09093f7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc1af940 con 0x562d8c9842f0 2024-05-14T15:30:58.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.521+0000 7f08fb400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9842f0 0x562d8cd78670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.521+0000 7f08faa00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c98c4d0 0x562d8cd78bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.521+0000 7f08faa00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c98c4d0 0x562d8cd78bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:56136/0 (socket says 172.21.15.69:56136) 2024-05-14T15:30:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.521+0000 7f08faa00640 1 -- 172.21.15.69:0/4088726810 learned_addr learned my addr 172.21.15.69:0/4088726810 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:58.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.521+0000 7f08fbe00640 1 --2- 172.21.15.69:0/4088726810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9ad1b0 0x562d8cd6c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.522+0000 7f08faa00640 1 -- 172.21.15.69:0/4088726810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9842f0 msgr2=0x562d8cd78670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.523+0000 7f08faa00640 1 --2- 172.21.15.69:0/4088726810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9842f0 0x562d8cd78670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.523+0000 7f08faa00640 1 -- 172.21.15.69:0/4088726810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9ad1b0 msgr2=0x562d8cd6c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.523+0000 7f08faa00640 1 --2- 172.21.15.69:0/4088726810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9ad1b0 0x562d8cd6c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.523+0000 7f08faa00640 1 -- 172.21.15.69:0/4088726810 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562d8cd4a250 con 0x562d8c98c4d0 2024-05-14T15:30:58.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.524+0000 7f08fb400640 1 --2- 172.21.15.69:0/4088726810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9842f0 0x562d8cd78670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:30:58.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.524+0000 7f08faa00640 1 --2- 172.21.15.69:0/4088726810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c98c4d0 0x562d8cd78bb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f08e800a8a0 tx=0x7f08e8021000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bdba7de2c6565c6c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.525+0000 7f08e7e00640 1 -- 172.21.15.69:0/4088726810 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e803c070 con 0x562d8c98c4d0 2024-05-14T15:30:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.525+0000 7f08e7e00640 1 -- 172.21.15.69:0/4088726810 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08ec0cd830 con 0x562d8c98c4d0 2024-05-14T15:30:58.527 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.525+0000 7f08e7e00640 1 -- 172.21.15.69:0/4088726810 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e8016070 con 0x562d8c98c4d0 2024-05-14T15:30:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.527+0000 7f09093f7740 1 -- 172.21.15.69:0/4088726810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c98c4d0 msgr2=0x562d8cd78bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.527+0000 7f09093f7740 1 --2- 172.21.15.69:0/4088726810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c98c4d0 0x562d8cd78bb0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f08e800a8a0 tx=0x7f08e8021000 comp rx=0 tx=0).stop 2024-05-14T15:30:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.527+0000 7f09093f7740 1 -- 172.21.15.69:0/4088726810 shutdown_connections 2024-05-14T15:30:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.527+0000 7f09093f7740 1 --2- 172.21.15.69:0/4088726810 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c9ad1b0 0x562d8cd6c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.527+0000 7f09093f7740 1 --2- 172.21.15.69:0/4088726810 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c98c4d0 0x562d8cd78bb0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.527+0000 7f09093f7740 1 --2- 172.21.15.69:0/4088726810 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9842f0 0x562d8cd78670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.527+0000 7f09093f7740 1 -- 172.21.15.69:0/4088726810 >> 172.21.15.69:0/4088726810 conn(0x562d8c9a1300 msgr2=0x562d8cd5c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:58.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.527+0000 7f09093f7740 1 -- 172.21.15.69:0/4088726810 shutdown_connections 2024-05-14T15:30:58.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.528+0000 7f09093f7740 1 -- 172.21.15.69:0/4088726810 wait complete. 2024-05-14T15:30:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.530+0000 7f09093f7740 1 -- start start 2024-05-14T15:30:58.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.530+0000 7f09093f7740 1 Processor -- start 2024-05-14T15:30:58.533 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.531+0000 7f09093f7740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c9842f0 0x562d8cdd35f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.533 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.531+0000 7f09093f7740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c98c4d0 0x562d8cdd3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.531+0000 7f09093f7740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9ad1b0 0x562d8cd67d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.531+0000 7f09093f7740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc1b0710 con 0x562d8c98c4d0 2024-05-14T15:30:58.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.531+0000 7f09093f7740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc1b0010 con 0x562d8c9842f0 2024-05-14T15:30:58.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.531+0000 7f09093f7740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f08fc1ad2f0 con 0x562d8c9ad1b0 2024-05-14T15:30:58.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.531+0000 7f09093f7740 10 client.0 _ll_register_callbacks cb 0x7f08e800fb70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:30:58.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.532+0000 7f08faa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c98c4d0 0x562d8cdd3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.532+0000 7f08fbe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9ad1b0 0x562d8cd67d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.532+0000 7f08fbe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9ad1b0 0x562d8cd67d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:51520/0 (socket says 172.21.15.69:51520) 2024-05-14T15:30:58.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.532+0000 7f08fbe00640 1 -- 172.21.15.69:0/747932379 learned_addr learned my addr 172.21.15.69:0/747932379 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:30:58.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.533+0000 7f08fb400640 1 --2- 172.21.15.69:0/747932379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c9842f0 0x562d8cdd35f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.533+0000 7f08fbe00640 1 -- 172.21.15.69:0/747932379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c9842f0 msgr2=0x562d8cdd35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:58.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.533+0000 7f08fbe00640 1 --2- 172.21.15.69:0/747932379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c9842f0 0x562d8cdd35f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.533+0000 7f08fbe00640 1 -- 172.21.15.69:0/747932379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c98c4d0 msgr2=0x562d8cdd3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:30:58.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.533+0000 7f08fbe00640 1 --2- 172.21.15.69:0/747932379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c98c4d0 0x562d8cdd3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.533+0000 7f08fbe00640 1 -- 172.21.15.69:0/747932379 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562d8cdd4390 con 0x562d8c9ad1b0 2024-05-14T15:30:58.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.534+0000 7f08fbe00640 1 --2- 172.21.15.69:0/747932379 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9ad1b0 0x562d8cd67d40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009e10 tx=0x7f08f4004410 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35f469c62ac7e186 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:30:58.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.534+0000 7f08e5600640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:30:58.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.534+0000 7f08e5600640 1 -- 172.21.15.69:0/747932379 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08f4012720 con 0x562d8c9ad1b0 2024-05-14T15:30:58.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.534+0000 7f08e5600640 1 -- 172.21.15.69:0/747932379 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(98..98 src has 1..98) ==== 9554+0+0 (secure 0 0 0) 0x7f08f40128c0 con 0x562d8c9ad1b0 2024-05-14T15:30:58.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.534+0000 7f09093f7740 1 -- 172.21.15.69:0/747932379 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f08ec0cd830 con 0x562d8c9ad1b0 2024-05-14T15:30:58.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.535+0000 7f08e5600640 1 -- 172.21.15.69:0/747932379 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=61) ==== 24+0+0 (secure 0 0 0) 0x7f08f4012ac0 con 0x562d8c9ad1b0 2024-05-14T15:30:58.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.535+0000 7f09093f7740 10 client.26395 fetch_fsmap learned FSMap version 61 2024-05-14T15:30:58.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.535+0000 7f09093f7740 1 -- 172.21.15.69:0/747932379 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=61,monmap=4+}) -- 0x562d8cd692e0 con 0x562d8c9ad1b0 2024-05-14T15:30:58.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.536+0000 7f08e5600640 1 -- 172.21.15.69:0/747932379 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f08ec0cd830 con 0x562d8c9ad1b0 2024-05-14T15:30:58.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.536+0000 7f08e5600640 1 -- 172.21.15.69:0/747932379 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 61) ==== 8366+0+0 (secure 0 0 0) 0x7f08f401cca0 con 0x562d8c9ad1b0 2024-05-14T15:30:58.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.537+0000 7f09093f7740 10 client.26395 fetch_fsmap finished waiting for FSMap version 61 2024-05-14T15:30:58.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.537+0000 7f09093f7740 10 client.26395 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:30:58.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.537+0000 7f09093f7740 20 client.26395 populate_metadata read hostname 'smithi069' 2024-05-14T15:30:58.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.537+0000 7f09093f7740 1 --2- 172.21.15.69:0/747932379 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562d8c9411c0 0x562d8cd531f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:30:58.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.537+0000 7f09093f7740 4 client.26395 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:30:58.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.537+0000 7f09093f7740 1 -- 172.21.15.69:0/747932379 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562d8ccbafd0 con 0x562d8c9411c0 2024-05-14T15:30:58.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.538+0000 7f08fb400640 1 --2- 172.21.15.69:0/747932379 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562d8c9411c0 0x562d8cd531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:30:58.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.540+0000 7f08fb400640 1 --2- 172.21.15.69:0/747932379 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562d8c9411c0 0x562d8cd531f0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24e7293274e76940 server_cookie=d492b98007598989 in_seq=0 out_seq=0 2024-05-14T15:30:58.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.541+0000 7f08e5600640 10 client.26395 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:58.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.571+0000 7f08e5600640 1 -- 172.21.15.69:0/747932379 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562d8ccbafd0 con 0x562d8c9411c0 2024-05-14T15:30:58.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.571+0000 7f08e5600640 10 client.26395 handle_command_reply: tid=0 2024-05-14T15:30:58.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.571+0000 7f09093f7740 1 client.26395 shutdown 2024-05-14T15:30:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.574+0000 7f09093f7740 1 -- 172.21.15.69:0/747932379 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9ad1b0 msgr2=0x562d8cd67d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:58.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.574+0000 7f09093f7740 1 --2- 172.21.15.69:0/747932379 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9ad1b0 0x562d8cd67d40 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f08f4009e10 tx=0x7f08f4004410 comp rx=0 tx=0).stop 2024-05-14T15:30:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.575+0000 7f09093f7740 1 -- 172.21.15.69:0/747932379 shutdown_connections 2024-05-14T15:30:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.575+0000 7f09093f7740 1 --2- 172.21.15.69:0/747932379 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562d8c9ad1b0 0x562d8cd67d40 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.575+0000 7f09093f7740 1 --2- 172.21.15.69:0/747932379 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562d8c9411c0 0x562d8cd531f0 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.575+0000 7f09093f7740 1 --2- 172.21.15.69:0/747932379 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562d8c98c4d0 0x562d8cdd3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.575+0000 7f09093f7740 1 --2- 172.21.15.69:0/747932379 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562d8c9842f0 0x562d8cdd35f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.575+0000 7f09093f7740 1 -- 172.21.15.69:0/747932379 >> 172.21.15.69:0/747932379 conn(0x562d8c9a1300 msgr2=0x562d8cd4ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:58.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.575+0000 7f08e5600640 0 client.26395 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:30:58.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.576+0000 7f09093f7740 1 -- 172.21.15.69:0/747932379 shutdown_connections 2024-05-14T15:30:58.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.577+0000 7f09093f7740 1 -- 172.21.15.69:0/747932379 wait complete. 2024-05-14T15:30:58.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.577+0000 7f09093f7740 20 client.26395 trim_cache size 0 max 16384 2024-05-14T15:30:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:30:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:30:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:30:58.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:30:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.580+0000 7f0902400640 1 -- 172.21.15.69:0/3233102120 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f08e00b2aa0 msgr2=0x7f08e00b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.580+0000 7f0902400640 1 --2- 172.21.15.69:0/3233102120 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f08e00b2aa0 0x7f08e00b4fb0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f08fc102390 tx=0x7f08e800a2d0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.580+0000 7f0902400640 1 -- 172.21.15.69:0/3233102120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08fc106600 msgr2=0x7f08fc1a26e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:30:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.580+0000 7f0902400640 1 --2- 172.21.15.69:0/3233102120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08fc106600 0x7f08fc1a26e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f08ec004770 tx=0x7f08ec003bb0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.580+0000 7f0902400640 1 -- 172.21.15.69:0/3233102120 shutdown_connections 2024-05-14T15:30:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.580+0000 7f0902400640 1 --2- 172.21.15.69:0/3233102120 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f08e00b2aa0 0x7f08e00b4fb0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.580+0000 7f0902400640 1 --2- 172.21.15.69:0/3233102120 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f08fc10c350 0x7f08fc19c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.580+0000 7f0902400640 1 --2- 172.21.15.69:0/3233102120 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f08fc10beb0 0x7f08fc1a2c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.580+0000 7f0902400640 1 --2- 172.21.15.69:0/3233102120 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f08fc106600 0x7f08fc1a26e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:30:58.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.580+0000 7f0902400640 1 -- 172.21.15.69:0/3233102120 >> 172.21.15.69:0/3233102120 conn(0x7f08fc101530 msgr2=0x7f08fc111b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:30:58.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.581+0000 7f0902400640 1 -- 172.21.15.69:0/3233102120 shutdown_connections 2024-05-14T15:30:58.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:30:58.581+0000 7f0902400640 1 -- 172.21.15.69:0/3233102120 wait complete. 2024-05-14T15:30:59.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:30:59 smithi203 ceph-mon[34567]: pgmap v289: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.2 MiB/s wr, 516 op/s 2024-05-14T15:30:59.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:30:59 smithi092 ceph-mon[34729]: pgmap v289: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.2 MiB/s wr, 516 op/s 2024-05-14T15:30:59.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:30:59 smithi069 ceph-mon[31270]: pgmap v289: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 5.2 MiB/s wr, 516 op/s 2024-05-14T15:31:00.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:00 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:31:00.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:00 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:31:00.738 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:00 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:31:01.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 315.0 s, 592.2 tps, lat 169.396 ms stddev 72.968 2024-05-14T15:31:01.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:01 smithi203 ceph-mon[34567]: pgmap v290: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 7.7 MiB/s wr, 794 op/s 2024-05-14T15:31:01.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:01 smithi092 ceph-mon[34729]: pgmap v290: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 7.7 MiB/s wr, 794 op/s 2024-05-14T15:31:01.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:01 smithi069 ceph-mon[31270]: pgmap v290: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 7.7 MiB/s wr, 794 op/s 2024-05-14T15:31:03.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:03 smithi203 ceph-mon[34567]: pgmap v291: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 5.3 MiB/s wr, 550 op/s 2024-05-14T15:31:03.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:03 smithi203 ceph-mon[34567]: osdmap e99: 12 total, 12 up, 12 in 2024-05-14T15:31:03.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:03 smithi092 ceph-mon[34729]: pgmap v291: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 5.3 MiB/s wr, 550 op/s 2024-05-14T15:31:03.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:03 smithi092 ceph-mon[34729]: osdmap e99: 12 total, 12 up, 12 in 2024-05-14T15:31:03.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:03 smithi069 ceph-mon[31270]: pgmap v291: 129 pgs: 129 active+clean; 2.9 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 5.3 MiB/s wr, 550 op/s 2024-05-14T15:31:03.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:03 smithi069 ceph-mon[31270]: osdmap e99: 12 total, 12 up, 12 in 2024-05-14T15:31:05.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:05 smithi203 ceph-mon[34567]: pgmap v293: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 6.4 MiB/s wr, 672 op/s 2024-05-14T15:31:05.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:05 smithi092 ceph-mon[34729]: pgmap v293: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 6.4 MiB/s wr, 672 op/s 2024-05-14T15:31:05.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:05 smithi069 ceph-mon[31270]: pgmap v293: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 6.4 MiB/s wr, 672 op/s 2024-05-14T15:31:06.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 320.0 s, 588.6 tps, lat 169.214 ms stddev 109.775 2024-05-14T15:31:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:07 smithi203 ceph-mon[34567]: pgmap v294: 129 pgs: 129 active+clean; 2.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.0 MiB/s wr, 660 op/s 2024-05-14T15:31:07.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:07 smithi092 ceph-mon[34729]: pgmap v294: 129 pgs: 129 active+clean; 2.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.0 MiB/s wr, 660 op/s 2024-05-14T15:31:07.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:07 smithi069 ceph-mon[31270]: pgmap v294: 129 pgs: 129 active+clean; 2.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.0 MiB/s wr, 660 op/s 2024-05-14T15:31:09.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:09 smithi203 ceph-mon[34567]: pgmap v295: 129 pgs: 129 active+clean; 2.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.0 MiB/s wr, 660 op/s 2024-05-14T15:31:09.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:09 smithi092 ceph-mon[34729]: pgmap v295: 129 pgs: 129 active+clean; 2.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.0 MiB/s wr, 660 op/s 2024-05-14T15:31:09.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:09 smithi069 ceph-mon[31270]: pgmap v295: 129 pgs: 129 active+clean; 2.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 6.0 MiB/s wr, 660 op/s 2024-05-14T15:31:11.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:10 smithi203 ceph-mon[34567]: osdmap e100: 12 total, 12 up, 12 in 2024-05-14T15:31:11.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:10 smithi092 ceph-mon[34729]: osdmap e100: 12 total, 12 up, 12 in 2024-05-14T15:31:11.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:10 smithi069 ceph-mon[31270]: osdmap e100: 12 total, 12 up, 12 in 2024-05-14T15:31:11.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 325.0 s, 643.2 tps, lat 155.397 ms stddev 49.684 2024-05-14T15:31:12.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:11 smithi203 ceph-mon[34567]: pgmap v297: 129 pgs: 129 active+clean; 2.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 7.4 MiB/s wr, 797 op/s 2024-05-14T15:31:12.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:11 smithi092 ceph-mon[34729]: pgmap v297: 129 pgs: 129 active+clean; 2.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 7.4 MiB/s wr, 797 op/s 2024-05-14T15:31:12.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:11 smithi069 ceph-mon[31270]: pgmap v297: 129 pgs: 129 active+clean; 2.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 7.4 MiB/s wr, 797 op/s 2024-05-14T15:31:13.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.424+0000 7fa6d5400640 1 -- 172.21.15.69:0/4294717593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d010b8c0 msgr2=0x7fa6d010dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:13.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.424+0000 7fa6d5400640 1 --2- 172.21.15.69:0/4294717593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d010b8c0 0x7fa6d010dce0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009900 tx=0x7fa6b802a490 comp rx=0 tx=0).stop 2024-05-14T15:31:13.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.425+0000 7fa6d5400640 1 -- 172.21.15.69:0/4294717593 shutdown_connections 2024-05-14T15:31:13.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.425+0000 7fa6d5400640 1 --2- 172.21.15.69:0/4294717593 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6d010e220 0x7fa6d01106f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.425+0000 7fa6d5400640 1 --2- 172.21.15.69:0/4294717593 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d010b8c0 0x7fa6d010dce0 secure :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009900 tx=0x7fa6b802a490 comp rx=0 tx=0).stop 2024-05-14T15:31:13.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.425+0000 7fa6d5400640 1 --2- 172.21.15.69:0/4294717593 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d0104e60 0x7fa6d0105270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.425+0000 7fa6d5400640 1 -- 172.21.15.69:0/4294717593 >> 172.21.15.69:0/4294717593 conn(0x7fa6d00782e0 msgr2=0x7fa6d0078720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:13.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.426+0000 7fa6d5400640 1 -- 172.21.15.69:0/4294717593 shutdown_connections 2024-05-14T15:31:13.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.426+0000 7fa6d5400640 1 -- 172.21.15.69:0/4294717593 wait complete. 2024-05-14T15:31:13.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.427+0000 7fa6d5400640 1 Processor -- start 2024-05-14T15:31:13.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.428+0000 7fa6d5400640 1 -- start start 2024-05-14T15:31:13.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.428+0000 7fa6d5400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6d0104e60 0x7fa6d0199490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.428+0000 7fa6d5400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d010e220 0x7fa6d01999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.428+0000 7fa6d5400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d01a0250 0x7fa6d01a0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.429+0000 7fa6cf200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d01a0250 0x7fa6d01a0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:13.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.429+0000 7fa6c7e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d010e220 0x7fa6d01999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:13.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.429+0000 7fa6c7e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d010e220 0x7fa6d01999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:52614/0 (socket says 172.21.15.69:52614) 2024-05-14T15:31:13.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.429+0000 7fa6d5400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d0113d60 con 0x7fa6d01a0250 2024-05-14T15:31:13.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.429+0000 7fa6d5400640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d0113be0 con 0x7fa6d010e220 2024-05-14T15:31:13.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.429+0000 7fa6d5400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d0113ee0 con 0x7fa6d0104e60 2024-05-14T15:31:13.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.429+0000 7fa6ce800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6d0104e60 0x7fa6d0199490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:13.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.430+0000 7fa6c7e00640 1 -- 172.21.15.69:0/2853203929 learned_addr learned my addr 172.21.15.69:0/2853203929 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:13.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.431+0000 7fa6cf200640 1 -- 172.21.15.69:0/2853203929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6d0104e60 msgr2=0x7fa6d0199490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:13.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.431+0000 7fa6cf200640 1 --2- 172.21.15.69:0/2853203929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6d0104e60 0x7fa6d0199490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.431+0000 7fa6cf200640 1 -- 172.21.15.69:0/2853203929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d010e220 msgr2=0x7fa6d01999d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:13.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.431+0000 7fa6cf200640 1 --2- 172.21.15.69:0/2853203929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d010e220 0x7fa6d01999d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.431+0000 7fa6cf200640 1 -- 172.21.15.69:0/2853203929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d01a0cd0 con 0x7fa6d01a0250 2024-05-14T15:31:13.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.431+0000 7fa6c7e00640 1 --2- 172.21.15.69:0/2853203929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d010e220 0x7fa6d01999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:31:13.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.432+0000 7fa6ce800640 1 --2- 172.21.15.69:0/2853203929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6d0104e60 0x7fa6d0199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:31:13.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.432+0000 7fa6cf200640 1 --2- 172.21.15.69:0/2853203929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d01a0250 0x7fa6d01a0660 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009fd0 tx=0x7fa6c800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:13.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.433+0000 7fa6c7400640 1 -- 172.21.15.69:0/2853203929 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c800ce20 con 0x7fa6d01a0250 2024-05-14T15:31:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.433+0000 7fa6c7400640 1 -- 172.21.15.69:0/2853203929 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6c8005020 con 0x7fa6d01a0250 2024-05-14T15:31:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.433+0000 7fa6c7400640 1 -- 172.21.15.69:0/2853203929 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8010690 con 0x7fa6d01a0250 2024-05-14T15:31:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.433+0000 7fa6d5400640 1 -- 172.21.15.69:0/2853203929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d01a0fc0 con 0x7fa6d01a0250 2024-05-14T15:31:13.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.433+0000 7fa6d5400640 1 -- 172.21.15.69:0/2853203929 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d01a1490 con 0x7fa6d01a0250 2024-05-14T15:31:13.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.441+0000 7fa6c7400640 1 -- 172.21.15.69:0/2853203929 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa6c8004a40 con 0x7fa6d01a0250 2024-05-14T15:31:13.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.445+0000 7fa6c7400640 1 --2- 172.21.15.69:0/2853203929 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa6b40b2aa0 0x7fa6b40b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.446+0000 7fa6c7400640 1 -- 172.21.15.69:0/2853203929 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9554+0+0 (secure 0 0 0) 0x7fa6c80e2fe0 con 0x7fa6d01a0250 2024-05-14T15:31:13.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.446+0000 7fa6ce800640 1 --2- 172.21.15.69:0/2853203929 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa6b40b2aa0 0x7fa6b40b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:13.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.447+0000 7fa6ce800640 1 --2- 172.21.15.69:0/2853203929 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa6b40b2aa0 0x7fa6b40b4fb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009fc0 tx=0x7fa6c0005f90 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.448+0000 7fa6dc403740 1 Processor -- start 2024-05-14T15:31:13.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.449+0000 7fa6dc403740 1 -- start start 2024-05-14T15:31:13.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.450+0000 7fa6dc403740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a6a1b0 0x560d79e0b280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.451+0000 7fa6dc403740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a412f0 0x560d79e0b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.451+0000 7fa6dc403740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a494d0 0x560d79e0bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.451+0000 7fa6ce800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a6a1b0 0x560d79e0b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.451+0000 7fa6dc403740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560d79d70550 con 0x560d79a412f0 2024-05-14T15:31:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.451+0000 7fa6ce800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a6a1b0 0x560d79e0b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:50622/0 (socket says 172.21.15.69:50622) 2024-05-14T15:31:13.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.451+0000 7fa6ce800640 1 -- 172.21.15.69:0/4216134722 learned_addr learned my addr 172.21.15.69:0/4216134722 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.451+0000 7fa6c7e00640 1 --2- 172.21.15.69:0/4216134722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a412f0 0x560d79e0b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.452+0000 7fa6dc403740 1 -- 172.21.15.69:0/4216134722 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560d79d15bc0 con 0x560d79a494d0 2024-05-14T15:31:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.452+0000 7fa6dc403740 1 -- 172.21.15.69:0/4216134722 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560d79d6c510 con 0x560d79a6a1b0 2024-05-14T15:31:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.452+0000 7fa6cf200640 1 --2- 172.21.15.69:0/4216134722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a494d0 0x560d79e0bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.453+0000 7fa6ce800640 1 -- 172.21.15.69:0/4216134722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a494d0 msgr2=0x560d79e0bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.453+0000 7fa6ce800640 1 --2- 172.21.15.69:0/4216134722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a494d0 0x560d79e0bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.453+0000 7fa6ce800640 1 -- 172.21.15.69:0/4216134722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a412f0 msgr2=0x560d79e0b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:13.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.453+0000 7fa6ce800640 1 --2- 172.21.15.69:0/4216134722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a412f0 0x560d79e0b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.453+0000 7fa6ce800640 1 -- 172.21.15.69:0/4216134722 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d79a82210 con 0x560d79a6a1b0 2024-05-14T15:31:13.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.453+0000 7fa6ce800640 1 --2- 172.21.15.69:0/4216134722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a6a1b0 0x560d79e0b280 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00042c0 tx=0x7fa6c0014000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ddee13f47b0b564f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:13.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.454+0000 7fa6bf400640 1 -- 172.21.15.69:0/4216134722 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c000f480 con 0x560d79a6a1b0 2024-05-14T15:31:13.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.454+0000 7fa6bf400640 1 -- 172.21.15.69:0/4216134722 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6c000fab0 con 0x560d79a6a1b0 2024-05-14T15:31:13.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.454+0000 7fa6bf400640 1 -- 172.21.15.69:0/4216134722 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c001ca90 con 0x560d79a6a1b0 2024-05-14T15:31:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.455+0000 7fa6dc403740 1 -- 172.21.15.69:0/4216134722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a6a1b0 msgr2=0x560d79e0b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.455+0000 7fa6dc403740 1 --2- 172.21.15.69:0/4216134722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a6a1b0 0x560d79e0b280 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa6c00042c0 tx=0x7fa6c0014000 comp rx=0 tx=0).stop 2024-05-14T15:31:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.455+0000 7fa6dc403740 1 -- 172.21.15.69:0/4216134722 shutdown_connections 2024-05-14T15:31:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.455+0000 7fa6dc403740 1 --2- 172.21.15.69:0/4216134722 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a494d0 0x560d79e0bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.455+0000 7fa6dc403740 1 --2- 172.21.15.69:0/4216134722 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a412f0 0x560d79e0b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.455+0000 7fa6dc403740 1 --2- 172.21.15.69:0/4216134722 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a6a1b0 0x560d79e0b280 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.455+0000 7fa6dc403740 1 -- 172.21.15.69:0/4216134722 >> 172.21.15.69:0/4216134722 conn(0x560d79a5e300 msgr2=0x560d79e07a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:13.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.456+0000 7fa6dc403740 1 -- 172.21.15.69:0/4216134722 shutdown_connections 2024-05-14T15:31:13.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.456+0000 7fa6dc403740 1 -- 172.21.15.69:0/4216134722 wait complete. 2024-05-14T15:31:13.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.456+0000 7fa6dc403740 1 -- start start 2024-05-14T15:31:13.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.457+0000 7fa6dc403740 1 Processor -- start 2024-05-14T15:31:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.457+0000 7fa6dc403740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a412f0 0x560d79e15760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.457+0000 7fa6dc403740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a494d0 0x560d79e15ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.457+0000 7fa6dc403740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a6a1b0 0x560d79e21860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.457+0000 7fa6dc403740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560d79e183b0 con 0x560d79a494d0 2024-05-14T15:31:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.457+0000 7fa6dc403740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560d79d29660 con 0x560d79a6a1b0 2024-05-14T15:31:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.457+0000 7fa6dc403740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560d79e18530 con 0x560d79a412f0 2024-05-14T15:31:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.457+0000 7fa6dc403740 10 client.0 _ll_register_callbacks cb 0x560d79cf3400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:31:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.458+0000 7fa6ce800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a412f0 0x560d79e15760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:13.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.458+0000 7fa6ce800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a412f0 0x560d79e15760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:50638/0 (socket says 172.21.15.69:50638) 2024-05-14T15:31:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.458+0000 7fa6ce800640 1 -- 172.21.15.69:0/1716188115 learned_addr learned my addr 172.21.15.69:0/1716188115 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:13.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.458+0000 7fa6cf200640 1 --2- 172.21.15.69:0/1716188115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a6a1b0 0x560d79e21860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.459+0000 7fa6c7e00640 1 --2- 172.21.15.69:0/1716188115 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a494d0 0x560d79e15ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.459+0000 7fa6ce800640 1 -- 172.21.15.69:0/1716188115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a6a1b0 msgr2=0x560d79e21860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.459+0000 7fa6ce800640 1 --2- 172.21.15.69:0/1716188115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a6a1b0 0x560d79e21860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.459+0000 7fa6ce800640 1 -- 172.21.15.69:0/1716188115 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a494d0 msgr2=0x560d79e15ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.459+0000 7fa6ce800640 1 --2- 172.21.15.69:0/1716188115 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a494d0 0x560d79e15ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.459+0000 7fa6ce800640 1 -- 172.21.15.69:0/1716188115 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d79b4e620 con 0x560d79a412f0 2024-05-14T15:31:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.459+0000 7fa6c7e00640 1 --2- 172.21.15.69:0/1716188115 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a494d0 0x560d79e15ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:31:13.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.460+0000 7fa6b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:31:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.460+0000 7fa6ce800640 1 --2- 172.21.15.69:0/1716188115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a412f0 0x560d79e15760 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009e80 tx=0x7fa6c001c5a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d17308c168bef3c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.460+0000 7fa6b3e00640 1 -- 172.21.15.69:0/1716188115 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c000fc60 con 0x560d79a412f0 2024-05-14T15:31:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.460+0000 7fa6b3e00640 1 -- 172.21.15.69:0/1716188115 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9554+0+0 (secure 0 0 0) 0x7fa6c000fe00 con 0x560d79a412f0 2024-05-14T15:31:13.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.461+0000 7fa6dc403740 1 -- 172.21.15.69:0/1716188115 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6c000fab0 con 0x560d79a412f0 2024-05-14T15:31:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.461+0000 7fa6b3e00640 1 -- 172.21.15.69:0/1716188115 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fa6c000f480 con 0x560d79a412f0 2024-05-14T15:31:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.461+0000 7fa6dc403740 10 client.26407 fetch_fsmap learned FSMap version 62 2024-05-14T15:31:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.461+0000 7fa6dc403740 1 -- 172.21.15.69:0/1716188115 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x560d79e355f0 con 0x560d79a412f0 2024-05-14T15:31:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.461+0000 7fa6b3e00640 1 -- 172.21.15.69:0/1716188115 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6c000fab0 con 0x560d79a412f0 2024-05-14T15:31:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.462+0000 7fa6b3e00640 1 -- 172.21.15.69:0/1716188115 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7fa6c001a070 con 0x560d79a412f0 2024-05-14T15:31:13.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.462+0000 7fa6dc403740 10 client.26407 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:31:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.462+0000 7fa6dc403740 10 client.26407 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:31:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.462+0000 7fa6dc403740 20 client.26407 populate_metadata read hostname 'smithi069' 2024-05-14T15:31:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.462+0000 7fa6dc403740 1 --2- 172.21.15.69:0/1716188115 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560d79a28d80 0x560d79e38a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.462+0000 7fa6dc403740 4 client.26407 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:31:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.462+0000 7fa6dc403740 1 -- 172.21.15.69:0/1716188115 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560d79d7e160 con 0x560d79a28d80 2024-05-14T15:31:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.463+0000 7fa6c7e00640 1 --2- 172.21.15.69:0/1716188115 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560d79a28d80 0x560d79e38a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.464+0000 7fa6c7e00640 1 --2- 172.21.15.69:0/1716188115 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560d79a28d80 0x560d79e38a60 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96dc105fb800420a server_cookie=a3b6b1afcfbee059 in_seq=0 out_seq=0 2024-05-14T15:31:13.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.464+0000 7fa6b3e00640 10 client.26407 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:31:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.465+0000 7fa6b3e00640 1 -- 172.21.15.69:0/1716188115 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560d79d7e160 con 0x560d79a28d80 2024-05-14T15:31:13.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.465+0000 7fa6b3e00640 10 client.26407 handle_command_reply: tid=0 2024-05-14T15:31:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.465+0000 7fa6dc403740 1 client.26407 shutdown 2024-05-14T15:31:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.465+0000 7fa6dc403740 1 -- 172.21.15.69:0/1716188115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a412f0 msgr2=0x560d79e15760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.465+0000 7fa6dc403740 1 --2- 172.21.15.69:0/1716188115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a412f0 0x560d79e15760 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009e80 tx=0x7fa6c001c5a0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.466+0000 7fa6dc403740 1 -- 172.21.15.69:0/1716188115 shutdown_connections 2024-05-14T15:31:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.466+0000 7fa6dc403740 1 --2- 172.21.15.69:0/1716188115 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a6a1b0 0x560d79e21860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.466+0000 7fa6dc403740 1 --2- 172.21.15.69:0/1716188115 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560d79a28d80 0x560d79e38a60 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.466+0000 7fa6dc403740 1 --2- 172.21.15.69:0/1716188115 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a494d0 0x560d79e15ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.466+0000 7fa6dc403740 1 --2- 172.21.15.69:0/1716188115 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a412f0 0x560d79e15760 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.466+0000 7fa6dc403740 1 -- 172.21.15.69:0/1716188115 >> 172.21.15.69:0/1716188115 conn(0x560d79a5e300 msgr2=0x560d79e0b050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:13.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.466+0000 7fa6b3e00640 0 client.26407 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:31:13.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.466+0000 7fa6dc403740 1 -- 172.21.15.69:0/1716188115 shutdown_connections 2024-05-14T15:31:13.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.466+0000 7fa6dc403740 1 -- 172.21.15.69:0/1716188115 wait complete. 2024-05-14T15:31:13.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.467+0000 7fa6dc403740 20 client.26407 trim_cache size 0 max 16384 2024-05-14T15:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.503+0000 7fa6dc403740 1 Processor -- start 2024-05-14T15:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.503+0000 7fa6dc403740 1 -- start start 2024-05-14T15:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.504+0000 7fa6dc403740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a412f0 0x560d79e14850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.504+0000 7fa6dc403740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a494d0 0x560d79e217d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.504+0000 7fa6dc403740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a6a1b0 0x560d79e06710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.504+0000 7fa6dc403740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01b7fc0 con 0x560d79a494d0 2024-05-14T15:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.504+0000 7fa6dc403740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01b9b00 con 0x560d79a412f0 2024-05-14T15:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.504+0000 7fa6dc403740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01b8690 con 0x560d79a6a1b0 2024-05-14T15:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.504+0000 7fa6c7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a494d0 0x560d79e217d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:13.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.504+0000 7fa6c7e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a494d0 0x560d79e217d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39192/0 (socket says 172.21.15.69:39192) 2024-05-14T15:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.504+0000 7fa6c7e00640 1 -- 172.21.15.69:0/2775889941 learned_addr learned my addr 172.21.15.69:0/2775889941 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.505+0000 7fa6c7e00640 1 -- 172.21.15.69:0/2775889941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a6a1b0 msgr2=0x560d79e06710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.505+0000 7fa6c7e00640 1 --2- 172.21.15.69:0/2775889941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a6a1b0 0x560d79e06710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.505+0000 7fa6c7e00640 1 -- 172.21.15.69:0/2775889941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a412f0 msgr2=0x560d79e14850 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.505+0000 7fa6c7e00640 1 --2- 172.21.15.69:0/2775889941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a412f0 0x560d79e14850 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.505+0000 7fa6c7e00640 1 -- 172.21.15.69:0/2775889941 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560d79e030b0 con 0x560d79a494d0 2024-05-14T15:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.507+0000 7fa6c7e00640 1 --2- 172.21.15.69:0/2775889941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a494d0 0x560d79e217d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009900 tx=0x7fa6b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=673ec079f4a3c36a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.507+0000 7fa6bea00640 1 -- 172.21.15.69:0/2775889941 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b8035040 con 0x560d79a494d0 2024-05-14T15:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.508+0000 7fa6bea00640 1 -- 172.21.15.69:0/2775889941 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6b8047900 con 0x560d79a494d0 2024-05-14T15:31:13.509 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.508+0000 7fa6bea00640 1 -- 172.21.15.69:0/2775889941 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b803c6a0 con 0x560d79a494d0 2024-05-14T15:31:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.509+0000 7fa6dc403740 1 -- 172.21.15.69:0/2775889941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a494d0 msgr2=0x560d79e217d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:13.510 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.509+0000 7fa6dc403740 1 --2- 172.21.15.69:0/2775889941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a494d0 0x560d79e217d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa6b8009900 tx=0x7fa6b80046c0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.511+0000 7fa6dc403740 1 -- 172.21.15.69:0/2775889941 shutdown_connections 2024-05-14T15:31:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.511+0000 7fa6dc403740 1 --2- 172.21.15.69:0/2775889941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a6a1b0 0x560d79e06710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.511+0000 7fa6dc403740 1 --2- 172.21.15.69:0/2775889941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a494d0 0x560d79e217d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.511+0000 7fa6dc403740 1 --2- 172.21.15.69:0/2775889941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a412f0 0x560d79e14850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.511+0000 7fa6dc403740 1 -- 172.21.15.69:0/2775889941 >> 172.21.15.69:0/2775889941 conn(0x560d79a5e300 msgr2=0x560d79e06000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.511+0000 7fa6dc403740 1 -- 172.21.15.69:0/2775889941 shutdown_connections 2024-05-14T15:31:13.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.512+0000 7fa6dc403740 1 -- 172.21.15.69:0/2775889941 wait complete. 2024-05-14T15:31:13.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.513+0000 7fa6dc403740 1 -- start start 2024-05-14T15:31:13.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.513+0000 7fa6dc403740 1 Processor -- start 2024-05-14T15:31:13.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.514+0000 7fa6dc403740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a412f0 0x560d79e3bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.514+0000 7fa6dc403740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a494d0 0x560d79e38150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.514+0000 7fa6dc403740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a6a1b0 0x560d79e38690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.514+0000 7fa6ce800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a412f0 0x560d79e3bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.514+0000 7fa6ce800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a412f0 0x560d79e3bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:50648/0 (socket says 172.21.15.69:50648) 2024-05-14T15:31:13.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.515+0000 7fa6ce800640 1 -- 172.21.15.69:0/1532497689 learned_addr learned my addr 172.21.15.69:0/1532497689 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.515+0000 7fa6dc403740 1 -- 172.21.15.69:0/1532497689 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01b9430 con 0x560d79a6a1b0 2024-05-14T15:31:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.515+0000 7fa6cf200640 1 --2- 172.21.15.69:0/1532497689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a6a1b0 0x560d79e38690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.515+0000 7fa6c7e00640 1 --2- 172.21.15.69:0/1532497689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a494d0 0x560d79e38150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:13.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.515+0000 7fa6dc403740 1 -- 172.21.15.69:0/1532497689 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d01b8d60 con 0x560d79a494d0 2024-05-14T15:31:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.516+0000 7fa6dc403740 1 -- 172.21.15.69:0/1532497689 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d006a240 con 0x560d79a412f0 2024-05-14T15:31:13.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.516+0000 7fa6dc403740 10 client.0 _ll_register_callbacks cb 0x7fa6c80093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:31:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.517+0000 7fa6ce800640 1 -- 172.21.15.69:0/1532497689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a494d0 msgr2=0x560d79e38150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.517+0000 7fa6ce800640 1 --2- 172.21.15.69:0/1532497689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a494d0 0x560d79e38150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.517+0000 7fa6ce800640 1 -- 172.21.15.69:0/1532497689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a6a1b0 msgr2=0x560d79e38690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.517+0000 7fa6ce800640 1 --2- 172.21.15.69:0/1532497689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a6a1b0 0x560d79e38690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.517+0000 7fa6ce800640 1 -- 172.21.15.69:0/1532497689 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560d79e38bd0 con 0x560d79a412f0 2024-05-14T15:31:13.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.517+0000 7fa6cf200640 1 --2- 172.21.15.69:0/1532497689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a6a1b0 0x560d79e38690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:31:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.519+0000 7fa6ce800640 1 --2- 172.21.15.69:0/1532497689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a412f0 0x560d79e3bdf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0011d40 tx=0x7fa6c001c460 comp rx=0 tx=0).ready entity=mon.1 client_cookie=efdb455c09e3e8c3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:13.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.519+0000 7fa6b3e00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:31:13.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.520+0000 7fa6b3e00640 1 -- 172.21.15.69:0/1532497689 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c000f480 con 0x560d79a412f0 2024-05-14T15:31:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.520+0000 7fa6b3e00640 1 -- 172.21.15.69:0/1532497689 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9554+0+0 (secure 0 0 0) 0x7fa6c002b030 con 0x560d79a412f0 2024-05-14T15:31:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.520+0000 7fa6dc403740 1 -- 172.21.15.69:0/1532497689 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa6b8047900 con 0x560d79a412f0 2024-05-14T15:31:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.521+0000 7fa6b3e00640 1 -- 172.21.15.69:0/1532497689 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fa6c001cb20 con 0x560d79a412f0 2024-05-14T15:31:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.521+0000 7fa6dc403740 10 client.26410 fetch_fsmap learned FSMap version 62 2024-05-14T15:31:13.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.521+0000 7fa6dc403740 1 -- 172.21.15.69:0/1532497689 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x560d79e9f830 con 0x560d79a412f0 2024-05-14T15:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.521+0000 7fa6b3e00640 1 -- 172.21.15.69:0/1532497689 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa6b8047900 con 0x560d79a412f0 2024-05-14T15:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.521+0000 7fa6b3e00640 1 -- 172.21.15.69:0/1532497689 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7fa6c001a070 con 0x560d79a412f0 2024-05-14T15:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.521+0000 7fa6dc403740 10 client.26410 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.521+0000 7fa6dc403740 10 client.26410 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.521+0000 7fa6dc403740 20 client.26410 populate_metadata read hostname 'smithi069' 2024-05-14T15:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.522+0000 7fa6dc403740 1 --2- 172.21.15.69:0/1532497689 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560d799fe1c0 0x560d79ea1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.522+0000 7fa6dc403740 4 client.26410 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.522+0000 7fa6dc403740 1 -- 172.21.15.69:0/1532497689 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560d79d77fd0 con 0x560d799fe1c0 2024-05-14T15:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.522+0000 7fa6c7e00640 1 --2- 172.21.15.69:0/1532497689 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560d799fe1c0 0x560d79ea1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.523+0000 7fa6b3e00640 10 client.26410 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:31:13.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.523+0000 7fa6c7e00640 1 --2- 172.21.15.69:0/1532497689 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560d799fe1c0 0x560d79ea1f00 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c4878702a946a84d server_cookie=9845acaf2b8420f8 in_seq=0 out_seq=0 2024-05-14T15:31:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.558+0000 7fa6b3e00640 1 -- 172.21.15.69:0/1532497689 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560d79d77fd0 con 0x560d799fe1c0 2024-05-14T15:31:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.558+0000 7fa6b3e00640 10 client.26410 handle_command_reply: tid=0 2024-05-14T15:31:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.558+0000 7fa6dc403740 1 client.26410 shutdown 2024-05-14T15:31:13.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.558+0000 7fa6dc403740 1 -- 172.21.15.69:0/1532497689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a412f0 msgr2=0x560d79e3bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.558+0000 7fa6dc403740 1 --2- 172.21.15.69:0/1532497689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a412f0 0x560d79e3bdf0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0011d40 tx=0x7fa6c001c460 comp rx=0 tx=0).stop 2024-05-14T15:31:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.559+0000 7fa6dc403740 1 -- 172.21.15.69:0/1532497689 shutdown_connections 2024-05-14T15:31:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.559+0000 7fa6dc403740 1 --2- 172.21.15.69:0/1532497689 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560d799fe1c0 0x560d79ea1f00 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.559+0000 7fa6dc403740 1 --2- 172.21.15.69:0/1532497689 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560d79a6a1b0 0x560d79e38690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.559+0000 7fa6dc403740 1 --2- 172.21.15.69:0/1532497689 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560d79a494d0 0x560d79e38150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.559+0000 7fa6dc403740 1 --2- 172.21.15.69:0/1532497689 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560d79a412f0 0x560d79e3bdf0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.559+0000 7fa6dc403740 1 -- 172.21.15.69:0/1532497689 >> 172.21.15.69:0/1532497689 conn(0x560d79a5e300 msgr2=0x560d79e06a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.559+0000 7fa6b3e00640 0 client.26410 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:31:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.559+0000 7fa6dc403740 1 -- 172.21.15.69:0/1532497689 shutdown_connections 2024-05-14T15:31:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.559+0000 7fa6dc403740 1 -- 172.21.15.69:0/1532497689 wait complete. 2024-05-14T15:31:13.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.559+0000 7fa6dc403740 20 client.26410 trim_cache size 0 max 16384 2024-05-14T15:31:13.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:31:13.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:31:13.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:31:13.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:31:13.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.560+0000 7fa6d5400640 1 -- 172.21.15.69:0/2853203929 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa6b40b2aa0 msgr2=0x7fa6b40b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:13.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.560+0000 7fa6d5400640 1 --2- 172.21.15.69:0/2853203929 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa6b40b2aa0 0x7fa6b40b4fb0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0009fc0 tx=0x7fa6c0005f90 comp rx=0 tx=0).stop 2024-05-14T15:31:13.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.560+0000 7fa6d5400640 1 -- 172.21.15.69:0/2853203929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d01a0250 msgr2=0x7fa6d01a0660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:13.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.560+0000 7fa6d5400640 1 --2- 172.21.15.69:0/2853203929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d01a0250 0x7fa6d01a0660 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fa6c8009fd0 tx=0x7fa6c800ef10 comp rx=0 tx=0).stop 2024-05-14T15:31:13.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.561+0000 7fa6d5400640 1 -- 172.21.15.69:0/2853203929 shutdown_connections 2024-05-14T15:31:13.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.561+0000 7fa6d5400640 1 --2- 172.21.15.69:0/2853203929 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa6b40b2aa0 0x7fa6b40b4fb0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.561+0000 7fa6d5400640 1 --2- 172.21.15.69:0/2853203929 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa6d01a0250 0x7fa6d01a0660 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.561+0000 7fa6d5400640 1 --2- 172.21.15.69:0/2853203929 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa6d010e220 0x7fa6d01999d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.561+0000 7fa6d5400640 1 --2- 172.21.15.69:0/2853203929 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa6d0104e60 0x7fa6d0199490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:13.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.561+0000 7fa6d5400640 1 -- 172.21.15.69:0/2853203929 >> 172.21.15.69:0/2853203929 conn(0x7fa6d00782e0 msgr2=0x7fa6d010e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:13.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.561+0000 7fa6d5400640 1 -- 172.21.15.69:0/2853203929 shutdown_connections 2024-05-14T15:31:13.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:13.561+0000 7fa6d5400640 1 -- 172.21.15.69:0/2853203929 wait complete. 2024-05-14T15:31:14.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:13 smithi203 ceph-mon[34567]: pgmap v298: 129 pgs: 129 active+clean; 2.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.0 MiB/s wr, 649 op/s 2024-05-14T15:31:14.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:13 smithi092 ceph-mon[34729]: pgmap v298: 129 pgs: 129 active+clean; 2.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.0 MiB/s wr, 649 op/s 2024-05-14T15:31:14.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:13 smithi069 ceph-mon[31270]: pgmap v298: 129 pgs: 129 active+clean; 2.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.0 MiB/s wr, 649 op/s 2024-05-14T15:31:16.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:15 smithi203 ceph-mon[34567]: pgmap v299: 129 pgs: 129 active+clean; 2.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.6 MiB/s wr, 619 op/s 2024-05-14T15:31:16.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:15 smithi092 ceph-mon[34729]: pgmap v299: 129 pgs: 129 active+clean; 2.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.6 MiB/s wr, 619 op/s 2024-05-14T15:31:16.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:15 smithi069 ceph-mon[31270]: pgmap v299: 129 pgs: 129 active+clean; 2.6 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.6 MiB/s wr, 619 op/s 2024-05-14T15:31:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 330.0 s, 626.2 tps, lat 158.951 ms stddev 46.696 2024-05-14T15:31:18.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:17 smithi203 ceph-mon[34567]: pgmap v300: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.9 MiB/s wr, 622 op/s 2024-05-14T15:31:18.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:17 smithi092 ceph-mon[34729]: pgmap v300: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.9 MiB/s wr, 622 op/s 2024-05-14T15:31:18.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:17 smithi069 ceph-mon[31270]: pgmap v300: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.9 MiB/s wr, 622 op/s 2024-05-14T15:31:20.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:19 smithi203 ceph-mon[34567]: pgmap v301: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.9 MiB/s wr, 622 op/s 2024-05-14T15:31:20.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:19 smithi092 ceph-mon[34729]: pgmap v301: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.9 MiB/s wr, 622 op/s 2024-05-14T15:31:20.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:19 smithi069 ceph-mon[31270]: pgmap v301: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 5.9 MiB/s wr, 622 op/s 2024-05-14T15:31:21.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 335.0 s, 690.7 tps, lat 145.006 ms stddev 43.098 2024-05-14T15:31:22.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:21 smithi203 ceph-mon[34567]: pgmap v302: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.8 MiB/s wr, 619 op/s 2024-05-14T15:31:22.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:21 smithi092 ceph-mon[34729]: pgmap v302: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.8 MiB/s wr, 619 op/s 2024-05-14T15:31:22.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:21 smithi069 ceph-mon[31270]: pgmap v302: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 5.8 MiB/s wr, 619 op/s 2024-05-14T15:31:24.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:23 smithi203 ceph-mon[34567]: pgmap v303: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.0 MiB/s wr, 537 op/s 2024-05-14T15:31:24.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:23 smithi092 ceph-mon[34729]: pgmap v303: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.0 MiB/s wr, 537 op/s 2024-05-14T15:31:24.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:23 smithi069 ceph-mon[31270]: pgmap v303: 129 pgs: 129 active+clean; 2.7 GiB data, 14 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.0 MiB/s wr, 537 op/s 2024-05-14T15:31:26.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:25 smithi203 ceph-mon[34567]: pgmap v304: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.1 MiB/s wr, 762 op/s 2024-05-14T15:31:26.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:25 smithi092 ceph-mon[34729]: pgmap v304: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.1 MiB/s wr, 762 op/s 2024-05-14T15:31:26.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:25 smithi069 ceph-mon[31270]: pgmap v304: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.1 MiB/s wr, 762 op/s 2024-05-14T15:31:26.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 340.0 s, 679.8 tps, lat 147.076 ms stddev 44.379 2024-05-14T15:31:27.732 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.729+0000 7f8e63200640 1 -- 172.21.15.69:0/1601796607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e64107e30 msgr2=0x7f8e641082c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.729+0000 7f8e63200640 1 --2- 172.21.15.69:0/1601796607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e64107e30 0x7f8e641082c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c009ca0 tx=0x7f8e5c02a8f0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.729+0000 7f8e63200640 1 -- 172.21.15.69:0/1601796607 shutdown_connections 2024-05-14T15:31:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.729+0000 7f8e63200640 1 --2- 172.21.15.69:0/1601796607 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e64107e30 0x7f8e641082c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.729+0000 7f8e63200640 1 --2- 172.21.15.69:0/1601796607 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e64107400 0x7f8e64107810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.729+0000 7f8e63200640 1 --2- 172.21.15.69:0/1601796607 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e641029b0 0x7f8e64102dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.729+0000 7f8e63200640 1 -- 172.21.15.69:0/1601796607 >> 172.21.15.69:0/1601796607 conn(0x7f8e640fe220 msgr2=0x7f8e64100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:27.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.730+0000 7f8e63200640 1 -- 172.21.15.69:0/1601796607 shutdown_connections 2024-05-14T15:31:27.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.730+0000 7f8e63200640 1 -- 172.21.15.69:0/1601796607 wait complete. 2024-05-14T15:31:27.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.731+0000 7f8e63200640 1 Processor -- start 2024-05-14T15:31:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.732+0000 7f8e63200640 1 -- start start 2024-05-14T15:31:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.732+0000 7f8e63200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e641029b0 0x7f8e641a6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.732+0000 7f8e63200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e64107400 0x7f8e641a6ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.732+0000 7f8e63200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e64107e30 0x7f8e641a0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.732+0000 7f8e63200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6411a0f0 con 0x7f8e641029b0 2024-05-14T15:31:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.732+0000 7f8e63200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8e64119f70 con 0x7f8e64107e30 2024-05-14T15:31:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.732+0000 7f8e63200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6411a270 con 0x7f8e64107400 2024-05-14T15:31:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.733+0000 7f8e61e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e641029b0 0x7f8e641a6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.733+0000 7f8e61e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e641029b0 0x7f8e641a6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56572/0 (socket says 172.21.15.69:56572) 2024-05-14T15:31:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.733+0000 7f8e61e00640 1 -- 172.21.15.69:0/1695468582 learned_addr learned my addr 172.21.15.69:0/1695468582 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.733+0000 7f8e5be00640 1 --2- 172.21.15.69:0/1695468582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e64107400 0x7f8e641a6ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.733+0000 7f8e62800640 1 --2- 172.21.15.69:0/1695468582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e64107e30 0x7f8e641a0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.733+0000 7f8e61e00640 1 -- 172.21.15.69:0/1695468582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e64107400 msgr2=0x7f8e641a6ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:27.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.734+0000 7f8e61e00640 1 --2- 172.21.15.69:0/1695468582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e64107400 0x7f8e641a6ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.734+0000 7f8e61e00640 1 -- 172.21.15.69:0/1695468582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e64107e30 msgr2=0x7f8e641a0970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:27.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.734+0000 7f8e61e00640 1 --2- 172.21.15.69:0/1695468582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e64107e30 0x7f8e641a0970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.734+0000 7f8e61e00640 1 -- 172.21.15.69:0/1695468582 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e641a1010 con 0x7f8e641029b0 2024-05-14T15:31:27.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.735+0000 7f8e61e00640 1 --2- 172.21.15.69:0/1695468582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e641029b0 0x7f8e641a6760 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400e9f0 tx=0x7f8e5400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:27.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.737+0000 7f8e5aa00640 1 -- 172.21.15.69:0/1695468582 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5400cd80 con 0x7f8e641029b0 2024-05-14T15:31:27.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.737+0000 7f8e5aa00640 1 -- 172.21.15.69:0/1695468582 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e540108c0 con 0x7f8e641029b0 2024-05-14T15:31:27.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.737+0000 7f8e63200640 1 -- 172.21.15.69:0/1695468582 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e641a1300 con 0x7f8e641029b0 2024-05-14T15:31:27.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.737+0000 7f8e63200640 1 -- 172.21.15.69:0/1695468582 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e641ad5e0 con 0x7f8e641029b0 2024-05-14T15:31:27.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.737+0000 7f8e5aa00640 1 -- 172.21.15.69:0/1695468582 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e540187c0 con 0x7f8e641029b0 2024-05-14T15:31:27.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.741+0000 7f8e6fd7d740 1 Processor -- start 2024-05-14T15:31:27.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.742+0000 7f8e6fd7d740 1 -- start start 2024-05-14T15:31:27.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.742+0000 7f8e6fd7d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05e11b0 0x55f9a0982480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.742+0000 7f8e6fd7d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05b82f0 0x55f9a09829c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.742+0000 7f8e6fd7d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05c04d0 0x55f9a0982f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.742+0000 7f8e6fd7d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55f9a08e7550 con 0x55f9a05c04d0 2024-05-14T15:31:27.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.742+0000 7f8e6fd7d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f9a088cbc0 con 0x55f9a05b82f0 2024-05-14T15:31:27.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.742+0000 7f8e6fd7d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f9a08e3510 con 0x55f9a05e11b0 2024-05-14T15:31:27.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.743+0000 7f8e62800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05e11b0 0x55f9a0982480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.745+0000 7f8e62800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05e11b0 0x55f9a0982480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:52702/0 (socket says 172.21.15.69:52702) 2024-05-14T15:31:27.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.745+0000 7f8e62800640 1 -- 172.21.15.69:0/1917466044 learned_addr learned my addr 172.21.15.69:0/1917466044 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:27.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.745+0000 7f8e5be00640 1 --2- 172.21.15.69:0/1917466044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05c04d0 0x55f9a0982f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.745+0000 7f8e5aa00640 1 -- 172.21.15.69:0/1695468582 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f8e54010430 con 0x7f8e641029b0 2024-05-14T15:31:27.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.746+0000 7f8e61e00640 1 --2- 172.21.15.69:0/1917466044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05b82f0 0x55f9a09829c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.746+0000 7f8e5be00640 1 -- 172.21.15.69:0/1917466044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05e11b0 msgr2=0x55f9a0982480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:27.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.746+0000 7f8e5be00640 1 --2- 172.21.15.69:0/1917466044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05e11b0 0x55f9a0982480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.756 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.746+0000 7f8e5be00640 1 -- 172.21.15.69:0/1917466044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05b82f0 msgr2=0x55f9a09829c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:27.756 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.746+0000 7f8e5be00640 1 --2- 172.21.15.69:0/1917466044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05b82f0 0x55f9a09829c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.756 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.746+0000 7f8e5be00640 1 -- 172.21.15.69:0/1917466044 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9a05f9210 con 0x55f9a05c04d0 2024-05-14T15:31:27.756 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.747+0000 7f8e5be00640 1 --2- 172.21.15.69:0/1917466044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05c04d0 0x55f9a0982f00 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8e64106fb0 tx=0x7f8e4c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=834bab5bac91ad2b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:27.756 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.747+0000 7f8e53000640 1 -- 172.21.15.69:0/1917466044 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c004050 con 0x55f9a05c04d0 2024-05-14T15:31:27.756 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.748+0000 7f8e53000640 1 -- 172.21.15.69:0/1917466044 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e4c005020 con 0x55f9a05c04d0 2024-05-14T15:31:27.756 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.749+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/1917466044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05c04d0 msgr2=0x55f9a0982f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:27.756 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.749+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/1917466044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05c04d0 0x55f9a0982f00 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f8e64106fb0 tx=0x7f8e4c011810 comp rx=0 tx=0).stop 2024-05-14T15:31:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.750+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/1917466044 shutdown_connections 2024-05-14T15:31:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.750+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/1917466044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05c04d0 0x55f9a0982f00 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.750+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/1917466044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05b82f0 0x55f9a09829c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.750+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/1917466044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05e11b0 0x55f9a0982480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.750+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/1917466044 >> 172.21.15.69:0/1917466044 conn(0x55f9a05d5300 msgr2=0x55f9a097ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.750+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/1917466044 shutdown_connections 2024-05-14T15:31:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.751+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/1917466044 wait complete. 2024-05-14T15:31:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.751+0000 7f8e5aa00640 1 --2- 172.21.15.69:0/1695468582 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f8e480b29e0 0x7f8e480b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.751+0000 7f8e5be00640 1 --2- 172.21.15.69:0/1695468582 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f8e480b29e0 0x7f8e480b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.751+0000 7f8e6fd7d740 1 -- start start 2024-05-14T15:31:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.752+0000 7f8e5aa00640 1 -- 172.21.15.69:0/1695468582 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9554+0+0 (secure 0 0 0) 0x7f8e540e2d10 con 0x7f8e641029b0 2024-05-14T15:31:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.752+0000 7f8e6fd7d740 1 Processor -- start 2024-05-14T15:31:27.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.753+0000 7f8e5be00640 1 --2- 172.21.15.69:0/1695468582 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f8e480b29e0 0x7f8e480b4ef0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00a010 tx=0x7f8e4c0096a0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.753+0000 7f8e6fd7d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05b82f0 0x55f9a098c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.753+0000 7f8e6fd7d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05c04d0 0x55f9a098cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.753+0000 7f8e6fd7d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05e11b0 0x55f9a09a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.753+0000 7f8e6fd7d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55f9a09a0610 con 0x55f9a05e11b0 2024-05-14T15:31:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.753+0000 7f8e6fd7d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55f9a08a0660 con 0x55f9a05b82f0 2024-05-14T15:31:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.753+0000 7f8e6fd7d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55f9a09a0790 con 0x55f9a05c04d0 2024-05-14T15:31:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.753+0000 7f8e6fd7d740 10 client.0 _ll_register_callbacks cb 0x55f9a086a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:31:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.754+0000 7f8e61e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05b82f0 0x55f9a098c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.755+0000 7f8e61e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05b82f0 0x55f9a098c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:43888/0 (socket says 172.21.15.69:43888) 2024-05-14T15:31:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.755+0000 7f8e61e00640 1 -- 172.21.15.69:0/3667558032 learned_addr learned my addr 172.21.15.69:0/3667558032 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:27.759 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.755+0000 7f8e62800640 1 --2- 172.21.15.69:0/3667558032 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05e11b0 0x55f9a09a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.755+0000 7f8e5be00640 1 --2- 172.21.15.69:0/3667558032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05c04d0 0x55f9a098cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.755+0000 7f8e61e00640 1 -- 172.21.15.69:0/3667558032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05c04d0 msgr2=0x55f9a098cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.755+0000 7f8e61e00640 1 --2- 172.21.15.69:0/3667558032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05c04d0 0x55f9a098cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.755+0000 7f8e61e00640 1 -- 172.21.15.69:0/3667558032 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05e11b0 msgr2=0x55f9a09a9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.755+0000 7f8e61e00640 1 --2- 172.21.15.69:0/3667558032 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05e11b0 0x55f9a09a9ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.755+0000 7f8e61e00640 1 -- 172.21.15.69:0/3667558032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9a06c5620 con 0x55f9a05b82f0 2024-05-14T15:31:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.756+0000 7f8e61e00640 1 --2- 172.21.15.69:0/3667558032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05b82f0 0x55f9a098c650 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400e9c0 tx=0x7f8e540a5c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ca174f38584a2f9e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.756+0000 7f8e47400640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:31:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.756+0000 7f8e47400640 1 -- 172.21.15.69:0/3667558032 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e540a9740 con 0x55f9a05b82f0 2024-05-14T15:31:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.757+0000 7f8e47400640 1 -- 172.21.15.69:0/3667558032 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9554+0+0 (secure 0 0 0) 0x7f8e540a6220 con 0x55f9a05b82f0 2024-05-14T15:31:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.757+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/3667558032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e4c005020 con 0x55f9a05b82f0 2024-05-14T15:31:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.757+0000 7f8e47400640 1 -- 172.21.15.69:0/3667558032 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f8e540a9c30 con 0x55f9a05b82f0 2024-05-14T15:31:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.758+0000 7f8e6fd7d740 10 client.36446 fetch_fsmap learned FSMap version 62 2024-05-14T15:31:27.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.758+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/3667558032 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55f9a09ac830 con 0x55f9a05b82f0 2024-05-14T15:31:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.758+0000 7f8e47400640 1 -- 172.21.15.69:0/3667558032 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e540adf30 con 0x55f9a05b82f0 2024-05-14T15:31:27.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.759+0000 7f8e47400640 1 -- 172.21.15.69:0/3667558032 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f8e540a55a0 con 0x55f9a05b82f0 2024-05-14T15:31:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.759+0000 7f8e6fd7d740 10 client.36446 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:31:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.759+0000 7f8e6fd7d740 10 client.36446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:31:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.759+0000 7f8e6fd7d740 20 client.36446 populate_metadata read hostname 'smithi069' 2024-05-14T15:31:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.759+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/3667558032 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55f9a059fd80 0x55f9a09afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.759+0000 7f8e6fd7d740 4 client.36446 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:31:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.759+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/3667558032 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f8e4c005020 con 0x55f9a059fd80 2024-05-14T15:31:27.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.760+0000 7f8e5be00640 1 --2- 172.21.15.69:0/3667558032 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55f9a059fd80 0x55f9a09afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.761+0000 7f8e5be00640 1 --2- 172.21.15.69:0/3667558032 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55f9a059fd80 0x55f9a09afdb0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26663f88ec12234a server_cookie=2a1b6a7db36baf44 in_seq=0 out_seq=0 2024-05-14T15:31:27.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.761+0000 7f8e47400640 10 client.36446 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:31:27.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.763+0000 7f8e47400640 1 -- 172.21.15.69:0/3667558032 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f8e4c005020 con 0x55f9a059fd80 2024-05-14T15:31:27.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.763+0000 7f8e47400640 10 client.36446 handle_command_reply: tid=0 2024-05-14T15:31:27.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.764+0000 7f8e6fd7d740 1 client.36446 shutdown 2024-05-14T15:31:27.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.764+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/3667558032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05b82f0 msgr2=0x55f9a098c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:27.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.764+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/3667558032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05b82f0 0x55f9a098c650 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400e9c0 tx=0x7f8e540a5c00 comp rx=0 tx=0).stop 2024-05-14T15:31:27.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.764+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/3667558032 shutdown_connections 2024-05-14T15:31:27.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.764+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/3667558032 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55f9a059fd80 0x55f9a09afdb0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.764+0000 7f8e47400640 0 client.36446 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:31:27.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.764+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/3667558032 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05e11b0 0x55f9a09a9ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.764+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/3667558032 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05c04d0 0x55f9a098cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.764+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/3667558032 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05b82f0 0x55f9a098c650 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.764+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/3667558032 >> 172.21.15.69:0/3667558032 conn(0x55f9a05d5300 msgr2=0x55f9a09841a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:27.768 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.765+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/3667558032 shutdown_connections 2024-05-14T15:31:27.768 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.765+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/3667558032 wait complete. 2024-05-14T15:31:27.768 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.765+0000 7f8e6fd7d740 20 client.36446 trim_cache size 0 max 16384 2024-05-14T15:31:27.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.795+0000 7f8e6fd7d740 1 Processor -- start 2024-05-14T15:31:27.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.796+0000 7f8e6fd7d740 1 -- start start 2024-05-14T15:31:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.796+0000 7f8e6fd7d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05b82f0 0x55f9a098e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.796+0000 7f8e6fd7d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05c04d0 0x55f9a09847d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.796+0000 7f8e6fd7d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05e11b0 0x55f9a09b55b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.796+0000 7f8e6fd7d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8e40010070 con 0x55f9a05b82f0 2024-05-14T15:31:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.796+0000 7f8e6fd7d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8e40011bb0 con 0x55f9a05e11b0 2024-05-14T15:31:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.796+0000 7f8e6fd7d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8e40010740 con 0x55f9a05c04d0 2024-05-14T15:31:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.797+0000 7f8e5be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05c04d0 0x55f9a09847d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.797+0000 7f8e62800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05e11b0 0x55f9a09b55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.797+0000 7f8e62800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05e11b0 0x55f9a09b55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:43896/0 (socket says 172.21.15.69:43896) 2024-05-14T15:31:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.797+0000 7f8e62800640 1 -- 172.21.15.69:0/2467683617 learned_addr learned my addr 172.21.15.69:0/2467683617 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.797+0000 7f8e61e00640 1 --2- 172.21.15.69:0/2467683617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05b82f0 0x55f9a098e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.798+0000 7f8e61e00640 1 -- 172.21.15.69:0/2467683617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05c04d0 msgr2=0x55f9a09847d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.798+0000 7f8e61e00640 1 --2- 172.21.15.69:0/2467683617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05c04d0 0x55f9a09847d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.798+0000 7f8e61e00640 1 -- 172.21.15.69:0/2467683617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05e11b0 msgr2=0x55f9a09b55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.798+0000 7f8e61e00640 1 --2- 172.21.15.69:0/2467683617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05e11b0 0x55f9a09b55b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.798+0000 7f8e61e00640 1 -- 172.21.15.69:0/2467683617 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9a097f820 con 0x55f9a05b82f0 2024-05-14T15:31:27.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.799+0000 7f8e61e00640 1 --2- 172.21.15.69:0/2467683617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05b82f0 0x55f9a098e7a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8e540a9df0 tx=0x7f8e54000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d0a6bd07a30a446 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:27.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.808+0000 7f8e52600640 1 -- 172.21.15.69:0/2467683617 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e540c8070 con 0x55f9a05b82f0 2024-05-14T15:31:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.808+0000 7f8e52600640 1 -- 172.21.15.69:0/2467683617 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e540adf30 con 0x55f9a05b82f0 2024-05-14T15:31:27.811 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.808+0000 7f8e52600640 1 -- 172.21.15.69:0/2467683617 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e540c8070 con 0x55f9a05b82f0 2024-05-14T15:31:27.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.810+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/2467683617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05b82f0 msgr2=0x55f9a098e7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:27.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.810+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/2467683617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05b82f0 0x55f9a098e7a0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f8e540a9df0 tx=0x7f8e54000bc0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.811+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/2467683617 shutdown_connections 2024-05-14T15:31:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.811+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/2467683617 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05e11b0 0x55f9a09b55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.811+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/2467683617 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05c04d0 0x55f9a09847d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.811+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/2467683617 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05b82f0 0x55f9a098e7a0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.811+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/2467683617 >> 172.21.15.69:0/2467683617 conn(0x55f9a05d5300 msgr2=0x55f9a09840c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:27.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.811+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/2467683617 shutdown_connections 2024-05-14T15:31:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.811+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/2467683617 wait complete. 2024-05-14T15:31:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.812+0000 7f8e6fd7d740 1 -- start start 2024-05-14T15:31:27.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.812+0000 7f8e6fd7d740 1 Processor -- start 2024-05-14T15:31:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.813+0000 7f8e6fd7d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05b82f0 0x55f9a09a5f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.813+0000 7f8e6fd7d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05c04d0 0x55f9a09a12e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.814+0000 7f8e6fd7d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05e11b0 0x55f9a09a1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.814+0000 7f8e6fd7d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f8e400114e0 con 0x55f9a05e11b0 2024-05-14T15:31:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.814+0000 7f8e6fd7d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f8e40010e10 con 0x55f9a05c04d0 2024-05-14T15:31:27.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.814+0000 7f8e5be00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05c04d0 0x55f9a09a12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.815+0000 7f8e5be00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05c04d0 0x55f9a09a12e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:43912/0 (socket says 172.21.15.69:43912) 2024-05-14T15:31:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.815+0000 7f8e5be00640 1 -- 172.21.15.69:0/4219930010 learned_addr learned my addr 172.21.15.69:0/4219930010 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.815+0000 7f8e61e00640 1 --2- 172.21.15.69:0/4219930010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05b82f0 0x55f9a09a5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.815+0000 7f8e62800640 1 --2- 172.21.15.69:0/4219930010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05e11b0 0x55f9a09a1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.815+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/4219930010 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4000e070 con 0x55f9a05b82f0 2024-05-14T15:31:27.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.815+0000 7f8e6fd7d740 10 client.0 _ll_register_callbacks cb 0x7f8e540a9580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:31:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.816+0000 7f8e5be00640 1 -- 172.21.15.69:0/4219930010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05b82f0 msgr2=0x55f9a09a5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.816+0000 7f8e5be00640 1 --2- 172.21.15.69:0/4219930010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05b82f0 0x55f9a09a5f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.816+0000 7f8e5be00640 1 -- 172.21.15.69:0/4219930010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05e11b0 msgr2=0x55f9a09a1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.816+0000 7f8e5be00640 1 --2- 172.21.15.69:0/4219930010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05e11b0 0x55f9a09a1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.816+0000 7f8e5be00640 1 -- 172.21.15.69:0/4219930010 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9a09a1e60 con 0x55f9a05c04d0 2024-05-14T15:31:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.817+0000 7f8e5be00640 1 --2- 172.21.15.69:0/4219930010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05c04d0 0x55f9a09a12e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c011d10 tx=0x7f8e4c005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1059597872c8710 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:27.820 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.817+0000 7f8e47400640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:31:27.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.819+0000 7f8e47400640 1 -- 172.21.15.69:0/4219930010 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e4c004e60 con 0x55f9a05c04d0 2024-05-14T15:31:27.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.819+0000 7f8e47400640 1 -- 172.21.15.69:0/4219930010 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9554+0+0 (secure 0 0 0) 0x7f8e4c0035f0 con 0x55f9a05c04d0 2024-05-14T15:31:27.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.819+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/4219930010 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8e540adf30 con 0x55f9a05c04d0 2024-05-14T15:31:27.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.819+0000 7f8e47400640 1 -- 172.21.15.69:0/4219930010 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f8e4c047050 con 0x55f9a05c04d0 2024-05-14T15:31:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.819+0000 7f8e6fd7d740 10 client.36452 fetch_fsmap learned FSMap version 62 2024-05-14T15:31:27.822 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.819+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/4219930010 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55f9a0a17f60 con 0x55f9a05c04d0 2024-05-14T15:31:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.820+0000 7f8e47400640 1 -- 172.21.15.69:0/4219930010 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8e540adf30 con 0x55f9a05c04d0 2024-05-14T15:31:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.820+0000 7f8e47400640 1 -- 172.21.15.69:0/4219930010 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f8e4c038460 con 0x55f9a05c04d0 2024-05-14T15:31:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.820+0000 7f8e6fd7d740 10 client.36452 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:31:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.820+0000 7f8e6fd7d740 10 client.36452 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:31:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.820+0000 7f8e6fd7d740 20 client.36452 populate_metadata read hostname 'smithi069' 2024-05-14T15:31:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.820+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/4219930010 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55f9a05751c0 0x55f9a0a1a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.820+0000 7f8e6fd7d740 4 client.36452 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:31:27.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.820+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/4219930010 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55f9a08f5160 con 0x55f9a05751c0 2024-05-14T15:31:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.821+0000 7f8e61e00640 1 --2- 172.21.15.69:0/4219930010 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55f9a05751c0 0x55f9a0a1a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.822+0000 7f8e61e00640 1 --2- 172.21.15.69:0/4219930010 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55f9a05751c0 0x55f9a0a1a590 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=98c3252f84727678 server_cookie=4d08bf25be58c6f4 in_seq=0 out_seq=0 2024-05-14T15:31:27.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.822+0000 7f8e47400640 10 client.36452 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:31:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.854+0000 7f8e47400640 1 -- 172.21.15.69:0/4219930010 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55f9a08f5160 con 0x55f9a05751c0 2024-05-14T15:31:27.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.854+0000 7f8e47400640 10 client.36452 handle_command_reply: tid=0 2024-05-14T15:31:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.854+0000 7f8e6fd7d740 1 client.36452 shutdown 2024-05-14T15:31:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.854+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/4219930010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05c04d0 msgr2=0x55f9a09a12e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:27.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.854+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/4219930010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05c04d0 0x55f9a09a12e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c011d10 tx=0x7f8e4c005f90 comp rx=0 tx=0).stop 2024-05-14T15:31:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.855+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/4219930010 shutdown_connections 2024-05-14T15:31:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.855+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/4219930010 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55f9a05751c0 0x55f9a0a1a590 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.855+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/4219930010 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55f9a05e11b0 0x55f9a09a1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.855+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/4219930010 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55f9a05c04d0 0x55f9a09a12e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.855+0000 7f8e6fd7d740 1 --2- 172.21.15.69:0/4219930010 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55f9a05b82f0 0x55f9a09a5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.855+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/4219930010 >> 172.21.15.69:0/4219930010 conn(0x55f9a05d5300 msgr2=0x55f9a097d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.856+0000 7f8e47400640 0 client.36452 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:31:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.856+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/4219930010 shutdown_connections 2024-05-14T15:31:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.856+0000 7f8e6fd7d740 1 -- 172.21.15.69:0/4219930010 wait complete. 2024-05-14T15:31:27.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.857+0000 7f8e6fd7d740 20 client.36452 trim_cache size 0 max 16384 2024-05-14T15:31:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:31:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:31:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:31:27.860 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:31:27.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.858+0000 7f8e63200640 1 -- 172.21.15.69:0/1695468582 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f8e480b29e0 msgr2=0x7f8e480b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.858+0000 7f8e63200640 1 --2- 172.21.15.69:0/1695468582 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f8e480b29e0 0x7f8e480b4ef0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c00a010 tx=0x7f8e4c0096a0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.858+0000 7f8e63200640 1 -- 172.21.15.69:0/1695468582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e641029b0 msgr2=0x7f8e641a6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.858+0000 7f8e63200640 1 --2- 172.21.15.69:0/1695468582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e641029b0 0x7f8e641a6760 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f8e5400e9f0 tx=0x7f8e5400eeb0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.859+0000 7f8e63200640 1 -- 172.21.15.69:0/1695468582 shutdown_connections 2024-05-14T15:31:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.859+0000 7f8e63200640 1 --2- 172.21.15.69:0/1695468582 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f8e480b29e0 0x7f8e480b4ef0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.859+0000 7f8e63200640 1 --2- 172.21.15.69:0/1695468582 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f8e64107e30 0x7f8e641a0970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.859+0000 7f8e63200640 1 --2- 172.21.15.69:0/1695468582 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f8e64107400 0x7f8e641a6ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.859+0000 7f8e63200640 1 --2- 172.21.15.69:0/1695468582 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f8e641029b0 0x7f8e641a6760 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.859+0000 7f8e63200640 1 -- 172.21.15.69:0/1695468582 >> 172.21.15.69:0/1695468582 conn(0x7f8e640fe220 msgr2=0x7f8e64104eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.859+0000 7f8e63200640 1 -- 172.21.15.69:0/1695468582 shutdown_connections 2024-05-14T15:31:27.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:27.859+0000 7f8e63200640 1 -- 172.21.15.69:0/1695468582 wait complete. 2024-05-14T15:31:28.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:27 smithi203 ceph-mon[34567]: pgmap v305: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.7 MiB/s wr, 721 op/s 2024-05-14T15:31:28.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:27 smithi092 ceph-mon[34729]: pgmap v305: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.7 MiB/s wr, 721 op/s 2024-05-14T15:31:28.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:27 smithi069 ceph-mon[31270]: pgmap v305: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 6.7 MiB/s wr, 721 op/s 2024-05-14T15:31:30.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:29 smithi203 ceph-mon[34567]: pgmap v306: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.5 MiB/s wr, 604 op/s 2024-05-14T15:31:30.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:29 smithi092 ceph-mon[34729]: pgmap v306: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.5 MiB/s wr, 604 op/s 2024-05-14T15:31:30.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:29 smithi069 ceph-mon[31270]: pgmap v306: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 5.5 MiB/s wr, 604 op/s 2024-05-14T15:31:31.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 345.0 s, 592.4 tps, lat 168.752 ms stddev 56.175 2024-05-14T15:31:32.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:31 smithi203 ceph-mon[34567]: pgmap v307: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.0 MiB/s wr, 879 op/s 2024-05-14T15:31:32.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:31 smithi092 ceph-mon[34729]: pgmap v307: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.0 MiB/s wr, 879 op/s 2024-05-14T15:31:32.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:31 smithi069 ceph-mon[31270]: pgmap v307: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 8.0 MiB/s wr, 879 op/s 2024-05-14T15:31:33.098 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:32 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:31:33.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:32 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:31:33.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:32 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:31:34.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:33 smithi203 ceph-mon[34567]: pgmap v308: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.4 MiB/s wr, 601 op/s 2024-05-14T15:31:34.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:33 smithi092 ceph-mon[34729]: pgmap v308: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.4 MiB/s wr, 601 op/s 2024-05-14T15:31:34.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:33 smithi069 ceph-mon[31270]: pgmap v308: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.4 MiB/s wr, 601 op/s 2024-05-14T15:31:36.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:35 smithi092 ceph-mon[34729]: pgmap v309: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 761 op/s 2024-05-14T15:31:36.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:35 smithi069 ceph-mon[31270]: pgmap v309: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 761 op/s 2024-05-14T15:31:36.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:35 smithi203 ceph-mon[34567]: pgmap v309: 129 pgs: 129 active+clean; 2.7 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.9 MiB/s wr, 761 op/s 2024-05-14T15:31:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 350.0 s, 609.8 tps, lat 163.991 ms stddev 48.067 2024-05-14T15:31:37.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:36 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:31:37.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:36 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:31:37.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:36 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:31:37.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:36 smithi092 ceph-mon[34729]: pgmap v310: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.6 MiB/s wr, 628 op/s 2024-05-14T15:31:37.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:36 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:31:37.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:36 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:31:37.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:36 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:31:37.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:36 smithi069 ceph-mon[31270]: pgmap v310: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.6 MiB/s wr, 628 op/s 2024-05-14T15:31:37.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:36 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:31:37.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:36 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:31:37.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:36 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:31:37.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:36 smithi203 ceph-mon[34567]: pgmap v310: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.6 MiB/s wr, 628 op/s 2024-05-14T15:31:39.476 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:39 smithi069 ceph-mon[31270]: pgmap v311: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 527 op/s 2024-05-14T15:31:39.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:39 smithi203 ceph-mon[34567]: pgmap v311: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 527 op/s 2024-05-14T15:31:39.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:39 smithi092 ceph-mon[34729]: pgmap v311: 129 pgs: 129 active+clean; 2.8 GiB data, 15 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 4.8 MiB/s wr, 527 op/s 2024-05-14T15:31:41.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 355.0 s, 575.0 tps, lat 173.092 ms stddev 94.032 2024-05-14T15:31:41.475 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:41 smithi069 ceph-mon[31270]: pgmap v312: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.2 MiB/s wr, 794 op/s 2024-05-14T15:31:41.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:41 smithi203 ceph-mon[34567]: pgmap v312: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.2 MiB/s wr, 794 op/s 2024-05-14T15:31:41.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:41 smithi092 ceph-mon[34729]: pgmap v312: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 7.2 MiB/s wr, 794 op/s 2024-05-14T15:31:43.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.045+0000 7f16c9a00640 1 -- 172.21.15.69:0/330656207 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16c410ecd0 msgr2=0x7f16c410f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.045+0000 7f16c9a00640 1 --2- 172.21.15.69:0/330656207 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16c410ecd0 0x7f16c410f100 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009860 tx=0x7f16b402a340 comp rx=0 tx=0).stop 2024-05-14T15:31:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.045+0000 7f16c9a00640 1 -- 172.21.15.69:0/330656207 shutdown_connections 2024-05-14T15:31:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.045+0000 7f16c9a00640 1 --2- 172.21.15.69:0/330656207 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c410f790 0x7f16c4116f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.045+0000 7f16c9a00640 1 --2- 172.21.15.69:0/330656207 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16c410ecd0 0x7f16c410f100 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.045+0000 7f16c9a00640 1 --2- 172.21.15.69:0/330656207 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16c410a740 0x7f16c410ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.045+0000 7f16c9a00640 1 -- 172.21.15.69:0/330656207 >> 172.21.15.69:0/330656207 conn(0x7f16c406fba0 msgr2=0x7f16c406ffe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:43.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.046+0000 7f16c9a00640 1 -- 172.21.15.69:0/330656207 shutdown_connections 2024-05-14T15:31:43.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.048+0000 7f16c9a00640 1 -- 172.21.15.69:0/330656207 wait complete. 2024-05-14T15:31:43.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.050+0000 7f16c9a00640 1 Processor -- start 2024-05-14T15:31:43.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.051+0000 7f16c9a00640 1 -- start start 2024-05-14T15:31:43.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.052+0000 7f16c9a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16c410a740 0x7f16c41a4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.052+0000 7f16c9a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c410ecd0 0x7f16c41a5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.052+0000 7f16c9a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16c410f790 0x7f16c41a9800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.052+0000 7f16c9a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f16c411e540 con 0x7f16c410f790 2024-05-14T15:31:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.052+0000 7f16c9a00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f16c411e3c0 con 0x7f16c410ecd0 2024-05-14T15:31:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.052+0000 7f16c9a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f16c411e6c0 con 0x7f16c410a740 2024-05-14T15:31:43.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.052+0000 7f16c9000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16c410f790 0x7f16c41a9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.052+0000 7f16c9000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16c410f790 0x7f16c41a9800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:53200/0 (socket says 172.21.15.69:53200) 2024-05-14T15:31:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.052+0000 7f16c9000640 1 -- 172.21.15.69:0/627904180 learned_addr learned my addr 172.21.15.69:0/627904180 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.052+0000 7f16c3e00640 1 --2- 172.21.15.69:0/627904180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16c410a740 0x7f16c41a4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.053+0000 7f16bb400640 1 --2- 172.21.15.69:0/627904180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c410ecd0 0x7f16c41a5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.054+0000 7f16c9000640 1 -- 172.21.15.69:0/627904180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16c410a740 msgr2=0x7f16c41a4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.054+0000 7f16c9000640 1 --2- 172.21.15.69:0/627904180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16c410a740 0x7f16c41a4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.054+0000 7f16c9000640 1 -- 172.21.15.69:0/627904180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c410ecd0 msgr2=0x7f16c41a5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.054+0000 7f16c9000640 1 --2- 172.21.15.69:0/627904180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c410ecd0 0x7f16c41a5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.054+0000 7f16c9000640 1 -- 172.21.15.69:0/627904180 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16c41a9e40 con 0x7f16c410f790 2024-05-14T15:31:43.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.055+0000 7f16c9000640 1 --2- 172.21.15.69:0/627904180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16c410f790 0x7f16c41a9800 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009e20 tx=0x7f16bc00e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:43.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.057+0000 7f16c1600640 1 -- 172.21.15.69:0/627904180 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc004b20 con 0x7f16c410f790 2024-05-14T15:31:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.057+0000 7f16c1600640 1 -- 172.21.15.69:0/627904180 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16bc004cc0 con 0x7f16c410f790 2024-05-14T15:31:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.057+0000 7f16c1600640 1 -- 172.21.15.69:0/627904180 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc005740 con 0x7f16c410f790 2024-05-14T15:31:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.057+0000 7f16c9a00640 1 -- 172.21.15.69:0/627904180 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16c41aa130 con 0x7f16c410f790 2024-05-14T15:31:43.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.057+0000 7f16c9a00640 1 -- 172.21.15.69:0/627904180 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16c41aa600 con 0x7f16c410f790 2024-05-14T15:31:43.071 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.068+0000 7f16d2071740 1 Processor -- start 2024-05-14T15:31:43.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.070+0000 7f16d2071740 1 -- start start 2024-05-14T15:31:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.071+0000 7f16c1600640 1 -- 172.21.15.69:0/627904180 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f16bc01b020 con 0x7f16c410f790 2024-05-14T15:31:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.071+0000 7f16d2071740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2c5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.071+0000 7f16d2071740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588ccefb2f0 0x5588cd2c5990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.071+0000 7f16d2071740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccf034d0 0x5588cd2c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.071+0000 7f16d2071740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5588cd22a550 con 0x5588ccefb2f0 2024-05-14T15:31:43.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.071+0000 7f16d2071740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5588cd1cfbc0 con 0x5588ccf034d0 2024-05-14T15:31:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.071+0000 7f16d2071740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5588cd226510 con 0x5588ccf241b0 2024-05-14T15:31:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.072+0000 7f16bb400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2c5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.072+0000 7f16bb400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2c5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:45338/0 (socket says 172.21.15.69:45338) 2024-05-14T15:31:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.072+0000 7f16bb400640 1 -- 172.21.15.69:0/402934520 learned_addr learned my addr 172.21.15.69:0/402934520 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.072+0000 7f16bb400640 1 --2- 172.21.15.69:0/402934520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccf034d0 0x5588cd2c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.072+0000 7f16bb400640 1 -- 172.21.15.69:0/402934520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccf034d0 msgr2=0x5588cd2c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.072+0000 7f16bb400640 1 --2- 172.21.15.69:0/402934520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccf034d0 0x5588cd2c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.072+0000 7f16bb400640 1 -- 172.21.15.69:0/402934520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588ccefb2f0 msgr2=0x5588cd2c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.072+0000 7f16c3e00640 1 --2- 172.21.15.69:0/402934520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588ccefb2f0 0x5588cd2c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.072+0000 7f16bb400640 1 --2- 172.21.15.69:0/402934520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588ccefb2f0 0x5588cd2c5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.072+0000 7f16bb400640 1 -- 172.21.15.69:0/402934520 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588ccf3c210 con 0x5588ccf241b0 2024-05-14T15:31:43.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.073+0000 7f16c3e00640 1 --2- 172.21.15.69:0/402934520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588ccefb2f0 0x5588cd2c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:31:43.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.073+0000 7f16bb400640 1 --2- 172.21.15.69:0/402934520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2c5450 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009830 tx=0x7f16b4005c90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=307a99e94033af06 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:43.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.073+0000 7f16c1600640 1 --2- 172.21.15.69:0/627904180 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f16a80b2a50 0x7f16a80b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.073+0000 7f16b9600640 1 -- 172.21.15.69:0/402934520 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4037040 con 0x5588ccf241b0 2024-05-14T15:31:43.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.073+0000 7f16c1600640 1 -- 172.21.15.69:0/627904180 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9554+0+0 (secure 0 0 0) 0x7f16bc0e23b0 con 0x7f16c410f790 2024-05-14T15:31:43.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.073+0000 7f16b9600640 1 -- 172.21.15.69:0/402934520 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16b40307d0 con 0x5588ccf241b0 2024-05-14T15:31:43.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.073+0000 7f16b9600640 1 -- 172.21.15.69:0/402934520 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4003980 con 0x5588ccf241b0 2024-05-14T15:31:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.074+0000 7f16c3e00640 1 --2- 172.21.15.69:0/627904180 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f16a80b2a50 0x7f16a80b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.074+0000 7f16d2071740 1 -- 172.21.15.69:0/402934520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 msgr2=0x5588cd2c5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.075+0000 7f16d2071740 1 --2- 172.21.15.69:0/402934520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2c5450 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009830 tx=0x7f16b4005c90 comp rx=0 tx=0).stop 2024-05-14T15:31:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.075+0000 7f16d2071740 1 -- 172.21.15.69:0/402934520 shutdown_connections 2024-05-14T15:31:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.075+0000 7f16d2071740 1 --2- 172.21.15.69:0/402934520 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccf034d0 0x5588cd2c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.075+0000 7f16d2071740 1 --2- 172.21.15.69:0/402934520 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588ccefb2f0 0x5588cd2c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.075+0000 7f16d2071740 1 --2- 172.21.15.69:0/402934520 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2c5450 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.075+0000 7f16d2071740 1 -- 172.21.15.69:0/402934520 >> 172.21.15.69:0/402934520 conn(0x5588ccf18300 msgr2=0x5588cd2c1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.075+0000 7f16c3e00640 1 --2- 172.21.15.69:0/627904180 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f16a80b2a50 0x7f16a80b4f60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00a550 tx=0x7f16ac00a480 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.075+0000 7f16d2071740 1 -- 172.21.15.69:0/402934520 shutdown_connections 2024-05-14T15:31:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.075+0000 7f16d2071740 1 -- 172.21.15.69:0/402934520 wait complete. 2024-05-14T15:31:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.076+0000 7f16d2071740 1 -- start start 2024-05-14T15:31:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.076+0000 7f16d2071740 1 Processor -- start 2024-05-14T15:31:43.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.077+0000 7f16d2071740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccefb2f0 0x5588cd2cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.077+0000 7f16d2071740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccf034d0 0x5588cd2cff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.077+0000 7f16d2071740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588ccf241b0 0x5588cd2db9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.077+0000 7f16d2071740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5588cd2d2520 con 0x5588ccf241b0 2024-05-14T15:31:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.077+0000 7f16d2071740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5588cd1e3660 con 0x5588ccf034d0 2024-05-14T15:31:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.077+0000 7f16d2071740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5588cd2d26a0 con 0x5588ccefb2f0 2024-05-14T15:31:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.077+0000 7f16d2071740 10 client.0 _ll_register_callbacks cb 0x5588cd1ad400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:31:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.077+0000 7f16c3e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccefb2f0 0x5588cd2cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.078+0000 7f16c3e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccefb2f0 0x5588cd2cf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:45348/0 (socket says 172.21.15.69:45348) 2024-05-14T15:31:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.078+0000 7f16c3e00640 1 -- 172.21.15.69:0/2260217387 learned_addr learned my addr 172.21.15.69:0/2260217387 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:43.080 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.078+0000 7f16c9000640 1 --2- 172.21.15.69:0/2260217387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588ccf241b0 0x5588cd2db9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.078+0000 7f16bb400640 1 --2- 172.21.15.69:0/2260217387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccf034d0 0x5588cd2cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.079+0000 7f16bb400640 1 -- 172.21.15.69:0/2260217387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccefb2f0 msgr2=0x5588cd2cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:43.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.079+0000 7f16bb400640 1 --2- 172.21.15.69:0/2260217387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccefb2f0 0x5588cd2cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.079+0000 7f16bb400640 1 -- 172.21.15.69:0/2260217387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588ccf241b0 msgr2=0x5588cd2db9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:43.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.080+0000 7f16bb400640 1 --2- 172.21.15.69:0/2260217387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588ccf241b0 0x5588cd2db9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.080+0000 7f16bb400640 1 -- 172.21.15.69:0/2260217387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588cd008620 con 0x5588ccf034d0 2024-05-14T15:31:43.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.080+0000 7f16c9000640 1 --2- 172.21.15.69:0/2260217387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588ccf241b0 0x5588cd2db9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:31:43.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.080+0000 7f16bb400640 1 --2- 172.21.15.69:0/2260217387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccf034d0 0x5588cd2cff00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009830 tx=0x7f16b4030ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=92f65a768b832c0b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:43.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.080+0000 7f16b2000640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:31:43.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.081+0000 7f16b2000640 1 -- 172.21.15.69:0/2260217387 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4037040 con 0x5588ccf034d0 2024-05-14T15:31:43.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.081+0000 7f16b2000640 1 -- 172.21.15.69:0/2260217387 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9554+0+0 (secure 0 0 0) 0x7f16b4004320 con 0x5588ccf034d0 2024-05-14T15:31:43.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.081+0000 7f16d2071740 1 -- 172.21.15.69:0/2260217387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16b40307d0 con 0x5588ccf034d0 2024-05-14T15:31:43.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.082+0000 7f16b2000640 1 -- 172.21.15.69:0/2260217387 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f16b4059050 con 0x5588ccf034d0 2024-05-14T15:31:43.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.082+0000 7f16d2071740 10 client.36464 fetch_fsmap learned FSMap version 62 2024-05-14T15:31:43.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.082+0000 7f16d2071740 1 -- 172.21.15.69:0/2260217387 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5588cd2de740 con 0x5588ccf034d0 2024-05-14T15:31:43.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.082+0000 7f16b2000640 1 -- 172.21.15.69:0/2260217387 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16b40307d0 con 0x5588ccf034d0 2024-05-14T15:31:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.083+0000 7f16b2000640 1 -- 172.21.15.69:0/2260217387 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f16b4054030 con 0x5588ccf034d0 2024-05-14T15:31:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.084+0000 7f16d2071740 10 client.36464 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:31:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.084+0000 7f16d2071740 10 client.36464 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:31:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.084+0000 7f16d2071740 20 client.36464 populate_metadata read hostname 'smithi069' 2024-05-14T15:31:43.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.084+0000 7f16d2071740 1 --2- 172.21.15.69:0/2260217387 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5588ccee2d80 0x5588cd2e1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.084+0000 7f16d2071740 4 client.36464 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:31:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.084+0000 7f16d2071740 1 -- 172.21.15.69:0/2260217387 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5588cd238160 con 0x5588ccee2d80 2024-05-14T15:31:43.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.084+0000 7f16c3e00640 1 --2- 172.21.15.69:0/2260217387 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5588ccee2d80 0x5588cd2e1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.085+0000 7f16b2000640 10 client.36464 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:31:43.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.086+0000 7f16c3e00640 1 --2- 172.21.15.69:0/2260217387 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5588ccee2d80 0x5588cd2e1aa0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f57f1090fc5f83d server_cookie=5c4a2c5e22269415 in_seq=0 out_seq=0 2024-05-14T15:31:43.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.088+0000 7f16b2000640 1 -- 172.21.15.69:0/2260217387 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5588cd238160 con 0x5588ccee2d80 2024-05-14T15:31:43.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.088+0000 7f16b2000640 10 client.36464 handle_command_reply: tid=0 2024-05-14T15:31:43.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.088+0000 7f16d2071740 1 client.36464 shutdown 2024-05-14T15:31:43.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.089+0000 7f16d2071740 1 -- 172.21.15.69:0/2260217387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccf034d0 msgr2=0x5588cd2cff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.089+0000 7f16d2071740 1 --2- 172.21.15.69:0/2260217387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccf034d0 0x5588cd2cff00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009830 tx=0x7f16b4030ab0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.089+0000 7f16d2071740 1 -- 172.21.15.69:0/2260217387 shutdown_connections 2024-05-14T15:31:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.089+0000 7f16d2071740 1 --2- 172.21.15.69:0/2260217387 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5588ccee2d80 0x5588cd2e1aa0 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.089+0000 7f16d2071740 1 --2- 172.21.15.69:0/2260217387 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588ccf241b0 0x5588cd2db9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.089+0000 7f16d2071740 1 --2- 172.21.15.69:0/2260217387 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccf034d0 0x5588cd2cff00 secure :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009830 tx=0x7f16b4030ab0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.089+0000 7f16d2071740 1 --2- 172.21.15.69:0/2260217387 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccefb2f0 0x5588cd2cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.089+0000 7f16b2000640 0 client.36464 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:31:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.089+0000 7f16d2071740 1 -- 172.21.15.69:0/2260217387 >> 172.21.15.69:0/2260217387 conn(0x5588ccf18300 msgr2=0x5588cd2c5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:43.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.090+0000 7f16d2071740 1 -- 172.21.15.69:0/2260217387 shutdown_connections 2024-05-14T15:31:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.091+0000 7f16d2071740 1 -- 172.21.15.69:0/2260217387 wait complete. 2024-05-14T15:31:43.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.091+0000 7f16d2071740 20 client.36464 trim_cache size 0 max 16384 2024-05-14T15:31:43.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.135+0000 7f16d2071740 1 Processor -- start 2024-05-14T15:31:43.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.135+0000 7f16d2071740 1 -- start start 2024-05-14T15:31:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.136+0000 7f16d2071740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccefb2f0 0x5588cd2c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.136+0000 7f16d2071740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2db940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.136+0000 7f16d2071740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588cceb81c0 0x5588cd2dbe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.137+0000 7f16d2071740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f16c41c0030 con 0x5588cceb81c0 2024-05-14T15:31:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.137+0000 7f16d2071740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f16c41c1b70 con 0x5588ccefb2f0 2024-05-14T15:31:43.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.137+0000 7f16d2071740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f16c41c0700 con 0x5588ccf241b0 2024-05-14T15:31:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.137+0000 7f16c3e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccefb2f0 0x5588cd2c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.137+0000 7f16bb400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2db940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.137+0000 7f16c3e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccefb2f0 0x5588cd2c5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:42286/0 (socket says 172.21.15.69:42286) 2024-05-14T15:31:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.137+0000 7f16bb400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2db940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:45358/0 (socket says 172.21.15.69:45358) 2024-05-14T15:31:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.137+0000 7f16c3e00640 1 -- 172.21.15.69:0/909975715 learned_addr learned my addr 172.21.15.69:0/909975715 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.137+0000 7f16c9000640 1 --2- 172.21.15.69:0/909975715 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588cceb81c0 0x5588cd2dbe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.138+0000 7f16bb400640 1 -- 172.21.15.69:0/909975715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccefb2f0 msgr2=0x5588cd2c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.138+0000 7f16bb400640 1 --2- 172.21.15.69:0/909975715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccefb2f0 0x5588cd2c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.138+0000 7f16bb400640 1 -- 172.21.15.69:0/909975715 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588cceb81c0 msgr2=0x5588cd2dbe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:43.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.138+0000 7f16bb400640 1 --2- 172.21.15.69:0/909975715 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588cceb81c0 0x5588cd2dbe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.138+0000 7f16bb400640 1 -- 172.21.15.69:0/909975715 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5588cd2d0050 con 0x5588ccf241b0 2024-05-14T15:31:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.139+0000 7f16c9000640 1 --2- 172.21.15.69:0/909975715 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588cceb81c0 0x5588cd2dbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:31:43.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.140+0000 7f16bb400640 1 --2- 172.21.15.69:0/909975715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2db940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f16b4048000 tx=0x7f16b40096b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=48828c0b43676d27 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:43.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.141+0000 7f16b8c00640 1 -- 172.21.15.69:0/909975715 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4037040 con 0x5588ccf241b0 2024-05-14T15:31:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.141+0000 7f16b8c00640 1 -- 172.21.15.69:0/909975715 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16b4032440 con 0x5588ccf241b0 2024-05-14T15:31:43.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.141+0000 7f16b8c00640 1 -- 172.21.15.69:0/909975715 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b4005020 con 0x5588ccf241b0 2024-05-14T15:31:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.143+0000 7f16d2071740 1 -- 172.21.15.69:0/909975715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 msgr2=0x5588cd2db940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.143+0000 7f16d2071740 1 --2- 172.21.15.69:0/909975715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2db940 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f16b4048000 tx=0x7f16b40096b0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.143+0000 7f16d2071740 1 -- 172.21.15.69:0/909975715 shutdown_connections 2024-05-14T15:31:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.143+0000 7f16d2071740 1 --2- 172.21.15.69:0/909975715 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588cceb81c0 0x5588cd2dbe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.143+0000 7f16d2071740 1 --2- 172.21.15.69:0/909975715 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2db940 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.143+0000 7f16d2071740 1 --2- 172.21.15.69:0/909975715 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588ccefb2f0 0x5588cd2c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.143+0000 7f16d2071740 1 -- 172.21.15.69:0/909975715 >> 172.21.15.69:0/909975715 conn(0x5588ccf18300 msgr2=0x5588cd2c0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.144+0000 7f16d2071740 1 -- 172.21.15.69:0/909975715 shutdown_connections 2024-05-14T15:31:43.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.144+0000 7f16d2071740 1 -- 172.21.15.69:0/909975715 wait complete. 2024-05-14T15:31:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.145+0000 7f16d2071740 1 -- start start 2024-05-14T15:31:43.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.145+0000 7f16d2071740 1 Processor -- start 2024-05-14T15:31:43.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.149+0000 7f16d2071740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cceb81c0 0x5588cd2e4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.149+0000 7f16d2071740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588ccefb2f0 0x5588cd2e2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.149+0000 7f16d2071740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2e2770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.150+0000 7f16d2071740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f16c41c14a0 con 0x5588ccefb2f0 2024-05-14T15:31:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.150+0000 7f16d2071740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f16c41c0dd0 con 0x5588cceb81c0 2024-05-14T15:31:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.150+0000 7f16c9000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2e2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.150+0000 7f16c9000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2e2770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:45362/0 (socket says 172.21.15.69:45362) 2024-05-14T15:31:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.150+0000 7f16c9000640 1 -- 172.21.15.69:0/1168669449 learned_addr learned my addr 172.21.15.69:0/1168669449 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:43.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.150+0000 7f16d2071740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f16c41be050 con 0x5588ccf241b0 2024-05-14T15:31:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.150+0000 7f16d2071740 10 client.0 _ll_register_callbacks cb 0x7f16bc00b5b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:31:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.151+0000 7f16c3e00640 1 --2- 172.21.15.69:0/1168669449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cceb81c0 0x5588cd2e4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.151+0000 7f16c9000640 1 -- 172.21.15.69:0/1168669449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cceb81c0 msgr2=0x5588cd2e4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.151+0000 7f16c9000640 1 --2- 172.21.15.69:0/1168669449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cceb81c0 0x5588cd2e4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.151+0000 7f16c9000640 1 -- 172.21.15.69:0/1168669449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588ccefb2f0 msgr2=0x5588cd2e2230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.151+0000 7f16c9000640 1 --2- 172.21.15.69:0/1168669449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588ccefb2f0 0x5588cd2e2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.151+0000 7f16c9000640 1 -- 172.21.15.69:0/1168669449 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5588cd2e2ce0 con 0x5588ccf241b0 2024-05-14T15:31:43.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.153+0000 7f16c9000640 1 --2- 172.21.15.69:0/1168669449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2e2770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0a52a0 tx=0x7f16bc005b60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2b79bcffdd234d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:43.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.153+0000 7f16b2000640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:31:43.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.153+0000 7f16b2000640 1 -- 172.21.15.69:0/1168669449 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc0a9220 con 0x5588ccf241b0 2024-05-14T15:31:43.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.154+0000 7f16b2000640 1 -- 172.21.15.69:0/1168669449 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9554+0+0 (secure 0 0 0) 0x7f16bc0a54b0 con 0x5588ccf241b0 2024-05-14T15:31:43.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.154+0000 7f16d2071740 1 -- 172.21.15.69:0/1168669449 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16b4032440 con 0x5588ccf241b0 2024-05-14T15:31:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.155+0000 7f16b2000640 1 -- 172.21.15.69:0/1168669449 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f16bc0ad5d0 con 0x5588ccf241b0 2024-05-14T15:31:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.156+0000 7f16d2071740 10 client.26446 fetch_fsmap learned FSMap version 62 2024-05-14T15:31:43.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.156+0000 7f16d2071740 1 -- 172.21.15.69:0/1168669449 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5588cd3498d0 con 0x5588ccf241b0 2024-05-14T15:31:43.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.156+0000 7f16b2000640 1 -- 172.21.15.69:0/1168669449 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f16b4032440 con 0x5588ccf241b0 2024-05-14T15:31:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.157+0000 7f16b2000640 1 -- 172.21.15.69:0/1168669449 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f16bc0ad170 con 0x5588ccf241b0 2024-05-14T15:31:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.157+0000 7f16d2071740 10 client.26446 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:31:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.157+0000 7f16d2071740 10 client.26446 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:31:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.157+0000 7f16d2071740 20 client.26446 populate_metadata read hostname 'smithi069' 2024-05-14T15:31:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.157+0000 7f16d2071740 1 --2- 172.21.15.69:0/1168669449 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5588cd34a0d0 0x5588cd34c560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.157+0000 7f16d2071740 4 client.26446 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:31:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.157+0000 7f16d2071740 1 -- 172.21.15.69:0/1168669449 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5588cd231fd0 con 0x5588cd34a0d0 2024-05-14T15:31:43.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.158+0000 7f16c3e00640 1 --2- 172.21.15.69:0/1168669449 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5588cd34a0d0 0x5588cd34c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.159+0000 7f16b2000640 10 client.26446 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:31:43.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.159+0000 7f16c3e00640 1 --2- 172.21.15.69:0/1168669449 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5588cd34a0d0 0x5588cd34c560 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5031abb4193a16e3 server_cookie=bf6803bb0dfcd83a in_seq=0 out_seq=0 2024-05-14T15:31:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.183+0000 7f16b2000640 1 -- 172.21.15.69:0/1168669449 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5588cd231fd0 con 0x5588cd34a0d0 2024-05-14T15:31:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.183+0000 7f16b2000640 10 client.26446 handle_command_reply: tid=0 2024-05-14T15:31:43.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.183+0000 7f16d2071740 1 client.26446 shutdown 2024-05-14T15:31:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.184+0000 7f16d2071740 1 -- 172.21.15.69:0/1168669449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 msgr2=0x5588cd2e2770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.184+0000 7f16d2071740 1 --2- 172.21.15.69:0/1168669449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2e2770 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f16bc0a52a0 tx=0x7f16bc005b60 comp rx=0 tx=0).stop 2024-05-14T15:31:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.184+0000 7f16d2071740 1 -- 172.21.15.69:0/1168669449 shutdown_connections 2024-05-14T15:31:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.184+0000 7f16d2071740 1 --2- 172.21.15.69:0/1168669449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5588ccf241b0 0x5588cd2e2770 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.184+0000 7f16d2071740 1 --2- 172.21.15.69:0/1168669449 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5588cd34a0d0 0x5588cd34c560 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.184+0000 7f16d2071740 1 --2- 172.21.15.69:0/1168669449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5588ccefb2f0 0x5588cd2e2230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.184+0000 7f16d2071740 1 --2- 172.21.15.69:0/1168669449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5588cceb81c0 0x5588cd2e4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.184+0000 7f16d2071740 1 -- 172.21.15.69:0/1168669449 >> 172.21.15.69:0/1168669449 conn(0x5588ccf18300 msgr2=0x5588cd2cf7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.185+0000 7f16b2000640 0 client.26446 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:31:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.185+0000 7f16d2071740 1 -- 172.21.15.69:0/1168669449 shutdown_connections 2024-05-14T15:31:43.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.186+0000 7f16d2071740 1 -- 172.21.15.69:0/1168669449 wait complete. 2024-05-14T15:31:43.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.186+0000 7f16d2071740 20 client.26446 trim_cache size 0 max 16384 2024-05-14T15:31:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:31:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:31:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:31:43.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:31:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.188+0000 7f16c9a00640 1 -- 172.21.15.69:0/627904180 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f16a80b2a50 msgr2=0x7f16a80b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.188+0000 7f16c9a00640 1 --2- 172.21.15.69:0/627904180 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f16a80b2a50 0x7f16a80b4f60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00a550 tx=0x7f16ac00a480 comp rx=0 tx=0).stop 2024-05-14T15:31:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.188+0000 7f16c9a00640 1 -- 172.21.15.69:0/627904180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16c410f790 msgr2=0x7f16c41a9800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.188+0000 7f16c9a00640 1 --2- 172.21.15.69:0/627904180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16c410f790 0x7f16c41a9800 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009e20 tx=0x7f16bc00e490 comp rx=0 tx=0).stop 2024-05-14T15:31:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.188+0000 7f16c9a00640 1 -- 172.21.15.69:0/627904180 shutdown_connections 2024-05-14T15:31:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.188+0000 7f16c9a00640 1 --2- 172.21.15.69:0/627904180 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f16a80b2a50 0x7f16a80b4f60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.188+0000 7f16c9a00640 1 --2- 172.21.15.69:0/627904180 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f16c410f790 0x7f16c41a9800 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.188+0000 7f16c9a00640 1 --2- 172.21.15.69:0/627904180 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f16c410ecd0 0x7f16c41a5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.188+0000 7f16c9a00640 1 --2- 172.21.15.69:0/627904180 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f16c410a740 0x7f16c41a4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:43.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.188+0000 7f16c9a00640 1 -- 172.21.15.69:0/627904180 >> 172.21.15.69:0/627904180 conn(0x7f16c406fba0 msgr2=0x7f16c410dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.189+0000 7f16c9a00640 1 -- 172.21.15.69:0/627904180 shutdown_connections 2024-05-14T15:31:43.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:43.189+0000 7f16c9a00640 1 -- 172.21.15.69:0/627904180 wait complete. 2024-05-14T15:31:43.496 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:43 smithi092 ceph-mon[34729]: pgmap v313: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.7 MiB/s wr, 519 op/s 2024-05-14T15:31:43.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:43 smithi203 ceph-mon[34567]: pgmap v313: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.7 MiB/s wr, 519 op/s 2024-05-14T15:31:43.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:43 smithi069 ceph-mon[31270]: pgmap v313: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.7 MiB/s wr, 519 op/s 2024-05-14T15:31:45.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:45 smithi203 ceph-mon[34567]: pgmap v314: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.8 MiB/s wr, 649 op/s 2024-05-14T15:31:45.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:45 smithi092 ceph-mon[34729]: pgmap v314: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.8 MiB/s wr, 649 op/s 2024-05-14T15:31:45.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:45 smithi069 ceph-mon[31270]: pgmap v314: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.8 MiB/s wr, 649 op/s 2024-05-14T15:31:46.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 360.0 s, 642.4 tps, lat 155.845 ms stddev 65.625 2024-05-14T15:31:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:47 smithi203 ceph-mon[34567]: pgmap v315: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.4 MiB/s wr, 610 op/s 2024-05-14T15:31:47.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:47 smithi092 ceph-mon[34729]: pgmap v315: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.4 MiB/s wr, 610 op/s 2024-05-14T15:31:47.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:47 smithi069 ceph-mon[31270]: pgmap v315: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 5.4 MiB/s wr, 610 op/s 2024-05-14T15:31:49.597 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:49 smithi203 ceph-mon[34567]: pgmap v316: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.6 MiB/s wr, 517 op/s 2024-05-14T15:31:49.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:49 smithi092 ceph-mon[34729]: pgmap v316: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.6 MiB/s wr, 517 op/s 2024-05-14T15:31:49.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:49 smithi069 ceph-mon[31270]: pgmap v316: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 4.6 MiB/s wr, 517 op/s 2024-05-14T15:31:51.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 365.0 s, 656.0 tps, lat 153.351 ms stddev 93.336 2024-05-14T15:31:51.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:51 smithi203 ceph-mon[34567]: pgmap v317: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 7.2 MiB/s wr, 797 op/s 2024-05-14T15:31:51.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:51 smithi092 ceph-mon[34729]: pgmap v317: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 7.2 MiB/s wr, 797 op/s 2024-05-14T15:31:51.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:51 smithi069 ceph-mon[31270]: pgmap v317: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 7.2 MiB/s wr, 797 op/s 2024-05-14T15:31:53.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:53 smithi203 ceph-mon[34567]: pgmap v318: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.7 MiB/s wr, 530 op/s 2024-05-14T15:31:53.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:53 smithi092 ceph-mon[34729]: pgmap v318: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.7 MiB/s wr, 530 op/s 2024-05-14T15:31:53.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:53 smithi069 ceph-mon[31270]: pgmap v318: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 4.7 MiB/s wr, 530 op/s 2024-05-14T15:31:55.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:55 smithi203 ceph-mon[34567]: pgmap v319: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.5 MiB/s wr, 721 op/s 2024-05-14T15:31:55.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:55 smithi092 ceph-mon[34729]: pgmap v319: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.5 MiB/s wr, 721 op/s 2024-05-14T15:31:55.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:55 smithi069 ceph-mon[31270]: pgmap v319: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.5 MiB/s wr, 721 op/s 2024-05-14T15:31:56.369 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 370.0 s, 676.4 tps, lat 146.619 ms stddev 50.393 2024-05-14T15:31:57.597 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:57 smithi203 ceph-mon[34567]: pgmap v320: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.2 MiB/s wr, 688 op/s 2024-05-14T15:31:57.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:57 smithi092 ceph-mon[34729]: pgmap v320: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.2 MiB/s wr, 688 op/s 2024-05-14T15:31:57.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:57 smithi069 ceph-mon[31270]: pgmap v320: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.2 MiB/s wr, 688 op/s 2024-05-14T15:31:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.582+0000 7f4f60a00640 1 -- 172.21.15.69:0/1622955462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4f5c114930 msgr2=0x7f4f5c116d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.582+0000 7f4f60a00640 1 --2- 172.21.15.69:0/1622955462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4f5c114930 0x7f4f5c116d50 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009c30 tx=0x7f4f5402a700 comp rx=0 tx=0).stop 2024-05-14T15:31:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.583+0000 7f4f60a00640 1 -- 172.21.15.69:0/1622955462 shutdown_connections 2024-05-14T15:31:58.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.583+0000 7f4f60a00640 1 --2- 172.21.15.69:0/1622955462 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4f5c114930 0x7f4f5c116d50 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.583+0000 7f4f60a00640 1 --2- 172.21.15.69:0/1622955462 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f5c111fd0 0x7f4f5c1143f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.583+0000 7f4f60a00640 1 --2- 172.21.15.69:0/1622955462 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f5c077620 0x7f4f5c077a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.583+0000 7f4f60a00640 1 -- 172.21.15.69:0/1622955462 >> 172.21.15.69:0/1622955462 conn(0x7f4f5c1013e0 msgr2=0x7f4f5c103830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.583+0000 7f4f60a00640 1 -- 172.21.15.69:0/1622955462 shutdown_connections 2024-05-14T15:31:58.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.583+0000 7f4f60a00640 1 -- 172.21.15.69:0/1622955462 wait complete. 2024-05-14T15:31:58.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.585+0000 7f4f60a00640 1 Processor -- start 2024-05-14T15:31:58.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.586+0000 7f4f60a00640 1 -- start start 2024-05-14T15:31:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.587+0000 7f4f60a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4f5c077620 0x7f4f5c1a6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.587+0000 7f4f60a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f5c111fd0 0x7f4f5c1a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.587+0000 7f4f60a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f5c114930 0x7f4f5c1a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.587+0000 7f4f60a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c11a170 con 0x7f4f5c077620 2024-05-14T15:31:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.587+0000 7f4f60a00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c119ff0 con 0x7f4f5c111fd0 2024-05-14T15:31:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.587+0000 7f4f60a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c11a2f0 con 0x7f4f5c114930 2024-05-14T15:31:58.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.588+0000 7f4f5aa00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f5c111fd0 0x7f4f5c1a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.588+0000 7f4f5aa00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f5c111fd0 0x7f4f5c1a6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:40250/0 (socket says 172.21.15.69:40250) 2024-05-14T15:31:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.588+0000 7f4f5aa00640 1 -- 172.21.15.69:0/4283526359 learned_addr learned my addr 172.21.15.69:0/4283526359 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:58.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.588+0000 7f4f5be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f5c114930 0x7f4f5c1a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.588+0000 7f4f5b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4f5c077620 0x7f4f5c1a6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.589+0000 7f4f5b400640 1 -- 172.21.15.69:0/4283526359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f5c114930 msgr2=0x7f4f5c1a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.589+0000 7f4f5b400640 1 --2- 172.21.15.69:0/4283526359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f5c114930 0x7f4f5c1a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.589+0000 7f4f5b400640 1 -- 172.21.15.69:0/4283526359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f5c111fd0 msgr2=0x7f4f5c1a6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.589+0000 7f4f5b400640 1 --2- 172.21.15.69:0/4283526359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f5c111fd0 0x7f4f5c1a6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.589+0000 7f4f5b400640 1 -- 172.21.15.69:0/4283526359 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5c1a1030 con 0x7f4f5c077620 2024-05-14T15:31:58.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.589+0000 7f4f5aa00640 1 --2- 172.21.15.69:0/4283526359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f5c111fd0 0x7f4f5c1a6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:31:58.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.592+0000 7f4f5b400640 1 --2- 172.21.15.69:0/4283526359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4f5c077620 0x7f4f5c1a6780 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009fd0 tx=0x7f4f4c00ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.593+0000 7f4f53e00640 1 -- 172.21.15.69:0/4283526359 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c00ccc0 con 0x7f4f5c077620 2024-05-14T15:31:58.595 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.594+0000 7f4f53e00640 1 -- 172.21.15.69:0/4283526359 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f4c00ee70 con 0x7f4f5c077620 2024-05-14T15:31:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.594+0000 7f4f53e00640 1 -- 172.21.15.69:0/4283526359 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0047a0 con 0x7f4f5c077620 2024-05-14T15:31:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.594+0000 7f4f60a00640 1 -- 172.21.15.69:0/4283526359 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f5c1a1320 con 0x7f4f5c077620 2024-05-14T15:31:58.596 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.594+0000 7f4f60a00640 1 -- 172.21.15.69:0/4283526359 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f5c06c6f0 con 0x7f4f5c077620 2024-05-14T15:31:58.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.598+0000 7f4f53e00640 1 -- 172.21.15.69:0/4283526359 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f4f4c0049c0 con 0x7f4f5c077620 2024-05-14T15:31:58.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.600+0000 7f4f68fd6740 1 Processor -- start 2024-05-14T15:31:58.602 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.600+0000 7f4f68fd6740 1 -- start start 2024-05-14T15:31:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.601+0000 7f4f53e00640 1 --2- 172.21.15.69:0/4283526359 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f4f400b2b20 0x7f4f400b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.601+0000 7f4f68fd6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e83b1b0 0x562a8ebdc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.601+0000 7f4f53e00640 1 -- 172.21.15.69:0/4283526359 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9554+0+0 (secure 0 0 0) 0x7f4f4c0e2850 con 0x7f4f5c077620 2024-05-14T15:31:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.601+0000 7f4f68fd6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e8122f0 0x562a8ebdc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.601+0000 7f4f68fd6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e81a4d0 0x562a8ebdcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.601+0000 7f4f68fd6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x562a8eb41550 con 0x562a8e81a4d0 2024-05-14T15:31:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.601+0000 7f4f68fd6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562a8eae6bc0 con 0x562a8e83b1b0 2024-05-14T15:31:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.601+0000 7f4f68fd6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562a8eb3d510 con 0x562a8e8122f0 2024-05-14T15:31:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.601+0000 7f4f5be00640 1 --2- 172.21.15.69:0/4283526359 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f4f400b2b20 0x7f4f400b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.602+0000 7f4f5b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e83b1b0 0x562a8ebdc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.602+0000 7f4f5b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e83b1b0 0x562a8ebdc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:40258/0 (socket says 172.21.15.69:40258) 2024-05-14T15:31:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.602+0000 7f4f5b400640 1 -- 172.21.15.69:0/3496951924 learned_addr learned my addr 172.21.15.69:0/3496951924 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:58.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.602+0000 7f4f5be00640 1 --2- 172.21.15.69:0/3496951924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e81a4d0 0x562a8ebdcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.602+0000 7f4f5aa00640 1 --2- 172.21.15.69:0/3496951924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e8122f0 0x562a8ebdc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.602+0000 7f4f5b400640 1 -- 172.21.15.69:0/3496951924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e8122f0 msgr2=0x562a8ebdc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:58.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.602+0000 7f4f5b400640 1 --2- 172.21.15.69:0/3496951924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e8122f0 0x562a8ebdc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.602+0000 7f4f5b400640 1 -- 172.21.15.69:0/3496951924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e81a4d0 msgr2=0x562a8ebdcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.602+0000 7f4f5b400640 1 --2- 172.21.15.69:0/3496951924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e81a4d0 0x562a8ebdcf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.602+0000 7f4f5b400640 1 -- 172.21.15.69:0/3496951924 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a8e853210 con 0x562a8e83b1b0 2024-05-14T15:31:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.602+0000 7f4f5be00640 1 --2- 172.21.15.69:0/3496951924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e81a4d0 0x562a8ebdcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:31:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.603+0000 7f4f5b400640 1 --2- 172.21.15.69:0/3496951924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e83b1b0 0x562a8ebdc480 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0a5740 tx=0x7f4f4c0a8ef0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c72f6214d2e6343a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.603+0000 7f4f4be00640 1 -- 172.21.15.69:0/3496951924 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c01c040 con 0x562a8e83b1b0 2024-05-14T15:31:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.603+0000 7f4f4be00640 1 -- 172.21.15.69:0/3496951924 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f4c0a9dc0 con 0x562a8e83b1b0 2024-05-14T15:31:58.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.603+0000 7f4f4be00640 1 -- 172.21.15.69:0/3496951924 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0b2090 con 0x562a8e83b1b0 2024-05-14T15:31:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.605+0000 7f4f68fd6740 1 -- 172.21.15.69:0/3496951924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e83b1b0 msgr2=0x562a8ebdc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.605+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/3496951924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e83b1b0 0x562a8ebdc480 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0a5740 tx=0x7f4f4c0a8ef0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.605+0000 7f4f5be00640 1 --2- 172.21.15.69:0/4283526359 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f4f400b2b20 0x7f4f400b5030 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009370 tx=0x7f4f54030fa0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.605+0000 7f4f68fd6740 1 -- 172.21.15.69:0/3496951924 shutdown_connections 2024-05-14T15:31:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.605+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/3496951924 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e81a4d0 0x562a8ebdcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.605+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/3496951924 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e8122f0 0x562a8ebdc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.605+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/3496951924 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e83b1b0 0x562a8ebdc480 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.605+0000 7f4f68fd6740 1 -- 172.21.15.69:0/3496951924 >> 172.21.15.69:0/3496951924 conn(0x562a8e82f300 msgr2=0x562a8ebd8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:58.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.606+0000 7f4f68fd6740 1 -- 172.21.15.69:0/3496951924 shutdown_connections 2024-05-14T15:31:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.606+0000 7f4f68fd6740 1 -- 172.21.15.69:0/3496951924 wait complete. 2024-05-14T15:31:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.607+0000 7f4f68fd6740 1 -- start start 2024-05-14T15:31:58.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.607+0000 7f4f68fd6740 1 Processor -- start 2024-05-14T15:31:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.608+0000 7f4f68fd6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e8122f0 0x562a8ebe6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.608+0000 7f4f68fd6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e81a4d0 0x562a8ebe6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.608+0000 7f4f68fd6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e83b1b0 0x562a8ebf2a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.608+0000 7f4f68fd6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x562a8ebe9550 con 0x562a8e8122f0 2024-05-14T15:31:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.608+0000 7f4f68fd6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x562a8eafa660 con 0x562a8e81a4d0 2024-05-14T15:31:58.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.608+0000 7f4f68fd6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x562a8ebe96d0 con 0x562a8e83b1b0 2024-05-14T15:31:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.608+0000 7f4f68fd6740 10 client.0 _ll_register_callbacks cb 0x562a8eac4400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:31:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.609+0000 7f4f5be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e83b1b0 0x562a8ebf2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.609+0000 7f4f5be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e83b1b0 0x562a8ebf2a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:45086/0 (socket says 172.21.15.69:45086) 2024-05-14T15:31:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.609+0000 7f4f5be00640 1 -- 172.21.15.69:0/2603050964 learned_addr learned my addr 172.21.15.69:0/2603050964 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.609+0000 7f4f5be00640 1 -- 172.21.15.69:0/2603050964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e81a4d0 msgr2=0x562a8ebe6ed0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:31:58.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.609+0000 7f4f5be00640 1 --2- 172.21.15.69:0/2603050964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e81a4d0 0x562a8ebe6ed0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.609+0000 7f4f5be00640 1 -- 172.21.15.69:0/2603050964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e8122f0 msgr2=0x562a8ebe6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.609+0000 7f4f5be00640 1 --2- 172.21.15.69:0/2603050964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e8122f0 0x562a8ebe6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.609+0000 7f4f5be00640 1 -- 172.21.15.69:0/2603050964 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a8e91f620 con 0x562a8e83b1b0 2024-05-14T15:31:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.610+0000 7f4f5be00640 1 --2- 172.21.15.69:0/2603050964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e83b1b0 0x562a8ebf2a00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009c30 tx=0x7f4f54009500 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2d4f98fcd44d689 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:58.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.610+0000 7f4f48c00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:31:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.611+0000 7f4f48c00640 1 -- 172.21.15.69:0/2603050964 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f5404e020 con 0x562a8e83b1b0 2024-05-14T15:31:58.613 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.611+0000 7f4f48c00640 1 -- 172.21.15.69:0/2603050964 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9554+0+0 (secure 0 0 0) 0x7f4f54004710 con 0x562a8e83b1b0 2024-05-14T15:31:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.611+0000 7f4f68fd6740 1 -- 172.21.15.69:0/2603050964 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f4c0a9dc0 con 0x562a8e83b1b0 2024-05-14T15:31:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.612+0000 7f4f48c00640 1 -- 172.21.15.69:0/2603050964 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f4f54043070 con 0x562a8e83b1b0 2024-05-14T15:31:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.612+0000 7f4f68fd6740 10 client.26458 fetch_fsmap learned FSMap version 62 2024-05-14T15:31:58.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.612+0000 7f4f68fd6740 1 -- 172.21.15.69:0/2603050964 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x562a8ebf5730 con 0x562a8e83b1b0 2024-05-14T15:31:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.615+0000 7f4f48c00640 1 -- 172.21.15.69:0/2603050964 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f4c0a9dc0 con 0x562a8e83b1b0 2024-05-14T15:31:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.615+0000 7f4f48c00640 1 -- 172.21.15.69:0/2603050964 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f4f5403c070 con 0x562a8e83b1b0 2024-05-14T15:31:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.615+0000 7f4f68fd6740 10 client.26458 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:31:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.615+0000 7f4f68fd6740 10 client.26458 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:31:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.615+0000 7f4f68fd6740 20 client.26458 populate_metadata read hostname 'smithi069' 2024-05-14T15:31:58.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.615+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/2603050964 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562a8e7f9d80 0x562a8ebf8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.615+0000 7f4f68fd6740 4 client.26458 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:31:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.615+0000 7f4f68fd6740 1 -- 172.21.15.69:0/2603050964 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a8eb4f160 con 0x562a8e7f9d80 2024-05-14T15:31:58.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.616+0000 7f4f5b400640 1 --2- 172.21.15.69:0/2603050964 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562a8e7f9d80 0x562a8ebf8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.617+0000 7f4f48c00640 10 client.26458 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:31:58.619 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.617+0000 7f4f5b400640 1 --2- 172.21.15.69:0/2603050964 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562a8e7f9d80 0x562a8ebf8cb0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc30153f80c87114 server_cookie=c920e5f179306b1b in_seq=0 out_seq=0 2024-05-14T15:31:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.619+0000 7f4f48c00640 1 -- 172.21.15.69:0/2603050964 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x562a8eb4f160 con 0x562a8e7f9d80 2024-05-14T15:31:58.620 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.619+0000 7f4f48c00640 10 client.26458 handle_command_reply: tid=0 2024-05-14T15:31:58.621 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.619+0000 7f4f68fd6740 1 client.26458 shutdown 2024-05-14T15:31:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.621+0000 7f4f68fd6740 1 -- 172.21.15.69:0/2603050964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e83b1b0 msgr2=0x562a8ebf2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.621+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/2603050964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e83b1b0 0x562a8ebf2a00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009c30 tx=0x7f4f54009500 comp rx=0 tx=0).stop 2024-05-14T15:31:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.621+0000 7f4f68fd6740 1 -- 172.21.15.69:0/2603050964 shutdown_connections 2024-05-14T15:31:58.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.621+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/2603050964 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e83b1b0 0x562a8ebf2a00 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.621+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/2603050964 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e81a4d0 0x562a8ebe6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.621+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/2603050964 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562a8e7f9d80 0x562a8ebf8cb0 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.621+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/2603050964 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e8122f0 0x562a8ebe6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.621+0000 7f4f48c00640 0 client.26458 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:31:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.621+0000 7f4f68fd6740 1 -- 172.21.15.69:0/2603050964 >> 172.21.15.69:0/2603050964 conn(0x562a8e82f300 msgr2=0x562a8ebde1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.622+0000 7f4f68fd6740 1 -- 172.21.15.69:0/2603050964 shutdown_connections 2024-05-14T15:31:58.624 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.623+0000 7f4f68fd6740 1 -- 172.21.15.69:0/2603050964 wait complete. 2024-05-14T15:31:58.625 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.623+0000 7f4f68fd6740 20 client.26458 trim_cache size 0 max 16384 2024-05-14T15:31:58.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.666+0000 7f4f68fd6740 1 Processor -- start 2024-05-14T15:31:58.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.667+0000 7f4f68fd6740 1 -- start start 2024-05-14T15:31:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.667+0000 7f4f68fd6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e8122f0 0x562a8ebdd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.667+0000 7f4f68fd6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e81a4d0 0x562a8ebd7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.667+0000 7f4f68fd6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e83b1b0 0x562a8ebd7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.667+0000 7f4f68fd6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c1c0010 con 0x562a8e81a4d0 2024-05-14T15:31:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.667+0000 7f4f68fd6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c1c1b50 con 0x562a8e8122f0 2024-05-14T15:31:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.667+0000 7f4f68fd6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c1c06e0 con 0x562a8e83b1b0 2024-05-14T15:31:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.668+0000 7f4f5aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e81a4d0 0x562a8ebd7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.668+0000 7f4f5aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e81a4d0 0x562a8ebd7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44684/0 (socket says 172.21.15.69:44684) 2024-05-14T15:31:58.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.668+0000 7f4f5aa00640 1 -- 172.21.15.69:0/67974944 learned_addr learned my addr 172.21.15.69:0/67974944 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.669+0000 7f4f5aa00640 1 -- 172.21.15.69:0/67974944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e83b1b0 msgr2=0x562a8ebd7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.669+0000 7f4f5be00640 1 --2- 172.21.15.69:0/67974944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e83b1b0 0x562a8ebd7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.669+0000 7f4f5b400640 1 --2- 172.21.15.69:0/67974944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e8122f0 0x562a8ebdd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.670+0000 7f4f5aa00640 1 --2- 172.21.15.69:0/67974944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e83b1b0 0x562a8ebd7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.670+0000 7f4f5aa00640 1 -- 172.21.15.69:0/67974944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e8122f0 msgr2=0x562a8ebdd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.670+0000 7f4f5aa00640 1 --2- 172.21.15.69:0/67974944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e8122f0 0x562a8ebdd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.670+0000 7f4f5aa00640 1 -- 172.21.15.69:0/67974944 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a8ebe7c40 con 0x562a8e81a4d0 2024-05-14T15:31:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.670+0000 7f4f5b400640 1 --2- 172.21.15.69:0/67974944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e8122f0 0x562a8ebdd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:31:58.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.670+0000 7f4f5be00640 1 --2- 172.21.15.69:0/67974944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e83b1b0 0x562a8ebd7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:31:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.670+0000 7f4f5aa00640 1 --2- 172.21.15.69:0/67974944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e81a4d0 0x562a8ebd7960 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f4f44005bc0 tx=0x7f4f440045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188aaee78f97603e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.671+0000 7f4f4b400640 1 -- 172.21.15.69:0/67974944 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f44005020 con 0x562a8e81a4d0 2024-05-14T15:31:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.671+0000 7f4f4b400640 1 -- 172.21.15.69:0/67974944 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f440047a0 con 0x562a8e81a4d0 2024-05-14T15:31:58.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.672+0000 7f4f4b400640 1 -- 172.21.15.69:0/67974944 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f44005020 con 0x562a8e81a4d0 2024-05-14T15:31:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.676+0000 7f4f68fd6740 1 -- 172.21.15.69:0/67974944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e81a4d0 msgr2=0x562a8ebd7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.676+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/67974944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e81a4d0 0x562a8ebd7960 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f4f44005bc0 tx=0x7f4f440045d0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.676+0000 7f4f68fd6740 1 -- 172.21.15.69:0/67974944 shutdown_connections 2024-05-14T15:31:58.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.676+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/67974944 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e83b1b0 0x562a8ebd7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.677+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/67974944 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e81a4d0 0x562a8ebd7960 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.677+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/67974944 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e8122f0 0x562a8ebdd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.677+0000 7f4f68fd6740 1 -- 172.21.15.69:0/67974944 >> 172.21.15.69:0/67974944 conn(0x562a8e82f300 msgr2=0x562a8ebd7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:58.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.678+0000 7f4f68fd6740 1 -- 172.21.15.69:0/67974944 shutdown_connections 2024-05-14T15:31:58.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.678+0000 7f4f68fd6740 1 -- 172.21.15.69:0/67974944 wait complete. 2024-05-14T15:31:58.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.679+0000 7f4f68fd6740 1 -- start start 2024-05-14T15:31:58.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.679+0000 7f4f68fd6740 1 Processor -- start 2024-05-14T15:31:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.681+0000 7f4f68fd6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e8122f0 0x562a8ebe9920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.681+0000 7f4f68fd6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e81a4d0 0x562a8ebe9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.681+0000 7f4f68fd6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e83b1b0 0x562a8ec5f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.682+0000 7f4f5b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e8122f0 0x562a8ebe9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.682+0000 7f4f5b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e8122f0 0x562a8ebe9920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:40282/0 (socket says 172.21.15.69:40282) 2024-05-14T15:31:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.682+0000 7f4f68fd6740 1 -- 172.21.15.69:0/3520670927 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c1c1480 con 0x562a8e83b1b0 2024-05-14T15:31:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.682+0000 7f4f68fd6740 1 -- 172.21.15.69:0/3520670927 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c1c0db0 con 0x562a8e8122f0 2024-05-14T15:31:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.682+0000 7f4f68fd6740 1 -- 172.21.15.69:0/3520670927 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f4f5c074900 con 0x562a8e81a4d0 2024-05-14T15:31:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.682+0000 7f4f68fd6740 10 client.0 _ll_register_callbacks cb 0x7f4f4c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:31:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.682+0000 7f4f5b400640 1 -- 172.21.15.69:0/3520670927 learned_addr learned my addr 172.21.15.69:0/3520670927 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:31:58.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.682+0000 7f4f5aa00640 1 --2- 172.21.15.69:0/3520670927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e81a4d0 0x562a8ebe9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.683+0000 7f4f5be00640 1 --2- 172.21.15.69:0/3520670927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e83b1b0 0x562a8ec5f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.683+0000 7f4f5b400640 1 -- 172.21.15.69:0/3520670927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e81a4d0 msgr2=0x562a8ebe9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.683+0000 7f4f5b400640 1 --2- 172.21.15.69:0/3520670927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e81a4d0 0x562a8ebe9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.683+0000 7f4f5b400640 1 -- 172.21.15.69:0/3520670927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e83b1b0 msgr2=0x562a8ec5f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:31:58.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.683+0000 7f4f5b400640 1 --2- 172.21.15.69:0/3520670927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e83b1b0 0x562a8ec5f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.683+0000 7f4f5b400640 1 -- 172.21.15.69:0/3520670927 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a8ec5f5e0 con 0x562a8e8122f0 2024-05-14T15:31:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.683+0000 7f4f5be00640 1 --2- 172.21.15.69:0/3520670927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e83b1b0 0x562a8ec5f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:31:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.683+0000 7f4f48c00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:31:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.683+0000 7f4f5b400640 1 --2- 172.21.15.69:0/3520670927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e8122f0 0x562a8ebe9920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0a5740 tx=0x7f4f4c00cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4275b049ef3bdc83 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:31:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.684+0000 7f4f48c00640 1 -- 172.21.15.69:0/3520670927 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c01c070 con 0x562a8e8122f0 2024-05-14T15:31:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.684+0000 7f4f48c00640 1 -- 172.21.15.69:0/3520670927 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(100..100 src has 1..100) ==== 9554+0+0 (secure 0 0 0) 0x7f4f4c0b4ce0 con 0x562a8e8122f0 2024-05-14T15:31:58.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.684+0000 7f4f68fd6740 1 -- 172.21.15.69:0/3520670927 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4f440047a0 con 0x562a8e8122f0 2024-05-14T15:31:58.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.686+0000 7f4f48c00640 1 -- 172.21.15.69:0/3520670927 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f4f4c0a9dc0 con 0x562a8e8122f0 2024-05-14T15:31:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.686+0000 7f4f68fd6740 10 client.36479 fetch_fsmap learned FSMap version 62 2024-05-14T15:31:58.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.686+0000 7f4f68fd6740 1 -- 172.21.15.69:0/3520670927 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x562a8ec60620 con 0x562a8e8122f0 2024-05-14T15:31:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.687+0000 7f4f48c00640 1 -- 172.21.15.69:0/3520670927 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f4f440047a0 con 0x562a8e8122f0 2024-05-14T15:31:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.687+0000 7f4f48c00640 1 -- 172.21.15.69:0/3520670927 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f4f4c0e2070 con 0x562a8e8122f0 2024-05-14T15:31:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.687+0000 7f4f68fd6740 10 client.36479 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:31:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.687+0000 7f4f68fd6740 10 client.36479 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:31:58.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.687+0000 7f4f68fd6740 20 client.36479 populate_metadata read hostname 'smithi069' 2024-05-14T15:31:58.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.687+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/3520670927 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562a8e7cf1c0 0x562a8ec62920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:31:58.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.687+0000 7f4f68fd6740 4 client.36479 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:31:58.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.688+0000 7f4f68fd6740 1 -- 172.21.15.69:0/3520670927 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x562a8eb48fd0 con 0x562a8e7cf1c0 2024-05-14T15:31:58.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.688+0000 7f4f5aa00640 1 --2- 172.21.15.69:0/3520670927 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562a8e7cf1c0 0x562a8ec62920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:31:58.692 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.689+0000 7f4f5aa00640 1 --2- 172.21.15.69:0/3520670927 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562a8e7cf1c0 0x562a8ec62920 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=efdf0104743be7 server_cookie=293550e231d0457 in_seq=0 out_seq=0 2024-05-14T15:31:58.692 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.690+0000 7f4f48c00640 10 client.36479 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:31:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.723+0000 7f4f48c00640 1 -- 172.21.15.69:0/3520670927 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x562a8eb48fd0 con 0x562a8e7cf1c0 2024-05-14T15:31:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.723+0000 7f4f48c00640 10 client.36479 handle_command_reply: tid=0 2024-05-14T15:31:58.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.723+0000 7f4f68fd6740 1 client.36479 shutdown 2024-05-14T15:31:58.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.725+0000 7f4f68fd6740 1 -- 172.21.15.69:0/3520670927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e8122f0 msgr2=0x562a8ebe9920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:58.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.725+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/3520670927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e8122f0 0x562a8ebe9920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c0a5740 tx=0x7f4f4c00cf10 comp rx=0 tx=0).stop 2024-05-14T15:31:58.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.725+0000 7f4f68fd6740 1 -- 172.21.15.69:0/3520670927 shutdown_connections 2024-05-14T15:31:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.726+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/3520670927 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x562a8e7cf1c0 0x562a8ec62920 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.726+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/3520670927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x562a8e83b1b0 0x562a8ec5f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.726+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/3520670927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x562a8e81a4d0 0x562a8ebe9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.726+0000 7f4f68fd6740 1 --2- 172.21.15.69:0/3520670927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x562a8e8122f0 0x562a8ebe9920 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.726+0000 7f4f68fd6740 1 -- 172.21.15.69:0/3520670927 >> 172.21.15.69:0/3520670927 conn(0x562a8e82f300 msgr2=0x562a8ebe7e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:58.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.726+0000 7f4f48c00640 0 client.36479 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:31:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.726+0000 7f4f68fd6740 1 -- 172.21.15.69:0/3520670927 shutdown_connections 2024-05-14T15:31:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.726+0000 7f4f68fd6740 1 -- 172.21.15.69:0/3520670927 wait complete. 2024-05-14T15:31:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.727+0000 7f4f68fd6740 20 client.36479 trim_cache size 0 max 16384 2024-05-14T15:31:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:31:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:31:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:31:58.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:31:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.728+0000 7f4f60a00640 1 -- 172.21.15.69:0/4283526359 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f4f400b2b20 msgr2=0x7f4f400b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.728+0000 7f4f60a00640 1 --2- 172.21.15.69:0/4283526359 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f4f400b2b20 0x7f4f400b5030 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f4f54009370 tx=0x7f4f54030fa0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.728+0000 7f4f60a00640 1 -- 172.21.15.69:0/4283526359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4f5c077620 msgr2=0x7f4f5c1a6780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:31:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.728+0000 7f4f60a00640 1 --2- 172.21.15.69:0/4283526359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4f5c077620 0x7f4f5c1a6780 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009fd0 tx=0x7f4f4c00ec20 comp rx=0 tx=0).stop 2024-05-14T15:31:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.728+0000 7f4f60a00640 1 -- 172.21.15.69:0/4283526359 shutdown_connections 2024-05-14T15:31:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.728+0000 7f4f60a00640 1 --2- 172.21.15.69:0/4283526359 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f4f400b2b20 0x7f4f400b5030 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.728+0000 7f4f60a00640 1 --2- 172.21.15.69:0/4283526359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f4f5c114930 0x7f4f5c1a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.728+0000 7f4f60a00640 1 --2- 172.21.15.69:0/4283526359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f4f5c111fd0 0x7f4f5c1a6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.728+0000 7f4f60a00640 1 --2- 172.21.15.69:0/4283526359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f4f5c077620 0x7f4f5c1a6780 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:31:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.728+0000 7f4f60a00640 1 -- 172.21.15.69:0/4283526359 >> 172.21.15.69:0/4283526359 conn(0x7f4f5c1013e0 msgr2=0x7f4f5c07a5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:31:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.728+0000 7f4f60a00640 1 -- 172.21.15.69:0/4283526359 shutdown_connections 2024-05-14T15:31:58.731 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:31:58.729+0000 7f4f60a00640 1 -- 172.21.15.69:0/4283526359 wait complete. 2024-05-14T15:31:59.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:31:59 smithi203 ceph-mon[34567]: pgmap v321: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.1 MiB/s wr, 567 op/s 2024-05-14T15:31:59.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:31:59 smithi092 ceph-mon[34729]: pgmap v321: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.1 MiB/s wr, 567 op/s 2024-05-14T15:31:59.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:31:59 smithi069 ceph-mon[31270]: pgmap v321: 129 pgs: 129 active+clean; 2.8 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 5.1 MiB/s wr, 567 op/s 2024-05-14T15:32:01.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 375.0 s, 529.9 tps, lat 190.962 ms stddev 103.409 2024-05-14T15:32:01.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:01 smithi203 ceph-mon[34567]: pgmap v322: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 7.4 MiB/s wr, 830 op/s 2024-05-14T15:32:01.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:01 smithi092 ceph-mon[34729]: pgmap v322: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 7.4 MiB/s wr, 830 op/s 2024-05-14T15:32:01.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:01 smithi069 ceph-mon[31270]: pgmap v322: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 7.4 MiB/s wr, 830 op/s 2024-05-14T15:32:03.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:03 smithi203 ceph-mon[34567]: pgmap v323: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 4.9 MiB/s wr, 549 op/s 2024-05-14T15:32:03.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:03 smithi203 ceph-mon[34567]: osdmap e101: 12 total, 12 up, 12 in 2024-05-14T15:32:03.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:03 smithi092 ceph-mon[34729]: pgmap v323: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 4.9 MiB/s wr, 549 op/s 2024-05-14T15:32:03.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:03 smithi092 ceph-mon[34729]: osdmap e101: 12 total, 12 up, 12 in 2024-05-14T15:32:03.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:03 smithi069 ceph-mon[31270]: pgmap v323: 129 pgs: 129 active+clean; 2.8 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 4.9 MiB/s wr, 549 op/s 2024-05-14T15:32:03.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:03 smithi069 ceph-mon[31270]: osdmap e101: 12 total, 12 up, 12 in 2024-05-14T15:32:05.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:05 smithi203 ceph-mon[34567]: pgmap v325: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.5 MiB/s wr, 604 op/s 2024-05-14T15:32:05.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:05 smithi092 ceph-mon[34729]: pgmap v325: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.5 MiB/s wr, 604 op/s 2024-05-14T15:32:05.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:05 smithi069 ceph-mon[31270]: pgmap v325: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.5 MiB/s wr, 604 op/s 2024-05-14T15:32:06.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 380.0 s, 556.6 tps, lat 177.903 ms stddev 153.651 2024-05-14T15:32:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:07 smithi203 ceph-mon[34567]: pgmap v326: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 5.5 MiB/s wr, 628 op/s 2024-05-14T15:32:07.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:07 smithi092 ceph-mon[34729]: pgmap v326: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 5.5 MiB/s wr, 628 op/s 2024-05-14T15:32:07.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:07 smithi069 ceph-mon[31270]: pgmap v326: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 5.5 MiB/s wr, 628 op/s 2024-05-14T15:32:09.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:09 smithi092 ceph-mon[34729]: pgmap v327: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 5.5 MiB/s wr, 628 op/s 2024-05-14T15:32:09.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:09 smithi069 ceph-mon[31270]: pgmap v327: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 5.5 MiB/s wr, 628 op/s 2024-05-14T15:32:09.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:09 smithi203 ceph-mon[34567]: pgmap v327: 129 pgs: 129 active+clean; 2.6 GiB data, 16 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 5.5 MiB/s wr, 628 op/s 2024-05-14T15:32:11.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:10 smithi203 ceph-mon[34567]: osdmap e102: 12 total, 12 up, 12 in 2024-05-14T15:32:11.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:10 smithi092 ceph-mon[34729]: osdmap e102: 12 total, 12 up, 12 in 2024-05-14T15:32:11.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:10 smithi069 ceph-mon[31270]: osdmap e102: 12 total, 12 up, 12 in 2024-05-14T15:32:11.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 385.0 s, 624.0 tps, lat 160.566 ms stddev 47.728 2024-05-14T15:32:12.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:11 smithi203 ceph-mon[34567]: pgmap v329: 129 pgs: 129 active+clean; 2.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.8 MiB/s wr, 775 op/s 2024-05-14T15:32:12.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:11 smithi092 ceph-mon[34729]: pgmap v329: 129 pgs: 129 active+clean; 2.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.8 MiB/s wr, 775 op/s 2024-05-14T15:32:12.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:11 smithi069 ceph-mon[31270]: pgmap v329: 129 pgs: 129 active+clean; 2.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.8 MiB/s wr, 775 op/s 2024-05-14T15:32:12.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.703+0000 7fb783000640 1 -- 172.21.15.69:0/756167253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77c10b680 msgr2=0x7fb77c10daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:12.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.703+0000 7fb783000640 1 --2- 172.21.15.69:0/756167253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77c10b680 0x7fb77c10daa0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb774009ca0 tx=0x7fb77402a9e0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.704+0000 7fb783000640 1 -- 172.21.15.69:0/756167253 shutdown_connections 2024-05-14T15:32:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.704+0000 7fb783000640 1 --2- 172.21.15.69:0/756167253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77c10e030 0x7fb77c110520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.704+0000 7fb783000640 1 --2- 172.21.15.69:0/756167253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77c10b680 0x7fb77c10daa0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.704+0000 7fb783000640 1 --2- 172.21.15.69:0/756167253 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c104c20 0x7fb77c105030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.707 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.704+0000 7fb783000640 1 -- 172.21.15.69:0/756167253 >> 172.21.15.69:0/756167253 conn(0x7fb77c0fe220 msgr2=0x7fb77c100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:12.708 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.705+0000 7fb783000640 1 -- 172.21.15.69:0/756167253 shutdown_connections 2024-05-14T15:32:12.708 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.705+0000 7fb783000640 1 -- 172.21.15.69:0/756167253 wait complete. 2024-05-14T15:32:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.707+0000 7fb783000640 1 Processor -- start 2024-05-14T15:32:12.710 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.708+0000 7fb783000640 1 -- start start 2024-05-14T15:32:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.708+0000 7fb783000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77c104c20 0x7fb77c1079b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.708+0000 7fb783000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c10b680 0x7fb77c107ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.708+0000 7fb783000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77c10e030 0x7fb77c1aca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.708+0000 7fb783000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c102f70 con 0x7fb77c10b680 2024-05-14T15:32:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.708+0000 7fb783000640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c102df0 con 0x7fb77c10e030 2024-05-14T15:32:12.711 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.708+0000 7fb783000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c1030f0 con 0x7fb77c104c20 2024-05-14T15:32:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.709+0000 7fb781200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c10b680 0x7fb77c107ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.709+0000 7fb782600640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77c10e030 0x7fb77c1aca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.709+0000 7fb781200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c10b680 0x7fb77c107ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34760/0 (socket says 172.21.15.69:34760) 2024-05-14T15:32:12.712 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.709+0000 7fb781200640 1 -- 172.21.15.69:0/2272835702 learned_addr learned my addr 172.21.15.69:0/2272835702 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.710+0000 7fb781c00640 1 --2- 172.21.15.69:0/2272835702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77c104c20 0x7fb77c1079b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.710+0000 7fb781200640 1 -- 172.21.15.69:0/2272835702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77c104c20 msgr2=0x7fb77c1079b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:12.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.710+0000 7fb781200640 1 --2- 172.21.15.69:0/2272835702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77c104c20 0x7fb77c1079b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.711+0000 7fb781200640 1 -- 172.21.15.69:0/2272835702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77c10e030 msgr2=0x7fb77c1aca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:12.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.711+0000 7fb781200640 1 --2- 172.21.15.69:0/2272835702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77c10e030 0x7fb77c1aca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.711+0000 7fb781200640 1 -- 172.21.15.69:0/2272835702 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb77c1acfb0 con 0x7fb77c10b680 2024-05-14T15:32:12.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.712+0000 7fb781200640 1 --2- 172.21.15.69:0/2272835702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c10b680 0x7fb77c107ef0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb7740098d0 tx=0x7fb774003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:12.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.712+0000 7fb77a000640 1 -- 172.21.15.69:0/2272835702 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774046070 con 0x7fb77c10b680 2024-05-14T15:32:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.713+0000 7fb77a000640 1 -- 172.21.15.69:0/2272835702 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb77402ee40 con 0x7fb77c10b680 2024-05-14T15:32:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.713+0000 7fb77a000640 1 -- 172.21.15.69:0/2272835702 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb774033070 con 0x7fb77c10b680 2024-05-14T15:32:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.713+0000 7fb783000640 1 -- 172.21.15.69:0/2272835702 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb77c1ad180 con 0x7fb77c10b680 2024-05-14T15:32:12.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.714+0000 7fb783000640 1 -- 172.21.15.69:0/2272835702 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb77c1ad590 con 0x7fb77c10b680 2024-05-14T15:32:12.732 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.728+0000 7fb78b5f6740 1 Processor -- start 2024-05-14T15:32:12.732 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.729+0000 7fb78b5f6740 1 -- start start 2024-05-14T15:32:12.732 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.729+0000 7fb78b5f6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84bc41b0 0x555d84f65480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.732 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.729+0000 7fb78b5f6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84b9b2f0 0x555d84f659c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.732 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.729+0000 7fb78b5f6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84ba34d0 0x555d84f65f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.732 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.729+0000 7fb78b5f6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x555d84eca550 con 0x555d84ba34d0 2024-05-14T15:32:12.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.729+0000 7fb78b5f6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555d84e6fbc0 con 0x555d84bc41b0 2024-05-14T15:32:12.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.729+0000 7fb78b5f6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555d84ec6510 con 0x555d84b9b2f0 2024-05-14T15:32:12.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.730+0000 7fb781c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84b9b2f0 0x555d84f659c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.730+0000 7fb781c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84b9b2f0 0x555d84f659c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:41274/0 (socket says 172.21.15.69:41274) 2024-05-14T15:32:12.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.730+0000 7fb781c00640 1 -- 172.21.15.69:0/720991007 learned_addr learned my addr 172.21.15.69:0/720991007 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:12.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.731+0000 7fb782600640 1 --2- 172.21.15.69:0/720991007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84bc41b0 0x555d84f65480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.731+0000 7fb781200640 1 --2- 172.21.15.69:0/720991007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84ba34d0 0x555d84f65f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.731+0000 7fb781c00640 1 -- 172.21.15.69:0/720991007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84bc41b0 msgr2=0x555d84f65480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.732+0000 7fb77a000640 1 -- 172.21.15.69:0/2272835702 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb774049070 con 0x7fb77c10b680 2024-05-14T15:32:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.733+0000 7fb781c00640 1 --2- 172.21.15.69:0/720991007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84bc41b0 0x555d84f65480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.733+0000 7fb781c00640 1 -- 172.21.15.69:0/720991007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84ba34d0 msgr2=0x555d84f65f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.733+0000 7fb781c00640 1 --2- 172.21.15.69:0/720991007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84ba34d0 0x555d84f65f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.733+0000 7fb781c00640 1 -- 172.21.15.69:0/720991007 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d84bdc210 con 0x555d84b9b2f0 2024-05-14T15:32:12.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.733+0000 7fb782600640 1 --2- 172.21.15.69:0/720991007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84bc41b0 0x555d84f65480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:32:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.733+0000 7fb781c00640 1 --2- 172.21.15.69:0/720991007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84b9b2f0 0x555d84f659c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb768009a70 tx=0x7fb768009f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8eaa1499c5b72066 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:12.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.735+0000 7fb76ea00640 1 -- 172.21.15.69:0/720991007 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb768017070 con 0x555d84b9b2f0 2024-05-14T15:32:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.735+0000 7fb76ea00640 1 -- 172.21.15.69:0/720991007 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb768013470 con 0x555d84b9b2f0 2024-05-14T15:32:12.738 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.735+0000 7fb76ea00640 1 -- 172.21.15.69:0/720991007 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb768012630 con 0x555d84b9b2f0 2024-05-14T15:32:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.737+0000 7fb78b5f6740 1 -- 172.21.15.69:0/720991007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84b9b2f0 msgr2=0x555d84f659c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:12.740 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.737+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/720991007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84b9b2f0 0x555d84f659c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb768009a70 tx=0x7fb768009f30 comp rx=0 tx=0).stop 2024-05-14T15:32:12.741 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.739+0000 7fb77a000640 1 --2- 172.21.15.69:0/2272835702 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb7640b2b20 0x7fb7640b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.739+0000 7fb77a000640 1 -- 172.21.15.69:0/2272835702 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9554+0+0 (secure 0 0 0) 0x7fb774103610 con 0x7fb77c10b680 2024-05-14T15:32:12.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.740+0000 7fb782600640 1 --2- 172.21.15.69:0/2272835702 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb7640b2b20 0x7fb7640b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.740+0000 7fb78b5f6740 1 -- 172.21.15.69:0/720991007 shutdown_connections 2024-05-14T15:32:12.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.740+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/720991007 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84ba34d0 0x555d84f65f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.741+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/720991007 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84b9b2f0 0x555d84f659c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.741+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/720991007 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84bc41b0 0x555d84f65480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.741+0000 7fb78b5f6740 1 -- 172.21.15.69:0/720991007 >> 172.21.15.69:0/720991007 conn(0x555d84bb8300 msgr2=0x555d84f61c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:12.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.741+0000 7fb78b5f6740 1 -- 172.21.15.69:0/720991007 shutdown_connections 2024-05-14T15:32:12.744 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.742+0000 7fb78b5f6740 1 -- 172.21.15.69:0/720991007 wait complete. 2024-05-14T15:32:12.745 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.742+0000 7fb782600640 1 --2- 172.21.15.69:0/2272835702 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb7640b2b20 0x7fb7640b5030 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x555d84f625f0 tx=0x7fb770008040 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:12.746 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.743+0000 7fb78b5f6740 1 -- start start 2024-05-14T15:32:12.746 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.743+0000 7fb78b5f6740 1 Processor -- start 2024-05-14T15:32:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.745+0000 7fb78b5f6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84b9b2f0 0x555d84f6f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.745+0000 7fb78b5f6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84ba34d0 0x555d84f6fee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.747 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.745+0000 7fb78b5f6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 0x555d84f7ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.745+0000 7fb781200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84ba34d0 0x555d84f6fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.748 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.745+0000 7fb781200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84ba34d0 0x555d84f6fee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:46250/0 (socket says 172.21.15.69:46250) 2024-05-14T15:32:12.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.746+0000 7fb78b5f6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x555d84f725b0 con 0x555d84b9b2f0 2024-05-14T15:32:12.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.746+0000 7fb78b5f6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x555d84e83660 con 0x555d84ba34d0 2024-05-14T15:32:12.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.746+0000 7fb78b5f6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x555d84f72730 con 0x555d84bc41b0 2024-05-14T15:32:12.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.746+0000 7fb78b5f6740 10 client.0 _ll_register_callbacks cb 0x555d84e4d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:32:12.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.746+0000 7fb781200640 1 -- 172.21.15.69:0/1739196811 learned_addr learned my addr 172.21.15.69:0/1739196811 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:12.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.746+0000 7fb781c00640 1 --2- 172.21.15.69:0/1739196811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84b9b2f0 0x555d84f6f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.747+0000 7fb782600640 1 --2- 172.21.15.69:0/1739196811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 0x555d84f7ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.747+0000 7fb781200640 1 -- 172.21.15.69:0/1739196811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 msgr2=0x555d84f7ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.747+0000 7fb781200640 1 --2- 172.21.15.69:0/1739196811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 0x555d84f7ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.747+0000 7fb781200640 1 -- 172.21.15.69:0/1739196811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84b9b2f0 msgr2=0x555d84f6f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.747+0000 7fb781200640 1 --2- 172.21.15.69:0/1739196811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84b9b2f0 0x555d84f6f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.747+0000 7fb781200640 1 -- 172.21.15.69:0/1739196811 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d84ca8620 con 0x555d84ba34d0 2024-05-14T15:32:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.748+0000 7fb781200640 1 --2- 172.21.15.69:0/1739196811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84ba34d0 0x555d84f6fee0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb7740ca180 tx=0x7fb7740c6340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e48821e7b8b6fff8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:12.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.748+0000 7fb763400640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:32:12.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.748+0000 7fb763400640 1 -- 172.21.15.69:0/1739196811 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7740c9bf0 con 0x555d84ba34d0 2024-05-14T15:32:12.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.748+0000 7fb763400640 1 -- 172.21.15.69:0/1739196811 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9554+0+0 (secure 0 0 0) 0x7fb77402e9b0 con 0x555d84ba34d0 2024-05-14T15:32:12.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.749+0000 7fb78b5f6740 1 -- 172.21.15.69:0/1739196811 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb768013470 con 0x555d84ba34d0 2024-05-14T15:32:12.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.750+0000 7fb763400640 1 -- 172.21.15.69:0/1739196811 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fb77402f9d0 con 0x555d84ba34d0 2024-05-14T15:32:12.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.750+0000 7fb78b5f6740 10 client.36485 fetch_fsmap learned FSMap version 62 2024-05-14T15:32:12.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.750+0000 7fb78b5f6740 1 -- 172.21.15.69:0/1739196811 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x555d84f725b0 con 0x555d84ba34d0 2024-05-14T15:32:12.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.752+0000 7fb763400640 1 -- 172.21.15.69:0/1739196811 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb768013470 con 0x555d84ba34d0 2024-05-14T15:32:12.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.752+0000 7fb763400640 1 -- 172.21.15.69:0/1739196811 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7fb774100b70 con 0x555d84ba34d0 2024-05-14T15:32:12.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.752+0000 7fb78b5f6740 10 client.36485 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:32:12.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.752+0000 7fb78b5f6740 10 client.36485 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:32:12.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.752+0000 7fb78b5f6740 20 client.36485 populate_metadata read hostname 'smithi069' 2024-05-14T15:32:12.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.752+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/1739196811 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555d84b82d80 0x555d84f81cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.752+0000 7fb78b5f6740 4 client.36485 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:32:12.755 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.752+0000 7fb78b5f6740 1 -- 172.21.15.69:0/1739196811 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555d84ed8160 con 0x555d84b82d80 2024-05-14T15:32:12.756 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.753+0000 7fb781c00640 1 --2- 172.21.15.69:0/1739196811 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555d84b82d80 0x555d84f81cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.755+0000 7fb781c00640 1 --2- 172.21.15.69:0/1739196811 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555d84b82d80 0x555d84f81cd0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b42530e51aed87e server_cookie=6b58892fd5ccee3b in_seq=0 out_seq=0 2024-05-14T15:32:12.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.755+0000 7fb763400640 10 client.36485 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:32:12.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.758+0000 7fb763400640 1 -- 172.21.15.69:0/1739196811 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555d84ed8160 con 0x555d84b82d80 2024-05-14T15:32:12.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.758+0000 7fb763400640 10 client.36485 handle_command_reply: tid=0 2024-05-14T15:32:12.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.758+0000 7fb78b5f6740 1 client.36485 shutdown 2024-05-14T15:32:12.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.759+0000 7fb78b5f6740 1 -- 172.21.15.69:0/1739196811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84ba34d0 msgr2=0x555d84f6fee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:12.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.759+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/1739196811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84ba34d0 0x555d84f6fee0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb7740ca180 tx=0x7fb7740c6340 comp rx=0 tx=0).stop 2024-05-14T15:32:12.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.760+0000 7fb78b5f6740 1 -- 172.21.15.69:0/1739196811 shutdown_connections 2024-05-14T15:32:12.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.760+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/1739196811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 0x555d84f7ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.760+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/1739196811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84ba34d0 0x555d84f6fee0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.760+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/1739196811 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555d84b82d80 0x555d84f81cd0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.760+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/1739196811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84b9b2f0 0x555d84f6f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.761+0000 7fb78b5f6740 1 -- 172.21.15.69:0/1739196811 >> 172.21.15.69:0/1739196811 conn(0x555d84bb8300 msgr2=0x555d84f65250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:12.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.761+0000 7fb763400640 0 client.36485 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:32:12.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.761+0000 7fb78b5f6740 1 -- 172.21.15.69:0/1739196811 shutdown_connections 2024-05-14T15:32:12.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.761+0000 7fb78b5f6740 1 -- 172.21.15.69:0/1739196811 wait complete. 2024-05-14T15:32:12.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.762+0000 7fb78b5f6740 20 client.36485 trim_cache size 0 max 16384 2024-05-14T15:32:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.807+0000 7fb78b5f6740 1 Processor -- start 2024-05-14T15:32:12.810 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.807+0000 7fb78b5f6740 1 -- start start 2024-05-14T15:32:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.808+0000 7fb78b5f6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84b9b2f0 0x555d84f6a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.809+0000 7fb78b5f6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84ba34d0 0x555d84f65920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.810+0000 7fb78b5f6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 0x555d84f874d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.810+0000 7fb781c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84b9b2f0 0x555d84f6a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.810+0000 7fb78b5f6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c1b7820 con 0x555d84ba34d0 2024-05-14T15:32:12.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.810+0000 7fb78b5f6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c1b9360 con 0x555d84b9b2f0 2024-05-14T15:32:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.810+0000 7fb78b5f6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c1b7ef0 con 0x555d84bc41b0 2024-05-14T15:32:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.810+0000 7fb781c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84b9b2f0 0x555d84f6a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:43038/0 (socket says 172.21.15.69:43038) 2024-05-14T15:32:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.811+0000 7fb781c00640 1 -- 172.21.15.69:0/2057724631 learned_addr learned my addr 172.21.15.69:0/2057724631 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.811+0000 7fb782600640 1 --2- 172.21.15.69:0/2057724631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 0x555d84f874d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.811+0000 7fb781200640 1 --2- 172.21.15.69:0/2057724631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84ba34d0 0x555d84f65920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.812+0000 7fb781c00640 1 -- 172.21.15.69:0/2057724631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 msgr2=0x555d84f874d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.812+0000 7fb781c00640 1 --2- 172.21.15.69:0/2057724631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 0x555d84f874d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.812+0000 7fb781c00640 1 -- 172.21.15.69:0/2057724631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84ba34d0 msgr2=0x555d84f65920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:12.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.813+0000 7fb781c00640 1 --2- 172.21.15.69:0/2057724631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84ba34d0 0x555d84f65920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.813+0000 7fb781c00640 1 -- 172.21.15.69:0/2057724631 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d84f62820 con 0x555d84b9b2f0 2024-05-14T15:32:12.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.813+0000 7fb781200640 1 --2- 172.21.15.69:0/2057724631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84ba34d0 0x555d84f65920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:32:12.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.814+0000 7fb781c00640 1 --2- 172.21.15.69:0/2057724631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84b9b2f0 0x555d84f6a0e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x555d84f62f70 tx=0x7fb7680046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=12f90cb6ed7fa703 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:12.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.815+0000 7fb76e000640 1 -- 172.21.15.69:0/2057724631 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb768029020 con 0x555d84b9b2f0 2024-05-14T15:32:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.816+0000 7fb76e000640 1 -- 172.21.15.69:0/2057724631 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x555d84ed8160 con 0x555d84b9b2f0 2024-05-14T15:32:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.816+0000 7fb76e000640 1 -- 172.21.15.69:0/2057724631 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb768017040 con 0x555d84b9b2f0 2024-05-14T15:32:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.817+0000 7fb78b5f6740 1 -- 172.21.15.69:0/2057724631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84b9b2f0 msgr2=0x555d84f6a0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:12.820 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.817+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/2057724631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84b9b2f0 0x555d84f6a0e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x555d84f62f70 tx=0x7fb7680046c0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.817+0000 7fb78b5f6740 1 -- 172.21.15.69:0/2057724631 shutdown_connections 2024-05-14T15:32:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.817+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/2057724631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 0x555d84f874d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.817+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/2057724631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84ba34d0 0x555d84f65920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.817+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/2057724631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84b9b2f0 0x555d84f6a0e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.817+0000 7fb78b5f6740 1 -- 172.21.15.69:0/2057724631 >> 172.21.15.69:0/2057724631 conn(0x555d84bb8300 msgr2=0x555d84f65210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.818+0000 7fb78b5f6740 1 -- 172.21.15.69:0/2057724631 shutdown_connections 2024-05-14T15:32:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.818+0000 7fb78b5f6740 1 -- 172.21.15.69:0/2057724631 wait complete. 2024-05-14T15:32:12.822 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.819+0000 7fb78b5f6740 1 -- start start 2024-05-14T15:32:12.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.819+0000 7fb78b5f6740 1 Processor -- start 2024-05-14T15:32:12.824 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.821+0000 7fb78b5f6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84b9b2f0 0x555d84f729b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.822+0000 7fb78b5f6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84ba34d0 0x555d84f72ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.822+0000 7fb78b5f6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 0x555d84fe8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.823+0000 7fb78b5f6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c1b8c90 con 0x555d84ba34d0 2024-05-14T15:32:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.823+0000 7fb78b5f6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c1b85c0 con 0x555d84b9b2f0 2024-05-14T15:32:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.823+0000 7fb78b5f6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb77c1b5820 con 0x555d84bc41b0 2024-05-14T15:32:12.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.823+0000 7fb78b5f6740 10 client.0 _ll_register_callbacks cb 0x7fb77402fbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:32:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.823+0000 7fb781c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84b9b2f0 0x555d84f729b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.823+0000 7fb782600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 0x555d84fe8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.823+0000 7fb782600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 0x555d84fe8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:52322/0 (socket says 172.21.15.69:52322) 2024-05-14T15:32:12.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.823+0000 7fb782600640 1 -- 172.21.15.69:0/1086999543 learned_addr learned my addr 172.21.15.69:0/1086999543 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.824+0000 7fb782600640 1 -- 172.21.15.69:0/1086999543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84b9b2f0 msgr2=0x555d84f729b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.824+0000 7fb782600640 1 --2- 172.21.15.69:0/1086999543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84b9b2f0 0x555d84f729b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.824+0000 7fb782600640 1 -- 172.21.15.69:0/1086999543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84ba34d0 msgr2=0x555d84f72ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.824+0000 7fb782600640 1 --2- 172.21.15.69:0/1086999543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84ba34d0 0x555d84f72ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.824+0000 7fb782600640 1 -- 172.21.15.69:0/1086999543 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d84f73740 con 0x555d84bc41b0 2024-05-14T15:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.825+0000 7fb782600640 1 --2- 172.21.15.69:0/1086999543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 0x555d84fe8070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb770015a20 tx=0x7fb7700046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f25fc1158f7f9b77 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:12.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.825+0000 7fb763400640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:32:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.826+0000 7fb763400640 1 -- 172.21.15.69:0/1086999543 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb770028070 con 0x555d84bc41b0 2024-05-14T15:32:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.826+0000 7fb763400640 1 -- 172.21.15.69:0/1086999543 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9554+0+0 (secure 0 0 0) 0x7fb770016db0 con 0x555d84bc41b0 2024-05-14T15:32:12.831 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.826+0000 7fb78b5f6740 1 -- 172.21.15.69:0/1086999543 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555d84ed8160 con 0x555d84bc41b0 2024-05-14T15:32:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.827+0000 7fb763400640 1 -- 172.21.15.69:0/1086999543 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fb770034050 con 0x555d84bc41b0 2024-05-14T15:32:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.828+0000 7fb78b5f6740 10 client.26479 fetch_fsmap learned FSMap version 62 2024-05-14T15:32:12.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.828+0000 7fb78b5f6740 1 -- 172.21.15.69:0/1086999543 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x555d84fe9630 con 0x555d84bc41b0 2024-05-14T15:32:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.829+0000 7fb763400640 1 -- 172.21.15.69:0/1086999543 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x555d84ed8160 con 0x555d84bc41b0 2024-05-14T15:32:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.829+0000 7fb763400640 1 -- 172.21.15.69:0/1086999543 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7fb770022040 con 0x555d84bc41b0 2024-05-14T15:32:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.829+0000 7fb78b5f6740 10 client.26479 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:32:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.830+0000 7fb78b5f6740 10 client.26479 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:32:12.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.830+0000 7fb78b5f6740 20 client.26479 populate_metadata read hostname 'smithi069' 2024-05-14T15:32:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.830+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/1086999543 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555d84b581c0 0x555d84febe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.830+0000 7fb78b5f6740 4 client.26479 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:32:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.830+0000 7fb78b5f6740 1 -- 172.21.15.69:0/1086999543 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555d84ed1fd0 con 0x555d84b581c0 2024-05-14T15:32:12.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.830+0000 7fb781c00640 1 --2- 172.21.15.69:0/1086999543 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555d84b581c0 0x555d84febe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.832+0000 7fb781c00640 1 --2- 172.21.15.69:0/1086999543 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555d84b581c0 0x555d84febe70 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=89dab13a41ea41b6 server_cookie=e702a3d9209febd in_seq=0 out_seq=0 2024-05-14T15:32:12.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.832+0000 7fb763400640 10 client.26479 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:32:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.872+0000 7fb763400640 1 -- 172.21.15.69:0/1086999543 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555d84ed1fd0 con 0x555d84b581c0 2024-05-14T15:32:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.873+0000 7fb763400640 10 client.26479 handle_command_reply: tid=0 2024-05-14T15:32:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.873+0000 7fb78b5f6740 1 client.26479 shutdown 2024-05-14T15:32:12.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.874+0000 7fb78b5f6740 1 -- 172.21.15.69:0/1086999543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 msgr2=0x555d84fe8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:12.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.874+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/1086999543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 0x555d84fe8070 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb770015a20 tx=0x7fb7700046c0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.875+0000 7fb78b5f6740 1 -- 172.21.15.69:0/1086999543 shutdown_connections 2024-05-14T15:32:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.875+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/1086999543 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x555d84bc41b0 0x555d84fe8070 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.875+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/1086999543 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x555d84b581c0 0x555d84febe70 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.875+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/1086999543 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x555d84ba34d0 0x555d84f72ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.875+0000 7fb78b5f6740 1 --2- 172.21.15.69:0/1086999543 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x555d84b9b2f0 0x555d84f729b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.875+0000 7fb78b5f6740 1 -- 172.21.15.69:0/1086999543 >> 172.21.15.69:0/1086999543 conn(0x555d84bb8300 msgr2=0x555d84f61b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.875+0000 7fb763400640 0 client.26479 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:32:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.876+0000 7fb78b5f6740 1 -- 172.21.15.69:0/1086999543 shutdown_connections 2024-05-14T15:32:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.876+0000 7fb78b5f6740 1 -- 172.21.15.69:0/1086999543 wait complete. 2024-05-14T15:32:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.876+0000 7fb78b5f6740 20 client.26479 trim_cache size 0 max 16384 2024-05-14T15:32:12.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:32:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:32:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:32:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:32:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.877+0000 7fb783000640 1 -- 172.21.15.69:0/2272835702 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb7640b2b20 msgr2=0x7fb7640b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.877+0000 7fb783000640 1 --2- 172.21.15.69:0/2272835702 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb7640b2b20 0x7fb7640b5030 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x555d84f625f0 tx=0x7fb770008040 comp rx=0 tx=0).stop 2024-05-14T15:32:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.877+0000 7fb783000640 1 -- 172.21.15.69:0/2272835702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c10b680 msgr2=0x7fb77c107ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:12.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.877+0000 7fb783000640 1 --2- 172.21.15.69:0/2272835702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c10b680 0x7fb77c107ef0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fb7740098d0 tx=0x7fb774003f80 comp rx=0 tx=0).stop 2024-05-14T15:32:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.878+0000 7fb783000640 1 -- 172.21.15.69:0/2272835702 shutdown_connections 2024-05-14T15:32:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.878+0000 7fb783000640 1 --2- 172.21.15.69:0/2272835702 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb7640b2b20 0x7fb7640b5030 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.878+0000 7fb783000640 1 --2- 172.21.15.69:0/2272835702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb77c10e030 0x7fb77c1aca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.878+0000 7fb783000640 1 --2- 172.21.15.69:0/2272835702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb77c10b680 0x7fb77c107ef0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.878+0000 7fb783000640 1 --2- 172.21.15.69:0/2272835702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb77c104c20 0x7fb77c1079b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:12.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.878+0000 7fb783000640 1 -- 172.21.15.69:0/2272835702 >> 172.21.15.69:0/2272835702 conn(0x7fb77c0fe220 msgr2=0x7fb77c10eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.879+0000 7fb783000640 1 -- 172.21.15.69:0/2272835702 shutdown_connections 2024-05-14T15:32:12.882 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:12.879+0000 7fb783000640 1 -- 172.21.15.69:0/2272835702 wait complete. 2024-05-14T15:32:14.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:13 smithi203 ceph-mon[34567]: pgmap v330: 129 pgs: 129 active+clean; 2.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.6 MiB/s wr, 631 op/s 2024-05-14T15:32:14.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:13 smithi092 ceph-mon[34729]: pgmap v330: 129 pgs: 129 active+clean; 2.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.6 MiB/s wr, 631 op/s 2024-05-14T15:32:14.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:13 smithi069 ceph-mon[31270]: pgmap v330: 129 pgs: 129 active+clean; 2.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 5.6 MiB/s wr, 631 op/s 2024-05-14T15:32:16.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:15 smithi203 ceph-mon[34567]: pgmap v331: 129 pgs: 129 active+clean; 2.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 4.8 MiB/s wr, 584 op/s 2024-05-14T15:32:16.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:15 smithi092 ceph-mon[34729]: pgmap v331: 129 pgs: 129 active+clean; 2.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 4.8 MiB/s wr, 584 op/s 2024-05-14T15:32:16.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:15 smithi069 ceph-mon[31270]: pgmap v331: 129 pgs: 129 active+clean; 2.6 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 4.8 MiB/s wr, 584 op/s 2024-05-14T15:32:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 390.0 s, 586.0 tps, lat 170.677 ms stddev 48.462 2024-05-14T15:32:18.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:17 smithi203 ceph-mon[34567]: pgmap v332: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.3 MiB/s wr, 605 op/s 2024-05-14T15:32:18.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:17 smithi092 ceph-mon[34729]: pgmap v332: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.3 MiB/s wr, 605 op/s 2024-05-14T15:32:18.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:17 smithi069 ceph-mon[31270]: pgmap v332: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.3 MiB/s wr, 605 op/s 2024-05-14T15:32:20.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:19 smithi203 ceph-mon[34567]: pgmap v333: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.3 MiB/s wr, 605 op/s 2024-05-14T15:32:20.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:19 smithi092 ceph-mon[34729]: pgmap v333: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.3 MiB/s wr, 605 op/s 2024-05-14T15:32:20.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:19 smithi069 ceph-mon[31270]: pgmap v333: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.3 MiB/s wr, 605 op/s 2024-05-14T15:32:21.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 395.0 s, 573.8 tps, lat 171.408 ms stddev 71.287 2024-05-14T15:32:22.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:21 smithi203 ceph-mon[34567]: pgmap v334: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.0 MiB/s wr, 574 op/s 2024-05-14T15:32:22.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:21 smithi092 ceph-mon[34729]: pgmap v334: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.0 MiB/s wr, 574 op/s 2024-05-14T15:32:22.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:21 smithi069 ceph-mon[31270]: pgmap v334: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 23 KiB/s rd, 5.0 MiB/s wr, 574 op/s 2024-05-14T15:32:24.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:23 smithi203 ceph-mon[34567]: pgmap v335: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 498 op/s 2024-05-14T15:32:24.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:23 smithi092 ceph-mon[34729]: pgmap v335: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 498 op/s 2024-05-14T15:32:24.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:23 smithi069 ceph-mon[31270]: pgmap v335: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 4.3 MiB/s wr, 498 op/s 2024-05-14T15:32:26.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:25 smithi203 ceph-mon[34567]: pgmap v336: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.6 MiB/s wr, 657 op/s 2024-05-14T15:32:26.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:25 smithi092 ceph-mon[34729]: pgmap v336: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.6 MiB/s wr, 657 op/s 2024-05-14T15:32:26.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:25 smithi069 ceph-mon[31270]: pgmap v336: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 5.6 MiB/s wr, 657 op/s 2024-05-14T15:32:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.342+0000 7f19a4800640 1 -- 172.21.15.69:0/3925002474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f199c1032f0 msgr2=0x7f199c10f6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.342+0000 7f19a4800640 1 --2- 172.21.15.69:0/3925002474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f199c1032f0 0x7f199c10f6c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f1998009be0 tx=0x7f199802a6e0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.343+0000 7f19a4800640 1 -- 172.21.15.69:0/3925002474 shutdown_connections 2024-05-14T15:32:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.343+0000 7f19a4800640 1 --2- 172.21.15.69:0/3925002474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f199c1032f0 0x7f199c10f6c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.343+0000 7f19a4800640 1 --2- 172.21.15.69:0/3925002474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c109040 0x7f199c102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.343+0000 7f19a4800640 1 --2- 172.21.15.69:0/3925002474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f199c108ba0 0x7f199c102740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.343+0000 7f19a4800640 1 -- 172.21.15.69:0/3925002474 >> 172.21.15.69:0/3925002474 conn(0x7f199c0782e0 msgr2=0x7f199c078720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.344+0000 7f19a4800640 1 -- 172.21.15.69:0/3925002474 shutdown_connections 2024-05-14T15:32:26.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.344+0000 7f19a4800640 1 -- 172.21.15.69:0/3925002474 wait complete. 2024-05-14T15:32:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.346+0000 7f19a4800640 1 Processor -- start 2024-05-14T15:32:26.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.348+0000 7f19a4800640 1 -- start start 2024-05-14T15:32:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.348+0000 7f19a4800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c1032f0 0x7f199c1a0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.348+0000 7f19a4800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f199c108ba0 0x7f199c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.348+0000 7f19a4800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f199c109040 0x7f199c198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.348+0000 7f19a4800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f199c112cc0 con 0x7f199c1032f0 2024-05-14T15:32:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.348+0000 7f19a4800640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f199c112b40 con 0x7f199c108ba0 2024-05-14T15:32:26.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.348+0000 7f19a4800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f199c112e40 con 0x7f199c109040 2024-05-14T15:32:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.349+0000 7f19a2800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f199c109040 0x7f199c198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.349+0000 7f19a2800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f199c109040 0x7f199c198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35342/0 (socket says 172.21.15.69:35342) 2024-05-14T15:32:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.349+0000 7f19a2800640 1 -- 172.21.15.69:0/1655334535 learned_addr learned my addr 172.21.15.69:0/1655334535 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:26.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.349+0000 7f19a2800640 1 -- 172.21.15.69:0/1655334535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f199c108ba0 msgr2=0x7f199c198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.349+0000 7f19a2800640 1 --2- 172.21.15.69:0/1655334535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f199c108ba0 0x7f199c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.349+0000 7f19a2800640 1 -- 172.21.15.69:0/1655334535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c1032f0 msgr2=0x7f199c1a0330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.349+0000 7f19a2800640 1 --2- 172.21.15.69:0/1655334535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c1032f0 0x7f199c1a0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.349+0000 7f19a2800640 1 -- 172.21.15.69:0/1655334535 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f199c1992a0 con 0x7f199c109040 2024-05-14T15:32:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.350+0000 7f19a2800640 1 --2- 172.21.15.69:0/1655334535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f199c109040 0x7f199c198a80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1998009b30 tx=0x7f1998030e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:26.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.350+0000 7f1996a00640 1 -- 172.21.15.69:0/1655334535 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1998041020 con 0x7f199c109040 2024-05-14T15:32:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.350+0000 7f1996a00640 1 -- 172.21.15.69:0/1655334535 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f1998037040 con 0x7f199c109040 2024-05-14T15:32:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.350+0000 7f1996a00640 1 -- 172.21.15.69:0/1655334535 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1998036070 con 0x7f199c109040 2024-05-14T15:32:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.351+0000 7f19a4800640 1 -- 172.21.15.69:0/1655334535 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f199c1b59d0 con 0x7f199c109040 2024-05-14T15:32:26.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.351+0000 7f19a4800640 1 -- 172.21.15.69:0/1655334535 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f199c1b5e70 con 0x7f199c109040 2024-05-14T15:32:26.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.355+0000 7f19ab80a740 1 Processor -- start 2024-05-14T15:32:26.358 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.356+0000 7f19ab80a740 1 -- start start 2024-05-14T15:32:26.359 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.357+0000 7f19ab80a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5d51b0 0x55763d976280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.359 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.357+0000 7f19ab80a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5ac2f0 0x55763d9767c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.359 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.357+0000 7f19ab80a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 0x55763d976d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.359 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.357+0000 7f19ab80a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55763d8db550 con 0x55763d5d51b0 2024-05-14T15:32:26.359 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.357+0000 7f19ab80a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55763d880bc0 con 0x55763d5ac2f0 2024-05-14T15:32:26.359 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.357+0000 7f19ab80a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55763d8d7510 con 0x55763d5b44d0 2024-05-14T15:32:26.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.357+0000 7f19a1400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5d51b0 0x55763d976280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:26.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.358+0000 7f19a1400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5d51b0 0x55763d976280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34232/0 (socket says 172.21.15.69:34232) 2024-05-14T15:32:26.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.358+0000 7f19a1400640 1 -- 172.21.15.69:0/1232655339 learned_addr learned my addr 172.21.15.69:0/1232655339 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:26.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.358+0000 7f19a1e00640 1 --2- 172.21.15.69:0/1232655339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5ac2f0 0x55763d9767c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:26.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.358+0000 7f19a1400640 1 --2- 172.21.15.69:0/1232655339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 0x55763d976d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.360+0000 7f19a1e00640 1 -- 172.21.15.69:0/1232655339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 msgr2=0x55763d976d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.360+0000 7f19a1e00640 1 --2- 172.21.15.69:0/1232655339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 0x55763d976d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.360+0000 7f19a1e00640 1 -- 172.21.15.69:0/1232655339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5d51b0 msgr2=0x55763d976280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.360+0000 7f19a1e00640 1 --2- 172.21.15.69:0/1232655339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5d51b0 0x55763d976280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.360+0000 7f19a1e00640 1 -- 172.21.15.69:0/1232655339 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55763d5ed210 con 0x55763d5ac2f0 2024-05-14T15:32:26.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.361+0000 7f19a1400640 1 --2- 172.21.15.69:0/1232655339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5d51b0 0x55763d976280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:32:26.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.362+0000 7f19a1e00640 1 --2- 172.21.15.69:0/1232655339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5ac2f0 0x55763d9767c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f19900096f0 tx=0x7f1990009bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a04f77a681357b42 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.363+0000 7f198b000640 1 -- 172.21.15.69:0/1232655339 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1990015020 con 0x55763d5ac2f0 2024-05-14T15:32:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.363+0000 7f198b000640 1 -- 172.21.15.69:0/1232655339 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f199000bd60 con 0x55763d5ac2f0 2024-05-14T15:32:26.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.363+0000 7f198b000640 1 -- 172.21.15.69:0/1232655339 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1990011de0 con 0x55763d5ac2f0 2024-05-14T15:32:26.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.364+0000 7f1996a00640 1 -- 172.21.15.69:0/1655334535 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f1998044020 con 0x7f199c109040 2024-05-14T15:32:26.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.365+0000 7f19ab80a740 1 -- 172.21.15.69:0/1232655339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5ac2f0 msgr2=0x55763d9767c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:26.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.365+0000 7f19ab80a740 1 --2- 172.21.15.69:0/1232655339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5ac2f0 0x55763d9767c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f19900096f0 tx=0x7f1990009bb0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.366+0000 7f19ab80a740 1 -- 172.21.15.69:0/1232655339 shutdown_connections 2024-05-14T15:32:26.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.366+0000 7f19ab80a740 1 --2- 172.21.15.69:0/1232655339 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 0x55763d976d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.366+0000 7f19ab80a740 1 --2- 172.21.15.69:0/1232655339 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5ac2f0 0x55763d9767c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.366+0000 7f19ab80a740 1 --2- 172.21.15.69:0/1232655339 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5d51b0 0x55763d976280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.366+0000 7f19ab80a740 1 -- 172.21.15.69:0/1232655339 >> 172.21.15.69:0/1232655339 conn(0x55763d5c9300 msgr2=0x55763d972a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:26.369 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 400.0 s, 582.4 tps, lat 173.708 ms stddev 97.222 2024-05-14T15:32:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.367+0000 7f19ab80a740 1 -- 172.21.15.69:0/1232655339 shutdown_connections 2024-05-14T15:32:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.367+0000 7f1996a00640 1 --2- 172.21.15.69:0/1655334535 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f19840b2860 0x7f19840b4d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.367+0000 7f1996a00640 1 -- 172.21.15.69:0/1655334535 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9554+0+0 (secure 0 0 0) 0x7f1998103530 con 0x7f199c109040 2024-05-14T15:32:26.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.367+0000 7f19ab80a740 1 -- 172.21.15.69:0/1232655339 wait complete. 2024-05-14T15:32:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.368+0000 7f19a1e00640 1 --2- 172.21.15.69:0/1655334535 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f19840b2860 0x7f19840b4d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.368+0000 7f19ab80a740 1 -- start start 2024-05-14T15:32:26.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.369+0000 7f19ab80a740 1 Processor -- start 2024-05-14T15:32:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.370+0000 7f19ab80a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5ac2f0 0x55763d980740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.370+0000 7f19ab80a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 0x55763d980c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.370+0000 7f19ab80a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5d51b0 0x55763d98c890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.370+0000 7f19ab80a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55763d9833b0 con 0x55763d5ac2f0 2024-05-14T15:32:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.370+0000 7f19ab80a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55763d894660 con 0x55763d5d51b0 2024-05-14T15:32:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.370+0000 7f19ab80a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55763d983530 con 0x55763d5b44d0 2024-05-14T15:32:26.372 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.370+0000 7f19ab80a740 10 client.0 _ll_register_callbacks cb 0x55763d85e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:32:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.370+0000 7f19a1e00640 1 --2- 172.21.15.69:0/1655334535 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f19840b2860 0x7f19840b4d70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1990007fd0 tx=0x7f1990011700 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.370+0000 7f19a1e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5ac2f0 0x55763d980740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.370+0000 7f19a1e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5ac2f0 0x55763d980740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34240/0 (socket says 172.21.15.69:34240) 2024-05-14T15:32:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.370+0000 7f19a1e00640 1 -- 172.21.15.69:0/52548257 learned_addr learned my addr 172.21.15.69:0/52548257 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:26.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.371+0000 7f19a1400640 1 --2- 172.21.15.69:0/52548257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 0x55763d980c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.371+0000 7f19a1e00640 1 -- 172.21.15.69:0/52548257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 msgr2=0x55763d980c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.371+0000 7f19a1e00640 1 --2- 172.21.15.69:0/52548257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 0x55763d980c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.371+0000 7f19a1e00640 1 -- 172.21.15.69:0/52548257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5d51b0 msgr2=0x55763d98c890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.371+0000 7f19a1e00640 1 --2- 172.21.15.69:0/52548257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5d51b0 0x55763d98c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.371+0000 7f19a1e00640 1 -- 172.21.15.69:0/52548257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55763d6b9620 con 0x55763d5ac2f0 2024-05-14T15:32:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.371+0000 7f19a1400640 1 --2- 172.21.15.69:0/52548257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 0x55763d980c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:32:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.372+0000 7f19a1e00640 1 --2- 172.21.15.69:0/52548257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5ac2f0 0x55763d980740 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x55763d973d70 tx=0x7f1990009bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7656f4bab46030b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:26.374 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.372+0000 7f197f400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:32:26.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.373+0000 7f197f400640 1 -- 172.21.15.69:0/52548257 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1990015040 con 0x55763d5ac2f0 2024-05-14T15:32:26.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.373+0000 7f197f400640 1 -- 172.21.15.69:0/52548257 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9554+0+0 (secure 0 0 0) 0x7f199001a630 con 0x55763d5ac2f0 2024-05-14T15:32:26.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.373+0000 7f19ab80a740 1 -- 172.21.15.69:0/52548257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f199000bd60 con 0x55763d5ac2f0 2024-05-14T15:32:26.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.374+0000 7f197f400640 1 -- 172.21.15.69:0/52548257 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f1990015040 con 0x55763d5ac2f0 2024-05-14T15:32:26.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.376+0000 7f19ab80a740 10 client.16998 fetch_fsmap learned FSMap version 62 2024-05-14T15:32:26.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.376+0000 7f19ab80a740 1 -- 172.21.15.69:0/52548257 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55763d9a05f0 con 0x55763d5ac2f0 2024-05-14T15:32:26.378 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.377+0000 7f197f400640 1 -- 172.21.15.69:0/52548257 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f199001acc0 con 0x55763d5ac2f0 2024-05-14T15:32:26.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.377+0000 7f197f400640 1 -- 172.21.15.69:0/52548257 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f1990039990 con 0x55763d5ac2f0 2024-05-14T15:32:26.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.377+0000 7f19ab80a740 10 client.16998 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:32:26.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.377+0000 7f19ab80a740 10 client.16998 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:32:26.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.377+0000 7f19ab80a740 20 client.16998 populate_metadata read hostname 'smithi069' 2024-05-14T15:32:26.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.377+0000 7f19ab80a740 1 --2- 172.21.15.69:0/52548257 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55763d593d80 0x55763d9a3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.377+0000 7f19ab80a740 4 client.16998 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:32:26.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.377+0000 7f19ab80a740 1 -- 172.21.15.69:0/52548257 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f199000bd60 con 0x55763d593d80 2024-05-14T15:32:26.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.378+0000 7f19a1400640 1 --2- 172.21.15.69:0/52548257 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55763d593d80 0x55763d9a3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:26.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.380+0000 7f197f400640 10 client.16998 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:32:26.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.380+0000 7f19a1400640 1 --2- 172.21.15.69:0/52548257 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55763d593d80 0x55763d9a3a00 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e3cfface4779a55c server_cookie=d6b04e1146ecf244 in_seq=0 out_seq=0 2024-05-14T15:32:26.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.381+0000 7f197f400640 1 -- 172.21.15.69:0/52548257 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f199000bd60 con 0x55763d593d80 2024-05-14T15:32:26.384 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.382+0000 7f197f400640 10 client.16998 handle_command_reply: tid=0 2024-05-14T15:32:26.384 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.382+0000 7f19ab80a740 1 client.16998 shutdown 2024-05-14T15:32:26.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.383+0000 7f19ab80a740 1 -- 172.21.15.69:0/52548257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5ac2f0 msgr2=0x55763d980740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:26.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.383+0000 7f19ab80a740 1 --2- 172.21.15.69:0/52548257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5ac2f0 0x55763d980740 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x55763d973d70 tx=0x7f1990009bb0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.384+0000 7f19ab80a740 1 -- 172.21.15.69:0/52548257 shutdown_connections 2024-05-14T15:32:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.384+0000 7f19ab80a740 1 --2- 172.21.15.69:0/52548257 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5d51b0 0x55763d98c890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.384+0000 7f19ab80a740 1 --2- 172.21.15.69:0/52548257 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 0x55763d980c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.384+0000 7f19ab80a740 1 --2- 172.21.15.69:0/52548257 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55763d593d80 0x55763d9a3a00 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.384+0000 7f19ab80a740 1 --2- 172.21.15.69:0/52548257 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5ac2f0 0x55763d980740 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.384+0000 7f19ab80a740 1 -- 172.21.15.69:0/52548257 >> 172.21.15.69:0/52548257 conn(0x55763d5c9300 msgr2=0x55763d977fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:26.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.384+0000 7f197f400640 0 client.16998 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:32:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.386+0000 7f19ab80a740 1 -- 172.21.15.69:0/52548257 shutdown_connections 2024-05-14T15:32:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.386+0000 7f19ab80a740 1 -- 172.21.15.69:0/52548257 wait complete. 2024-05-14T15:32:26.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.386+0000 7f19ab80a740 20 client.16998 trim_cache size 0 max 16384 2024-05-14T15:32:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.423+0000 7f19ab80a740 1 Processor -- start 2024-05-14T15:32:26.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.424+0000 7f19ab80a740 1 -- start start 2024-05-14T15:32:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.424+0000 7f19ab80a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5ac2f0 0x55763d9771b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.424+0000 7f19ab80a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5b44d0 0x55763d9788f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.424+0000 7f19ab80a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5d51b0 0x55763d98c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.424+0000 7f19ab80a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f199c1b7ba0 con 0x55763d5d51b0 2024-05-14T15:32:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.424+0000 7f19ab80a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f199c1b96e0 con 0x55763d5b44d0 2024-05-14T15:32:26.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.424+0000 7f19ab80a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f199c1b8270 con 0x55763d5ac2f0 2024-05-14T15:32:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.425+0000 7f19a1400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5b44d0 0x55763d9788f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.425+0000 7f19a1400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5b44d0 0x55763d9788f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:41106/0 (socket says 172.21.15.69:41106) 2024-05-14T15:32:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.425+0000 7f19a1400640 1 -- 172.21.15.69:0/3996090221 learned_addr learned my addr 172.21.15.69:0/3996090221 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.426+0000 7f19a1400640 1 -- 172.21.15.69:0/3996090221 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5ac2f0 msgr2=0x55763d9771b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:32:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.426+0000 7f19a1400640 1 --2- 172.21.15.69:0/3996090221 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5ac2f0 0x55763d9771b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.426+0000 7f19a1400640 1 -- 172.21.15.69:0/3996090221 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5d51b0 msgr2=0x55763d98c470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:32:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.426+0000 7f19a1400640 1 --2- 172.21.15.69:0/3996090221 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5d51b0 0x55763d98c470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.426+0000 7f19a1400640 1 -- 172.21.15.69:0/3996090221 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55763d983540 con 0x55763d5b44d0 2024-05-14T15:32:26.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.426+0000 7f19a1400640 1 --2- 172.21.15.69:0/3996090221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5b44d0 0x55763d9788f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f198c005dc0 tx=0x7f198c00bf90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeac23c49412631 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.427+0000 7f198a600640 1 -- 172.21.15.69:0/3996090221 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c005020 con 0x55763d5b44d0 2024-05-14T15:32:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.427+0000 7f198a600640 1 -- 172.21.15.69:0/3996090221 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f199000bd60 con 0x55763d5b44d0 2024-05-14T15:32:26.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.427+0000 7f198a600640 1 -- 172.21.15.69:0/3996090221 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c0047a0 con 0x55763d5b44d0 2024-05-14T15:32:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.428+0000 7f19ab80a740 1 -- 172.21.15.69:0/3996090221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5b44d0 msgr2=0x55763d9788f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.428+0000 7f19ab80a740 1 --2- 172.21.15.69:0/3996090221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5b44d0 0x55763d9788f0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f198c005dc0 tx=0x7f198c00bf90 comp rx=0 tx=0).stop 2024-05-14T15:32:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.428+0000 7f19ab80a740 1 -- 172.21.15.69:0/3996090221 shutdown_connections 2024-05-14T15:32:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.428+0000 7f19ab80a740 1 --2- 172.21.15.69:0/3996090221 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5d51b0 0x55763d98c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.428+0000 7f19ab80a740 1 --2- 172.21.15.69:0/3996090221 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5b44d0 0x55763d9788f0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.428+0000 7f19ab80a740 1 --2- 172.21.15.69:0/3996090221 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5ac2f0 0x55763d9771b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.428+0000 7f19ab80a740 1 -- 172.21.15.69:0/3996090221 >> 172.21.15.69:0/3996090221 conn(0x55763d5c9300 msgr2=0x55763d971000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:26.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.429+0000 7f19ab80a740 1 -- 172.21.15.69:0/3996090221 shutdown_connections 2024-05-14T15:32:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.429+0000 7f19ab80a740 1 -- 172.21.15.69:0/3996090221 wait complete. 2024-05-14T15:32:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.429+0000 7f19ab80a740 1 -- start start 2024-05-14T15:32:26.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.429+0000 7f19ab80a740 1 Processor -- start 2024-05-14T15:32:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.430+0000 7f19ab80a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5ac2f0 0x55763d983e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.430+0000 7f19ab80a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 0x55763d984370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.430+0000 7f19ab80a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5d51b0 0x55763da03cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.430+0000 7f19ab80a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f199c1b9010 con 0x55763d5d51b0 2024-05-14T15:32:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.430+0000 7f19ab80a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f199c1b8940 con 0x55763d5ac2f0 2024-05-14T15:32:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.430+0000 7f19ab80a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f199c0749c0 con 0x55763d5b44d0 2024-05-14T15:32:26.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.430+0000 7f19ab80a740 10 client.0 _ll_register_callbacks cb 0x7f199001e050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:32:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.431+0000 7f19a1400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 0x55763d984370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.431+0000 7f19a1400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 0x55763d984370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35360/0 (socket says 172.21.15.69:35360) 2024-05-14T15:32:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.431+0000 7f19a1400640 1 -- 172.21.15.69:0/214183160 learned_addr learned my addr 172.21.15.69:0/214183160 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.431+0000 7f19a1e00640 1 --2- 172.21.15.69:0/214183160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5ac2f0 0x55763d983e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.431+0000 7f19a2800640 1 --2- 172.21.15.69:0/214183160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5d51b0 0x55763da03cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.431+0000 7f19a1400640 1 -- 172.21.15.69:0/214183160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5ac2f0 msgr2=0x55763d983e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.431+0000 7f19a1400640 1 --2- 172.21.15.69:0/214183160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5ac2f0 0x55763d983e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.431+0000 7f19a1400640 1 -- 172.21.15.69:0/214183160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5d51b0 msgr2=0x55763da03cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.431+0000 7f19a1400640 1 --2- 172.21.15.69:0/214183160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5d51b0 0x55763da03cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.431+0000 7f19a1400640 1 -- 172.21.15.69:0/214183160 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55763da04270 con 0x55763d5b44d0 2024-05-14T15:32:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.432+0000 7f19a1400640 1 --2- 172.21.15.69:0/214183160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 0x55763d984370 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f198c005ff0 tx=0x7f198c01d480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e9e34664e8e0760 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.432+0000 7f197f400640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:32:26.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.433+0000 7f197f400640 1 -- 172.21.15.69:0/214183160 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f198c02b070 con 0x55763d5b44d0 2024-05-14T15:32:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.433+0000 7f197f400640 1 -- 172.21.15.69:0/214183160 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9554+0+0 (secure 0 0 0) 0x7f198c027450 con 0x55763d5b44d0 2024-05-14T15:32:26.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.433+0000 7f19ab80a740 1 -- 172.21.15.69:0/214183160 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f199000bd60 con 0x55763d5b44d0 2024-05-14T15:32:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.436+0000 7f197f400640 1 -- 172.21.15.69:0/214183160 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f198c035050 con 0x55763d5b44d0 2024-05-14T15:32:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.436+0000 7f19ab80a740 10 client.26491 fetch_fsmap learned FSMap version 62 2024-05-14T15:32:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.436+0000 7f19ab80a740 1 -- 172.21.15.69:0/214183160 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55763da0b530 con 0x55763d5b44d0 2024-05-14T15:32:26.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.437+0000 7f197f400640 1 -- 172.21.15.69:0/214183160 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f199000bd60 con 0x55763d5b44d0 2024-05-14T15:32:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.437+0000 7f197f400640 1 -- 172.21.15.69:0/214183160 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f198c01dce0 con 0x55763d5b44d0 2024-05-14T15:32:26.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.439+0000 7f19ab80a740 10 client.26491 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:32:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.439+0000 7f19ab80a740 10 client.26491 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:32:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.439+0000 7f19ab80a740 20 client.26491 populate_metadata read hostname 'smithi069' 2024-05-14T15:32:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.439+0000 7f19ab80a740 1 --2- 172.21.15.69:0/214183160 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55763d5691c0 0x55763da0dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.439+0000 7f19ab80a740 4 client.26491 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:32:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.439+0000 7f19ab80a740 1 -- 172.21.15.69:0/214183160 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55763d8e9160 con 0x55763d5691c0 2024-05-14T15:32:26.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.440+0000 7f19a1e00640 1 --2- 172.21.15.69:0/214183160 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55763d5691c0 0x55763da0dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.441+0000 7f197f400640 10 client.26491 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:32:26.444 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.441+0000 7f19a1e00640 1 --2- 172.21.15.69:0/214183160 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55763d5691c0 0x55763da0dc60 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d0b2eee763fcebfb server_cookie=54371b9a8b0f6724 in_seq=0 out_seq=0 2024-05-14T15:32:26.492 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.490+0000 7f197f400640 1 -- 172.21.15.69:0/214183160 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55763d8e9160 con 0x55763d5691c0 2024-05-14T15:32:26.492 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.490+0000 7f197f400640 10 client.26491 handle_command_reply: tid=0 2024-05-14T15:32:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.490+0000 7f19ab80a740 1 client.26491 shutdown 2024-05-14T15:32:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.490+0000 7f19ab80a740 1 -- 172.21.15.69:0/214183160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 msgr2=0x55763d984370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.490+0000 7f19ab80a740 1 --2- 172.21.15.69:0/214183160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 0x55763d984370 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f198c005ff0 tx=0x7f198c01d480 comp rx=0 tx=0).stop 2024-05-14T15:32:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.491+0000 7f19ab80a740 1 -- 172.21.15.69:0/214183160 shutdown_connections 2024-05-14T15:32:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.491+0000 7f19ab80a740 1 --2- 172.21.15.69:0/214183160 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55763d5691c0 0x55763da0dc60 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.491+0000 7f19ab80a740 1 --2- 172.21.15.69:0/214183160 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55763d5d51b0 0x55763da03cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.491+0000 7f197f400640 0 client.26491 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:32:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.491+0000 7f19ab80a740 1 --2- 172.21.15.69:0/214183160 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55763d5b44d0 0x55763d984370 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.491+0000 7f19ab80a740 1 --2- 172.21.15.69:0/214183160 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55763d5ac2f0 0x55763d983e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.493 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.491+0000 7f19ab80a740 1 -- 172.21.15.69:0/214183160 >> 172.21.15.69:0/214183160 conn(0x55763d5c9300 msgr2=0x55763d978650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:26.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.491+0000 7f19ab80a740 1 -- 172.21.15.69:0/214183160 shutdown_connections 2024-05-14T15:32:26.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.491+0000 7f19ab80a740 1 -- 172.21.15.69:0/214183160 wait complete. 2024-05-14T15:32:26.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.491+0000 7f19ab80a740 20 client.26491 trim_cache size 0 max 16384 2024-05-14T15:32:26.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:32:26.494 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:32:26.495 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:32:26.495 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:32:26.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.493+0000 7f19a4800640 1 -- 172.21.15.69:0/1655334535 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f19840b2860 msgr2=0x7f19840b4d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:26.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.493+0000 7f19a4800640 1 --2- 172.21.15.69:0/1655334535 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f19840b2860 0x7f19840b4d70 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f1990007fd0 tx=0x7f1990011700 comp rx=0 tx=0).stop 2024-05-14T15:32:26.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.493+0000 7f19a4800640 1 -- 172.21.15.69:0/1655334535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f199c109040 msgr2=0x7f199c198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:26.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.493+0000 7f19a4800640 1 --2- 172.21.15.69:0/1655334535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f199c109040 0x7f199c198a80 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1998009b30 tx=0x7f1998030e00 comp rx=0 tx=0).stop 2024-05-14T15:32:26.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.494+0000 7f19a4800640 1 -- 172.21.15.69:0/1655334535 shutdown_connections 2024-05-14T15:32:26.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.494+0000 7f19a4800640 1 --2- 172.21.15.69:0/1655334535 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f19840b2860 0x7f19840b4d70 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.494+0000 7f19a4800640 1 --2- 172.21.15.69:0/1655334535 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f199c109040 0x7f199c198a80 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.494+0000 7f19a4800640 1 --2- 172.21.15.69:0/1655334535 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f199c108ba0 0x7f199c198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.494+0000 7f19a4800640 1 --2- 172.21.15.69:0/1655334535 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f199c1032f0 0x7f199c1a0330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:26.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.494+0000 7f19a4800640 1 -- 172.21.15.69:0/1655334535 >> 172.21.15.69:0/1655334535 conn(0x7f199c0782e0 msgr2=0x7f199c10e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.494+0000 7f19a4800640 1 -- 172.21.15.69:0/1655334535 shutdown_connections 2024-05-14T15:32:26.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:26.494+0000 7f19a4800640 1 -- 172.21.15.69:0/1655334535 wait complete. 2024-05-14T15:32:28.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:27 smithi092 ceph-mon[34729]: pgmap v337: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 614 op/s 2024-05-14T15:32:28.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:27 smithi069 ceph-mon[31270]: pgmap v337: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 614 op/s 2024-05-14T15:32:28.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:27 smithi203 ceph-mon[34567]: pgmap v337: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 5.5 MiB/s wr, 614 op/s 2024-05-14T15:32:30.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:29 smithi092 ceph-mon[34729]: pgmap v338: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.2 MiB/s wr, 480 op/s 2024-05-14T15:32:30.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:29 smithi069 ceph-mon[31270]: pgmap v338: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.2 MiB/s wr, 480 op/s 2024-05-14T15:32:30.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:29 smithi203 ceph-mon[34567]: pgmap v338: 129 pgs: 129 active+clean; 2.7 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.2 MiB/s wr, 480 op/s 2024-05-14T15:32:31.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:30 smithi092 ceph-mon[34729]: pgmap v339: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.5 MiB/s wr, 744 op/s 2024-05-14T15:32:31.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:30 smithi069 ceph-mon[31270]: pgmap v339: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.5 MiB/s wr, 744 op/s 2024-05-14T15:32:31.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:30 smithi203 ceph-mon[34567]: pgmap v339: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.5 MiB/s wr, 744 op/s 2024-05-14T15:32:31.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 405.0 s, 608.4 tps, lat 164.969 ms stddev 93.425 2024-05-14T15:32:33.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:33 smithi203 ceph-mon[34567]: pgmap v340: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.4 MiB/s wr, 495 op/s 2024-05-14T15:32:33.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:33 smithi092 ceph-mon[34729]: pgmap v340: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.4 MiB/s wr, 495 op/s 2024-05-14T15:32:33.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:33 smithi069 ceph-mon[31270]: pgmap v340: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 4.4 MiB/s wr, 495 op/s 2024-05-14T15:32:36.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:35 smithi203 ceph-mon[34567]: pgmap v341: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 682 op/s 2024-05-14T15:32:36.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:35 smithi092 ceph-mon[34729]: pgmap v341: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 682 op/s 2024-05-14T15:32:36.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:35 smithi069 ceph-mon[31270]: pgmap v341: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.0 MiB/s wr, 682 op/s 2024-05-14T15:32:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 410.0 s, 592.6 tps, lat 168.245 ms stddev 64.362 2024-05-14T15:32:37.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:36 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:32:37.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:36 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:32:37.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:36 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:32:38.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:37 smithi203 ceph-mon[34567]: pgmap v342: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.2 MiB/s wr, 575 op/s 2024-05-14T15:32:38.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:37 smithi092 ceph-mon[34729]: pgmap v342: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.2 MiB/s wr, 575 op/s 2024-05-14T15:32:38.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:37 smithi069 ceph-mon[31270]: pgmap v342: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.2 MiB/s wr, 575 op/s 2024-05-14T15:32:39.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.942+0000 7f9e41200640 1 -- 172.21.15.69:0/2612255411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e340ab820 msgr2=0x7f9e340abc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:39.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.942+0000 7f9e41200640 1 --2- 172.21.15.69:0/2612255411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e340ab820 0x7f9e340abc30 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9e30009890 tx=0x7f9e3002a380 comp rx=0 tx=0).stop 2024-05-14T15:32:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.942+0000 7f9e41200640 1 -- 172.21.15.69:0/2612255411 shutdown_connections 2024-05-14T15:32:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.942+0000 7f9e41200640 1 --2- 172.21.15.69:0/2612255411 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e340a6130 0x7f9e340b37c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.942+0000 7f9e41200640 1 --2- 172.21.15.69:0/2612255411 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9e340a57e0 0x7f9e340a5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.942+0000 7f9e41200640 1 --2- 172.21.15.69:0/2612255411 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e340ab820 0x7f9e340abc30 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.942+0000 7f9e41200640 1 -- 172.21.15.69:0/2612255411 >> 172.21.15.69:0/2612255411 conn(0x7f9e3401b330 msgr2=0x7f9e3401b770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.942+0000 7f9e41200640 1 -- 172.21.15.69:0/2612255411 shutdown_connections 2024-05-14T15:32:39.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.942+0000 7f9e41200640 1 -- 172.21.15.69:0/2612255411 wait complete. 2024-05-14T15:32:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.944+0000 7f9e41200640 1 Processor -- start 2024-05-14T15:32:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.944+0000 7f9e41200640 1 -- start start 2024-05-14T15:32:39.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.945+0000 7f9e41200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e340a57e0 0x7f9e3413c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:39.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.945+0000 7f9e41200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e340a6130 0x7f9e3413c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:39.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.945+0000 7f9e41200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9e340ab820 0x7f9e34140c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.946+0000 7f9e3b400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e340a57e0 0x7f9e3413c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.946+0000 7f9e41200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9e340b5910 con 0x7f9e340ab820 2024-05-14T15:32:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.946+0000 7f9e3b400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e340a57e0 0x7f9e3413c450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:42018/0 (socket says 172.21.15.69:42018) 2024-05-14T15:32:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.946+0000 7f9e3b400640 1 -- 172.21.15.69:0/4237335933 learned_addr learned my addr 172.21.15.69:0/4237335933 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.946+0000 7f9e41200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9e340b5790 con 0x7f9e340a6130 2024-05-14T15:32:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.946+0000 7f9e41200640 1 -- 172.21.15.69:0/4237335933 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9e340b5a90 con 0x7f9e340a57e0 2024-05-14T15:32:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.947+0000 7f9e3aa00640 1 --2- 172.21.15.69:0/4237335933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e340a6130 0x7f9e3413c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:39.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.947+0000 7f9e3be00640 1 --2- 172.21.15.69:0/4237335933 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9e340ab820 0x7f9e34140c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.947+0000 7f9e3b400640 1 -- 172.21.15.69:0/4237335933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e340a6130 msgr2=0x7f9e3413c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.947+0000 7f9e3b400640 1 --2- 172.21.15.69:0/4237335933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e340a6130 0x7f9e3413c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.947+0000 7f9e3b400640 1 -- 172.21.15.69:0/4237335933 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9e340ab820 msgr2=0x7f9e34140c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.947+0000 7f9e3b400640 1 --2- 172.21.15.69:0/4237335933 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9e340ab820 0x7f9e34140c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:39.949 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.947+0000 7f9e3b400640 1 -- 172.21.15.69:0/4237335933 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e341412b0 con 0x7f9e340a57e0 2024-05-14T15:32:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.949+0000 7f9e3b400640 1 --2- 172.21.15.69:0/4237335933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e340a57e0 0x7f9e3413c450 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9e30000c00 tx=0x7f9e30030ce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:39.951 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.949+0000 7f9e2fe00640 1 -- 172.21.15.69:0/4237335933 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e30037040 con 0x7f9e340a57e0 2024-05-14T15:32:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.950+0000 7f9e41200640 1 -- 172.21.15.69:0/4237335933 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e34141540 con 0x7f9e340a57e0 2024-05-14T15:32:39.952 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.950+0000 7f9e41200640 1 -- 172.21.15.69:0/4237335933 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e34141a80 con 0x7f9e340a57e0 2024-05-14T15:32:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.951+0000 7f9e2fe00640 1 -- 172.21.15.69:0/4237335933 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e30041070 con 0x7f9e340a57e0 2024-05-14T15:32:39.954 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.953+0000 7f9e2fe00640 1 -- 172.21.15.69:0/4237335933 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e30037040 con 0x7f9e340a57e0 2024-05-14T15:32:39.960 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.958+0000 7f9e497a0740 1 Processor -- start 2024-05-14T15:32:39.963 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.961+0000 7f9e2fe00640 1 -- 172.21.15.69:0/4237335933 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9e30004240 con 0x7f9e340a57e0 2024-05-14T15:32:39.964 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.962+0000 7f9e497a0740 1 -- start start 2024-05-14T15:32:39.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.964+0000 7f9e497a0740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615fc1b0 0x55596199d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:39.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.964+0000 7f9e497a0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615d32f0 0x55596199d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:39.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.965+0000 7f9e2fe00640 1 --2- 172.21.15.69:0/4237335933 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9e240b2db0 0x7f9e240b52c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:39.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.965+0000 7f9e497a0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615db4d0 0x55596199def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:39.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.965+0000 7f9e497a0740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x555961902550 con 0x5559615fc1b0 2024-05-14T15:32:39.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.965+0000 7f9e497a0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5559618a7bc0 con 0x5559615d32f0 2024-05-14T15:32:39.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.965+0000 7f9e497a0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5559618fe510 con 0x5559615db4d0 2024-05-14T15:32:39.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.965+0000 7f9e2fe00640 1 -- 172.21.15.69:0/4237335933 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9554+0+0 (secure 0 0 0) 0x7f9e30004040 con 0x7f9e340a57e0 2024-05-14T15:32:39.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.965+0000 7f9e3b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615d32f0 0x55596199d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:39.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.965+0000 7f9e3b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615d32f0 0x55596199d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:38800/0 (socket says 172.21.15.69:38800) 2024-05-14T15:32:39.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.965+0000 7f9e3b400640 1 -- 172.21.15.69:0/4145971229 learned_addr learned my addr 172.21.15.69:0/4145971229 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:39.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.966+0000 7f9e3aa00640 1 --2- 172.21.15.69:0/4237335933 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9e240b2db0 0x7f9e240b52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:39.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.966+0000 7f9e3be00640 1 --2- 172.21.15.69:0/4145971229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615fc1b0 0x55596199d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:39.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.967+0000 7f9e3aa00640 1 --2- 172.21.15.69:0/4237335933 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9e240b2db0 0x7f9e240b52c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9e340a3050 tx=0x7f9e28011040 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:39.969 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.967+0000 7f9e3be00640 1 --2- 172.21.15.69:0/4145971229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615db4d0 0x55596199def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:39.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.968+0000 7f9e3b400640 1 -- 172.21.15.69:0/4145971229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615db4d0 msgr2=0x55596199def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:39.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.968+0000 7f9e3b400640 1 --2- 172.21.15.69:0/4145971229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615db4d0 0x55596199def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:39.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.968+0000 7f9e3b400640 1 -- 172.21.15.69:0/4145971229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615fc1b0 msgr2=0x55596199d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:39.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.968+0000 7f9e3b400640 1 --2- 172.21.15.69:0/4145971229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615fc1b0 0x55596199d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:39.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.968+0000 7f9e3b400640 1 -- 172.21.15.69:0/4145971229 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555961614210 con 0x5559615d32f0 2024-05-14T15:32:39.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.969+0000 7f9e3be00640 1 --2- 172.21.15.69:0/4145971229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615db4d0 0x55596199def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:32:39.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.969+0000 7f9e3b400640 1 --2- 172.21.15.69:0/4145971229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615d32f0 0x55596199d9b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9e30035040 tx=0x7f9e30005f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7baa902887142c4d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:39.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.971+0000 7f9e2cc00640 1 -- 172.21.15.69:0/4145971229 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e300337e0 con 0x5559615d32f0 2024-05-14T15:32:39.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.971+0000 7f9e2cc00640 1 -- 172.21.15.69:0/4145971229 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e30041070 con 0x5559615d32f0 2024-05-14T15:32:39.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.971+0000 7f9e2cc00640 1 -- 172.21.15.69:0/4145971229 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e300c8490 con 0x5559615d32f0 2024-05-14T15:32:39.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.974+0000 7f9e497a0740 1 -- 172.21.15.69:0/4145971229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615d32f0 msgr2=0x55596199d9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:39.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.974+0000 7f9e497a0740 1 --2- 172.21.15.69:0/4145971229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615d32f0 0x55596199d9b0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f9e30035040 tx=0x7f9e30005f90 comp rx=0 tx=0).stop 2024-05-14T15:32:39.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.974+0000 7f9e497a0740 1 -- 172.21.15.69:0/4145971229 shutdown_connections 2024-05-14T15:32:39.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.974+0000 7f9e497a0740 1 --2- 172.21.15.69:0/4145971229 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615db4d0 0x55596199def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:39.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.974+0000 7f9e497a0740 1 --2- 172.21.15.69:0/4145971229 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615d32f0 0x55596199d9b0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:39.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.975+0000 7f9e497a0740 1 --2- 172.21.15.69:0/4145971229 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615fc1b0 0x55596199d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:39.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.975+0000 7f9e497a0740 1 -- 172.21.15.69:0/4145971229 >> 172.21.15.69:0/4145971229 conn(0x5559615f0300 msgr2=0x555961999c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:39.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.975+0000 7f9e497a0740 1 -- 172.21.15.69:0/4145971229 shutdown_connections 2024-05-14T15:32:39.977 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.975+0000 7f9e497a0740 1 -- 172.21.15.69:0/4145971229 wait complete. 2024-05-14T15:32:39.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.977+0000 7f9e497a0740 1 -- start start 2024-05-14T15:32:39.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.977+0000 7f9e497a0740 1 Processor -- start 2024-05-14T15:32:39.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.979+0000 7f9e497a0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615d32f0 0x5559619a79a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:39.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.979+0000 7f9e497a0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615db4d0 0x5559619a7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:39.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.979+0000 7f9e497a0740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615fc1b0 0x5559619b3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:39.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.980+0000 7f9e497a0740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5559619aa360 con 0x5559615fc1b0 2024-05-14T15:32:39.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.980+0000 7f9e497a0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5559618bb660 con 0x5559615db4d0 2024-05-14T15:32:39.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.980+0000 7f9e497a0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5559619aa4e0 con 0x5559615d32f0 2024-05-14T15:32:39.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.980+0000 7f9e3aa00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615db4d0 0x5559619a7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:39.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.980+0000 7f9e3aa00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615db4d0 0x5559619a7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:38804/0 (socket says 172.21.15.69:38804) 2024-05-14T15:32:39.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.980+0000 7f9e3aa00640 1 -- 172.21.15.69:0/2122195621 learned_addr learned my addr 172.21.15.69:0/2122195621 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:39.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.980+0000 7f9e497a0740 10 client.0 _ll_register_callbacks cb 0x555961885400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:32:39.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.980+0000 7f9e3aa00640 1 -- 172.21.15.69:0/2122195621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615d32f0 msgr2=0x5559619a79a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:32:39.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.980+0000 7f9e3aa00640 1 --2- 172.21.15.69:0/2122195621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615d32f0 0x5559619a79a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:39.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.980+0000 7f9e3aa00640 1 -- 172.21.15.69:0/2122195621 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615fc1b0 msgr2=0x5559619b3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:39.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.980+0000 7f9e3be00640 1 --2- 172.21.15.69:0/2122195621 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615fc1b0 0x5559619b3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:39.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.980+0000 7f9e3aa00640 1 --2- 172.21.15.69:0/2122195621 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615fc1b0 0x5559619b3790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:39.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.980+0000 7f9e3aa00640 1 -- 172.21.15.69:0/2122195621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5559616e0620 con 0x5559615db4d0 2024-05-14T15:32:39.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.981+0000 7f9e3be00640 1 --2- 172.21.15.69:0/2122195621 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615fc1b0 0x5559619b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:32:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.983+0000 7f9e3aa00640 1 --2- 172.21.15.69:0/2122195621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615db4d0 0x5559619a7ee0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9e28003c70 tx=0x7f9e280046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=420f574b721be709 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:39.985 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.984+0000 7f9e21600640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:32:39.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.985+0000 7f9e21600640 1 -- 172.21.15.69:0/2122195621 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28009b60 con 0x5559615db4d0 2024-05-14T15:32:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.985+0000 7f9e21600640 1 -- 172.21.15.69:0/2122195621 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9554+0+0 (secure 0 0 0) 0x7f9e28009d00 con 0x5559615db4d0 2024-05-14T15:32:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.985+0000 7f9e497a0740 1 -- 172.21.15.69:0/2122195621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e30041070 con 0x5559615db4d0 2024-05-14T15:32:39.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.986+0000 7f9e21600640 1 -- 172.21.15.69:0/2122195621 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f9e2802e440 con 0x5559615db4d0 2024-05-14T15:32:39.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.986+0000 7f9e497a0740 10 client.36512 fetch_fsmap learned FSMap version 62 2024-05-14T15:32:39.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.987+0000 7f9e497a0740 1 -- 172.21.15.69:0/2122195621 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x5559619b6520 con 0x5559615db4d0 2024-05-14T15:32:39.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.990+0000 7f9e21600640 1 -- 172.21.15.69:0/2122195621 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e30041070 con 0x5559615db4d0 2024-05-14T15:32:39.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.995+0000 7f9e21600640 1 -- 172.21.15.69:0/2122195621 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f9e2802c070 con 0x5559615db4d0 2024-05-14T15:32:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.995+0000 7f9e497a0740 10 client.36512 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:32:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.995+0000 7f9e497a0740 10 client.36512 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:32:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.995+0000 7f9e497a0740 20 client.36512 populate_metadata read hostname 'smithi069' 2024-05-14T15:32:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.995+0000 7f9e497a0740 1 --2- 172.21.15.69:0/2122195621 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5559615bad80 0x5559619b9a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.995+0000 7f9e497a0740 4 client.36512 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:32:39.997 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.995+0000 7f9e497a0740 1 -- 172.21.15.69:0/2122195621 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555961910160 con 0x5559615bad80 2024-05-14T15:32:39.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.996+0000 7f9e3b400640 1 --2- 172.21.15.69:0/2122195621 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5559615bad80 0x5559619b9a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:39.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.997+0000 7f9e21600640 10 client.36512 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:32:39.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.998+0000 7f9e3b400640 1 --2- 172.21.15.69:0/2122195621 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5559615bad80 0x5559619b9a30 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=789f7969793bd8f8 server_cookie=d5c53ad9b823fcc8 in_seq=0 out_seq=0 2024-05-14T15:32:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.999+0000 7f9e21600640 1 -- 172.21.15.69:0/2122195621 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x555961910160 con 0x5559615bad80 2024-05-14T15:32:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.999+0000 7f9e21600640 10 client.36512 handle_command_reply: tid=0 2024-05-14T15:32:40.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:39.999+0000 7f9e497a0740 1 client.36512 shutdown 2024-05-14T15:32:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.001+0000 7f9e497a0740 1 -- 172.21.15.69:0/2122195621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615db4d0 msgr2=0x5559619a7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:40.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.001+0000 7f9e497a0740 1 --2- 172.21.15.69:0/2122195621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615db4d0 0x5559619a7ee0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9e28003c70 tx=0x7f9e280046c0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.001+0000 7f9e497a0740 1 -- 172.21.15.69:0/2122195621 shutdown_connections 2024-05-14T15:32:40.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.001+0000 7f9e497a0740 1 --2- 172.21.15.69:0/2122195621 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5559615bad80 0x5559619b9a30 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.001+0000 7f9e21600640 0 client.36512 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:32:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.002+0000 7f9e497a0740 1 --2- 172.21.15.69:0/2122195621 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615fc1b0 0x5559619b3790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.002+0000 7f9e497a0740 1 --2- 172.21.15.69:0/2122195621 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615db4d0 0x5559619a7ee0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.002+0000 7f9e497a0740 1 --2- 172.21.15.69:0/2122195621 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615d32f0 0x5559619a79a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.002+0000 7f9e497a0740 1 -- 172.21.15.69:0/2122195621 >> 172.21.15.69:0/2122195621 conn(0x5559615f0300 msgr2=0x55596199f190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.005+0000 7f9e497a0740 1 -- 172.21.15.69:0/2122195621 shutdown_connections 2024-05-14T15:32:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.005+0000 7f9e497a0740 1 -- 172.21.15.69:0/2122195621 wait complete. 2024-05-14T15:32:40.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.006+0000 7f9e497a0740 20 client.36512 trim_cache size 0 max 16384 2024-05-14T15:32:40.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.040+0000 7f9e497a0740 1 Processor -- start 2024-05-14T15:32:40.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.040+0000 7f9e497a0740 1 -- start start 2024-05-14T15:32:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.042+0000 7f9e497a0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615bad80 0x5559619a20d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:40.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.042+0000 7f9e497a0740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615d32f0 0x555961998960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.042+0000 7f9e497a0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615db4d0 0x555961998ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.042+0000 7f9e497a0740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1c010150 con 0x5559615d32f0 2024-05-14T15:32:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.042+0000 7f9e497a0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1c011c90 con 0x5559615bad80 2024-05-14T15:32:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.042+0000 7f9e497a0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1c010820 con 0x5559615db4d0 2024-05-14T15:32:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.043+0000 7f9e3be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615db4d0 0x555961998ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.043+0000 7f9e3b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615bad80 0x5559619a20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.043+0000 7f9e3b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615bad80 0x5559619a20d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:38806/0 (socket says 172.21.15.69:38806) 2024-05-14T15:32:40.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.043+0000 7f9e3b400640 1 -- 172.21.15.69:0/111174090 learned_addr learned my addr 172.21.15.69:0/111174090 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.044+0000 7f9e3aa00640 1 --2- 172.21.15.69:0/111174090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615d32f0 0x555961998960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.044+0000 7f9e3be00640 1 -- 172.21.15.69:0/111174090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615bad80 msgr2=0x5559619a20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.044+0000 7f9e3be00640 1 --2- 172.21.15.69:0/111174090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615bad80 0x5559619a20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.044+0000 7f9e3be00640 1 -- 172.21.15.69:0/111174090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615d32f0 msgr2=0x555961998960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:40.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.045+0000 7f9e3be00640 1 --2- 172.21.15.69:0/111174090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615d32f0 0x555961998960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.045+0000 7f9e3be00640 1 -- 172.21.15.69:0/111174090 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55596199a7f0 con 0x5559615db4d0 2024-05-14T15:32:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.045+0000 7f9e3b400640 1 --2- 172.21.15.69:0/111174090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615bad80 0x5559619a20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:32:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.045+0000 7f9e3aa00640 1 --2- 172.21.15.69:0/111174090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615d32f0 0x555961998960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:32:40.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.046+0000 7f9e3be00640 1 --2- 172.21.15.69:0/111174090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615db4d0 0x555961998ea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c069180 tx=0x7f9e3c050ec0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d9fe0e2504b075ca server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:40.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.046+0000 7f9e23e00640 1 -- 172.21.15.69:0/111174090 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c077440 con 0x5559615db4d0 2024-05-14T15:32:40.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.047+0000 7f9e23e00640 1 -- 172.21.15.69:0/111174090 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e3c077a70 con 0x5559615db4d0 2024-05-14T15:32:40.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.047+0000 7f9e23e00640 1 -- 172.21.15.69:0/111174090 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c0798a0 con 0x5559615db4d0 2024-05-14T15:32:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.048+0000 7f9e497a0740 1 -- 172.21.15.69:0/111174090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615db4d0 msgr2=0x555961998ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.048+0000 7f9e497a0740 1 --2- 172.21.15.69:0/111174090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615db4d0 0x555961998ea0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c069180 tx=0x7f9e3c050ec0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.048+0000 7f9e497a0740 1 -- 172.21.15.69:0/111174090 shutdown_connections 2024-05-14T15:32:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.048+0000 7f9e497a0740 1 --2- 172.21.15.69:0/111174090 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615db4d0 0x555961998ea0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.048+0000 7f9e497a0740 1 --2- 172.21.15.69:0/111174090 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615d32f0 0x555961998960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.048+0000 7f9e497a0740 1 --2- 172.21.15.69:0/111174090 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615bad80 0x5559619a20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.048+0000 7f9e497a0740 1 -- 172.21.15.69:0/111174090 >> 172.21.15.69:0/111174090 conn(0x5559615f0300 msgr2=0x555961998250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.049+0000 7f9e497a0740 1 -- 172.21.15.69:0/111174090 shutdown_connections 2024-05-14T15:32:40.051 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.049+0000 7f9e497a0740 1 -- 172.21.15.69:0/111174090 wait complete. 2024-05-14T15:32:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.050+0000 7f9e497a0740 1 -- start start 2024-05-14T15:32:40.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.050+0000 7f9e497a0740 1 Processor -- start 2024-05-14T15:32:40.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.052+0000 7f9e497a0740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615bad80 0x5559619aad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.053+0000 7f9e497a0740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615d32f0 0x5559619ab2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.053+0000 7f9e497a0740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615db4d0 0x555961a19da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.053+0000 7f9e497a0740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1c0115c0 con 0x5559615bad80 2024-05-14T15:32:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.053+0000 7f9e497a0740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1c010ef0 con 0x5559615db4d0 2024-05-14T15:32:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.053+0000 7f9e497a0740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1c00e150 con 0x5559615d32f0 2024-05-14T15:32:40.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.053+0000 7f9e497a0740 10 client.0 _ll_register_callbacks cb 0x7f9e28004340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:32:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.054+0000 7f9e3b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615bad80 0x5559619aad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.054+0000 7f9e3b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615bad80 0x5559619aad70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34324/0 (socket says 172.21.15.69:34324) 2024-05-14T15:32:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.054+0000 7f9e3b400640 1 -- 172.21.15.69:0/2826438550 learned_addr learned my addr 172.21.15.69:0/2826438550 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.054+0000 7f9e3aa00640 1 --2- 172.21.15.69:0/2826438550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615d32f0 0x5559619ab2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:40.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.054+0000 7f9e3be00640 1 --2- 172.21.15.69:0/2826438550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615db4d0 0x555961a19da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.055+0000 7f9e3aa00640 1 -- 172.21.15.69:0/2826438550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615db4d0 msgr2=0x555961a19da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.055+0000 7f9e3aa00640 1 --2- 172.21.15.69:0/2826438550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615db4d0 0x555961a19da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.055+0000 7f9e3aa00640 1 -- 172.21.15.69:0/2826438550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615bad80 msgr2=0x5559619aad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.055+0000 7f9e3aa00640 1 --2- 172.21.15.69:0/2826438550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615bad80 0x5559619aad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.055+0000 7f9e3aa00640 1 -- 172.21.15.69:0/2826438550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555961a1a360 con 0x5559615d32f0 2024-05-14T15:32:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.055+0000 7f9e3b400640 1 --2- 172.21.15.69:0/2826438550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615bad80 0x5559619aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:32:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.056+0000 7f9e3aa00640 1 --2- 172.21.15.69:0/2826438550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615d32f0 0x5559619ab2b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55596188a4c0 tx=0x7f9e2801c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3803d6a6a7f43e08 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:40.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.056+0000 7f9e21600640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:32:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.057+0000 7f9e21600640 1 -- 172.21.15.69:0/2826438550 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800f230 con 0x5559615d32f0 2024-05-14T15:32:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.057+0000 7f9e21600640 1 -- 172.21.15.69:0/2826438550 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9554+0+0 (secure 0 0 0) 0x7f9e2800f3d0 con 0x5559615d32f0 2024-05-14T15:32:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.057+0000 7f9e497a0740 1 -- 172.21.15.69:0/2826438550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9e3c077a70 con 0x5559615d32f0 2024-05-14T15:32:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.057+0000 7f9e21600640 1 -- 172.21.15.69:0/2826438550 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f9e2802e5e0 con 0x5559615d32f0 2024-05-14T15:32:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.057+0000 7f9e497a0740 10 client.26506 fetch_fsmap learned FSMap version 62 2024-05-14T15:32:40.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.058+0000 7f9e497a0740 1 -- 172.21.15.69:0/2826438550 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x555961a21590 con 0x5559615d32f0 2024-05-14T15:32:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.058+0000 7f9e21600640 1 -- 172.21.15.69:0/2826438550 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9e3c077a70 con 0x5559615d32f0 2024-05-14T15:32:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.058+0000 7f9e21600640 1 -- 172.21.15.69:0/2826438550 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f9e2802c050 con 0x5559615d32f0 2024-05-14T15:32:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.058+0000 7f9e497a0740 10 client.26506 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:32:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.058+0000 7f9e497a0740 10 client.26506 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:32:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.058+0000 7f9e497a0740 20 client.26506 populate_metadata read hostname 'smithi069' 2024-05-14T15:32:40.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.059+0000 7f9e497a0740 1 --2- 172.21.15.69:0/2826438550 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5559615fc1b0 0x555961a23c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.059+0000 7f9e497a0740 4 client.26506 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:32:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.059+0000 7f9e497a0740 1 -- 172.21.15.69:0/2826438550 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x555961909fd0 con 0x5559615fc1b0 2024-05-14T15:32:40.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.059+0000 7f9e3b400640 1 --2- 172.21.15.69:0/2826438550 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5559615fc1b0 0x555961a23c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:40.062 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.060+0000 7f9e21600640 10 client.26506 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:32:40.067 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.065+0000 7f9e3b400640 1 --2- 172.21.15.69:0/2826438550 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5559615fc1b0 0x555961a23c90 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6637c4f395e939fb server_cookie=ceac67ce76f811ad in_seq=0 out_seq=0 2024-05-14T15:32:40.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:39 smithi203 ceph-mon[34567]: pgmap v343: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.4 MiB/s wr, 504 op/s 2024-05-14T15:32:40.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:39 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:40.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:39 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.094+0000 7f9e21600640 1 -- 172.21.15.69:0/2826438550 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x555961909fd0 con 0x5559615fc1b0 2024-05-14T15:32:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.094+0000 7f9e21600640 10 client.26506 handle_command_reply: tid=0 2024-05-14T15:32:40.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.094+0000 7f9e497a0740 1 client.26506 shutdown 2024-05-14T15:32:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.095+0000 7f9e497a0740 1 -- 172.21.15.69:0/2826438550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615d32f0 msgr2=0x5559619ab2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:40.097 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.095+0000 7f9e497a0740 1 --2- 172.21.15.69:0/2826438550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615d32f0 0x5559619ab2b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55596188a4c0 tx=0x7f9e2801c490 comp rx=0 tx=0).stop 2024-05-14T15:32:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.096+0000 7f9e497a0740 1 -- 172.21.15.69:0/2826438550 shutdown_connections 2024-05-14T15:32:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.096+0000 7f9e497a0740 1 --2- 172.21.15.69:0/2826438550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5559615db4d0 0x555961a19da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.096+0000 7f9e497a0740 1 --2- 172.21.15.69:0/2826438550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5559615d32f0 0x5559619ab2b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.096+0000 7f9e497a0740 1 --2- 172.21.15.69:0/2826438550 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5559615fc1b0 0x555961a23c90 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.096+0000 7f9e497a0740 1 --2- 172.21.15.69:0/2826438550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5559615bad80 0x5559619aad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.096+0000 7f9e497a0740 1 -- 172.21.15.69:0/2826438550 >> 172.21.15.69:0/2826438550 conn(0x5559615f0300 msgr2=0x555961998c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:40.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.096+0000 7f9e21600640 0 client.26506 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:32:40.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.097+0000 7f9e497a0740 1 -- 172.21.15.69:0/2826438550 shutdown_connections 2024-05-14T15:32:40.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.098+0000 7f9e497a0740 1 -- 172.21.15.69:0/2826438550 wait complete. 2024-05-14T15:32:40.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.101+0000 7f9e497a0740 20 client.26506 trim_cache size 0 max 16384 2024-05-14T15:32:40.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:32:40.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:32:40.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:32:40.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:32:40.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.104+0000 7f9e41200640 1 -- 172.21.15.69:0/4237335933 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9e240b2db0 msgr2=0x7f9e240b52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:40.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.104+0000 7f9e41200640 1 --2- 172.21.15.69:0/4237335933 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9e240b2db0 0x7f9e240b52c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9e340a3050 tx=0x7f9e28011040 comp rx=0 tx=0).stop 2024-05-14T15:32:40.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.104+0000 7f9e41200640 1 -- 172.21.15.69:0/4237335933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e340a57e0 msgr2=0x7f9e3413c450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:40.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.105+0000 7f9e41200640 1 --2- 172.21.15.69:0/4237335933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e340a57e0 0x7f9e3413c450 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9e30000c00 tx=0x7f9e30030ce0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.105+0000 7f9e41200640 1 -- 172.21.15.69:0/4237335933 shutdown_connections 2024-05-14T15:32:40.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.105+0000 7f9e41200640 1 --2- 172.21.15.69:0/4237335933 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9e240b2db0 0x7f9e240b52c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.107 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.106+0000 7f9e41200640 1 --2- 172.21.15.69:0/4237335933 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9e340ab820 0x7f9e34140c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.108 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.106+0000 7f9e41200640 1 --2- 172.21.15.69:0/4237335933 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9e340a6130 0x7f9e3413c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.108 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.106+0000 7f9e41200640 1 --2- 172.21.15.69:0/4237335933 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9e340a57e0 0x7f9e3413c450 secure :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9e30000c00 tx=0x7f9e30030ce0 comp rx=0 tx=0).stop 2024-05-14T15:32:40.108 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.106+0000 7f9e41200640 1 -- 172.21.15.69:0/4237335933 >> 172.21.15.69:0/4237335933 conn(0x7f9e3401b330 msgr2=0x7f9e340a3c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:40.108 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.106+0000 7f9e41200640 1 -- 172.21.15.69:0/4237335933 shutdown_connections 2024-05-14T15:32:40.108 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:40.107+0000 7f9e41200640 1 -- 172.21.15.69:0/4237335933 wait complete. 2024-05-14T15:32:40.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:39 smithi092 ceph-mon[34729]: pgmap v343: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.4 MiB/s wr, 504 op/s 2024-05-14T15:32:40.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:39 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:40.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:39 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:40.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:39 smithi069 ceph-mon[31270]: pgmap v343: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 4.4 MiB/s wr, 504 op/s 2024-05-14T15:32:40.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:39 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:40.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:39 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:41.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:40 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:41.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:40 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:41.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:40 smithi092 ceph-mon[34729]: pgmap v344: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.3 MiB/s wr, 720 op/s 2024-05-14T15:32:41.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:40 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:41.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:40 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:41.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:40 smithi069 ceph-mon[31270]: pgmap v344: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.3 MiB/s wr, 720 op/s 2024-05-14T15:32:41.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:40 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:41.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:40 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:41.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:40 smithi203 ceph-mon[34567]: pgmap v344: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.3 MiB/s wr, 720 op/s 2024-05-14T15:32:41.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 415.0 s, 497.0 tps, lat 200.986 ms stddev 95.423 2024-05-14T15:32:42.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:41 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:41 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:41 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:41 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:41 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi092 to 176.4M 2024-05-14T15:32:42.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:41 smithi092 ceph-mon[34729]: Unable to set osd_memory_target on smithi092 to 185061273: error parsing value: Value '185061273' is below minimum 939524096 2024-05-14T15:32:42.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:41 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:41 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:41 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:41 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:41 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi203 to 176.4M 2024-05-14T15:32:42.196 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:41 smithi092 ceph-mon[34729]: Unable to set osd_memory_target on smithi203 to 185036185: error parsing value: Value '185036185' is below minimum 939524096 2024-05-14T15:32:42.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:41 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:41 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:41 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:41 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:41 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi092 to 176.4M 2024-05-14T15:32:42.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:41 smithi069 ceph-mon[31270]: Unable to set osd_memory_target on smithi092 to 185061273: error parsing value: Value '185061273' is below minimum 939524096 2024-05-14T15:32:42.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:41 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:41 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:41 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:41 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:41 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi203 to 176.4M 2024-05-14T15:32:42.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:41 smithi069 ceph-mon[31270]: Unable to set osd_memory_target on smithi203 to 185036185: error parsing value: Value '185036185' is below minimum 939524096 2024-05-14T15:32:42.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:41 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:41 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:41 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:41 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:41 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi092 to 176.4M 2024-05-14T15:32:42.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:41 smithi203 ceph-mon[34567]: Unable to set osd_memory_target on smithi092 to 185061273: error parsing value: Value '185061273' is below minimum 939524096 2024-05-14T15:32:42.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:41 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:41 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:41 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:41 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:42.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:41 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi203 to 176.4M 2024-05-14T15:32:42.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:41 smithi203 ceph-mon[34567]: Unable to set osd_memory_target on smithi203 to 185036185: error parsing value: Value '185036185' is below minimum 939524096 2024-05-14T15:32:43.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:42 smithi092 ceph-mon[34729]: pgmap v345: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 456 op/s 2024-05-14T15:32:43.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:42 smithi069 ceph-mon[31270]: pgmap v345: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 456 op/s 2024-05-14T15:32:43.246 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:42 smithi203 ceph-mon[34567]: pgmap v345: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 4.0 MiB/s wr, 456 op/s 2024-05-14T15:32:45.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:45 smithi069 ceph-mon[31270]: pgmap v346: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.3 MiB/s wr, 612 op/s 2024-05-14T15:32:45.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:45 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:45.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:45 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:45.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:45 smithi203 ceph-mon[34567]: pgmap v346: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.3 MiB/s wr, 612 op/s 2024-05-14T15:32:45.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:45 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:45.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:45 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:45.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:45 smithi092 ceph-mon[34729]: pgmap v346: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 5.3 MiB/s wr, 612 op/s 2024-05-14T15:32:45.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:45 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:45.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:45 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:46.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 420.0 s, 535.3 tps, lat 186.872 ms stddev 62.474 2024-05-14T15:32:47.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:47 smithi069 ceph-mon[31270]: pgmap v347: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.2 MiB/s wr, 489 op/s 2024-05-14T15:32:47.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:47 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:47.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:47 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:47.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:47 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:47.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:47 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:47.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:47 smithi069 ceph-mon[31270]: Adjusting osd_memory_target on smithi069 to 176.4M 2024-05-14T15:32:47.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:47 smithi069 ceph-mon[31270]: Unable to set osd_memory_target on smithi069 to 185003929: error parsing value: Value '185003929' is below minimum 939524096 2024-05-14T15:32:47.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:47 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:32:47.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:47 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:32:47.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:47 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:47.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:47 smithi203 ceph-mon[34567]: pgmap v347: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.2 MiB/s wr, 489 op/s 2024-05-14T15:32:47.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:47 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:47.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:47 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:47.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:47 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:47.847 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:47 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:47.847 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:47 smithi203 ceph-mon[34567]: Adjusting osd_memory_target on smithi069 to 176.4M 2024-05-14T15:32:47.847 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:47 smithi203 ceph-mon[34567]: Unable to set osd_memory_target on smithi069 to 185003929: error parsing value: Value '185003929' is below minimum 939524096 2024-05-14T15:32:47.847 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:47 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:32:47.847 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:47 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:32:47.847 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:47 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:47.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:47 smithi092 ceph-mon[34729]: pgmap v347: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 4.2 MiB/s wr, 489 op/s 2024-05-14T15:32:47.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:47 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:47.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:47 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:47.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:47 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:47.945 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:47 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-05-14T15:32:47.945 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:47 smithi092 ceph-mon[34729]: Adjusting osd_memory_target on smithi069 to 176.4M 2024-05-14T15:32:47.945 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:47 smithi092 ceph-mon[34729]: Unable to set osd_memory_target on smithi069 to 185003929: error parsing value: Value '185003929' is below minimum 939524096 2024-05-14T15:32:47.945 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:47 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:32:47.945 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:47 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:32:47.945 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:47 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:32:49.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:49 smithi203 ceph-mon[34567]: pgmap v348: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.8 MiB/s wr, 435 op/s 2024-05-14T15:32:49.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:49 smithi092 ceph-mon[34729]: pgmap v348: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.8 MiB/s wr, 435 op/s 2024-05-14T15:32:49.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:49 smithi069 ceph-mon[31270]: pgmap v348: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.8 MiB/s wr, 435 op/s 2024-05-14T15:32:51.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 425.0 s, 533.6 tps, lat 187.882 ms stddev 101.229 2024-05-14T15:32:51.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:51 smithi203 ceph-mon[34567]: pgmap v349: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.5 MiB/s wr, 640 op/s 2024-05-14T15:32:51.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:51 smithi092 ceph-mon[34729]: pgmap v349: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.5 MiB/s wr, 640 op/s 2024-05-14T15:32:51.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:51 smithi069 ceph-mon[31270]: pgmap v349: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 5.5 MiB/s wr, 640 op/s 2024-05-14T15:32:53.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.493+0000 7f7b16c00640 1 -- 172.21.15.69:0/1706365559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b101089f0 msgr2=0x7f7b10102580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.493+0000 7f7b16c00640 1 --2- 172.21.15.69:0/1706365559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b101089f0 0x7f7b10102580 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7b04009900 tx=0x7f7b0402a440 comp rx=0 tx=0).stop 2024-05-14T15:32:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.494+0000 7f7b16c00640 1 -- 172.21.15.69:0/1706365559 shutdown_connections 2024-05-14T15:32:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.494+0000 7f7b16c00640 1 --2- 172.21.15.69:0/1706365559 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b1010d350 0x7f7b1010f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.494+0000 7f7b16c00640 1 --2- 172.21.15.69:0/1706365559 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b10102ac0 0x7f7b10102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.494+0000 7f7b16c00640 1 --2- 172.21.15.69:0/1706365559 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b101089f0 0x7f7b10102580 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.494+0000 7f7b16c00640 1 -- 172.21.15.69:0/1706365559 >> 172.21.15.69:0/1706365559 conn(0x7f7b100fe220 msgr2=0x7f7b10100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.495+0000 7f7b16c00640 1 -- 172.21.15.69:0/1706365559 shutdown_connections 2024-05-14T15:32:53.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.495+0000 7f7b16c00640 1 -- 172.21.15.69:0/1706365559 wait complete. 2024-05-14T15:32:53.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.497+0000 7f7b16c00640 1 Processor -- start 2024-05-14T15:32:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.497+0000 7f7b16c00640 1 -- start start 2024-05-14T15:32:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.498+0000 7f7b16c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b10102ac0 0x7f7b1010f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.498+0000 7f7b16c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b101089f0 0x7f7b1010d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.498+0000 7f7b16c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b1010d350 0x7f7b1010de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.498+0000 7f7b16c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7b10112bb0 con 0x7f7b101089f0 2024-05-14T15:32:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.498+0000 7f7b16c00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7b10112a30 con 0x7f7b10102ac0 2024-05-14T15:32:53.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.498+0000 7f7b16c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7b10112d30 con 0x7f7b1010d350 2024-05-14T15:32:53.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.499+0000 7f7b14e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b101089f0 0x7f7b1010d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.499+0000 7f7b16200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b1010d350 0x7f7b1010de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.499+0000 7f7b15800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b10102ac0 0x7f7b1010f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.499+0000 7f7b16200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b1010d350 0x7f7b1010de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:38256/0 (socket says 172.21.15.69:38256) 2024-05-14T15:32:53.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.499+0000 7f7b16200640 1 -- 172.21.15.69:0/3702019173 learned_addr learned my addr 172.21.15.69:0/3702019173 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.500+0000 7f7b16200640 1 -- 172.21.15.69:0/3702019173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b10102ac0 msgr2=0x7f7b1010f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.500+0000 7f7b16200640 1 --2- 172.21.15.69:0/3702019173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b10102ac0 0x7f7b1010f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.500+0000 7f7b16200640 1 -- 172.21.15.69:0/3702019173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b101089f0 msgr2=0x7f7b1010d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.500+0000 7f7b16200640 1 --2- 172.21.15.69:0/3702019173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b101089f0 0x7f7b1010d830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.500+0000 7f7b16200640 1 -- 172.21.15.69:0/3702019173 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1010e620 con 0x7f7b1010d350 2024-05-14T15:32:53.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.501+0000 7f7b16200640 1 --2- 172.21.15.69:0/3702019173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b1010d350 0x7f7b1010de30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800b990 tx=0x7f7b0800bd90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.501+0000 7f7b0e000640 1 -- 172.21.15.69:0/3702019173 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b08019070 con 0x7f7b1010d350 2024-05-14T15:32:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.501+0000 7f7b0e000640 1 -- 172.21.15.69:0/3702019173 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b08014440 con 0x7f7b1010d350 2024-05-14T15:32:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.501+0000 7f7b0e000640 1 -- 172.21.15.69:0/3702019173 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b080075d0 con 0x7f7b1010d350 2024-05-14T15:32:53.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.501+0000 7f7b16c00640 1 -- 172.21.15.69:0/3702019173 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1019ea80 con 0x7f7b1010d350 2024-05-14T15:32:53.505 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.503+0000 7f7b16c00640 1 -- 172.21.15.69:0/3702019173 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1019ef80 con 0x7f7b1010d350 2024-05-14T15:32:53.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.507+0000 7f7b1f1c2740 1 Processor -- start 2024-05-14T15:32:53.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.508+0000 7f7b0e000640 1 -- 172.21.15.69:0/3702019173 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f7b080145f0 con 0x7f7b1010d350 2024-05-14T15:32:53.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.509+0000 7f7b1f1c2740 1 -- start start 2024-05-14T15:32:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.509+0000 7f7b1f1c2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a6651b0 0x55718aa06480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.509+0000 7f7b1f1c2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a63c2f0 0x55718aa069c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.509+0000 7f7b1f1c2740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6444d0 0x55718aa06f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.509+0000 7f7b1f1c2740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55718a96b550 con 0x55718a6444d0 2024-05-14T15:32:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.509+0000 7f7b1f1c2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55718a910bc0 con 0x55718a6651b0 2024-05-14T15:32:53.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.509+0000 7f7b1f1c2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55718a967510 con 0x55718a63c2f0 2024-05-14T15:32:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.510+0000 7f7b15800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a63c2f0 0x55718aa069c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.510+0000 7f7b15800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a63c2f0 0x55718aa069c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:38270/0 (socket says 172.21.15.69:38270) 2024-05-14T15:32:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.510+0000 7f7b15800640 1 -- 172.21.15.69:0/1173809252 learned_addr learned my addr 172.21.15.69:0/1173809252 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.510+0000 7f7b14e00640 1 --2- 172.21.15.69:0/1173809252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a6651b0 0x55718aa06480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.510+0000 7f7b15800640 1 -- 172.21.15.69:0/1173809252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a6651b0 msgr2=0x55718aa06480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.510+0000 7f7b15800640 1 --2- 172.21.15.69:0/1173809252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a6651b0 0x55718aa06480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.510+0000 7f7b14e00640 1 --2- 172.21.15.69:0/1173809252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6444d0 0x55718aa06f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.510+0000 7f7b15800640 1 -- 172.21.15.69:0/1173809252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6444d0 msgr2=0x55718aa06f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:53.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.510+0000 7f7b15800640 1 --2- 172.21.15.69:0/1173809252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6444d0 0x55718aa06f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.510+0000 7f7b15800640 1 -- 172.21.15.69:0/1173809252 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55718a67d210 con 0x55718a63c2f0 2024-05-14T15:32:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.511+0000 7f7b14e00640 1 --2- 172.21.15.69:0/1173809252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6444d0 0x55718aa06f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:32:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.511+0000 7f7b15800640 1 --2- 172.21.15.69:0/1173809252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a63c2f0 0x55718aa069c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7b101039f0 tx=0x7f7b040040c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5265f5b97e384f3d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.511+0000 7f7afea00640 1 -- 172.21.15.69:0/1173809252 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b04035030 con 0x55718a63c2f0 2024-05-14T15:32:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.511+0000 7f7afea00640 1 -- 172.21.15.69:0/1173809252 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b040044b0 con 0x55718a63c2f0 2024-05-14T15:32:53.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.511+0000 7f7afea00640 1 -- 172.21.15.69:0/1173809252 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b0403c970 con 0x55718a63c2f0 2024-05-14T15:32:53.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.511+0000 7f7b0e000640 1 --2- 172.21.15.69:0/3702019173 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7af80b2a50 0x7f7af80b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.512+0000 7f7b0e000640 1 -- 172.21.15.69:0/3702019173 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9554+0+0 (secure 0 0 0) 0x7f7b080e1e70 con 0x7f7b1010d350 2024-05-14T15:32:53.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.512+0000 7f7b14e00640 1 --2- 172.21.15.69:0/3702019173 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7af80b2a50 0x7f7af80b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.512+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/1173809252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a63c2f0 msgr2=0x55718aa069c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.512+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/1173809252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a63c2f0 0x55718aa069c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7b101039f0 tx=0x7f7b040040c0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.513+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/1173809252 shutdown_connections 2024-05-14T15:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.513+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/1173809252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6444d0 0x55718aa06f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.513+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/1173809252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a63c2f0 0x55718aa069c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.513+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/1173809252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a6651b0 0x55718aa06480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.513+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/1173809252 >> 172.21.15.69:0/1173809252 conn(0x55718a659300 msgr2=0x55718aa02c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:53.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.513+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/1173809252 shutdown_connections 2024-05-14T15:32:53.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.513+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/1173809252 wait complete. 2024-05-14T15:32:53.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.513+0000 7f7b14e00640 1 --2- 172.21.15.69:0/3702019173 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7af80b2a50 0x7f7af80b4f60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55718aa035f0 tx=0x7f7b00009110 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:53.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.514+0000 7f7b1f1c2740 1 -- start start 2024-05-14T15:32:53.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.514+0000 7f7b1f1c2740 1 Processor -- start 2024-05-14T15:32:53.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.515+0000 7f7b1f1c2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a63c2f0 0x55718aa109a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.515+0000 7f7b1f1c2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a6444d0 0x55718aa10ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.515+0000 7f7b1f1c2740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6651b0 0x55718aa1ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.515+0000 7f7b1f1c2740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55718aa13550 con 0x55718a6651b0 2024-05-14T15:32:53.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.515+0000 7f7b1f1c2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55718a924660 con 0x55718a63c2f0 2024-05-14T15:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.515+0000 7f7b1f1c2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55718aa136d0 con 0x55718a6444d0 2024-05-14T15:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.515+0000 7f7b1f1c2740 10 client.0 _ll_register_callbacks cb 0x55718a8ee400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.515+0000 7f7b14e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a6444d0 0x55718aa10ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.515+0000 7f7b14e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a6444d0 0x55718aa10ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:38280/0 (socket says 172.21.15.69:38280) 2024-05-14T15:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.515+0000 7f7b14e00640 1 -- 172.21.15.69:0/3310905060 learned_addr learned my addr 172.21.15.69:0/3310905060 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.515+0000 7f7b15800640 1 --2- 172.21.15.69:0/3310905060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a63c2f0 0x55718aa109a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.515+0000 7f7b16200640 1 --2- 172.21.15.69:0/3310905060 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6651b0 0x55718aa1ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.516+0000 7f7b14e00640 1 -- 172.21.15.69:0/3310905060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a63c2f0 msgr2=0x55718aa109a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:53.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.516+0000 7f7b14e00640 1 --2- 172.21.15.69:0/3310905060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a63c2f0 0x55718aa109a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.516+0000 7f7b14e00640 1 -- 172.21.15.69:0/3310905060 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6651b0 msgr2=0x55718aa1ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:53.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.516+0000 7f7b14e00640 1 --2- 172.21.15.69:0/3310905060 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6651b0 0x55718aa1ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.516+0000 7f7b14e00640 1 -- 172.21.15.69:0/3310905060 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55718a749620 con 0x55718a6444d0 2024-05-14T15:32:53.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.517+0000 7f7b14e00640 1 --2- 172.21.15.69:0/3310905060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a6444d0 0x55718aa10ee0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7b00015950 tx=0x7f7b00009550 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f729bff9cf62e72 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:53.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.517+0000 7f7af3400640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:32:53.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.517+0000 7f7af3400640 1 -- 172.21.15.69:0/3310905060 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b00025030 con 0x55718a6444d0 2024-05-14T15:32:53.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.517+0000 7f7af3400640 1 -- 172.21.15.69:0/3310905060 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9554+0+0 (secure 0 0 0) 0x7f7b0000f040 con 0x55718a6444d0 2024-05-14T15:32:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.517+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/3310905060 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b040044b0 con 0x55718a6444d0 2024-05-14T15:32:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.517+0000 7f7af3400640 1 -- 172.21.15.69:0/3310905060 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f7b00032050 con 0x55718a6444d0 2024-05-14T15:32:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.517+0000 7f7b1f1c2740 10 client.26515 fetch_fsmap learned FSMap version 62 2024-05-14T15:32:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.517+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/3310905060 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55718aa1f810 con 0x55718a6444d0 2024-05-14T15:32:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.518+0000 7f7af3400640 1 -- 172.21.15.69:0/3310905060 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b040044b0 con 0x55718a6444d0 2024-05-14T15:32:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.519+0000 7f7af3400640 1 -- 172.21.15.69:0/3310905060 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f7b00021ab0 con 0x55718a6444d0 2024-05-14T15:32:53.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.519+0000 7f7b1f1c2740 10 client.26515 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.519+0000 7f7b1f1c2740 10 client.26515 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.519+0000 7f7b1f1c2740 20 client.26515 populate_metadata read hostname 'smithi069' 2024-05-14T15:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.519+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/3310905060 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55718a623d80 0x55718aa22de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.519+0000 7f7b1f1c2740 4 client.26515 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.519+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/3310905060 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55718a979160 con 0x55718a623d80 2024-05-14T15:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.519+0000 7f7b15800640 1 --2- 172.21.15.69:0/3310905060 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55718a623d80 0x55718aa22de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.520+0000 7f7b15800640 1 --2- 172.21.15.69:0/3310905060 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55718a623d80 0x55718aa22de0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c76d97b0ba52d67 server_cookie=ed5c4754d530e32e in_seq=0 out_seq=0 2024-05-14T15:32:53.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.520+0000 7f7af3400640 10 client.26515 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:32:53.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.522+0000 7f7af3400640 1 -- 172.21.15.69:0/3310905060 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55718a979160 con 0x55718a623d80 2024-05-14T15:32:53.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.522+0000 7f7af3400640 10 client.26515 handle_command_reply: tid=0 2024-05-14T15:32:53.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.522+0000 7f7b1f1c2740 1 client.26515 shutdown 2024-05-14T15:32:53.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.522+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/3310905060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a6444d0 msgr2=0x55718aa10ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:53.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.522+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/3310905060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a6444d0 0x55718aa10ee0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7b00015950 tx=0x7f7b00009550 comp rx=0 tx=0).stop 2024-05-14T15:32:53.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.522+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/3310905060 shutdown_connections 2024-05-14T15:32:53.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.522+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/3310905060 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55718a623d80 0x55718aa22de0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.522+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/3310905060 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6651b0 0x55718aa1ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.522+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/3310905060 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a6444d0 0x55718aa10ee0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.522+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/3310905060 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a63c2f0 0x55718aa109a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.522+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/3310905060 >> 172.21.15.69:0/3310905060 conn(0x55718a659300 msgr2=0x55718aa06250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:53.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.523+0000 7f7af3400640 0 client.26515 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:32:53.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.523+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/3310905060 shutdown_connections 2024-05-14T15:32:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.523+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/3310905060 wait complete. 2024-05-14T15:32:53.527 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.524+0000 7f7b1f1c2740 20 client.26515 trim_cache size 0 max 16384 2024-05-14T15:32:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.558+0000 7f7b1f1c2740 1 Processor -- start 2024-05-14T15:32:53.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.559+0000 7f7b1f1c2740 1 -- start start 2024-05-14T15:32:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.559+0000 7f7b1f1c2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a63c2f0 0x55718aa0b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.559+0000 7f7b1f1c2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a6444d0 0x55718aa01960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.559+0000 7f7b1f1c2740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6651b0 0x55718aa01ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.559+0000 7f7b1f1c2740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7b101bfe90 con 0x55718a6651b0 2024-05-14T15:32:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.559+0000 7f7b1f1c2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7b101c19d0 con 0x55718a6444d0 2024-05-14T15:32:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.559+0000 7f7b1f1c2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7b101c0560 con 0x55718a63c2f0 2024-05-14T15:32:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.560+0000 7f7b14e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a6444d0 0x55718aa01960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.560+0000 7f7b14e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a6444d0 0x55718aa01960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:52766/0 (socket says 172.21.15.69:52766) 2024-05-14T15:32:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.560+0000 7f7b14e00640 1 -- 172.21.15.69:0/2758197907 learned_addr learned my addr 172.21.15.69:0/2758197907 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.560+0000 7f7b16200640 1 --2- 172.21.15.69:0/2758197907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6651b0 0x55718aa01ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.560+0000 7f7b15800640 1 --2- 172.21.15.69:0/2758197907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a63c2f0 0x55718aa0b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.561+0000 7f7b16200640 1 -- 172.21.15.69:0/2758197907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a63c2f0 msgr2=0x55718aa0b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.561+0000 7f7b16200640 1 --2- 172.21.15.69:0/2758197907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a63c2f0 0x55718aa0b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.561+0000 7f7b16200640 1 -- 172.21.15.69:0/2758197907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a6444d0 msgr2=0x55718aa01960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.561+0000 7f7b16200640 1 --2- 172.21.15.69:0/2758197907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a6444d0 0x55718aa01960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.561+0000 7f7b16200640 1 -- 172.21.15.69:0/2758197907 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55718aa116b0 con 0x55718a6651b0 2024-05-14T15:32:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.561+0000 7f7b15800640 1 --2- 172.21.15.69:0/2758197907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a63c2f0 0x55718aa0b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:32:53.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.562+0000 7f7b16200640 1 --2- 172.21.15.69:0/2758197907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6651b0 0x55718aa01ea0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f7b080df260 tx=0x7f7b080a8a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167c7cde33e24c89 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.563+0000 7f7afe000640 1 -- 172.21.15.69:0/2758197907 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b080b1c50 con 0x55718a6651b0 2024-05-14T15:32:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.563+0000 7f7afe000640 1 -- 172.21.15.69:0/2758197907 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b080a5110 con 0x55718a6651b0 2024-05-14T15:32:53.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.563+0000 7f7afe000640 1 -- 172.21.15.69:0/2758197907 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b080b17c0 con 0x55718a6651b0 2024-05-14T15:32:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.565+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/2758197907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6651b0 msgr2=0x55718aa01ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.565+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/2758197907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6651b0 0x55718aa01ea0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f7b080df260 tx=0x7f7b080a8a50 comp rx=0 tx=0).stop 2024-05-14T15:32:53.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.566+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/2758197907 shutdown_connections 2024-05-14T15:32:53.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.566+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/2758197907 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6651b0 0x55718aa01ea0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.566+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/2758197907 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a6444d0 0x55718aa01960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.566+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/2758197907 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a63c2f0 0x55718aa0b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.566+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/2758197907 >> 172.21.15.69:0/2758197907 conn(0x55718a659300 msgr2=0x55718aa01250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:53.570 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.568+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/2758197907 shutdown_connections 2024-05-14T15:32:53.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.568+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/2758197907 wait complete. 2024-05-14T15:32:53.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.569+0000 7f7b1f1c2740 1 -- start start 2024-05-14T15:32:53.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.570+0000 7f7b1f1c2740 1 Processor -- start 2024-05-14T15:32:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.572+0000 7f7b1f1c2740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a63c2f0 0x55718aa141a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.572+0000 7f7b1f1c2740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6444d0 0x55718aa146e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.572+0000 7f7b1f1c2740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a6651b0 0x55718aa185d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.572+0000 7f7b1f1c2740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7b101c1300 con 0x55718a6444d0 2024-05-14T15:32:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.572+0000 7f7b1f1c2740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7b101c0c30 con 0x55718a63c2f0 2024-05-14T15:32:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.572+0000 7f7b1f1c2740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7b10103ca0 con 0x55718a6651b0 2024-05-14T15:32:53.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.572+0000 7f7b1f1c2740 10 client.0 _ll_register_callbacks cb 0x7f7b00019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:32:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.573+0000 7f7b16200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a6651b0 0x55718aa185d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.573+0000 7f7b15800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a63c2f0 0x55718aa141a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.573+0000 7f7b15800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a63c2f0 0x55718aa141a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:52776/0 (socket says 172.21.15.69:52776) 2024-05-14T15:32:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.574+0000 7f7b15800640 1 -- 172.21.15.69:0/1423286371 learned_addr learned my addr 172.21.15.69:0/1423286371 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:32:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.574+0000 7f7b14e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6444d0 0x55718aa146e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.574+0000 7f7b16200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a6651b0 0x55718aa185d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:38304/0 (socket says 172.21.15.69:38304) 2024-05-14T15:32:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.575+0000 7f7b16200640 1 -- 172.21.15.69:0/1423286371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a63c2f0 msgr2=0x55718aa141a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.575+0000 7f7b16200640 1 --2- 172.21.15.69:0/1423286371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a63c2f0 0x55718aa141a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.575+0000 7f7b16200640 1 -- 172.21.15.69:0/1423286371 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6444d0 msgr2=0x55718aa146e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:32:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.575+0000 7f7b16200640 1 --2- 172.21.15.69:0/1423286371 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6444d0 0x55718aa146e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.575+0000 7f7b16200640 1 -- 172.21.15.69:0/1423286371 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55718aa18b90 con 0x55718a6651b0 2024-05-14T15:32:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.576+0000 7f7af3400640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:32:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.576+0000 7f7b16200640 1 --2- 172.21.15.69:0/1423286371 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a6651b0 0x55718aa185d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7b080a8e10 tx=0x7f7b0800c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dca69c9a0a4f8556 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:32:53.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.577+0000 7f7af3400640 1 -- 172.21.15.69:0/1423286371 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b08088060 con 0x55718a6651b0 2024-05-14T15:32:53.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.577+0000 7f7af3400640 1 -- 172.21.15.69:0/1423286371 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9554+0+0 (secure 0 0 0) 0x7f7b080a90e0 con 0x55718a6651b0 2024-05-14T15:32:53.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.577+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/1423286371 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7b080a5110 con 0x55718a6651b0 2024-05-14T15:32:53.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.579+0000 7f7af3400640 1 -- 172.21.15.69:0/1423286371 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f7b080c9070 con 0x55718a6651b0 2024-05-14T15:32:53.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.579+0000 7f7b1f1c2740 10 client.26521 fetch_fsmap learned FSMap version 62 2024-05-14T15:32:53.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.579+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/1423286371 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55718aa9bc30 con 0x55718a6651b0 2024-05-14T15:32:53.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.580+0000 7f7af3400640 1 -- 172.21.15.69:0/1423286371 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7b080a5110 con 0x55718a6651b0 2024-05-14T15:32:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.580+0000 7f7af3400640 1 -- 172.21.15.69:0/1423286371 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f7b080b17e0 con 0x55718a6651b0 2024-05-14T15:32:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.580+0000 7f7b1f1c2740 10 client.26521 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:32:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.581+0000 7f7b1f1c2740 10 client.26521 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:32:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.581+0000 7f7b1f1c2740 20 client.26521 populate_metadata read hostname 'smithi069' 2024-05-14T15:32:53.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.581+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/1423286371 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55718a5f91c0 0x55718aa9e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:32:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.581+0000 7f7b1f1c2740 4 client.26521 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:32:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.581+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/1423286371 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55718aa11270 con 0x55718a5f91c0 2024-05-14T15:32:53.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.582+0000 7f7b15800640 1 --2- 172.21.15.69:0/1423286371 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55718a5f91c0 0x55718aa9e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:32:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.583+0000 7f7b15800640 1 --2- 172.21.15.69:0/1423286371 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55718a5f91c0 0x55718aa9e290 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d32d9941609e3a8a server_cookie=183499af69d995b6 in_seq=0 out_seq=0 2024-05-14T15:32:53.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.583+0000 7f7af3400640 10 client.26521 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:32:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.613+0000 7f7af3400640 1 -- 172.21.15.69:0/1423286371 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55718aa11270 con 0x55718a5f91c0 2024-05-14T15:32:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.613+0000 7f7af3400640 10 client.26521 handle_command_reply: tid=0 2024-05-14T15:32:53.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.614+0000 7f7b1f1c2740 1 client.26521 shutdown 2024-05-14T15:32:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.614+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/1423286371 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a6651b0 msgr2=0x55718aa185d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.614+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/1423286371 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a6651b0 0x55718aa185d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7b080a8e10 tx=0x7f7b0800c490 comp rx=0 tx=0).stop 2024-05-14T15:32:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.615+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/1423286371 shutdown_connections 2024-05-14T15:32:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.615+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/1423286371 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55718a6651b0 0x55718aa185d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.617 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.615+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/1423286371 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55718a5f91c0 0x55718aa9e290 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.615+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/1423286371 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55718a6444d0 0x55718aa146e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.615+0000 7f7af3400640 0 client.26521 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:32:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.615+0000 7f7b1f1c2740 1 --2- 172.21.15.69:0/1423286371 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55718a63c2f0 0x55718aa141a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.615+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/1423286371 >> 172.21.15.69:0/1423286371 conn(0x55718a659300 msgr2=0x55718aa01c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:53.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.615+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/1423286371 shutdown_connections 2024-05-14T15:32:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.615+0000 7f7b1f1c2740 1 -- 172.21.15.69:0/1423286371 wait complete. 2024-05-14T15:32:53.619 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.616+0000 7f7b1f1c2740 20 client.26521 trim_cache size 0 max 16384 2024-05-14T15:32:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:32:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:32:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:32:53.620 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:32:53.622 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.620+0000 7f7b16c00640 1 -- 172.21.15.69:0/3702019173 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7af80b2a50 msgr2=0x7f7af80b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.620+0000 7f7b16c00640 1 --2- 172.21.15.69:0/3702019173 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7af80b2a50 0x7f7af80b4f60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x55718aa035f0 tx=0x7f7b00009110 comp rx=0 tx=0).stop 2024-05-14T15:32:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.620+0000 7f7b16c00640 1 -- 172.21.15.69:0/3702019173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b1010d350 msgr2=0x7f7b1010de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:32:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.620+0000 7f7b16c00640 1 --2- 172.21.15.69:0/3702019173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b1010d350 0x7f7b1010de30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7b0800b990 tx=0x7f7b0800bd90 comp rx=0 tx=0).stop 2024-05-14T15:32:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.620+0000 7f7b16c00640 1 -- 172.21.15.69:0/3702019173 shutdown_connections 2024-05-14T15:32:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.620+0000 7f7b16c00640 1 --2- 172.21.15.69:0/3702019173 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7af80b2a50 0x7f7af80b4f60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.620+0000 7f7b16c00640 1 --2- 172.21.15.69:0/3702019173 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7b1010d350 0x7f7b1010de30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.620+0000 7f7b16c00640 1 --2- 172.21.15.69:0/3702019173 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7b101089f0 0x7f7b1010d830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.620+0000 7f7b16c00640 1 --2- 172.21.15.69:0/3702019173 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7b10102ac0 0x7f7b1010f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:32:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.620+0000 7f7b16c00640 1 -- 172.21.15.69:0/3702019173 >> 172.21.15.69:0/3702019173 conn(0x7f7b100fe220 msgr2=0x7f7b10100c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:32:53.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.621+0000 7f7b16c00640 1 -- 172.21.15.69:0/3702019173 shutdown_connections 2024-05-14T15:32:53.624 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:32:53.621+0000 7f7b16c00640 1 -- 172.21.15.69:0/3702019173 wait complete. 2024-05-14T15:32:53.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:53 smithi203 ceph-mon[34567]: pgmap v350: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 424 op/s 2024-05-14T15:32:53.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:53 smithi092 ceph-mon[34729]: pgmap v350: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 424 op/s 2024-05-14T15:32:53.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:53 smithi069 ceph-mon[31270]: pgmap v350: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 21 KiB/s rd, 3.7 MiB/s wr, 424 op/s 2024-05-14T15:32:55.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:55 smithi203 ceph-mon[34567]: pgmap v351: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.5 MiB/s wr, 516 op/s 2024-05-14T15:32:55.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:55 smithi092 ceph-mon[34729]: pgmap v351: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.5 MiB/s wr, 516 op/s 2024-05-14T15:32:55.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:55 smithi069 ceph-mon[31270]: pgmap v351: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 24 KiB/s rd, 4.5 MiB/s wr, 516 op/s 2024-05-14T15:32:56.369 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 430.0 s, 526.5 tps, lat 189.640 ms stddev 123.188 2024-05-14T15:32:57.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:57 smithi203 ceph-mon[34567]: pgmap v352: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.8 MiB/s wr, 515 op/s 2024-05-14T15:32:57.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:57 smithi092 ceph-mon[34729]: pgmap v352: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.8 MiB/s wr, 515 op/s 2024-05-14T15:32:57.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:57 smithi069 ceph-mon[31270]: pgmap v352: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 4.8 MiB/s wr, 515 op/s 2024-05-14T15:32:59.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:32:59 smithi203 ceph-mon[34567]: pgmap v353: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.1 MiB/s wr, 452 op/s 2024-05-14T15:32:59.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:32:59 smithi092 ceph-mon[34729]: pgmap v353: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.1 MiB/s wr, 452 op/s 2024-05-14T15:32:59.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:32:59 smithi069 ceph-mon[31270]: pgmap v353: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 4.1 MiB/s wr, 452 op/s 2024-05-14T15:33:01.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 435.0 s, 539.1 tps, lat 183.806 ms stddev 93.232 2024-05-14T15:33:01.777 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:01 smithi069 ceph-mon[31270]: pgmap v354: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 8.4 MiB/s wr, 737 op/s 2024-05-14T15:33:01.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:01 smithi203 ceph-mon[34567]: pgmap v354: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 8.4 MiB/s wr, 737 op/s 2024-05-14T15:33:01.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:01 smithi092 ceph-mon[34729]: pgmap v354: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 8.4 MiB/s wr, 737 op/s 2024-05-14T15:33:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:03 smithi203 ceph-mon[34567]: pgmap v355: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 6.6 MiB/s wr, 533 op/s 2024-05-14T15:33:03.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:03 smithi092 ceph-mon[34729]: pgmap v355: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 6.6 MiB/s wr, 533 op/s 2024-05-14T15:33:03.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:03 smithi069 ceph-mon[31270]: pgmap v355: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 6.6 MiB/s wr, 533 op/s 2024-05-14T15:33:05.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:05 smithi203 ceph-mon[34567]: pgmap v356: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 8.0 MiB/s wr, 625 op/s 2024-05-14T15:33:05.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:05 smithi092 ceph-mon[34729]: pgmap v356: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 8.0 MiB/s wr, 625 op/s 2024-05-14T15:33:05.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:05 smithi069 ceph-mon[31270]: pgmap v356: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 84 KiB/s rd, 8.0 MiB/s wr, 625 op/s 2024-05-14T15:33:06.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 440.0 s, 670.2 tps, lat 150.895 ms stddev 98.717 2024-05-14T15:33:07.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.424+0000 7f2a4a200640 1 -- 172.21.15.69:0/448165449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4410c350 msgr2=0x7f2a44105f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.424+0000 7f2a4a200640 1 --2- 172.21.15.69:0/448165449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4410c350 0x7f2a44105f90 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2a30009900 tx=0x7f2a3002a3f0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.425+0000 7f2a4a200640 1 -- 172.21.15.69:0/448165449 shutdown_connections 2024-05-14T15:33:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.425+0000 7f2a4a200640 1 --2- 172.21.15.69:0/448165449 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a44106600 0x7f2a441129d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.425+0000 7f2a4a200640 1 --2- 172.21.15.69:0/448165449 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4410c350 0x7f2a44105f90 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.425+0000 7f2a4a200640 1 --2- 172.21.15.69:0/448165449 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a4410beb0 0x7f2a44105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.425+0000 7f2a4a200640 1 -- 172.21.15.69:0/448165449 >> 172.21.15.69:0/448165449 conn(0x7f2a44101530 msgr2=0x7f2a44103980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.425+0000 7f2a4a200640 1 -- 172.21.15.69:0/448165449 shutdown_connections 2024-05-14T15:33:07.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.425+0000 7f2a4a200640 1 -- 172.21.15.69:0/448165449 wait complete. 2024-05-14T15:33:07.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.427+0000 7f2a4a200640 1 Processor -- start 2024-05-14T15:33:07.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.427+0000 7f2a4a200640 1 -- start start 2024-05-14T15:33:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.427+0000 7f2a4a200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a44106600 0x7f2a441a2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.427+0000 7f2a4a200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a4410beb0 0x7f2a441a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.427+0000 7f2a4a200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4410c350 0x7f2a4419c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.427+0000 7f2a4a200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2a44115f80 con 0x7f2a44106600 2024-05-14T15:33:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.427+0000 7f2a4a200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2a44115e00 con 0x7f2a4410beb0 2024-05-14T15:33:07.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.427+0000 7f2a4a200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2a44116100 con 0x7f2a4410c350 2024-05-14T15:33:07.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.428+0000 7f2a43e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4410c350 0x7f2a4419c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.428+0000 7f2a43e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4410c350 0x7f2a4419c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:53802/0 (socket says 172.21.15.69:53802) 2024-05-14T15:33:07.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.428+0000 7f2a43e00640 1 -- 172.21.15.69:0/2525023857 learned_addr learned my addr 172.21.15.69:0/2525023857 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:07.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.429+0000 7f2a42a00640 1 --2- 172.21.15.69:0/2525023857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a4410beb0 0x7f2a441a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.429+0000 7f2a43400640 1 --2- 172.21.15.69:0/2525023857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a44106600 0x7f2a441a2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.430+0000 7f2a43400640 1 -- 172.21.15.69:0/2525023857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4410c350 msgr2=0x7f2a4419c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:07.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.430+0000 7f2a43400640 1 --2- 172.21.15.69:0/2525023857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4410c350 0x7f2a4419c860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.430+0000 7f2a43400640 1 -- 172.21.15.69:0/2525023857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a4410beb0 msgr2=0x7f2a441a2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:07.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.430+0000 7f2a43400640 1 --2- 172.21.15.69:0/2525023857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a4410beb0 0x7f2a441a2b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.430+0000 7f2a43400640 1 -- 172.21.15.69:0/2525023857 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a4419cf00 con 0x7f2a44106600 2024-05-14T15:33:07.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.430+0000 7f2a43400640 1 --2- 172.21.15.69:0/2525023857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a44106600 0x7f2a441a2650 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f2a34005fd0 tx=0x7f2a3400dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.433+0000 7f2a3be00640 1 -- 172.21.15.69:0/2525023857 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34009c00 con 0x7f2a44106600 2024-05-14T15:33:07.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.433+0000 7f2a3be00640 1 -- 172.21.15.69:0/2525023857 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a340044c0 con 0x7f2a44106600 2024-05-14T15:33:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.433+0000 7f2a4a200640 1 -- 172.21.15.69:0/2525023857 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a4419d1f0 con 0x7f2a44106600 2024-05-14T15:33:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.433+0000 7f2a3be00640 1 -- 172.21.15.69:0/2525023857 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34003d40 con 0x7f2a44106600 2024-05-14T15:33:07.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.433+0000 7f2a4a200640 1 -- 172.21.15.69:0/2525023857 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a44077110 con 0x7f2a44106600 2024-05-14T15:33:07.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.439+0000 7f2a5119b740 1 Processor -- start 2024-05-14T15:33:07.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.440+0000 7f2a5119b740 1 -- start start 2024-05-14T15:33:07.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.441+0000 7f2a5119b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec691b0 0x55743f00a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.441+0000 7f2a5119b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec402f0 0x55743f00a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.441+0000 7f2a5119b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec484d0 0x55743f00ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.441+0000 7f2a5119b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55743ef6f550 con 0x55743ec484d0 2024-05-14T15:33:07.444 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.441+0000 7f2a5119b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55743ef14bc0 con 0x55743ec402f0 2024-05-14T15:33:07.444 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.441+0000 7f2a5119b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55743ef6b510 con 0x55743ec691b0 2024-05-14T15:33:07.444 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.442+0000 7f2a43e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec691b0 0x55743f00a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.444 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.442+0000 7f2a42a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec484d0 0x55743f00ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.444 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.442+0000 7f2a42a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec484d0 0x55743f00ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56272/0 (socket says 172.21.15.69:56272) 2024-05-14T15:33:07.444 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.442+0000 7f2a42a00640 1 -- 172.21.15.69:0/2043843920 learned_addr learned my addr 172.21.15.69:0/2043843920 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:07.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.442+0000 7f2a3be00640 1 -- 172.21.15.69:0/2525023857 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2a34010460 con 0x7f2a44106600 2024-05-14T15:33:07.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.442+0000 7f2a43400640 1 --2- 172.21.15.69:0/2043843920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec402f0 0x55743f00a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.443+0000 7f2a42a00640 1 -- 172.21.15.69:0/2043843920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec691b0 msgr2=0x55743f00a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:07.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.443+0000 7f2a42a00640 1 --2- 172.21.15.69:0/2043843920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec691b0 0x55743f00a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.443+0000 7f2a42a00640 1 -- 172.21.15.69:0/2043843920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec402f0 msgr2=0x55743f00a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:07.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.443+0000 7f2a42a00640 1 --2- 172.21.15.69:0/2043843920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec402f0 0x55743f00a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.443+0000 7f2a42a00640 1 -- 172.21.15.69:0/2043843920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55743ec81210 con 0x55743ec484d0 2024-05-14T15:33:07.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.443+0000 7f2a43400640 1 --2- 172.21.15.69:0/2043843920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec402f0 0x55743f00a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:33:07.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.444+0000 7f2a42a00640 1 --2- 172.21.15.69:0/2043843920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec484d0 0x55743f00ad00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2a30005ab0 tx=0x7f2a30004190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b9b3fb84ca5f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:07.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.444+0000 7f2a3be00640 1 --2- 172.21.15.69:0/2525023857 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2a280b2b20 0x7f2a280b5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.445+0000 7f2a3be00640 1 -- 172.21.15.69:0/2525023857 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9554+0+0 (secure 0 0 0) 0x7f2a340e24c0 con 0x7f2a44106600 2024-05-14T15:33:07.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.445+0000 7f2a43e00640 1 --2- 172.21.15.69:0/2525023857 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2a280b2b20 0x7f2a280b5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.445+0000 7f2a2fe00640 1 -- 172.21.15.69:0/2043843920 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a30035030 con 0x55743ec484d0 2024-05-14T15:33:07.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.446+0000 7f2a2fe00640 1 -- 172.21.15.69:0/2043843920 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a30040070 con 0x55743ec484d0 2024-05-14T15:33:07.448 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.446+0000 7f2a2fe00640 1 -- 172.21.15.69:0/2043843920 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3003c860 con 0x55743ec484d0 2024-05-14T15:33:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.447+0000 7f2a5119b740 1 -- 172.21.15.69:0/2043843920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec484d0 msgr2=0x55743f00ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:07.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.448+0000 7f2a5119b740 1 --2- 172.21.15.69:0/2043843920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec484d0 0x55743f00ad00 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f2a30005ab0 tx=0x7f2a30004190 comp rx=0 tx=0).stop 2024-05-14T15:33:07.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.448+0000 7f2a43e00640 1 --2- 172.21.15.69:0/2525023857 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2a280b2b20 0x7f2a280b5030 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55743f0073f0 tx=0x7f2a3c009500 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.449+0000 7f2a5119b740 1 -- 172.21.15.69:0/2043843920 shutdown_connections 2024-05-14T15:33:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.449+0000 7f2a5119b740 1 --2- 172.21.15.69:0/2043843920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec484d0 0x55743f00ad00 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.449+0000 7f2a5119b740 1 --2- 172.21.15.69:0/2043843920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec402f0 0x55743f00a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.449+0000 7f2a5119b740 1 --2- 172.21.15.69:0/2043843920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec691b0 0x55743f00a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.449+0000 7f2a5119b740 1 -- 172.21.15.69:0/2043843920 >> 172.21.15.69:0/2043843920 conn(0x55743ec5d300 msgr2=0x55743f006a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.449+0000 7f2a5119b740 1 -- 172.21.15.69:0/2043843920 shutdown_connections 2024-05-14T15:33:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.450+0000 7f2a5119b740 1 -- 172.21.15.69:0/2043843920 wait complete. 2024-05-14T15:33:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.450+0000 7f2a5119b740 1 -- start start 2024-05-14T15:33:07.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.450+0000 7f2a5119b740 1 Processor -- start 2024-05-14T15:33:07.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.451+0000 7f2a5119b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec402f0 0x55743f014810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.451+0000 7f2a5119b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec691b0 0x55743f014d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.451+0000 7f2a5119b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec27d80 0x55743f020800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.451+0000 7f2a5119b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55743f017350 con 0x55743ec402f0 2024-05-14T15:33:07.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.451+0000 7f2a5119b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55743ef28660 con 0x55743ec691b0 2024-05-14T15:33:07.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.451+0000 7f2a5119b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55743f0174d0 con 0x55743ec27d80 2024-05-14T15:33:07.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.451+0000 7f2a5119b740 10 client.0 _ll_register_callbacks cb 0x55743eef2400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:33:07.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.452+0000 7f2a42a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec691b0 0x55743f014d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.452+0000 7f2a43400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec402f0 0x55743f014810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.452+0000 7f2a42a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec691b0 0x55743f014d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:37622/0 (socket says 172.21.15.69:37622) 2024-05-14T15:33:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.452+0000 7f2a42a00640 1 -- 172.21.15.69:0/2382601345 learned_addr learned my addr 172.21.15.69:0/2382601345 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.452+0000 7f2a43e00640 1 --2- 172.21.15.69:0/2382601345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec27d80 0x55743f020800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.453+0000 7f2a43400640 1 -- 172.21.15.69:0/2382601345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec27d80 msgr2=0x55743f020800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.453+0000 7f2a43400640 1 --2- 172.21.15.69:0/2382601345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec27d80 0x55743f020800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.453+0000 7f2a43400640 1 -- 172.21.15.69:0/2382601345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec691b0 msgr2=0x55743f014d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.453+0000 7f2a43400640 1 --2- 172.21.15.69:0/2382601345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec691b0 0x55743f014d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.453+0000 7f2a43400640 1 -- 172.21.15.69:0/2382601345 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55743ed4d620 con 0x55743ec402f0 2024-05-14T15:33:07.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.453+0000 7f2a43400640 1 --2- 172.21.15.69:0/2382601345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec402f0 0x55743f014810 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2a340df7a0 tx=0x7f2a340a52b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a2067b782733ac5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:07.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.453+0000 7f2a2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:33:07.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.454+0000 7f2a2cc00640 1 -- 172.21.15.69:0/2382601345 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a34020040 con 0x55743ec402f0 2024-05-14T15:33:07.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.454+0000 7f2a2cc00640 1 -- 172.21.15.69:0/2382601345 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9554+0+0 (secure 0 0 0) 0x7f2a340e2170 con 0x55743ec402f0 2024-05-14T15:33:07.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.454+0000 7f2a5119b740 1 -- 172.21.15.69:0/2382601345 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a30040070 con 0x55743ec402f0 2024-05-14T15:33:07.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.455+0000 7f2a2cc00640 1 -- 172.21.15.69:0/2382601345 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f2a340a8e40 con 0x55743ec402f0 2024-05-14T15:33:07.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.455+0000 7f2a5119b740 10 client.17031 fetch_fsmap learned FSMap version 62 2024-05-14T15:33:07.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.455+0000 7f2a5119b740 1 -- 172.21.15.69:0/2382601345 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55743f023690 con 0x55743ec402f0 2024-05-14T15:33:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.455+0000 7f2a2cc00640 1 -- 172.21.15.69:0/2382601345 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a30040070 con 0x55743ec402f0 2024-05-14T15:33:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.455+0000 7f2a2cc00640 1 -- 172.21.15.69:0/2382601345 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f2a340dfa20 con 0x55743ec402f0 2024-05-14T15:33:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.456+0000 7f2a5119b740 10 client.17031 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:33:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.456+0000 7f2a5119b740 10 client.17031 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:33:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.456+0000 7f2a5119b740 20 client.17031 populate_metadata read hostname 'smithi069' 2024-05-14T15:33:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.456+0000 7f2a5119b740 1 --2- 172.21.15.69:0/2382601345 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55743ebfd1c0 0x55743f026b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.456+0000 7f2a5119b740 4 client.17031 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:33:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.456+0000 7f2a5119b740 1 -- 172.21.15.69:0/2382601345 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55743ef7d160 con 0x55743ebfd1c0 2024-05-14T15:33:07.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.456+0000 7f2a42a00640 1 --2- 172.21.15.69:0/2382601345 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55743ebfd1c0 0x55743f026b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.457+0000 7f2a42a00640 1 --2- 172.21.15.69:0/2382601345 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55743ebfd1c0 0x55743f026b30 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd518f7616003d34 server_cookie=caf2b550dcf43d14 in_seq=0 out_seq=0 2024-05-14T15:33:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.458+0000 7f2a2cc00640 10 client.17031 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:33:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.459+0000 7f2a2cc00640 1 -- 172.21.15.69:0/2382601345 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55743ef7d160 con 0x55743ebfd1c0 2024-05-14T15:33:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.459+0000 7f2a2cc00640 10 client.17031 handle_command_reply: tid=0 2024-05-14T15:33:07.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.460+0000 7f2a5119b740 1 client.17031 shutdown 2024-05-14T15:33:07.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.460+0000 7f2a5119b740 1 -- 172.21.15.69:0/2382601345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec402f0 msgr2=0x55743f014810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:07.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.460+0000 7f2a5119b740 1 --2- 172.21.15.69:0/2382601345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec402f0 0x55743f014810 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f2a340df7a0 tx=0x7f2a340a52b0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.460+0000 7f2a5119b740 1 -- 172.21.15.69:0/2382601345 shutdown_connections 2024-05-14T15:33:07.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.460+0000 7f2a5119b740 1 --2- 172.21.15.69:0/2382601345 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec27d80 0x55743f020800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.460+0000 7f2a5119b740 1 --2- 172.21.15.69:0/2382601345 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec691b0 0x55743f014d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.460+0000 7f2a5119b740 1 --2- 172.21.15.69:0/2382601345 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55743ebfd1c0 0x55743f026b30 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.460+0000 7f2a5119b740 1 --2- 172.21.15.69:0/2382601345 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec402f0 0x55743f014810 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.460+0000 7f2a5119b740 1 -- 172.21.15.69:0/2382601345 >> 172.21.15.69:0/2382601345 conn(0x55743ec5d300 msgr2=0x55743f00bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:07.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.461+0000 7f2a2cc00640 0 client.17031 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:33:07.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.461+0000 7f2a5119b740 1 -- 172.21.15.69:0/2382601345 shutdown_connections 2024-05-14T15:33:07.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.461+0000 7f2a5119b740 1 -- 172.21.15.69:0/2382601345 wait complete. 2024-05-14T15:33:07.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.461+0000 7f2a5119b740 20 client.17031 trim_cache size 0 max 16384 2024-05-14T15:33:07.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.495+0000 7f2a5119b740 1 Processor -- start 2024-05-14T15:33:07.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.499+0000 7f2a5119b740 1 -- start start 2024-05-14T15:33:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.499+0000 7f2a5119b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec27d80 0x55743f00eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.499+0000 7f2a5119b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec402f0 0x55743f016750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.499+0000 7f2a5119b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec691b0 0x55743f005710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.499+0000 7f2a5119b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2a441b79e0 con 0x55743ec691b0 2024-05-14T15:33:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.499+0000 7f2a5119b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2a441b9520 con 0x55743ec402f0 2024-05-14T15:33:07.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.499+0000 7f2a5119b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2a441b80b0 con 0x55743ec27d80 2024-05-14T15:33:07.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.500+0000 7f2a43e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec691b0 0x55743f005710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.501+0000 7f2a43e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec691b0 0x55743f005710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56290/0 (socket says 172.21.15.69:56290) 2024-05-14T15:33:07.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.501+0000 7f2a43e00640 1 -- 172.21.15.69:0/1223483916 learned_addr learned my addr 172.21.15.69:0/1223483916 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.501+0000 7f2a42a00640 1 --2- 172.21.15.69:0/1223483916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec402f0 0x55743f016750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.501+0000 7f2a43400640 1 --2- 172.21.15.69:0/1223483916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec27d80 0x55743f00eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.502+0000 7f2a43e00640 1 -- 172.21.15.69:0/1223483916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec27d80 msgr2=0x55743f00eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.502+0000 7f2a43e00640 1 --2- 172.21.15.69:0/1223483916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec27d80 0x55743f00eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.502+0000 7f2a43e00640 1 -- 172.21.15.69:0/1223483916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec402f0 msgr2=0x55743f016750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.502+0000 7f2a43e00640 1 --2- 172.21.15.69:0/1223483916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec402f0 0x55743f016750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.502+0000 7f2a43e00640 1 -- 172.21.15.69:0/1223483916 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55743f006ec0 con 0x55743ec691b0 2024-05-14T15:33:07.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.502+0000 7f2a42a00640 1 --2- 172.21.15.69:0/1223483916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec402f0 0x55743f016750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:33:07.505 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.503+0000 7f2a43e00640 1 --2- 172.21.15.69:0/1223483916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec691b0 0x55743f005710 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0106f0 tx=0x7f2a3c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79ee513432731bfe server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.504+0000 7f2a2f400640 1 -- 172.21.15.69:0/1223483916 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c02a070 con 0x55743ec691b0 2024-05-14T15:33:07.506 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.505+0000 7f2a2f400640 1 -- 172.21.15.69:0/1223483916 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a3c01c9c0 con 0x55743ec691b0 2024-05-14T15:33:07.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.505+0000 7f2a2f400640 1 -- 172.21.15.69:0/1223483916 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c025ae0 con 0x55743ec691b0 2024-05-14T15:33:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.506+0000 7f2a5119b740 1 -- 172.21.15.69:0/1223483916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec691b0 msgr2=0x55743f005710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.506+0000 7f2a5119b740 1 --2- 172.21.15.69:0/1223483916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec691b0 0x55743f005710 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0106f0 tx=0x7f2a3c015000 comp rx=0 tx=0).stop 2024-05-14T15:33:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.506+0000 7f2a5119b740 1 -- 172.21.15.69:0/1223483916 shutdown_connections 2024-05-14T15:33:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.506+0000 7f2a5119b740 1 --2- 172.21.15.69:0/1223483916 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec691b0 0x55743f005710 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.506+0000 7f2a5119b740 1 --2- 172.21.15.69:0/1223483916 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec402f0 0x55743f016750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.506+0000 7f2a5119b740 1 --2- 172.21.15.69:0/1223483916 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec27d80 0x55743f00eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.506+0000 7f2a5119b740 1 -- 172.21.15.69:0/1223483916 >> 172.21.15.69:0/1223483916 conn(0x55743ec5d300 msgr2=0x55743f005000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.507+0000 7f2a5119b740 1 -- 172.21.15.69:0/1223483916 shutdown_connections 2024-05-14T15:33:07.509 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.508+0000 7f2a5119b740 1 -- 172.21.15.69:0/1223483916 wait complete. 2024-05-14T15:33:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.508+0000 7f2a5119b740 1 -- start start 2024-05-14T15:33:07.510 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.509+0000 7f2a5119b740 1 Processor -- start 2024-05-14T15:33:07.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.510+0000 7f2a5119b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec27d80 0x55743f01c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.510+0000 7f2a5119b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec402f0 0x55743f01cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.510+0000 7f2a5119b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec691b0 0x55743f017d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.510+0000 7f2a5119b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2a441b8e50 con 0x55743ec691b0 2024-05-14T15:33:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.510+0000 7f2a5119b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2a441b8780 con 0x55743ec27d80 2024-05-14T15:33:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.510+0000 7f2a5119b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2a441b5a00 con 0x55743ec402f0 2024-05-14T15:33:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.510+0000 7f2a5119b740 10 client.0 _ll_register_callbacks cb 0x7f2a340e5c70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:33:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.511+0000 7f2a42a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec402f0 0x55743f01cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.511+0000 7f2a43e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec691b0 0x55743f017d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.511+0000 7f2a42a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec402f0 0x55743f01cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:53830/0 (socket says 172.21.15.69:53830) 2024-05-14T15:33:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.511+0000 7f2a43400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec27d80 0x55743f01c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.511+0000 7f2a43e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec691b0 0x55743f017d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56302/0 (socket says 172.21.15.69:56302) 2024-05-14T15:33:07.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.511+0000 7f2a43400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec27d80 0x55743f01c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:37648/0 (socket says 172.21.15.69:37648) 2024-05-14T15:33:07.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.511+0000 7f2a43e00640 1 -- 172.21.15.69:0/2181819842 learned_addr learned my addr 172.21.15.69:0/2181819842 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.512+0000 7f2a43e00640 1 -- 172.21.15.69:0/2181819842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec402f0 msgr2=0x55743f01cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.512+0000 7f2a43e00640 1 --2- 172.21.15.69:0/2181819842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec402f0 0x55743f01cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.512+0000 7f2a43e00640 1 -- 172.21.15.69:0/2181819842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec27d80 msgr2=0x55743f01c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.512+0000 7f2a43e00640 1 --2- 172.21.15.69:0/2181819842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec27d80 0x55743f01c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.512+0000 7f2a43e00640 1 -- 172.21.15.69:0/2181819842 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55743f018510 con 0x55743ec691b0 2024-05-14T15:33:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.512+0000 7f2a43e00640 1 --2- 172.21.15.69:0/2181819842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec691b0 0x55743f017d80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00a010 tx=0x7f2a3c01c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f954f2490a8d35fd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.513+0000 7f2a2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:33:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.513+0000 7f2a2cc00640 1 -- 172.21.15.69:0/2181819842 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c02a070 con 0x55743ec691b0 2024-05-14T15:33:07.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.513+0000 7f2a2cc00640 1 -- 172.21.15.69:0/2181819842 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(102..102 src has 1..102) ==== 9554+0+0 (secure 0 0 0) 0x7f2a3c004c50 con 0x55743ec691b0 2024-05-14T15:33:07.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.513+0000 7f2a5119b740 1 -- 172.21.15.69:0/2181819842 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a3c01c9c0 con 0x55743ec691b0 2024-05-14T15:33:07.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.514+0000 7f2a2cc00640 1 -- 172.21.15.69:0/2181819842 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f2a3c02a070 con 0x55743ec691b0 2024-05-14T15:33:07.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.514+0000 7f2a5119b740 10 client.17037 fetch_fsmap learned FSMap version 62 2024-05-14T15:33:07.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.514+0000 7f2a5119b740 1 -- 172.21.15.69:0/2181819842 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55743f08e950 con 0x55743ec691b0 2024-05-14T15:33:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.515+0000 7f2a2cc00640 1 -- 172.21.15.69:0/2181819842 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2a3c004e50 con 0x55743ec691b0 2024-05-14T15:33:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.515+0000 7f2a2cc00640 1 -- 172.21.15.69:0/2181819842 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f2a3c024070 con 0x55743ec691b0 2024-05-14T15:33:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.515+0000 7f2a5119b740 10 client.17037 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:33:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.515+0000 7f2a5119b740 10 client.17037 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:33:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.515+0000 7f2a5119b740 20 client.17037 populate_metadata read hostname 'smithi069' 2024-05-14T15:33:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.515+0000 7f2a5119b740 1 --2- 172.21.15.69:0/2181819842 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55743f08f0b0 0x55743f0914d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.515+0000 7f2a5119b740 4 client.17037 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:33:07.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.515+0000 7f2a5119b740 1 -- 172.21.15.69:0/2181819842 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f2a3c01c9c0 con 0x55743f08f0b0 2024-05-14T15:33:07.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.516+0000 7f2a43400640 1 --2- 172.21.15.69:0/2181819842 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55743f08f0b0 0x55743f0914d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:07.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.517+0000 7f2a43400640 1 --2- 172.21.15.69:0/2181819842 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55743f08f0b0 0x55743f0914d0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8246c460def47691 server_cookie=9364bef0a8d6a5c0 in_seq=0 out_seq=0 2024-05-14T15:33:07.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.517+0000 7f2a2cc00640 10 client.17037 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:33:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.557+0000 7f2a2cc00640 1 -- 172.21.15.69:0/2181819842 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f2a3c01c9c0 con 0x55743f08f0b0 2024-05-14T15:33:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.557+0000 7f2a2cc00640 10 client.17037 handle_command_reply: tid=0 2024-05-14T15:33:07.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.557+0000 7f2a5119b740 1 client.17037 shutdown 2024-05-14T15:33:07.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.559+0000 7f2a5119b740 1 -- 172.21.15.69:0/2181819842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec691b0 msgr2=0x55743f017d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.559+0000 7f2a5119b740 1 --2- 172.21.15.69:0/2181819842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec691b0 0x55743f017d80 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c00a010 tx=0x7f2a3c01c760 comp rx=0 tx=0).stop 2024-05-14T15:33:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.559+0000 7f2a5119b740 1 -- 172.21.15.69:0/2181819842 shutdown_connections 2024-05-14T15:33:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.559+0000 7f2a5119b740 1 --2- 172.21.15.69:0/2181819842 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55743f08f0b0 0x55743f0914d0 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.559+0000 7f2a5119b740 1 --2- 172.21.15.69:0/2181819842 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55743ec691b0 0x55743f017d80 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.559+0000 7f2a5119b740 1 --2- 172.21.15.69:0/2181819842 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55743ec402f0 0x55743f01cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.559+0000 7f2a5119b740 1 --2- 172.21.15.69:0/2181819842 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55743ec27d80 0x55743f01c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.559+0000 7f2a5119b740 1 -- 172.21.15.69:0/2181819842 >> 172.21.15.69:0/2181819842 conn(0x55743ec5d300 msgr2=0x55743f00a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:07.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.559+0000 7f2a2cc00640 0 client.17037 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:33:07.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.560+0000 7f2a5119b740 1 -- 172.21.15.69:0/2181819842 shutdown_connections 2024-05-14T15:33:07.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.560+0000 7f2a5119b740 1 -- 172.21.15.69:0/2181819842 wait complete. 2024-05-14T15:33:07.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.560+0000 7f2a5119b740 20 client.17037 trim_cache size 0 max 16384 2024-05-14T15:33:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:33:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:33:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:33:07.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:33:07.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.561+0000 7f2a4a200640 1 -- 172.21.15.69:0/2525023857 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2a280b2b20 msgr2=0x7f2a280b5030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:07.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.561+0000 7f2a4a200640 1 --2- 172.21.15.69:0/2525023857 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2a280b2b20 0x7f2a280b5030 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x55743f0073f0 tx=0x7f2a3c009500 comp rx=0 tx=0).stop 2024-05-14T15:33:07.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.561+0000 7f2a4a200640 1 -- 172.21.15.69:0/2525023857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a44106600 msgr2=0x7f2a441a2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:07.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.561+0000 7f2a4a200640 1 --2- 172.21.15.69:0/2525023857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a44106600 0x7f2a441a2650 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f2a34005fd0 tx=0x7f2a3400dde0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.561+0000 7f2a4a200640 1 -- 172.21.15.69:0/2525023857 shutdown_connections 2024-05-14T15:33:07.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.561+0000 7f2a4a200640 1 --2- 172.21.15.69:0/2525023857 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2a280b2b20 0x7f2a280b5030 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.561+0000 7f2a4a200640 1 --2- 172.21.15.69:0/2525023857 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2a4410c350 0x7f2a4419c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.561+0000 7f2a4a200640 1 --2- 172.21.15.69:0/2525023857 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2a4410beb0 0x7f2a441a2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.561+0000 7f2a4a200640 1 --2- 172.21.15.69:0/2525023857 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2a44106600 0x7f2a441a2650 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:07.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.561+0000 7f2a4a200640 1 -- 172.21.15.69:0/2525023857 >> 172.21.15.69:0/2525023857 conn(0x7f2a44101530 msgr2=0x7f2a441109f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:07.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.564+0000 7f2a4a200640 1 -- 172.21.15.69:0/2525023857 shutdown_connections 2024-05-14T15:33:07.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:07.564+0000 7f2a4a200640 1 -- 172.21.15.69:0/2525023857 wait complete. 2024-05-14T15:33:07.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:07 smithi203 ceph-mon[34567]: pgmap v357: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 9.9 MiB/s wr, 740 op/s 2024-05-14T15:33:07.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:07 smithi092 ceph-mon[34729]: pgmap v357: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 9.9 MiB/s wr, 740 op/s 2024-05-14T15:33:07.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:07 smithi069 ceph-mon[31270]: pgmap v357: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 127 KiB/s rd, 9.9 MiB/s wr, 740 op/s 2024-05-14T15:33:08.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:08 smithi203 ceph-mon[34567]: osdmap e103: 12 total, 12 up, 12 in 2024-05-14T15:33:08.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:08 smithi092 ceph-mon[34729]: osdmap e103: 12 total, 12 up, 12 in 2024-05-14T15:33:08.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:08 smithi069 ceph-mon[31270]: osdmap e103: 12 total, 12 up, 12 in 2024-05-14T15:33:09.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:09 smithi203 ceph-mon[34567]: pgmap v359: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 10 MiB/s wr, 701 op/s 2024-05-14T15:33:09.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:09 smithi092 ceph-mon[34729]: pgmap v359: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 10 MiB/s wr, 701 op/s 2024-05-14T15:33:09.976 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:09 smithi069 ceph-mon[31270]: pgmap v359: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 149 KiB/s rd, 10 MiB/s wr, 701 op/s 2024-05-14T15:33:11.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 445.0 s, 594.4 tps, lat 167.717 ms stddev 112.268 2024-05-14T15:33:11.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:11 smithi092 ceph-mon[34729]: pgmap v360: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 9.5 MiB/s wr, 613 op/s 2024-05-14T15:33:11.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:11 smithi069 ceph-mon[31270]: pgmap v360: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 9.5 MiB/s wr, 613 op/s 2024-05-14T15:33:12.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:11 smithi203 ceph-mon[34567]: pgmap v360: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 9.5 MiB/s wr, 613 op/s 2024-05-14T15:33:13.898 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:13 smithi203 ceph-mon[34567]: pgmap v361: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 9.5 MiB/s wr, 613 op/s 2024-05-14T15:33:13.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:13 smithi092 ceph-mon[34729]: pgmap v361: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 9.5 MiB/s wr, 613 op/s 2024-05-14T15:33:13.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:13 smithi069 ceph-mon[31270]: pgmap v361: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 9.5 MiB/s wr, 613 op/s 2024-05-14T15:33:16.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:15 smithi203 ceph-mon[34567]: pgmap v362: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 9.4 MiB/s wr, 607 op/s 2024-05-14T15:33:16.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:15 smithi203 ceph-mon[34567]: osdmap e104: 12 total, 12 up, 12 in 2024-05-14T15:33:16.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:15 smithi092 ceph-mon[34729]: pgmap v362: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 9.4 MiB/s wr, 607 op/s 2024-05-14T15:33:16.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:15 smithi092 ceph-mon[34729]: osdmap e104: 12 total, 12 up, 12 in 2024-05-14T15:33:16.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:15 smithi069 ceph-mon[31270]: pgmap v362: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 9.4 MiB/s wr, 607 op/s 2024-05-14T15:33:16.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:15 smithi069 ceph-mon[31270]: osdmap e104: 12 total, 12 up, 12 in 2024-05-14T15:33:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 450.0 s, 642.0 tps, lat 155.678 ms stddev 58.115 2024-05-14T15:33:18.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:17 smithi203 ceph-mon[34567]: pgmap v364: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 11 MiB/s wr, 653 op/s 2024-05-14T15:33:18.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:17 smithi092 ceph-mon[34729]: pgmap v364: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 11 MiB/s wr, 653 op/s 2024-05-14T15:33:18.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:17 smithi069 ceph-mon[31270]: pgmap v364: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 120 KiB/s rd, 11 MiB/s wr, 653 op/s 2024-05-14T15:33:20.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:19 smithi203 ceph-mon[34567]: pgmap v365: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 9.2 MiB/s wr, 563 op/s 2024-05-14T15:33:20.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:19 smithi092 ceph-mon[34729]: pgmap v365: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 9.2 MiB/s wr, 563 op/s 2024-05-14T15:33:20.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:19 smithi069 ceph-mon[31270]: pgmap v365: 129 pgs: 129 active+clean; 2.7 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 9.2 MiB/s wr, 563 op/s 2024-05-14T15:33:21.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.026+0000 7fbb4a200640 1 -- 172.21.15.69:0/187670846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb4410a140 msgr2=0x7fbb44103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.026+0000 7fbb4a200640 1 --2- 172.21.15.69:0/187670846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb4410a140 0x7fbb44103d80 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fbb30009860 tx=0x7fbb3002a340 comp rx=0 tx=0).stop 2024-05-14T15:33:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.026+0000 7fbb4a200640 1 -- 172.21.15.69:0/187670846 shutdown_connections 2024-05-14T15:33:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.026+0000 7fbb4a200640 1 --2- 172.21.15.69:0/187670846 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb441043f0 0x7fbb441107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.026+0000 7fbb4a200640 1 --2- 172.21.15.69:0/187670846 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb4410a140 0x7fbb44103d80 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.026+0000 7fbb4a200640 1 --2- 172.21.15.69:0/187670846 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb44109ca0 0x7fbb44103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.026+0000 7fbb4a200640 1 -- 172.21.15.69:0/187670846 >> 172.21.15.69:0/187670846 conn(0x7fbb440793a0 msgr2=0x7fbb440797e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.026+0000 7fbb4a200640 1 -- 172.21.15.69:0/187670846 shutdown_connections 2024-05-14T15:33:21.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.026+0000 7fbb4a200640 1 -- 172.21.15.69:0/187670846 wait complete. 2024-05-14T15:33:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.028+0000 7fbb4a200640 1 Processor -- start 2024-05-14T15:33:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.028+0000 7fbb4a200640 1 -- start start 2024-05-14T15:33:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.029+0000 7fbb4a200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb441043f0 0x7fbb44199450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.029+0000 7fbb4a200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb44109ca0 0x7fbb44199990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.029+0000 7fbb4a200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb4410a140 0x7fbb441a42f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.029+0000 7fbb4a200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbb44113da0 con 0x7fbb441043f0 2024-05-14T15:33:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.029+0000 7fbb4a200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb44113c20 con 0x7fbb44109ca0 2024-05-14T15:33:21.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.029+0000 7fbb4a200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbb44113f20 con 0x7fbb4410a140 2024-05-14T15:33:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.030+0000 7fbb43e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb4410a140 0x7fbb441a42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.030+0000 7fbb43e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb4410a140 0x7fbb441a42f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:34082/0 (socket says 172.21.15.69:34082) 2024-05-14T15:33:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.030+0000 7fbb43e00640 1 -- 172.21.15.69:0/554043413 learned_addr learned my addr 172.21.15.69:0/554043413 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.030+0000 7fbb43400640 1 --2- 172.21.15.69:0/554043413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb441043f0 0x7fbb44199450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.030+0000 7fbb42a00640 1 --2- 172.21.15.69:0/554043413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb44109ca0 0x7fbb44199990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.031+0000 7fbb42a00640 1 -- 172.21.15.69:0/554043413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb4410a140 msgr2=0x7fbb441a42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.031+0000 7fbb42a00640 1 --2- 172.21.15.69:0/554043413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb4410a140 0x7fbb441a42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.031+0000 7fbb42a00640 1 -- 172.21.15.69:0/554043413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb441043f0 msgr2=0x7fbb44199450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:21.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.031+0000 7fbb42a00640 1 --2- 172.21.15.69:0/554043413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb441043f0 0x7fbb44199450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.031+0000 7fbb42a00640 1 -- 172.21.15.69:0/554043413 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb441a4830 con 0x7fbb44109ca0 2024-05-14T15:33:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.031+0000 7fbb43e00640 1 --2- 172.21.15.69:0/554043413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb4410a140 0x7fbb441a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:33:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.032+0000 7fbb42a00640 1 --2- 172.21.15.69:0/554043413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb44109ca0 0x7fbb44199990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbb4410a570 tx=0x7fbb30030ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:21.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.033+0000 7fbb3be00640 1 -- 172.21.15.69:0/554043413 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30042070 con 0x7fbb44109ca0 2024-05-14T15:33:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.033+0000 7fbb3be00640 1 -- 172.21.15.69:0/554043413 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb30032df0 con 0x7fbb44109ca0 2024-05-14T15:33:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.033+0000 7fbb3be00640 1 -- 172.21.15.69:0/554043413 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb30042070 con 0x7fbb44109ca0 2024-05-14T15:33:21.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.033+0000 7fbb4a200640 1 -- 172.21.15.69:0/554043413 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb441a4ac0 con 0x7fbb44109ca0 2024-05-14T15:33:21.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.033+0000 7fbb4a200640 1 -- 172.21.15.69:0/554043413 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb441a4e70 con 0x7fbb44109ca0 2024-05-14T15:33:21.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.039+0000 7fbb51257740 1 Processor -- start 2024-05-14T15:33:21.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.039+0000 7fbb51257740 1 -- start start 2024-05-14T15:33:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.039+0000 7fbb51257740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431711b0 0x565543512280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.039+0000 7fbb51257740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431482f0 0x5655435127c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.039+0000 7fbb51257740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431504d0 0x565543512d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.039+0000 7fbb51257740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x565543477550 con 0x5655431711b0 2024-05-14T15:33:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.040+0000 7fbb51257740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56554341cbc0 con 0x5655431482f0 2024-05-14T15:33:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.040+0000 7fbb51257740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x565543473510 con 0x5655431504d0 2024-05-14T15:33:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.040+0000 7fbb43e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431711b0 0x565543512280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.040+0000 7fbb43e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431711b0 0x565543512280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41474/0 (socket says 172.21.15.69:41474) 2024-05-14T15:33:21.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.040+0000 7fbb43e00640 1 -- 172.21.15.69:0/3608575680 learned_addr learned my addr 172.21.15.69:0/3608575680 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:21.043 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.041+0000 7fbb43400640 1 --2- 172.21.15.69:0/3608575680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431482f0 0x5655435127c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.041+0000 7fbb43e00640 1 -- 172.21.15.69:0/3608575680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431504d0 msgr2=0x565543512d00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:33:21.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.042+0000 7fbb3be00640 1 -- 172.21.15.69:0/554043413 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fbb30045070 con 0x7fbb44109ca0 2024-05-14T15:33:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.043+0000 7fbb42a00640 1 --2- 172.21.15.69:0/3608575680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431504d0 0x565543512d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.043+0000 7fbb43e00640 1 --2- 172.21.15.69:0/3608575680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431504d0 0x565543512d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.043+0000 7fbb43e00640 1 -- 172.21.15.69:0/3608575680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431482f0 msgr2=0x5655435127c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.043+0000 7fbb43e00640 1 --2- 172.21.15.69:0/3608575680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431482f0 0x5655435127c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.043+0000 7fbb43e00640 1 -- 172.21.15.69:0/3608575680 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565543189210 con 0x5655431711b0 2024-05-14T15:33:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.043+0000 7fbb43400640 1 --2- 172.21.15.69:0/3608575680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431482f0 0x5655435127c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:33:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.043+0000 7fbb42a00640 1 --2- 172.21.15.69:0/3608575680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431504d0 0x565543512d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:33:21.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.044+0000 7fbb43e00640 1 --2- 172.21.15.69:0/3608575680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431711b0 0x565543512280 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c00eaf0 tx=0x7fbb3c009ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d80a1acb1ea50dc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.044+0000 7fbb3be00640 1 --2- 172.21.15.69:0/554043413 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbb280b2bd0 0x7fbb280b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.044+0000 7fbb2fe00640 1 -- 172.21.15.69:0/3608575680 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c00cc60 con 0x5655431711b0 2024-05-14T15:33:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.044+0000 7fbb2fe00640 1 -- 172.21.15.69:0/3608575680 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb3c00ce00 con 0x5655431711b0 2024-05-14T15:33:21.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.044+0000 7fbb2fe00640 1 -- 172.21.15.69:0/3608575680 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c0183f0 con 0x5655431711b0 2024-05-14T15:33:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.045+0000 7fbb3be00640 1 -- 172.21.15.69:0/554043413 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9554+0+0 (secure 0 0 0) 0x7fbb30101cd0 con 0x7fbb44109ca0 2024-05-14T15:33:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.045+0000 7fbb43400640 1 --2- 172.21.15.69:0/554043413 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbb280b2bd0 0x7fbb280b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.046+0000 7fbb51257740 1 -- 172.21.15.69:0/3608575680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431711b0 msgr2=0x565543512280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:21.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.046+0000 7fbb51257740 1 --2- 172.21.15.69:0/3608575680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431711b0 0x565543512280 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c00eaf0 tx=0x7fbb3c009ee0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.046+0000 7fbb43400640 1 --2- 172.21.15.69:0/554043413 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbb280b2bd0 0x7fbb280b50e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x565543513630 tx=0x7fbb34008040 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.046+0000 7fbb51257740 1 -- 172.21.15.69:0/3608575680 shutdown_connections 2024-05-14T15:33:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.047+0000 7fbb51257740 1 --2- 172.21.15.69:0/3608575680 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431504d0 0x565543512d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.047+0000 7fbb51257740 1 --2- 172.21.15.69:0/3608575680 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431482f0 0x5655435127c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.047+0000 7fbb51257740 1 --2- 172.21.15.69:0/3608575680 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431711b0 0x565543512280 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.047+0000 7fbb51257740 1 -- 172.21.15.69:0/3608575680 >> 172.21.15.69:0/3608575680 conn(0x565543165300 msgr2=0x56554350ea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.047+0000 7fbb51257740 1 -- 172.21.15.69:0/3608575680 shutdown_connections 2024-05-14T15:33:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.047+0000 7fbb51257740 1 -- 172.21.15.69:0/3608575680 wait complete. 2024-05-14T15:33:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.048+0000 7fbb51257740 1 -- start start 2024-05-14T15:33:21.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.048+0000 7fbb51257740 1 Processor -- start 2024-05-14T15:33:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.048+0000 7fbb51257740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431482f0 0x56554351c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.048+0000 7fbb51257740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431504d0 0x56554351cc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.049+0000 7fbb51257740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431711b0 0x565543528910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.049+0000 7fbb51257740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56554351f400 con 0x5655431711b0 2024-05-14T15:33:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.049+0000 7fbb51257740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x565543430660 con 0x5655431504d0 2024-05-14T15:33:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.049+0000 7fbb51257740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56554351f580 con 0x5655431482f0 2024-05-14T15:33:21.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.049+0000 7fbb51257740 10 client.0 _ll_register_callbacks cb 0x5655433fa400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:33:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.050+0000 7fbb43e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431711b0 0x565543528910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.050+0000 7fbb43e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431711b0 0x565543528910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:41490/0 (socket says 172.21.15.69:41490) 2024-05-14T15:33:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.050+0000 7fbb43e00640 1 -- 172.21.15.69:0/85690141 learned_addr learned my addr 172.21.15.69:0/85690141 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.050+0000 7fbb42a00640 1 --2- 172.21.15.69:0/85690141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431504d0 0x56554351cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.050+0000 7fbb43400640 1 --2- 172.21.15.69:0/85690141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431482f0 0x56554351c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.050+0000 7fbb43e00640 1 -- 172.21.15.69:0/85690141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431482f0 msgr2=0x56554351c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.050+0000 7fbb43e00640 1 --2- 172.21.15.69:0/85690141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431482f0 0x56554351c700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.050+0000 7fbb43e00640 1 -- 172.21.15.69:0/85690141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431504d0 msgr2=0x56554351cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.050+0000 7fbb43e00640 1 --2- 172.21.15.69:0/85690141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431504d0 0x56554351cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.050+0000 7fbb43e00640 1 -- 172.21.15.69:0/85690141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565543255620 con 0x5655431711b0 2024-05-14T15:33:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.051+0000 7fbb43400640 1 --2- 172.21.15.69:0/85690141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431482f0 0x56554351c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:33:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.051+0000 7fbb42a00640 1 --2- 172.21.15.69:0/85690141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431504d0 0x56554351cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:33:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.051+0000 7fbb43e00640 1 --2- 172.21.15.69:0/85690141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431711b0 0x565543528910 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c004cf0 tx=0x7fbb3c004d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e7da185ba04c19 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:21.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.051+0000 7fbb2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:33:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.052+0000 7fbb2cc00640 1 -- 172.21.15.69:0/85690141 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c025030 con 0x5655431711b0 2024-05-14T15:33:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.052+0000 7fbb2cc00640 1 -- 172.21.15.69:0/85690141 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9554+0+0 (secure 0 0 0) 0x7fbb3c01d050 con 0x5655431711b0 2024-05-14T15:33:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.052+0000 7fbb51257740 1 -- 172.21.15.69:0/85690141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb3c00ce00 con 0x5655431711b0 2024-05-14T15:33:21.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.053+0000 7fbb2cc00640 1 -- 172.21.15.69:0/85690141 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fbb3c02f050 con 0x5655431711b0 2024-05-14T15:33:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.053+0000 7fbb51257740 10 client.17046 fetch_fsmap learned FSMap version 62 2024-05-14T15:33:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.053+0000 7fbb51257740 1 -- 172.21.15.69:0/85690141 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x56554352b5b0 con 0x5655431711b0 2024-05-14T15:33:21.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.054+0000 7fbb2cc00640 1 -- 172.21.15.69:0/85690141 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb3c00ce00 con 0x5655431711b0 2024-05-14T15:33:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.054+0000 7fbb2cc00640 1 -- 172.21.15.69:0/85690141 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7fbb3c00b040 con 0x5655431711b0 2024-05-14T15:33:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.055+0000 7fbb51257740 10 client.17046 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:33:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.055+0000 7fbb51257740 10 client.17046 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:33:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.055+0000 7fbb51257740 20 client.17046 populate_metadata read hostname 'smithi069' 2024-05-14T15:33:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.055+0000 7fbb51257740 1 --2- 172.21.15.69:0/85690141 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56554312fd80 0x56554352e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.055+0000 7fbb51257740 4 client.17046 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:33:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.055+0000 7fbb51257740 1 -- 172.21.15.69:0/85690141 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x565543485160 con 0x56554312fd80 2024-05-14T15:33:21.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.056+0000 7fbb43400640 1 --2- 172.21.15.69:0/85690141 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56554312fd80 0x56554352e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.057+0000 7fbb43400640 1 --2- 172.21.15.69:0/85690141 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56554312fd80 0x56554352e9c0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e8d17cf5ff83c20f server_cookie=107cdd1da93e5597 in_seq=0 out_seq=0 2024-05-14T15:33:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.057+0000 7fbb2cc00640 10 client.17046 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:33:21.059 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.058+0000 7fbb2cc00640 1 -- 172.21.15.69:0/85690141 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x565543485160 con 0x56554312fd80 2024-05-14T15:33:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.058+0000 7fbb2cc00640 10 client.17046 handle_command_reply: tid=0 2024-05-14T15:33:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.058+0000 7fbb51257740 1 client.17046 shutdown 2024-05-14T15:33:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.058+0000 7fbb51257740 1 -- 172.21.15.69:0/85690141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431711b0 msgr2=0x565543528910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.058+0000 7fbb51257740 1 --2- 172.21.15.69:0/85690141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431711b0 0x565543528910 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c004cf0 tx=0x7fbb3c004d20 comp rx=0 tx=0).stop 2024-05-14T15:33:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.059+0000 7fbb51257740 1 -- 172.21.15.69:0/85690141 shutdown_connections 2024-05-14T15:33:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.059+0000 7fbb51257740 1 --2- 172.21.15.69:0/85690141 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56554312fd80 0x56554352e9c0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.059+0000 7fbb2cc00640 0 client.17046 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:33:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.059+0000 7fbb51257740 1 --2- 172.21.15.69:0/85690141 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431711b0 0x565543528910 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.059+0000 7fbb51257740 1 --2- 172.21.15.69:0/85690141 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431504d0 0x56554351cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.059+0000 7fbb51257740 1 --2- 172.21.15.69:0/85690141 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431482f0 0x56554351c700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.059+0000 7fbb51257740 1 -- 172.21.15.69:0/85690141 >> 172.21.15.69:0/85690141 conn(0x565543165300 msgr2=0x565543512050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.059+0000 7fbb51257740 1 -- 172.21.15.69:0/85690141 shutdown_connections 2024-05-14T15:33:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.059+0000 7fbb51257740 1 -- 172.21.15.69:0/85690141 wait complete. 2024-05-14T15:33:21.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.060+0000 7fbb51257740 20 client.17046 trim_cache size 0 max 16384 2024-05-14T15:33:21.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.091+0000 7fbb51257740 1 Processor -- start 2024-05-14T15:33:21.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.091+0000 7fbb51257740 1 -- start start 2024-05-14T15:33:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.092+0000 7fbb51257740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431482f0 0x565543516d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.092+0000 7fbb51257740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431504d0 0x56554351e320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.092+0000 7fbb51257740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431711b0 0x565543528880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.092+0000 7fbb51257740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441c8a30 con 0x5655431482f0 2024-05-14T15:33:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.092+0000 7fbb51257740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441ca570 con 0x5655431711b0 2024-05-14T15:33:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.092+0000 7fbb51257740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441c9100 con 0x5655431504d0 2024-05-14T15:33:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.093+0000 7fbb43400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431482f0 0x565543516d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.093+0000 7fbb43e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431711b0 0x565543528880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.093+0000 7fbb43e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431711b0 0x565543528880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:52934/0 (socket says 172.21.15.69:52934) 2024-05-14T15:33:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.093+0000 7fbb43e00640 1 -- 172.21.15.69:0/2765066206 learned_addr learned my addr 172.21.15.69:0/2765066206 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:21.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.093+0000 7fbb42a00640 1 --2- 172.21.15.69:0/2765066206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431504d0 0x56554351e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.094+0000 7fbb43e00640 1 -- 172.21.15.69:0/2765066206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431504d0 msgr2=0x56554351e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.094+0000 7fbb43e00640 1 --2- 172.21.15.69:0/2765066206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431504d0 0x56554351e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.094+0000 7fbb43e00640 1 -- 172.21.15.69:0/2765066206 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431482f0 msgr2=0x565543516d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.094+0000 7fbb43e00640 1 --2- 172.21.15.69:0/2765066206 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431482f0 0x565543516d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.094+0000 7fbb43e00640 1 -- 172.21.15.69:0/2765066206 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565543513660 con 0x5655431711b0 2024-05-14T15:33:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.094+0000 7fbb43400640 1 --2- 172.21.15.69:0/2765066206 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431482f0 0x565543516d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:33:21.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.094+0000 7fbb42a00640 1 --2- 172.21.15.69:0/2765066206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431504d0 0x56554351e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:33:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.094+0000 7fbb43e00640 1 --2- 172.21.15.69:0/2765066206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431711b0 0x565543528880 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c02af70 tx=0x7fbb3c005aa0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f513a81466b4e0f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.095+0000 7fbb2f400640 1 -- 172.21.15.69:0/2765066206 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c025070 con 0x5655431711b0 2024-05-14T15:33:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.095+0000 7fbb2f400640 1 -- 172.21.15.69:0/2765066206 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb3c0055c0 con 0x5655431711b0 2024-05-14T15:33:21.097 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.095+0000 7fbb2f400640 1 -- 172.21.15.69:0/2765066206 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3c005150 con 0x5655431711b0 2024-05-14T15:33:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.097+0000 7fbb51257740 1 -- 172.21.15.69:0/2765066206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431711b0 msgr2=0x565543528880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.097+0000 7fbb51257740 1 --2- 172.21.15.69:0/2765066206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431711b0 0x565543528880 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fbb3c02af70 tx=0x7fbb3c005aa0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.097+0000 7fbb51257740 1 -- 172.21.15.69:0/2765066206 shutdown_connections 2024-05-14T15:33:21.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.097+0000 7fbb51257740 1 --2- 172.21.15.69:0/2765066206 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431711b0 0x565543528880 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.097+0000 7fbb51257740 1 --2- 172.21.15.69:0/2765066206 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431504d0 0x56554351e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.097+0000 7fbb51257740 1 --2- 172.21.15.69:0/2765066206 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431482f0 0x565543516d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.097+0000 7fbb51257740 1 -- 172.21.15.69:0/2765066206 >> 172.21.15.69:0/2765066206 conn(0x565543165300 msgr2=0x56554351dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:21.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.098+0000 7fbb51257740 1 -- 172.21.15.69:0/2765066206 shutdown_connections 2024-05-14T15:33:21.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.098+0000 7fbb51257740 1 -- 172.21.15.69:0/2765066206 wait complete. 2024-05-14T15:33:21.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.098+0000 7fbb51257740 1 -- start start 2024-05-14T15:33:21.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.099+0000 7fbb51257740 1 Processor -- start 2024-05-14T15:33:21.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.100+0000 7fbb51257740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431482f0 0x5655435317d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.100+0000 7fbb51257740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431504d0 0x565543531d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.100+0000 7fbb51257740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431711b0 0x56554352ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.100+0000 7fbb51257740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441c9ea0 con 0x5655431504d0 2024-05-14T15:33:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.100+0000 7fbb51257740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbb441c97d0 con 0x5655431482f0 2024-05-14T15:33:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.101+0000 7fbb51257740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbb44073a80 con 0x5655431711b0 2024-05-14T15:33:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.101+0000 7fbb51257740 10 client.0 _ll_register_callbacks cb 0x7fbb3c00e9c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:33:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.101+0000 7fbb43400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431482f0 0x5655435317d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.101+0000 7fbb43400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431482f0 0x5655435317d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:52948/0 (socket says 172.21.15.69:52948) 2024-05-14T15:33:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.101+0000 7fbb43400640 1 -- 172.21.15.69:0/1805731915 learned_addr learned my addr 172.21.15.69:0/1805731915 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:21.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.101+0000 7fbb42a00640 1 --2- 172.21.15.69:0/1805731915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431504d0 0x565543531d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.101+0000 7fbb43e00640 1 --2- 172.21.15.69:0/1805731915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431711b0 0x56554352ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.102+0000 7fbb43400640 1 -- 172.21.15.69:0/1805731915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431711b0 msgr2=0x56554352ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.102+0000 7fbb43400640 1 --2- 172.21.15.69:0/1805731915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431711b0 0x56554352ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.102+0000 7fbb43400640 1 -- 172.21.15.69:0/1805731915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431504d0 msgr2=0x565543531d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.102+0000 7fbb43400640 1 --2- 172.21.15.69:0/1805731915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431504d0 0x565543531d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.102+0000 7fbb43400640 1 -- 172.21.15.69:0/1805731915 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56554352f340 con 0x5655431482f0 2024-05-14T15:33:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.102+0000 7fbb42a00640 1 --2- 172.21.15.69:0/1805731915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431504d0 0x565543531d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:33:21.105 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.103+0000 7fbb43e00640 1 --2- 172.21.15.69:0/1805731915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431711b0 0x56554352ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:33:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.103+0000 7fbb2cc00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:33:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.103+0000 7fbb43400640 1 --2- 172.21.15.69:0/1805731915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431482f0 0x5655435317d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x56554350f9c0 tx=0x7fbb340046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98fdd4b69d3b8a60 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.104+0000 7fbb2cc00640 1 -- 172.21.15.69:0/1805731915 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb3401b040 con 0x5655431482f0 2024-05-14T15:33:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.104+0000 7fbb2cc00640 1 -- 172.21.15.69:0/1805731915 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9554+0+0 (secure 0 0 0) 0x7fbb3400fd40 con 0x5655431482f0 2024-05-14T15:33:21.106 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.104+0000 7fbb51257740 1 -- 172.21.15.69:0/1805731915 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbb3c0055c0 con 0x5655431482f0 2024-05-14T15:33:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.108+0000 7fbb2cc00640 1 -- 172.21.15.69:0/1805731915 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fbb34026130 con 0x5655431482f0 2024-05-14T15:33:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.108+0000 7fbb51257740 10 client.36572 fetch_fsmap learned FSMap version 62 2024-05-14T15:33:21.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.108+0000 7fbb51257740 1 -- 172.21.15.69:0/1805731915 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x565543596420 con 0x5655431482f0 2024-05-14T15:33:21.112 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.110+0000 7fbb2cc00640 1 -- 172.21.15.69:0/1805731915 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbb3c0055c0 con 0x5655431482f0 2024-05-14T15:33:21.112 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.110+0000 7fbb2cc00640 1 -- 172.21.15.69:0/1805731915 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7fbb3402f560 con 0x5655431482f0 2024-05-14T15:33:21.112 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.110+0000 7fbb51257740 10 client.36572 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:33:21.112 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.110+0000 7fbb51257740 10 client.36572 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:33:21.112 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.110+0000 7fbb51257740 20 client.36572 populate_metadata read hostname 'smithi069' 2024-05-14T15:33:21.112 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.110+0000 7fbb51257740 1 --2- 172.21.15.69:0/1805731915 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5655431051c0 0x565543598b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:21.112 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.110+0000 7fbb51257740 4 client.36572 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:33:21.112 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.110+0000 7fbb51257740 1 -- 172.21.15.69:0/1805731915 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56554347efd0 con 0x5655431051c0 2024-05-14T15:33:21.113 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.111+0000 7fbb42a00640 1 --2- 172.21.15.69:0/1805731915 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5655431051c0 0x565543598b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:21.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.112+0000 7fbb42a00640 1 --2- 172.21.15.69:0/1805731915 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5655431051c0 0x565543598b90 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d08668b90e7456dc server_cookie=3b4ee50b04039650 in_seq=0 out_seq=0 2024-05-14T15:33:21.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.112+0000 7fbb2cc00640 10 client.36572 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:33:21.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.148+0000 7fbb2cc00640 1 -- 172.21.15.69:0/1805731915 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56554347efd0 con 0x5655431051c0 2024-05-14T15:33:21.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.148+0000 7fbb2cc00640 10 client.36572 handle_command_reply: tid=0 2024-05-14T15:33:21.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.148+0000 7fbb51257740 1 client.36572 shutdown 2024-05-14T15:33:21.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.149+0000 7fbb51257740 1 -- 172.21.15.69:0/1805731915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431482f0 msgr2=0x5655435317d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:21.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.149+0000 7fbb51257740 1 --2- 172.21.15.69:0/1805731915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431482f0 0x5655435317d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x56554350f9c0 tx=0x7fbb340046c0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.150+0000 7fbb51257740 1 -- 172.21.15.69:0/1805731915 shutdown_connections 2024-05-14T15:33:21.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.150+0000 7fbb51257740 1 --2- 172.21.15.69:0/1805731915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5655431711b0 0x56554352ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.150+0000 7fbb51257740 1 --2- 172.21.15.69:0/1805731915 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5655431051c0 0x565543598b90 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.150+0000 7fbb51257740 1 --2- 172.21.15.69:0/1805731915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5655431504d0 0x565543531d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.150+0000 7fbb51257740 1 --2- 172.21.15.69:0/1805731915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5655431482f0 0x5655435317d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.150+0000 7fbb51257740 1 -- 172.21.15.69:0/1805731915 >> 172.21.15.69:0/1805731915 conn(0x565543165300 msgr2=0x56554351e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:21.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.150+0000 7fbb2cc00640 0 client.36572 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:33:21.152 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.150+0000 7fbb51257740 1 -- 172.21.15.69:0/1805731915 shutdown_connections 2024-05-14T15:33:21.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.150+0000 7fbb51257740 1 -- 172.21.15.69:0/1805731915 wait complete. 2024-05-14T15:33:21.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.150+0000 7fbb51257740 20 client.36572 trim_cache size 0 max 16384 2024-05-14T15:33:21.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:33:21.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:33:21.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:33:21.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:33:21.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.151+0000 7fbb4a200640 1 -- 172.21.15.69:0/554043413 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbb280b2bd0 msgr2=0x7fbb280b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.151+0000 7fbb4a200640 1 --2- 172.21.15.69:0/554043413 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbb280b2bd0 0x7fbb280b50e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x565543513630 tx=0x7fbb34008040 comp rx=0 tx=0).stop 2024-05-14T15:33:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.151+0000 7fbb4a200640 1 -- 172.21.15.69:0/554043413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb44109ca0 msgr2=0x7fbb44199990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.151+0000 7fbb4a200640 1 --2- 172.21.15.69:0/554043413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb44109ca0 0x7fbb44199990 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fbb4410a570 tx=0x7fbb30030ce0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.152+0000 7fbb4a200640 1 -- 172.21.15.69:0/554043413 shutdown_connections 2024-05-14T15:33:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.152+0000 7fbb4a200640 1 --2- 172.21.15.69:0/554043413 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbb280b2bd0 0x7fbb280b50e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.152+0000 7fbb4a200640 1 --2- 172.21.15.69:0/554043413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbb4410a140 0x7fbb441a42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.152+0000 7fbb4a200640 1 --2- 172.21.15.69:0/554043413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbb44109ca0 0x7fbb44199990 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.152+0000 7fbb4a200640 1 --2- 172.21.15.69:0/554043413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbb441043f0 0x7fbb44199450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:21.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.152+0000 7fbb4a200640 1 -- 172.21.15.69:0/554043413 >> 172.21.15.69:0/554043413 conn(0x7fbb440793a0 msgr2=0x7fbb441003b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:21.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.153+0000 7fbb4a200640 1 -- 172.21.15.69:0/554043413 shutdown_connections 2024-05-14T15:33:21.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:21.153+0000 7fbb4a200640 1 -- 172.21.15.69:0/554043413 wait complete. 2024-05-14T15:33:21.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 455.0 s, 629.9 tps, lat 159.842 ms stddev 84.424 2024-05-14T15:33:22.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:21 smithi203 ceph-mon[34567]: pgmap v366: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.4 MiB/s wr, 623 op/s 2024-05-14T15:33:22.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:21 smithi092 ceph-mon[34729]: pgmap v366: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.4 MiB/s wr, 623 op/s 2024-05-14T15:33:22.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:21 smithi069 ceph-mon[31270]: pgmap v366: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.4 MiB/s wr, 623 op/s 2024-05-14T15:33:24.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:23 smithi203 ceph-mon[34567]: pgmap v367: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.4 MiB/s wr, 623 op/s 2024-05-14T15:33:24.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:23 smithi092 ceph-mon[34729]: pgmap v367: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.4 MiB/s wr, 623 op/s 2024-05-14T15:33:24.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:23 smithi069 ceph-mon[31270]: pgmap v367: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.4 MiB/s wr, 623 op/s 2024-05-14T15:33:26.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:25 smithi203 ceph-mon[34567]: pgmap v368: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 8.9 MiB/s wr, 614 op/s 2024-05-14T15:33:26.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:25 smithi092 ceph-mon[34729]: pgmap v368: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 8.9 MiB/s wr, 614 op/s 2024-05-14T15:33:26.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:25 smithi069 ceph-mon[31270]: pgmap v368: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 8.9 MiB/s wr, 614 op/s 2024-05-14T15:33:26.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 460.0 s, 646.6 tps, lat 154.245 ms stddev 66.676 2024-05-14T15:33:28.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:27 smithi203 ceph-mon[34567]: pgmap v369: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 7.9 MiB/s wr, 547 op/s 2024-05-14T15:33:28.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:27 smithi092 ceph-mon[34729]: pgmap v369: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 7.9 MiB/s wr, 547 op/s 2024-05-14T15:33:28.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:27 smithi069 ceph-mon[31270]: pgmap v369: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 7.9 MiB/s wr, 547 op/s 2024-05-14T15:33:30.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:29 smithi092 ceph-mon[34729]: pgmap v370: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 7.5 MiB/s wr, 520 op/s 2024-05-14T15:33:30.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:29 smithi069 ceph-mon[31270]: pgmap v370: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 7.5 MiB/s wr, 520 op/s 2024-05-14T15:33:30.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:29 smithi203 ceph-mon[34567]: pgmap v370: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 7.5 MiB/s wr, 520 op/s 2024-05-14T15:33:31.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 465.0 s, 597.4 tps, lat 166.772 ms stddev 143.202 2024-05-14T15:33:32.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:31 smithi092 ceph-mon[34729]: pgmap v371: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 11 MiB/s wr, 796 op/s 2024-05-14T15:33:32.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:31 smithi069 ceph-mon[31270]: pgmap v371: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 11 MiB/s wr, 796 op/s 2024-05-14T15:33:32.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:31 smithi203 ceph-mon[34567]: pgmap v371: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 11 MiB/s wr, 796 op/s 2024-05-14T15:33:34.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:33 smithi092 ceph-mon[34729]: pgmap v372: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 7.2 MiB/s wr, 534 op/s 2024-05-14T15:33:34.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:33 smithi069 ceph-mon[31270]: pgmap v372: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 7.2 MiB/s wr, 534 op/s 2024-05-14T15:33:34.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:33 smithi203 ceph-mon[34567]: pgmap v372: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 7.2 MiB/s wr, 534 op/s 2024-05-14T15:33:35.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:34 smithi092 ceph-mon[34729]: pgmap v373: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 7.4 MiB/s wr, 560 op/s 2024-05-14T15:33:35.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:34 smithi069 ceph-mon[31270]: pgmap v373: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 7.4 MiB/s wr, 560 op/s 2024-05-14T15:33:35.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:34 smithi203 ceph-mon[34567]: pgmap v373: 129 pgs: 129 active+clean; 2.8 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 7.4 MiB/s wr, 560 op/s 2024-05-14T15:33:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.555+0000 7efc3e800640 1 -- 172.21.15.69:0/1780897619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc3810a4a0 msgr2=0x7efc3810a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:35.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.555+0000 7efc3e800640 1 --2- 172.21.15.69:0/1780897619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc3810a4a0 0x7efc3810a8b0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7efc28009900 tx=0x7efc2802a480 comp rx=0 tx=0).stop 2024-05-14T15:33:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.556+0000 7efc3e800640 1 -- 172.21.15.69:0/1780897619 shutdown_connections 2024-05-14T15:33:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.556+0000 7efc3e800640 1 --2- 172.21.15.69:0/1780897619 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc38112910 0x7efc38118ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.556+0000 7efc3e800640 1 --2- 172.21.15.69:0/1780897619 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc38111df0 0x7efc38112280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.556+0000 7efc3e800640 1 --2- 172.21.15.69:0/1780897619 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc3810a4a0 0x7efc3810a8b0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.556+0000 7efc3e800640 1 -- 172.21.15.69:0/1780897619 >> 172.21.15.69:0/1780897619 conn(0x7efc3806e900 msgr2=0x7efc3806ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:35.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.557+0000 7efc3e800640 1 -- 172.21.15.69:0/1780897619 shutdown_connections 2024-05-14T15:33:35.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.557+0000 7efc3e800640 1 -- 172.21.15.69:0/1780897619 wait complete. 2024-05-14T15:33:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.559+0000 7efc3e800640 1 Processor -- start 2024-05-14T15:33:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.559+0000 7efc3e800640 1 -- start start 2024-05-14T15:33:35.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.560+0000 7efc3e800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc3810a4a0 0x7efc3811bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.560+0000 7efc3e800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc38111df0 0x7efc3811c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.560+0000 7efc3e800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc38112910 0x7efc381b53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.560+0000 7efc3e800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7efc3810d580 con 0x7efc38111df0 2024-05-14T15:33:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.560+0000 7efc3e800640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc3810d400 con 0x7efc38112910 2024-05-14T15:33:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.560+0000 7efc3e800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efc3810d700 con 0x7efc3810a4a0 2024-05-14T15:33:35.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.561+0000 7efc37400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc3810a4a0 0x7efc3811bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.561+0000 7efc37400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc3810a4a0 0x7efc3811bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35268/0 (socket says 172.21.15.69:35268) 2024-05-14T15:33:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.561+0000 7efc37400640 1 -- 172.21.15.69:0/4105184019 learned_addr learned my addr 172.21.15.69:0/4105184019 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.561+0000 7efc36a00640 1 --2- 172.21.15.69:0/4105184019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc38111df0 0x7efc3811c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.561+0000 7efc37e00640 1 --2- 172.21.15.69:0/4105184019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc38112910 0x7efc381b53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.561+0000 7efc37400640 1 -- 172.21.15.69:0/4105184019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc38112910 msgr2=0x7efc381b53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:35.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.561+0000 7efc37400640 1 --2- 172.21.15.69:0/4105184019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc38112910 0x7efc381b53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.562+0000 7efc37400640 1 -- 172.21.15.69:0/4105184019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc38111df0 msgr2=0x7efc3811c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:35.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.562+0000 7efc37400640 1 --2- 172.21.15.69:0/4105184019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc38111df0 0x7efc3811c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.562+0000 7efc37400640 1 -- 172.21.15.69:0/4105184019 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3811cd50 con 0x7efc3810a4a0 2024-05-14T15:33:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.562+0000 7efc37400640 1 --2- 172.21.15.69:0/4105184019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc3810a4a0 0x7efc3811bf30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efc2802a9a0 tx=0x7efc28003b90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.564+0000 7efc2fe00640 1 -- 172.21.15.69:0/4105184019 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2803f070 con 0x7efc3810a4a0 2024-05-14T15:33:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.564+0000 7efc2fe00640 1 -- 172.21.15.69:0/4105184019 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc2803baf0 con 0x7efc3810a4a0 2024-05-14T15:33:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.564+0000 7efc2fe00640 1 -- 172.21.15.69:0/4105184019 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc28035030 con 0x7efc3810a4a0 2024-05-14T15:33:35.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.564+0000 7efc3e800640 1 -- 172.21.15.69:0/4105184019 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc381b59f0 con 0x7efc3810a4a0 2024-05-14T15:33:35.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.564+0000 7efc3e800640 1 -- 172.21.15.69:0/4105184019 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc381b5f30 con 0x7efc3810a4a0 2024-05-14T15:33:35.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.573+0000 7efc45806740 1 Processor -- start 2024-05-14T15:33:35.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.573+0000 7efc45806740 1 -- start start 2024-05-14T15:33:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.573+0000 7efc45806740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 0x55a01d5ae280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.574+0000 7efc2fe00640 1 -- 172.21.15.69:0/4105184019 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7efc28042070 con 0x7efc3810a4a0 2024-05-14T15:33:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.574+0000 7efc45806740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1e42f0 0x55a01d5ae7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.574+0000 7efc45806740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1ec4d0 0x55a01d5aed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.574+0000 7efc45806740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55a01d513550 con 0x55a01d1e42f0 2024-05-14T15:33:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.574+0000 7efc45806740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a01d4b8bc0 con 0x55a01d1ec4d0 2024-05-14T15:33:35.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.574+0000 7efc45806740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a01d50f510 con 0x55a01d20d1b0 2024-05-14T15:33:35.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.574+0000 7efc37400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1e42f0 0x55a01d5ae7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.574+0000 7efc37e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 0x55a01d5ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.574+0000 7efc37e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 0x55a01d5ae280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35280/0 (socket says 172.21.15.69:35280) 2024-05-14T15:33:35.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.574+0000 7efc37e00640 1 -- 172.21.15.69:0/224491600 learned_addr learned my addr 172.21.15.69:0/224491600 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:35.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.575+0000 7efc37e00640 1 -- 172.21.15.69:0/224491600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1ec4d0 msgr2=0x55a01d5aed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:35.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.575+0000 7efc37e00640 1 --2- 172.21.15.69:0/224491600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1ec4d0 0x55a01d5aed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.575+0000 7efc37e00640 1 -- 172.21.15.69:0/224491600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1e42f0 msgr2=0x55a01d5ae7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.575+0000 7efc37e00640 1 --2- 172.21.15.69:0/224491600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1e42f0 0x55a01d5ae7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.575+0000 7efc37e00640 1 -- 172.21.15.69:0/224491600 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a01d225210 con 0x55a01d20d1b0 2024-05-14T15:33:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.576+0000 7efc37e00640 1 --2- 172.21.15.69:0/224491600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 0x55a01d5ae280 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efc30009f30 tx=0x7efc300118d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de8fff8905666d62 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:35.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.577+0000 7efc2fe00640 1 --2- 172.21.15.69:0/4105184019 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7efc1c0b29d0 0x7efc1c0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.577+0000 7efc37400640 1 --2- 172.21.15.69:0/4105184019 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7efc1c0b29d0 0x7efc1c0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.577+0000 7efc2cc00640 1 -- 172.21.15.69:0/224491600 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30004d20 con 0x55a01d20d1b0 2024-05-14T15:33:35.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.577+0000 7efc2fe00640 1 -- 172.21.15.69:0/4105184019 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9554+0+0 (secure 0 0 0) 0x7efc28103070 con 0x7efc3810a4a0 2024-05-14T15:33:35.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.577+0000 7efc2cc00640 1 -- 172.21.15.69:0/224491600 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc30004050 con 0x55a01d20d1b0 2024-05-14T15:33:35.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.577+0000 7efc2cc00640 1 -- 172.21.15.69:0/224491600 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30005260 con 0x55a01d20d1b0 2024-05-14T15:33:35.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.578+0000 7efc45806740 1 -- 172.21.15.69:0/224491600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 msgr2=0x55a01d5ae280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:35.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.578+0000 7efc37400640 1 --2- 172.21.15.69:0/4105184019 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7efc1c0b29d0 0x7efc1c0b4ee0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55a01d5abd70 tx=0x7efc28005de0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:35.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.578+0000 7efc45806740 1 --2- 172.21.15.69:0/224491600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 0x55a01d5ae280 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7efc30009f30 tx=0x7efc300118d0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.579+0000 7efc45806740 1 -- 172.21.15.69:0/224491600 shutdown_connections 2024-05-14T15:33:35.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.579+0000 7efc45806740 1 --2- 172.21.15.69:0/224491600 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1ec4d0 0x55a01d5aed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.579+0000 7efc45806740 1 --2- 172.21.15.69:0/224491600 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1e42f0 0x55a01d5ae7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.579+0000 7efc45806740 1 --2- 172.21.15.69:0/224491600 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 0x55a01d5ae280 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.579+0000 7efc45806740 1 -- 172.21.15.69:0/224491600 >> 172.21.15.69:0/224491600 conn(0x55a01d201300 msgr2=0x55a01d5aaa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.580+0000 7efc45806740 1 -- 172.21.15.69:0/224491600 shutdown_connections 2024-05-14T15:33:35.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.580+0000 7efc45806740 1 -- 172.21.15.69:0/224491600 wait complete. 2024-05-14T15:33:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.581+0000 7efc45806740 1 -- start start 2024-05-14T15:33:35.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.581+0000 7efc45806740 1 Processor -- start 2024-05-14T15:33:35.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.583+0000 7efc45806740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1e42f0 0x55a01d5b87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.583+0000 7efc45806740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1ec4d0 0x55a01d5b8cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.583+0000 7efc45806740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 0x55a01d5c4890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.584+0000 7efc45806740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55a01d5bb3b0 con 0x55a01d1ec4d0 2024-05-14T15:33:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.584+0000 7efc45806740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a01d4cc660 con 0x55a01d1e42f0 2024-05-14T15:33:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.584+0000 7efc45806740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a01d5bb530 con 0x55a01d20d1b0 2024-05-14T15:33:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.584+0000 7efc45806740 10 client.0 _ll_register_callbacks cb 0x55a01d496400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:33:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.584+0000 7efc37e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1e42f0 0x55a01d5b87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.584+0000 7efc37e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1e42f0 0x55a01d5b87b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:44492/0 (socket says 172.21.15.69:44492) 2024-05-14T15:33:35.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.584+0000 7efc37e00640 1 -- 172.21.15.69:0/2131319975 learned_addr learned my addr 172.21.15.69:0/2131319975 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.585+0000 7efc36a00640 1 --2- 172.21.15.69:0/2131319975 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1ec4d0 0x55a01d5b8cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.585+0000 7efc37e00640 1 --2- 172.21.15.69:0/2131319975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 0x55a01d5c4890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.587+0000 7efc36a00640 1 -- 172.21.15.69:0/2131319975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 msgr2=0x55a01d5c4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.587+0000 7efc36a00640 1 --2- 172.21.15.69:0/2131319975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 0x55a01d5c4890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.587+0000 7efc36a00640 1 -- 172.21.15.69:0/2131319975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1e42f0 msgr2=0x55a01d5b87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.587+0000 7efc36a00640 1 --2- 172.21.15.69:0/2131319975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1e42f0 0x55a01d5b87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.587+0000 7efc36a00640 1 -- 172.21.15.69:0/2131319975 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a01d2f1620 con 0x55a01d1ec4d0 2024-05-14T15:33:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.588+0000 7efc37e00640 1 --2- 172.21.15.69:0/2131319975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 0x55a01d5c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:33:35.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.589+0000 7efc36a00640 1 --2- 172.21.15.69:0/2131319975 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1ec4d0 0x55a01d5b8cf0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7efc3811d6f0 tx=0x7efc240118c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b18f8cddc8a1577 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:35.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.589+0000 7efc21600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:33:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.590+0000 7efc21600640 1 -- 172.21.15.69:0/2131319975 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc24005220 con 0x55a01d1ec4d0 2024-05-14T15:33:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.590+0000 7efc21600640 1 -- 172.21.15.69:0/2131319975 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9554+0+0 (secure 0 0 0) 0x7efc240053c0 con 0x55a01d1ec4d0 2024-05-14T15:33:35.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.590+0000 7efc45806740 1 -- 172.21.15.69:0/2131319975 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc30004050 con 0x55a01d1ec4d0 2024-05-14T15:33:35.596 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.593+0000 7efc21600640 1 -- 172.21.15.69:0/2131319975 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7efc240055e0 con 0x55a01d1ec4d0 2024-05-14T15:33:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.595+0000 7efc45806740 10 client.17064 fetch_fsmap learned FSMap version 62 2024-05-14T15:33:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.596+0000 7efc45806740 1 -- 172.21.15.69:0/2131319975 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55a01d5c76e0 con 0x55a01d1ec4d0 2024-05-14T15:33:35.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.597+0000 7efc21600640 1 -- 172.21.15.69:0/2131319975 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc30004050 con 0x55a01d1ec4d0 2024-05-14T15:33:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.598+0000 7efc21600640 1 -- 172.21.15.69:0/2131319975 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7efc24012bd0 con 0x55a01d1ec4d0 2024-05-14T15:33:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.598+0000 7efc45806740 10 client.17064 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:33:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.598+0000 7efc45806740 10 client.17064 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:33:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.598+0000 7efc45806740 20 client.17064 populate_metadata read hostname 'smithi069' 2024-05-14T15:33:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.598+0000 7efc45806740 1 --2- 172.21.15.69:0/2131319975 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a01d1cbd80 0x55a01d5cac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.598+0000 7efc45806740 4 client.17064 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:33:35.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.598+0000 7efc45806740 1 -- 172.21.15.69:0/2131319975 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a01d521160 con 0x55a01d1cbd80 2024-05-14T15:33:35.602 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.599+0000 7efc37e00640 1 --2- 172.21.15.69:0/2131319975 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a01d1cbd80 0x55a01d5cac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.600+0000 7efc37e00640 1 --2- 172.21.15.69:0/2131319975 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a01d1cbd80 0x55a01d5cac20 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=762dfdfcb245a39a server_cookie=eab0d6fa5523d522 in_seq=0 out_seq=0 2024-05-14T15:33:35.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.601+0000 7efc21600640 10 client.17064 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:33:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.603+0000 7efc21600640 1 -- 172.21.15.69:0/2131319975 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a01d521160 con 0x55a01d1cbd80 2024-05-14T15:33:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.604+0000 7efc21600640 10 client.17064 handle_command_reply: tid=0 2024-05-14T15:33:35.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.604+0000 7efc45806740 1 client.17064 shutdown 2024-05-14T15:33:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.608+0000 7efc45806740 1 -- 172.21.15.69:0/2131319975 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1ec4d0 msgr2=0x55a01d5b8cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:35.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.608+0000 7efc45806740 1 --2- 172.21.15.69:0/2131319975 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1ec4d0 0x55a01d5b8cf0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7efc3811d6f0 tx=0x7efc240118c0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.608+0000 7efc45806740 1 -- 172.21.15.69:0/2131319975 shutdown_connections 2024-05-14T15:33:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.608+0000 7efc45806740 1 --2- 172.21.15.69:0/2131319975 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 0x55a01d5c4890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.608+0000 7efc45806740 1 --2- 172.21.15.69:0/2131319975 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a01d1cbd80 0x55a01d5cac20 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.608+0000 7efc45806740 1 --2- 172.21.15.69:0/2131319975 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1ec4d0 0x55a01d5b8cf0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.608+0000 7efc45806740 1 --2- 172.21.15.69:0/2131319975 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1e42f0 0x55a01d5b87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.608+0000 7efc45806740 1 -- 172.21.15.69:0/2131319975 >> 172.21.15.69:0/2131319975 conn(0x55a01d201300 msgr2=0x55a01d5ae0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:35.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.608+0000 7efc21600640 0 client.17064 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:33:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.608+0000 7efc45806740 1 -- 172.21.15.69:0/2131319975 shutdown_connections 2024-05-14T15:33:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.609+0000 7efc45806740 1 -- 172.21.15.69:0/2131319975 wait complete. 2024-05-14T15:33:35.612 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.609+0000 7efc45806740 20 client.17064 trim_cache size 0 max 16384 2024-05-14T15:33:35.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.673+0000 7efc45806740 1 Processor -- start 2024-05-14T15:33:35.676 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.673+0000 7efc45806740 1 -- start start 2024-05-14T15:33:35.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.677+0000 7efc45806740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1e42f0 0x55a01d5aa960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.677+0000 7efc45806740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 0x55a01d5d03e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.677+0000 7efc45806740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1a11c0 0x55a01d5d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.677+0000 7efc45806740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7efc18010080 con 0x55a01d1e42f0 2024-05-14T15:33:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.677+0000 7efc45806740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc18011bc0 con 0x55a01d1a11c0 2024-05-14T15:33:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.677+0000 7efc45806740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efc18010750 con 0x55a01d20d1b0 2024-05-14T15:33:35.680 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.678+0000 7efc37e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1e42f0 0x55a01d5aa960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.678+0000 7efc37e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1e42f0 0x55a01d5aa960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54722/0 (socket says 172.21.15.69:54722) 2024-05-14T15:33:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.678+0000 7efc37e00640 1 -- 172.21.15.69:0/1835093383 learned_addr learned my addr 172.21.15.69:0/1835093383 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:35.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.679+0000 7efc36a00640 1 --2- 172.21.15.69:0/1835093383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 0x55a01d5d03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.679+0000 7efc37e00640 1 --2- 172.21.15.69:0/1835093383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1a11c0 0x55a01d5d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.680+0000 7efc36a00640 1 -- 172.21.15.69:0/1835093383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1a11c0 msgr2=0x55a01d5d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:35.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.680+0000 7efc36a00640 1 --2- 172.21.15.69:0/1835093383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1a11c0 0x55a01d5d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.681+0000 7efc36a00640 1 -- 172.21.15.69:0/1835093383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1e42f0 msgr2=0x55a01d5aa960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:35.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.681+0000 7efc36a00640 1 --2- 172.21.15.69:0/1835093383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1e42f0 0x55a01d5aa960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.681+0000 7efc36a00640 1 -- 172.21.15.69:0/1835093383 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a01d1cbfb0 con 0x55a01d20d1b0 2024-05-14T15:33:35.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.681+0000 7efc37e00640 1 --2- 172.21.15.69:0/1835093383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1e42f0 0x55a01d5aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:33:35.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.682+0000 7efc36a00640 1 --2- 172.21.15.69:0/1835093383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 0x55a01d5d03e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efc2400e000 tx=0x7efc24009b10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6cfaad13c73afd5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:35.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.683+0000 7efc23e00640 1 -- 172.21.15.69:0/1835093383 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc240248e0 con 0x55a01d20d1b0 2024-05-14T15:33:35.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.684+0000 7efc23e00640 1 -- 172.21.15.69:0/1835093383 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc24012bb0 con 0x55a01d20d1b0 2024-05-14T15:33:35.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.684+0000 7efc23e00640 1 -- 172.21.15.69:0/1835093383 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc2401ab60 con 0x55a01d20d1b0 2024-05-14T15:33:35.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.685+0000 7efc45806740 1 -- 172.21.15.69:0/1835093383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 msgr2=0x55a01d5d03e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:35.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.685+0000 7efc45806740 1 --2- 172.21.15.69:0/1835093383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 0x55a01d5d03e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efc2400e000 tx=0x7efc24009b10 comp rx=0 tx=0).stop 2024-05-14T15:33:35.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.685+0000 7efc45806740 1 -- 172.21.15.69:0/1835093383 shutdown_connections 2024-05-14T15:33:35.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.685+0000 7efc45806740 1 --2- 172.21.15.69:0/1835093383 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1a11c0 0x55a01d5d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.685+0000 7efc45806740 1 --2- 172.21.15.69:0/1835093383 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d20d1b0 0x55a01d5d03e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.685+0000 7efc45806740 1 --2- 172.21.15.69:0/1835093383 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d1e42f0 0x55a01d5aa960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.685+0000 7efc45806740 1 -- 172.21.15.69:0/1835093383 >> 172.21.15.69:0/1835093383 conn(0x55a01d201300 msgr2=0x55a01d5aa250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:35.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.687+0000 7efc45806740 1 -- 172.21.15.69:0/1835093383 shutdown_connections 2024-05-14T15:33:35.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.687+0000 7efc45806740 1 -- 172.21.15.69:0/1835093383 wait complete. 2024-05-14T15:33:35.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.687+0000 7efc45806740 1 -- start start 2024-05-14T15:33:35.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.688+0000 7efc45806740 1 Processor -- start 2024-05-14T15:33:35.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.688+0000 7efc45806740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d1a11c0 0x55a01d5bba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.691 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.688+0000 7efc45806740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1e42f0 0x55a01d5bbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.689+0000 7efc45806740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d20d1b0 0x55a01d630f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.689+0000 7efc45806740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7efc180114f0 con 0x55a01d20d1b0 2024-05-14T15:33:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.689+0000 7efc45806740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efc18010e20 con 0x55a01d1e42f0 2024-05-14T15:33:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.689+0000 7efc45806740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efc1800e080 con 0x55a01d1a11c0 2024-05-14T15:33:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.689+0000 7efc45806740 10 client.0 _ll_register_callbacks cb 0x7efc24009450 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:33:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.689+0000 7efc36a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1e42f0 0x55a01d5bbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.689+0000 7efc36a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1e42f0 0x55a01d5bbfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:44512/0 (socket says 172.21.15.69:44512) 2024-05-14T15:33:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.689+0000 7efc36a00640 1 -- 172.21.15.69:0/732751498 learned_addr learned my addr 172.21.15.69:0/732751498 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.690+0000 7efc37e00640 1 --2- 172.21.15.69:0/732751498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d20d1b0 0x55a01d630f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.690+0000 7efc37e00640 1 --2- 172.21.15.69:0/732751498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d1a11c0 0x55a01d5bba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.691+0000 7efc37e00640 1 -- 172.21.15.69:0/732751498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1e42f0 msgr2=0x55a01d5bbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:35.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.691+0000 7efc37e00640 1 --2- 172.21.15.69:0/732751498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1e42f0 0x55a01d5bbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.691+0000 7efc37e00640 1 -- 172.21.15.69:0/732751498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d20d1b0 msgr2=0x55a01d630f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:35.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.691+0000 7efc37e00640 1 --2- 172.21.15.69:0/732751498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d20d1b0 0x55a01d630f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.691+0000 7efc37e00640 1 -- 172.21.15.69:0/732751498 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a01d6314c0 con 0x55a01d1a11c0 2024-05-14T15:33:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.692+0000 7efc37e00640 1 --2- 172.21.15.69:0/732751498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d1a11c0 0x55a01d5bba80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efc30011dd0 tx=0x7efc30009fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f00ca82b5dbaa771 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.692+0000 7efc21600640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:33:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.693+0000 7efc21600640 1 -- 172.21.15.69:0/732751498 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30003de0 con 0x55a01d1a11c0 2024-05-14T15:33:35.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.693+0000 7efc45806740 1 -- 172.21.15.69:0/732751498 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc24012bb0 con 0x55a01d1a11c0 2024-05-14T15:33:35.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.693+0000 7efc21600640 1 -- 172.21.15.69:0/732751498 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9554+0+0 (secure 0 0 0) 0x7efc3002d120 con 0x55a01d1a11c0 2024-05-14T15:33:35.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.694+0000 7efc21600640 1 -- 172.21.15.69:0/732751498 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7efc3002d320 con 0x55a01d1a11c0 2024-05-14T15:33:35.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.694+0000 7efc45806740 10 client.26566 fetch_fsmap learned FSMap version 62 2024-05-14T15:33:35.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.694+0000 7efc45806740 1 -- 172.21.15.69:0/732751498 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55a01d6326b0 con 0x55a01d1a11c0 2024-05-14T15:33:35.700 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.695+0000 7efc21600640 1 -- 172.21.15.69:0/732751498 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efc24012bb0 con 0x55a01d1a11c0 2024-05-14T15:33:35.700 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.695+0000 7efc21600640 1 -- 172.21.15.69:0/732751498 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7efc30027710 con 0x55a01d1a11c0 2024-05-14T15:33:35.700 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.698+0000 7efc45806740 10 client.26566 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:33:35.701 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.698+0000 7efc45806740 10 client.26566 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:33:35.701 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.698+0000 7efc45806740 20 client.26566 populate_metadata read hostname 'smithi069' 2024-05-14T15:33:35.701 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.698+0000 7efc45806740 1 --2- 172.21.15.69:0/732751498 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a01d632b90 0x55a01d634fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:35.701 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.698+0000 7efc45806740 4 client.26566 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:33:35.701 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.698+0000 7efc45806740 1 -- 172.21.15.69:0/732751498 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a01d51afd0 con 0x55a01d632b90 2024-05-14T15:33:35.701 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.699+0000 7efc36a00640 1 --2- 172.21.15.69:0/732751498 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a01d632b90 0x55a01d634fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:35.704 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.701+0000 7efc36a00640 1 --2- 172.21.15.69:0/732751498 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a01d632b90 0x55a01d634fb0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ce63e6fec821e24 server_cookie=7253cf8fef726d24 in_seq=0 out_seq=0 2024-05-14T15:33:35.704 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.701+0000 7efc21600640 10 client.26566 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:33:35.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.733+0000 7efc21600640 1 -- 172.21.15.69:0/732751498 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a01d51afd0 con 0x55a01d632b90 2024-05-14T15:33:35.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.733+0000 7efc21600640 10 client.26566 handle_command_reply: tid=0 2024-05-14T15:33:35.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.733+0000 7efc45806740 1 client.26566 shutdown 2024-05-14T15:33:35.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.734+0000 7efc45806740 1 -- 172.21.15.69:0/732751498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d1a11c0 msgr2=0x55a01d5bba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:35.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.734+0000 7efc45806740 1 --2- 172.21.15.69:0/732751498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d1a11c0 0x55a01d5bba80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7efc30011dd0 tx=0x7efc30009fa0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.734+0000 7efc45806740 1 -- 172.21.15.69:0/732751498 shutdown_connections 2024-05-14T15:33:35.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.734+0000 7efc45806740 1 --2- 172.21.15.69:0/732751498 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a01d632b90 0x55a01d634fb0 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.734+0000 7efc45806740 1 --2- 172.21.15.69:0/732751498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a01d20d1b0 0x55a01d630f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.734+0000 7efc45806740 1 --2- 172.21.15.69:0/732751498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a01d1e42f0 0x55a01d5bbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.734+0000 7efc45806740 1 --2- 172.21.15.69:0/732751498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a01d1a11c0 0x55a01d5bba80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.734+0000 7efc45806740 1 -- 172.21.15.69:0/732751498 >> 172.21.15.69:0/732751498 conn(0x55a01d201300 msgr2=0x55a01d5ae010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:35.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.734+0000 7efc21600640 0 client.26566 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:33:35.737 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.735+0000 7efc45806740 1 -- 172.21.15.69:0/732751498 shutdown_connections 2024-05-14T15:33:35.738 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.735+0000 7efc45806740 1 -- 172.21.15.69:0/732751498 wait complete. 2024-05-14T15:33:35.738 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.735+0000 7efc45806740 20 client.26566 trim_cache size 0 max 16384 2024-05-14T15:33:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:33:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:33:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:33:35.739 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:33:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.739+0000 7efc3e800640 1 -- 172.21.15.69:0/4105184019 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7efc1c0b29d0 msgr2=0x7efc1c0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.739+0000 7efc3e800640 1 --2- 172.21.15.69:0/4105184019 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7efc1c0b29d0 0x7efc1c0b4ee0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x55a01d5abd70 tx=0x7efc28005de0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.739+0000 7efc3e800640 1 -- 172.21.15.69:0/4105184019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc3810a4a0 msgr2=0x7efc3811bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.739+0000 7efc3e800640 1 --2- 172.21.15.69:0/4105184019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc3810a4a0 0x7efc3811bf30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efc2802a9a0 tx=0x7efc28003b90 comp rx=0 tx=0).stop 2024-05-14T15:33:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.739+0000 7efc3e800640 1 -- 172.21.15.69:0/4105184019 shutdown_connections 2024-05-14T15:33:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.739+0000 7efc3e800640 1 --2- 172.21.15.69:0/4105184019 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7efc1c0b29d0 0x7efc1c0b4ee0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.739+0000 7efc3e800640 1 --2- 172.21.15.69:0/4105184019 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efc38112910 0x7efc381b53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.739+0000 7efc3e800640 1 --2- 172.21.15.69:0/4105184019 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efc38111df0 0x7efc3811c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.739+0000 7efc3e800640 1 --2- 172.21.15.69:0/4105184019 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efc3810a4a0 0x7efc3811bf30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:35.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.739+0000 7efc3e800640 1 -- 172.21.15.69:0/4105184019 >> 172.21.15.69:0/4105184019 conn(0x7efc3806e900 msgr2=0x7efc38071bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:35.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.740+0000 7efc3e800640 1 -- 172.21.15.69:0/4105184019 shutdown_connections 2024-05-14T15:33:35.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:35.740+0000 7efc3e800640 1 -- 172.21.15.69:0/4105184019 wait complete. 2024-05-14T15:33:36.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 470.0 s, 617.2 tps, lat 162.073 ms stddev 70.321 2024-05-14T15:33:37.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:37 smithi203 ceph-mon[34567]: pgmap v374: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 9.9 MiB/s wr, 692 op/s 2024-05-14T15:33:37.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:37 smithi092 ceph-mon[34729]: pgmap v374: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 9.9 MiB/s wr, 692 op/s 2024-05-14T15:33:37.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:37 smithi069 ceph-mon[31270]: pgmap v374: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 9.9 MiB/s wr, 692 op/s 2024-05-14T15:33:39.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:39 smithi203 ceph-mon[34567]: pgmap v375: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.2 MiB/s wr, 513 op/s 2024-05-14T15:33:39.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:39 smithi092 ceph-mon[34729]: pgmap v375: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.2 MiB/s wr, 513 op/s 2024-05-14T15:33:39.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:39 smithi069 ceph-mon[31270]: pgmap v375: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 7.2 MiB/s wr, 513 op/s 2024-05-14T15:33:41.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 475.0 s, 667.8 tps, lat 149.722 ms stddev 53.676 2024-05-14T15:33:41.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:41 smithi203 ceph-mon[34567]: pgmap v376: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 11 MiB/s wr, 776 op/s 2024-05-14T15:33:41.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:41 smithi092 ceph-mon[34729]: pgmap v376: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 11 MiB/s wr, 776 op/s 2024-05-14T15:33:41.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:41 smithi069 ceph-mon[31270]: pgmap v376: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 11 MiB/s wr, 776 op/s 2024-05-14T15:33:43.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:43 smithi203 ceph-mon[34567]: pgmap v377: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 7.1 MiB/s wr, 500 op/s 2024-05-14T15:33:43.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:43 smithi092 ceph-mon[34729]: pgmap v377: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 7.1 MiB/s wr, 500 op/s 2024-05-14T15:33:43.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:43 smithi069 ceph-mon[31270]: pgmap v377: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 7.1 MiB/s wr, 500 op/s 2024-05-14T15:33:45.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:45 smithi203 ceph-mon[34567]: pgmap v378: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 8.1 MiB/s wr, 582 op/s 2024-05-14T15:33:45.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:45 smithi092 ceph-mon[34729]: pgmap v378: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 8.1 MiB/s wr, 582 op/s 2024-05-14T15:33:45.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:45 smithi069 ceph-mon[31270]: pgmap v378: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 8.1 MiB/s wr, 582 op/s 2024-05-14T15:33:46.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 480.0 s, 633.4 tps, lat 158.467 ms stddev 49.583 2024-05-14T15:33:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:47 smithi203 ceph-mon[34567]: pgmap v379: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 10 MiB/s wr, 721 op/s 2024-05-14T15:33:47.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:47 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:33:47.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:47 smithi092 ceph-mon[34729]: pgmap v379: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 10 MiB/s wr, 721 op/s 2024-05-14T15:33:47.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:47 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:33:47.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:47 smithi069 ceph-mon[31270]: pgmap v379: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 10 MiB/s wr, 721 op/s 2024-05-14T15:33:47.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:47 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:33:49.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:49 smithi203 ceph-mon[34567]: pgmap v380: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.7 MiB/s wr, 509 op/s 2024-05-14T15:33:49.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:49 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:33:49.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:49 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:33:49.597 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:49 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:33:49.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:49 smithi092 ceph-mon[34729]: pgmap v380: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.7 MiB/s wr, 509 op/s 2024-05-14T15:33:49.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:49 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:33:49.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:49 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:33:49.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:49 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:33:49.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:49 smithi069 ceph-mon[31270]: pgmap v380: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.7 MiB/s wr, 509 op/s 2024-05-14T15:33:49.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:49 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:33:49.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:49 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:33:49.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:49 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:33:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.923+0000 7fbdca400640 1 -- 172.21.15.69:0/737880957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc4109ac0 msgr2=0x7fbdc41036b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.923+0000 7fbdca400640 1 --2- 172.21.15.69:0/737880957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc4109ac0 0x7fbdc41036b0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009900 tx=0x7fbdb802a410 comp rx=0 tx=0).stop 2024-05-14T15:33:49.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.923+0000 7fbdca400640 1 -- 172.21.15.69:0/737880957 shutdown_connections 2024-05-14T15:33:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.923+0000 7fbdca400640 1 --2- 172.21.15.69:0/737880957 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdc4104260 0x7fbdc41105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.923+0000 7fbdca400640 1 --2- 172.21.15.69:0/737880957 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdc4109f60 0x7fbdc4103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.923+0000 7fbdca400640 1 --2- 172.21.15.69:0/737880957 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc4109ac0 0x7fbdc41036b0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.923+0000 7fbdca400640 1 -- 172.21.15.69:0/737880957 >> 172.21.15.69:0/737880957 conn(0x7fbdc4079250 msgr2=0x7fbdc4079690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.924+0000 7fbdca400640 1 -- 172.21.15.69:0/737880957 shutdown_connections 2024-05-14T15:33:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.924+0000 7fbdca400640 1 -- 172.21.15.69:0/737880957 wait complete. 2024-05-14T15:33:49.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.925+0000 7fbdca400640 1 Processor -- start 2024-05-14T15:33:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.925+0000 7fbdca400640 1 -- start start 2024-05-14T15:33:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.925+0000 7fbdca400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc4104260 0x7fbdc419d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.926+0000 7fbdca400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdc4109ac0 0x7fbdc419db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.926+0000 7fbdca400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdc4109f60 0x7fbdc41a84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.926+0000 7fbdca400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc4113bb0 con 0x7fbdc4104260 2024-05-14T15:33:49.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.926+0000 7fbdca400640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc4113a30 con 0x7fbdc4109ac0 2024-05-14T15:33:49.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.926+0000 7fbdca400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbdc4113d30 con 0x7fbdc4109f60 2024-05-14T15:33:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.926+0000 7fbdc3e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdc4109ac0 0x7fbdc419db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.926+0000 7fbdc3e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdc4109ac0 0x7fbdc419db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:39468/0 (socket says 172.21.15.69:39468) 2024-05-14T15:33:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.926+0000 7fbdc3e00640 1 -- 172.21.15.69:0/4126356814 learned_addr learned my addr 172.21.15.69:0/4126356814 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.926+0000 7fbdc9000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc4104260 0x7fbdc419d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.926+0000 7fbdc9a00640 1 --2- 172.21.15.69:0/4126356814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdc4109f60 0x7fbdc41a84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.927+0000 7fbdc3e00640 1 -- 172.21.15.69:0/4126356814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdc4109f60 msgr2=0x7fbdc41a84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.927+0000 7fbdc3e00640 1 --2- 172.21.15.69:0/4126356814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdc4109f60 0x7fbdc41a84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.927+0000 7fbdc3e00640 1 -- 172.21.15.69:0/4126356814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc4104260 msgr2=0x7fbdc419d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.927+0000 7fbdc3e00640 1 --2- 172.21.15.69:0/4126356814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc4104260 0x7fbdc419d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.927+0000 7fbdc3e00640 1 -- 172.21.15.69:0/4126356814 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdc41a8a30 con 0x7fbdc4109ac0 2024-05-14T15:33:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.927+0000 7fbdc9a00640 1 --2- 172.21.15.69:0/4126356814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdc4109f60 0x7fbdc41a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:33:49.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.927+0000 7fbdc9000640 1 --2- 172.21.15.69:0/4126356814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc4104260 0x7fbdc419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:33:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.927+0000 7fbdc3e00640 1 --2- 172.21.15.69:0/4126356814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdc4109ac0 0x7fbdc419db90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000e9f0 tx=0x7fbdb000eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.928+0000 7fbdc1600640 1 -- 172.21.15.69:0/4126356814 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb000ccc0 con 0x7fbdc4109ac0 2024-05-14T15:33:49.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.928+0000 7fbdc1600640 1 -- 172.21.15.69:0/4126356814 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbdb00044b0 con 0x7fbdc4109ac0 2024-05-14T15:33:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.928+0000 7fbdca400640 1 -- 172.21.15.69:0/4126356814 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdc41a8d20 con 0x7fbdc4109ac0 2024-05-14T15:33:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.928+0000 7fbdca400640 1 -- 172.21.15.69:0/4126356814 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdc41a91c0 con 0x7fbdc4109ac0 2024-05-14T15:33:49.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.928+0000 7fbdc1600640 1 -- 172.21.15.69:0/4126356814 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb0010430 con 0x7fbdc4109ac0 2024-05-14T15:33:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.932+0000 7fbdd29df740 1 Processor -- start 2024-05-14T15:33:49.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.932+0000 7fbdd29df740 1 -- start start 2024-05-14T15:33:49.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.932+0000 7fbdd29df740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b09331b0 0x55c3b0cd4480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.933+0000 7fbdd29df740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b090a2f0 0x55c3b0cd49c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.933+0000 7fbdd29df740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09124d0 0x55c3b0cd4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.933+0000 7fbdd29df740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55c3b0c39550 con 0x55c3b09124d0 2024-05-14T15:33:49.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.933+0000 7fbdd29df740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c3b0bdebc0 con 0x55c3b09331b0 2024-05-14T15:33:49.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.933+0000 7fbdd29df740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c3b0c35510 con 0x55c3b090a2f0 2024-05-14T15:33:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.933+0000 7fbdc9a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b09331b0 0x55c3b0cd4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.933+0000 7fbdc9000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b090a2f0 0x55c3b0cd49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.933+0000 7fbdc9000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b090a2f0 0x55c3b0cd49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35190/0 (socket says 172.21.15.69:35190) 2024-05-14T15:33:49.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.933+0000 7fbdc9000640 1 -- 172.21.15.69:0/1243763089 learned_addr learned my addr 172.21.15.69:0/1243763089 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:49.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.934+0000 7fbdc1600640 1 -- 172.21.15.69:0/4126356814 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fbdb00035f0 con 0x7fbdc4109ac0 2024-05-14T15:33:49.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.934+0000 7fbdc9000640 1 -- 172.21.15.69:0/1243763089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b09331b0 msgr2=0x55c3b0cd4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:49.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.934+0000 7fbdc9000640 1 --2- 172.21.15.69:0/1243763089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b09331b0 0x55c3b0cd4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.934+0000 7fbdc9000640 1 -- 172.21.15.69:0/1243763089 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09124d0 msgr2=0x55c3b0cd4f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:33:49.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.934+0000 7fbdc3e00640 1 --2- 172.21.15.69:0/1243763089 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09124d0 0x55c3b0cd4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.934+0000 7fbdc9000640 1 --2- 172.21.15.69:0/1243763089 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09124d0 0x55c3b0cd4f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.934+0000 7fbdc9000640 1 -- 172.21.15.69:0/1243763089 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b094b210 con 0x55c3b090a2f0 2024-05-14T15:33:49.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.934+0000 7fbdc3e00640 1 --2- 172.21.15.69:0/1243763089 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09124d0 0x55c3b0cd4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:33:49.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.935+0000 7fbdc9000640 1 --2- 172.21.15.69:0/1243763089 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b090a2f0 0x55c3b0cd49c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009900 tx=0x7fbdb8005fd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4d04fef751ebafa5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:49.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.935+0000 7fbdb6000640 1 -- 172.21.15.69:0/1243763089 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8040070 con 0x55c3b090a2f0 2024-05-14T15:33:49.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.935+0000 7fbdb6000640 1 -- 172.21.15.69:0/1243763089 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbdb8003d00 con 0x55c3b090a2f0 2024-05-14T15:33:49.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.935+0000 7fbdb6000640 1 -- 172.21.15.69:0/1243763089 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb8035040 con 0x55c3b090a2f0 2024-05-14T15:33:49.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.936+0000 7fbdc1600640 1 --2- 172.21.15.69:0/4126356814 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbdac0b29d0 0x7fbdac0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.936+0000 7fbdc1600640 1 -- 172.21.15.69:0/4126356814 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 9554+0+0 (secure 0 0 0) 0x7fbdb00e2bc0 con 0x7fbdc4109ac0 2024-05-14T15:33:49.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.936+0000 7fbdc9a00640 1 --2- 172.21.15.69:0/4126356814 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbdac0b29d0 0x7fbdac0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.936+0000 7fbdd29df740 1 -- 172.21.15.69:0/1243763089 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b090a2f0 msgr2=0x55c3b0cd49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.936+0000 7fbdd29df740 1 --2- 172.21.15.69:0/1243763089 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b090a2f0 0x55c3b0cd49c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbdb8009900 tx=0x7fbdb8005fd0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.937+0000 7fbdd29df740 1 -- 172.21.15.69:0/1243763089 shutdown_connections 2024-05-14T15:33:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.937+0000 7fbdd29df740 1 --2- 172.21.15.69:0/1243763089 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09124d0 0x55c3b0cd4f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.937+0000 7fbdd29df740 1 --2- 172.21.15.69:0/1243763089 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b090a2f0 0x55c3b0cd49c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.937+0000 7fbdd29df740 1 --2- 172.21.15.69:0/1243763089 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b09331b0 0x55c3b0cd4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.937+0000 7fbdd29df740 1 -- 172.21.15.69:0/1243763089 >> 172.21.15.69:0/1243763089 conn(0x55c3b0927300 msgr2=0x55c3b0cd0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.937+0000 7fbdd29df740 1 -- 172.21.15.69:0/1243763089 shutdown_connections 2024-05-14T15:33:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.937+0000 7fbdd29df740 1 -- 172.21.15.69:0/1243763089 wait complete. 2024-05-14T15:33:49.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.937+0000 7fbdc9a00640 1 --2- 172.21.15.69:0/4126356814 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbdac0b29d0 0x7fbdac0b4ee0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55c3b0cd15f0 tx=0x7fbdbc0096a0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.937+0000 7fbdd29df740 1 -- start start 2024-05-14T15:33:49.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.938+0000 7fbdd29df740 1 Processor -- start 2024-05-14T15:33:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.938+0000 7fbdd29df740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 0x55c3b0cde910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.938+0000 7fbdd29df740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09124d0 0x55c3b0cdee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.938+0000 7fbdd29df740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09331b0 0x55c3b0cf32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.938+0000 7fbdd29df740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55c3b0ce9d60 con 0x55c3b09124d0 2024-05-14T15:33:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.938+0000 7fbdd29df740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c3b0bf2660 con 0x55c3b090a2f0 2024-05-14T15:33:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.938+0000 7fbdd29df740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c3b0ce9ee0 con 0x55c3b09331b0 2024-05-14T15:33:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.938+0000 7fbdd29df740 10 client.0 _ll_register_callbacks cb 0x55c3b0bbc400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:33:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.939+0000 7fbdc9a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09331b0 0x55c3b0cf32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.939+0000 7fbdc9a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09331b0 0x55c3b0cf32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35192/0 (socket says 172.21.15.69:35192) 2024-05-14T15:33:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.939+0000 7fbdc9a00640 1 -- 172.21.15.69:0/90369487 learned_addr learned my addr 172.21.15.69:0/90369487 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.939+0000 7fbdc3e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09124d0 0x55c3b0cdee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.939+0000 7fbdc9000640 1 --2- 172.21.15.69:0/90369487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 0x55c3b0cde910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.939+0000 7fbdc9a00640 1 -- 172.21.15.69:0/90369487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 msgr2=0x55c3b0cde910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:49.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.939+0000 7fbdc9a00640 1 --2- 172.21.15.69:0/90369487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 0x55c3b0cde910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.939+0000 7fbdc9a00640 1 -- 172.21.15.69:0/90369487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09124d0 msgr2=0x55c3b0cdee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.939+0000 7fbdc9a00640 1 --2- 172.21.15.69:0/90369487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09124d0 0x55c3b0cdee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.939+0000 7fbdc9a00640 1 -- 172.21.15.69:0/90369487 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b0a17620 con 0x55c3b09331b0 2024-05-14T15:33:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.940+0000 7fbdc9a00640 1 --2- 172.21.15.69:0/90369487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09331b0 0x55c3b0cf32a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc010c40 tx=0x7fbdbc004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4515cc911ffca260 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.940+0000 7fbdaaa00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:33:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.940+0000 7fbdaaa00640 1 -- 172.21.15.69:0/90369487 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc01fd80 con 0x55c3b09331b0 2024-05-14T15:33:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.940+0000 7fbdd29df740 1 -- 172.21.15.69:0/90369487 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdb8003d00 con 0x55c3b09331b0 2024-05-14T15:33:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.940+0000 7fbdaaa00640 1 -- 172.21.15.69:0/90369487 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9554+0+0 (secure 0 0 0) 0x7fbdbc017030 con 0x55c3b09331b0 2024-05-14T15:33:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.940+0000 7fbdaaa00640 1 -- 172.21.15.69:0/90369487 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fbdbc032050 con 0x55c3b09331b0 2024-05-14T15:33:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.940+0000 7fbdd29df740 10 client.26578 fetch_fsmap learned FSMap version 62 2024-05-14T15:33:49.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.940+0000 7fbdd29df740 1 -- 172.21.15.69:0/90369487 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55c3b0cf5ff0 con 0x55c3b09331b0 2024-05-14T15:33:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.941+0000 7fbdaaa00640 1 -- 172.21.15.69:0/90369487 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbdb8003d00 con 0x55c3b09331b0 2024-05-14T15:33:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.941+0000 7fbdaaa00640 1 -- 172.21.15.69:0/90369487 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7fbdbc027bc0 con 0x55c3b09331b0 2024-05-14T15:33:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.941+0000 7fbdd29df740 10 client.26578 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:33:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.941+0000 7fbdd29df740 10 client.26578 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:33:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.941+0000 7fbdd29df740 20 client.26578 populate_metadata read hostname 'smithi069' 2024-05-14T15:33:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.941+0000 7fbdd29df740 1 --2- 172.21.15.69:0/90369487 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c3b08f1d80 0x55c3b0cf9600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.941+0000 7fbdd29df740 4 client.26578 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:33:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.941+0000 7fbdd29df740 1 -- 172.21.15.69:0/90369487 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c3b0c47160 con 0x55c3b08f1d80 2024-05-14T15:33:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.942+0000 7fbdc9000640 1 --2- 172.21.15.69:0/90369487 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c3b08f1d80 0x55c3b0cf9600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.943+0000 7fbdc9000640 1 --2- 172.21.15.69:0/90369487 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c3b08f1d80 0x55c3b0cf9600 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f31887d7529e5649 server_cookie=609dcb0f2c870aaf in_seq=0 out_seq=0 2024-05-14T15:33:49.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.943+0000 7fbdaaa00640 10 client.26578 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:33:49.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.944+0000 7fbdaaa00640 1 -- 172.21.15.69:0/90369487 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c3b0c47160 con 0x55c3b08f1d80 2024-05-14T15:33:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.944+0000 7fbdaaa00640 10 client.26578 handle_command_reply: tid=0 2024-05-14T15:33:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.945+0000 7fbdd29df740 1 client.26578 shutdown 2024-05-14T15:33:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.945+0000 7fbdd29df740 1 -- 172.21.15.69:0/90369487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09331b0 msgr2=0x55c3b0cf32a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.945+0000 7fbdd29df740 1 --2- 172.21.15.69:0/90369487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09331b0 0x55c3b0cf32a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc010c40 tx=0x7fbdbc004ab0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.945+0000 7fbdd29df740 1 -- 172.21.15.69:0/90369487 shutdown_connections 2024-05-14T15:33:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.945+0000 7fbdd29df740 1 --2- 172.21.15.69:0/90369487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09331b0 0x55c3b0cf32a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.945+0000 7fbdd29df740 1 --2- 172.21.15.69:0/90369487 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c3b08f1d80 0x55c3b0cf9600 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.945+0000 7fbdd29df740 1 --2- 172.21.15.69:0/90369487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09124d0 0x55c3b0cdee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.945+0000 7fbdd29df740 1 --2- 172.21.15.69:0/90369487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 0x55c3b0cde910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.945+0000 7fbdd29df740 1 -- 172.21.15.69:0/90369487 >> 172.21.15.69:0/90369487 conn(0x55c3b0927300 msgr2=0x55c3b0cd42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.945+0000 7fbdaaa00640 0 client.26578 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:33:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.945+0000 7fbdd29df740 1 -- 172.21.15.69:0/90369487 shutdown_connections 2024-05-14T15:33:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.945+0000 7fbdd29df740 1 -- 172.21.15.69:0/90369487 wait complete. 2024-05-14T15:33:49.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.945+0000 7fbdd29df740 20 client.26578 trim_cache size 0 max 16384 2024-05-14T15:33:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.964+0000 7fbdd29df740 1 Processor -- start 2024-05-14T15:33:49.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.964+0000 7fbdd29df740 1 -- start start 2024-05-14T15:33:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.965+0000 7fbdd29df740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 0x55c3b0cd90e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.965+0000 7fbdd29df740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09124d0 0x55c3b0cdda00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.965+0000 7fbdd29df740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09331b0 0x55c3b0cd4920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.967 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.965+0000 7fbdd29df740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbda4010080 con 0x55c3b09331b0 2024-05-14T15:33:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.965+0000 7fbdd29df740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbda4011bc0 con 0x55c3b090a2f0 2024-05-14T15:33:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.965+0000 7fbdd29df740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbda4010750 con 0x55c3b09124d0 2024-05-14T15:33:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.965+0000 7fbdc9a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09331b0 0x55c3b0cd4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.965+0000 7fbdc9a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09331b0 0x55c3b0cd4920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45390/0 (socket says 172.21.15.69:45390) 2024-05-14T15:33:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.965+0000 7fbdc9a00640 1 -- 172.21.15.69:0/1638015394 learned_addr learned my addr 172.21.15.69:0/1638015394 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.965+0000 7fbdc3e00640 1 --2- 172.21.15.69:0/1638015394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09124d0 0x55c3b0cdda00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.966+0000 7fbdc9000640 1 --2- 172.21.15.69:0/1638015394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 0x55c3b0cd90e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.966+0000 7fbdc9a00640 1 -- 172.21.15.69:0/1638015394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09124d0 msgr2=0x55c3b0cdda00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.966+0000 7fbdc9a00640 1 --2- 172.21.15.69:0/1638015394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09124d0 0x55c3b0cdda00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.966+0000 7fbdc9a00640 1 -- 172.21.15.69:0/1638015394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 msgr2=0x55c3b0cd90e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.966+0000 7fbdc9a00640 1 --2- 172.21.15.69:0/1638015394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 0x55c3b0cd90e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.966+0000 7fbdc9a00640 1 -- 172.21.15.69:0/1638015394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3b0cd0260 con 0x55c3b09331b0 2024-05-14T15:33:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.966+0000 7fbdc9000640 1 --2- 172.21.15.69:0/1638015394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 0x55c3b0cd90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:33:49.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.966+0000 7fbdc9a00640 1 --2- 172.21.15.69:0/1638015394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09331b0 0x55c3b0cd4920 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0116b0 tx=0x7fbdbc01f940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=603768aeaa9738e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.966+0000 7fbdb5600640 1 -- 172.21.15.69:0/1638015394 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc004d20 con 0x55c3b09331b0 2024-05-14T15:33:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.966+0000 7fbdb5600640 1 -- 172.21.15.69:0/1638015394 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbdbc003e00 con 0x55c3b09331b0 2024-05-14T15:33:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.966+0000 7fbdb5600640 1 -- 172.21.15.69:0/1638015394 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc01c660 con 0x55c3b09331b0 2024-05-14T15:33:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.967+0000 7fbdd29df740 1 -- 172.21.15.69:0/1638015394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09331b0 msgr2=0x55c3b0cd4920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.967+0000 7fbdd29df740 1 --2- 172.21.15.69:0/1638015394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09331b0 0x55c3b0cd4920 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc0116b0 tx=0x7fbdbc01f940 comp rx=0 tx=0).stop 2024-05-14T15:33:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.967+0000 7fbdd29df740 1 -- 172.21.15.69:0/1638015394 shutdown_connections 2024-05-14T15:33:49.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.967+0000 7fbdd29df740 1 --2- 172.21.15.69:0/1638015394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09331b0 0x55c3b0cd4920 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.967+0000 7fbdd29df740 1 --2- 172.21.15.69:0/1638015394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09124d0 0x55c3b0cdda00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.967+0000 7fbdd29df740 1 --2- 172.21.15.69:0/1638015394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 0x55c3b0cd90e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.967+0000 7fbdd29df740 1 -- 172.21.15.69:0/1638015394 >> 172.21.15.69:0/1638015394 conn(0x55c3b0927300 msgr2=0x55c3b0cd4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.967+0000 7fbdd29df740 1 -- 172.21.15.69:0/1638015394 shutdown_connections 2024-05-14T15:33:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.967+0000 7fbdd29df740 1 -- 172.21.15.69:0/1638015394 wait complete. 2024-05-14T15:33:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.968+0000 7fbdd29df740 1 -- start start 2024-05-14T15:33:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.968+0000 7fbdd29df740 1 Processor -- start 2024-05-14T15:33:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdd29df740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 0x55c3b0cef380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdd29df740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09124d0 0x55c3b0cef8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdd29df740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09331b0 0x55c3b0cea8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdd29df740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbda40114f0 con 0x55c3b09331b0 2024-05-14T15:33:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdd29df740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbda4010e20 con 0x55c3b090a2f0 2024-05-14T15:33:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdd29df740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbda400e080 con 0x55c3b09124d0 2024-05-14T15:33:49.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdd29df740 10 client.0 _ll_register_callbacks cb 0x7fbdbc011e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:33:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdc9a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09331b0 0x55c3b0cea8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdc9a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09331b0 0x55c3b0cea8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45402/0 (socket says 172.21.15.69:45402) 2024-05-14T15:33:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdc9a00640 1 -- 172.21.15.69:0/2742290096 learned_addr learned my addr 172.21.15.69:0/2742290096 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:33:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdc3e00640 1 --2- 172.21.15.69:0/2742290096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09124d0 0x55c3b0cef8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdc9000640 1 --2- 172.21.15.69:0/2742290096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 0x55c3b0cef380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdc9a00640 1 -- 172.21.15.69:0/2742290096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09124d0 msgr2=0x55c3b0cef8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdc9a00640 1 --2- 172.21.15.69:0/2742290096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09124d0 0x55c3b0cef8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdc9a00640 1 -- 172.21.15.69:0/2742290096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 msgr2=0x55c3b0cef380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:33:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdc9a00640 1 --2- 172.21.15.69:0/2742290096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 0x55c3b0cef380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdc9a00640 1 -- 172.21.15.69:0/2742290096 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c3b0ceb040 con 0x55c3b09331b0 2024-05-14T15:33:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdc9000640 1 --2- 172.21.15.69:0/2742290096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 0x55c3b0cef380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:33:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.969+0000 7fbdc3e00640 1 --2- 172.21.15.69:0/2742290096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09124d0 0x55c3b0cef8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:33:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.970+0000 7fbdc9a00640 1 --2- 172.21.15.69:0/2742290096 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09331b0 0x55c3b0cea8d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc010970 tx=0x7fbdbc003c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874e7d9546f5e267 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:33:49.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.970+0000 7fbdaaa00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:33:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.970+0000 7fbdaaa00640 1 -- 172.21.15.69:0/2742290096 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdbc045060 con 0x55c3b09331b0 2024-05-14T15:33:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.970+0000 7fbdaaa00640 1 -- 172.21.15.69:0/2742290096 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(104..104 src has 1..104) ==== 9554+0+0 (secure 0 0 0) 0x7fbdbc004d90 con 0x55c3b09331b0 2024-05-14T15:33:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.970+0000 7fbdd29df740 1 -- 172.21.15.69:0/2742290096 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbdbc003e00 con 0x55c3b09331b0 2024-05-14T15:33:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.970+0000 7fbdaaa00640 1 -- 172.21.15.69:0/2742290096 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fbdbc04c050 con 0x55c3b09331b0 2024-05-14T15:33:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.970+0000 7fbdd29df740 10 client.17085 fetch_fsmap learned FSMap version 62 2024-05-14T15:33:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.970+0000 7fbdd29df740 1 -- 172.21.15.69:0/2742290096 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55c3b0d613f0 con 0x55c3b09331b0 2024-05-14T15:33:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.971+0000 7fbdaaa00640 1 -- 172.21.15.69:0/2742290096 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbdbc003e00 con 0x55c3b09331b0 2024-05-14T15:33:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.971+0000 7fbdaaa00640 1 -- 172.21.15.69:0/2742290096 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7fbdbc01c860 con 0x55c3b09331b0 2024-05-14T15:33:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.971+0000 7fbdd29df740 10 client.17085 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:33:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.971+0000 7fbdd29df740 10 client.17085 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:33:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.971+0000 7fbdd29df740 20 client.17085 populate_metadata read hostname 'smithi069' 2024-05-14T15:33:49.975 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.971+0000 7fbdd29df740 1 --2- 172.21.15.69:0/2742290096 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c3b08c71c0 0x55c3b0d63a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:33:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.971+0000 7fbdd29df740 4 client.17085 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:33:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.971+0000 7fbdd29df740 1 -- 172.21.15.69:0/2742290096 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c3b0c40fd0 con 0x55c3b08c71c0 2024-05-14T15:33:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.972+0000 7fbdc9000640 1 --2- 172.21.15.69:0/2742290096 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c3b08c71c0 0x55c3b0d63a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:33:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.973+0000 7fbdc9000640 1 --2- 172.21.15.69:0/2742290096 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c3b08c71c0 0x55c3b0d63a60 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1bde18d2b51b0fa server_cookie=acb4602e395e15a3 in_seq=0 out_seq=0 2024-05-14T15:33:49.976 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:49.973+0000 7fbdaaa00640 10 client.17085 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:33:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.002+0000 7fbdaaa00640 1 -- 172.21.15.69:0/2742290096 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c3b0c40fd0 con 0x55c3b08c71c0 2024-05-14T15:33:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.002+0000 7fbdaaa00640 10 client.17085 handle_command_reply: tid=0 2024-05-14T15:33:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.003+0000 7fbdd29df740 1 client.17085 shutdown 2024-05-14T15:33:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.003+0000 7fbdd29df740 1 -- 172.21.15.69:0/2742290096 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09331b0 msgr2=0x55c3b0cea8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.003+0000 7fbdd29df740 1 --2- 172.21.15.69:0/2742290096 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09331b0 0x55c3b0cea8d0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fbdbc010970 tx=0x7fbdbc003c90 comp rx=0 tx=0).stop 2024-05-14T15:33:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.003+0000 7fbdd29df740 1 -- 172.21.15.69:0/2742290096 shutdown_connections 2024-05-14T15:33:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.003+0000 7fbdd29df740 1 --2- 172.21.15.69:0/2742290096 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c3b08c71c0 0x55c3b0d63a60 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.003+0000 7fbdd29df740 1 --2- 172.21.15.69:0/2742290096 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c3b09331b0 0x55c3b0cea8d0 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.003+0000 7fbdd29df740 1 --2- 172.21.15.69:0/2742290096 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c3b09124d0 0x55c3b0cef8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.003+0000 7fbdd29df740 1 --2- 172.21.15.69:0/2742290096 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c3b090a2f0 0x55c3b0cef380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:50.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.003+0000 7fbdd29df740 1 -- 172.21.15.69:0/2742290096 >> 172.21.15.69:0/2742290096 conn(0x55c3b0927300 msgr2=0x55c3b0cdd760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.003+0000 7fbdaaa00640 0 client.17085 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:33:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.003+0000 7fbdd29df740 1 -- 172.21.15.69:0/2742290096 shutdown_connections 2024-05-14T15:33:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.003+0000 7fbdd29df740 1 -- 172.21.15.69:0/2742290096 wait complete. 2024-05-14T15:33:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.003+0000 7fbdd29df740 20 client.17085 trim_cache size 0 max 16384 2024-05-14T15:33:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:33:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:33:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:33:50.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:33:50.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.004+0000 7fbdca400640 1 -- 172.21.15.69:0/4126356814 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbdac0b29d0 msgr2=0x7fbdac0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:50.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.004+0000 7fbdca400640 1 --2- 172.21.15.69:0/4126356814 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbdac0b29d0 0x7fbdac0b4ee0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x55c3b0cd15f0 tx=0x7fbdbc0096a0 comp rx=0 tx=0).stop 2024-05-14T15:33:50.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.004+0000 7fbdca400640 1 -- 172.21.15.69:0/4126356814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdc4109ac0 msgr2=0x7fbdc419db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:33:50.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.004+0000 7fbdca400640 1 --2- 172.21.15.69:0/4126356814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdc4109ac0 0x7fbdc419db90 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fbdb000e9f0 tx=0x7fbdb000eeb0 comp rx=0 tx=0).stop 2024-05-14T15:33:50.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.004+0000 7fbdca400640 1 -- 172.21.15.69:0/4126356814 shutdown_connections 2024-05-14T15:33:50.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.004+0000 7fbdca400640 1 --2- 172.21.15.69:0/4126356814 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbdac0b29d0 0x7fbdac0b4ee0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:50.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.004+0000 7fbdca400640 1 --2- 172.21.15.69:0/4126356814 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbdc4109f60 0x7fbdc41a84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.004+0000 7fbdca400640 1 --2- 172.21.15.69:0/4126356814 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbdc4109ac0 0x7fbdc419db90 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.004+0000 7fbdca400640 1 --2- 172.21.15.69:0/4126356814 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbdc4104260 0x7fbdc419d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:33:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.004+0000 7fbdca400640 1 -- 172.21.15.69:0/4126356814 >> 172.21.15.69:0/4126356814 conn(0x7fbdc4079250 msgr2=0x7fbdc4102230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:33:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.004+0000 7fbdca400640 1 -- 172.21.15.69:0/4126356814 shutdown_connections 2024-05-14T15:33:50.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:33:50.004+0000 7fbdca400640 1 -- 172.21.15.69:0/4126356814 wait complete. 2024-05-14T15:33:51.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 485.0 s, 505.2 tps, lat 198.066 ms stddev 310.323 2024-05-14T15:33:51.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:51 smithi203 ceph-mon[34567]: pgmap v381: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 9.9 MiB/s wr, 784 op/s 2024-05-14T15:33:51.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:51 smithi092 ceph-mon[34729]: pgmap v381: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 9.9 MiB/s wr, 784 op/s 2024-05-14T15:33:51.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:51 smithi069 ceph-mon[31270]: pgmap v381: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 9.9 MiB/s wr, 784 op/s 2024-05-14T15:33:53.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:53 smithi203 ceph-mon[34567]: pgmap v382: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.5 MiB/s wr, 521 op/s 2024-05-14T15:33:53.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:53 smithi092 ceph-mon[34729]: pgmap v382: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.5 MiB/s wr, 521 op/s 2024-05-14T15:33:53.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:53 smithi069 ceph-mon[31270]: pgmap v382: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.5 MiB/s wr, 521 op/s 2024-05-14T15:33:55.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:55 smithi092 ceph-mon[34729]: pgmap v383: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.2 MiB/s wr, 608 op/s 2024-05-14T15:33:55.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:55 smithi069 ceph-mon[31270]: pgmap v383: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.2 MiB/s wr, 608 op/s 2024-05-14T15:33:55.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:55 smithi203 ceph-mon[34567]: pgmap v383: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 9.2 MiB/s wr, 608 op/s 2024-05-14T15:33:56.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 490.0 s, 488.5 tps, lat 155.709 ms stddev 66.570 2024-05-14T15:33:57.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:57 smithi092 ceph-mon[34729]: pgmap v384: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 9.7 MiB/s wr, 656 op/s 2024-05-14T15:33:57.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:57 smithi069 ceph-mon[31270]: pgmap v384: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 9.7 MiB/s wr, 656 op/s 2024-05-14T15:33:57.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:57 smithi203 ceph-mon[34567]: pgmap v384: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 9.7 MiB/s wr, 656 op/s 2024-05-14T15:33:59.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:33:59 smithi092 ceph-mon[34729]: pgmap v385: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.4 MiB/s wr, 492 op/s 2024-05-14T15:33:59.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:33:59 smithi069 ceph-mon[31270]: pgmap v385: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.4 MiB/s wr, 492 op/s 2024-05-14T15:33:59.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:33:59 smithi203 ceph-mon[34567]: pgmap v385: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 7.4 MiB/s wr, 492 op/s 2024-05-14T15:34:01.369 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 495.0 s, 655.5 tps, lat 188.606 ms stddev 291.002 2024-05-14T15:34:01.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:01 smithi092 ceph-mon[34729]: pgmap v386: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 11 MiB/s wr, 725 op/s 2024-05-14T15:34:01.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:01 smithi069 ceph-mon[31270]: pgmap v386: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 11 MiB/s wr, 725 op/s 2024-05-14T15:34:01.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:01 smithi203 ceph-mon[34567]: pgmap v386: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 11 MiB/s wr, 725 op/s 2024-05-14T15:34:03.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.397+0000 7f3572a00640 1 -- 172.21.15.69:0/3235905095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f356c102580 msgr2=0x7f356c102990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.397+0000 7f3572a00640 1 --2- 172.21.15.69:0/3235905095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f356c102580 0x7f356c102990 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f355c00aa10 tx=0x7f355c02b730 comp rx=0 tx=0).stop 2024-05-14T15:34:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.398+0000 7f3572a00640 1 -- 172.21.15.69:0/3235905095 shutdown_connections 2024-05-14T15:34:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.398+0000 7f3572a00640 1 --2- 172.21.15.69:0/3235905095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f356c1075d0 0x7f356c10ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.398+0000 7f3572a00640 1 --2- 172.21.15.69:0/3235905095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f356c106b10 0x7f356c106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.398+0000 7f3572a00640 1 --2- 172.21.15.69:0/3235905095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f356c102580 0x7f356c102990 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.398+0000 7f3572a00640 1 -- 172.21.15.69:0/3235905095 >> 172.21.15.69:0/3235905095 conn(0x7f356c0779e0 msgr2=0x7f356c077e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.398+0000 7f3572a00640 1 -- 172.21.15.69:0/3235905095 shutdown_connections 2024-05-14T15:34:03.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.398+0000 7f3572a00640 1 -- 172.21.15.69:0/3235905095 wait complete. 2024-05-14T15:34:03.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.400+0000 7f3572a00640 1 Processor -- start 2024-05-14T15:34:03.402 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.400+0000 7f3572a00640 1 -- start start 2024-05-14T15:34:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.403+0000 7f3572a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f356c102580 0x7f356c19a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.403+0000 7f3572a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f356c106b10 0x7f356c19ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.403+0000 7f3572a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f356c1075d0 0x7f356c19f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.403+0000 7f3572a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f356c111b10 con 0x7f356c1075d0 2024-05-14T15:34:03.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.403+0000 7f3572a00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f356c111990 con 0x7f356c106b10 2024-05-14T15:34:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.403+0000 7f3572a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f356c111c90 con 0x7f356c102580 2024-05-14T15:34:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.404+0000 7f356b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f356c106b10 0x7f356c19ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.404+0000 7f356b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f356c106b10 0x7f356c19ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:37058/0 (socket says 172.21.15.69:37058) 2024-05-14T15:34:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.404+0000 7f356b400640 1 -- 172.21.15.69:0/1263506494 learned_addr learned my addr 172.21.15.69:0/1263506494 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.404+0000 7f3570a00640 1 --2- 172.21.15.69:0/1263506494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f356c1075d0 0x7f356c19f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:03.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.404+0000 7f356be00640 1 --2- 172.21.15.69:0/1263506494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f356c102580 0x7f356c19a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.405+0000 7f356b400640 1 -- 172.21.15.69:0/1263506494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f356c102580 msgr2=0x7f356c19a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.405+0000 7f356b400640 1 --2- 172.21.15.69:0/1263506494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f356c102580 0x7f356c19a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.405+0000 7f356b400640 1 -- 172.21.15.69:0/1263506494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f356c1075d0 msgr2=0x7f356c19f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.405+0000 7f356b400640 1 --2- 172.21.15.69:0/1263506494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f356c1075d0 0x7f356c19f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.405+0000 7f356b400640 1 -- 172.21.15.69:0/1263506494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f356c19f650 con 0x7f356c106b10 2024-05-14T15:34:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.405+0000 7f356be00640 1 --2- 172.21.15.69:0/1263506494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f356c102580 0x7f356c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:34:03.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.405+0000 7f356b400640 1 --2- 172.21.15.69:0/1263506494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f356c106b10 0x7f356c19ad50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f355800e9f0 tx=0x7f355800eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:03.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.411+0000 7f3568c00640 1 -- 172.21.15.69:0/1263506494 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355800ccc0 con 0x7f356c106b10 2024-05-14T15:34:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.411+0000 7f3568c00640 1 -- 172.21.15.69:0/1263506494 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f35580054b0 con 0x7f356c106b10 2024-05-14T15:34:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.411+0000 7f3568c00640 1 -- 172.21.15.69:0/1263506494 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3558010430 con 0x7f356c106b10 2024-05-14T15:34:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.411+0000 7f3572a00640 1 -- 172.21.15.69:0/1263506494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f356c19f940 con 0x7f356c106b10 2024-05-14T15:34:03.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.411+0000 7f3572a00640 1 -- 172.21.15.69:0/1263506494 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f356c19fe40 con 0x7f356c106b10 2024-05-14T15:34:03.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.427+0000 7f35799dc740 1 Processor -- start 2024-05-14T15:34:03.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.428+0000 7f3568c00640 1 -- 172.21.15.69:0/1263506494 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f35580046c0 con 0x7f356c106b10 2024-05-14T15:34:03.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.432+0000 7f35799dc740 1 -- start start 2024-05-14T15:34:03.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.432+0000 7f35799dc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089a11b0 0x564008d512f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.432+0000 7f35799dc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 0x564008d51830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.432+0000 7f35799dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089804d0 0x564008d4ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.432+0000 7f35799dc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564008ca7550 con 0x5640089a11b0 2024-05-14T15:34:03.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.432+0000 7f35799dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564008c4cbc0 con 0x5640089804d0 2024-05-14T15:34:03.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.432+0000 7f35799dc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564008ca3510 con 0x5640089782f0 2024-05-14T15:34:03.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.433+0000 7f356be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 0x564008d51830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:03.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.433+0000 7f356be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 0x564008d51830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:33570/0 (socket says 172.21.15.69:33570) 2024-05-14T15:34:03.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.433+0000 7f356be00640 1 -- 172.21.15.69:0/971217128 learned_addr learned my addr 172.21.15.69:0/971217128 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:03.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.433+0000 7f356b400640 1 --2- 172.21.15.69:0/971217128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089804d0 0x564008d4ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:03.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.434+0000 7f356be00640 1 -- 172.21.15.69:0/971217128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089804d0 msgr2=0x564008d4ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:03.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.434+0000 7f356be00640 1 --2- 172.21.15.69:0/971217128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089804d0 0x564008d4ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.434+0000 7f356be00640 1 -- 172.21.15.69:0/971217128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089a11b0 msgr2=0x564008d512f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:34:03.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.434+0000 7f356be00640 1 --2- 172.21.15.69:0/971217128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089a11b0 0x564008d512f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.434+0000 7f356be00640 1 -- 172.21.15.69:0/971217128 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640089b9210 con 0x5640089782f0 2024-05-14T15:34:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.434+0000 7f356be00640 1 --2- 172.21.15.69:0/971217128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 0x564008d51830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f355c00a7d0 tx=0x7f355c030dc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a2a830a1158bdda server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.435+0000 7f3568c00640 1 --2- 172.21.15.69:0/1263506494 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f35500b2aa0 0x7f35500b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.436+0000 7f3561200640 1 -- 172.21.15.69:0/971217128 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c036040 con 0x5640089782f0 2024-05-14T15:34:03.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.436+0000 7f3561200640 1 -- 172.21.15.69:0/971217128 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f355c0044c0 con 0x5640089782f0 2024-05-14T15:34:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.436+0000 7f3561200640 1 -- 172.21.15.69:0/971217128 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c0046c0 con 0x5640089782f0 2024-05-14T15:34:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.436+0000 7f3568c00640 1 -- 172.21.15.69:0/1263506494 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 9642+0+0 (secure 0 0 0) 0x7f35580e2dd0 con 0x7f356c106b10 2024-05-14T15:34:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.437+0000 7f35799dc740 1 -- 172.21.15.69:0/971217128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 msgr2=0x564008d51830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:03.438 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.437+0000 7f35799dc740 1 --2- 172.21.15.69:0/971217128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 0x564008d51830 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f355c00a7d0 tx=0x7f355c030dc0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.438+0000 7f3570a00640 1 --2- 172.21.15.69:0/1263506494 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f35500b2aa0 0x7f35500b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.440+0000 7f35799dc740 1 -- 172.21.15.69:0/971217128 shutdown_connections 2024-05-14T15:34:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.440+0000 7f35799dc740 1 --2- 172.21.15.69:0/971217128 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089804d0 0x564008d4ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.440+0000 7f35799dc740 1 --2- 172.21.15.69:0/971217128 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 0x564008d51830 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.440+0000 7f35799dc740 1 --2- 172.21.15.69:0/971217128 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089a11b0 0x564008d512f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.440+0000 7f35799dc740 1 -- 172.21.15.69:0/971217128 >> 172.21.15.69:0/971217128 conn(0x564008995300 msgr2=0x564008d3e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.440+0000 7f35799dc740 1 -- 172.21.15.69:0/971217128 shutdown_connections 2024-05-14T15:34:03.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.440+0000 7f35799dc740 1 -- 172.21.15.69:0/971217128 wait complete. 2024-05-14T15:34:03.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.441+0000 7f35799dc740 1 -- start start 2024-05-14T15:34:03.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.441+0000 7f3570a00640 1 --2- 172.21.15.69:0/1263506494 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f35500b2aa0 0x7f35500b4fb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x564008d3f250 tx=0x7f356400a4d0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:03.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.441+0000 7f35799dc740 1 Processor -- start 2024-05-14T15:34:03.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.445+0000 7f35799dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089782f0 0x564008d5b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.447 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.445+0000 7f35799dc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089804d0 0x564008d5b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.448 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.447+0000 7f35799dc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089a11b0 0x564008d554a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.448 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.447+0000 7f35799dc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564008d50960 con 0x5640089804d0 2024-05-14T15:34:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.447+0000 7f35799dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564008c60660 con 0x5640089782f0 2024-05-14T15:34:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.447+0000 7f35799dc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564008d50ae0 con 0x5640089a11b0 2024-05-14T15:34:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.447+0000 7f35799dc740 10 client.0 _ll_register_callbacks cb 0x564008c2a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:34:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.446+0000 7f356be00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089782f0 0x564008d5b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.447+0000 7f356be00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089782f0 0x564008d5b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:37072/0 (socket says 172.21.15.69:37072) 2024-05-14T15:34:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.447+0000 7f356be00640 1 -- 172.21.15.69:0/32937500 learned_addr learned my addr 172.21.15.69:0/32937500 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:03.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.448+0000 7f356b400640 1 --2- 172.21.15.69:0/32937500 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089804d0 0x564008d5b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:03.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.448+0000 7f356b400640 1 -- 172.21.15.69:0/32937500 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089a11b0 msgr2=0x564008d554a0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:34:03.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.448+0000 7f356b400640 1 --2- 172.21.15.69:0/32937500 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089a11b0 0x564008d554a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.448+0000 7f356b400640 1 -- 172.21.15.69:0/32937500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089782f0 msgr2=0x564008d5b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:03.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.448+0000 7f356b400640 1 --2- 172.21.15.69:0/32937500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089782f0 0x564008d5b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.448+0000 7f356b400640 1 -- 172.21.15.69:0/32937500 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564008a85620 con 0x5640089804d0 2024-05-14T15:34:03.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.448+0000 7f356be00640 1 --2- 172.21.15.69:0/32937500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089782f0 0x564008d5b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:34:03.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.450+0000 7f356b400640 1 --2- 172.21.15.69:0/32937500 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089804d0 0x564008d5b5f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f35580e00c0 tx=0x7f35580a9a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ae35dfabefa52a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:03.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.450+0000 7f3555600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:34:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.450+0000 7f3555600640 1 -- 172.21.15.69:0/32937500 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35580a53e0 con 0x5640089804d0 2024-05-14T15:34:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.450+0000 7f3555600640 1 -- 172.21.15.69:0/32937500 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9642+0+0 (secure 0 0 0) 0x7f35580b2830 con 0x5640089804d0 2024-05-14T15:34:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.450+0000 7f35799dc740 1 -- 172.21.15.69:0/32937500 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564008cb5160 con 0x5640089804d0 2024-05-14T15:34:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.452+0000 7f3555600640 1 -- 172.21.15.69:0/32937500 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f35580c9050 con 0x5640089804d0 2024-05-14T15:34:03.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.452+0000 7f35799dc740 10 client.17091 fetch_fsmap learned FSMap version 62 2024-05-14T15:34:03.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.452+0000 7f35799dc740 1 -- 172.21.15.69:0/32937500 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x564008d63e50 con 0x5640089804d0 2024-05-14T15:34:03.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.454+0000 7f3555600640 1 -- 172.21.15.69:0/32937500 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x564008cb5160 con 0x5640089804d0 2024-05-14T15:34:03.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.454+0000 7f3555600640 1 -- 172.21.15.69:0/32937500 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f35580a55c0 con 0x5640089804d0 2024-05-14T15:34:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.454+0000 7f35799dc740 10 client.17091 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:34:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.454+0000 7f35799dc740 10 client.17091 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:34:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.454+0000 7f35799dc740 20 client.17091 populate_metadata read hostname 'smithi069' 2024-05-14T15:34:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.454+0000 7f35799dc740 1 --2- 172.21.15.69:0/32937500 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56400895fd80 0x564008d67860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.454+0000 7f35799dc740 4 client.17091 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:34:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.454+0000 7f35799dc740 1 -- 172.21.15.69:0/32937500 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564008caefd0 con 0x56400895fd80 2024-05-14T15:34:03.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.456+0000 7f356be00640 1 --2- 172.21.15.69:0/32937500 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56400895fd80 0x564008d67860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:03.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.458+0000 7f3555600640 10 client.17091 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:34:03.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.458+0000 7f356be00640 1 --2- 172.21.15.69:0/32937500 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56400895fd80 0x564008d67860 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77cc28a899d3bd55 server_cookie=5bc43d9e7243500b in_seq=0 out_seq=0 2024-05-14T15:34:03.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.460+0000 7f3555600640 1 -- 172.21.15.69:0/32937500 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564008caefd0 con 0x56400895fd80 2024-05-14T15:34:03.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.460+0000 7f3555600640 10 client.17091 handle_command_reply: tid=0 2024-05-14T15:34:03.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.460+0000 7f35799dc740 1 client.17091 shutdown 2024-05-14T15:34:03.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.461+0000 7f35799dc740 1 -- 172.21.15.69:0/32937500 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089804d0 msgr2=0x564008d5b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:03.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.461+0000 7f35799dc740 1 --2- 172.21.15.69:0/32937500 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089804d0 0x564008d5b5f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f35580e00c0 tx=0x7f35580a9a20 comp rx=0 tx=0).stop 2024-05-14T15:34:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.461+0000 7f35799dc740 1 -- 172.21.15.69:0/32937500 shutdown_connections 2024-05-14T15:34:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.461+0000 7f35799dc740 1 --2- 172.21.15.69:0/32937500 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089a11b0 0x564008d554a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.461+0000 7f35799dc740 1 --2- 172.21.15.69:0/32937500 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56400895fd80 0x564008d67860 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.461+0000 7f35799dc740 1 --2- 172.21.15.69:0/32937500 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089804d0 0x564008d5b5f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.461+0000 7f35799dc740 1 --2- 172.21.15.69:0/32937500 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089782f0 0x564008d5b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.461+0000 7f3555600640 0 client.17091 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:34:03.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.461+0000 7f35799dc740 1 -- 172.21.15.69:0/32937500 >> 172.21.15.69:0/32937500 conn(0x564008995300 msgr2=0x564008d3e3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:03.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.462+0000 7f35799dc740 1 -- 172.21.15.69:0/32937500 shutdown_connections 2024-05-14T15:34:03.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.462+0000 7f35799dc740 1 -- 172.21.15.69:0/32937500 wait complete. 2024-05-14T15:34:03.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.463+0000 7f35799dc740 20 client.17091 trim_cache size 0 max 16384 2024-05-14T15:34:03.510 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.506+0000 7f35799dc740 1 Processor -- start 2024-05-14T15:34:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.507+0000 7f35799dc740 1 -- start start 2024-05-14T15:34:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.507+0000 7f35799dc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 0x564008d52e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.507+0000 7f35799dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089804d0 0x564008d6d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.507+0000 7f35799dc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089a11b0 0x564008d6d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.508+0000 7f35799dc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f356c1af200 con 0x5640089a11b0 2024-05-14T15:34:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.508+0000 7f356be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 0x564008d52e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.508+0000 7f356be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 0x564008d52e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:33588/0 (socket says 172.21.15.69:33588) 2024-05-14T15:34:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.508+0000 7f356be00640 1 -- 172.21.15.69:0/3316130482 learned_addr learned my addr 172.21.15.69:0/3316130482 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.508+0000 7f3570a00640 1 --2- 172.21.15.69:0/3316130482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089a11b0 0x564008d6d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.509+0000 7f35799dc740 1 -- 172.21.15.69:0/3316130482 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f356c1b0d40 con 0x5640089804d0 2024-05-14T15:34:03.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.509+0000 7f35799dc740 1 -- 172.21.15.69:0/3316130482 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f356c1af8d0 con 0x5640089782f0 2024-05-14T15:34:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.510+0000 7f356be00640 1 -- 172.21.15.69:0/3316130482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089804d0 msgr2=0x564008d6d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.510+0000 7f356be00640 1 --2- 172.21.15.69:0/3316130482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089804d0 0x564008d6d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.510+0000 7f356be00640 1 -- 172.21.15.69:0/3316130482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089a11b0 msgr2=0x564008d6d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.510+0000 7f356be00640 1 --2- 172.21.15.69:0/3316130482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089a11b0 0x564008d6d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.510+0000 7f356be00640 1 -- 172.21.15.69:0/3316130482 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564008d4f3f0 con 0x5640089782f0 2024-05-14T15:34:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.511+0000 7f356be00640 1 --2- 172.21.15.69:0/3316130482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 0x564008d52e80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f355c00aa10 tx=0x7f355c02b730 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae48e4932e0c0b74 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.512+0000 7f3557e00640 1 -- 172.21.15.69:0/3316130482 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c036040 con 0x5640089782f0 2024-05-14T15:34:03.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.512+0000 7f3557e00640 1 -- 172.21.15.69:0/3316130482 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f355c051e50 con 0x5640089782f0 2024-05-14T15:34:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.512+0000 7f3557e00640 1 -- 172.21.15.69:0/3316130482 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f355c03c460 con 0x5640089782f0 2024-05-14T15:34:03.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.513+0000 7f35799dc740 1 -- 172.21.15.69:0/3316130482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 msgr2=0x564008d52e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:03.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.513+0000 7f35799dc740 1 --2- 172.21.15.69:0/3316130482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 0x564008d52e80 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f355c00aa10 tx=0x7f355c02b730 comp rx=0 tx=0).stop 2024-05-14T15:34:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.513+0000 7f35799dc740 1 -- 172.21.15.69:0/3316130482 shutdown_connections 2024-05-14T15:34:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.513+0000 7f35799dc740 1 --2- 172.21.15.69:0/3316130482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089a11b0 0x564008d6d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.513+0000 7f35799dc740 1 --2- 172.21.15.69:0/3316130482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089804d0 0x564008d6d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.513+0000 7f35799dc740 1 --2- 172.21.15.69:0/3316130482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 0x564008d52e80 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.513+0000 7f35799dc740 1 -- 172.21.15.69:0/3316130482 >> 172.21.15.69:0/3316130482 conn(0x564008995300 msgr2=0x564008d53d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.515+0000 7f35799dc740 1 -- 172.21.15.69:0/3316130482 shutdown_connections 2024-05-14T15:34:03.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.515+0000 7f35799dc740 1 -- 172.21.15.69:0/3316130482 wait complete. 2024-05-14T15:34:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.516+0000 7f35799dc740 1 -- start start 2024-05-14T15:34:03.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.516+0000 7f35799dc740 1 Processor -- start 2024-05-14T15:34:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.517+0000 7f35799dc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 0x564008d618e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.518+0000 7f35799dc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089804d0 0x564008d5eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.518+0000 7f35799dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089a11b0 0x564008d5f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.518+0000 7f3570a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089a11b0 0x564008d5f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.519+0000 7f3570a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089a11b0 0x564008d5f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:37078/0 (socket says 172.21.15.69:37078) 2024-05-14T15:34:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.519+0000 7f3570a00640 1 -- 172.21.15.69:0/2106085094 learned_addr learned my addr 172.21.15.69:0/2106085094 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:03.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.519+0000 7f356be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 0x564008d618e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.519+0000 7f35799dc740 1 -- 172.21.15.69:0/2106085094 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f356c1b0670 con 0x5640089804d0 2024-05-14T15:34:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.520+0000 7f35799dc740 1 -- 172.21.15.69:0/2106085094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f356c1affa0 con 0x5640089a11b0 2024-05-14T15:34:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.520+0000 7f35799dc740 1 -- 172.21.15.69:0/2106085094 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f356c1ad200 con 0x5640089782f0 2024-05-14T15:34:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.520+0000 7f35799dc740 10 client.0 _ll_register_callbacks cb 0x7f355800cef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:34:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.520+0000 7f356b400640 1 --2- 172.21.15.69:0/2106085094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089804d0 0x564008d5eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.520+0000 7f3570a00640 1 -- 172.21.15.69:0/2106085094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 msgr2=0x564008d618e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.520+0000 7f3570a00640 1 --2- 172.21.15.69:0/2106085094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 0x564008d618e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.520+0000 7f3570a00640 1 -- 172.21.15.69:0/2106085094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089804d0 msgr2=0x564008d5eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.521+0000 7f3570a00640 1 --2- 172.21.15.69:0/2106085094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089804d0 0x564008d5eca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.521+0000 7f3570a00640 1 -- 172.21.15.69:0/2106085094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564008d5f920 con 0x5640089a11b0 2024-05-14T15:34:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.521+0000 7f356b400640 1 --2- 172.21.15.69:0/2106085094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089804d0 0x564008d5eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:34:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.522+0000 7f3555600640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:34:03.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.522+0000 7f3570a00640 1 --2- 172.21.15.69:0/2106085094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089a11b0 0x564008d5f1e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f356401ee40 tx=0x7f3564004ab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47e11301f3cad4e8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.522+0000 7f3555600640 1 -- 172.21.15.69:0/2106085094 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564016070 con 0x5640089a11b0 2024-05-14T15:34:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.523+0000 7f3555600640 1 -- 172.21.15.69:0/2106085094 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(105..105 src has 1..105) ==== 9642+0+0 (secure 0 0 0) 0x7f3564004b20 con 0x5640089a11b0 2024-05-14T15:34:03.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.523+0000 7f35799dc740 1 -- 172.21.15.69:0/2106085094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f355c051e50 con 0x5640089a11b0 2024-05-14T15:34:03.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.524+0000 7f3555600640 1 -- 172.21.15.69:0/2106085094 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f3564004d20 con 0x5640089a11b0 2024-05-14T15:34:03.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.524+0000 7f35799dc740 10 client.36611 fetch_fsmap learned FSMap version 62 2024-05-14T15:34:03.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.524+0000 7f35799dc740 1 -- 172.21.15.69:0/2106085094 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x564008dcfb90 con 0x5640089a11b0 2024-05-14T15:34:03.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.524+0000 7f3555600640 1 -- 172.21.15.69:0/2106085094 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f355c051e50 con 0x5640089a11b0 2024-05-14T15:34:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.525+0000 7f3555600640 1 -- 172.21.15.69:0/2106085094 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f35640050b0 con 0x5640089a11b0 2024-05-14T15:34:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.526+0000 7f35799dc740 10 client.36611 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:34:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.526+0000 7f35799dc740 10 client.36611 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:34:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.526+0000 7f35799dc740 20 client.36611 populate_metadata read hostname 'smithi069' 2024-05-14T15:34:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.526+0000 7f35799dc740 1 --2- 172.21.15.69:0/2106085094 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5640089351c0 0x564008dd23b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:03.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.526+0000 7f35799dc740 4 client.36611 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:34:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.526+0000 7f35799dc740 1 -- 172.21.15.69:0/2106085094 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564008c2a4b0 con 0x5640089351c0 2024-05-14T15:34:03.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.526+0000 7f356be00640 1 --2- 172.21.15.69:0/2106085094 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5640089351c0 0x564008dd23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.528+0000 7f356be00640 1 --2- 172.21.15.69:0/2106085094 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5640089351c0 0x564008dd23b0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d62d70dca9e72311 server_cookie=e5d26fb99e03f5ff in_seq=0 out_seq=0 2024-05-14T15:34:03.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.528+0000 7f3555600640 10 client.36611 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:34:03.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:03 smithi092 ceph-mon[34729]: pgmap v387: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 8.2 MiB/s wr, 450 op/s 2024-05-14T15:34:03.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:03 smithi092 ceph-mon[34729]: osdmap e105: 12 total, 12 up, 12 in 2024-05-14T15:34:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.723+0000 7f3555600640 1 -- 172.21.15.69:0/2106085094 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564008c2a4b0 con 0x5640089351c0 2024-05-14T15:34:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.723+0000 7f3555600640 10 client.36611 handle_command_reply: tid=0 2024-05-14T15:34:03.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.723+0000 7f35799dc740 1 client.36611 shutdown 2024-05-14T15:34:03.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:03 smithi069 ceph-mon[31270]: pgmap v387: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 8.2 MiB/s wr, 450 op/s 2024-05-14T15:34:03.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:03 smithi069 ceph-mon[31270]: osdmap e105: 12 total, 12 up, 12 in 2024-05-14T15:34:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.724+0000 7f35799dc740 1 -- 172.21.15.69:0/2106085094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089a11b0 msgr2=0x564008d5f1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.724+0000 7f35799dc740 1 --2- 172.21.15.69:0/2106085094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089a11b0 0x564008d5f1e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f356401ee40 tx=0x7f3564004ab0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.724+0000 7f35799dc740 1 -- 172.21.15.69:0/2106085094 shutdown_connections 2024-05-14T15:34:03.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.724+0000 7f35799dc740 1 --2- 172.21.15.69:0/2106085094 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5640089a11b0 0x564008d5f1e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.725+0000 7f35799dc740 1 --2- 172.21.15.69:0/2106085094 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5640089351c0 0x564008dd23b0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.725+0000 7f35799dc740 1 --2- 172.21.15.69:0/2106085094 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5640089804d0 0x564008d5eca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.725+0000 7f35799dc740 1 --2- 172.21.15.69:0/2106085094 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5640089782f0 0x564008d618e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.725+0000 7f35799dc740 1 -- 172.21.15.69:0/2106085094 >> 172.21.15.69:0/2106085094 conn(0x564008995300 msgr2=0x564008d4cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.725+0000 7f3555600640 0 client.36611 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:34:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.725+0000 7f35799dc740 1 -- 172.21.15.69:0/2106085094 shutdown_connections 2024-05-14T15:34:03.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.726+0000 7f35799dc740 1 -- 172.21.15.69:0/2106085094 wait complete. 2024-05-14T15:34:03.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.726+0000 7f35799dc740 20 client.36611 trim_cache size 0 max 16384 2024-05-14T15:34:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:34:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:34:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:34:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:34:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.728+0000 7f3572a00640 1 -- 172.21.15.69:0/1263506494 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f35500b2aa0 msgr2=0x7f35500b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.728+0000 7f3572a00640 1 --2- 172.21.15.69:0/1263506494 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f35500b2aa0 0x7f35500b4fb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x564008d3f250 tx=0x7f356400a4d0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.728+0000 7f3572a00640 1 -- 172.21.15.69:0/1263506494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f356c106b10 msgr2=0x7f356c19ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:03.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.728+0000 7f3572a00640 1 --2- 172.21.15.69:0/1263506494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f356c106b10 0x7f356c19ad50 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f355800e9f0 tx=0x7f355800eeb0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.728+0000 7f3572a00640 1 -- 172.21.15.69:0/1263506494 shutdown_connections 2024-05-14T15:34:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.728+0000 7f3572a00640 1 --2- 172.21.15.69:0/1263506494 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f35500b2aa0 0x7f35500b4fb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.728+0000 7f3572a00640 1 --2- 172.21.15.69:0/1263506494 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f356c1075d0 0x7f356c19f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.728+0000 7f3572a00640 1 --2- 172.21.15.69:0/1263506494 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f356c106b10 0x7f356c19ad50 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.728+0000 7f3572a00640 1 --2- 172.21.15.69:0/1263506494 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f356c102580 0x7f356c19a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.728+0000 7f3572a00640 1 -- 172.21.15.69:0/1263506494 >> 172.21.15.69:0/1263506494 conn(0x7f356c0779e0 msgr2=0x7f356c10bd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.728+0000 7f3572a00640 1 -- 172.21.15.69:0/1263506494 shutdown_connections 2024-05-14T15:34:03.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:03.728+0000 7f3572a00640 1 -- 172.21.15.69:0/1263506494 wait complete. 2024-05-14T15:34:03.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:03 smithi203 ceph-mon[34567]: pgmap v387: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 8.2 MiB/s wr, 450 op/s 2024-05-14T15:34:03.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:03 smithi203 ceph-mon[34567]: osdmap e105: 12 total, 12 up, 12 in 2024-05-14T15:34:05.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:05 smithi092 ceph-mon[34729]: pgmap v389: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 7.7 MiB/s wr, 466 op/s 2024-05-14T15:34:05.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:05 smithi069 ceph-mon[31270]: pgmap v389: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 7.7 MiB/s wr, 466 op/s 2024-05-14T15:34:05.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:05 smithi203 ceph-mon[34567]: pgmap v389: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 116 KiB/s rd, 7.7 MiB/s wr, 466 op/s 2024-05-14T15:34:06.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 500.0 s, 497.5 tps, lat 199.591 ms stddev 432.457 2024-05-14T15:34:07.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:07 smithi092 ceph-mon[34729]: pgmap v390: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 9.7 MiB/s wr, 611 op/s 2024-05-14T15:34:07.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:07 smithi069 ceph-mon[31270]: pgmap v390: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 9.7 MiB/s wr, 611 op/s 2024-05-14T15:34:07.848 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:07 smithi203 ceph-mon[34567]: pgmap v390: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 9.7 MiB/s wr, 611 op/s 2024-05-14T15:34:09.696 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:09 smithi092 ceph-mon[34729]: pgmap v391: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 9.7 MiB/s wr, 611 op/s 2024-05-14T15:34:09.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:09 smithi069 ceph-mon[31270]: pgmap v391: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 9.7 MiB/s wr, 611 op/s 2024-05-14T15:34:09.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:09 smithi203 ceph-mon[34567]: pgmap v391: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 140 KiB/s rd, 9.7 MiB/s wr, 611 op/s 2024-05-14T15:34:11.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:10 smithi203 ceph-mon[34567]: osdmap e106: 12 total, 12 up, 12 in 2024-05-14T15:34:11.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:10 smithi092 ceph-mon[34729]: osdmap e106: 12 total, 12 up, 12 in 2024-05-14T15:34:11.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:10 smithi069 ceph-mon[31270]: osdmap e106: 12 total, 12 up, 12 in 2024-05-14T15:34:11.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 505.0 s, 416.6 tps, lat 195.638 ms stddev 157.640 2024-05-14T15:34:12.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:11 smithi203 ceph-mon[34567]: pgmap v393: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 10 MiB/s wr, 714 op/s 2024-05-14T15:34:12.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:11 smithi092 ceph-mon[34729]: pgmap v393: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 10 MiB/s wr, 714 op/s 2024-05-14T15:34:12.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:11 smithi069 ceph-mon[31270]: pgmap v393: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 10 MiB/s wr, 714 op/s 2024-05-14T15:34:14.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:13 smithi092 ceph-mon[34729]: pgmap v394: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 8.3 MiB/s wr, 581 op/s 2024-05-14T15:34:14.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:13 smithi069 ceph-mon[31270]: pgmap v394: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 8.3 MiB/s wr, 581 op/s 2024-05-14T15:34:14.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:13 smithi203 ceph-mon[34567]: pgmap v394: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 8.3 MiB/s wr, 581 op/s 2024-05-14T15:34:16.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:15 smithi092 ceph-mon[34729]: pgmap v395: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 7.7 MiB/s wr, 617 op/s 2024-05-14T15:34:16.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:15 smithi069 ceph-mon[31270]: pgmap v395: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 7.7 MiB/s wr, 617 op/s 2024-05-14T15:34:16.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:15 smithi203 ceph-mon[34567]: pgmap v395: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 103 KiB/s rd, 7.7 MiB/s wr, 617 op/s 2024-05-14T15:34:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 510.0 s, 717.1 tps, lat 164.233 ms stddev 259.739 2024-05-14T15:34:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.115+0000 7f3a6e000640 1 -- 172.21.15.69:0/3570234631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a681075e0 msgr2=0x7f3a681079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:17.117 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.115+0000 7f3a6e000640 1 --2- 172.21.15.69:0/3570234631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a681075e0 0x7f3a681079f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3a54009900 tx=0x7f3a5402a3f0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.117+0000 7f3a6e000640 1 -- 172.21.15.69:0/3570234631 shutdown_connections 2024-05-14T15:34:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.117+0000 7f3a6e000640 1 --2- 172.21.15.69:0/3570234631 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a68108010 0x7f3a681084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.117+0000 7f3a6e000640 1 --2- 172.21.15.69:0/3570234631 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a681075e0 0x7f3a681079f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.117+0000 7f3a6e000640 1 --2- 172.21.15.69:0/3570234631 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a68102b90 0x7f3a68102fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.117+0000 7f3a6e000640 1 -- 172.21.15.69:0/3570234631 >> 172.21.15.69:0/3570234631 conn(0x7f3a680782e0 msgr2=0x7f3a68078720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.117+0000 7f3a6e000640 1 -- 172.21.15.69:0/3570234631 shutdown_connections 2024-05-14T15:34:17.119 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.117+0000 7f3a6e000640 1 -- 172.21.15.69:0/3570234631 wait complete. 2024-05-14T15:34:17.120 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.119+0000 7f3a6e000640 1 Processor -- start 2024-05-14T15:34:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.119+0000 7f3a6e000640 1 -- start start 2024-05-14T15:34:17.121 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.120+0000 7f3a6e000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a68102b90 0x7f3a681a0da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.121+0000 7f3a6e000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a681075e0 0x7f3a681a1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.121+0000 7f3a6e000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a68108010 0x7f3a681a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.121+0000 7f3a6e000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6811a340 con 0x7f3a68102b90 2024-05-14T15:34:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.121+0000 7f3a6e000640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6811a1c0 con 0x7f3a681075e0 2024-05-14T15:34:17.122 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.121+0000 7f3a6e000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6811a4c0 con 0x7f3a68108010 2024-05-14T15:34:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.121+0000 7f3a67400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a68102b90 0x7f3a681a0da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.121+0000 7f3a67400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a68102b90 0x7f3a681a0da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52052/0 (socket says 172.21.15.69:52052) 2024-05-14T15:34:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.121+0000 7f3a67400640 1 -- 172.21.15.69:0/814719464 learned_addr learned my addr 172.21.15.69:0/814719464 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.121+0000 7f3a67e00640 1 --2- 172.21.15.69:0/814719464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a68108010 0x7f3a681a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.123 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.121+0000 7f3a66a00640 1 --2- 172.21.15.69:0/814719464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a681075e0 0x7f3a681a1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.124 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.122+0000 7f3a67e00640 1 -- 172.21.15.69:0/814719464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a681075e0 msgr2=0x7f3a681a1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.122+0000 7f3a67e00640 1 --2- 172.21.15.69:0/814719464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a681075e0 0x7f3a681a1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.122+0000 7f3a67e00640 1 -- 172.21.15.69:0/814719464 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a68102b90 msgr2=0x7f3a681a0da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.122+0000 7f3a67e00640 1 --2- 172.21.15.69:0/814719464 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a68102b90 0x7f3a681a0da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.123+0000 7f3a67e00640 1 -- 172.21.15.69:0/814719464 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a681a5c00 con 0x7f3a68108010 2024-05-14T15:34:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.123+0000 7f3a66a00640 1 --2- 172.21.15.69:0/814719464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a681075e0 0x7f3a681a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:34:17.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.124+0000 7f3a67e00640 1 --2- 172.21.15.69:0/814719464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a68108010 0x7f3a681a55c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009fd0 tx=0x7f3a6000ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.124+0000 7f3a5fe00640 1 -- 172.21.15.69:0/814719464 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a6000ce20 con 0x7f3a68108010 2024-05-14T15:34:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.125+0000 7f3a5fe00640 1 -- 172.21.15.69:0/814719464 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a60005020 con 0x7f3a68108010 2024-05-14T15:34:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.125+0000 7f3a5fe00640 1 -- 172.21.15.69:0/814719464 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a60010690 con 0x7f3a68108010 2024-05-14T15:34:17.126 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.125+0000 7f3a6e000640 1 -- 172.21.15.69:0/814719464 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a681a5ef0 con 0x7f3a68108010 2024-05-14T15:34:17.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.125+0000 7f3a6e000640 1 -- 172.21.15.69:0/814719464 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a681a63c0 con 0x7f3a68108010 2024-05-14T15:34:17.131 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.129+0000 7f3a74fe5740 1 Processor -- start 2024-05-14T15:34:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.131+0000 7f3a74fe5740 1 -- start start 2024-05-14T15:34:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.131+0000 7f3a5fe00640 1 -- 172.21.15.69:0/814719464 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3a60004a40 con 0x7f3a68108010 2024-05-14T15:34:17.133 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.132+0000 7f3a74fe5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07e21b0 0x55acf0b83280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.132+0000 7f3a74fe5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07b92f0 0x55acf0b837c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.132+0000 7f3a74fe5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b83d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.132+0000 7f3a74fe5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55acf0ae8550 con 0x55acf07c14d0 2024-05-14T15:34:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.132+0000 7f3a74fe5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55acf0a8dbc0 con 0x55acf07b92f0 2024-05-14T15:34:17.134 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.132+0000 7f3a74fe5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55acf0ae4510 con 0x55acf07e21b0 2024-05-14T15:34:17.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.134+0000 7f3a5fe00640 1 --2- 172.21.15.69:0/814719464 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3a4c0b2aa0 0x7f3a4c0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.135+0000 7f3a67e00640 1 --2- 172.21.15.69:0/814719464 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3a4c0b2aa0 0x7f3a4c0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.135+0000 7f3a66a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b83d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.135+0000 7f3a66a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b83d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52066/0 (socket says 172.21.15.69:52066) 2024-05-14T15:34:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.135+0000 7f3a66a00640 1 -- 172.21.15.69:0/1826013584 learned_addr learned my addr 172.21.15.69:0/1826013584 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.135+0000 7f3a66a00640 1 --2- 172.21.15.69:0/1826013584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07e21b0 0x55acf0b83280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.136+0000 7f3a67400640 1 --2- 172.21.15.69:0/1826013584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07b92f0 0x55acf0b837c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.136+0000 7f3a66a00640 1 -- 172.21.15.69:0/1826013584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07e21b0 msgr2=0x55acf0b83280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.136+0000 7f3a66a00640 1 --2- 172.21.15.69:0/1826013584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07e21b0 0x55acf0b83280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.136+0000 7f3a66a00640 1 -- 172.21.15.69:0/1826013584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07b92f0 msgr2=0x55acf0b837c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.136+0000 7f3a66a00640 1 --2- 172.21.15.69:0/1826013584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07b92f0 0x55acf0b837c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.136+0000 7f3a66a00640 1 -- 172.21.15.69:0/1826013584 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acf07fa210 con 0x55acf07c14d0 2024-05-14T15:34:17.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.137+0000 7f3a66a00640 1 --2- 172.21.15.69:0/1826013584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b83d00 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f3a540096c0 tx=0x7f3a54005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b674d3d906301012 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.138+0000 7f3a5fe00640 1 -- 172.21.15.69:0/814719464 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9554+0+0 (secure 0 0 0) 0x7f3a600e2fd0 con 0x7f3a68108010 2024-05-14T15:34:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.138+0000 7f3a67e00640 1 --2- 172.21.15.69:0/814719464 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3a4c0b2aa0 0x7f3a4c0b4fb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a6001a040 tx=0x7f3a60005f70 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.138+0000 7f3a53e00640 1 -- 172.21.15.69:0/1826013584 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a54035040 con 0x55acf07c14d0 2024-05-14T15:34:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.138+0000 7f3a53e00640 1 -- 172.21.15.69:0/1826013584 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a54003d40 con 0x55acf07c14d0 2024-05-14T15:34:17.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.138+0000 7f3a53e00640 1 -- 172.21.15.69:0/1826013584 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a54004e90 con 0x55acf07c14d0 2024-05-14T15:34:17.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.140+0000 7f3a74fe5740 1 -- 172.21.15.69:0/1826013584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 msgr2=0x55acf0b83d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:17.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.140+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/1826013584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b83d00 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f3a540096c0 tx=0x7f3a54005fd0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.140+0000 7f3a74fe5740 1 -- 172.21.15.69:0/1826013584 shutdown_connections 2024-05-14T15:34:17.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.140+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/1826013584 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b83d00 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.140+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/1826013584 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07b92f0 0x55acf0b837c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.140+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/1826013584 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07e21b0 0x55acf0b83280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.140+0000 7f3a74fe5740 1 -- 172.21.15.69:0/1826013584 >> 172.21.15.69:0/1826013584 conn(0x55acf07d6300 msgr2=0x55acf0b7fa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:17.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.140+0000 7f3a74fe5740 1 -- 172.21.15.69:0/1826013584 shutdown_connections 2024-05-14T15:34:17.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.140+0000 7f3a74fe5740 1 -- 172.21.15.69:0/1826013584 wait complete. 2024-05-14T15:34:17.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.141+0000 7f3a74fe5740 1 -- start start 2024-05-14T15:34:17.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.142+0000 7f3a74fe5740 1 Processor -- start 2024-05-14T15:34:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.143+0000 7f3a74fe5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07b92f0 0x55acf0b8d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.143+0000 7f3a74fe5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b8dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.143+0000 7f3a74fe5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07e21b0 0x55acf0baa870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.143+0000 7f3a74fe5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55acf0ba1360 con 0x55acf07c14d0 2024-05-14T15:34:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.143+0000 7f3a74fe5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55acf0aa1660 con 0x55acf07e21b0 2024-05-14T15:34:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.143+0000 7f3a74fe5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55acf0ba14e0 con 0x55acf07b92f0 2024-05-14T15:34:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.145+0000 7f3a74fe5740 10 client.0 _ll_register_callbacks cb 0x55acf0a6b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:34:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.144+0000 7f3a66a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07e21b0 0x55acf0baa870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.145+0000 7f3a66a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07e21b0 0x55acf0baa870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:35040/0 (socket says 172.21.15.69:35040) 2024-05-14T15:34:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.145+0000 7f3a66a00640 1 -- 172.21.15.69:0/4111946175 learned_addr learned my addr 172.21.15.69:0/4111946175 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:17.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.145+0000 7f3a66a00640 1 --2- 172.21.15.69:0/4111946175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07b92f0 0x55acf0b8d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.144+0000 7f3a67400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b8dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.146+0000 7f3a66a00640 1 -- 172.21.15.69:0/4111946175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07b92f0 msgr2=0x55acf0b8d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.146+0000 7f3a66a00640 1 --2- 172.21.15.69:0/4111946175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07b92f0 0x55acf0b8d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.148 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.146+0000 7f3a66a00640 1 -- 172.21.15.69:0/4111946175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 msgr2=0x55acf0b8dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.147+0000 7f3a66a00640 1 --2- 172.21.15.69:0/4111946175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b8dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.147+0000 7f3a66a00640 1 -- 172.21.15.69:0/4111946175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acf08c6620 con 0x55acf07e21b0 2024-05-14T15:34:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.147+0000 7f3a67400640 1 --2- 172.21.15.69:0/4111946175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b8dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:34:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.147+0000 7f3a66a00640 1 --2- 172.21.15.69:0/4111946175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07e21b0 0x55acf0baa870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55acf0b8cdc0 tx=0x7f3a5402a3f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7b1ff1e7700729f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.147+0000 7f3a50c00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:34:17.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.148+0000 7f3a50c00640 1 -- 172.21.15.69:0/4111946175 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a54035030 con 0x55acf07e21b0 2024-05-14T15:34:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.148+0000 7f3a50c00640 1 -- 172.21.15.69:0/4111946175 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9554+0+0 (secure 0 0 0) 0x7f3a540036b0 con 0x55acf07e21b0 2024-05-14T15:34:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.149+0000 7f3a74fe5740 1 -- 172.21.15.69:0/4111946175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a54003d40 con 0x55acf07e21b0 2024-05-14T15:34:17.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.149+0000 7f3a50c00640 1 -- 172.21.15.69:0/4111946175 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f3a54004a00 con 0x55acf07e21b0 2024-05-14T15:34:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.149+0000 7f3a74fe5740 10 client.36623 fetch_fsmap learned FSMap version 62 2024-05-14T15:34:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.149+0000 7f3a74fe5740 1 -- 172.21.15.69:0/4111946175 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55acf0bbe630 con 0x55acf07e21b0 2024-05-14T15:34:17.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.150+0000 7f3a50c00640 1 -- 172.21.15.69:0/4111946175 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a54003d40 con 0x55acf07e21b0 2024-05-14T15:34:17.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.152+0000 7f3a50c00640 1 -- 172.21.15.69:0/4111946175 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f3a5404aa80 con 0x55acf07e21b0 2024-05-14T15:34:17.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.153+0000 7f3a74fe5740 10 client.36623 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:34:17.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.153+0000 7f3a74fe5740 10 client.36623 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:34:17.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.153+0000 7f3a74fe5740 20 client.36623 populate_metadata read hostname 'smithi069' 2024-05-14T15:34:17.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.153+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/4111946175 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55acf07a0d80 0x55acf0bc1990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.153+0000 7f3a74fe5740 4 client.36623 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:34:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.153+0000 7f3a74fe5740 1 -- 172.21.15.69:0/4111946175 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55acf0af6160 con 0x55acf07a0d80 2024-05-14T15:34:17.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.153+0000 7f3a67400640 1 --2- 172.21.15.69:0/4111946175 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55acf07a0d80 0x55acf0bc1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.154+0000 7f3a67400640 1 --2- 172.21.15.69:0/4111946175 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55acf07a0d80 0x55acf0bc1990 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c28e7391226a841 server_cookie=21a5a9ea7fd6c319 in_seq=0 out_seq=0 2024-05-14T15:34:17.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.155+0000 7f3a50c00640 10 client.36623 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:34:17.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.156+0000 7f3a50c00640 1 -- 172.21.15.69:0/4111946175 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55acf0af6160 con 0x55acf07a0d80 2024-05-14T15:34:17.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.156+0000 7f3a50c00640 10 client.36623 handle_command_reply: tid=0 2024-05-14T15:34:17.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.156+0000 7f3a74fe5740 1 client.36623 shutdown 2024-05-14T15:34:17.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.157+0000 7f3a74fe5740 1 -- 172.21.15.69:0/4111946175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07e21b0 msgr2=0x55acf0baa870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.157+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/4111946175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07e21b0 0x55acf0baa870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55acf0b8cdc0 tx=0x7f3a5402a3f0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.157+0000 7f3a74fe5740 1 -- 172.21.15.69:0/4111946175 shutdown_connections 2024-05-14T15:34:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.157+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/4111946175 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07e21b0 0x55acf0baa870 secure :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0x55acf0b8cdc0 tx=0x7f3a5402a3f0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.157+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/4111946175 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55acf07a0d80 0x55acf0bc1990 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.157+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/4111946175 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b8dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.157+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/4111946175 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07b92f0 0x55acf0b8d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.157+0000 7f3a74fe5740 1 -- 172.21.15.69:0/4111946175 >> 172.21.15.69:0/4111946175 conn(0x55acf07d6300 msgr2=0x55acf0b84fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.157+0000 7f3a50c00640 0 client.36623 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:34:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.157+0000 7f3a74fe5740 1 -- 172.21.15.69:0/4111946175 shutdown_connections 2024-05-14T15:34:17.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.157+0000 7f3a74fe5740 1 -- 172.21.15.69:0/4111946175 wait complete. 2024-05-14T15:34:17.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.158+0000 7f3a74fe5740 20 client.36623 trim_cache size 0 max 16384 2024-05-14T15:34:17.212 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.210+0000 7f3a74fe5740 1 Processor -- start 2024-05-14T15:34:17.212 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.211+0000 7f3a74fe5740 1 -- start start 2024-05-14T15:34:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.212+0000 7f3a74fe5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07b92f0 0x55acf0b87d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.213+0000 7f3a74fe5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b83840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.213+0000 7f3a74fe5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07761c0 0x55acf0baa7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.213+0000 7f3a74fe5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6810b560 con 0x55acf07c14d0 2024-05-14T15:34:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.213+0000 7f3a74fe5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6810d0a0 con 0x55acf07b92f0 2024-05-14T15:34:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.213+0000 7f3a74fe5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6810bc30 con 0x55acf07761c0 2024-05-14T15:34:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.214+0000 7f3a67400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b83840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.214+0000 7f3a67400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b83840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52080/0 (socket says 172.21.15.69:52080) 2024-05-14T15:34:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.214+0000 7f3a67400640 1 -- 172.21.15.69:0/831265573 learned_addr learned my addr 172.21.15.69:0/831265573 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.214+0000 7f3a66a00640 1 --2- 172.21.15.69:0/831265573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07b92f0 0x55acf0b87d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.215+0000 7f3a66a00640 1 --2- 172.21.15.69:0/831265573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07761c0 0x55acf0baa7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.215+0000 7f3a66a00640 1 -- 172.21.15.69:0/831265573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07761c0 msgr2=0x55acf0baa7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.215+0000 7f3a66a00640 1 --2- 172.21.15.69:0/831265573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07761c0 0x55acf0baa7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.215+0000 7f3a66a00640 1 -- 172.21.15.69:0/831265573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 msgr2=0x55acf0b83840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.215+0000 7f3a66a00640 1 --2- 172.21.15.69:0/831265573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b83840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.215+0000 7f3a66a00640 1 -- 172.21.15.69:0/831265573 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55acf0b8e040 con 0x55acf07b92f0 2024-05-14T15:34:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.215+0000 7f3a67400640 1 --2- 172.21.15.69:0/831265573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b83840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:34:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.216+0000 7f3a66a00640 1 --2- 172.21.15.69:0/831265573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07b92f0 0x55acf0b87d50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55acf0b8e230 tx=0x7f3a54005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4367d7ab1f62242b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:17.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.217+0000 7f3a53400640 1 -- 172.21.15.69:0/831265573 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a54035020 con 0x55acf07b92f0 2024-05-14T15:34:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.217+0000 7f3a53400640 1 -- 172.21.15.69:0/831265573 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a54051070 con 0x55acf07b92f0 2024-05-14T15:34:17.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.218+0000 7f3a53400640 1 -- 172.21.15.69:0/831265573 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a5404a7e0 con 0x55acf07b92f0 2024-05-14T15:34:17.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.219+0000 7f3a74fe5740 1 -- 172.21.15.69:0/831265573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07b92f0 msgr2=0x55acf0b87d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:17.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.219+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/831265573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07b92f0 0x55acf0b87d50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x55acf0b8e230 tx=0x7f3a54005fd0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.220+0000 7f3a74fe5740 1 -- 172.21.15.69:0/831265573 shutdown_connections 2024-05-14T15:34:17.226 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.225+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/831265573 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07761c0 0x55acf0baa7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.225+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/831265573 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0b83840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.225+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/831265573 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07b92f0 0x55acf0b87d50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.225+0000 7f3a74fe5740 1 -- 172.21.15.69:0/831265573 >> 172.21.15.69:0/831265573 conn(0x55acf07d6300 msgr2=0x55acf0b83130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.226+0000 7f3a74fe5740 1 -- 172.21.15.69:0/831265573 shutdown_connections 2024-05-14T15:34:17.227 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.226+0000 7f3a74fe5740 1 -- 172.21.15.69:0/831265573 wait complete. 2024-05-14T15:34:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.226+0000 7f3a74fe5740 1 -- start start 2024-05-14T15:34:17.229 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.227+0000 7f3a74fe5740 1 Processor -- start 2024-05-14T15:34:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.228+0000 7f3a74fe5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07761c0 0x55acf0bc48e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.228+0000 7f3a74fe5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07b92f0 0x55acf0bc4e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.228+0000 7f3a74fe5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0bc1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.228+0000 7f3a74fe5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6810c9d0 con 0x55acf07c14d0 2024-05-14T15:34:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.228+0000 7f3a74fe5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6810c300 con 0x55acf07761c0 2024-05-14T15:34:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.228+0000 7f3a74fe5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3a6806a240 con 0x55acf07b92f0 2024-05-14T15:34:17.230 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.228+0000 7f3a74fe5740 10 client.0 _ll_register_callbacks cb 0x7f3a54005190 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:34:17.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.229+0000 7f3a67400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07b92f0 0x55acf0bc4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.229+0000 7f3a67400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07b92f0 0x55acf0bc4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:33890/0 (socket says 172.21.15.69:33890) 2024-05-14T15:34:17.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.229+0000 7f3a67400640 1 -- 172.21.15.69:0/3923595782 learned_addr learned my addr 172.21.15.69:0/3923595782 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:17.231 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.229+0000 7f3a66a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0bc1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.230+0000 7f3a66a00640 1 --2- 172.21.15.69:0/3923595782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07761c0 0x55acf0bc48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.230+0000 7f3a66a00640 1 -- 172.21.15.69:0/3923595782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07b92f0 msgr2=0x55acf0bc4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.230+0000 7f3a66a00640 1 --2- 172.21.15.69:0/3923595782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07b92f0 0x55acf0bc4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.230+0000 7f3a66a00640 1 -- 172.21.15.69:0/3923595782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07761c0 msgr2=0x55acf0bc48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.230+0000 7f3a66a00640 1 --2- 172.21.15.69:0/3923595782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07761c0 0x55acf0bc48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.230+0000 7f3a66a00640 1 -- 172.21.15.69:0/3923595782 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55acf0bc23b0 con 0x55acf07c14d0 2024-05-14T15:34:17.232 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.231+0000 7f3a66a00640 1 --2- 172.21.15.69:0/3923595782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0bc1d70 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3a54005e80 tx=0x7f3a54005850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9a24670330e515 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:17.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.231+0000 7f3a50c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:34:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.232+0000 7f3a50c00640 1 -- 172.21.15.69:0/3923595782 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a54035040 con 0x55acf07c14d0 2024-05-14T15:34:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.232+0000 7f3a50c00640 1 -- 172.21.15.69:0/3923595782 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9554+0+0 (secure 0 0 0) 0x7f3a54004e20 con 0x55acf07c14d0 2024-05-14T15:34:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.232+0000 7f3a74fe5740 1 -- 172.21.15.69:0/3923595782 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3a54051070 con 0x55acf07c14d0 2024-05-14T15:34:17.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.233+0000 7f3a50c00640 1 -- 172.21.15.69:0/3923595782 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7f3a54035040 con 0x55acf07c14d0 2024-05-14T15:34:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.234+0000 7f3a74fe5740 10 client.17112 fetch_fsmap learned FSMap version 62 2024-05-14T15:34:17.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.234+0000 7f3a74fe5740 1 -- 172.21.15.69:0/3923595782 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55acf0c29470 con 0x55acf07c14d0 2024-05-14T15:34:17.236 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.235+0000 7f3a50c00640 1 -- 172.21.15.69:0/3923595782 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3a5404ac20 con 0x55acf07c14d0 2024-05-14T15:34:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.236+0000 7f3a50c00640 1 -- 172.21.15.69:0/3923595782 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7f3a54059930 con 0x55acf07c14d0 2024-05-14T15:34:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.236+0000 7f3a74fe5740 10 client.17112 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:34:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.236+0000 7f3a74fe5740 10 client.17112 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:34:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.236+0000 7f3a74fe5740 20 client.17112 populate_metadata read hostname 'smithi069' 2024-05-14T15:34:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.236+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/3923595782 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55acf0c29830 0x55acf0c2bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.236+0000 7f3a74fe5740 4 client.17112 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:34:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.236+0000 7f3a74fe5740 1 -- 172.21.15.69:0/3923595782 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7f3a54051070 con 0x55acf0c29830 2024-05-14T15:34:17.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.237+0000 7f3a67400640 1 --2- 172.21.15.69:0/3923595782 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55acf0c29830 0x55acf0c2bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.238+0000 7f3a50c00640 10 client.17112 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:34:17.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.238+0000 7f3a67400640 1 --2- 172.21.15.69:0/3923595782 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55acf0c29830 0x55acf0c2bc80 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cfcc546da061390 server_cookie=689836011fa3d2d2 in_seq=0 out_seq=0 2024-05-14T15:34:17.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.292+0000 7f3a50c00640 1 -- 172.21.15.69:0/3923595782 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7f3a54051070 con 0x55acf0c29830 2024-05-14T15:34:17.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.292+0000 7f3a50c00640 10 client.17112 handle_command_reply: tid=0 2024-05-14T15:34:17.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.293+0000 7f3a74fe5740 1 client.17112 shutdown 2024-05-14T15:34:17.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.293+0000 7f3a74fe5740 1 -- 172.21.15.69:0/3923595782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 msgr2=0x55acf0bc1d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:17.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.293+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/3923595782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0bc1d70 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3a54005e80 tx=0x7f3a54005850 comp rx=0 tx=0).stop 2024-05-14T15:34:17.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.294+0000 7f3a74fe5740 1 -- 172.21.15.69:0/3923595782 shutdown_connections 2024-05-14T15:34:17.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.294+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/3923595782 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55acf0c29830 0x55acf0c2bc80 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.294+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/3923595782 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55acf07c14d0 0x55acf0bc1d70 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.294+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/3923595782 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55acf07b92f0 0x55acf0bc4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.294+0000 7f3a74fe5740 1 --2- 172.21.15.69:0/3923595782 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55acf07761c0 0x55acf0bc48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.294+0000 7f3a74fe5740 1 -- 172.21.15.69:0/3923595782 >> 172.21.15.69:0/3923595782 conn(0x55acf07d6300 msgr2=0x55acf0b7f980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:17.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.294+0000 7f3a50c00640 0 client.17112 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:34:17.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.295+0000 7f3a74fe5740 1 -- 172.21.15.69:0/3923595782 shutdown_connections 2024-05-14T15:34:17.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.295+0000 7f3a74fe5740 1 -- 172.21.15.69:0/3923595782 wait complete. 2024-05-14T15:34:17.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.296+0000 7f3a74fe5740 20 client.17112 trim_cache size 0 max 16384 2024-05-14T15:34:17.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:34:17.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:34:17.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:34:17.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:34:17.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.298+0000 7f3a6e000640 1 -- 172.21.15.69:0/814719464 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3a4c0b2aa0 msgr2=0x7f3a4c0b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:17.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.298+0000 7f3a6e000640 1 --2- 172.21.15.69:0/814719464 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3a4c0b2aa0 0x7f3a4c0b4fb0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a6001a040 tx=0x7f3a60005f70 comp rx=0 tx=0).stop 2024-05-14T15:34:17.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.298+0000 7f3a6e000640 1 -- 172.21.15.69:0/814719464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a68108010 msgr2=0x7f3a681a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:17.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.298+0000 7f3a6e000640 1 --2- 172.21.15.69:0/814719464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a68108010 0x7f3a681a55c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3a60009fd0 tx=0x7f3a6000ef10 comp rx=0 tx=0).stop 2024-05-14T15:34:17.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.299+0000 7f3a6e000640 1 -- 172.21.15.69:0/814719464 shutdown_connections 2024-05-14T15:34:17.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.299+0000 7f3a6e000640 1 --2- 172.21.15.69:0/814719464 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3a4c0b2aa0 0x7f3a4c0b4fb0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.299+0000 7f3a6e000640 1 --2- 172.21.15.69:0/814719464 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3a68108010 0x7f3a681a55c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.299+0000 7f3a6e000640 1 --2- 172.21.15.69:0/814719464 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3a681075e0 0x7f3a681a1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.299+0000 7f3a6e000640 1 --2- 172.21.15.69:0/814719464 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3a68102b90 0x7f3a681a0da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.299+0000 7f3a6e000640 1 -- 172.21.15.69:0/814719464 >> 172.21.15.69:0/814719464 conn(0x7f3a680782e0 msgr2=0x7f3a68105240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:17.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.300+0000 7f3a6e000640 1 -- 172.21.15.69:0/814719464 shutdown_connections 2024-05-14T15:34:17.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:17.300+0000 7f3a6e000640 1 -- 172.21.15.69:0/814719464 wait complete. 2024-05-14T15:34:18.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:17 smithi092 ceph-mon[34729]: pgmap v396: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 7.8 MiB/s wr, 494 op/s 2024-05-14T15:34:18.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:17 smithi069 ceph-mon[31270]: pgmap v396: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 7.8 MiB/s wr, 494 op/s 2024-05-14T15:34:18.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:17 smithi203 ceph-mon[34567]: pgmap v396: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 7.8 MiB/s wr, 494 op/s 2024-05-14T15:34:20.128 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:19 smithi069 ceph-mon[31270]: pgmap v397: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 7.8 MiB/s wr, 494 op/s 2024-05-14T15:34:20.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:19 smithi092 ceph-mon[34729]: pgmap v397: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 7.8 MiB/s wr, 494 op/s 2024-05-14T15:34:20.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:19 smithi203 ceph-mon[34567]: pgmap v397: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 7.8 MiB/s wr, 494 op/s 2024-05-14T15:34:21.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 515.0 s, 589.4 tps, lat 171.761 ms stddev 280.209 2024-05-14T15:34:22.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:21 smithi092 ceph-mon[34729]: pgmap v398: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 9.4 MiB/s wr, 588 op/s 2024-05-14T15:34:22.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:21 smithi069 ceph-mon[31270]: pgmap v398: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 9.4 MiB/s wr, 588 op/s 2024-05-14T15:34:22.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:21 smithi203 ceph-mon[34567]: pgmap v398: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 9.4 MiB/s wr, 588 op/s 2024-05-14T15:34:23.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:22 smithi092 ceph-mon[34729]: pgmap v399: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.1 MiB/s wr, 510 op/s 2024-05-14T15:34:23.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:22 smithi069 ceph-mon[31270]: pgmap v399: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.1 MiB/s wr, 510 op/s 2024-05-14T15:34:23.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:22 smithi203 ceph-mon[34567]: pgmap v399: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.1 MiB/s wr, 510 op/s 2024-05-14T15:34:25.598 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:25 smithi203 ceph-mon[34567]: pgmap v400: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.6 MiB/s wr, 566 op/s 2024-05-14T15:34:25.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:25 smithi092 ceph-mon[34729]: pgmap v400: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.6 MiB/s wr, 566 op/s 2024-05-14T15:34:25.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:25 smithi069 ceph-mon[31270]: pgmap v400: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 8.6 MiB/s wr, 566 op/s 2024-05-14T15:34:26.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 520.0 s, 553.4 tps, lat 151.968 ms stddev 46.862 2024-05-14T15:34:27.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:27 smithi203 ceph-mon[34567]: pgmap v401: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 10 MiB/s wr, 658 op/s 2024-05-14T15:34:27.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:27 smithi092 ceph-mon[34729]: pgmap v401: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 10 MiB/s wr, 658 op/s 2024-05-14T15:34:27.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:27 smithi069 ceph-mon[31270]: pgmap v401: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 10 MiB/s wr, 658 op/s 2024-05-14T15:34:29.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:29 smithi203 ceph-mon[34567]: pgmap v402: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.2 MiB/s wr, 509 op/s 2024-05-14T15:34:29.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:29 smithi092 ceph-mon[34729]: pgmap v402: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.2 MiB/s wr, 509 op/s 2024-05-14T15:34:29.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:29 smithi069 ceph-mon[31270]: pgmap v402: 129 pgs: 129 active+clean; 2.9 GiB data, 17 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.2 MiB/s wr, 509 op/s 2024-05-14T15:34:31.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 525.0 s, 648.7 tps, lat 178.196 ms stddev 272.123 2024-05-14T15:34:31.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:31 smithi203 ceph-mon[34567]: pgmap v403: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 11 MiB/s wr, 747 op/s 2024-05-14T15:34:31.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:31 smithi092 ceph-mon[34729]: pgmap v403: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 11 MiB/s wr, 747 op/s 2024-05-14T15:34:31.727 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:31 smithi069 ceph-mon[31270]: pgmap v403: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 75 KiB/s rd, 11 MiB/s wr, 747 op/s 2024-05-14T15:34:32.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.666+0000 7fe59b600640 1 -- 172.21.15.69:0/3908863236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe594076520 msgr2=0x7fe594076930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.666+0000 7fe59b600640 1 --2- 172.21.15.69:0/3908863236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe594076520 0x7fe594076930 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fe588009900 tx=0x7fe58802a480 comp rx=0 tx=0).stop 2024-05-14T15:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.667+0000 7fe59b600640 1 -- 172.21.15.69:0/3908863236 shutdown_connections 2024-05-14T15:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.667+0000 7fe59b600640 1 --2- 172.21.15.69:0/3908863236 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe5941104f0 0x7fe594112910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.667+0000 7fe59b600640 1 --2- 172.21.15.69:0/3908863236 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe59410db90 0x7fe59410ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.667+0000 7fe59b600640 1 --2- 172.21.15.69:0/3908863236 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe594076520 0x7fe594076930 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.667+0000 7fe59b600640 1 -- 172.21.15.69:0/3908863236 >> 172.21.15.69:0/3908863236 conn(0x7fe5940ff360 msgr2=0x7fe5941017b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.667+0000 7fe59b600640 1 -- 172.21.15.69:0/3908863236 shutdown_connections 2024-05-14T15:34:32.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.667+0000 7fe59b600640 1 -- 172.21.15.69:0/3908863236 wait complete. 2024-05-14T15:34:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.669+0000 7fe59b600640 1 Processor -- start 2024-05-14T15:34:32.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.669+0000 7fe59b600640 1 -- start start 2024-05-14T15:34:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.670+0000 7fe59b600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe594076520 0x7fe5941a2640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.670+0000 7fe59b600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe59410db90 0x7fe5941a2b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:32.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.670+0000 7fe59b600640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5941104f0 0x7fe59419c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.670+0000 7fe59b600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe594115f50 con 0x7fe594076520 2024-05-14T15:34:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.670+0000 7fe59b600640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe594115dd0 con 0x7fe5941104f0 2024-05-14T15:34:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.670+0000 7fe59b600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe5941160d0 con 0x7fe59410db90 2024-05-14T15:34:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.670+0000 7fe598c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe594076520 0x7fe5941a2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.670+0000 7fe598c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe594076520 0x7fe5941a2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:45938/0 (socket says 172.21.15.69:45938) 2024-05-14T15:34:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.670+0000 7fe598c00640 1 -- 172.21.15.69:0/3789052478 learned_addr learned my addr 172.21.15.69:0/3789052478 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:32.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.671+0000 7fe598c00640 1 -- 172.21.15.69:0/3789052478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe59410db90 msgr2=0x7fe5941a2b80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-14T15:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.671+0000 7fe598c00640 1 --2- 172.21.15.69:0/3789052478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe59410db90 0x7fe5941a2b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.671+0000 7fe598c00640 1 -- 172.21.15.69:0/3789052478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5941104f0 msgr2=0x7fe59419c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.671+0000 7fe598c00640 1 --2- 172.21.15.69:0/3789052478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5941104f0 0x7fe59419c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.671+0000 7fe598c00640 1 -- 172.21.15.69:0/3789052478 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe59419cf50 con 0x7fe594076520 2024-05-14T15:34:32.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.672+0000 7fe598c00640 1 --2- 172.21.15.69:0/3789052478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe594076520 0x7fe5941a2640 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe58802a9a0 tx=0x7fe588003b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.673+0000 7fe591600640 1 -- 172.21.15.69:0/3789052478 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58803f070 con 0x7fe594076520 2024-05-14T15:34:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.673+0000 7fe591600640 1 -- 172.21.15.69:0/3789052478 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe58803baf0 con 0x7fe594076520 2024-05-14T15:34:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.673+0000 7fe591600640 1 -- 172.21.15.69:0/3789052478 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588035030 con 0x7fe594076520 2024-05-14T15:34:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.673+0000 7fe59b600640 1 -- 172.21.15.69:0/3789052478 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe59419d1e0 con 0x7fe594076520 2024-05-14T15:34:32.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.674+0000 7fe59b600640 1 -- 172.21.15.69:0/3789052478 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe59419d6d0 con 0x7fe594076520 2024-05-14T15:34:32.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.678+0000 7fe591600640 1 -- 172.21.15.69:0/3789052478 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe588042070 con 0x7fe594076520 2024-05-14T15:34:32.681 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.680+0000 7fe591600640 1 --2- 172.21.15.69:0/3789052478 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe57c0b2aa0 0x7fe57c0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.683+0000 7fe593e00640 1 --2- 172.21.15.69:0/3789052478 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe57c0b2aa0 0x7fe57c0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:32.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.683+0000 7fe591600640 1 -- 172.21.15.69:0/3789052478 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9554+0+0 (secure 0 0 0) 0x7fe588102b90 con 0x7fe594076520 2024-05-14T15:34:32.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:32.684+0000 7fe593e00640 1 --2- 172.21.15.69:0/3789052478 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe57c0b2aa0 0x7fe57c0b4fb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe594112340 tx=0x7fe58000b370 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:33.487 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.486+0000 7fe5a262e740 1 Processor -- start 2024-05-14T15:34:33.488 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.487+0000 7fe5a262e740 1 -- start start 2024-05-14T15:34:33.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.488+0000 7fe5a262e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbe91b0 0x557e9cf8a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:33.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.488+0000 7fe5a262e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbc02f0 0x557e9cf8a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:33.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.488+0000 7fe5a262e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc84d0 0x557e9cf8ad00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:33.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.488+0000 7fe5a262e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x557e9ceef550 con 0x557e9cbc02f0 2024-05-14T15:34:33.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.488+0000 7fe5a262e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557e9ce94bc0 con 0x557e9cbe91b0 2024-05-14T15:34:33.489 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.488+0000 7fe5a262e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557e9ceeb510 con 0x557e9cbc84d0 2024-05-14T15:34:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.488+0000 7fe598c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbe91b0 0x557e9cf8a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.489+0000 7fe598c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbe91b0 0x557e9cf8a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:37102/0 (socket says 172.21.15.69:37102) 2024-05-14T15:34:33.490 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.489+0000 7fe598c00640 1 -- 172.21.15.69:0/1632561425 learned_addr learned my addr 172.21.15.69:0/1632561425 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.489+0000 7fe599600640 1 --2- 172.21.15.69:0/1632561425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc84d0 0x557e9cf8ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.489+0000 7fe598c00640 1 -- 172.21.15.69:0/1632561425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc84d0 msgr2=0x557e9cf8ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.489+0000 7fe598c00640 1 --2- 172.21.15.69:0/1632561425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc84d0 0x557e9cf8ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.489+0000 7fe598c00640 1 -- 172.21.15.69:0/1632561425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbc02f0 msgr2=0x557e9cf8a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.489+0000 7fe598c00640 1 --2- 172.21.15.69:0/1632561425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbc02f0 0x557e9cf8a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.491 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.489+0000 7fe598c00640 1 -- 172.21.15.69:0/1632561425 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9cc01210 con 0x557e9cbe91b0 2024-05-14T15:34:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.490+0000 7fe598c00640 1 --2- 172.21.15.69:0/1632561425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbe91b0 0x557e9cf8a280 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe5880c9990 tx=0x7fe58802a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7d401bd682c89839 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.490+0000 7fe585c00640 1 -- 172.21.15.69:0/1632561425 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe588049040 con 0x557e9cbe91b0 2024-05-14T15:34:33.492 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.491+0000 7fe585c00640 1 -- 172.21.15.69:0/1632561425 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5880d21b0 con 0x557e9cbe91b0 2024-05-14T15:34:33.493 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.491+0000 7fe585c00640 1 -- 172.21.15.69:0/1632561425 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5880c5c90 con 0x557e9cbe91b0 2024-05-14T15:34:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.493+0000 7fe5a262e740 1 -- 172.21.15.69:0/1632561425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbe91b0 msgr2=0x557e9cf8a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.493+0000 7fe5a262e740 1 --2- 172.21.15.69:0/1632561425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbe91b0 0x557e9cf8a280 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fe5880c9990 tx=0x7fe58802a480 comp rx=0 tx=0).stop 2024-05-14T15:34:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.493+0000 7fe5a262e740 1 -- 172.21.15.69:0/1632561425 shutdown_connections 2024-05-14T15:34:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.493+0000 7fe5a262e740 1 --2- 172.21.15.69:0/1632561425 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc84d0 0x557e9cf8ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.493+0000 7fe5a262e740 1 --2- 172.21.15.69:0/1632561425 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbc02f0 0x557e9cf8a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.494+0000 7fe5a262e740 1 --2- 172.21.15.69:0/1632561425 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbe91b0 0x557e9cf8a280 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.495 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.494+0000 7fe5a262e740 1 -- 172.21.15.69:0/1632561425 >> 172.21.15.69:0/1632561425 conn(0x557e9cbdd300 msgr2=0x557e9cf86a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.494+0000 7fe5a262e740 1 -- 172.21.15.69:0/1632561425 shutdown_connections 2024-05-14T15:34:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.494+0000 7fe5a262e740 1 -- 172.21.15.69:0/1632561425 wait complete. 2024-05-14T15:34:33.496 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.495+0000 7fe5a262e740 1 -- start start 2024-05-14T15:34:33.497 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.496+0000 7fe5a262e740 1 Processor -- start 2024-05-14T15:34:33.498 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.497+0000 7fe5a262e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbc02f0 0x557e9cf94850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.497+0000 7fe5a262e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc84d0 0x557e9cf94d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.497+0000 7fe598c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbc02f0 0x557e9cf94850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.498+0000 7fe598c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbc02f0 0x557e9cf94850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39108/0 (socket says 172.21.15.69:39108) 2024-05-14T15:34:33.499 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.498+0000 7fe598c00640 1 -- 172.21.15.69:0/2209968829 learned_addr learned my addr 172.21.15.69:0/2209968829 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.498+0000 7fe5a262e740 1 --2- 172.21.15.69:0/2209968829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbe91b0 0x557e9cfa8cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.498+0000 7fe5a262e740 1 -- 172.21.15.69:0/2209968829 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x557e9ce94bc0 con 0x557e9cbc02f0 2024-05-14T15:34:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.498+0000 7fe5a262e740 1 -- 172.21.15.69:0/2209968829 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557e9cea8660 con 0x557e9cbe91b0 2024-05-14T15:34:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.498+0000 7fe5a262e740 1 -- 172.21.15.69:0/2209968829 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557e9cf9f980 con 0x557e9cbc84d0 2024-05-14T15:34:33.500 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.498+0000 7fe5a262e740 10 client.0 _ll_register_callbacks cb 0x557e9ce72400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:34:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.499+0000 7fe599600640 1 --2- 172.21.15.69:0/2209968829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbe91b0 0x557e9cfa8cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.499+0000 7fe593e00640 1 --2- 172.21.15.69:0/2209968829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc84d0 0x557e9cf94d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.499+0000 7fe598c00640 1 -- 172.21.15.69:0/2209968829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc84d0 msgr2=0x557e9cf94d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.499+0000 7fe598c00640 1 --2- 172.21.15.69:0/2209968829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc84d0 0x557e9cf94d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.499+0000 7fe598c00640 1 -- 172.21.15.69:0/2209968829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbe91b0 msgr2=0x557e9cfa8cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.499+0000 7fe598c00640 1 --2- 172.21.15.69:0/2209968829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbe91b0 0x557e9cfa8cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.499+0000 7fe598c00640 1 -- 172.21.15.69:0/2209968829 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e9cccd620 con 0x557e9cbc02f0 2024-05-14T15:34:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.500+0000 7fe598c00640 1 --2- 172.21.15.69:0/2209968829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbc02f0 0x557e9cf94850 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe588005e20 tx=0x7fe588009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f04f46ae88198293 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:33.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.500+0000 7fe57a000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:34:33.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.501+0000 7fe57a000640 1 -- 172.21.15.69:0/2209968829 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5880e2030 con 0x557e9cbc02f0 2024-05-14T15:34:33.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.501+0000 7fe57a000640 1 -- 172.21.15.69:0/2209968829 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9554+0+0 (secure 0 0 0) 0x7fe5880c5ff0 con 0x557e9cbc02f0 2024-05-14T15:34:33.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.502+0000 7fe5a262e740 1 -- 172.21.15.69:0/2209968829 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe5880d21b0 con 0x557e9cbc02f0 2024-05-14T15:34:33.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.503+0000 7fe57a000640 1 -- 172.21.15.69:0/2209968829 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fe588049040 con 0x557e9cbc02f0 2024-05-14T15:34:33.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.503+0000 7fe5a262e740 10 client.17121 fetch_fsmap learned FSMap version 62 2024-05-14T15:34:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.503+0000 7fe5a262e740 1 -- 172.21.15.69:0/2209968829 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x557e9cfabb30 con 0x557e9cbc02f0 2024-05-14T15:34:33.505 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.504+0000 7fe57a000640 1 -- 172.21.15.69:0/2209968829 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe5880d21b0 con 0x557e9cbc02f0 2024-05-14T15:34:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.504+0000 7fe57a000640 1 -- 172.21.15.69:0/2209968829 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7fe5880e5020 con 0x557e9cbc02f0 2024-05-14T15:34:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.505+0000 7fe5a262e740 10 client.17121 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:34:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.505+0000 7fe5a262e740 10 client.17121 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:34:33.506 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.505+0000 7fe5a262e740 20 client.17121 populate_metadata read hostname 'smithi069' 2024-05-14T15:34:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.505+0000 7fe5a262e740 1 --2- 172.21.15.69:0/2209968829 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557e9cba7d80 0x557e9cfaee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.505+0000 7fe5a262e740 4 client.17121 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:34:33.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.505+0000 7fe5a262e740 1 -- 172.21.15.69:0/2209968829 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e9cefd160 con 0x557e9cba7d80 2024-05-14T15:34:33.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.506+0000 7fe593e00640 1 --2- 172.21.15.69:0/2209968829 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557e9cba7d80 0x557e9cfaee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.510+0000 7fe593e00640 1 --2- 172.21.15.69:0/2209968829 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557e9cba7d80 0x557e9cfaee90 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de2a3725526f95b7 server_cookie=a8d8e250ca835727 in_seq=0 out_seq=0 2024-05-14T15:34:33.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.511+0000 7fe57a000640 10 client.17121 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:34:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.512+0000 7fe57a000640 1 -- 172.21.15.69:0/2209968829 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557e9cefd160 con 0x557e9cba7d80 2024-05-14T15:34:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.513+0000 7fe57a000640 10 client.17121 handle_command_reply: tid=0 2024-05-14T15:34:33.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.513+0000 7fe5a262e740 1 client.17121 shutdown 2024-05-14T15:34:33.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.514+0000 7fe5a262e740 1 -- 172.21.15.69:0/2209968829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbc02f0 msgr2=0x557e9cf94850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:33.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.514+0000 7fe5a262e740 1 --2- 172.21.15.69:0/2209968829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbc02f0 0x557e9cf94850 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7fe588005e20 tx=0x7fe588009260 comp rx=0 tx=0).stop 2024-05-14T15:34:33.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.514+0000 7fe5a262e740 1 -- 172.21.15.69:0/2209968829 shutdown_connections 2024-05-14T15:34:33.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.514+0000 7fe5a262e740 1 --2- 172.21.15.69:0/2209968829 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbe91b0 0x557e9cfa8cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.514+0000 7fe5a262e740 1 --2- 172.21.15.69:0/2209968829 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc84d0 0x557e9cf94d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.514+0000 7fe5a262e740 1 --2- 172.21.15.69:0/2209968829 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557e9cba7d80 0x557e9cfaee90 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.514+0000 7fe5a262e740 1 --2- 172.21.15.69:0/2209968829 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbc02f0 0x557e9cf94850 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.514+0000 7fe5a262e740 1 -- 172.21.15.69:0/2209968829 >> 172.21.15.69:0/2209968829 conn(0x557e9cbdd300 msgr2=0x557e9cf8a050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:33.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.515+0000 7fe57a000640 0 client.17121 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:34:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.516+0000 7fe5a262e740 1 -- 172.21.15.69:0/2209968829 shutdown_connections 2024-05-14T15:34:33.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.516+0000 7fe5a262e740 1 -- 172.21.15.69:0/2209968829 wait complete. 2024-05-14T15:34:33.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.517+0000 7fe5a262e740 20 client.17121 trim_cache size 0 max 16384 2024-05-14T15:34:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.558+0000 7fe5a262e740 1 Processor -- start 2024-05-14T15:34:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.558+0000 7fe5a262e740 1 -- start start 2024-05-14T15:34:33.559 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.558+0000 7fe5a262e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc02f0 0x557e9cfb44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.558+0000 7fe5a262e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbc84d0 0x557e9cfb4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.558+0000 7fe5a262e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbe91b0 0x557e9cfa8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.558+0000 7fe5a262e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe5941af2f0 con 0x557e9cbe91b0 2024-05-14T15:34:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.558+0000 7fe5a262e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5941b0e30 con 0x557e9cbc84d0 2024-05-14T15:34:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.558+0000 7fe5a262e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe5941af9c0 con 0x557e9cbc02f0 2024-05-14T15:34:33.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.559+0000 7fe593e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbc84d0 0x557e9cfb4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.559+0000 7fe593e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbc84d0 0x557e9cfb4a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:37118/0 (socket says 172.21.15.69:37118) 2024-05-14T15:34:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.559+0000 7fe593e00640 1 -- 172.21.15.69:0/1740985030 learned_addr learned my addr 172.21.15.69:0/1740985030 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.559+0000 7fe598c00640 1 --2- 172.21.15.69:0/1740985030 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc02f0 0x557e9cfb44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:33.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.559+0000 7fe599600640 1 --2- 172.21.15.69:0/1740985030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbe91b0 0x557e9cfa8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.560+0000 7fe593e00640 1 -- 172.21.15.69:0/1740985030 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc02f0 msgr2=0x557e9cfb44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.560+0000 7fe593e00640 1 --2- 172.21.15.69:0/1740985030 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc02f0 0x557e9cfb44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.560+0000 7fe593e00640 1 -- 172.21.15.69:0/1740985030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbe91b0 msgr2=0x557e9cfa8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.561+0000 7fe593e00640 1 --2- 172.21.15.69:0/1740985030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbe91b0 0x557e9cfa8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.561+0000 7fe593e00640 1 -- 172.21.15.69:0/1740985030 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e9cf8b660 con 0x557e9cbc84d0 2024-05-14T15:34:33.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.561+0000 7fe599600640 1 --2- 172.21.15.69:0/1740985030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbe91b0 0x557e9cfa8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:34:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.562+0000 7fe593e00640 1 --2- 172.21.15.69:0/1740985030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbc84d0 0x557e9cfb4a00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe59406b690 tx=0x7fe5800046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65996bf8609ace25 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.564+0000 7fe585200640 1 -- 172.21.15.69:0/1740985030 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe580010cb0 con 0x557e9cbc84d0 2024-05-14T15:34:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.564+0000 7fe585200640 1 -- 172.21.15.69:0/1740985030 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe58002a070 con 0x557e9cbc84d0 2024-05-14T15:34:33.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.564+0000 7fe585200640 1 -- 172.21.15.69:0/1740985030 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58001e6b0 con 0x557e9cbc84d0 2024-05-14T15:34:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.567+0000 7fe5a262e740 1 -- 172.21.15.69:0/1740985030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbc84d0 msgr2=0x557e9cfb4a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:33.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.567+0000 7fe5a262e740 1 --2- 172.21.15.69:0/1740985030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbc84d0 0x557e9cfb4a00 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fe59406b690 tx=0x7fe5800046c0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.567+0000 7fe5a262e740 1 -- 172.21.15.69:0/1740985030 shutdown_connections 2024-05-14T15:34:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.567+0000 7fe5a262e740 1 --2- 172.21.15.69:0/1740985030 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbe91b0 0x557e9cfa8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.567+0000 7fe5a262e740 1 --2- 172.21.15.69:0/1740985030 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbc84d0 0x557e9cfb4a00 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.567+0000 7fe5a262e740 1 --2- 172.21.15.69:0/1740985030 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc02f0 0x557e9cfb44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.567+0000 7fe5a262e740 1 -- 172.21.15.69:0/1740985030 >> 172.21.15.69:0/1740985030 conn(0x557e9cbdd300 msgr2=0x557e9cf8aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.568+0000 7fe5a262e740 1 -- 172.21.15.69:0/1740985030 shutdown_connections 2024-05-14T15:34:33.570 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.568+0000 7fe5a262e740 1 -- 172.21.15.69:0/1740985030 wait complete. 2024-05-14T15:34:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.569+0000 7fe5a262e740 1 -- start start 2024-05-14T15:34:33.571 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.569+0000 7fe5a262e740 1 Processor -- start 2024-05-14T15:34:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.571+0000 7fe5a262e740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbc02f0 0x557e9cfa0210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:33.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.571+0000 7fe5a262e740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc84d0 0x557e9cfa0770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.571+0000 7fe5a262e740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbe91b0 0x557e9d00f030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.571+0000 7fe5a262e740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe5941b0760 con 0x557e9cbe91b0 2024-05-14T15:34:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.571+0000 7fe5a262e740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe5941b0090 con 0x557e9cbc02f0 2024-05-14T15:34:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.572+0000 7fe593e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc84d0 0x557e9cfa0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:33.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.572+0000 7fe5a262e740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe5941ad310 con 0x557e9cbc84d0 2024-05-14T15:34:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.572+0000 7fe598c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbc02f0 0x557e9cfa0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.572+0000 7fe593e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc84d0 0x557e9cfa0770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:38204/0 (socket says 172.21.15.69:38204) 2024-05-14T15:34:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.572+0000 7fe593e00640 1 -- 172.21.15.69:0/752266168 learned_addr learned my addr 172.21.15.69:0/752266168 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.572+0000 7fe599600640 1 --2- 172.21.15.69:0/752266168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbe91b0 0x557e9d00f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.572+0000 7fe5a262e740 10 client.0 _ll_register_callbacks cb 0x7fe5880c9170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:34:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.573+0000 7fe599600640 1 -- 172.21.15.69:0/752266168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc84d0 msgr2=0x557e9cfa0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.573+0000 7fe599600640 1 --2- 172.21.15.69:0/752266168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc84d0 0x557e9cfa0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.573+0000 7fe599600640 1 -- 172.21.15.69:0/752266168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbc02f0 msgr2=0x557e9cfa0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.573+0000 7fe599600640 1 --2- 172.21.15.69:0/752266168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbc02f0 0x557e9cfa0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.573+0000 7fe599600640 1 -- 172.21.15.69:0/752266168 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e9d00f5f0 con 0x557e9cbe91b0 2024-05-14T15:34:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.573+0000 7fe599600640 1 --2- 172.21.15.69:0/752266168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbe91b0 0x557e9d00f030 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe58c010cb0 tx=0x7fe58c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b03dc7f08f48023 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:33.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.573+0000 7fe57a000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:34:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.575+0000 7fe57a000640 1 -- 172.21.15.69:0/752266168 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe58c003970 con 0x557e9cbe91b0 2024-05-14T15:34:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.575+0000 7fe57a000640 1 -- 172.21.15.69:0/752266168 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9554+0+0 (secure 0 0 0) 0x7fe58c003b10 con 0x557e9cbe91b0 2024-05-14T15:34:33.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.576+0000 7fe5a262e740 1 -- 172.21.15.69:0/752266168 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe58002a070 con 0x557e9cbe91b0 2024-05-14T15:34:33.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.577+0000 7fe57a000640 1 -- 172.21.15.69:0/752266168 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fe58c003d10 con 0x557e9cbe91b0 2024-05-14T15:34:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.577+0000 7fe5a262e740 10 client.17127 fetch_fsmap learned FSMap version 62 2024-05-14T15:34:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.577+0000 7fe5a262e740 1 -- 172.21.15.69:0/752266168 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x557e9d0169f0 con 0x557e9cbe91b0 2024-05-14T15:34:33.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.578+0000 7fe57a000640 1 -- 172.21.15.69:0/752266168 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe58002a070 con 0x557e9cbe91b0 2024-05-14T15:34:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.578+0000 7fe57a000640 1 -- 172.21.15.69:0/752266168 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7fe58c027600 con 0x557e9cbe91b0 2024-05-14T15:34:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.579+0000 7fe5a262e740 10 client.17127 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:34:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.579+0000 7fe5a262e740 10 client.17127 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:34:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.579+0000 7fe5a262e740 20 client.17127 populate_metadata read hostname 'smithi069' 2024-05-14T15:34:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.579+0000 7fe5a262e740 1 --2- 172.21.15.69:0/752266168 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557e9cb7d1c0 0x557e9d019160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.579+0000 7fe5a262e740 4 client.17127 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:34:33.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.579+0000 7fe5a262e740 1 -- 172.21.15.69:0/752266168 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557e9cef6fd0 con 0x557e9cb7d1c0 2024-05-14T15:34:33.583 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.582+0000 7fe598c00640 1 --2- 172.21.15.69:0/752266168 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557e9cb7d1c0 0x557e9d019160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.583+0000 7fe598c00640 1 --2- 172.21.15.69:0/752266168 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557e9cb7d1c0 0x557e9d019160 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cfaba8d0df062b9 server_cookie=d1e5136f652d1485 in_seq=0 out_seq=0 2024-05-14T15:34:33.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.583+0000 7fe57a000640 10 client.17127 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:34:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.621+0000 7fe57a000640 1 -- 172.21.15.69:0/752266168 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557e9cef6fd0 con 0x557e9cb7d1c0 2024-05-14T15:34:33.622 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.621+0000 7fe57a000640 10 client.17127 handle_command_reply: tid=0 2024-05-14T15:34:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.621+0000 7fe5a262e740 1 client.17127 shutdown 2024-05-14T15:34:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.621+0000 7fe5a262e740 1 -- 172.21.15.69:0/752266168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbe91b0 msgr2=0x557e9d00f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:33.623 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.621+0000 7fe5a262e740 1 --2- 172.21.15.69:0/752266168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbe91b0 0x557e9d00f030 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe58c010cb0 tx=0x7fe58c00f790 comp rx=0 tx=0).stop 2024-05-14T15:34:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.624+0000 7fe5a262e740 1 -- 172.21.15.69:0/752266168 shutdown_connections 2024-05-14T15:34:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.624+0000 7fe5a262e740 1 --2- 172.21.15.69:0/752266168 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557e9cb7d1c0 0x557e9d019160 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.625+0000 7fe5a262e740 1 --2- 172.21.15.69:0/752266168 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e9cbe91b0 0x557e9d00f030 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.625+0000 7fe5a262e740 1 --2- 172.21.15.69:0/752266168 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e9cbc84d0 0x557e9cfa0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.625+0000 7fe57a000640 0 client.17127 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:34:33.626 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.625+0000 7fe5a262e740 1 --2- 172.21.15.69:0/752266168 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e9cbc02f0 0x557e9cfa0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.627 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.625+0000 7fe5a262e740 1 -- 172.21.15.69:0/752266168 >> 172.21.15.69:0/752266168 conn(0x557e9cbdd300 msgr2=0x557e9cf8aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:33.627 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.626+0000 7fe5a262e740 1 -- 172.21.15.69:0/752266168 shutdown_connections 2024-05-14T15:34:33.627 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.626+0000 7fe5a262e740 1 -- 172.21.15.69:0/752266168 wait complete. 2024-05-14T15:34:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.626+0000 7fe5a262e740 20 client.17127 trim_cache size 0 max 16384 2024-05-14T15:34:33.628 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:34:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:34:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:34:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:34:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.628+0000 7fe59b600640 1 -- 172.21.15.69:0/3789052478 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe57c0b2aa0 msgr2=0x7fe57c0b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:33.629 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.628+0000 7fe59b600640 1 --2- 172.21.15.69:0/3789052478 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe57c0b2aa0 0x7fe57c0b4fb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe594112340 tx=0x7fe58000b370 comp rx=0 tx=0).stop 2024-05-14T15:34:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.628+0000 7fe59b600640 1 -- 172.21.15.69:0/3789052478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe594076520 msgr2=0x7fe5941a2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.628+0000 7fe59b600640 1 --2- 172.21.15.69:0/3789052478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe594076520 0x7fe5941a2640 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fe58802a9a0 tx=0x7fe588003b90 comp rx=0 tx=0).stop 2024-05-14T15:34:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.628+0000 7fe59b600640 1 -- 172.21.15.69:0/3789052478 shutdown_connections 2024-05-14T15:34:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.628+0000 7fe59b600640 1 --2- 172.21.15.69:0/3789052478 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe57c0b2aa0 0x7fe57c0b4fb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.628+0000 7fe59b600640 1 --2- 172.21.15.69:0/3789052478 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe5941104f0 0x7fe59419c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.628+0000 7fe59b600640 1 --2- 172.21.15.69:0/3789052478 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe59410db90 0x7fe5941a2b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.628+0000 7fe59b600640 1 --2- 172.21.15.69:0/3789052478 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe594076520 0x7fe5941a2640 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.628+0000 7fe59b600640 1 -- 172.21.15.69:0/3789052478 >> 172.21.15.69:0/3789052478 conn(0x7fe5940ff360 msgr2=0x7fe594110920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.629+0000 7fe59b600640 1 -- 172.21.15.69:0/3789052478 shutdown_connections 2024-05-14T15:34:33.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:33.629+0000 7fe59b600640 1 -- 172.21.15.69:0/3789052478 wait complete. 2024-05-14T15:34:33.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:33 smithi092 ceph-mon[34729]: pgmap v404: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.7 MiB/s wr, 448 op/s 2024-05-14T15:34:33.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:33 smithi069 ceph-mon[31270]: pgmap v404: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.7 MiB/s wr, 448 op/s 2024-05-14T15:34:33.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:33 smithi203 ceph-mon[34567]: pgmap v404: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.7 MiB/s wr, 448 op/s 2024-05-14T15:34:35.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:35 smithi092 ceph-mon[34729]: pgmap v405: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.9 MiB/s wr, 470 op/s 2024-05-14T15:34:35.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:35 smithi069 ceph-mon[31270]: pgmap v405: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.9 MiB/s wr, 470 op/s 2024-05-14T15:34:35.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:35 smithi203 ceph-mon[34567]: pgmap v405: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.9 MiB/s wr, 470 op/s 2024-05-14T15:34:36.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 530.0 s, 418.6 tps, lat 237.354 ms stddev 331.706 2024-05-14T15:34:37.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:37 smithi092 ceph-mon[34729]: pgmap v406: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 9.1 MiB/s wr, 635 op/s 2024-05-14T15:34:37.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:37 smithi069 ceph-mon[31270]: pgmap v406: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 9.1 MiB/s wr, 635 op/s 2024-05-14T15:34:37.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:37 smithi203 ceph-mon[34567]: pgmap v406: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 9.1 MiB/s wr, 635 op/s 2024-05-14T15:34:39.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:39 smithi092 ceph-mon[34729]: pgmap v407: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.7 MiB/s wr, 480 op/s 2024-05-14T15:34:39.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:39 smithi069 ceph-mon[31270]: pgmap v407: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.7 MiB/s wr, 480 op/s 2024-05-14T15:34:39.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:39 smithi203 ceph-mon[34567]: pgmap v407: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.7 MiB/s wr, 480 op/s 2024-05-14T15:34:41.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 535.0 s, 749.4 tps, lat 134.042 ms stddev 114.533 2024-05-14T15:34:41.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:41 smithi092 ceph-mon[34729]: pgmap v408: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 11 MiB/s wr, 709 op/s 2024-05-14T15:34:41.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:41 smithi069 ceph-mon[31270]: pgmap v408: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 11 MiB/s wr, 709 op/s 2024-05-14T15:34:41.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:41 smithi203 ceph-mon[34567]: pgmap v408: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 11 MiB/s wr, 709 op/s 2024-05-14T15:34:43.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:43 smithi092 ceph-mon[34729]: pgmap v409: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.6 MiB/s wr, 471 op/s 2024-05-14T15:34:43.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:43 smithi069 ceph-mon[31270]: pgmap v409: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.6 MiB/s wr, 471 op/s 2024-05-14T15:34:43.847 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:43 smithi203 ceph-mon[34567]: pgmap v409: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 6.6 MiB/s wr, 471 op/s 2024-05-14T15:34:45.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:45 smithi092 ceph-mon[34729]: pgmap v410: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.7 MiB/s wr, 481 op/s 2024-05-14T15:34:45.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:45 smithi069 ceph-mon[31270]: pgmap v410: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.7 MiB/s wr, 481 op/s 2024-05-14T15:34:45.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:45 smithi203 ceph-mon[34567]: pgmap v410: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 6.7 MiB/s wr, 481 op/s 2024-05-14T15:34:46.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 540.0 s, 551.6 tps, lat 180.870 ms stddev 260.328 2024-05-14T15:34:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.001+0000 7ff846a00640 1 -- 172.21.15.69:0/845553275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff840108ba0 msgr2=0x7ff840102740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:47.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.001+0000 7ff846a00640 1 --2- 172.21.15.69:0/845553275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff840108ba0 0x7ff840102740 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7ff838009ca0 tx=0x7ff83802a8f0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.002+0000 7ff846a00640 1 -- 172.21.15.69:0/845553275 shutdown_connections 2024-05-14T15:34:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.002+0000 7ff846a00640 1 --2- 172.21.15.69:0/845553275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff8401032f0 0x7ff84010f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.002+0000 7ff846a00640 1 --2- 172.21.15.69:0/845553275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff840109040 0x7ff840102c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.002+0000 7ff846a00640 1 --2- 172.21.15.69:0/845553275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff840108ba0 0x7ff840102740 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.002+0000 7ff846a00640 1 -- 172.21.15.69:0/845553275 >> 172.21.15.69:0/845553275 conn(0x7ff8400782e0 msgr2=0x7ff840078720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:47.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.003+0000 7ff846a00640 1 -- 172.21.15.69:0/845553275 shutdown_connections 2024-05-14T15:34:47.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.003+0000 7ff846a00640 1 -- 172.21.15.69:0/845553275 wait complete. 2024-05-14T15:34:47.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.005+0000 7ff846a00640 1 Processor -- start 2024-05-14T15:34:47.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.006+0000 7ff846a00640 1 -- start start 2024-05-14T15:34:47.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.007+0000 7ff846a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8401032f0 0x7ff84019d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.007+0000 7ff846a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff840108ba0 0x7ff84019d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.007+0000 7ff846a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840109040 0x7ff840198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.007+0000 7ff83fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8401032f0 0x7ff84019d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:47.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.008+0000 7ff83f400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff840108ba0 0x7ff84019d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:47.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.008+0000 7ff83f400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff840108ba0 0x7ff84019d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35274/0 (socket says 172.21.15.69:35274) 2024-05-14T15:34:47.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.008+0000 7ff83fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8401032f0 0x7ff84019d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37316/0 (socket says 172.21.15.69:37316) 2024-05-14T15:34:47.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.008+0000 7ff844a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840109040 0x7ff840198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:47.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.008+0000 7ff844a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840109040 0x7ff840198780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:58194/0 (socket says 172.21.15.69:58194) 2024-05-14T15:34:47.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.008+0000 7ff83f400640 1 -- 172.21.15.69:0/2123845524 learned_addr learned my addr 172.21.15.69:0/2123845524 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:47.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.008+0000 7ff846a00640 1 -- 172.21.15.69:0/2123845524 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff840112d90 con 0x7ff8401032f0 2024-05-14T15:34:47.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.008+0000 7ff846a00640 1 -- 172.21.15.69:0/2123845524 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff840112c10 con 0x7ff840109040 2024-05-14T15:34:47.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.008+0000 7ff846a00640 1 -- 172.21.15.69:0/2123845524 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff840112f10 con 0x7ff840108ba0 2024-05-14T15:34:47.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.013+0000 7ff83fe00640 1 -- 172.21.15.69:0/2123845524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff840108ba0 msgr2=0x7ff84019d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:47.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.013+0000 7ff83fe00640 1 --2- 172.21.15.69:0/2123845524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff840108ba0 0x7ff84019d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.013+0000 7ff83fe00640 1 -- 172.21.15.69:0/2123845524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840109040 msgr2=0x7ff840198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:47.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.013+0000 7ff83fe00640 1 --2- 172.21.15.69:0/2123845524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840109040 0x7ff840198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.013+0000 7ff83fe00640 1 -- 172.21.15.69:0/2123845524 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff840198f80 con 0x7ff8401032f0 2024-05-14T15:34:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.013+0000 7ff83fe00640 1 --2- 172.21.15.69:0/2123845524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8401032f0 0x7ff84019d410 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff83802ae10 tx=0x7ff83802f510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.014+0000 7ff83cc00640 1 -- 172.21.15.69:0/2123845524 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838003cf0 con 0x7ff8401032f0 2024-05-14T15:34:47.015 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.014+0000 7ff83cc00640 1 -- 172.21.15.69:0/2123845524 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff83802d070 con 0x7ff8401032f0 2024-05-14T15:34:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.016+0000 7ff83cc00640 1 -- 172.21.15.69:0/2123845524 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83802fa30 con 0x7ff8401032f0 2024-05-14T15:34:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.016+0000 7ff846a00640 1 -- 172.21.15.69:0/2123845524 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff840199210 con 0x7ff8401032f0 2024-05-14T15:34:47.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.016+0000 7ff846a00640 1 -- 172.21.15.69:0/2123845524 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8401a3120 con 0x7ff8401032f0 2024-05-14T15:34:47.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.023+0000 7ff83cc00640 1 -- 172.21.15.69:0/2123845524 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ff83802fbd0 con 0x7ff8401032f0 2024-05-14T15:34:47.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.026+0000 7ff84d9b5740 1 Processor -- start 2024-05-14T15:34:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.026+0000 7ff84d9b5740 1 -- start start 2024-05-14T15:34:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.027+0000 7ff84d9b5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e74d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.027+0000 7ff84d9b5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e3832f0 0x55ed6e74d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.027+0000 7ff84d9b5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e38b4d0 0x55ed6e74dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.027+0000 7ff84d9b5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ed6e6b2550 con 0x55ed6e38b4d0 2024-05-14T15:34:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.027+0000 7ff84d9b5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ed6e657bc0 con 0x55ed6e3832f0 2024-05-14T15:34:47.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.027+0000 7ff84d9b5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ed6e6ae510 con 0x55ed6e3ac1b0 2024-05-14T15:34:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.027+0000 7ff844a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e74d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.027+0000 7ff844a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e74d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35290/0 (socket says 172.21.15.69:35290) 2024-05-14T15:34:47.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.027+0000 7ff844a00640 1 -- 172.21.15.69:0/4242399678 learned_addr learned my addr 172.21.15.69:0/4242399678 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.028+0000 7ff83fe00640 1 --2- 172.21.15.69:0/4242399678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e3832f0 0x55ed6e74d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.028+0000 7ff844a00640 1 -- 172.21.15.69:0/4242399678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e3832f0 msgr2=0x55ed6e74d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.028+0000 7ff844a00640 1 --2- 172.21.15.69:0/4242399678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e3832f0 0x55ed6e74d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.028+0000 7ff844a00640 1 -- 172.21.15.69:0/4242399678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e38b4d0 msgr2=0x55ed6e74dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.028+0000 7ff844a00640 1 --2- 172.21.15.69:0/4242399678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e38b4d0 0x55ed6e74dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.028+0000 7ff844a00640 1 -- 172.21.15.69:0/4242399678 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed6e3c4210 con 0x55ed6e3ac1b0 2024-05-14T15:34:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.028+0000 7ff844a00640 1 --2- 172.21.15.69:0/4242399678 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e74d280 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff830009990 tx=0x7ff830009e50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=268076f95e0479c4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.028+0000 7ff835200640 1 -- 172.21.15.69:0/4242399678 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff830017070 con 0x55ed6e3ac1b0 2024-05-14T15:34:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.029+0000 7ff835200640 1 -- 172.21.15.69:0/4242399678 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff830013470 con 0x55ed6e3ac1b0 2024-05-14T15:34:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.029+0000 7ff835200640 1 -- 172.21.15.69:0/4242399678 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff830012630 con 0x55ed6e3ac1b0 2024-05-14T15:34:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.029+0000 7ff84d9b5740 1 -- 172.21.15.69:0/4242399678 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 msgr2=0x55ed6e74d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.029+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/4242399678 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e74d280 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff830009990 tx=0x7ff830009e50 comp rx=0 tx=0).stop 2024-05-14T15:34:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.030+0000 7ff84d9b5740 1 -- 172.21.15.69:0/4242399678 shutdown_connections 2024-05-14T15:34:47.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.030+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/4242399678 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e38b4d0 0x55ed6e74dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.030+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/4242399678 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e3832f0 0x55ed6e74d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.030+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/4242399678 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e74d280 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.030+0000 7ff84d9b5740 1 -- 172.21.15.69:0/4242399678 >> 172.21.15.69:0/4242399678 conn(0x55ed6e3a0300 msgr2=0x55ed6e749a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:47.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.031+0000 7ff84d9b5740 1 -- 172.21.15.69:0/4242399678 shutdown_connections 2024-05-14T15:34:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.031+0000 7ff84d9b5740 1 -- 172.21.15.69:0/4242399678 wait complete. 2024-05-14T15:34:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.031+0000 7ff84d9b5740 1 -- start start 2024-05-14T15:34:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.032+0000 7ff83cc00640 1 --2- 172.21.15.69:0/2123845524 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff8240b2900 0x7ff8240b4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.032+0000 7ff84d9b5740 1 Processor -- start 2024-05-14T15:34:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.032+0000 7ff84d9b5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e3832f0 0x55ed6e7577e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.032+0000 7ff84d9b5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e757d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.032+0000 7ff84d9b5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e36ad80 0x55ed6e763860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.032+0000 7ff84d9b5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55ed6e75a3b0 con 0x55ed6e36ad80 2024-05-14T15:34:47.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.032+0000 7ff84d9b5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55ed6e66b660 con 0x55ed6e3832f0 2024-05-14T15:34:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.032+0000 7ff84d9b5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55ed6e75a530 con 0x55ed6e3ac1b0 2024-05-14T15:34:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.033+0000 7ff84d9b5740 10 client.0 _ll_register_callbacks cb 0x55ed6e635400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:34:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.033+0000 7ff83fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e3832f0 0x55ed6e7577e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.033+0000 7ff83fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e3832f0 0x55ed6e7577e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:58220/0 (socket says 172.21.15.69:58220) 2024-05-14T15:34:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.033+0000 7ff83fe00640 1 -- 172.21.15.69:0/2665489748 learned_addr learned my addr 172.21.15.69:0/2665489748 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:47.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.033+0000 7ff83f400640 1 --2- 172.21.15.69:0/2665489748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e757d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.034+0000 7ff844a00640 1 --2- 172.21.15.69:0/2665489748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e36ad80 0x55ed6e763860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.034+0000 7ff844a00640 1 --2- 172.21.15.69:0/2123845524 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff8240b2900 0x7ff8240b4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.034+0000 7ff83fe00640 1 -- 172.21.15.69:0/2665489748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 msgr2=0x55ed6e757d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.034+0000 7ff83fe00640 1 --2- 172.21.15.69:0/2665489748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e757d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.034+0000 7ff83fe00640 1 -- 172.21.15.69:0/2665489748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e36ad80 msgr2=0x55ed6e763860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.034+0000 7ff83fe00640 1 --2- 172.21.15.69:0/2665489748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e36ad80 0x55ed6e763860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.034+0000 7ff83fe00640 1 -- 172.21.15.69:0/2665489748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed6e490620 con 0x55ed6e3832f0 2024-05-14T15:34:47.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.034+0000 7ff83f400640 1 --2- 172.21.15.69:0/2665489748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e757d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:34:47.037 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.035+0000 7ff83fe00640 1 --2- 172.21.15.69:0/2665489748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e3832f0 0x55ed6e7577e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff838101020 tx=0x7ff838094560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc311ddac87d24a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:47.037 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.035+0000 7ff829600640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:34:47.037 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.035+0000 7ff829600640 1 -- 172.21.15.69:0/2665489748 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8380ca750 con 0x55ed6e3832f0 2024-05-14T15:34:47.037 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.035+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2665489748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff830013470 con 0x55ed6e3832f0 2024-05-14T15:34:47.037 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.035+0000 7ff829600640 1 -- 172.21.15.69:0/2665489748 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9554+0+0 (secure 0 0 0) 0x7ff838045430 con 0x55ed6e3832f0 2024-05-14T15:34:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.036+0000 7ff83cc00640 1 -- 172.21.15.69:0/2123845524 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9554+0+0 (secure 0 0 0) 0x7ff838103cc0 con 0x7ff8401032f0 2024-05-14T15:34:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.036+0000 7ff844a00640 1 --2- 172.21.15.69:0/2123845524 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff8240b2900 0x7ff8240b4e10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff830013e30 tx=0x7ff830013d30 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.037+0000 7ff829600640 1 -- 172.21.15.69:0/2665489748 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7ff8380cb340 con 0x55ed6e3832f0 2024-05-14T15:34:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.037+0000 7ff84d9b5740 10 client.36650 fetch_fsmap learned FSMap version 62 2024-05-14T15:34:47.038 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.037+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2665489748 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55ed6e766670 con 0x55ed6e3832f0 2024-05-14T15:34:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.038+0000 7ff829600640 1 -- 172.21.15.69:0/2665489748 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff838036020 con 0x55ed6e3832f0 2024-05-14T15:34:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.038+0000 7ff829600640 1 -- 172.21.15.69:0/2665489748 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7ff838092070 con 0x55ed6e3832f0 2024-05-14T15:34:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.038+0000 7ff84d9b5740 10 client.36650 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:34:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.038+0000 7ff84d9b5740 10 client.36650 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:34:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.038+0000 7ff84d9b5740 20 client.36650 populate_metadata read hostname 'smithi069' 2024-05-14T15:34:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.038+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/2665489748 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ed6e3401c0 0x55ed6e769ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.039+0000 7ff84d9b5740 4 client.36650 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:34:47.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.039+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2665489748 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed6e6c0160 con 0x55ed6e3401c0 2024-05-14T15:34:47.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.043+0000 7ff83f400640 1 --2- 172.21.15.69:0/2665489748 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ed6e3401c0 0x55ed6e769ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:47.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.045+0000 7ff83f400640 1 --2- 172.21.15.69:0/2665489748 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ed6e3401c0 0x55ed6e769ae0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=521dd308ff9df66e server_cookie=8b20434639c29e7c in_seq=0 out_seq=0 2024-05-14T15:34:47.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.045+0000 7ff829600640 10 client.36650 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:34:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.046+0000 7ff829600640 1 -- 172.21.15.69:0/2665489748 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55ed6e6c0160 con 0x55ed6e3401c0 2024-05-14T15:34:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.047+0000 7ff829600640 10 client.36650 handle_command_reply: tid=0 2024-05-14T15:34:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.047+0000 7ff84d9b5740 1 client.36650 shutdown 2024-05-14T15:34:47.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.047+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2665489748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e3832f0 msgr2=0x55ed6e7577e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.047+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/2665489748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e3832f0 0x55ed6e7577e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff838101020 tx=0x7ff838094560 comp rx=0 tx=0).stop 2024-05-14T15:34:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.047+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2665489748 shutdown_connections 2024-05-14T15:34:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.047+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/2665489748 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ed6e3401c0 0x55ed6e769ae0 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.047+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/2665489748 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e36ad80 0x55ed6e763860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.047+0000 7ff829600640 0 client.36650 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:34:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.047+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/2665489748 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e757d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.047+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/2665489748 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e3832f0 0x55ed6e7577e0 secure :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff838101020 tx=0x7ff838094560 comp rx=0 tx=0).stop 2024-05-14T15:34:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.047+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2665489748 >> 172.21.15.69:0/2665489748 conn(0x55ed6e3a0300 msgr2=0x55ed6e74efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:47.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.048+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2665489748 shutdown_connections 2024-05-14T15:34:47.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.048+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2665489748 wait complete. 2024-05-14T15:34:47.051 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.049+0000 7ff84d9b5740 20 client.36650 trim_cache size 0 max 16384 2024-05-14T15:34:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.080+0000 7ff84d9b5740 1 Processor -- start 2024-05-14T15:34:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.080+0000 7ff84d9b5740 1 -- start start 2024-05-14T15:34:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.081+0000 7ff84d9b5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e36ad80 0x55ed6e74dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.081+0000 7ff84d9b5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e76f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.081+0000 7ff84d9b5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e751f50 0x55ed6e76f7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.081+0000 7ff84d9b5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff8401bfee0 con 0x55ed6e751f50 2024-05-14T15:34:47.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.081+0000 7ff84d9b5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff8401c1a20 con 0x55ed6e36ad80 2024-05-14T15:34:47.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.081+0000 7ff84d9b5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff8401c05b0 con 0x55ed6e3ac1b0 2024-05-14T15:34:47.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.082+0000 7ff844a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e751f50 0x55ed6e76f7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:47.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.082+0000 7ff844a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e751f50 0x55ed6e76f7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:37344/0 (socket says 172.21.15.69:37344) 2024-05-14T15:34:47.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.082+0000 7ff83f400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e76f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:47.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.082+0000 7ff844a00640 1 -- 172.21.15.69:0/2768202428 learned_addr learned my addr 172.21.15.69:0/2768202428 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:47.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.082+0000 7ff83fe00640 1 --2- 172.21.15.69:0/2768202428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e36ad80 0x55ed6e74dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:47.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.083+0000 7ff83fe00640 1 -- 172.21.15.69:0/2768202428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 msgr2=0x55ed6e76f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:47.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.083+0000 7ff83fe00640 1 --2- 172.21.15.69:0/2768202428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e76f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.083+0000 7ff83fe00640 1 -- 172.21.15.69:0/2768202428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e751f50 msgr2=0x55ed6e76f7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:47.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.083+0000 7ff83fe00640 1 --2- 172.21.15.69:0/2768202428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e751f50 0x55ed6e76f7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.083+0000 7ff83fe00640 1 -- 172.21.15.69:0/2768202428 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed6e7584b0 con 0x55ed6e36ad80 2024-05-14T15:34:47.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.084+0000 7ff83fe00640 1 --2- 172.21.15.69:0/2768202428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e36ad80 0x55ed6e74dc60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55ed6e756e60 tx=0x7ff838096810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bd46a02cda642359 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.086+0000 7ff82be00640 1 -- 172.21.15.69:0/2768202428 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8380ca3b0 con 0x55ed6e36ad80 2024-05-14T15:34:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.086+0000 7ff82be00640 1 -- 172.21.15.69:0/2768202428 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff838036070 con 0x55ed6e36ad80 2024-05-14T15:34:47.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.086+0000 7ff82be00640 1 -- 172.21.15.69:0/2768202428 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8380c6b00 con 0x55ed6e36ad80 2024-05-14T15:34:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.087+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2768202428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e36ad80 msgr2=0x55ed6e74dc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.087+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/2768202428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e36ad80 0x55ed6e74dc60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55ed6e756e60 tx=0x7ff838096810 comp rx=0 tx=0).stop 2024-05-14T15:34:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.088+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2768202428 shutdown_connections 2024-05-14T15:34:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.088+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/2768202428 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e751f50 0x55ed6e76f7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.088+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/2768202428 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e76f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.088+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/2768202428 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e36ad80 0x55ed6e74dc60 secure :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0x55ed6e756e60 tx=0x7ff838096810 comp rx=0 tx=0).stop 2024-05-14T15:34:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.088+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2768202428 >> 172.21.15.69:0/2768202428 conn(0x55ed6e3a0300 msgr2=0x55ed6e756510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.089+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2768202428 shutdown_connections 2024-05-14T15:34:47.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.089+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2768202428 wait complete. 2024-05-14T15:34:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.090+0000 7ff84d9b5740 1 -- start start 2024-05-14T15:34:47.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.090+0000 7ff84d9b5740 1 Processor -- start 2024-05-14T15:34:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.091+0000 7ff84d9b5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e75b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.091+0000 7ff84d9b5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e751f50 0x55ed6e75b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.091+0000 7ff84d9b5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e75bd60 0x55ed6e7d0e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.091+0000 7ff84d9b5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff8401c1350 con 0x55ed6e75bd60 2024-05-14T15:34:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.091+0000 7ff84d9b5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff8401c0c80 con 0x55ed6e3ac1b0 2024-05-14T15:34:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.091+0000 7ff84d9b5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff8401bdee0 con 0x55ed6e751f50 2024-05-14T15:34:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.091+0000 7ff84d9b5740 10 client.0 _ll_register_callbacks cb 0x7ff8380caa10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:34:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.092+0000 7ff83f400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e751f50 0x55ed6e75b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.092+0000 7ff83f400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e751f50 0x55ed6e75b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:35302/0 (socket says 172.21.15.69:35302) 2024-05-14T15:34:47.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.092+0000 7ff83f400640 1 -- 172.21.15.69:0/2797698025 learned_addr learned my addr 172.21.15.69:0/2797698025 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:34:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.092+0000 7ff844a00640 1 --2- 172.21.15.69:0/2797698025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e75bd60 0x55ed6e7d0e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.092+0000 7ff83f400640 1 -- 172.21.15.69:0/2797698025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e3ac1b0 msgr2=0x55ed6e75b2e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:34:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.093+0000 7ff83f400640 1 --2- 172.21.15.69:0/2797698025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e75b2e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.093+0000 7ff83f400640 1 -- 172.21.15.69:0/2797698025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e75bd60 msgr2=0x55ed6e7d0e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:34:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.093+0000 7ff83f400640 1 --2- 172.21.15.69:0/2797698025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e75bd60 0x55ed6e7d0e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.093+0000 7ff83f400640 1 -- 172.21.15.69:0/2797698025 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed6e760190 con 0x55ed6e751f50 2024-05-14T15:34:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.095+0000 7ff83f400640 1 --2- 172.21.15.69:0/2797698025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e751f50 0x55ed6e75b820 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff84010e560 tx=0x7ff82c01b5d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dc3c839ca0deef3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:34:47.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.095+0000 7ff829600640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:34:47.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.096+0000 7ff829600640 1 -- 172.21.15.69:0/2797698025 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff82c005bd0 con 0x55ed6e751f50 2024-05-14T15:34:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.096+0000 7ff829600640 1 -- 172.21.15.69:0/2797698025 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9554+0+0 (secure 0 0 0) 0x7ff82c005d70 con 0x55ed6e751f50 2024-05-14T15:34:47.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.096+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2797698025 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff838036070 con 0x55ed6e751f50 2024-05-14T15:34:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.099+0000 7ff829600640 1 -- 172.21.15.69:0/2797698025 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7ff82c006030 con 0x55ed6e751f50 2024-05-14T15:34:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.099+0000 7ff84d9b5740 10 client.26641 fetch_fsmap learned FSMap version 62 2024-05-14T15:34:47.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.099+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2797698025 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x55ed6e7d2420 con 0x55ed6e751f50 2024-05-14T15:34:47.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.099+0000 7ff829600640 1 -- 172.21.15.69:0/2797698025 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff838036070 con 0x55ed6e751f50 2024-05-14T15:34:47.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.101+0000 7ff829600640 1 -- 172.21.15.69:0/2797698025 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7ff82c022020 con 0x55ed6e751f50 2024-05-14T15:34:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.101+0000 7ff84d9b5740 10 client.26641 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:34:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.101+0000 7ff84d9b5740 10 client.26641 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:34:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.101+0000 7ff84d9b5740 20 client.26641 populate_metadata read hostname 'smithi069' 2024-05-14T15:34:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.101+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/2797698025 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ed6e7d2ab0 0x55ed6e7d4f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:34:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.101+0000 7ff84d9b5740 4 client.26641 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:34:47.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.102+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2797698025 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55ed6e6b9fd0 con 0x55ed6e7d2ab0 2024-05-14T15:34:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.102+0000 7ff83fe00640 1 --2- 172.21.15.69:0/2797698025 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ed6e7d2ab0 0x55ed6e7d4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:34:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.103+0000 7ff83fe00640 1 --2- 172.21.15.69:0/2797698025 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ed6e7d2ab0 0x55ed6e7d4f00 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=168a483ec6f177fc server_cookie=ee38c1bd678fbfc5 in_seq=0 out_seq=0 2024-05-14T15:34:47.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.103+0000 7ff829600640 10 client.26641 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:34:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.136+0000 7ff829600640 1 -- 172.21.15.69:0/2797698025 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55ed6e6b9fd0 con 0x55ed6e7d2ab0 2024-05-14T15:34:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.136+0000 7ff829600640 10 client.26641 handle_command_reply: tid=0 2024-05-14T15:34:47.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.136+0000 7ff84d9b5740 1 client.26641 shutdown 2024-05-14T15:34:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.137+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2797698025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e751f50 msgr2=0x55ed6e75b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:47.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.137+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/2797698025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e751f50 0x55ed6e75b820 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff84010e560 tx=0x7ff82c01b5d0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.137+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2797698025 shutdown_connections 2024-05-14T15:34:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.137+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/2797698025 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55ed6e7d2ab0 0x55ed6e7d4f00 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.138+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/2797698025 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55ed6e75bd60 0x55ed6e7d0e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.138+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/2797698025 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55ed6e751f50 0x55ed6e75b820 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.138+0000 7ff829600640 0 client.26641 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:34:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.139+0000 7ff84d9b5740 1 --2- 172.21.15.69:0/2797698025 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55ed6e3ac1b0 0x55ed6e75b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.139+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2797698025 >> 172.21.15.69:0/2797698025 conn(0x55ed6e3a0300 msgr2=0x55ed6e756510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.139+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2797698025 shutdown_connections 2024-05-14T15:34:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.139+0000 7ff84d9b5740 1 -- 172.21.15.69:0/2797698025 wait complete. 2024-05-14T15:34:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.139+0000 7ff84d9b5740 20 client.26641 trim_cache size 0 max 16384 2024-05-14T15:34:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:34:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:34:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:34:47.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:34:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.142+0000 7ff846a00640 1 -- 172.21.15.69:0/2123845524 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff8240b2900 msgr2=0x7ff8240b4e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.142+0000 7ff846a00640 1 --2- 172.21.15.69:0/2123845524 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff8240b2900 0x7ff8240b4e10 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff830013e30 tx=0x7ff830013d30 comp rx=0 tx=0).stop 2024-05-14T15:34:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.142+0000 7ff846a00640 1 -- 172.21.15.69:0/2123845524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8401032f0 msgr2=0x7ff84019d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:34:47.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.142+0000 7ff846a00640 1 --2- 172.21.15.69:0/2123845524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8401032f0 0x7ff84019d410 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7ff83802ae10 tx=0x7ff83802f510 comp rx=0 tx=0).stop 2024-05-14T15:34:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.143+0000 7ff846a00640 1 -- 172.21.15.69:0/2123845524 shutdown_connections 2024-05-14T15:34:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.143+0000 7ff846a00640 1 --2- 172.21.15.69:0/2123845524 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff8240b2900 0x7ff8240b4e10 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.143+0000 7ff846a00640 1 --2- 172.21.15.69:0/2123845524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff840109040 0x7ff840198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.143+0000 7ff846a00640 1 --2- 172.21.15.69:0/2123845524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff840108ba0 0x7ff84019d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.143+0000 7ff846a00640 1 --2- 172.21.15.69:0/2123845524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff8401032f0 0x7ff84019d410 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:34:47.145 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.144+0000 7ff846a00640 1 -- 172.21.15.69:0/2123845524 >> 172.21.15.69:0/2123845524 conn(0x7ff8400782e0 msgr2=0x7ff8401012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:34:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.144+0000 7ff846a00640 1 -- 172.21.15.69:0/2123845524 shutdown_connections 2024-05-14T15:34:47.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:34:47.144+0000 7ff846a00640 1 -- 172.21.15.69:0/2123845524 wait complete. 2024-05-14T15:34:47.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:47 smithi092 ceph-mon[34729]: pgmap v411: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.4 MiB/s wr, 743 op/s 2024-05-14T15:34:47.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:47 smithi069 ceph-mon[31270]: pgmap v411: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.4 MiB/s wr, 743 op/s 2024-05-14T15:34:47.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:47 smithi203 ceph-mon[34567]: pgmap v411: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 9.4 MiB/s wr, 743 op/s 2024-05-14T15:34:49.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:49 smithi092 ceph-mon[34729]: pgmap v412: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.8 MiB/s wr, 522 op/s 2024-05-14T15:34:49.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:49 smithi069 ceph-mon[31270]: pgmap v412: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.8 MiB/s wr, 522 op/s 2024-05-14T15:34:49.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:49 smithi203 ceph-mon[34567]: pgmap v412: 129 pgs: 129 active+clean; 3.0 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 6.8 MiB/s wr, 522 op/s 2024-05-14T15:34:50.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:50 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:34:50.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:50 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:34:50.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:50 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:34:51.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 545.0 s, 613.0 tps, lat 162.473 ms stddev 82.888 2024-05-14T15:34:51.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:51 smithi092 ceph-mon[34729]: pgmap v413: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 10 MiB/s wr, 709 op/s 2024-05-14T15:34:51.727 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:51 smithi069 ceph-mon[31270]: pgmap v413: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 10 MiB/s wr, 709 op/s 2024-05-14T15:34:51.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:51 smithi203 ceph-mon[34567]: pgmap v413: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 10 MiB/s wr, 709 op/s 2024-05-14T15:34:52.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:52 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:34:52.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:52 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:34:52.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:52 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:34:52.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:52 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:34:52.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:52 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:34:52.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:52 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:34:53.072 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:52 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:34:53.072 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:52 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:34:53.073 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:52 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:34:53.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:53 smithi069 ceph-mon[31270]: pgmap v414: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.5 MiB/s wr, 480 op/s 2024-05-14T15:34:53.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:53 smithi203 ceph-mon[34567]: pgmap v414: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.5 MiB/s wr, 480 op/s 2024-05-14T15:34:53.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:53 smithi092 ceph-mon[34729]: pgmap v414: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.5 MiB/s wr, 480 op/s 2024-05-14T15:34:55.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:55 smithi069 ceph-mon[31270]: pgmap v415: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.5 MiB/s wr, 493 op/s 2024-05-14T15:34:55.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:55 smithi203 ceph-mon[34567]: pgmap v415: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.5 MiB/s wr, 493 op/s 2024-05-14T15:34:55.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:55 smithi092 ceph-mon[34729]: pgmap v415: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.5 MiB/s wr, 493 op/s 2024-05-14T15:34:56.369 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 550.0 s, 481.5 tps, lat 151.793 ms stddev 104.483 2024-05-14T15:34:57.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:57 smithi069 ceph-mon[31270]: pgmap v416: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 9.2 MiB/s wr, 748 op/s 2024-05-14T15:34:57.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:57 smithi203 ceph-mon[34567]: pgmap v416: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 9.2 MiB/s wr, 748 op/s 2024-05-14T15:34:57.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:57 smithi092 ceph-mon[34729]: pgmap v416: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 106 KiB/s rd, 9.2 MiB/s wr, 748 op/s 2024-05-14T15:34:59.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:34:59 smithi069 ceph-mon[31270]: pgmap v417: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 6.4 MiB/s wr, 464 op/s 2024-05-14T15:34:59.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:34:59 smithi203 ceph-mon[34567]: pgmap v417: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 6.4 MiB/s wr, 464 op/s 2024-05-14T15:34:59.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:34:59 smithi092 ceph-mon[34729]: pgmap v417: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 6.4 MiB/s wr, 464 op/s 2024-05-14T15:35:00.448 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.446+0000 7fa037200640 1 -- 172.21.15.69:0/2058300997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa038075430 msgr2=0x7fa038075840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.446+0000 7fa037200640 1 --2- 172.21.15.69:0/2058300997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa038075430 0x7fa038075840 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fa028009900 tx=0x7fa02802a490 comp rx=0 tx=0).stop 2024-05-14T15:35:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.447+0000 7fa037200640 1 -- 172.21.15.69:0/2058300997 shutdown_connections 2024-05-14T15:35:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.447+0000 7fa037200640 1 --2- 172.21.15.69:0/2058300997 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa038110330 0x7fa038112750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.447+0000 7fa037200640 1 --2- 172.21.15.69:0/2058300997 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa03810d9d0 0x7fa03810fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.447+0000 7fa037200640 1 --2- 172.21.15.69:0/2058300997 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa038075430 0x7fa038075840 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.447+0000 7fa037200640 1 -- 172.21.15.69:0/2058300997 >> 172.21.15.69:0/2058300997 conn(0x7fa03807a1c0 msgr2=0x7fa03807a600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:00.449 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.447+0000 7fa037200640 1 -- 172.21.15.69:0/2058300997 shutdown_connections 2024-05-14T15:35:00.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.447+0000 7fa037200640 1 -- 172.21.15.69:0/2058300997 wait complete. 2024-05-14T15:35:00.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.448+0000 7fa037200640 1 Processor -- start 2024-05-14T15:35:00.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.448+0000 7fa037200640 1 -- start start 2024-05-14T15:35:00.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.449+0000 7fa037200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa038075430 0x7fa03819c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.449+0000 7fa037200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa03810d9d0 0x7fa03819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.449+0000 7fa037200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa038110330 0x7fa0381a1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.449+0000 7fa037200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa038115da0 con 0x7fa038110330 2024-05-14T15:35:00.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.449+0000 7fa037200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa038115c20 con 0x7fa03810d9d0 2024-05-14T15:35:00.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.449+0000 7fa037200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa038115f20 con 0x7fa038075430 2024-05-14T15:35:00.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.449+0000 7fa036800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa038110330 0x7fa0381a1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:00.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.449+0000 7fa035400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa03810d9d0 0x7fa03819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:00.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.450+0000 7fa035400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa03810d9d0 0x7fa03819cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:56450/0 (socket says 172.21.15.69:56450) 2024-05-14T15:35:00.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.450+0000 7fa035400640 1 -- 172.21.15.69:0/3127788253 learned_addr learned my addr 172.21.15.69:0/3127788253 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:00.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.450+0000 7fa035e00640 1 --2- 172.21.15.69:0/3127788253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa038075430 0x7fa03819c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:00.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.450+0000 7fa035400640 1 -- 172.21.15.69:0/3127788253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa038075430 msgr2=0x7fa03819c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:00.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.450+0000 7fa035400640 1 --2- 172.21.15.69:0/3127788253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa038075430 0x7fa03819c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.450+0000 7fa035400640 1 -- 172.21.15.69:0/3127788253 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa038110330 msgr2=0x7fa0381a1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:00.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.450+0000 7fa035400640 1 --2- 172.21.15.69:0/3127788253 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa038110330 0x7fa0381a1000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.450+0000 7fa035400640 1 -- 172.21.15.69:0/3127788253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0381a1640 con 0x7fa03810d9d0 2024-05-14T15:35:00.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.450+0000 7fa035e00640 1 --2- 172.21.15.69:0/3127788253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa038075430 0x7fa03819c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:35:00.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.451+0000 7fa035400640 1 --2- 172.21.15.69:0/3127788253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa03810d9d0 0x7fa03819cd40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa024005fd0 tx=0x7fa02400dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:00.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.451+0000 7fa02ea00640 1 -- 172.21.15.69:0/3127788253 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa024017070 con 0x7fa03810d9d0 2024-05-14T15:35:00.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.451+0000 7fa037200640 1 -- 172.21.15.69:0/3127788253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0381a1930 con 0x7fa03810d9d0 2024-05-14T15:35:00.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.451+0000 7fa037200640 1 -- 172.21.15.69:0/3127788253 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0381a92b0 con 0x7fa03810d9d0 2024-05-14T15:35:00.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.452+0000 7fa02ea00640 1 -- 172.21.15.69:0/3127788253 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa024009c30 con 0x7fa03810d9d0 2024-05-14T15:35:00.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.452+0000 7fa02ea00640 1 -- 172.21.15.69:0/3127788253 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa024003c70 con 0x7fa03810d9d0 2024-05-14T15:35:00.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.456+0000 7fa044024740 1 Processor -- start 2024-05-14T15:35:00.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.458+0000 7fa02ea00640 1 -- 172.21.15.69:0/3127788253 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa024004020 con 0x7fa03810d9d0 2024-05-14T15:35:00.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.458+0000 7fa044024740 1 -- start start 2024-05-14T15:35:00.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.458+0000 7fa044024740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb351b0 0x560e9fed6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.458+0000 7fa044024740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb0c2f0 0x560e9fed69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.458+0000 7fa044024740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb144d0 0x560e9fed6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.458+0000 7fa044024740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560e9fe3b550 con 0x560e9fb144d0 2024-05-14T15:35:00.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.458+0000 7fa044024740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e9fde0bc0 con 0x560e9fb0c2f0 2024-05-14T15:35:00.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.458+0000 7fa044024740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560e9fe37510 con 0x560e9fb351b0 2024-05-14T15:35:00.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.459+0000 7fa035e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb0c2f0 0x560e9fed69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.459+0000 7fa035e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb0c2f0 0x560e9fed69c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:56456/0 (socket says 172.21.15.69:56456) 2024-05-14T15:35:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.459+0000 7fa035e00640 1 -- 172.21.15.69:0/2493320775 learned_addr learned my addr 172.21.15.69:0/2493320775 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.459+0000 7fa036800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb351b0 0x560e9fed6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:00.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.459+0000 7fa035400640 1 --2- 172.21.15.69:0/2493320775 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb144d0 0x560e9fed6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.459+0000 7fa035e00640 1 -- 172.21.15.69:0/2493320775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb351b0 msgr2=0x560e9fed6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.459+0000 7fa035e00640 1 --2- 172.21.15.69:0/2493320775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb351b0 0x560e9fed6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.459+0000 7fa035e00640 1 -- 172.21.15.69:0/2493320775 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb144d0 msgr2=0x560e9fed6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:00.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.459+0000 7fa035e00640 1 --2- 172.21.15.69:0/2493320775 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb144d0 0x560e9fed6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.459+0000 7fa035e00640 1 -- 172.21.15.69:0/2493320775 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e9fb4d210 con 0x560e9fb0c2f0 2024-05-14T15:35:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.459+0000 7fa035400640 1 --2- 172.21.15.69:0/2493320775 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb144d0 0x560e9fed6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:35:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.460+0000 7fa035e00640 1 --2- 172.21.15.69:0/2493320775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb0c2f0 0x560e9fed69c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa028000c00 tx=0x7fa028005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ac55a245a2d6b39 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.460+0000 7fa02ea00640 1 --2- 172.21.15.69:0/3127788253 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa01c0b2aa0 0x7fa01c0b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.460+0000 7fa02ea00640 1 -- 172.21.15.69:0/3127788253 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 9554+0+0 (secure 0 0 0) 0x7fa0240e2490 con 0x7fa03810d9d0 2024-05-14T15:35:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.460+0000 7fa023400640 1 -- 172.21.15.69:0/2493320775 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa028035040 con 0x560e9fb0c2f0 2024-05-14T15:35:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.460+0000 7fa023400640 1 -- 172.21.15.69:0/2493320775 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa028005430 con 0x560e9fb0c2f0 2024-05-14T15:35:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.460+0000 7fa023400640 1 -- 172.21.15.69:0/2493320775 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa028003a80 con 0x560e9fb0c2f0 2024-05-14T15:35:00.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.461+0000 7fa036800640 1 --2- 172.21.15.69:0/3127788253 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa01c0b2aa0 0x7fa01c0b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:00.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.461+0000 7fa044024740 1 -- 172.21.15.69:0/2493320775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb0c2f0 msgr2=0x560e9fed69c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:00.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.461+0000 7fa044024740 1 --2- 172.21.15.69:0/2493320775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb0c2f0 0x560e9fed69c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa028000c00 tx=0x7fa028005040 comp rx=0 tx=0).stop 2024-05-14T15:35:00.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.462+0000 7fa036800640 1 --2- 172.21.15.69:0/3127788253 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa01c0b2aa0 0x7fa01c0b4fb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x560e9fed35f0 tx=0x7fa030009600 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:00.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.462+0000 7fa044024740 1 -- 172.21.15.69:0/2493320775 shutdown_connections 2024-05-14T15:35:00.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.462+0000 7fa044024740 1 --2- 172.21.15.69:0/2493320775 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb144d0 0x560e9fed6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.462+0000 7fa044024740 1 --2- 172.21.15.69:0/2493320775 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb0c2f0 0x560e9fed69c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.462+0000 7fa044024740 1 --2- 172.21.15.69:0/2493320775 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb351b0 0x560e9fed6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.462+0000 7fa044024740 1 -- 172.21.15.69:0/2493320775 >> 172.21.15.69:0/2493320775 conn(0x560e9fb29300 msgr2=0x560e9fed2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:00.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.462+0000 7fa044024740 1 -- 172.21.15.69:0/2493320775 shutdown_connections 2024-05-14T15:35:00.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.463+0000 7fa044024740 1 -- 172.21.15.69:0/2493320775 wait complete. 2024-05-14T15:35:00.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.463+0000 7fa044024740 1 -- start start 2024-05-14T15:35:00.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.463+0000 7fa044024740 1 Processor -- start 2024-05-14T15:35:00.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.464+0000 7fa044024740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb0c2f0 0x560e9fee08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.464+0000 7fa044024740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb144d0 0x560e9fee0e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.464+0000 7fa044024740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb351b0 0x560e9feeca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.464+0000 7fa044024740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x560e9fee3550 con 0x560e9fb351b0 2024-05-14T15:35:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.464+0000 7fa044024740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x560e9fdf4660 con 0x560e9fb0c2f0 2024-05-14T15:35:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.464+0000 7fa044024740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x560e9fee36d0 con 0x560e9fb144d0 2024-05-14T15:35:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.465+0000 7fa044024740 10 client.0 _ll_register_callbacks cb 0x560e9fdbe400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:35:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.465+0000 7fa036800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb351b0 0x560e9feeca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:00.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.465+0000 7fa036800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb351b0 0x560e9feeca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54386/0 (socket says 172.21.15.69:54386) 2024-05-14T15:35:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.465+0000 7fa035e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb0c2f0 0x560e9fee08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.465+0000 7fa036800640 1 -- 172.21.15.69:0/2042193471 learned_addr learned my addr 172.21.15.69:0/2042193471 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.465+0000 7fa035400640 1 --2- 172.21.15.69:0/2042193471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb144d0 0x560e9fee0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.465+0000 7fa035e00640 1 -- 172.21.15.69:0/2042193471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb144d0 msgr2=0x560e9fee0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.466+0000 7fa035e00640 1 --2- 172.21.15.69:0/2042193471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb144d0 0x560e9fee0e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.466+0000 7fa035e00640 1 -- 172.21.15.69:0/2042193471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb351b0 msgr2=0x560e9feeca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.466+0000 7fa035e00640 1 --2- 172.21.15.69:0/2042193471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb351b0 0x560e9feeca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.466+0000 7fa035e00640 1 -- 172.21.15.69:0/2042193471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e9fc19620 con 0x560e9fb0c2f0 2024-05-14T15:35:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.466+0000 7fa036800640 1 --2- 172.21.15.69:0/2042193471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb351b0 0x560e9feeca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:35:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.466+0000 7fa035e00640 1 --2- 172.21.15.69:0/2042193471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb0c2f0 0x560e9fee08f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x560e9fed7830 tx=0x7fa028003a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b930d25a03c3a72a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:00.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.466+0000 7fa017e00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:35:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.467+0000 7fa017e00640 1 -- 172.21.15.69:0/2042193471 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa028035070 con 0x560e9fb0c2f0 2024-05-14T15:35:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.467+0000 7fa017e00640 1 -- 172.21.15.69:0/2042193471 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9554+0+0 (secure 0 0 0) 0x7fa028005230 con 0x560e9fb0c2f0 2024-05-14T15:35:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.467+0000 7fa044024740 1 -- 172.21.15.69:0/2042193471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa028005430 con 0x560e9fb0c2f0 2024-05-14T15:35:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.467+0000 7fa017e00640 1 -- 172.21.15.69:0/2042193471 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fa0280055e0 con 0x560e9fb0c2f0 2024-05-14T15:35:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.467+0000 7fa044024740 10 client.36665 fetch_fsmap learned FSMap version 62 2024-05-14T15:35:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.467+0000 7fa044024740 1 -- 172.21.15.69:0/2042193471 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x560e9feef7a0 con 0x560e9fb0c2f0 2024-05-14T15:35:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.467+0000 7fa017e00640 1 -- 172.21.15.69:0/2042193471 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa028005430 con 0x560e9fb0c2f0 2024-05-14T15:35:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.468+0000 7fa017e00640 1 -- 172.21.15.69:0/2042193471 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7fa02803c440 con 0x560e9fb0c2f0 2024-05-14T15:35:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.468+0000 7fa044024740 10 client.36665 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:35:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.468+0000 7fa044024740 10 client.36665 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:35:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.468+0000 7fa044024740 20 client.36665 populate_metadata read hostname 'smithi069' 2024-05-14T15:35:00.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.468+0000 7fa044024740 1 --2- 172.21.15.69:0/2042193471 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560e9faf3d80 0x560e9fef2b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.468+0000 7fa044024740 4 client.36665 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:35:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.468+0000 7fa044024740 1 -- 172.21.15.69:0/2042193471 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e9fe49160 con 0x560e9faf3d80 2024-05-14T15:35:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.468+0000 7fa035400640 1 --2- 172.21.15.69:0/2042193471 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560e9faf3d80 0x560e9fef2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.469+0000 7fa017e00640 10 client.36665 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.469+0000 7fa035400640 1 --2- 172.21.15.69:0/2042193471 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560e9faf3d80 0x560e9fef2b00 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9d90c842225657e4 server_cookie=e6b0aa6c964a87a1 in_seq=0 out_seq=0 2024-05-14T15:35:00.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.470+0000 7fa017e00640 1 -- 172.21.15.69:0/2042193471 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x560e9fe49160 con 0x560e9faf3d80 2024-05-14T15:35:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.470+0000 7fa017e00640 10 client.36665 handle_command_reply: tid=0 2024-05-14T15:35:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.470+0000 7fa044024740 1 client.36665 shutdown 2024-05-14T15:35:00.472 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.471+0000 7fa044024740 1 -- 172.21.15.69:0/2042193471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb0c2f0 msgr2=0x560e9fee08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.471+0000 7fa044024740 1 --2- 172.21.15.69:0/2042193471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb0c2f0 0x560e9fee08f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x560e9fed7830 tx=0x7fa028003a30 comp rx=0 tx=0).stop 2024-05-14T15:35:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.471+0000 7fa044024740 1 -- 172.21.15.69:0/2042193471 shutdown_connections 2024-05-14T15:35:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.471+0000 7fa044024740 1 --2- 172.21.15.69:0/2042193471 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560e9faf3d80 0x560e9fef2b00 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.471+0000 7fa044024740 1 --2- 172.21.15.69:0/2042193471 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb351b0 0x560e9feeca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.471+0000 7fa044024740 1 --2- 172.21.15.69:0/2042193471 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb144d0 0x560e9fee0e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.471+0000 7fa044024740 1 --2- 172.21.15.69:0/2042193471 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb0c2f0 0x560e9fee08f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.471+0000 7fa044024740 1 -- 172.21.15.69:0/2042193471 >> 172.21.15.69:0/2042193471 conn(0x560e9fb29300 msgr2=0x560e9fed62b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.471+0000 7fa017e00640 0 client.36665 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.471+0000 7fa044024740 1 -- 172.21.15.69:0/2042193471 shutdown_connections 2024-05-14T15:35:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.471+0000 7fa044024740 1 -- 172.21.15.69:0/2042193471 wait complete. 2024-05-14T15:35:00.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.471+0000 7fa044024740 20 client.36665 trim_cache size 0 max 16384 2024-05-14T15:35:00.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.500+0000 7fa044024740 1 Processor -- start 2024-05-14T15:35:00.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.500+0000 7fa044024740 1 -- start start 2024-05-14T15:35:00.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.501+0000 7fa044024740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb0c2f0 0x560e9fed1c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.501+0000 7fa044024740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb144d0 0x560e9feeca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.501+0000 7fa044024740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb351b0 0x560e9feecf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.501+0000 7fa044024740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa018010080 con 0x560e9fb351b0 2024-05-14T15:35:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.501+0000 7fa044024740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa018011bc0 con 0x560e9fb144d0 2024-05-14T15:35:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.501+0000 7fa044024740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa018010750 con 0x560e9fb0c2f0 2024-05-14T15:35:00.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.501+0000 7fa035e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb0c2f0 0x560e9fed1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.502+0000 7fa035e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb0c2f0 0x560e9fed1c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:43782/0 (socket says 172.21.15.69:43782) 2024-05-14T15:35:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.502+0000 7fa035e00640 1 -- 172.21.15.69:0/179304210 learned_addr learned my addr 172.21.15.69:0/179304210 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.502+0000 7fa035e00640 1 -- 172.21.15.69:0/179304210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb144d0 msgr2=0x560e9feeca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.502+0000 7fa035e00640 1 --2- 172.21.15.69:0/179304210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb144d0 0x560e9feeca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.502+0000 7fa035e00640 1 -- 172.21.15.69:0/179304210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb351b0 msgr2=0x560e9feecf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.502+0000 7fa035e00640 1 --2- 172.21.15.69:0/179304210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb351b0 0x560e9feecf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.502+0000 7fa035e00640 1 -- 172.21.15.69:0/179304210 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e9fedec30 con 0x560e9fb0c2f0 2024-05-14T15:35:00.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.503+0000 7fa035e00640 1 --2- 172.21.15.69:0/179304210 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb0c2f0 0x560e9fed1c80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa0280057c0 tx=0x7fa028000bc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5a434620849186e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.504+0000 7fa022a00640 1 -- 172.21.15.69:0/179304210 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa028003e30 con 0x560e9fb0c2f0 2024-05-14T15:35:00.505 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.504+0000 7fa022a00640 1 -- 172.21.15.69:0/179304210 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa02803c440 con 0x560e9fb0c2f0 2024-05-14T15:35:00.506 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.504+0000 7fa022a00640 1 -- 172.21.15.69:0/179304210 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa028004700 con 0x560e9fb0c2f0 2024-05-14T15:35:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.506+0000 7fa044024740 1 -- 172.21.15.69:0/179304210 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb0c2f0 msgr2=0x560e9fed1c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.506+0000 7fa044024740 1 --2- 172.21.15.69:0/179304210 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb0c2f0 0x560e9fed1c80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fa0280057c0 tx=0x7fa028000bc0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.506+0000 7fa044024740 1 -- 172.21.15.69:0/179304210 shutdown_connections 2024-05-14T15:35:00.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.506+0000 7fa044024740 1 --2- 172.21.15.69:0/179304210 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb351b0 0x560e9feecf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.506+0000 7fa044024740 1 --2- 172.21.15.69:0/179304210 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb144d0 0x560e9feeca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.506+0000 7fa044024740 1 --2- 172.21.15.69:0/179304210 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb0c2f0 0x560e9fed1c80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.506+0000 7fa044024740 1 -- 172.21.15.69:0/179304210 >> 172.21.15.69:0/179304210 conn(0x560e9fb29300 msgr2=0x560e9fed6210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:00.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.506+0000 7fa044024740 1 -- 172.21.15.69:0/179304210 shutdown_connections 2024-05-14T15:35:00.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.506+0000 7fa044024740 1 -- 172.21.15.69:0/179304210 wait complete. 2024-05-14T15:35:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.507+0000 7fa044024740 1 -- start start 2024-05-14T15:35:00.509 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.507+0000 7fa044024740 1 Processor -- start 2024-05-14T15:35:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.509+0000 7fa044024740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb0c2f0 0x560e9fef5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.510 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.509+0000 7fa044024740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb144d0 0x560e9fef61d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.509+0000 7fa044024740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb351b0 0x560e9fef3110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.509+0000 7fa035400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb144d0 0x560e9fef61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.509+0000 7fa035400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb144d0 0x560e9fef61d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54404/0 (socket says 172.21.15.69:54404) 2024-05-14T15:35:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.510+0000 7fa044024740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa0180114f0 con 0x560e9fb144d0 2024-05-14T15:35:00.511 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.510+0000 7fa044024740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa018010e20 con 0x560e9fb351b0 2024-05-14T15:35:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.510+0000 7fa044024740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa01800e080 con 0x560e9fb0c2f0 2024-05-14T15:35:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.510+0000 7fa044024740 10 client.0 _ll_register_callbacks cb 0x7fa030009a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:35:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.510+0000 7fa035400640 1 -- 172.21.15.69:0/3633751413 learned_addr learned my addr 172.21.15.69:0/3633751413 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.510+0000 7fa035e00640 1 --2- 172.21.15.69:0/3633751413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb0c2f0 0x560e9fef5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:00.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.511+0000 7fa036800640 1 --2- 172.21.15.69:0/3633751413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb351b0 0x560e9fef3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.511+0000 7fa035400640 1 -- 172.21.15.69:0/3633751413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb0c2f0 msgr2=0x560e9fef5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.511+0000 7fa035400640 1 --2- 172.21.15.69:0/3633751413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb0c2f0 0x560e9fef5c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.511+0000 7fa035400640 1 -- 172.21.15.69:0/3633751413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb351b0 msgr2=0x560e9fef3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.511+0000 7fa035400640 1 --2- 172.21.15.69:0/3633751413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb351b0 0x560e9fef3110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.511+0000 7fa035400640 1 -- 172.21.15.69:0/3633751413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e9fef3850 con 0x560e9fb144d0 2024-05-14T15:35:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.511+0000 7fa035400640 1 --2- 172.21.15.69:0/3633751413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb144d0 0x560e9fef61d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa0240038c0 tx=0x7fa0240a8d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fcc2e98acde257f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:00.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.511+0000 7fa017e00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:35:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.512+0000 7fa017e00640 1 -- 172.21.15.69:0/3633751413 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0240a9a00 con 0x560e9fb144d0 2024-05-14T15:35:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.512+0000 7fa017e00640 1 -- 172.21.15.69:0/3633751413 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(106..106 src has 1..106) ==== 9554+0+0 (secure 0 0 0) 0x7fa024004310 con 0x560e9fb144d0 2024-05-14T15:35:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.513+0000 7fa044024740 1 -- 172.21.15.69:0/3633751413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa02803c440 con 0x560e9fb144d0 2024-05-14T15:35:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.513+0000 7fa017e00640 1 -- 172.21.15.69:0/3633751413 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=62) ==== 24+0+0 (secure 0 0 0) 0x7fa0240a9300 con 0x560e9fb144d0 2024-05-14T15:35:00.514 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.513+0000 7fa044024740 10 client.17157 fetch_fsmap learned FSMap version 62 2024-05-14T15:35:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.514+0000 7fa044024740 1 -- 172.21.15.69:0/3633751413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=62,monmap=4+}) -- 0x560e9ff62f10 con 0x560e9fb144d0 2024-05-14T15:35:00.515 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.514+0000 7fa017e00640 1 -- 172.21.15.69:0/3633751413 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa02803c440 con 0x560e9fb144d0 2024-05-14T15:35:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.514+0000 7fa017e00640 1 -- 172.21.15.69:0/3633751413 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 62) ==== 8362+0+0 (secure 0 0 0) 0x7fa0240df9f0 con 0x560e9fb144d0 2024-05-14T15:35:00.516 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.515+0000 7fa044024740 10 client.17157 fetch_fsmap finished waiting for FSMap version 62 2024-05-14T15:35:00.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.515+0000 7fa044024740 10 client.17157 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:35:00.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.515+0000 7fa044024740 20 client.17157 populate_metadata read hostname 'smithi069' 2024-05-14T15:35:00.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.515+0000 7fa044024740 1 --2- 172.21.15.69:0/3633751413 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560e9fac91c0 0x560e9ff65660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:00.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.516+0000 7fa044024740 4 client.17157 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:35:00.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.516+0000 7fa044024740 1 -- 172.21.15.69:0/3633751413 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x560e9fe42fd0 con 0x560e9fac91c0 2024-05-14T15:35:00.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.519+0000 7fa035e00640 1 --2- 172.21.15.69:0/3633751413 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560e9fac91c0 0x560e9ff65660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.521+0000 7fa035e00640 1 --2- 172.21.15.69:0/3633751413 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560e9fac91c0 0x560e9ff65660 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8afe197e34813289 server_cookie=c4129a8ab278e525 in_seq=0 out_seq=0 2024-05-14T15:35:00.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.521+0000 7fa017e00640 10 client.17157 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:00.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.601+0000 7fa017e00640 1 -- 172.21.15.69:0/3633751413 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x560e9fe42fd0 con 0x560e9fac91c0 2024-05-14T15:35:00.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.601+0000 7fa017e00640 10 client.17157 handle_command_reply: tid=0 2024-05-14T15:35:00.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.601+0000 7fa044024740 1 client.17157 shutdown 2024-05-14T15:35:00.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.601+0000 7fa044024740 1 -- 172.21.15.69:0/3633751413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb144d0 msgr2=0x560e9fef61d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:00.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.601+0000 7fa044024740 1 --2- 172.21.15.69:0/3633751413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb144d0 0x560e9fef61d0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fa0240038c0 tx=0x7fa0240a8d10 comp rx=0 tx=0).stop 2024-05-14T15:35:00.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.602+0000 7fa044024740 1 -- 172.21.15.69:0/3633751413 shutdown_connections 2024-05-14T15:35:00.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.602+0000 7fa044024740 1 --2- 172.21.15.69:0/3633751413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x560e9fb351b0 0x560e9fef3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.602+0000 7fa044024740 1 --2- 172.21.15.69:0/3633751413 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x560e9fac91c0 0x560e9ff65660 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.602+0000 7fa044024740 1 --2- 172.21.15.69:0/3633751413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x560e9fb144d0 0x560e9fef61d0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.602+0000 7fa044024740 1 --2- 172.21.15.69:0/3633751413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x560e9fb0c2f0 0x560e9fef5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.602+0000 7fa017e00640 0 client.17157 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:00.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.602+0000 7fa044024740 1 -- 172.21.15.69:0/3633751413 >> 172.21.15.69:0/3633751413 conn(0x560e9fb29300 msgr2=0x560e9fed19e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:00.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.602+0000 7fa044024740 1 -- 172.21.15.69:0/3633751413 shutdown_connections 2024-05-14T15:35:00.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.602+0000 7fa044024740 1 -- 172.21.15.69:0/3633751413 wait complete. 2024-05-14T15:35:00.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.602+0000 7fa044024740 20 client.17157 trim_cache size 0 max 16384 2024-05-14T15:35:00.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:35:00.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:35:00.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:35:00.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:35:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.603+0000 7fa037200640 1 -- 172.21.15.69:0/3127788253 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa01c0b2aa0 msgr2=0x7fa01c0b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.603+0000 7fa037200640 1 --2- 172.21.15.69:0/3127788253 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa01c0b2aa0 0x7fa01c0b4fb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x560e9fed35f0 tx=0x7fa030009600 comp rx=0 tx=0).stop 2024-05-14T15:35:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.603+0000 7fa037200640 1 -- 172.21.15.69:0/3127788253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa03810d9d0 msgr2=0x7fa03819cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.603+0000 7fa037200640 1 --2- 172.21.15.69:0/3127788253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa03810d9d0 0x7fa03819cd40 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa024005fd0 tx=0x7fa02400dde0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.603+0000 7fa037200640 1 -- 172.21.15.69:0/3127788253 shutdown_connections 2024-05-14T15:35:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.603+0000 7fa037200640 1 --2- 172.21.15.69:0/3127788253 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa01c0b2aa0 0x7fa01c0b4fb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.603+0000 7fa037200640 1 --2- 172.21.15.69:0/3127788253 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa038110330 0x7fa0381a1000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.603+0000 7fa037200640 1 --2- 172.21.15.69:0/3127788253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa03810d9d0 0x7fa03819cd40 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.603+0000 7fa037200640 1 --2- 172.21.15.69:0/3127788253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa038075430 0x7fa03819c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.603+0000 7fa037200640 1 -- 172.21.15.69:0/3127788253 >> 172.21.15.69:0/3127788253 conn(0x7fa03807a1c0 msgr2=0x7fa038102200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:00.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.603+0000 7fa037200640 1 -- 172.21.15.69:0/3127788253 shutdown_connections 2024-05-14T15:35:00.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:00.603+0000 7fa037200640 1 -- 172.21.15.69:0/3127788253 wait complete. 2024-05-14T15:35:01.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 555.0 s, 68.2 tps, lat 1808.880 ms stddev 1476.895 2024-05-14T15:35:01.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:01 smithi203 ceph-mon[34567]: pgmap v418: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 9.9 MiB/s wr, 815 op/s 2024-05-14T15:35:01.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:01 smithi092 ceph-mon[34729]: pgmap v418: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 9.9 MiB/s wr, 815 op/s 2024-05-14T15:35:01.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:01 smithi069 ceph-mon[31270]: pgmap v418: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 188 KiB/s rd, 9.9 MiB/s wr, 815 op/s 2024-05-14T15:35:03.779 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:03 smithi069 ceph-mon[31270]: pgmap v419: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 6.4 MiB/s wr, 629 op/s 2024-05-14T15:35:03.780 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:03 smithi069 ceph-mon[31270]: osdmap e107: 12 total, 12 up, 12 in 2024-05-14T15:35:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:03 smithi203 ceph-mon[34567]: pgmap v419: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 6.4 MiB/s wr, 629 op/s 2024-05-14T15:35:03.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:03 smithi203 ceph-mon[34567]: osdmap e107: 12 total, 12 up, 12 in 2024-05-14T15:35:03.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:03 smithi092 ceph-mon[34729]: pgmap v419: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 152 KiB/s rd, 6.4 MiB/s wr, 629 op/s 2024-05-14T15:35:03.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:03 smithi092 ceph-mon[34729]: osdmap e107: 12 total, 12 up, 12 in 2024-05-14T15:35:05.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:05 smithi203 ceph-mon[34567]: pgmap v421: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 7.8 MiB/s wr, 756 op/s 2024-05-14T15:35:05.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:05 smithi092 ceph-mon[34729]: pgmap v421: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 7.8 MiB/s wr, 756 op/s 2024-05-14T15:35:05.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:05 smithi069 ceph-mon[31270]: pgmap v421: 129 pgs: 129 active+clean; 3.1 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 180 KiB/s rd, 7.8 MiB/s wr, 756 op/s 2024-05-14T15:35:06.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 560.0 s, 572.4 tps, lat 176.199 ms stddev 232.740 2024-05-14T15:35:06.847 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:06 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:35:06.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:06 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:35:06.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:06 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:35:07.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:07 smithi203 ceph-mon[34567]: pgmap v422: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 7.7 MiB/s wr, 688 op/s 2024-05-14T15:35:07.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:07 smithi092 ceph-mon[34729]: pgmap v422: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 7.7 MiB/s wr, 688 op/s 2024-05-14T15:35:07.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:07 smithi069 ceph-mon[31270]: pgmap v422: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 7.7 MiB/s wr, 688 op/s 2024-05-14T15:35:09.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:09 smithi203 ceph-mon[34567]: pgmap v423: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 7.7 MiB/s wr, 688 op/s 2024-05-14T15:35:09.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:09 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:35:09.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:09 smithi092 ceph-mon[34729]: pgmap v423: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 7.7 MiB/s wr, 688 op/s 2024-05-14T15:35:09.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:09 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:35:09.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:09 smithi069 ceph-mon[31270]: pgmap v423: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 226 KiB/s rd, 7.7 MiB/s wr, 688 op/s 2024-05-14T15:35:09.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:09 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:35:11.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:10 smithi092 ceph-mon[34729]: osdmap e108: 12 total, 12 up, 12 in 2024-05-14T15:35:11.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:10 smithi069 ceph-mon[31270]: osdmap e108: 12 total, 12 up, 12 in 2024-05-14T15:35:11.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:10 smithi203 ceph-mon[34567]: osdmap e108: 12 total, 12 up, 12 in 2024-05-14T15:35:11.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 565.0 s, 471.0 tps, lat 218.298 ms stddev 249.308 2024-05-14T15:35:12.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:11 smithi092 ceph-mon[34729]: pgmap v425: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 8.7 MiB/s wr, 702 op/s 2024-05-14T15:35:12.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:11 smithi069 ceph-mon[31270]: pgmap v425: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 8.7 MiB/s wr, 702 op/s 2024-05-14T15:35:12.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:11 smithi203 ceph-mon[34567]: pgmap v425: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 168 KiB/s rd, 8.7 MiB/s wr, 702 op/s 2024-05-14T15:35:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.956+0000 7fec81600640 1 -- 172.21.15.69:0/1353165403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7c10a4a0 msgr2=0x7fec7c10a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.956+0000 7fec81600640 1 --2- 172.21.15.69:0/1353165403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7c10a4a0 0x7fec7c10a8b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fec74009ca0 tx=0x7fec7402a950 comp rx=0 tx=0).stop 2024-05-14T15:35:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.957+0000 7fec81600640 1 -- 172.21.15.69:0/1353165403 shutdown_connections 2024-05-14T15:35:13.959 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.957+0000 7fec81600640 1 --2- 172.21.15.69:0/1353165403 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec7c112910 0x7fec7c118ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.957+0000 7fec81600640 1 --2- 172.21.15.69:0/1353165403 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c111df0 0x7fec7c112280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.957+0000 7fec81600640 1 --2- 172.21.15.69:0/1353165403 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7c10a4a0 0x7fec7c10a8b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:13.960 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.957+0000 7fec81600640 1 -- 172.21.15.69:0/1353165403 >> 172.21.15.69:0/1353165403 conn(0x7fec7c06e900 msgr2=0x7fec7c06ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.960+0000 7fec81600640 1 -- 172.21.15.69:0/1353165403 shutdown_connections 2024-05-14T15:35:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.961+0000 7fec81600640 1 -- 172.21.15.69:0/1353165403 wait complete. 2024-05-14T15:35:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.963+0000 7fec81600640 1 Processor -- start 2024-05-14T15:35:13.965 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.963+0000 7fec81600640 1 -- start start 2024-05-14T15:35:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.964+0000 7fec81600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c10a4a0 0x7fec7c122070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.964+0000 7fec81600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec7c111df0 0x7fec7c11b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:13.966 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.964+0000 7fec81600640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7c112910 0x7fec7c11b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:13.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.965+0000 7fec81600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c122b60 con 0x7fec7c10a4a0 2024-05-14T15:35:13.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.965+0000 7fec81600640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c1229e0 con 0x7fec7c112910 2024-05-14T15:35:13.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.965+0000 7fec81600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c122ce0 con 0x7fec7c111df0 2024-05-14T15:35:13.968 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.965+0000 7fec7aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c10a4a0 0x7fec7c122070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:13.969 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.965+0000 7fec7a000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec7c111df0 0x7fec7c11b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:13.969 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.965+0000 7fec7aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c10a4a0 0x7fec7c122070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33678/0 (socket says 172.21.15.69:33678) 2024-05-14T15:35:13.969 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.965+0000 7fec7aa00640 1 -- 172.21.15.69:0/3877875161 learned_addr learned my addr 172.21.15.69:0/3877875161 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:13.969 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.965+0000 7fec7a000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec7c111df0 0x7fec7c11b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:50244/0 (socket says 172.21.15.69:50244) 2024-05-14T15:35:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.965+0000 7fec7b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7c112910 0x7fec7c11b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.966+0000 7fec7a000640 1 -- 172.21.15.69:0/3877875161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7c112910 msgr2=0x7fec7c11b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.966+0000 7fec7a000640 1 --2- 172.21.15.69:0/3877875161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7c112910 0x7fec7c11b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.966+0000 7fec7a000640 1 -- 172.21.15.69:0/3877875161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c10a4a0 msgr2=0x7fec7c122070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.966+0000 7fec7a000640 1 --2- 172.21.15.69:0/3877875161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c10a4a0 0x7fec7c122070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.966+0000 7fec7a000640 1 -- 172.21.15.69:0/3877875161 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec7c11fb90 con 0x7fec7c111df0 2024-05-14T15:35:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.966+0000 7fec7a000640 1 --2- 172.21.15.69:0/3877875161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec7c111df0 0x7fec7c11b1e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009790 tx=0x7fec6c009c50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.967+0000 7fec73400640 1 -- 172.21.15.69:0/3877875161 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6c01c070 con 0x7fec7c111df0 2024-05-14T15:35:13.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.967+0000 7fec81600640 1 -- 172.21.15.69:0/3877875161 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec7c11fe80 con 0x7fec7c111df0 2024-05-14T15:35:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.967+0000 7fec81600640 1 -- 172.21.15.69:0/3877875161 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec7c1203d0 con 0x7fec7c111df0 2024-05-14T15:35:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.967+0000 7fec73400640 1 -- 172.21.15.69:0/3877875161 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec6c00cc60 con 0x7fec7c111df0 2024-05-14T15:35:13.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.967+0000 7fec73400640 1 -- 172.21.15.69:0/3877875161 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6c0165c0 con 0x7fec7c111df0 2024-05-14T15:35:13.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.980+0000 7fec88598740 1 Processor -- start 2024-05-14T15:35:13.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.980+0000 7fec73400640 1 -- 172.21.15.69:0/3877875161 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fec6c01f070 con 0x7fec7c111df0 2024-05-14T15:35:13.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.981+0000 7fec88598740 1 -- start start 2024-05-14T15:35:13.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.985+0000 7fec88598740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a75c1b0 0x56401aafd280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:13.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.985+0000 7fec88598740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a7332f0 0x56401aafd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.986+0000 7fec88598740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a73b4d0 0x56401aafdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.986+0000 7fec88598740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56401aa62550 con 0x56401a7332f0 2024-05-14T15:35:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.986+0000 7fec88598740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56401aa07bc0 con 0x56401a75c1b0 2024-05-14T15:35:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.986+0000 7fec88598740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56401aa5e510 con 0x56401a73b4d0 2024-05-14T15:35:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.986+0000 7fec7b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a75c1b0 0x56401aafd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.986+0000 7fec7b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a75c1b0 0x56401aafd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:57116/0 (socket says 172.21.15.69:57116) 2024-05-14T15:35:13.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.986+0000 7fec73400640 1 --2- 172.21.15.69:0/3877875161 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fec600b2ae0 0x7fec600b4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:13.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.986+0000 7fec7b400640 1 -- 172.21.15.69:0/1121301359 learned_addr learned my addr 172.21.15.69:0/1121301359 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:13.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.986+0000 7fec7aa00640 1 --2- 172.21.15.69:0/1121301359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a7332f0 0x56401aafd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:13.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.987+0000 7fec73400640 1 -- 172.21.15.69:0/3877875161 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9554+0+0 (secure 0 0 0) 0x7fec6c0e2580 con 0x7fec7c111df0 2024-05-14T15:35:13.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.987+0000 7fec7b400640 1 --2- 172.21.15.69:0/3877875161 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fec600b2ae0 0x7fec600b4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.987+0000 7fec7a000640 1 --2- 172.21.15.69:0/1121301359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a73b4d0 0x56401aafdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.988+0000 7fec7aa00640 1 -- 172.21.15.69:0/1121301359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a73b4d0 msgr2=0x56401aafdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.988+0000 7fec7aa00640 1 --2- 172.21.15.69:0/1121301359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a73b4d0 0x56401aafdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.988+0000 7fec7aa00640 1 -- 172.21.15.69:0/1121301359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a75c1b0 msgr2=0x56401aafd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:13.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.988+0000 7fec7aa00640 1 --2- 172.21.15.69:0/1121301359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a75c1b0 0x56401aafd280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.988+0000 7fec7aa00640 1 -- 172.21.15.69:0/1121301359 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56401a774210 con 0x56401a7332f0 2024-05-14T15:35:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.988+0000 7fec7b400640 1 --2- 172.21.15.69:0/1121301359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a75c1b0 0x56401aafd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:35:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.989+0000 7fec7b400640 1 --2- 172.21.15.69:0/3877875161 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fec600b2ae0 0x7fec600b4ff0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x56401aafa3f0 tx=0x7fec64004730 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:13.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.989+0000 7fec7aa00640 1 --2- 172.21.15.69:0/1121301359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a7332f0 0x56401aafd7c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fec74005e30 tx=0x7fec7402f3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d726daab93246541 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:13.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.990+0000 7fec6b400640 1 -- 172.21.15.69:0/1121301359 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74048070 con 0x56401a7332f0 2024-05-14T15:35:13.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.990+0000 7fec6b400640 1 -- 172.21.15.69:0/1121301359 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec74003e00 con 0x56401a7332f0 2024-05-14T15:35:13.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.990+0000 7fec6b400640 1 -- 172.21.15.69:0/1121301359 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74034040 con 0x56401a7332f0 2024-05-14T15:35:13.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.993+0000 7fec88598740 1 -- 172.21.15.69:0/1121301359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a7332f0 msgr2=0x56401aafd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:13.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.993+0000 7fec88598740 1 --2- 172.21.15.69:0/1121301359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a7332f0 0x56401aafd7c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fec74005e30 tx=0x7fec7402f3a0 comp rx=0 tx=0).stop 2024-05-14T15:35:13.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.994+0000 7fec88598740 1 -- 172.21.15.69:0/1121301359 shutdown_connections 2024-05-14T15:35:13.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.994+0000 7fec88598740 1 --2- 172.21.15.69:0/1121301359 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a73b4d0 0x56401aafdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:13.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.994+0000 7fec88598740 1 --2- 172.21.15.69:0/1121301359 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a7332f0 0x56401aafd7c0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:13.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.994+0000 7fec88598740 1 --2- 172.21.15.69:0/1121301359 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a75c1b0 0x56401aafd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:13.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.994+0000 7fec88598740 1 -- 172.21.15.69:0/1121301359 >> 172.21.15.69:0/1121301359 conn(0x56401a750300 msgr2=0x56401aaf9a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:13.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.995+0000 7fec88598740 1 -- 172.21.15.69:0/1121301359 shutdown_connections 2024-05-14T15:35:13.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.995+0000 7fec88598740 1 -- 172.21.15.69:0/1121301359 wait complete. 2024-05-14T15:35:13.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.996+0000 7fec88598740 1 -- start start 2024-05-14T15:35:13.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.996+0000 7fec88598740 1 Processor -- start 2024-05-14T15:35:14.000 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.998+0000 7fec88598740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a7332f0 0x56401ab07750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.998+0000 7fec88598740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a73b4d0 0x56401ab07c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.998+0000 7fec88598740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 0x56401ab13880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.998+0000 7fec88598740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56401ab0a350 con 0x56401a73b4d0 2024-05-14T15:35:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.998+0000 7fec88598740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56401aa1b660 con 0x56401a7332f0 2024-05-14T15:35:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.998+0000 7fec88598740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56401ab0a4d0 con 0x56401a75c1b0 2024-05-14T15:35:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.998+0000 7fec88598740 10 client.0 _ll_register_callbacks cb 0x56401a9e5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:35:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.998+0000 7fec7aa00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a7332f0 0x56401ab07750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.998+0000 7fec7aa00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a7332f0 0x56401ab07750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:57132/0 (socket says 172.21.15.69:57132) 2024-05-14T15:35:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.998+0000 7fec7aa00640 1 -- 172.21.15.69:0/190847730 learned_addr learned my addr 172.21.15.69:0/190847730 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:14.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.998+0000 7fec7b400640 1 --2- 172.21.15.69:0/190847730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 0x56401ab13880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.999+0000 7fec7a000640 1 --2- 172.21.15.69:0/190847730 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a73b4d0 0x56401ab07c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.999+0000 7fec7b400640 1 -- 172.21.15.69:0/190847730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a7332f0 msgr2=0x56401ab07750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.999+0000 7fec7b400640 1 --2- 172.21.15.69:0/190847730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a7332f0 0x56401ab07750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.999+0000 7fec7b400640 1 -- 172.21.15.69:0/190847730 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a73b4d0 msgr2=0x56401ab07c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.999+0000 7fec7b400640 1 --2- 172.21.15.69:0/190847730 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a73b4d0 0x56401ab07c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:13.999+0000 7fec7b400640 1 -- 172.21.15.69:0/190847730 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56401a840620 con 0x56401a75c1b0 2024-05-14T15:35:14.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.000+0000 7fec7a000640 1 --2- 172.21.15.69:0/190847730 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a73b4d0 0x56401ab07c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:35:14.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.000+0000 7fec7b400640 1 --2- 172.21.15.69:0/190847730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 0x56401ab13880 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fec64009710 tx=0x7fec640046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b319257ba37b2fc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:14.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.000+0000 7fec5fe00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:35:14.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.000+0000 7fec5fe00640 1 -- 172.21.15.69:0/190847730 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec64026070 con 0x56401a75c1b0 2024-05-14T15:35:14.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.001+0000 7fec88598740 1 -- 172.21.15.69:0/190847730 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec74003e00 con 0x56401a75c1b0 2024-05-14T15:35:14.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.001+0000 7fec5fe00640 1 -- 172.21.15.69:0/190847730 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9554+0+0 (secure 0 0 0) 0x7fec64005020 con 0x56401a75c1b0 2024-05-14T15:35:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.001+0000 7fec5fe00640 1 -- 172.21.15.69:0/190847730 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fec6400fe30 con 0x56401a75c1b0 2024-05-14T15:35:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.001+0000 7fec88598740 10 client.26668 fetch_fsmap learned FSMap version 65 2024-05-14T15:35:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.001+0000 7fec88598740 1 -- 172.21.15.69:0/190847730 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x56401ab16650 con 0x56401a75c1b0 2024-05-14T15:35:14.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.002+0000 7fec5fe00640 1 -- 172.21.15.69:0/190847730 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec74003e00 con 0x56401a75c1b0 2024-05-14T15:35:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.002+0000 7fec5fe00640 1 -- 172.21.15.69:0/190847730 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 65) ==== 8378+0+0 (secure 0 0 0) 0x7fec640047a0 con 0x56401a75c1b0 2024-05-14T15:35:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.002+0000 7fec88598740 10 client.26668 fetch_fsmap finished waiting for FSMap version 65 2024-05-14T15:35:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.002+0000 7fec88598740 10 client.26668 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:35:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.002+0000 7fec88598740 20 client.26668 populate_metadata read hostname 'smithi069' 2024-05-14T15:35:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.003+0000 7fec88598740 1 --2- 172.21.15.69:0/190847730 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56401a71ad80 0x56401ab19f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.003+0000 7fec88598740 4 client.26668 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:35:14.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.003+0000 7fec88598740 1 -- 172.21.15.69:0/190847730 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56401aa70160 con 0x56401a71ad80 2024-05-14T15:35:14.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.004+0000 7fec7aa00640 1 --2- 172.21.15.69:0/190847730 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56401a71ad80 0x56401ab19f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.006+0000 7fec7aa00640 1 --2- 172.21.15.69:0/190847730 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56401a71ad80 0x56401ab19f90 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=132ec6dcfb48e836 server_cookie=54593cec0bf9bd56 in_seq=0 out_seq=0 2024-05-14T15:35:14.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.006+0000 7fec5fe00640 10 client.26668 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.007+0000 7fec5fe00640 1 -- 172.21.15.69:0/190847730 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56401aa70160 con 0x56401a71ad80 2024-05-14T15:35:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.007+0000 7fec5fe00640 10 client.26668 handle_command_reply: tid=0 2024-05-14T15:35:14.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.007+0000 7fec88598740 1 client.26668 shutdown 2024-05-14T15:35:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.008+0000 7fec88598740 1 -- 172.21.15.69:0/190847730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 msgr2=0x56401ab13880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.008+0000 7fec88598740 1 --2- 172.21.15.69:0/190847730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 0x56401ab13880 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fec64009710 tx=0x7fec640046c0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.009+0000 7fec88598740 1 -- 172.21.15.69:0/190847730 shutdown_connections 2024-05-14T15:35:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.009+0000 7fec88598740 1 --2- 172.21.15.69:0/190847730 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 0x56401ab13880 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.009+0000 7fec88598740 1 --2- 172.21.15.69:0/190847730 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56401a71ad80 0x56401ab19f90 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.009+0000 7fec88598740 1 --2- 172.21.15.69:0/190847730 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a73b4d0 0x56401ab07c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.009+0000 7fec88598740 1 --2- 172.21.15.69:0/190847730 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a7332f0 0x56401ab07750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.009+0000 7fec88598740 1 -- 172.21.15.69:0/190847730 >> 172.21.15.69:0/190847730 conn(0x56401a750300 msgr2=0x56401aafd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.009+0000 7fec5fe00640 0 client.26668 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.009+0000 7fec88598740 1 -- 172.21.15.69:0/190847730 shutdown_connections 2024-05-14T15:35:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.009+0000 7fec88598740 1 -- 172.21.15.69:0/190847730 wait complete. 2024-05-14T15:35:14.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.009+0000 7fec88598740 20 client.26668 trim_cache size 0 max 16384 2024-05-14T15:35:14.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.050+0000 7fec88598740 1 Processor -- start 2024-05-14T15:35:14.052 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.050+0000 7fec88598740 1 -- start start 2024-05-14T15:35:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.050+0000 7fec88598740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a7332f0 0x56401ab06480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:14.053 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.051+0000 7fec88598740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a73b4d0 0x56401aaf9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.051+0000 7fec88598740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 0x56401ab1f750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.051+0000 7fec88598740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c1c8a50 con 0x56401a73b4d0 2024-05-14T15:35:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.051+0000 7fec88598740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c1ca650 con 0x56401a7332f0 2024-05-14T15:35:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.051+0000 7fec88598740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c1c9120 con 0x56401a75c1b0 2024-05-14T15:35:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.051+0000 7fec7aa00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a7332f0 0x56401ab06480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.052+0000 7fec7aa00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a7332f0 0x56401ab06480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:57138/0 (socket says 172.21.15.69:57138) 2024-05-14T15:35:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.052+0000 7fec7aa00640 1 -- 172.21.15.69:0/12090481 learned_addr learned my addr 172.21.15.69:0/12090481 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:14.054 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.052+0000 7fec7b400640 1 --2- 172.21.15.69:0/12090481 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 0x56401ab1f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.052+0000 7fec7a000640 1 --2- 172.21.15.69:0/12090481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a73b4d0 0x56401aaf9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.052+0000 7fec7aa00640 1 -- 172.21.15.69:0/12090481 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 msgr2=0x56401ab1f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.052+0000 7fec7aa00640 1 --2- 172.21.15.69:0/12090481 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 0x56401ab1f750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.052+0000 7fec7aa00640 1 -- 172.21.15.69:0/12090481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a73b4d0 msgr2=0x56401aaf9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:14.055 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.052+0000 7fec7aa00640 1 --2- 172.21.15.69:0/12090481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a73b4d0 0x56401aaf9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.052+0000 7fec7aa00640 1 -- 172.21.15.69:0/12090481 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56401aaf3ca0 con 0x56401a7332f0 2024-05-14T15:35:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.053+0000 7fec7b400640 1 --2- 172.21.15.69:0/12090481 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 0x56401ab1f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:35:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.053+0000 7fec7a000640 1 --2- 172.21.15.69:0/12090481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a73b4d0 0x56401aaf9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:35:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.053+0000 7fec7aa00640 1 --2- 172.21.15.69:0/12090481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a7332f0 0x56401ab06480 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fec74009dc0 tx=0x7fec7402b0d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e815812217664cc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:14.056 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.054+0000 7fec6aa00640 1 -- 172.21.15.69:0/12090481 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74048040 con 0x56401a7332f0 2024-05-14T15:35:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.054+0000 7fec6aa00640 1 -- 172.21.15.69:0/12090481 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec74056070 con 0x56401a7332f0 2024-05-14T15:35:14.057 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.054+0000 7fec6aa00640 1 -- 172.21.15.69:0/12090481 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec74034040 con 0x56401a7332f0 2024-05-14T15:35:14.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.056+0000 7fec88598740 1 -- 172.21.15.69:0/12090481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a7332f0 msgr2=0x56401ab06480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:14.058 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.056+0000 7fec88598740 1 --2- 172.21.15.69:0/12090481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a7332f0 0x56401ab06480 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fec74009dc0 tx=0x7fec7402b0d0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.056+0000 7fec88598740 1 -- 172.21.15.69:0/12090481 shutdown_connections 2024-05-14T15:35:14.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.057+0000 7fec88598740 1 --2- 172.21.15.69:0/12090481 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 0x56401ab1f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.057+0000 7fec88598740 1 --2- 172.21.15.69:0/12090481 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a73b4d0 0x56401aaf9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.057+0000 7fec88598740 1 --2- 172.21.15.69:0/12090481 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a7332f0 0x56401ab06480 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.057+0000 7fec88598740 1 -- 172.21.15.69:0/12090481 >> 172.21.15.69:0/12090481 conn(0x56401a750300 msgr2=0x56401aaf9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:14.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.057+0000 7fec88598740 1 -- 172.21.15.69:0/12090481 shutdown_connections 2024-05-14T15:35:14.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.057+0000 7fec88598740 1 -- 172.21.15.69:0/12090481 wait complete. 2024-05-14T15:35:14.060 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.058+0000 7fec88598740 1 -- start start 2024-05-14T15:35:14.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.058+0000 7fec88598740 1 Processor -- start 2024-05-14T15:35:14.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.059+0000 7fec88598740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a7332f0 0x56401ab0fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:14.061 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.059+0000 7fec88598740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a73b4d0 0x56401ab0a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:14.062 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.059+0000 7fec88598740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 0x56401ab0ace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:14.062 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.059+0000 7fec88598740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c1c9f80 con 0x56401a7332f0 2024-05-14T15:35:14.062 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.059+0000 7fec88598740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c1c9820 con 0x56401a73b4d0 2024-05-14T15:35:14.062 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.059+0000 7fec88598740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fec7c1c69d0 con 0x56401a75c1b0 2024-05-14T15:35:14.062 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.060+0000 7fec88598740 10 client.0 _ll_register_callbacks cb 0x7fec64013ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:35:14.062 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.060+0000 7fec7aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a7332f0 0x56401ab0fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:14.062 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.060+0000 7fec7aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a7332f0 0x56401ab0fbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33718/0 (socket says 172.21.15.69:33718) 2024-05-14T15:35:14.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.060+0000 7fec7aa00640 1 -- 172.21.15.69:0/2653097313 learned_addr learned my addr 172.21.15.69:0/2653097313 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:14.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.060+0000 7fec7a000640 1 --2- 172.21.15.69:0/2653097313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a73b4d0 0x56401ab0a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:14.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.060+0000 7fec7b400640 1 --2- 172.21.15.69:0/2653097313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 0x56401ab0ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:14.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.061+0000 7fec7b400640 1 -- 172.21.15.69:0/2653097313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a73b4d0 msgr2=0x56401ab0a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:14.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.061+0000 7fec7b400640 1 --2- 172.21.15.69:0/2653097313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a73b4d0 0x56401ab0a7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.061+0000 7fec7b400640 1 -- 172.21.15.69:0/2653097313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a7332f0 msgr2=0x56401ab0fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:14.063 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.061+0000 7fec7b400640 1 --2- 172.21.15.69:0/2653097313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a7332f0 0x56401ab0fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.061+0000 7fec7b400640 1 -- 172.21.15.69:0/2653097313 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56401ab0b270 con 0x56401a75c1b0 2024-05-14T15:35:14.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.061+0000 7fec7b400640 1 --2- 172.21.15.69:0/2653097313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 0x56401ab0ace0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fec6401f630 tx=0x7fec6400ffd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=aff4c76c9ed0ec8a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:14.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.061+0000 7fec5fe00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:35:14.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.062+0000 7fec5fe00640 1 -- 172.21.15.69:0/2653097313 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec6400fe30 con 0x56401a75c1b0 2024-05-14T15:35:14.064 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.062+0000 7fec88598740 1 -- 172.21.15.69:0/2653097313 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fec74056070 con 0x56401a75c1b0 2024-05-14T15:35:14.065 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.062+0000 7fec5fe00640 1 -- 172.21.15.69:0/2653097313 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9554+0+0 (secure 0 0 0) 0x7fec64005020 con 0x56401a75c1b0 2024-05-14T15:35:14.065 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.063+0000 7fec5fe00640 1 -- 172.21.15.69:0/2653097313 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=65) ==== 24+0+0 (secure 0 0 0) 0x7fec64040050 con 0x56401a75c1b0 2024-05-14T15:35:14.065 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.063+0000 7fec88598740 10 client.26671 fetch_fsmap learned FSMap version 65 2024-05-14T15:35:14.065 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.063+0000 7fec88598740 1 -- 172.21.15.69:0/2653097313 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=65,monmap=4+}) -- 0x56401ab80f90 con 0x56401a75c1b0 2024-05-14T15:35:14.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.063+0000 7fec5fe00640 1 -- 172.21.15.69:0/2653097313 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fec74056070 con 0x56401a75c1b0 2024-05-14T15:35:14.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.064+0000 7fec5fe00640 1 -- 172.21.15.69:0/2653097313 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 65) ==== 8378+0+0 (secure 0 0 0) 0x7fec640047a0 con 0x56401a75c1b0 2024-05-14T15:35:14.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.064+0000 7fec88598740 10 client.26671 fetch_fsmap finished waiting for FSMap version 65 2024-05-14T15:35:14.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.064+0000 7fec88598740 10 client.26671 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:35:14.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.064+0000 7fec88598740 20 client.26671 populate_metadata read hostname 'smithi069' 2024-05-14T15:35:14.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.064+0000 7fec88598740 1 --2- 172.21.15.69:0/2653097313 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56401a6f01c0 0x56401ab83720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:14.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.064+0000 7fec88598740 4 client.26671 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:35:14.066 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.064+0000 7fec88598740 1 -- 172.21.15.69:0/2653097313 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56401aa69fd0 con 0x56401a6f01c0 2024-05-14T15:35:14.068 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.066+0000 7fec7aa00640 1 --2- 172.21.15.69:0/2653097313 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56401a6f01c0 0x56401ab83720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:14.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.067+0000 7fec5fe00640 10 client.26671 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:14.069 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.067+0000 7fec7aa00640 1 --2- 172.21.15.69:0/2653097313 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56401a6f01c0 0x56401ab83720 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cf88392eb2b970b server_cookie=ee5d3e4a1dd7a607 in_seq=0 out_seq=0 2024-05-14T15:35:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.122+0000 7fec5fe00640 1 -- 172.21.15.69:0/2653097313 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56401aa69fd0 con 0x56401a6f01c0 2024-05-14T15:35:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.122+0000 7fec5fe00640 10 client.26671 handle_command_reply: tid=0 2024-05-14T15:35:14.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.123+0000 7fec88598740 1 client.26671 shutdown 2024-05-14T15:35:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.124+0000 7fec88598740 1 -- 172.21.15.69:0/2653097313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 msgr2=0x56401ab0ace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.124+0000 7fec88598740 1 --2- 172.21.15.69:0/2653097313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 0x56401ab0ace0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fec6401f630 tx=0x7fec6400ffd0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.124+0000 7fec88598740 1 -- 172.21.15.69:0/2653097313 shutdown_connections 2024-05-14T15:35:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.124+0000 7fec88598740 1 --2- 172.21.15.69:0/2653097313 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56401a75c1b0 0x56401ab0ace0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.124+0000 7fec88598740 1 --2- 172.21.15.69:0/2653097313 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56401a73b4d0 0x56401ab0a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.124+0000 7fec88598740 1 --2- 172.21.15.69:0/2653097313 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56401a6f01c0 0x56401ab83720 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.124+0000 7fec88598740 1 --2- 172.21.15.69:0/2653097313 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56401a7332f0 0x56401ab0fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.124+0000 7fec88598740 1 -- 172.21.15.69:0/2653097313 >> 172.21.15.69:0/2653097313 conn(0x56401a750300 msgr2=0x56401ab08a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.124+0000 7fec5fe00640 0 client.26671 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:14.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.125+0000 7fec88598740 1 -- 172.21.15.69:0/2653097313 shutdown_connections 2024-05-14T15:35:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.125+0000 7fec88598740 1 -- 172.21.15.69:0/2653097313 wait complete. 2024-05-14T15:35:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.125+0000 7fec88598740 20 client.26671 trim_cache size 0 max 16384 2024-05-14T15:35:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:35:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:35:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:35:14.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:35:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.126+0000 7fec81600640 1 -- 172.21.15.69:0/3877875161 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fec600b2ae0 msgr2=0x7fec600b4ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.126+0000 7fec81600640 1 --2- 172.21.15.69:0/3877875161 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fec600b2ae0 0x7fec600b4ff0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x56401aafa3f0 tx=0x7fec64004730 comp rx=0 tx=0).stop 2024-05-14T15:35:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.126+0000 7fec81600640 1 -- 172.21.15.69:0/3877875161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec7c111df0 msgr2=0x7fec7c11b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.126+0000 7fec81600640 1 --2- 172.21.15.69:0/3877875161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec7c111df0 0x7fec7c11b1e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fec6c009790 tx=0x7fec6c009c50 comp rx=0 tx=0).stop 2024-05-14T15:35:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.126+0000 7fec81600640 1 -- 172.21.15.69:0/3877875161 shutdown_connections 2024-05-14T15:35:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.126+0000 7fec81600640 1 --2- 172.21.15.69:0/3877875161 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fec600b2ae0 0x7fec600b4ff0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.126+0000 7fec81600640 1 --2- 172.21.15.69:0/3877875161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fec7c112910 0x7fec7c11b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.126+0000 7fec81600640 1 --2- 172.21.15.69:0/3877875161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fec7c111df0 0x7fec7c11b1e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.126+0000 7fec81600640 1 --2- 172.21.15.69:0/3877875161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fec7c10a4a0 0x7fec7c122070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:14.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.126+0000 7fec81600640 1 -- 172.21.15.69:0/3877875161 >> 172.21.15.69:0/3877875161 conn(0x7fec7c06e900 msgr2=0x7fec7c10ddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.127+0000 7fec81600640 1 -- 172.21.15.69:0/3877875161 shutdown_connections 2024-05-14T15:35:14.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:14.127+0000 7fec81600640 1 -- 172.21.15.69:0/3877875161 wait complete. 2024-05-14T15:35:14.147 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:13 smithi203 ceph-mon[34567]: pgmap v426: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 7.2 MiB/s wr, 575 op/s 2024-05-14T15:35:14.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:13 smithi092 ceph-mon[34729]: pgmap v426: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 7.2 MiB/s wr, 575 op/s 2024-05-14T15:35:14.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:13 smithi069 ceph-mon[31270]: pgmap v426: 129 pgs: 129 active+clean; 2.8 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 138 KiB/s rd, 7.2 MiB/s wr, 575 op/s 2024-05-14T15:35:15.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:14 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:35:15.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:14 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:35:15.348 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:14 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:35:16.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:15 smithi092 ceph-mon[34729]: pgmap v427: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 7.4 MiB/s wr, 579 op/s 2024-05-14T15:35:16.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:15 smithi069 ceph-mon[31270]: pgmap v427: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 7.4 MiB/s wr, 579 op/s 2024-05-14T15:35:16.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:15 smithi203 ceph-mon[34567]: pgmap v427: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 7.4 MiB/s wr, 579 op/s 2024-05-14T15:35:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 570.0 s, 598.8 tps, lat 168.590 ms stddev 113.114 2024-05-14T15:35:17.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:16 smithi092 ceph-mon[34729]: pgmap v428: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.0 MiB/s wr, 596 op/s 2024-05-14T15:35:17.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:16 smithi069 ceph-mon[31270]: pgmap v428: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.0 MiB/s wr, 596 op/s 2024-05-14T15:35:17.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:16 smithi203 ceph-mon[34567]: pgmap v428: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.0 MiB/s wr, 596 op/s 2024-05-14T15:35:19.596 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:19 smithi203 ceph-mon[34567]: pgmap v429: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.0 MiB/s wr, 596 op/s 2024-05-14T15:35:19.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:19 smithi092 ceph-mon[34729]: pgmap v429: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.0 MiB/s wr, 596 op/s 2024-05-14T15:35:19.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:19 smithi069 ceph-mon[31270]: pgmap v429: 129 pgs: 129 active+clean; 2.9 GiB data, 18 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 7.0 MiB/s wr, 596 op/s 2024-05-14T15:35:20.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:20 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:35:20.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:20 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:35:20.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:20 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:35:21.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 575.0 s, 554.4 tps, lat 178.258 ms stddev 178.006 2024-05-14T15:35:21.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:21 smithi092 ceph-mon[34729]: pgmap v430: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 7.4 MiB/s wr, 664 op/s 2024-05-14T15:35:21.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:21 smithi069 ceph-mon[31270]: pgmap v430: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 7.4 MiB/s wr, 664 op/s 2024-05-14T15:35:21.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:21 smithi203 ceph-mon[34567]: pgmap v430: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 7.4 MiB/s wr, 664 op/s 2024-05-14T15:35:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:23 smithi092 ceph-mon[34729]: pgmap v431: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.3 MiB/s wr, 561 op/s 2024-05-14T15:35:23.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:23 smithi069 ceph-mon[31270]: pgmap v431: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.3 MiB/s wr, 561 op/s 2024-05-14T15:35:23.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:23 smithi203 ceph-mon[34567]: pgmap v431: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 6.3 MiB/s wr, 561 op/s 2024-05-14T15:35:25.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:25 smithi092 ceph-mon[34729]: pgmap v432: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.4 MiB/s wr, 569 op/s 2024-05-14T15:35:25.727 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:25 smithi069 ceph-mon[31270]: pgmap v432: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.4 MiB/s wr, 569 op/s 2024-05-14T15:35:25.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:25 smithi203 ceph-mon[34567]: pgmap v432: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 6.4 MiB/s wr, 569 op/s 2024-05-14T15:35:26.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 580.0 s, 600.2 tps, lat 167.446 ms stddev 76.083 2024-05-14T15:35:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.499+0000 7ffa52800640 1 -- 172.21.15.69:0/1839174550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa4c078730 msgr2=0x7ffa4c078b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.499+0000 7ffa52800640 1 --2- 172.21.15.69:0/1839174550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa4c078730 0x7ffa4c078b40 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c009860 tx=0x7ffa3c02a340 comp rx=0 tx=0).stop 2024-05-14T15:35:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.500+0000 7ffa52800640 1 -- 172.21.15.69:0/1839174550 shutdown_connections 2024-05-14T15:35:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.500+0000 7ffa52800640 1 --2- 172.21.15.69:0/1839174550 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa4c114b00 0x7ffa4c116f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.500+0000 7ffa52800640 1 --2- 172.21.15.69:0/1839174550 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa4c1121a0 0x7ffa4c1145c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.500+0000 7ffa52800640 1 --2- 172.21.15.69:0/1839174550 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa4c078730 0x7ffa4c078b40 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.501 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.500+0000 7ffa52800640 1 -- 172.21.15.69:0/1839174550 >> 172.21.15.69:0/1839174550 conn(0x7ffa4c077200 msgr2=0x7ffa4c077640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:27.502 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.501+0000 7ffa52800640 1 -- 172.21.15.69:0/1839174550 shutdown_connections 2024-05-14T15:35:27.503 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.501+0000 7ffa52800640 1 -- 172.21.15.69:0/1839174550 wait complete. 2024-05-14T15:35:27.504 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.503+0000 7ffa52800640 1 Processor -- start 2024-05-14T15:35:27.506 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.503+0000 7ffa52800640 1 -- start start 2024-05-14T15:35:27.506 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.504+0000 7ffa52800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa4c078730 0x7ffa4c1a0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.506 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.505+0000 7ffa52800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa4c1121a0 0x7ffa4c1a1360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.506 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.505+0000 7ffa52800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa4c114b00 0x7ffa4c1a5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.506 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.505+0000 7ffa52800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c11a320 con 0x7ffa4c1121a0 2024-05-14T15:35:27.506 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.505+0000 7ffa52800640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c11a1a0 con 0x7ffa4c078730 2024-05-14T15:35:27.506 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.505+0000 7ffa52800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c11a4a0 con 0x7ffa4c114b00 2024-05-14T15:35:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.505+0000 7ffa4b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa4c078730 0x7ffa4c1a0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.506+0000 7ffa4be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa4c114b00 0x7ffa4c1a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.506+0000 7ffa4be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa4c114b00 0x7ffa4c1a5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:53564/0 (socket says 172.21.15.69:53564) 2024-05-14T15:35:27.507 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.506+0000 7ffa4be00640 1 -- 172.21.15.69:0/2344140363 learned_addr learned my addr 172.21.15.69:0/2344140363 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.507+0000 7ffa4aa00640 1 --2- 172.21.15.69:0/2344140363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa4c1121a0 0x7ffa4c1a1360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.507+0000 7ffa4b400640 1 -- 172.21.15.69:0/2344140363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa4c114b00 msgr2=0x7ffa4c1a5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.507+0000 7ffa4b400640 1 --2- 172.21.15.69:0/2344140363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa4c114b00 0x7ffa4c1a5620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.508 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.507+0000 7ffa4b400640 1 -- 172.21.15.69:0/2344140363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa4c1121a0 msgr2=0x7ffa4c1a1360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:27.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.510+0000 7ffa4b400640 1 --2- 172.21.15.69:0/2344140363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa4c1121a0 0x7ffa4c1a1360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.510+0000 7ffa4b400640 1 -- 172.21.15.69:0/2344140363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa4c1a5be0 con 0x7ffa4c078730 2024-05-14T15:35:27.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.510+0000 7ffa4aa00640 1 --2- 172.21.15.69:0/2344140363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa4c1121a0 0x7ffa4c1a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:35:27.512 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.511+0000 7ffa4b400640 1 --2- 172.21.15.69:0/2344140363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa4c078730 0x7ffa4c1a0e00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c02a860 tx=0x7ffa3c030ce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:27.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.511+0000 7ffa43e00640 1 -- 172.21.15.69:0/2344140363 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c037040 con 0x7ffa4c078730 2024-05-14T15:35:27.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.511+0000 7ffa43e00640 1 -- 172.21.15.69:0/2344140363 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa3c041070 con 0x7ffa4c078730 2024-05-14T15:35:27.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.511+0000 7ffa43e00640 1 -- 172.21.15.69:0/2344140363 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c0035f0 con 0x7ffa4c078730 2024-05-14T15:35:27.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.512+0000 7ffa52800640 1 -- 172.21.15.69:0/2344140363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa4c1a5e70 con 0x7ffa4c078730 2024-05-14T15:35:27.513 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.512+0000 7ffa52800640 1 -- 172.21.15.69:0/2344140363 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa4c1a6280 con 0x7ffa4c078730 2024-05-14T15:35:27.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.515+0000 7ffa5978d740 1 Processor -- start 2024-05-14T15:35:27.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.516+0000 7ffa5978d740 1 -- start start 2024-05-14T15:35:27.518 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.516+0000 7ffa5978d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82eb1b0 0x55cea868c280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.517+0000 7ffa5978d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea868c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.517+0000 7ffa4be00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82eb1b0 0x55cea868c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:27.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.517+0000 7ffa4be00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82eb1b0 0x55cea868c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:35170/0 (socket says 172.21.15.69:35170) 2024-05-14T15:35:27.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.517+0000 7ffa4be00640 1 -- 172.21.15.69:0/2563487230 learned_addr learned my addr 172.21.15.69:0/2563487230 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:27.519 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.517+0000 7ffa5978d740 1 --2- 172.21.15.69:0/2563487230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82ca4d0 0x55cea868cd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.518+0000 7ffa5978d740 1 -- 172.21.15.69:0/2563487230 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cea85f1550 con 0x55cea82ca4d0 2024-05-14T15:35:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.518+0000 7ffa5978d740 1 -- 172.21.15.69:0/2563487230 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cea8596bc0 con 0x55cea82eb1b0 2024-05-14T15:35:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.518+0000 7ffa5978d740 1 -- 172.21.15.69:0/2563487230 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cea85ed510 con 0x55cea82c22f0 2024-05-14T15:35:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.518+0000 7ffa4aa00640 1 --2- 172.21.15.69:0/2563487230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82ca4d0 0x55cea868cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.519+0000 7ffa4be00640 1 -- 172.21.15.69:0/2563487230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 msgr2=0x55cea868c7c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:35:27.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.519+0000 7ffa4be00640 1 --2- 172.21.15.69:0/2563487230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea868c7c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.519+0000 7ffa4be00640 1 -- 172.21.15.69:0/2563487230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82ca4d0 msgr2=0x55cea868cd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.519+0000 7ffa4be00640 1 --2- 172.21.15.69:0/2563487230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82ca4d0 0x55cea868cd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.519+0000 7ffa4be00640 1 -- 172.21.15.69:0/2563487230 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cea8303210 con 0x55cea82eb1b0 2024-05-14T15:35:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.519+0000 7ffa4be00640 1 --2- 172.21.15.69:0/2563487230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82eb1b0 0x55cea868c280 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffa44007f40 tx=0x7ffa4400f850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad67017c558be28c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.520+0000 7ffa40c00640 1 -- 172.21.15.69:0/2563487230 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa44004d20 con 0x55cea82eb1b0 2024-05-14T15:35:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.520+0000 7ffa40c00640 1 -- 172.21.15.69:0/2563487230 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa44010b90 con 0x55cea82eb1b0 2024-05-14T15:35:27.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.520+0000 7ffa40c00640 1 -- 172.21.15.69:0/2563487230 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa44005660 con 0x55cea82eb1b0 2024-05-14T15:35:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.521+0000 7ffa43e00640 1 -- 172.21.15.69:0/2344140363 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ffa3c030340 con 0x7ffa4c078730 2024-05-14T15:35:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.522+0000 7ffa5978d740 1 -- 172.21.15.69:0/2563487230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82eb1b0 msgr2=0x55cea868c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.522+0000 7ffa5978d740 1 --2- 172.21.15.69:0/2563487230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82eb1b0 0x55cea868c280 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7ffa44007f40 tx=0x7ffa4400f850 comp rx=0 tx=0).stop 2024-05-14T15:35:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.523+0000 7ffa5978d740 1 -- 172.21.15.69:0/2563487230 shutdown_connections 2024-05-14T15:35:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.523+0000 7ffa5978d740 1 --2- 172.21.15.69:0/2563487230 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82ca4d0 0x55cea868cd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.523+0000 7ffa5978d740 1 --2- 172.21.15.69:0/2563487230 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea868c7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.523+0000 7ffa5978d740 1 --2- 172.21.15.69:0/2563487230 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82eb1b0 0x55cea868c280 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.523+0000 7ffa5978d740 1 -- 172.21.15.69:0/2563487230 >> 172.21.15.69:0/2563487230 conn(0x55cea82df300 msgr2=0x55cea8688a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.523+0000 7ffa5978d740 1 -- 172.21.15.69:0/2563487230 shutdown_connections 2024-05-14T15:35:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.523+0000 7ffa5978d740 1 -- 172.21.15.69:0/2563487230 wait complete. 2024-05-14T15:35:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.524+0000 7ffa5978d740 1 -- start start 2024-05-14T15:35:27.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.524+0000 7ffa5978d740 1 Processor -- start 2024-05-14T15:35:27.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.527+0000 7ffa43e00640 1 --2- 172.21.15.69:0/2344140363 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ffa300b2a30 0x7ffa300b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.527+0000 7ffa43e00640 1 -- 172.21.15.69:0/2344140363 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9554+0+0 (secure 0 0 0) 0x7ffa3c102320 con 0x7ffa4c078730 2024-05-14T15:35:27.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.527+0000 7ffa4be00640 1 --2- 172.21.15.69:0/2344140363 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ffa300b2a30 0x7ffa300b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:27.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.530+0000 7ffa4be00640 1 --2- 172.21.15.69:0/2344140363 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ffa300b2a30 0x7ffa300b4f40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffa44005340 tx=0x7ffa44005240 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.530+0000 7ffa5978d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea8696720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.530+0000 7ffa5978d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82ca4d0 0x55cea8696c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.530+0000 7ffa5978d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82eb1b0 0x55cea86a2910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.530+0000 7ffa5978d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cea86993b0 con 0x55cea82ca4d0 2024-05-14T15:35:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.530+0000 7ffa5978d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cea85aa660 con 0x55cea82eb1b0 2024-05-14T15:35:27.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.530+0000 7ffa5978d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cea8699530 con 0x55cea82c22f0 2024-05-14T15:35:27.533 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.530+0000 7ffa5978d740 10 client.0 _ll_register_callbacks cb 0x55cea8574400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:35:27.533 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.531+0000 7ffa4aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82ca4d0 0x55cea8696c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:27.533 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.531+0000 7ffa4aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82ca4d0 0x55cea8696c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59852/0 (socket says 172.21.15.69:59852) 2024-05-14T15:35:27.533 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.531+0000 7ffa4aa00640 1 -- 172.21.15.69:0/167001202 learned_addr learned my addr 172.21.15.69:0/167001202 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:27.533 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.532+0000 7ffa4be00640 1 --2- 172.21.15.69:0/167001202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82eb1b0 0x55cea86a2910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:27.533 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.532+0000 7ffa4b400640 1 --2- 172.21.15.69:0/167001202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea8696720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:27.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.532+0000 7ffa4aa00640 1 -- 172.21.15.69:0/167001202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 msgr2=0x55cea8696720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:27.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.532+0000 7ffa4aa00640 1 --2- 172.21.15.69:0/167001202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea8696720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.532+0000 7ffa4aa00640 1 -- 172.21.15.69:0/167001202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82eb1b0 msgr2=0x55cea86a2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:27.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.532+0000 7ffa4aa00640 1 --2- 172.21.15.69:0/167001202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82eb1b0 0x55cea86a2910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.532+0000 7ffa4aa00640 1 -- 172.21.15.69:0/167001202 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cea83cf620 con 0x55cea82ca4d0 2024-05-14T15:35:27.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.533+0000 7ffa4aa00640 1 --2- 172.21.15.69:0/167001202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82ca4d0 0x55cea8696c60 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ffa38012780 tx=0x7ffa38012c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32111f7a3c0f7f91 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:27.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.533+0000 7ffa35600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:35:27.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.533+0000 7ffa35600640 1 -- 172.21.15.69:0/167001202 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa38010e80 con 0x55cea82ca4d0 2024-05-14T15:35:27.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.533+0000 7ffa35600640 1 -- 172.21.15.69:0/167001202 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9554+0+0 (secure 0 0 0) 0x7ffa38004020 con 0x55cea82ca4d0 2024-05-14T15:35:27.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.533+0000 7ffa5978d740 1 -- 172.21.15.69:0/167001202 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa44010b90 con 0x55cea82ca4d0 2024-05-14T15:35:27.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.534+0000 7ffa35600640 1 -- 172.21.15.69:0/167001202 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7ffa38025050 con 0x55cea82ca4d0 2024-05-14T15:35:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.534+0000 7ffa5978d740 10 client.17184 fetch_fsmap learned FSMap version 66 2024-05-14T15:35:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.534+0000 7ffa5978d740 1 -- 172.21.15.69:0/167001202 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55cea86a56d0 con 0x55cea82ca4d0 2024-05-14T15:35:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.535+0000 7ffa35600640 1 -- 172.21.15.69:0/167001202 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa44010b90 con 0x55cea82ca4d0 2024-05-14T15:35:27.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.535+0000 7ffa35600640 1 -- 172.21.15.69:0/167001202 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7ffa38019030 con 0x55cea82ca4d0 2024-05-14T15:35:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.536+0000 7ffa5978d740 10 client.17184 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:35:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.536+0000 7ffa5978d740 10 client.17184 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:35:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.536+0000 7ffa5978d740 20 client.17184 populate_metadata read hostname 'smithi069' 2024-05-14T15:35:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.536+0000 7ffa5978d740 1 --2- 172.21.15.69:0/167001202 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cea82a9d80 0x55cea86a8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.536+0000 7ffa5978d740 4 client.17184 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:35:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.536+0000 7ffa5978d740 1 -- 172.21.15.69:0/167001202 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cea85ff160 con 0x55cea82a9d80 2024-05-14T15:35:27.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.537+0000 7ffa4b400640 1 --2- 172.21.15.69:0/167001202 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cea82a9d80 0x55cea86a8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.538+0000 7ffa4b400640 1 --2- 172.21.15.69:0/167001202 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cea82a9d80 0x55cea86a8bf0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c011886c7de9ad0 server_cookie=bd39ea2ed5968de0 in_seq=0 out_seq=0 2024-05-14T15:35:27.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.538+0000 7ffa35600640 10 client.17184 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.539+0000 7ffa35600640 1 -- 172.21.15.69:0/167001202 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cea85ff160 con 0x55cea82a9d80 2024-05-14T15:35:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.539+0000 7ffa35600640 10 client.17184 handle_command_reply: tid=0 2024-05-14T15:35:27.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.539+0000 7ffa5978d740 1 client.17184 shutdown 2024-05-14T15:35:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.540+0000 7ffa5978d740 1 -- 172.21.15.69:0/167001202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82ca4d0 msgr2=0x55cea8696c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:27.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.540+0000 7ffa5978d740 1 --2- 172.21.15.69:0/167001202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82ca4d0 0x55cea8696c60 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7ffa38012780 tx=0x7ffa38012c40 comp rx=0 tx=0).stop 2024-05-14T15:35:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.541+0000 7ffa5978d740 1 -- 172.21.15.69:0/167001202 shutdown_connections 2024-05-14T15:35:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.541+0000 7ffa5978d740 1 --2- 172.21.15.69:0/167001202 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82eb1b0 0x55cea86a2910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.541+0000 7ffa5978d740 1 --2- 172.21.15.69:0/167001202 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cea82a9d80 0x55cea86a8bf0 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.541+0000 7ffa5978d740 1 --2- 172.21.15.69:0/167001202 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82ca4d0 0x55cea8696c60 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.541+0000 7ffa5978d740 1 --2- 172.21.15.69:0/167001202 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea8696720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.541+0000 7ffa5978d740 1 -- 172.21.15.69:0/167001202 >> 172.21.15.69:0/167001202 conn(0x55cea82df300 msgr2=0x55cea868c0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:27.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.541+0000 7ffa35600640 0 client.17184 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.541+0000 7ffa5978d740 1 -- 172.21.15.69:0/167001202 shutdown_connections 2024-05-14T15:35:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.542+0000 7ffa5978d740 1 -- 172.21.15.69:0/167001202 wait complete. 2024-05-14T15:35:27.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.542+0000 7ffa5978d740 20 client.17184 trim_cache size 0 max 16384 2024-05-14T15:35:27.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.585+0000 7ffa5978d740 1 Processor -- start 2024-05-14T15:35:27.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.586+0000 7ffa5978d740 1 -- start start 2024-05-14T15:35:27.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.586+0000 7ffa5978d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea868c720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.586+0000 7ffa5978d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82ca4d0 0x55cea86ae3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.586+0000 7ffa5978d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82eb1b0 0x55cea86ae930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.586+0000 7ffa5978d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c1c0220 con 0x55cea82eb1b0 2024-05-14T15:35:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.586+0000 7ffa5978d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c1c1e50 con 0x55cea82ca4d0 2024-05-14T15:35:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.586+0000 7ffa5978d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c1c08f0 con 0x55cea82c22f0 2024-05-14T15:35:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.587+0000 7ffa4b400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea868c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:27.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.587+0000 7ffa4be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82eb1b0 0x55cea86ae930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:27.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.587+0000 7ffa4b400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea868c720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:53584/0 (socket says 172.21.15.69:53584) 2024-05-14T15:35:27.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.587+0000 7ffa4b400640 1 -- 172.21.15.69:0/1096367487 learned_addr learned my addr 172.21.15.69:0/1096367487 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:27.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.587+0000 7ffa4aa00640 1 --2- 172.21.15.69:0/1096367487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82ca4d0 0x55cea86ae3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:27.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.588+0000 7ffa4be00640 1 -- 172.21.15.69:0/1096367487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 msgr2=0x55cea868c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:27.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.588+0000 7ffa4be00640 1 --2- 172.21.15.69:0/1096367487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea868c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.588+0000 7ffa4be00640 1 -- 172.21.15.69:0/1096367487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82ca4d0 msgr2=0x55cea86ae3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.588+0000 7ffa4be00640 1 --2- 172.21.15.69:0/1096367487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82ca4d0 0x55cea86ae3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.588+0000 7ffa4be00640 1 -- 172.21.15.69:0/1096367487 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cea8689620 con 0x55cea82eb1b0 2024-05-14T15:35:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.588+0000 7ffa4be00640 1 --2- 172.21.15.69:0/1096367487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82eb1b0 0x55cea86ae930 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7ffa44007f10 tx=0x7ffa44021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23eafed322544a22 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.589+0000 7ffa37e00640 1 -- 172.21.15.69:0/1096367487 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa44036070 con 0x55cea82eb1b0 2024-05-14T15:35:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.589+0000 7ffa37e00640 1 -- 172.21.15.69:0/1096367487 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa4402b040 con 0x55cea82eb1b0 2024-05-14T15:35:27.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.589+0000 7ffa37e00640 1 -- 172.21.15.69:0/1096367487 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa4402a070 con 0x55cea82eb1b0 2024-05-14T15:35:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.590+0000 7ffa5978d740 1 -- 172.21.15.69:0/1096367487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82eb1b0 msgr2=0x55cea86ae930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:27.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.590+0000 7ffa5978d740 1 --2- 172.21.15.69:0/1096367487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82eb1b0 0x55cea86ae930 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7ffa44007f10 tx=0x7ffa44021000 comp rx=0 tx=0).stop 2024-05-14T15:35:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.591+0000 7ffa5978d740 1 -- 172.21.15.69:0/1096367487 shutdown_connections 2024-05-14T15:35:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.591+0000 7ffa5978d740 1 --2- 172.21.15.69:0/1096367487 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82eb1b0 0x55cea86ae930 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.591+0000 7ffa5978d740 1 --2- 172.21.15.69:0/1096367487 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82ca4d0 0x55cea86ae3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.591+0000 7ffa5978d740 1 --2- 172.21.15.69:0/1096367487 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea868c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.591+0000 7ffa5978d740 1 -- 172.21.15.69:0/1096367487 >> 172.21.15.69:0/1096367487 conn(0x55cea82df300 msgr2=0x55cea868c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.591+0000 7ffa5978d740 1 -- 172.21.15.69:0/1096367487 shutdown_connections 2024-05-14T15:35:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.592+0000 7ffa5978d740 1 -- 172.21.15.69:0/1096367487 wait complete. 2024-05-14T15:35:27.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.592+0000 7ffa5978d740 1 -- start start 2024-05-14T15:35:27.594 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.592+0000 7ffa5978d740 1 Processor -- start 2024-05-14T15:35:27.595 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.594+0000 7ffa5978d740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea869eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.595 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.594+0000 7ffa5978d740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82ca4d0 0x55cea8699e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.595 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.594+0000 7ffa5978d740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82eb1b0 0x55cea869a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.594+0000 7ffa5978d740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c1c1780 con 0x55cea82eb1b0 2024-05-14T15:35:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.594+0000 7ffa5978d740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c1c0ff0 con 0x55cea82ca4d0 2024-05-14T15:35:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.594+0000 7ffa5978d740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ffa4c1a2150 con 0x55cea82c22f0 2024-05-14T15:35:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.595+0000 7ffa4be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82eb1b0 0x55cea869a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.595+0000 7ffa4b400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea869eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.595+0000 7ffa5978d740 10 client.0 _ll_register_callbacks cb 0x7ffa380096e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:35:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.595+0000 7ffa4be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82eb1b0 0x55cea869a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59874/0 (socket says 172.21.15.69:59874) 2024-05-14T15:35:27.596 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.595+0000 7ffa4be00640 1 -- 172.21.15.69:0/4277740056 learned_addr learned my addr 172.21.15.69:0/4277740056 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.595+0000 7ffa4b400640 1 -- 172.21.15.69:0/4277740056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82ca4d0 msgr2=0x55cea8699e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.595+0000 7ffa4b400640 1 --2- 172.21.15.69:0/4277740056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82ca4d0 0x55cea8699e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.595+0000 7ffa4b400640 1 -- 172.21.15.69:0/4277740056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82eb1b0 msgr2=0x55cea869a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.595+0000 7ffa4b400640 1 --2- 172.21.15.69:0/4277740056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82eb1b0 0x55cea869a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.595+0000 7ffa4b400640 1 -- 172.21.15.69:0/4277740056 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cea869a910 con 0x55cea82c22f0 2024-05-14T15:35:27.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.596+0000 7ffa4b400640 1 --2- 172.21.15.69:0/4277740056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea869eb40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0ff770 tx=0x7ffa3c101040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=234d22c4ad1741cf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:27.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.596+0000 7ffa35600640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:35:27.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.596+0000 7ffa35600640 1 -- 172.21.15.69:0/4277740056 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa3c032df0 con 0x55cea82c22f0 2024-05-14T15:35:27.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.596+0000 7ffa35600640 1 -- 172.21.15.69:0/4277740056 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9554+0+0 (secure 0 0 0) 0x7ffa3c0ff880 con 0x55cea82c22f0 2024-05-14T15:35:27.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.596+0000 7ffa5978d740 1 -- 172.21.15.69:0/4277740056 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffa4402b040 con 0x55cea82c22f0 2024-05-14T15:35:27.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.597+0000 7ffa35600640 1 -- 172.21.15.69:0/4277740056 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7ffa3c0ffa80 con 0x55cea82c22f0 2024-05-14T15:35:27.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.597+0000 7ffa5978d740 10 client.26683 fetch_fsmap learned FSMap version 66 2024-05-14T15:35:27.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.597+0000 7ffa5978d740 1 -- 172.21.15.69:0/4277740056 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55cea8710c50 con 0x55cea82c22f0 2024-05-14T15:35:27.602 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.601+0000 7ffa35600640 1 -- 172.21.15.69:0/4277740056 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ffa4402b040 con 0x55cea82c22f0 2024-05-14T15:35:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.601+0000 7ffa35600640 1 -- 172.21.15.69:0/4277740056 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7ffa3c0d1cf0 con 0x55cea82c22f0 2024-05-14T15:35:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.602+0000 7ffa5978d740 10 client.26683 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:35:27.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.602+0000 7ffa5978d740 10 client.26683 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:35:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.602+0000 7ffa5978d740 20 client.26683 populate_metadata read hostname 'smithi069' 2024-05-14T15:35:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.602+0000 7ffa5978d740 1 --2- 172.21.15.69:0/4277740056 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cea827f1c0 0x55cea8713310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.602+0000 7ffa5978d740 4 client.26683 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:35:27.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.602+0000 7ffa5978d740 1 -- 172.21.15.69:0/4277740056 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cea85f8fd0 con 0x55cea827f1c0 2024-05-14T15:35:27.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.606+0000 7ffa4aa00640 1 --2- 172.21.15.69:0/4277740056 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cea827f1c0 0x55cea8713310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.606+0000 7ffa4aa00640 1 --2- 172.21.15.69:0/4277740056 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cea827f1c0 0x55cea8713310 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7c0b30bc152e5379 server_cookie=68e1c132d72063ec in_seq=0 out_seq=0 2024-05-14T15:35:27.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.607+0000 7ffa35600640 10 client.26683 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:27.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.629+0000 7ffa35600640 1 -- 172.21.15.69:0/4277740056 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cea85f8fd0 con 0x55cea827f1c0 2024-05-14T15:35:27.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.629+0000 7ffa35600640 10 client.26683 handle_command_reply: tid=0 2024-05-14T15:35:27.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.629+0000 7ffa5978d740 1 client.26683 shutdown 2024-05-14T15:35:27.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.629+0000 7ffa5978d740 1 -- 172.21.15.69:0/4277740056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 msgr2=0x55cea869eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:27.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.629+0000 7ffa5978d740 1 --2- 172.21.15.69:0/4277740056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea869eb40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c0ff770 tx=0x7ffa3c101040 comp rx=0 tx=0).stop 2024-05-14T15:35:27.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.631+0000 7ffa5978d740 1 -- 172.21.15.69:0/4277740056 shutdown_connections 2024-05-14T15:35:27.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.631+0000 7ffa5978d740 1 --2- 172.21.15.69:0/4277740056 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cea827f1c0 0x55cea8713310 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.631+0000 7ffa5978d740 1 --2- 172.21.15.69:0/4277740056 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cea82eb1b0 0x55cea869a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.631+0000 7ffa5978d740 1 --2- 172.21.15.69:0/4277740056 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cea82ca4d0 0x55cea8699e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.631+0000 7ffa35600640 0 client.26683 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.631+0000 7ffa5978d740 1 --2- 172.21.15.69:0/4277740056 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cea82c22f0 0x55cea869eb40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.632+0000 7ffa5978d740 1 -- 172.21.15.69:0/4277740056 >> 172.21.15.69:0/4277740056 conn(0x55cea82df300 msgr2=0x55cea868c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.633+0000 7ffa5978d740 1 -- 172.21.15.69:0/4277740056 shutdown_connections 2024-05-14T15:35:27.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.633+0000 7ffa5978d740 1 -- 172.21.15.69:0/4277740056 wait complete. 2024-05-14T15:35:27.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.634+0000 7ffa5978d740 20 client.26683 trim_cache size 0 max 16384 2024-05-14T15:35:27.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:35:27.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:35:27.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:35:27.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:35:27.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.635+0000 7ffa52800640 1 -- 172.21.15.69:0/2344140363 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ffa300b2a30 msgr2=0x7ffa300b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:27.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.635+0000 7ffa52800640 1 --2- 172.21.15.69:0/2344140363 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ffa300b2a30 0x7ffa300b4f40 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ffa44005340 tx=0x7ffa44005240 comp rx=0 tx=0).stop 2024-05-14T15:35:27.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.635+0000 7ffa52800640 1 -- 172.21.15.69:0/2344140363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa4c078730 msgr2=0x7ffa4c1a0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:27.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.635+0000 7ffa52800640 1 --2- 172.21.15.69:0/2344140363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa4c078730 0x7ffa4c1a0e00 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7ffa3c02a860 tx=0x7ffa3c030ce0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.635+0000 7ffa52800640 1 -- 172.21.15.69:0/2344140363 shutdown_connections 2024-05-14T15:35:27.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.635+0000 7ffa52800640 1 --2- 172.21.15.69:0/2344140363 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ffa300b2a30 0x7ffa300b4f40 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.635+0000 7ffa52800640 1 --2- 172.21.15.69:0/2344140363 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ffa4c114b00 0x7ffa4c1a5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.635+0000 7ffa52800640 1 --2- 172.21.15.69:0/2344140363 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ffa4c1121a0 0x7ffa4c1a1360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.636+0000 7ffa52800640 1 --2- 172.21.15.69:0/2344140363 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ffa4c078730 0x7ffa4c1a0e00 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.636+0000 7ffa52800640 1 -- 172.21.15.69:0/2344140363 >> 172.21.15.69:0/2344140363 conn(0x7ffa4c077200 msgr2=0x7ffa4c1125b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.636+0000 7ffa52800640 1 -- 172.21.15.69:0/2344140363 shutdown_connections 2024-05-14T15:35:27.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:27.636+0000 7ffa52800640 1 -- 172.21.15.69:0/2344140363 wait complete. 2024-05-14T15:35:27.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:27 smithi092 ceph-mon[34729]: pgmap v433: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 8.4 MiB/s wr, 757 op/s 2024-05-14T15:35:27.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:27 smithi069 ceph-mon[31270]: pgmap v433: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 8.4 MiB/s wr, 757 op/s 2024-05-14T15:35:27.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:27 smithi203 ceph-mon[34567]: pgmap v433: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 8.4 MiB/s wr, 757 op/s 2024-05-14T15:35:29.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:29 smithi092 ceph-mon[34729]: pgmap v434: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.1 MiB/s wr, 534 op/s 2024-05-14T15:35:29.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:29 smithi069 ceph-mon[31270]: pgmap v434: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.1 MiB/s wr, 534 op/s 2024-05-14T15:35:29.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:29 smithi203 ceph-mon[34567]: pgmap v434: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 6.1 MiB/s wr, 534 op/s 2024-05-14T15:35:31.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 585.0 s, 475.6 tps, lat 210.930 ms stddev 204.064 2024-05-14T15:35:31.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:31 smithi092 ceph-mon[34729]: pgmap v435: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.3 MiB/s wr, 812 op/s 2024-05-14T15:35:31.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:31 smithi069 ceph-mon[31270]: pgmap v435: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.3 MiB/s wr, 812 op/s 2024-05-14T15:35:31.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:31 smithi203 ceph-mon[34567]: pgmap v435: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 9.3 MiB/s wr, 812 op/s 2024-05-14T15:35:33.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:33 smithi092 ceph-mon[34729]: pgmap v436: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.8 MiB/s wr, 503 op/s 2024-05-14T15:35:33.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:33 smithi069 ceph-mon[31270]: pgmap v436: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.8 MiB/s wr, 503 op/s 2024-05-14T15:35:33.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:33 smithi203 ceph-mon[34567]: pgmap v436: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.8 MiB/s wr, 503 op/s 2024-05-14T15:35:35.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:35 smithi092 ceph-mon[34729]: pgmap v437: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.9 MiB/s wr, 512 op/s 2024-05-14T15:35:35.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:35 smithi069 ceph-mon[31270]: pgmap v437: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.9 MiB/s wr, 512 op/s 2024-05-14T15:35:35.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:35 smithi203 ceph-mon[34567]: pgmap v437: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 5.9 MiB/s wr, 512 op/s 2024-05-14T15:35:36.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 590.0 s, 431.0 tps, lat 228.655 ms stddev 287.266 2024-05-14T15:35:37.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:37 smithi092 ceph-mon[34729]: pgmap v438: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.8 MiB/s wr, 752 op/s 2024-05-14T15:35:37.727 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:37 smithi069 ceph-mon[31270]: pgmap v438: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.8 MiB/s wr, 752 op/s 2024-05-14T15:35:37.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:37 smithi203 ceph-mon[34567]: pgmap v438: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 8.8 MiB/s wr, 752 op/s 2024-05-14T15:35:39.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:39 smithi092 ceph-mon[34729]: pgmap v439: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.2 MiB/s wr, 536 op/s 2024-05-14T15:35:39.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:39 smithi069 ceph-mon[31270]: pgmap v439: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.2 MiB/s wr, 536 op/s 2024-05-14T15:35:39.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:39 smithi203 ceph-mon[34567]: pgmap v439: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 6.2 MiB/s wr, 536 op/s 2024-05-14T15:35:41.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.008+0000 7f6352200640 1 -- 172.21.15.69:0/4075864223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f634c104260 msgr2=0x7f634c1105e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:41.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.008+0000 7f6352200640 1 --2- 172.21.15.69:0/4075864223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f634c104260 0x7f634c1105e0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f633c009900 tx=0x7f633c02a3f0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.009+0000 7f6352200640 1 -- 172.21.15.69:0/4075864223 shutdown_connections 2024-05-14T15:35:41.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.009+0000 7f6352200640 1 --2- 172.21.15.69:0/4075864223 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f634c104260 0x7f634c1105e0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.009+0000 7f6352200640 1 --2- 172.21.15.69:0/4075864223 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f634c109f60 0x7f634c103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.009+0000 7f6352200640 1 --2- 172.21.15.69:0/4075864223 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f634c109ac0 0x7f634c1036b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.009+0000 7f6352200640 1 -- 172.21.15.69:0/4075864223 >> 172.21.15.69:0/4075864223 conn(0x7f634c079250 msgr2=0x7f634c079690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:41.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.010+0000 7f6352200640 1 -- 172.21.15.69:0/4075864223 shutdown_connections 2024-05-14T15:35:41.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.010+0000 7f6352200640 1 -- 172.21.15.69:0/4075864223 wait complete. 2024-05-14T15:35:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.011+0000 7f6352200640 1 Processor -- start 2024-05-14T15:35:41.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.012+0000 7f6352200640 1 -- start start 2024-05-14T15:35:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.012+0000 7f6352200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f634c104260 0x7f634c074960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.012+0000 7f6352200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f634c109ac0 0x7f634c06da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.012+0000 7f6352200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f634c109f60 0x7f634c06e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.012+0000 7f6352200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f634c113bb0 con 0x7f634c109ac0 2024-05-14T15:35:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.012+0000 7f6352200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f634c113a30 con 0x7f634c104260 2024-05-14T15:35:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.012+0000 7f6352200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f634c113d30 con 0x7f634c109f60 2024-05-14T15:35:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.013+0000 7f634be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f634c109ac0 0x7f634c06da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:41.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.013+0000 7f6350e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f634c104260 0x7f634c074960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.013+0000 7f6350e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f634c104260 0x7f634c074960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:47878/0 (socket says 172.21.15.69:47878) 2024-05-14T15:35:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.013+0000 7f6350e00640 1 -- 172.21.15.69:0/913618936 learned_addr learned my addr 172.21.15.69:0/913618936 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:41.015 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.013+0000 7f6351800640 1 --2- 172.21.15.69:0/913618936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f634c109f60 0x7f634c06e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.014+0000 7f6350e00640 1 -- 172.21.15.69:0/913618936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f634c109f60 msgr2=0x7f634c06e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.014+0000 7f6350e00640 1 --2- 172.21.15.69:0/913618936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f634c109f60 0x7f634c06e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.014+0000 7f6350e00640 1 -- 172.21.15.69:0/913618936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f634c109ac0 msgr2=0x7f634c06da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.014+0000 7f6350e00640 1 --2- 172.21.15.69:0/913618936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f634c109ac0 0x7f634c06da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.014+0000 7f6350e00640 1 -- 172.21.15.69:0/913618936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634c072480 con 0x7f634c104260 2024-05-14T15:35:41.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.015+0000 7f6350e00640 1 --2- 172.21.15.69:0/913618936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f634c104260 0x7f634c074960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f634400ea80 tx=0x7f634400ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.015+0000 7f6349600640 1 -- 172.21.15.69:0/913618936 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634400ce40 con 0x7f634c104260 2024-05-14T15:35:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.015+0000 7f6352200640 1 -- 172.21.15.69:0/913618936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634c072710 con 0x7f634c104260 2024-05-14T15:35:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.015+0000 7f6349600640 1 -- 172.21.15.69:0/913618936 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6344011900 con 0x7f634c104260 2024-05-14T15:35:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.015+0000 7f6349600640 1 -- 172.21.15.69:0/913618936 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634401a9c0 con 0x7f634c104260 2024-05-14T15:35:41.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.015+0000 7f6352200640 1 -- 172.21.15.69:0/913618936 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f634c072cb0 con 0x7f634c104260 2024-05-14T15:35:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.022+0000 7f635a7dd740 1 Processor -- start 2024-05-14T15:35:41.023 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.022+0000 7f635a7dd740 1 -- start start 2024-05-14T15:35:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.023+0000 7f635a7dd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f239951b0 0x559f23d3ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.023+0000 7f635a7dd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f2396c2f0 0x559f23d3f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.024 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.023+0000 7f635a7dd740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f239744d0 0x559f23d3f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.023+0000 7f634be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f239744d0 0x559f23d3f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.023+0000 7f6351800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f239951b0 0x559f23d3ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.023+0000 7f635a7dd740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x559f23c9b550 con 0x559f239744d0 2024-05-14T15:35:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.023+0000 7f635a7dd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559f23c40bc0 con 0x559f2396c2f0 2024-05-14T15:35:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.023+0000 7f635a7dd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559f23c97510 con 0x559f239951b0 2024-05-14T15:35:41.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.024+0000 7f6351800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f239951b0 0x559f23d3ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:51512/0 (socket says 172.21.15.69:51512) 2024-05-14T15:35:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.024+0000 7f6351800640 1 -- 172.21.15.69:0/1039746839 learned_addr learned my addr 172.21.15.69:0/1039746839 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.025+0000 7f634be00640 1 -- 172.21.15.69:0/1039746839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f239951b0 msgr2=0x559f23d3ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.025+0000 7f6349600640 1 -- 172.21.15.69:0/913618936 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f634401ab60 con 0x7f634c104260 2024-05-14T15:35:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.025+0000 7f634be00640 1 --2- 172.21.15.69:0/1039746839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f239951b0 0x559f23d3ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.025+0000 7f634be00640 1 -- 172.21.15.69:0/1039746839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f2396c2f0 msgr2=0x559f23d3f1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:35:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.025+0000 7f634be00640 1 --2- 172.21.15.69:0/1039746839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f2396c2f0 0x559f23d3f1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.026 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.025+0000 7f634be00640 1 -- 172.21.15.69:0/1039746839 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f239ad210 con 0x559f239744d0 2024-05-14T15:35:41.027 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.026+0000 7f6349600640 1 --2- 172.21.15.69:0/913618936 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f63300b2950 0x7f63300b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.028 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.027+0000 7f6349600640 1 -- 172.21.15.69:0/913618936 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9554+0+0 (secure 0 0 0) 0x7f63440e3020 con 0x7f634c104260 2024-05-14T15:35:41.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.028+0000 7f6351800640 1 --2- 172.21.15.69:0/913618936 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f63300b2950 0x7f63300b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:41.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.028+0000 7f634be00640 1 --2- 172.21.15.69:0/1039746839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f239744d0 0x559f23d3f700 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f634c06c3a0 tx=0x7f6338005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d0332e2e620b8b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:41.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.028+0000 7f6342000640 1 -- 172.21.15.69:0/1039746839 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338004030 con 0x559f239744d0 2024-05-14T15:35:41.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.029+0000 7f6342000640 1 -- 172.21.15.69:0/1039746839 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63380035f0 con 0x559f239744d0 2024-05-14T15:35:41.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.029+0000 7f6342000640 1 -- 172.21.15.69:0/1039746839 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633800f600 con 0x559f239744d0 2024-05-14T15:35:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.030+0000 7f635a7dd740 1 -- 172.21.15.69:0/1039746839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f239744d0 msgr2=0x559f23d3f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.030+0000 7f635a7dd740 1 --2- 172.21.15.69:0/1039746839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f239744d0 0x559f23d3f700 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f634c06c3a0 tx=0x7f6338005f90 comp rx=0 tx=0).stop 2024-05-14T15:35:41.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.030+0000 7f6351800640 1 --2- 172.21.15.69:0/913618936 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f63300b2950 0x7f63300b4e60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f633c0096c0 tx=0x7f633c004400 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.030+0000 7f635a7dd740 1 -- 172.21.15.69:0/1039746839 shutdown_connections 2024-05-14T15:35:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.030+0000 7f635a7dd740 1 --2- 172.21.15.69:0/1039746839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f239744d0 0x559f23d3f700 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.030+0000 7f635a7dd740 1 --2- 172.21.15.69:0/1039746839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f2396c2f0 0x559f23d3f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.030+0000 7f635a7dd740 1 --2- 172.21.15.69:0/1039746839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f239951b0 0x559f23d3ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.030+0000 7f635a7dd740 1 -- 172.21.15.69:0/1039746839 >> 172.21.15.69:0/1039746839 conn(0x559f23989300 msgr2=0x559f23d3b430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:41.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.031+0000 7f635a7dd740 1 -- 172.21.15.69:0/1039746839 shutdown_connections 2024-05-14T15:35:41.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.031+0000 7f635a7dd740 1 -- 172.21.15.69:0/1039746839 wait complete. 2024-05-14T15:35:41.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.033+0000 7f635a7dd740 1 -- start start 2024-05-14T15:35:41.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.034+0000 7f635a7dd740 1 Processor -- start 2024-05-14T15:35:41.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.035+0000 7f635a7dd740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f2396c2f0 0x559f23d49250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.035+0000 7f635a7dd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f239951b0 0x559f23d49790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.035+0000 7f635a7dd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f23953d80 0x559f23d55260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.036+0000 7f635a7dd740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x559f23d4bdb0 con 0x559f2396c2f0 2024-05-14T15:35:41.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.036+0000 7f635a7dd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x559f23c54660 con 0x559f239951b0 2024-05-14T15:35:41.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.036+0000 7f635a7dd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x559f23d4bf30 con 0x559f23953d80 2024-05-14T15:35:41.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.036+0000 7f635a7dd740 10 client.0 _ll_register_callbacks cb 0x559f23c1e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:35:41.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.036+0000 7f6350e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f2396c2f0 0x559f23d49250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:41.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.036+0000 7f6351800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f23953d80 0x559f23d55260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:41.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.036+0000 7f6350e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f2396c2f0 0x559f23d49250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57282/0 (socket says 172.21.15.69:57282) 2024-05-14T15:35:41.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.036+0000 7f6350e00640 1 -- 172.21.15.69:0/1514808832 learned_addr learned my addr 172.21.15.69:0/1514808832 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:41.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.036+0000 7f634be00640 1 --2- 172.21.15.69:0/1514808832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f239951b0 0x559f23d49790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:41.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.037+0000 7f634be00640 1 -- 172.21.15.69:0/1514808832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f23953d80 msgr2=0x559f23d55260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:41.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.037+0000 7f634be00640 1 --2- 172.21.15.69:0/1514808832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f23953d80 0x559f23d55260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.037+0000 7f634be00640 1 -- 172.21.15.69:0/1514808832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f2396c2f0 msgr2=0x559f23d49250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:41.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.037+0000 7f634be00640 1 --2- 172.21.15.69:0/1514808832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f2396c2f0 0x559f23d49250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.037+0000 7f634be00640 1 -- 172.21.15.69:0/1514808832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f23a79620 con 0x559f239951b0 2024-05-14T15:35:41.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.037+0000 7f6350e00640 1 --2- 172.21.15.69:0/1514808832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f2396c2f0 0x559f23d49250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:35:41.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.038+0000 7f634be00640 1 --2- 172.21.15.69:0/1514808832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f239951b0 0x559f23d49790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6338008000 tx=0x7f63380039d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd82f1b3098bea72 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:41.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.038+0000 7f6336a00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:35:41.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.039+0000 7f6336a00640 1 -- 172.21.15.69:0/1514808832 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633802a060 con 0x559f239951b0 2024-05-14T15:35:41.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.039+0000 7f6336a00640 1 -- 172.21.15.69:0/1514808832 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9554+0+0 (secure 0 0 0) 0x7f6338004410 con 0x559f239951b0 2024-05-14T15:35:41.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.039+0000 7f635a7dd740 1 -- 172.21.15.69:0/1514808832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63380035f0 con 0x559f239951b0 2024-05-14T15:35:41.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.039+0000 7f6336a00640 1 -- 172.21.15.69:0/1514808832 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f6338005030 con 0x559f239951b0 2024-05-14T15:35:41.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.040+0000 7f635a7dd740 10 client.36707 fetch_fsmap learned FSMap version 66 2024-05-14T15:35:41.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.040+0000 7f635a7dd740 1 -- 172.21.15.69:0/1514808832 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x559f23d34e50 con 0x559f239951b0 2024-05-14T15:35:41.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.041+0000 7f6336a00640 1 -- 172.21.15.69:0/1514808832 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f63380035f0 con 0x559f239951b0 2024-05-14T15:35:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.041+0000 7f6336a00640 1 -- 172.21.15.69:0/1514808832 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7f6338004aa0 con 0x559f239951b0 2024-05-14T15:35:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.041+0000 7f635a7dd740 10 client.36707 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:35:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.041+0000 7f635a7dd740 10 client.36707 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:35:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.041+0000 7f635a7dd740 20 client.36707 populate_metadata read hostname 'smithi069' 2024-05-14T15:35:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.041+0000 7f635a7dd740 1 --2- 172.21.15.69:0/1514808832 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559f239291c0 0x559f23d382d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.041+0000 7f635a7dd740 4 client.36707 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:35:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.041+0000 7f635a7dd740 1 -- 172.21.15.69:0/1514808832 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559f23ca9160 con 0x559f239291c0 2024-05-14T15:35:41.044 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.042+0000 7f6350e00640 1 --2- 172.21.15.69:0/1514808832 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559f239291c0 0x559f23d382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:41.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.043+0000 7f6350e00640 1 --2- 172.21.15.69:0/1514808832 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559f239291c0 0x559f23d382d0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddefbc4054a4e049 server_cookie=214f3337a81ada02 in_seq=0 out_seq=0 2024-05-14T15:35:41.045 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.043+0000 7f6336a00640 10 client.36707 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.045+0000 7f6336a00640 1 -- 172.21.15.69:0/1514808832 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x559f23ca9160 con 0x559f239291c0 2024-05-14T15:35:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.045+0000 7f6336a00640 10 client.36707 handle_command_reply: tid=0 2024-05-14T15:35:41.046 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.045+0000 7f635a7dd740 1 client.36707 shutdown 2024-05-14T15:35:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.045+0000 7f635a7dd740 1 -- 172.21.15.69:0/1514808832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f239951b0 msgr2=0x559f23d49790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.045+0000 7f635a7dd740 1 --2- 172.21.15.69:0/1514808832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f239951b0 0x559f23d49790 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f6338008000 tx=0x7f63380039d0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.045+0000 7f635a7dd740 1 -- 172.21.15.69:0/1514808832 shutdown_connections 2024-05-14T15:35:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.045+0000 7f635a7dd740 1 --2- 172.21.15.69:0/1514808832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f23953d80 0x559f23d55260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.045+0000 7f635a7dd740 1 --2- 172.21.15.69:0/1514808832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f239951b0 0x559f23d49790 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.047 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.045+0000 7f635a7dd740 1 --2- 172.21.15.69:0/1514808832 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559f239291c0 0x559f23d382d0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.045+0000 7f635a7dd740 1 --2- 172.21.15.69:0/1514808832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f2396c2f0 0x559f23d49250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.045+0000 7f635a7dd740 1 -- 172.21.15.69:0/1514808832 >> 172.21.15.69:0/1514808832 conn(0x559f23989300 msgr2=0x559f23d409a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:41.048 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.046+0000 7f6336a00640 0 client.36707 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:41.049 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.047+0000 7f635a7dd740 1 -- 172.21.15.69:0/1514808832 shutdown_connections 2024-05-14T15:35:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.047+0000 7f635a7dd740 1 -- 172.21.15.69:0/1514808832 wait complete. 2024-05-14T15:35:41.050 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.048+0000 7f635a7dd740 20 client.36707 trim_cache size 0 max 16384 2024-05-14T15:35:41.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.081+0000 7f635a7dd740 1 Processor -- start 2024-05-14T15:35:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.081+0000 7f635a7dd740 1 -- start start 2024-05-14T15:35:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.082+0000 7f635a7dd740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f23953d80 0x559f23d41360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.082+0000 7f635a7dd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f2396c2f0 0x559f23d5ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.082+0000 7f635a7dd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f239951b0 0x559f23d3b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.082+0000 7f635a7dd740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1b7840 con 0x559f23953d80 2024-05-14T15:35:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.082+0000 7f635a7dd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1b9470 con 0x559f2396c2f0 2024-05-14T15:35:41.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.082+0000 7f635a7dd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1b7f10 con 0x559f239951b0 2024-05-14T15:35:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.082+0000 7f6350e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f23953d80 0x559f23d41360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.082+0000 7f634be00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f2396c2f0 0x559f23d5ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.082+0000 7f6350e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f23953d80 0x559f23d41360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57292/0 (socket says 172.21.15.69:57292) 2024-05-14T15:35:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.082+0000 7f6350e00640 1 -- 172.21.15.69:0/2079534214 learned_addr learned my addr 172.21.15.69:0/2079534214 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.083+0000 7f6351800640 1 --2- 172.21.15.69:0/2079534214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f239951b0 0x559f23d3b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.083+0000 7f634be00640 1 -- 172.21.15.69:0/2079534214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f239951b0 msgr2=0x559f23d3b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:41.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.083+0000 7f634be00640 1 --2- 172.21.15.69:0/2079534214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f239951b0 0x559f23d3b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.083+0000 7f634be00640 1 -- 172.21.15.69:0/2079534214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f23953d80 msgr2=0x559f23d41360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.083+0000 7f634be00640 1 --2- 172.21.15.69:0/2079534214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f23953d80 0x559f23d41360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.083+0000 7f634be00640 1 -- 172.21.15.69:0/2079534214 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559f23d47590 con 0x559f2396c2f0 2024-05-14T15:35:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.083+0000 7f6350e00640 1 --2- 172.21.15.69:0/2079534214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f23953d80 0x559f23d41360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:35:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.084+0000 7f634be00640 1 --2- 172.21.15.69:0/2079534214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f2396c2f0 0x559f23d5ae70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6338005000 tx=0x7f6338005d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=caf4095a8b576454 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:41.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.084+0000 7f6341600640 1 -- 172.21.15.69:0/2079534214 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633802a070 con 0x559f2396c2f0 2024-05-14T15:35:41.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.085+0000 7f6341600640 1 -- 172.21.15.69:0/2079534214 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f633801f040 con 0x559f2396c2f0 2024-05-14T15:35:41.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.085+0000 7f6341600640 1 -- 172.21.15.69:0/2079534214 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6338031030 con 0x559f2396c2f0 2024-05-14T15:35:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.087+0000 7f635a7dd740 1 -- 172.21.15.69:0/2079534214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f2396c2f0 msgr2=0x559f23d5ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:41.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.087+0000 7f635a7dd740 1 --2- 172.21.15.69:0/2079534214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f2396c2f0 0x559f23d5ae70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6338005000 tx=0x7f6338005d30 comp rx=0 tx=0).stop 2024-05-14T15:35:41.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.087+0000 7f635a7dd740 1 -- 172.21.15.69:0/2079534214 shutdown_connections 2024-05-14T15:35:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.087+0000 7f635a7dd740 1 --2- 172.21.15.69:0/2079534214 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f239951b0 0x559f23d3b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.087+0000 7f635a7dd740 1 --2- 172.21.15.69:0/2079534214 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f2396c2f0 0x559f23d5ae70 secure :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6338005000 tx=0x7f6338005d30 comp rx=0 tx=0).stop 2024-05-14T15:35:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.087+0000 7f635a7dd740 1 --2- 172.21.15.69:0/2079534214 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f23953d80 0x559f23d41360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.087+0000 7f635a7dd740 1 -- 172.21.15.69:0/2079534214 >> 172.21.15.69:0/2079534214 conn(0x559f23989300 msgr2=0x559f23d47f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:41.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.088+0000 7f635a7dd740 1 -- 172.21.15.69:0/2079534214 shutdown_connections 2024-05-14T15:35:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.088+0000 7f635a7dd740 1 -- 172.21.15.69:0/2079534214 wait complete. 2024-05-14T15:35:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.089+0000 7f635a7dd740 1 -- start start 2024-05-14T15:35:41.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.093+0000 7f635a7dd740 1 Processor -- start 2024-05-14T15:35:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.094+0000 7f635a7dd740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f23953d80 0x559f23d4dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.094+0000 7f635a7dd740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f239951b0 0x559f23d4e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.094+0000 7f635a7dd740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f23d519d0 0x559f23db9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.094+0000 7f635a7dd740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1b8da0 con 0x559f23953d80 2024-05-14T15:35:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.094+0000 7f635a7dd740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1b8610 con 0x559f23d519d0 2024-05-14T15:35:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.094+0000 7f635a7dd740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f634c1b5840 con 0x559f239951b0 2024-05-14T15:35:41.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.094+0000 7f635a7dd740 10 client.0 _ll_register_callbacks cb 0x7f6338010c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:35:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.094+0000 7f6350e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f23953d80 0x559f23d4dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.095+0000 7f6350e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f23953d80 0x559f23d4dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57298/0 (socket says 172.21.15.69:57298) 2024-05-14T15:35:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.095+0000 7f6350e00640 1 -- 172.21.15.69:0/2803235301 learned_addr learned my addr 172.21.15.69:0/2803235301 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.095+0000 7f6350e00640 1 -- 172.21.15.69:0/2803235301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f239951b0 msgr2=0x559f23d4e1d0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:35:41.096 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.095+0000 7f6350e00640 1 --2- 172.21.15.69:0/2803235301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f239951b0 0x559f23d4e1d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.095+0000 7f6350e00640 1 -- 172.21.15.69:0/2803235301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f23d519d0 msgr2=0x559f23db9370 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:35:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.095+0000 7f6350e00640 1 --2- 172.21.15.69:0/2803235301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f23d519d0 0x559f23db9370 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.095+0000 7f6350e00640 1 -- 172.21.15.69:0/2803235301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559f23d4e9b0 con 0x559f23953d80 2024-05-14T15:35:41.097 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.096+0000 7f6350e00640 1 --2- 172.21.15.69:0/2803235301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f23953d80 0x559f23d4dc90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f63440e0960 tx=0x7f63440ae2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df03413d2156c986 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.096+0000 7f6336a00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:35:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.096+0000 7f6336a00640 1 -- 172.21.15.69:0/2803235301 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63440a6180 con 0x559f23953d80 2024-05-14T15:35:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.096+0000 7f6336a00640 1 -- 172.21.15.69:0/2803235301 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9554+0+0 (secure 0 0 0) 0x7f6344011470 con 0x559f23953d80 2024-05-14T15:35:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.096+0000 7f635a7dd740 1 -- 172.21.15.69:0/2803235301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f633801f040 con 0x559f23953d80 2024-05-14T15:35:41.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.097+0000 7f6336a00640 1 -- 172.21.15.69:0/2803235301 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f63440a6320 con 0x559f23953d80 2024-05-14T15:35:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.097+0000 7f635a7dd740 10 client.17208 fetch_fsmap learned FSMap version 66 2024-05-14T15:35:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.097+0000 7f635a7dd740 1 -- 172.21.15.69:0/2803235301 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x559f23dba850 con 0x559f23953d80 2024-05-14T15:35:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.097+0000 7f6336a00640 1 -- 172.21.15.69:0/2803235301 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f633801f040 con 0x559f23953d80 2024-05-14T15:35:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.098+0000 7f6336a00640 1 -- 172.21.15.69:0/2803235301 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7f6344022030 con 0x559f23953d80 2024-05-14T15:35:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.098+0000 7f635a7dd740 10 client.17208 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:35:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.098+0000 7f635a7dd740 10 client.17208 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:35:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.098+0000 7f635a7dd740 20 client.17208 populate_metadata read hostname 'smithi069' 2024-05-14T15:35:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.098+0000 7f635a7dd740 1 --2- 172.21.15.69:0/2803235301 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559f23dbafa0 0x559f23dbd430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.098+0000 7f635a7dd740 4 client.17208 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:35:41.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.098+0000 7f635a7dd740 1 -- 172.21.15.69:0/2803235301 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x559f23ca2fd0 con 0x559f23dbafa0 2024-05-14T15:35:41.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.098+0000 7f634be00640 1 --2- 172.21.15.69:0/2803235301 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559f23dbafa0 0x559f23dbd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:41.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.101+0000 7f634be00640 1 --2- 172.21.15.69:0/2803235301 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559f23dbafa0 0x559f23dbd430 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1bc6ddf0cb0ed8cf server_cookie=d91b137e1cd0cd41 in_seq=0 out_seq=0 2024-05-14T15:35:41.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.101+0000 7f6336a00640 10 client.17208 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.123+0000 7f6336a00640 1 -- 172.21.15.69:0/2803235301 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x559f23ca2fd0 con 0x559f23dbafa0 2024-05-14T15:35:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.123+0000 7f6336a00640 10 client.17208 handle_command_reply: tid=0 2024-05-14T15:35:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.123+0000 7f635a7dd740 1 client.17208 shutdown 2024-05-14T15:35:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.124+0000 7f635a7dd740 1 -- 172.21.15.69:0/2803235301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f23953d80 msgr2=0x559f23d4dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:41.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.124+0000 7f635a7dd740 1 --2- 172.21.15.69:0/2803235301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f23953d80 0x559f23d4dc90 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f63440e0960 tx=0x7f63440ae2a0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.125+0000 7f635a7dd740 1 -- 172.21.15.69:0/2803235301 shutdown_connections 2024-05-14T15:35:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.125+0000 7f635a7dd740 1 --2- 172.21.15.69:0/2803235301 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x559f23d519d0 0x559f23db9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.125+0000 7f635a7dd740 1 --2- 172.21.15.69:0/2803235301 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x559f239951b0 0x559f23d4e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.125+0000 7f635a7dd740 1 --2- 172.21.15.69:0/2803235301 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x559f23dbafa0 0x559f23dbd430 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.126 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.125+0000 7f635a7dd740 1 --2- 172.21.15.69:0/2803235301 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x559f23953d80 0x559f23d4dc90 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.125+0000 7f635a7dd740 1 -- 172.21.15.69:0/2803235301 >> 172.21.15.69:0/2803235301 conn(0x559f23989300 msgr2=0x559f23d4a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:41.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.125+0000 7f6336a00640 0 client.17208 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:41.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.125+0000 7f635a7dd740 1 -- 172.21.15.69:0/2803235301 shutdown_connections 2024-05-14T15:35:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.126+0000 7f635a7dd740 1 -- 172.21.15.69:0/2803235301 wait complete. 2024-05-14T15:35:41.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.126+0000 7f635a7dd740 20 client.17208 trim_cache size 0 max 16384 2024-05-14T15:35:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:35:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:35:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:35:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:35:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.128+0000 7f6352200640 1 -- 172.21.15.69:0/913618936 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f63300b2950 msgr2=0x7f63300b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.128+0000 7f6352200640 1 --2- 172.21.15.69:0/913618936 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f63300b2950 0x7f63300b4e60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f633c0096c0 tx=0x7f633c004400 comp rx=0 tx=0).stop 2024-05-14T15:35:41.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.128+0000 7f6352200640 1 -- 172.21.15.69:0/913618936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f634c104260 msgr2=0x7f634c074960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.128+0000 7f6352200640 1 --2- 172.21.15.69:0/913618936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f634c104260 0x7f634c074960 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f634400ea80 tx=0x7f634400ef40 comp rx=0 tx=0).stop 2024-05-14T15:35:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.129+0000 7f6352200640 1 -- 172.21.15.69:0/913618936 shutdown_connections 2024-05-14T15:35:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.129+0000 7f6352200640 1 --2- 172.21.15.69:0/913618936 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f63300b2950 0x7f63300b4e60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.129+0000 7f6352200640 1 --2- 172.21.15.69:0/913618936 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f634c109f60 0x7f634c06e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.129+0000 7f6352200640 1 --2- 172.21.15.69:0/913618936 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f634c109ac0 0x7f634c06da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.129+0000 7f6352200640 1 --2- 172.21.15.69:0/913618936 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f634c104260 0x7f634c074960 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:41.130 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.129+0000 7f6352200640 1 -- 172.21.15.69:0/913618936 >> 172.21.15.69:0/913618936 conn(0x7f634c079250 msgr2=0x7f634c100e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:41.131 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.129+0000 7f6352200640 1 -- 172.21.15.69:0/913618936 shutdown_connections 2024-05-14T15:35:41.131 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:41.129+0000 7f6352200640 1 -- 172.21.15.69:0/913618936 wait complete. 2024-05-14T15:35:41.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 595.0 s, 528.2 tps, lat 187.387 ms stddev 122.522 2024-05-14T15:35:41.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:41 smithi092 ceph-mon[34729]: pgmap v440: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 9.4 MiB/s wr, 774 op/s 2024-05-14T15:35:41.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:41 smithi069 ceph-mon[31270]: pgmap v440: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 9.4 MiB/s wr, 774 op/s 2024-05-14T15:35:41.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:41 smithi203 ceph-mon[34567]: pgmap v440: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 55 KiB/s rd, 9.4 MiB/s wr, 774 op/s 2024-05-14T15:35:43.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:43 smithi069 ceph-mon[31270]: pgmap v441: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.2 MiB/s wr, 495 op/s 2024-05-14T15:35:43.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:43 smithi203 ceph-mon[34567]: pgmap v441: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.2 MiB/s wr, 495 op/s 2024-05-14T15:35:43.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:43 smithi092 ceph-mon[34729]: pgmap v441: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 6.2 MiB/s wr, 495 op/s 2024-05-14T15:35:45.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:45 smithi069 ceph-mon[31270]: pgmap v442: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.2 MiB/s wr, 506 op/s 2024-05-14T15:35:45.745 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:45 smithi092 ceph-mon[34729]: pgmap v442: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.2 MiB/s wr, 506 op/s 2024-05-14T15:35:45.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:45 smithi203 ceph-mon[34567]: pgmap v442: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 6.2 MiB/s wr, 506 op/s 2024-05-14T15:35:46.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 600.0 s, 564.0 tps, lat 180.459 ms stddev 254.511 2024-05-14T15:35:47.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:47 smithi069 ceph-mon[31270]: pgmap v443: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.2 MiB/s wr, 747 op/s 2024-05-14T15:35:47.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:47 smithi203 ceph-mon[34567]: pgmap v443: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.2 MiB/s wr, 747 op/s 2024-05-14T15:35:47.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:47 smithi092 ceph-mon[34729]: pgmap v443: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 9.2 MiB/s wr, 747 op/s 2024-05-14T15:35:49.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:49 smithi203 ceph-mon[34567]: pgmap v444: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 MiB/s wr, 499 op/s 2024-05-14T15:35:49.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:49 smithi092 ceph-mon[34729]: pgmap v444: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 MiB/s wr, 499 op/s 2024-05-14T15:35:49.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:49 smithi069 ceph-mon[31270]: pgmap v444: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 28 KiB/s rd, 6.3 MiB/s wr, 499 op/s 2024-05-14T15:35:51.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 605.0 s, 551.6 tps, lat 178.011 ms stddev 102.771 2024-05-14T15:35:51.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:51 smithi203 ceph-mon[34567]: pgmap v445: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.3 MiB/s wr, 756 op/s 2024-05-14T15:35:51.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:51 smithi092 ceph-mon[34729]: pgmap v445: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.3 MiB/s wr, 756 op/s 2024-05-14T15:35:51.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:51 smithi069 ceph-mon[31270]: pgmap v445: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 9.3 MiB/s wr, 756 op/s 2024-05-14T15:35:53.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:53 smithi203 ceph-mon[34567]: pgmap v446: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.1 MiB/s wr, 518 op/s 2024-05-14T15:35:53.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:53 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:35:53.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:53 smithi092 ceph-mon[34729]: pgmap v446: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.1 MiB/s wr, 518 op/s 2024-05-14T15:35:53.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:53 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:35:53.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:53 smithi069 ceph-mon[31270]: pgmap v446: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 6.1 MiB/s wr, 518 op/s 2024-05-14T15:35:53.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:53 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:35:54.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.552+0000 7f11bf000640 1 -- 172.21.15.69:0/1273085548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b810fa10 msgr2=0x7f11b810fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:54.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.552+0000 7f11bf000640 1 --2- 172.21.15.69:0/1273085548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b810fa10 0x7f11b810fe20 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f11b0009ca0 tx=0x7f11b002a8b0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.553+0000 7f11bf000640 1 -- 172.21.15.69:0/1273085548 shutdown_connections 2024-05-14T15:35:54.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.553+0000 7f11bf000640 1 --2- 172.21.15.69:0/1273085548 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11b810a210 0x7f11b810a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.553+0000 7f11bf000640 1 --2- 172.21.15.69:0/1273085548 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11b81103f0 0x7f11b8109cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.553+0000 7f11bf000640 1 --2- 172.21.15.69:0/1273085548 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b810fa10 0x7f11b810fe20 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.556 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.553+0000 7f11bf000640 1 -- 172.21.15.69:0/1273085548 >> 172.21.15.69:0/1273085548 conn(0x7f11b806f810 msgr2=0x7f11b806fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:54.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.555+0000 7f11bf000640 1 -- 172.21.15.69:0/1273085548 shutdown_connections 2024-05-14T15:35:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.556+0000 7f11bf000640 1 -- 172.21.15.69:0/1273085548 wait complete. 2024-05-14T15:35:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.557+0000 7f11bf000640 1 Processor -- start 2024-05-14T15:35:54.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.558+0000 7f11bf000640 1 -- start start 2024-05-14T15:35:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.559+0000 7f11bf000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11b810a210 0x7f11b8120270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.559+0000 7f11bf000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11b810fa10 0x7f11b811a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.559+0000 7f11bf000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b81103f0 0x7f11b811a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.559+0000 7f11bdc00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11b810a210 0x7f11b8120270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.559+0000 7f11bd200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11b810fa10 0x7f11b811a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.559+0000 7f11bd200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11b810fa10 0x7f11b811a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:44180/0 (socket says 172.21.15.69:44180) 2024-05-14T15:35:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.560+0000 7f11be600640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b81103f0 0x7f11b811a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.560+0000 7f11be600640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b81103f0 0x7f11b811a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:45224/0 (socket says 172.21.15.69:45224) 2024-05-14T15:35:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.560+0000 7f11bd200640 1 -- 172.21.15.69:0/262695711 learned_addr learned my addr 172.21.15.69:0/262695711 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.560+0000 7f11bf000640 1 -- 172.21.15.69:0/262695711 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f11b8112800 con 0x7f11b810a210 2024-05-14T15:35:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.560+0000 7f11bf000640 1 -- 172.21.15.69:0/262695711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11b8112680 con 0x7f11b81103f0 2024-05-14T15:35:54.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.560+0000 7f11bf000640 1 -- 172.21.15.69:0/262695711 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f11b8112980 con 0x7f11b810fa10 2024-05-14T15:35:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.561+0000 7f11be600640 1 -- 172.21.15.69:0/262695711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11b810fa10 msgr2=0x7f11b811a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:54.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.561+0000 7f11be600640 1 --2- 172.21.15.69:0/262695711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11b810fa10 0x7f11b811a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.561+0000 7f11be600640 1 -- 172.21.15.69:0/262695711 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11b810a210 msgr2=0x7f11b8120270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:54.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.563+0000 7f11be600640 1 --2- 172.21.15.69:0/262695711 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11b810a210 0x7f11b8120270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.563+0000 7f11be600640 1 -- 172.21.15.69:0/262695711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11b811b090 con 0x7f11b81103f0 2024-05-14T15:35:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.563+0000 7f11bd200640 1 --2- 172.21.15.69:0/262695711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11b810fa10 0x7f11b811a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:35:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.563+0000 7f11bdc00640 1 --2- 172.21.15.69:0/262695711 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11b810a210 0x7f11b8120270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:35:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.564+0000 7f11be600640 1 --2- 172.21.15.69:0/262695711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b81103f0 0x7f11b811a900 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f11a400c7a0 tx=0x7f11a400cc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:54.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.564+0000 7f11b6000640 1 -- 172.21.15.69:0/262695711 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4007bb0 con 0x7f11b81103f0 2024-05-14T15:35:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.564+0000 7f11b6000640 1 -- 172.21.15.69:0/262695711 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11a4007d50 con 0x7f11b81103f0 2024-05-14T15:35:54.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.564+0000 7f11b6000640 1 -- 172.21.15.69:0/262695711 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11a4004d10 con 0x7f11b81103f0 2024-05-14T15:35:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.565+0000 7f11bf000640 1 -- 172.21.15.69:0/262695711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11b81bdfa0 con 0x7f11b81103f0 2024-05-14T15:35:54.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.567+0000 7f11bf000640 1 -- 172.21.15.69:0/262695711 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11b81be410 con 0x7f11b81103f0 2024-05-14T15:35:54.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.575+0000 7f11c75dc740 1 Processor -- start 2024-05-14T15:35:54.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.577+0000 7f11b6000640 1 -- 172.21.15.69:0/262695711 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f11a4004eb0 con 0x7f11b81103f0 2024-05-14T15:35:54.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.580+0000 7f11c75dc740 1 -- start start 2024-05-14T15:35:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.586+0000 7f11c75dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdd91b0 0x5624f017a470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.586+0000 7f11c75dc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb02f0 0x5624f017a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.586+0000 7f11c75dc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb84d0 0x5624f017aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.586+0000 7f11c75dc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5624f00df550 con 0x5624efdb84d0 2024-05-14T15:35:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.586+0000 7f11c75dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5624f0084bc0 con 0x5624efdd91b0 2024-05-14T15:35:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.586+0000 7f11c75dc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5624f00db510 con 0x5624efdb02f0 2024-05-14T15:35:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.586+0000 7f11bd200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdd91b0 0x5624f017a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.586+0000 7f11bd200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb84d0 0x5624f017aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.586+0000 7f11bd200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdd91b0 0x5624f017a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:45240/0 (socket says 172.21.15.69:45240) 2024-05-14T15:35:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.586+0000 7f11bd200640 1 -- 172.21.15.69:0/161860106 learned_addr learned my addr 172.21.15.69:0/161860106 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.587+0000 7f11b6000640 1 --2- 172.21.15.69:0/262695711 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f11a00b29d0 0x7f11a00b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.587+0000 7f11bd200640 1 -- 172.21.15.69:0/161860106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb02f0 msgr2=0x5624f017a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.587+0000 7f11bd200640 1 --2- 172.21.15.69:0/161860106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb02f0 0x5624f017a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.587+0000 7f11bd200640 1 -- 172.21.15.69:0/161860106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb84d0 msgr2=0x5624f017aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.587+0000 7f11bd200640 1 --2- 172.21.15.69:0/161860106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb84d0 0x5624f017aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.587+0000 7f11bd200640 1 -- 172.21.15.69:0/161860106 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624efdf1210 con 0x5624efdd91b0 2024-05-14T15:35:54.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.587+0000 7f11b6000640 1 -- 172.21.15.69:0/262695711 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 9554+0+0 (secure 0 0 0) 0x7f11a40e28b0 con 0x7f11b81103f0 2024-05-14T15:35:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.588+0000 7f11be600640 1 --2- 172.21.15.69:0/262695711 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f11a00b29d0 0x7f11a00b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.589+0000 7f11bd200640 1 --2- 172.21.15.69:0/161860106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdd91b0 0x5624f017a470 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f11ac011b80 tx=0x7f11ac0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1fb514e2d40ae3b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.589+0000 7f11be600640 1 --2- 172.21.15.69:0/262695711 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f11a00b29d0 0x7f11a00b4ee0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f11a40a5800 tx=0x7f11a400ceb0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.590+0000 7f11aaa00640 1 -- 172.21.15.69:0/161860106 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac00ee50 con 0x5624efdd91b0 2024-05-14T15:35:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.590+0000 7f11aaa00640 1 -- 172.21.15.69:0/161860106 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11ac0110d0 con 0x5624efdd91b0 2024-05-14T15:35:54.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.590+0000 7f11aaa00640 1 -- 172.21.15.69:0/161860106 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac003b80 con 0x5624efdd91b0 2024-05-14T15:35:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.591+0000 7f11c75dc740 1 -- 172.21.15.69:0/161860106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdd91b0 msgr2=0x5624f017a470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.591+0000 7f11c75dc740 1 --2- 172.21.15.69:0/161860106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdd91b0 0x5624f017a470 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f11ac011b80 tx=0x7f11ac0046c0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.593+0000 7f11c75dc740 1 -- 172.21.15.69:0/161860106 shutdown_connections 2024-05-14T15:35:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.593+0000 7f11c75dc740 1 --2- 172.21.15.69:0/161860106 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb84d0 0x5624f017aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.593+0000 7f11c75dc740 1 --2- 172.21.15.69:0/161860106 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb02f0 0x5624f017a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.593+0000 7f11c75dc740 1 --2- 172.21.15.69:0/161860106 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdd91b0 0x5624f017a470 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.593+0000 7f11c75dc740 1 -- 172.21.15.69:0/161860106 >> 172.21.15.69:0/161860106 conn(0x5624efdcd300 msgr2=0x5624f0176c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.593+0000 7f11c75dc740 1 -- 172.21.15.69:0/161860106 shutdown_connections 2024-05-14T15:35:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.593+0000 7f11c75dc740 1 -- 172.21.15.69:0/161860106 wait complete. 2024-05-14T15:35:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.594+0000 7f11c75dc740 1 -- start start 2024-05-14T15:35:54.597 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.595+0000 7f11c75dc740 1 Processor -- start 2024-05-14T15:35:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.596+0000 7f11c75dc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb02f0 0x5624f0184950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.596+0000 7f11c75dc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb84d0 0x5624f0184e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.596+0000 7f11c75dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdd91b0 0x5624f01909f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.596+0000 7f11c75dc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5624f0187540 con 0x5624efdb02f0 2024-05-14T15:35:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.596+0000 7f11c75dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5624f0098660 con 0x5624efdd91b0 2024-05-14T15:35:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.596+0000 7f11c75dc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5624f01876c0 con 0x5624efdb84d0 2024-05-14T15:35:54.598 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.596+0000 7f11c75dc740 10 client.0 _ll_register_callbacks cb 0x5624f0062400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:35:54.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.597+0000 7f11bd200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb02f0 0x5624f0184950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.597+0000 7f11bd200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb02f0 0x5624f0184950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57626/0 (socket says 172.21.15.69:57626) 2024-05-14T15:35:54.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.597+0000 7f11bd200640 1 -- 172.21.15.69:0/23665923 learned_addr learned my addr 172.21.15.69:0/23665923 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:54.599 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.597+0000 7f11bdc00640 1 --2- 172.21.15.69:0/23665923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb84d0 0x5624f0184e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.597+0000 7f11bd200640 1 --2- 172.21.15.69:0/23665923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdd91b0 0x5624f01909f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.600 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.598+0000 7f11bd200640 1 -- 172.21.15.69:0/23665923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb84d0 msgr2=0x5624f0184e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.598+0000 7f11bd200640 1 --2- 172.21.15.69:0/23665923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb84d0 0x5624f0184e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.598+0000 7f11bd200640 1 -- 172.21.15.69:0/23665923 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb02f0 msgr2=0x5624f0184950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.598+0000 7f11bd200640 1 --2- 172.21.15.69:0/23665923 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb02f0 0x5624f0184950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.598+0000 7f11bd200640 1 -- 172.21.15.69:0/23665923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624efebd620 con 0x5624efdd91b0 2024-05-14T15:35:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.598+0000 7f11bdc00640 1 --2- 172.21.15.69:0/23665923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb84d0 0x5624f0184e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:35:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.599+0000 7f11bd200640 1 --2- 172.21.15.69:0/23665923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdd91b0 0x5624f01909f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0058c0 tx=0x7f11ac00a3b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4dda73454a23390c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:54.601 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.599+0000 7f119f400640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:35:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.600+0000 7f119f400640 1 -- 172.21.15.69:0/23665923 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11ac026060 con 0x5624efdd91b0 2024-05-14T15:35:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.600+0000 7f11c75dc740 1 -- 172.21.15.69:0/23665923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11ac0110d0 con 0x5624efdd91b0 2024-05-14T15:35:54.602 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.600+0000 7f119f400640 1 -- 172.21.15.69:0/23665923 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9554+0+0 (secure 0 0 0) 0x7f11ac003d10 con 0x5624efdd91b0 2024-05-14T15:35:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.601+0000 7f119f400640 1 -- 172.21.15.69:0/23665923 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f11ac02d050 con 0x5624efdd91b0 2024-05-14T15:35:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.601+0000 7f11c75dc740 10 client.36722 fetch_fsmap learned FSMap version 66 2024-05-14T15:35:54.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.601+0000 7f11c75dc740 1 -- 172.21.15.69:0/23665923 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5624f01937c0 con 0x5624efdd91b0 2024-05-14T15:35:54.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.601+0000 7f119f400640 1 -- 172.21.15.69:0/23665923 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11ac0110d0 con 0x5624efdd91b0 2024-05-14T15:35:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.603+0000 7f119f400640 1 -- 172.21.15.69:0/23665923 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7f11ac01fb70 con 0x5624efdd91b0 2024-05-14T15:35:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.603+0000 7f11c75dc740 10 client.36722 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:35:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.603+0000 7f11c75dc740 10 client.36722 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:35:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.603+0000 7f11c75dc740 20 client.36722 populate_metadata read hostname 'smithi069' 2024-05-14T15:35:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.603+0000 7f11c75dc740 1 --2- 172.21.15.69:0/23665923 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5624efd97d80 0x5624f0196c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.603+0000 7f11c75dc740 4 client.36722 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:35:54.605 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.603+0000 7f11c75dc740 1 -- 172.21.15.69:0/23665923 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5624f00ed160 con 0x5624efd97d80 2024-05-14T15:35:54.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.604+0000 7f11bdc00640 1 --2- 172.21.15.69:0/23665923 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5624efd97d80 0x5624f0196c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.607+0000 7f11bdc00640 1 --2- 172.21.15.69:0/23665923 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5624efd97d80 0x5624f0196c40 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93af25cb50fa725b server_cookie=e01c3cf6bb5f7ac5 in_seq=0 out_seq=0 2024-05-14T15:35:54.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.607+0000 7f119f400640 10 client.36722 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.608+0000 7f119f400640 1 -- 172.21.15.69:0/23665923 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5624f00ed160 con 0x5624efd97d80 2024-05-14T15:35:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.608+0000 7f119f400640 10 client.36722 handle_command_reply: tid=0 2024-05-14T15:35:54.610 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.608+0000 7f11c75dc740 1 client.36722 shutdown 2024-05-14T15:35:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.609+0000 7f11c75dc740 1 -- 172.21.15.69:0/23665923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdd91b0 msgr2=0x5624f01909f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:54.611 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.609+0000 7f11c75dc740 1 --2- 172.21.15.69:0/23665923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdd91b0 0x5624f01909f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f11ac0058c0 tx=0x7f11ac00a3b0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.611+0000 7f11c75dc740 1 -- 172.21.15.69:0/23665923 shutdown_connections 2024-05-14T15:35:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.611+0000 7f11c75dc740 1 --2- 172.21.15.69:0/23665923 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdd91b0 0x5624f01909f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.611+0000 7f11c75dc740 1 --2- 172.21.15.69:0/23665923 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb84d0 0x5624f0184e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.611+0000 7f11c75dc740 1 --2- 172.21.15.69:0/23665923 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5624efd97d80 0x5624f0196c40 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.611+0000 7f11c75dc740 1 --2- 172.21.15.69:0/23665923 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb02f0 0x5624f0184950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.611+0000 7f11c75dc740 1 -- 172.21.15.69:0/23665923 >> 172.21.15.69:0/23665923 conn(0x5624efdcd300 msgr2=0x5624f017a2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.612+0000 7f119f400640 0 client.36722 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.612+0000 7f11c75dc740 1 -- 172.21.15.69:0/23665923 shutdown_connections 2024-05-14T15:35:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.612+0000 7f11c75dc740 1 -- 172.21.15.69:0/23665923 wait complete. 2024-05-14T15:35:54.615 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.613+0000 7f11c75dc740 20 client.36722 trim_cache size 0 max 16384 2024-05-14T15:35:54.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.648+0000 7f11c75dc740 1 Processor -- start 2024-05-14T15:35:54.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.649+0000 7f11c75dc740 1 -- start start 2024-05-14T15:35:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.650+0000 7f11c75dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdb02f0 0x5624f0175250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.650+0000 7f11c75dc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb84d0 0x5624f017b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.651+0000 7f11c75dc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdd91b0 0x5624f019c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.651+0000 7f11c75dc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81c8730 con 0x5624efdb84d0 2024-05-14T15:35:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.651+0000 7f11c75dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81ca360 con 0x5624efdb02f0 2024-05-14T15:35:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.651+0000 7f11c75dc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81c8e00 con 0x5624efdd91b0 2024-05-14T15:35:54.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.651+0000 7f11bd200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdb02f0 0x5624f0175250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.651+0000 7f11bd200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdb02f0 0x5624f0175250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:45272/0 (socket says 172.21.15.69:45272) 2024-05-14T15:35:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.651+0000 7f11bd200640 1 -- 172.21.15.69:0/1707213717 learned_addr learned my addr 172.21.15.69:0/1707213717 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:54.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.651+0000 7f11bdc00640 1 --2- 172.21.15.69:0/1707213717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb84d0 0x5624f017b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.652+0000 7f11bd200640 1 --2- 172.21.15.69:0/1707213717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdd91b0 0x5624f019c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.652+0000 7f11bdc00640 1 -- 172.21.15.69:0/1707213717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdd91b0 msgr2=0x5624f019c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.652+0000 7f11bdc00640 1 --2- 172.21.15.69:0/1707213717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdd91b0 0x5624f019c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.652+0000 7f11bdc00640 1 -- 172.21.15.69:0/1707213717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdb02f0 msgr2=0x5624f0175250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.652+0000 7f11bdc00640 1 --2- 172.21.15.69:0/1707213717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdb02f0 0x5624f0175250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.653+0000 7f11bdc00640 1 -- 172.21.15.69:0/1707213717 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624f0185c00 con 0x5624efdb84d0 2024-05-14T15:35:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.653+0000 7f11bdc00640 1 --2- 172.21.15.69:0/1707213717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb84d0 0x5624f017b210 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f11b0000f80 tx=0x7f11b0030bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b088baa57f0b669c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:54.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.654+0000 7f11aa000640 1 -- 172.21.15.69:0/1707213717 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0003b70 con 0x5624efdb84d0 2024-05-14T15:35:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.655+0000 7f11aa000640 1 -- 172.21.15.69:0/1707213717 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11b0036040 con 0x5624efdb84d0 2024-05-14T15:35:54.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.655+0000 7f11aa000640 1 -- 172.21.15.69:0/1707213717 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b00476a0 con 0x5624efdb84d0 2024-05-14T15:35:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.656+0000 7f11c75dc740 1 -- 172.21.15.69:0/1707213717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb84d0 msgr2=0x5624f017b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.656+0000 7f11c75dc740 1 --2- 172.21.15.69:0/1707213717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb84d0 0x5624f017b210 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f11b0000f80 tx=0x7f11b0030bd0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.657+0000 7f11c75dc740 1 -- 172.21.15.69:0/1707213717 shutdown_connections 2024-05-14T15:35:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.657+0000 7f11c75dc740 1 --2- 172.21.15.69:0/1707213717 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdd91b0 0x5624f019c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.657+0000 7f11c75dc740 1 --2- 172.21.15.69:0/1707213717 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdb84d0 0x5624f017b210 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.657+0000 7f11c75dc740 1 --2- 172.21.15.69:0/1707213717 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdb02f0 0x5624f0175250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.657+0000 7f11c75dc740 1 -- 172.21.15.69:0/1707213717 >> 172.21.15.69:0/1707213717 conn(0x5624efdcd300 msgr2=0x5624f0186890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.657+0000 7f11c75dc740 1 -- 172.21.15.69:0/1707213717 shutdown_connections 2024-05-14T15:35:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.657+0000 7f11c75dc740 1 -- 172.21.15.69:0/1707213717 wait complete. 2024-05-14T15:35:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.658+0000 7f11c75dc740 1 -- start start 2024-05-14T15:35:54.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.658+0000 7f11c75dc740 1 Processor -- start 2024-05-14T15:35:54.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.659+0000 7f11c75dc740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdb02f0 0x5624f018cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.660+0000 7f11c75dc740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb84d0 0x5624f0188330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.660+0000 7f11c75dc740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdd91b0 0x5624f0188980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.660+0000 7f11c75dc740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81c9c90 con 0x5624efdd91b0 2024-05-14T15:35:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.660+0000 7f11c75dc740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81c9500 con 0x5624efdb02f0 2024-05-14T15:35:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.660+0000 7f11c75dc740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f11b81c6730 con 0x5624efdb84d0 2024-05-14T15:35:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.660+0000 7f11c75dc740 10 client.0 _ll_register_callbacks cb 0x7f11ac011680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:35:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.660+0000 7f11bd200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdb02f0 0x5624f018cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.661+0000 7f11bd200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdb02f0 0x5624f018cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:45276/0 (socket says 172.21.15.69:45276) 2024-05-14T15:35:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.661+0000 7f11bdc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb84d0 0x5624f0188330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.661+0000 7f11bdc00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb84d0 0x5624f0188330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:44224/0 (socket says 172.21.15.69:44224) 2024-05-14T15:35:54.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.661+0000 7f11bdc00640 1 -- 172.21.15.69:0/2530497310 learned_addr learned my addr 172.21.15.69:0/2530497310 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:35:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.661+0000 7f11bd200640 1 --2- 172.21.15.69:0/2530497310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdd91b0 0x5624f0188980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.661+0000 7f11bdc00640 1 -- 172.21.15.69:0/2530497310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdb02f0 msgr2=0x5624f018cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.662+0000 7f11bdc00640 1 --2- 172.21.15.69:0/2530497310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdb02f0 0x5624f018cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.662+0000 7f11bdc00640 1 -- 172.21.15.69:0/2530497310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdd91b0 msgr2=0x5624f0188980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:35:54.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.662+0000 7f11bdc00640 1 --2- 172.21.15.69:0/2530497310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdd91b0 0x5624f0188980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.662+0000 7f11bdc00640 1 -- 172.21.15.69:0/2530497310 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624f01890c0 con 0x5624efdb84d0 2024-05-14T15:35:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.662+0000 7f11bdc00640 1 --2- 172.21.15.69:0/2530497310 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb84d0 0x5624f0188330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f11b004b040 tx=0x7f11b0030a00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a668865b9700ca1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:35:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.662+0000 7f119f400640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:35:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.662+0000 7f119f400640 1 -- 172.21.15.69:0/2530497310 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b0004240 con 0x5624efdb84d0 2024-05-14T15:35:54.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.663+0000 7f119f400640 1 -- 172.21.15.69:0/2530497310 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(108..108 src has 1..108) ==== 9554+0+0 (secure 0 0 0) 0x7f11b00043e0 con 0x5624efdb84d0 2024-05-14T15:35:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.663+0000 7f11c75dc740 1 -- 172.21.15.69:0/2530497310 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f11b0036040 con 0x5624efdb84d0 2024-05-14T15:35:54.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.663+0000 7f119f400640 1 -- 172.21.15.69:0/2530497310 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f11b00045e0 con 0x5624efdb84d0 2024-05-14T15:35:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.665+0000 7f11c75dc740 10 client.26707 fetch_fsmap learned FSMap version 66 2024-05-14T15:35:54.667 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.665+0000 7f11c75dc740 1 -- 172.21.15.69:0/2530497310 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x5624f01fee70 con 0x5624efdb84d0 2024-05-14T15:35:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.667+0000 7f119f400640 1 -- 172.21.15.69:0/2530497310 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f11b0036040 con 0x5624efdb84d0 2024-05-14T15:35:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.667+0000 7f119f400640 1 -- 172.21.15.69:0/2530497310 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7f11b0031930 con 0x5624efdb84d0 2024-05-14T15:35:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.667+0000 7f11c75dc740 10 client.26707 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:35:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.667+0000 7f11c75dc740 10 client.26707 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:35:54.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.667+0000 7f11c75dc740 20 client.26707 populate_metadata read hostname 'smithi069' 2024-05-14T15:35:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.667+0000 7f11c75dc740 1 --2- 172.21.15.69:0/2530497310 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5624efd6d1c0 0x5624f02014d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:35:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.667+0000 7f11c75dc740 4 client.26707 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:35:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.667+0000 7f11c75dc740 1 -- 172.21.15.69:0/2530497310 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5624f00e6fd0 con 0x5624efd6d1c0 2024-05-14T15:35:54.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.668+0000 7f11bd200640 1 --2- 172.21.15.69:0/2530497310 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5624efd6d1c0 0x5624f02014d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:35:54.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.669+0000 7f119f400640 10 client.26707 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:54.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.670+0000 7f11bd200640 1 --2- 172.21.15.69:0/2530497310 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5624efd6d1c0 0x5624f02014d0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=22177b1fdecb5bdf server_cookie=651e4aacbaf98b54 in_seq=0 out_seq=0 2024-05-14T15:35:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.712+0000 7f119f400640 1 -- 172.21.15.69:0/2530497310 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5624f00e6fd0 con 0x5624efd6d1c0 2024-05-14T15:35:54.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.712+0000 7f119f400640 10 client.26707 handle_command_reply: tid=0 2024-05-14T15:35:54.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.714+0000 7f11c75dc740 1 client.26707 shutdown 2024-05-14T15:35:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.716+0000 7f11c75dc740 1 -- 172.21.15.69:0/2530497310 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb84d0 msgr2=0x5624f0188330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:54.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.716+0000 7f11c75dc740 1 --2- 172.21.15.69:0/2530497310 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb84d0 0x5624f0188330 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f11b004b040 tx=0x7f11b0030a00 comp rx=0 tx=0).stop 2024-05-14T15:35:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.716+0000 7f11c75dc740 1 -- 172.21.15.69:0/2530497310 shutdown_connections 2024-05-14T15:35:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.716+0000 7f11c75dc740 1 --2- 172.21.15.69:0/2530497310 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5624efd6d1c0 0x5624f02014d0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.716+0000 7f11c75dc740 1 --2- 172.21.15.69:0/2530497310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5624efdd91b0 0x5624f0188980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.716+0000 7f11c75dc740 1 --2- 172.21.15.69:0/2530497310 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5624efdb84d0 0x5624f0188330 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.716+0000 7f11c75dc740 1 --2- 172.21.15.69:0/2530497310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5624efdb02f0 0x5624f018cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.717+0000 7f11c75dc740 1 -- 172.21.15.69:0/2530497310 >> 172.21.15.69:0/2530497310 conn(0x5624efdcd300 msgr2=0x5624f017e0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:54.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.717+0000 7f119f400640 0 client.26707 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:35:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.717+0000 7f11c75dc740 1 -- 172.21.15.69:0/2530497310 shutdown_connections 2024-05-14T15:35:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.718+0000 7f11c75dc740 1 -- 172.21.15.69:0/2530497310 wait complete. 2024-05-14T15:35:54.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.718+0000 7f11c75dc740 20 client.26707 trim_cache size 0 max 16384 2024-05-14T15:35:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:35:54.723 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:35:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:35:54.724 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:35:54.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.723+0000 7f11bf000640 1 -- 172.21.15.69:0/262695711 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f11a00b29d0 msgr2=0x7f11a00b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.723+0000 7f11bf000640 1 --2- 172.21.15.69:0/262695711 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f11a00b29d0 0x7f11a00b4ee0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f11a40a5800 tx=0x7f11a400ceb0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.723+0000 7f11bf000640 1 -- 172.21.15.69:0/262695711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b81103f0 msgr2=0x7f11b811a900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:35:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.723+0000 7f11bf000640 1 --2- 172.21.15.69:0/262695711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b81103f0 0x7f11b811a900 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f11a400c7a0 tx=0x7f11a400cc60 comp rx=0 tx=0).stop 2024-05-14T15:35:54.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.723+0000 7f11bf000640 1 -- 172.21.15.69:0/262695711 shutdown_connections 2024-05-14T15:35:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.723+0000 7f11bf000640 1 --2- 172.21.15.69:0/262695711 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f11a00b29d0 0x7f11a00b4ee0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.723+0000 7f11bf000640 1 --2- 172.21.15.69:0/262695711 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f11b81103f0 0x7f11b811a900 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.723+0000 7f11bf000640 1 --2- 172.21.15.69:0/262695711 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f11b810fa10 0x7f11b811a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.723+0000 7f11bf000640 1 --2- 172.21.15.69:0/262695711 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f11b810a210 0x7f11b8120270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:35:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.724+0000 7f11bf000640 1 -- 172.21.15.69:0/262695711 >> 172.21.15.69:0/262695711 conn(0x7f11b806f810 msgr2=0x7f11b810d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:35:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.724+0000 7f11bf000640 1 -- 172.21.15.69:0/262695711 shutdown_connections 2024-05-14T15:35:54.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:35:54.724+0000 7f11bf000640 1 -- 172.21.15.69:0/262695711 wait complete. 2024-05-14T15:35:55.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:55 smithi203 ceph-mon[34567]: pgmap v447: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.2 MiB/s wr, 529 op/s 2024-05-14T15:35:55.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:55 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:35:55.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:55 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:35:55.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:55 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:35:55.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:55 smithi092 ceph-mon[34729]: pgmap v447: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.2 MiB/s wr, 529 op/s 2024-05-14T15:35:55.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:55 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:35:55.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:55 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:35:55.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:55 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:35:55.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:55 smithi069 ceph-mon[31270]: pgmap v447: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 42 KiB/s rd, 6.2 MiB/s wr, 529 op/s 2024-05-14T15:35:55.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:55 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:35:55.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:55 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:35:55.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:55 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:35:56.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 610.0 s, 498.4 tps, lat 204.812 ms stddev 199.544 2024-05-14T15:35:57.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:57 smithi203 ceph-mon[34567]: pgmap v448: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.8 MiB/s wr, 763 op/s 2024-05-14T15:35:57.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:57 smithi092 ceph-mon[34729]: pgmap v448: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.8 MiB/s wr, 763 op/s 2024-05-14T15:35:57.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:57 smithi069 ceph-mon[31270]: pgmap v448: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 57 KiB/s rd, 8.8 MiB/s wr, 763 op/s 2024-05-14T15:35:59.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:35:59 smithi203 ceph-mon[34567]: pgmap v449: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.7 MiB/s wr, 512 op/s 2024-05-14T15:35:59.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:35:59 smithi092 ceph-mon[34729]: pgmap v449: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.7 MiB/s wr, 512 op/s 2024-05-14T15:35:59.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:35:59 smithi069 ceph-mon[31270]: pgmap v449: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.7 MiB/s wr, 512 op/s 2024-05-14T15:36:01.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 615.0 s, 553.2 tps, lat 181.648 ms stddev 87.473 2024-05-14T15:36:01.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:01 smithi203 ceph-mon[34567]: pgmap v450: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 8.4 MiB/s wr, 736 op/s 2024-05-14T15:36:01.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:01 smithi092 ceph-mon[34729]: pgmap v450: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 8.4 MiB/s wr, 736 op/s 2024-05-14T15:36:01.977 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:01 smithi069 ceph-mon[31270]: pgmap v450: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 95 KiB/s rd, 8.4 MiB/s wr, 736 op/s 2024-05-14T15:36:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:03 smithi203 ceph-mon[34567]: pgmap v451: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.4 MiB/s wr, 479 op/s 2024-05-14T15:36:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:03 smithi203 ceph-mon[34567]: osdmap e109: 12 total, 12 up, 12 in 2024-05-14T15:36:03.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:03 smithi092 ceph-mon[34729]: pgmap v451: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.4 MiB/s wr, 479 op/s 2024-05-14T15:36:03.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:03 smithi092 ceph-mon[34729]: osdmap e109: 12 total, 12 up, 12 in 2024-05-14T15:36:03.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:03 smithi069 ceph-mon[31270]: pgmap v451: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 5.4 MiB/s wr, 479 op/s 2024-05-14T15:36:03.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:03 smithi069 ceph-mon[31270]: osdmap e109: 12 total, 12 up, 12 in 2024-05-14T15:36:05.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:05 smithi203 ceph-mon[34567]: pgmap v453: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 7.0 MiB/s wr, 590 op/s 2024-05-14T15:36:05.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:05 smithi092 ceph-mon[34729]: pgmap v453: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 7.0 MiB/s wr, 590 op/s 2024-05-14T15:36:05.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:05 smithi069 ceph-mon[31270]: pgmap v453: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 7.0 MiB/s wr, 590 op/s 2024-05-14T15:36:06.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 620.0 s, 422.2 tps, lat 236.066 ms stddev 300.414 2024-05-14T15:36:07.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:07 smithi203 ceph-mon[34567]: pgmap v454: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 7.0 MiB/s wr, 616 op/s 2024-05-14T15:36:07.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:07 smithi092 ceph-mon[34729]: pgmap v454: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 7.0 MiB/s wr, 616 op/s 2024-05-14T15:36:07.977 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:07 smithi069 ceph-mon[31270]: pgmap v454: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 7.0 MiB/s wr, 616 op/s 2024-05-14T15:36:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.081+0000 7fd58aa00640 1 -- 172.21.15.69:0/3435636318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5841075e0 msgr2=0x7fd5841079f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:08.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.081+0000 7fd58aa00640 1 --2- 172.21.15.69:0/3435636318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5841075e0 0x7fd5841079f0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fd574009900 tx=0x7fd57402a3f0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.085+0000 7fd58aa00640 1 -- 172.21.15.69:0/3435636318 shutdown_connections 2024-05-14T15:36:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.085+0000 7fd58aa00640 1 --2- 172.21.15.69:0/3435636318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd584108010 0x7fd5841084a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.085+0000 7fd58aa00640 1 --2- 172.21.15.69:0/3435636318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5841075e0 0x7fd5841079f0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.085+0000 7fd58aa00640 1 --2- 172.21.15.69:0/3435636318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd584102b90 0x7fd584102fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.085+0000 7fd58aa00640 1 -- 172.21.15.69:0/3435636318 >> 172.21.15.69:0/3435636318 conn(0x7fd5840782e0 msgr2=0x7fd584078720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:08.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.086+0000 7fd58aa00640 1 -- 172.21.15.69:0/3435636318 shutdown_connections 2024-05-14T15:36:08.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.086+0000 7fd58aa00640 1 -- 172.21.15.69:0/3435636318 wait complete. 2024-05-14T15:36:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.087+0000 7fd58aa00640 1 Processor -- start 2024-05-14T15:36:08.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.088+0000 7fd58aa00640 1 -- start start 2024-05-14T15:36:08.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.088+0000 7fd58aa00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd584102b90 0x7fd5841a0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.088+0000 7fd58aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5841075e0 0x7fd5841a1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.089+0000 7fd58aa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd584108010 0x7fd5841a55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.089+0000 7fd58aa00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd58411a320 con 0x7fd5841075e0 2024-05-14T15:36:08.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.089+0000 7fd58aa00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd58411a1a0 con 0x7fd584102b90 2024-05-14T15:36:08.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.089+0000 7fd58aa00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd58411a4a0 con 0x7fd584108010 2024-05-14T15:36:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.089+0000 7fd57be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5841075e0 0x7fd5841a1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.089+0000 7fd588a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd584108010 0x7fd5841a55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.089+0000 7fd588a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd584108010 0x7fd5841a55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:37770/0 (socket says 172.21.15.69:37770) 2024-05-14T15:36:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.089+0000 7fd588a00640 1 -- 172.21.15.69:0/1493980958 learned_addr learned my addr 172.21.15.69:0/1493980958 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.090+0000 7fd583e00640 1 --2- 172.21.15.69:0/1493980958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd584102b90 0x7fd5841a0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.091+0000 7fd588a00640 1 -- 172.21.15.69:0/1493980958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd584102b90 msgr2=0x7fd5841a0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.091+0000 7fd588a00640 1 --2- 172.21.15.69:0/1493980958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd584102b90 0x7fd5841a0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.091+0000 7fd588a00640 1 -- 172.21.15.69:0/1493980958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5841075e0 msgr2=0x7fd5841a1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.091+0000 7fd588a00640 1 --2- 172.21.15.69:0/1493980958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5841075e0 0x7fd5841a1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.091+0000 7fd588a00640 1 -- 172.21.15.69:0/1493980958 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5841a5ba0 con 0x7fd584108010 2024-05-14T15:36:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.091+0000 7fd57be00640 1 --2- 172.21.15.69:0/1493980958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5841075e0 0x7fd5841a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:36:08.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.092+0000 7fd588a00640 1 --2- 172.21.15.69:0/1493980958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd584108010 0x7fd5841a55e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00eb40 tx=0x7fd57c00c2d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.093+0000 7fd583e00640 1 --2- 172.21.15.69:0/1493980958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd584102b90 0x7fd5841a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:36:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.093+0000 7fd581600640 1 -- 172.21.15.69:0/1493980958 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c004b20 con 0x7fd584108010 2024-05-14T15:36:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.093+0000 7fd581600640 1 -- 172.21.15.69:0/1493980958 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd57c004cc0 con 0x7fd584108010 2024-05-14T15:36:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.093+0000 7fd581600640 1 -- 172.21.15.69:0/1493980958 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c010690 con 0x7fd584108010 2024-05-14T15:36:08.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.093+0000 7fd58aa00640 1 -- 172.21.15.69:0/1493980958 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5841a5e90 con 0x7fd584108010 2024-05-14T15:36:08.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.093+0000 7fd58aa00640 1 -- 172.21.15.69:0/1493980958 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5841a6360 con 0x7fd584108010 2024-05-14T15:36:08.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.101+0000 7fd591b79740 1 Processor -- start 2024-05-14T15:36:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.105+0000 7fd581600640 1 -- 172.21.15.69:0/1493980958 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd57c005020 con 0x7fd584108010 2024-05-14T15:36:08.109 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.107+0000 7fd591b79740 1 -- start start 2024-05-14T15:36:08.110 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.109+0000 7fd581600640 1 --2- 172.21.15.69:0/1493980958 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5680b2aa0 0x7fd5680b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.109+0000 7fd581600640 1 -- 172.21.15.69:0/1493980958 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 9642+0+0 (secure 0 0 0) 0x7fd57c0e2fb0 con 0x7fd584108010 2024-05-14T15:36:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.110+0000 7fd591b79740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485b81b0 0x558f48959280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.110+0000 7fd591b79740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4858f2f0 0x558f489597c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.111 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.110+0000 7fd591b79740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485974d0 0x558f48959d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.110+0000 7fd591b79740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x558f488be550 con 0x558f485b81b0 2024-05-14T15:36:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.110+0000 7fd591b79740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558f48863bc0 con 0x558f4858f2f0 2024-05-14T15:36:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.110+0000 7fd591b79740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558f488ba510 con 0x558f485974d0 2024-05-14T15:36:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.111+0000 7fd588a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485974d0 0x558f48959d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.112 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.111+0000 7fd588a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485974d0 0x558f48959d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:37786/0 (socket says 172.21.15.69:37786) 2024-05-14T15:36:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.111+0000 7fd588a00640 1 -- 172.21.15.69:0/1481941040 learned_addr learned my addr 172.21.15.69:0/1481941040 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:08.113 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.111+0000 7fd583e00640 1 --2- 172.21.15.69:0/1481941040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485b81b0 0x558f48959280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.112+0000 7fd588a00640 1 -- 172.21.15.69:0/1481941040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4858f2f0 msgr2=0x558f489597c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.112+0000 7fd588a00640 1 --2- 172.21.15.69:0/1481941040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4858f2f0 0x558f489597c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.112+0000 7fd588a00640 1 -- 172.21.15.69:0/1481941040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485b81b0 msgr2=0x558f48959280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.112+0000 7fd588a00640 1 --2- 172.21.15.69:0/1481941040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485b81b0 0x558f48959280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.114 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.112+0000 7fd588a00640 1 -- 172.21.15.69:0/1481941040 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f485d0210 con 0x558f485974d0 2024-05-14T15:36:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.113+0000 7fd588a00640 1 --2- 172.21.15.69:0/1481941040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485974d0 0x558f48959d00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0a9dc0 tx=0x7fd57c0a5e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f0af0df326c12a42 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:08.115 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.113+0000 7fd57be00640 1 --2- 172.21.15.69:0/1493980958 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5680b2aa0 0x7fd5680b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.114+0000 7fd579200640 1 -- 172.21.15.69:0/1481941040 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0aa530 con 0x558f485974d0 2024-05-14T15:36:08.116 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.114+0000 7fd579200640 1 -- 172.21.15.69:0/1481941040 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd57c0a9e30 con 0x558f485974d0 2024-05-14T15:36:08.118 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.114+0000 7fd579200640 1 -- 172.21.15.69:0/1481941040 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57c0b2800 con 0x558f485974d0 2024-05-14T15:36:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.118+0000 7fd591b79740 1 -- 172.21.15.69:0/1481941040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485974d0 msgr2=0x558f48959d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:08.119 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.118+0000 7fd591b79740 1 --2- 172.21.15.69:0/1481941040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485974d0 0x558f48959d00 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd57c0a9dc0 tx=0x7fd57c0a5e20 comp rx=0 tx=0).stop 2024-05-14T15:36:08.120 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.119+0000 7fd591b79740 1 -- 172.21.15.69:0/1481941040 shutdown_connections 2024-05-14T15:36:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.119+0000 7fd591b79740 1 --2- 172.21.15.69:0/1481941040 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485974d0 0x558f48959d00 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.119+0000 7fd591b79740 1 --2- 172.21.15.69:0/1481941040 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4858f2f0 0x558f489597c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.119+0000 7fd591b79740 1 --2- 172.21.15.69:0/1481941040 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485b81b0 0x558f48959280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.121 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.119+0000 7fd591b79740 1 -- 172.21.15.69:0/1481941040 >> 172.21.15.69:0/1481941040 conn(0x558f485ac300 msgr2=0x558f48955a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.120+0000 7fd57be00640 1 --2- 172.21.15.69:0/1493980958 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5680b2aa0 0x7fd5680b4fb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd574006010 tx=0x7fd5740056d0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.121+0000 7fd591b79740 1 -- 172.21.15.69:0/1481941040 shutdown_connections 2024-05-14T15:36:08.122 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.121+0000 7fd591b79740 1 -- 172.21.15.69:0/1481941040 wait complete. 2024-05-14T15:36:08.123 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.122+0000 7fd591b79740 1 -- start start 2024-05-14T15:36:08.123 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.122+0000 7fd591b79740 1 Processor -- start 2024-05-14T15:36:08.124 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.123+0000 7fd591b79740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4858f2f0 0x558f48963750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.124 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.123+0000 7fd591b79740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485974d0 0x558f48963c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.124 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.123+0000 7fd591b79740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 0x558f4896f860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.123+0000 7fd591b79740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x558f489663b0 con 0x558f485974d0 2024-05-14T15:36:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.123+0000 7fd591b79740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558f48877660 con 0x558f4858f2f0 2024-05-14T15:36:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.123+0000 7fd591b79740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558f48966530 con 0x558f485b81b0 2024-05-14T15:36:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.123+0000 7fd591b79740 10 client.0 _ll_register_callbacks cb 0x558f48841400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:36:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.123+0000 7fd57be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485974d0 0x558f48963c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.124+0000 7fd57be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485974d0 0x558f48963c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42692/0 (socket says 172.21.15.69:42692) 2024-05-14T15:36:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.124+0000 7fd583e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4858f2f0 0x558f48963750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.125 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.124+0000 7fd57be00640 1 -- 172.21.15.69:0/960331934 learned_addr learned my addr 172.21.15.69:0/960331934 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.124+0000 7fd588a00640 1 --2- 172.21.15.69:0/960331934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 0x558f4896f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.124+0000 7fd57be00640 1 -- 172.21.15.69:0/960331934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 msgr2=0x558f4896f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.124+0000 7fd57be00640 1 --2- 172.21.15.69:0/960331934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 0x558f4896f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.127 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.124+0000 7fd57be00640 1 -- 172.21.15.69:0/960331934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4858f2f0 msgr2=0x558f48963750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.124+0000 7fd57be00640 1 --2- 172.21.15.69:0/960331934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4858f2f0 0x558f48963750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.124+0000 7fd57be00640 1 -- 172.21.15.69:0/960331934 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f4869c620 con 0x558f485974d0 2024-05-14T15:36:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.125+0000 7fd57be00640 1 --2- 172.21.15.69:0/960331934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485974d0 0x558f48963c90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd574009900 tx=0x7fd574009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d5f25b96dcf965f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:08.128 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.125+0000 7fd571600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:36:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.127+0000 7fd571600640 1 -- 172.21.15.69:0/960331934 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57404b070 con 0x558f485974d0 2024-05-14T15:36:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.127+0000 7fd571600640 1 -- 172.21.15.69:0/960331934 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9642+0+0 (secure 0 0 0) 0x7fd57403d860 con 0x558f485974d0 2024-05-14T15:36:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.128+0000 7fd591b79740 1 -- 172.21.15.69:0/960331934 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd57c0a9e30 con 0x558f485974d0 2024-05-14T15:36:08.129 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.128+0000 7fd571600640 1 -- 172.21.15.69:0/960331934 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fd574041070 con 0x558f485974d0 2024-05-14T15:36:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.130+0000 7fd591b79740 10 client.17232 fetch_fsmap learned FSMap version 66 2024-05-14T15:36:08.131 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.130+0000 7fd591b79740 1 -- 172.21.15.69:0/960331934 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x558f489725e0 con 0x558f485974d0 2024-05-14T15:36:08.132 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.131+0000 7fd571600640 1 -- 172.21.15.69:0/960331934 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd57c0a9e30 con 0x558f485974d0 2024-05-14T15:36:08.132 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.131+0000 7fd571600640 1 -- 172.21.15.69:0/960331934 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7fd57403a040 con 0x558f485974d0 2024-05-14T15:36:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.132+0000 7fd591b79740 10 client.17232 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:36:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.132+0000 7fd591b79740 10 client.17232 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:36:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.132+0000 7fd591b79740 20 client.17232 populate_metadata read hostname 'smithi069' 2024-05-14T15:36:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.132+0000 7fd591b79740 1 --2- 172.21.15.69:0/960331934 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558f48576d80 0x558f48975ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.132+0000 7fd591b79740 4 client.17232 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:36:08.134 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.132+0000 7fd591b79740 1 -- 172.21.15.69:0/960331934 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f488cc160 con 0x558f48576d80 2024-05-14T15:36:08.135 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.133+0000 7fd583e00640 1 --2- 172.21.15.69:0/960331934 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558f48576d80 0x558f48975ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.135 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.134+0000 7fd571600640 10 client.17232 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:36:08.135 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.134+0000 7fd583e00640 1 --2- 172.21.15.69:0/960331934 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558f48576d80 0x558f48975ab0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ada4e3bf92379329 server_cookie=be2364161275423b in_seq=0 out_seq=0 2024-05-14T15:36:08.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.137+0000 7fd571600640 1 -- 172.21.15.69:0/960331934 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558f488cc160 con 0x558f48576d80 2024-05-14T15:36:08.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.137+0000 7fd571600640 10 client.17232 handle_command_reply: tid=0 2024-05-14T15:36:08.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.137+0000 7fd591b79740 1 client.17232 shutdown 2024-05-14T15:36:08.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.137+0000 7fd591b79740 1 -- 172.21.15.69:0/960331934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485974d0 msgr2=0x558f48963c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:08.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.137+0000 7fd591b79740 1 --2- 172.21.15.69:0/960331934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485974d0 0x558f48963c90 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fd574009900 tx=0x7fd574009260 comp rx=0 tx=0).stop 2024-05-14T15:36:08.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.137+0000 7fd591b79740 1 -- 172.21.15.69:0/960331934 shutdown_connections 2024-05-14T15:36:08.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.137+0000 7fd591b79740 1 --2- 172.21.15.69:0/960331934 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 0x558f4896f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.138+0000 7fd591b79740 1 --2- 172.21.15.69:0/960331934 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558f48576d80 0x558f48975ab0 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.138+0000 7fd591b79740 1 --2- 172.21.15.69:0/960331934 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485974d0 0x558f48963c90 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.138+0000 7fd591b79740 1 --2- 172.21.15.69:0/960331934 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4858f2f0 0x558f48963750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.138+0000 7fd591b79740 1 -- 172.21.15.69:0/960331934 >> 172.21.15.69:0/960331934 conn(0x558f485ac300 msgr2=0x558f4895afa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.138+0000 7fd571600640 0 client.17232 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:36:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.138+0000 7fd591b79740 1 -- 172.21.15.69:0/960331934 shutdown_connections 2024-05-14T15:36:08.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.138+0000 7fd591b79740 1 -- 172.21.15.69:0/960331934 wait complete. 2024-05-14T15:36:08.143 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.142+0000 7fd591b79740 20 client.17232 trim_cache size 0 max 16384 2024-05-14T15:36:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.190+0000 7fd591b79740 1 Processor -- start 2024-05-14T15:36:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.190+0000 7fd591b79740 1 -- start start 2024-05-14T15:36:08.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.190+0000 7fd591b79740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4858f2f0 0x558f489630f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.190+0000 7fd591b79740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f485974d0 0x558f48955900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.190+0000 7fd591b79740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 0x558f4897b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.190+0000 7fd591b79740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd5841b7bb0 con 0x558f4858f2f0 2024-05-14T15:36:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.190+0000 7fd591b79740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd5841b97e0 con 0x558f485974d0 2024-05-14T15:36:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.190+0000 7fd591b79740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd5841b8280 con 0x558f485b81b0 2024-05-14T15:36:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.191+0000 7fd583e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4858f2f0 0x558f489630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.191+0000 7fd583e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4858f2f0 0x558f489630f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42700/0 (socket says 172.21.15.69:42700) 2024-05-14T15:36:08.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.191+0000 7fd583e00640 1 -- 172.21.15.69:0/2394470328 learned_addr learned my addr 172.21.15.69:0/2394470328 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:08.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.191+0000 7fd588a00640 1 --2- 172.21.15.69:0/2394470328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 0x558f4897b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.191+0000 7fd57be00640 1 --2- 172.21.15.69:0/2394470328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f485974d0 0x558f48955900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.193+0000 7fd583e00640 1 -- 172.21.15.69:0/2394470328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 msgr2=0x558f4897b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.193+0000 7fd583e00640 1 --2- 172.21.15.69:0/2394470328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 0x558f4897b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.193+0000 7fd583e00640 1 -- 172.21.15.69:0/2394470328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f485974d0 msgr2=0x558f48955900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.193+0000 7fd583e00640 1 --2- 172.21.15.69:0/2394470328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f485974d0 0x558f48955900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.194+0000 7fd583e00640 1 -- 172.21.15.69:0/2394470328 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f48961a90 con 0x558f4858f2f0 2024-05-14T15:36:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.194+0000 7fd57be00640 1 --2- 172.21.15.69:0/2394470328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f485974d0 0x558f48955900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:36:08.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.194+0000 7fd583e00640 1 --2- 172.21.15.69:0/2394470328 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4858f2f0 0x558f489630f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd56c005fd0 tx=0x7fd56c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f160ca0e4d639d6c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.195+0000 7fd573e00640 1 -- 172.21.15.69:0/2394470328 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c004030 con 0x558f4858f2f0 2024-05-14T15:36:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.196+0000 7fd573e00640 1 -- 172.21.15.69:0/2394470328 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd56c0035f0 con 0x558f4858f2f0 2024-05-14T15:36:08.197 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.196+0000 7fd573e00640 1 -- 172.21.15.69:0/2394470328 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56c01b6a0 con 0x558f4858f2f0 2024-05-14T15:36:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.198+0000 7fd591b79740 1 -- 172.21.15.69:0/2394470328 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4858f2f0 msgr2=0x558f489630f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:08.199 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.198+0000 7fd591b79740 1 --2- 172.21.15.69:0/2394470328 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4858f2f0 0x558f489630f0 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fd56c005fd0 tx=0x7fd56c0046c0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.198+0000 7fd591b79740 1 -- 172.21.15.69:0/2394470328 shutdown_connections 2024-05-14T15:36:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.198+0000 7fd591b79740 1 --2- 172.21.15.69:0/2394470328 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 0x558f4897b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.198+0000 7fd591b79740 1 --2- 172.21.15.69:0/2394470328 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f485974d0 0x558f48955900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.198+0000 7fd591b79740 1 --2- 172.21.15.69:0/2394470328 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4858f2f0 0x558f489630f0 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.198+0000 7fd591b79740 1 -- 172.21.15.69:0/2394470328 >> 172.21.15.69:0/2394470328 conn(0x558f485ac300 msgr2=0x558f489551f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:08.200 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.199+0000 7fd591b79740 1 -- 172.21.15.69:0/2394470328 shutdown_connections 2024-05-14T15:36:08.201 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.199+0000 7fd591b79740 1 -- 172.21.15.69:0/2394470328 wait complete. 2024-05-14T15:36:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.200+0000 7fd591b79740 1 -- start start 2024-05-14T15:36:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.200+0000 7fd591b79740 1 Processor -- start 2024-05-14T15:36:08.202 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.201+0000 7fd591b79740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485974d0 0x558f48966780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.202+0000 7fd591b79740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 0x558f48966cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.202+0000 7fd591b79740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4854c1c0 0x558f489dbe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.202+0000 7fd591b79740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd5841b9110 con 0x558f485974d0 2024-05-14T15:36:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.202+0000 7fd591b79740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd5841b8980 con 0x558f4854c1c0 2024-05-14T15:36:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.202+0000 7fd591b79740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd5841b5bb0 con 0x558f485b81b0 2024-05-14T15:36:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.202+0000 7fd591b79740 10 client.0 _ll_register_callbacks cb 0x7fd57c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:36:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.203+0000 7fd583e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485974d0 0x558f48966780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.203+0000 7fd57be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 0x558f48966cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.203+0000 7fd57be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 0x558f48966cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:37798/0 (socket says 172.21.15.69:37798) 2024-05-14T15:36:08.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.203+0000 7fd57be00640 1 -- 172.21.15.69:0/731877595 learned_addr learned my addr 172.21.15.69:0/731877595 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.203+0000 7fd583e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485974d0 0x558f48966780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42702/0 (socket says 172.21.15.69:42702) 2024-05-14T15:36:08.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.204+0000 7fd588a00640 1 --2- 172.21.15.69:0/731877595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4854c1c0 0x558f489dbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.206 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.204+0000 7fd57be00640 1 -- 172.21.15.69:0/731877595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4854c1c0 msgr2=0x558f489dbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.204+0000 7fd57be00640 1 --2- 172.21.15.69:0/731877595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4854c1c0 0x558f489dbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.204+0000 7fd57be00640 1 -- 172.21.15.69:0/731877595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485974d0 msgr2=0x558f48966780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.204+0000 7fd57be00640 1 --2- 172.21.15.69:0/731877595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485974d0 0x558f48966780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.204+0000 7fd57be00640 1 -- 172.21.15.69:0/731877595 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f48967540 con 0x558f485b81b0 2024-05-14T15:36:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.205+0000 7fd57be00640 1 --2- 172.21.15.69:0/731877595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 0x558f48966cc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd57402a430 tx=0x7fd574050710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=688c23f06ee82881 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.205+0000 7fd571600640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:36:08.207 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.206+0000 7fd571600640 1 -- 172.21.15.69:0/731877595 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd57404b040 con 0x558f485b81b0 2024-05-14T15:36:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.206+0000 7fd571600640 1 -- 172.21.15.69:0/731877595 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(109..109 src has 1..109) ==== 9642+0+0 (secure 0 0 0) 0x7fd57403da70 con 0x558f485b81b0 2024-05-14T15:36:08.208 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.206+0000 7fd591b79740 1 -- 172.21.15.69:0/731877595 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd56c0035f0 con 0x558f485b81b0 2024-05-14T15:36:08.209 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.208+0000 7fd571600640 1 -- 172.21.15.69:0/731877595 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fd574035040 con 0x558f485b81b0 2024-05-14T15:36:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.209+0000 7fd591b79740 10 client.26722 fetch_fsmap learned FSMap version 66 2024-05-14T15:36:08.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.209+0000 7fd591b79740 1 -- 172.21.15.69:0/731877595 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x558f489dd360 con 0x558f485b81b0 2024-05-14T15:36:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.211+0000 7fd571600640 1 -- 172.21.15.69:0/731877595 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd56c0035f0 con 0x558f485b81b0 2024-05-14T15:36:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.211+0000 7fd571600640 1 -- 172.21.15.69:0/731877595 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7fd57406ca70 con 0x558f485b81b0 2024-05-14T15:36:08.212 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.211+0000 7fd591b79740 10 client.26722 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:36:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.211+0000 7fd591b79740 10 client.26722 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:36:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.211+0000 7fd591b79740 20 client.26722 populate_metadata read hostname 'smithi069' 2024-05-14T15:36:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.211+0000 7fd591b79740 1 --2- 172.21.15.69:0/731877595 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558f489dda80 0x558f489dfea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.211+0000 7fd591b79740 4 client.26722 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:36:08.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.211+0000 7fd591b79740 1 -- 172.21.15.69:0/731877595 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558f48964020 con 0x558f489dda80 2024-05-14T15:36:08.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.213+0000 7fd583e00640 1 --2- 172.21.15.69:0/731877595 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558f489dda80 0x558f489dfea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.214+0000 7fd583e00640 1 --2- 172.21.15.69:0/731877595 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558f489dda80 0x558f489dfea0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfb25ffdb0b18b3f server_cookie=c1de8ae06b681c19 in_seq=0 out_seq=0 2024-05-14T15:36:08.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.214+0000 7fd571600640 10 client.26722 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:36:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.293+0000 7fd571600640 1 -- 172.21.15.69:0/731877595 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558f48964020 con 0x558f489dda80 2024-05-14T15:36:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.293+0000 7fd571600640 10 client.26722 handle_command_reply: tid=0 2024-05-14T15:36:08.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.294+0000 7fd591b79740 1 client.26722 shutdown 2024-05-14T15:36:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.294+0000 7fd591b79740 1 -- 172.21.15.69:0/731877595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 msgr2=0x558f48966cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.294+0000 7fd591b79740 1 --2- 172.21.15.69:0/731877595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 0x558f48966cc0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fd57402a430 tx=0x7fd574050710 comp rx=0 tx=0).stop 2024-05-14T15:36:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.295+0000 7fd591b79740 1 -- 172.21.15.69:0/731877595 shutdown_connections 2024-05-14T15:36:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.295+0000 7fd591b79740 1 --2- 172.21.15.69:0/731877595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4854c1c0 0x558f489dbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.295+0000 7fd591b79740 1 --2- 172.21.15.69:0/731877595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f485b81b0 0x558f48966cc0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.295+0000 7fd591b79740 1 --2- 172.21.15.69:0/731877595 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558f489dda80 0x558f489dfea0 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.295+0000 7fd591b79740 1 --2- 172.21.15.69:0/731877595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f485974d0 0x558f48966780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.295+0000 7fd591b79740 1 -- 172.21.15.69:0/731877595 >> 172.21.15.69:0/731877595 conn(0x558f485ac300 msgr2=0x558f48954000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:08.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.295+0000 7fd571600640 0 client.26722 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:36:08.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.295+0000 7fd591b79740 1 -- 172.21.15.69:0/731877595 shutdown_connections 2024-05-14T15:36:08.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.296+0000 7fd591b79740 1 -- 172.21.15.69:0/731877595 wait complete. 2024-05-14T15:36:08.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.296+0000 7fd591b79740 20 client.26722 trim_cache size 0 max 16384 2024-05-14T15:36:08.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:36:08.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:36:08.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:36:08.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:36:08.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.297+0000 7fd58aa00640 1 -- 172.21.15.69:0/1493980958 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5680b2aa0 msgr2=0x7fd5680b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:08.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.298+0000 7fd58aa00640 1 --2- 172.21.15.69:0/1493980958 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5680b2aa0 0x7fd5680b4fb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd574006010 tx=0x7fd5740056d0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.298+0000 7fd58aa00640 1 -- 172.21.15.69:0/1493980958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd584108010 msgr2=0x7fd5841a55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:08.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.298+0000 7fd58aa00640 1 --2- 172.21.15.69:0/1493980958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd584108010 0x7fd5841a55e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd57c00eb40 tx=0x7fd57c00c2d0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.298+0000 7fd58aa00640 1 -- 172.21.15.69:0/1493980958 shutdown_connections 2024-05-14T15:36:08.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.299+0000 7fd58aa00640 1 --2- 172.21.15.69:0/1493980958 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd5680b2aa0 0x7fd5680b4fb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.299+0000 7fd58aa00640 1 --2- 172.21.15.69:0/1493980958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd584108010 0x7fd5841a55e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.299+0000 7fd58aa00640 1 --2- 172.21.15.69:0/1493980958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd5841075e0 0x7fd5841a1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.299+0000 7fd58aa00640 1 --2- 172.21.15.69:0/1493980958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd584102b90 0x7fd5841a0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:08.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.299+0000 7fd58aa00640 1 -- 172.21.15.69:0/1493980958 >> 172.21.15.69:0/1493980958 conn(0x7fd5840782e0 msgr2=0x7fd584105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:08.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.300+0000 7fd58aa00640 1 -- 172.21.15.69:0/1493980958 shutdown_connections 2024-05-14T15:36:08.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:08.300+0000 7fd58aa00640 1 -- 172.21.15.69:0/1493980958 wait complete. 2024-05-14T15:36:09.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:09 smithi203 ceph-mon[34567]: pgmap v455: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 7.0 MiB/s wr, 616 op/s 2024-05-14T15:36:09.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:09 smithi092 ceph-mon[34729]: pgmap v455: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 7.0 MiB/s wr, 616 op/s 2024-05-14T15:36:09.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:09 smithi069 ceph-mon[31270]: pgmap v455: 129 pgs: 129 active+clean; 2.9 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 112 KiB/s rd, 7.0 MiB/s wr, 616 op/s 2024-05-14T15:36:11.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:10 smithi092 ceph-mon[34729]: osdmap e110: 12 total, 12 up, 12 in 2024-05-14T15:36:11.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:10 smithi069 ceph-mon[31270]: osdmap e110: 12 total, 12 up, 12 in 2024-05-14T15:36:11.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:10 smithi203 ceph-mon[34567]: osdmap e110: 12 total, 12 up, 12 in 2024-05-14T15:36:11.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 625.0 s, 561.6 tps, lat 177.613 ms stddev 54.151 2024-05-14T15:36:12.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:11 smithi092 ceph-mon[34729]: pgmap v457: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 9.2 MiB/s wr, 820 op/s 2024-05-14T15:36:12.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:11 smithi069 ceph-mon[31270]: pgmap v457: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 9.2 MiB/s wr, 820 op/s 2024-05-14T15:36:12.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:11 smithi203 ceph-mon[34567]: pgmap v457: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 9.2 MiB/s wr, 820 op/s 2024-05-14T15:36:14.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:13 smithi092 ceph-mon[34729]: pgmap v458: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 7.5 MiB/s wr, 672 op/s 2024-05-14T15:36:14.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:13 smithi069 ceph-mon[31270]: pgmap v458: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 7.5 MiB/s wr, 672 op/s 2024-05-14T15:36:14.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:13 smithi203 ceph-mon[34567]: pgmap v458: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 7.5 MiB/s wr, 672 op/s 2024-05-14T15:36:16.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:15 smithi092 ceph-mon[34729]: pgmap v459: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 6.9 MiB/s wr, 643 op/s 2024-05-14T15:36:16.227 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:15 smithi069 ceph-mon[31270]: pgmap v459: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 6.9 MiB/s wr, 643 op/s 2024-05-14T15:36:16.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:15 smithi203 ceph-mon[34567]: pgmap v459: 129 pgs: 129 active+clean; 2.9 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 6.9 MiB/s wr, 643 op/s 2024-05-14T15:36:16.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 630.0 s, 482.6 tps, lat 207.266 ms stddev 167.517 2024-05-14T15:36:18.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:17 smithi092 ceph-mon[34729]: pgmap v460: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.9 MiB/s wr, 638 op/s 2024-05-14T15:36:18.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:17 smithi069 ceph-mon[31270]: pgmap v460: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.9 MiB/s wr, 638 op/s 2024-05-14T15:36:18.347 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:17 smithi203 ceph-mon[34567]: pgmap v460: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.9 MiB/s wr, 638 op/s 2024-05-14T15:36:20.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:19 smithi092 ceph-mon[34729]: pgmap v461: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.9 MiB/s wr, 638 op/s 2024-05-14T15:36:20.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:19 smithi069 ceph-mon[31270]: pgmap v461: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.9 MiB/s wr, 638 op/s 2024-05-14T15:36:20.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:19 smithi203 ceph-mon[34567]: pgmap v461: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 6.9 MiB/s wr, 638 op/s 2024-05-14T15:36:21.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:20 smithi092 ceph-mon[34729]: pgmap v462: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.3 MiB/s wr, 700 op/s 2024-05-14T15:36:21.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:20 smithi069 ceph-mon[31270]: pgmap v462: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.3 MiB/s wr, 700 op/s 2024-05-14T15:36:21.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:20 smithi203 ceph-mon[34567]: pgmap v462: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 7.3 MiB/s wr, 700 op/s 2024-05-14T15:36:21.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 635.0 s, 566.0 tps, lat 146.892 ms stddev 84.574 2024-05-14T15:36:21.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.646+0000 7f2c82000640 1 -- 172.21.15.69:0/1334672499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7c10a140 msgr2=0x7f2c7c103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:21.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.646+0000 7f2c82000640 1 --2- 172.21.15.69:0/1334672499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7c10a140 0x7f2c7c103d80 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009900 tx=0x7f2c6802a440 comp rx=0 tx=0).stop 2024-05-14T15:36:21.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.647+0000 7f2c82000640 1 -- 172.21.15.69:0/1334672499 shutdown_connections 2024-05-14T15:36:21.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.647+0000 7f2c82000640 1 --2- 172.21.15.69:0/1334672499 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c7c1043f0 0x7f2c7c1107c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.647+0000 7f2c82000640 1 --2- 172.21.15.69:0/1334672499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7c10a140 0x7f2c7c103d80 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.647+0000 7f2c82000640 1 --2- 172.21.15.69:0/1334672499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c7c109ca0 0x7f2c7c103840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.648+0000 7f2c82000640 1 -- 172.21.15.69:0/1334672499 >> 172.21.15.69:0/1334672499 conn(0x7f2c7c0ff3a0 msgr2=0x7f2c7c1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:21.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.648+0000 7f2c82000640 1 -- 172.21.15.69:0/1334672499 shutdown_connections 2024-05-14T15:36:21.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.648+0000 7f2c82000640 1 -- 172.21.15.69:0/1334672499 wait complete. 2024-05-14T15:36:21.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.650+0000 7f2c82000640 1 Processor -- start 2024-05-14T15:36:21.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.650+0000 7f2c82000640 1 -- start start 2024-05-14T15:36:21.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.650+0000 7f2c82000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c7c1043f0 0x7f2c7c1126f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.650+0000 7f2c82000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c7c109ca0 0x7f2c7c112c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.650+0000 7f2c82000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7c10a140 0x7f2c7c1a2510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.650+0000 7f2c82000640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c115ff0 con 0x7f2c7c1043f0 2024-05-14T15:36:21.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.650+0000 7f2c82000640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c115e70 con 0x7f2c7c10a140 2024-05-14T15:36:21.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.650+0000 7f2c82000640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c116170 con 0x7f2c7c109ca0 2024-05-14T15:36:21.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.651+0000 7f2c7be00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7c10a140 0x7f2c7c1a2510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.651+0000 7f2c7be00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7c10a140 0x7f2c7c1a2510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:50980/0 (socket says 172.21.15.69:50980) 2024-05-14T15:36:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.651+0000 7f2c7be00640 1 -- 172.21.15.69:0/687380793 learned_addr learned my addr 172.21.15.69:0/687380793 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.651+0000 7f2c7b400640 1 --2- 172.21.15.69:0/687380793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c7c1043f0 0x7f2c7c1126f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.651+0000 7f2c7aa00640 1 --2- 172.21.15.69:0/687380793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c7c109ca0 0x7f2c7c112c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.652+0000 7f2c7be00640 1 -- 172.21.15.69:0/687380793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c7c109ca0 msgr2=0x7f2c7c112c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.652+0000 7f2c7be00640 1 --2- 172.21.15.69:0/687380793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c7c109ca0 0x7f2c7c112c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.652+0000 7f2c7be00640 1 -- 172.21.15.69:0/687380793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c7c1043f0 msgr2=0x7f2c7c1126f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.652+0000 7f2c7be00640 1 --2- 172.21.15.69:0/687380793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c7c1043f0 0x7f2c7c1126f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.652+0000 7f2c7be00640 1 -- 172.21.15.69:0/687380793 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c7c1134d0 con 0x7f2c7c10a140 2024-05-14T15:36:21.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.653+0000 7f2c7be00640 1 --2- 172.21.15.69:0/687380793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7c10a140 0x7f2c7c1a2510 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2c7400d750 tx=0x7f2c7400dc10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.653+0000 7f2c73e00640 1 -- 172.21.15.69:0/687380793 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c74017070 con 0x7f2c7c10a140 2024-05-14T15:36:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.653+0000 7f2c73e00640 1 -- 172.21.15.69:0/687380793 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c740054b0 con 0x7f2c7c10a140 2024-05-14T15:36:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.654+0000 7f2c73e00640 1 -- 172.21.15.69:0/687380793 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c74004b90 con 0x7f2c7c10a140 2024-05-14T15:36:21.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.654+0000 7f2c82000640 1 -- 172.21.15.69:0/687380793 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c7c1a2b10 con 0x7f2c7c10a140 2024-05-14T15:36:21.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.654+0000 7f2c82000640 1 -- 172.21.15.69:0/687380793 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c7c1a2fe0 con 0x7f2c7c10a140 2024-05-14T15:36:21.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.659+0000 7f2c88f7b740 1 Processor -- start 2024-05-14T15:36:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.660+0000 7f2c73e00640 1 -- 172.21.15.69:0/687380793 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f2c74004d30 con 0x7f2c7c10a140 2024-05-14T15:36:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.660+0000 7f2c88f7b740 1 -- start start 2024-05-14T15:36:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.661+0000 7f2c88f7b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867f41b0 0x55a086b95280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.661+0000 7f2c88f7b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867cb2f0 0x55a086b957c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.661+0000 7f2c88f7b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867d34d0 0x55a086b95d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.661+0000 7f2c88f7b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55a086afa550 con 0x55a0867d34d0 2024-05-14T15:36:21.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.661+0000 7f2c88f7b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a086a9fbc0 con 0x55a0867cb2f0 2024-05-14T15:36:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.661+0000 7f2c88f7b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a086af6510 con 0x55a0867f41b0 2024-05-14T15:36:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.662+0000 7f2c7b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867cb2f0 0x55a086b957c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.662+0000 7f2c7b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867cb2f0 0x55a086b957c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:50986/0 (socket says 172.21.15.69:50986) 2024-05-14T15:36:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.662+0000 7f2c7b400640 1 -- 172.21.15.69:0/2668372927 learned_addr learned my addr 172.21.15.69:0/2668372927 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.662+0000 7f2c7aa00640 1 --2- 172.21.15.69:0/2668372927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867d34d0 0x55a086b95d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.662+0000 7f2c7aa00640 1 --2- 172.21.15.69:0/2668372927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867f41b0 0x55a086b95280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.662+0000 7f2c7b400640 1 -- 172.21.15.69:0/2668372927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867f41b0 msgr2=0x55a086b95280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:21.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.662+0000 7f2c7b400640 1 --2- 172.21.15.69:0/2668372927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867f41b0 0x55a086b95280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.662+0000 7f2c7b400640 1 -- 172.21.15.69:0/2668372927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867d34d0 msgr2=0x55a086b95d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:21.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.662+0000 7f2c7b400640 1 --2- 172.21.15.69:0/2668372927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867d34d0 0x55a086b95d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.662+0000 7f2c7b400640 1 -- 172.21.15.69:0/2668372927 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a08680c210 con 0x55a0867cb2f0 2024-05-14T15:36:21.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.662+0000 7f2c7aa00640 1 --2- 172.21.15.69:0/2668372927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867d34d0 0x55a086b95d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:36:21.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.663+0000 7f2c73e00640 1 --2- 172.21.15.69:0/687380793 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2c600b2a50 0x7f2c600b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.663+0000 7f2c7b400640 1 --2- 172.21.15.69:0/2668372927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867cb2f0 0x55a086b957c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009fd0 tx=0x7f2c6c0096d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=339e085e49f77f10 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:21.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.664+0000 7f2c7aa00640 1 --2- 172.21.15.69:0/687380793 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2c600b2a50 0x7f2c600b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.664+0000 7f2c67e00640 1 -- 172.21.15.69:0/2668372927 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c013790 con 0x55a0867cb2f0 2024-05-14T15:36:21.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.664+0000 7f2c67e00640 1 -- 172.21.15.69:0/2668372927 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c6c019070 con 0x55a0867cb2f0 2024-05-14T15:36:21.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.664+0000 7f2c67e00640 1 -- 172.21.15.69:0/2668372927 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c014c60 con 0x55a0867cb2f0 2024-05-14T15:36:21.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.664+0000 7f2c73e00640 1 -- 172.21.15.69:0/687380793 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9554+0+0 (secure 0 0 0) 0x7f2c740e23e0 con 0x7f2c7c10a140 2024-05-14T15:36:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.666+0000 7f2c88f7b740 1 -- 172.21.15.69:0/2668372927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867cb2f0 msgr2=0x55a086b957c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.666+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/2668372927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867cb2f0 0x55a086b957c0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009fd0 tx=0x7f2c6c0096d0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.666+0000 7f2c7aa00640 1 --2- 172.21.15.69:0/687380793 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2c600b2a50 0x7f2c600b4f60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2c6802aa30 tx=0x7f2c68000bc0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.666+0000 7f2c88f7b740 1 -- 172.21.15.69:0/2668372927 shutdown_connections 2024-05-14T15:36:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.666+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/2668372927 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867d34d0 0x55a086b95d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.667 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.666+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/2668372927 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867cb2f0 0x55a086b957c0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.666+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/2668372927 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867f41b0 0x55a086b95280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.666+0000 7f2c88f7b740 1 -- 172.21.15.69:0/2668372927 >> 172.21.15.69:0/2668372927 conn(0x55a0867e8300 msgr2=0x55a086b91a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.666+0000 7f2c88f7b740 1 -- 172.21.15.69:0/2668372927 shutdown_connections 2024-05-14T15:36:21.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.666+0000 7f2c88f7b740 1 -- 172.21.15.69:0/2668372927 wait complete. 2024-05-14T15:36:21.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.670+0000 7f2c88f7b740 1 -- start start 2024-05-14T15:36:21.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.670+0000 7f2c88f7b740 1 Processor -- start 2024-05-14T15:36:21.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.671+0000 7f2c88f7b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867cb2f0 0x55a086b9f790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.671+0000 7f2c88f7b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867d34d0 0x55a086b9fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.671+0000 7f2c88f7b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867f41b0 0x55a086bbc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.671+0000 7f2c88f7b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55a086bb33c0 con 0x55a0867d34d0 2024-05-14T15:36:21.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.671+0000 7f2c88f7b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a086ab3660 con 0x55a0867f41b0 2024-05-14T15:36:21.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.671+0000 7f2c88f7b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a086bb3540 con 0x55a0867cb2f0 2024-05-14T15:36:21.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.671+0000 7f2c88f7b740 10 client.0 _ll_register_callbacks cb 0x55a086a7d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:36:21.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.672+0000 7f2c7b400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867cb2f0 0x55a086b9f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.672+0000 7f2c7b400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867cb2f0 0x55a086b9f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:47974/0 (socket says 172.21.15.69:47974) 2024-05-14T15:36:21.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.672+0000 7f2c7b400640 1 -- 172.21.15.69:0/4242403153 learned_addr learned my addr 172.21.15.69:0/4242403153 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:21.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.672+0000 7f2c7be00640 1 --2- 172.21.15.69:0/4242403153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867f41b0 0x55a086bbc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.672+0000 7f2c7be00640 1 -- 172.21.15.69:0/4242403153 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867cb2f0 msgr2=0x55a086b9f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:21.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.672+0000 7f2c7be00640 1 --2- 172.21.15.69:0/4242403153 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867cb2f0 0x55a086b9f790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.672+0000 7f2c7be00640 1 -- 172.21.15.69:0/4242403153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867d34d0 msgr2=0x55a086b9fcd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:36:21.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.672+0000 7f2c7be00640 1 --2- 172.21.15.69:0/4242403153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867d34d0 0x55a086b9fcd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.672+0000 7f2c7be00640 1 -- 172.21.15.69:0/4242403153 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0868d8620 con 0x55a0867f41b0 2024-05-14T15:36:21.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.673+0000 7f2c7be00640 1 --2- 172.21.15.69:0/4242403153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867f41b0 0x55a086bbc8c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2c740df6c0 tx=0x7f2c740a8ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5803bd935b4b2cd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:21.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.673+0000 7f2c64c00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:36:21.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.673+0000 7f2c64c00640 1 -- 172.21.15.69:0/4242403153 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c74020040 con 0x55a0867f41b0 2024-05-14T15:36:21.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.674+0000 7f2c64c00640 1 -- 172.21.15.69:0/4242403153 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9554+0+0 (secure 0 0 0) 0x7f2c740ad120 con 0x55a0867f41b0 2024-05-14T15:36:21.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.674+0000 7f2c88f7b740 1 -- 172.21.15.69:0/4242403153 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c6c019070 con 0x55a0867f41b0 2024-05-14T15:36:21.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.674+0000 7f2c64c00640 1 -- 172.21.15.69:0/4242403153 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f2c740dfb50 con 0x55a0867f41b0 2024-05-14T15:36:21.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.675+0000 7f2c88f7b740 10 client.36755 fetch_fsmap learned FSMap version 66 2024-05-14T15:36:21.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.675+0000 7f2c88f7b740 1 -- 172.21.15.69:0/4242403153 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55a086bbf5f0 con 0x55a0867f41b0 2024-05-14T15:36:21.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.676+0000 7f2c64c00640 1 -- 172.21.15.69:0/4242403153 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c6c019070 con 0x55a0867f41b0 2024-05-14T15:36:21.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.676+0000 7f2c64c00640 1 -- 172.21.15.69:0/4242403153 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7f2c740c3c50 con 0x55a0867f41b0 2024-05-14T15:36:21.677 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.676+0000 7f2c88f7b740 10 client.36755 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:36:21.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.676+0000 7f2c88f7b740 10 client.36755 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:36:21.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.676+0000 7f2c88f7b740 20 client.36755 populate_metadata read hostname 'smithi069' 2024-05-14T15:36:21.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.676+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/4242403153 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a0867b2d80 0x55a086bc2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.676+0000 7f2c88f7b740 4 client.36755 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:36:21.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.676+0000 7f2c88f7b740 1 -- 172.21.15.69:0/4242403153 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a086b08160 con 0x55a0867b2d80 2024-05-14T15:36:21.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.677+0000 7f2c7b400640 1 --2- 172.21.15.69:0/4242403153 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a0867b2d80 0x55a086bc2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.677+0000 7f2c7b400640 1 --2- 172.21.15.69:0/4242403153 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a0867b2d80 0x55a086bc2a70 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a1da5ada059e843a server_cookie=d725b2397b1c5e4c in_seq=0 out_seq=0 2024-05-14T15:36:21.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.678+0000 7f2c64c00640 10 client.36755 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:36:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.679+0000 7f2c64c00640 1 -- 172.21.15.69:0/4242403153 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a086b08160 con 0x55a0867b2d80 2024-05-14T15:36:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.679+0000 7f2c64c00640 10 client.36755 handle_command_reply: tid=0 2024-05-14T15:36:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.679+0000 7f2c88f7b740 1 client.36755 shutdown 2024-05-14T15:36:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.679+0000 7f2c88f7b740 1 -- 172.21.15.69:0/4242403153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867f41b0 msgr2=0x55a086bbc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.679+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/4242403153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867f41b0 0x55a086bbc8c0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f2c740df6c0 tx=0x7f2c740a8ba0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.680+0000 7f2c88f7b740 1 -- 172.21.15.69:0/4242403153 shutdown_connections 2024-05-14T15:36:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.680+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/4242403153 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867f41b0 0x55a086bbc8c0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.680+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/4242403153 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a0867b2d80 0x55a086bc2a70 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.680+0000 7f2c64c00640 0 client.36755 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:36:21.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.680+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/4242403153 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867d34d0 0x55a086b9fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.680+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/4242403153 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867cb2f0 0x55a086b9f790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.680+0000 7f2c88f7b740 1 -- 172.21.15.69:0/4242403153 >> 172.21.15.69:0/4242403153 conn(0x55a0867e8300 msgr2=0x55a086b950b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.680+0000 7f2c88f7b740 1 -- 172.21.15.69:0/4242403153 shutdown_connections 2024-05-14T15:36:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.680+0000 7f2c88f7b740 1 -- 172.21.15.69:0/4242403153 wait complete. 2024-05-14T15:36:21.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.680+0000 7f2c88f7b740 20 client.36755 trim_cache size 0 max 16384 2024-05-14T15:36:21.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.718+0000 7f2c88f7b740 1 Processor -- start 2024-05-14T15:36:21.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.718+0000 7f2c88f7b740 1 -- start start 2024-05-14T15:36:21.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.719+0000 7f2c88f7b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867b2d80 0x55a086b91920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.719+0000 7f2c88f7b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867cb2f0 0x55a086bc8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.719+0000 7f2c88f7b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867d34d0 0x55a086bc87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.719+0000 7f2c88f7b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c1b7b40 con 0x55a0867d34d0 2024-05-14T15:36:21.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.719+0000 7f2c88f7b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c1b9770 con 0x55a0867b2d80 2024-05-14T15:36:21.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.719+0000 7f2c88f7b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c1b8210 con 0x55a0867cb2f0 2024-05-14T15:36:21.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.720+0000 7f2c7be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867d34d0 0x55a086bc87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.720+0000 7f2c7b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867b2d80 0x55a086b91920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.720+0000 7f2c7aa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867cb2f0 0x55a086bc8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.720+0000 7f2c7b400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867b2d80 0x55a086b91920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:51002/0 (socket says 172.21.15.69:51002) 2024-05-14T15:36:21.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.720+0000 7f2c7b400640 1 -- 172.21.15.69:0/556085034 learned_addr learned my addr 172.21.15.69:0/556085034 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:21.722 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.720+0000 7f2c7be00640 1 -- 172.21.15.69:0/556085034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867cb2f0 msgr2=0x55a086bc8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:21.722 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.720+0000 7f2c7be00640 1 --2- 172.21.15.69:0/556085034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867cb2f0 0x55a086bc8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.722 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.720+0000 7f2c7be00640 1 -- 172.21.15.69:0/556085034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867b2d80 msgr2=0x55a086b91920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:21.722 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.720+0000 7f2c7be00640 1 --2- 172.21.15.69:0/556085034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867b2d80 0x55a086b91920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.722 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.720+0000 7f2c7be00640 1 -- 172.21.15.69:0/556085034 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a086b9dad0 con 0x55a0867d34d0 2024-05-14T15:36:21.723 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.721+0000 7f2c7be00640 1 --2- 172.21.15.69:0/556085034 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867d34d0 0x55a086bc87b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2c740a9000 tx=0x7f2c740a8a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=199c721df59eb298 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:21.723 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.722+0000 7f2c67400640 1 -- 172.21.15.69:0/556085034 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c74020070 con 0x55a0867d34d0 2024-05-14T15:36:21.723 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.722+0000 7f2c67400640 1 -- 172.21.15.69:0/556085034 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c740e21b0 con 0x55a0867d34d0 2024-05-14T15:36:21.723 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.722+0000 7f2c67400640 1 -- 172.21.15.69:0/556085034 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c740c3da0 con 0x55a0867d34d0 2024-05-14T15:36:21.724 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.723+0000 7f2c88f7b740 1 -- 172.21.15.69:0/556085034 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867d34d0 msgr2=0x55a086bc87b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:21.724 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.723+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/556085034 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867d34d0 0x55a086bc87b0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f2c740a9000 tx=0x7f2c740a8a70 comp rx=0 tx=0).stop 2024-05-14T15:36:21.724 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.723+0000 7f2c88f7b740 1 -- 172.21.15.69:0/556085034 shutdown_connections 2024-05-14T15:36:21.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.723+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/556085034 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867d34d0 0x55a086bc87b0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.723+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/556085034 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867cb2f0 0x55a086bc8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.723+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/556085034 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867b2d80 0x55a086b91920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.723+0000 7f2c88f7b740 1 -- 172.21.15.69:0/556085034 >> 172.21.15.69:0/556085034 conn(0x55a0867e8300 msgr2=0x55a086b91210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:21.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.723+0000 7f2c88f7b740 1 -- 172.21.15.69:0/556085034 shutdown_connections 2024-05-14T15:36:21.725 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.724+0000 7f2c88f7b740 1 -- 172.21.15.69:0/556085034 wait complete. 2024-05-14T15:36:21.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.724+0000 7f2c88f7b740 1 -- start start 2024-05-14T15:36:21.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.725+0000 7f2c88f7b740 1 Processor -- start 2024-05-14T15:36:21.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.726+0000 7f2c88f7b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867b2d80 0x55a086bb8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.726+0000 7f2c88f7b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867cb2f0 0x55a086bb3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.726+0000 7f2c88f7b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867d34d0 0x55a086bb4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.726+0000 7f2c88f7b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c1b90a0 con 0x55a0867b2d80 2024-05-14T15:36:21.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.726+0000 7f2c88f7b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c1b8910 con 0x55a0867cb2f0 2024-05-14T15:36:21.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.726+0000 7f2c88f7b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7c113c20 con 0x55a0867d34d0 2024-05-14T15:36:21.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.726+0000 7f2c88f7b740 10 client.0 _ll_register_callbacks cb 0x7f2c74005660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:36:21.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.726+0000 7f2c7b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867b2d80 0x55a086bb8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.726+0000 7f2c7b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867b2d80 0x55a086bb8c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57046/0 (socket says 172.21.15.69:57046) 2024-05-14T15:36:21.728 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.726+0000 7f2c7b400640 1 -- 172.21.15.69:0/3661312523 learned_addr learned my addr 172.21.15.69:0/3661312523 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:21.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.726+0000 7f2c7be00640 1 --2- 172.21.15.69:0/3661312523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867d34d0 0x55a086bb4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.726+0000 7f2c7aa00640 1 --2- 172.21.15.69:0/3661312523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867cb2f0 0x55a086bb3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.727+0000 7f2c7b400640 1 -- 172.21.15.69:0/3661312523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867d34d0 msgr2=0x55a086bb4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:21.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.728+0000 7f2c7b400640 1 --2- 172.21.15.69:0/3661312523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867d34d0 0x55a086bb4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.728+0000 7f2c7b400640 1 -- 172.21.15.69:0/3661312523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867cb2f0 msgr2=0x55a086bb3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:21.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.728+0000 7f2c7b400640 1 --2- 172.21.15.69:0/3661312523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867cb2f0 0x55a086bb3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.728+0000 7f2c7b400640 1 -- 172.21.15.69:0/3661312523 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a086bb4b20 con 0x55a0867b2d80 2024-05-14T15:36:21.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.728+0000 7f2c7aa00640 1 --2- 172.21.15.69:0/3661312523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867cb2f0 0x55a086bb3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:36:21.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.728+0000 7f2c7be00640 1 --2- 172.21.15.69:0/3661312523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867d34d0 0x55a086bb4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:36:21.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.728+0000 7f2c7b400640 1 --2- 172.21.15.69:0/3661312523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867b2d80 0x55a086bb8c80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c007040 tx=0x7f2c6c0148c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4abfed1251cc1079 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:21.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.728+0000 7f2c64c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:36:21.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.729+0000 7f2c64c00640 1 -- 172.21.15.69:0/3661312523 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c009ad0 con 0x55a0867b2d80 2024-05-14T15:36:21.730 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.729+0000 7f2c64c00640 1 -- 172.21.15.69:0/3661312523 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9554+0+0 (secure 0 0 0) 0x7f2c6c02b030 con 0x55a0867b2d80 2024-05-14T15:36:21.732 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.730+0000 7f2c88f7b740 1 -- 172.21.15.69:0/3661312523 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2c740e21b0 con 0x55a0867b2d80 2024-05-14T15:36:21.732 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.731+0000 7f2c64c00640 1 -- 172.21.15.69:0/3661312523 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f2c6c003c20 con 0x55a0867b2d80 2024-05-14T15:36:21.732 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.731+0000 7f2c88f7b740 10 client.17250 fetch_fsmap learned FSMap version 66 2024-05-14T15:36:21.732 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.731+0000 7f2c88f7b740 1 -- 172.21.15.69:0/3661312523 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x55a086c2ac00 con 0x55a0867b2d80 2024-05-14T15:36:21.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.732+0000 7f2c64c00640 1 -- 172.21.15.69:0/3661312523 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f2c740e21b0 con 0x55a0867b2d80 2024-05-14T15:36:21.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.732+0000 7f2c64c00640 1 -- 172.21.15.69:0/3661312523 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7f2c6c026700 con 0x55a0867b2d80 2024-05-14T15:36:21.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.733+0000 7f2c88f7b740 10 client.17250 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:36:21.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.733+0000 7f2c88f7b740 10 client.17250 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:36:21.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.733+0000 7f2c88f7b740 20 client.17250 populate_metadata read hostname 'smithi069' 2024-05-14T15:36:21.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.733+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/3661312523 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a0867f41b0 0x55a086c2d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:21.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.733+0000 7f2c88f7b740 4 client.17250 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:36:21.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.733+0000 7f2c88f7b740 1 -- 172.21.15.69:0/3661312523 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a086b01fd0 con 0x55a0867f41b0 2024-05-14T15:36:21.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.733+0000 7f2c7aa00640 1 --2- 172.21.15.69:0/3661312523 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a0867f41b0 0x55a086c2d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:21.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.735+0000 7f2c7aa00640 1 --2- 172.21.15.69:0/3661312523 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a0867f41b0 0x55a086c2d050 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=781b640fbc20e012 server_cookie=6ff4951384fdcd38 in_seq=0 out_seq=0 2024-05-14T15:36:21.736 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.735+0000 7f2c64c00640 10 client.17250 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:36:21.770 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.769+0000 7f2c64c00640 1 -- 172.21.15.69:0/3661312523 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a086b01fd0 con 0x55a0867f41b0 2024-05-14T15:36:21.770 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.769+0000 7f2c64c00640 10 client.17250 handle_command_reply: tid=0 2024-05-14T15:36:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.769+0000 7f2c88f7b740 1 client.17250 shutdown 2024-05-14T15:36:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.770+0000 7f2c88f7b740 1 -- 172.21.15.69:0/3661312523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867b2d80 msgr2=0x55a086bb8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:21.771 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.770+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/3661312523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867b2d80 0x55a086bb8c80 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c007040 tx=0x7f2c6c0148c0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.770+0000 7f2c88f7b740 1 -- 172.21.15.69:0/3661312523 shutdown_connections 2024-05-14T15:36:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.770+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/3661312523 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a0867d34d0 0x55a086bb4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.770+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/3661312523 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a0867cb2f0 0x55a086bb3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.770+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/3661312523 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a0867f41b0 0x55a086c2d050 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.770+0000 7f2c88f7b740 1 --2- 172.21.15.69:0/3661312523 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a0867b2d80 0x55a086bb8c80 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.770+0000 7f2c88f7b740 1 -- 172.21.15.69:0/3661312523 >> 172.21.15.69:0/3661312523 conn(0x55a0867e8300 msgr2=0x55a086b90000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.770+0000 7f2c64c00640 0 client.17250 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:36:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.770+0000 7f2c88f7b740 1 -- 172.21.15.69:0/3661312523 shutdown_connections 2024-05-14T15:36:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.770+0000 7f2c88f7b740 1 -- 172.21.15.69:0/3661312523 wait complete. 2024-05-14T15:36:21.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.770+0000 7f2c88f7b740 20 client.17250 trim_cache size 0 max 16384 2024-05-14T15:36:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:36:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:36:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:36:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:36:21.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.772+0000 7f2c82000640 1 -- 172.21.15.69:0/687380793 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2c600b2a50 msgr2=0x7f2c600b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:21.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.772+0000 7f2c82000640 1 --2- 172.21.15.69:0/687380793 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2c600b2a50 0x7f2c600b4f60 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f2c6802aa30 tx=0x7f2c68000bc0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.773+0000 7f2c82000640 1 -- 172.21.15.69:0/687380793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7c10a140 msgr2=0x7f2c7c1a2510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:21.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.773+0000 7f2c82000640 1 --2- 172.21.15.69:0/687380793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7c10a140 0x7f2c7c1a2510 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f2c7400d750 tx=0x7f2c7400dc10 comp rx=0 tx=0).stop 2024-05-14T15:36:21.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.773+0000 7f2c82000640 1 -- 172.21.15.69:0/687380793 shutdown_connections 2024-05-14T15:36:21.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.773+0000 7f2c82000640 1 --2- 172.21.15.69:0/687380793 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f2c600b2a50 0x7f2c600b4f60 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.773+0000 7f2c82000640 1 --2- 172.21.15.69:0/687380793 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f2c7c10a140 0x7f2c7c1a2510 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.773+0000 7f2c82000640 1 --2- 172.21.15.69:0/687380793 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f2c7c109ca0 0x7f2c7c112c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.773+0000 7f2c82000640 1 --2- 172.21.15.69:0/687380793 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f2c7c1043f0 0x7f2c7c1126f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.773+0000 7f2c82000640 1 -- 172.21.15.69:0/687380793 >> 172.21.15.69:0/687380793 conn(0x7f2c7c0ff3a0 msgr2=0x7f2c7c10f890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.773+0000 7f2c82000640 1 -- 172.21.15.69:0/687380793 shutdown_connections 2024-05-14T15:36:21.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:21.773+0000 7f2c82000640 1 -- 172.21.15.69:0/687380793 wait complete. 2024-05-14T15:36:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:23 smithi092 ceph-mon[34729]: pgmap v463: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.8 MiB/s wr, 550 op/s 2024-05-14T15:36:23.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:23 smithi069 ceph-mon[31270]: pgmap v463: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.8 MiB/s wr, 550 op/s 2024-05-14T15:36:23.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:23 smithi203 ceph-mon[34567]: pgmap v463: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 5.8 MiB/s wr, 550 op/s 2024-05-14T15:36:25.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:25 smithi092 ceph-mon[34729]: pgmap v464: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.9 MiB/s wr, 561 op/s 2024-05-14T15:36:25.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:25 smithi069 ceph-mon[31270]: pgmap v464: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.9 MiB/s wr, 561 op/s 2024-05-14T15:36:25.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:25 smithi203 ceph-mon[34567]: pgmap v464: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 5.9 MiB/s wr, 561 op/s 2024-05-14T15:36:26.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 640.0 s, 488.6 tps, lat 239.167 ms stddev 768.044 2024-05-14T15:36:27.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:27 smithi092 ceph-mon[34729]: pgmap v465: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.5 MiB/s wr, 813 op/s 2024-05-14T15:36:27.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:27 smithi069 ceph-mon[31270]: pgmap v465: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.5 MiB/s wr, 813 op/s 2024-05-14T15:36:27.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:27 smithi203 ceph-mon[34567]: pgmap v465: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.5 MiB/s wr, 813 op/s 2024-05-14T15:36:29.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:29 smithi092 ceph-mon[34729]: pgmap v466: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.8 MiB/s wr, 551 op/s 2024-05-14T15:36:29.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:29 smithi069 ceph-mon[31270]: pgmap v466: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.8 MiB/s wr, 551 op/s 2024-05-14T15:36:29.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:29 smithi203 ceph-mon[34567]: pgmap v466: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.8 MiB/s wr, 551 op/s 2024-05-14T15:36:31.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 645.0 s, 591.4 tps, lat 168.293 ms stddev 57.258 2024-05-14T15:36:31.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:31 smithi092 ceph-mon[34729]: pgmap v467: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 8.7 MiB/s wr, 815 op/s 2024-05-14T15:36:31.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:31 smithi069 ceph-mon[31270]: pgmap v467: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 8.7 MiB/s wr, 815 op/s 2024-05-14T15:36:31.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:31 smithi203 ceph-mon[34567]: pgmap v467: 129 pgs: 129 active+clean; 3.1 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 8.7 MiB/s wr, 815 op/s 2024-05-14T15:36:33.697 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:33 smithi092 ceph-mon[34729]: pgmap v468: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.8 MiB/s wr, 558 op/s 2024-05-14T15:36:33.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:33 smithi069 ceph-mon[31270]: pgmap v468: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.8 MiB/s wr, 558 op/s 2024-05-14T15:36:33.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:33 smithi203 ceph-mon[34567]: pgmap v468: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 36 KiB/s rd, 5.8 MiB/s wr, 558 op/s 2024-05-14T15:36:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.154+0000 7fb87c800640 1 -- 172.21.15.69:0/2565821245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb87410a510 msgr2=0x7fb87410a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.154+0000 7fb87c800640 1 --2- 172.21.15.69:0/2565821245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb87410a510 0x7fb87410a920 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fb864009900 tx=0x7fb86402a3f0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.154+0000 7fb87c800640 1 -- 172.21.15.69:0/2565821245 shutdown_connections 2024-05-14T15:36:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.154+0000 7fb87c800640 1 --2- 172.21.15.69:0/2565821245 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb87410f550 0x7fb874116cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.154+0000 7fb87c800640 1 --2- 172.21.15.69:0/2565821245 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb87410ea90 0x7fb87410eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.154+0000 7fb87c800640 1 --2- 172.21.15.69:0/2565821245 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb87410a510 0x7fb87410a920 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.154+0000 7fb87c800640 1 -- 172.21.15.69:0/2565821245 >> 172.21.15.69:0/2565821245 conn(0x7fb8740771a0 msgr2=0x7fb8740775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:35.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.155+0000 7fb87c800640 1 -- 172.21.15.69:0/2565821245 shutdown_connections 2024-05-14T15:36:35.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.155+0000 7fb87c800640 1 -- 172.21.15.69:0/2565821245 wait complete. 2024-05-14T15:36:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.156+0000 7fb87c800640 1 Processor -- start 2024-05-14T15:36:35.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.157+0000 7fb87c800640 1 -- start start 2024-05-14T15:36:35.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.157+0000 7fb87c800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb87410a510 0x7fb874074990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.157+0000 7fb87c800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb87410ea90 0x7fb87406dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.159 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.157+0000 7fb87c800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb87410f550 0x7fb87406e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.158+0000 7fb87c800640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb87411a3c0 con 0x7fb87410a510 2024-05-14T15:36:35.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.158+0000 7fb87c800640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb87411a240 con 0x7fb87410ea90 2024-05-14T15:36:35.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.158+0000 7fb87c800640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb87411a540 con 0x7fb87410f550 2024-05-14T15:36:35.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.158+0000 7fb879e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb87410a510 0x7fb874074990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.160 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.158+0000 7fb879400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb87410ea90 0x7fb87406dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.158+0000 7fb879400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb87410ea90 0x7fb87406dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:49718/0 (socket says 172.21.15.69:49718) 2024-05-14T15:36:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.158+0000 7fb879400640 1 -- 172.21.15.69:0/2076687702 learned_addr learned my addr 172.21.15.69:0/2076687702 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.158+0000 7fb87a800640 1 --2- 172.21.15.69:0/2076687702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb87410f550 0x7fb87406e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.159+0000 7fb879400640 1 -- 172.21.15.69:0/2076687702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb87410f550 msgr2=0x7fb87406e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.159+0000 7fb879400640 1 --2- 172.21.15.69:0/2076687702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb87410f550 0x7fb87406e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.159+0000 7fb879400640 1 -- 172.21.15.69:0/2076687702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb87410a510 msgr2=0x7fb874074990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.159+0000 7fb879400640 1 --2- 172.21.15.69:0/2076687702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb87410a510 0x7fb874074990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.159+0000 7fb879400640 1 -- 172.21.15.69:0/2076687702 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8740724b0 con 0x7fb87410ea90 2024-05-14T15:36:35.161 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.159+0000 7fb879400640 1 --2- 172.21.15.69:0/2076687702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb87410ea90 0x7fb87406dad0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb868005fd0 tx=0x7fb86800dde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.160+0000 7fb86ea00640 1 -- 172.21.15.69:0/2076687702 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb868017070 con 0x7fb87410ea90 2024-05-14T15:36:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.160+0000 7fb86ea00640 1 -- 172.21.15.69:0/2076687702 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb868009c30 con 0x7fb87410ea90 2024-05-14T15:36:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.160+0000 7fb86ea00640 1 -- 172.21.15.69:0/2076687702 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb86800f620 con 0x7fb87410ea90 2024-05-14T15:36:35.162 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.160+0000 7fb87c800640 1 -- 172.21.15.69:0/2076687702 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8740727a0 con 0x7fb87410ea90 2024-05-14T15:36:35.164 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.160+0000 7fb87c800640 1 -- 172.21.15.69:0/2076687702 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb874072ca0 con 0x7fb87410ea90 2024-05-14T15:36:35.166 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.165+0000 7fb883837740 1 Processor -- start 2024-05-14T15:36:35.167 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.166+0000 7fb883837740 1 -- start start 2024-05-14T15:36:35.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.167+0000 7fb883837740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc501b0 0x56311cff1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.167+0000 7fb86ea00640 1 -- 172.21.15.69:0/2076687702 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb868010460 con 0x7fb87410ea90 2024-05-14T15:36:35.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.167+0000 7fb87a800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc501b0 0x56311cff1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.168+0000 7fb87a800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc501b0 0x56311cff1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35344/0 (socket says 172.21.15.69:35344) 2024-05-14T15:36:35.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.168+0000 7fb87a800640 1 -- 172.21.15.69:0/352171095 learned_addr learned my addr 172.21.15.69:0/352171095 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:35.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.168+0000 7fb883837740 1 --2- 172.21.15.69:0/352171095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc272f0 0x56311cff17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.169+0000 7fb883837740 1 --2- 172.21.15.69:0/352171095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc2f4d0 0x56311cff1d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.170 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.169+0000 7fb883837740 1 -- 172.21.15.69:0/352171095 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56311cf56550 con 0x56311cc501b0 2024-05-14T15:36:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.169+0000 7fb883837740 1 -- 172.21.15.69:0/352171095 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56311cefbbc0 con 0x56311cc2f4d0 2024-05-14T15:36:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.169+0000 7fb883837740 1 -- 172.21.15.69:0/352171095 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56311cf52510 con 0x56311cc272f0 2024-05-14T15:36:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.170+0000 7fb879e00640 1 --2- 172.21.15.69:0/352171095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc272f0 0x56311cff17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.170+0000 7fb879400640 1 --2- 172.21.15.69:0/352171095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc2f4d0 0x56311cff1d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.171+0000 7fb879400640 1 -- 172.21.15.69:0/352171095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc272f0 msgr2=0x56311cff17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:35.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.171+0000 7fb879400640 1 --2- 172.21.15.69:0/352171095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc272f0 0x56311cff17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.171+0000 7fb879400640 1 -- 172.21.15.69:0/352171095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc501b0 msgr2=0x56311cff1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:35.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.171+0000 7fb879400640 1 --2- 172.21.15.69:0/352171095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc501b0 0x56311cff1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.171+0000 7fb879400640 1 -- 172.21.15.69:0/352171095 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311cc68210 con 0x56311cc2f4d0 2024-05-14T15:36:35.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.172+0000 7fb87a800640 1 --2- 172.21.15.69:0/352171095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc501b0 0x56311cff1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:36:35.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.172+0000 7fb879400640 1 --2- 172.21.15.69:0/352171095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc2f4d0 0x56311cff1d00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb8680df970 tx=0x7fb8680ea670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=31a50755cc765a7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:35.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.173+0000 7fb863000640 1 -- 172.21.15.69:0/352171095 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8680f1070 con 0x56311cc2f4d0 2024-05-14T15:36:35.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.173+0000 7fb863000640 1 -- 172.21.15.69:0/352171095 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8680e2c40 con 0x56311cc2f4d0 2024-05-14T15:36:35.175 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.173+0000 7fb863000640 1 -- 172.21.15.69:0/352171095 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8680ed680 con 0x56311cc2f4d0 2024-05-14T15:36:35.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.175+0000 7fb883837740 1 -- 172.21.15.69:0/352171095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc2f4d0 msgr2=0x56311cff1d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.175+0000 7fb883837740 1 --2- 172.21.15.69:0/352171095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc2f4d0 0x56311cff1d00 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fb8680df970 tx=0x7fb8680ea670 comp rx=0 tx=0).stop 2024-05-14T15:36:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.175+0000 7fb86ea00640 1 --2- 172.21.15.69:0/2076687702 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb85c0b2a50 0x7fb85c0b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.175+0000 7fb86ea00640 1 -- 172.21.15.69:0/2076687702 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9554+0+0 (secure 0 0 0) 0x7fb8680e2690 con 0x7fb87410ea90 2024-05-14T15:36:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.177+0000 7fb87a800640 1 --2- 172.21.15.69:0/2076687702 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb85c0b2a50 0x7fb85c0b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.177+0000 7fb883837740 1 -- 172.21.15.69:0/352171095 shutdown_connections 2024-05-14T15:36:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.177+0000 7fb883837740 1 --2- 172.21.15.69:0/352171095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc2f4d0 0x56311cff1d00 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.177+0000 7fb883837740 1 --2- 172.21.15.69:0/352171095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc272f0 0x56311cff17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.177+0000 7fb883837740 1 --2- 172.21.15.69:0/352171095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc501b0 0x56311cff1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.177+0000 7fb883837740 1 -- 172.21.15.69:0/352171095 >> 172.21.15.69:0/352171095 conn(0x56311cc44300 msgr2=0x56311cfeda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:35.179 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.178+0000 7fb883837740 1 -- 172.21.15.69:0/352171095 shutdown_connections 2024-05-14T15:36:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.178+0000 7fb883837740 1 -- 172.21.15.69:0/352171095 wait complete. 2024-05-14T15:36:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.178+0000 7fb87a800640 1 --2- 172.21.15.69:0/2076687702 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb85c0b2a50 0x7fb85c0b4f60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb870009fd0 tx=0x7fb87000e040 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.179+0000 7fb883837740 1 -- start start 2024-05-14T15:36:35.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.179+0000 7fb883837740 1 Processor -- start 2024-05-14T15:36:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.181+0000 7fb883837740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc272f0 0x56311cffb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.181+0000 7fb883837740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc2f4d0 0x56311cffbca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.181+0000 7fb883837740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc501b0 0x56311d0078b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.181+0000 7fb883837740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56311cffe3b0 con 0x56311cc2f4d0 2024-05-14T15:36:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.181+0000 7fb883837740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56311cf0f660 con 0x56311cc272f0 2024-05-14T15:36:35.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.181+0000 7fb883837740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56311cffe530 con 0x56311cc501b0 2024-05-14T15:36:35.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.181+0000 7fb879e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc272f0 0x56311cffb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.181+0000 7fb879400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc2f4d0 0x56311cffbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.181+0000 7fb879e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc272f0 0x56311cffb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:49728/0 (socket says 172.21.15.69:49728) 2024-05-14T15:36:35.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.181+0000 7fb879e00640 1 -- 172.21.15.69:0/4186835768 learned_addr learned my addr 172.21.15.69:0/4186835768 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:35.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.181+0000 7fb87a800640 1 --2- 172.21.15.69:0/4186835768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc501b0 0x56311d0078b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.182+0000 7fb883837740 10 client.0 _ll_register_callbacks cb 0x56311ced9400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:36:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.182+0000 7fb879400640 1 -- 172.21.15.69:0/4186835768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc501b0 msgr2=0x56311d0078b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.182+0000 7fb879400640 1 --2- 172.21.15.69:0/4186835768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc501b0 0x56311d0078b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.182+0000 7fb879400640 1 -- 172.21.15.69:0/4186835768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc272f0 msgr2=0x56311cffb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.182+0000 7fb879400640 1 --2- 172.21.15.69:0/4186835768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc272f0 0x56311cffb760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.182+0000 7fb879400640 1 -- 172.21.15.69:0/4186835768 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56311cd34620 con 0x56311cc2f4d0 2024-05-14T15:36:35.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.183+0000 7fb879400640 1 --2- 172.21.15.69:0/4186835768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc2f4d0 0x56311cffbca0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb8680a6770 tx=0x7fb8680e84b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3526b174a9fea2fe server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:35.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.183+0000 7fb857400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:36:35.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.184+0000 7fb857400640 1 -- 172.21.15.69:0/4186835768 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb868020070 con 0x56311cc2f4d0 2024-05-14T15:36:35.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.184+0000 7fb857400640 1 -- 172.21.15.69:0/4186835768 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9554+0+0 (secure 0 0 0) 0x7fb8680e2a40 con 0x56311cc2f4d0 2024-05-14T15:36:35.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.184+0000 7fb883837740 1 -- 172.21.15.69:0/4186835768 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb8680e2c40 con 0x56311cc2f4d0 2024-05-14T15:36:35.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.184+0000 7fb857400640 1 -- 172.21.15.69:0/4186835768 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fb8680f1030 con 0x56311cc2f4d0 2024-05-14T15:36:35.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.184+0000 7fb883837740 10 client.17262 fetch_fsmap learned FSMap version 66 2024-05-14T15:36:35.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.184+0000 7fb883837740 1 -- 172.21.15.69:0/4186835768 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x56311d00a5f0 con 0x56311cc2f4d0 2024-05-14T15:36:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.185+0000 7fb857400640 1 -- 172.21.15.69:0/4186835768 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb8680e2c40 con 0x56311cc2f4d0 2024-05-14T15:36:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.185+0000 7fb857400640 1 -- 172.21.15.69:0/4186835768 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7fb8680dfbf0 con 0x56311cc2f4d0 2024-05-14T15:36:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.185+0000 7fb883837740 10 client.17262 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:36:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.185+0000 7fb883837740 10 client.17262 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:36:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.185+0000 7fb883837740 20 client.17262 populate_metadata read hostname 'smithi069' 2024-05-14T15:36:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.186+0000 7fb883837740 1 --2- 172.21.15.69:0/4186835768 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56311cc0ed80 0x56311d00d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.186+0000 7fb883837740 4 client.17262 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:36:35.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.186+0000 7fb883837740 1 -- 172.21.15.69:0/4186835768 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56311cf64160 con 0x56311cc0ed80 2024-05-14T15:36:35.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.187+0000 7fb879e00640 1 --2- 172.21.15.69:0/4186835768 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56311cc0ed80 0x56311d00d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.189+0000 7fb879e00640 1 --2- 172.21.15.69:0/4186835768 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56311cc0ed80 0x56311d00d950 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eef5d1685d3ac8f5 server_cookie=a1cf3e4dd2cc5e11 in_seq=0 out_seq=0 2024-05-14T15:36:35.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.189+0000 7fb857400640 10 client.17262 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:36:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.192+0000 7fb857400640 1 -- 172.21.15.69:0/4186835768 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56311cf64160 con 0x56311cc0ed80 2024-05-14T15:36:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.192+0000 7fb857400640 10 client.17262 handle_command_reply: tid=0 2024-05-14T15:36:35.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.192+0000 7fb883837740 1 client.17262 shutdown 2024-05-14T15:36:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.193+0000 7fb883837740 1 -- 172.21.15.69:0/4186835768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc2f4d0 msgr2=0x56311cffbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.193+0000 7fb883837740 1 --2- 172.21.15.69:0/4186835768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc2f4d0 0x56311cffbca0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb8680a6770 tx=0x7fb8680e84b0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.193+0000 7fb883837740 1 -- 172.21.15.69:0/4186835768 shutdown_connections 2024-05-14T15:36:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.193+0000 7fb883837740 1 --2- 172.21.15.69:0/4186835768 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc501b0 0x56311d0078b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.193+0000 7fb883837740 1 --2- 172.21.15.69:0/4186835768 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56311cc0ed80 0x56311d00d950 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.193+0000 7fb883837740 1 --2- 172.21.15.69:0/4186835768 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc2f4d0 0x56311cffbca0 secure :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fb8680a6770 tx=0x7fb8680e84b0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.193+0000 7fb883837740 1 --2- 172.21.15.69:0/4186835768 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc272f0 0x56311cffb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.193+0000 7fb883837740 1 -- 172.21.15.69:0/4186835768 >> 172.21.15.69:0/4186835768 conn(0x56311cc44300 msgr2=0x56311cff2fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.193+0000 7fb857400640 0 client.17262 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:36:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.193+0000 7fb883837740 1 -- 172.21.15.69:0/4186835768 shutdown_connections 2024-05-14T15:36:35.195 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.194+0000 7fb883837740 1 -- 172.21.15.69:0/4186835768 wait complete. 2024-05-14T15:36:35.196 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.194+0000 7fb883837740 20 client.17262 trim_cache size 0 max 16384 2024-05-14T15:36:35.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.237+0000 7fb883837740 1 Processor -- start 2024-05-14T15:36:35.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.237+0000 7fb883837740 1 -- start start 2024-05-14T15:36:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.238+0000 7fb883837740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc272f0 0x56311cfedb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.238+0000 7fb883837740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc501b0 0x56311d007820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.238+0000 7fb883837740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cbe41c0 0x56311d007d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.238+0000 7fb883837740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb8741c02c0 con 0x56311cc272f0 2024-05-14T15:36:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.238+0000 7fb883837740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8741c1ef0 con 0x56311cc501b0 2024-05-14T15:36:35.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.238+0000 7fb883837740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb8741c0990 con 0x56311cbe41c0 2024-05-14T15:36:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.239+0000 7fb879e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc272f0 0x56311cfedb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.239+0000 7fb87a800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cbe41c0 0x56311d007d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.239+0000 7fb87a800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cbe41c0 0x56311d007d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:50254/0 (socket says 172.21.15.69:50254) 2024-05-14T15:36:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.239+0000 7fb87a800640 1 -- 172.21.15.69:0/409124458 learned_addr learned my addr 172.21.15.69:0/409124458 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:35.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.239+0000 7fb879e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc272f0 0x56311cfedb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:35358/0 (socket says 172.21.15.69:35358) 2024-05-14T15:36:35.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.239+0000 7fb879400640 1 --2- 172.21.15.69:0/409124458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc501b0 0x56311d007820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.240+0000 7fb87a800640 1 -- 172.21.15.69:0/409124458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc501b0 msgr2=0x56311d007820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:35.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.240+0000 7fb87a800640 1 --2- 172.21.15.69:0/409124458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc501b0 0x56311d007820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.240+0000 7fb87a800640 1 -- 172.21.15.69:0/409124458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc272f0 msgr2=0x56311cfedb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.240+0000 7fb87a800640 1 --2- 172.21.15.69:0/409124458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc272f0 0x56311cfedb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.240+0000 7fb87a800640 1 -- 172.21.15.69:0/409124458 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56311d008740 con 0x56311cbe41c0 2024-05-14T15:36:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.240+0000 7fb879e00640 1 --2- 172.21.15.69:0/409124458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc272f0 0x56311cfedb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:36:35.242 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.241+0000 7fb87a800640 1 --2- 172.21.15.69:0/409124458 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cbe41c0 0x56311d007d60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb870007950 tx=0x7fb870012000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b4e1ad37c4fb1f3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.242+0000 7fb862600640 1 -- 172.21.15.69:0/409124458 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb870028070 con 0x56311cbe41c0 2024-05-14T15:36:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.242+0000 7fb862600640 1 -- 172.21.15.69:0/409124458 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb870017d10 con 0x56311cbe41c0 2024-05-14T15:36:35.243 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.242+0000 7fb862600640 1 -- 172.21.15.69:0/409124458 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8700165f0 con 0x56311cbe41c0 2024-05-14T15:36:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.243+0000 7fb883837740 1 -- 172.21.15.69:0/409124458 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cbe41c0 msgr2=0x56311d007d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:35.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.243+0000 7fb883837740 1 --2- 172.21.15.69:0/409124458 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cbe41c0 0x56311d007d60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb870007950 tx=0x7fb870012000 comp rx=0 tx=0).stop 2024-05-14T15:36:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.244+0000 7fb883837740 1 -- 172.21.15.69:0/409124458 shutdown_connections 2024-05-14T15:36:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.244+0000 7fb883837740 1 --2- 172.21.15.69:0/409124458 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cbe41c0 0x56311d007d60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.244+0000 7fb883837740 1 --2- 172.21.15.69:0/409124458 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc501b0 0x56311d007820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.244+0000 7fb883837740 1 --2- 172.21.15.69:0/409124458 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cc272f0 0x56311cfedb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.244+0000 7fb883837740 1 -- 172.21.15.69:0/409124458 >> 172.21.15.69:0/409124458 conn(0x56311cc44300 msgr2=0x56311cfed3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:35.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.244+0000 7fb883837740 1 -- 172.21.15.69:0/409124458 shutdown_connections 2024-05-14T15:36:35.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.244+0000 7fb883837740 1 -- 172.21.15.69:0/409124458 wait complete. 2024-05-14T15:36:35.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.245+0000 7fb883837740 1 -- start start 2024-05-14T15:36:35.246 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.245+0000 7fb883837740 1 Processor -- start 2024-05-14T15:36:35.248 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.247+0000 7fb883837740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cbe41c0 0x56311d06ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.247+0000 7fb883837740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc272f0 0x56311d06d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.248+0000 7fb883837740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc501b0 0x56311d00ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.248+0000 7fb883837740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb8741c1820 con 0x56311cbe41c0 2024-05-14T15:36:35.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.248+0000 7fb883837740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb8741c1090 con 0x56311cc272f0 2024-05-14T15:36:35.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.248+0000 7fb883837740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb8741be2c0 con 0x56311cc501b0 2024-05-14T15:36:35.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.248+0000 7fb883837740 10 client.0 _ll_register_callbacks cb 0x7fb870009710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:36:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.248+0000 7fb87a800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc501b0 0x56311d00ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.248+0000 7fb87a800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc501b0 0x56311d00ddb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:50266/0 (socket says 172.21.15.69:50266) 2024-05-14T15:36:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.248+0000 7fb87a800640 1 -- 172.21.15.69:0/2993050398 learned_addr learned my addr 172.21.15.69:0/2993050398 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.248+0000 7fb879e00640 1 --2- 172.21.15.69:0/2993050398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cbe41c0 0x56311d06ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.249+0000 7fb879400640 1 --2- 172.21.15.69:0/2993050398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc272f0 0x56311d06d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.249+0000 7fb87a800640 1 -- 172.21.15.69:0/2993050398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc272f0 msgr2=0x56311d06d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.249+0000 7fb87a800640 1 --2- 172.21.15.69:0/2993050398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc272f0 0x56311d06d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.249+0000 7fb87a800640 1 -- 172.21.15.69:0/2993050398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cbe41c0 msgr2=0x56311d06ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.249+0000 7fb87a800640 1 --2- 172.21.15.69:0/2993050398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cbe41c0 0x56311d06ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.249+0000 7fb87a800640 1 -- 172.21.15.69:0/2993050398 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56311d00e4a0 con 0x56311cc501b0 2024-05-14T15:36:35.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.249+0000 7fb879400640 1 --2- 172.21.15.69:0/2993050398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc272f0 0x56311d06d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:36:35.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.250+0000 7fb87a800640 1 --2- 172.21.15.69:0/2993050398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc501b0 0x56311d00ddb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb870004a80 tx=0x7fb870023a90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3862081f767f34bd server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:35.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.250+0000 7fb857400640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:36:35.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.250+0000 7fb857400640 1 -- 172.21.15.69:0/2993050398 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb870031060 con 0x56311cc501b0 2024-05-14T15:36:35.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.250+0000 7fb857400640 1 -- 172.21.15.69:0/2993050398 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9554+0+0 (secure 0 0 0) 0x7fb87002c410 con 0x56311cc501b0 2024-05-14T15:36:35.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.250+0000 7fb883837740 1 -- 172.21.15.69:0/2993050398 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb870017d10 con 0x56311cc501b0 2024-05-14T15:36:35.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.251+0000 7fb857400640 1 -- 172.21.15.69:0/2993050398 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fb870028070 con 0x56311cc501b0 2024-05-14T15:36:35.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.251+0000 7fb883837740 10 client.26749 fetch_fsmap learned FSMap version 66 2024-05-14T15:36:35.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.251+0000 7fb883837740 1 -- 172.21.15.69:0/2993050398 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x56311d075460 con 0x56311cc501b0 2024-05-14T15:36:35.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.252+0000 7fb857400640 1 -- 172.21.15.69:0/2993050398 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb870017d10 con 0x56311cc501b0 2024-05-14T15:36:35.255 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.254+0000 7fb857400640 1 -- 172.21.15.69:0/2993050398 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7fb870022070 con 0x56311cc501b0 2024-05-14T15:36:35.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.254+0000 7fb883837740 10 client.26749 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:36:35.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.254+0000 7fb883837740 10 client.26749 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:36:35.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.254+0000 7fb883837740 20 client.26749 populate_metadata read hostname 'smithi069' 2024-05-14T15:36:35.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.254+0000 7fb883837740 1 --2- 172.21.15.69:0/2993050398 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56311d0759d0 0x56311d077df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:35.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.255+0000 7fb883837740 4 client.26749 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:36:35.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.255+0000 7fb883837740 1 -- 172.21.15.69:0/2993050398 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56311cf5dfd0 con 0x56311d0759d0 2024-05-14T15:36:35.256 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.255+0000 7fb879e00640 1 --2- 172.21.15.69:0/2993050398 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56311d0759d0 0x56311d077df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:35.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.256+0000 7fb857400640 10 client.26749 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:36:35.257 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.256+0000 7fb879e00640 1 --2- 172.21.15.69:0/2993050398 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56311d0759d0 0x56311d077df0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf65f296fe9e362a server_cookie=7d10b49bb341d1a0 in_seq=0 out_seq=0 2024-05-14T15:36:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.294+0000 7fb857400640 1 -- 172.21.15.69:0/2993050398 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56311cf5dfd0 con 0x56311d0759d0 2024-05-14T15:36:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.294+0000 7fb857400640 10 client.26749 handle_command_reply: tid=0 2024-05-14T15:36:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.294+0000 7fb883837740 1 client.26749 shutdown 2024-05-14T15:36:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.295+0000 7fb883837740 1 -- 172.21.15.69:0/2993050398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc501b0 msgr2=0x56311d00ddb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:35.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.295+0000 7fb883837740 1 --2- 172.21.15.69:0/2993050398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc501b0 0x56311d00ddb0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb870004a80 tx=0x7fb870023a90 comp rx=0 tx=0).stop 2024-05-14T15:36:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.296+0000 7fb883837740 1 -- 172.21.15.69:0/2993050398 shutdown_connections 2024-05-14T15:36:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.296+0000 7fb883837740 1 --2- 172.21.15.69:0/2993050398 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56311cc501b0 0x56311d00ddb0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.296+0000 7fb883837740 1 --2- 172.21.15.69:0/2993050398 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56311cc272f0 0x56311d06d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.296+0000 7fb883837740 1 --2- 172.21.15.69:0/2993050398 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56311d0759d0 0x56311d077df0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.296+0000 7fb883837740 1 --2- 172.21.15.69:0/2993050398 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56311cbe41c0 0x56311d06ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.296+0000 7fb883837740 1 -- 172.21.15.69:0/2993050398 >> 172.21.15.69:0/2993050398 conn(0x56311cc44300 msgr2=0x56311cff10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:35.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.296+0000 7fb857400640 0 client.26749 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:36:35.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.296+0000 7fb883837740 1 -- 172.21.15.69:0/2993050398 shutdown_connections 2024-05-14T15:36:35.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.296+0000 7fb883837740 1 -- 172.21.15.69:0/2993050398 wait complete. 2024-05-14T15:36:35.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.297+0000 7fb883837740 20 client.26749 trim_cache size 0 max 16384 2024-05-14T15:36:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:36:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:36:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:36:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:36:35.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.298+0000 7fb87c800640 1 -- 172.21.15.69:0/2076687702 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb85c0b2a50 msgr2=0x7fb85c0b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.298+0000 7fb87c800640 1 --2- 172.21.15.69:0/2076687702 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb85c0b2a50 0x7fb85c0b4f60 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fb870009fd0 tx=0x7fb87000e040 comp rx=0 tx=0).stop 2024-05-14T15:36:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.298+0000 7fb87c800640 1 -- 172.21.15.69:0/2076687702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb87410ea90 msgr2=0x7fb87406dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.298+0000 7fb87c800640 1 --2- 172.21.15.69:0/2076687702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb87410ea90 0x7fb87406dad0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fb868005fd0 tx=0x7fb86800dde0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.298+0000 7fb87c800640 1 -- 172.21.15.69:0/2076687702 shutdown_connections 2024-05-14T15:36:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.298+0000 7fb87c800640 1 --2- 172.21.15.69:0/2076687702 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb85c0b2a50 0x7fb85c0b4f60 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.298+0000 7fb87c800640 1 --2- 172.21.15.69:0/2076687702 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb87410f550 0x7fb87406e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.298+0000 7fb87c800640 1 --2- 172.21.15.69:0/2076687702 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb87410ea90 0x7fb87406dad0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.298+0000 7fb87c800640 1 --2- 172.21.15.69:0/2076687702 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb87410a510 0x7fb874074990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.298+0000 7fb87c800640 1 -- 172.21.15.69:0/2076687702 >> 172.21.15.69:0/2076687702 conn(0x7fb8740771a0 msgr2=0x7fb87407a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.299+0000 7fb87c800640 1 -- 172.21.15.69:0/2076687702 shutdown_connections 2024-05-14T15:36:35.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:35.299+0000 7fb87c800640 1 -- 172.21.15.69:0/2076687702 wait complete. 2024-05-14T15:36:36.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:35 smithi092 ceph-mon[34729]: pgmap v469: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.9 MiB/s wr, 569 op/s 2024-05-14T15:36:36.226 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:35 smithi069 ceph-mon[31270]: pgmap v469: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.9 MiB/s wr, 569 op/s 2024-05-14T15:36:36.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:35 smithi203 ceph-mon[34567]: pgmap v469: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 5.9 MiB/s wr, 569 op/s 2024-05-14T15:36:36.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 650.0 s, 550.6 tps, lat 180.732 ms stddev 81.132 2024-05-14T15:36:38.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:37 smithi092 ceph-mon[34729]: pgmap v470: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 8.3 MiB/s wr, 812 op/s 2024-05-14T15:36:38.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:37 smithi069 ceph-mon[31270]: pgmap v470: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 8.3 MiB/s wr, 812 op/s 2024-05-14T15:36:38.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:37 smithi203 ceph-mon[34567]: pgmap v470: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 8.3 MiB/s wr, 812 op/s 2024-05-14T15:36:40.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:39 smithi092 ceph-mon[34729]: pgmap v471: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.6 MiB/s wr, 547 op/s 2024-05-14T15:36:40.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:39 smithi069 ceph-mon[31270]: pgmap v471: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.6 MiB/s wr, 547 op/s 2024-05-14T15:36:40.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:39 smithi203 ceph-mon[34567]: pgmap v471: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 5.6 MiB/s wr, 547 op/s 2024-05-14T15:36:41.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 655.0 s, 523.4 tps, lat 191.875 ms stddev 87.474 2024-05-14T15:36:42.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:41 smithi092 ceph-mon[34729]: pgmap v472: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 8.0 MiB/s wr, 783 op/s 2024-05-14T15:36:42.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:41 smithi069 ceph-mon[31270]: pgmap v472: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 8.0 MiB/s wr, 783 op/s 2024-05-14T15:36:42.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:41 smithi203 ceph-mon[34567]: pgmap v472: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 8.0 MiB/s wr, 783 op/s 2024-05-14T15:36:44.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:43 smithi092 ceph-mon[34729]: pgmap v473: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.3 MiB/s wr, 538 op/s 2024-05-14T15:36:44.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:43 smithi069 ceph-mon[31270]: pgmap v473: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.3 MiB/s wr, 538 op/s 2024-05-14T15:36:44.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:43 smithi203 ceph-mon[34567]: pgmap v473: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.3 MiB/s wr, 538 op/s 2024-05-14T15:36:46.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:45 smithi092 ceph-mon[34729]: pgmap v474: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.2 MiB/s wr, 533 op/s 2024-05-14T15:36:46.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:45 smithi069 ceph-mon[31270]: pgmap v474: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.2 MiB/s wr, 533 op/s 2024-05-14T15:36:46.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:45 smithi203 ceph-mon[34567]: pgmap v474: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.2 MiB/s wr, 533 op/s 2024-05-14T15:36:46.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 660.0 s, 486.8 tps, lat 204.593 ms stddev 162.519 2024-05-14T15:36:47.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:46 smithi203 ceph-mon[34567]: pgmap v475: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 7.7 MiB/s wr, 792 op/s 2024-05-14T15:36:47.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:46 smithi092 ceph-mon[34729]: pgmap v475: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 7.7 MiB/s wr, 792 op/s 2024-05-14T15:36:47.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:46 smithi069 ceph-mon[31270]: pgmap v475: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 7.7 MiB/s wr, 792 op/s 2024-05-14T15:36:48.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.666+0000 7f26b8200640 1 -- 172.21.15.69:0/4106695832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26a809cec0 msgr2=0x7f26a8096b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:48.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.666+0000 7f26b8200640 1 --2- 172.21.15.69:0/4106695832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26a809cec0 0x7f26a8096b10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f269c01a910 tx=0x7f269c03b420 comp rx=0 tx=0).stop 2024-05-14T15:36:48.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.667+0000 7f26b8200640 1 -- 172.21.15.69:0/4106695832 shutdown_connections 2024-05-14T15:36:48.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.667+0000 7f26b8200640 1 --2- 172.21.15.69:0/4106695832 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26a8097180 0x7f26a80a34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.667+0000 7f26b8200640 1 --2- 172.21.15.69:0/4106695832 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26a809cec0 0x7f26a8096b10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.667+0000 7f26b8200640 1 --2- 172.21.15.69:0/4106695832 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26a809ca20 0x7f26a80965d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.667+0000 7f26b8200640 1 -- 172.21.15.69:0/4106695832 >> 172.21.15.69:0/4106695832 conn(0x7f26a800d260 msgr2=0x7f26a800d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.667+0000 7f26b8200640 1 -- 172.21.15.69:0/4106695832 shutdown_connections 2024-05-14T15:36:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.667+0000 7f26b8200640 1 -- 172.21.15.69:0/4106695832 wait complete. 2024-05-14T15:36:48.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.668+0000 7f26b8200640 1 Processor -- start 2024-05-14T15:36:48.671 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.669+0000 7f26b8200640 1 -- start start 2024-05-14T15:36:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.669+0000 7f26b8200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26a8097180 0x7f26a812b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.669+0000 7f26b8200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26a809ca20 0x7f26a812b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.669+0000 7f26b8200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26a809cec0 0x7f26a812fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.669+0000 7f26b8200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f26a80a4920 con 0x7f26a8097180 2024-05-14T15:36:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.669+0000 7f26b8200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f26a80a47a0 con 0x7f26a809ca20 2024-05-14T15:36:48.672 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.669+0000 7f26b8200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f26a80a4aa0 con 0x7f26a809cec0 2024-05-14T15:36:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.670+0000 7f26b5800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26a8097180 0x7f26a812b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.670+0000 7f26b5800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26a8097180 0x7f26a812b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52100/0 (socket says 172.21.15.69:52100) 2024-05-14T15:36:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.670+0000 7f26b5800640 1 -- 172.21.15.69:0/676889524 learned_addr learned my addr 172.21.15.69:0/676889524 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.671+0000 7f26b4e00640 1 --2- 172.21.15.69:0/676889524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26a809ca20 0x7f26a812b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.671+0000 7f26b6200640 1 --2- 172.21.15.69:0/676889524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26a809cec0 0x7f26a812fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.672+0000 7f26b5800640 1 -- 172.21.15.69:0/676889524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26a809cec0 msgr2=0x7f26a812fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.672+0000 7f26b5800640 1 --2- 172.21.15.69:0/676889524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26a809cec0 0x7f26a812fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.672+0000 7f26b5800640 1 -- 172.21.15.69:0/676889524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26a809ca20 msgr2=0x7f26a812b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.672+0000 7f26b5800640 1 --2- 172.21.15.69:0/676889524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26a809ca20 0x7f26a812b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.675 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.672+0000 7f26b5800640 1 -- 172.21.15.69:0/676889524 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a8130180 con 0x7f26a8097180 2024-05-14T15:36:48.678 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.675+0000 7f26b5800640 1 --2- 172.21.15.69:0/676889524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26a8097180 0x7f26a812b320 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f26b0050b40 tx=0x7f26b0071b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.677+0000 7f26ae000640 1 -- 172.21.15.69:0/676889524 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b006f810 con 0x7f26a8097180 2024-05-14T15:36:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.677+0000 7f26b8200640 1 -- 172.21.15.69:0/676889524 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26a8130470 con 0x7f26a8097180 2024-05-14T15:36:48.679 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.677+0000 7f26b8200640 1 -- 172.21.15.69:0/676889524 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26a8130940 con 0x7f26a8097180 2024-05-14T15:36:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.679+0000 7f26ae000640 1 -- 172.21.15.69:0/676889524 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26b006fe40 con 0x7f26a8097180 2024-05-14T15:36:48.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.679+0000 7f26ae000640 1 -- 172.21.15.69:0/676889524 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b006f810 con 0x7f26a8097180 2024-05-14T15:36:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.688+0000 7f26bf190740 1 Processor -- start 2024-05-14T15:36:48.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.688+0000 7f26bf190740 1 -- start start 2024-05-14T15:36:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.692+0000 7f26bf190740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af4d1b0 0x56356b2ee470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.692+0000 7f26bf190740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af242f0 0x56356b2ee9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.692+0000 7f26bf190740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af2c4d0 0x56356b2eeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.692+0000 7f26bf190740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56356b253550 con 0x56356af4d1b0 2024-05-14T15:36:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.692+0000 7f26bf190740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56356b1f8bc0 con 0x56356af2c4d0 2024-05-14T15:36:48.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.692+0000 7f26bf190740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56356b24f510 con 0x56356af242f0 2024-05-14T15:36:48.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.693+0000 7f26b4e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af2c4d0 0x56356b2eeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.694+0000 7f26ae000640 1 -- 172.21.15.69:0/676889524 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f26b006f9b0 con 0x7f26a8097180 2024-05-14T15:36:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.693+0000 7f26b6200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af4d1b0 0x56356b2ee470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.694+0000 7f26b6200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af4d1b0 0x56356b2ee470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52106/0 (socket says 172.21.15.69:52106) 2024-05-14T15:36:48.697 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.694+0000 7f26b6200640 1 -- 172.21.15.69:0/2926145092 learned_addr learned my addr 172.21.15.69:0/2926145092 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.696+0000 7f26b6200640 1 -- 172.21.15.69:0/2926145092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af242f0 msgr2=0x56356b2ee9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:48.698 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.696+0000 7f26b5800640 1 --2- 172.21.15.69:0/2926145092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af242f0 0x56356b2ee9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.697+0000 7f26b6200640 1 --2- 172.21.15.69:0/2926145092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af242f0 0x56356b2ee9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.697+0000 7f26b6200640 1 -- 172.21.15.69:0/2926145092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af2c4d0 msgr2=0x56356b2eeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.697+0000 7f26b6200640 1 --2- 172.21.15.69:0/2926145092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af2c4d0 0x56356b2eeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.697+0000 7f26b6200640 1 -- 172.21.15.69:0/2926145092 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56356af65210 con 0x56356af4d1b0 2024-05-14T15:36:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.698+0000 7f26b5800640 1 --2- 172.21.15.69:0/2926145092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af242f0 0x56356b2ee9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:36:48.700 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.698+0000 7f26b4e00640 1 --2- 172.21.15.69:0/2926145092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af2c4d0 0x56356b2eeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:36:48.701 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.699+0000 7f26ae000640 1 --2- 172.21.15.69:0/676889524 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f26980b2bc0 0x7f26980b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.703 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.699+0000 7f26b6200640 1 --2- 172.21.15.69:0/2926145092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af4d1b0 0x56356b2ee470 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f26a400ab80 tx=0x7f26a400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fb3271556cab57a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.699+0000 7f26b5800640 1 --2- 172.21.15.69:0/676889524 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f26980b2bc0 0x7f26980b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.700+0000 7f26ae000640 1 -- 172.21.15.69:0/676889524 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9554+0+0 (secure 0 0 0) 0x7f26b01465e0 con 0x7f26a8097180 2024-05-14T15:36:48.704 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.702+0000 7f26b5800640 1 --2- 172.21.15.69:0/676889524 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f26980b2bc0 0x7f26980b50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f26b0143ae0 tx=0x7f26b0050de0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:48.705 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.703+0000 7f26a2a00640 1 -- 172.21.15.69:0/2926145092 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a401d070 con 0x56356af4d1b0 2024-05-14T15:36:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.703+0000 7f26a2a00640 1 -- 172.21.15.69:0/2926145092 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26a4018ad0 con 0x56356af4d1b0 2024-05-14T15:36:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.703+0000 7f26a2a00640 1 -- 172.21.15.69:0/2926145092 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a4010970 con 0x56356af4d1b0 2024-05-14T15:36:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.705+0000 7f26bf190740 1 -- 172.21.15.69:0/2926145092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af4d1b0 msgr2=0x56356b2ee470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:48.707 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.705+0000 7f26bf190740 1 --2- 172.21.15.69:0/2926145092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af4d1b0 0x56356b2ee470 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f26a400ab80 tx=0x7f26a400f790 comp rx=0 tx=0).stop 2024-05-14T15:36:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.705+0000 7f26bf190740 1 -- 172.21.15.69:0/2926145092 shutdown_connections 2024-05-14T15:36:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.705+0000 7f26bf190740 1 --2- 172.21.15.69:0/2926145092 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af2c4d0 0x56356b2eeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.705+0000 7f26bf190740 1 --2- 172.21.15.69:0/2926145092 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af242f0 0x56356b2ee9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.706+0000 7f26bf190740 1 --2- 172.21.15.69:0/2926145092 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af4d1b0 0x56356b2ee470 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.708 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.706+0000 7f26bf190740 1 -- 172.21.15.69:0/2926145092 >> 172.21.15.69:0/2926145092 conn(0x56356af41300 msgr2=0x56356b2eac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.707+0000 7f26bf190740 1 -- 172.21.15.69:0/2926145092 shutdown_connections 2024-05-14T15:36:48.709 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.707+0000 7f26bf190740 1 -- 172.21.15.69:0/2926145092 wait complete. 2024-05-14T15:36:48.710 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.708+0000 7f26bf190740 1 -- start start 2024-05-14T15:36:48.710 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.709+0000 7f26bf190740 1 Processor -- start 2024-05-14T15:36:48.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.711+0000 7f26bf190740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af242f0 0x56356b2f8940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.711+0000 7f26bf190740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af2c4d0 0x56356b2f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.711+0000 7f26bf190740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af4d1b0 0x56356b304a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.712+0000 7f26bf190740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56356b2fb5a0 con 0x56356af242f0 2024-05-14T15:36:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.712+0000 7f26bf190740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56356b20c660 con 0x56356af4d1b0 2024-05-14T15:36:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.712+0000 7f26b6200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af242f0 0x56356b2f8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.712+0000 7f26bf190740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56356b2fb720 con 0x56356af2c4d0 2024-05-14T15:36:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.712+0000 7f26bf190740 10 client.0 _ll_register_callbacks cb 0x56356b1d6400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:36:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.712+0000 7f26b6200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af242f0 0x56356b2f8940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52118/0 (socket says 172.21.15.69:52118) 2024-05-14T15:36:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.712+0000 7f26b6200640 1 -- 172.21.15.69:0/1017954330 learned_addr learned my addr 172.21.15.69:0/1017954330 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:48.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.712+0000 7f26b4e00640 1 --2- 172.21.15.69:0/1017954330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af2c4d0 0x56356b2f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.714+0000 7f26b4e00640 1 -- 172.21.15.69:0/1017954330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af4d1b0 msgr2=0x56356b304a50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:36:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.714+0000 7f26b4e00640 1 --2- 172.21.15.69:0/1017954330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af4d1b0 0x56356b304a50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.714+0000 7f26b4e00640 1 -- 172.21.15.69:0/1017954330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af242f0 msgr2=0x56356b2f8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.715+0000 7f26b4e00640 1 --2- 172.21.15.69:0/1017954330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af242f0 0x56356b2f8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.715+0000 7f26b4e00640 1 -- 172.21.15.69:0/1017954330 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56356b031620 con 0x56356af2c4d0 2024-05-14T15:36:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.716+0000 7f2697400640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:36:48.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.716+0000 7f26b4e00640 1 --2- 172.21.15.69:0/1017954330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af2c4d0 0x56356b2f8e80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f269c03b940 tx=0x7f269c004a30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bdc1b56ef9d90eeb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:48.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.718+0000 7f2697400640 1 -- 172.21.15.69:0/1017954330 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c046040 con 0x56356af2c4d0 2024-05-14T15:36:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.718+0000 7f2697400640 1 -- 172.21.15.69:0/1017954330 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9554+0+0 (secure 0 0 0) 0x7f269c004f80 con 0x56356af2c4d0 2024-05-14T15:36:48.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.718+0000 7f26bf190740 1 -- 172.21.15.69:0/1017954330 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26a4018ad0 con 0x56356af2c4d0 2024-05-14T15:36:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.719+0000 7f2697400640 1 -- 172.21.15.69:0/1017954330 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f269c005180 con 0x56356af2c4d0 2024-05-14T15:36:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.719+0000 7f26bf190740 10 client.26755 fetch_fsmap learned FSMap version 66 2024-05-14T15:36:48.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.719+0000 7f26bf190740 1 -- 172.21.15.69:0/1017954330 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x56356b307740 con 0x56356af2c4d0 2024-05-14T15:36:48.722 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.720+0000 7f2697400640 1 -- 172.21.15.69:0/1017954330 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26a4018ad0 con 0x56356af2c4d0 2024-05-14T15:36:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.721+0000 7f2697400640 1 -- 172.21.15.69:0/1017954330 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7f269c040d40 con 0x56356af2c4d0 2024-05-14T15:36:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.724+0000 7f26bf190740 10 client.26755 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:36:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.724+0000 7f26bf190740 10 client.26755 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:36:48.726 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.724+0000 7f26bf190740 20 client.26755 populate_metadata read hostname 'smithi069' 2024-05-14T15:36:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.724+0000 7f26bf190740 1 --2- 172.21.15.69:0/1017954330 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56356af0bd80 0x56356b30ac60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.724+0000 7f26bf190740 4 client.26755 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:36:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.724+0000 7f26bf190740 1 -- 172.21.15.69:0/1017954330 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56356b261160 con 0x56356af0bd80 2024-05-14T15:36:48.727 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.725+0000 7f26b6200640 1 --2- 172.21.15.69:0/1017954330 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56356af0bd80 0x56356b30ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.727+0000 7f2697400640 10 client.26755 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:36:48.729 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.727+0000 7f26b6200640 1 --2- 172.21.15.69:0/1017954330 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56356af0bd80 0x56356b30ac60 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64c1ddded494ad69 server_cookie=a290f99eada6f742 in_seq=0 out_seq=0 2024-05-14T15:36:48.732 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.729+0000 7f2697400640 1 -- 172.21.15.69:0/1017954330 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56356b261160 con 0x56356af0bd80 2024-05-14T15:36:48.732 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.729+0000 7f2697400640 10 client.26755 handle_command_reply: tid=0 2024-05-14T15:36:48.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.729+0000 7f26bf190740 1 client.26755 shutdown 2024-05-14T15:36:48.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.730+0000 7f26bf190740 1 -- 172.21.15.69:0/1017954330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af2c4d0 msgr2=0x56356b2f8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:48.733 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.730+0000 7f26bf190740 1 --2- 172.21.15.69:0/1017954330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af2c4d0 0x56356b2f8e80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f269c03b940 tx=0x7f269c004a30 comp rx=0 tx=0).stop 2024-05-14T15:36:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.731+0000 7f26bf190740 1 -- 172.21.15.69:0/1017954330 shutdown_connections 2024-05-14T15:36:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.731+0000 7f26bf190740 1 --2- 172.21.15.69:0/1017954330 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af4d1b0 0x56356b304a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.731+0000 7f26bf190740 1 --2- 172.21.15.69:0/1017954330 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af2c4d0 0x56356b2f8e80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.731+0000 7f26bf190740 1 --2- 172.21.15.69:0/1017954330 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56356af0bd80 0x56356b30ac60 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.731+0000 7f26bf190740 1 --2- 172.21.15.69:0/1017954330 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af242f0 0x56356b2f8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.731+0000 7f26bf190740 1 -- 172.21.15.69:0/1017954330 >> 172.21.15.69:0/1017954330 conn(0x56356af41300 msgr2=0x56356b2ee2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:48.734 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.731+0000 7f2697400640 0 client.26755 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:36:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.733+0000 7f26bf190740 1 -- 172.21.15.69:0/1017954330 shutdown_connections 2024-05-14T15:36:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.733+0000 7f26bf190740 1 -- 172.21.15.69:0/1017954330 wait complete. 2024-05-14T15:36:48.735 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.733+0000 7f26bf190740 20 client.26755 trim_cache size 0 max 16384 2024-05-14T15:36:48.778 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.775+0000 7f26bf190740 1 Processor -- start 2024-05-14T15:36:48.778 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.776+0000 7f26bf190740 1 -- start start 2024-05-14T15:36:48.779 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.777+0000 7f26bf190740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af242f0 0x56356b2ef210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.778+0000 7f26bf190740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af2c4d0 0x56356b2e9960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.778+0000 7f26bf190740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af4d1b0 0x56356b2e9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.778+0000 7f26bf190740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f2690010080 con 0x56356af2c4d0 2024-05-14T15:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.778+0000 7f26bf190740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2690011cb0 con 0x56356af4d1b0 2024-05-14T15:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.778+0000 7f26bf190740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f2690010750 con 0x56356af242f0 2024-05-14T15:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.778+0000 7f26b6200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af242f0 0x56356b2ef210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.778+0000 7f26b6200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af242f0 0x56356b2ef210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:42552/0 (socket says 172.21.15.69:42552) 2024-05-14T15:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.778+0000 7f26b6200640 1 -- 172.21.15.69:0/2647124095 learned_addr learned my addr 172.21.15.69:0/2647124095 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:48.781 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.779+0000 7f26b6200640 1 --2- 172.21.15.69:0/2647124095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af4d1b0 0x56356b2e9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.780+0000 7f26b4e00640 1 --2- 172.21.15.69:0/2647124095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af2c4d0 0x56356b2e9960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.782 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.780+0000 7f26b6200640 1 -- 172.21.15.69:0/2647124095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af4d1b0 msgr2=0x56356b2e9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.780+0000 7f26b6200640 1 --2- 172.21.15.69:0/2647124095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af4d1b0 0x56356b2e9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.783 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.781+0000 7f26b6200640 1 -- 172.21.15.69:0/2647124095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af2c4d0 msgr2=0x56356b2e9960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.781+0000 7f26b6200640 1 --2- 172.21.15.69:0/2647124095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af2c4d0 0x56356b2e9960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.781+0000 7f26b6200640 1 -- 172.21.15.69:0/2647124095 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56356b2f6c80 con 0x56356af242f0 2024-05-14T15:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.782+0000 7f26b4e00640 1 --2- 172.21.15.69:0/2647124095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af2c4d0 0x56356b2e9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:36:48.784 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.782+0000 7f26b6200640 1 --2- 172.21.15.69:0/2647124095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af242f0 0x56356b2ef210 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f26a400ab80 tx=0x7f26a4005f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3bcbf980a9df616 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.784+0000 7f26a2000640 1 -- 172.21.15.69:0/2647124095 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a401d050 con 0x56356af242f0 2024-05-14T15:36:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.784+0000 7f26a2000640 1 -- 172.21.15.69:0/2647124095 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26a401e040 con 0x56356af242f0 2024-05-14T15:36:48.786 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.784+0000 7f26a2000640 1 -- 172.21.15.69:0/2647124095 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a4004680 con 0x56356af242f0 2024-05-14T15:36:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.788+0000 7f26bf190740 1 -- 172.21.15.69:0/2647124095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af242f0 msgr2=0x56356b2ef210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:48.791 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.788+0000 7f26bf190740 1 --2- 172.21.15.69:0/2647124095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af242f0 0x56356b2ef210 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f26a400ab80 tx=0x7f26a4005f60 comp rx=0 tx=0).stop 2024-05-14T15:36:48.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.790+0000 7f26bf190740 1 -- 172.21.15.69:0/2647124095 shutdown_connections 2024-05-14T15:36:48.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.790+0000 7f26bf190740 1 --2- 172.21.15.69:0/2647124095 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af4d1b0 0x56356b2e9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.790+0000 7f26bf190740 1 --2- 172.21.15.69:0/2647124095 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af2c4d0 0x56356b2e9960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.790+0000 7f26bf190740 1 --2- 172.21.15.69:0/2647124095 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af242f0 0x56356b2ef210 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.790+0000 7f26bf190740 1 -- 172.21.15.69:0/2647124095 >> 172.21.15.69:0/2647124095 conn(0x56356af41300 msgr2=0x56356b2e9250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:48.792 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.790+0000 7f26bf190740 1 -- 172.21.15.69:0/2647124095 shutdown_connections 2024-05-14T15:36:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.791+0000 7f26bf190740 1 -- 172.21.15.69:0/2647124095 wait complete. 2024-05-14T15:36:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.792+0000 7f26bf190740 1 -- start start 2024-05-14T15:36:48.794 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.792+0000 7f26bf190740 1 Processor -- start 2024-05-14T15:36:48.795 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.793+0000 7f26bf190740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af242f0 0x56356b36b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.793+0000 7f26bf190740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af2c4d0 0x56356b36b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.793+0000 7f26bf190740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af4d1b0 0x56356b2fbf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.793+0000 7f26bf190740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f26900115e0 con 0x56356af242f0 2024-05-14T15:36:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.793+0000 7f26bf190740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f2690010e50 con 0x56356af4d1b0 2024-05-14T15:36:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.793+0000 7f26bf190740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f269000e080 con 0x56356af2c4d0 2024-05-14T15:36:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.793+0000 7f26bf190740 10 client.0 _ll_register_callbacks cb 0x7f269c01a650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:36:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.794+0000 7f26b6200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af242f0 0x56356b36b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.794+0000 7f26b6200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af242f0 0x56356b36b3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:52132/0 (socket says 172.21.15.69:52132) 2024-05-14T15:36:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.794+0000 7f26b6200640 1 -- 172.21.15.69:0/341619149 learned_addr learned my addr 172.21.15.69:0/341619149 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:36:48.796 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.794+0000 7f26b6200640 1 --2- 172.21.15.69:0/341619149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af4d1b0 0x56356b2fbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.794+0000 7f26b4e00640 1 --2- 172.21.15.69:0/341619149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af2c4d0 0x56356b36b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.797 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.795+0000 7f26b6200640 1 -- 172.21.15.69:0/341619149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af2c4d0 msgr2=0x56356b36b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.795+0000 7f26b6200640 1 --2- 172.21.15.69:0/341619149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af2c4d0 0x56356b36b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.795+0000 7f26b6200640 1 -- 172.21.15.69:0/341619149 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af242f0 msgr2=0x56356b36b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:36:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.795+0000 7f26b6200640 1 --2- 172.21.15.69:0/341619149 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af242f0 0x56356b36b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.795+0000 7f26b6200640 1 -- 172.21.15.69:0/341619149 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56356b2fc560 con 0x56356af4d1b0 2024-05-14T15:36:48.798 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.796+0000 7f26b4e00640 1 --2- 172.21.15.69:0/341619149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af2c4d0 0x56356b36b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:36:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.796+0000 7f26b6200640 1 --2- 172.21.15.69:0/341619149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af4d1b0 0x56356b2fbf70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f26a400ab50 tx=0x7f26a400f790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=845991dd178a942f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:36:48.799 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.797+0000 7f2697400640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:36:48.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.797+0000 7f2697400640 1 -- 172.21.15.69:0/341619149 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a401d070 con 0x56356af4d1b0 2024-05-14T15:36:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.799+0000 7f2697400640 1 -- 172.21.15.69:0/341619149 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9554+0+0 (secure 0 0 0) 0x7f26a4010600 con 0x56356af4d1b0 2024-05-14T15:36:48.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.799+0000 7f26bf190740 1 -- 172.21.15.69:0/341619149 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26a401e040 con 0x56356af4d1b0 2024-05-14T15:36:48.802 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.800+0000 7f2697400640 1 -- 172.21.15.69:0/341619149 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7f26a4010800 con 0x56356af4d1b0 2024-05-14T15:36:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.800+0000 7f26bf190740 10 client.36788 fetch_fsmap learned FSMap version 66 2024-05-14T15:36:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.800+0000 7f26bf190740 1 -- 172.21.15.69:0/341619149 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x56356b372980 con 0x56356af4d1b0 2024-05-14T15:36:48.803 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.801+0000 7f2697400640 1 -- 172.21.15.69:0/341619149 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f26a401e040 con 0x56356af4d1b0 2024-05-14T15:36:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.802+0000 7f2697400640 1 -- 172.21.15.69:0/341619149 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7f26a4023040 con 0x56356af4d1b0 2024-05-14T15:36:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.802+0000 7f26bf190740 10 client.36788 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:36:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.802+0000 7f26bf190740 10 client.36788 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:36:48.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.802+0000 7f26bf190740 20 client.36788 populate_metadata read hostname 'smithi069' 2024-05-14T15:36:48.806 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.804+0000 7f26bf190740 1 --2- 172.21.15.69:0/341619149 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56356aee11c0 0x56356b374c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:36:48.806 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.804+0000 7f26bf190740 4 client.36788 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:36:48.806 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.804+0000 7f26bf190740 1 -- 172.21.15.69:0/341619149 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56356b25afd0 con 0x56356aee11c0 2024-05-14T15:36:48.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.805+0000 7f26b4e00640 1 --2- 172.21.15.69:0/341619149 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56356aee11c0 0x56356b374c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:36:48.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.807+0000 7f26b4e00640 1 --2- 172.21.15.69:0/341619149 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56356aee11c0 0x56356b374c70 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4843c4609115761e server_cookie=529c4ac1db703d6a in_seq=0 out_seq=0 2024-05-14T15:36:48.809 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.807+0000 7f2697400640 10 client.36788 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:36:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.847+0000 7f2697400640 1 -- 172.21.15.69:0/341619149 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56356b25afd0 con 0x56356aee11c0 2024-05-14T15:36:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.847+0000 7f2697400640 10 client.36788 handle_command_reply: tid=0 2024-05-14T15:36:48.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.847+0000 7f26bf190740 1 client.36788 shutdown 2024-05-14T15:36:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.848+0000 7f26bf190740 1 -- 172.21.15.69:0/341619149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af4d1b0 msgr2=0x56356b2fbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.848+0000 7f26bf190740 1 --2- 172.21.15.69:0/341619149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af4d1b0 0x56356b2fbf70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f26a400ab50 tx=0x7f26a400f790 comp rx=0 tx=0).stop 2024-05-14T15:36:48.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.848+0000 7f26bf190740 1 -- 172.21.15.69:0/341619149 shutdown_connections 2024-05-14T15:36:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.848+0000 7f26bf190740 1 --2- 172.21.15.69:0/341619149 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56356af4d1b0 0x56356b2fbf70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.848+0000 7f26bf190740 1 --2- 172.21.15.69:0/341619149 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56356af2c4d0 0x56356b36b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.848+0000 7f26bf190740 1 --2- 172.21.15.69:0/341619149 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56356aee11c0 0x56356b374c70 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.848+0000 7f26bf190740 1 --2- 172.21.15.69:0/341619149 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56356af242f0 0x56356b36b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.848+0000 7f26bf190740 1 -- 172.21.15.69:0/341619149 >> 172.21.15.69:0/341619149 conn(0x56356af41300 msgr2=0x56356b2e9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.848+0000 7f2697400640 0 client.36788 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:36:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.849+0000 7f26bf190740 1 -- 172.21.15.69:0/341619149 shutdown_connections 2024-05-14T15:36:48.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.849+0000 7f26bf190740 1 -- 172.21.15.69:0/341619149 wait complete. 2024-05-14T15:36:48.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:36:48.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:36:48.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:36:48.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:36:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.850+0000 7f26bf190740 20 client.36788 trim_cache size 0 max 16384 2024-05-14T15:36:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.851+0000 7f26b8200640 1 -- 172.21.15.69:0/676889524 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f26980b2bc0 msgr2=0x7f26980b50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.851+0000 7f26b8200640 1 --2- 172.21.15.69:0/676889524 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f26980b2bc0 0x7f26980b50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f26b0143ae0 tx=0x7f26b0050de0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.851+0000 7f26b8200640 1 -- 172.21.15.69:0/676889524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26a8097180 msgr2=0x7f26a812b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:36:48.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.851+0000 7f26b8200640 1 --2- 172.21.15.69:0/676889524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26a8097180 0x7f26a812b320 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f26b0050b40 tx=0x7f26b0071b70 comp rx=0 tx=0).stop 2024-05-14T15:36:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.851+0000 7f26b8200640 1 -- 172.21.15.69:0/676889524 shutdown_connections 2024-05-14T15:36:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.851+0000 7f26b8200640 1 --2- 172.21.15.69:0/676889524 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f26980b2bc0 0x7f26980b50d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.852+0000 7f26b8200640 1 --2- 172.21.15.69:0/676889524 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f26a809cec0 0x7f26a812fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.852+0000 7f26b8200640 1 --2- 172.21.15.69:0/676889524 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f26a809ca20 0x7f26a812b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.852+0000 7f26b8200640 1 --2- 172.21.15.69:0/676889524 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f26a8097180 0x7f26a812b320 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:36:48.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.852+0000 7f26b8200640 1 -- 172.21.15.69:0/676889524 >> 172.21.15.69:0/676889524 conn(0x7f26a800d260 msgr2=0x7f26a8098100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:36:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.853+0000 7f26b8200640 1 -- 172.21.15.69:0/676889524 shutdown_connections 2024-05-14T15:36:48.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:36:48.853+0000 7f26b8200640 1 -- 172.21.15.69:0/676889524 wait complete. 2024-05-14T15:36:49.695 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:49 smithi092 ceph-mon[34729]: pgmap v476: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.2 MiB/s wr, 538 op/s 2024-05-14T15:36:49.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:49 smithi069 ceph-mon[31270]: pgmap v476: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.2 MiB/s wr, 538 op/s 2024-05-14T15:36:49.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:49 smithi203 ceph-mon[34567]: pgmap v476: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 5.2 MiB/s wr, 538 op/s 2024-05-14T15:36:51.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 665.0 s, 330.4 tps, lat 291.735 ms stddev 246.807 2024-05-14T15:36:51.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:51 smithi092 ceph-mon[34729]: pgmap v477: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.5 MiB/s wr, 782 op/s 2024-05-14T15:36:51.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:51 smithi069 ceph-mon[31270]: pgmap v477: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.5 MiB/s wr, 782 op/s 2024-05-14T15:36:51.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:51 smithi203 ceph-mon[34567]: pgmap v477: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.5 MiB/s wr, 782 op/s 2024-05-14T15:36:53.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:53 smithi092 ceph-mon[34729]: pgmap v478: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.6 MiB/s wr, 572 op/s 2024-05-14T15:36:53.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:53 smithi069 ceph-mon[31270]: pgmap v478: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.6 MiB/s wr, 572 op/s 2024-05-14T15:36:53.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:53 smithi203 ceph-mon[34567]: pgmap v478: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.6 MiB/s wr, 572 op/s 2024-05-14T15:36:55.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:55 smithi092 ceph-mon[34729]: pgmap v479: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.5 MiB/s wr, 560 op/s 2024-05-14T15:36:55.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:55 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:36:55.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:55 smithi069 ceph-mon[31270]: pgmap v479: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.5 MiB/s wr, 560 op/s 2024-05-14T15:36:55.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:55 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:36:55.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:55 smithi203 ceph-mon[34567]: pgmap v479: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 5.5 MiB/s wr, 560 op/s 2024-05-14T15:36:55.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:55 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:36:56.371 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 670.0 s, 525.4 tps, lat 196.434 ms stddev 165.815 2024-05-14T15:36:57.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:57 smithi203 ceph-mon[34567]: pgmap v480: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.1 MiB/s wr, 795 op/s 2024-05-14T15:36:57.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:57 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:36:57.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:57 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:36:57.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:57 smithi092 ceph-mon[34729]: pgmap v480: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.1 MiB/s wr, 795 op/s 2024-05-14T15:36:57.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:57 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:36:57.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:57 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:36:57.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:57 smithi069 ceph-mon[31270]: pgmap v480: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 8.1 MiB/s wr, 795 op/s 2024-05-14T15:36:57.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:57 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:36:57.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:57 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:36:59.623 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:59 smithi203 ceph-mon[34567]: pgmap v481: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.5 MiB/s wr, 524 op/s 2024-05-14T15:36:59.624 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:59 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:36:59.624 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:59 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:36:59.624 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:36:59 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:36:59.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:59 smithi092 ceph-mon[34729]: pgmap v481: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.5 MiB/s wr, 524 op/s 2024-05-14T15:36:59.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:59 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:36:59.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:59 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:36:59.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:36:59 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:36:59.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:59 smithi069 ceph-mon[31270]: pgmap v481: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 5.5 MiB/s wr, 524 op/s 2024-05-14T15:36:59.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:59 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:36:59.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:59 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:36:59.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:36:59 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:37:01.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 675.0 s, 440.6 tps, lat 226.270 ms stddev 93.838 2024-05-14T15:37:01.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:01 smithi092 ceph-mon[34729]: pgmap v482: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 7.5 MiB/s wr, 741 op/s 2024-05-14T15:37:01.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:01 smithi069 ceph-mon[31270]: pgmap v482: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 7.5 MiB/s wr, 741 op/s 2024-05-14T15:37:02.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:01 smithi203 ceph-mon[34567]: pgmap v482: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 7.5 MiB/s wr, 741 op/s 2024-05-14T15:37:02.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.167+0000 7fb413c00640 1 -- 172.21.15.69:0/1429001932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb40c106600 msgr2=0x7fb40c1129d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:02.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.167+0000 7fb413c00640 1 --2- 172.21.15.69:0/1429001932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb40c106600 0x7fb40c1129d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fb404009ca0 tx=0x7fb40402a8c0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.168 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.167+0000 7fb413c00640 1 -- 172.21.15.69:0/1429001932 shutdown_connections 2024-05-14T15:37:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.167+0000 7fb413c00640 1 --2- 172.21.15.69:0/1429001932 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb40c106600 0x7fb40c1129d0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.167+0000 7fb413c00640 1 --2- 172.21.15.69:0/1429001932 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb40c10c350 0x7fb40c105f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.167+0000 7fb413c00640 1 --2- 172.21.15.69:0/1429001932 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb40c10beb0 0x7fb40c105a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.167+0000 7fb413c00640 1 -- 172.21.15.69:0/1429001932 >> 172.21.15.69:0/1429001932 conn(0x7fb40c077200 msgr2=0x7fb40c077640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.167+0000 7fb413c00640 1 -- 172.21.15.69:0/1429001932 shutdown_connections 2024-05-14T15:37:02.169 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.167+0000 7fb413c00640 1 -- 172.21.15.69:0/1429001932 wait complete. 2024-05-14T15:37:02.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.168+0000 7fb413c00640 1 Processor -- start 2024-05-14T15:37:02.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.168+0000 7fb413c00640 1 -- start start 2024-05-14T15:37:02.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.169+0000 7fb413c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb40c106600 0x7fb40c1a2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.169+0000 7fb413c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb40c10beb0 0x7fb40c1a2b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.169+0000 7fb413c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb40c10c350 0x7fb40c19c860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.171 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.169+0000 7fb413c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c116040 con 0x7fb40c106600 2024-05-14T15:37:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.169+0000 7fb413c00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c115ec0 con 0x7fb40c10c350 2024-05-14T15:37:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.169+0000 7fb413c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c1161c0 con 0x7fb40c10beb0 2024-05-14T15:37:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.169+0000 7fb411200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb40c106600 0x7fb40c1a2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.169+0000 7fb411200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb40c106600 0x7fb40c1a2650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59688/0 (socket says 172.21.15.69:59688) 2024-05-14T15:37:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.169+0000 7fb411200640 1 -- 172.21.15.69:0/1520102501 learned_addr learned my addr 172.21.15.69:0/1520102501 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.169+0000 7fb411c00640 1 --2- 172.21.15.69:0/1520102501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb40c10c350 0x7fb40c19c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.169+0000 7fb411200640 1 -- 172.21.15.69:0/1520102501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb40c10beb0 msgr2=0x7fb40c1a2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.169+0000 7fb411200640 1 --2- 172.21.15.69:0/1520102501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb40c10beb0 0x7fb40c1a2b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.169+0000 7fb411200640 1 -- 172.21.15.69:0/1520102501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb40c10c350 msgr2=0x7fb40c19c860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.170+0000 7fb411200640 1 --2- 172.21.15.69:0/1520102501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb40c10c350 0x7fb40c19c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.170+0000 7fb411200640 1 -- 172.21.15.69:0/1520102501 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40c19cf00 con 0x7fb40c106600 2024-05-14T15:37:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.170+0000 7fb411200640 1 --2- 172.21.15.69:0/1520102501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb40c106600 0x7fb40c1a2650 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb40000b450 tx=0x7fb40000b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:02.172 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.170+0000 7fb409600640 1 -- 172.21.15.69:0/1520102501 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb400015020 con 0x7fb40c106600 2024-05-14T15:37:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.170+0000 7fb409600640 1 -- 172.21.15.69:0/1520102501 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb400011d20 con 0x7fb40c106600 2024-05-14T15:37:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.170+0000 7fb413c00640 1 -- 172.21.15.69:0/1520102501 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40c19d1f0 con 0x7fb40c106600 2024-05-14T15:37:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.170+0000 7fb409600640 1 -- 172.21.15.69:0/1520102501 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb400010e10 con 0x7fb40c106600 2024-05-14T15:37:02.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.170+0000 7fb413c00640 1 -- 172.21.15.69:0/1520102501 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb40c1a94d0 con 0x7fb40c106600 2024-05-14T15:37:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.173+0000 7fb41ac16740 1 Processor -- start 2024-05-14T15:37:02.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.174+0000 7fb41ac16740 1 -- start start 2024-05-14T15:37:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.174+0000 7fb41ac16740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e64464280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.174+0000 7fb41ac16740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e6409a2f0 0x557e644647c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.174+0000 7fb41ac16740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e64464d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.174+0000 7fb41ac16740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x557e643c9550 con 0x557e640a24d0 2024-05-14T15:37:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.174+0000 7fb41ac16740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557e6436ebc0 con 0x557e640c31b0 2024-05-14T15:37:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.174+0000 7fb41ac16740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557e643c5510 con 0x557e6409a2f0 2024-05-14T15:37:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.174+0000 7fb40be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e64464d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.174+0000 7fb40be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e64464d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59690/0 (socket says 172.21.15.69:59690) 2024-05-14T15:37:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.174+0000 7fb40be00640 1 -- 172.21.15.69:0/3130393440 learned_addr learned my addr 172.21.15.69:0/3130393440 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.174+0000 7fb411c00640 1 --2- 172.21.15.69:0/3130393440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e64464280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.175+0000 7fb409600640 1 -- 172.21.15.69:0/1520102501 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fb400018020 con 0x7fb40c106600 2024-05-14T15:37:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.175+0000 7fb40be00640 1 -- 172.21.15.69:0/3130393440 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e6409a2f0 msgr2=0x557e644647c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:37:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.175+0000 7fb40be00640 1 --2- 172.21.15.69:0/3130393440 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e6409a2f0 0x557e644647c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.175+0000 7fb40be00640 1 -- 172.21.15.69:0/3130393440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 msgr2=0x557e64464280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.175+0000 7fb40be00640 1 --2- 172.21.15.69:0/3130393440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e64464280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.175+0000 7fb40be00640 1 -- 172.21.15.69:0/3130393440 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e640db210 con 0x557e640a24d0 2024-05-14T15:37:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.175+0000 7fb40be00640 1 --2- 172.21.15.69:0/3130393440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e64464d00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00a950 tx=0x7fb3fc00ae10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9106205e0e93959 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:02.177 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.175+0000 7fb3fa000640 1 -- 172.21.15.69:0/3130393440 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc00cd80 con 0x557e640a24d0 2024-05-14T15:37:02.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.175+0000 7fb3fa000640 1 -- 172.21.15.69:0/3130393440 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb3fc0054b0 con 0x557e640a24d0 2024-05-14T15:37:02.178 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.175+0000 7fb3fa000640 1 -- 172.21.15.69:0/3130393440 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc00f450 con 0x557e640a24d0 2024-05-14T15:37:02.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.176+0000 7fb41ac16740 1 -- 172.21.15.69:0/3130393440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 msgr2=0x557e64464d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:02.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.176+0000 7fb41ac16740 1 --2- 172.21.15.69:0/3130393440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e64464d00 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00a950 tx=0x7fb3fc00ae10 comp rx=0 tx=0).stop 2024-05-14T15:37:02.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.176+0000 7fb41ac16740 1 -- 172.21.15.69:0/3130393440 shutdown_connections 2024-05-14T15:37:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.176+0000 7fb41ac16740 1 --2- 172.21.15.69:0/3130393440 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e64464d00 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.176+0000 7fb41ac16740 1 --2- 172.21.15.69:0/3130393440 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e6409a2f0 0x557e644647c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.176+0000 7fb41ac16740 1 --2- 172.21.15.69:0/3130393440 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e64464280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.176+0000 7fb41ac16740 1 -- 172.21.15.69:0/3130393440 >> 172.21.15.69:0/3130393440 conn(0x557e640b7300 msgr2=0x557e64460a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.176+0000 7fb409600640 1 --2- 172.21.15.69:0/1520102501 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb3f40b2950 0x7fb3f40b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.176+0000 7fb41ac16740 1 -- 172.21.15.69:0/3130393440 shutdown_connections 2024-05-14T15:37:02.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.177+0000 7fb41ac16740 1 -- 172.21.15.69:0/3130393440 wait complete. 2024-05-14T15:37:02.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.177+0000 7fb409600640 1 -- 172.21.15.69:0/1520102501 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(110..110 src has 1..110) ==== 9554+0+0 (secure 0 0 0) 0x7fb4000e24f0 con 0x7fb40c106600 2024-05-14T15:37:02.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.177+0000 7fb411c00640 1 --2- 172.21.15.69:0/1520102501 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb3f40b2950 0x7fb3f40b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:02.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.177+0000 7fb41ac16740 1 -- start start 2024-05-14T15:37:02.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.178+0000 7fb41ac16740 1 Processor -- start 2024-05-14T15:37:02.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.178+0000 7fb411c00640 1 --2- 172.21.15.69:0/1520102501 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb3f40b2950 0x7fb3f40b4e60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb404006010 tx=0x7fb4040094a0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:02.184 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.178+0000 7fb41ac16740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e6409a2f0 0x557e6446e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.178+0000 7fb41ac16740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e6446ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.178+0000 7fb41ac16740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e6447a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.178+0000 7fb41ac16740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x557e644713b0 con 0x557e640a24d0 2024-05-14T15:37:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.178+0000 7fb41ac16740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557e64382660 con 0x557e640c31b0 2024-05-14T15:37:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.178+0000 7fb41ac16740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557e64471530 con 0x557e6409a2f0 2024-05-14T15:37:02.185 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.178+0000 7fb41ac16740 10 client.0 _ll_register_callbacks cb 0x557e6434c400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:37:02.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.178+0000 7fb40be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e6446ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:02.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.178+0000 7fb40be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e6446ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59700/0 (socket says 172.21.15.69:59700) 2024-05-14T15:37:02.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.178+0000 7fb40be00640 1 -- 172.21.15.69:0/3399972960 learned_addr learned my addr 172.21.15.69:0/3399972960 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:02.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.179+0000 7fb411200640 1 --2- 172.21.15.69:0/3399972960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e6409a2f0 0x557e6446e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:02.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.179+0000 7fb411c00640 1 --2- 172.21.15.69:0/3399972960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e6447a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:02.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.179+0000 7fb40be00640 1 -- 172.21.15.69:0/3399972960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e6409a2f0 msgr2=0x557e6446e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:02.186 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.179+0000 7fb40be00640 1 --2- 172.21.15.69:0/3399972960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e6409a2f0 0x557e6446e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.179+0000 7fb40be00640 1 -- 172.21.15.69:0/3399972960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 msgr2=0x557e6447a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.179+0000 7fb40be00640 1 --2- 172.21.15.69:0/3399972960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e6447a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.179+0000 7fb40be00640 1 -- 172.21.15.69:0/3399972960 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e641a7620 con 0x557e640a24d0 2024-05-14T15:37:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.179+0000 7fb411c00640 1 --2- 172.21.15.69:0/3399972960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e6447a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:37:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.179+0000 7fb40be00640 1 --2- 172.21.15.69:0/3399972960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e6446ec10 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc004be0 tx=0x7fb3fc0056d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c200bf84764604e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.179+0000 7fb3eea00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:37:02.187 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.179+0000 7fb3eea00640 1 -- 172.21.15.69:0/3399972960 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc028060 con 0x557e640a24d0 2024-05-14T15:37:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.180+0000 7fb41ac16740 1 -- 172.21.15.69:0/3399972960 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3fc0054b0 con 0x557e640a24d0 2024-05-14T15:37:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.180+0000 7fb3eea00640 1 -- 172.21.15.69:0/3399972960 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9554+0+0 (secure 0 0 0) 0x7fb3fc00cb80 con 0x557e640a24d0 2024-05-14T15:37:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.180+0000 7fb3eea00640 1 -- 172.21.15.69:0/3399972960 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fb3fc02f050 con 0x557e640a24d0 2024-05-14T15:37:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.180+0000 7fb41ac16740 10 client.17292 fetch_fsmap learned FSMap version 66 2024-05-14T15:37:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.180+0000 7fb41ac16740 1 -- 172.21.15.69:0/3399972960 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x557e6447d550 con 0x557e640a24d0 2024-05-14T15:37:02.188 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.180+0000 7fb3eea00640 1 -- 172.21.15.69:0/3399972960 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb3fc0054b0 con 0x557e640a24d0 2024-05-14T15:37:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.180+0000 7fb3eea00640 1 -- 172.21.15.69:0/3399972960 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7fb3fc00fc50 con 0x557e640a24d0 2024-05-14T15:37:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.180+0000 7fb41ac16740 10 client.17292 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:37:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.180+0000 7fb41ac16740 10 client.17292 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:37:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.180+0000 7fb41ac16740 20 client.17292 populate_metadata read hostname 'smithi069' 2024-05-14T15:37:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.180+0000 7fb41ac16740 1 --2- 172.21.15.69:0/3399972960 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557e64081d80 0x557e64480910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.189 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.180+0000 7fb41ac16740 4 client.17292 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:37:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.180+0000 7fb41ac16740 1 -- 172.21.15.69:0/3399972960 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557e643d7160 con 0x557e64081d80 2024-05-14T15:37:02.190 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.181+0000 7fb411200640 1 --2- 172.21.15.69:0/3399972960 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557e64081d80 0x557e64480910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:02.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.182+0000 7fb411200640 1 --2- 172.21.15.69:0/3399972960 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557e64081d80 0x557e64480910 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=746ea1ecc4d8d52f server_cookie=38573182e78b15f5 in_seq=0 out_seq=0 2024-05-14T15:37:02.191 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.182+0000 7fb3eea00640 10 client.17292 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.184+0000 7fb3eea00640 1 -- 172.21.15.69:0/3399972960 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557e643d7160 con 0x557e64081d80 2024-05-14T15:37:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.184+0000 7fb3eea00640 10 client.17292 handle_command_reply: tid=0 2024-05-14T15:37:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.184+0000 7fb41ac16740 1 client.17292 shutdown 2024-05-14T15:37:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.184+0000 7fb41ac16740 1 -- 172.21.15.69:0/3399972960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 msgr2=0x557e6446ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.184+0000 7fb41ac16740 1 --2- 172.21.15.69:0/3399972960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e6446ec10 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc004be0 tx=0x7fb3fc0056d0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.192 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.184+0000 7fb41ac16740 1 -- 172.21.15.69:0/3399972960 shutdown_connections 2024-05-14T15:37:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.184+0000 7fb41ac16740 1 --2- 172.21.15.69:0/3399972960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e6447a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.184+0000 7fb41ac16740 1 --2- 172.21.15.69:0/3399972960 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557e64081d80 0x557e64480910 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.184+0000 7fb41ac16740 1 --2- 172.21.15.69:0/3399972960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e6446ec10 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.184+0000 7fb41ac16740 1 --2- 172.21.15.69:0/3399972960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e6409a2f0 0x557e6446e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.184+0000 7fb3eea00640 0 client.17292 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.184+0000 7fb41ac16740 1 -- 172.21.15.69:0/3399972960 >> 172.21.15.69:0/3399972960 conn(0x557e640b7300 msgr2=0x557e64465fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:02.193 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.184+0000 7fb41ac16740 1 -- 172.21.15.69:0/3399972960 shutdown_connections 2024-05-14T15:37:02.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.184+0000 7fb41ac16740 1 -- 172.21.15.69:0/3399972960 wait complete. 2024-05-14T15:37:02.194 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.185+0000 7fb41ac16740 20 client.17292 trim_cache size 0 max 16384 2024-05-14T15:37:02.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.201+0000 7fb41ac16740 1 Processor -- start 2024-05-14T15:37:02.203 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.201+0000 7fb41ac16740 1 -- start start 2024-05-14T15:37:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.201+0000 7fb41ac16740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e6409a2f0 0x557e64465140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.201+0000 7fb41ac16740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e640a24d0 0x557e644702f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.201+0000 7fb41ac16740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e6447a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.201+0000 7fb41ac16740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c1b35c0 con 0x557e6409a2f0 2024-05-14T15:37:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.201+0000 7fb41ac16740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c1b51f0 con 0x557e640c31b0 2024-05-14T15:37:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.201+0000 7fb41ac16740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c1b3c90 con 0x557e640a24d0 2024-05-14T15:37:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.201+0000 7fb411200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e6409a2f0 0x557e64465140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.202+0000 7fb411200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e6409a2f0 0x557e64465140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59708/0 (socket says 172.21.15.69:59708) 2024-05-14T15:37:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.202+0000 7fb411200640 1 -- 172.21.15.69:0/3925464729 learned_addr learned my addr 172.21.15.69:0/3925464729 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.202+0000 7fb40be00640 1 --2- 172.21.15.69:0/3925464729 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e640a24d0 0x557e644702f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.202+0000 7fb411c00640 1 --2- 172.21.15.69:0/3925464729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e6447a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.202+0000 7fb411200640 1 -- 172.21.15.69:0/3925464729 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e640a24d0 msgr2=0x557e644702f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.202+0000 7fb411200640 1 --2- 172.21.15.69:0/3925464729 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e640a24d0 0x557e644702f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.202+0000 7fb411200640 1 -- 172.21.15.69:0/3925464729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 msgr2=0x557e6447a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:02.204 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.202+0000 7fb411200640 1 --2- 172.21.15.69:0/3925464729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e6447a7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.202+0000 7fb411200640 1 -- 172.21.15.69:0/3925464729 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557e643c54a0 con 0x557e6409a2f0 2024-05-14T15:37:02.205 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.203+0000 7fb411200640 1 --2- 172.21.15.69:0/3925464729 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e6409a2f0 0x557e64465140 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb400011040 tx=0x7fb4000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=436fe5b840e6daf5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:02.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.205+0000 7fb3f9600640 1 -- 172.21.15.69:0/3925464729 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4000ad880 con 0x557e6409a2f0 2024-05-14T15:37:02.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.205+0000 7fb3f9600640 1 -- 172.21.15.69:0/3925464729 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4000b2330 con 0x557e6409a2f0 2024-05-14T15:37:02.210 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.205+0000 7fb3f9600640 1 -- 172.21.15.69:0/3925464729 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4000b1ea0 con 0x557e6409a2f0 2024-05-14T15:37:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.208+0000 7fb41ac16740 1 -- 172.21.15.69:0/3925464729 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e6409a2f0 msgr2=0x557e64465140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.208+0000 7fb41ac16740 1 --2- 172.21.15.69:0/3925464729 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e6409a2f0 0x557e64465140 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb400011040 tx=0x7fb4000046c0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.213 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.209+0000 7fb41ac16740 1 -- 172.21.15.69:0/3925464729 shutdown_connections 2024-05-14T15:37:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.209+0000 7fb41ac16740 1 --2- 172.21.15.69:0/3925464729 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e6447a7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.209+0000 7fb41ac16740 1 --2- 172.21.15.69:0/3925464729 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e640a24d0 0x557e644702f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.209+0000 7fb41ac16740 1 --2- 172.21.15.69:0/3925464729 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e6409a2f0 0x557e64465140 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.209+0000 7fb41ac16740 1 -- 172.21.15.69:0/3925464729 >> 172.21.15.69:0/3925464729 conn(0x557e640b7300 msgr2=0x557e6446fbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.210+0000 7fb41ac16740 1 -- 172.21.15.69:0/3925464729 shutdown_connections 2024-05-14T15:37:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.210+0000 7fb41ac16740 1 -- 172.21.15.69:0/3925464729 wait complete. 2024-05-14T15:37:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.211+0000 7fb41ac16740 1 -- start start 2024-05-14T15:37:02.214 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.211+0000 7fb41ac16740 1 Processor -- start 2024-05-14T15:37:02.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.213+0000 7fb41ac16740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e6409a2f0 0x557e64480b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.213+0000 7fb41ac16740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e644810c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.215 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.214+0000 7fb41ac16740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e644ef240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.214+0000 7fb41ac16740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c1b4b20 con 0x557e640a24d0 2024-05-14T15:37:02.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.214+0000 7fb411200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e6409a2f0 0x557e64480b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:02.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.214+0000 7fb411200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e6409a2f0 0x557e64480b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:52040/0 (socket says 172.21.15.69:52040) 2024-05-14T15:37:02.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.214+0000 7fb41ac16740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c1b4390 con 0x557e640c31b0 2024-05-14T15:37:02.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.214+0000 7fb41ac16740 1 -- 172.21.15.69:0/497354287 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fb40c1b15c0 con 0x557e6409a2f0 2024-05-14T15:37:02.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.214+0000 7fb411200640 1 -- 172.21.15.69:0/497354287 learned_addr learned my addr 172.21.15.69:0/497354287 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:02.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.214+0000 7fb41ac16740 10 client.0 _ll_register_callbacks cb 0x7fb3fc00a7a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:37:02.216 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.215+0000 7fb411c00640 1 --2- 172.21.15.69:0/497354287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e644ef240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.215+0000 7fb40be00640 1 --2- 172.21.15.69:0/497354287 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e644810c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.216+0000 7fb411200640 1 -- 172.21.15.69:0/497354287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 msgr2=0x557e644ef240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.216+0000 7fb411200640 1 --2- 172.21.15.69:0/497354287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e644ef240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.216+0000 7fb411200640 1 -- 172.21.15.69:0/497354287 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 msgr2=0x557e644810c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.216+0000 7fb411200640 1 --2- 172.21.15.69:0/497354287 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e644810c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.217 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.216+0000 7fb411200640 1 -- 172.21.15.69:0/497354287 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557e644ef780 con 0x557e6409a2f0 2024-05-14T15:37:02.218 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.216+0000 7fb40be00640 1 --2- 172.21.15.69:0/497354287 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e644810c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:37:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.216+0000 7fb411200640 1 --2- 172.21.15.69:0/497354287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e6409a2f0 0x557e64480b80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb400009fd0 tx=0x7fb4000a9650 comp rx=0 tx=0).ready entity=mon.1 client_cookie=22bf4131e9a8a5f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.216+0000 7fb3eea00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:37:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.217+0000 7fb3eea00640 1 -- 172.21.15.69:0/497354287 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4000dfab0 con 0x557e6409a2f0 2024-05-14T15:37:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.217+0000 7fb3eea00640 1 -- 172.21.15.69:0/497354287 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(110..110 src has 1..110) ==== 9554+0+0 (secure 0 0 0) 0x7fb4000ca300 con 0x557e6409a2f0 2024-05-14T15:37:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.217+0000 7fb41ac16740 1 -- 172.21.15.69:0/497354287 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb4000b2330 con 0x557e6409a2f0 2024-05-14T15:37:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.218+0000 7fb3eea00640 1 -- 172.21.15.69:0/497354287 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fb4000ca500 con 0x557e6409a2f0 2024-05-14T15:37:02.219 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.218+0000 7fb41ac16740 10 client.26770 fetch_fsmap learned FSMap version 66 2024-05-14T15:37:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.218+0000 7fb41ac16740 1 -- 172.21.15.69:0/497354287 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x557e644f0890 con 0x557e6409a2f0 2024-05-14T15:37:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.219+0000 7fb3eea00640 1 -- 172.21.15.69:0/497354287 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fb4000b2330 con 0x557e6409a2f0 2024-05-14T15:37:02.220 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.219+0000 7fb3eea00640 1 -- 172.21.15.69:0/497354287 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7fb4000a8730 con 0x557e6409a2f0 2024-05-14T15:37:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.219+0000 7fb41ac16740 10 client.26770 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:37:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.219+0000 7fb41ac16740 10 client.26770 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:37:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.219+0000 7fb41ac16740 20 client.26770 populate_metadata read hostname 'smithi069' 2024-05-14T15:37:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.219+0000 7fb41ac16740 1 --2- 172.21.15.69:0/497354287 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557e640571c0 0x557e644f2f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.220+0000 7fb41ac16740 4 client.26770 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:37:02.221 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.220+0000 7fb41ac16740 1 -- 172.21.15.69:0/497354287 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557e643d0fd0 con 0x557e640571c0 2024-05-14T15:37:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.220+0000 7fb40be00640 1 --2- 172.21.15.69:0/497354287 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557e640571c0 0x557e644f2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:02.222 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.222+0000 7fb40be00640 1 --2- 172.21.15.69:0/497354287 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557e640571c0 0x557e644f2f70 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b887556197d25d27 server_cookie=58f4b57a6f9b86c1 in_seq=0 out_seq=0 2024-05-14T15:37:02.223 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.222+0000 7fb3eea00640 10 client.26770 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:02.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.291+0000 7fb3eea00640 1 -- 172.21.15.69:0/497354287 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557e643d0fd0 con 0x557e640571c0 2024-05-14T15:37:02.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.291+0000 7fb3eea00640 10 client.26770 handle_command_reply: tid=0 2024-05-14T15:37:02.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.291+0000 7fb41ac16740 1 client.26770 shutdown 2024-05-14T15:37:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.292+0000 7fb41ac16740 1 -- 172.21.15.69:0/497354287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e6409a2f0 msgr2=0x557e64480b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.292+0000 7fb41ac16740 1 --2- 172.21.15.69:0/497354287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e6409a2f0 0x557e64480b80 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fb400009fd0 tx=0x7fb4000a9650 comp rx=0 tx=0).stop 2024-05-14T15:37:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.293+0000 7fb41ac16740 1 -- 172.21.15.69:0/497354287 shutdown_connections 2024-05-14T15:37:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.293+0000 7fb41ac16740 1 --2- 172.21.15.69:0/497354287 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557e640c31b0 0x557e644ef240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.293+0000 7fb41ac16740 1 --2- 172.21.15.69:0/497354287 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557e640571c0 0x557e644f2f70 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.293+0000 7fb41ac16740 1 --2- 172.21.15.69:0/497354287 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557e640a24d0 0x557e644810c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.293+0000 7fb41ac16740 1 --2- 172.21.15.69:0/497354287 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557e6409a2f0 0x557e64480b80 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.293+0000 7fb41ac16740 1 -- 172.21.15.69:0/497354287 >> 172.21.15.69:0/497354287 conn(0x557e640b7300 msgr2=0x557e6445f790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.293+0000 7fb3eea00640 0 client.26770 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.294+0000 7fb41ac16740 1 -- 172.21.15.69:0/497354287 shutdown_connections 2024-05-14T15:37:02.295 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.294+0000 7fb41ac16740 1 -- 172.21.15.69:0/497354287 wait complete. 2024-05-14T15:37:02.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.294+0000 7fb41ac16740 20 client.26770 trim_cache size 0 max 16384 2024-05-14T15:37:02.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:37:02.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:37:02.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:37:02.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:37:02.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.296+0000 7fb413c00640 1 -- 172.21.15.69:0/1520102501 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb3f40b2950 msgr2=0x7fb3f40b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:02.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.296+0000 7fb413c00640 1 --2- 172.21.15.69:0/1520102501 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb3f40b2950 0x7fb3f40b4e60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb404006010 tx=0x7fb4040094a0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.296+0000 7fb413c00640 1 -- 172.21.15.69:0/1520102501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb40c106600 msgr2=0x7fb40c1a2650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:02.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.296+0000 7fb413c00640 1 --2- 172.21.15.69:0/1520102501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb40c106600 0x7fb40c1a2650 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb40000b450 tx=0x7fb40000b910 comp rx=0 tx=0).stop 2024-05-14T15:37:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.296+0000 7fb413c00640 1 -- 172.21.15.69:0/1520102501 shutdown_connections 2024-05-14T15:37:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.296+0000 7fb413c00640 1 --2- 172.21.15.69:0/1520102501 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fb3f40b2950 0x7fb3f40b4e60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.296+0000 7fb413c00640 1 --2- 172.21.15.69:0/1520102501 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fb40c10c350 0x7fb40c19c860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.296+0000 7fb413c00640 1 --2- 172.21.15.69:0/1520102501 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fb40c10beb0 0x7fb40c1a2b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.296+0000 7fb413c00640 1 --2- 172.21.15.69:0/1520102501 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fb40c106600 0x7fb40c1a2650 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.296+0000 7fb413c00640 1 -- 172.21.15.69:0/1520102501 >> 172.21.15.69:0/1520102501 conn(0x7fb40c077200 msgr2=0x7fb40c103170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.296+0000 7fb413c00640 1 -- 172.21.15.69:0/1520102501 shutdown_connections 2024-05-14T15:37:02.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:02.296+0000 7fb413c00640 1 -- 172.21.15.69:0/1520102501 wait complete. 2024-05-14T15:37:03.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:03 smithi092 ceph-mon[34729]: pgmap v483: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.4 MiB/s wr, 516 op/s 2024-05-14T15:37:03.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:03 smithi069 ceph-mon[31270]: pgmap v483: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.4 MiB/s wr, 516 op/s 2024-05-14T15:37:04.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:03 smithi203 ceph-mon[34567]: pgmap v483: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 5.4 MiB/s wr, 516 op/s 2024-05-14T15:37:05.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:05 smithi092 ceph-mon[34729]: pgmap v484: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.3 MiB/s wr, 515 op/s 2024-05-14T15:37:05.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:05 smithi069 ceph-mon[31270]: pgmap v484: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.3 MiB/s wr, 515 op/s 2024-05-14T15:37:06.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:05 smithi203 ceph-mon[34567]: pgmap v484: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.3 MiB/s wr, 515 op/s 2024-05-14T15:37:06.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 680.0 s, 549.2 tps, lat 184.140 ms stddev 107.663 2024-05-14T15:37:07.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:07 smithi092 ceph-mon[34729]: pgmap v485: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.5 MiB/s wr, 777 op/s 2024-05-14T15:37:07.978 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:07 smithi069 ceph-mon[31270]: pgmap v485: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.5 MiB/s wr, 777 op/s 2024-05-14T15:37:08.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:07 smithi203 ceph-mon[34567]: pgmap v485: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.5 MiB/s wr, 777 op/s 2024-05-14T15:37:08.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:08 smithi092 ceph-mon[34729]: osdmap e111: 12 total, 12 up, 12 in 2024-05-14T15:37:08.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:08 smithi069 ceph-mon[31270]: osdmap e111: 12 total, 12 up, 12 in 2024-05-14T15:37:09.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:08 smithi203 ceph-mon[34567]: osdmap e111: 12 total, 12 up, 12 in 2024-05-14T15:37:09.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:09 smithi092 ceph-mon[34729]: pgmap v487: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.7 MiB/s wr, 635 op/s 2024-05-14T15:37:09.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:09 smithi069 ceph-mon[31270]: pgmap v487: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.7 MiB/s wr, 635 op/s 2024-05-14T15:37:10.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:09 smithi203 ceph-mon[34567]: pgmap v487: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 5.7 MiB/s wr, 635 op/s 2024-05-14T15:37:11.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 685.0 s, 263.4 tps, lat 367.177 ms stddev 419.242 2024-05-14T15:37:11.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:11 smithi092 ceph-mon[34729]: pgmap v488: 129 pgs: 2 active+clean+snaptrim, 120 active+clean, 7 active+clean+snaptrim_wait; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.8 MiB/s wr, 636 op/s 2024-05-14T15:37:11.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:11 smithi069 ceph-mon[31270]: pgmap v488: 129 pgs: 2 active+clean+snaptrim, 120 active+clean, 7 active+clean+snaptrim_wait; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.8 MiB/s wr, 636 op/s 2024-05-14T15:37:12.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:11 smithi203 ceph-mon[34567]: pgmap v488: 129 pgs: 2 active+clean+snaptrim, 120 active+clean, 7 active+clean+snaptrim_wait; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 5.8 MiB/s wr, 636 op/s 2024-05-14T15:37:13.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:13 smithi092 ceph-mon[34729]: pgmap v489: 129 pgs: 3 active+clean+snaptrim, 119 active+clean, 7 active+clean+snaptrim_wait; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.4 MiB/s wr, 695 op/s 2024-05-14T15:37:13.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:13 smithi069 ceph-mon[31270]: pgmap v489: 129 pgs: 3 active+clean+snaptrim, 119 active+clean, 7 active+clean+snaptrim_wait; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.4 MiB/s wr, 695 op/s 2024-05-14T15:37:14.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:13 smithi203 ceph-mon[34567]: pgmap v489: 129 pgs: 3 active+clean+snaptrim, 119 active+clean, 7 active+clean+snaptrim_wait; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 6.4 MiB/s wr, 695 op/s 2024-05-14T15:37:15.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.633+0000 7fed36400640 1 -- 172.21.15.69:0/363982994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed30104210 msgr2=0x7fed301105e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:15.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.633+0000 7fed36400640 1 --2- 172.21.15.69:0/363982994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed30104210 0x7fed301105e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fed28009be0 tx=0x7fed2802a6f0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.634+0000 7fed36400640 1 -- 172.21.15.69:0/363982994 shutdown_connections 2024-05-14T15:37:15.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.634+0000 7fed36400640 1 --2- 172.21.15.69:0/363982994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed30104210 0x7fed301105e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.634+0000 7fed36400640 1 --2- 172.21.15.69:0/363982994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed30109f60 0x7fed30103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.634+0000 7fed36400640 1 --2- 172.21.15.69:0/363982994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed30109ac0 0x7fed30103660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.634+0000 7fed36400640 1 -- 172.21.15.69:0/363982994 >> 172.21.15.69:0/363982994 conn(0x7fed30079150 msgr2=0x7fed30079590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:15.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.635+0000 7fed36400640 1 -- 172.21.15.69:0/363982994 shutdown_connections 2024-05-14T15:37:15.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.635+0000 7fed36400640 1 -- 172.21.15.69:0/363982994 wait complete. 2024-05-14T15:37:15.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.636+0000 7fed36400640 1 Processor -- start 2024-05-14T15:37:15.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.636+0000 7fed36400640 1 -- start start 2024-05-14T15:37:15.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.637+0000 7fed36400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed30104210 0x7fed30074fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.637+0000 7fed36400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed30109ac0 0x7fed30075510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.637+0000 7fed36400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed30109f60 0x7fed30075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.637+0000 7fed36400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fed30113b60 con 0x7fed30104210 2024-05-14T15:37:15.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.637+0000 7fed36400640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fed301139e0 con 0x7fed30109f60 2024-05-14T15:37:15.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.637+0000 7fed36400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fed30113ce0 con 0x7fed30109ac0 2024-05-14T15:37:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.638+0000 7fed35a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed30109f60 0x7fed30075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.638+0000 7fed35000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed30104210 0x7fed30074fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.638+0000 7fed35a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed30109f60 0x7fed30075a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:44320/0 (socket says 172.21.15.69:44320) 2024-05-14T15:37:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.638+0000 7fed35a00640 1 -- 172.21.15.69:0/4174004283 learned_addr learned my addr 172.21.15.69:0/4174004283 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.638+0000 7fed2fe00640 1 --2- 172.21.15.69:0/4174004283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed30109ac0 0x7fed30075510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.638+0000 7fed35a00640 1 -- 172.21.15.69:0/4174004283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed30109ac0 msgr2=0x7fed30075510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.638+0000 7fed35a00640 1 --2- 172.21.15.69:0/4174004283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed30109ac0 0x7fed30075510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.638+0000 7fed35a00640 1 -- 172.21.15.69:0/4174004283 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed30104210 msgr2=0x7fed30074fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.639+0000 7fed35a00640 1 --2- 172.21.15.69:0/4174004283 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed30104210 0x7fed30074fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.639+0000 7fed35a00640 1 -- 172.21.15.69:0/4174004283 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed301a89a0 con 0x7fed30109f60 2024-05-14T15:37:15.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.640+0000 7fed35a00640 1 --2- 172.21.15.69:0/4174004283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed30109f60 0x7fed30075a50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fed28034040 tx=0x7fed28030bb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:15.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.640+0000 7fed2d600640 1 -- 172.21.15.69:0/4174004283 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28041020 con 0x7fed30109f60 2024-05-14T15:37:15.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.640+0000 7fed2d600640 1 -- 172.21.15.69:0/4174004283 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed28031440 con 0x7fed30109f60 2024-05-14T15:37:15.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.640+0000 7fed2d600640 1 -- 172.21.15.69:0/4174004283 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed28036040 con 0x7fed30109f60 2024-05-14T15:37:15.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.640+0000 7fed36400640 1 -- 172.21.15.69:0/4174004283 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed301a8c30 con 0x7fed30109f60 2024-05-14T15:37:15.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.640+0000 7fed36400640 1 -- 172.21.15.69:0/4174004283 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed301a90d0 con 0x7fed30109f60 2024-05-14T15:37:15.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.647+0000 7fed2d600640 1 -- 172.21.15.69:0/4174004283 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fed28044020 con 0x7fed30109f60 2024-05-14T15:37:15.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.651+0000 7fed3ea1c740 1 Processor -- start 2024-05-14T15:37:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.651+0000 7fed3ea1c740 1 -- start start 2024-05-14T15:37:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.652+0000 7fed3ea1c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4126d1b0 0x558f4160e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.652+0000 7fed3ea1c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f412442f0 0x558f4160e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.652+0000 7fed3ea1c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4124c4d0 0x558f4160edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.652+0000 7fed3ea1c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x558f41573550 con 0x558f4124c4d0 2024-05-14T15:37:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.652+0000 7fed3ea1c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558f41518bc0 con 0x558f4126d1b0 2024-05-14T15:37:15.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.652+0000 7fed3ea1c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558f4156f510 con 0x558f412442f0 2024-05-14T15:37:15.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.652+0000 7fed2fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4126d1b0 0x558f4160e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:15.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.652+0000 7fed2fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4126d1b0 0x558f4160e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:44334/0 (socket says 172.21.15.69:44334) 2024-05-14T15:37:15.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.652+0000 7fed2fe00640 1 -- 172.21.15.69:0/2680636377 learned_addr learned my addr 172.21.15.69:0/2680636377 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:15.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.653+0000 7fed2fe00640 1 -- 172.21.15.69:0/2680636377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f412442f0 msgr2=0x558f4160e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:15.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.653+0000 7fed2fe00640 1 --2- 172.21.15.69:0/2680636377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f412442f0 0x558f4160e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.653+0000 7fed2fe00640 1 -- 172.21.15.69:0/2680636377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4124c4d0 msgr2=0x558f4160edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:15.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.653+0000 7fed2fe00640 1 --2- 172.21.15.69:0/2680636377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4124c4d0 0x558f4160edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.653+0000 7fed2fe00640 1 -- 172.21.15.69:0/2680636377 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f41285210 con 0x558f4126d1b0 2024-05-14T15:37:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.654+0000 7fed2fe00640 1 --2- 172.21.15.69:0/2680636377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4126d1b0 0x558f4160e370 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00bcb0 tx=0x7fed1c0127c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b54497897f61f15f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.654+0000 7fed22000640 1 -- 172.21.15.69:0/2680636377 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c004250 con 0x558f4126d1b0 2024-05-14T15:37:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.655+0000 7fed22000640 1 -- 172.21.15.69:0/2680636377 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed1c00be60 con 0x558f4126d1b0 2024-05-14T15:37:15.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.655+0000 7fed22000640 1 -- 172.21.15.69:0/2680636377 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c004bd0 con 0x558f4126d1b0 2024-05-14T15:37:15.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.656+0000 7fed3ea1c740 1 -- 172.21.15.69:0/2680636377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4126d1b0 msgr2=0x558f4160e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:15.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.656+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/2680636377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4126d1b0 0x558f4160e370 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00bcb0 tx=0x7fed1c0127c0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.656+0000 7fed3ea1c740 1 -- 172.21.15.69:0/2680636377 shutdown_connections 2024-05-14T15:37:15.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.657+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/2680636377 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4124c4d0 0x558f4160edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.657+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/2680636377 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f412442f0 0x558f4160e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.657+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/2680636377 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4126d1b0 0x558f4160e370 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.657+0000 7fed3ea1c740 1 -- 172.21.15.69:0/2680636377 >> 172.21.15.69:0/2680636377 conn(0x558f41261300 msgr2=0x558f4160ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:15.658 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.657+0000 7fed2d600640 1 --2- 172.21.15.69:0/4174004283 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fed180b2a50 0x7fed180b4f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.657+0000 7fed2d600640 1 -- 172.21.15.69:0/4174004283 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(112..112 src has 1..112) ==== 9566+0+0 (secure 0 0 0) 0x7fed28103350 con 0x7fed30109f60 2024-05-14T15:37:15.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.658+0000 7fed3ea1c740 1 -- 172.21.15.69:0/2680636377 shutdown_connections 2024-05-14T15:37:15.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.658+0000 7fed3ea1c740 1 -- 172.21.15.69:0/2680636377 wait complete. 2024-05-14T15:37:15.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.658+0000 7fed35000640 1 --2- 172.21.15.69:0/4174004283 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fed180b2a50 0x7fed180b4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:15.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.659+0000 7fed3ea1c740 1 -- start start 2024-05-14T15:37:15.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.659+0000 7fed3ea1c740 1 Processor -- start 2024-05-14T15:37:15.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.660+0000 7fed3ea1c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f412442f0 0x558f416212e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.660+0000 7fed3ea1c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f4124c4d0 0x558f41621820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.662 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.660+0000 7fed3ea1c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4126d1b0 0x558f41627240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.662 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.660+0000 7fed3ea1c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x558f41623dc0 con 0x558f4126d1b0 2024-05-14T15:37:15.662 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.660+0000 7fed3ea1c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x558f4152c660 con 0x558f412442f0 2024-05-14T15:37:15.662 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.660+0000 7fed3ea1c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x558f41623f40 con 0x558f4124c4d0 2024-05-14T15:37:15.662 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.660+0000 7fed3ea1c740 10 client.0 _ll_register_callbacks cb 0x558f414f6400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:37:15.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.661+0000 7fed2fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f4124c4d0 0x558f41621820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:15.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.661+0000 7fed35a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4126d1b0 0x558f41627240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:15.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.661+0000 7fed2fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f4124c4d0 0x558f41621820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:52084/0 (socket says 172.21.15.69:52084) 2024-05-14T15:37:15.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.661+0000 7fed2fe00640 1 -- 172.21.15.69:0/1760079563 learned_addr learned my addr 172.21.15.69:0/1760079563 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:15.663 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.661+0000 7fed35000640 1 --2- 172.21.15.69:0/1760079563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f412442f0 0x558f416212e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.662+0000 7fed2fe00640 1 -- 172.21.15.69:0/1760079563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f412442f0 msgr2=0x558f416212e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.662+0000 7fed2fe00640 1 --2- 172.21.15.69:0/1760079563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f412442f0 0x558f416212e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.662+0000 7fed2fe00640 1 -- 172.21.15.69:0/1760079563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4126d1b0 msgr2=0x558f41627240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.662+0000 7fed2fe00640 1 --2- 172.21.15.69:0/1760079563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4126d1b0 0x558f41627240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.662+0000 7fed2fe00640 1 -- 172.21.15.69:0/1760079563 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f41351620 con 0x558f4124c4d0 2024-05-14T15:37:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.662+0000 7fed35a00640 1 --2- 172.21.15.69:0/1760079563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4126d1b0 0x558f41627240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:37:15.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.663+0000 7fed35000640 1 --2- 172.21.15.69:0/4174004283 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fed180b2a50 0x7fed180b4f60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fed24005fd0 tx=0x7fed24005850 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:15.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.663+0000 7fed2fe00640 1 --2- 172.21.15.69:0/1760079563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f4124c4d0 0x558f41621820 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00b770 tx=0x7fed1c004270 comp rx=0 tx=0).ready entity=mon.1 client_cookie=75a69bbac3db75fb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:15.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.663+0000 7fed16a00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:37:15.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.663+0000 7fed16a00640 1 -- 172.21.15.69:0/1760079563 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed1c0035f0 con 0x558f4124c4d0 2024-05-14T15:37:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.663+0000 7fed16a00640 1 -- 172.21.15.69:0/1760079563 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9566+0+0 (secure 0 0 0) 0x7fed1c003790 con 0x558f4124c4d0 2024-05-14T15:37:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.664+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1760079563 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed1c00be60 con 0x558f4124c4d0 2024-05-14T15:37:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.664+0000 7fed16a00640 1 -- 172.21.15.69:0/1760079563 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fed1c0039d0 con 0x558f4124c4d0 2024-05-14T15:37:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.664+0000 7fed3ea1c740 10 client.26779 fetch_fsmap learned FSMap version 66 2024-05-14T15:37:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.664+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1760079563 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x558f41630170 con 0x558f4124c4d0 2024-05-14T15:37:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.665+0000 7fed16a00640 1 -- 172.21.15.69:0/1760079563 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed1c00be60 con 0x558f4124c4d0 2024-05-14T15:37:15.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.665+0000 7fed16a00640 1 -- 172.21.15.69:0/1760079563 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7fed1c019030 con 0x558f4124c4d0 2024-05-14T15:37:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.666+0000 7fed3ea1c740 10 client.26779 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:37:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.666+0000 7fed3ea1c740 10 client.26779 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:37:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.666+0000 7fed3ea1c740 20 client.26779 populate_metadata read hostname 'smithi069' 2024-05-14T15:37:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.666+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/1760079563 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558f4122bd80 0x558f41633530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.667 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.666+0000 7fed3ea1c740 4 client.26779 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:37:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.666+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1760079563 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f41581160 con 0x558f4122bd80 2024-05-14T15:37:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.667+0000 7fed35000640 1 --2- 172.21.15.69:0/1760079563 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558f4122bd80 0x558f41633530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:15.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.667+0000 7fed35000640 1 --2- 172.21.15.69:0/1760079563 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558f4122bd80 0x558f41633530 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=91deb68321c82c09 server_cookie=45c2055ff2d6fbe7 in_seq=0 out_seq=0 2024-05-14T15:37:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.668+0000 7fed16a00640 10 client.26779 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.668+0000 7fed16a00640 1 -- 172.21.15.69:0/1760079563 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x558f41581160 con 0x558f4122bd80 2024-05-14T15:37:15.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.668+0000 7fed16a00640 10 client.26779 handle_command_reply: tid=0 2024-05-14T15:37:15.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.669+0000 7fed3ea1c740 1 client.26779 shutdown 2024-05-14T15:37:15.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.669+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1760079563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f4124c4d0 msgr2=0x558f41621820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.669+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/1760079563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f4124c4d0 0x558f41621820 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fed1c00b770 tx=0x7fed1c004270 comp rx=0 tx=0).stop 2024-05-14T15:37:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.669+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1760079563 shutdown_connections 2024-05-14T15:37:15.673 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.669+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/1760079563 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558f4122bd80 0x558f41633530 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.670+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/1760079563 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4126d1b0 0x558f41627240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.670+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/1760079563 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f4124c4d0 0x558f41621820 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.670+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/1760079563 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f412442f0 0x558f416212e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.670+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1760079563 >> 172.21.15.69:0/1760079563 conn(0x558f41261300 msgr2=0x558f41610130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.670+0000 7fed16a00640 0 client.26779 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.670+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1760079563 shutdown_connections 2024-05-14T15:37:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.670+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1760079563 wait complete. 2024-05-14T15:37:15.674 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.670+0000 7fed3ea1c740 20 client.26779 trim_cache size 0 max 16384 2024-05-14T15:37:15.702 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.701+0000 7fed3ea1c740 1 Processor -- start 2024-05-14T15:37:15.702 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.701+0000 7fed3ea1c740 1 -- start start 2024-05-14T15:37:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.701+0000 7fed3ea1c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f412442f0 0x558f416232e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.701+0000 7fed3ea1c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4124c4d0 0x558f416271b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.701+0000 7fed3ea1c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4126d1b0 0x558f416276f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.701+0000 7fed3ea1c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fed301af130 con 0x558f4124c4d0 2024-05-14T15:37:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.701+0000 7fed3ea1c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fed301b0d60 con 0x558f4126d1b0 2024-05-14T15:37:15.703 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.701+0000 7fed3ea1c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fed301af800 con 0x558f412442f0 2024-05-14T15:37:15.704 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.702+0000 7fed35a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4126d1b0 0x558f416276f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:15.704 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.702+0000 7fed35a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4126d1b0 0x558f416276f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:44354/0 (socket says 172.21.15.69:44354) 2024-05-14T15:37:15.704 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.702+0000 7fed35a00640 1 -- 172.21.15.69:0/1591912169 learned_addr learned my addr 172.21.15.69:0/1591912169 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:15.704 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.703+0000 7fed35a00640 1 -- 172.21.15.69:0/1591912169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f412442f0 msgr2=0x558f416232e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:15.704 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.703+0000 7fed35a00640 1 --2- 172.21.15.69:0/1591912169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f412442f0 0x558f416232e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.704 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.703+0000 7fed35a00640 1 -- 172.21.15.69:0/1591912169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4124c4d0 msgr2=0x558f416271b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:15.705 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.704+0000 7fed2fe00640 1 --2- 172.21.15.69:0/1591912169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4124c4d0 0x558f416271b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:15.705 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.704+0000 7fed35a00640 1 --2- 172.21.15.69:0/1591912169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4124c4d0 0x558f416271b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.705 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.704+0000 7fed35a00640 1 -- 172.21.15.69:0/1591912169 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f416338a0 con 0x558f4126d1b0 2024-05-14T15:37:15.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.704+0000 7fed2fe00640 1 --2- 172.21.15.69:0/1591912169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4124c4d0 0x558f416271b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:37:15.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.704+0000 7fed35a00640 1 --2- 172.21.15.69:0/1591912169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4126d1b0 0x558f416276f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fed280c6240 tx=0x7fed28031970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ef5afb3abee4771 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:15.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.705+0000 7fed21600640 1 -- 172.21.15.69:0/1591912169 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280ca8c0 con 0x558f4126d1b0 2024-05-14T15:37:15.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.705+0000 7fed21600640 1 -- 172.21.15.69:0/1591912169 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed280ca1c0 con 0x558f4126d1b0 2024-05-14T15:37:15.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.705+0000 7fed21600640 1 -- 172.21.15.69:0/1591912169 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280ca8c0 con 0x558f4126d1b0 2024-05-14T15:37:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.706+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1591912169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4126d1b0 msgr2=0x558f416276f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.706+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/1591912169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4126d1b0 0x558f416276f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fed280c6240 tx=0x7fed28031970 comp rx=0 tx=0).stop 2024-05-14T15:37:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.707+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1591912169 shutdown_connections 2024-05-14T15:37:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.707+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/1591912169 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4126d1b0 0x558f416276f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.707+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/1591912169 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f4124c4d0 0x558f416271b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.707+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/1591912169 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f412442f0 0x558f416232e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.708 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.707+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1591912169 >> 172.21.15.69:0/1591912169 conn(0x558f41261300 msgr2=0x558f41610b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.707+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1591912169 shutdown_connections 2024-05-14T15:37:15.709 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.707+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1591912169 wait complete. 2024-05-14T15:37:15.710 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.708+0000 7fed3ea1c740 1 -- start start 2024-05-14T15:37:15.710 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.708+0000 7fed3ea1c740 1 Processor -- start 2024-05-14T15:37:15.712 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.710+0000 7fed3ea1c740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f412442f0 0x558f4162aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.712 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.711+0000 7fed3ea1c740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4124c4d0 0x558f4162af60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.712 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.711+0000 7fed3ea1c740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f4126d1b0 0x558f41699680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.711+0000 7fed3ea1c740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fed301b0690 con 0x558f412442f0 2024-05-14T15:37:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.711+0000 7fed3ea1c740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fed301aff00 con 0x558f4124c4d0 2024-05-14T15:37:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.711+0000 7fed3ea1c740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fed301ad110 con 0x558f4126d1b0 2024-05-14T15:37:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.712+0000 7fed3ea1c740 10 client.0 _ll_register_callbacks cb 0x7fed1c00bb80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:37:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.712+0000 7fed35a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f4126d1b0 0x558f41699680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.712+0000 7fed35a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f4126d1b0 0x558f41699680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:52108/0 (socket says 172.21.15.69:52108) 2024-05-14T15:37:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.712+0000 7fed35a00640 1 -- 172.21.15.69:0/1733848161 learned_addr learned my addr 172.21.15.69:0/1733848161 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:15.713 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.712+0000 7fed2fe00640 1 --2- 172.21.15.69:0/1733848161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4124c4d0 0x558f4162af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.712+0000 7fed35000640 1 --2- 172.21.15.69:0/1733848161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f412442f0 0x558f4162aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.713+0000 7fed35a00640 1 -- 172.21.15.69:0/1733848161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4124c4d0 msgr2=0x558f4162af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.713+0000 7fed35a00640 1 --2- 172.21.15.69:0/1733848161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4124c4d0 0x558f4162af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.713+0000 7fed35a00640 1 -- 172.21.15.69:0/1733848161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f412442f0 msgr2=0x558f4162aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:15.714 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.713+0000 7fed35a00640 1 --2- 172.21.15.69:0/1733848161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f412442f0 0x558f4162aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.713+0000 7fed35a00640 1 -- 172.21.15.69:0/1733848161 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f4162b650 con 0x558f4126d1b0 2024-05-14T15:37:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.713+0000 7fed35000640 1 --2- 172.21.15.69:0/1733848161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f412442f0 0x558f4162aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:37:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.714+0000 7fed16a00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:37:15.715 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.714+0000 7fed35a00640 1 --2- 172.21.15.69:0/1733848161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f4126d1b0 0x558f41699680 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fed28031040 tx=0x7fed28100be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f6ca597ee2670e3 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:15.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.715+0000 7fed16a00640 1 -- 172.21.15.69:0/1733848161 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed280ca8c0 con 0x558f4126d1b0 2024-05-14T15:37:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.715+0000 7fed16a00640 1 -- 172.21.15.69:0/1733848161 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(112..112 src has 1..112) ==== 9566+0+0 (secure 0 0 0) 0x7fed280d2da0 con 0x558f4126d1b0 2024-05-14T15:37:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.716+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1733848161 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fed280ca1c0 con 0x558f4126d1b0 2024-05-14T15:37:15.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.716+0000 7fed16a00640 1 -- 172.21.15.69:0/1733848161 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=66) ==== 24+0+0 (secure 0 0 0) 0x7fed28003b70 con 0x558f4126d1b0 2024-05-14T15:37:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.717+0000 7fed3ea1c740 10 client.26782 fetch_fsmap learned FSMap version 66 2024-05-14T15:37:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.717+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1733848161 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=66,monmap=4+}) -- 0x558f4169abf0 con 0x558f4126d1b0 2024-05-14T15:37:15.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.717+0000 7fed16a00640 1 -- 172.21.15.69:0/1733848161 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fed280ca1c0 con 0x558f4126d1b0 2024-05-14T15:37:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.718+0000 7fed16a00640 1 -- 172.21.15.69:0/1733848161 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 66) ==== 8382+0+0 (secure 0 0 0) 0x7fed280c5b30 con 0x558f4126d1b0 2024-05-14T15:37:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.718+0000 7fed3ea1c740 10 client.26782 fetch_fsmap finished waiting for FSMap version 66 2024-05-14T15:37:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.718+0000 7fed3ea1c740 10 client.26782 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:37:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.718+0000 7fed3ea1c740 20 client.26782 populate_metadata read hostname 'smithi069' 2024-05-14T15:37:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.718+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/1733848161 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558f412011c0 0x558f4169d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:15.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.718+0000 7fed3ea1c740 4 client.26782 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:37:15.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.718+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1733848161 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558f4157afd0 con 0x558f412011c0 2024-05-14T15:37:15.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.719+0000 7fed35000640 1 --2- 172.21.15.69:0/1733848161 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558f412011c0 0x558f4169d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.720+0000 7fed35000640 1 --2- 172.21.15.69:0/1733848161 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558f412011c0 0x558f4169d2c0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60c8f048cd0c39fa server_cookie=ad805b22d5c083a in_seq=0 out_seq=0 2024-05-14T15:37:15.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.720+0000 7fed16a00640 10 client.26782 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:15.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.749+0000 7fed16a00640 1 -- 172.21.15.69:0/1733848161 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558f4157afd0 con 0x558f412011c0 2024-05-14T15:37:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.749+0000 7fed16a00640 10 client.26782 handle_command_reply: tid=0 2024-05-14T15:37:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.749+0000 7fed3ea1c740 1 client.26782 shutdown 2024-05-14T15:37:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.749+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1733848161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f4126d1b0 msgr2=0x558f41699680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.749+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/1733848161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f4126d1b0 0x558f41699680 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fed28031040 tx=0x7fed28100be0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.750+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1733848161 shutdown_connections 2024-05-14T15:37:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.750+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/1733848161 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x558f4126d1b0 0x558f41699680 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.750+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/1733848161 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x558f4124c4d0 0x558f4162af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.750+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/1733848161 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x558f412011c0 0x558f4169d2c0 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.750+0000 7fed3ea1c740 1 --2- 172.21.15.69:0/1733848161 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x558f412442f0 0x558f4162aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.750+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1733848161 >> 172.21.15.69:0/1733848161 conn(0x558f41261300 msgr2=0x558f4160ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:15.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.750+0000 7fed16a00640 0 client.26782 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.750+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1733848161 shutdown_connections 2024-05-14T15:37:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.750+0000 7fed3ea1c740 1 -- 172.21.15.69:0/1733848161 wait complete. 2024-05-14T15:37:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.751+0000 7fed3ea1c740 20 client.26782 trim_cache size 0 max 16384 2024-05-14T15:37:15.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:37:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:37:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:37:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:37:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.752+0000 7fed36400640 1 -- 172.21.15.69:0/4174004283 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fed180b2a50 msgr2=0x7fed180b4f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:15.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.752+0000 7fed36400640 1 --2- 172.21.15.69:0/4174004283 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fed180b2a50 0x7fed180b4f60 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fed24005fd0 tx=0x7fed24005850 comp rx=0 tx=0).stop 2024-05-14T15:37:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.752+0000 7fed36400640 1 -- 172.21.15.69:0/4174004283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed30109f60 msgr2=0x7fed30075a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.752+0000 7fed36400640 1 --2- 172.21.15.69:0/4174004283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed30109f60 0x7fed30075a50 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fed28034040 tx=0x7fed28030bb0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.752+0000 7fed36400640 1 -- 172.21.15.69:0/4174004283 shutdown_connections 2024-05-14T15:37:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.752+0000 7fed36400640 1 --2- 172.21.15.69:0/4174004283 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fed180b2a50 0x7fed180b4f60 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.752+0000 7fed36400640 1 --2- 172.21.15.69:0/4174004283 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fed30109f60 0x7fed30075a50 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.752+0000 7fed36400640 1 --2- 172.21.15.69:0/4174004283 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fed30109ac0 0x7fed30075510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.752+0000 7fed36400640 1 --2- 172.21.15.69:0/4174004283 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fed30104210 0x7fed30074fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.752+0000 7fed36400640 1 -- 172.21.15.69:0/4174004283 >> 172.21.15.69:0/4174004283 conn(0x7fed30079150 msgr2=0x7fed30101040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.752+0000 7fed36400640 1 -- 172.21.15.69:0/4174004283 shutdown_connections 2024-05-14T15:37:15.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:15.753+0000 7fed36400640 1 -- 172.21.15.69:0/4174004283 wait complete. 2024-05-14T15:37:16.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:15 smithi092 ceph-mon[34729]: pgmap v490: 129 pgs: 3 active+clean+snaptrim, 119 active+clean, 7 active+clean+snaptrim_wait; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.2 MiB/s wr, 682 op/s 2024-05-14T15:37:16.194 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:15 smithi092 ceph-mon[34729]: osdmap e112: 12 total, 12 up, 12 in 2024-05-14T15:37:16.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:15 smithi069 ceph-mon[31270]: pgmap v490: 129 pgs: 3 active+clean+snaptrim, 119 active+clean, 7 active+clean+snaptrim_wait; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.2 MiB/s wr, 682 op/s 2024-05-14T15:37:16.225 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:15 smithi069 ceph-mon[31270]: osdmap e112: 12 total, 12 up, 12 in 2024-05-14T15:37:16.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:15 smithi203 ceph-mon[34567]: pgmap v490: 129 pgs: 3 active+clean+snaptrim, 119 active+clean, 7 active+clean+snaptrim_wait; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 60 KiB/s rd, 6.2 MiB/s wr, 682 op/s 2024-05-14T15:37:16.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:15 smithi203 ceph-mon[34567]: osdmap e112: 12 total, 12 up, 12 in 2024-05-14T15:37:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 690.0 s, 495.6 tps, lat 206.837 ms stddev 159.882 2024-05-14T15:37:17.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:16 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:37:17.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:16 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:37:17.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:16 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:37:18.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:17 smithi092 ceph-mon[34729]: pgmap v492: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.0 MiB/s wr, 673 op/s 2024-05-14T15:37:18.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:17 smithi069 ceph-mon[31270]: pgmap v492: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.0 MiB/s wr, 673 op/s 2024-05-14T15:37:18.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:17 smithi203 ceph-mon[34567]: pgmap v492: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 7.0 MiB/s wr, 673 op/s 2024-05-14T15:37:20.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:19 smithi069 ceph-mon[31270]: pgmap v493: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.1 MiB/s wr, 585 op/s 2024-05-14T15:37:20.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:19 smithi069 ceph-mon[31270]: osdmap e113: 12 total, 12 up, 12 in 2024-05-14T15:37:20.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:19 smithi203 ceph-mon[34567]: pgmap v493: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.1 MiB/s wr, 585 op/s 2024-05-14T15:37:20.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:19 smithi203 ceph-mon[34567]: osdmap e113: 12 total, 12 up, 12 in 2024-05-14T15:37:20.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:19 smithi092 ceph-mon[34729]: pgmap v493: 129 pgs: 129 active+clean; 3.0 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 6.1 MiB/s wr, 585 op/s 2024-05-14T15:37:20.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:19 smithi092 ceph-mon[34729]: osdmap e113: 12 total, 12 up, 12 in 2024-05-14T15:37:21.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:21 smithi203 ceph-mon[34567]: pgmap v495: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 6.3 MiB/s wr, 606 op/s 2024-05-14T15:37:21.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 695.0 s, 518.2 tps, lat 194.428 ms stddev 130.191 2024-05-14T15:37:21.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:21 smithi092 ceph-mon[34729]: pgmap v495: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 6.3 MiB/s wr, 606 op/s 2024-05-14T15:37:21.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:21 smithi069 ceph-mon[31270]: pgmap v495: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 6.3 MiB/s wr, 606 op/s 2024-05-14T15:37:23.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:23 smithi092 ceph-mon[34729]: pgmap v496: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 6.8 MiB/s wr, 669 op/s 2024-05-14T15:37:23.726 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:23 smithi069 ceph-mon[31270]: pgmap v496: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 6.8 MiB/s wr, 669 op/s 2024-05-14T15:37:23.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:23 smithi203 ceph-mon[34567]: pgmap v496: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 110 KiB/s rd, 6.8 MiB/s wr, 669 op/s 2024-05-14T15:37:25.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:25 smithi092 ceph-mon[34729]: pgmap v497: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 3.7 MiB/s wr, 405 op/s 2024-05-14T15:37:25.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:25 smithi069 ceph-mon[31270]: pgmap v497: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 3.7 MiB/s wr, 405 op/s 2024-05-14T15:37:25.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:25 smithi203 ceph-mon[34567]: pgmap v497: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 3.7 MiB/s wr, 405 op/s 2024-05-14T15:37:26.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 700.0 s, 561.0 tps, lat 179.672 ms stddev 102.614 2024-05-14T15:37:27.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:27 smithi092 ceph-mon[34729]: pgmap v498: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 5.6 MiB/s wr, 626 op/s 2024-05-14T15:37:27.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:27 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:37:27.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:27 smithi069 ceph-mon[31270]: pgmap v498: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 5.6 MiB/s wr, 626 op/s 2024-05-14T15:37:27.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:27 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:37:27.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:27 smithi203 ceph-mon[34567]: pgmap v498: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 5.6 MiB/s wr, 626 op/s 2024-05-14T15:37:27.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:27 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:37:29.266 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.264+0000 7ff1b0c00640 1 -- 172.21.15.69:0/3960806839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1a40ab830 msgr2=0x7ff1a40ac0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.264+0000 7ff1b0c00640 1 --2- 172.21.15.69:0/3960806839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1a40ab830 0x7ff1a40ac0f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7ff198009900 tx=0x7ff19802a490 comp rx=0 tx=0).stop 2024-05-14T15:37:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.264+0000 7ff1b0c00640 1 -- 172.21.15.69:0/3960806839 shutdown_connections 2024-05-14T15:37:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.264+0000 7ff1b0c00640 1 --2- 172.21.15.69:0/3960806839 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1a40b1260 0x7ff1a40b3680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.264+0000 7ff1b0c00640 1 --2- 172.21.15.69:0/3960806839 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a40abc40 0x7ff1a40ac670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.264+0000 7ff1b0c00640 1 --2- 172.21.15.69:0/3960806839 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1a40ab830 0x7ff1a40ac0f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.267 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.264+0000 7ff1b0c00640 1 -- 172.21.15.69:0/3960806839 >> 172.21.15.69:0/3960806839 conn(0x7ff1a401b300 msgr2=0x7ff1a401b740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:29.270 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.265+0000 7ff1b0c00640 1 -- 172.21.15.69:0/3960806839 shutdown_connections 2024-05-14T15:37:29.270 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.265+0000 7ff1b0c00640 1 -- 172.21.15.69:0/3960806839 wait complete. 2024-05-14T15:37:29.270 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.267+0000 7ff1b0c00640 1 Processor -- start 2024-05-14T15:37:29.270 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.268+0000 7ff1b0c00640 1 -- start start 2024-05-14T15:37:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.269+0000 7ff1b0c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1a40ab830 0x7ff1a413c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.269+0000 7ff1b0c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a40abc40 0x7ff1a413c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.269+0000 7ff1b0c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1a40b1260 0x7ff1a4140bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.269+0000 7ff1b0c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a40b5870 con 0x7ff1a40b1260 2024-05-14T15:37:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.269+0000 7ff1b0c00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a40b56f0 con 0x7ff1a40abc40 2024-05-14T15:37:29.271 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.269+0000 7ff1b0c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff1a40b59f0 con 0x7ff1a40ab830 2024-05-14T15:37:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.270+0000 7ff1ab400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1a40ab830 0x7ff1a413c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.270+0000 7ff1ab400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1a40ab830 0x7ff1a413c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:46490/0 (socket says 172.21.15.69:46490) 2024-05-14T15:37:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.270+0000 7ff1ab400640 1 -- 172.21.15.69:0/1005172958 learned_addr learned my addr 172.21.15.69:0/1005172958 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.270+0000 7ff1aaa00640 1 --2- 172.21.15.69:0/1005172958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a40abc40 0x7ff1a413c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.272 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.271+0000 7ff1ab400640 1 -- 172.21.15.69:0/1005172958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a40abc40 msgr2=0x7ff1a413c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.271+0000 7ff1ab400640 1 --2- 172.21.15.69:0/1005172958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a40abc40 0x7ff1a413c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.271+0000 7ff1ab400640 1 -- 172.21.15.69:0/1005172958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1a40b1260 msgr2=0x7ff1a4140bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.271+0000 7ff1ab400640 1 --2- 172.21.15.69:0/1005172958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1a40b1260 0x7ff1a4140bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.271+0000 7ff1ab400640 1 -- 172.21.15.69:0/1005172958 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1a41411f0 con 0x7ff1a40ab830 2024-05-14T15:37:29.273 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.272+0000 7ff1ab400640 1 --2- 172.21.15.69:0/1005172958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1a40ab830 0x7ff1a413c390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff198000c00 tx=0x7ff198032c30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.272+0000 7ff19fe00640 1 -- 172.21.15.69:0/1005172958 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff19803f030 con 0x7ff1a40ab830 2024-05-14T15:37:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.272+0000 7ff19fe00640 1 -- 172.21.15.69:0/1005172958 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff198031400 con 0x7ff1a40ab830 2024-05-14T15:37:29.274 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.272+0000 7ff1b0c00640 1 -- 172.21.15.69:0/1005172958 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff1a4141480 con 0x7ff1a40ab830 2024-05-14T15:37:29.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.272+0000 7ff1b0c00640 1 -- 172.21.15.69:0/1005172958 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff1a41419c0 con 0x7ff1a40ab830 2024-05-14T15:37:29.275 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.272+0000 7ff19fe00640 1 -- 172.21.15.69:0/1005172958 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198035070 con 0x7ff1a40ab830 2024-05-14T15:37:29.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.281+0000 7ff1b91a3740 1 Processor -- start 2024-05-14T15:37:29.285 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.283+0000 7ff1b91a3740 1 -- start start 2024-05-14T15:37:29.286 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.284+0000 7ff19fe00640 1 -- 172.21.15.69:0/1005172958 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7ff198042030 con 0x7ff1a40ab830 2024-05-14T15:37:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.286+0000 7ff1b91a3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287f51b0 0x557a28b96470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.287+0000 7ff1b91a3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287cc2f0 0x557a28b969b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.287+0000 7ff1b91a3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 0x557a28b96ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.287+0000 7ff1b91a3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x557a28afb550 con 0x557a287f51b0 2024-05-14T15:37:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.287+0000 7ff1b91a3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557a28aa0bc0 con 0x557a287cc2f0 2024-05-14T15:37:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.287+0000 7ff1b91a3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557a28af7510 con 0x557a287d44d0 2024-05-14T15:37:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.287+0000 7ff19fe00640 1 --2- 172.21.15.69:0/1005172958 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff1940b2a60 0x7ff1940b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.287+0000 7ff1abe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287f51b0 0x557a28b96470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.287+0000 7ff19fe00640 1 -- 172.21.15.69:0/1005172958 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9538+0+0 (secure 0 0 0) 0x7ff198102e50 con 0x7ff1a40ab830 2024-05-14T15:37:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.287+0000 7ff1abe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287f51b0 0x557a28b96470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36238/0 (socket says 172.21.15.69:36238) 2024-05-14T15:37:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.287+0000 7ff1abe00640 1 -- 172.21.15.69:0/4027838910 learned_addr learned my addr 172.21.15.69:0/4027838910 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.288+0000 7ff1abe00640 1 --2- 172.21.15.69:0/1005172958 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff1940b2a60 0x7ff1940b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.289+0000 7ff1ab400640 1 --2- 172.21.15.69:0/4027838910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287cc2f0 0x557a28b969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.289+0000 7ff1aaa00640 1 --2- 172.21.15.69:0/4027838910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 0x557a28b96ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.289+0000 7ff1abe00640 1 -- 172.21.15.69:0/4027838910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 msgr2=0x557a28b96ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.289+0000 7ff1abe00640 1 --2- 172.21.15.69:0/4027838910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 0x557a28b96ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.292 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.289+0000 7ff1abe00640 1 -- 172.21.15.69:0/4027838910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287cc2f0 msgr2=0x557a28b969b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.289+0000 7ff1abe00640 1 --2- 172.21.15.69:0/4027838910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287cc2f0 0x557a28b969b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.289+0000 7ff1abe00640 1 -- 172.21.15.69:0/4027838910 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a2880d210 con 0x557a287f51b0 2024-05-14T15:37:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.290+0000 7ff1abe00640 1 --2- 172.21.15.69:0/1005172958 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff1940b2a60 0x7ff1940b4f70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac066580 tx=0x7ff1ac07b000 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.290+0000 7ff1abe00640 1 --2- 172.21.15.69:0/4027838910 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287f51b0 0x557a28b96470 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac02e1f0 tx=0x7ff1ac073a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c5ea915e3e466f server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.291+0000 7ff193e00640 1 -- 172.21.15.69:0/4027838910 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac086d10 con 0x557a287f51b0 2024-05-14T15:37:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.291+0000 7ff193e00640 1 -- 172.21.15.69:0/4027838910 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1ac08a070 con 0x557a287f51b0 2024-05-14T15:37:29.293 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.291+0000 7ff193e00640 1 -- 172.21.15.69:0/4027838910 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac06b2d0 con 0x557a287f51b0 2024-05-14T15:37:29.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.292+0000 7ff1b91a3740 1 -- 172.21.15.69:0/4027838910 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287f51b0 msgr2=0x557a28b96470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:29.294 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.292+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/4027838910 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287f51b0 0x557a28b96470 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac02e1f0 tx=0x7ff1ac073a80 comp rx=0 tx=0).stop 2024-05-14T15:37:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.293+0000 7ff1b91a3740 1 -- 172.21.15.69:0/4027838910 shutdown_connections 2024-05-14T15:37:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.293+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/4027838910 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 0x557a28b96ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.293+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/4027838910 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287cc2f0 0x557a28b969b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.293+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/4027838910 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287f51b0 0x557a28b96470 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.293+0000 7ff1b91a3740 1 -- 172.21.15.69:0/4027838910 >> 172.21.15.69:0/4027838910 conn(0x557a287e9300 msgr2=0x557a28b92c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.294+0000 7ff1b91a3740 1 -- 172.21.15.69:0/4027838910 shutdown_connections 2024-05-14T15:37:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.294+0000 7ff1b91a3740 1 -- 172.21.15.69:0/4027838910 wait complete. 2024-05-14T15:37:29.296 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.294+0000 7ff1b91a3740 1 -- start start 2024-05-14T15:37:29.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.295+0000 7ff1b91a3740 1 Processor -- start 2024-05-14T15:37:29.297 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.295+0000 7ff1b91a3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 0x557a28ba0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.295+0000 7ff1b91a3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287d44d0 0x557a28ba0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.295+0000 7ff1b91a3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287f51b0 0x557a28bac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.295+0000 7ff1b91a3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x557a28ba3540 con 0x557a287cc2f0 2024-05-14T15:37:29.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.296+0000 7ff1b91a3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557a28ab4660 con 0x557a287d44d0 2024-05-14T15:37:29.298 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.296+0000 7ff1b91a3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557a28ba36c0 con 0x557a287f51b0 2024-05-14T15:37:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.296+0000 7ff1b91a3740 10 client.0 _ll_register_callbacks cb 0x557a28a7e400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:37:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.296+0000 7ff1abe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287f51b0 0x557a28bac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.296+0000 7ff1abe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287f51b0 0x557a28bac9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:46510/0 (socket says 172.21.15.69:46510) 2024-05-14T15:37:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.296+0000 7ff1abe00640 1 -- 172.21.15.69:0/2733698531 learned_addr learned my addr 172.21.15.69:0/2733698531 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.296+0000 7ff1ab400640 1 --2- 172.21.15.69:0/2733698531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 0x557a28ba0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.299 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.296+0000 7ff1aaa00640 1 --2- 172.21.15.69:0/2733698531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287d44d0 0x557a28ba0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.297+0000 7ff1ab400640 1 -- 172.21.15.69:0/2733698531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287f51b0 msgr2=0x557a28bac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.297+0000 7ff1ab400640 1 --2- 172.21.15.69:0/2733698531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287f51b0 0x557a28bac9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.297+0000 7ff1ab400640 1 -- 172.21.15.69:0/2733698531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287d44d0 msgr2=0x557a28ba0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.297+0000 7ff1ab400640 1 --2- 172.21.15.69:0/2733698531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287d44d0 0x557a28ba0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.300 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.297+0000 7ff1ab400640 1 -- 172.21.15.69:0/2733698531 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a288d9620 con 0x557a287cc2f0 2024-05-14T15:37:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.298+0000 7ff1ab400640 1 --2- 172.21.15.69:0/2733698531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 0x557a28ba0900 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff198100140 tx=0x7ff1981005f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15cb9e1bfec4601a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.298+0000 7ff190c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:37:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.298+0000 7ff190c00640 1 -- 172.21.15.69:0/2733698531 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff198032e20 con 0x557a287cc2f0 2024-05-14T15:37:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.298+0000 7ff190c00640 1 -- 172.21.15.69:0/2733698531 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9538+0+0 (secure 0 0 0) 0x7ff1980d28b0 con 0x557a287cc2f0 2024-05-14T15:37:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.298+0000 7ff1b91a3740 1 -- 172.21.15.69:0/2733698531 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1ac08a070 con 0x557a287cc2f0 2024-05-14T15:37:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.298+0000 7ff190c00640 1 -- 172.21.15.69:0/2733698531 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7ff1980e9050 con 0x557a287cc2f0 2024-05-14T15:37:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.298+0000 7ff1b91a3740 10 client.17316 fetch_fsmap learned FSMap version 69 2024-05-14T15:37:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.298+0000 7ff1b91a3740 1 -- 172.21.15.69:0/2733698531 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x557a28baf720 con 0x557a287cc2f0 2024-05-14T15:37:29.301 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.299+0000 7ff190c00640 1 -- 172.21.15.69:0/2733698531 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1ac08a070 con 0x557a287cc2f0 2024-05-14T15:37:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.300+0000 7ff190c00640 1 -- 172.21.15.69:0/2733698531 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 69) ==== 8378+0+0 (secure 0 0 0) 0x7ff198038a10 con 0x557a287cc2f0 2024-05-14T15:37:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.300+0000 7ff1b91a3740 10 client.17316 fetch_fsmap finished waiting for FSMap version 69 2024-05-14T15:37:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.300+0000 7ff1b91a3740 10 client.17316 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:37:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.300+0000 7ff1b91a3740 20 client.17316 populate_metadata read hostname 'smithi069' 2024-05-14T15:37:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.300+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/2733698531 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557a287b3d80 0x557a28bb2d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.302 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.300+0000 7ff1b91a3740 4 client.17316 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:37:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.300+0000 7ff1b91a3740 1 -- 172.21.15.69:0/2733698531 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a28b09160 con 0x557a287b3d80 2024-05-14T15:37:29.303 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.301+0000 7ff1aaa00640 1 --2- 172.21.15.69:0/2733698531 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557a287b3d80 0x557a28bb2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.302+0000 7ff1aaa00640 1 --2- 172.21.15.69:0/2733698531 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557a287b3d80 0x557a28bb2d40 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7bd81862e0f37ce5 server_cookie=5fbbd60e4ad6b47d in_seq=0 out_seq=0 2024-05-14T15:37:29.304 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.302+0000 7ff190c00640 10 client.17316 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.304+0000 7ff190c00640 1 -- 172.21.15.69:0/2733698531 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557a28b09160 con 0x557a287b3d80 2024-05-14T15:37:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.304+0000 7ff190c00640 10 client.17316 handle_command_reply: tid=0 2024-05-14T15:37:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.304+0000 7ff1b91a3740 1 client.17316 shutdown 2024-05-14T15:37:29.307 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.304+0000 7ff1b91a3740 1 -- 172.21.15.69:0/2733698531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 msgr2=0x557a28ba0900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.304+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/2733698531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 0x557a28ba0900 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7ff198100140 tx=0x7ff1981005f0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.305+0000 7ff1b91a3740 1 -- 172.21.15.69:0/2733698531 shutdown_connections 2024-05-14T15:37:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.305+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/2733698531 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287f51b0 0x557a28bac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.305+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/2733698531 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287d44d0 0x557a28ba0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.305+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/2733698531 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557a287b3d80 0x557a28bb2d40 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.305+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/2733698531 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 0x557a28ba0900 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.305+0000 7ff1b91a3740 1 -- 172.21.15.69:0/2733698531 >> 172.21.15.69:0/2733698531 conn(0x557a287e9300 msgr2=0x557a28b962a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.305+0000 7ff190c00640 0 client.17316 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:29.308 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.305+0000 7ff1b91a3740 1 -- 172.21.15.69:0/2733698531 shutdown_connections 2024-05-14T15:37:29.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.306+0000 7ff1b91a3740 1 -- 172.21.15.69:0/2733698531 wait complete. 2024-05-14T15:37:29.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.306+0000 7ff1b91a3740 20 client.17316 trim_cache size 0 max 16384 2024-05-14T15:37:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.352+0000 7ff1b91a3740 1 Processor -- start 2024-05-14T15:37:29.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.352+0000 7ff1b91a3740 1 -- start start 2024-05-14T15:37:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.353+0000 7ff1b91a3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 0x557a28bb8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.353+0000 7ff1b91a3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 0x557a28bb8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.353+0000 7ff1b91a3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287f51b0 0x557a28bac5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.353+0000 7ff1b91a3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c010070 con 0x557a287cc2f0 2024-05-14T15:37:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.353+0000 7ff1b91a3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c011c40 con 0x557a287f51b0 2024-05-14T15:37:29.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.353+0000 7ff1b91a3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c010740 con 0x557a287d44d0 2024-05-14T15:37:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.354+0000 7ff1ab400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 0x557a28bb8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.354+0000 7ff1ab400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 0x557a28bb8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36262/0 (socket says 172.21.15.69:36262) 2024-05-14T15:37:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.354+0000 7ff1ab400640 1 -- 172.21.15.69:0/2323516790 learned_addr learned my addr 172.21.15.69:0/2323516790 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.354+0000 7ff1abe00640 1 --2- 172.21.15.69:0/2323516790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287f51b0 0x557a28bac5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.354+0000 7ff1aaa00640 1 --2- 172.21.15.69:0/2323516790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 0x557a28bb8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.354+0000 7ff1abe00640 1 -- 172.21.15.69:0/2323516790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 msgr2=0x557a28bb8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.354+0000 7ff1abe00640 1 --2- 172.21.15.69:0/2323516790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 0x557a28bb8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.354+0000 7ff1abe00640 1 -- 172.21.15.69:0/2323516790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 msgr2=0x557a28bb8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.354+0000 7ff1abe00640 1 --2- 172.21.15.69:0/2323516790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 0x557a28bb8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.355+0000 7ff1abe00640 1 -- 172.21.15.69:0/2323516790 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a28b97210 con 0x557a287f51b0 2024-05-14T15:37:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.355+0000 7ff1ab400640 1 --2- 172.21.15.69:0/2323516790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 0x557a28bb8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:37:29.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.355+0000 7ff1aaa00640 1 --2- 172.21.15.69:0/2323516790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 0x557a28bb8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:37:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.355+0000 7ff1abe00640 1 --2- 172.21.15.69:0/2323516790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287f51b0 0x557a28bac5d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac051dc0 tx=0x7ff1ac068f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=de89bf4750b655ed server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.356+0000 7ff193400640 1 -- 172.21.15.69:0/2323516790 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac09f070 con 0x557a287f51b0 2024-05-14T15:37:29.358 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.356+0000 7ff193400640 1 -- 172.21.15.69:0/2323516790 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1ac08a070 con 0x557a287f51b0 2024-05-14T15:37:29.359 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.357+0000 7ff193400640 1 -- 172.21.15.69:0/2323516790 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1ac069a70 con 0x557a287f51b0 2024-05-14T15:37:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.358+0000 7ff1b91a3740 1 -- 172.21.15.69:0/2323516790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287f51b0 msgr2=0x557a28bac5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.358+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/2323516790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287f51b0 0x557a28bac5d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac051dc0 tx=0x7ff1ac068f90 comp rx=0 tx=0).stop 2024-05-14T15:37:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.359+0000 7ff1b91a3740 1 -- 172.21.15.69:0/2323516790 shutdown_connections 2024-05-14T15:37:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.359+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/2323516790 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287f51b0 0x557a28bac5d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.359+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/2323516790 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 0x557a28bb8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.359+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/2323516790 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 0x557a28bb8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.359+0000 7ff1b91a3740 1 -- 172.21.15.69:0/2323516790 >> 172.21.15.69:0/2323516790 conn(0x557a287e9300 msgr2=0x557a28b91c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.359+0000 7ff1b91a3740 1 -- 172.21.15.69:0/2323516790 shutdown_connections 2024-05-14T15:37:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.360+0000 7ff1b91a3740 1 -- 172.21.15.69:0/2323516790 wait complete. 2024-05-14T15:37:29.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.360+0000 7ff1b91a3740 1 -- start start 2024-05-14T15:37:29.363 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.361+0000 7ff1b91a3740 1 Processor -- start 2024-05-14T15:37:29.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.362+0000 7ff1b91a3740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 0x557a28ba8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.362+0000 7ff1b91a3740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 0x557a28ba3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.362+0000 7ff1b91a3740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287f51b0 0x557a28ba4510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.362+0000 7ff1b91a3740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c011570 con 0x557a287cc2f0 2024-05-14T15:37:29.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.362+0000 7ff1b91a3740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c010e10 con 0x557a287f51b0 2024-05-14T15:37:29.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.362+0000 7ff1b91a3740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7ff18c00e070 con 0x557a287d44d0 2024-05-14T15:37:29.365 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.362+0000 7ff1b91a3740 10 client.0 _ll_register_callbacks cb 0x7ff198005ec0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:37:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.363+0000 7ff1abe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287f51b0 0x557a28ba4510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.363+0000 7ff1abe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287f51b0 0x557a28ba4510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:50236/0 (socket says 172.21.15.69:50236) 2024-05-14T15:37:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.363+0000 7ff1abe00640 1 -- 172.21.15.69:0/381105638 learned_addr learned my addr 172.21.15.69:0/381105638 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.363+0000 7ff1aaa00640 1 --2- 172.21.15.69:0/381105638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 0x557a28ba3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.363+0000 7ff1ab400640 1 --2- 172.21.15.69:0/381105638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 0x557a28ba8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.364+0000 7ff1ab400640 1 -- 172.21.15.69:0/381105638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 msgr2=0x557a28ba3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.364+0000 7ff1ab400640 1 --2- 172.21.15.69:0/381105638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 0x557a28ba3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.364+0000 7ff1ab400640 1 -- 172.21.15.69:0/381105638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287f51b0 msgr2=0x557a28ba4510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.364+0000 7ff1ab400640 1 --2- 172.21.15.69:0/381105638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287f51b0 0x557a28ba4510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.364+0000 7ff1ab400640 1 -- 172.21.15.69:0/381105638 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a28ba4a50 con 0x557a287cc2f0 2024-05-14T15:37:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.365+0000 7ff1ab400640 1 --2- 172.21.15.69:0/381105638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 0x557a28ba8c80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff198100740 tx=0x7ff1980092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d2d53c680fb273c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.365+0000 7ff190c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:37:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.367+0000 7ff1abe00640 1 --2- 172.21.15.69:0/381105638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287f51b0 0x557a28ba4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:37:29.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.368+0000 7ff1aaa00640 1 --2- 172.21.15.69:0/381105638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 0x557a28ba3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:37:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.368+0000 7ff190c00640 1 -- 172.21.15.69:0/381105638 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1980c9440 con 0x557a287cc2f0 2024-05-14T15:37:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.368+0000 7ff190c00640 1 -- 172.21.15.69:0/381105638 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9538+0+0 (secure 0 0 0) 0x7ff1980c5870 con 0x557a287cc2f0 2024-05-14T15:37:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.369+0000 7ff1b91a3740 1 -- 172.21.15.69:0/381105638 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff1ac08a070 con 0x557a287cc2f0 2024-05-14T15:37:29.371 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.369+0000 7ff190c00640 1 -- 172.21.15.69:0/381105638 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=69) ==== 24+0+0 (secure 0 0 0) 0x7ff1980ca3d0 con 0x557a287cc2f0 2024-05-14T15:37:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.370+0000 7ff1b91a3740 10 client.17322 fetch_fsmap learned FSMap version 69 2024-05-14T15:37:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.370+0000 7ff1b91a3740 1 -- 172.21.15.69:0/381105638 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=69,monmap=4+}) -- 0x557a28c1ad50 con 0x557a287cc2f0 2024-05-14T15:37:29.372 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.371+0000 7ff190c00640 1 -- 172.21.15.69:0/381105638 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7ff1ac08a070 con 0x557a287cc2f0 2024-05-14T15:37:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.371+0000 7ff190c00640 1 -- 172.21.15.69:0/381105638 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 69) ==== 8378+0+0 (secure 0 0 0) 0x7ff1980c89a0 con 0x557a287cc2f0 2024-05-14T15:37:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.371+0000 7ff1b91a3740 10 client.17322 fetch_fsmap finished waiting for FSMap version 69 2024-05-14T15:37:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.371+0000 7ff1b91a3740 10 client.17322 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:37:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.371+0000 7ff1b91a3740 20 client.17322 populate_metadata read hostname 'smithi069' 2024-05-14T15:37:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.371+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/381105638 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557a287891c0 0x557a28c1d300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:29.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.371+0000 7ff1b91a3740 4 client.17322 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:37:29.374 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.371+0000 7ff1b91a3740 1 -- 172.21.15.69:0/381105638 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557a28b02fd0 con 0x557a287891c0 2024-05-14T15:37:29.375 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.373+0000 7ff1aaa00640 1 --2- 172.21.15.69:0/381105638 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557a287891c0 0x557a28c1d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.374+0000 7ff1aaa00640 1 --2- 172.21.15.69:0/381105638 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557a287891c0 0x557a28c1d300 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d186570c4f6331a server_cookie=3191f8c0867d1f4a in_seq=0 out_seq=0 2024-05-14T15:37:29.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.374+0000 7ff190c00640 10 client.17322 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:29.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.412+0000 7ff190c00640 1 -- 172.21.15.69:0/381105638 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557a28b02fd0 con 0x557a287891c0 2024-05-14T15:37:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.412+0000 7ff190c00640 10 client.17322 handle_command_reply: tid=0 2024-05-14T15:37:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.412+0000 7ff1b91a3740 1 client.17322 shutdown 2024-05-14T15:37:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.413+0000 7ff1b91a3740 1 -- 172.21.15.69:0/381105638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 msgr2=0x557a28ba8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.413+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/381105638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 0x557a28ba8c80 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff198100740 tx=0x7ff1980092b0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.413+0000 7ff1b91a3740 1 -- 172.21.15.69:0/381105638 shutdown_connections 2024-05-14T15:37:29.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.413+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/381105638 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557a287f51b0 0x557a28ba4510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.413+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/381105638 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557a287d44d0 0x557a28ba3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.413+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/381105638 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557a287891c0 0x557a28c1d300 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.413+0000 7ff1b91a3740 1 --2- 172.21.15.69:0/381105638 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557a287cc2f0 0x557a28ba8c80 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.413+0000 7ff1b91a3740 1 -- 172.21.15.69:0/381105638 >> 172.21.15.69:0/381105638 conn(0x557a287e9300 msgr2=0x557a28b91c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.413+0000 7ff190c00640 0 client.17322 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.414+0000 7ff1b91a3740 1 -- 172.21.15.69:0/381105638 shutdown_connections 2024-05-14T15:37:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.414+0000 7ff1b91a3740 1 -- 172.21.15.69:0/381105638 wait complete. 2024-05-14T15:37:29.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.414+0000 7ff1b91a3740 20 client.17322 trim_cache size 0 max 16384 2024-05-14T15:37:29.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:37:29.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:37:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:37:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:37:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.415+0000 7ff1b0c00640 1 -- 172.21.15.69:0/1005172958 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff1940b2a60 msgr2=0x7ff1940b4f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.415+0000 7ff1b0c00640 1 --2- 172.21.15.69:0/1005172958 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff1940b2a60 0x7ff1940b4f70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff1ac066580 tx=0x7ff1ac07b000 comp rx=0 tx=0).stop 2024-05-14T15:37:29.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.415+0000 7ff1b0c00640 1 -- 172.21.15.69:0/1005172958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1a40ab830 msgr2=0x7ff1a413c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.415+0000 7ff1b0c00640 1 --2- 172.21.15.69:0/1005172958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1a40ab830 0x7ff1a413c390 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff198000c00 tx=0x7ff198032c30 comp rx=0 tx=0).stop 2024-05-14T15:37:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.416+0000 7ff1b0c00640 1 -- 172.21.15.69:0/1005172958 shutdown_connections 2024-05-14T15:37:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.416+0000 7ff1b0c00640 1 --2- 172.21.15.69:0/1005172958 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7ff1940b2a60 0x7ff1940b4f70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.416+0000 7ff1b0c00640 1 --2- 172.21.15.69:0/1005172958 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7ff1a40b1260 0x7ff1a4140bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.416+0000 7ff1b0c00640 1 --2- 172.21.15.69:0/1005172958 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7ff1a40abc40 0x7ff1a413c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.416+0000 7ff1b0c00640 1 --2- 172.21.15.69:0/1005172958 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7ff1a40ab830 0x7ff1a413c390 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.416+0000 7ff1b0c00640 1 -- 172.21.15.69:0/1005172958 >> 172.21.15.69:0/1005172958 conn(0x7ff1a401b300 msgr2=0x7ff1a40ad220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.416+0000 7ff1b0c00640 1 -- 172.21.15.69:0/1005172958 shutdown_connections 2024-05-14T15:37:29.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:29.416+0000 7ff1b0c00640 1 -- 172.21.15.69:0/1005172958 wait complete. 2024-05-14T15:37:29.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:29 smithi069 ceph-mon[31270]: pgmap v499: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 5.6 MiB/s wr, 626 op/s 2024-05-14T15:37:29.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:29 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:37:29.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:29 smithi203 ceph-mon[34567]: pgmap v499: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 5.6 MiB/s wr, 626 op/s 2024-05-14T15:37:29.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:29 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:37:29.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:29 smithi092 ceph-mon[34729]: pgmap v499: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 5.6 MiB/s wr, 626 op/s 2024-05-14T15:37:29.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:29 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:37:31.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 705.0 s, 536.4 tps, lat 184.738 ms stddev 116.973 2024-05-14T15:37:31.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:31 smithi069 ceph-mon[31270]: pgmap v500: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.4 MiB/s wr, 614 op/s 2024-05-14T15:37:31.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:31 smithi203 ceph-mon[34567]: pgmap v500: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.4 MiB/s wr, 614 op/s 2024-05-14T15:37:31.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:31 smithi092 ceph-mon[34729]: pgmap v500: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.4 MiB/s wr, 614 op/s 2024-05-14T15:37:32.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:32 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:37:32.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:32 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:37:32.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:32 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:37:33.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:33 smithi203 ceph-mon[34567]: pgmap v501: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.2 MiB/s wr, 600 op/s 2024-05-14T15:37:33.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:33 smithi092 ceph-mon[34729]: pgmap v501: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.2 MiB/s wr, 600 op/s 2024-05-14T15:37:33.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:33 smithi069 ceph-mon[31270]: pgmap v501: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 5.2 MiB/s wr, 600 op/s 2024-05-14T15:37:36.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:35 smithi092 ceph-mon[34729]: pgmap v502: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.8 MiB/s wr, 554 op/s 2024-05-14T15:37:36.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:35 smithi069 ceph-mon[31270]: pgmap v502: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.8 MiB/s wr, 554 op/s 2024-05-14T15:37:36.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:35 smithi203 ceph-mon[34567]: pgmap v502: 129 pgs: 129 active+clean; 3.1 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.8 MiB/s wr, 554 op/s 2024-05-14T15:37:36.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 710.0 s, 580.8 tps, lat 171.767 ms stddev 88.967 2024-05-14T15:37:38.195 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:37 smithi092 ceph-mon[34729]: pgmap v503: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 7.0 MiB/s wr, 791 op/s 2024-05-14T15:37:38.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:37 smithi069 ceph-mon[31270]: pgmap v503: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 7.0 MiB/s wr, 791 op/s 2024-05-14T15:37:38.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:37 smithi203 ceph-mon[34567]: pgmap v503: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 7.0 MiB/s wr, 791 op/s 2024-05-14T15:37:40.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:39 smithi069 ceph-mon[31270]: pgmap v504: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 4.8 MiB/s wr, 539 op/s 2024-05-14T15:37:40.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:39 smithi203 ceph-mon[34567]: pgmap v504: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 4.8 MiB/s wr, 539 op/s 2024-05-14T15:37:40.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:39 smithi092 ceph-mon[34729]: pgmap v504: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 4.8 MiB/s wr, 539 op/s 2024-05-14T15:37:41.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 715.0 s, 507.4 tps, lat 193.050 ms stddev 118.205 2024-05-14T15:37:42.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:41 smithi069 ceph-mon[31270]: pgmap v505: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.2 MiB/s wr, 714 op/s 2024-05-14T15:37:42.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:41 smithi203 ceph-mon[34567]: pgmap v505: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.2 MiB/s wr, 714 op/s 2024-05-14T15:37:42.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:41 smithi092 ceph-mon[34729]: pgmap v505: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 69 KiB/s rd, 6.2 MiB/s wr, 714 op/s 2024-05-14T15:37:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.826+0000 7fef84200640 1 -- 172.21.15.69:0/1460200547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c114b10 msgr2=0x7fef7c116f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.828+0000 7fef84200640 1 --2- 172.21.15.69:0/1460200547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c114b10 0x7fef7c116f30 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fef70009900 tx=0x7fef7002a420 comp rx=0 tx=0).stop 2024-05-14T15:37:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.828+0000 7fef84200640 1 -- 172.21.15.69:0/1460200547 shutdown_connections 2024-05-14T15:37:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.828+0000 7fef84200640 1 --2- 172.21.15.69:0/1460200547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c114b10 0x7fef7c116f30 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.828+0000 7fef84200640 1 --2- 172.21.15.69:0/1460200547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef7c1121b0 0x7fef7c1145d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.828+0000 7fef84200640 1 --2- 172.21.15.69:0/1460200547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c077620 0x7fef7c077a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.829 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.828+0000 7fef84200640 1 -- 172.21.15.69:0/1460200547 >> 172.21.15.69:0/1460200547 conn(0x7fef7c101540 msgr2=0x7fef7c103990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:42.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.828+0000 7fef84200640 1 -- 172.21.15.69:0/1460200547 shutdown_connections 2024-05-14T15:37:42.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.828+0000 7fef84200640 1 -- 172.21.15.69:0/1460200547 wait complete. 2024-05-14T15:37:42.830 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.830+0000 7fef84200640 1 Processor -- start 2024-05-14T15:37:42.831 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.830+0000 7fef84200640 1 -- start start 2024-05-14T15:37:42.831 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.830+0000 7fef84200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c077620 0x7fef7c1a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.831+0000 7fef84200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef7c1121b0 0x7fef7c1a1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.831+0000 7fef84200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c114b10 0x7fef7c1a5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.831+0000 7fef84200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c11a410 con 0x7fef7c1121b0 2024-05-14T15:37:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.831+0000 7fef84200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c11a290 con 0x7fef7c114b10 2024-05-14T15:37:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.831+0000 7fef84200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c11a590 con 0x7fef7c077620 2024-05-14T15:37:42.832 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.831+0000 7fef81800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c077620 0x7fef7c1a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.831+0000 7fef81800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c077620 0x7fef7c1a0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:47408/0 (socket says 172.21.15.69:47408) 2024-05-14T15:37:42.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.831+0000 7fef81800640 1 -- 172.21.15.69:0/1780461894 learned_addr learned my addr 172.21.15.69:0/1780461894 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:42.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.831+0000 7fef82200640 1 --2- 172.21.15.69:0/1780461894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c114b10 0x7fef7c1a5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.832+0000 7fef80e00640 1 --2- 172.21.15.69:0/1780461894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef7c1121b0 0x7fef7c1a1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.832+0000 7fef81800640 1 -- 172.21.15.69:0/1780461894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c114b10 msgr2=0x7fef7c1a5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:42.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.832+0000 7fef81800640 1 --2- 172.21.15.69:0/1780461894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c114b10 0x7fef7c1a5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.832+0000 7fef81800640 1 -- 172.21.15.69:0/1780461894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef7c1121b0 msgr2=0x7fef7c1a1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:42.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.832+0000 7fef81800640 1 --2- 172.21.15.69:0/1780461894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef7c1121b0 0x7fef7c1a1350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.832+0000 7fef81800640 1 -- 172.21.15.69:0/1780461894 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7c1a5c50 con 0x7fef7c077620 2024-05-14T15:37:42.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.833+0000 7fef81800640 1 --2- 172.21.15.69:0/1780461894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c077620 0x7fef7c1a0df0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fef7400eb90 tx=0x7fef7400ef90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:42.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.833+0000 7fef7a000640 1 -- 172.21.15.69:0/1780461894 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74004b20 con 0x7fef7c077620 2024-05-14T15:37:42.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.833+0000 7fef7a000640 1 -- 172.21.15.69:0/1780461894 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef74004cc0 con 0x7fef7c077620 2024-05-14T15:37:42.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.833+0000 7fef7a000640 1 -- 172.21.15.69:0/1780461894 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef74010690 con 0x7fef7c077620 2024-05-14T15:37:42.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.833+0000 7fef84200640 1 -- 172.21.15.69:0/1780461894 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef7c1a5f40 con 0x7fef7c077620 2024-05-14T15:37:42.835 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.833+0000 7fef84200640 1 -- 172.21.15.69:0/1780461894 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef7c1a6440 con 0x7fef7c077620 2024-05-14T15:37:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.841+0000 7fef8b1e6740 1 Processor -- start 2024-05-14T15:37:42.842 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.841+0000 7fef7a000640 1 -- 172.21.15.69:0/1780461894 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fef74005020 con 0x7fef7c077620 2024-05-14T15:37:42.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.842+0000 7fef8b1e6740 1 -- start start 2024-05-14T15:37:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.842+0000 7fef8b1e6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdcc71b0 0x5631be068280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.843+0000 7fef8b1e6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be0687c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.843+0000 7fef8b1e6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdca64d0 0x5631be068d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.843+0000 7fef8b1e6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5631bdfcd550 con 0x5631bdcc71b0 2024-05-14T15:37:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.843+0000 7fef8b1e6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5631bdf72bc0 con 0x5631bdca64d0 2024-05-14T15:37:42.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.843+0000 7fef8b1e6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5631bdfc9510 con 0x5631bdc9e2f0 2024-05-14T15:37:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.843+0000 7fef80e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdca64d0 0x5631be068d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.843+0000 7fef80e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdca64d0 0x5631be068d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:44312/0 (socket says 172.21.15.69:44312) 2024-05-14T15:37:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.843+0000 7fef80e00640 1 -- 172.21.15.69:0/4244723351 learned_addr learned my addr 172.21.15.69:0/4244723351 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.844+0000 7fef81800640 1 --2- 172.21.15.69:0/4244723351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be0687c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.844+0000 7fef81800640 1 -- 172.21.15.69:0/4244723351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdca64d0 msgr2=0x5631be068d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:42.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.844+0000 7fef81800640 1 --2- 172.21.15.69:0/4244723351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdca64d0 0x5631be068d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.844+0000 7fef81800640 1 -- 172.21.15.69:0/4244723351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdcc71b0 msgr2=0x5631be068280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.844+0000 7fef81800640 1 --2- 172.21.15.69:0/4244723351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdcc71b0 0x5631be068280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.844+0000 7fef7a000640 1 --2- 172.21.15.69:0/1780461894 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fef640b29d0 0x7fef640b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.844+0000 7fef81800640 1 -- 172.21.15.69:0/4244723351 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631bdcdf210 con 0x5631bdc9e2f0 2024-05-14T15:37:42.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.845+0000 7fef7a000640 1 -- 172.21.15.69:0/1780461894 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9538+0+0 (secure 0 0 0) 0x7fef740e3080 con 0x7fef7c077620 2024-05-14T15:37:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.845+0000 7fef81800640 1 --2- 172.21.15.69:0/4244723351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be0687c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fef740e0370 tx=0x7fef740e6f50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f818c207e275feef server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.846+0000 7fef6ea00640 1 -- 172.21.15.69:0/4244723351 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef740a9cd0 con 0x5631bdc9e2f0 2024-05-14T15:37:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.846+0000 7fef6ea00640 1 -- 172.21.15.69:0/4244723351 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef740a9a10 con 0x5631bdc9e2f0 2024-05-14T15:37:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.846+0000 7fef6ea00640 1 -- 172.21.15.69:0/4244723351 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef740a9670 con 0x5631bdc9e2f0 2024-05-14T15:37:42.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.846+0000 7fef82200640 1 --2- 172.21.15.69:0/1780461894 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fef640b29d0 0x7fef640b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.848+0000 7fef8b1e6740 1 -- 172.21.15.69:0/4244723351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 msgr2=0x5631be0687c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.848+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/4244723351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be0687c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fef740e0370 tx=0x7fef740e6f50 comp rx=0 tx=0).stop 2024-05-14T15:37:42.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.849+0000 7fef8b1e6740 1 -- 172.21.15.69:0/4244723351 shutdown_connections 2024-05-14T15:37:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.849+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/4244723351 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdca64d0 0x5631be068d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.849+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/4244723351 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be0687c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.849+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/4244723351 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdcc71b0 0x5631be068280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.849+0000 7fef8b1e6740 1 -- 172.21.15.69:0/4244723351 >> 172.21.15.69:0/4244723351 conn(0x5631bdcbb300 msgr2=0x5631be064a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:42.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.850+0000 7fef8b1e6740 1 -- 172.21.15.69:0/4244723351 shutdown_connections 2024-05-14T15:37:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.850+0000 7fef8b1e6740 1 -- 172.21.15.69:0/4244723351 wait complete. 2024-05-14T15:37:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.851+0000 7fef8b1e6740 1 -- start start 2024-05-14T15:37:42.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.851+0000 7fef8b1e6740 1 Processor -- start 2024-05-14T15:37:42.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.852+0000 7fef82200640 1 --2- 172.21.15.69:0/1780461894 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fef640b29d0 0x7fef640b4ee0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fef70005d90 tx=0x7fef70005fd0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:42.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.854+0000 7fef8b1e6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.855+0000 7fef8b1e6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdca64d0 0x5631be072cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.855+0000 7fef8b1e6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdcc71b0 0x5631be07e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.855+0000 7fef81800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.855+0000 7fef81800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be072770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:47426/0 (socket says 172.21.15.69:47426) 2024-05-14T15:37:42.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.856+0000 7fef81800640 1 -- 172.21.15.69:0/2660119837 learned_addr learned my addr 172.21.15.69:0/2660119837 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.856+0000 7fef8b1e6740 1 -- 172.21.15.69:0/2660119837 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5631be0753b0 con 0x5631bdcc71b0 2024-05-14T15:37:42.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.856+0000 7fef8b1e6740 1 -- 172.21.15.69:0/2660119837 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5631bdf86660 con 0x5631bdca64d0 2024-05-14T15:37:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.856+0000 7fef8b1e6740 1 -- 172.21.15.69:0/2660119837 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5631be075530 con 0x5631bdc9e2f0 2024-05-14T15:37:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.856+0000 7fef8b1e6740 10 client.0 _ll_register_callbacks cb 0x5631bdf50400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:37:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.856+0000 7fef82200640 1 --2- 172.21.15.69:0/2660119837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdcc71b0 0x5631be07e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.857+0000 7fef80e00640 1 --2- 172.21.15.69:0/2660119837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdca64d0 0x5631be072cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.858+0000 7fef82200640 1 -- 172.21.15.69:0/2660119837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 msgr2=0x5631be072770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:42.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.858+0000 7fef82200640 1 --2- 172.21.15.69:0/2660119837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be072770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.858+0000 7fef82200640 1 -- 172.21.15.69:0/2660119837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdca64d0 msgr2=0x5631be072cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.858+0000 7fef82200640 1 --2- 172.21.15.69:0/2660119837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdca64d0 0x5631be072cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.859 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.858+0000 7fef82200640 1 -- 172.21.15.69:0/2660119837 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631bddab620 con 0x5631bdcc71b0 2024-05-14T15:37:42.862 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.861+0000 7fef82200640 1 --2- 172.21.15.69:0/2660119837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdcc71b0 0x5631be07e860 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fef7002aa10 tx=0x7fef7002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9273fdd5b06e01fb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:42.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.861+0000 7fef63400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:37:42.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.862+0000 7fef63400640 1 -- 172.21.15.69:0/2660119837 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef7004d020 con 0x5631bdcc71b0 2024-05-14T15:37:42.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.862+0000 7fef63400640 1 -- 172.21.15.69:0/2660119837 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9538+0+0 (secure 0 0 0) 0x7fef70049680 con 0x5631bdcc71b0 2024-05-14T15:37:42.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.863+0000 7fef8b1e6740 1 -- 172.21.15.69:0/2660119837 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef740a9a10 con 0x5631bdcc71b0 2024-05-14T15:37:42.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.865+0000 7fef63400640 1 -- 172.21.15.69:0/2660119837 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fef70035040 con 0x5631bdcc71b0 2024-05-14T15:37:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.866+0000 7fef8b1e6740 10 client.17328 fetch_fsmap learned FSMap version 70 2024-05-14T15:37:42.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.866+0000 7fef8b1e6740 1 -- 172.21.15.69:0/2660119837 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x5631be081610 con 0x5631bdcc71b0 2024-05-14T15:37:42.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.873+0000 7fef63400640 1 -- 172.21.15.69:0/2660119837 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef740a9a10 con 0x5631bdcc71b0 2024-05-14T15:37:42.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.873+0000 7fef63400640 1 -- 172.21.15.69:0/2660119837 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 70) ==== 8390+0+0 (secure 0 0 0) 0x7fef7003c7c0 con 0x5631bdcc71b0 2024-05-14T15:37:42.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.874+0000 7fef8b1e6740 10 client.17328 fetch_fsmap finished waiting for FSMap version 70 2024-05-14T15:37:42.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.874+0000 7fef8b1e6740 10 client.17328 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:37:42.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.874+0000 7fef8b1e6740 20 client.17328 populate_metadata read hostname 'smithi069' 2024-05-14T15:37:42.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.875+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/2660119837 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5631bdc85d80 0x5631be084ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.875+0000 7fef8b1e6740 4 client.17328 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:37:42.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.875+0000 7fef8b1e6740 1 -- 172.21.15.69:0/2660119837 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5631bdfdb160 con 0x5631bdc85d80 2024-05-14T15:37:42.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.876+0000 7fef81800640 1 --2- 172.21.15.69:0/2660119837 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5631bdc85d80 0x5631be084ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.877+0000 7fef81800640 1 --2- 172.21.15.69:0/2660119837 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5631bdc85d80 0x5631be084ab0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e53acd2f5a0219da server_cookie=5fa4fa3591bb5e51 in_seq=0 out_seq=0 2024-05-14T15:37:42.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.877+0000 7fef63400640 10 client.17328 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:42.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.878+0000 7fef63400640 1 -- 172.21.15.69:0/2660119837 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5631bdfdb160 con 0x5631bdc85d80 2024-05-14T15:37:42.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.878+0000 7fef63400640 10 client.17328 handle_command_reply: tid=0 2024-05-14T15:37:42.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.878+0000 7fef8b1e6740 1 client.17328 shutdown 2024-05-14T15:37:42.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.879+0000 7fef8b1e6740 1 -- 172.21.15.69:0/2660119837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdcc71b0 msgr2=0x5631be07e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:42.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.879+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/2660119837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdcc71b0 0x5631be07e860 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fef7002aa10 tx=0x7fef7002a420 comp rx=0 tx=0).stop 2024-05-14T15:37:42.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.879+0000 7fef8b1e6740 1 -- 172.21.15.69:0/2660119837 shutdown_connections 2024-05-14T15:37:42.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.879+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/2660119837 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5631bdc85d80 0x5631be084ab0 crc :-1 s=READY pgs=230 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.879+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/2660119837 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdcc71b0 0x5631be07e860 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.879+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/2660119837 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdca64d0 0x5631be072cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.879+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/2660119837 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be072770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.879+0000 7fef8b1e6740 1 -- 172.21.15.69:0/2660119837 >> 172.21.15.69:0/2660119837 conn(0x5631bdcbb300 msgr2=0x5631be069fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:42.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.879+0000 7fef63400640 0 client.17328 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:42.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.879+0000 7fef8b1e6740 1 -- 172.21.15.69:0/2660119837 shutdown_connections 2024-05-14T15:37:42.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.880+0000 7fef8b1e6740 1 -- 172.21.15.69:0/2660119837 wait complete. 2024-05-14T15:37:42.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.880+0000 7fef8b1e6740 20 client.17328 trim_cache size 0 max 16384 2024-05-14T15:37:42.917 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.916+0000 7fef8b1e6740 1 Processor -- start 2024-05-14T15:37:42.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.916+0000 7fef8b1e6740 1 -- start start 2024-05-14T15:37:42.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.917+0000 7fef8b1e6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be0714c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.917+0000 7fef8b1e6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdca64d0 0x5631be069020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.917+0000 7fef8b1e6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdcc71b0 0x5631be074390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.917+0000 7fef8b1e6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c1b79e0 con 0x5631bdcc71b0 2024-05-14T15:37:42.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.917+0000 7fef8b1e6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c1b95b0 con 0x5631bdca64d0 2024-05-14T15:37:42.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.917+0000 7fef8b1e6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c1b80b0 con 0x5631bdc9e2f0 2024-05-14T15:37:42.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.918+0000 7fef81800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be0714c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.918+0000 7fef81800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be0714c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:47428/0 (socket says 172.21.15.69:47428) 2024-05-14T15:37:42.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.918+0000 7fef81800640 1 -- 172.21.15.69:0/2677844044 learned_addr learned my addr 172.21.15.69:0/2677844044 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:42.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.918+0000 7fef80e00640 1 --2- 172.21.15.69:0/2677844044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdca64d0 0x5631be069020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.918+0000 7fef82200640 1 --2- 172.21.15.69:0/2677844044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdcc71b0 0x5631be074390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.920 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.919+0000 7fef82200640 1 -- 172.21.15.69:0/2677844044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 msgr2=0x5631be0714c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.919+0000 7fef82200640 1 --2- 172.21.15.69:0/2677844044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be0714c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.919+0000 7fef82200640 1 -- 172.21.15.69:0/2677844044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdca64d0 msgr2=0x5631be069020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.919+0000 7fef82200640 1 --2- 172.21.15.69:0/2677844044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdca64d0 0x5631be069020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.919+0000 7fef82200640 1 -- 172.21.15.69:0/2677844044 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5631be073040 con 0x5631bdcc71b0 2024-05-14T15:37:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.919+0000 7fef81800640 1 --2- 172.21.15.69:0/2677844044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be0714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:37:42.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.921+0000 7fef82200640 1 --2- 172.21.15.69:0/2677844044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdcc71b0 0x5631be074390 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fef7003cbe0 tx=0x7fef70005d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3c23dc9bbc6ade9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.922+0000 7fef6e000640 1 -- 172.21.15.69:0/2677844044 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef70060070 con 0x5631bdcc71b0 2024-05-14T15:37:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.922+0000 7fef6e000640 1 -- 172.21.15.69:0/2677844044 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef70009780 con 0x5631bdcc71b0 2024-05-14T15:37:42.924 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.922+0000 7fef6e000640 1 -- 172.21.15.69:0/2677844044 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef70060070 con 0x5631bdcc71b0 2024-05-14T15:37:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.924+0000 7fef8b1e6740 1 -- 172.21.15.69:0/2677844044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdcc71b0 msgr2=0x5631be074390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:42.925 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.924+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/2677844044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdcc71b0 0x5631be074390 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fef7003cbe0 tx=0x7fef70005d10 comp rx=0 tx=0).stop 2024-05-14T15:37:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.925+0000 7fef8b1e6740 1 -- 172.21.15.69:0/2677844044 shutdown_connections 2024-05-14T15:37:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.925+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/2677844044 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdcc71b0 0x5631be074390 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.925+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/2677844044 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdca64d0 0x5631be069020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.925+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/2677844044 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be0714c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.925+0000 7fef8b1e6740 1 -- 172.21.15.69:0/2677844044 >> 172.21.15.69:0/2677844044 conn(0x5631bdcbb300 msgr2=0x5631be073c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:42.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.927+0000 7fef8b1e6740 1 -- 172.21.15.69:0/2677844044 shutdown_connections 2024-05-14T15:37:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.927+0000 7fef8b1e6740 1 -- 172.21.15.69:0/2677844044 wait complete. 2024-05-14T15:37:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.927+0000 7fef8b1e6740 1 -- start start 2024-05-14T15:37:42.929 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.928+0000 7fef8b1e6740 1 Processor -- start 2024-05-14T15:37:42.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.932+0000 7fef8b1e6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be075780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.932+0000 7fef8b1e6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdca64d0 0x5631be075cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.932+0000 7fef8b1e6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdcc71b0 0x5631be076200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.932+0000 7fef8b1e6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c1b8ee0 con 0x5631bdca64d0 2024-05-14T15:37:42.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.932+0000 7fef80e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdca64d0 0x5631be075cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.932+0000 7fef8b1e6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c1b8780 con 0x5631bdcc71b0 2024-05-14T15:37:42.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.932+0000 7fef8b1e6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c1b59e0 con 0x5631bdc9e2f0 2024-05-14T15:37:42.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.933+0000 7fef8b1e6740 10 client.0 _ll_register_callbacks cb 0x7fef70040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:37:42.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.933+0000 7fef82200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdcc71b0 0x5631be076200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.933+0000 7fef80e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdca64d0 0x5631be075cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:59510/0 (socket says 172.21.15.69:59510) 2024-05-14T15:37:42.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.933+0000 7fef80e00640 1 -- 172.21.15.69:0/832911771 learned_addr learned my addr 172.21.15.69:0/832911771 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:42.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.933+0000 7fef81800640 1 --2- 172.21.15.69:0/832911771 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be075780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.935+0000 7fef80e00640 1 -- 172.21.15.69:0/832911771 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 msgr2=0x5631be075780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:42.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.935+0000 7fef80e00640 1 --2- 172.21.15.69:0/832911771 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be075780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.935+0000 7fef80e00640 1 -- 172.21.15.69:0/832911771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdcc71b0 msgr2=0x5631be076200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:42.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.935+0000 7fef80e00640 1 --2- 172.21.15.69:0/832911771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdcc71b0 0x5631be076200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.935+0000 7fef80e00640 1 -- 172.21.15.69:0/832911771 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5631be0eaea0 con 0x5631bdca64d0 2024-05-14T15:37:42.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.935+0000 7fef80e00640 1 --2- 172.21.15.69:0/832911771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdca64d0 0x5631be075cc0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fef68015a10 tx=0x7fef68015b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=209355c64f7bc1f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:42.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.935+0000 7fef63400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:37:42.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.936+0000 7fef63400640 1 -- 172.21.15.69:0/832911771 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef68023060 con 0x5631bdca64d0 2024-05-14T15:37:42.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.936+0000 7fef63400640 1 -- 172.21.15.69:0/832911771 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9538+0+0 (secure 0 0 0) 0x7fef6800f040 con 0x5631bdca64d0 2024-05-14T15:37:42.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.936+0000 7fef8b1e6740 1 -- 172.21.15.69:0/832911771 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef70009780 con 0x5631bdca64d0 2024-05-14T15:37:42.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.936+0000 7fef63400640 1 -- 172.21.15.69:0/832911771 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7fef6802a050 con 0x5631bdca64d0 2024-05-14T15:37:42.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.936+0000 7fef8b1e6740 10 client.17334 fetch_fsmap learned FSMap version 70 2024-05-14T15:37:42.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.936+0000 7fef8b1e6740 1 -- 172.21.15.69:0/832911771 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x5631be0ec070 con 0x5631bdca64d0 2024-05-14T15:37:42.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.937+0000 7fef63400640 1 -- 172.21.15.69:0/832911771 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef70009780 con 0x5631bdca64d0 2024-05-14T15:37:42.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.937+0000 7fef63400640 1 -- 172.21.15.69:0/832911771 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 70) ==== 8390+0+0 (secure 0 0 0) 0x7fef6801e860 con 0x5631bdca64d0 2024-05-14T15:37:42.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.937+0000 7fef8b1e6740 10 client.17334 fetch_fsmap finished waiting for FSMap version 70 2024-05-14T15:37:42.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.937+0000 7fef8b1e6740 10 client.17334 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:37:42.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.938+0000 7fef8b1e6740 20 client.17334 populate_metadata read hostname 'smithi069' 2024-05-14T15:37:42.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.938+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/832911771 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5631bdc5b1c0 0x5631be0ee810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.938+0000 7fef8b1e6740 4 client.17334 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:37:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.938+0000 7fef8b1e6740 1 -- 172.21.15.69:0/832911771 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5631bdfd4fd0 con 0x5631bdc5b1c0 2024-05-14T15:37:42.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.939+0000 7fef81800640 1 --2- 172.21.15.69:0/832911771 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5631bdc5b1c0 0x5631be0ee810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.943+0000 7fef81800640 1 --2- 172.21.15.69:0/832911771 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5631bdc5b1c0 0x5631be0ee810 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a81b29727e124c39 server_cookie=9142b4239f789d4e in_seq=0 out_seq=0 2024-05-14T15:37:42.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.943+0000 7fef63400640 10 client.17334 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.981+0000 7fef63400640 1 -- 172.21.15.69:0/832911771 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5631bdfd4fd0 con 0x5631bdc5b1c0 2024-05-14T15:37:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.982+0000 7fef63400640 10 client.17334 handle_command_reply: tid=0 2024-05-14T15:37:42.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.982+0000 7fef8b1e6740 1 client.17334 shutdown 2024-05-14T15:37:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.983+0000 7fef8b1e6740 1 -- 172.21.15.69:0/832911771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdca64d0 msgr2=0x5631be075cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:42.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.983+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/832911771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdca64d0 0x5631be075cc0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fef68015a10 tx=0x7fef68015b00 comp rx=0 tx=0).stop 2024-05-14T15:37:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.984+0000 7fef8b1e6740 1 -- 172.21.15.69:0/832911771 shutdown_connections 2024-05-14T15:37:42.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.984+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/832911771 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5631bdcc71b0 0x5631be076200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.984+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/832911771 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5631bdc5b1c0 0x5631be0ee810 crc :-1 s=READY pgs=231 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.984+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/832911771 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5631bdca64d0 0x5631be075cc0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.984+0000 7fef8b1e6740 1 --2- 172.21.15.69:0/832911771 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5631bdc9e2f0 0x5631be075780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.984+0000 7fef8b1e6740 1 -- 172.21.15.69:0/832911771 >> 172.21.15.69:0/832911771 conn(0x5631bdcbb300 msgr2=0x5631be074320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:42.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.986+0000 7fef63400640 0 client.17334 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.986+0000 7fef8b1e6740 1 -- 172.21.15.69:0/832911771 shutdown_connections 2024-05-14T15:37:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.986+0000 7fef8b1e6740 1 -- 172.21.15.69:0/832911771 wait complete. 2024-05-14T15:37:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.986+0000 7fef8b1e6740 20 client.17334 trim_cache size 0 max 16384 2024-05-14T15:37:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:37:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:37:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:37:42.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:37:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.987+0000 7fef84200640 1 -- 172.21.15.69:0/1780461894 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fef640b29d0 msgr2=0x7fef640b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.987+0000 7fef84200640 1 --2- 172.21.15.69:0/1780461894 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fef640b29d0 0x7fef640b4ee0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fef70005d90 tx=0x7fef70005fd0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.987+0000 7fef84200640 1 -- 172.21.15.69:0/1780461894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c077620 msgr2=0x7fef7c1a0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.987+0000 7fef84200640 1 --2- 172.21.15.69:0/1780461894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c077620 0x7fef7c1a0df0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fef7400eb90 tx=0x7fef7400ef90 comp rx=0 tx=0).stop 2024-05-14T15:37:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.988+0000 7fef84200640 1 -- 172.21.15.69:0/1780461894 shutdown_connections 2024-05-14T15:37:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.988+0000 7fef84200640 1 --2- 172.21.15.69:0/1780461894 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fef640b29d0 0x7fef640b4ee0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.988+0000 7fef84200640 1 --2- 172.21.15.69:0/1780461894 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c114b10 0x7fef7c1a5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.988+0000 7fef84200640 1 --2- 172.21.15.69:0/1780461894 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef7c1121b0 0x7fef7c1a1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:42.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.988+0000 7fef84200640 1 --2- 172.21.15.69:0/1780461894 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c077620 0x7fef7c1a0df0 secure :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fef7400eb90 tx=0x7fef7400ef90 comp rx=0 tx=0).stop 2024-05-14T15:37:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.988+0000 7fef84200640 1 -- 172.21.15.69:0/1780461894 >> 172.21.15.69:0/1780461894 conn(0x7fef7c101540 msgr2=0x7fef7c113470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.988+0000 7fef84200640 1 -- 172.21.15.69:0/1780461894 shutdown_connections 2024-05-14T15:37:42.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:42.989+0000 7fef84200640 1 -- 172.21.15.69:0/1780461894 wait complete. 2024-05-14T15:37:43.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:43 smithi203 ceph-mon[34567]: pgmap v506: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.1 MiB/s wr, 577 op/s 2024-05-14T15:37:43.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:43 smithi092 ceph-mon[34729]: pgmap v506: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.1 MiB/s wr, 577 op/s 2024-05-14T15:37:43.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:43 smithi069 ceph-mon[31270]: pgmap v506: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 54 KiB/s rd, 5.1 MiB/s wr, 577 op/s 2024-05-14T15:37:45.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:45 smithi092 ceph-mon[34729]: pgmap v507: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.7 MiB/s wr, 522 op/s 2024-05-14T15:37:45.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:45 smithi069 ceph-mon[31270]: pgmap v507: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.7 MiB/s wr, 522 op/s 2024-05-14T15:37:45.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:45 smithi203 ceph-mon[34567]: pgmap v507: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 4.7 MiB/s wr, 522 op/s 2024-05-14T15:37:46.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 720.0 s, 477.7 tps, lat 204.026 ms stddev 264.121 2024-05-14T15:37:47.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:47 smithi069 ceph-mon[31270]: pgmap v508: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 6.7 MiB/s wr, 750 op/s 2024-05-14T15:37:47.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:47 smithi203 ceph-mon[34567]: pgmap v508: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 6.7 MiB/s wr, 750 op/s 2024-05-14T15:37:47.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:47 smithi092 ceph-mon[34729]: pgmap v508: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 6.7 MiB/s wr, 750 op/s 2024-05-14T15:37:49.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:49 smithi069 ceph-mon[31270]: pgmap v509: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 4.3 MiB/s wr, 501 op/s 2024-05-14T15:37:49.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:49 smithi203 ceph-mon[34567]: pgmap v509: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 4.3 MiB/s wr, 501 op/s 2024-05-14T15:37:49.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:49 smithi092 ceph-mon[34729]: pgmap v509: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 4.3 MiB/s wr, 501 op/s 2024-05-14T15:37:51.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 725.0 s, 550.7 tps, lat 186.411 ms stddev 231.921 2024-05-14T15:37:51.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:51 smithi203 ceph-mon[34567]: pgmap v510: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 6.1 MiB/s wr, 694 op/s 2024-05-14T15:37:51.947 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:51 smithi092 ceph-mon[34729]: pgmap v510: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 6.1 MiB/s wr, 694 op/s 2024-05-14T15:37:51.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:51 smithi069 ceph-mon[31270]: pgmap v510: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 107 KiB/s rd, 6.1 MiB/s wr, 694 op/s 2024-05-14T15:37:53.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:53 smithi203 ceph-mon[34567]: pgmap v511: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 570 op/s 2024-05-14T15:37:53.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:53 smithi092 ceph-mon[34729]: pgmap v511: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 570 op/s 2024-05-14T15:37:53.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:53 smithi069 ceph-mon[31270]: pgmap v511: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 570 op/s 2024-05-14T15:37:55.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:55 smithi203 ceph-mon[34567]: pgmap v512: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 4.4 MiB/s wr, 503 op/s 2024-05-14T15:37:55.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:55 smithi092 ceph-mon[34729]: pgmap v512: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 4.4 MiB/s wr, 503 op/s 2024-05-14T15:37:55.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:55 smithi069 ceph-mon[31270]: pgmap v512: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 4.4 MiB/s wr, 503 op/s 2024-05-14T15:37:56.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.231+0000 7f9be0a00640 1 -- 172.21.15.69:0/2557603252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9bdc10c170 msgr2=0x7f9bdc105db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:56.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.231+0000 7f9be0a00640 1 --2- 172.21.15.69:0/2557603252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9bdc10c170 0x7f9bdc105db0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc009900 tx=0x7f9bcc02a410 comp rx=0 tx=0).stop 2024-05-14T15:37:56.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.231+0000 7f9be0a00640 1 -- 172.21.15.69:0/2557603252 shutdown_connections 2024-05-14T15:37:56.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.231+0000 7f9be0a00640 1 --2- 172.21.15.69:0/2557603252 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bdc106420 0x7f9bdc1127f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.231+0000 7f9be0a00640 1 --2- 172.21.15.69:0/2557603252 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9bdc10c170 0x7f9bdc105db0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.231+0000 7f9be0a00640 1 --2- 172.21.15.69:0/2557603252 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bdc10bcd0 0x7f9bdc105870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.231+0000 7f9be0a00640 1 -- 172.21.15.69:0/2557603252 >> 172.21.15.69:0/2557603252 conn(0x7f9bdc101470 msgr2=0x7f9bdc103890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:56.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.232+0000 7f9be0a00640 1 -- 172.21.15.69:0/2557603252 shutdown_connections 2024-05-14T15:37:56.233 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.232+0000 7f9be0a00640 1 -- 172.21.15.69:0/2557603252 wait complete. 2024-05-14T15:37:56.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.233+0000 7f9be0a00640 1 Processor -- start 2024-05-14T15:37:56.234 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.233+0000 7f9be0a00640 1 -- start start 2024-05-14T15:37:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.234+0000 7f9be0a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bdc106420 0x7f9bdc1a25b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.234+0000 7f9be0a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bdc10bcd0 0x7f9bdc1a2af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.234+0000 7f9be0a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9bdc10c170 0x7f9bdc19c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.234+0000 7f9be0a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc115da0 con 0x7f9bdc10c170 2024-05-14T15:37:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.234+0000 7f9be0a00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc115c20 con 0x7f9bdc10bcd0 2024-05-14T15:37:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.234+0000 7f9be0a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc115f20 con 0x7f9bdc106420 2024-05-14T15:37:56.235 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.234+0000 7f9bdb200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9bdc10c170 0x7f9bdc19c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.236 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.234+0000 7f9bdb200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9bdc10c170 0x7f9bdc19c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57414/0 (socket says 172.21.15.69:57414) 2024-05-14T15:37:56.236 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.234+0000 7f9bdb200640 1 -- 172.21.15.69:0/2370779968 learned_addr learned my addr 172.21.15.69:0/2370779968 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:56.236 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.234+0000 7f9bda800640 1 --2- 172.21.15.69:0/2370779968 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bdc106420 0x7f9bdc1a25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.236 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.234+0000 7f9bd9e00640 1 --2- 172.21.15.69:0/2370779968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bdc10bcd0 0x7f9bdc1a2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.235+0000 7f9bdb200640 1 -- 172.21.15.69:0/2370779968 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bdc106420 msgr2=0x7f9bdc1a25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.235+0000 7f9bdb200640 1 --2- 172.21.15.69:0/2370779968 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bdc106420 0x7f9bdc1a25b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.235+0000 7f9bdb200640 1 -- 172.21.15.69:0/2370779968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bdc10bcd0 msgr2=0x7f9bdc1a2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.235+0000 7f9bdb200640 1 --2- 172.21.15.69:0/2370779968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bdc10bcd0 0x7f9bdc1a2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.235+0000 7f9bdb200640 1 -- 172.21.15.69:0/2370779968 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bdc19ceb0 con 0x7f9bdc10c170 2024-05-14T15:37:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.235+0000 7f9bdb200640 1 --2- 172.21.15.69:0/2370779968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9bdc10c170 0x7f9bdc19c780 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400eaa0 tx=0x7f9bd400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.235+0000 7f9bd3400640 1 -- 172.21.15.69:0/2370779968 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd400cdb0 con 0x7f9bdc10c170 2024-05-14T15:37:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.235+0000 7f9bd3400640 1 -- 172.21.15.69:0/2370779968 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bd4005020 con 0x7f9bdc10c170 2024-05-14T15:37:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.235+0000 7f9be0a00640 1 -- 172.21.15.69:0/2370779968 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bdc19d1a0 con 0x7f9bdc10c170 2024-05-14T15:37:56.237 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.235+0000 7f9bd3400640 1 -- 172.21.15.69:0/2370779968 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd40116d0 con 0x7f9bdc10c170 2024-05-14T15:37:56.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.235+0000 7f9be0a00640 1 -- 172.21.15.69:0/2370779968 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bdc1a93a0 con 0x7f9bdc10c170 2024-05-14T15:37:56.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.239+0000 7f9be843a740 1 Processor -- start 2024-05-14T15:37:56.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.240+0000 7f9bd3400640 1 -- 172.21.15.69:0/2370779968 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9bd40051d0 con 0x7f9bdc10c170 2024-05-14T15:37:56.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.240+0000 7f9be843a740 1 -- start start 2024-05-14T15:37:56.243 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.241+0000 7f9be843a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c12c1b0 0x56005c4cd480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.241+0000 7f9be843a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c1032f0 0x56005c4cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.241+0000 7f9be843a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c10b4d0 0x56005c4cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.241+0000 7f9be843a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56005c432550 con 0x56005c1032f0 2024-05-14T15:37:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.241+0000 7f9be843a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56005c3d7bc0 con 0x56005c10b4d0 2024-05-14T15:37:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.241+0000 7f9be843a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56005c42e510 con 0x56005c12c1b0 2024-05-14T15:37:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.241+0000 7f9bda800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c1032f0 0x56005c4cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.241+0000 7f9bda800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c1032f0 0x56005c4cd9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57424/0 (socket says 172.21.15.69:57424) 2024-05-14T15:37:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.241+0000 7f9bda800640 1 -- 172.21.15.69:0/3831399783 learned_addr learned my addr 172.21.15.69:0/3831399783 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.241+0000 7f9bd9e00640 1 --2- 172.21.15.69:0/3831399783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c10b4d0 0x56005c4cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.244 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.241+0000 7f9bd9e00640 1 --2- 172.21.15.69:0/3831399783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c12c1b0 0x56005c4cd480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.241+0000 7f9bda800640 1 -- 172.21.15.69:0/3831399783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c12c1b0 msgr2=0x56005c4cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.241+0000 7f9bda800640 1 --2- 172.21.15.69:0/3831399783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c12c1b0 0x56005c4cd480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.242+0000 7f9bda800640 1 -- 172.21.15.69:0/3831399783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c10b4d0 msgr2=0x56005c4cdf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.242+0000 7f9bda800640 1 --2- 172.21.15.69:0/3831399783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c10b4d0 0x56005c4cdf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.242+0000 7f9bda800640 1 -- 172.21.15.69:0/3831399783 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56005c144210 con 0x56005c1032f0 2024-05-14T15:37:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.242+0000 7f9bd9e00640 1 --2- 172.21.15.69:0/3831399783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c10b4d0 0x56005c4cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:37:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.242+0000 7f9bd3400640 1 --2- 172.21.15.69:0/2370779968 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9bc00b29d0 0x7f9bc00b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.242+0000 7f9bda800640 1 --2- 172.21.15.69:0/3831399783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c1032f0 0x56005c4cd9c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800bbf0 tx=0x7f9bc80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36a1b4688a105b0b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.242+0000 7f9bd3400640 1 -- 172.21.15.69:0/2370779968 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 9538+0+0 (secure 0 0 0) 0x7f9bd40e2c00 con 0x7f9bdc10c170 2024-05-14T15:37:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.242+0000 7f9bc7400640 1 -- 172.21.15.69:0/3831399783 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc801c480 con 0x56005c1032f0 2024-05-14T15:37:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.242+0000 7f9bc7400640 1 -- 172.21.15.69:0/3831399783 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bc801cab0 con 0x56005c1032f0 2024-05-14T15:37:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.242+0000 7f9bc7400640 1 -- 172.21.15.69:0/3831399783 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bc80119a0 con 0x56005c1032f0 2024-05-14T15:37:56.245 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.242+0000 7f9bd9e00640 1 --2- 172.21.15.69:0/2370779968 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9bc00b29d0 0x7f9bc00b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.243+0000 7f9be843a740 1 -- 172.21.15.69:0/3831399783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c1032f0 msgr2=0x56005c4cd9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.243+0000 7f9be843a740 1 --2- 172.21.15.69:0/3831399783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c1032f0 0x56005c4cd9c0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f9bc800bbf0 tx=0x7f9bc80107a0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.243+0000 7f9bd9e00640 1 --2- 172.21.15.69:0/2370779968 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9bc00b29d0 0x7f9bc00b4ee0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc02a930 tx=0x7f9bcc005a20 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.243+0000 7f9be843a740 1 -- 172.21.15.69:0/3831399783 shutdown_connections 2024-05-14T15:37:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.243+0000 7f9be843a740 1 --2- 172.21.15.69:0/3831399783 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c10b4d0 0x56005c4cdf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.243+0000 7f9be843a740 1 --2- 172.21.15.69:0/3831399783 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c1032f0 0x56005c4cd9c0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.243+0000 7f9be843a740 1 --2- 172.21.15.69:0/3831399783 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c12c1b0 0x56005c4cd480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.243+0000 7f9be843a740 1 -- 172.21.15.69:0/3831399783 >> 172.21.15.69:0/3831399783 conn(0x56005c120300 msgr2=0x56005c4c9c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.243+0000 7f9be843a740 1 -- 172.21.15.69:0/3831399783 shutdown_connections 2024-05-14T15:37:56.249 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.244+0000 7f9be843a740 1 -- 172.21.15.69:0/3831399783 wait complete. 2024-05-14T15:37:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.244+0000 7f9be843a740 1 -- start start 2024-05-14T15:37:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.244+0000 7f9be843a740 1 Processor -- start 2024-05-14T15:37:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.245+0000 7f9be843a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c1032f0 0x56005c4d7930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.245+0000 7f9be843a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c10b4d0 0x56005c4d7e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.245+0000 7f9be843a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c12c1b0 0x56005c4e3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.245+0000 7f9be843a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56005c4da5b0 con 0x56005c12c1b0 2024-05-14T15:37:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.245+0000 7f9be843a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56005c3eb660 con 0x56005c10b4d0 2024-05-14T15:37:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.245+0000 7f9be843a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56005c4da730 con 0x56005c1032f0 2024-05-14T15:37:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.245+0000 7f9be843a740 10 client.0 _ll_register_callbacks cb 0x56005c3b5400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:37:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.245+0000 7f9bdb200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c12c1b0 0x56005c4e3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.245+0000 7f9bdb200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c12c1b0 0x56005c4e3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57432/0 (socket says 172.21.15.69:57432) 2024-05-14T15:37:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.245+0000 7f9bdb200640 1 -- 172.21.15.69:0/2582259183 learned_addr learned my addr 172.21.15.69:0/2582259183 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.245+0000 7f9bda800640 1 --2- 172.21.15.69:0/2582259183 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c1032f0 0x56005c4d7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.250 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.245+0000 7f9bd9e00640 1 --2- 172.21.15.69:0/2582259183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c10b4d0 0x56005c4d7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.246+0000 7f9bdb200640 1 -- 172.21.15.69:0/2582259183 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c1032f0 msgr2=0x56005c4d7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.246+0000 7f9bdb200640 1 --2- 172.21.15.69:0/2582259183 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c1032f0 0x56005c4d7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.246+0000 7f9bdb200640 1 -- 172.21.15.69:0/2582259183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c10b4d0 msgr2=0x56005c4d7e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.246+0000 7f9bdb200640 1 --2- 172.21.15.69:0/2582259183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c10b4d0 0x56005c4d7e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.246+0000 7f9bdb200640 1 -- 172.21.15.69:0/2582259183 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56005c210620 con 0x56005c12c1b0 2024-05-14T15:37:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.246+0000 7f9bdb200640 1 --2- 172.21.15.69:0/2582259183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c12c1b0 0x56005c4e3a90 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40a9a10 tx=0x7f9bd4005720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=190e2b307e32a8df server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.246+0000 7f9bbbe00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:37:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.246+0000 7f9bbbe00640 1 -- 172.21.15.69:0/2582259183 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd401f040 con 0x56005c12c1b0 2024-05-14T15:37:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.246+0000 7f9be843a740 1 -- 172.21.15.69:0/2582259183 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bc801cab0 con 0x56005c12c1b0 2024-05-14T15:37:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.246+0000 7f9bbbe00640 1 -- 172.21.15.69:0/2582259183 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9538+0+0 (secure 0 0 0) 0x7f9bd40cc0d0 con 0x56005c12c1b0 2024-05-14T15:37:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.246+0000 7f9bbbe00640 1 -- 172.21.15.69:0/2582259183 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f9bd40b28e0 con 0x56005c12c1b0 2024-05-14T15:37:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.247+0000 7f9be843a740 10 client.17346 fetch_fsmap learned FSMap version 70 2024-05-14T15:37:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.247+0000 7f9be843a740 1 -- 172.21.15.69:0/2582259183 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x56005c4e6810 con 0x56005c12c1b0 2024-05-14T15:37:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.247+0000 7f9bbbe00640 1 -- 172.21.15.69:0/2582259183 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bc801cab0 con 0x56005c12c1b0 2024-05-14T15:37:56.251 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.247+0000 7f9bbbe00640 1 -- 172.21.15.69:0/2582259183 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 70) ==== 8390+0+0 (secure 0 0 0) 0x7f9bd400f040 con 0x56005c12c1b0 2024-05-14T15:37:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.247+0000 7f9be843a740 10 client.17346 fetch_fsmap finished waiting for FSMap version 70 2024-05-14T15:37:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.247+0000 7f9be843a740 10 client.17346 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:37:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.247+0000 7f9be843a740 20 client.17346 populate_metadata read hostname 'smithi069' 2024-05-14T15:37:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.247+0000 7f9be843a740 1 --2- 172.21.15.69:0/2582259183 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56005c0ead80 0x56005c4e9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.247+0000 7f9be843a740 4 client.17346 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:37:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.247+0000 7f9be843a740 1 -- 172.21.15.69:0/2582259183 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56005c440160 con 0x56005c0ead80 2024-05-14T15:37:56.252 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.248+0000 7f9bda800640 1 --2- 172.21.15.69:0/2582259183 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56005c0ead80 0x56005c4e9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.249+0000 7f9bbbe00640 10 client.17346 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.249+0000 7f9bda800640 1 --2- 172.21.15.69:0/2582259183 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56005c0ead80 0x56005c4e9c90 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=326615d6ceb00c25 server_cookie=d78238466e73c56d in_seq=0 out_seq=0 2024-05-14T15:37:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.250+0000 7f9bbbe00640 1 -- 172.21.15.69:0/2582259183 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56005c440160 con 0x56005c0ead80 2024-05-14T15:37:56.253 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.250+0000 7f9bbbe00640 10 client.17346 handle_command_reply: tid=0 2024-05-14T15:37:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.251+0000 7f9be843a740 1 client.17346 shutdown 2024-05-14T15:37:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.251+0000 7f9be843a740 1 -- 172.21.15.69:0/2582259183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c12c1b0 msgr2=0x56005c4e3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.251+0000 7f9be843a740 1 --2- 172.21.15.69:0/2582259183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c12c1b0 0x56005c4e3a90 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40a9a10 tx=0x7f9bd4005720 comp rx=0 tx=0).stop 2024-05-14T15:37:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.251+0000 7f9be843a740 1 -- 172.21.15.69:0/2582259183 shutdown_connections 2024-05-14T15:37:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.251+0000 7f9be843a740 1 --2- 172.21.15.69:0/2582259183 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56005c0ead80 0x56005c4e9c90 crc :-1 s=READY pgs=232 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.251+0000 7f9be843a740 1 --2- 172.21.15.69:0/2582259183 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c12c1b0 0x56005c4e3a90 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.251+0000 7f9be843a740 1 --2- 172.21.15.69:0/2582259183 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c10b4d0 0x56005c4d7e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.251+0000 7f9be843a740 1 --2- 172.21.15.69:0/2582259183 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c1032f0 0x56005c4d7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.251+0000 7f9bbbe00640 0 client.17346 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.251+0000 7f9be843a740 1 -- 172.21.15.69:0/2582259183 >> 172.21.15.69:0/2582259183 conn(0x56005c120300 msgr2=0x56005c4cd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.251+0000 7f9be843a740 1 -- 172.21.15.69:0/2582259183 shutdown_connections 2024-05-14T15:37:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.251+0000 7f9be843a740 1 -- 172.21.15.69:0/2582259183 wait complete. 2024-05-14T15:37:56.254 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.251+0000 7f9be843a740 20 client.17346 trim_cache size 0 max 16384 2024-05-14T15:37:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.280+0000 7f9be843a740 1 Processor -- start 2024-05-14T15:37:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.280+0000 7f9be843a740 1 -- start start 2024-05-14T15:37:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.281+0000 7f9be843a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c1032f0 0x56005c4c8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.281+0000 7f9be843a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c10b4d0 0x56005c4ef4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.281+0000 7f9be843a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c12c1b0 0x56005c4efa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.282 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.281+0000 7f9be843a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc1b3390 con 0x56005c12c1b0 2024-05-14T15:37:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.281+0000 7f9be843a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc1b4f60 con 0x56005c1032f0 2024-05-14T15:37:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.281+0000 7f9be843a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc1b3a60 con 0x56005c10b4d0 2024-05-14T15:37:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.281+0000 7f9bdb200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c12c1b0 0x56005c4efa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.281+0000 7f9bdb200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c12c1b0 0x56005c4efa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57444/0 (socket says 172.21.15.69:57444) 2024-05-14T15:37:56.283 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.281+0000 7f9bdb200640 1 -- 172.21.15.69:0/3115113215 learned_addr learned my addr 172.21.15.69:0/3115113215 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.281+0000 7f9bd9e00640 1 --2- 172.21.15.69:0/3115113215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c10b4d0 0x56005c4ef4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.281+0000 7f9bda800640 1 --2- 172.21.15.69:0/3115113215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c1032f0 0x56005c4c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.282+0000 7f9bdb200640 1 -- 172.21.15.69:0/3115113215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c10b4d0 msgr2=0x56005c4ef4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.282+0000 7f9bdb200640 1 --2- 172.21.15.69:0/3115113215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c10b4d0 0x56005c4ef4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.282+0000 7f9bdb200640 1 -- 172.21.15.69:0/3115113215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c1032f0 msgr2=0x56005c4c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.282+0000 7f9bdb200640 1 --2- 172.21.15.69:0/3115113215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c1032f0 0x56005c4c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.282+0000 7f9bdb200640 1 -- 172.21.15.69:0/3115113215 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56005c4c49b0 con 0x56005c12c1b0 2024-05-14T15:37:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.282+0000 7f9bdb200640 1 --2- 172.21.15.69:0/3115113215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c12c1b0 0x56005c4efa20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40b2aa0 tx=0x7f9bd40a8750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbf08dd26c5085d server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.282+0000 7f9bc6a00640 1 -- 172.21.15.69:0/3115113215 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd401f030 con 0x56005c12c1b0 2024-05-14T15:37:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.282+0000 7f9bc6a00640 1 -- 172.21.15.69:0/3115113215 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bd40a53f0 con 0x56005c12c1b0 2024-05-14T15:37:56.284 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.282+0000 7f9bc6a00640 1 -- 172.21.15.69:0/3115113215 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bd40a8f00 con 0x56005c12c1b0 2024-05-14T15:37:56.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.283+0000 7f9be843a740 1 -- 172.21.15.69:0/3115113215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c12c1b0 msgr2=0x56005c4efa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:56.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.283+0000 7f9be843a740 1 --2- 172.21.15.69:0/3115113215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c12c1b0 0x56005c4efa20 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f9bd40b2aa0 tx=0x7f9bd40a8750 comp rx=0 tx=0).stop 2024-05-14T15:37:56.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.283+0000 7f9be843a740 1 -- 172.21.15.69:0/3115113215 shutdown_connections 2024-05-14T15:37:56.287 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.283+0000 7f9be843a740 1 --2- 172.21.15.69:0/3115113215 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c12c1b0 0x56005c4efa20 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.283+0000 7f9be843a740 1 --2- 172.21.15.69:0/3115113215 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c10b4d0 0x56005c4ef4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.283+0000 7f9be843a740 1 --2- 172.21.15.69:0/3115113215 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c1032f0 0x56005c4c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.283+0000 7f9be843a740 1 -- 172.21.15.69:0/3115113215 >> 172.21.15.69:0/3115113215 conn(0x56005c120300 msgr2=0x56005c4c8250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:56.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.284+0000 7f9be843a740 1 -- 172.21.15.69:0/3115113215 shutdown_connections 2024-05-14T15:37:56.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.284+0000 7f9be843a740 1 -- 172.21.15.69:0/3115113215 wait complete. 2024-05-14T15:37:56.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.284+0000 7f9be843a740 1 -- start start 2024-05-14T15:37:56.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.284+0000 7f9be843a740 1 Processor -- start 2024-05-14T15:37:56.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9be843a740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c1032f0 0x56005c4db010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9be843a740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c10b4d0 0x56005c4db550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9be843a740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c12c1b0 0x56005c54a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9be843a740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc1b4890 con 0x56005c10b4d0 2024-05-14T15:37:56.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9be843a740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc1b4130 con 0x56005c12c1b0 2024-05-14T15:37:56.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9be843a740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9bdc1b1390 con 0x56005c1032f0 2024-05-14T15:37:56.288 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9be843a740 10 client.0 _ll_register_callbacks cb 0x7f9bd40a59e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:37:56.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9bd9e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c10b4d0 0x56005c4db550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9bd9e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c10b4d0 0x56005c4db550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57454/0 (socket says 172.21.15.69:57454) 2024-05-14T15:37:56.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9bd9e00640 1 -- 172.21.15.69:0/343599498 learned_addr learned my addr 172.21.15.69:0/343599498 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:37:56.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9bdb200640 1 --2- 172.21.15.69:0/343599498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c12c1b0 0x56005c54a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9bda800640 1 --2- 172.21.15.69:0/343599498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c1032f0 0x56005c4db010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9bd9e00640 1 -- 172.21.15.69:0/343599498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c1032f0 msgr2=0x56005c4db010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:56.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9bd9e00640 1 --2- 172.21.15.69:0/343599498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c1032f0 0x56005c4db010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9bd9e00640 1 -- 172.21.15.69:0/343599498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c12c1b0 msgr2=0x56005c54a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:37:56.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9bd9e00640 1 --2- 172.21.15.69:0/343599498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c12c1b0 0x56005c54a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.285+0000 7f9bd9e00640 1 -- 172.21.15.69:0/343599498 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56005c54a600 con 0x56005c10b4d0 2024-05-14T15:37:56.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.286+0000 7f9bd9e00640 1 --2- 172.21.15.69:0/343599498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c10b4d0 0x56005c4db550 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc06c4c0 tx=0x7f9bcc000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4368165dc3608a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:37:56.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.286+0000 7f9bbbe00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:37:56.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.286+0000 7f9bbbe00640 1 -- 172.21.15.69:0/343599498 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bcc035040 con 0x56005c10b4d0 2024-05-14T15:37:56.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.286+0000 7f9bbbe00640 1 -- 172.21.15.69:0/343599498 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(113..113 src has 1..113) ==== 9538+0+0 (secure 0 0 0) 0x7f9bcc055670 con 0x56005c10b4d0 2024-05-14T15:37:56.289 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.286+0000 7f9be843a740 1 -- 172.21.15.69:0/343599498 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9bd40a53f0 con 0x56005c10b4d0 2024-05-14T15:37:56.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.286+0000 7f9bbbe00640 1 -- 172.21.15.69:0/343599498 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) ==== 24+0+0 (secure 0 0 0) 0x7f9bcc05e050 con 0x56005c10b4d0 2024-05-14T15:37:56.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.286+0000 7f9be843a740 10 client.17352 fetch_fsmap learned FSMap version 70 2024-05-14T15:37:56.290 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.286+0000 7f9be843a740 1 -- 172.21.15.69:0/343599498 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=4+}) -- 0x56005c551900 con 0x56005c10b4d0 2024-05-14T15:37:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.287+0000 7f9bbbe00640 1 -- 172.21.15.69:0/343599498 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9bd40a53f0 con 0x56005c10b4d0 2024-05-14T15:37:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.287+0000 7f9bbbe00640 1 -- 172.21.15.69:0/343599498 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 70) ==== 8390+0+0 (secure 0 0 0) 0x7f9bcc04c4d0 con 0x56005c10b4d0 2024-05-14T15:37:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.287+0000 7f9be843a740 10 client.17352 fetch_fsmap finished waiting for FSMap version 70 2024-05-14T15:37:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.287+0000 7f9be843a740 10 client.17352 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:37:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.287+0000 7f9be843a740 20 client.17352 populate_metadata read hostname 'smithi069' 2024-05-14T15:37:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.287+0000 7f9be843a740 1 --2- 172.21.15.69:0/343599498 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56005c0c01c0 0x56005c554120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:37:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.287+0000 7f9be843a740 4 client.17352 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:37:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.287+0000 7f9be843a740 1 -- 172.21.15.69:0/343599498 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56005c439fd0 con 0x56005c0c01c0 2024-05-14T15:37:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.288+0000 7f9bda800640 1 --2- 172.21.15.69:0/343599498 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56005c0c01c0 0x56005c554120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:37:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.288+0000 7f9bbbe00640 10 client.17352 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:56.291 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.288+0000 7f9bda800640 1 --2- 172.21.15.69:0/343599498 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56005c0c01c0 0x56005c554120 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92b28677426c6710 server_cookie=1c03db691264c763 in_seq=0 out_seq=0 2024-05-14T15:37:56.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.349+0000 7f9bbbe00640 1 -- 172.21.15.69:0/343599498 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56005c439fd0 con 0x56005c0c01c0 2024-05-14T15:37:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.349+0000 7f9bbbe00640 10 client.17352 handle_command_reply: tid=0 2024-05-14T15:37:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.349+0000 7f9be843a740 1 client.17352 shutdown 2024-05-14T15:37:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.349+0000 7f9be843a740 1 -- 172.21.15.69:0/343599498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c10b4d0 msgr2=0x56005c4db550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.349+0000 7f9be843a740 1 --2- 172.21.15.69:0/343599498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c10b4d0 0x56005c4db550 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f9bdc06c4c0 tx=0x7f9bcc000bc0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.350+0000 7f9be843a740 1 -- 172.21.15.69:0/343599498 shutdown_connections 2024-05-14T15:37:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.350+0000 7f9be843a740 1 --2- 172.21.15.69:0/343599498 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56005c12c1b0 0x56005c54a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.350+0000 7f9be843a740 1 --2- 172.21.15.69:0/343599498 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56005c0c01c0 0x56005c554120 crc :-1 s=READY pgs=233 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.350+0000 7f9be843a740 1 --2- 172.21.15.69:0/343599498 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56005c10b4d0 0x56005c4db550 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.350+0000 7f9be843a740 1 --2- 172.21.15.69:0/343599498 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56005c1032f0 0x56005c4db010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.350+0000 7f9be843a740 1 -- 172.21.15.69:0/343599498 >> 172.21.15.69:0/343599498 conn(0x56005c120300 msgr2=0x56005c4d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:56.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.350+0000 7f9bbbe00640 0 client.17352 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.350+0000 7f9be843a740 1 -- 172.21.15.69:0/343599498 shutdown_connections 2024-05-14T15:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.350+0000 7f9be843a740 1 -- 172.21.15.69:0/343599498 wait complete. 2024-05-14T15:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.350+0000 7f9be843a740 20 client.17352 trim_cache size 0 max 16384 2024-05-14T15:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:37:56.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.351+0000 7f9be0a00640 1 -- 172.21.15.69:0/2370779968 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9bc00b29d0 msgr2=0x7f9bc00b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.351+0000 7f9be0a00640 1 --2- 172.21.15.69:0/2370779968 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9bc00b29d0 0x7f9bc00b4ee0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9bcc02a930 tx=0x7f9bcc005a20 comp rx=0 tx=0).stop 2024-05-14T15:37:56.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.351+0000 7f9be0a00640 1 -- 172.21.15.69:0/2370779968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9bdc10c170 msgr2=0x7f9bdc19c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:37:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.351+0000 7f9be0a00640 1 --2- 172.21.15.69:0/2370779968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9bdc10c170 0x7f9bdc19c780 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f9bd400eaa0 tx=0x7f9bd400ef60 comp rx=0 tx=0).stop 2024-05-14T15:37:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.351+0000 7f9be0a00640 1 -- 172.21.15.69:0/2370779968 shutdown_connections 2024-05-14T15:37:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.351+0000 7f9be0a00640 1 --2- 172.21.15.69:0/2370779968 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9bc00b29d0 0x7f9bc00b4ee0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.352+0000 7f9be0a00640 1 --2- 172.21.15.69:0/2370779968 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9bdc10c170 0x7f9bdc19c780 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.352+0000 7f9be0a00640 1 --2- 172.21.15.69:0/2370779968 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9bdc10bcd0 0x7f9bdc1a2af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.352+0000 7f9be0a00640 1 --2- 172.21.15.69:0/2370779968 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9bdc106420 0x7f9bdc1a25b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:37:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.352+0000 7f9be0a00640 1 -- 172.21.15.69:0/2370779968 >> 172.21.15.69:0/2370779968 conn(0x7f9bdc101470 msgr2=0x7f9bdc101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:37:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.352+0000 7f9be0a00640 1 -- 172.21.15.69:0/2370779968 shutdown_connections 2024-05-14T15:37:56.354 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:37:56.352+0000 7f9be0a00640 1 -- 172.21.15.69:0/2370779968 wait complete. 2024-05-14T15:37:56.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 730.0 s, 341.2 tps, lat 141.561 ms stddev 153.431 2024-05-14T15:37:57.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:57 smithi203 ceph-mon[34567]: pgmap v513: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 6.9 MiB/s wr, 711 op/s 2024-05-14T15:37:57.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:57 smithi092 ceph-mon[34729]: pgmap v513: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 6.9 MiB/s wr, 711 op/s 2024-05-14T15:37:57.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:57 smithi069 ceph-mon[31270]: pgmap v513: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 6.9 MiB/s wr, 711 op/s 2024-05-14T15:37:59.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:59 smithi203 ceph-mon[34567]: pgmap v514: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.8 MiB/s wr, 471 op/s 2024-05-14T15:37:59.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:37:59 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:37:59.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:59 smithi092 ceph-mon[34729]: pgmap v514: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.8 MiB/s wr, 471 op/s 2024-05-14T15:37:59.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:37:59 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:37:59.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:59 smithi069 ceph-mon[31270]: pgmap v514: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 4.8 MiB/s wr, 471 op/s 2024-05-14T15:37:59.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:37:59 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:38:01.370 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 735.0 s, 0.0 tps, lat 0.000 ms stddev 0.000 2024-05-14T15:38:01.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:01 smithi203 ceph-mon[34567]: pgmap v515: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.3 MiB/s wr, 533 op/s 2024-05-14T15:38:01.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:01 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:38:01.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:01 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:38:01.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:01 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:38:01.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:01 smithi092 ceph-mon[34729]: pgmap v515: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.3 MiB/s wr, 533 op/s 2024-05-14T15:38:01.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:01 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:38:01.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:01 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:38:01.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:01 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:38:01.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:01 smithi069 ceph-mon[31270]: pgmap v515: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 5.3 MiB/s wr, 533 op/s 2024-05-14T15:38:01.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:01 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:38:01.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:01 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:38:01.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:01 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:38:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:03 smithi203 ceph-mon[34567]: pgmap v516: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 3.7 MiB/s wr, 368 op/s 2024-05-14T15:38:03.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:03 smithi203 ceph-mon[34567]: osdmap e114: 12 total, 12 up, 12 in 2024-05-14T15:38:03.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:03 smithi092 ceph-mon[34729]: pgmap v516: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 3.7 MiB/s wr, 368 op/s 2024-05-14T15:38:03.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:03 smithi092 ceph-mon[34729]: osdmap e114: 12 total, 12 up, 12 in 2024-05-14T15:38:03.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:03 smithi069 ceph-mon[31270]: pgmap v516: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 3.7 MiB/s wr, 368 op/s 2024-05-14T15:38:03.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:03 smithi069 ceph-mon[31270]: osdmap e114: 12 total, 12 up, 12 in 2024-05-14T15:38:05.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:05 smithi203 ceph-mon[34567]: pgmap v518: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 3.9 MiB/s wr, 375 op/s 2024-05-14T15:38:05.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:05 smithi092 ceph-mon[34729]: pgmap v518: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 3.9 MiB/s wr, 375 op/s 2024-05-14T15:38:05.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:05 smithi069 ceph-mon[31270]: pgmap v518: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 3.9 MiB/s wr, 375 op/s 2024-05-14T15:38:06.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 740.0 s, 429.8 tps, lat 587.067 ms stddev 2153.643 2024-05-14T15:38:07.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:07 smithi203 ceph-mon[34567]: pgmap v519: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 3.2 MiB/s wr, 232 op/s 2024-05-14T15:38:07.945 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:07 smithi092 ceph-mon[34729]: pgmap v519: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 3.2 MiB/s wr, 232 op/s 2024-05-14T15:38:07.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:07 smithi069 ceph-mon[31270]: pgmap v519: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 3.2 MiB/s wr, 232 op/s 2024-05-14T15:38:08.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:08 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:38:08.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:08 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:38:08.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:08 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:38:09.742 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.741+0000 7f9dd1c00640 1 -- 172.21.15.69:0/2185541849 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dcc104400 msgr2=0x7f9dcc1107d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.741+0000 7f9dd1c00640 1 --2- 172.21.15.69:0/2185541849 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dcc104400 0x7f9dcc1107d0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009900 tx=0x7f9db802a3f0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.741+0000 7f9dd1c00640 1 -- 172.21.15.69:0/2185541849 shutdown_connections 2024-05-14T15:38:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.741+0000 7f9dd1c00640 1 --2- 172.21.15.69:0/2185541849 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dcc104400 0x7f9dcc1107d0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.741+0000 7f9dd1c00640 1 --2- 172.21.15.69:0/2185541849 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dcc10a150 0x7f9dcc103d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.741+0000 7f9dd1c00640 1 --2- 172.21.15.69:0/2185541849 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dcc109cb0 0x7f9dcc103850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.741+0000 7f9dd1c00640 1 -- 172.21.15.69:0/2185541849 >> 172.21.15.69:0/2185541849 conn(0x7f9dcc0793a0 msgr2=0x7f9dcc0797e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.742+0000 7f9dd1c00640 1 -- 172.21.15.69:0/2185541849 shutdown_connections 2024-05-14T15:38:09.743 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.742+0000 7f9dd1c00640 1 -- 172.21.15.69:0/2185541849 wait complete. 2024-05-14T15:38:09.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.745+0000 7f9dd1c00640 1 Processor -- start 2024-05-14T15:38:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.746+0000 7f9dd1c00640 1 -- start start 2024-05-14T15:38:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.746+0000 7f9dd1c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dcc104400 0x7f9dcc076b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.746+0000 7f9dd1c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dcc109cb0 0x7f9dcc074fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.746+0000 7f9dd1c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dcc10a150 0x7f9dcc0755d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.746+0000 7f9dd1c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc113d50 con 0x7f9dcc109cb0 2024-05-14T15:38:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.749+0000 7f9dd1c00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc113bd0 con 0x7f9dcc10a150 2024-05-14T15:38:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.749+0000 7f9dd1c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9dcc113ed0 con 0x7f9dcc104400 2024-05-14T15:38:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.747+0000 7f9dcaa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dcc104400 0x7f9dcc076b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.749+0000 7f9dcaa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dcc104400 0x7f9dcc076b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:59026/0 (socket says 172.21.15.69:59026) 2024-05-14T15:38:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.749+0000 7f9dcaa00640 1 -- 172.21.15.69:0/785484107 learned_addr learned my addr 172.21.15.69:0/785484107 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:09.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.749+0000 7f9dcb400640 1 --2- 172.21.15.69:0/785484107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dcc10a150 0x7f9dcc0755d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.750+0000 7f9dca000640 1 --2- 172.21.15.69:0/785484107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dcc109cb0 0x7f9dcc074fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.751+0000 7f9dcaa00640 1 -- 172.21.15.69:0/785484107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dcc10a150 msgr2=0x7f9dcc0755d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.751+0000 7f9dcaa00640 1 --2- 172.21.15.69:0/785484107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dcc10a150 0x7f9dcc0755d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.751+0000 7f9dcaa00640 1 -- 172.21.15.69:0/785484107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dcc109cb0 msgr2=0x7f9dcc074fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.751+0000 7f9dcaa00640 1 --2- 172.21.15.69:0/785484107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dcc109cb0 0x7f9dcc074fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.751+0000 7f9dcaa00640 1 -- 172.21.15.69:0/785484107 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dcc075dc0 con 0x7f9dcc104400 2024-05-14T15:38:09.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.751+0000 7f9dcaa00640 1 --2- 172.21.15.69:0/785484107 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dcc104400 0x7f9dcc076b80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400eb90 tx=0x7f9dc400c6a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.752+0000 7f9dc3400640 1 -- 172.21.15.69:0/785484107 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4010630 con 0x7f9dcc104400 2024-05-14T15:38:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.752+0000 7f9dc3400640 1 -- 172.21.15.69:0/785484107 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9dc400ee90 con 0x7f9dcc104400 2024-05-14T15:38:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.752+0000 7f9dc3400640 1 -- 172.21.15.69:0/785484107 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dc4018a50 con 0x7f9dcc104400 2024-05-14T15:38:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.752+0000 7f9dd1c00640 1 -- 172.21.15.69:0/785484107 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dcc19ea10 con 0x7f9dcc104400 2024-05-14T15:38:09.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.753+0000 7f9dd1c00640 1 -- 172.21.15.69:0/785484107 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dcc19ef10 con 0x7f9dcc104400 2024-05-14T15:38:09.758 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.757+0000 7f9dd8c78740 1 Processor -- start 2024-05-14T15:38:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.758+0000 7f9dd8c78740 1 -- start start 2024-05-14T15:38:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.758+0000 7f9dd8c78740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637641b0 0x561263b05280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.759 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.759+0000 7f9dd8c78740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56126373b2f0 0x561263b057c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.759+0000 7f9dd8c78740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 0x561263b05d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.759+0000 7f9dd8c78740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x561263a6a550 con 0x56126373b2f0 2024-05-14T15:38:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.759+0000 7f9dd8c78740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561263a0fbc0 con 0x5612637434d0 2024-05-14T15:38:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.759+0000 7f9dd8c78740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561263a66510 con 0x5612637641b0 2024-05-14T15:38:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.759+0000 7f9dcaa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56126373b2f0 0x561263b057c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.760 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.759+0000 7f9dcb400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637641b0 0x561263b05280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.759+0000 7f9dcaa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56126373b2f0 0x561263b057c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:40982/0 (socket says 172.21.15.69:40982) 2024-05-14T15:38:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.759+0000 7f9dcaa00640 1 -- 172.21.15.69:0/317356843 learned_addr learned my addr 172.21.15.69:0/317356843 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.759+0000 7f9dca000640 1 --2- 172.21.15.69:0/317356843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 0x561263b05d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.760+0000 7f9dcb400640 1 -- 172.21.15.69:0/317356843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 msgr2=0x561263b05d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:09.761 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.760+0000 7f9dcb400640 1 --2- 172.21.15.69:0/317356843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 0x561263b05d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.760+0000 7f9dcb400640 1 -- 172.21.15.69:0/317356843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56126373b2f0 msgr2=0x561263b057c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:09.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.760+0000 7f9dcb400640 1 --2- 172.21.15.69:0/317356843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56126373b2f0 0x561263b057c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.762 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.760+0000 7f9dcb400640 1 -- 172.21.15.69:0/317356843 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56126377c210 con 0x5612637641b0 2024-05-14T15:38:09.763 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.762+0000 7f9dcb400640 1 --2- 172.21.15.69:0/317356843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637641b0 0x561263b05280 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009850 tx=0x7f9db80040f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1499a05c91a08b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:09.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.763+0000 7f9db7e00640 1 -- 172.21.15.69:0/317356843 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db8040070 con 0x5612637641b0 2024-05-14T15:38:09.764 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.763+0000 7f9db7e00640 1 -- 172.21.15.69:0/317356843 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db8003a80 con 0x5612637641b0 2024-05-14T15:38:09.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.763+0000 7f9db7e00640 1 -- 172.21.15.69:0/317356843 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db8035040 con 0x5612637641b0 2024-05-14T15:38:09.765 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.764+0000 7f9dc3400640 1 -- 172.21.15.69:0/785484107 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9dc4018bf0 con 0x7f9dcc104400 2024-05-14T15:38:09.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.765+0000 7f9dd8c78740 1 -- 172.21.15.69:0/317356843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637641b0 msgr2=0x561263b05280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:09.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.765+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/317356843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637641b0 0x561263b05280 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f9db8009850 tx=0x7f9db80040f0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.766 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.766+0000 7f9dd8c78740 1 -- 172.21.15.69:0/317356843 shutdown_connections 2024-05-14T15:38:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.766+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/317356843 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 0x561263b05d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.766+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/317356843 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56126373b2f0 0x561263b057c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.766+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/317356843 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637641b0 0x561263b05280 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.766+0000 7f9dd8c78740 1 -- 172.21.15.69:0/317356843 >> 172.21.15.69:0/317356843 conn(0x561263758300 msgr2=0x561263b01a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.766+0000 7f9dd8c78740 1 -- 172.21.15.69:0/317356843 shutdown_connections 2024-05-14T15:38:09.767 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.767+0000 7f9dd8c78740 1 -- 172.21.15.69:0/317356843 wait complete. 2024-05-14T15:38:09.768 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.767+0000 7f9dc3400640 1 --2- 172.21.15.69:0/785484107 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9db00b2a70 0x7f9db00b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.768 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.767+0000 7f9dc3400640 1 -- 172.21.15.69:0/785484107 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 9642+0+0 (secure 0 0 0) 0x7f9dc40e32f0 con 0x7f9dcc104400 2024-05-14T15:38:09.768 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.767+0000 7f9dcb400640 1 --2- 172.21.15.69:0/785484107 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9db00b2a70 0x7f9db00b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.767+0000 7f9dd8c78740 1 -- start start 2024-05-14T15:38:09.769 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.768+0000 7f9dd8c78740 1 Processor -- start 2024-05-14T15:38:09.770 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.769+0000 7f9dcb400640 1 --2- 172.21.15.69:0/785484107 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9db00b2a70 0x7f9db00b4f80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9db80096c0 tx=0x7f9db802a3f0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.770+0000 7f9dd8c78740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56126373b2f0 0x561263b0f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.771 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.770+0000 7f9dd8c78740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637434d0 0x561263b0fc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.771+0000 7f9dd8c78740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5612637641b0 0x561263b1b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.771+0000 7f9dd8c78740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x561263b12350 con 0x5612637641b0 2024-05-14T15:38:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.771+0000 7f9dd8c78740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561263a23660 con 0x56126373b2f0 2024-05-14T15:38:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.771+0000 7f9dd8c78740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561263b124d0 con 0x5612637434d0 2024-05-14T15:38:09.772 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.771+0000 7f9dd8c78740 10 client.0 _ll_register_callbacks cb 0x5612639ed400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:38:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.771+0000 7f9dcaa00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56126373b2f0 0x561263b0f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.771+0000 7f9dca000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637434d0 0x561263b0fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.771+0000 7f9dca000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637434d0 0x561263b0fc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:59036/0 (socket says 172.21.15.69:59036) 2024-05-14T15:38:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.771+0000 7f9dca000640 1 -- 172.21.15.69:0/203158253 learned_addr learned my addr 172.21.15.69:0/203158253 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:09.773 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.772+0000 7f9dcb400640 1 --2- 172.21.15.69:0/203158253 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5612637641b0 0x561263b1b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.772+0000 7f9dca000640 1 -- 172.21.15.69:0/203158253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56126373b2f0 msgr2=0x561263b0f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:09.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.772+0000 7f9dca000640 1 --2- 172.21.15.69:0/203158253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56126373b2f0 0x561263b0f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.772+0000 7f9dca000640 1 -- 172.21.15.69:0/203158253 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5612637641b0 msgr2=0x561263b1b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:09.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.772+0000 7f9dca000640 1 --2- 172.21.15.69:0/203158253 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5612637641b0 0x561263b1b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.772+0000 7f9dca000640 1 -- 172.21.15.69:0/203158253 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561263848620 con 0x5612637434d0 2024-05-14T15:38:09.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.773+0000 7f9dcb400640 1 --2- 172.21.15.69:0/203158253 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5612637641b0 0x561263b1b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:38:09.774 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.773+0000 7f9dca000640 1 --2- 172.21.15.69:0/203158253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637434d0 0x561263b0fc10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc06c520 tx=0x7f9dbc012820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=47a518863146f8d2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:09.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.773+0000 7f9db4c00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:38:09.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.774+0000 7f9db4c00640 1 -- 172.21.15.69:0/203158253 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc004220 con 0x5612637434d0 2024-05-14T15:38:09.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.774+0000 7f9db4c00640 1 -- 172.21.15.69:0/203158253 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9642+0+0 (secure 0 0 0) 0x7f9dbc0043c0 con 0x5612637434d0 2024-05-14T15:38:09.775 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.774+0000 7f9dd8c78740 1 -- 172.21.15.69:0/203158253 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9db8003a80 con 0x5612637434d0 2024-05-14T15:38:09.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.775+0000 7f9db4c00640 1 -- 172.21.15.69:0/203158253 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f9dbc005020 con 0x5612637434d0 2024-05-14T15:38:09.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.775+0000 7f9dd8c78740 10 client.26845 fetch_fsmap learned FSMap version 71 2024-05-14T15:38:09.776 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.775+0000 7f9dd8c78740 1 -- 172.21.15.69:0/203158253 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x561263b1e550 con 0x5612637434d0 2024-05-14T15:38:09.777 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.776+0000 7f9db4c00640 1 -- 172.21.15.69:0/203158253 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db8003a80 con 0x5612637434d0 2024-05-14T15:38:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.776+0000 7f9db4c00640 1 -- 172.21.15.69:0/203158253 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 71) ==== 8398+0+0 (secure 0 0 0) 0x7f9dbc019070 con 0x5612637434d0 2024-05-14T15:38:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.776+0000 7f9dd8c78740 10 client.26845 fetch_fsmap finished waiting for FSMap version 71 2024-05-14T15:38:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.776+0000 7f9dd8c78740 10 client.26845 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:38:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.776+0000 7f9dd8c78740 20 client.26845 populate_metadata read hostname 'smithi069' 2024-05-14T15:38:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.777+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/203158253 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x561263722d80 0x561263b21af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.777+0000 7f9dd8c78740 4 client.26845 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:38:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.777+0000 7f9dd8c78740 1 -- 172.21.15.69:0/203158253 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561263a78160 con 0x561263722d80 2024-05-14T15:38:09.778 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.777+0000 7f9dcaa00640 1 --2- 172.21.15.69:0/203158253 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x561263722d80 0x561263b21af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.779+0000 7f9dcaa00640 1 --2- 172.21.15.69:0/203158253 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x561263722d80 0x561263b21af0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8aaef8191f8adc06 server_cookie=44a14cbfe0e77ad9 in_seq=0 out_seq=0 2024-05-14T15:38:09.780 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.779+0000 7f9db4c00640 10 client.26845 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:38:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.781+0000 7f9db4c00640 1 -- 172.21.15.69:0/203158253 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x561263a78160 con 0x561263722d80 2024-05-14T15:38:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.781+0000 7f9db4c00640 10 client.26845 handle_command_reply: tid=0 2024-05-14T15:38:09.782 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.781+0000 7f9dd8c78740 1 client.26845 shutdown 2024-05-14T15:38:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.782+0000 7f9dd8c78740 1 -- 172.21.15.69:0/203158253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637434d0 msgr2=0x561263b0fc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.782+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/203158253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637434d0 0x561263b0fc10 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f9dcc06c520 tx=0x7f9dbc012820 comp rx=0 tx=0).stop 2024-05-14T15:38:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.782+0000 7f9dd8c78740 1 -- 172.21.15.69:0/203158253 shutdown_connections 2024-05-14T15:38:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.782+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/203158253 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x561263722d80 0x561263b21af0 crc :-1 s=READY pgs=234 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.782+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/203158253 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5612637641b0 0x561263b1b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.782+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/203158253 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637434d0 0x561263b0fc10 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.782+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/203158253 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56126373b2f0 0x561263b0f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.782+0000 7f9dd8c78740 1 -- 172.21.15.69:0/203158253 >> 172.21.15.69:0/203158253 conn(0x561263758300 msgr2=0x561263b050b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:09.783 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.782+0000 7f9db4c00640 0 client.26845 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:38:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.782+0000 7f9dd8c78740 1 -- 172.21.15.69:0/203158253 shutdown_connections 2024-05-14T15:38:09.784 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.783+0000 7f9dd8c78740 1 -- 172.21.15.69:0/203158253 wait complete. 2024-05-14T15:38:09.785 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.784+0000 7f9dd8c78740 20 client.26845 trim_cache size 0 max 16384 2024-05-14T15:38:09.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.836+0000 7f9dd8c78740 1 Processor -- start 2024-05-14T15:38:09.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.837+0000 7f9dd8c78740 1 -- start start 2024-05-14T15:38:09.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.837+0000 7f9dd8c78740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56126373b2f0 0x561263b0e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.837+0000 7f9dd8c78740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 0x561263b018c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.837+0000 7f9dd8c78740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5612637641b0 0x561263b272f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.837+0000 7f9dd8c78740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac010270 con 0x5612637641b0 2024-05-14T15:38:09.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.838+0000 7f9dd8c78740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac011ea0 con 0x5612637434d0 2024-05-14T15:38:09.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.838+0000 7f9dd8c78740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac010940 con 0x56126373b2f0 2024-05-14T15:38:09.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.838+0000 7f9dcb400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5612637641b0 0x561263b272f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.838+0000 7f9dca000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 0x561263b018c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.838+0000 7f9dcaa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56126373b2f0 0x561263b0e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.839 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.838+0000 7f9dca000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 0x561263b018c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:54370/0 (socket says 172.21.15.69:54370) 2024-05-14T15:38:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.838+0000 7f9dca000640 1 -- 172.21.15.69:0/3609948250 learned_addr learned my addr 172.21.15.69:0/3609948250 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.839+0000 7f9dcb400640 1 -- 172.21.15.69:0/3609948250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56126373b2f0 msgr2=0x561263b0e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:09.840 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.839+0000 7f9dcb400640 1 --2- 172.21.15.69:0/3609948250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56126373b2f0 0x561263b0e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.839+0000 7f9dcb400640 1 -- 172.21.15.69:0/3609948250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 msgr2=0x561263b018c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.839+0000 7f9dcb400640 1 --2- 172.21.15.69:0/3609948250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 0x561263b018c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.839+0000 7f9dcb400640 1 -- 172.21.15.69:0/3609948250 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561263b06020 con 0x5612637641b0 2024-05-14T15:38:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.839+0000 7f9dca000640 1 --2- 172.21.15.69:0/3609948250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 0x561263b018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:38:09.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.840+0000 7f9dcb400640 1 --2- 172.21.15.69:0/3609948250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5612637641b0 0x561263b272f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f9db8006010 tx=0x7f9db8049000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4354bf875482bdaf server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:09.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.841+0000 7f9db7400640 1 -- 172.21.15.69:0/3609948250 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db805b070 con 0x5612637641b0 2024-05-14T15:38:09.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.841+0000 7f9db7400640 1 -- 172.21.15.69:0/3609948250 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db8003a80 con 0x5612637641b0 2024-05-14T15:38:09.843 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.841+0000 7f9db7400640 1 -- 172.21.15.69:0/3609948250 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9db8035040 con 0x5612637641b0 2024-05-14T15:38:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.843+0000 7f9dd8c78740 1 -- 172.21.15.69:0/3609948250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5612637641b0 msgr2=0x561263b272f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.843+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/3609948250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5612637641b0 0x561263b272f0 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f9db8006010 tx=0x7f9db8049000 comp rx=0 tx=0).stop 2024-05-14T15:38:09.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.844+0000 7f9dd8c78740 1 -- 172.21.15.69:0/3609948250 shutdown_connections 2024-05-14T15:38:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.844+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/3609948250 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5612637641b0 0x561263b272f0 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.844+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/3609948250 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 0x561263b018c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.844+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/3609948250 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56126373b2f0 0x561263b0e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.844+0000 7f9dd8c78740 1 -- 172.21.15.69:0/3609948250 >> 172.21.15.69:0/3609948250 conn(0x561263758300 msgr2=0x561263b011b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:09.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.844+0000 7f9dd8c78740 1 -- 172.21.15.69:0/3609948250 shutdown_connections 2024-05-14T15:38:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.845+0000 7f9dd8c78740 1 -- 172.21.15.69:0/3609948250 wait complete. 2024-05-14T15:38:09.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.845+0000 7f9dd8c78740 1 -- start start 2024-05-14T15:38:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.846+0000 7f9dd8c78740 1 Processor -- start 2024-05-14T15:38:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.846+0000 7f9dd8c78740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56126373b2f0 0x561263b17d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.846+0000 7f9dd8c78740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 0x561263b12720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.847+0000 7f9dd8c78740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637641b0 0x561263b12c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.847+0000 7f9dd8c78740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac011770 con 0x56126373b2f0 2024-05-14T15:38:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.847+0000 7f9dd8c78740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac011010 con 0x5612637434d0 2024-05-14T15:38:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.847+0000 7f9dd8c78740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9dac00e270 con 0x5612637641b0 2024-05-14T15:38:09.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.847+0000 7f9dd8c78740 10 client.0 _ll_register_callbacks cb 0x7f9dbc00b710 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:38:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.847+0000 7f9dcaa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56126373b2f0 0x561263b17d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.848+0000 7f9dcb400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637641b0 0x561263b12c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.848+0000 7f9dcb400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637641b0 0x561263b12c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:59060/0 (socket says 172.21.15.69:59060) 2024-05-14T15:38:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.848+0000 7f9dcb400640 1 -- 172.21.15.69:0/985611685 learned_addr learned my addr 172.21.15.69:0/985611685 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:09.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.848+0000 7f9dca000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 0x561263b12720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.849+0000 7f9dca000640 1 -- 172.21.15.69:0/985611685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637641b0 msgr2=0x561263b12c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:09.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.849+0000 7f9dca000640 1 --2- 172.21.15.69:0/985611685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637641b0 0x561263b12c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.849+0000 7f9dca000640 1 -- 172.21.15.69:0/985611685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56126373b2f0 msgr2=0x561263b17d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:09.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.850+0000 7f9dca000640 1 --2- 172.21.15.69:0/985611685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56126373b2f0 0x561263b17d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.850+0000 7f9dca000640 1 -- 172.21.15.69:0/985611685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561263b133a0 con 0x5612637434d0 2024-05-14T15:38:09.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.850+0000 7f9dcb400640 1 --2- 172.21.15.69:0/985611685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637641b0 0x561263b12c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:38:09.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.850+0000 7f9dcaa00640 1 --2- 172.21.15.69:0/985611685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56126373b2f0 0x561263b17d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:38:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.851+0000 7f9dca000640 1 --2- 172.21.15.69:0/985611685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 0x561263b12720 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc001eb0 tx=0x7f9dbc010d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4fc129eae64ab756 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:09.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.851+0000 7f9db4c00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:38:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.852+0000 7f9db4c00640 1 -- 172.21.15.69:0/985611685 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9dbc032060 con 0x5612637434d0 2024-05-14T15:38:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.852+0000 7f9db4c00640 1 -- 172.21.15.69:0/985611685 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(114..114 src has 1..114) ==== 9642+0+0 (secure 0 0 0) 0x7f9dbc0055d0 con 0x5612637434d0 2024-05-14T15:38:09.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.852+0000 7f9dd8c78740 1 -- 172.21.15.69:0/985611685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9db8003a80 con 0x5612637434d0 2024-05-14T15:38:09.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.853+0000 7f9db4c00640 1 -- 172.21.15.69:0/985611685 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=71) ==== 24+0+0 (secure 0 0 0) 0x7f9dbc029070 con 0x5612637434d0 2024-05-14T15:38:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.854+0000 7f9dd8c78740 10 client.36881 fetch_fsmap learned FSMap version 71 2024-05-14T15:38:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.854+0000 7f9dd8c78740 1 -- 172.21.15.69:0/985611685 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=71,monmap=4+}) -- 0x561263b88d50 con 0x5612637434d0 2024-05-14T15:38:09.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.854+0000 7f9db4c00640 1 -- 172.21.15.69:0/985611685 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9db8003a80 con 0x5612637434d0 2024-05-14T15:38:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.855+0000 7f9db4c00640 1 -- 172.21.15.69:0/985611685 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 71) ==== 8398+0+0 (secure 0 0 0) 0x7f9dbc019040 con 0x5612637434d0 2024-05-14T15:38:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.855+0000 7f9dd8c78740 10 client.36881 fetch_fsmap finished waiting for FSMap version 71 2024-05-14T15:38:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.855+0000 7f9dd8c78740 10 client.36881 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:38:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.855+0000 7f9dd8c78740 20 client.36881 populate_metadata read hostname 'smithi069' 2024-05-14T15:38:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.855+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/985611685 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5612636f81c0 0x561263b8b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.855+0000 7f9dd8c78740 4 client.36881 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:38:09.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.855+0000 7f9dd8c78740 1 -- 172.21.15.69:0/985611685 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561263a71fd0 con 0x5612636f81c0 2024-05-14T15:38:09.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.856+0000 7f9dcaa00640 1 --2- 172.21.15.69:0/985611685 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5612636f81c0 0x561263b8b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:09.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.857+0000 7f9dcaa00640 1 --2- 172.21.15.69:0/985611685 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5612636f81c0 0x561263b8b4f0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b756b348dcd0f75a server_cookie=ee7a06d860ca8ad6 in_seq=0 out_seq=0 2024-05-14T15:38:09.858 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.857+0000 7f9db4c00640 10 client.36881 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:38:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.905+0000 7f9db4c00640 1 -- 172.21.15.69:0/985611685 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561263a71fd0 con 0x5612636f81c0 2024-05-14T15:38:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.905+0000 7f9db4c00640 10 client.36881 handle_command_reply: tid=0 2024-05-14T15:38:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.905+0000 7f9dd8c78740 1 client.36881 shutdown 2024-05-14T15:38:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.905+0000 7f9dd8c78740 1 -- 172.21.15.69:0/985611685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 msgr2=0x561263b12720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.905+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/985611685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 0x561263b12720 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f9dbc001eb0 tx=0x7f9dbc010d70 comp rx=0 tx=0).stop 2024-05-14T15:38:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.905+0000 7f9dd8c78740 1 -- 172.21.15.69:0/985611685 shutdown_connections 2024-05-14T15:38:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.906+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/985611685 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5612637641b0 0x561263b12c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.906+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/985611685 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5612637434d0 0x561263b12720 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.906+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/985611685 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5612636f81c0 0x561263b8b4f0 crc :-1 s=READY pgs=235 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.906+0000 7f9dd8c78740 1 --2- 172.21.15.69:0/985611685 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56126373b2f0 0x561263b17d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.906+0000 7f9dd8c78740 1 -- 172.21.15.69:0/985611685 >> 172.21.15.69:0/985611685 conn(0x561263758300 msgr2=0x561263b05010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:09.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.906+0000 7f9db4c00640 0 client.36881 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:38:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.906+0000 7f9dd8c78740 1 -- 172.21.15.69:0/985611685 shutdown_connections 2024-05-14T15:38:09.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.906+0000 7f9dd8c78740 1 -- 172.21.15.69:0/985611685 wait complete. 2024-05-14T15:38:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.908+0000 7f9dd8c78740 20 client.36881 trim_cache size 0 max 16384 2024-05-14T15:38:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:38:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:38:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:38:09.909 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:38:09.911 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.910+0000 7f9dd1c00640 1 -- 172.21.15.69:0/785484107 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9db00b2a70 msgr2=0x7f9db00b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:09.911 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.910+0000 7f9dd1c00640 1 --2- 172.21.15.69:0/785484107 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9db00b2a70 0x7f9db00b4f80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9db80096c0 tx=0x7f9db802a3f0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.911 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.910+0000 7f9dd1c00640 1 -- 172.21.15.69:0/785484107 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dcc104400 msgr2=0x7f9dcc076b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:09.911 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.910+0000 7f9dd1c00640 1 --2- 172.21.15.69:0/785484107 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dcc104400 0x7f9dcc076b80 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9dc400eb90 tx=0x7f9dc400c6a0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.911+0000 7f9dd1c00640 1 -- 172.21.15.69:0/785484107 shutdown_connections 2024-05-14T15:38:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.911+0000 7f9dd1c00640 1 --2- 172.21.15.69:0/785484107 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9db00b2a70 0x7f9db00b4f80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.911+0000 7f9dd1c00640 1 --2- 172.21.15.69:0/785484107 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9dcc10a150 0x7f9dcc0755d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.911+0000 7f9dd1c00640 1 --2- 172.21.15.69:0/785484107 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9dcc109cb0 0x7f9dcc074fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.912 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.911+0000 7f9dd1c00640 1 --2- 172.21.15.69:0/785484107 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9dcc104400 0x7f9dcc076b80 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.911+0000 7f9dd1c00640 1 -- 172.21.15.69:0/785484107 >> 172.21.15.69:0/785484107 conn(0x7f9dcc0793a0 msgr2=0x7f9dcc100fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.912+0000 7f9dd1c00640 1 -- 172.21.15.69:0/785484107 shutdown_connections 2024-05-14T15:38:09.913 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:09.913+0000 7f9dd1c00640 1 -- 172.21.15.69:0/785484107 wait complete. 2024-05-14T15:38:09.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:09 smithi092 ceph-mon[34729]: pgmap v520: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 3.2 MiB/s wr, 232 op/s 2024-05-14T15:38:09.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:09 smithi069 ceph-mon[31270]: pgmap v520: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 3.2 MiB/s wr, 232 op/s 2024-05-14T15:38:10.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:09 smithi203 ceph-mon[34567]: pgmap v520: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 3.2 MiB/s wr, 232 op/s 2024-05-14T15:38:11.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:10 smithi069 ceph-mon[31270]: osdmap e115: 12 total, 12 up, 12 in 2024-05-14T15:38:11.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:10 smithi203 ceph-mon[34567]: osdmap e115: 12 total, 12 up, 12 in 2024-05-14T15:38:11.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 745.0 s, 575.4 tps, lat 175.882 ms stddev 103.396 2024-05-14T15:38:11.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:10 smithi092 ceph-mon[34729]: osdmap e115: 12 total, 12 up, 12 in 2024-05-14T15:38:12.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:11 smithi069 ceph-mon[31270]: pgmap v522: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 6.6 MiB/s wr, 384 op/s 2024-05-14T15:38:12.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:11 smithi203 ceph-mon[34567]: pgmap v522: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 6.6 MiB/s wr, 384 op/s 2024-05-14T15:38:12.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:11 smithi092 ceph-mon[34729]: pgmap v522: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 121 KiB/s rd, 6.6 MiB/s wr, 384 op/s 2024-05-14T15:38:14.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:13 smithi069 ceph-mon[31270]: pgmap v523: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 6.2 MiB/s wr, 377 op/s 2024-05-14T15:38:14.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:13 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:38:14.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:13 smithi203 ceph-mon[34567]: pgmap v523: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 6.2 MiB/s wr, 377 op/s 2024-05-14T15:38:14.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:13 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:38:14.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:13 smithi092 ceph-mon[34729]: pgmap v523: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 131 KiB/s rd, 6.2 MiB/s wr, 377 op/s 2024-05-14T15:38:14.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:13 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:38:15.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:14 smithi203 ceph-mon[34567]: pgmap v524: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 6.3 MiB/s wr, 383 op/s 2024-05-14T15:38:15.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:14 smithi092 ceph-mon[34729]: pgmap v524: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 6.3 MiB/s wr, 383 op/s 2024-05-14T15:38:15.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:14 smithi069 ceph-mon[31270]: pgmap v524: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 234 KiB/s rd, 6.3 MiB/s wr, 383 op/s 2024-05-14T15:38:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 750.0 s, 626.4 tps, lat 161.053 ms stddev 69.848 2024-05-14T15:38:17.725 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:17 smithi069 ceph-mon[31270]: pgmap v525: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 9.2 MiB/s wr, 569 op/s 2024-05-14T15:38:17.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:17 smithi203 ceph-mon[34567]: pgmap v525: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 9.2 MiB/s wr, 569 op/s 2024-05-14T15:38:17.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:17 smithi092 ceph-mon[34729]: pgmap v525: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 9.2 MiB/s wr, 569 op/s 2024-05-14T15:38:19.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:19 smithi069 ceph-mon[31270]: pgmap v526: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 9.2 MiB/s wr, 569 op/s 2024-05-14T15:38:19.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:19 smithi203 ceph-mon[34567]: pgmap v526: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 9.2 MiB/s wr, 569 op/s 2024-05-14T15:38:19.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:19 smithi092 ceph-mon[34729]: pgmap v526: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 237 KiB/s rd, 9.2 MiB/s wr, 569 op/s 2024-05-14T15:38:21.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 755.0 s, 482.0 tps, lat 161.577 ms stddev 91.172 2024-05-14T15:38:21.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:21 smithi069 ceph-mon[31270]: pgmap v527: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 9.4 MiB/s wr, 606 op/s 2024-05-14T15:38:21.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:21 smithi203 ceph-mon[34567]: pgmap v527: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 9.4 MiB/s wr, 606 op/s 2024-05-14T15:38:21.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:21 smithi092 ceph-mon[34729]: pgmap v527: 129 pgs: 129 active+clean; 3.1 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 204 KiB/s rd, 9.4 MiB/s wr, 606 op/s 2024-05-14T15:38:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.306+0000 7f80b1400640 1 -- 172.21.15.69:0/1416306329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80a40af6c0 msgr2=0x7f80a40afb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.306+0000 7f80b1400640 1 --2- 172.21.15.69:0/1416306329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80a40af6c0 0x7f80a40afb50 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f8098009900 tx=0x7f809802a410 comp rx=0 tx=0).stop 2024-05-14T15:38:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.307+0000 7f80b1400640 1 -- 172.21.15.69:0/1416306329 shutdown_connections 2024-05-14T15:38:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.307+0000 7f80b1400640 1 --2- 172.21.15.69:0/1416306329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80a40b01e0 0x7f80a40b6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.307+0000 7f80b1400640 1 --2- 172.21.15.69:0/1416306329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80a40af6c0 0x7f80a40afb50 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.309 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.307+0000 7f80b1400640 1 --2- 172.21.15.69:0/1416306329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a40a5ca0 0x7f80a40a60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.310 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.307+0000 7f80b1400640 1 -- 172.21.15.69:0/1416306329 >> 172.21.15.69:0/1416306329 conn(0x7f80a401b370 msgr2=0x7f80a401b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:23.311 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.309+0000 7f80b1400640 1 -- 172.21.15.69:0/1416306329 shutdown_connections 2024-05-14T15:38:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.309+0000 7f80b1400640 1 -- 172.21.15.69:0/1416306329 wait complete. 2024-05-14T15:38:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.311+0000 7f80b1400640 1 Processor -- start 2024-05-14T15:38:23.313 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.311+0000 7f80b1400640 1 -- start start 2024-05-14T15:38:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.312+0000 7f80b1400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a40a5ca0 0x7f80a41464e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.314 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.312+0000 7f80b1400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80a40af6c0 0x7f80a4146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.313+0000 7f80b1400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80a40b01e0 0x7f80a4140660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.313+0000 7f80aa800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a40a5ca0 0x7f80a41464e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.313+0000 7f80aa800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a40a5ca0 0x7f80a41464e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:44868/0 (socket says 172.21.15.69:44868) 2024-05-14T15:38:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.313+0000 7f80ab200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80a40b01e0 0x7f80a4140660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.313+0000 7f80ab200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80a40b01e0 0x7f80a4140660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54020/0 (socket says 172.21.15.69:54020) 2024-05-14T15:38:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.313+0000 7f80b1400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f80a40b9e00 con 0x7f80a40b01e0 2024-05-14T15:38:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.313+0000 7f80b1400640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80a40b9c80 con 0x7f80a40a5ca0 2024-05-14T15:38:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.313+0000 7f80b1400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f80a40b9f80 con 0x7f80a40af6c0 2024-05-14T15:38:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.313+0000 7f80aa800640 1 -- 172.21.15.69:0/3022980578 learned_addr learned my addr 172.21.15.69:0/3022980578 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:23.316 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.314+0000 7f80a9e00640 1 --2- 172.21.15.69:0/3022980578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80a40af6c0 0x7f80a4146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.314+0000 7f80ab200640 1 -- 172.21.15.69:0/3022980578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80a40af6c0 msgr2=0x7f80a4146a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.314+0000 7f80ab200640 1 --2- 172.21.15.69:0/3022980578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80a40af6c0 0x7f80a4146a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.314+0000 7f80ab200640 1 -- 172.21.15.69:0/3022980578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a40a5ca0 msgr2=0x7f80a41464e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.314+0000 7f80ab200640 1 --2- 172.21.15.69:0/3022980578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a40a5ca0 0x7f80a41464e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.314+0000 7f80ab200640 1 -- 172.21.15.69:0/3022980578 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80a4140d90 con 0x7f80a40b01e0 2024-05-14T15:38:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.315+0000 7f80ab200640 1 --2- 172.21.15.69:0/3022980578 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80a40b01e0 0x7f80a4140660 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f80ac069180 tx=0x7f80ac073a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:23.317 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.315+0000 7f80aa800640 1 --2- 172.21.15.69:0/3022980578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a40a5ca0 0x7f80a41464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:38:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.315+0000 7f80a3400640 1 -- 172.21.15.69:0/3022980578 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac07a070 con 0x7f80a40b01e0 2024-05-14T15:38:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.316+0000 7f80a3400640 1 -- 172.21.15.69:0/3022980578 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f80ac06b5a0 con 0x7f80a40b01e0 2024-05-14T15:38:23.318 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.316+0000 7f80a3400640 1 -- 172.21.15.69:0/3022980578 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80ac076a50 con 0x7f80a40b01e0 2024-05-14T15:38:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.317+0000 7f80b1400640 1 -- 172.21.15.69:0/3022980578 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80a4141020 con 0x7f80a40b01e0 2024-05-14T15:38:23.319 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.317+0000 7f80b1400640 1 -- 172.21.15.69:0/3022980578 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80a414d280 con 0x7f80a40b01e0 2024-05-14T15:38:23.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.326+0000 7f80b8383740 1 Processor -- start 2024-05-14T15:38:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.326+0000 7f80a3400640 1 -- 172.21.15.69:0/3022980578 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f80ac0697c0 con 0x7f80a40b01e0 2024-05-14T15:38:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.327+0000 7f80b8383740 1 -- start start 2024-05-14T15:38:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.327+0000 7f80b8383740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574587bb1b0 0x557458b64c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.327+0000 7f80b8383740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574587922f0 0x557458b651c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.330 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.327+0000 7f80b8383740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55745879a4d0 0x557458b65700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.327+0000 7f80b8383740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x557458ac1550 con 0x55745879a4d0 2024-05-14T15:38:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.327+0000 7f80b8383740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557458a66bc0 con 0x5574587922f0 2024-05-14T15:38:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.327+0000 7f80b8383740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557458abd510 con 0x5574587bb1b0 2024-05-14T15:38:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.328+0000 7f80a9e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55745879a4d0 0x557458b65700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.328+0000 7f80a9e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55745879a4d0 0x557458b65700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54034/0 (socket says 172.21.15.69:54034) 2024-05-14T15:38:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.328+0000 7f80a9e00640 1 -- 172.21.15.69:0/1403419441 learned_addr learned my addr 172.21.15.69:0/1403419441 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.328+0000 7f80a9e00640 1 --2- 172.21.15.69:0/1403419441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574587bb1b0 0x557458b64c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.329+0000 7f80aa800640 1 --2- 172.21.15.69:0/1403419441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574587922f0 0x557458b651c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.330+0000 7f80a3400640 1 --2- 172.21.15.69:0/3022980578 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f80900b2a10 0x7f80900b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.330+0000 7f80a9e00640 1 -- 172.21.15.69:0/1403419441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574587bb1b0 msgr2=0x557458b64c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.330+0000 7f80a9e00640 1 --2- 172.21.15.69:0/1403419441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574587bb1b0 0x557458b64c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.330+0000 7f80a9e00640 1 -- 172.21.15.69:0/1403419441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574587922f0 msgr2=0x557458b651c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.330+0000 7f80a3400640 1 -- 172.21.15.69:0/3022980578 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9554+0+0 (secure 0 0 0) 0x7f80ac146cd0 con 0x7f80a40b01e0 2024-05-14T15:38:23.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.330+0000 7f80a9e00640 1 --2- 172.21.15.69:0/1403419441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574587922f0 0x557458b651c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.330+0000 7f80a9e00640 1 -- 172.21.15.69:0/1403419441 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574587d3210 con 0x55745879a4d0 2024-05-14T15:38:23.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.331+0000 7f80ab200640 1 --2- 172.21.15.69:0/3022980578 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f80900b2a10 0x7f80900b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.331+0000 7f80aa800640 1 --2- 172.21.15.69:0/1403419441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574587922f0 0x557458b651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:38:23.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.332+0000 7f80a9e00640 1 --2- 172.21.15.69:0/1403419441 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55745879a4d0 0x557458b65700 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x557458b61df0 tx=0x7f8098005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3ed013dca27dbac server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:23.335 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.333+0000 7f80ab200640 1 --2- 172.21.15.69:0/3022980578 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f80900b2a10 0x7f80900b4f20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f80ac1440c0 tx=0x7f80ac068f90 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:23.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.333+0000 7f8097400640 1 -- 172.21.15.69:0/1403419441 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098035030 con 0x55745879a4d0 2024-05-14T15:38:23.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.334+0000 7f8097400640 1 -- 172.21.15.69:0/1403419441 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8098005560 con 0x55745879a4d0 2024-05-14T15:38:23.336 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.334+0000 7f8097400640 1 -- 172.21.15.69:0/1403419441 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098003910 con 0x55745879a4d0 2024-05-14T15:38:23.337 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.335+0000 7f80b8383740 1 -- 172.21.15.69:0/1403419441 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55745879a4d0 msgr2=0x557458b65700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:23.337 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.335+0000 7f80b8383740 1 --2- 172.21.15.69:0/1403419441 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55745879a4d0 0x557458b65700 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x557458b61df0 tx=0x7f8098005d50 comp rx=0 tx=0).stop 2024-05-14T15:38:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.336+0000 7f80b8383740 1 -- 172.21.15.69:0/1403419441 shutdown_connections 2024-05-14T15:38:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.336+0000 7f80b8383740 1 --2- 172.21.15.69:0/1403419441 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55745879a4d0 0x557458b65700 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.336+0000 7f80b8383740 1 --2- 172.21.15.69:0/1403419441 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574587922f0 0x557458b651c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.336+0000 7f80b8383740 1 --2- 172.21.15.69:0/1403419441 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574587bb1b0 0x557458b64c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.336+0000 7f80b8383740 1 -- 172.21.15.69:0/1403419441 >> 172.21.15.69:0/1403419441 conn(0x5574587af300 msgr2=0x557458b61430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.336+0000 7f80b8383740 1 -- 172.21.15.69:0/1403419441 shutdown_connections 2024-05-14T15:38:23.338 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.336+0000 7f80b8383740 1 -- 172.21.15.69:0/1403419441 wait complete. 2024-05-14T15:38:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.337+0000 7f80b8383740 1 -- start start 2024-05-14T15:38:23.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.337+0000 7f80b8383740 1 Processor -- start 2024-05-14T15:38:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.338+0000 7f80b8383740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574587922f0 0x557458b6f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.338+0000 7f80b8383740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55745879a4d0 0x557458b6f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.338+0000 7f80b8383740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574587bb1b0 0x557458b7b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.338+0000 7f80b8383740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x557458b71d50 con 0x5574587922f0 2024-05-14T15:38:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.338+0000 7f80b8383740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557458a7a660 con 0x55745879a4d0 2024-05-14T15:38:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.338+0000 7f80b8383740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557458b71ed0 con 0x5574587bb1b0 2024-05-14T15:38:23.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.338+0000 7f80b8383740 10 client.0 _ll_register_callbacks cb 0x557458a44400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:38:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.339+0000 7f80aa800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55745879a4d0 0x557458b6f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.339+0000 7f80a9e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574587922f0 0x557458b6f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.339+0000 7f80aa800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55745879a4d0 0x557458b6f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:44894/0 (socket says 172.21.15.69:44894) 2024-05-14T15:38:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.339+0000 7f80aa800640 1 -- 172.21.15.69:0/1341667176 learned_addr learned my addr 172.21.15.69:0/1341667176 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:23.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.339+0000 7f80a9e00640 1 --2- 172.21.15.69:0/1341667176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574587bb1b0 0x557458b7b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.340+0000 7f80a9e00640 1 -- 172.21.15.69:0/1341667176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574587bb1b0 msgr2=0x557458b7b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.340+0000 7f80a9e00640 1 --2- 172.21.15.69:0/1341667176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574587bb1b0 0x557458b7b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.340+0000 7f80a9e00640 1 -- 172.21.15.69:0/1341667176 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55745879a4d0 msgr2=0x557458b6f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.340+0000 7f80a9e00640 1 --2- 172.21.15.69:0/1341667176 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55745879a4d0 0x557458b6f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.340+0000 7f80a9e00640 1 -- 172.21.15.69:0/1341667176 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55745889f620 con 0x5574587922f0 2024-05-14T15:38:23.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.342+0000 7f80a9e00640 1 --2- 172.21.15.69:0/1341667176 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574587922f0 0x557458b6f260 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f80980057c0 tx=0x7f80980035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2218579a5008587 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:23.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.342+0000 7f808be00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:38:23.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.345+0000 7f808be00640 1 -- 172.21.15.69:0/1341667176 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098035040 con 0x5574587922f0 2024-05-14T15:38:23.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.345+0000 7f80b8383740 1 -- 172.21.15.69:0/1341667176 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8098005560 con 0x5574587922f0 2024-05-14T15:38:23.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.347+0000 7f808be00640 1 -- 172.21.15.69:0/1341667176 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9554+0+0 (secure 0 0 0) 0x7f8098004ad0 con 0x5574587922f0 2024-05-14T15:38:23.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.347+0000 7f808be00640 1 -- 172.21.15.69:0/1341667176 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f8098004cd0 con 0x5574587922f0 2024-05-14T15:38:23.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.347+0000 7f80b8383740 10 client.17382 fetch_fsmap learned FSMap version 72 2024-05-14T15:38:23.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.347+0000 7f80b8383740 1 -- 172.21.15.69:0/1341667176 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=4+}) -- 0x557458b7e0b0 con 0x5574587922f0 2024-05-14T15:38:23.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.348+0000 7f808be00640 1 -- 172.21.15.69:0/1341667176 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8098005560 con 0x5574587922f0 2024-05-14T15:38:23.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.349+0000 7f808be00640 1 -- 172.21.15.69:0/1341667176 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 72) ==== 8406+0+0 (secure 0 0 0) 0x7f809804c980 con 0x5574587922f0 2024-05-14T15:38:23.351 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.349+0000 7f80b8383740 10 client.17382 fetch_fsmap finished waiting for FSMap version 72 2024-05-14T15:38:23.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.349+0000 7f80b8383740 10 client.17382 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:38:23.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.349+0000 7f80b8383740 20 client.17382 populate_metadata read hostname 'smithi069' 2024-05-14T15:38:23.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.349+0000 7f80b8383740 1 --2- 172.21.15.69:0/1341667176 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557458779d80 0x557458b81410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.349+0000 7f80b8383740 4 client.17382 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:38:23.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.349+0000 7f80b8383740 1 -- 172.21.15.69:0/1341667176 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557458acf160 con 0x557458779d80 2024-05-14T15:38:23.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.350+0000 7f80aa800640 1 --2- 172.21.15.69:0/1341667176 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557458779d80 0x557458b81410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.351+0000 7f80aa800640 1 --2- 172.21.15.69:0/1341667176 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557458779d80 0x557458b81410 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae3739cf1e8e62ba server_cookie=bef0b3ce5d99763d in_seq=0 out_seq=0 2024-05-14T15:38:23.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.351+0000 7f808be00640 10 client.17382 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:38:23.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.353+0000 7f808be00640 1 -- 172.21.15.69:0/1341667176 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557458acf160 con 0x557458779d80 2024-05-14T15:38:23.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.353+0000 7f808be00640 10 client.17382 handle_command_reply: tid=0 2024-05-14T15:38:23.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.354+0000 7f80b8383740 1 client.17382 shutdown 2024-05-14T15:38:23.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.354+0000 7f80b8383740 1 -- 172.21.15.69:0/1341667176 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574587922f0 msgr2=0x557458b6f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:23.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.354+0000 7f80b8383740 1 --2- 172.21.15.69:0/1341667176 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574587922f0 0x557458b6f260 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f80980057c0 tx=0x7f80980035f0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.354+0000 7f80b8383740 1 -- 172.21.15.69:0/1341667176 shutdown_connections 2024-05-14T15:38:23.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.354+0000 7f80b8383740 1 --2- 172.21.15.69:0/1341667176 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5574587bb1b0 0x557458b7b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.354+0000 7f80b8383740 1 --2- 172.21.15.69:0/1341667176 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55745879a4d0 0x557458b6f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.354+0000 7f80b8383740 1 --2- 172.21.15.69:0/1341667176 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557458779d80 0x557458b81410 crc :-1 s=READY pgs=236 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.354+0000 7f80b8383740 1 --2- 172.21.15.69:0/1341667176 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574587922f0 0x557458b6f260 secure :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f80980057c0 tx=0x7f80980035f0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.354+0000 7f80b8383740 1 -- 172.21.15.69:0/1341667176 >> 172.21.15.69:0/1341667176 conn(0x5574587af300 msgr2=0x557458b669a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:23.357 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.354+0000 7f808be00640 0 client.17382 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:38:23.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.358+0000 7f80b8383740 1 -- 172.21.15.69:0/1341667176 shutdown_connections 2024-05-14T15:38:23.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.358+0000 7f80b8383740 1 -- 172.21.15.69:0/1341667176 wait complete. 2024-05-14T15:38:23.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.359+0000 7f80b8383740 20 client.17382 trim_cache size 0 max 16384 2024-05-14T15:38:23.402 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.400+0000 7f80b8383740 1 Processor -- start 2024-05-14T15:38:23.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.400+0000 7f80b8383740 1 -- start start 2024-05-14T15:38:23.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.401+0000 7f80b8383740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55745879a4d0 0x557458b67260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.401+0000 7f80b8383740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574587bb1b0 0x557458b70ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.401+0000 7f80b8383740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55745874f1c0 0x557458b86c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.401+0000 7f80b8383740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f80a4152fa0 con 0x55745879a4d0 2024-05-14T15:38:23.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.401+0000 7f80b8383740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80a4154c30 con 0x5574587bb1b0 2024-05-14T15:38:23.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.401+0000 7f80b8383740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f80a4153670 con 0x55745874f1c0 2024-05-14T15:38:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.402+0000 7f80a9e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55745874f1c0 0x557458b86c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.402+0000 7f80a9e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55745874f1c0 0x557458b86c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:44232/0 (socket says 172.21.15.69:44232) 2024-05-14T15:38:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.402+0000 7f80a9e00640 1 -- 172.21.15.69:0/2623163831 learned_addr learned my addr 172.21.15.69:0/2623163831 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.402+0000 7f80a9e00640 1 --2- 172.21.15.69:0/2623163831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55745879a4d0 0x557458b67260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.403+0000 7f80aa800640 1 --2- 172.21.15.69:0/2623163831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574587bb1b0 0x557458b70ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.404+0000 7f80a9e00640 1 -- 172.21.15.69:0/2623163831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55745874f1c0 msgr2=0x557458b86c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.404+0000 7f80a9e00640 1 --2- 172.21.15.69:0/2623163831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55745874f1c0 0x557458b86c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.404+0000 7f80a9e00640 1 -- 172.21.15.69:0/2623163831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574587bb1b0 msgr2=0x557458b70ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:23.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.404+0000 7f80a9e00640 1 --2- 172.21.15.69:0/2623163831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574587bb1b0 0x557458b70ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.404+0000 7f80a9e00640 1 -- 172.21.15.69:0/2623163831 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557458b6fe20 con 0x55745879a4d0 2024-05-14T15:38:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.405+0000 7f80aa800640 1 --2- 172.21.15.69:0/2623163831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574587bb1b0 0x557458b70ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:38:23.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.405+0000 7f80a9e00640 1 --2- 172.21.15.69:0/2623163831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55745879a4d0 0x557458b67260 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f80980059d0 tx=0x7f8098000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc30db78a699cf8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.406+0000 7f8096a00640 1 -- 172.21.15.69:0/2623163831 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8098035070 con 0x55745879a4d0 2024-05-14T15:38:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.406+0000 7f8096a00640 1 -- 172.21.15.69:0/2623163831 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8098005d50 con 0x55745879a4d0 2024-05-14T15:38:23.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.406+0000 7f8096a00640 1 -- 172.21.15.69:0/2623163831 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809804c8f0 con 0x55745879a4d0 2024-05-14T15:38:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.408+0000 7f80b8383740 1 -- 172.21.15.69:0/2623163831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55745879a4d0 msgr2=0x557458b67260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:23.410 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.408+0000 7f80b8383740 1 --2- 172.21.15.69:0/2623163831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55745879a4d0 0x557458b67260 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f80980059d0 tx=0x7f8098000bc0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.409+0000 7f80b8383740 1 -- 172.21.15.69:0/2623163831 shutdown_connections 2024-05-14T15:38:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.409+0000 7f80b8383740 1 --2- 172.21.15.69:0/2623163831 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55745874f1c0 0x557458b86c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.409+0000 7f80b8383740 1 --2- 172.21.15.69:0/2623163831 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5574587bb1b0 0x557458b70ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.409+0000 7f80b8383740 1 --2- 172.21.15.69:0/2623163831 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55745879a4d0 0x557458b67260 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.409+0000 7f80b8383740 1 -- 172.21.15.69:0/2623163831 >> 172.21.15.69:0/2623163831 conn(0x5574587af300 msgr2=0x557458b70790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.409+0000 7f80b8383740 1 -- 172.21.15.69:0/2623163831 shutdown_connections 2024-05-14T15:38:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.409+0000 7f80b8383740 1 -- 172.21.15.69:0/2623163831 wait complete. 2024-05-14T15:38:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.410+0000 7f80b8383740 1 -- start start 2024-05-14T15:38:23.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.411+0000 7f80b8383740 1 Processor -- start 2024-05-14T15:38:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.411+0000 7f80b8383740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55745874f1c0 0x557458b72760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.411+0000 7f80b8383740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55745879a4d0 0x557458b72ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.411+0000 7f80b8383740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574587bb1b0 0x557458be1780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.411+0000 7f80b8383740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f80a41544a0 con 0x5574587bb1b0 2024-05-14T15:38:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.411+0000 7f80b8383740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f80a4153d40 con 0x55745879a4d0 2024-05-14T15:38:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.412+0000 7f80b8383740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f80a4150fc0 con 0x55745874f1c0 2024-05-14T15:38:23.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.412+0000 7f80b8383740 10 client.0 _ll_register_callbacks cb 0x7f8098004320 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:38:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.412+0000 7f80aa800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55745879a4d0 0x557458b72ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.413+0000 7f80aa800640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55745879a4d0 0x557458b72ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:44914/0 (socket says 172.21.15.69:44914) 2024-05-14T15:38:23.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.413+0000 7f80aa800640 1 -- 172.21.15.69:0/246183624 learned_addr learned my addr 172.21.15.69:0/246183624 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:23.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.413+0000 7f80a9e00640 1 --2- 172.21.15.69:0/246183624 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574587bb1b0 0x557458be1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.414+0000 7f80aa800640 1 -- 172.21.15.69:0/246183624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55745874f1c0 msgr2=0x557458b72760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:23.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.414+0000 7f80aa800640 1 --2- 172.21.15.69:0/246183624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55745874f1c0 0x557458b72760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.414+0000 7f80aa800640 1 -- 172.21.15.69:0/246183624 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574587bb1b0 msgr2=0x557458be1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:23.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.414+0000 7f80aa800640 1 --2- 172.21.15.69:0/246183624 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574587bb1b0 0x557458be1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.415+0000 7f80aa800640 1 -- 172.21.15.69:0/246183624 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557458be1cf0 con 0x55745879a4d0 2024-05-14T15:38:23.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.415+0000 7f80a9e00640 1 --2- 172.21.15.69:0/246183624 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574587bb1b0 0x557458be1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:38:23.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.416+0000 7f80aa800640 1 --2- 172.21.15.69:0/246183624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55745879a4d0 0x557458b72ca0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f809c005fd0 tx=0x7f809c01cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7b2f7392e40acbe server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:23.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.416+0000 7f808be00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:38:23.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.416+0000 7f808be00640 1 -- 172.21.15.69:0/246183624 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f809c012ca0 con 0x55745879a4d0 2024-05-14T15:38:23.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.417+0000 7f808be00640 1 -- 172.21.15.69:0/246183624 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9554+0+0 (secure 0 0 0) 0x7f809c012e40 con 0x55745879a4d0 2024-05-14T15:38:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.417+0000 7f80b8383740 1 -- 172.21.15.69:0/246183624 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8098005d50 con 0x55745879a4d0 2024-05-14T15:38:23.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.417+0000 7f808be00640 1 -- 172.21.15.69:0/246183624 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7f809c025440 con 0x55745879a4d0 2024-05-14T15:38:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.418+0000 7f80b8383740 10 client.36893 fetch_fsmap learned FSMap version 72 2024-05-14T15:38:23.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.418+0000 7f80b8383740 1 -- 172.21.15.69:0/246183624 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=4+}) -- 0x557458b58d30 con 0x55745879a4d0 2024-05-14T15:38:23.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.418+0000 7f808be00640 1 -- 172.21.15.69:0/246183624 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f8098005d50 con 0x55745879a4d0 2024-05-14T15:38:23.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.421+0000 7f808be00640 1 -- 172.21.15.69:0/246183624 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 72) ==== 8406+0+0 (secure 0 0 0) 0x7f809c023070 con 0x55745879a4d0 2024-05-14T15:38:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.421+0000 7f80b8383740 10 client.36893 fetch_fsmap finished waiting for FSMap version 72 2024-05-14T15:38:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.421+0000 7f80b8383740 10 client.36893 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:38:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.421+0000 7f80b8383740 20 client.36893 populate_metadata read hostname 'smithi069' 2024-05-14T15:38:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.421+0000 7f80b8383740 1 --2- 172.21.15.69:0/246183624 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557458b595f0 0x557458b5ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:23.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.421+0000 7f80b8383740 4 client.36893 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:38:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.421+0000 7f80b8383740 1 -- 172.21.15.69:0/246183624 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557458ac8fd0 con 0x557458b595f0 2024-05-14T15:38:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.422+0000 7f80a9e00640 1 --2- 172.21.15.69:0/246183624 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557458b595f0 0x557458b5ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.423+0000 7f80a9e00640 1 --2- 172.21.15.69:0/246183624 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557458b595f0 0x557458b5ba70 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3eb2b14910609f5c server_cookie=9e99e040963e8405 in_seq=0 out_seq=0 2024-05-14T15:38:23.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.423+0000 7f808be00640 10 client.36893 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:38:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.454+0000 7f808be00640 1 -- 172.21.15.69:0/246183624 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557458ac8fd0 con 0x557458b595f0 2024-05-14T15:38:23.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.454+0000 7f808be00640 10 client.36893 handle_command_reply: tid=0 2024-05-14T15:38:23.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.455+0000 7f80b8383740 1 client.36893 shutdown 2024-05-14T15:38:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.456+0000 7f80b8383740 1 -- 172.21.15.69:0/246183624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55745879a4d0 msgr2=0x557458b72ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.456+0000 7f80b8383740 1 --2- 172.21.15.69:0/246183624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55745879a4d0 0x557458b72ca0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f809c005fd0 tx=0x7f809c01cbf0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.456+0000 7f80b8383740 1 -- 172.21.15.69:0/246183624 shutdown_connections 2024-05-14T15:38:23.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.456+0000 7f80b8383740 1 --2- 172.21.15.69:0/246183624 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557458b595f0 0x557458b5ba70 crc :-1 s=READY pgs=237 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.456+0000 7f80b8383740 1 --2- 172.21.15.69:0/246183624 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5574587bb1b0 0x557458be1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.456+0000 7f808be00640 0 client.36893 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:38:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.456+0000 7f80b8383740 1 --2- 172.21.15.69:0/246183624 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55745879a4d0 0x557458b72ca0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.456+0000 7f80b8383740 1 --2- 172.21.15.69:0/246183624 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55745874f1c0 0x557458b72760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.456+0000 7f80b8383740 1 -- 172.21.15.69:0/246183624 >> 172.21.15.69:0/246183624 conn(0x5574587af300 msgr2=0x557458b71150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:23.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.457+0000 7f80b8383740 1 -- 172.21.15.69:0/246183624 shutdown_connections 2024-05-14T15:38:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.457+0000 7f80b8383740 1 -- 172.21.15.69:0/246183624 wait complete. 2024-05-14T15:38:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.457+0000 7f80b8383740 20 client.36893 trim_cache size 0 max 16384 2024-05-14T15:38:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:38:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:38:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:38:23.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:38:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.459+0000 7f80b1400640 1 -- 172.21.15.69:0/3022980578 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f80900b2a10 msgr2=0x7f80900b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.459+0000 7f80b1400640 1 --2- 172.21.15.69:0/3022980578 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f80900b2a10 0x7f80900b4f20 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f80ac1440c0 tx=0x7f80ac068f90 comp rx=0 tx=0).stop 2024-05-14T15:38:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.459+0000 7f80b1400640 1 -- 172.21.15.69:0/3022980578 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80a40b01e0 msgr2=0x7f80a4140660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.459+0000 7f80b1400640 1 --2- 172.21.15.69:0/3022980578 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80a40b01e0 0x7f80a4140660 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f80ac069180 tx=0x7f80ac073a00 comp rx=0 tx=0).stop 2024-05-14T15:38:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.459+0000 7f80b1400640 1 -- 172.21.15.69:0/3022980578 shutdown_connections 2024-05-14T15:38:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.459+0000 7f80b1400640 1 --2- 172.21.15.69:0/3022980578 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f80900b2a10 0x7f80900b4f20 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.459+0000 7f80b1400640 1 --2- 172.21.15.69:0/3022980578 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f80a40b01e0 0x7f80a4140660 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.459+0000 7f80b1400640 1 --2- 172.21.15.69:0/3022980578 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f80a40af6c0 0x7f80a4146a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.459+0000 7f80b1400640 1 --2- 172.21.15.69:0/3022980578 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f80a40a5ca0 0x7f80a41464e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.459+0000 7f80b1400640 1 -- 172.21.15.69:0/3022980578 >> 172.21.15.69:0/3022980578 conn(0x7f80a401b370 msgr2=0x7f80a40ad5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.460+0000 7f80b1400640 1 -- 172.21.15.69:0/3022980578 shutdown_connections 2024-05-14T15:38:23.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:23.460+0000 7f80b1400640 1 -- 172.21.15.69:0/3022980578 wait complete. 2024-05-14T15:38:23.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:23 smithi203 ceph-mon[34567]: pgmap v528: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 8.8 MiB/s wr, 576 op/s 2024-05-14T15:38:23.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:23 smithi092 ceph-mon[34729]: pgmap v528: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 8.8 MiB/s wr, 576 op/s 2024-05-14T15:38:23.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:23 smithi069 ceph-mon[31270]: pgmap v528: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 179 KiB/s rd, 8.8 MiB/s wr, 576 op/s 2024-05-14T15:38:25.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:25 smithi203 ceph-mon[34567]: pgmap v529: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 8.2 MiB/s wr, 534 op/s 2024-05-14T15:38:25.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:25 smithi092 ceph-mon[34729]: pgmap v529: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 8.2 MiB/s wr, 534 op/s 2024-05-14T15:38:25.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:25 smithi069 ceph-mon[31270]: pgmap v529: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 229 KiB/s rd, 8.2 MiB/s wr, 534 op/s 2024-05-14T15:38:26.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 760.0 s, 706.6 tps, lat 172.642 ms stddev 200.828 2024-05-14T15:38:27.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:27 smithi203 ceph-mon[34567]: pgmap v530: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 12 MiB/s wr, 740 op/s 2024-05-14T15:38:27.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:27 smithi092 ceph-mon[34729]: pgmap v530: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 12 MiB/s wr, 740 op/s 2024-05-14T15:38:27.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:27 smithi069 ceph-mon[31270]: pgmap v530: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 151 KiB/s rd, 12 MiB/s wr, 740 op/s 2024-05-14T15:38:29.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:29 smithi203 ceph-mon[34567]: pgmap v531: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 7.2 MiB/s wr, 487 op/s 2024-05-14T15:38:29.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:29 smithi092 ceph-mon[34729]: pgmap v531: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 7.2 MiB/s wr, 487 op/s 2024-05-14T15:38:29.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:29 smithi069 ceph-mon[31270]: pgmap v531: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 123 KiB/s rd, 7.2 MiB/s wr, 487 op/s 2024-05-14T15:38:31.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 765.0 s, 593.4 tps, lat 165.033 ms stddev 83.034 2024-05-14T15:38:31.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:31 smithi203 ceph-mon[34567]: pgmap v532: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 10 MiB/s wr, 691 op/s 2024-05-14T15:38:31.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:31 smithi092 ceph-mon[34729]: pgmap v532: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 10 MiB/s wr, 691 op/s 2024-05-14T15:38:31.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:31 smithi069 ceph-mon[31270]: pgmap v532: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 157 KiB/s rd, 10 MiB/s wr, 691 op/s 2024-05-14T15:38:33.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:33 smithi203 ceph-mon[34567]: pgmap v533: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 8.9 MiB/s wr, 575 op/s 2024-05-14T15:38:33.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:33 smithi092 ceph-mon[34729]: pgmap v533: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 8.9 MiB/s wr, 575 op/s 2024-05-14T15:38:33.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:33 smithi069 ceph-mon[31270]: pgmap v533: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 126 KiB/s rd, 8.9 MiB/s wr, 575 op/s 2024-05-14T15:38:35.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:35 smithi203 ceph-mon[34567]: pgmap v534: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 7.7 MiB/s wr, 510 op/s 2024-05-14T15:38:35.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:35 smithi092 ceph-mon[34729]: pgmap v534: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 7.7 MiB/s wr, 510 op/s 2024-05-14T15:38:35.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:35 smithi069 ceph-mon[31270]: pgmap v534: 129 pgs: 129 active+clean; 3.2 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 7.7 MiB/s wr, 510 op/s 2024-05-14T15:38:36.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 770.0 s, 605.8 tps, lat 166.716 ms stddev 92.029 2024-05-14T15:38:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.845+0000 7fbe63200640 1 -- 172.21.15.69:0/4064001295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe6410c150 msgr2=0x7fbe64105d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.845+0000 7fbe63200640 1 --2- 172.21.15.69:0/4064001295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe6410c150 0x7fbe64105d90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbe50009900 tx=0x7fbe5002a3f0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.845+0000 7fbe63200640 1 -- 172.21.15.69:0/4064001295 shutdown_connections 2024-05-14T15:38:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.845+0000 7fbe63200640 1 --2- 172.21.15.69:0/4064001295 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe64106400 0x7fbe641127d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.846 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.845+0000 7fbe63200640 1 --2- 172.21.15.69:0/4064001295 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe6410c150 0x7fbe64105d90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.845+0000 7fbe63200640 1 --2- 172.21.15.69:0/4064001295 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe6410bcb0 0x7fbe64105850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.845+0000 7fbe63200640 1 -- 172.21.15.69:0/4064001295 >> 172.21.15.69:0/4064001295 conn(0x7fbe64101350 msgr2=0x7fbe641037a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:36.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.845+0000 7fbe63200640 1 -- 172.21.15.69:0/4064001295 shutdown_connections 2024-05-14T15:38:36.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.846+0000 7fbe63200640 1 -- 172.21.15.69:0/4064001295 wait complete. 2024-05-14T15:38:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.847+0000 7fbe63200640 1 Processor -- start 2024-05-14T15:38:36.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.847+0000 7fbe63200640 1 -- start start 2024-05-14T15:38:36.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.848+0000 7fbe63200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe64106400 0x7fbe641a2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.848+0000 7fbe63200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe6410bcb0 0x7fbe641a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.848+0000 7fbe63200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe6410c150 0x7fbe6419c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.849+0000 7fbe63200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbe64115d80 con 0x7fbe64106400 2024-05-14T15:38:36.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.849+0000 7fbe63200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbe64115c00 con 0x7fbe6410bcb0 2024-05-14T15:38:36.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.849+0000 7fbe63200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbe64115f00 con 0x7fbe6410c150 2024-05-14T15:38:36.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.849+0000 7fbe61e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe64106400 0x7fbe641a2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:36.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.849+0000 7fbe61e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe64106400 0x7fbe641a2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55580/0 (socket says 172.21.15.69:55580) 2024-05-14T15:38:36.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.849+0000 7fbe61e00640 1 -- 172.21.15.69:0/3833515152 learned_addr learned my addr 172.21.15.69:0/3833515152 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:36.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.850+0000 7fbe62800640 1 --2- 172.21.15.69:0/3833515152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe6410c150 0x7fbe6419c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:36.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.851+0000 7fbe62800640 1 -- 172.21.15.69:0/3833515152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe6410bcb0 msgr2=0x7fbe641a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:36.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.851+0000 7fbe62800640 1 --2- 172.21.15.69:0/3833515152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe6410bcb0 0x7fbe641a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.851+0000 7fbe62800640 1 -- 172.21.15.69:0/3833515152 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe64106400 msgr2=0x7fbe641a2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:36.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.851+0000 7fbe62800640 1 --2- 172.21.15.69:0/3833515152 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe64106400 0x7fbe641a2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.851+0000 7fbe62800640 1 -- 172.21.15.69:0/3833515152 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6419cdb0 con 0x7fbe6410c150 2024-05-14T15:38:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.852+0000 7fbe62800640 1 --2- 172.21.15.69:0/3833515152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe6410c150 0x7fbe6419c680 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009fd0 tx=0x7fbe5c00ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.853+0000 7fbe5aa00640 1 -- 172.21.15.69:0/3833515152 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c00ce20 con 0x7fbe6410c150 2024-05-14T15:38:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.853+0000 7fbe5aa00640 1 -- 172.21.15.69:0/3833515152 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe5c005020 con 0x7fbe6410c150 2024-05-14T15:38:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.853+0000 7fbe5aa00640 1 -- 172.21.15.69:0/3833515152 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c010690 con 0x7fbe6410c150 2024-05-14T15:38:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.853+0000 7fbe63200640 1 -- 172.21.15.69:0/3833515152 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe6419d040 con 0x7fbe6410c150 2024-05-14T15:38:36.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.853+0000 7fbe63200640 1 -- 172.21.15.69:0/3833515152 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe641a92a0 con 0x7fbe6410c150 2024-05-14T15:38:36.861 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.860+0000 7fbe6fba4740 1 Processor -- start 2024-05-14T15:38:36.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.862+0000 7fbe5aa00640 1 -- 172.21.15.69:0/3833515152 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fbe5c004b20 con 0x7fbe6410c150 2024-05-14T15:38:36.863 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.862+0000 7fbe6fba4740 1 -- start start 2024-05-14T15:38:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.863+0000 7fbe6fba4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9d181b0 0x5582ea0b94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.863+0000 7fbe6fba4740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cef2f0 0x5582ea0b99f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.863+0000 7fbe6fba4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9cf74d0 0x5582ea0b9f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.863+0000 7fbe6fba4740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5582ea01e550 con 0x5582e9cef2f0 2024-05-14T15:38:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.863+0000 7fbe6fba4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5582e9fc3bc0 con 0x5582e9d181b0 2024-05-14T15:38:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.863+0000 7fbe6fba4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5582ea01a510 con 0x5582e9cf74d0 2024-05-14T15:38:36.864 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.863+0000 7fbe61e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cef2f0 0x5582ea0b99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.863+0000 7fbe61400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9d181b0 0x5582ea0b94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.864+0000 7fbe61400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9d181b0 0x5582ea0b94b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:55314/0 (socket says 172.21.15.69:55314) 2024-05-14T15:38:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.864+0000 7fbe61e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cef2f0 0x5582ea0b99f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55594/0 (socket says 172.21.15.69:55594) 2024-05-14T15:38:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.864+0000 7fbe61400640 1 -- 172.21.15.69:0/3725299027 learned_addr learned my addr 172.21.15.69:0/3725299027 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:36.865 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.864+0000 7fbe61400640 1 --2- 172.21.15.69:0/3725299027 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9cf74d0 0x5582ea0b9f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:36.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.864+0000 7fbe5aa00640 1 --2- 172.21.15.69:0/3833515152 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbe480b29d0 0x7fbe480b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.865+0000 7fbe61400640 1 -- 172.21.15.69:0/3725299027 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9cf74d0 msgr2=0x5582ea0b9f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:36.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.865+0000 7fbe61400640 1 --2- 172.21.15.69:0/3725299027 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9cf74d0 0x5582ea0b9f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.865+0000 7fbe61400640 1 -- 172.21.15.69:0/3725299027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cef2f0 msgr2=0x5582ea0b99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:36.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.865+0000 7fbe61400640 1 --2- 172.21.15.69:0/3725299027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cef2f0 0x5582ea0b99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.865+0000 7fbe61400640 1 -- 172.21.15.69:0/3725299027 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582e9d30210 con 0x5582e9d181b0 2024-05-14T15:38:36.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.865+0000 7fbe61e00640 1 --2- 172.21.15.69:0/3725299027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cef2f0 0x5582ea0b99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:38:36.866 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.865+0000 7fbe5aa00640 1 -- 172.21.15.69:0/3833515152 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9554+0+0 (secure 0 0 0) 0x7fbe5c0e31d0 con 0x7fbe6410c150 2024-05-14T15:38:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.866+0000 7fbe62800640 1 --2- 172.21.15.69:0/3833515152 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbe480b29d0 0x7fbe480b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:36.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.866+0000 7fbe61400640 1 --2- 172.21.15.69:0/3725299027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9d181b0 0x5582ea0b94b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbe50005760 tx=0x7fbe500056d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35d87451d418503c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.867+0000 7fbe62800640 1 --2- 172.21.15.69:0/3833515152 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbe480b29d0 0x7fbe480b4ee0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c005850 tx=0x7fbe5c0057a0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.867+0000 7fbe4f000640 1 -- 172.21.15.69:0/3725299027 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe50035030 con 0x5582e9d181b0 2024-05-14T15:38:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.867+0000 7fbe4f000640 1 -- 172.21.15.69:0/3725299027 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe500044c0 con 0x5582e9d181b0 2024-05-14T15:38:36.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.867+0000 7fbe4f000640 1 -- 172.21.15.69:0/3725299027 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe500035f0 con 0x5582e9d181b0 2024-05-14T15:38:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.868+0000 7fbe6fba4740 1 -- 172.21.15.69:0/3725299027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9d181b0 msgr2=0x5582ea0b94b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:36.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.868+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/3725299027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9d181b0 0x5582ea0b94b0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbe50005760 tx=0x7fbe500056d0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.869+0000 7fbe6fba4740 1 -- 172.21.15.69:0/3725299027 shutdown_connections 2024-05-14T15:38:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.869+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/3725299027 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9cf74d0 0x5582ea0b9f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.869+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/3725299027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cef2f0 0x5582ea0b99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.869+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/3725299027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9d181b0 0x5582ea0b94b0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.869+0000 7fbe6fba4740 1 -- 172.21.15.69:0/3725299027 >> 172.21.15.69:0/3725299027 conn(0x5582e9d0c300 msgr2=0x5582ea0b5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.869+0000 7fbe6fba4740 1 -- 172.21.15.69:0/3725299027 shutdown_connections 2024-05-14T15:38:36.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.869+0000 7fbe6fba4740 1 -- 172.21.15.69:0/3725299027 wait complete. 2024-05-14T15:38:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.870+0000 7fbe6fba4740 1 -- start start 2024-05-14T15:38:36.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.870+0000 7fbe6fba4740 1 Processor -- start 2024-05-14T15:38:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.871+0000 7fbe6fba4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9cef2f0 0x5582ea0d22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.871+0000 7fbe6fba4740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cf74d0 0x5582ea0d2810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.871+0000 7fbe6fba4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9d181b0 0x5582ea0cc6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.871+0000 7fbe6fba4740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5582ea0c6580 con 0x5582e9cf74d0 2024-05-14T15:38:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.871+0000 7fbe6fba4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5582e9fd7660 con 0x5582e9cef2f0 2024-05-14T15:38:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.871+0000 7fbe6fba4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5582ea0c6700 con 0x5582e9d181b0 2024-05-14T15:38:36.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.871+0000 7fbe6fba4740 10 client.0 _ll_register_callbacks cb 0x5582e9fa1400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:38:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.872+0000 7fbe61e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cf74d0 0x5582ea0d2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.872+0000 7fbe61e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cf74d0 0x5582ea0d2810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55600/0 (socket says 172.21.15.69:55600) 2024-05-14T15:38:36.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.872+0000 7fbe61e00640 1 -- 172.21.15.69:0/649319212 learned_addr learned my addr 172.21.15.69:0/649319212 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:36.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.872+0000 7fbe61400640 1 --2- 172.21.15.69:0/649319212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9cef2f0 0x5582ea0d22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:36.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.872+0000 7fbe61e00640 1 -- 172.21.15.69:0/649319212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9d181b0 msgr2=0x5582ea0cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:36.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.872+0000 7fbe61e00640 1 --2- 172.21.15.69:0/649319212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9d181b0 0x5582ea0cc6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.872+0000 7fbe61e00640 1 -- 172.21.15.69:0/649319212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9cef2f0 msgr2=0x5582ea0d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:36.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.873+0000 7fbe61e00640 1 --2- 172.21.15.69:0/649319212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9cef2f0 0x5582ea0d22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.874 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.873+0000 7fbe61e00640 1 -- 172.21.15.69:0/649319212 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582e9dfc620 con 0x5582e9cf74d0 2024-05-14T15:38:36.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.873+0000 7fbe61e00640 1 --2- 172.21.15.69:0/649319212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cf74d0 0x5582ea0d2810 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fbe540126d0 tx=0x7fbe54012b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25a033895aaeaa7e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:36.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.873+0000 7fbe43400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:38:36.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.874+0000 7fbe43400640 1 -- 172.21.15.69:0/649319212 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe54004050 con 0x5582e9cf74d0 2024-05-14T15:38:36.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.874+0000 7fbe43400640 1 -- 172.21.15.69:0/649319212 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9554+0+0 (secure 0 0 0) 0x7fbe54018030 con 0x5582e9cf74d0 2024-05-14T15:38:36.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.874+0000 7fbe6fba4740 1 -- 172.21.15.69:0/649319212 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5582ea02c160 con 0x5582e9cf74d0 2024-05-14T15:38:36.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.874+0000 7fbe43400640 1 -- 172.21.15.69:0/649319212 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fbe54004050 con 0x5582e9cf74d0 2024-05-14T15:38:36.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.875+0000 7fbe6fba4740 10 client.17400 fetch_fsmap learned FSMap version 72 2024-05-14T15:38:36.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.875+0000 7fbe6fba4740 1 -- 172.21.15.69:0/649319212 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=4+}) -- 0x5582ea0db0d0 con 0x5582e9cf74d0 2024-05-14T15:38:36.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.875+0000 7fbe43400640 1 -- 172.21.15.69:0/649319212 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe5400f9a0 con 0x5582e9cf74d0 2024-05-14T15:38:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.876+0000 7fbe43400640 1 -- 172.21.15.69:0/649319212 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 72) ==== 8406+0+0 (secure 0 0 0) 0x7fbe540038b0 con 0x5582e9cf74d0 2024-05-14T15:38:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.876+0000 7fbe6fba4740 10 client.17400 fetch_fsmap finished waiting for FSMap version 72 2024-05-14T15:38:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.876+0000 7fbe6fba4740 10 client.17400 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:38:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.876+0000 7fbe6fba4740 20 client.17400 populate_metadata read hostname 'smithi069' 2024-05-14T15:38:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.876+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/649319212 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5582e9cd6d80 0x5582ea0de6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.876+0000 7fbe6fba4740 4 client.17400 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:38:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.876+0000 7fbe6fba4740 1 -- 172.21.15.69:0/649319212 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5582ea02c160 con 0x5582e9cd6d80 2024-05-14T15:38:36.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.877+0000 7fbe61400640 1 --2- 172.21.15.69:0/649319212 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5582e9cd6d80 0x5582ea0de6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:36.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.879+0000 7fbe61400640 1 --2- 172.21.15.69:0/649319212 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5582e9cd6d80 0x5582ea0de6a0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c2a6f9bfb6148802 server_cookie=beb9e6e842ea552 in_seq=0 out_seq=0 2024-05-14T15:38:36.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.879+0000 7fbe43400640 10 client.17400 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:38:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.881+0000 7fbe43400640 1 -- 172.21.15.69:0/649319212 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5582ea02c160 con 0x5582e9cd6d80 2024-05-14T15:38:36.882 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.881+0000 7fbe43400640 10 client.17400 handle_command_reply: tid=0 2024-05-14T15:38:36.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.882+0000 7fbe6fba4740 1 client.17400 shutdown 2024-05-14T15:38:36.884 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.882+0000 7fbe6fba4740 1 -- 172.21.15.69:0/649319212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cf74d0 msgr2=0x5582ea0d2810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:36.884 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.882+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/649319212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cf74d0 0x5582ea0d2810 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fbe540126d0 tx=0x7fbe54012b90 comp rx=0 tx=0).stop 2024-05-14T15:38:36.884 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.882+0000 7fbe6fba4740 1 -- 172.21.15.69:0/649319212 shutdown_connections 2024-05-14T15:38:36.885 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.883+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/649319212 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9d181b0 0x5582ea0cc6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.885 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.883+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/649319212 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5582e9cd6d80 0x5582ea0de6a0 crc :-1 s=READY pgs=238 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.885 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.883+0000 7fbe43400640 0 client.17400 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:38:36.885 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.883+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/649319212 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cf74d0 0x5582ea0d2810 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.885 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.883+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/649319212 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9cef2f0 0x5582ea0d22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.885 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.883+0000 7fbe6fba4740 1 -- 172.21.15.69:0/649319212 >> 172.21.15.69:0/649319212 conn(0x5582e9d0c300 msgr2=0x5582ea0b9280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.883+0000 7fbe6fba4740 1 -- 172.21.15.69:0/649319212 shutdown_connections 2024-05-14T15:38:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.883+0000 7fbe6fba4740 1 -- 172.21.15.69:0/649319212 wait complete. 2024-05-14T15:38:36.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.884+0000 7fbe6fba4740 20 client.17400 trim_cache size 0 max 16384 2024-05-14T15:38:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.916+0000 7fbe6fba4740 1 Processor -- start 2024-05-14T15:38:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.916+0000 7fbe6fba4740 1 -- start start 2024-05-14T15:38:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.917+0000 7fbe6fba4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9cef2f0 0x5582ea0c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.918 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.917+0000 7fbe6fba4740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cf74d0 0x5582ea0bb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.917+0000 7fbe6fba4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9d181b0 0x5582ea0bbd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.917+0000 7fbe6fba4740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbe641aefc0 con 0x5582e9cf74d0 2024-05-14T15:38:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.917+0000 7fbe6fba4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbe641b0c50 con 0x5582e9d181b0 2024-05-14T15:38:36.919 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.917+0000 7fbe6fba4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbe641af690 con 0x5582e9cef2f0 2024-05-14T15:38:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.918+0000 7fbe61e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cf74d0 0x5582ea0bb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.918+0000 7fbe61400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9d181b0 0x5582ea0bbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.918+0000 7fbe61e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cf74d0 0x5582ea0bb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55614/0 (socket says 172.21.15.69:55614) 2024-05-14T15:38:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.918+0000 7fbe61e00640 1 -- 172.21.15.69:0/2413490560 learned_addr learned my addr 172.21.15.69:0/2413490560 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.918+0000 7fbe61400640 1 --2- 172.21.15.69:0/2413490560 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9cef2f0 0x5582ea0c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:36.920 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.919+0000 7fbe61e00640 1 -- 172.21.15.69:0/2413490560 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9cef2f0 msgr2=0x5582ea0c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.919+0000 7fbe61e00640 1 --2- 172.21.15.69:0/2413490560 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9cef2f0 0x5582ea0c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.921 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.919+0000 7fbe61e00640 1 -- 172.21.15.69:0/2413490560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9d181b0 msgr2=0x5582ea0bbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.919+0000 7fbe61e00640 1 --2- 172.21.15.69:0/2413490560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9d181b0 0x5582ea0bbd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.919+0000 7fbe61e00640 1 -- 172.21.15.69:0/2413490560 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5582ea0ba250 con 0x5582e9cf74d0 2024-05-14T15:38:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.920+0000 7fbe61e00640 1 --2- 172.21.15.69:0/2413490560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cf74d0 0x5582ea0bb800 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fbe54001eb0 tx=0x7fbe540123a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86bff314ace21730 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:36.922 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.921+0000 7fbe4e600640 1 -- 172.21.15.69:0/2413490560 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe54010430 con 0x5582e9cf74d0 2024-05-14T15:38:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.921+0000 7fbe4e600640 1 -- 172.21.15.69:0/2413490560 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe540035f0 con 0x5582e9cf74d0 2024-05-14T15:38:36.923 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.921+0000 7fbe4e600640 1 -- 172.21.15.69:0/2413490560 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5400fcd0 con 0x5582e9cf74d0 2024-05-14T15:38:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.924+0000 7fbe6fba4740 1 -- 172.21.15.69:0/2413490560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cf74d0 msgr2=0x5582ea0bb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.924+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/2413490560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cf74d0 0x5582ea0bb800 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fbe54001eb0 tx=0x7fbe540123a0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.925+0000 7fbe6fba4740 1 -- 172.21.15.69:0/2413490560 shutdown_connections 2024-05-14T15:38:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.925+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/2413490560 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9d181b0 0x5582ea0bbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.925+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/2413490560 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cf74d0 0x5582ea0bb800 secure :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fbe54001eb0 tx=0x7fbe540123a0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.925+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/2413490560 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9cef2f0 0x5582ea0c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.926 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.925+0000 7fbe6fba4740 1 -- 172.21.15.69:0/2413490560 >> 172.21.15.69:0/2413490560 conn(0x5582e9d0c300 msgr2=0x5582ea0bb0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:36.927 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.926+0000 7fbe6fba4740 1 -- 172.21.15.69:0/2413490560 shutdown_connections 2024-05-14T15:38:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.926+0000 7fbe6fba4740 1 -- 172.21.15.69:0/2413490560 wait complete. 2024-05-14T15:38:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.927+0000 7fbe6fba4740 1 -- start start 2024-05-14T15:38:36.928 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.927+0000 7fbe6fba4740 1 Processor -- start 2024-05-14T15:38:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.928+0000 7fbe6fba4740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9cef2f0 0x5582ea0d8540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.928+0000 7fbe6fba4740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9d181b0 0x5582ea0d8a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.928+0000 7fbe6fba4740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cac1c0 0x5582ea0d5a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.928+0000 7fbe6fba4740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fbe641b04c0 con 0x5582e9cac1c0 2024-05-14T15:38:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.928+0000 7fbe6fba4740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fbe641afd60 con 0x5582e9cef2f0 2024-05-14T15:38:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.928+0000 7fbe6fba4740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fbe641acfe0 con 0x5582e9d181b0 2024-05-14T15:38:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.928+0000 7fbe6fba4740 10 client.0 _ll_register_callbacks cb 0x7fbe54005d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:38:36.930 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.929+0000 7fbe61400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cac1c0 0x5582ea0d5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.929+0000 7fbe61400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cac1c0 0x5582ea0d5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55622/0 (socket says 172.21.15.69:55622) 2024-05-14T15:38:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.930+0000 7fbe61400640 1 -- 172.21.15.69:0/3585952463 learned_addr learned my addr 172.21.15.69:0/3585952463 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:36.931 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.930+0000 7fbe61400640 1 --2- 172.21.15.69:0/3585952463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9cef2f0 0x5582ea0d8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:36.932 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.930+0000 7fbe61e00640 1 --2- 172.21.15.69:0/3585952463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9d181b0 0x5582ea0d8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.931+0000 7fbe61400640 1 -- 172.21.15.69:0/3585952463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9d181b0 msgr2=0x5582ea0d8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.931+0000 7fbe61400640 1 --2- 172.21.15.69:0/3585952463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9d181b0 0x5582ea0d8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.932+0000 7fbe61400640 1 -- 172.21.15.69:0/3585952463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9cef2f0 msgr2=0x5582ea0d8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.932+0000 7fbe61400640 1 --2- 172.21.15.69:0/3585952463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9cef2f0 0x5582ea0d8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.932+0000 7fbe61400640 1 -- 172.21.15.69:0/3585952463 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5582ea0d6050 con 0x5582e9cac1c0 2024-05-14T15:38:36.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.932+0000 7fbe61e00640 1 --2- 172.21.15.69:0/3585952463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9d181b0 0x5582ea0d8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:38:36.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.933+0000 7fbe61400640 1 --2- 172.21.15.69:0/3585952463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cac1c0 0x5582ea0d5a40 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fbe5002a910 tx=0x7fbe54009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d440287a2f56785 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:36.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.933+0000 7fbe43400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:38:36.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.934+0000 7fbe43400640 1 -- 172.21.15.69:0/3585952463 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5004f070 con 0x5582e9cac1c0 2024-05-14T15:38:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.934+0000 7fbe43400640 1 -- 172.21.15.69:0/3585952463 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9554+0+0 (secure 0 0 0) 0x7fbe50005040 con 0x5582e9cac1c0 2024-05-14T15:38:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.935+0000 7fbe6fba4740 1 -- 172.21.15.69:0/3585952463 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbe540035f0 con 0x5582e9cac1c0 2024-05-14T15:38:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.937+0000 7fbe43400640 1 -- 172.21.15.69:0/3585952463 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=72) ==== 24+0+0 (secure 0 0 0) 0x7fbe5005b050 con 0x5582e9cac1c0 2024-05-14T15:38:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.937+0000 7fbe6fba4740 10 client.17406 fetch_fsmap learned FSMap version 72 2024-05-14T15:38:36.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.937+0000 7fbe6fba4740 1 -- 172.21.15.69:0/3585952463 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=72,monmap=4+}) -- 0x5582ea1573a0 con 0x5582e9cac1c0 2024-05-14T15:38:36.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.939+0000 7fbe43400640 1 -- 172.21.15.69:0/3585952463 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fbe540035f0 con 0x5582e9cac1c0 2024-05-14T15:38:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.939+0000 7fbe43400640 1 -- 172.21.15.69:0/3585952463 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 72) ==== 8406+0+0 (secure 0 0 0) 0x7fbe5003a040 con 0x5582e9cac1c0 2024-05-14T15:38:36.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.940+0000 7fbe6fba4740 10 client.17406 fetch_fsmap finished waiting for FSMap version 72 2024-05-14T15:38:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.940+0000 7fbe6fba4740 10 client.17406 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:38:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.940+0000 7fbe6fba4740 20 client.17406 populate_metadata read hostname 'smithi069' 2024-05-14T15:38:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.940+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/3585952463 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5582ea157680 0x5582ea159ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.940+0000 7fbe6fba4740 4 client.17406 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:38:36.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.940+0000 7fbe6fba4740 1 -- 172.21.15.69:0/3585952463 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5582ea025fd0 con 0x5582ea157680 2024-05-14T15:38:36.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.941+0000 7fbe61e00640 1 --2- 172.21.15.69:0/3585952463 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5582ea157680 0x5582ea159ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:36.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.943+0000 7fbe61e00640 1 --2- 172.21.15.69:0/3585952463 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5582ea157680 0x5582ea159ac0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c028209e1472076 server_cookie=d1809acbde668a5b in_seq=0 out_seq=0 2024-05-14T15:38:36.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.943+0000 7fbe43400640 10 client.17406 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:38:36.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.980+0000 7fbe43400640 1 -- 172.21.15.69:0/3585952463 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5582ea025fd0 con 0x5582ea157680 2024-05-14T15:38:36.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.980+0000 7fbe43400640 10 client.17406 handle_command_reply: tid=0 2024-05-14T15:38:36.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.980+0000 7fbe6fba4740 1 client.17406 shutdown 2024-05-14T15:38:36.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.981+0000 7fbe6fba4740 1 -- 172.21.15.69:0/3585952463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cac1c0 msgr2=0x5582ea0d5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:36.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.981+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/3585952463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cac1c0 0x5582ea0d5a40 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7fbe5002a910 tx=0x7fbe54009cd0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.982+0000 7fbe6fba4740 1 -- 172.21.15.69:0/3585952463 shutdown_connections 2024-05-14T15:38:36.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.982+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/3585952463 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5582ea157680 0x5582ea159ac0 crc :-1 s=READY pgs=239 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.982+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/3585952463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5582e9cac1c0 0x5582ea0d5a40 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.982+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/3585952463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5582e9d181b0 0x5582ea0d8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.982+0000 7fbe6fba4740 1 --2- 172.21.15.69:0/3585952463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5582e9cef2f0 0x5582ea0d8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.982+0000 7fbe43400640 0 client.17406 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:38:36.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.982+0000 7fbe6fba4740 1 -- 172.21.15.69:0/3585952463 >> 172.21.15.69:0/3585952463 conn(0x5582e9d0c300 msgr2=0x5582ea0bbb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:36.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.982+0000 7fbe6fba4740 1 -- 172.21.15.69:0/3585952463 shutdown_connections 2024-05-14T15:38:36.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.982+0000 7fbe6fba4740 1 -- 172.21.15.69:0/3585952463 wait complete. 2024-05-14T15:38:36.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.983+0000 7fbe6fba4740 20 client.17406 trim_cache size 0 max 16384 2024-05-14T15:38:36.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:38:36.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:38:36.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:38:36.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:38:36.985 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.984+0000 7fbe63200640 1 -- 172.21.15.69:0/3833515152 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbe480b29d0 msgr2=0x7fbe480b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.984+0000 7fbe63200640 1 --2- 172.21.15.69:0/3833515152 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbe480b29d0 0x7fbe480b4ee0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c005850 tx=0x7fbe5c0057a0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.984+0000 7fbe63200640 1 -- 172.21.15.69:0/3833515152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe6410c150 msgr2=0x7fbe6419c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.984+0000 7fbe63200640 1 --2- 172.21.15.69:0/3833515152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe6410c150 0x7fbe6419c680 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009fd0 tx=0x7fbe5c00ef10 comp rx=0 tx=0).stop 2024-05-14T15:38:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.984+0000 7fbe63200640 1 -- 172.21.15.69:0/3833515152 shutdown_connections 2024-05-14T15:38:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.984+0000 7fbe63200640 1 --2- 172.21.15.69:0/3833515152 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fbe480b29d0 0x7fbe480b4ee0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.984+0000 7fbe63200640 1 --2- 172.21.15.69:0/3833515152 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fbe6410c150 0x7fbe6419c680 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.984+0000 7fbe63200640 1 --2- 172.21.15.69:0/3833515152 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fbe6410bcb0 0x7fbe641a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.984+0000 7fbe63200640 1 --2- 172.21.15.69:0/3833515152 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fbe64106400 0x7fbe641a2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.984+0000 7fbe63200640 1 -- 172.21.15.69:0/3833515152 >> 172.21.15.69:0/3833515152 conn(0x7fbe64101350 msgr2=0x7fbe64111890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.984+0000 7fbe63200640 1 -- 172.21.15.69:0/3833515152 shutdown_connections 2024-05-14T15:38:36.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:36.985+0000 7fbe63200640 1 -- 172.21.15.69:0/3833515152 wait complete. 2024-05-14T15:38:37.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:37 smithi203 ceph-mon[34567]: pgmap v535: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 10 MiB/s wr, 722 op/s 2024-05-14T15:38:37.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:37 smithi092 ceph-mon[34729]: pgmap v535: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 10 MiB/s wr, 722 op/s 2024-05-14T15:38:37.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:37 smithi069 ceph-mon[31270]: pgmap v535: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 62 KiB/s rd, 10 MiB/s wr, 722 op/s 2024-05-14T15:38:39.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:39 smithi203 ceph-mon[34567]: pgmap v536: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.0 MiB/s wr, 502 op/s 2024-05-14T15:38:39.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:39 smithi092 ceph-mon[34729]: pgmap v536: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.0 MiB/s wr, 502 op/s 2024-05-14T15:38:39.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:39 smithi069 ceph-mon[31270]: pgmap v536: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 7.0 MiB/s wr, 502 op/s 2024-05-14T15:38:41.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 775.0 s, 571.6 tps, lat 176.074 ms stddev 96.538 2024-05-14T15:38:41.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:41 smithi203 ceph-mon[34567]: pgmap v537: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 9.6 MiB/s wr, 690 op/s 2024-05-14T15:38:41.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:41 smithi092 ceph-mon[34729]: pgmap v537: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 9.6 MiB/s wr, 690 op/s 2024-05-14T15:38:41.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:41 smithi069 ceph-mon[31270]: pgmap v537: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 9.6 MiB/s wr, 690 op/s 2024-05-14T15:38:43.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:43 smithi203 ceph-mon[34567]: pgmap v538: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.4 MiB/s wr, 540 op/s 2024-05-14T15:38:43.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:43 smithi092 ceph-mon[34729]: pgmap v538: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.4 MiB/s wr, 540 op/s 2024-05-14T15:38:43.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:43 smithi069 ceph-mon[31270]: pgmap v538: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 7.4 MiB/s wr, 540 op/s 2024-05-14T15:38:44.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:44 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:38:44.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:44 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:38:44.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:44 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:38:45.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:45 smithi092 ceph-mon[34729]: pgmap v539: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.4 MiB/s wr, 488 op/s 2024-05-14T15:38:45.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:45 smithi069 ceph-mon[31270]: pgmap v539: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.4 MiB/s wr, 488 op/s 2024-05-14T15:38:46.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:45 smithi203 ceph-mon[34567]: pgmap v539: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 6.4 MiB/s wr, 488 op/s 2024-05-14T15:38:46.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 780.0 s, 621.8 tps, lat 159.880 ms stddev 68.296 2024-05-14T15:38:47.897 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:47 smithi203 ceph-mon[34567]: pgmap v540: 129 pgs: 129 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.6 MiB/s wr, 715 op/s 2024-05-14T15:38:47.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:47 smithi092 ceph-mon[34729]: pgmap v540: 129 pgs: 129 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.6 MiB/s wr, 715 op/s 2024-05-14T15:38:47.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:47 smithi069 ceph-mon[31270]: pgmap v540: 129 pgs: 129 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 9.6 MiB/s wr, 715 op/s 2024-05-14T15:38:49.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:49 smithi092 ceph-mon[34729]: pgmap v541: 129 pgs: 129 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 6.7 MiB/s wr, 490 op/s 2024-05-14T15:38:49.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:49 smithi069 ceph-mon[31270]: pgmap v541: 129 pgs: 129 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 6.7 MiB/s wr, 490 op/s 2024-05-14T15:38:50.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:49 smithi203 ceph-mon[34567]: pgmap v541: 129 pgs: 129 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 70 KiB/s rd, 6.7 MiB/s wr, 490 op/s 2024-05-14T15:38:50.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.345+0000 7eff38400640 1 -- 172.21.15.69:0/66461374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff301075d0 msgr2=0x7eff3010ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:50.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.345+0000 7eff38400640 1 --2- 172.21.15.69:0/66461374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff301075d0 0x7eff3010ed70 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00b9f0 tx=0x7eff1c02c0a0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.346 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.345+0000 7eff38400640 1 -- 172.21.15.69:0/66461374 shutdown_connections 2024-05-14T15:38:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.345+0000 7eff38400640 1 --2- 172.21.15.69:0/66461374 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff301075d0 0x7eff3010ed70 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.345+0000 7eff38400640 1 --2- 172.21.15.69:0/66461374 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff30106b10 0x7eff30106f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.345+0000 7eff38400640 1 --2- 172.21.15.69:0/66461374 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff30102580 0x7eff30102990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.345+0000 7eff38400640 1 -- 172.21.15.69:0/66461374 >> 172.21.15.69:0/66461374 conn(0x7eff300779e0 msgr2=0x7eff30077e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.345+0000 7eff38400640 1 -- 172.21.15.69:0/66461374 shutdown_connections 2024-05-14T15:38:50.347 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.345+0000 7eff38400640 1 -- 172.21.15.69:0/66461374 wait complete. 2024-05-14T15:38:50.348 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.347+0000 7eff38400640 1 Processor -- start 2024-05-14T15:38:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.348+0000 7eff38400640 1 -- start start 2024-05-14T15:38:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.348+0000 7eff38400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff30102580 0x7eff301a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.349 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.348+0000 7eff38400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff30106b10 0x7eff301a5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.348+0000 7eff38400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff301075d0 0x7eff3010db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.348+0000 7eff38400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7eff301111a0 con 0x7eff30106b10 2024-05-14T15:38:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.348+0000 7eff38400640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7eff30111020 con 0x7eff301075d0 2024-05-14T15:38:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.348+0000 7eff38400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7eff30111320 con 0x7eff30102580 2024-05-14T15:38:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.349+0000 7eff36400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff301075d0 0x7eff3010db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.349+0000 7eff36400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff301075d0 0x7eff3010db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:36640/0 (socket says 172.21.15.69:36640) 2024-05-14T15:38:50.350 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.349+0000 7eff36400640 1 -- 172.21.15.69:0/2441190687 learned_addr learned my addr 172.21.15.69:0/2441190687 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.350+0000 7eff35000640 1 --2- 172.21.15.69:0/2441190687 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff30106b10 0x7eff301a5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.352 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.351+0000 7eff35a00640 1 --2- 172.21.15.69:0/2441190687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff30102580 0x7eff301a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.351+0000 7eff36400640 1 -- 172.21.15.69:0/2441190687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff30102580 msgr2=0x7eff301a5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.352+0000 7eff36400640 1 --2- 172.21.15.69:0/2441190687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff30102580 0x7eff301a5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.352+0000 7eff36400640 1 -- 172.21.15.69:0/2441190687 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff30106b10 msgr2=0x7eff301a5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.352+0000 7eff36400640 1 --2- 172.21.15.69:0/2441190687 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff30106b10 0x7eff301a5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.352+0000 7eff36400640 1 -- 172.21.15.69:0/2441190687 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff3010e1a0 con 0x7eff301075d0 2024-05-14T15:38:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.352+0000 7eff35000640 1 --2- 172.21.15.69:0/2441190687 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff30106b10 0x7eff301a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:38:50.353 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.352+0000 7eff35a00640 1 --2- 172.21.15.69:0/2441190687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff30102580 0x7eff301a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:38:50.355 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.354+0000 7eff36400640 1 --2- 172.21.15.69:0/2441190687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff301075d0 0x7eff3010db00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff1c037040 tx=0x7eff1c0045e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.355+0000 7eff2e000640 1 -- 172.21.15.69:0/2441190687 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c042070 con 0x7eff301075d0 2024-05-14T15:38:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.355+0000 7eff2e000640 1 -- 172.21.15.69:0/2441190687 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff1c009770 con 0x7eff301075d0 2024-05-14T15:38:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.355+0000 7eff38400640 1 -- 172.21.15.69:0/2441190687 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff3010e430 con 0x7eff301075d0 2024-05-14T15:38:50.356 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.355+0000 7eff38400640 1 -- 172.21.15.69:0/2441190687 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff3010e970 con 0x7eff301075d0 2024-05-14T15:38:50.358 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.356+0000 7eff2e000640 1 -- 172.21.15.69:0/2441190687 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c039070 con 0x7eff301075d0 2024-05-14T15:38:50.364 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.363+0000 7eff2e000640 1 -- 172.21.15.69:0/2441190687 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7eff1c045070 con 0x7eff301075d0 2024-05-14T15:38:50.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.365+0000 7eff3f372740 1 Processor -- start 2024-05-14T15:38:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.366+0000 7eff3f372740 1 -- start start 2024-05-14T15:38:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.366+0000 7eff3f372740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab17d1b0 0x5558ab51e280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.366+0000 7eff3f372740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab1542f0 0x5558ab51e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.366+0000 7eff3f372740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab15c4d0 0x5558ab51ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.366+0000 7eff3f372740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5558ab483550 con 0x5558ab1542f0 2024-05-14T15:38:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.366+0000 7eff3f372740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5558ab428bc0 con 0x5558ab15c4d0 2024-05-14T15:38:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.366+0000 7eff3f372740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5558ab47f510 con 0x5558ab17d1b0 2024-05-14T15:38:50.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.367+0000 7eff35000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab15c4d0 0x5558ab51ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.367+0000 7eff35000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab17d1b0 0x5558ab51e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.367+0000 7eff35000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab17d1b0 0x5558ab51e280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:47182/0 (socket says 172.21.15.69:47182) 2024-05-14T15:38:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.367+0000 7eff35000640 1 -- 172.21.15.69:0/2721542190 learned_addr learned my addr 172.21.15.69:0/2721542190 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.368+0000 7eff35a00640 1 --2- 172.21.15.69:0/2721542190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab1542f0 0x5558ab51e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.368+0000 7eff35000640 1 -- 172.21.15.69:0/2721542190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab17d1b0 msgr2=0x5558ab51e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:50.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.368+0000 7eff35000640 1 --2- 172.21.15.69:0/2721542190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab17d1b0 0x5558ab51e280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.368+0000 7eff35000640 1 -- 172.21.15.69:0/2721542190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab1542f0 msgr2=0x5558ab51e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:50.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.369+0000 7eff35000640 1 --2- 172.21.15.69:0/2721542190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab1542f0 0x5558ab51e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.369+0000 7eff35000640 1 -- 172.21.15.69:0/2721542190 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558ab195210 con 0x5558ab15c4d0 2024-05-14T15:38:50.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.369+0000 7eff35a00640 1 --2- 172.21.15.69:0/2721542190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab1542f0 0x5558ab51e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:38:50.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.369+0000 7eff2e000640 1 --2- 172.21.15.69:0/2441190687 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7eff180b2aa0 0x7eff180b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.371 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.370+0000 7eff2e000640 1 -- 172.21.15.69:0/2441190687 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9554+0+0 (secure 0 0 0) 0x7eff1c1021e0 con 0x7eff301075d0 2024-05-14T15:38:50.371 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.371+0000 7eff35000640 1 --2- 172.21.15.69:0/2721542190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab15c4d0 0x5558ab51ed00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7eff24014800 tx=0x7eff2400a280 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9db9c25126244d64 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:50.372 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.371+0000 7eff22a00640 1 -- 172.21.15.69:0/2721542190 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff24014250 con 0x5558ab15c4d0 2024-05-14T15:38:50.372 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.371+0000 7eff22a00640 1 -- 172.21.15.69:0/2721542190 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff2401a070 con 0x5558ab15c4d0 2024-05-14T15:38:50.372 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.371+0000 7eff22a00640 1 -- 172.21.15.69:0/2721542190 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff2400f9d0 con 0x5558ab15c4d0 2024-05-14T15:38:50.372 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.371+0000 7eff35a00640 1 --2- 172.21.15.69:0/2441190687 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7eff180b2aa0 0x7eff180b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.373+0000 7eff3f372740 1 -- 172.21.15.69:0/2721542190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab15c4d0 msgr2=0x5558ab51ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:50.373 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.373+0000 7eff3f372740 1 --2- 172.21.15.69:0/2721542190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab15c4d0 0x5558ab51ed00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7eff24014800 tx=0x7eff2400a280 comp rx=0 tx=0).stop 2024-05-14T15:38:50.374 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.373+0000 7eff35a00640 1 --2- 172.21.15.69:0/2441190687 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7eff180b2aa0 0x7eff180b4fb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7eff28005ab0 tx=0x7eff2800a310 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:50.375 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.374+0000 7eff3f372740 1 -- 172.21.15.69:0/2721542190 shutdown_connections 2024-05-14T15:38:50.375 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.374+0000 7eff3f372740 1 --2- 172.21.15.69:0/2721542190 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab15c4d0 0x5558ab51ed00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.375 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.374+0000 7eff3f372740 1 --2- 172.21.15.69:0/2721542190 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab1542f0 0x5558ab51e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.375 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.374+0000 7eff3f372740 1 --2- 172.21.15.69:0/2721542190 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab17d1b0 0x5558ab51e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.375 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.374+0000 7eff3f372740 1 -- 172.21.15.69:0/2721542190 >> 172.21.15.69:0/2721542190 conn(0x5558ab171300 msgr2=0x5558ab51aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:50.375 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.374+0000 7eff3f372740 1 -- 172.21.15.69:0/2721542190 shutdown_connections 2024-05-14T15:38:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.374+0000 7eff3f372740 1 -- 172.21.15.69:0/2721542190 wait complete. 2024-05-14T15:38:50.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.375+0000 7eff3f372740 1 -- start start 2024-05-14T15:38:50.377 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.376+0000 7eff3f372740 1 Processor -- start 2024-05-14T15:38:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.377+0000 7eff3f372740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab1542f0 0x5558ab528770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.377+0000 7eff3f372740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab15c4d0 0x5558ab528cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.377+0000 7eff3f372740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab17d1b0 0x5558ab5348f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.377+0000 7eff3f372740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5558ab52b3b0 con 0x5558ab17d1b0 2024-05-14T15:38:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.377+0000 7eff3f372740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5558ab43c660 con 0x5558ab15c4d0 2024-05-14T15:38:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.377+0000 7eff3f372740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5558ab52b530 con 0x5558ab1542f0 2024-05-14T15:38:50.378 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.377+0000 7eff3f372740 10 client.0 _ll_register_callbacks cb 0x5558ab406400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:38:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.377+0000 7eff36400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab17d1b0 0x5558ab5348f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.377+0000 7eff36400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab17d1b0 0x5558ab5348f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:39070/0 (socket says 172.21.15.69:39070) 2024-05-14T15:38:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.377+0000 7eff36400640 1 -- 172.21.15.69:0/2590993444 learned_addr learned my addr 172.21.15.69:0/2590993444 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.377+0000 7eff35a00640 1 --2- 172.21.15.69:0/2590993444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab1542f0 0x5558ab528770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.378+0000 7eff36400640 1 -- 172.21.15.69:0/2590993444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab1542f0 msgr2=0x5558ab528770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.378+0000 7eff36400640 1 --2- 172.21.15.69:0/2590993444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab1542f0 0x5558ab528770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.378+0000 7eff35000640 1 --2- 172.21.15.69:0/2590993444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab15c4d0 0x5558ab528cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.378+0000 7eff36400640 1 -- 172.21.15.69:0/2590993444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab15c4d0 msgr2=0x5558ab528cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.378+0000 7eff36400640 1 --2- 172.21.15.69:0/2590993444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab15c4d0 0x5558ab528cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.378+0000 7eff36400640 1 -- 172.21.15.69:0/2590993444 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558ab261620 con 0x5558ab17d1b0 2024-05-14T15:38:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.379+0000 7eff35000640 1 --2- 172.21.15.69:0/2590993444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab15c4d0 0x5558ab528cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:38:50.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.379+0000 7eff36400640 1 --2- 172.21.15.69:0/2590993444 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab17d1b0 0x5558ab5348f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0c5270 tx=0x7eff1c0c8a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab2f9d8359608f4c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.379+0000 7eff17400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:38:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.379+0000 7eff17400640 1 -- 172.21.15.69:0/2590993444 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c0ff950 con 0x5558ab17d1b0 2024-05-14T15:38:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.379+0000 7eff17400640 1 -- 172.21.15.69:0/2590993444 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9554+0+0 (secure 0 0 0) 0x7eff1c0cd120 con 0x5558ab17d1b0 2024-05-14T15:38:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.380+0000 7eff3f372740 1 -- 172.21.15.69:0/2590993444 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff2401a070 con 0x5558ab17d1b0 2024-05-14T15:38:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.380+0000 7eff17400640 1 -- 172.21.15.69:0/2590993444 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7eff1c0cd3a0 con 0x5558ab17d1b0 2024-05-14T15:38:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.380+0000 7eff3f372740 10 client.17412 fetch_fsmap learned FSMap version 73 2024-05-14T15:38:50.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.380+0000 7eff3f372740 1 -- 172.21.15.69:0/2590993444 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x5558ab537610 con 0x5558ab17d1b0 2024-05-14T15:38:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.380+0000 7eff17400640 1 -- 172.21.15.69:0/2590993444 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff2401a070 con 0x5558ab17d1b0 2024-05-14T15:38:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.381+0000 7eff17400640 1 -- 172.21.15.69:0/2590993444 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 73) ==== 8402+0+0 (secure 0 0 0) 0x7eff1c0c4b60 con 0x5558ab17d1b0 2024-05-14T15:38:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.381+0000 7eff3f372740 10 client.17412 fetch_fsmap finished waiting for FSMap version 73 2024-05-14T15:38:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.381+0000 7eff3f372740 10 client.17412 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:38:50.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.381+0000 7eff3f372740 20 client.17412 populate_metadata read hostname 'smithi069' 2024-05-14T15:38:50.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.381+0000 7eff3f372740 1 --2- 172.21.15.69:0/2590993444 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5558ab13bd80 0x5558ab53ac20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.381+0000 7eff3f372740 4 client.17412 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:38:50.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.381+0000 7eff3f372740 1 -- 172.21.15.69:0/2590993444 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558ab491160 con 0x5558ab13bd80 2024-05-14T15:38:50.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.382+0000 7eff35a00640 1 --2- 172.21.15.69:0/2590993444 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5558ab13bd80 0x5558ab53ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.384+0000 7eff35a00640 1 --2- 172.21.15.69:0/2590993444 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5558ab13bd80 0x5558ab53ac20 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e949fc584b87bade server_cookie=6798b6f497c5b2af in_seq=0 out_seq=0 2024-05-14T15:38:50.385 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.385+0000 7eff17400640 10 client.17412 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:38:50.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.386+0000 7eff17400640 1 -- 172.21.15.69:0/2590993444 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5558ab491160 con 0x5558ab13bd80 2024-05-14T15:38:50.386 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.386+0000 7eff17400640 10 client.17412 handle_command_reply: tid=0 2024-05-14T15:38:50.387 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.386+0000 7eff3f372740 1 client.17412 shutdown 2024-05-14T15:38:50.387 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.386+0000 7eff3f372740 1 -- 172.21.15.69:0/2590993444 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab17d1b0 msgr2=0x5558ab5348f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:50.387 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.386+0000 7eff3f372740 1 --2- 172.21.15.69:0/2590993444 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab17d1b0 0x5558ab5348f0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0c5270 tx=0x7eff1c0c8a20 comp rx=0 tx=0).stop 2024-05-14T15:38:50.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.386+0000 7eff3f372740 1 -- 172.21.15.69:0/2590993444 shutdown_connections 2024-05-14T15:38:50.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.386+0000 7eff3f372740 1 --2- 172.21.15.69:0/2590993444 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5558ab13bd80 0x5558ab53ac20 crc :-1 s=READY pgs=240 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.387+0000 7eff3f372740 1 --2- 172.21.15.69:0/2590993444 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab17d1b0 0x5558ab5348f0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.387+0000 7eff3f372740 1 --2- 172.21.15.69:0/2590993444 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab15c4d0 0x5558ab528cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.387+0000 7eff3f372740 1 --2- 172.21.15.69:0/2590993444 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab1542f0 0x5558ab528770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.387+0000 7eff3f372740 1 -- 172.21.15.69:0/2590993444 >> 172.21.15.69:0/2590993444 conn(0x5558ab171300 msgr2=0x5558ab51ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:50.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.387+0000 7eff17400640 0 client.17412 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:38:50.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.387+0000 7eff3f372740 1 -- 172.21.15.69:0/2590993444 shutdown_connections 2024-05-14T15:38:50.388 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.387+0000 7eff3f372740 1 -- 172.21.15.69:0/2590993444 wait complete. 2024-05-14T15:38:50.389 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.387+0000 7eff3f372740 20 client.17412 trim_cache size 0 max 16384 2024-05-14T15:38:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.416+0000 7eff3f372740 1 Processor -- start 2024-05-14T15:38:50.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.416+0000 7eff3f372740 1 -- start start 2024-05-14T15:38:50.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.417+0000 7eff3f372740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab1542f0 0x5558ab51a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.417+0000 7eff3f372740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab15c4d0 0x5558ab540420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.417+0000 7eff3f372740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab17d1b0 0x5558ab540960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.417+0000 7eff3f372740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7eff10010100 con 0x5558ab1542f0 2024-05-14T15:38:50.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.417+0000 7eff3f372740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7eff10011d60 con 0x5558ab17d1b0 2024-05-14T15:38:50.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.417+0000 7eff3f372740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7eff100107d0 con 0x5558ab15c4d0 2024-05-14T15:38:50.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.418+0000 7eff36400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab17d1b0 0x5558ab540960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.418+0000 7eff36400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab17d1b0 0x5558ab540960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:36672/0 (socket says 172.21.15.69:36672) 2024-05-14T15:38:50.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.418+0000 7eff36400640 1 -- 172.21.15.69:0/3848339705 learned_addr learned my addr 172.21.15.69:0/3848339705 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:50.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.418+0000 7eff35a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab1542f0 0x5558ab51a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.418+0000 7eff35000640 1 --2- 172.21.15.69:0/3848339705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab15c4d0 0x5558ab540420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.419+0000 7eff36400640 1 -- 172.21.15.69:0/3848339705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab15c4d0 msgr2=0x5558ab540420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:50.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.419+0000 7eff36400640 1 --2- 172.21.15.69:0/3848339705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab15c4d0 0x5558ab540420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.419+0000 7eff36400640 1 -- 172.21.15.69:0/3848339705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab1542f0 msgr2=0x5558ab51a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:50.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.419+0000 7eff36400640 1 --2- 172.21.15.69:0/3848339705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab1542f0 0x5558ab51a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.420 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.419+0000 7eff36400640 1 -- 172.21.15.69:0/3848339705 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558ab51a010 con 0x5558ab17d1b0 2024-05-14T15:38:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.420+0000 7eff36400640 1 --2- 172.21.15.69:0/3848339705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab17d1b0 0x5558ab540960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0c9180 tx=0x7eff1c0c8a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a933de5073c42f85 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.420+0000 7eff22000640 1 -- 172.21.15.69:0/3848339705 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c0ff950 con 0x5558ab17d1b0 2024-05-14T15:38:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.420+0000 7eff22000640 1 -- 172.21.15.69:0/3848339705 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff1c0d1fc0 con 0x5558ab17d1b0 2024-05-14T15:38:50.421 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.420+0000 7eff22000640 1 -- 172.21.15.69:0/3848339705 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c0c8fc0 con 0x5558ab17d1b0 2024-05-14T15:38:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.421+0000 7eff3f372740 1 -- 172.21.15.69:0/3848339705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab17d1b0 msgr2=0x5558ab540960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:50.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.421+0000 7eff3f372740 1 --2- 172.21.15.69:0/3848339705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab17d1b0 0x5558ab540960 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0c9180 tx=0x7eff1c0c8a90 comp rx=0 tx=0).stop 2024-05-14T15:38:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.422+0000 7eff3f372740 1 -- 172.21.15.69:0/3848339705 shutdown_connections 2024-05-14T15:38:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.422+0000 7eff3f372740 1 --2- 172.21.15.69:0/3848339705 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab17d1b0 0x5558ab540960 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.422+0000 7eff3f372740 1 --2- 172.21.15.69:0/3848339705 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab15c4d0 0x5558ab540420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.422+0000 7eff3f372740 1 --2- 172.21.15.69:0/3848339705 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab1542f0 0x5558ab51a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.422+0000 7eff3f372740 1 -- 172.21.15.69:0/3848339705 >> 172.21.15.69:0/3848339705 conn(0x5558ab171300 msgr2=0x5558ab51a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:50.424 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.422+0000 7eff3f372740 1 -- 172.21.15.69:0/3848339705 shutdown_connections 2024-05-14T15:38:50.424 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.422+0000 7eff3f372740 1 -- 172.21.15.69:0/3848339705 wait complete. 2024-05-14T15:38:50.424 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.423+0000 7eff3f372740 1 -- start start 2024-05-14T15:38:50.424 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.423+0000 7eff3f372740 1 Processor -- start 2024-05-14T15:38:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.424+0000 7eff3f372740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab1542f0 0x5558ab52be10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.424+0000 7eff3f372740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab15c4d0 0x5558ab52c370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.424+0000 7eff3f372740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab17d1b0 0x5558ab59af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.424+0000 7eff3f372740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7eff100115d0 con 0x5558ab15c4d0 2024-05-14T15:38:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.424+0000 7eff3f372740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7eff10010ea0 con 0x5558ab17d1b0 2024-05-14T15:38:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.424+0000 7eff3f372740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7eff1000e100 con 0x5558ab1542f0 2024-05-14T15:38:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.424+0000 7eff3f372740 10 client.0 _ll_register_callbacks cb 0x7eff1c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:38:50.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.424+0000 7eff35a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab1542f0 0x5558ab52be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.424+0000 7eff35a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab1542f0 0x5558ab52be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:47218/0 (socket says 172.21.15.69:47218) 2024-05-14T15:38:50.426 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.425+0000 7eff35a00640 1 -- 172.21.15.69:0/3719734731 learned_addr learned my addr 172.21.15.69:0/3719734731 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:38:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.425+0000 7eff35000640 1 --2- 172.21.15.69:0/3719734731 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab15c4d0 0x5558ab52c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.425+0000 7eff36400640 1 --2- 172.21.15.69:0/3719734731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab17d1b0 0x5558ab59af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.425+0000 7eff35a00640 1 -- 172.21.15.69:0/3719734731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab17d1b0 msgr2=0x5558ab59af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.425+0000 7eff35a00640 1 --2- 172.21.15.69:0/3719734731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab17d1b0 0x5558ab59af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.425+0000 7eff35a00640 1 -- 172.21.15.69:0/3719734731 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab15c4d0 msgr2=0x5558ab52c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:38:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.425+0000 7eff35a00640 1 --2- 172.21.15.69:0/3719734731 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab15c4d0 0x5558ab52c370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.425+0000 7eff35a00640 1 -- 172.21.15.69:0/3719734731 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558ab59b520 con 0x5558ab1542f0 2024-05-14T15:38:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.426+0000 7eff35a00640 1 --2- 172.21.15.69:0/3719734731 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab1542f0 0x5558ab52be10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x5558ab51bd70 tx=0x7eff280046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60c5dcf1b9431dd1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:38:50.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.426+0000 7eff17400640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:38:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.426+0000 7eff17400640 1 -- 172.21.15.69:0/3719734731 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff28004230 con 0x5558ab1542f0 2024-05-14T15:38:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.426+0000 7eff3f372740 1 -- 172.21.15.69:0/3719734731 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff1c0d1fc0 con 0x5558ab1542f0 2024-05-14T15:38:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.426+0000 7eff17400640 1 -- 172.21.15.69:0/3719734731 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9554+0+0 (secure 0 0 0) 0x7eff280043d0 con 0x5558ab1542f0 2024-05-14T15:38:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.426+0000 7eff17400640 1 -- 172.21.15.69:0/3719734731 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7eff28037050 con 0x5558ab1542f0 2024-05-14T15:38:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.427+0000 7eff3f372740 10 client.26887 fetch_fsmap learned FSMap version 73 2024-05-14T15:38:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.427+0000 7eff3f372740 1 -- 172.21.15.69:0/3719734731 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x5558ab5a28b0 con 0x5558ab1542f0 2024-05-14T15:38:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.427+0000 7eff17400640 1 -- 172.21.15.69:0/3719734731 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7eff2802c070 con 0x5558ab1542f0 2024-05-14T15:38:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.427+0000 7eff17400640 1 -- 172.21.15.69:0/3719734731 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 73) ==== 8402+0+0 (secure 0 0 0) 0x7eff2800b040 con 0x5558ab1542f0 2024-05-14T15:38:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.428+0000 7eff3f372740 10 client.26887 fetch_fsmap finished waiting for FSMap version 73 2024-05-14T15:38:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.428+0000 7eff3f372740 10 client.26887 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:38:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.428+0000 7eff3f372740 20 client.26887 populate_metadata read hostname 'smithi069' 2024-05-14T15:38:50.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.428+0000 7eff3f372740 1 --2- 172.21.15.69:0/3719734731 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5558ab1111c0 0x5558ab5a5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:38:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.428+0000 7eff3f372740 4 client.26887 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:38:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.428+0000 7eff3f372740 1 -- 172.21.15.69:0/3719734731 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x7eff1c0d1fc0 con 0x5558ab1111c0 2024-05-14T15:38:50.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.429+0000 7eff35000640 1 --2- 172.21.15.69:0/3719734731 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5558ab1111c0 0x5558ab5a5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:38:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.430+0000 7eff35000640 1 --2- 172.21.15.69:0/3719734731 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5558ab1111c0 0x5558ab5a5140 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e678cecaf0c16639 server_cookie=64393cd042abb32c in_seq=0 out_seq=0 2024-05-14T15:38:50.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.430+0000 7eff17400640 10 client.26887 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:38:50.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.454+0000 7eff17400640 1 -- 172.21.15.69:0/3719734731 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x7eff1c0d1fc0 con 0x5558ab1111c0 2024-05-14T15:38:50.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.454+0000 7eff17400640 10 client.26887 handle_command_reply: tid=0 2024-05-14T15:38:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.454+0000 7eff3f372740 1 client.26887 shutdown 2024-05-14T15:38:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.455+0000 7eff3f372740 1 -- 172.21.15.69:0/3719734731 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab1542f0 msgr2=0x5558ab52be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.455+0000 7eff3f372740 1 --2- 172.21.15.69:0/3719734731 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab1542f0 0x5558ab52be10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x5558ab51bd70 tx=0x7eff280046c0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.455+0000 7eff3f372740 1 -- 172.21.15.69:0/3719734731 shutdown_connections 2024-05-14T15:38:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.455+0000 7eff3f372740 1 --2- 172.21.15.69:0/3719734731 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5558ab17d1b0 0x5558ab59af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.455+0000 7eff3f372740 1 --2- 172.21.15.69:0/3719734731 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5558ab1111c0 0x5558ab5a5140 crc :-1 s=READY pgs=241 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.455+0000 7eff3f372740 1 --2- 172.21.15.69:0/3719734731 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5558ab15c4d0 0x5558ab52c370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.455+0000 7eff3f372740 1 --2- 172.21.15.69:0/3719734731 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5558ab1542f0 0x5558ab52be10 secure :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0x5558ab51bd70 tx=0x7eff280046c0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.455+0000 7eff3f372740 1 -- 172.21.15.69:0/3719734731 >> 172.21.15.69:0/3719734731 conn(0x5558ab171300 msgr2=0x5558ab51fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.455+0000 7eff17400640 0 client.26887 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:38:50.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.457+0000 7eff3f372740 1 -- 172.21.15.69:0/3719734731 shutdown_connections 2024-05-14T15:38:50.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.457+0000 7eff3f372740 1 -- 172.21.15.69:0/3719734731 wait complete. 2024-05-14T15:38:50.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.457+0000 7eff3f372740 20 client.26887 trim_cache size 0 max 16384 2024-05-14T15:38:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:38:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:38:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:38:50.459 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:38:50.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.459+0000 7eff38400640 1 -- 172.21.15.69:0/2441190687 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7eff180b2aa0 msgr2=0x7eff180b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:50.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.459+0000 7eff38400640 1 --2- 172.21.15.69:0/2441190687 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7eff180b2aa0 0x7eff180b4fb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7eff28005ab0 tx=0x7eff2800a310 comp rx=0 tx=0).stop 2024-05-14T15:38:50.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.459+0000 7eff38400640 1 -- 172.21.15.69:0/2441190687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff301075d0 msgr2=0x7eff3010db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:38:50.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.459+0000 7eff38400640 1 --2- 172.21.15.69:0/2441190687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff301075d0 0x7eff3010db00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7eff1c037040 tx=0x7eff1c0045e0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.459+0000 7eff38400640 1 -- 172.21.15.69:0/2441190687 shutdown_connections 2024-05-14T15:38:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.459+0000 7eff38400640 1 --2- 172.21.15.69:0/2441190687 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7eff180b2aa0 0x7eff180b4fb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.459+0000 7eff38400640 1 --2- 172.21.15.69:0/2441190687 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7eff301075d0 0x7eff3010db00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.459+0000 7eff38400640 1 --2- 172.21.15.69:0/2441190687 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7eff30106b10 0x7eff301a5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.459+0000 7eff38400640 1 --2- 172.21.15.69:0/2441190687 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7eff30102580 0x7eff301a5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:38:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.459+0000 7eff38400640 1 -- 172.21.15.69:0/2441190687 >> 172.21.15.69:0/2441190687 conn(0x7eff300779e0 msgr2=0x7eff30113d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:38:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.460+0000 7eff38400640 1 -- 172.21.15.69:0/2441190687 shutdown_connections 2024-05-14T15:38:50.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:38:50.460+0000 7eff38400640 1 -- 172.21.15.69:0/2441190687 wait complete. 2024-05-14T15:38:51.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 785.0 s, 518.4 tps, lat 194.500 ms stddev 134.150 2024-05-14T15:38:51.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:51 smithi092 ceph-mon[34729]: pgmap v542: 129 pgs: 129 active+clean; 3.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 8.8 MiB/s wr, 671 op/s 2024-05-14T15:38:51.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:51 smithi069 ceph-mon[31270]: pgmap v542: 129 pgs: 129 active+clean; 3.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 8.8 MiB/s wr, 671 op/s 2024-05-14T15:38:52.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:51 smithi203 ceph-mon[34567]: pgmap v542: 129 pgs: 129 active+clean; 3.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 8.8 MiB/s wr, 671 op/s 2024-05-14T15:38:53.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:53 smithi092 ceph-mon[34729]: pgmap v543: 129 pgs: 129 active+clean; 3.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.2 MiB/s wr, 545 op/s 2024-05-14T15:38:53.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:53 smithi069 ceph-mon[31270]: pgmap v543: 129 pgs: 129 active+clean; 3.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.2 MiB/s wr, 545 op/s 2024-05-14T15:38:54.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:53 smithi203 ceph-mon[34567]: pgmap v543: 129 pgs: 129 active+clean; 3.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 61 KiB/s rd, 7.2 MiB/s wr, 545 op/s 2024-05-14T15:38:55.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:55 smithi092 ceph-mon[34729]: pgmap v544: 129 pgs: 129 active+clean; 3.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 7.0 MiB/s wr, 509 op/s 2024-05-14T15:38:55.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:55 smithi069 ceph-mon[31270]: pgmap v544: 129 pgs: 129 active+clean; 3.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 7.0 MiB/s wr, 509 op/s 2024-05-14T15:38:56.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:55 smithi203 ceph-mon[34567]: pgmap v544: 129 pgs: 129 active+clean; 3.4 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 71 KiB/s rd, 7.0 MiB/s wr, 509 op/s 2024-05-14T15:38:56.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 790.0 s, 601.8 tps, lat 163.270 ms stddev 86.233 2024-05-14T15:38:57.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:57 smithi092 ceph-mon[34729]: pgmap v545: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.7 MiB/s wr, 722 op/s 2024-05-14T15:38:57.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:57 smithi069 ceph-mon[31270]: pgmap v545: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.7 MiB/s wr, 722 op/s 2024-05-14T15:38:58.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:57 smithi203 ceph-mon[34567]: pgmap v545: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 9.7 MiB/s wr, 722 op/s 2024-05-14T15:38:59.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:38:59 smithi092 ceph-mon[34729]: pgmap v546: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.4 MiB/s wr, 483 op/s 2024-05-14T15:38:59.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:38:59 smithi069 ceph-mon[31270]: pgmap v546: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.4 MiB/s wr, 483 op/s 2024-05-14T15:39:00.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:38:59 smithi203 ceph-mon[34567]: pgmap v546: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.4 MiB/s wr, 483 op/s 2024-05-14T15:39:01.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 795.0 s, 521.6 tps, lat 183.963 ms stddev 138.828 2024-05-14T15:39:01.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:01 smithi092 ceph-mon[34729]: pgmap v547: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.1 MiB/s wr, 660 op/s 2024-05-14T15:39:01.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:01 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:39:01.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:01 smithi069 ceph-mon[31270]: pgmap v547: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.1 MiB/s wr, 660 op/s 2024-05-14T15:39:01.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:01 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:39:02.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:01 smithi203 ceph-mon[34567]: pgmap v547: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 8.1 MiB/s wr, 660 op/s 2024-05-14T15:39:02.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:01 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:39:03.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:03 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:39:03.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:03 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:39:03.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:03 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:39:03.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:03 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:39:03.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:03 smithi203 ceph-mon[34567]: pgmap v548: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.3 MiB/s wr, 554 op/s 2024-05-14T15:39:03.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:03 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:39:03.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:03 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:39:03.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:03 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:39:03.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:03 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:39:03.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:03 smithi092 ceph-mon[34729]: pgmap v548: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.3 MiB/s wr, 554 op/s 2024-05-14T15:39:03.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:03 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:39:03.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:03 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:39:03.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:03 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:39:03.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:03 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:39:03.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:03 smithi069 ceph-mon[31270]: pgmap v548: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.3 MiB/s wr, 554 op/s 2024-05-14T15:39:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.846+0000 7fba59e00640 1 -- 172.21.15.69:0/3930938984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba5410e220 msgr2=0x7fba541106f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.846+0000 7fba59e00640 1 --2- 172.21.15.69:0/3930938984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba5410e220 0x7fba541106f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fba4c009be0 tx=0x7fba4c02a790 comp rx=0 tx=0).stop 2024-05-14T15:39:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.846+0000 7fba59e00640 1 -- 172.21.15.69:0/3930938984 shutdown_connections 2024-05-14T15:39:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.846+0000 7fba59e00640 1 --2- 172.21.15.69:0/3930938984 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba5410e220 0x7fba541106f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.846+0000 7fba59e00640 1 --2- 172.21.15.69:0/3930938984 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba5410b8c0 0x7fba5410dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.846+0000 7fba59e00640 1 --2- 172.21.15.69:0/3930938984 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba54104e60 0x7fba54105270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.846+0000 7fba59e00640 1 -- 172.21.15.69:0/3930938984 >> 172.21.15.69:0/3930938984 conn(0x7fba540782e0 msgr2=0x7fba54078720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:03.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.846+0000 7fba59e00640 1 -- 172.21.15.69:0/3930938984 shutdown_connections 2024-05-14T15:39:03.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.847+0000 7fba59e00640 1 -- 172.21.15.69:0/3930938984 wait complete. 2024-05-14T15:39:03.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.850+0000 7fba59e00640 1 Processor -- start 2024-05-14T15:39:03.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.850+0000 7fba59e00640 1 -- start start 2024-05-14T15:39:03.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.851+0000 7fba59e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba54104e60 0x7fba541a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.851+0000 7fba59e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba5410b8c0 0x7fba541a1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.851+0000 7fba59e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba5410e220 0x7fba5419c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.851+0000 7fba59e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fba54102f10 con 0x7fba54104e60 2024-05-14T15:39:03.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.851+0000 7fba59e00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fba54102d90 con 0x7fba5410e220 2024-05-14T15:39:03.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.851+0000 7fba59e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fba54103090 con 0x7fba5410b8c0 2024-05-14T15:39:03.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.852+0000 7fba53400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba5410e220 0x7fba5419c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.852+0000 7fba53400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba5410e220 0x7fba5419c7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:58526/0 (socket says 172.21.15.69:58526) 2024-05-14T15:39:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.852+0000 7fba53400640 1 -- 172.21.15.69:0/3324889707 learned_addr learned my addr 172.21.15.69:0/3324889707 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.852+0000 7fba52000640 1 --2- 172.21.15.69:0/3324889707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba5410b8c0 0x7fba541a1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.852+0000 7fba53400640 1 -- 172.21.15.69:0/3324889707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba5410b8c0 msgr2=0x7fba541a1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.852+0000 7fba53400640 1 --2- 172.21.15.69:0/3324889707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba5410b8c0 0x7fba541a1a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.852+0000 7fba53400640 1 -- 172.21.15.69:0/3324889707 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba54104e60 msgr2=0x7fba541a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.852+0000 7fba53400640 1 --2- 172.21.15.69:0/3324889707 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba54104e60 0x7fba541a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.855 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.852+0000 7fba53400640 1 -- 172.21.15.69:0/3324889707 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba5419ce40 con 0x7fba5410e220 2024-05-14T15:39:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.853+0000 7fba53400640 1 --2- 172.21.15.69:0/3324889707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba5410e220 0x7fba5419c7d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fba4c034040 tx=0x7fba4c003e60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.854+0000 7fba58a00640 1 -- 172.21.15.69:0/3324889707 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c040020 con 0x7fba5410e220 2024-05-14T15:39:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.854+0000 7fba58a00640 1 -- 172.21.15.69:0/3324889707 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba4c030890 con 0x7fba5410e220 2024-05-14T15:39:03.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.854+0000 7fba58a00640 1 -- 172.21.15.69:0/3324889707 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c036040 con 0x7fba5410e220 2024-05-14T15:39:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.855+0000 7fba59e00640 1 -- 172.21.15.69:0/3324889707 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba5419d0d0 con 0x7fba5410e220 2024-05-14T15:39:03.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.856+0000 7fba59e00640 1 -- 172.21.15.69:0/3324889707 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba5419d540 con 0x7fba5410e220 2024-05-14T15:39:03.867 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.865+0000 7fba60e11740 1 Processor -- start 2024-05-14T15:39:03.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.866+0000 7fba60e11740 1 -- start start 2024-05-14T15:39:03.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.867+0000 7fba60e11740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24e0b1b0 0x564e251ac2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.868 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.867+0000 7fba58a00640 1 -- 172.21.15.69:0/3324889707 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fba4c043020 con 0x7fba5410e220 2024-05-14T15:39:03.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.867+0000 7fba60e11740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24de22f0 0x564e251ac7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.867+0000 7fba60e11740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 0x564e251acd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.867+0000 7fba60e11740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564e25111550 con 0x564e24de22f0 2024-05-14T15:39:03.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.867+0000 7fba60e11740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564e250b6bc0 con 0x564e24e0b1b0 2024-05-14T15:39:03.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.867+0000 7fba60e11740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564e2510d510 con 0x564e24dea4d0 2024-05-14T15:39:03.869 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.867+0000 7fba52a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24de22f0 0x564e251ac7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:03.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.867+0000 7fba52000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24e0b1b0 0x564e251ac2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:03.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.868+0000 7fba52000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24e0b1b0 0x564e251ac2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:58538/0 (socket says 172.21.15.69:58538) 2024-05-14T15:39:03.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.868+0000 7fba52000640 1 -- 172.21.15.69:0/2001021838 learned_addr learned my addr 172.21.15.69:0/2001021838 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:03.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.868+0000 7fba52000640 1 --2- 172.21.15.69:0/2001021838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 0x564e251acd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:03.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.869+0000 7fba52000640 1 -- 172.21.15.69:0/2001021838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 msgr2=0x564e251acd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:03.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.869+0000 7fba52000640 1 --2- 172.21.15.69:0/2001021838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 0x564e251acd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.869+0000 7fba52000640 1 -- 172.21.15.69:0/2001021838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24de22f0 msgr2=0x564e251ac7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:03.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.869+0000 7fba52000640 1 --2- 172.21.15.69:0/2001021838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24de22f0 0x564e251ac7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.869+0000 7fba52000640 1 -- 172.21.15.69:0/2001021838 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e24e23210 con 0x564e24e0b1b0 2024-05-14T15:39:03.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.869+0000 7fba58a00640 1 --2- 172.21.15.69:0/3324889707 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fba380b2b90 0x7fba380b50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.870+0000 7fba58a00640 1 -- 172.21.15.69:0/3324889707 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 9554+0+0 (secure 0 0 0) 0x7fba4c102f50 con 0x7fba5410e220 2024-05-14T15:39:03.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.870+0000 7fba52000640 1 --2- 172.21.15.69:0/2001021838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24e0b1b0 0x564e251ac2a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fba44012550 tx=0x7fba440096a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d99a3ba1d31c9286 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:03.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.870+0000 7fba52a00640 1 --2- 172.21.15.69:0/3324889707 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fba380b2b90 0x7fba380b50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.871+0000 7fba3fe00640 1 -- 172.21.15.69:0/2001021838 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44010690 con 0x564e24e0b1b0 2024-05-14T15:39:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.871+0000 7fba3fe00640 1 -- 172.21.15.69:0/2001021838 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba44010cc0 con 0x564e24e0b1b0 2024-05-14T15:39:03.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.871+0000 7fba3fe00640 1 -- 172.21.15.69:0/2001021838 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4401dc10 con 0x564e24e0b1b0 2024-05-14T15:39:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.873+0000 7fba60e11740 1 -- 172.21.15.69:0/2001021838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24e0b1b0 msgr2=0x564e251ac2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.873+0000 7fba60e11740 1 --2- 172.21.15.69:0/2001021838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24e0b1b0 0x564e251ac2a0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fba44012550 tx=0x7fba440096a0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.873+0000 7fba60e11740 1 -- 172.21.15.69:0/2001021838 shutdown_connections 2024-05-14T15:39:03.875 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.873+0000 7fba60e11740 1 --2- 172.21.15.69:0/2001021838 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 0x564e251acd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.874+0000 7fba60e11740 1 --2- 172.21.15.69:0/2001021838 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24de22f0 0x564e251ac7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.874+0000 7fba60e11740 1 --2- 172.21.15.69:0/2001021838 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24e0b1b0 0x564e251ac2a0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.874+0000 7fba60e11740 1 -- 172.21.15.69:0/2001021838 >> 172.21.15.69:0/2001021838 conn(0x564e24dff300 msgr2=0x564e251a8a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:03.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.874+0000 7fba60e11740 1 -- 172.21.15.69:0/2001021838 shutdown_connections 2024-05-14T15:39:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.874+0000 7fba52a00640 1 --2- 172.21.15.69:0/3324889707 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fba380b2b90 0x7fba380b50a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x564e251ad650 tx=0x7fba40009620 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.874+0000 7fba60e11740 1 -- 172.21.15.69:0/2001021838 wait complete. 2024-05-14T15:39:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.875+0000 7fba60e11740 1 -- start start 2024-05-14T15:39:03.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.876+0000 7fba60e11740 1 Processor -- start 2024-05-14T15:39:03.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.881+0000 7fba60e11740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24de22f0 0x564e251c5160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.881+0000 7fba60e11740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 0x564e251c56a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.883 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.881+0000 7fba60e11740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24e0b1b0 0x564e251bf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.882+0000 7fba52a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24de22f0 0x564e251c5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.882+0000 7fba52a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24de22f0 0x564e251c5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:57554/0 (socket says 172.21.15.69:57554) 2024-05-14T15:39:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.882+0000 7fba52a00640 1 -- 172.21.15.69:0/616773959 learned_addr learned my addr 172.21.15.69:0/616773959 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.882+0000 7fba53400640 1 --2- 172.21.15.69:0/616773959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24e0b1b0 0x564e251bf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:03.884 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.882+0000 7fba60e11740 1 -- 172.21.15.69:0/616773959 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564e251b93d0 con 0x564e24de22f0 2024-05-14T15:39:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.882+0000 7fba60e11740 1 -- 172.21.15.69:0/616773959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564e250ca660 con 0x564e24e0b1b0 2024-05-14T15:39:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.882+0000 7fba60e11740 1 -- 172.21.15.69:0/616773959 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564e251b9550 con 0x564e24dea4d0 2024-05-14T15:39:03.885 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.882+0000 7fba52000640 1 --2- 172.21.15.69:0/616773959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 0x564e251c56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.882+0000 7fba60e11740 10 client.0 _ll_register_callbacks cb 0x564e25094400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:39:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.883+0000 7fba53400640 1 -- 172.21.15.69:0/616773959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 msgr2=0x564e251c56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.883+0000 7fba53400640 1 --2- 172.21.15.69:0/616773959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 0x564e251c56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.883+0000 7fba53400640 1 -- 172.21.15.69:0/616773959 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24de22f0 msgr2=0x564e251c5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.883+0000 7fba53400640 1 --2- 172.21.15.69:0/616773959 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24de22f0 0x564e251c5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.883+0000 7fba53400640 1 -- 172.21.15.69:0/616773959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e24eef620 con 0x564e24e0b1b0 2024-05-14T15:39:03.886 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.883+0000 7fba52a00640 1 --2- 172.21.15.69:0/616773959 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24de22f0 0x564e251c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:39:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.884+0000 7fba53400640 1 --2- 172.21.15.69:0/616773959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24e0b1b0 0x564e251bf550 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fba4c100230 tx=0x7fba4c0ca4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c29bb5e9ef33c02 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.884+0000 7fba3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:39:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.884+0000 7fba3cc00640 1 -- 172.21.15.69:0/616773959 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba4c0d2c20 con 0x564e24e0b1b0 2024-05-14T15:39:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.884+0000 7fba60e11740 1 -- 172.21.15.69:0/616773959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba44010cc0 con 0x564e24e0b1b0 2024-05-14T15:39:03.887 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.885+0000 7fba3cc00640 1 -- 172.21.15.69:0/616773959 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9554+0+0 (secure 0 0 0) 0x7fba4c1004b0 con 0x564e24e0b1b0 2024-05-14T15:39:03.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.889+0000 7fba3cc00640 1 -- 172.21.15.69:0/616773959 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fba4c1006b0 con 0x564e24e0b1b0 2024-05-14T15:39:03.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.889+0000 7fba60e11740 10 client.36929 fetch_fsmap learned FSMap version 73 2024-05-14T15:39:03.891 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.889+0000 7fba60e11740 1 -- 172.21.15.69:0/616773959 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x564e251b93d0 con 0x564e24e0b1b0 2024-05-14T15:39:03.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.890+0000 7fba3cc00640 1 -- 172.21.15.69:0/616773959 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba44010cc0 con 0x564e24e0b1b0 2024-05-14T15:39:03.893 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.892+0000 7fba3cc00640 1 -- 172.21.15.69:0/616773959 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 73) ==== 8402+0+0 (secure 0 0 0) 0x7fba4c0d2890 con 0x564e24e0b1b0 2024-05-14T15:39:03.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.892+0000 7fba60e11740 10 client.36929 fetch_fsmap finished waiting for FSMap version 73 2024-05-14T15:39:03.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.892+0000 7fba60e11740 10 client.36929 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:39:03.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.892+0000 7fba60e11740 20 client.36929 populate_metadata read hostname 'smithi069' 2024-05-14T15:39:03.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.892+0000 7fba60e11740 1 --2- 172.21.15.69:0/616773959 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564e24dc9d80 0x564e251d1540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.892+0000 7fba60e11740 4 client.36929 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:39:03.894 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.892+0000 7fba60e11740 1 -- 172.21.15.69:0/616773959 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e2511f160 con 0x564e24dc9d80 2024-05-14T15:39:03.895 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.893+0000 7fba52a00640 1 --2- 172.21.15.69:0/616773959 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564e24dc9d80 0x564e251d1540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:03.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.894+0000 7fba52a00640 1 --2- 172.21.15.69:0/616773959 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564e24dc9d80 0x564e251d1540 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=520256fc6731b535 server_cookie=9f963b3381bb2846 in_seq=0 out_seq=0 2024-05-14T15:39:03.897 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.895+0000 7fba3cc00640 10 client.36929 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:03.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.899+0000 7fba3cc00640 1 -- 172.21.15.69:0/616773959 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564e2511f160 con 0x564e24dc9d80 2024-05-14T15:39:03.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.899+0000 7fba3cc00640 10 client.36929 handle_command_reply: tid=0 2024-05-14T15:39:03.901 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.899+0000 7fba60e11740 1 client.36929 shutdown 2024-05-14T15:39:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.902+0000 7fba60e11740 1 -- 172.21.15.69:0/616773959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24e0b1b0 msgr2=0x564e251bf550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.902+0000 7fba60e11740 1 --2- 172.21.15.69:0/616773959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24e0b1b0 0x564e251bf550 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fba4c100230 tx=0x7fba4c0ca4c0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.902+0000 7fba60e11740 1 -- 172.21.15.69:0/616773959 shutdown_connections 2024-05-14T15:39:03.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.902+0000 7fba60e11740 1 --2- 172.21.15.69:0/616773959 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24e0b1b0 0x564e251bf550 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.902+0000 7fba60e11740 1 --2- 172.21.15.69:0/616773959 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 0x564e251c56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.902+0000 7fba60e11740 1 --2- 172.21.15.69:0/616773959 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564e24dc9d80 0x564e251d1540 crc :-1 s=READY pgs=242 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.902+0000 7fba60e11740 1 --2- 172.21.15.69:0/616773959 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24de22f0 0x564e251c5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.902+0000 7fba60e11740 1 -- 172.21.15.69:0/616773959 >> 172.21.15.69:0/616773959 conn(0x564e24dff300 msgr2=0x564e251a7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:03.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.902+0000 7fba3cc00640 0 client.36929 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:03.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.903+0000 7fba60e11740 1 -- 172.21.15.69:0/616773959 shutdown_connections 2024-05-14T15:39:03.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.903+0000 7fba60e11740 1 -- 172.21.15.69:0/616773959 wait complete. 2024-05-14T15:39:03.906 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.903+0000 7fba60e11740 20 client.36929 trim_cache size 0 max 16384 2024-05-14T15:39:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.931+0000 7fba60e11740 1 Processor -- start 2024-05-14T15:39:03.933 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.931+0000 7fba60e11740 1 -- start start 2024-05-14T15:39:03.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.932+0000 7fba60e11740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24de22f0 0x564e251b88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.932+0000 7fba60e11740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24dea4d0 0x564e251be400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.932+0000 7fba60e11740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24e0b1b0 0x564e251a8260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.932+0000 7fba60e11740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fba54072350 con 0x564e24dea4d0 2024-05-14T15:39:03.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.932+0000 7fba60e11740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fba54073fb0 con 0x564e24de22f0 2024-05-14T15:39:03.934 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.932+0000 7fba60e11740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fba54072a20 con 0x564e24e0b1b0 2024-05-14T15:39:03.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.933+0000 7fba52a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24de22f0 0x564e251b88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:03.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.933+0000 7fba52a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24de22f0 0x564e251b88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:58564/0 (socket says 172.21.15.69:58564) 2024-05-14T15:39:03.935 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.933+0000 7fba52a00640 1 -- 172.21.15.69:0/405513688 learned_addr learned my addr 172.21.15.69:0/405513688 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:03.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.933+0000 7fba53400640 1 --2- 172.21.15.69:0/405513688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24e0b1b0 0x564e251a8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:03.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.933+0000 7fba52a00640 1 -- 172.21.15.69:0/405513688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24e0b1b0 msgr2=0x564e251a8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:03.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.933+0000 7fba52a00640 1 --2- 172.21.15.69:0/405513688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24e0b1b0 0x564e251a8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.933+0000 7fba52a00640 1 -- 172.21.15.69:0/405513688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24dea4d0 msgr2=0x564e251be400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:03.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.933+0000 7fba52a00640 1 --2- 172.21.15.69:0/405513688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24dea4d0 0x564e251be400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.933+0000 7fba52a00640 1 -- 172.21.15.69:0/405513688 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e251bdaa0 con 0x564e24de22f0 2024-05-14T15:39:03.936 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.934+0000 7fba52a00640 1 --2- 172.21.15.69:0/405513688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24de22f0 0x564e251b88a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x564e251d1c70 tx=0x7fba40014000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fbb614056ee46e6b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:03.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.934+0000 7fba3f400640 1 -- 172.21.15.69:0/405513688 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40005020 con 0x564e24de22f0 2024-05-14T15:39:03.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.935+0000 7fba3f400640 1 -- 172.21.15.69:0/405513688 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba400047a0 con 0x564e24de22f0 2024-05-14T15:39:03.937 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.935+0000 7fba3f400640 1 -- 172.21.15.69:0/405513688 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba40005020 con 0x564e24de22f0 2024-05-14T15:39:03.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.936+0000 7fba60e11740 1 -- 172.21.15.69:0/405513688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24de22f0 msgr2=0x564e251b88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:03.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.936+0000 7fba60e11740 1 --2- 172.21.15.69:0/405513688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24de22f0 0x564e251b88a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x564e251d1c70 tx=0x7fba40014000 comp rx=0 tx=0).stop 2024-05-14T15:39:03.938 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.936+0000 7fba60e11740 1 -- 172.21.15.69:0/405513688 shutdown_connections 2024-05-14T15:39:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.936+0000 7fba60e11740 1 --2- 172.21.15.69:0/405513688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24e0b1b0 0x564e251a8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.936+0000 7fba60e11740 1 --2- 172.21.15.69:0/405513688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24dea4d0 0x564e251be400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.936+0000 7fba60e11740 1 --2- 172.21.15.69:0/405513688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24de22f0 0x564e251b88a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.936+0000 7fba60e11740 1 -- 172.21.15.69:0/405513688 >> 172.21.15.69:0/405513688 conn(0x564e24dff300 msgr2=0x564e251bdcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.937+0000 7fba60e11740 1 -- 172.21.15.69:0/405513688 shutdown_connections 2024-05-14T15:39:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.937+0000 7fba60e11740 1 -- 172.21.15.69:0/405513688 wait complete. 2024-05-14T15:39:03.939 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.938+0000 7fba60e11740 1 -- start start 2024-05-14T15:39:03.940 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.938+0000 7fba60e11740 1 Processor -- start 2024-05-14T15:39:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.939+0000 7fba60e11740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24de22f0 0x564e251cb850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.939+0000 7fba60e11740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 0x564e251c6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.939+0000 7fba60e11740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24e0b1b0 0x564e251c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.939+0000 7fba60e11740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fba54073820 con 0x564e24e0b1b0 2024-05-14T15:39:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.939+0000 7fba60e11740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fba540730f0 con 0x564e24de22f0 2024-05-14T15:39:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.939+0000 7fba60e11740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fba54070370 con 0x564e24dea4d0 2024-05-14T15:39:03.941 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.939+0000 7fba60e11740 10 client.0 _ll_register_callbacks cb 0x7fba4c0c5c80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:39:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.939+0000 7fba52a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24de22f0 0x564e251cb850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.940+0000 7fba52000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 0x564e251c6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.940+0000 7fba52000640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 0x564e251c6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:38944/0 (socket says 172.21.15.69:38944) 2024-05-14T15:39:03.942 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.940+0000 7fba52000640 1 -- 172.21.15.69:0/782812635 learned_addr learned my addr 172.21.15.69:0/782812635 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.941+0000 7fba52000640 1 -- 172.21.15.69:0/782812635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24de22f0 msgr2=0x564e251cb850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.941+0000 7fba52000640 1 --2- 172.21.15.69:0/782812635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24de22f0 0x564e251cb850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.941+0000 7fba52000640 1 -- 172.21.15.69:0/782812635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24e0b1b0 msgr2=0x564e251c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.941+0000 7fba52000640 1 --2- 172.21.15.69:0/782812635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24e0b1b0 0x564e251c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.941+0000 7fba52000640 1 -- 172.21.15.69:0/782812635 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e251c76d0 con 0x564e24dea4d0 2024-05-14T15:39:03.943 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.941+0000 7fba52a00640 1 --2- 172.21.15.69:0/782812635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24de22f0 0x564e251cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:39:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.942+0000 7fba52000640 1 --2- 172.21.15.69:0/782812635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 0x564e251c6ba0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fba44012520 tx=0x7fba44005760 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d3c0db1ae5e6b18 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:03.944 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.942+0000 7fba3cc00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:39:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.942+0000 7fba3cc00640 1 -- 172.21.15.69:0/782812635 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba44023040 con 0x564e24dea4d0 2024-05-14T15:39:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.942+0000 7fba3cc00640 1 -- 172.21.15.69:0/782812635 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(115..115 src has 1..115) ==== 9554+0+0 (secure 0 0 0) 0x7fba440035f0 con 0x564e24dea4d0 2024-05-14T15:39:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.942+0000 7fba60e11740 1 -- 172.21.15.69:0/782812635 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba400047a0 con 0x564e24dea4d0 2024-05-14T15:39:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.943+0000 7fba3cc00640 1 -- 172.21.15.69:0/782812635 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=73) ==== 24+0+0 (secure 0 0 0) 0x7fba44037050 con 0x564e24dea4d0 2024-05-14T15:39:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.943+0000 7fba60e11740 10 client.26902 fetch_fsmap learned FSMap version 73 2024-05-14T15:39:03.945 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.943+0000 7fba60e11740 1 -- 172.21.15.69:0/782812635 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=73,monmap=4+}) -- 0x564e25239660 con 0x564e24dea4d0 2024-05-14T15:39:03.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.943+0000 7fba3cc00640 1 -- 172.21.15.69:0/782812635 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fba400047a0 con 0x564e24dea4d0 2024-05-14T15:39:03.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.944+0000 7fba3cc00640 1 -- 172.21.15.69:0/782812635 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 73) ==== 8402+0+0 (secure 0 0 0) 0x7fba44026030 con 0x564e24dea4d0 2024-05-14T15:39:03.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.944+0000 7fba60e11740 10 client.26902 fetch_fsmap finished waiting for FSMap version 73 2024-05-14T15:39:03.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.944+0000 7fba60e11740 10 client.26902 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:39:03.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.944+0000 7fba60e11740 20 client.26902 populate_metadata read hostname 'smithi069' 2024-05-14T15:39:03.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.944+0000 7fba60e11740 1 --2- 172.21.15.69:0/782812635 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564e24d9f1c0 0x564e2523be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:03.946 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.944+0000 7fba60e11740 4 client.26902 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:39:03.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.944+0000 7fba60e11740 1 -- 172.21.15.69:0/782812635 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564e25118fd0 con 0x564e24d9f1c0 2024-05-14T15:39:03.947 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.945+0000 7fba52a00640 1 --2- 172.21.15.69:0/782812635 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564e24d9f1c0 0x564e2523be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:03.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.946+0000 7fba52a00640 1 --2- 172.21.15.69:0/782812635 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564e24d9f1c0 0x564e2523be00 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16b055be4ad99d7e server_cookie=5363a8bc9a28981f in_seq=0 out_seq=0 2024-05-14T15:39:03.948 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.946+0000 7fba3cc00640 10 client.26902 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.968+0000 7fba3cc00640 1 -- 172.21.15.69:0/782812635 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564e25118fd0 con 0x564e24d9f1c0 2024-05-14T15:39:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.968+0000 7fba3cc00640 10 client.26902 handle_command_reply: tid=0 2024-05-14T15:39:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.968+0000 7fba60e11740 1 client.26902 shutdown 2024-05-14T15:39:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.968+0000 7fba60e11740 1 -- 172.21.15.69:0/782812635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 msgr2=0x564e251c6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:03.970 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.968+0000 7fba60e11740 1 --2- 172.21.15.69:0/782812635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 0x564e251c6ba0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fba44012520 tx=0x7fba44005760 comp rx=0 tx=0).stop 2024-05-14T15:39:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.968+0000 7fba60e11740 1 -- 172.21.15.69:0/782812635 shutdown_connections 2024-05-14T15:39:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.968+0000 7fba60e11740 1 --2- 172.21.15.69:0/782812635 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564e24d9f1c0 0x564e2523be00 crc :-1 s=READY pgs=243 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.968+0000 7fba60e11740 1 --2- 172.21.15.69:0/782812635 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564e24e0b1b0 0x564e251c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.968+0000 7fba60e11740 1 --2- 172.21.15.69:0/782812635 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564e24dea4d0 0x564e251c6ba0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.968+0000 7fba60e11740 1 --2- 172.21.15.69:0/782812635 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564e24de22f0 0x564e251cb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.968+0000 7fba60e11740 1 -- 172.21.15.69:0/782812635 >> 172.21.15.69:0/782812635 conn(0x564e24dff300 msgr2=0x564e251adee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:03.971 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.968+0000 7fba3cc00640 0 client.26902 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.968+0000 7fba60e11740 1 -- 172.21.15.69:0/782812635 shutdown_connections 2024-05-14T15:39:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.969+0000 7fba60e11740 1 -- 172.21.15.69:0/782812635 wait complete. 2024-05-14T15:39:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.969+0000 7fba60e11740 20 client.26902 trim_cache size 0 max 16384 2024-05-14T15:39:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:39:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:39:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:39:03.972 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:39:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.970+0000 7fba59e00640 1 -- 172.21.15.69:0/3324889707 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fba380b2b90 msgr2=0x7fba380b50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.970+0000 7fba59e00640 1 --2- 172.21.15.69:0/3324889707 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fba380b2b90 0x7fba380b50a0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x564e251ad650 tx=0x7fba40009620 comp rx=0 tx=0).stop 2024-05-14T15:39:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.970+0000 7fba59e00640 1 -- 172.21.15.69:0/3324889707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba5410e220 msgr2=0x7fba5419c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.970+0000 7fba59e00640 1 --2- 172.21.15.69:0/3324889707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba5410e220 0x7fba5419c7d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fba4c034040 tx=0x7fba4c003e60 comp rx=0 tx=0).stop 2024-05-14T15:39:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.970+0000 7fba59e00640 1 -- 172.21.15.69:0/3324889707 shutdown_connections 2024-05-14T15:39:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.970+0000 7fba59e00640 1 --2- 172.21.15.69:0/3324889707 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fba380b2b90 0x7fba380b50a0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.973 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.970+0000 7fba59e00640 1 --2- 172.21.15.69:0/3324889707 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fba5410e220 0x7fba5419c7d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.970+0000 7fba59e00640 1 --2- 172.21.15.69:0/3324889707 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fba5410b8c0 0x7fba541a1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.970+0000 7fba59e00640 1 --2- 172.21.15.69:0/3324889707 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fba54104e60 0x7fba541a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.970+0000 7fba59e00640 1 -- 172.21.15.69:0/3324889707 >> 172.21.15.69:0/3324889707 conn(0x7fba540782e0 msgr2=0x7fba541012c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.970+0000 7fba59e00640 1 -- 172.21.15.69:0/3324889707 shutdown_connections 2024-05-14T15:39:03.974 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:03.970+0000 7fba59e00640 1 -- 172.21.15.69:0/3324889707 wait complete. 2024-05-14T15:39:04.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:04 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:39:04.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:04 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:39:04.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:04 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:39:04.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:04 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:39:04.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:04 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:39:04.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:04 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:39:04.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:04 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:39:04.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:04 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:39:04.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:04 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:39:05.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:05 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:05.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:05 smithi203 ceph-mon[34567]: pgmap v549: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 6.4 MiB/s wr, 508 op/s 2024-05-14T15:39:05.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:05 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:05.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:05 smithi092 ceph-mon[34729]: pgmap v549: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 6.4 MiB/s wr, 508 op/s 2024-05-14T15:39:05.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:05 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:05.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:05 smithi069 ceph-mon[31270]: pgmap v549: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 6.4 MiB/s wr, 508 op/s 2024-05-14T15:39:06.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 800.0 s, 581.3 tps, lat 181.440 ms stddev 133.253 2024-05-14T15:39:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:07 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:07.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:07 smithi203 ceph-mon[34567]: pgmap v550: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 8.1 MiB/s wr, 700 op/s 2024-05-14T15:39:07.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:07 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:07.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:07 smithi092 ceph-mon[34729]: pgmap v550: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 8.1 MiB/s wr, 700 op/s 2024-05-14T15:39:07.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:07 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:07.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:07 smithi069 ceph-mon[31270]: pgmap v550: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 125 KiB/s rd, 8.1 MiB/s wr, 700 op/s 2024-05-14T15:39:08.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:08 smithi203 ceph-mon[34567]: osdmap e116: 12 total, 12 up, 12 in 2024-05-14T15:39:08.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:08 smithi092 ceph-mon[34729]: osdmap e116: 12 total, 12 up, 12 in 2024-05-14T15:39:08.723 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:08 smithi069 ceph-mon[31270]: osdmap e116: 12 total, 12 up, 12 in 2024-05-14T15:39:09.594 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:09 smithi203 ceph-mon[34567]: pgmap v552: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 6.4 MiB/s wr, 572 op/s 2024-05-14T15:39:09.693 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:09 smithi092 ceph-mon[34729]: pgmap v552: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 6.4 MiB/s wr, 572 op/s 2024-05-14T15:39:09.724 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:09 smithi069 ceph-mon[31270]: pgmap v552: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 122 KiB/s rd, 6.4 MiB/s wr, 572 op/s 2024-05-14T15:39:11.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 805.0 s, 417.8 tps, lat 238.031 ms stddev 266.392 2024-05-14T15:39:11.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:11 smithi203 ceph-mon[34567]: pgmap v553: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 7.2 MiB/s wr, 602 op/s 2024-05-14T15:39:11.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:11 smithi092 ceph-mon[34729]: pgmap v553: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 7.2 MiB/s wr, 602 op/s 2024-05-14T15:39:11.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:11 smithi069 ceph-mon[31270]: pgmap v553: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 124 KiB/s rd, 7.2 MiB/s wr, 602 op/s 2024-05-14T15:39:12.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:12 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:13.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:12 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:13.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:12 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:14.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:13 smithi203 ceph-mon[34567]: pgmap v554: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 6.5 MiB/s wr, 568 op/s 2024-05-14T15:39:14.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:13 smithi092 ceph-mon[34729]: pgmap v554: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 6.5 MiB/s wr, 568 op/s 2024-05-14T15:39:14.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:13 smithi069 ceph-mon[31270]: pgmap v554: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 6.5 MiB/s wr, 568 op/s 2024-05-14T15:39:16.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:15 smithi203 ceph-mon[34567]: pgmap v555: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 6.6 MiB/s wr, 565 op/s 2024-05-14T15:39:16.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:15 smithi203 ceph-mon[34567]: osdmap e117: 12 total, 12 up, 12 in 2024-05-14T15:39:16.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 810.0 s, 549.8 tps, lat 182.221 ms stddev 120.426 2024-05-14T15:39:16.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:15 smithi092 ceph-mon[34729]: pgmap v555: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 6.6 MiB/s wr, 565 op/s 2024-05-14T15:39:16.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:15 smithi092 ceph-mon[34729]: osdmap e117: 12 total, 12 up, 12 in 2024-05-14T15:39:16.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:15 smithi069 ceph-mon[31270]: pgmap v555: 129 pgs: 1 active+clean+snaptrim, 128 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 135 KiB/s rd, 6.6 MiB/s wr, 565 op/s 2024-05-14T15:39:16.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:15 smithi069 ceph-mon[31270]: osdmap e117: 12 total, 12 up, 12 in 2024-05-14T15:39:17.374 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.373+0000 7f0643600640 1 -- 172.21.15.69:0/1272374647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f063c10e010 msgr2=0x7f063c110500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:17.374 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.373+0000 7f0643600640 1 --2- 172.21.15.69:0/1272374647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f063c10e010 0x7f063c110500 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f063400acb0 tx=0x7f063402a940 comp rx=0 tx=0).stop 2024-05-14T15:39:17.374 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.373+0000 7f0643600640 1 -- 172.21.15.69:0/1272374647 shutdown_connections 2024-05-14T15:39:17.374 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.373+0000 7f0643600640 1 --2- 172.21.15.69:0/1272374647 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f063c10e010 0x7f063c110500 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.373+0000 7f0643600640 1 --2- 172.21.15.69:0/1272374647 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f063c10b620 0x7f063c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.373+0000 7f0643600640 1 --2- 172.21.15.69:0/1272374647 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f063c104bc0 0x7f063c104fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.373+0000 7f0643600640 1 -- 172.21.15.69:0/1272374647 >> 172.21.15.69:0/1272374647 conn(0x7f063c0fe220 msgr2=0x7f063c100640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.373+0000 7f0643600640 1 -- 172.21.15.69:0/1272374647 shutdown_connections 2024-05-14T15:39:17.375 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.374+0000 7f0643600640 1 -- 172.21.15.69:0/1272374647 wait complete. 2024-05-14T15:39:17.376 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.375+0000 7f0643600640 1 Processor -- start 2024-05-14T15:39:17.378 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.377+0000 7f0643600640 1 -- start start 2024-05-14T15:39:17.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.378+0000 7f0643600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f063c104bc0 0x7f063c19c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.378+0000 7f0643600640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f063c10b620 0x7f063c19cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.378+0000 7f0643600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f063c10e010 0x7f063c1a0f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.379 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.379+0000 7f0643600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f063c113b70 con 0x7f063c10e010 2024-05-14T15:39:17.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.379+0000 7f0643600640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f063c1139f0 con 0x7f063c10b620 2024-05-14T15:39:17.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.379+0000 7f0643600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f063c113cf0 con 0x7f063c104bc0 2024-05-14T15:39:17.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.379+0000 7f0640c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f063c104bc0 0x7f063c19c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.379+0000 7f063be00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f063c10b620 0x7f063c19cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.379+0000 7f063be00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f063c10b620 0x7f063c19cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:36984/0 (socket says 172.21.15.69:36984) 2024-05-14T15:39:17.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.379+0000 7f0640c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f063c104bc0 0x7f063c19c710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:50088/0 (socket says 172.21.15.69:50088) 2024-05-14T15:39:17.380 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.379+0000 7f063be00640 1 -- 172.21.15.69:0/2086576329 learned_addr learned my addr 172.21.15.69:0/2086576329 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:17.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.380+0000 7f063be00640 1 -- 172.21.15.69:0/2086576329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f063c104bc0 msgr2=0x7f063c19c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:17.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.380+0000 7f0641600640 1 --2- 172.21.15.69:0/2086576329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f063c10e010 0x7f063c1a0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.380+0000 7f063be00640 1 --2- 172.21.15.69:0/2086576329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f063c104bc0 0x7f063c19c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.380+0000 7f063be00640 1 -- 172.21.15.69:0/2086576329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f063c10e010 msgr2=0x7f063c1a0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:17.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.380+0000 7f063be00640 1 --2- 172.21.15.69:0/2086576329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f063c10e010 0x7f063c1a0f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.380+0000 7f063be00640 1 -- 172.21.15.69:0/2086576329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063c1a14f0 con 0x7f063c10b620 2024-05-14T15:39:17.381 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.380+0000 7f0640c00640 1 --2- 172.21.15.69:0/2086576329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f063c104bc0 0x7f063c19c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:39:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.380+0000 7f0641600640 1 --2- 172.21.15.69:0/2086576329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f063c10e010 0x7f063c1a0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:39:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.381+0000 7f063be00640 1 --2- 172.21.15.69:0/2086576329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f063c10b620 0x7f063c19cc70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f063000e9f0 tx=0x7f063000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:17.382 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.381+0000 7f0639600640 1 -- 172.21.15.69:0/2086576329 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063000ccc0 con 0x7f063c10b620 2024-05-14T15:39:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.382+0000 7f0643600640 1 -- 172.21.15.69:0/2086576329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f063c1a17e0 con 0x7f063c10b620 2024-05-14T15:39:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.382+0000 7f0643600640 1 -- 172.21.15.69:0/2086576329 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f063c1a1d30 con 0x7f063c10b620 2024-05-14T15:39:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.382+0000 7f0639600640 1 -- 172.21.15.69:0/2086576329 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06300108c0 con 0x7f063c10b620 2024-05-14T15:39:17.383 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.382+0000 7f0639600640 1 -- 172.21.15.69:0/2086576329 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06300187a0 con 0x7f063c10b620 2024-05-14T15:39:17.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.390+0000 7f064a678740 1 Processor -- start 2024-05-14T15:39:17.391 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.391+0000 7f0639600640 1 -- 172.21.15.69:0/2086576329 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f0630018940 con 0x7f063c10b620 2024-05-14T15:39:17.392 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.391+0000 7f064a678740 1 -- start start 2024-05-14T15:39:17.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.392+0000 7f064a678740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220971b0 0x563322438470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.392+0000 7f064a678740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 0x5633224389b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.392+0000 7f064a678740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220764d0 0x563322438ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.392+0000 7f064a678740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56332239d550 con 0x5633220971b0 2024-05-14T15:39:17.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.392+0000 7f064a678740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563322342bc0 con 0x56332206e2f0 2024-05-14T15:39:17.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.392+0000 7f064a678740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563322399510 con 0x5633220764d0 2024-05-14T15:39:17.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.392+0000 7f0641600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220971b0 0x563322438470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.393+0000 7f0641600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220971b0 0x563322438470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:32898/0 (socket says 172.21.15.69:32898) 2024-05-14T15:39:17.393 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.393+0000 7f0641600640 1 -- 172.21.15.69:0/2438705027 learned_addr learned my addr 172.21.15.69:0/2438705027 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:17.394 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.393+0000 7f0640c00640 1 --2- 172.21.15.69:0/2438705027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 0x5633224389b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.394 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.393+0000 7f0641600640 1 -- 172.21.15.69:0/2438705027 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220764d0 msgr2=0x563322438ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:17.394 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.393+0000 7f0641600640 1 --2- 172.21.15.69:0/2438705027 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220764d0 0x563322438ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.394 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.393+0000 7f0641600640 1 -- 172.21.15.69:0/2438705027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 msgr2=0x5633224389b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:17.394 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.393+0000 7f0641600640 1 --2- 172.21.15.69:0/2438705027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 0x5633224389b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.394 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.393+0000 7f0641600640 1 -- 172.21.15.69:0/2438705027 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633220af210 con 0x5633220971b0 2024-05-14T15:39:17.395 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.394+0000 7f0641600640 1 --2- 172.21.15.69:0/2438705027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220971b0 0x563322438470 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f063400aa30 tx=0x7f063400a360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1fbbc4ee423f1a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:17.396 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.395+0000 7f062dc00640 1 -- 172.21.15.69:0/2438705027 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f063402f840 con 0x5633220971b0 2024-05-14T15:39:17.396 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.395+0000 7f062dc00640 1 -- 172.21.15.69:0/2438705027 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0634040030 con 0x5633220971b0 2024-05-14T15:39:17.396 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.395+0000 7f062dc00640 1 -- 172.21.15.69:0/2438705027 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634030ce0 con 0x5633220971b0 2024-05-14T15:39:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.396+0000 7f0639600640 1 --2- 172.21.15.69:0/2086576329 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f06240b2aa0 0x7f06240b4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.397 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.396+0000 7f064a678740 1 -- 172.21.15.69:0/2438705027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220971b0 msgr2=0x563322438470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:17.398 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.396+0000 7f064a678740 1 --2- 172.21.15.69:0/2438705027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220971b0 0x563322438470 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f063400aa30 tx=0x7f063400a360 comp rx=0 tx=0).stop 2024-05-14T15:39:17.398 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.396+0000 7f0640c00640 1 --2- 172.21.15.69:0/2086576329 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f06240b2aa0 0x7f06240b4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.397+0000 7f0639600640 1 -- 172.21.15.69:0/2086576329 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 9554+0+0 (secure 0 0 0) 0x7f06300e2d00 con 0x7f063c10b620 2024-05-14T15:39:17.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.397+0000 7f064a678740 1 -- 172.21.15.69:0/2438705027 shutdown_connections 2024-05-14T15:39:17.399 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.397+0000 7f064a678740 1 --2- 172.21.15.69:0/2438705027 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220764d0 0x563322438ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.397+0000 7f064a678740 1 --2- 172.21.15.69:0/2438705027 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 0x5633224389b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.397+0000 7f064a678740 1 --2- 172.21.15.69:0/2438705027 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220971b0 0x563322438470 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.397+0000 7f064a678740 1 -- 172.21.15.69:0/2438705027 >> 172.21.15.69:0/2438705027 conn(0x56332208b300 msgr2=0x563322434c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:17.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.397+0000 7f064a678740 1 -- 172.21.15.69:0/2438705027 shutdown_connections 2024-05-14T15:39:17.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.398+0000 7f0640c00640 1 --2- 172.21.15.69:0/2086576329 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f06240b2aa0 0x7f06240b4fb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x563322439820 tx=0x7f062800a2d0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:17.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.398+0000 7f064a678740 1 -- 172.21.15.69:0/2438705027 wait complete. 2024-05-14T15:39:17.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.398+0000 7f064a678740 1 -- start start 2024-05-14T15:39:17.400 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.399+0000 7f064a678740 1 Processor -- start 2024-05-14T15:39:17.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.400+0000 7f064a678740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56332206e2f0 0x563322451280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.400+0000 7f064a678740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220764d0 0x5633224517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.400+0000 7f064a678740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5633220971b0 0x56332244b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.400+0000 7f064a678740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5633224455e0 con 0x56332206e2f0 2024-05-14T15:39:17.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.400+0000 7f064a678740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x563322356660 con 0x5633220971b0 2024-05-14T15:39:17.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.400+0000 7f064a678740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x563322445760 con 0x5633220764d0 2024-05-14T15:39:17.401 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.400+0000 7f064a678740 10 client.0 _ll_register_callbacks cb 0x563322320400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:39:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.401+0000 7f0641600640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5633220971b0 0x56332244b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.401+0000 7f0640c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56332206e2f0 0x563322451280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.401+0000 7f0641600640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5633220971b0 0x56332244b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:36990/0 (socket says 172.21.15.69:36990) 2024-05-14T15:39:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.401+0000 7f0641600640 1 -- 172.21.15.69:0/185773869 learned_addr learned my addr 172.21.15.69:0/185773869 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:17.402 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.401+0000 7f063be00640 1 --2- 172.21.15.69:0/185773869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220764d0 0x5633224517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.402+0000 7f0641600640 1 -- 172.21.15.69:0/185773869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220764d0 msgr2=0x5633224517c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.402+0000 7f0641600640 1 --2- 172.21.15.69:0/185773869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220764d0 0x5633224517c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.402+0000 7f0641600640 1 -- 172.21.15.69:0/185773869 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56332206e2f0 msgr2=0x563322451280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.402+0000 7f0641600640 1 --2- 172.21.15.69:0/185773869 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56332206e2f0 0x563322451280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.403 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.402+0000 7f0641600640 1 -- 172.21.15.69:0/185773869 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56332217b620 con 0x5633220971b0 2024-05-14T15:39:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.403+0000 7f0641600640 1 --2- 172.21.15.69:0/185773869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5633220971b0 0x56332244b670 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f063402a980 tx=0x7f06340309e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6178b0c86f5b1e09 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:17.404 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.403+0000 7f0622000640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:39:17.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.404+0000 7f0622000640 1 -- 172.21.15.69:0/185773869 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0634053060 con 0x5633220971b0 2024-05-14T15:39:17.405 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.404+0000 7f0622000640 1 -- 172.21.15.69:0/185773869 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9554+0+0 (secure 0 0 0) 0x7f063402f640 con 0x5633220971b0 2024-05-14T15:39:17.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.405+0000 7f064a678740 1 -- 172.21.15.69:0/185773869 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0634040030 con 0x5633220971b0 2024-05-14T15:39:17.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.406+0000 7f0622000640 1 -- 172.21.15.69:0/185773869 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f063402f840 con 0x5633220971b0 2024-05-14T15:39:17.406 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.406+0000 7f064a678740 10 client.36947 fetch_fsmap learned FSMap version 77 2024-05-14T15:39:17.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.406+0000 7f064a678740 1 -- 172.21.15.69:0/185773869 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x56332245a020 con 0x5633220971b0 2024-05-14T15:39:17.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.406+0000 7f0622000640 1 -- 172.21.15.69:0/185773869 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0634040030 con 0x5633220971b0 2024-05-14T15:39:17.407 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.407+0000 7f0622000640 1 -- 172.21.15.69:0/185773869 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 77) ==== 8402+0+0 (secure 0 0 0) 0x7f0634045830 con 0x5633220971b0 2024-05-14T15:39:17.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.407+0000 7f064a678740 10 client.36947 fetch_fsmap finished waiting for FSMap version 77 2024-05-14T15:39:17.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.407+0000 7f064a678740 10 client.36947 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:39:17.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.407+0000 7f064a678740 20 client.36947 populate_metadata read hostname 'smithi069' 2024-05-14T15:39:17.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.407+0000 7f064a678740 1 --2- 172.21.15.69:0/185773869 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x563322055d80 0x56332245d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.407+0000 7f064a678740 4 client.36947 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:39:17.408 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.407+0000 7f064a678740 1 -- 172.21.15.69:0/185773869 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633223ab160 con 0x563322055d80 2024-05-14T15:39:17.409 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.408+0000 7f0640c00640 1 --2- 172.21.15.69:0/185773869 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x563322055d80 0x56332245d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.411+0000 7f0640c00640 1 --2- 172.21.15.69:0/185773869 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x563322055d80 0x56332245d380 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3865ab395402a845 server_cookie=7409ef1d203cb4a7 in_seq=0 out_seq=0 2024-05-14T15:39:17.412 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.411+0000 7f0622000640 10 client.36947 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:17.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.413+0000 7f0622000640 1 -- 172.21.15.69:0/185773869 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5633223ab160 con 0x563322055d80 2024-05-14T15:39:17.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.413+0000 7f0622000640 10 client.36947 handle_command_reply: tid=0 2024-05-14T15:39:17.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.414+0000 7f064a678740 1 client.36947 shutdown 2024-05-14T15:39:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.416+0000 7f064a678740 1 -- 172.21.15.69:0/185773869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5633220971b0 msgr2=0x56332244b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.416+0000 7f064a678740 1 --2- 172.21.15.69:0/185773869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5633220971b0 0x56332244b670 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f063402a980 tx=0x7f06340309e0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.416+0000 7f064a678740 1 -- 172.21.15.69:0/185773869 shutdown_connections 2024-05-14T15:39:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.416+0000 7f064a678740 1 --2- 172.21.15.69:0/185773869 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5633220971b0 0x56332244b670 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.416+0000 7f064a678740 1 --2- 172.21.15.69:0/185773869 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220764d0 0x5633224517c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.416+0000 7f064a678740 1 --2- 172.21.15.69:0/185773869 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x563322055d80 0x56332245d380 crc :-1 s=READY pgs=244 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.416+0000 7f064a678740 1 --2- 172.21.15.69:0/185773869 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56332206e2f0 0x563322451280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.416+0000 7f0622000640 0 client.36947 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:17.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.416+0000 7f064a678740 1 -- 172.21.15.69:0/185773869 >> 172.21.15.69:0/185773869 conn(0x56332208b300 msgr2=0x56332243a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:17.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.416+0000 7f064a678740 1 -- 172.21.15.69:0/185773869 shutdown_connections 2024-05-14T15:39:17.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.416+0000 7f064a678740 1 -- 172.21.15.69:0/185773869 wait complete. 2024-05-14T15:39:17.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.417+0000 7f064a678740 20 client.36947 trim_cache size 0 max 16384 2024-05-14T15:39:17.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.448+0000 7f064a678740 1 Processor -- start 2024-05-14T15:39:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.449+0000 7f064a678740 1 -- start start 2024-05-14T15:39:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.450+0000 7f064a678740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 0x563322438420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.450+0000 7f064a678740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220764d0 0x56332244bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.450+0000 7f064a678740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220971b0 0x5633224629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.450+0000 7f064a678740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f063c1aee70 con 0x5633220764d0 2024-05-14T15:39:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.450+0000 7f064a678740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f063c1b0b60 con 0x56332206e2f0 2024-05-14T15:39:17.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.450+0000 7f064a678740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f063c1af540 con 0x5633220971b0 2024-05-14T15:39:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.452+0000 7f0640c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 0x563322438420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.452+0000 7f0640c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 0x563322438420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:37000/0 (socket says 172.21.15.69:37000) 2024-05-14T15:39:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.452+0000 7f0640c00640 1 -- 172.21.15.69:0/731679896 learned_addr learned my addr 172.21.15.69:0/731679896 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:17.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.452+0000 7f063be00640 1 --2- 172.21.15.69:0/731679896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220764d0 0x56332244bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.453+0000 7f063be00640 1 -- 172.21.15.69:0/731679896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220971b0 msgr2=0x5633224629e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.452+0000 7f0641600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220971b0 0x5633224629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.453+0000 7f063be00640 1 --2- 172.21.15.69:0/731679896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220971b0 0x5633224629e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.453+0000 7f063be00640 1 -- 172.21.15.69:0/731679896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 msgr2=0x563322438420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.453+0000 7f063be00640 1 --2- 172.21.15.69:0/731679896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 0x563322438420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.453+0000 7f063be00640 1 -- 172.21.15.69:0/731679896 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563322438200 con 0x5633220764d0 2024-05-14T15:39:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.454+0000 7f0640c00640 1 --2- 172.21.15.69:0/731679896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 0x563322438420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:39:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.454+0000 7f0641600640 1 --2- 172.21.15.69:0/731679896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220971b0 0x5633224629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:39:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.454+0000 7f063be00640 1 --2- 172.21.15.69:0/731679896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220764d0 0x56332244bf10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f06300e0040 tx=0x7f06300a9650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5df47f43c5cdfca1 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:17.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.454+0000 7f062d200640 1 -- 172.21.15.69:0/731679896 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06300b2370 con 0x5633220764d0 2024-05-14T15:39:17.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.455+0000 7f062d200640 1 -- 172.21.15.69:0/731679896 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06300a96e0 con 0x5633220764d0 2024-05-14T15:39:17.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.455+0000 7f062d200640 1 -- 172.21.15.69:0/731679896 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06300a5e60 con 0x5633220764d0 2024-05-14T15:39:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.456+0000 7f064a678740 1 -- 172.21.15.69:0/731679896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220764d0 msgr2=0x56332244bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.456+0000 7f064a678740 1 --2- 172.21.15.69:0/731679896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220764d0 0x56332244bf10 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f06300e0040 tx=0x7f06300a9650 comp rx=0 tx=0).stop 2024-05-14T15:39:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.456+0000 7f064a678740 1 -- 172.21.15.69:0/731679896 shutdown_connections 2024-05-14T15:39:17.457 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.456+0000 7f064a678740 1 --2- 172.21.15.69:0/731679896 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220971b0 0x5633224629e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.457+0000 7f064a678740 1 --2- 172.21.15.69:0/731679896 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220764d0 0x56332244bf10 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.457+0000 7f064a678740 1 --2- 172.21.15.69:0/731679896 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 0x563322438420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.458 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.458+0000 7f064a678740 1 -- 172.21.15.69:0/731679896 >> 172.21.15.69:0/731679896 conn(0x56332208b300 msgr2=0x56332243aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:17.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.459+0000 7f064a678740 1 -- 172.21.15.69:0/731679896 shutdown_connections 2024-05-14T15:39:17.460 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.459+0000 7f064a678740 1 -- 172.21.15.69:0/731679896 wait complete. 2024-05-14T15:39:17.461 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.460+0000 7f064a678740 1 -- start start 2024-05-14T15:39:17.462 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.461+0000 7f064a678740 1 Processor -- start 2024-05-14T15:39:17.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.462+0000 7f064a678740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 0x563322457560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.462+0000 7f064a678740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220764d0 0x563322457aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.463 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.462+0000 7f064a678740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220971b0 0x563322451210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.462+0000 7f064a678740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f063c1b03d0 con 0x5633220971b0 2024-05-14T15:39:17.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.462+0000 7f064a678740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f063c1afcd0 con 0x56332206e2f0 2024-05-14T15:39:17.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.462+0000 7f064a678740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f063c1aced0 con 0x5633220764d0 2024-05-14T15:39:17.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.462+0000 7f064a678740 10 client.0 _ll_register_callbacks cb 0x7f062800a9e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:39:17.464 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.463+0000 7f0640c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 0x563322457560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.463+0000 7f063be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220764d0 0x563322457aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.463+0000 7f0640c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 0x563322457560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:37006/0 (socket says 172.21.15.69:37006) 2024-05-14T15:39:17.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.463+0000 7f0640c00640 1 -- 172.21.15.69:0/2634164811 learned_addr learned my addr 172.21.15.69:0/2634164811 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:17.465 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.464+0000 7f0641600640 1 --2- 172.21.15.69:0/2634164811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220971b0 0x563322451210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.466+0000 7f063be00640 1 -- 172.21.15.69:0/2634164811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 msgr2=0x563322457560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:17.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.466+0000 7f063be00640 1 --2- 172.21.15.69:0/2634164811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 0x563322457560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.466+0000 7f063be00640 1 -- 172.21.15.69:0/2634164811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220971b0 msgr2=0x563322451210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:17.466 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.466+0000 7f063be00640 1 --2- 172.21.15.69:0/2634164811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220971b0 0x563322451210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.466+0000 7f063be00640 1 -- 172.21.15.69:0/2634164811 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563322451820 con 0x5633220764d0 2024-05-14T15:39:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.466+0000 7f063be00640 1 --2- 172.21.15.69:0/2634164811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220764d0 0x563322457aa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f06300ae140 tx=0x7f06300e2f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=939b8e8fc4ed4894 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.466+0000 7f0622000640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:39:17.467 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.466+0000 7f0622000640 1 -- 172.21.15.69:0/2634164811 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06300b2370 con 0x5633220764d0 2024-05-14T15:39:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.467+0000 7f064a678740 1 -- 172.21.15.69:0/2634164811 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f06300a96e0 con 0x5633220764d0 2024-05-14T15:39:17.468 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.467+0000 7f0622000640 1 -- 172.21.15.69:0/2634164811 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 9554+0+0 (secure 0 0 0) 0x7f0630010640 con 0x5633220764d0 2024-05-14T15:39:17.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.468+0000 7f0622000640 1 -- 172.21.15.69:0/2634164811 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=77) ==== 24+0+0 (secure 0 0 0) 0x7f06300a9bd0 con 0x5633220764d0 2024-05-14T15:39:17.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.468+0000 7f064a678740 10 client.26914 fetch_fsmap learned FSMap version 77 2024-05-14T15:39:17.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.468+0000 7f064a678740 1 -- 172.21.15.69:0/2634164811 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=77,monmap=4+}) -- 0x563322456ad0 con 0x5633220764d0 2024-05-14T15:39:17.469 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.468+0000 7f0622000640 1 -- 172.21.15.69:0/2634164811 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f06300a96e0 con 0x5633220764d0 2024-05-14T15:39:17.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.469+0000 7f0622000640 1 -- 172.21.15.69:0/2634164811 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 77) ==== 8402+0+0 (secure 0 0 0) 0x7f06300a5040 con 0x5633220764d0 2024-05-14T15:39:17.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.469+0000 7f064a678740 10 client.26914 fetch_fsmap finished waiting for FSMap version 77 2024-05-14T15:39:17.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.469+0000 7f064a678740 10 client.26914 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:39:17.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.469+0000 7f064a678740 20 client.26914 populate_metadata read hostname 'smithi069' 2024-05-14T15:39:17.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.469+0000 7f064a678740 1 --2- 172.21.15.69:0/2634164811 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56332202b1c0 0x5633224d85b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:17.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.469+0000 7f064a678740 4 client.26914 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:39:17.470 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.469+0000 7f064a678740 1 -- 172.21.15.69:0/2634164811 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5633223a4fd0 con 0x56332202b1c0 2024-05-14T15:39:17.471 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.470+0000 7f0640c00640 1 --2- 172.21.15.69:0/2634164811 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56332202b1c0 0x5633224d85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:17.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.471+0000 7f0640c00640 1 --2- 172.21.15.69:0/2634164811 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56332202b1c0 0x5633224d85b0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24f233f09e97be37 server_cookie=e04751ead38c6579 in_seq=0 out_seq=0 2024-05-14T15:39:17.473 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.472+0000 7f0622000640 10 client.26914 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.560+0000 7f0622000640 1 -- 172.21.15.69:0/2634164811 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5633223a4fd0 con 0x56332202b1c0 2024-05-14T15:39:17.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.560+0000 7f0622000640 10 client.26914 handle_command_reply: tid=0 2024-05-14T15:39:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.561+0000 7f064a678740 1 client.26914 shutdown 2024-05-14T15:39:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.561+0000 7f064a678740 1 -- 172.21.15.69:0/2634164811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220764d0 msgr2=0x563322457aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.561+0000 7f064a678740 1 --2- 172.21.15.69:0/2634164811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220764d0 0x563322457aa0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f06300ae140 tx=0x7f06300e2f00 comp rx=0 tx=0).stop 2024-05-14T15:39:17.562 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.562+0000 7f064a678740 1 -- 172.21.15.69:0/2634164811 shutdown_connections 2024-05-14T15:39:17.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.562+0000 7f064a678740 1 --2- 172.21.15.69:0/2634164811 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56332202b1c0 0x5633224d85b0 crc :-1 s=READY pgs=245 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.562+0000 7f064a678740 1 --2- 172.21.15.69:0/2634164811 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5633220971b0 0x563322451210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.562+0000 7f064a678740 1 --2- 172.21.15.69:0/2634164811 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5633220764d0 0x563322457aa0 secure :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f06300ae140 tx=0x7f06300e2f00 comp rx=0 tx=0).stop 2024-05-14T15:39:17.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.562+0000 7f064a678740 1 --2- 172.21.15.69:0/2634164811 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56332206e2f0 0x563322457560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.562+0000 7f0622000640 0 client.26914 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:17.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.562+0000 7f064a678740 1 -- 172.21.15.69:0/2634164811 >> 172.21.15.69:0/2634164811 conn(0x56332208b300 msgr2=0x5633224383d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:17.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.563+0000 7f064a678740 1 -- 172.21.15.69:0/2634164811 shutdown_connections 2024-05-14T15:39:17.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.563+0000 7f064a678740 1 -- 172.21.15.69:0/2634164811 wait complete. 2024-05-14T15:39:17.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.563+0000 7f064a678740 20 client.26914 trim_cache size 0 max 16384 2024-05-14T15:39:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:39:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:39:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:39:17.566 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:39:17.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.566+0000 7f0643600640 1 -- 172.21.15.69:0/2086576329 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f06240b2aa0 msgr2=0x7f06240b4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.566+0000 7f0643600640 1 --2- 172.21.15.69:0/2086576329 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f06240b2aa0 0x7f06240b4fb0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x563322439820 tx=0x7f062800a2d0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.566+0000 7f0643600640 1 -- 172.21.15.69:0/2086576329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f063c10b620 msgr2=0x7f063c19cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.566+0000 7f0643600640 1 --2- 172.21.15.69:0/2086576329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f063c10b620 0x7f063c19cc70 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f063000e9f0 tx=0x7f063000edf0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.566+0000 7f0643600640 1 -- 172.21.15.69:0/2086576329 shutdown_connections 2024-05-14T15:39:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.566+0000 7f0643600640 1 --2- 172.21.15.69:0/2086576329 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f06240b2aa0 0x7f06240b4fb0 secure :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0x563322439820 tx=0x7f062800a2d0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.566+0000 7f0643600640 1 --2- 172.21.15.69:0/2086576329 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f063c10e010 0x7f063c1a0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.566+0000 7f0643600640 1 --2- 172.21.15.69:0/2086576329 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f063c10b620 0x7f063c19cc70 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.566+0000 7f0643600640 1 --2- 172.21.15.69:0/2086576329 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f063c104bc0 0x7f063c19c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:17.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.566+0000 7f0643600640 1 -- 172.21.15.69:0/2086576329 >> 172.21.15.69:0/2086576329 conn(0x7f063c0fe220 msgr2=0x7f063c109ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.567+0000 7f0643600640 1 -- 172.21.15.69:0/2086576329 shutdown_connections 2024-05-14T15:39:17.569 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:17.567+0000 7f0643600640 1 -- 172.21.15.69:0/2086576329 wait complete. 2024-05-14T15:39:18.245 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:17 smithi092 ceph-mon[34729]: pgmap v557: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 7.5 MiB/s wr, 563 op/s 2024-05-14T15:39:18.245 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:17 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:18.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:17 smithi203 ceph-mon[34567]: pgmap v557: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 7.5 MiB/s wr, 563 op/s 2024-05-14T15:39:18.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:17 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:18.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:17 smithi069 ceph-mon[31270]: pgmap v557: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 119 KiB/s rd, 7.5 MiB/s wr, 563 op/s 2024-05-14T15:39:18.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:17 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:19.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:19 smithi203 ceph-mon[34567]: pgmap v558: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 6.9 MiB/s wr, 514 op/s 2024-05-14T15:39:19.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:19 smithi092 ceph-mon[34729]: pgmap v558: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 6.9 MiB/s wr, 514 op/s 2024-05-14T15:39:19.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:19 smithi069 ceph-mon[31270]: pgmap v558: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 109 KiB/s rd, 6.9 MiB/s wr, 514 op/s 2024-05-14T15:39:20.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:20 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:20.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:20 smithi203 ceph-mon[34567]: osdmap e118: 12 total, 12 up, 12 in 2024-05-14T15:39:20.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:20 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:20.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:20 smithi092 ceph-mon[34729]: osdmap e118: 12 total, 12 up, 12 in 2024-05-14T15:39:20.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:20 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:20.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:20 smithi069 ceph-mon[31270]: osdmap e118: 12 total, 12 up, 12 in 2024-05-14T15:39:21.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:21 smithi203 ceph-mon[34567]: pgmap v560: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 6.1 MiB/s wr, 473 op/s 2024-05-14T15:39:21.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 815.0 s, 259.6 tps, lat 380.168 ms stddev 823.545 2024-05-14T15:39:21.444 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:21 smithi092 ceph-mon[34729]: pgmap v560: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 6.1 MiB/s wr, 473 op/s 2024-05-14T15:39:21.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:21 smithi069 ceph-mon[31270]: pgmap v560: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 144 KiB/s rd, 6.1 MiB/s wr, 473 op/s 2024-05-14T15:39:23.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:23 smithi203 ceph-mon[34567]: pgmap v561: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 6.3 MiB/s wr, 500 op/s 2024-05-14T15:39:23.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:23 smithi092 ceph-mon[34729]: pgmap v561: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 6.3 MiB/s wr, 500 op/s 2024-05-14T15:39:23.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:23 smithi069 ceph-mon[31270]: pgmap v561: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 6.3 MiB/s wr, 500 op/s 2024-05-14T15:39:25.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:25 smithi203 ceph-mon[34567]: pgmap v562: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 4.1 MiB/s wr, 359 op/s 2024-05-14T15:39:25.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:25 smithi092 ceph-mon[34729]: pgmap v562: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 4.1 MiB/s wr, 359 op/s 2024-05-14T15:39:25.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:25 smithi069 ceph-mon[31270]: pgmap v562: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 100 KiB/s rd, 4.1 MiB/s wr, 359 op/s 2024-05-14T15:39:26.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 820.0 s, 608.2 tps, lat 166.969 ms stddev 119.437 2024-05-14T15:39:27.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:27 smithi203 ceph-mon[34567]: pgmap v563: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 442 op/s 2024-05-14T15:39:27.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:27 smithi092 ceph-mon[34729]: pgmap v563: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 442 op/s 2024-05-14T15:39:27.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:27 smithi069 ceph-mon[31270]: pgmap v563: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 442 op/s 2024-05-14T15:39:29.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:29 smithi203 ceph-mon[34567]: pgmap v564: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 442 op/s 2024-05-14T15:39:29.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:29 smithi092 ceph-mon[34729]: pgmap v564: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 442 op/s 2024-05-14T15:39:29.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:29 smithi069 ceph-mon[31270]: pgmap v564: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 89 KiB/s rd, 5.1 MiB/s wr, 442 op/s 2024-05-14T15:39:30.978 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.977+0000 7f28f2a00640 1 -- 172.21.15.69:0/4125519046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28ec113db0 msgr2=0x7f28ec1161d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.977+0000 7f28f2a00640 1 --2- 172.21.15.69:0/4125519046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28ec113db0 0x7f28ec1161d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009900 tx=0x7f28d802a410 comp rx=0 tx=0).stop 2024-05-14T15:39:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.977+0000 7f28f2a00640 1 -- 172.21.15.69:0/4125519046 shutdown_connections 2024-05-14T15:39:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.977+0000 7f28f2a00640 1 --2- 172.21.15.69:0/4125519046 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28ec1167f0 0x7f28ec118ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.977+0000 7f28f2a00640 1 --2- 172.21.15.69:0/4125519046 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28ec113db0 0x7f28ec1161d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.977+0000 7f28f2a00640 1 --2- 172.21.15.69:0/4125519046 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28ec10a390 0x7f28ec10a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.977+0000 7f28f2a00640 1 -- 172.21.15.69:0/4125519046 >> 172.21.15.69:0/4125519046 conn(0x7f28ec06e710 msgr2=0x7f28ec06eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.978+0000 7f28f2a00640 1 -- 172.21.15.69:0/4125519046 shutdown_connections 2024-05-14T15:39:30.979 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.978+0000 7f28f2a00640 1 -- 172.21.15.69:0/4125519046 wait complete. 2024-05-14T15:39:30.980 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.980+0000 7f28f2a00640 1 Processor -- start 2024-05-14T15:39:30.981 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.981+0000 7f28f2a00640 1 -- start start 2024-05-14T15:39:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.981+0000 7f28f2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28ec10a390 0x7f28ec1aa270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.981+0000 7f28f2a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28ec113db0 0x7f28ec1aa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.981+0000 7f28f2a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28ec1167f0 0x7f28ec1b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.981+0000 7f28f2a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec11c3b0 con 0x7f28ec10a390 2024-05-14T15:39:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.981+0000 7f28f2a00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec11c230 con 0x7f28ec1167f0 2024-05-14T15:39:30.982 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.981+0000 7f28f2a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec11c530 con 0x7f28ec113db0 2024-05-14T15:39:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.982+0000 7f28f2000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28ec1167f0 0x7f28ec1b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.982+0000 7f28f2000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28ec1167f0 0x7f28ec1b5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:56278/0 (socket says 172.21.15.69:56278) 2024-05-14T15:39:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.982+0000 7f28f2000640 1 -- 172.21.15.69:0/4192220557 learned_addr learned my addr 172.21.15.69:0/4192220557 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:30.983 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.982+0000 7f28f0c00640 1 --2- 172.21.15.69:0/4192220557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28ec113db0 0x7f28ec1aa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.983+0000 7f28f2000640 1 -- 172.21.15.69:0/4192220557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28ec113db0 msgr2=0x7f28ec1aa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.983+0000 7f28f2000640 1 --2- 172.21.15.69:0/4192220557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28ec113db0 0x7f28ec1aa7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.983+0000 7f28f2000640 1 -- 172.21.15.69:0/4192220557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28ec10a390 msgr2=0x7f28ec1aa270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.983+0000 7f28f2000640 1 --2- 172.21.15.69:0/4192220557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28ec10a390 0x7f28ec1aa270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.983+0000 7f28f2000640 1 -- 172.21.15.69:0/4192220557 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ec1b5650 con 0x7f28ec1167f0 2024-05-14T15:39:30.984 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.983+0000 7f28f2000640 1 --2- 172.21.15.69:0/4192220557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28ec1167f0 0x7f28ec1b5110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f28e400efd0 tx=0x7f28e400c6a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:30.985 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.984+0000 7f28ea000640 1 -- 172.21.15.69:0/4192220557 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e4003b70 con 0x7f28ec1167f0 2024-05-14T15:39:30.986 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.984+0000 7f28ea000640 1 -- 172.21.15.69:0/4192220557 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28e4003d10 con 0x7f28ec1167f0 2024-05-14T15:39:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.984+0000 7f28ea000640 1 -- 172.21.15.69:0/4192220557 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e40108f0 con 0x7f28ec1167f0 2024-05-14T15:39:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.984+0000 7f28f2a00640 1 -- 172.21.15.69:0/4192220557 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ec1b58e0 con 0x7f28ec1167f0 2024-05-14T15:39:30.987 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.984+0000 7f28f2a00640 1 -- 172.21.15.69:0/4192220557 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ec1b5db0 con 0x7f28ec1167f0 2024-05-14T15:39:30.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.992+0000 7f28fb076740 1 Processor -- start 2024-05-14T15:39:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.994+0000 7f28ea000640 1 -- 172.21.15.69:0/4192220557 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f28e40045d0 con 0x7f28ec1167f0 2024-05-14T15:39:30.997 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.996+0000 7f28fb076740 1 -- start start 2024-05-14T15:39:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.997+0000 7f28fb076740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba66d1b0 0x557ebaa0e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.997+0000 7f28fb076740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa0e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.997+0000 7f28fb076740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba64c4d0 0x557ebaa0ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.997+0000 7f28fb076740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x557eba973550 con 0x557eba64c4d0 2024-05-14T15:39:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.997+0000 7f28fb076740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557eba918bc0 con 0x557eba66d1b0 2024-05-14T15:39:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.997+0000 7f28fb076740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557eba96f510 con 0x557eba6442f0 2024-05-14T15:39:30.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.998+0000 7f28f1600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa0e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.999+0000 7f28f1600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa0e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:43172/0 (socket says 172.21.15.69:43172) 2024-05-14T15:39:31.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:30.999+0000 7f28f1600640 1 -- 172.21.15.69:0/281828878 learned_addr learned my addr 172.21.15.69:0/281828878 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.000+0000 7f28f0c00640 1 --2- 172.21.15.69:0/281828878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba64c4d0 0x557ebaa0ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.000+0000 7f28f0c00640 1 --2- 172.21.15.69:0/281828878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba66d1b0 0x557ebaa0e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.001+0000 7f28f1600640 1 -- 172.21.15.69:0/281828878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba66d1b0 msgr2=0x557ebaa0e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.001+0000 7f28f1600640 1 --2- 172.21.15.69:0/281828878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba66d1b0 0x557ebaa0e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.001+0000 7f28f1600640 1 -- 172.21.15.69:0/281828878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba64c4d0 msgr2=0x557ebaa0ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.001+0000 7f28f1600640 1 --2- 172.21.15.69:0/281828878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba64c4d0 0x557ebaa0ef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.001+0000 7f28f1600640 1 -- 172.21.15.69:0/281828878 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557eba685210 con 0x557eba6442f0 2024-05-14T15:39:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.002+0000 7f28f0c00640 1 --2- 172.21.15.69:0/281828878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba66d1b0 0x557ebaa0e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:39:31.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.002+0000 7f28ea000640 1 --2- 172.21.15.69:0/4192220557 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f28d40b29d0 0x7f28d40b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:31.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.003+0000 7f28ea000640 1 -- 172.21.15.69:0/4192220557 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9510+0+0 (secure 0 0 0) 0x7f28e40e2f90 con 0x7f28ec1167f0 2024-05-14T15:39:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.003+0000 7f28f1600640 1 --2- 172.21.15.69:0/281828878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa0e9f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f28e00097b0 tx=0x7f28e0009c70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7dd516f06a577c56 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.004+0000 7f28f0c00640 1 --2- 172.21.15.69:0/4192220557 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f28d40b29d0 0x7f28d40b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.004+0000 7f28de600640 1 -- 172.21.15.69:0/281828878 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e0015020 con 0x557eba6442f0 2024-05-14T15:39:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.004+0000 7f28de600640 1 -- 172.21.15.69:0/281828878 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28e0011420 con 0x557eba6442f0 2024-05-14T15:39:31.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.004+0000 7f28de600640 1 -- 172.21.15.69:0/281828878 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e00105e0 con 0x557eba6442f0 2024-05-14T15:39:31.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.006+0000 7f28f0c00640 1 --2- 172.21.15.69:0/4192220557 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f28d40b29d0 0x7f28d40b4ee0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f28d802a930 tx=0x7f28d8005a20 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.008+0000 7f28fb076740 1 -- 172.21.15.69:0/281828878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 msgr2=0x557ebaa0e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:31.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.008+0000 7f28fb076740 1 --2- 172.21.15.69:0/281828878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa0e9f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f28e00097b0 tx=0x7f28e0009c70 comp rx=0 tx=0).stop 2024-05-14T15:39:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.009+0000 7f28fb076740 1 -- 172.21.15.69:0/281828878 shutdown_connections 2024-05-14T15:39:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.009+0000 7f28fb076740 1 --2- 172.21.15.69:0/281828878 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba64c4d0 0x557ebaa0ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.009+0000 7f28fb076740 1 --2- 172.21.15.69:0/281828878 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa0e9f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.009+0000 7f28fb076740 1 --2- 172.21.15.69:0/281828878 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba66d1b0 0x557ebaa0e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.009+0000 7f28fb076740 1 -- 172.21.15.69:0/281828878 >> 172.21.15.69:0/281828878 conn(0x557eba661300 msgr2=0x557ebaa0ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.010+0000 7f28fb076740 1 -- 172.21.15.69:0/281828878 shutdown_connections 2024-05-14T15:39:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.010+0000 7f28fb076740 1 -- 172.21.15.69:0/281828878 wait complete. 2024-05-14T15:39:31.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.011+0000 7f28fb076740 1 -- start start 2024-05-14T15:39:31.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.011+0000 7f28fb076740 1 Processor -- start 2024-05-14T15:39:31.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.014+0000 7f28fb076740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa18a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:31.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.014+0000 7f28fb076740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba64c4d0 0x557ebaa18f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:31.015 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.014+0000 7f28fb076740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba66d1b0 0x557ebaa24a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:31.015 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.015+0000 7f28f0c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba64c4d0 0x557ebaa18f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.015+0000 7f28f0c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba64c4d0 0x557ebaa18f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58134/0 (socket says 172.21.15.69:58134) 2024-05-14T15:39:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.015+0000 7f28f0c00640 1 -- 172.21.15.69:0/734837820 learned_addr learned my addr 172.21.15.69:0/734837820 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.015+0000 7f28fb076740 1 -- 172.21.15.69:0/734837820 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x557ebaa1b5e0 con 0x557eba64c4d0 2024-05-14T15:39:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.015+0000 7f28fb076740 1 -- 172.21.15.69:0/734837820 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x557eba92c660 con 0x557eba66d1b0 2024-05-14T15:39:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.015+0000 7f28fb076740 1 -- 172.21.15.69:0/734837820 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x557ebaa1b760 con 0x557eba6442f0 2024-05-14T15:39:31.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.015+0000 7f28f1600640 1 --2- 172.21.15.69:0/734837820 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa18a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.015+0000 7f28f2000640 1 --2- 172.21.15.69:0/734837820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba66d1b0 0x557ebaa24a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.015+0000 7f28fb076740 10 client.0 _ll_register_callbacks cb 0x557eba8f6400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:39:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.016+0000 7f28f2000640 1 -- 172.21.15.69:0/734837820 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 msgr2=0x557ebaa18a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.016+0000 7f28f2000640 1 --2- 172.21.15.69:0/734837820 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa18a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.016+0000 7f28f2000640 1 -- 172.21.15.69:0/734837820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba64c4d0 msgr2=0x557ebaa18f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.016+0000 7f28f2000640 1 --2- 172.21.15.69:0/734837820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba64c4d0 0x557ebaa18f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.016+0000 7f28f2000640 1 -- 172.21.15.69:0/734837820 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557eba751620 con 0x557eba66d1b0 2024-05-14T15:39:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.016+0000 7f28f1600640 1 --2- 172.21.15.69:0/734837820 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa18a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:39:31.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.016+0000 7f28f0c00640 1 --2- 172.21.15.69:0/734837820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba64c4d0 0x557ebaa18f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:39:31.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.017+0000 7f28f2000640 1 --2- 172.21.15.69:0/734837820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba66d1b0 0x557ebaa24a90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f28e40e0300 tx=0x7f28e40aa590 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c741563a081c057 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:31.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.017+0000 7f28d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:39:31.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.017+0000 7f28d2a00640 1 -- 172.21.15.69:0/734837820 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e40b2cf0 con 0x557eba66d1b0 2024-05-14T15:39:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.017+0000 7f28d2a00640 1 -- 172.21.15.69:0/734837820 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9510+0+0 (secure 0 0 0) 0x7f28e4004b40 con 0x557eba66d1b0 2024-05-14T15:39:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.018+0000 7f28fb076740 1 -- 172.21.15.69:0/734837820 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28e0011420 con 0x557eba66d1b0 2024-05-14T15:39:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.018+0000 7f28d2a00640 1 -- 172.21.15.69:0/734837820 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f28e4004d40 con 0x557eba66d1b0 2024-05-14T15:39:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.018+0000 7f28fb076740 10 client.36965 fetch_fsmap learned FSMap version 78 2024-05-14T15:39:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.018+0000 7f28fb076740 1 -- 172.21.15.69:0/734837820 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) -- 0x557ebaa27860 con 0x557eba66d1b0 2024-05-14T15:39:31.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.019+0000 7f28d2a00640 1 -- 172.21.15.69:0/734837820 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28e0011420 con 0x557eba66d1b0 2024-05-14T15:39:31.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.020+0000 7f28d2a00640 1 -- 172.21.15.69:0/734837820 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 78) ==== 8398+0+0 (secure 0 0 0) 0x7f28e401f020 con 0x557eba66d1b0 2024-05-14T15:39:31.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.020+0000 7f28fb076740 10 client.36965 fetch_fsmap finished waiting for FSMap version 78 2024-05-14T15:39:31.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.020+0000 7f28fb076740 10 client.36965 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:39:31.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.020+0000 7f28fb076740 20 client.36965 populate_metadata read hostname 'smithi069' 2024-05-14T15:39:31.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.020+0000 7f28fb076740 1 --2- 172.21.15.69:0/734837820 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557eba62bd80 0x557ebaa2ae10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:31.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.020+0000 7f28fb076740 4 client.36965 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:39:31.021 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.020+0000 7f28fb076740 1 -- 172.21.15.69:0/734837820 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557eba981160 con 0x557eba62bd80 2024-05-14T15:39:31.022 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.021+0000 7f28f1600640 1 --2- 172.21.15.69:0/734837820 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557eba62bd80 0x557ebaa2ae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:31.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.023+0000 7f28f1600640 1 --2- 172.21.15.69:0/734837820 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557eba62bd80 0x557ebaa2ae10 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fd4435e61d505e0e server_cookie=c38906b2240c5e83 in_seq=0 out_seq=0 2024-05-14T15:39:31.025 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.024+0000 7f28d2a00640 10 client.36965 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:31.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.028+0000 7f28d2a00640 1 -- 172.21.15.69:0/734837820 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x557eba981160 con 0x557eba62bd80 2024-05-14T15:39:31.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.028+0000 7f28d2a00640 10 client.36965 handle_command_reply: tid=0 2024-05-14T15:39:31.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.028+0000 7f28fb076740 1 client.36965 shutdown 2024-05-14T15:39:31.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.029+0000 7f28fb076740 1 -- 172.21.15.69:0/734837820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba66d1b0 msgr2=0x557ebaa24a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:31.029 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.029+0000 7f28fb076740 1 --2- 172.21.15.69:0/734837820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba66d1b0 0x557ebaa24a90 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f28e40e0300 tx=0x7f28e40aa590 comp rx=0 tx=0).stop 2024-05-14T15:39:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.029+0000 7f28fb076740 1 -- 172.21.15.69:0/734837820 shutdown_connections 2024-05-14T15:39:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.029+0000 7f28fb076740 1 --2- 172.21.15.69:0/734837820 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba66d1b0 0x557ebaa24a90 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.029+0000 7f28fb076740 1 --2- 172.21.15.69:0/734837820 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557eba62bd80 0x557ebaa2ae10 crc :-1 s=READY pgs=246 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.029+0000 7f28fb076740 1 --2- 172.21.15.69:0/734837820 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba64c4d0 0x557ebaa18f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.029+0000 7f28fb076740 1 --2- 172.21.15.69:0/734837820 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa18a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.029+0000 7f28fb076740 1 -- 172.21.15.69:0/734837820 >> 172.21.15.69:0/734837820 conn(0x557eba661300 msgr2=0x557ebaa0e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:31.030 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.029+0000 7f28d2a00640 0 client.36965 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.029+0000 7f28fb076740 1 -- 172.21.15.69:0/734837820 shutdown_connections 2024-05-14T15:39:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.030+0000 7f28fb076740 1 -- 172.21.15.69:0/734837820 wait complete. 2024-05-14T15:39:31.031 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.030+0000 7f28fb076740 20 client.36965 trim_cache size 0 max 16384 2024-05-14T15:39:31.072 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.071+0000 7f28fb076740 1 Processor -- start 2024-05-14T15:39:31.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.071+0000 7f28fb076740 1 -- start start 2024-05-14T15:39:31.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.072+0000 7f28fb076740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba6442f0 0x557ebaa0abf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:31.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.072+0000 7f28fb076740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba64c4d0 0x557ebaa305d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:31.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.072+0000 7f28fb076740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba66d1b0 0x557ebaa30b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:31.073 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.072+0000 7f28fb076740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec1bffc0 con 0x557eba6442f0 2024-05-14T15:39:31.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.072+0000 7f28fb076740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec1c1c80 con 0x557eba64c4d0 2024-05-14T15:39:31.074 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.072+0000 7f28fb076740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec1c0690 con 0x557eba66d1b0 2024-05-14T15:39:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.073+0000 7f28f1600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba6442f0 0x557ebaa0abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.074+0000 7f28f1600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba6442f0 0x557ebaa0abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58146/0 (socket says 172.21.15.69:58146) 2024-05-14T15:39:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.074+0000 7f28f1600640 1 -- 172.21.15.69:0/4218021293 learned_addr learned my addr 172.21.15.69:0/4218021293 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.074+0000 7f28f0c00640 1 --2- 172.21.15.69:0/4218021293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba64c4d0 0x557ebaa305d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.074+0000 7f28f2000640 1 --2- 172.21.15.69:0/4218021293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba66d1b0 0x557ebaa30b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:31.075 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.075+0000 7f28f2000640 1 -- 172.21.15.69:0/4218021293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba64c4d0 msgr2=0x557ebaa305d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.075+0000 7f28f2000640 1 --2- 172.21.15.69:0/4218021293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba64c4d0 0x557ebaa305d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.075+0000 7f28f2000640 1 -- 172.21.15.69:0/4218021293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba6442f0 msgr2=0x557ebaa0abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:31.076 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.075+0000 7f28f2000640 1 --2- 172.21.15.69:0/4218021293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba6442f0 0x557ebaa0abf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.076+0000 7f28f2000640 1 -- 172.21.15.69:0/4218021293 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557ebaa192b0 con 0x557eba66d1b0 2024-05-14T15:39:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.076+0000 7f28f0c00640 1 --2- 172.21.15.69:0/4218021293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba64c4d0 0x557ebaa305d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:39:31.077 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.076+0000 7f28f1600640 1 --2- 172.21.15.69:0/4218021293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba6442f0 0x557ebaa0abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:39:31.078 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.078+0000 7f28f2000640 1 --2- 172.21.15.69:0/4218021293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba66d1b0 0x557ebaa30b10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f28e40e0900 tx=0x7f28e4009570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=518bebd32c207e3c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.078+0000 7f28ddc00640 1 -- 172.21.15.69:0/4218021293 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e40b2cf0 con 0x557eba66d1b0 2024-05-14T15:39:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.078+0000 7f28ddc00640 1 -- 172.21.15.69:0/4218021293 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28e4004b40 con 0x557eba66d1b0 2024-05-14T15:39:31.079 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.078+0000 7f28ddc00640 1 -- 172.21.15.69:0/4218021293 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e4010d40 con 0x557eba66d1b0 2024-05-14T15:39:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.079+0000 7f28fb076740 1 -- 172.21.15.69:0/4218021293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba66d1b0 msgr2=0x557ebaa30b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:31.080 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.079+0000 7f28fb076740 1 --2- 172.21.15.69:0/4218021293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba66d1b0 0x557ebaa30b10 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f28e40e0900 tx=0x7f28e4009570 comp rx=0 tx=0).stop 2024-05-14T15:39:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.080+0000 7f28fb076740 1 -- 172.21.15.69:0/4218021293 shutdown_connections 2024-05-14T15:39:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.080+0000 7f28fb076740 1 --2- 172.21.15.69:0/4218021293 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba66d1b0 0x557ebaa30b10 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.080+0000 7f28fb076740 1 --2- 172.21.15.69:0/4218021293 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba64c4d0 0x557ebaa305d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.080+0000 7f28fb076740 1 --2- 172.21.15.69:0/4218021293 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba6442f0 0x557ebaa0abf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.080+0000 7f28fb076740 1 -- 172.21.15.69:0/4218021293 >> 172.21.15.69:0/4218021293 conn(0x557eba661300 msgr2=0x557ebaa0a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:31.081 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.081+0000 7f28fb076740 1 -- 172.21.15.69:0/4218021293 shutdown_connections 2024-05-14T15:39:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.081+0000 7f28fb076740 1 -- 172.21.15.69:0/4218021293 wait complete. 2024-05-14T15:39:31.082 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.082+0000 7f28fb076740 1 -- start start 2024-05-14T15:39:31.083 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.082+0000 7f28fb076740 1 Processor -- start 2024-05-14T15:39:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.083+0000 7f28fb076740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa8e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:31.084 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.083+0000 7f28fb076740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba64c4d0 0x557ebaa8ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.083+0000 7f28fb076740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba66d1b0 0x557ebaa8b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.083+0000 7f28fb076740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec1c14f0 con 0x557eba66d1b0 2024-05-14T15:39:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.083+0000 7f28fb076740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec1c0e20 con 0x557eba64c4d0 2024-05-14T15:39:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.083+0000 7f28fb076740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f28ec1bdfc0 con 0x557eba6442f0 2024-05-14T15:39:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.083+0000 7f28fb076740 10 client.0 _ll_register_callbacks cb 0x7f28e40a5d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:39:31.085 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.084+0000 7f28f2000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba66d1b0 0x557ebaa8b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:31.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.084+0000 7f28f0c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba64c4d0 0x557ebaa8ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:31.086 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.084+0000 7f28f1600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa8e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:31.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.085+0000 7f28f0c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba64c4d0 0x557ebaa8ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:56306/0 (socket says 172.21.15.69:56306) 2024-05-14T15:39:31.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.085+0000 7f28f1600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa8e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:43204/0 (socket says 172.21.15.69:43204) 2024-05-14T15:39:31.087 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.087+0000 7f28f1600640 1 -- 172.21.15.69:0/119210652 learned_addr learned my addr 172.21.15.69:0/119210652 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:31.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.087+0000 7f28f1600640 1 -- 172.21.15.69:0/119210652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba64c4d0 msgr2=0x557ebaa8ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:31.088 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.087+0000 7f28f1600640 1 --2- 172.21.15.69:0/119210652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba64c4d0 0x557ebaa8ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.087+0000 7f28f1600640 1 -- 172.21.15.69:0/119210652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba66d1b0 msgr2=0x557ebaa8b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:31.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.085+0000 7f28f2000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba66d1b0 0x557ebaa8b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:58152/0 (socket says 172.21.15.69:58152) 2024-05-14T15:39:31.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.088+0000 7f28f1600640 1 --2- 172.21.15.69:0/119210652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba66d1b0 0x557ebaa8b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.088+0000 7f28f1600640 1 -- 172.21.15.69:0/119210652 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557ebaa8b920 con 0x557eba6442f0 2024-05-14T15:39:31.089 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.088+0000 7f28f2000640 1 --2- 172.21.15.69:0/119210652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba66d1b0 0x557ebaa8b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:39:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.089+0000 7f28f1600640 1 --2- 172.21.15.69:0/119210652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa8e690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f28e0000c00 tx=0x7f28e0004770 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b1cf71fc8d4dec11 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:31.090 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.089+0000 7f28d2a00640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:39:31.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.090+0000 7f28d2a00640 1 -- 172.21.15.69:0/119210652 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e002b030 con 0x557eba6442f0 2024-05-14T15:39:31.091 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.090+0000 7f28d2a00640 1 -- 172.21.15.69:0/119210652 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9510+0+0 (secure 0 0 0) 0x7f28e000bae0 con 0x557eba6442f0 2024-05-14T15:39:31.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.091+0000 7f28fb076740 1 -- 172.21.15.69:0/119210652 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28e4004b40 con 0x557eba6442f0 2024-05-14T15:39:31.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.092+0000 7f28d2a00640 1 -- 172.21.15.69:0/119210652 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=78) ==== 24+0+0 (secure 0 0 0) 0x7f28e0015040 con 0x557eba6442f0 2024-05-14T15:39:31.092 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.092+0000 7f28fb076740 10 client.26929 fetch_fsmap learned FSMap version 78 2024-05-14T15:39:31.093 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.092+0000 7f28fb076740 1 -- 172.21.15.69:0/119210652 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=78,monmap=4+}) -- 0x557ebaa20430 con 0x557eba6442f0 2024-05-14T15:39:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.093+0000 7f28d2a00640 1 -- 172.21.15.69:0/119210652 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f28e4004b40 con 0x557eba6442f0 2024-05-14T15:39:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.093+0000 7f28d2a00640 1 -- 172.21.15.69:0/119210652 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 78) ==== 8398+0+0 (secure 0 0 0) 0x7f28e0023070 con 0x557eba6442f0 2024-05-14T15:39:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.093+0000 7f28fb076740 10 client.26929 fetch_fsmap finished waiting for FSMap version 78 2024-05-14T15:39:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.093+0000 7f28fb076740 10 client.26929 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:39:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.093+0000 7f28fb076740 20 client.26929 populate_metadata read hostname 'smithi069' 2024-05-14T15:39:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.093+0000 7f28fb076740 1 --2- 172.21.15.69:0/119210652 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557eba6011c0 0x557ebaa20ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.093+0000 7f28fb076740 4 client.26929 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:39:31.094 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.093+0000 7f28fb076740 1 -- 172.21.15.69:0/119210652 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557eba97afd0 con 0x557eba6011c0 2024-05-14T15:39:31.095 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.094+0000 7f28f0c00640 1 --2- 172.21.15.69:0/119210652 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557eba6011c0 0x557ebaa20ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:31.098 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.097+0000 7f28d2a00640 10 client.26929 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:31.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.097+0000 7f28f0c00640 1 --2- 172.21.15.69:0/119210652 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557eba6011c0 0x557ebaa20ad0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b58c4a26c4822bb0 server_cookie=103a001bded2ae64 in_seq=0 out_seq=0 2024-05-14T15:39:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.132+0000 7f28d2a00640 1 -- 172.21.15.69:0/119210652 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557eba97afd0 con 0x557eba6011c0 2024-05-14T15:39:31.133 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.132+0000 7f28d2a00640 10 client.26929 handle_command_reply: tid=0 2024-05-14T15:39:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.133+0000 7f28fb076740 1 client.26929 shutdown 2024-05-14T15:39:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.133+0000 7f28fb076740 1 -- 172.21.15.69:0/119210652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 msgr2=0x557ebaa8e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.133+0000 7f28fb076740 1 --2- 172.21.15.69:0/119210652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa8e690 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f28e0000c00 tx=0x7f28e0004770 comp rx=0 tx=0).stop 2024-05-14T15:39:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.133+0000 7f28fb076740 1 -- 172.21.15.69:0/119210652 shutdown_connections 2024-05-14T15:39:31.134 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.133+0000 7f28fb076740 1 --2- 172.21.15.69:0/119210652 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x557eba6011c0 0x557ebaa20ad0 crc :-1 s=READY pgs=247 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.133+0000 7f28fb076740 1 --2- 172.21.15.69:0/119210652 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x557eba66d1b0 0x557ebaa8b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.133+0000 7f28fb076740 1 --2- 172.21.15.69:0/119210652 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x557eba64c4d0 0x557ebaa8ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.133+0000 7f28fb076740 1 --2- 172.21.15.69:0/119210652 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x557eba6442f0 0x557ebaa8e690 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.133+0000 7f28fb076740 1 -- 172.21.15.69:0/119210652 >> 172.21.15.69:0/119210652 conn(0x557eba661300 msgr2=0x557ebaa19e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.133+0000 7f28d2a00640 0 client.26929 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.134+0000 7f28fb076740 1 -- 172.21.15.69:0/119210652 shutdown_connections 2024-05-14T15:39:31.135 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.134+0000 7f28fb076740 1 -- 172.21.15.69:0/119210652 wait complete. 2024-05-14T15:39:31.136 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.136+0000 7f28fb076740 20 client.26929 trim_cache size 0 max 16384 2024-05-14T15:39:31.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:39:31.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:39:31.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:39:31.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:39:31.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.137+0000 7f28f2a00640 1 -- 172.21.15.69:0/4192220557 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f28d40b29d0 msgr2=0x7f28d40b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:31.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.137+0000 7f28f2a00640 1 --2- 172.21.15.69:0/4192220557 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f28d40b29d0 0x7f28d40b4ee0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f28d802a930 tx=0x7f28d8005a20 comp rx=0 tx=0).stop 2024-05-14T15:39:31.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.137+0000 7f28f2a00640 1 -- 172.21.15.69:0/4192220557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28ec1167f0 msgr2=0x7f28ec1b5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:31.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.137+0000 7f28f2a00640 1 --2- 172.21.15.69:0/4192220557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28ec1167f0 0x7f28ec1b5110 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f28e400efd0 tx=0x7f28e400c6a0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.137+0000 7f28f2a00640 1 -- 172.21.15.69:0/4192220557 shutdown_connections 2024-05-14T15:39:31.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.137+0000 7f28f2a00640 1 --2- 172.21.15.69:0/4192220557 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f28d40b29d0 0x7f28d40b4ee0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.137+0000 7f28f2a00640 1 --2- 172.21.15.69:0/4192220557 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f28ec1167f0 0x7f28ec1b5110 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.137+0000 7f28f2a00640 1 --2- 172.21.15.69:0/4192220557 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f28ec113db0 0x7f28ec1aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.137+0000 7f28f2a00640 1 --2- 172.21.15.69:0/4192220557 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f28ec10a390 0x7f28ec1aa270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:31.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.137+0000 7f28f2a00640 1 -- 172.21.15.69:0/4192220557 >> 172.21.15.69:0/4192220557 conn(0x7f28ec06e710 msgr2=0x7f28ec10c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:31.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.138+0000 7f28f2a00640 1 -- 172.21.15.69:0/4192220557 shutdown_connections 2024-05-14T15:39:31.139 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:31.138+0000 7f28f2a00640 1 -- 172.21.15.69:0/4192220557 wait complete. 2024-05-14T15:39:31.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 825.0 s, 632.8 tps, lat 156.864 ms stddev 65.968 2024-05-14T15:39:31.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:31 smithi203 ceph-mon[34567]: pgmap v565: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.9 MiB/s wr, 578 op/s 2024-05-14T15:39:31.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:31 smithi092 ceph-mon[34729]: pgmap v565: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.9 MiB/s wr, 578 op/s 2024-05-14T15:39:31.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:31 smithi069 ceph-mon[31270]: pgmap v565: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 59 KiB/s rd, 6.9 MiB/s wr, 578 op/s 2024-05-14T15:39:32.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:32 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:32.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:32 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:32.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:32 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:33.847 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:33 smithi203 ceph-mon[34567]: pgmap v566: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.1 MiB/s wr, 502 op/s 2024-05-14T15:39:33.876 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:33 smithi069 ceph-mon[31270]: pgmap v566: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.1 MiB/s wr, 502 op/s 2024-05-14T15:39:33.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:33 smithi092 ceph-mon[34729]: pgmap v566: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 6.1 MiB/s wr, 502 op/s 2024-05-14T15:39:35.846 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:35 smithi203 ceph-mon[34567]: pgmap v567: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.8 MiB/s wr, 483 op/s 2024-05-14T15:39:35.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:35 smithi092 ceph-mon[34729]: pgmap v567: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.8 MiB/s wr, 483 op/s 2024-05-14T15:39:35.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:35 smithi069 ceph-mon[31270]: pgmap v567: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.8 MiB/s wr, 483 op/s 2024-05-14T15:39:36.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 830.0 s, 588.2 tps, lat 171.504 ms stddev 75.722 2024-05-14T15:39:37.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:37 smithi203 ceph-mon[34567]: pgmap v568: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.6 MiB/s wr, 720 op/s 2024-05-14T15:39:37.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:37 smithi092 ceph-mon[34729]: pgmap v568: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.6 MiB/s wr, 720 op/s 2024-05-14T15:39:37.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:37 smithi069 ceph-mon[31270]: pgmap v568: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 8.6 MiB/s wr, 720 op/s 2024-05-14T15:39:39.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:39 smithi203 ceph-mon[34567]: pgmap v569: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.2 MiB/s wr, 526 op/s 2024-05-14T15:39:39.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:39 smithi092 ceph-mon[34729]: pgmap v569: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.2 MiB/s wr, 526 op/s 2024-05-14T15:39:39.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:39 smithi069 ceph-mon[31270]: pgmap v569: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 49 KiB/s rd, 6.2 MiB/s wr, 526 op/s 2024-05-14T15:39:41.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 835.0 s, 557.4 tps, lat 176.666 ms stddev 98.395 2024-05-14T15:39:41.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:41 smithi203 ceph-mon[34567]: pgmap v570: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 8.0 MiB/s wr, 701 op/s 2024-05-14T15:39:41.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:41 smithi092 ceph-mon[34729]: pgmap v570: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 8.0 MiB/s wr, 701 op/s 2024-05-14T15:39:41.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:41 smithi069 ceph-mon[31270]: pgmap v570: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 58 KiB/s rd, 8.0 MiB/s wr, 701 op/s 2024-05-14T15:39:43.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:43 smithi092 ceph-mon[34729]: pgmap v571: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 5.8 MiB/s wr, 538 op/s 2024-05-14T15:39:43.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:43 smithi069 ceph-mon[31270]: pgmap v571: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 5.8 MiB/s wr, 538 op/s 2024-05-14T15:39:44.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:43 smithi203 ceph-mon[34567]: pgmap v571: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 68 KiB/s rd, 5.8 MiB/s wr, 538 op/s 2024-05-14T15:39:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.529+0000 7f29d6c00640 1 -- 172.21.15.69:0/1488508438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d01103f0 msgr2=0x7f29d0109cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:44.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.529+0000 7f29d6c00640 1 --2- 172.21.15.69:0/1488508438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d01103f0 0x7f29d0109cd0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f29bc009900 tx=0x7f29bc02a400 comp rx=0 tx=0).stop 2024-05-14T15:39:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.530+0000 7f29d6c00640 1 -- 172.21.15.69:0/1488508438 shutdown_connections 2024-05-14T15:39:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.530+0000 7f29d6c00640 1 --2- 172.21.15.69:0/1488508438 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29d010a210 0x7f29d010a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.530+0000 7f29d6c00640 1 --2- 172.21.15.69:0/1488508438 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d01103f0 0x7f29d0109cd0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.530+0000 7f29d6c00640 1 --2- 172.21.15.69:0/1488508438 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29d010fa10 0x7f29d010fe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.530+0000 7f29d6c00640 1 -- 172.21.15.69:0/1488508438 >> 172.21.15.69:0/1488508438 conn(0x7f29d006f810 msgr2=0x7f29d006fc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:44.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.531+0000 7f29d6c00640 1 -- 172.21.15.69:0/1488508438 shutdown_connections 2024-05-14T15:39:44.533 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.532+0000 7f29d6c00640 1 -- 172.21.15.69:0/1488508438 wait complete. 2024-05-14T15:39:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.534+0000 7f29d6c00640 1 Processor -- start 2024-05-14T15:39:44.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.534+0000 7f29d6c00640 1 -- start start 2024-05-14T15:39:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.535+0000 7f29d6c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29d010a210 0x7f29d01a9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.535+0000 7f29d6c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d010fa10 0x7f29d01a98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.535+0000 7f29d6c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29d01103f0 0x7f29d01adb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.535+0000 7f29d6c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f29d0122930 con 0x7f29d010a210 2024-05-14T15:39:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.535+0000 7f29d6c00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29d01227b0 con 0x7f29d010fa10 2024-05-14T15:39:44.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.535+0000 7f29d6c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f29d0122ab0 con 0x7f29d01103f0 2024-05-14T15:39:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.536+0000 7f29d5800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29d010a210 0x7f29d01a9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.536+0000 7f29d5800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29d010a210 0x7f29d01a9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54436/0 (socket says 172.21.15.69:54436) 2024-05-14T15:39:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.536+0000 7f29d5800640 1 -- 172.21.15.69:0/277906547 learned_addr learned my addr 172.21.15.69:0/277906547 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:44.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.536+0000 7f29d6200640 1 --2- 172.21.15.69:0/277906547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29d01103f0 0x7f29d01adb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.537+0000 7f29d4e00640 1 --2- 172.21.15.69:0/277906547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d010fa10 0x7f29d01a98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.537+0000 7f29d6200640 1 -- 172.21.15.69:0/277906547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d010fa10 msgr2=0x7f29d01a98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.537+0000 7f29d6200640 1 --2- 172.21.15.69:0/277906547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d010fa10 0x7f29d01a98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.537+0000 7f29d6200640 1 -- 172.21.15.69:0/277906547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29d010a210 msgr2=0x7f29d01a9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.537+0000 7f29d6200640 1 --2- 172.21.15.69:0/277906547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29d010a210 0x7f29d01a9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.537+0000 7f29d6200640 1 -- 172.21.15.69:0/277906547 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29d01ae1d0 con 0x7f29d01103f0 2024-05-14T15:39:44.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.537+0000 7f29d5800640 1 --2- 172.21.15.69:0/277906547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29d010a210 0x7f29d01a9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:39:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.539+0000 7f29d6200640 1 --2- 172.21.15.69:0/277906547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29d01103f0 0x7f29d01adb90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009fd0 tx=0x7f29c800ef10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:44.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.540+0000 7f29ce000640 1 -- 172.21.15.69:0/277906547 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c800ce20 con 0x7f29d01103f0 2024-05-14T15:39:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.540+0000 7f29ce000640 1 -- 172.21.15.69:0/277906547 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29c8005020 con 0x7f29d01103f0 2024-05-14T15:39:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.540+0000 7f29ce000640 1 -- 172.21.15.69:0/277906547 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c8010690 con 0x7f29d01103f0 2024-05-14T15:39:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.540+0000 7f29d6c00640 1 -- 172.21.15.69:0/277906547 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29d01ae4c0 con 0x7f29d01103f0 2024-05-14T15:39:44.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.540+0000 7f29d6c00640 1 -- 172.21.15.69:0/277906547 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29d01ae990 con 0x7f29d01103f0 2024-05-14T15:39:44.553 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.552+0000 7f29df1b6740 1 Processor -- start 2024-05-14T15:39:44.555 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.554+0000 7f29ce000640 1 -- 172.21.15.69:0/277906547 <== mon.1 v2:172.21.15.203:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f29c8004a40 con 0x7f29d01103f0 2024-05-14T15:39:44.558 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.557+0000 7f29df1b6740 1 -- start start 2024-05-14T15:39:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.559+0000 7f29df1b6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedd61b0 0x561fbf177480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.559+0000 7f29df1b6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedad2f0 0x561fbf1779c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.559+0000 7f29df1b6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedb54d0 0x561fbf177f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.559+0000 7f29df1b6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x561fbf0dc550 con 0x561fbedd61b0 2024-05-14T15:39:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.559+0000 7f29df1b6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561fbf081bc0 con 0x561fbedad2f0 2024-05-14T15:39:44.560 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.559+0000 7f29df1b6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561fbf0d8510 con 0x561fbedb54d0 2024-05-14T15:39:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.560+0000 7f29d4e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedb54d0 0x561fbf177f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.560+0000 7f29d4e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedb54d0 0x561fbf177f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:57460/0 (socket says 172.21.15.69:57460) 2024-05-14T15:39:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.560+0000 7f29d4e00640 1 -- 172.21.15.69:0/2426702193 learned_addr learned my addr 172.21.15.69:0/2426702193 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.560+0000 7f29d4e00640 1 --2- 172.21.15.69:0/2426702193 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedd61b0 0x561fbf177480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.561 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.561+0000 7f29d5800640 1 --2- 172.21.15.69:0/2426702193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedad2f0 0x561fbf1779c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.561+0000 7f29d5800640 1 -- 172.21.15.69:0/2426702193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedb54d0 msgr2=0x561fbf177f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.562+0000 7f29d5800640 1 --2- 172.21.15.69:0/2426702193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedb54d0 0x561fbf177f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.562+0000 7f29d5800640 1 -- 172.21.15.69:0/2426702193 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedd61b0 msgr2=0x561fbf177480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.562+0000 7f29d5800640 1 --2- 172.21.15.69:0/2426702193 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedd61b0 0x561fbf177480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.562+0000 7f29d5800640 1 -- 172.21.15.69:0/2426702193 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fbedee210 con 0x561fbedad2f0 2024-05-14T15:39:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.562+0000 7f29d5800640 1 --2- 172.21.15.69:0/2426702193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedad2f0 0x561fbf1779c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f29c40058c0 tx=0x7f29c4010820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e1660460dbbe5ebb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:44.563 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.562+0000 7f29ce000640 1 --2- 172.21.15.69:0/277906547 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f29b80b2af0 0x7f29b80b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.563+0000 7f29ce000640 1 -- 172.21.15.69:0/277906547 <== mon.1 v2:172.21.15.203:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9510+0+0 (secure 0 0 0) 0x7f29c80e2ee0 con 0x7f29d01103f0 2024-05-14T15:39:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.563+0000 7f29c2a00640 1 -- 172.21.15.69:0/2426702193 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c40117c0 con 0x561fbedad2f0 2024-05-14T15:39:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.563+0000 7f29c2a00640 1 -- 172.21.15.69:0/2426702193 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29c4015070 con 0x561fbedad2f0 2024-05-14T15:39:44.564 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.563+0000 7f29c2a00640 1 -- 172.21.15.69:0/2426702193 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c400fb80 con 0x561fbedad2f0 2024-05-14T15:39:44.565 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.564+0000 7f29d4e00640 1 --2- 172.21.15.69:0/277906547 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f29b80b2af0 0x7f29b80b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.565+0000 7f29df1b6740 1 -- 172.21.15.69:0/2426702193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedad2f0 msgr2=0x561fbf1779c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.565+0000 7f29df1b6740 1 --2- 172.21.15.69:0/2426702193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedad2f0 0x561fbf1779c0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f29c40058c0 tx=0x7f29c4010820 comp rx=0 tx=0).stop 2024-05-14T15:39:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.566+0000 7f29df1b6740 1 -- 172.21.15.69:0/2426702193 shutdown_connections 2024-05-14T15:39:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.566+0000 7f29df1b6740 1 --2- 172.21.15.69:0/2426702193 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedb54d0 0x561fbf177f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.566+0000 7f29df1b6740 1 --2- 172.21.15.69:0/2426702193 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedad2f0 0x561fbf1779c0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.566+0000 7f29df1b6740 1 --2- 172.21.15.69:0/2426702193 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedd61b0 0x561fbf177480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.567 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.566+0000 7f29df1b6740 1 -- 172.21.15.69:0/2426702193 >> 172.21.15.69:0/2426702193 conn(0x561fbedca300 msgr2=0x561fbf173c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.566+0000 7f29d4e00640 1 --2- 172.21.15.69:0/277906547 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f29b80b2af0 0x7f29b80b5000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x561fbf1745f0 tx=0x7f29bc005a20 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:44.568 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.566+0000 7f29df1b6740 1 -- 172.21.15.69:0/2426702193 shutdown_connections 2024-05-14T15:39:44.570 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.569+0000 7f29df1b6740 1 -- 172.21.15.69:0/2426702193 wait complete. 2024-05-14T15:39:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.570+0000 7f29df1b6740 1 -- start start 2024-05-14T15:39:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.570+0000 7f29df1b6740 1 Processor -- start 2024-05-14T15:39:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.571+0000 7f29df1b6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedad2f0 0x561fbf181930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.571+0000 7f29df1b6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 0x561fbf181e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.571+0000 7f29df1b6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedd61b0 0x561fbf18daf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.571+0000 7f29df1b6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x561fbf1845b0 con 0x561fbedad2f0 2024-05-14T15:39:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.571+0000 7f29df1b6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x561fbf095660 con 0x561fbedb54d0 2024-05-14T15:39:44.572 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.571+0000 7f29df1b6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x561fbf184730 con 0x561fbedd61b0 2024-05-14T15:39:44.573 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.571+0000 7f29df1b6740 10 client.0 _ll_register_callbacks cb 0x561fbf05f400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:39:44.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.573+0000 7f29d4e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 0x561fbf181e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.573+0000 7f29d4e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 0x561fbf181e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:49202/0 (socket says 172.21.15.69:49202) 2024-05-14T15:39:44.574 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.573+0000 7f29d4e00640 1 -- 172.21.15.69:0/3939954318 learned_addr learned my addr 172.21.15.69:0/3939954318 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:44.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.574+0000 7f29d6200640 1 --2- 172.21.15.69:0/3939954318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedd61b0 0x561fbf18daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.575 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.574+0000 7f29d5800640 1 --2- 172.21.15.69:0/3939954318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedad2f0 0x561fbf181930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.575+0000 7f29d6200640 1 -- 172.21.15.69:0/3939954318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 msgr2=0x561fbf181e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.575+0000 7f29d6200640 1 --2- 172.21.15.69:0/3939954318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 0x561fbf181e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.576 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.575+0000 7f29d6200640 1 -- 172.21.15.69:0/3939954318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedad2f0 msgr2=0x561fbf181930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.575+0000 7f29d6200640 1 --2- 172.21.15.69:0/3939954318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedad2f0 0x561fbf181930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.575+0000 7f29d6200640 1 -- 172.21.15.69:0/3939954318 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fbeeba620 con 0x561fbedd61b0 2024-05-14T15:39:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.576+0000 7f29d6200640 1 --2- 172.21.15.69:0/3939954318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedd61b0 0x561fbf18daf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f29c80e0250 tx=0x7f29c80aa560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd6cff31081bad40 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.576+0000 7f29b7400640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:39:44.577 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.576+0000 7f29b7400640 1 -- 172.21.15.69:0/3939954318 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c80b2c40 con 0x561fbedd61b0 2024-05-14T15:39:44.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.577+0000 7f29b7400640 1 -- 172.21.15.69:0/3939954318 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9510+0+0 (secure 0 0 0) 0x7f29c80b27b0 con 0x561fbedd61b0 2024-05-14T15:39:44.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.577+0000 7f29df1b6740 1 -- 172.21.15.69:0/3939954318 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29c4015070 con 0x561fbedd61b0 2024-05-14T15:39:44.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.578+0000 7f29b7400640 1 -- 172.21.15.69:0/3939954318 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f29c80b29f0 con 0x561fbedd61b0 2024-05-14T15:39:44.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.578+0000 7f29df1b6740 10 client.26941 fetch_fsmap learned FSMap version 79 2024-05-14T15:39:44.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.578+0000 7f29df1b6740 1 -- 172.21.15.69:0/3939954318 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) -- 0x561fbf1908b0 con 0x561fbedd61b0 2024-05-14T15:39:44.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.579+0000 7f29b7400640 1 -- 172.21.15.69:0/3939954318 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29c80a5750 con 0x561fbedd61b0 2024-05-14T15:39:44.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.580+0000 7f29b7400640 1 -- 172.21.15.69:0/3939954318 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 79) ==== 8402+0+0 (secure 0 0 0) 0x7f29c80af320 con 0x561fbedd61b0 2024-05-14T15:39:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.580+0000 7f29df1b6740 10 client.26941 fetch_fsmap finished waiting for FSMap version 79 2024-05-14T15:39:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.580+0000 7f29df1b6740 10 client.26941 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:39:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.580+0000 7f29df1b6740 20 client.26941 populate_metadata read hostname 'smithi069' 2024-05-14T15:39:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.580+0000 7f29df1b6740 1 --2- 172.21.15.69:0/3939954318 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x561fbed94d80 0x561fbf193ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.580+0000 7f29df1b6740 4 client.26941 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:39:44.581 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.580+0000 7f29df1b6740 1 -- 172.21.15.69:0/3939954318 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f29c4015070 con 0x561fbed94d80 2024-05-14T15:39:44.582 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.581+0000 7f29d5800640 1 --2- 172.21.15.69:0/3939954318 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x561fbed94d80 0x561fbf193ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.583+0000 7f29b7400640 10 client.26941 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:44.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.583+0000 7f29d5800640 1 --2- 172.21.15.69:0/3939954318 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x561fbed94d80 0x561fbf193ed0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a8ee4512c25cc15 server_cookie=9df87133cbc1045 in_seq=0 out_seq=0 2024-05-14T15:39:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.587+0000 7f29b7400640 1 -- 172.21.15.69:0/3939954318 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x7f29c4015070 con 0x561fbed94d80 2024-05-14T15:39:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.587+0000 7f29b7400640 10 client.26941 handle_command_reply: tid=0 2024-05-14T15:39:44.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.587+0000 7f29df1b6740 1 client.26941 shutdown 2024-05-14T15:39:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.590+0000 7f29df1b6740 1 -- 172.21.15.69:0/3939954318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedd61b0 msgr2=0x561fbf18daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.590+0000 7f29df1b6740 1 --2- 172.21.15.69:0/3939954318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedd61b0 0x561fbf18daf0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f29c80e0250 tx=0x7f29c80aa560 comp rx=0 tx=0).stop 2024-05-14T15:39:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.590+0000 7f29df1b6740 1 -- 172.21.15.69:0/3939954318 shutdown_connections 2024-05-14T15:39:44.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.590+0000 7f29df1b6740 1 --2- 172.21.15.69:0/3939954318 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedd61b0 0x561fbf18daf0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.590+0000 7f29df1b6740 1 --2- 172.21.15.69:0/3939954318 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 0x561fbf181e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.590+0000 7f29df1b6740 1 --2- 172.21.15.69:0/3939954318 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x561fbed94d80 0x561fbf193ed0 crc :-1 s=READY pgs=248 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.590+0000 7f29df1b6740 1 --2- 172.21.15.69:0/3939954318 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedad2f0 0x561fbf181930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.590+0000 7f29df1b6740 1 -- 172.21.15.69:0/3939954318 >> 172.21.15.69:0/3939954318 conn(0x561fbedca300 msgr2=0x561fbf177420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.591+0000 7f29b7400640 0 client.26941 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:44.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.592+0000 7f29df1b6740 1 -- 172.21.15.69:0/3939954318 shutdown_connections 2024-05-14T15:39:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.592+0000 7f29df1b6740 1 -- 172.21.15.69:0/3939954318 wait complete. 2024-05-14T15:39:44.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.592+0000 7f29df1b6740 20 client.26941 trim_cache size 0 max 16384 2024-05-14T15:39:44.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.634+0000 7f29df1b6740 1 Processor -- start 2024-05-14T15:39:44.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.635+0000 7f29df1b6740 1 -- start start 2024-05-14T15:39:44.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.635+0000 7f29df1b6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedad2f0 0x561fbf180a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.635+0000 7f29df1b6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 0x561fbf183550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.635+0000 7f29df1b6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedd61b0 0x561fbf199690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.635+0000 7f29df1b6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0010020 con 0x561fbedad2f0 2024-05-14T15:39:44.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.635+0000 7f29df1b6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0011ce0 con 0x561fbedb54d0 2024-05-14T15:39:44.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.635+0000 7f29df1b6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f29b00106f0 con 0x561fbedd61b0 2024-05-14T15:39:44.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.636+0000 7f29d6200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedd61b0 0x561fbf199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.636+0000 7f29d4e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 0x561fbf183550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.636+0000 7f29d5800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedad2f0 0x561fbf180a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.636+0000 7f29d5800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedad2f0 0x561fbf180a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54460/0 (socket says 172.21.15.69:54460) 2024-05-14T15:39:44.637 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.636+0000 7f29d5800640 1 -- 172.21.15.69:0/1440033074 learned_addr learned my addr 172.21.15.69:0/1440033074 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.637+0000 7f29d5800640 1 -- 172.21.15.69:0/1440033074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedd61b0 msgr2=0x561fbf199690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.637+0000 7f29d5800640 1 --2- 172.21.15.69:0/1440033074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedd61b0 0x561fbf199690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.637+0000 7f29d5800640 1 -- 172.21.15.69:0/1440033074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 msgr2=0x561fbf183550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.638+0000 7f29d5800640 1 --2- 172.21.15.69:0/1440033074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 0x561fbf183550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.639 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.638+0000 7f29d5800640 1 -- 172.21.15.69:0/1440033074 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561fbf178860 con 0x561fbedad2f0 2024-05-14T15:39:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.638+0000 7f29d4e00640 1 --2- 172.21.15.69:0/1440033074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 0x561fbf183550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:39:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.638+0000 7f29d5800640 1 --2- 172.21.15.69:0/1440033074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedad2f0 0x561fbf180a20 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f29c4013010 tx=0x7f29c4013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e464047633356884 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.639+0000 7f29c2000640 1 -- 172.21.15.69:0/1440033074 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c4005300 con 0x561fbedad2f0 2024-05-14T15:39:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.639+0000 7f29c2000640 1 -- 172.21.15.69:0/1440033074 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29c4015070 con 0x561fbedad2f0 2024-05-14T15:39:44.640 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.639+0000 7f29c2000640 1 -- 172.21.15.69:0/1440033074 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c4003850 con 0x561fbedad2f0 2024-05-14T15:39:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.640+0000 7f29df1b6740 1 -- 172.21.15.69:0/1440033074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedad2f0 msgr2=0x561fbf180a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:44.641 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.640+0000 7f29df1b6740 1 --2- 172.21.15.69:0/1440033074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedad2f0 0x561fbf180a20 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f29c4013010 tx=0x7f29c4013040 comp rx=0 tx=0).stop 2024-05-14T15:39:44.642 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.641+0000 7f29df1b6740 1 -- 172.21.15.69:0/1440033074 shutdown_connections 2024-05-14T15:39:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.641+0000 7f29df1b6740 1 --2- 172.21.15.69:0/1440033074 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedd61b0 0x561fbf199690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.641+0000 7f29df1b6740 1 --2- 172.21.15.69:0/1440033074 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 0x561fbf183550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.641+0000 7f29df1b6740 1 --2- 172.21.15.69:0/1440033074 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedad2f0 0x561fbf180a20 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.641+0000 7f29df1b6740 1 -- 172.21.15.69:0/1440033074 >> 172.21.15.69:0/1440033074 conn(0x561fbedca300 msgr2=0x561fbf182e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.642+0000 7f29df1b6740 1 -- 172.21.15.69:0/1440033074 shutdown_connections 2024-05-14T15:39:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.642+0000 7f29df1b6740 1 -- 172.21.15.69:0/1440033074 wait complete. 2024-05-14T15:39:44.643 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.643+0000 7f29df1b6740 1 -- start start 2024-05-14T15:39:44.644 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.643+0000 7f29df1b6740 1 Processor -- start 2024-05-14T15:39:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.644+0000 7f29df1b6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedad2f0 0x561fbf184d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.644+0000 7f29df1b6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 0x561fbf185240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.644+0000 7f29df1b6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedd61b0 0x561fbf1fa230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.645 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.644+0000 7f29d5800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedad2f0 0x561fbf184d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.645+0000 7f29d5800640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedad2f0 0x561fbf184d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:57488/0 (socket says 172.21.15.69:57488) 2024-05-14T15:39:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.645+0000 7f29d6200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedd61b0 0x561fbf1fa230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.645+0000 7f29d4e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 0x561fbf185240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.645+0000 7f29d4e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 0x561fbf185240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:49220/0 (socket says 172.21.15.69:49220) 2024-05-14T15:39:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.645+0000 7f29df1b6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0011550 con 0x561fbedd61b0 2024-05-14T15:39:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.645+0000 7f29df1b6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f29b0010e80 con 0x561fbedb54d0 2024-05-14T15:39:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.645+0000 7f29df1b6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f29b000e020 con 0x561fbedad2f0 2024-05-14T15:39:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.645+0000 7f29df1b6740 10 client.0 _ll_register_callbacks cb 0x7f29c80a5d00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:39:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.645+0000 7f29d6200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedd61b0 0x561fbf1fa230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54474/0 (socket says 172.21.15.69:54474) 2024-05-14T15:39:44.646 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.645+0000 7f29d6200640 1 -- 172.21.15.69:0/2352930853 learned_addr learned my addr 172.21.15.69:0/2352930853 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.646+0000 7f29d5800640 1 -- 172.21.15.69:0/2352930853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 msgr2=0x561fbf185240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.646+0000 7f29d5800640 1 --2- 172.21.15.69:0/2352930853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 0x561fbf185240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.646+0000 7f29d5800640 1 -- 172.21.15.69:0/2352930853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedd61b0 msgr2=0x561fbf1fa230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.646+0000 7f29d5800640 1 --2- 172.21.15.69:0/2352930853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedd61b0 0x561fbf1fa230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.646+0000 7f29d5800640 1 -- 172.21.15.69:0/2352930853 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561fbf1fa770 con 0x561fbedad2f0 2024-05-14T15:39:44.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.647+0000 7f29d5800640 1 --2- 172.21.15.69:0/2352930853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedad2f0 0x561fbf184d00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f29c4006010 tx=0x7f29c4005100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a8dbc781c6a1aa54 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:44.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.647+0000 7f29b7400640 10 client.0 ms_handle_connect on v2:172.21.15.203:3300/0 2024-05-14T15:39:44.649 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.648+0000 7f29b7400640 1 -- 172.21.15.69:0/2352930853 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c4020070 con 0x561fbedad2f0 2024-05-14T15:39:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.649+0000 7f29b7400640 1 -- 172.21.15.69:0/2352930853 <== mon.1 v2:172.21.15.203:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9510+0+0 (secure 0 0 0) 0x7f29c4005600 con 0x561fbedad2f0 2024-05-14T15:39:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.649+0000 7f29df1b6740 1 -- 172.21.15.69:0/2352930853 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f29c4015070 con 0x561fbedad2f0 2024-05-14T15:39:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.650+0000 7f29b7400640 1 -- 172.21.15.69:0/2352930853 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_get_version_reply(handle=1 version=79) ==== 24+0+0 (secure 0 0 0) 0x7f29c40115c0 con 0x561fbedad2f0 2024-05-14T15:39:44.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.650+0000 7f29df1b6740 10 client.26947 fetch_fsmap learned FSMap version 79 2024-05-14T15:39:44.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.650+0000 7f29df1b6740 1 -- 172.21.15.69:0/2352930853 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,fsmap=79,monmap=4+}) -- 0x561fbf1fb900 con 0x561fbedad2f0 2024-05-14T15:39:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.651+0000 7f29b7400640 1 -- 172.21.15.69:0/2352930853 <== mon.1 v2:172.21.15.203:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f29c4015070 con 0x561fbedad2f0 2024-05-14T15:39:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.652+0000 7f29b7400640 1 -- 172.21.15.69:0/2352930853 <== mon.1 v2:172.21.15.203:3300/0 5 ==== fsmap(e 79) ==== 8402+0+0 (secure 0 0 0) 0x7f29c401a070 con 0x561fbedad2f0 2024-05-14T15:39:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.652+0000 7f29df1b6740 10 client.26947 fetch_fsmap finished waiting for FSMap version 79 2024-05-14T15:39:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.652+0000 7f29df1b6740 10 client.26947 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:39:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.652+0000 7f29df1b6740 20 client.26947 populate_metadata read hostname 'smithi069' 2024-05-14T15:39:44.653 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.652+0000 7f29df1b6740 1 --2- 172.21.15.69:0/2352930853 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x561fbed6a1c0 0x561fbf1fde70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.652+0000 7f29df1b6740 4 client.26947 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:39:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.652+0000 7f29df1b6740 1 -- 172.21.15.69:0/2352930853 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x561fbf0ea160 con 0x561fbed6a1c0 2024-05-14T15:39:44.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.653+0000 7f29d4e00640 1 --2- 172.21.15.69:0/2352930853 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x561fbed6a1c0 0x561fbf1fde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:44.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.654+0000 7f29d4e00640 1 --2- 172.21.15.69:0/2352930853 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x561fbed6a1c0 0x561fbf1fde70 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7b50ee078f346b67 server_cookie=73a0e9bac41fffe8 in_seq=0 out_seq=0 2024-05-14T15:39:44.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.654+0000 7f29b7400640 10 client.26947 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.715+0000 7f29b7400640 1 -- 172.21.15.69:0/2352930853 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x561fbf0ea160 con 0x561fbed6a1c0 2024-05-14T15:39:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.715+0000 7f29b7400640 10 client.26947 handle_command_reply: tid=0 2024-05-14T15:39:44.716 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.715+0000 7f29df1b6740 1 client.26947 shutdown 2024-05-14T15:39:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.715+0000 7f29df1b6740 1 -- 172.21.15.69:0/2352930853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedad2f0 msgr2=0x561fbf184d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.715+0000 7f29df1b6740 1 --2- 172.21.15.69:0/2352930853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedad2f0 0x561fbf184d00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f29c4006010 tx=0x7f29c4005100 comp rx=0 tx=0).stop 2024-05-14T15:39:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.716+0000 7f29df1b6740 1 -- 172.21.15.69:0/2352930853 shutdown_connections 2024-05-14T15:39:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.716+0000 7f29df1b6740 1 --2- 172.21.15.69:0/2352930853 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x561fbed6a1c0 0x561fbf1fde70 crc :-1 s=READY pgs=249 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.717 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.716+0000 7f29df1b6740 1 --2- 172.21.15.69:0/2352930853 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x561fbedd61b0 0x561fbf1fa230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.716+0000 7f29df1b6740 1 --2- 172.21.15.69:0/2352930853 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x561fbedb54d0 0x561fbf185240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.716+0000 7f29df1b6740 1 --2- 172.21.15.69:0/2352930853 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x561fbedad2f0 0x561fbf184d00 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.716+0000 7f29df1b6740 1 -- 172.21.15.69:0/2352930853 >> 172.21.15.69:0/2352930853 conn(0x561fbedca300 msgr2=0x561fbf180780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.716+0000 7f29b7400640 0 client.26947 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.717+0000 7f29df1b6740 1 -- 172.21.15.69:0/2352930853 shutdown_connections 2024-05-14T15:39:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.717+0000 7f29df1b6740 1 -- 172.21.15.69:0/2352930853 wait complete. 2024-05-14T15:39:44.718 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.717+0000 7f29df1b6740 20 client.26947 trim_cache size 0 max 16384 2024-05-14T15:39:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:39:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:39:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:39:44.719 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:39:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.719+0000 7f29d6c00640 1 -- 172.21.15.69:0/277906547 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f29b80b2af0 msgr2=0x7f29b80b5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.719+0000 7f29d6c00640 1 --2- 172.21.15.69:0/277906547 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f29b80b2af0 0x7f29b80b5000 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x561fbf1745f0 tx=0x7f29bc005a20 comp rx=0 tx=0).stop 2024-05-14T15:39:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.719+0000 7f29d6c00640 1 -- 172.21.15.69:0/277906547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29d01103f0 msgr2=0x7f29d01adb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:44.720 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.719+0000 7f29d6c00640 1 --2- 172.21.15.69:0/277906547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29d01103f0 0x7f29d01adb90 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f29c8009fd0 tx=0x7f29c800ef10 comp rx=0 tx=0).stop 2024-05-14T15:39:44.721 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.720+0000 7f29d6c00640 1 -- 172.21.15.69:0/277906547 shutdown_connections 2024-05-14T15:39:44.722 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.720+0000 7f29d6c00640 1 --2- 172.21.15.69:0/277906547 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f29b80b2af0 0x7f29b80b5000 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.722 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.720+0000 7f29d6c00640 1 --2- 172.21.15.69:0/277906547 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f29d01103f0 0x7f29d01adb90 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.722 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.720+0000 7f29d6c00640 1 --2- 172.21.15.69:0/277906547 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f29d010fa10 0x7f29d01a98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.722 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.720+0000 7f29d6c00640 1 --2- 172.21.15.69:0/277906547 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f29d010a210 0x7f29d01a9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:44.722 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.720+0000 7f29d6c00640 1 -- 172.21.15.69:0/277906547 >> 172.21.15.69:0/277906547 conn(0x7f29d006f810 msgr2=0x7f29d010d300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:44.722 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.721+0000 7f29d6c00640 1 -- 172.21.15.69:0/277906547 shutdown_connections 2024-05-14T15:39:44.722 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:44.721+0000 7f29d6c00640 1 -- 172.21.15.69:0/277906547 wait complete. 2024-05-14T15:39:45.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:45 smithi092 ceph-mon[34729]: pgmap v572: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 5.4 MiB/s wr, 493 op/s 2024-05-14T15:39:45.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:45 smithi069 ceph-mon[31270]: pgmap v572: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 5.4 MiB/s wr, 493 op/s 2024-05-14T15:39:46.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:45 smithi203 ceph-mon[34567]: pgmap v572: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 5.4 MiB/s wr, 493 op/s 2024-05-14T15:39:46.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 840.0 s, 591.0 tps, lat 171.537 ms stddev 92.650 2024-05-14T15:39:47.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:47 smithi092 ceph-mon[34729]: pgmap v573: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 8.0 MiB/s wr, 710 op/s 2024-05-14T15:39:47.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:47 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:47.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:47 smithi069 ceph-mon[31270]: pgmap v573: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 8.0 MiB/s wr, 710 op/s 2024-05-14T15:39:47.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:47 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:48.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:47 smithi203 ceph-mon[34567]: pgmap v573: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 8.0 MiB/s wr, 710 op/s 2024-05-14T15:39:48.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:47 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:49.897 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:49 smithi203 ceph-mon[34567]: pgmap v574: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.1 MiB/s wr, 463 op/s 2024-05-14T15:39:49.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:49 smithi092 ceph-mon[34729]: pgmap v574: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.1 MiB/s wr, 463 op/s 2024-05-14T15:39:49.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:49 smithi069 ceph-mon[31270]: pgmap v574: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.1 MiB/s wr, 463 op/s 2024-05-14T15:39:51.035 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:51 smithi069 ceph-mon[31270]: pgmap v575: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 7.3 MiB/s wr, 651 op/s 2024-05-14T15:39:51.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:51 smithi203 ceph-mon[34567]: pgmap v575: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 7.3 MiB/s wr, 651 op/s 2024-05-14T15:39:51.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 845.0 s, 524.4 tps, lat 186.698 ms stddev 123.537 2024-05-14T15:39:51.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:51 smithi092 ceph-mon[34729]: pgmap v575: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 7.3 MiB/s wr, 651 op/s 2024-05-14T15:39:53.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:53 smithi203 ceph-mon[34567]: pgmap v576: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.0 MiB/s wr, 532 op/s 2024-05-14T15:39:53.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:53 smithi092 ceph-mon[34729]: pgmap v576: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.0 MiB/s wr, 532 op/s 2024-05-14T15:39:53.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:53 smithi069 ceph-mon[31270]: pgmap v576: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 6.0 MiB/s wr, 532 op/s 2024-05-14T15:39:54.844 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:54 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:54.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:54 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:54.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:54 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:39:55.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:55 smithi203 ceph-mon[34567]: pgmap v577: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.6 MiB/s wr, 490 op/s 2024-05-14T15:39:55.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:55 smithi092 ceph-mon[34729]: pgmap v577: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.6 MiB/s wr, 490 op/s 2024-05-14T15:39:55.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:55 smithi069 ceph-mon[31270]: pgmap v577: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 5.6 MiB/s wr, 490 op/s 2024-05-14T15:39:56.370 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 850.0 s, 218.9 tps, lat 209.501 ms stddev 160.738 2024-05-14T15:39:57.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:57 smithi203 ceph-mon[34567]: pgmap v578: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 7.2 MiB/s wr, 660 op/s 2024-05-14T15:39:57.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:57 smithi092 ceph-mon[34729]: pgmap v578: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 7.2 MiB/s wr, 660 op/s 2024-05-14T15:39:57.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:57 smithi069 ceph-mon[31270]: pgmap v578: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 48 KiB/s rd, 7.2 MiB/s wr, 660 op/s 2024-05-14T15:39:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.987+0000 7f9b04a00640 1 -- 172.21.15.69:0/3776284100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b00104230 msgr2=0x7f9b00110600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.987+0000 7f9b04a00640 1 --2- 172.21.15.69:0/3776284100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b00104230 0x7f9b00110600 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009900 tx=0x7f9af802a3f0 comp rx=0 tx=0).stop 2024-05-14T15:39:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.987+0000 7f9b04a00640 1 -- 172.21.15.69:0/3776284100 shutdown_connections 2024-05-14T15:39:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.987+0000 7f9b04a00640 1 --2- 172.21.15.69:0/3776284100 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b00104230 0x7f9b00110600 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:57.988 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.987+0000 7f9b04a00640 1 --2- 172.21.15.69:0/3776284100 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b00109f80 0x7f9b00103bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.987+0000 7f9b04a00640 1 --2- 172.21.15.69:0/3776284100 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b00109ae0 0x7f9b00103680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.987+0000 7f9b04a00640 1 -- 172.21.15.69:0/3776284100 >> 172.21.15.69:0/3776284100 conn(0x7f9b00079110 msgr2=0x7f9b00079550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.987+0000 7f9b04a00640 1 -- 172.21.15.69:0/3776284100 shutdown_connections 2024-05-14T15:39:57.989 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.987+0000 7f9b04a00640 1 -- 172.21.15.69:0/3776284100 wait complete. 2024-05-14T15:39:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.988+0000 7f9b04a00640 1 Processor -- start 2024-05-14T15:39:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.989+0000 7f9b04a00640 1 -- start start 2024-05-14T15:39:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.989+0000 7f9b04a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b00104230 0x7f9b0019c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.989+0000 7f9b04a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b00109ae0 0x7f9b0019cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.989+0000 7f9b04a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b00109f80 0x7f9b001a0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.989+0000 7f9b04a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9b00113b80 con 0x7f9b00109ae0 2024-05-14T15:39:57.990 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.989+0000 7f9b04a00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9b00113a00 con 0x7f9b00109f80 2024-05-14T15:39:57.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.989+0000 7f9b04a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9b00113d00 con 0x7f9b00104230 2024-05-14T15:39:57.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.989+0000 7f9afde00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b00109ae0 0x7f9b0019cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:57.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.989+0000 7f9afde00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b00109ae0 0x7f9b0019cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55954/0 (socket says 172.21.15.69:55954) 2024-05-14T15:39:57.991 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.989+0000 7f9afde00640 1 -- 172.21.15.69:0/3321833239 learned_addr learned my addr 172.21.15.69:0/3321833239 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.990+0000 7f9afe800640 1 --2- 172.21.15.69:0/3321833239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b00104230 0x7f9b0019c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.990+0000 7f9aff200640 1 --2- 172.21.15.69:0/3321833239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b00109f80 0x7f9b001a0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:57.992 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.990+0000 7f9afde00640 1 -- 172.21.15.69:0/3321833239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b00104230 msgr2=0x7f9b0019c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.990+0000 7f9afde00640 1 --2- 172.21.15.69:0/3321833239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b00104230 0x7f9b0019c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.990+0000 7f9afde00640 1 -- 172.21.15.69:0/3321833239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b00109f80 msgr2=0x7f9b001a0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.990+0000 7f9afde00640 1 --2- 172.21.15.69:0/3321833239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b00109f80 0x7f9b001a0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.990+0000 7f9afde00640 1 -- 172.21.15.69:0/3321833239 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b001a1580 con 0x7f9b00109ae0 2024-05-14T15:39:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.990+0000 7f9aff200640 1 --2- 172.21.15.69:0/3321833239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b00109f80 0x7f9b001a0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:39:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.990+0000 7f9afde00640 1 --2- 172.21.15.69:0/3321833239 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b00109ae0 0x7f9b0019cd00 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800d770 tx=0x7f9ae800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.990+0000 7f9af7400640 1 -- 172.21.15.69:0/3321833239 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8017070 con 0x7f9b00109ae0 2024-05-14T15:39:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.990+0000 7f9af7400640 1 -- 172.21.15.69:0/3321833239 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ae800de80 con 0x7f9b00109ae0 2024-05-14T15:39:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.990+0000 7f9af7400640 1 -- 172.21.15.69:0/3321833239 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8003bb0 con 0x7f9b00109ae0 2024-05-14T15:39:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.991+0000 7f9b04a00640 1 -- 172.21.15.69:0/3321833239 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b001a1870 con 0x7f9b00109ae0 2024-05-14T15:39:57.993 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.991+0000 7f9b04a00640 1 -- 172.21.15.69:0/3321833239 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b001a1d70 con 0x7f9b00109ae0 2024-05-14T15:39:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.995+0000 7f9b0c3ab740 1 Processor -- start 2024-05-14T15:39:57.996 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.995+0000 7f9b0c3ab740 1 -- start start 2024-05-14T15:39:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.996+0000 7f9b0c3ab740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272edc21b0 0x56272f163480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.996+0000 7f9b0c3ab740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272ed992f0 0x56272f1639c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.996+0000 7f9b0c3ab740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272eda14d0 0x56272f163f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.996+0000 7f9b0c3ab740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56272f0c8550 con 0x56272edc21b0 2024-05-14T15:39:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.996+0000 7f9b0c3ab740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56272f06dbc0 con 0x56272eda14d0 2024-05-14T15:39:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.996+0000 7f9b0c3ab740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56272f0c4510 con 0x56272ed992f0 2024-05-14T15:39:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.996+0000 7f9af7400640 1 -- 172.21.15.69:0/3321833239 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9ae8003d50 con 0x7f9b00109ae0 2024-05-14T15:39:57.997 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.996+0000 7f9aff200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272edc21b0 0x56272f163480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.996+0000 7f9aff200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272edc21b0 0x56272f163480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55958/0 (socket says 172.21.15.69:55958) 2024-05-14T15:39:57.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.996+0000 7f9aff200640 1 -- 172.21.15.69:0/1538431447 learned_addr learned my addr 172.21.15.69:0/1538431447 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:58.000 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.996+0000 7f9afe800640 1 --2- 172.21.15.69:0/1538431447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272ed992f0 0x56272f1639c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.997+0000 7f9aff200640 1 -- 172.21.15.69:0/1538431447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272ed992f0 msgr2=0x56272f1639c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.997+0000 7f9aff200640 1 --2- 172.21.15.69:0/1538431447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272ed992f0 0x56272f1639c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.997+0000 7f9aff200640 1 -- 172.21.15.69:0/1538431447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272eda14d0 msgr2=0x56272f163f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.997+0000 7f9aff200640 1 --2- 172.21.15.69:0/1538431447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272eda14d0 0x56272f163f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.997+0000 7f9aff200640 1 -- 172.21.15.69:0/1538431447 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56272edda210 con 0x56272edc21b0 2024-05-14T15:39:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.997+0000 7f9afe800640 1 --2- 172.21.15.69:0/1538431447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272ed992f0 0x56272f1639c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:39:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.997+0000 7f9aff200640 1 --2- 172.21.15.69:0/1538431447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272edc21b0 0x56272f163480 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009a20 tx=0x7f9af8032c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d52bede7198c033 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.997+0000 7f9aef400640 1 -- 172.21.15.69:0/1538431447 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af803f070 con 0x56272edc21b0 2024-05-14T15:39:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.997+0000 7f9aef400640 1 -- 172.21.15.69:0/1538431447 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9af80044c0 con 0x56272edc21b0 2024-05-14T15:39:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.997+0000 7f9aef400640 1 -- 172.21.15.69:0/1538431447 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8035070 con 0x56272edc21b0 2024-05-14T15:39:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.998+0000 7f9af7400640 1 --2- 172.21.15.69:0/3321833239 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9ae40b29d0 0x7f9ae40b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.998+0000 7f9af7400640 1 -- 172.21.15.69:0/3321833239 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 9510+0+0 (secure 0 0 0) 0x7f9ae80e23d0 con 0x7f9b00109ae0 2024-05-14T15:39:58.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.998+0000 7f9afe800640 1 --2- 172.21.15.69:0/3321833239 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9ae40b29d0 0x7f9ae40b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.998+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/1538431447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272edc21b0 msgr2=0x56272f163480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.998+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/1538431447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272edc21b0 0x56272f163480 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009a20 tx=0x7f9af8032c40 comp rx=0 tx=0).stop 2024-05-14T15:39:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.999+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/1538431447 shutdown_connections 2024-05-14T15:39:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.999+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/1538431447 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272eda14d0 0x56272f163f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.999+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/1538431447 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272ed992f0 0x56272f1639c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.999+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/1538431447 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272edc21b0 0x56272f163480 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.999+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/1538431447 >> 172.21.15.69:0/1538431447 conn(0x56272edb6300 msgr2=0x56272f15fc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.999+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/1538431447 shutdown_connections 2024-05-14T15:39:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.999+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/1538431447 wait complete. 2024-05-14T15:39:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:57.999+0000 7f9afe800640 1 --2- 172.21.15.69:0/3321833239 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9ae40b29d0 0x7f9ae40b4ee0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x56272f164830 tx=0x7f9af0007480 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.000+0000 7f9b0c3ab740 1 -- start start 2024-05-14T15:39:58.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.000+0000 7f9b0c3ab740 1 Processor -- start 2024-05-14T15:39:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.000+0000 7f9b0c3ab740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272ed992f0 0x56272f16d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.000+0000 7f9b0c3ab740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272eda14d0 0x56272f16ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.000+0000 7f9b0c3ab740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272edc21b0 0x56272f179a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.000+0000 7f9b0c3ab740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x56272f170550 con 0x56272ed992f0 2024-05-14T15:39:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.000+0000 7f9b0c3ab740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x56272f081660 con 0x56272edc21b0 2024-05-14T15:39:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.000+0000 7f9b0c3ab740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x56272f1706d0 con 0x56272eda14d0 2024-05-14T15:39:58.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.001+0000 7f9b0c3ab740 10 client.0 _ll_register_callbacks cb 0x56272f04b400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:39:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.001+0000 7f9afe800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272ed992f0 0x56272f16d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.001+0000 7f9afe800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272ed992f0 0x56272f16d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55974/0 (socket says 172.21.15.69:55974) 2024-05-14T15:39:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.001+0000 7f9afe800640 1 -- 172.21.15.69:0/778542275 learned_addr learned my addr 172.21.15.69:0/778542275 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.001+0000 7f9afde00640 1 --2- 172.21.15.69:0/778542275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272eda14d0 0x56272f16ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.001+0000 7f9aff200640 1 --2- 172.21.15.69:0/778542275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272edc21b0 0x56272f179a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.001+0000 7f9afe800640 1 -- 172.21.15.69:0/778542275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272eda14d0 msgr2=0x56272f16ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.001+0000 7f9afe800640 1 --2- 172.21.15.69:0/778542275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272eda14d0 0x56272f16ded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.001+0000 7f9afe800640 1 -- 172.21.15.69:0/778542275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272edc21b0 msgr2=0x56272f179a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.001+0000 7f9afe800640 1 --2- 172.21.15.69:0/778542275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272edc21b0 0x56272f179a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.001+0000 7f9afe800640 1 -- 172.21.15.69:0/778542275 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56272eea6620 con 0x56272ed992f0 2024-05-14T15:39:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.001+0000 7f9afde00640 1 --2- 172.21.15.69:0/778542275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272eda14d0 0x56272f16ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:39:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.002+0000 7f9afe800640 1 --2- 172.21.15.69:0/778542275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272ed992f0 0x56272f16d990 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9af0003f20 tx=0x7f9af0004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aa926ea03cfbd1c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.002+0000 7f9ae3e00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:39:58.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.002+0000 7f9ae3e00640 1 -- 172.21.15.69:0/778542275 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0011910 con 0x56272ed992f0 2024-05-14T15:39:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.002+0000 7f9ae3e00640 1 -- 172.21.15.69:0/778542275 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9510+0+0 (secure 0 0 0) 0x7f9af0011ab0 con 0x56272ed992f0 2024-05-14T15:39:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.002+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/778542275 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56272f0d6160 con 0x56272ed992f0 2024-05-14T15:39:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.002+0000 7f9ae3e00640 1 -- 172.21.15.69:0/778542275 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f9af002d050 con 0x56272ed992f0 2024-05-14T15:39:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.002+0000 7f9b0c3ab740 10 client.17478 fetch_fsmap learned FSMap version 81 2024-05-14T15:39:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.002+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/778542275 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=4+}) -- 0x56272f17c7c0 con 0x56272ed992f0 2024-05-14T15:39:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.002+0000 7f9ae3e00640 1 -- 172.21.15.69:0/778542275 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x56272f0d6160 con 0x56272ed992f0 2024-05-14T15:39:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.003+0000 7f9ae3e00640 1 -- 172.21.15.69:0/778542275 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 81) ==== 8406+0+0 (secure 0 0 0) 0x7f9af001fc60 con 0x56272ed992f0 2024-05-14T15:39:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.003+0000 7f9b0c3ab740 10 client.17478 fetch_fsmap finished waiting for FSMap version 81 2024-05-14T15:39:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.003+0000 7f9b0c3ab740 10 client.17478 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:39:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.003+0000 7f9b0c3ab740 20 client.17478 populate_metadata read hostname 'smithi069' 2024-05-14T15:39:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.003+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/778542275 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56272ed80d80 0x56272f17fe40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.003+0000 7f9b0c3ab740 4 client.17478 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:39:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.003+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/778542275 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56272f0cffd0 con 0x56272ed80d80 2024-05-14T15:39:58.008 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.004+0000 7f9afde00640 1 --2- 172.21.15.69:0/778542275 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56272ed80d80 0x56272f17fe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.005+0000 7f9ae3e00640 10 client.17478 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:58.009 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.005+0000 7f9afde00640 1 --2- 172.21.15.69:0/778542275 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56272ed80d80 0x56272f17fe40 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afdfb4a0501b197d server_cookie=9e468f1ddba42691 in_seq=0 out_seq=0 2024-05-14T15:39:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.007+0000 7f9ae3e00640 1 -- 172.21.15.69:0/778542275 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x56272f0cffd0 con 0x56272ed80d80 2024-05-14T15:39:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.007+0000 7f9ae3e00640 10 client.17478 handle_command_reply: tid=0 2024-05-14T15:39:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.007+0000 7f9b0c3ab740 1 client.17478 shutdown 2024-05-14T15:39:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.007+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/778542275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272ed992f0 msgr2=0x56272f16d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.007+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/778542275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272ed992f0 0x56272f16d990 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f9af0003f20 tx=0x7f9af0004ab0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.007+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/778542275 shutdown_connections 2024-05-14T15:39:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.007+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/778542275 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272edc21b0 0x56272f179a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.007+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/778542275 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272eda14d0 0x56272f16ded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.007+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/778542275 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56272ed80d80 0x56272f17fe40 crc :-1 s=READY pgs=250 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.007+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/778542275 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272ed992f0 0x56272f16d990 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.007+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/778542275 >> 172.21.15.69:0/778542275 conn(0x56272edb6300 msgr2=0x56272f1651a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:58.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.007+0000 7f9ae3e00640 0 client.17478 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.007+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/778542275 shutdown_connections 2024-05-14T15:39:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.007+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/778542275 wait complete. 2024-05-14T15:39:58.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.008+0000 7f9b0c3ab740 20 client.17478 trim_cache size 0 max 16384 2024-05-14T15:39:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.031+0000 7f9b0c3ab740 1 Processor -- start 2024-05-14T15:39:58.032 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.031+0000 7f9b0c3ab740 1 -- start start 2024-05-14T15:39:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.031+0000 7f9b0c3ab740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272ed992f0 0x56272f165b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.031+0000 7f9b0c3ab740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272eda14d0 0x56272f163d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.031+0000 7f9b0c3ab740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272edc21b0 0x56272f15e960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.031+0000 7f9b0c3ab740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001b32f0 con 0x56272eda14d0 2024-05-14T15:39:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.032+0000 7f9b0c3ab740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001b5010 con 0x56272ed992f0 2024-05-14T15:39:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.032+0000 7f9b0c3ab740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001b39c0 con 0x56272edc21b0 2024-05-14T15:39:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.032+0000 7f9afde00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272eda14d0 0x56272f163d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.032+0000 7f9afde00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272eda14d0 0x56272f163d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:55988/0 (socket says 172.21.15.69:55988) 2024-05-14T15:39:58.033 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.032+0000 7f9afde00640 1 -- 172.21.15.69:0/21898397 learned_addr learned my addr 172.21.15.69:0/21898397 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.032+0000 7f9afe800640 1 --2- 172.21.15.69:0/21898397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272ed992f0 0x56272f165b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:58.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.032+0000 7f9afde00640 1 -- 172.21.15.69:0/21898397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272edc21b0 msgr2=0x56272f15e960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.032+0000 7f9afde00640 1 --2- 172.21.15.69:0/21898397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272edc21b0 0x56272f15e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.032+0000 7f9afde00640 1 -- 172.21.15.69:0/21898397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272ed992f0 msgr2=0x56272f165b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.032+0000 7f9afde00640 1 --2- 172.21.15.69:0/21898397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272ed992f0 0x56272f165b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.032+0000 7f9afde00640 1 -- 172.21.15.69:0/21898397 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56272f164860 con 0x56272eda14d0 2024-05-14T15:39:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.033+0000 7f9afe800640 1 --2- 172.21.15.69:0/21898397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272ed992f0 0x56272f165b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:39:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.033+0000 7f9afde00640 1 --2- 172.21.15.69:0/21898397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272eda14d0 0x56272f163d60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8000c00 tx=0x7f9ae80035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86f6901c2f065213 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.033+0000 7f9aeea00640 1 -- 172.21.15.69:0/21898397 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae80c3070 con 0x56272eda14d0 2024-05-14T15:39:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.033+0000 7f9aeea00640 1 -- 172.21.15.69:0/21898397 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ae80b20d0 con 0x56272eda14d0 2024-05-14T15:39:58.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.033+0000 7f9aeea00640 1 -- 172.21.15.69:0/21898397 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ae8020040 con 0x56272eda14d0 2024-05-14T15:39:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.034+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/21898397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272eda14d0 msgr2=0x56272f163d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.034+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/21898397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272eda14d0 0x56272f163d60 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f9ae8000c00 tx=0x7f9ae80035f0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.034+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/21898397 shutdown_connections 2024-05-14T15:39:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.034+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/21898397 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272edc21b0 0x56272f15e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.034+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/21898397 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272eda14d0 0x56272f163d60 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.034+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/21898397 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272ed992f0 0x56272f165b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.036 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.034+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/21898397 >> 172.21.15.69:0/21898397 conn(0x56272edb6300 msgr2=0x56272f15e250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.035+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/21898397 shutdown_connections 2024-05-14T15:39:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.035+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/21898397 wait complete. 2024-05-14T15:39:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.035+0000 7f9b0c3ab740 1 -- start start 2024-05-14T15:39:58.037 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.035+0000 7f9b0c3ab740 1 Processor -- start 2024-05-14T15:39:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.036+0000 7f9b0c3ab740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272ed992f0 0x56272f1757c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.036+0000 7f9b0c3ab740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272eda14d0 0x56272f175d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.036+0000 7f9b0c3ab740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272edc21b0 0x56272f170d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:58.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.036+0000 7f9b0c3ab740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001b4880 con 0x56272edc21b0 2024-05-14T15:39:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.036+0000 7f9b0c3ab740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001b4150 con 0x56272ed992f0 2024-05-14T15:39:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.036+0000 7f9b0c3ab740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9b001b12f0 con 0x56272eda14d0 2024-05-14T15:39:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.036+0000 7f9b0c3ab740 10 client.0 _ll_register_callbacks cb 0x7f9af0015070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:39:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.036+0000 7f9aff200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272edc21b0 0x56272f170d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.036+0000 7f9aff200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272edc21b0 0x56272f170d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56002/0 (socket says 172.21.15.69:56002) 2024-05-14T15:39:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.036+0000 7f9aff200640 1 -- 172.21.15.69:0/3741486116 learned_addr learned my addr 172.21.15.69:0/3741486116 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:39:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.037+0000 7f9afe800640 1 --2- 172.21.15.69:0/3741486116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272ed992f0 0x56272f1757c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.037+0000 7f9aff200640 1 -- 172.21.15.69:0/3741486116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272eda14d0 msgr2=0x56272f175d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.037+0000 7f9aff200640 1 --2- 172.21.15.69:0/3741486116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272eda14d0 0x56272f175d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.037+0000 7f9aff200640 1 -- 172.21.15.69:0/3741486116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272ed992f0 msgr2=0x56272f1757c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:39:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.037+0000 7f9aff200640 1 --2- 172.21.15.69:0/3741486116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272ed992f0 0x56272f1757c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.037+0000 7f9aff200640 1 -- 172.21.15.69:0/3741486116 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56272f171420 con 0x56272edc21b0 2024-05-14T15:39:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.037+0000 7f9aff200640 1 --2- 172.21.15.69:0/3741486116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272edc21b0 0x56272f170d60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9af80096c0 tx=0x7f9af8005f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc66ae3fa0dc3f02 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:39:58.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.037+0000 7f9ae3e00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:39:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.037+0000 7f9ae3e00640 1 -- 172.21.15.69:0/3741486116 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af804b020 con 0x56272edc21b0 2024-05-14T15:39:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.037+0000 7f9ae3e00640 1 -- 172.21.15.69:0/3741486116 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(118..118 src has 1..118) ==== 9510+0+0 (secure 0 0 0) 0x7f9af8005240 con 0x56272edc21b0 2024-05-14T15:39:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.037+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/3741486116 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ae80b20d0 con 0x56272edc21b0 2024-05-14T15:39:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.038+0000 7f9ae3e00640 1 -- 172.21.15.69:0/3741486116 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=81) ==== 24+0+0 (secure 0 0 0) 0x7f9af8056050 con 0x56272edc21b0 2024-05-14T15:39:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.038+0000 7f9b0c3ab740 10 client.17484 fetch_fsmap learned FSMap version 81 2024-05-14T15:39:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.038+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/3741486116 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=81,monmap=4+}) -- 0x56272f1e7aa0 con 0x56272edc21b0 2024-05-14T15:39:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.038+0000 7f9ae3e00640 1 -- 172.21.15.69:0/3741486116 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ae80b20d0 con 0x56272edc21b0 2024-05-14T15:39:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.038+0000 7f9ae3e00640 1 -- 172.21.15.69:0/3741486116 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 81) ==== 8406+0+0 (secure 0 0 0) 0x7f9af803b460 con 0x56272edc21b0 2024-05-14T15:39:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.038+0000 7f9b0c3ab740 10 client.17484 fetch_fsmap finished waiting for FSMap version 81 2024-05-14T15:39:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.038+0000 7f9b0c3ab740 10 client.17484 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:39:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.039+0000 7f9b0c3ab740 20 client.17484 populate_metadata read hostname 'smithi069' 2024-05-14T15:39:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.039+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/3741486116 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56272ed561c0 0x56272f1e9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:39:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.039+0000 7f9b0c3ab740 4 client.17484 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:39:58.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.039+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/3741486116 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56272f04b4b0 con 0x56272ed561c0 2024-05-14T15:39:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.039+0000 7f9afe800640 1 --2- 172.21.15.69:0/3741486116 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56272ed561c0 0x56272f1e9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:39:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.040+0000 7f9afe800640 1 --2- 172.21.15.69:0/3741486116 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56272ed561c0 0x56272f1e9fe0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dd7eb6e5de45c2d server_cookie=6a845f58070f4cf1 in_seq=0 out_seq=0 2024-05-14T15:39:58.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.040+0000 7f9ae3e00640 10 client.17484 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:58.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.097+0000 7f9ae3e00640 1 -- 172.21.15.69:0/3741486116 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56272f04b4b0 con 0x56272ed561c0 2024-05-14T15:39:58.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.097+0000 7f9ae3e00640 10 client.17484 handle_command_reply: tid=0 2024-05-14T15:39:58.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.097+0000 7f9b0c3ab740 1 client.17484 shutdown 2024-05-14T15:39:58.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.097+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/3741486116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272edc21b0 msgr2=0x56272f170d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:58.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.097+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/3741486116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272edc21b0 0x56272f170d60 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f9af80096c0 tx=0x7f9af8005f30 comp rx=0 tx=0).stop 2024-05-14T15:39:58.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.098+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/3741486116 shutdown_connections 2024-05-14T15:39:58.099 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.098+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/3741486116 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x56272ed561c0 0x56272f1e9fe0 crc :-1 s=READY pgs=251 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.098+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/3741486116 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x56272edc21b0 0x56272f170d60 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.098+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/3741486116 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x56272eda14d0 0x56272f175d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.098+0000 7f9b0c3ab740 1 --2- 172.21.15.69:0/3741486116 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x56272ed992f0 0x56272f1757c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.098+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/3741486116 >> 172.21.15.69:0/3741486116 conn(0x56272edb6300 msgr2=0x56272f15ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.098+0000 7f9ae3e00640 0 client.17484 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:39:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.098+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/3741486116 shutdown_connections 2024-05-14T15:39:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.098+0000 7f9b0c3ab740 1 -- 172.21.15.69:0/3741486116 wait complete. 2024-05-14T15:39:58.100 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.098+0000 7f9b0c3ab740 20 client.17484 trim_cache size 0 max 16384 2024-05-14T15:39:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:39:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:39:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:39:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:39:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.099+0000 7f9b04a00640 1 -- 172.21.15.69:0/3321833239 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9ae40b29d0 msgr2=0x7f9ae40b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:58.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.099+0000 7f9b04a00640 1 --2- 172.21.15.69:0/3321833239 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9ae40b29d0 0x7f9ae40b4ee0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x56272f164830 tx=0x7f9af0007480 comp rx=0 tx=0).stop 2024-05-14T15:39:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.099+0000 7f9b04a00640 1 -- 172.21.15.69:0/3321833239 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b00109ae0 msgr2=0x7f9b0019cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:39:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.099+0000 7f9b04a00640 1 --2- 172.21.15.69:0/3321833239 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b00109ae0 0x7f9b0019cd00 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f9ae800d770 tx=0x7f9ae800dc30 comp rx=0 tx=0).stop 2024-05-14T15:39:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.099+0000 7f9b04a00640 1 -- 172.21.15.69:0/3321833239 shutdown_connections 2024-05-14T15:39:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.099+0000 7f9b04a00640 1 --2- 172.21.15.69:0/3321833239 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9ae40b29d0 0x7f9ae40b4ee0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.099+0000 7f9b04a00640 1 --2- 172.21.15.69:0/3321833239 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9b00109f80 0x7f9b001a0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.099+0000 7f9b04a00640 1 --2- 172.21.15.69:0/3321833239 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9b00109ae0 0x7f9b0019cd00 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.099+0000 7f9b04a00640 1 --2- 172.21.15.69:0/3321833239 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9b00104230 0x7f9b0019c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:39:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.099+0000 7f9b04a00640 1 -- 172.21.15.69:0/3321833239 >> 172.21.15.69:0/3321833239 conn(0x7f9b00079110 msgr2=0x7f9b00100330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:39:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.099+0000 7f9b04a00640 1 -- 172.21.15.69:0/3321833239 shutdown_connections 2024-05-14T15:39:58.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:39:58.099+0000 7f9b04a00640 1 -- 172.21.15.69:0/3321833239 wait complete. 2024-05-14T15:39:59.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:39:59 smithi203 ceph-mon[34567]: pgmap v579: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 432 op/s 2024-05-14T15:39:59.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:39:59 smithi092 ceph-mon[34729]: pgmap v579: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 432 op/s 2024-05-14T15:39:59.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:39:59 smithi069 ceph-mon[31270]: pgmap v579: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 4.5 MiB/s wr, 432 op/s 2024-05-14T15:40:00.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a[31265]: 2024-05-14T15:39:59.999+0000 7f22e0a00700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 MDSs report damaged metadata 2024-05-14T15:40:00.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:00 smithi092 ceph-mon[34729]: overall HEALTH_ERR 1 MDSs report damaged metadata 2024-05-14T15:40:00.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:00 smithi069 ceph-mon[31270]: overall HEALTH_ERR 1 MDSs report damaged metadata 2024-05-14T15:40:01.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:00 smithi203 ceph-mon[34567]: overall HEALTH_ERR 1 MDSs report damaged metadata 2024-05-14T15:40:01.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 855.0 s, 442.2 tps, lat 354.560 ms stddev 1027.321 2024-05-14T15:40:01.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:01 smithi092 ceph-mon[34729]: pgmap v580: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.4 MiB/s wr, 503 op/s 2024-05-14T15:40:01.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:01 smithi069 ceph-mon[31270]: pgmap v580: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.4 MiB/s wr, 503 op/s 2024-05-14T15:40:02.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:01 smithi203 ceph-mon[34567]: pgmap v580: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 66 KiB/s rd, 5.4 MiB/s wr, 503 op/s 2024-05-14T15:40:03.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:03 smithi092 ceph-mon[34729]: pgmap v581: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 3.5 MiB/s wr, 361 op/s 2024-05-14T15:40:03.976 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:03 smithi069 ceph-mon[31270]: pgmap v581: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 3.5 MiB/s wr, 361 op/s 2024-05-14T15:40:04.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:03 smithi203 ceph-mon[34567]: pgmap v581: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 3.5 MiB/s wr, 361 op/s 2024-05-14T15:40:05.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:05 smithi092 ceph-mon[34729]: pgmap v582: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 3.4 MiB/s wr, 328 op/s 2024-05-14T15:40:05.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:05 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:40:05.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:05 smithi069 ceph-mon[31270]: pgmap v582: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 3.4 MiB/s wr, 328 op/s 2024-05-14T15:40:05.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:05 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:40:06.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:05 smithi203 ceph-mon[34567]: pgmap v582: 129 pgs: 129 active+clean; 3.5 GiB data, 23 GiB used, 1.0 TiB / 1.0 TiB avail; 83 KiB/s rd, 3.4 MiB/s wr, 328 op/s 2024-05-14T15:40:06.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:05 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:40:06.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 860.0 s, 542.6 tps, lat 181.781 ms stddev 111.708 2024-05-14T15:40:07.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:07 smithi092 ceph-mon[34729]: pgmap v583: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 5.1 MiB/s wr, 513 op/s 2024-05-14T15:40:07.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:07 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:40:07.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:07 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:40:07.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:07 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:40:07.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:07 smithi069 ceph-mon[31270]: pgmap v583: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 5.1 MiB/s wr, 513 op/s 2024-05-14T15:40:07.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:07 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:40:07.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:07 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:40:07.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:07 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:40:08.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:07 smithi203 ceph-mon[34567]: pgmap v583: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 5.1 MiB/s wr, 513 op/s 2024-05-14T15:40:08.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:07 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:40:08.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:07 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:40:08.097 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:07 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:40:09.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:08 smithi092 ceph-mon[34729]: osdmap e119: 12 total, 12 up, 12 in 2024-05-14T15:40:09.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:08 smithi069 ceph-mon[31270]: osdmap e119: 12 total, 12 up, 12 in 2024-05-14T15:40:09.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:08 smithi203 ceph-mon[34567]: osdmap e119: 12 total, 12 up, 12 in 2024-05-14T15:40:10.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:09 smithi092 ceph-mon[34729]: pgmap v585: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 4.1 MiB/s wr, 399 op/s 2024-05-14T15:40:10.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:09 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:40:10.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:09 smithi069 ceph-mon[31270]: pgmap v585: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 4.1 MiB/s wr, 399 op/s 2024-05-14T15:40:10.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:09 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:40:10.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:09 smithi203 ceph-mon[34567]: pgmap v585: 129 pgs: 129 active+clean; 3.5 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 4.1 MiB/s wr, 399 op/s 2024-05-14T15:40:10.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:09 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:40:11.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 865.0 s, 316.2 tps, lat 315.229 ms stddev 535.749 2024-05-14T15:40:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.412+0000 7f6c10e00640 1 -- 172.21.15.69:0/3210110049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c0c109ac0 msgr2=0x7f6c0c1036b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.412+0000 7f6c10e00640 1 --2- 172.21.15.69:0/3210110049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c0c109ac0 0x7f6c0c1036b0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f6c04009ca0 tx=0x7f6c0402a8c0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.412+0000 7f6c10e00640 1 -- 172.21.15.69:0/3210110049 shutdown_connections 2024-05-14T15:40:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.412+0000 7f6c10e00640 1 --2- 172.21.15.69:0/3210110049 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c0c104260 0x7f6c0c1105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.412+0000 7f6c10e00640 1 --2- 172.21.15.69:0/3210110049 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c0c109f60 0x7f6c0c103bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.412+0000 7f6c10e00640 1 --2- 172.21.15.69:0/3210110049 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c0c109ac0 0x7f6c0c1036b0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.413 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.412+0000 7f6c10e00640 1 -- 172.21.15.69:0/3210110049 >> 172.21.15.69:0/3210110049 conn(0x7f6c0c079250 msgr2=0x7f6c0c079690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.412+0000 7f6c10e00640 1 -- 172.21.15.69:0/3210110049 shutdown_connections 2024-05-14T15:40:11.414 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.413+0000 7f6c10e00640 1 -- 172.21.15.69:0/3210110049 wait complete. 2024-05-14T15:40:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.414+0000 7f6c10e00640 1 Processor -- start 2024-05-14T15:40:11.415 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.415+0000 7f6c10e00640 1 -- start start 2024-05-14T15:40:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.415+0000 7f6c10e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c0c104260 0x7f6c0c1163d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.415+0000 7f6c10e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c0c109ac0 0x7f6c0c113510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.415+0000 7f6c10e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c0c109f60 0x7f6c0c113a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.415+0000 7f6c10e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c0763a0 con 0x7f6c0c104260 2024-05-14T15:40:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.415+0000 7f6c10e00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c076220 con 0x7f6c0c109ac0 2024-05-14T15:40:11.416 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.415+0000 7f6c10e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c076520 con 0x7f6c0c109f60 2024-05-14T15:40:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.416+0000 7f6c0b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c0c104260 0x7f6c0c1163d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.416+0000 7f6c0b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c0c104260 0x7f6c0c1163d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54500/0 (socket says 172.21.15.69:54500) 2024-05-14T15:40:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.416+0000 7f6c0b400640 1 -- 172.21.15.69:0/3316789273 learned_addr learned my addr 172.21.15.69:0/3316789273 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.416+0000 7f6c0aa00640 1 --2- 172.21.15.69:0/3316789273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c0c109ac0 0x7f6c0c113510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:11.417 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.416+0000 7f6c0b400640 1 -- 172.21.15.69:0/3316789273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c0c109f60 msgr2=0x7f6c0c113a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.416+0000 7f6c0b400640 1 --2- 172.21.15.69:0/3316789273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c0c109f60 0x7f6c0c113a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.416+0000 7f6c0b400640 1 -- 172.21.15.69:0/3316789273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c0c109ac0 msgr2=0x7f6c0c113510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.416+0000 7f6c0b400640 1 --2- 172.21.15.69:0/3316789273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c0c109ac0 0x7f6c0c113510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.416+0000 7f6c0b400640 1 -- 172.21.15.69:0/3316789273 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c0c1141a0 con 0x7f6c0c104260 2024-05-14T15:40:11.418 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.417+0000 7f6c0b400640 1 --2- 172.21.15.69:0/3316789273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c0c104260 0x7f6c0c1163d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6c04000f80 tx=0x7f6c04032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.417+0000 7f6c03e00640 1 -- 172.21.15.69:0/3316789273 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c04004040 con 0x7f6c0c104260 2024-05-14T15:40:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.417+0000 7f6c03e00640 1 -- 172.21.15.69:0/3316789273 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6c04004670 con 0x7f6c0c104260 2024-05-14T15:40:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.417+0000 7f6c03e00640 1 -- 172.21.15.69:0/3316789273 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c04030dd0 con 0x7f6c0c104260 2024-05-14T15:40:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.417+0000 7f6c10e00640 1 -- 172.21.15.69:0/3316789273 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c0c1ad0a0 con 0x7f6c0c104260 2024-05-14T15:40:11.419 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.418+0000 7f6c10e00640 1 -- 172.21.15.69:0/3316789273 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c0c1ad4b0 con 0x7f6c0c104260 2024-05-14T15:40:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.427+0000 7f6c193b5740 1 Processor -- start 2024-05-14T15:40:11.427 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.427+0000 7f6c193b5740 1 -- start start 2024-05-14T15:40:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.427+0000 7f6c193b5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d3b1b0 0x55dc350dc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.427+0000 7f6c193b5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d122f0 0x55dc350dc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.427+0000 7f6c193b5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d1a4d0 0x55dc350dcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.427+0000 7f6c193b5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55dc35041550 con 0x55dc34d3b1b0 2024-05-14T15:40:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.427+0000 7f6c193b5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dc34fe6bc0 con 0x55dc34d122f0 2024-05-14T15:40:11.428 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.427+0000 7f6c193b5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dc3503d510 con 0x55dc34d1a4d0 2024-05-14T15:40:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.428+0000 7f6c03e00640 1 -- 172.21.15.69:0/3316789273 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f6c040305c0 con 0x7f6c0c104260 2024-05-14T15:40:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.428+0000 7f6c0be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d3b1b0 0x55dc350dc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.428+0000 7f6c0be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d3b1b0 0x55dc350dc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54516/0 (socket says 172.21.15.69:54516) 2024-05-14T15:40:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.428+0000 7f6c0be00640 1 -- 172.21.15.69:0/2428621745 learned_addr learned my addr 172.21.15.69:0/2428621745 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:11.429 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.429+0000 7f6c0be00640 1 -- 172.21.15.69:0/2428621745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d1a4d0 msgr2=0x55dc350dcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.429+0000 7f6c0be00640 1 --2- 172.21.15.69:0/2428621745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d1a4d0 0x55dc350dcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.429+0000 7f6c0be00640 1 -- 172.21.15.69:0/2428621745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d122f0 msgr2=0x55dc350dc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.429+0000 7f6c0be00640 1 --2- 172.21.15.69:0/2428621745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d122f0 0x55dc350dc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.430 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.429+0000 7f6c0be00640 1 -- 172.21.15.69:0/2428621745 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc34d53210 con 0x55dc34d3b1b0 2024-05-14T15:40:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.430+0000 7f6c0be00640 1 --2- 172.21.15.69:0/2428621745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d3b1b0 0x55dc350dc480 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800ba40 tx=0x7f6bf800bf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9289836e3a03eb4c server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.430+0000 7f6c03e00640 1 --2- 172.21.15.69:0/3316789273 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6bf00b2bd0 0x7f6bf00b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.431 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.430+0000 7f6c03e00640 1 -- 172.21.15.69:0/3316789273 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 9642+0+0 (secure 0 0 0) 0x7f6c04104380 con 0x7f6c0c104260 2024-05-14T15:40:11.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.431+0000 7f6c00c00640 1 -- 172.21.15.69:0/2428621745 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8016070 con 0x55dc34d3b1b0 2024-05-14T15:40:11.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.431+0000 7f6c0b400640 1 --2- 172.21.15.69:0/3316789273 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6bf00b2bd0 0x7f6bf00b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:11.432 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.431+0000 7f6c00c00640 1 -- 172.21.15.69:0/2428621745 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bf800dc40 con 0x55dc34d3b1b0 2024-05-14T15:40:11.433 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.431+0000 7f6c00c00640 1 -- 172.21.15.69:0/2428621745 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8003c60 con 0x55dc34d3b1b0 2024-05-14T15:40:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.433+0000 7f6c193b5740 1 -- 172.21.15.69:0/2428621745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d3b1b0 msgr2=0x55dc350dc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:11.434 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.433+0000 7f6c193b5740 1 --2- 172.21.15.69:0/2428621745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d3b1b0 0x55dc350dc480 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f6bf800ba40 tx=0x7f6bf800bf00 comp rx=0 tx=0).stop 2024-05-14T15:40:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.434+0000 7f6c0b400640 1 --2- 172.21.15.69:0/3316789273 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6bf00b2bd0 0x7f6bf00b50e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55dc350d9f70 tx=0x7f6c04009a00 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.435+0000 7f6c193b5740 1 -- 172.21.15.69:0/2428621745 shutdown_connections 2024-05-14T15:40:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.435+0000 7f6c193b5740 1 --2- 172.21.15.69:0/2428621745 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d1a4d0 0x55dc350dcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.435 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.435+0000 7f6c193b5740 1 --2- 172.21.15.69:0/2428621745 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d122f0 0x55dc350dc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.435+0000 7f6c193b5740 1 --2- 172.21.15.69:0/2428621745 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d3b1b0 0x55dc350dc480 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.435+0000 7f6c193b5740 1 -- 172.21.15.69:0/2428621745 >> 172.21.15.69:0/2428621745 conn(0x55dc34d2f300 msgr2=0x55dc350d8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.435+0000 7f6c193b5740 1 -- 172.21.15.69:0/2428621745 shutdown_connections 2024-05-14T15:40:11.436 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.435+0000 7f6c193b5740 1 -- 172.21.15.69:0/2428621745 wait complete. 2024-05-14T15:40:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.436+0000 7f6c193b5740 1 -- start start 2024-05-14T15:40:11.437 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.436+0000 7f6c193b5740 1 Processor -- start 2024-05-14T15:40:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.437+0000 7f6c193b5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d122f0 0x55dc350e6960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.438+0000 7f6c193b5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d1a4d0 0x55dc350e6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.439 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.438+0000 7f6c193b5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d3b1b0 0x55dc350f2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.438+0000 7f6c193b5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55dc350e95b0 con 0x55dc34d122f0 2024-05-14T15:40:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.438+0000 7f6c193b5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55dc34ffa660 con 0x55dc34d3b1b0 2024-05-14T15:40:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.438+0000 7f6c193b5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55dc350e9730 con 0x55dc34d1a4d0 2024-05-14T15:40:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.438+0000 7f6c193b5740 10 client.0 _ll_register_callbacks cb 0x55dc34fc4400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:40:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.439+0000 7f6c0be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d122f0 0x55dc350e6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:11.440 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.440+0000 7f6c0be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d122f0 0x55dc350e6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:54528/0 (socket says 172.21.15.69:54528) 2024-05-14T15:40:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.440+0000 7f6c0be00640 1 -- 172.21.15.69:0/1260480344 learned_addr learned my addr 172.21.15.69:0/1260480344 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.440+0000 7f6c0be00640 1 --2- 172.21.15.69:0/1260480344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d3b1b0 0x55dc350f2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.440+0000 7f6c0be00640 1 -- 172.21.15.69:0/1260480344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d1a4d0 msgr2=0x55dc350e6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.440+0000 7f6c0be00640 1 --2- 172.21.15.69:0/1260480344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d1a4d0 0x55dc350e6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.440+0000 7f6c0be00640 1 -- 172.21.15.69:0/1260480344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d3b1b0 msgr2=0x55dc350f2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.440+0000 7f6c0be00640 1 --2- 172.21.15.69:0/1260480344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d3b1b0 0x55dc350f2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.441 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.440+0000 7f6c0be00640 1 -- 172.21.15.69:0/1260480344 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc34e1f620 con 0x55dc34d122f0 2024-05-14T15:40:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.441+0000 7f6c0be00640 1 --2- 172.21.15.69:0/1260480344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d122f0 0x55dc350e6960 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8006010 tx=0x7f6bf8003800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe8406db21b02528 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.441+0000 7f6bf5600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:40:11.442 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.441+0000 7f6bf5600640 1 -- 172.21.15.69:0/1260480344 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8016040 con 0x55dc34d122f0 2024-05-14T15:40:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.442+0000 7f6bf5600640 1 -- 172.21.15.69:0/1260480344 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 9642+0+0 (secure 0 0 0) 0x7f6bf8003e00 con 0x55dc34d122f0 2024-05-14T15:40:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.442+0000 7f6c193b5740 1 -- 172.21.15.69:0/1260480344 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bf800dc40 con 0x55dc34d122f0 2024-05-14T15:40:11.443 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.442+0000 7f6bf5600640 1 -- 172.21.15.69:0/1260480344 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f6bf8004000 con 0x55dc34d122f0 2024-05-14T15:40:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.443+0000 7f6c193b5740 10 client.17496 fetch_fsmap learned FSMap version 82 2024-05-14T15:40:11.444 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.443+0000 7f6c193b5740 1 -- 172.21.15.69:0/1260480344 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=4+}) -- 0x55dc351067f0 con 0x55dc34d122f0 2024-05-14T15:40:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.444+0000 7f6bf5600640 1 -- 172.21.15.69:0/1260480344 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bf800dc40 con 0x55dc34d122f0 2024-05-14T15:40:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.444+0000 7f6bf5600640 1 -- 172.21.15.69:0/1260480344 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 82) ==== 8414+0+0 (secure 0 0 0) 0x7f6bf8010c30 con 0x55dc34d122f0 2024-05-14T15:40:11.445 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.444+0000 7f6c193b5740 10 client.17496 fetch_fsmap finished waiting for FSMap version 82 2024-05-14T15:40:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.444+0000 7f6c193b5740 10 client.17496 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:40:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.444+0000 7f6c193b5740 20 client.17496 populate_metadata read hostname 'smithi069' 2024-05-14T15:40:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.444+0000 7f6c193b5740 1 --2- 172.21.15.69:0/1260480344 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55dc34cf9d80 0x55dc35109c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.444+0000 7f6c193b5740 4 client.17496 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:40:11.446 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.444+0000 7f6c193b5740 1 -- 172.21.15.69:0/1260480344 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dc3504f160 con 0x55dc34cf9d80 2024-05-14T15:40:11.448 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.446+0000 7f6c0aa00640 1 --2- 172.21.15.69:0/1260480344 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55dc34cf9d80 0x55dc35109c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.450+0000 7f6c0aa00640 1 --2- 172.21.15.69:0/1260480344 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55dc34cf9d80 0x55dc35109c60 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfa8894e24fdadfa server_cookie=e473424a84410581 in_seq=0 out_seq=0 2024-05-14T15:40:11.450 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.450+0000 7f6bf5600640 10 client.17496 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:40:11.451 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.451+0000 7f6bf5600640 1 -- 172.21.15.69:0/1260480344 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55dc3504f160 con 0x55dc34cf9d80 2024-05-14T15:40:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.451+0000 7f6bf5600640 10 client.17496 handle_command_reply: tid=0 2024-05-14T15:40:11.452 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.451+0000 7f6c193b5740 1 client.17496 shutdown 2024-05-14T15:40:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.452+0000 7f6c193b5740 1 -- 172.21.15.69:0/1260480344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d122f0 msgr2=0x55dc350e6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.452+0000 7f6c193b5740 1 --2- 172.21.15.69:0/1260480344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d122f0 0x55dc350e6960 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8006010 tx=0x7f6bf8003800 comp rx=0 tx=0).stop 2024-05-14T15:40:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.452+0000 7f6c193b5740 1 -- 172.21.15.69:0/1260480344 shutdown_connections 2024-05-14T15:40:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.452+0000 7f6c193b5740 1 --2- 172.21.15.69:0/1260480344 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d3b1b0 0x55dc350f2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.452+0000 7f6c193b5740 1 --2- 172.21.15.69:0/1260480344 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d1a4d0 0x55dc350e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.453 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.452+0000 7f6c193b5740 1 --2- 172.21.15.69:0/1260480344 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55dc34cf9d80 0x55dc35109c60 crc :-1 s=READY pgs=252 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.452+0000 7f6c193b5740 1 --2- 172.21.15.69:0/1260480344 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d122f0 0x55dc350e6960 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.452+0000 7f6c193b5740 1 -- 172.21.15.69:0/1260480344 >> 172.21.15.69:0/1260480344 conn(0x55dc34d2f300 msgr2=0x55dc350de1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:11.454 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.452+0000 7f6bf5600640 0 client.17496 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:40:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.455+0000 7f6c193b5740 1 -- 172.21.15.69:0/1260480344 shutdown_connections 2024-05-14T15:40:11.455 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.455+0000 7f6c193b5740 1 -- 172.21.15.69:0/1260480344 wait complete. 2024-05-14T15:40:11.456 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.455+0000 7f6c193b5740 20 client.17496 trim_cache size 0 max 16384 2024-05-14T15:40:11.517 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.515+0000 7f6c193b5740 1 Processor -- start 2024-05-14T15:40:11.520 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.520+0000 7f6c193b5740 1 -- start start 2024-05-14T15:40:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.520+0000 7f6c193b5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d122f0 0x55dc350d7c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.521 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.520+0000 7f6c193b5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d1a4d0 0x55dc3510f330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.520+0000 7f6c193b5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d3b1b0 0x55dc3510f870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.520+0000 7f6c193b5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c1af270 con 0x55dc34d122f0 2024-05-14T15:40:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.520+0000 7f6c193b5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c1b0ff0 con 0x55dc34d3b1b0 2024-05-14T15:40:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.520+0000 7f6c193b5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c1af940 con 0x55dc34d1a4d0 2024-05-14T15:40:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.521+0000 7f6c0aa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d1a4d0 0x55dc3510f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.521+0000 7f6c0aa00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d1a4d0 0x55dc3510f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:52638/0 (socket says 172.21.15.69:52638) 2024-05-14T15:40:11.522 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.521+0000 7f6c0aa00640 1 -- 172.21.15.69:0/1868636786 learned_addr learned my addr 172.21.15.69:0/1868636786 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.522+0000 7f6c0aa00640 1 -- 172.21.15.69:0/1868636786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d3b1b0 msgr2=0x55dc3510f870 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-14T15:40:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.522+0000 7f6c0aa00640 1 --2- 172.21.15.69:0/1868636786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d3b1b0 0x55dc3510f870 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.522+0000 7f6c0aa00640 1 -- 172.21.15.69:0/1868636786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d122f0 msgr2=0x55dc350d7c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:11.523 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.522+0000 7f6c0aa00640 1 --2- 172.21.15.69:0/1868636786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d122f0 0x55dc350d7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.524 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.522+0000 7f6c0aa00640 1 -- 172.21.15.69:0/1868636786 --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc3510a0c0 con 0x55dc34d1a4d0 2024-05-14T15:40:11.525 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.524+0000 7f6c0aa00640 1 --2- 172.21.15.69:0/1868636786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d1a4d0 0x55dc3510f330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00bae0 tx=0x7f6bfc005850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e881aaf40ffa0729 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.525+0000 7f6bf7e00640 1 -- 172.21.15.69:0/1868636786 <== mon.1 v2:172.21.15.203:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc003d20 con 0x55dc34d1a4d0 2024-05-14T15:40:11.526 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.525+0000 7f6bf7e00640 1 -- 172.21.15.69:0/1868636786 <== mon.1 v2:172.21.15.203:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bfc0054b0 con 0x55dc34d1a4d0 2024-05-14T15:40:11.527 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.526+0000 7f6bf7e00640 1 -- 172.21.15.69:0/1868636786 <== mon.1 v2:172.21.15.203:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bfc003d20 con 0x55dc34d1a4d0 2024-05-14T15:40:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.527+0000 7f6c193b5740 1 -- 172.21.15.69:0/1868636786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d1a4d0 msgr2=0x55dc3510f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:11.528 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.527+0000 7f6c193b5740 1 --2- 172.21.15.69:0/1868636786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d1a4d0 0x55dc3510f330 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f6bfc00bae0 tx=0x7f6bfc005850 comp rx=0 tx=0).stop 2024-05-14T15:40:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.527+0000 7f6c193b5740 1 -- 172.21.15.69:0/1868636786 shutdown_connections 2024-05-14T15:40:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.527+0000 7f6c193b5740 1 --2- 172.21.15.69:0/1868636786 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d3b1b0 0x55dc3510f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.529 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.527+0000 7f6c193b5740 1 --2- 172.21.15.69:0/1868636786 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d1a4d0 0x55dc3510f330 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.527+0000 7f6c193b5740 1 --2- 172.21.15.69:0/1868636786 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d122f0 0x55dc350d7c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.527+0000 7f6c193b5740 1 -- 172.21.15.69:0/1868636786 >> 172.21.15.69:0/1868636786 conn(0x55dc34d2f300 msgr2=0x55dc350e7e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:11.530 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.529+0000 7f6c193b5740 1 -- 172.21.15.69:0/1868636786 shutdown_connections 2024-05-14T15:40:11.531 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.530+0000 7f6c193b5740 1 -- 172.21.15.69:0/1868636786 wait complete. 2024-05-14T15:40:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.531+0000 7f6c193b5740 1 -- start start 2024-05-14T15:40:11.532 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.531+0000 7f6c193b5740 1 Processor -- start 2024-05-14T15:40:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.533+0000 7f6c193b5740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d122f0 0x55dc350e9bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.534 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.534+0000 7f6c193b5740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d1a4d0 0x55dc350ea110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.534+0000 7f6c193b5740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d3b1b0 0x55dc3516fed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.534+0000 7f6c0be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d122f0 0x55dc350e9bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.534+0000 7f6c0be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d122f0 0x55dc350e9bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.203:3300/0 says I am v2:172.21.15.69:52648/0 (socket says 172.21.15.69:52648) 2024-05-14T15:40:11.535 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.534+0000 7f6c193b5740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c1b0860 con 0x55dc34d3b1b0 2024-05-14T15:40:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.534+0000 7f6c193b5740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c1b00d0 con 0x55dc34d1a4d0 2024-05-14T15:40:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.534+0000 7f6c193b5740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f6c0c11ed90 con 0x55dc34d122f0 2024-05-14T15:40:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.535+0000 7f6c193b5740 10 client.0 _ll_register_callbacks cb 0x7f6bf800b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:40:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.535+0000 7f6c0be00640 1 -- 172.21.15.69:0/2885219963 learned_addr learned my addr 172.21.15.69:0/2885219963 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:11.536 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.535+0000 7f6c0be00640 1 --2- 172.21.15.69:0/2885219963 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d3b1b0 0x55dc3516fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.536+0000 7f6c0be00640 1 -- 172.21.15.69:0/2885219963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d122f0 msgr2=0x55dc350e9bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.536+0000 7f6c0be00640 1 --2- 172.21.15.69:0/2885219963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d122f0 0x55dc350e9bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.536+0000 7f6c0be00640 1 -- 172.21.15.69:0/2885219963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d1a4d0 msgr2=0x55dc350ea110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:11.537 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.536+0000 7f6c0aa00640 1 --2- 172.21.15.69:0/2885219963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d1a4d0 0x55dc350ea110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.536+0000 7f6c0be00640 1 --2- 172.21.15.69:0/2885219963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d1a4d0 0x55dc350ea110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.536+0000 7f6c0be00640 1 -- 172.21.15.69:0/2885219963 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc35170410 con 0x55dc34d3b1b0 2024-05-14T15:40:11.538 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.537+0000 7f6c0aa00640 1 --2- 172.21.15.69:0/2885219963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d1a4d0 0x55dc350ea110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:40:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.538+0000 7f6c0be00640 1 --2- 172.21.15.69:0/2885219963 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d3b1b0 0x55dc3516fed0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8001eb0 tx=0x7f6bf800b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75eafb8a54a656bc server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:11.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.538+0000 7f6bf5600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:40:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.539+0000 7f6bf5600640 1 -- 172.21.15.69:0/2885219963 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bf8004000 con 0x55dc34d3b1b0 2024-05-14T15:40:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.539+0000 7f6c193b5740 1 -- 172.21.15.69:0/2885219963 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6bfc0054b0 con 0x55dc34d3b1b0 2024-05-14T15:40:11.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.539+0000 7f6bf5600640 1 -- 172.21.15.69:0/2885219963 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(119..119 src has 1..119) ==== 9642+0+0 (secure 0 0 0) 0x7f6bf8024040 con 0x55dc34d3b1b0 2024-05-14T15:40:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.540+0000 7f6bf5600640 1 -- 172.21.15.69:0/2885219963 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f6bf803f050 con 0x55dc34d3b1b0 2024-05-14T15:40:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.540+0000 7f6c193b5740 10 client.17499 fetch_fsmap learned FSMap version 82 2024-05-14T15:40:11.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.540+0000 7f6c193b5740 1 -- 172.21.15.69:0/2885219963 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=4+}) -- 0x55dc35171540 con 0x55dc34d3b1b0 2024-05-14T15:40:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.541+0000 7f6bf5600640 1 -- 172.21.15.69:0/2885219963 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f6bfc0054b0 con 0x55dc34d3b1b0 2024-05-14T15:40:11.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.541+0000 7f6bf5600640 1 -- 172.21.15.69:0/2885219963 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 82) ==== 8414+0+0 (secure 0 0 0) 0x7f6bf8005030 con 0x55dc34d3b1b0 2024-05-14T15:40:11.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.543+0000 7f6c193b5740 10 client.17499 fetch_fsmap finished waiting for FSMap version 82 2024-05-14T15:40:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.543+0000 7f6c193b5740 10 client.17499 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:40:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.543+0000 7f6c193b5740 20 client.17499 populate_metadata read hostname 'smithi069' 2024-05-14T15:40:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.543+0000 7f6c193b5740 1 --2- 172.21.15.69:0/2885219963 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55dc34ccf1c0 0x55dc35173c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.543+0000 7f6c193b5740 4 client.17499 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:40:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.543+0000 7f6c193b5740 1 -- 172.21.15.69:0/2885219963 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55dc35048fd0 con 0x55dc34ccf1c0 2024-05-14T15:40:11.544 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.543+0000 7f6c0aa00640 1 --2- 172.21.15.69:0/2885219963 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55dc34ccf1c0 0x55dc35173c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.545+0000 7f6c0aa00640 1 --2- 172.21.15.69:0/2885219963 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55dc34ccf1c0 0x55dc35173c40 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=acd2f30f675def72 server_cookie=51f4d37cf8ff73cc in_seq=0 out_seq=0 2024-05-14T15:40:11.545 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.545+0000 7f6bf5600640 10 client.17499 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:40:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.584+0000 7f6bf5600640 1 -- 172.21.15.69:0/2885219963 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55dc35048fd0 con 0x55dc34ccf1c0 2024-05-14T15:40:11.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.584+0000 7f6bf5600640 10 client.17499 handle_command_reply: tid=0 2024-05-14T15:40:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.585+0000 7f6c193b5740 1 client.17499 shutdown 2024-05-14T15:40:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.586+0000 7f6c193b5740 1 -- 172.21.15.69:0/2885219963 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d3b1b0 msgr2=0x55dc3516fed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:11.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.586+0000 7f6c193b5740 1 --2- 172.21.15.69:0/2885219963 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d3b1b0 0x55dc3516fed0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f6bf8001eb0 tx=0x7f6bf800b7c0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.586+0000 7f6c193b5740 1 -- 172.21.15.69:0/2885219963 shutdown_connections 2024-05-14T15:40:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.586+0000 7f6c193b5740 1 --2- 172.21.15.69:0/2885219963 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55dc34ccf1c0 0x55dc35173c40 crc :-1 s=READY pgs=253 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.586+0000 7f6c193b5740 1 --2- 172.21.15.69:0/2885219963 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55dc34d3b1b0 0x55dc3516fed0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.586+0000 7f6c193b5740 1 --2- 172.21.15.69:0/2885219963 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55dc34d1a4d0 0x55dc350ea110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.586+0000 7f6c193b5740 1 --2- 172.21.15.69:0/2885219963 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55dc34d122f0 0x55dc350e9bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.586+0000 7f6c193b5740 1 -- 172.21.15.69:0/2885219963 >> 172.21.15.69:0/2885219963 conn(0x55dc34d2f300 msgr2=0x55dc350d79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:11.587 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.586+0000 7f6bf5600640 0 client.17499 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:40:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.586+0000 7f6c193b5740 1 -- 172.21.15.69:0/2885219963 shutdown_connections 2024-05-14T15:40:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.587+0000 7f6c193b5740 1 -- 172.21.15.69:0/2885219963 wait complete. 2024-05-14T15:40:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.587+0000 7f6c193b5740 20 client.17499 trim_cache size 0 max 16384 2024-05-14T15:40:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:40:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:40:11.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:40:11.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:40:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.589+0000 7f6c10e00640 1 -- 172.21.15.69:0/3316789273 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6bf00b2bd0 msgr2=0x7f6bf00b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.590+0000 7f6c10e00640 1 --2- 172.21.15.69:0/3316789273 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6bf00b2bd0 0x7f6bf00b50e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x55dc350d9f70 tx=0x7f6c04009a00 comp rx=0 tx=0).stop 2024-05-14T15:40:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.590+0000 7f6c10e00640 1 -- 172.21.15.69:0/3316789273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c0c104260 msgr2=0x7f6c0c1163d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.590+0000 7f6c10e00640 1 --2- 172.21.15.69:0/3316789273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c0c104260 0x7f6c0c1163d0 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f6c04000f80 tx=0x7f6c04032c10 comp rx=0 tx=0).stop 2024-05-14T15:40:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.590+0000 7f6c10e00640 1 -- 172.21.15.69:0/3316789273 shutdown_connections 2024-05-14T15:40:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.590+0000 7f6c10e00640 1 --2- 172.21.15.69:0/3316789273 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f6bf00b2bd0 0x7f6bf00b50e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.590+0000 7f6c10e00640 1 --2- 172.21.15.69:0/3316789273 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f6c0c109f60 0x7f6c0c113a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.591 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.590+0000 7f6c10e00640 1 --2- 172.21.15.69:0/3316789273 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f6c0c109ac0 0x7f6c0c113510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.590+0000 7f6c10e00640 1 --2- 172.21.15.69:0/3316789273 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f6c0c104260 0x7f6c0c1163d0 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.590+0000 7f6c10e00640 1 -- 172.21.15.69:0/3316789273 >> 172.21.15.69:0/3316789273 conn(0x7f6c0c079250 msgr2=0x7f6c0c105160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:11.592 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.592+0000 7f6c10e00640 1 -- 172.21.15.69:0/3316789273 shutdown_connections 2024-05-14T15:40:11.593 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:11.592+0000 7f6c10e00640 1 -- 172.21.15.69:0/3316789273 wait complete. 2024-05-14T15:40:12.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:11 smithi092 ceph-mon[34729]: pgmap v586: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.4 MiB/s wr, 526 op/s 2024-05-14T15:40:12.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:11 smithi069 ceph-mon[31270]: pgmap v586: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.4 MiB/s wr, 526 op/s 2024-05-14T15:40:12.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:11 smithi203 ceph-mon[34567]: pgmap v586: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 6.4 MiB/s wr, 526 op/s 2024-05-14T15:40:14.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:13 smithi092 ceph-mon[34729]: pgmap v587: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 6.8 MiB/s wr, 519 op/s 2024-05-14T15:40:14.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:13 smithi069 ceph-mon[31270]: pgmap v587: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 6.8 MiB/s wr, 519 op/s 2024-05-14T15:40:14.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:13 smithi203 ceph-mon[34567]: pgmap v587: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 91 KiB/s rd, 6.8 MiB/s wr, 519 op/s 2024-05-14T15:40:16.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:15 smithi092 ceph-mon[34729]: pgmap v588: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 6.3 MiB/s wr, 509 op/s 2024-05-14T15:40:16.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:15 smithi092 ceph-mon[34729]: osdmap e120: 12 total, 12 up, 12 in 2024-05-14T15:40:16.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:15 smithi069 ceph-mon[31270]: pgmap v588: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 6.3 MiB/s wr, 509 op/s 2024-05-14T15:40:16.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:15 smithi069 ceph-mon[31270]: osdmap e120: 12 total, 12 up, 12 in 2024-05-14T15:40:16.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:15 smithi203 ceph-mon[34567]: pgmap v588: 129 pgs: 129 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 6.3 MiB/s wr, 509 op/s 2024-05-14T15:40:16.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:15 smithi203 ceph-mon[34567]: osdmap e120: 12 total, 12 up, 12 in 2024-05-14T15:40:16.370 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 870.0 s, 276.1 tps, lat 149.489 ms stddev 112.849 2024-05-14T15:40:18.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:17 smithi092 ceph-mon[34729]: pgmap v590: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 7.0 MiB/s wr, 529 op/s 2024-05-14T15:40:18.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:17 smithi069 ceph-mon[31270]: pgmap v590: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 7.0 MiB/s wr, 529 op/s 2024-05-14T15:40:18.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:17 smithi203 ceph-mon[34567]: pgmap v590: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 108 KiB/s rd, 7.0 MiB/s wr, 529 op/s 2024-05-14T15:40:20.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:19 smithi092 ceph-mon[34729]: pgmap v591: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.0 MiB/s wr, 454 op/s 2024-05-14T15:40:20.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:19 smithi069 ceph-mon[31270]: pgmap v591: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.0 MiB/s wr, 454 op/s 2024-05-14T15:40:20.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:19 smithi203 ceph-mon[34567]: pgmap v591: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 6.0 MiB/s wr, 454 op/s 2024-05-14T15:40:21.368 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 875.0 s, 186.7 tps, lat 765.658 ms stddev 1309.116 2024-05-14T15:40:22.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:21 smithi069 ceph-mon[31270]: pgmap v592: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 3.6 MiB/s wr, 333 op/s 2024-05-14T15:40:22.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:21 smithi203 ceph-mon[34567]: pgmap v592: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 3.6 MiB/s wr, 333 op/s 2024-05-14T15:40:22.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:21 smithi092 ceph-mon[34729]: pgmap v592: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 92 KiB/s rd, 3.6 MiB/s wr, 333 op/s 2024-05-14T15:40:24.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:23 smithi069 ceph-mon[31270]: pgmap v593: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 3.1 MiB/s wr, 312 op/s 2024-05-14T15:40:24.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:23 smithi203 ceph-mon[34567]: pgmap v593: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 3.1 MiB/s wr, 312 op/s 2024-05-14T15:40:24.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:23 smithi092 ceph-mon[34729]: pgmap v593: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 3.1 MiB/s wr, 312 op/s 2024-05-14T15:40:24.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.832+0000 7fa19f200640 1 -- 172.21.15.69:0/3472984508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a0109f60 msgr2=0x7fa1a01020d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:24.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.832+0000 7fa19f200640 1 --2- 172.21.15.69:0/3472984508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a0109f60 0x7fa1a01020d0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7fa18c009900 tx=0x7fa18c02a3f0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.833 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.832+0000 7fa19f200640 1 -- 172.21.15.69:0/3472984508 shutdown_connections 2024-05-14T15:40:24.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.832+0000 7fa19f200640 1 --2- 172.21.15.69:0/3472984508 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a0102760 0x7fa1a01105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.832+0000 7fa19f200640 1 --2- 172.21.15.69:0/3472984508 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a0109f60 0x7fa1a01020d0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.832+0000 7fa19f200640 1 --2- 172.21.15.69:0/3472984508 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1a0109ac0 0x7fa1a0101b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.832+0000 7fa19f200640 1 -- 172.21.15.69:0/3472984508 >> 172.21.15.69:0/3472984508 conn(0x7fa1a00fd7e0 msgr2=0x7fa1a00ffc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:24.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.832+0000 7fa19f200640 1 -- 172.21.15.69:0/3472984508 shutdown_connections 2024-05-14T15:40:24.834 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.832+0000 7fa19f200640 1 -- 172.21.15.69:0/3472984508 wait complete. 2024-05-14T15:40:24.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.834+0000 7fa19f200640 1 Processor -- start 2024-05-14T15:40:24.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.834+0000 7fa19f200640 1 -- start start 2024-05-14T15:40:24.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.834+0000 7fa19f200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a0109ac0 0x7fa1a010d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.834+0000 7fa19f200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1a010d590 0x7fa1a01a0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.834+0000 7fa19f200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a01a0d60 0x7fa1a01a1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.834+0000 7fa19f200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a0113bb0 con 0x7fa1a01a0d60 2024-05-14T15:40:24.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.834+0000 7fa19f200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a0113a30 con 0x7fa1a0109ac0 2024-05-14T15:40:24.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.834+0000 7fa19f200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a0113d30 con 0x7fa1a010d590 2024-05-14T15:40:24.836 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.835+0000 7fa19e800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a01a0d60 0x7fa1a01a1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.835+0000 7fa19e800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a01a0d60 0x7fa1a01a1170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36030/0 (socket says 172.21.15.69:36030) 2024-05-14T15:40:24.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.835+0000 7fa19e800640 1 -- 172.21.15.69:0/1314403921 learned_addr learned my addr 172.21.15.69:0/1314403921 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:24.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.835+0000 7fa19d400640 1 --2- 172.21.15.69:0/1314403921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1a010d590 0x7fa1a01a0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.835+0000 7fa19de00640 1 --2- 172.21.15.69:0/1314403921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a0109ac0 0x7fa1a010d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.835+0000 7fa19e800640 1 -- 172.21.15.69:0/1314403921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1a010d590 msgr2=0x7fa1a01a0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:24.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.835+0000 7fa19e800640 1 --2- 172.21.15.69:0/1314403921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1a010d590 0x7fa1a01a0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.835+0000 7fa19e800640 1 -- 172.21.15.69:0/1314403921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a0109ac0 msgr2=0x7fa1a010d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:24.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.835+0000 7fa19e800640 1 --2- 172.21.15.69:0/1314403921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a0109ac0 0x7fa1a010d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.835+0000 7fa19e800640 1 -- 172.21.15.69:0/1314403921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1a010dc40 con 0x7fa1a01a0d60 2024-05-14T15:40:24.837 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.835+0000 7fa19e800640 1 --2- 172.21.15.69:0/1314403921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a01a0d60 0x7fa1a01a1170 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fa19800cce0 tx=0x7fa19800a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:24.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.836+0000 7fa196a00640 1 -- 172.21.15.69:0/1314403921 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19800f450 con 0x7fa1a01a0d60 2024-05-14T15:40:24.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.836+0000 7fa196a00640 1 -- 172.21.15.69:0/1314403921 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa19800fa80 con 0x7fa1a01a0d60 2024-05-14T15:40:24.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.836+0000 7fa19f200640 1 -- 172.21.15.69:0/1314403921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1a01a8b90 con 0x7fa1a01a0d60 2024-05-14T15:40:24.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.836+0000 7fa196a00640 1 -- 172.21.15.69:0/1314403921 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa198018ad0 con 0x7fa1a01a0d60 2024-05-14T15:40:24.838 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.836+0000 7fa19f200640 1 -- 172.21.15.69:0/1314403921 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1a01a9060 con 0x7fa1a01a0d60 2024-05-14T15:40:24.841 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.840+0000 7fa1abdd6740 1 Processor -- start 2024-05-14T15:40:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.841+0000 7fa196a00640 1 -- 172.21.15.69:0/1314403921 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa19800f5f0 con 0x7fa1a01a0d60 2024-05-14T15:40:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.841+0000 7fa1abdd6740 1 -- start start 2024-05-14T15:40:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.841+0000 7fa1abdd6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeba11b0 0x55cbdef42480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.849 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.841+0000 7fa1abdd6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeb782f0 0x55cbdef429c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.841+0000 7fa1abdd6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb804d0 0x55cbdef42f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.841+0000 7fa1abdd6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cbdeea7550 con 0x55cbdeb804d0 2024-05-14T15:40:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.841+0000 7fa1abdd6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cbdee4cbc0 con 0x55cbdeba11b0 2024-05-14T15:40:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.841+0000 7fa1abdd6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cbdeea3510 con 0x55cbdeb782f0 2024-05-14T15:40:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.842+0000 7fa19d400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb804d0 0x55cbdef42f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.842+0000 7fa19d400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb804d0 0x55cbdef42f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36040/0 (socket says 172.21.15.69:36040) 2024-05-14T15:40:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.842+0000 7fa19d400640 1 -- 172.21.15.69:0/3350958549 learned_addr learned my addr 172.21.15.69:0/3350958549 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.842+0000 7fa19de00640 1 --2- 172.21.15.69:0/3350958549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeb782f0 0x55cbdef429c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.842+0000 7fa19d400640 1 --2- 172.21.15.69:0/3350958549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeba11b0 0x55cbdef42480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.842+0000 7fa19d400640 1 -- 172.21.15.69:0/3350958549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeb782f0 msgr2=0x55cbdef429c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.842+0000 7fa19d400640 1 --2- 172.21.15.69:0/3350958549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeb782f0 0x55cbdef429c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.842+0000 7fa19d400640 1 -- 172.21.15.69:0/3350958549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeba11b0 msgr2=0x55cbdef42480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.842+0000 7fa19d400640 1 --2- 172.21.15.69:0/3350958549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeba11b0 0x55cbdef42480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.842+0000 7fa19d400640 1 -- 172.21.15.69:0/3350958549 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbdebb9210 con 0x55cbdeb804d0 2024-05-14T15:40:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.842+0000 7fa19d400640 1 --2- 172.21.15.69:0/3350958549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb804d0 0x55cbdef42f00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x55cbdef3f5f0 tx=0x7fa18c005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50fb61a70ba408f0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.843+0000 7fa196a00640 1 --2- 172.21.15.69:0/1314403921 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1840b2950 0x7fa1840b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.843+0000 7fa18b400640 1 -- 172.21.15.69:0/3350958549 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c043020 con 0x55cbdeb804d0 2024-05-14T15:40:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.843+0000 7fa18b400640 1 -- 172.21.15.69:0/3350958549 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa18c005400 con 0x55cbdeb804d0 2024-05-14T15:40:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.843+0000 7fa18b400640 1 -- 172.21.15.69:0/3350958549 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c035070 con 0x55cbdeb804d0 2024-05-14T15:40:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.843+0000 7fa196a00640 1 -- 172.21.15.69:0/1314403921 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9554+0+0 (secure 0 0 0) 0x7fa1980e32e0 con 0x7fa1a01a0d60 2024-05-14T15:40:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.843+0000 7fa19de00640 1 --2- 172.21.15.69:0/1314403921 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1840b2950 0x7fa1840b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.844+0000 7fa1abdd6740 1 -- 172.21.15.69:0/3350958549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb804d0 msgr2=0x55cbdef42f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.844+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/3350958549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb804d0 0x55cbdef42f00 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x55cbdef3f5f0 tx=0x7fa18c005d50 comp rx=0 tx=0).stop 2024-05-14T15:40:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.844+0000 7fa19de00640 1 --2- 172.21.15.69:0/1314403921 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1840b2950 0x7fa1840b4e60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa190005fd0 tx=0x7fa190005cf0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.844+0000 7fa1abdd6740 1 -- 172.21.15.69:0/3350958549 shutdown_connections 2024-05-14T15:40:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.844+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/3350958549 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb804d0 0x55cbdef42f00 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.844+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/3350958549 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeb782f0 0x55cbdef429c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.844+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/3350958549 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeba11b0 0x55cbdef42480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.844+0000 7fa1abdd6740 1 -- 172.21.15.69:0/3350958549 >> 172.21.15.69:0/3350958549 conn(0x55cbdeb95300 msgr2=0x55cbdef3ec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.844+0000 7fa1abdd6740 1 -- 172.21.15.69:0/3350958549 shutdown_connections 2024-05-14T15:40:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.844+0000 7fa1abdd6740 1 -- 172.21.15.69:0/3350958549 wait complete. 2024-05-14T15:40:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.845+0000 7fa1abdd6740 1 -- start start 2024-05-14T15:40:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.845+0000 7fa1abdd6740 1 Processor -- start 2024-05-14T15:40:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.845+0000 7fa1abdd6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb782f0 0x55cbdef4c990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.845+0000 7fa1abdd6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeb804d0 0x55cbdef4ced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.845+0000 7fa1abdd6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeba11b0 0x55cbdef58a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.845+0000 7fa1abdd6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cbdef4f550 con 0x55cbdeb782f0 2024-05-14T15:40:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.845+0000 7fa1abdd6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cbdee60660 con 0x55cbdeba11b0 2024-05-14T15:40:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.845+0000 7fa1abdd6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cbdef4f6d0 con 0x55cbdeb804d0 2024-05-14T15:40:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.845+0000 7fa1abdd6740 10 client.0 _ll_register_callbacks cb 0x55cbdee2a400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:40:24.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.846+0000 7fa19de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb782f0 0x55cbdef4c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.846+0000 7fa19de00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb782f0 0x55cbdef4c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36056/0 (socket says 172.21.15.69:36056) 2024-05-14T15:40:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.846+0000 7fa19de00640 1 -- 172.21.15.69:0/3796079994 learned_addr learned my addr 172.21.15.69:0/3796079994 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.846+0000 7fa19e800640 1 --2- 172.21.15.69:0/3796079994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeba11b0 0x55cbdef58a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.846+0000 7fa19d400640 1 --2- 172.21.15.69:0/3796079994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeb804d0 0x55cbdef4ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.846+0000 7fa19de00640 1 -- 172.21.15.69:0/3796079994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeb804d0 msgr2=0x55cbdef4ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.846+0000 7fa19de00640 1 --2- 172.21.15.69:0/3796079994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeb804d0 0x55cbdef4ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.846+0000 7fa19de00640 1 -- 172.21.15.69:0/3796079994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeba11b0 msgr2=0x55cbdef58a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.846+0000 7fa19de00640 1 --2- 172.21.15.69:0/3796079994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeba11b0 0x55cbdef58a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.846+0000 7fa19de00640 1 -- 172.21.15.69:0/3796079994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbdec85620 con 0x55cbdeb782f0 2024-05-14T15:40:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.846+0000 7fa19de00640 1 --2- 172.21.15.69:0/3796079994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb782f0 0x55cbdef4c990 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa1a006b4d0 tx=0x7fa1900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1008cfe924f0a673 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.846+0000 7fa17fe00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:40:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.847+0000 7fa17fe00640 1 -- 172.21.15.69:0/3796079994 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19001f9b0 con 0x55cbdeb782f0 2024-05-14T15:40:24.853 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.847+0000 7fa1abdd6740 1 -- 172.21.15.69:0/3796079994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa18c005400 con 0x55cbdeb782f0 2024-05-14T15:40:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.847+0000 7fa17fe00640 1 -- 172.21.15.69:0/3796079994 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9554+0+0 (secure 0 0 0) 0x7fa19001fb50 con 0x55cbdeb782f0 2024-05-14T15:40:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.847+0000 7fa17fe00640 1 -- 172.21.15.69:0/3796079994 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fa190030050 con 0x55cbdeb782f0 2024-05-14T15:40:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.847+0000 7fa1abdd6740 10 client.17511 fetch_fsmap learned FSMap version 82 2024-05-14T15:40:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.847+0000 7fa1abdd6740 1 -- 172.21.15.69:0/3796079994 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=4+}) -- 0x55cbdef5b820 con 0x55cbdeb782f0 2024-05-14T15:40:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.847+0000 7fa17fe00640 1 -- 172.21.15.69:0/3796079994 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa18c005400 con 0x55cbdeb782f0 2024-05-14T15:40:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.848+0000 7fa17fe00640 1 -- 172.21.15.69:0/3796079994 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 82) ==== 8414+0+0 (secure 0 0 0) 0x7fa19001d3b0 con 0x55cbdeb782f0 2024-05-14T15:40:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.848+0000 7fa1abdd6740 10 client.17511 fetch_fsmap finished waiting for FSMap version 82 2024-05-14T15:40:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.848+0000 7fa1abdd6740 10 client.17511 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:40:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.848+0000 7fa1abdd6740 20 client.17511 populate_metadata read hostname 'smithi069' 2024-05-14T15:40:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.848+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/3796079994 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cbdeb5fd80 0x55cbdef5edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.848+0000 7fa1abdd6740 4 client.17511 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:40:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.848+0000 7fa1abdd6740 1 -- 172.21.15.69:0/3796079994 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cbdeeb5160 con 0x55cbdeb5fd80 2024-05-14T15:40:24.854 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.848+0000 7fa19d400640 1 --2- 172.21.15.69:0/3796079994 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cbdeb5fd80 0x55cbdef5edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.849+0000 7fa17fe00640 10 client.17511 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:40:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.849+0000 7fa19d400640 1 --2- 172.21.15.69:0/3796079994 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cbdeb5fd80 0x55cbdef5edd0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7b312393c1a8156 server_cookie=8456d3f4af91b577 in_seq=0 out_seq=0 2024-05-14T15:40:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.851+0000 7fa17fe00640 1 -- 172.21.15.69:0/3796079994 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cbdeeb5160 con 0x55cbdeb5fd80 2024-05-14T15:40:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.851+0000 7fa17fe00640 10 client.17511 handle_command_reply: tid=0 2024-05-14T15:40:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.852+0000 7fa1abdd6740 1 client.17511 shutdown 2024-05-14T15:40:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.852+0000 7fa1abdd6740 1 -- 172.21.15.69:0/3796079994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb782f0 msgr2=0x55cbdef4c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.852+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/3796079994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb782f0 0x55cbdef4c990 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa1a006b4d0 tx=0x7fa1900046c0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.852+0000 7fa1abdd6740 1 -- 172.21.15.69:0/3796079994 shutdown_connections 2024-05-14T15:40:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.852+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/3796079994 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeba11b0 0x55cbdef58a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.852+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/3796079994 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeb804d0 0x55cbdef4ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.856 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.852+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/3796079994 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cbdeb5fd80 0x55cbdef5edd0 crc :-1 s=READY pgs=254 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.852+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/3796079994 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb782f0 0x55cbdef4c990 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.852+0000 7fa1abdd6740 1 -- 172.21.15.69:0/3796079994 >> 172.21.15.69:0/3796079994 conn(0x55cbdeb95300 msgr2=0x55cbdef441a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.852+0000 7fa17fe00640 0 client.17511 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:40:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.852+0000 7fa1abdd6740 1 -- 172.21.15.69:0/3796079994 shutdown_connections 2024-05-14T15:40:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.852+0000 7fa1abdd6740 1 -- 172.21.15.69:0/3796079994 wait complete. 2024-05-14T15:40:24.857 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.852+0000 7fa1abdd6740 20 client.17511 trim_cache size 0 max 16384 2024-05-14T15:40:24.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.869+0000 7fa1abdd6740 1 Processor -- start 2024-05-14T15:40:24.870 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.869+0000 7fa1abdd6740 1 -- start start 2024-05-14T15:40:24.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.870+0000 7fa1abdd6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeb782f0 0x55cbdef43410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.870+0000 7fa1abdd6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb804d0 0x55cbdef4e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.870+0000 7fa1abdd6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeba11b0 0x55cbdef645d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.871 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.870+0000 7fa1abdd6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a01b32b0 con 0x55cbdeb804d0 2024-05-14T15:40:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.870+0000 7fa1abdd6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a01b5030 con 0x55cbdeb782f0 2024-05-14T15:40:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.870+0000 7fa1abdd6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a01b3980 con 0x55cbdeba11b0 2024-05-14T15:40:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.870+0000 7fa19d400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb804d0 0x55cbdef4e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.870+0000 7fa19d400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb804d0 0x55cbdef4e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36064/0 (socket says 172.21.15.69:36064) 2024-05-14T15:40:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.870+0000 7fa19d400640 1 -- 172.21.15.69:0/4079461348 learned_addr learned my addr 172.21.15.69:0/4079461348 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.870+0000 7fa19e800640 1 --2- 172.21.15.69:0/4079461348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeba11b0 0x55cbdef645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.870+0000 7fa19de00640 1 --2- 172.21.15.69:0/4079461348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeb782f0 0x55cbdef43410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.871+0000 7fa19d400640 1 -- 172.21.15.69:0/4079461348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeba11b0 msgr2=0x55cbdef645d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.871+0000 7fa19d400640 1 --2- 172.21.15.69:0/4079461348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeba11b0 0x55cbdef645d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.872 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.871+0000 7fa19d400640 1 -- 172.21.15.69:0/4079461348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeb782f0 msgr2=0x55cbdef43410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.871+0000 7fa19d400640 1 --2- 172.21.15.69:0/4079461348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeb782f0 0x55cbdef43410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.873 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.871+0000 7fa19d400640 1 -- 172.21.15.69:0/4079461348 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cbdef4acd0 con 0x55cbdeb804d0 2024-05-14T15:40:24.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.871+0000 7fa19d400640 1 --2- 172.21.15.69:0/4079461348 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb804d0 0x55cbdef4e8d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0096c0 tx=0x7fa18c02a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92656fac3979ef2 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:24.876 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.871+0000 7fa18aa00640 1 -- 172.21.15.69:0/4079461348 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c035070 con 0x55cbdeb804d0 2024-05-14T15:40:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.871+0000 7fa18aa00640 1 -- 172.21.15.69:0/4079461348 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa18c004310 con 0x55cbdeb804d0 2024-05-14T15:40:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.871+0000 7fa18aa00640 1 -- 172.21.15.69:0/4079461348 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18c043040 con 0x55cbdeb804d0 2024-05-14T15:40:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.872+0000 7fa1abdd6740 1 -- 172.21.15.69:0/4079461348 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb804d0 msgr2=0x55cbdef4e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.872+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/4079461348 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb804d0 0x55cbdef4e8d0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7fa18c0096c0 tx=0x7fa18c02a3f0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.872+0000 7fa1abdd6740 1 -- 172.21.15.69:0/4079461348 shutdown_connections 2024-05-14T15:40:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.872+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/4079461348 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeba11b0 0x55cbdef645d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.872+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/4079461348 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb804d0 0x55cbdef4e8d0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.872+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/4079461348 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeb782f0 0x55cbdef43410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.872+0000 7fa1abdd6740 1 -- 172.21.15.69:0/4079461348 >> 172.21.15.69:0/4079461348 conn(0x55cbdeb95300 msgr2=0x55cbdef3dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.872+0000 7fa1abdd6740 1 -- 172.21.15.69:0/4079461348 shutdown_connections 2024-05-14T15:40:24.877 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.872+0000 7fa1abdd6740 1 -- 172.21.15.69:0/4079461348 wait complete. 2024-05-14T15:40:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.873+0000 7fa1abdd6740 1 -- start start 2024-05-14T15:40:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.873+0000 7fa1abdd6740 1 Processor -- start 2024-05-14T15:40:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.873+0000 7fa1abdd6740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeb782f0 0x55cbdef54cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.873+0000 7fa1abdd6740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeba11b0 0x55cbdef50000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.873+0000 7fa1abdd6740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb351c0 0x55cbdef50540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.873+0000 7fa1abdd6740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a01b48a0 con 0x55cbdeb351c0 2024-05-14T15:40:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.873+0000 7fa1abdd6740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a01b4110 con 0x55cbdeb782f0 2024-05-14T15:40:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.874+0000 7fa1abdd6740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa1a01b12b0 con 0x55cbdeba11b0 2024-05-14T15:40:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.874+0000 7fa1abdd6740 10 client.0 _ll_register_callbacks cb 0x7fa190011c10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:40:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.874+0000 7fa19e800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb351c0 0x55cbdef50540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.874+0000 7fa19e800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb351c0 0x55cbdef50540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36080/0 (socket says 172.21.15.69:36080) 2024-05-14T15:40:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.874+0000 7fa19e800640 1 -- 172.21.15.69:0/2085010354 learned_addr learned my addr 172.21.15.69:0/2085010354 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.874+0000 7fa19de00640 1 --2- 172.21.15.69:0/2085010354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeb782f0 0x55cbdef54cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.878 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.874+0000 7fa19d400640 1 --2- 172.21.15.69:0/2085010354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeba11b0 0x55cbdef50000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.874+0000 7fa19e800640 1 -- 172.21.15.69:0/2085010354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeba11b0 msgr2=0x55cbdef50000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.874+0000 7fa19e800640 1 --2- 172.21.15.69:0/2085010354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeba11b0 0x55cbdef50000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.874+0000 7fa19e800640 1 -- 172.21.15.69:0/2085010354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeb782f0 msgr2=0x55cbdef54cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.874+0000 7fa19e800640 1 --2- 172.21.15.69:0/2085010354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeb782f0 0x55cbdef54cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.874+0000 7fa19e800640 1 -- 172.21.15.69:0/2085010354 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cbdef50a80 con 0x55cbdeb351c0 2024-05-14T15:40:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.875+0000 7fa19e800640 1 --2- 172.21.15.69:0/2085010354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb351c0 0x55cbdef50540 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa1980e0660 tx=0x7fa19800f9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242a33280c60e9f5 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.875+0000 7fa17fe00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:40:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.875+0000 7fa17fe00640 1 -- 172.21.15.69:0/2085010354 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1980c3070 con 0x55cbdeb351c0 2024-05-14T15:40:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.875+0000 7fa17fe00640 1 -- 172.21.15.69:0/2085010354 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9554+0+0 (secure 0 0 0) 0x7fa1980ae170 con 0x55cbdeb351c0 2024-05-14T15:40:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.875+0000 7fa1abdd6740 1 -- 172.21.15.69:0/2085010354 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa18c004310 con 0x55cbdeb351c0 2024-05-14T15:40:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.875+0000 7fa17fe00640 1 -- 172.21.15.69:0/2085010354 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fa1980aa190 con 0x55cbdeb351c0 2024-05-14T15:40:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.875+0000 7fa1abdd6740 10 client.17517 fetch_fsmap learned FSMap version 82 2024-05-14T15:40:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.875+0000 7fa1abdd6740 1 -- 172.21.15.69:0/2085010354 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=4+}) -- 0x55cbdefc6ea0 con 0x55cbdeb351c0 2024-05-14T15:40:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.875+0000 7fa17fe00640 1 -- 172.21.15.69:0/2085010354 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa18c004310 con 0x55cbdeb351c0 2024-05-14T15:40:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.875+0000 7fa17fe00640 1 -- 172.21.15.69:0/2085010354 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 82) ==== 8414+0+0 (secure 0 0 0) 0x7fa198069bb0 con 0x55cbdeb351c0 2024-05-14T15:40:24.879 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.876+0000 7fa1abdd6740 10 client.17517 fetch_fsmap finished waiting for FSMap version 82 2024-05-14T15:40:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.876+0000 7fa1abdd6740 10 client.17517 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:40:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.876+0000 7fa1abdd6740 20 client.17517 populate_metadata read hostname 'smithi069' 2024-05-14T15:40:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.876+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/2085010354 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cbdefc76b0 0x55cbdefc9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.876+0000 7fa1abdd6740 4 client.17517 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:40:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.876+0000 7fa1abdd6740 1 -- 172.21.15.69:0/2085010354 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cbdeeaefd0 con 0x55cbdefc76b0 2024-05-14T15:40:24.880 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.876+0000 7fa19de00640 1 --2- 172.21.15.69:0/2085010354 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cbdefc76b0 0x55cbdefc9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.877+0000 7fa17fe00640 10 client.17517 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:40:24.881 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:24.877+0000 7fa19de00640 1 --2- 172.21.15.69:0/2085010354 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cbdefc76b0 0x55cbdefc9b10 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7032aec65e52cf6 server_cookie=2e4b53096d449008 in_seq=0 out_seq=0 2024-05-14T15:40:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.538+0000 7fa17fe00640 1 -- 172.21.15.69:0/2085010354 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cbdeeaefd0 con 0x55cbdefc76b0 2024-05-14T15:40:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.538+0000 7fa17fe00640 10 client.17517 handle_command_reply: tid=0 2024-05-14T15:40:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.538+0000 7fa1abdd6740 1 client.17517 shutdown 2024-05-14T15:40:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.538+0000 7fa1abdd6740 1 -- 172.21.15.69:0/2085010354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb351c0 msgr2=0x55cbdef50540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:25.539 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.538+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/2085010354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb351c0 0x55cbdef50540 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fa1980e0660 tx=0x7fa19800f9a0 comp rx=0 tx=0).stop 2024-05-14T15:40:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.539+0000 7fa1abdd6740 1 -- 172.21.15.69:0/2085010354 shutdown_connections 2024-05-14T15:40:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.539+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/2085010354 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cbdefc76b0 0x55cbdefc9b10 crc :-1 s=READY pgs=255 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.539+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/2085010354 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cbdeb351c0 0x55cbdef50540 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:25.540 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.539+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/2085010354 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cbdeba11b0 0x55cbdef50000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.539+0000 7fa1abdd6740 1 --2- 172.21.15.69:0/2085010354 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cbdeb782f0 0x55cbdef54cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.539+0000 7fa1abdd6740 1 -- 172.21.15.69:0/2085010354 >> 172.21.15.69:0/2085010354 conn(0x55cbdeb95300 msgr2=0x55cbdef3dd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.539+0000 7fa17fe00640 0 client.17517 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:40:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.539+0000 7fa1abdd6740 1 -- 172.21.15.69:0/2085010354 shutdown_connections 2024-05-14T15:40:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.539+0000 7fa1abdd6740 1 -- 172.21.15.69:0/2085010354 wait complete. 2024-05-14T15:40:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.539+0000 7fa1abdd6740 20 client.17517 trim_cache size 0 max 16384 2024-05-14T15:40:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:40:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:40:25.541 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:40:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:40:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.541+0000 7fa19f200640 1 -- 172.21.15.69:0/1314403921 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1840b2950 msgr2=0x7fa1840b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.541+0000 7fa19f200640 1 --2- 172.21.15.69:0/1314403921 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1840b2950 0x7fa1840b4e60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa190005fd0 tx=0x7fa190005cf0 comp rx=0 tx=0).stop 2024-05-14T15:40:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.541+0000 7fa19f200640 1 -- 172.21.15.69:0/1314403921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a01a0d60 msgr2=0x7fa1a01a1170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.541+0000 7fa19f200640 1 --2- 172.21.15.69:0/1314403921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a01a0d60 0x7fa1a01a1170 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7fa19800cce0 tx=0x7fa19800a620 comp rx=0 tx=0).stop 2024-05-14T15:40:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.541+0000 7fa19f200640 1 -- 172.21.15.69:0/1314403921 shutdown_connections 2024-05-14T15:40:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.541+0000 7fa19f200640 1 --2- 172.21.15.69:0/1314403921 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa1840b2950 0x7fa1840b4e60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:25.542 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.541+0000 7fa19f200640 1 --2- 172.21.15.69:0/1314403921 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa1a01a0d60 0x7fa1a01a1170 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.541+0000 7fa19f200640 1 --2- 172.21.15.69:0/1314403921 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa1a010d590 0x7fa1a01a0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.541+0000 7fa19f200640 1 --2- 172.21.15.69:0/1314403921 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa1a0109ac0 0x7fa1a010d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.541+0000 7fa19f200640 1 -- 172.21.15.69:0/1314403921 >> 172.21.15.69:0/1314403921 conn(0x7fa1a00fd7e0 msgr2=0x7fa1a01036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.542+0000 7fa19f200640 1 -- 172.21.15.69:0/1314403921 shutdown_connections 2024-05-14T15:40:25.543 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:25.542+0000 7fa19f200640 1 -- 172.21.15.69:0/1314403921 wait complete. 2024-05-14T15:40:26.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:25 smithi069 ceph-mon[31270]: pgmap v594: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 3.0 MiB/s wr, 297 op/s 2024-05-14T15:40:26.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:25 smithi203 ceph-mon[34567]: pgmap v594: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 3.0 MiB/s wr, 297 op/s 2024-05-14T15:40:26.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 880.0 s, 58.4 tps, lat 1712.404 ms stddev 2432.052 2024-05-14T15:40:26.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:25 smithi092 ceph-mon[34729]: pgmap v594: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 3.0 MiB/s wr, 297 op/s 2024-05-14T15:40:28.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:27 smithi069 ceph-mon[31270]: pgmap v595: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 2.4 MiB/s wr, 232 op/s 2024-05-14T15:40:28.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:27 smithi203 ceph-mon[34567]: pgmap v595: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 2.4 MiB/s wr, 232 op/s 2024-05-14T15:40:28.446 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:27 smithi092 ceph-mon[34729]: pgmap v595: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 88 KiB/s rd, 2.4 MiB/s wr, 232 op/s 2024-05-14T15:40:30.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:29 smithi069 ceph-mon[31270]: pgmap v596: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 1.1 MiB/s wr, 119 op/s 2024-05-14T15:40:30.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:29 smithi203 ceph-mon[34567]: pgmap v596: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 1.1 MiB/s wr, 119 op/s 2024-05-14T15:40:30.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:29 smithi092 ceph-mon[34729]: pgmap v596: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 1.1 MiB/s wr, 119 op/s 2024-05-14T15:40:31.370 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 885.0 s, 222.5 tps, lat 288.737 ms stddev 681.980 2024-05-14T15:40:32.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:31 smithi203 ceph-mon[34567]: pgmap v597: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 1.6 MiB/s wr, 161 op/s 2024-05-14T15:40:32.356 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:31 smithi092 ceph-mon[34729]: pgmap v597: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 1.6 MiB/s wr, 161 op/s 2024-05-14T15:40:32.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:31 smithi069 ceph-mon[31270]: pgmap v597: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 1.6 MiB/s wr, 161 op/s 2024-05-14T15:40:34.280 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:33 smithi069 ceph-mon[31270]: pgmap v598: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 1005 KiB/s wr, 101 op/s 2024-05-14T15:40:34.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:33 smithi203 ceph-mon[34567]: pgmap v598: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 1005 KiB/s wr, 101 op/s 2024-05-14T15:40:34.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:33 smithi092 ceph-mon[34729]: pgmap v598: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 1005 KiB/s wr, 101 op/s 2024-05-14T15:40:36.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:35 smithi203 ceph-mon[34567]: pgmap v599: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 861 KiB/s wr, 83 op/s 2024-05-14T15:40:36.369 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 890.0 s, 136.6 tps, lat 692.912 ms stddev 1259.706 2024-05-14T15:40:36.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:35 smithi092 ceph-mon[34729]: pgmap v599: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 861 KiB/s wr, 83 op/s 2024-05-14T15:40:36.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:35 smithi069 ceph-mon[31270]: pgmap v599: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 861 KiB/s wr, 83 op/s 2024-05-14T15:40:38.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:37 smithi203 ceph-mon[34567]: pgmap v600: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 1.5 MiB/s wr, 146 op/s 2024-05-14T15:40:38.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:38 smithi092 ceph-mon[34729]: pgmap v600: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 1.5 MiB/s wr, 146 op/s 2024-05-14T15:40:38.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:37 smithi069 ceph-mon[31270]: pgmap v600: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 97 KiB/s rd, 1.5 MiB/s wr, 146 op/s 2024-05-14T15:40:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.798+0000 7fef80a00640 1 -- 172.21.15.69:0/3445786050 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef7c111df0 msgr2=0x7fef7c112280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.798+0000 7fef80a00640 1 --2- 172.21.15.69:0/3445786050 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef7c111df0 0x7fef7c112280 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fef68009900 tx=0x7fef6802a480 comp rx=0 tx=0).stop 2024-05-14T15:40:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.798+0000 7fef80a00640 1 -- 172.21.15.69:0/3445786050 shutdown_connections 2024-05-14T15:40:38.800 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.798+0000 7fef80a00640 1 --2- 172.21.15.69:0/3445786050 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c112910 0x7fef7c118ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.798+0000 7fef80a00640 1 --2- 172.21.15.69:0/3445786050 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef7c111df0 0x7fef7c112280 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.798+0000 7fef80a00640 1 --2- 172.21.15.69:0/3445786050 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c10a4a0 0x7fef7c10a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.798+0000 7fef80a00640 1 -- 172.21.15.69:0/3445786050 >> 172.21.15.69:0/3445786050 conn(0x7fef7c06e900 msgr2=0x7fef7c06ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.799+0000 7fef80a00640 1 -- 172.21.15.69:0/3445786050 shutdown_connections 2024-05-14T15:40:38.801 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.799+0000 7fef80a00640 1 -- 172.21.15.69:0/3445786050 wait complete. 2024-05-14T15:40:38.803 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.801+0000 7fef80a00640 1 Processor -- start 2024-05-14T15:40:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.801+0000 7fef80a00640 1 -- start start 2024-05-14T15:40:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.802+0000 7fef80a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef7c10a4a0 0x7fef7c1169a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.802+0000 7fef80a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c111df0 0x7fef7c116ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.802+0000 7fef80a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c112910 0x7fef7c1af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.802+0000 7fef80a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c10d8e0 con 0x7fef7c10a4a0 2024-05-14T15:40:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.802+0000 7fef80a00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c10d760 con 0x7fef7c111df0 2024-05-14T15:40:38.804 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.802+0000 7fef80a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef7c10da60 con 0x7fef7c112910 2024-05-14T15:40:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.803+0000 7fef79400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c111df0 0x7fef7c116ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.803+0000 7fef79400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c111df0 0x7fef7c116ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:40436/0 (socket says 172.21.15.69:40436) 2024-05-14T15:40:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.803+0000 7fef79400640 1 -- 172.21.15.69:0/459008158 learned_addr learned my addr 172.21.15.69:0/459008158 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.803+0000 7fef79e00640 1 --2- 172.21.15.69:0/459008158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef7c10a4a0 0x7fef7c1169a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:38.805 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.803+0000 7fef7a800640 1 --2- 172.21.15.69:0/459008158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c112910 0x7fef7c1af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.804+0000 7fef79400640 1 -- 172.21.15.69:0/459008158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c112910 msgr2=0x7fef7c1af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.804+0000 7fef79400640 1 --2- 172.21.15.69:0/459008158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c112910 0x7fef7c1af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.804+0000 7fef79400640 1 -- 172.21.15.69:0/459008158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef7c10a4a0 msgr2=0x7fef7c1169a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.804+0000 7fef79400640 1 --2- 172.21.15.69:0/459008158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef7c10a4a0 0x7fef7c1169a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.804+0000 7fef79400640 1 -- 172.21.15.69:0/459008158 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7c1af730 con 0x7fef7c111df0 2024-05-14T15:40:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.804+0000 7fef79e00640 1 --2- 172.21.15.69:0/459008158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef7c10a4a0 0x7fef7c1169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:40:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.805+0000 7fef79400640 1 --2- 172.21.15.69:0/459008158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c111df0 0x7fef7c116ee0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fef68005ab0 tx=0x7fef68003d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.806+0000 7fef72a00640 1 -- 172.21.15.69:0/459008158 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6803f070 con 0x7fef7c111df0 2024-05-14T15:40:38.807 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.806+0000 7fef80a00640 1 -- 172.21.15.69:0/459008158 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef7c1af9c0 con 0x7fef7c111df0 2024-05-14T15:40:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.806+0000 7fef80a00640 1 -- 172.21.15.69:0/459008158 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef7c1aff00 con 0x7fef7c111df0 2024-05-14T15:40:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.806+0000 7fef72a00640 1 -- 172.21.15.69:0/459008158 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef6803bd00 con 0x7fef7c111df0 2024-05-14T15:40:38.808 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.806+0000 7fef72a00640 1 -- 172.21.15.69:0/459008158 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef68035030 con 0x7fef7c111df0 2024-05-14T15:40:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.810+0000 7fef87a18740 1 Processor -- start 2024-05-14T15:40:38.812 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.811+0000 7fef87a18740 1 -- start start 2024-05-14T15:40:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.811+0000 7fef87a18740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661bcc1b0 0x55c661f6d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.811+0000 7fef87a18740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661ba32f0 0x55c661f6d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.811+0000 7fef87a18740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661bab4d0 0x55c661f6dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.811+0000 7fef87a18740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55c661ed2550 con 0x55c661ba32f0 2024-05-14T15:40:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.811+0000 7fef87a18740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c661e77bc0 con 0x55c661bcc1b0 2024-05-14T15:40:38.813 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.811+0000 7fef87a18740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c661ece510 con 0x55c661bab4d0 2024-05-14T15:40:38.814 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.812+0000 7fef79e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661ba32f0 0x55c661f6d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.812+0000 7fef79e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661ba32f0 0x55c661f6d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56180/0 (socket says 172.21.15.69:56180) 2024-05-14T15:40:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.812+0000 7fef79e00640 1 -- 172.21.15.69:0/1856799413 learned_addr learned my addr 172.21.15.69:0/1856799413 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.812+0000 7fef7a800640 1 --2- 172.21.15.69:0/1856799413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661bcc1b0 0x55c661f6d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.812+0000 7fef79e00640 1 -- 172.21.15.69:0/1856799413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661bab4d0 msgr2=0x55c661f6dd00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-14T15:40:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.812+0000 7fef79e00640 1 --2- 172.21.15.69:0/1856799413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661bab4d0 0x55c661f6dd00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.812+0000 7fef79e00640 1 -- 172.21.15.69:0/1856799413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661bcc1b0 msgr2=0x55c661f6d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.812+0000 7fef79e00640 1 --2- 172.21.15.69:0/1856799413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661bcc1b0 0x55c661f6d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.812+0000 7fef79e00640 1 -- 172.21.15.69:0/1856799413 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c661be4210 con 0x55c661ba32f0 2024-05-14T15:40:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.813+0000 7fef79e00640 1 --2- 172.21.15.69:0/1856799413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661ba32f0 0x55c661f6d7c0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fef6c007820 tx=0x7fef6c007ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1937f7caee34902 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:38.815 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.813+0000 7fef67000640 1 -- 172.21.15.69:0/1856799413 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c00d950 con 0x55c661ba32f0 2024-05-14T15:40:38.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.813+0000 7fef67000640 1 -- 172.21.15.69:0/1856799413 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef6c018070 con 0x55c661ba32f0 2024-05-14T15:40:38.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.813+0000 7fef67000640 1 -- 172.21.15.69:0/1856799413 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c013da0 con 0x55c661ba32f0 2024-05-14T15:40:38.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.813+0000 7fef72a00640 1 -- 172.21.15.69:0/459008158 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fef68042070 con 0x7fef7c111df0 2024-05-14T15:40:38.816 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.814+0000 7fef87a18740 1 -- 172.21.15.69:0/1856799413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661ba32f0 msgr2=0x55c661f6d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.814+0000 7fef87a18740 1 --2- 172.21.15.69:0/1856799413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661ba32f0 0x55c661f6d7c0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fef6c007820 tx=0x7fef6c007ce0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.815+0000 7fef87a18740 1 -- 172.21.15.69:0/1856799413 shutdown_connections 2024-05-14T15:40:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.815+0000 7fef87a18740 1 --2- 172.21.15.69:0/1856799413 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661bab4d0 0x55c661f6dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.815+0000 7fef87a18740 1 --2- 172.21.15.69:0/1856799413 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661ba32f0 0x55c661f6d7c0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.815+0000 7fef87a18740 1 --2- 172.21.15.69:0/1856799413 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661bcc1b0 0x55c661f6d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.815+0000 7fef87a18740 1 -- 172.21.15.69:0/1856799413 >> 172.21.15.69:0/1856799413 conn(0x55c661bc0300 msgr2=0x55c661f69a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.815+0000 7fef87a18740 1 -- 172.21.15.69:0/1856799413 shutdown_connections 2024-05-14T15:40:38.817 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.815+0000 7fef87a18740 1 -- 172.21.15.69:0/1856799413 wait complete. 2024-05-14T15:40:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.815+0000 7fef72a00640 1 --2- 172.21.15.69:0/459008158 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fef600b2930 0x7fef600b4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.815+0000 7fef87a18740 1 -- start start 2024-05-14T15:40:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.816+0000 7fef87a18740 1 Processor -- start 2024-05-14T15:40:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.816+0000 7fef72a00640 1 -- 172.21.15.69:0/459008158 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9554+0+0 (secure 0 0 0) 0x7fef681032f0 con 0x7fef7c111df0 2024-05-14T15:40:38.818 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.816+0000 7fef7a800640 1 --2- 172.21.15.69:0/459008158 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fef600b2930 0x7fef600b4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.817+0000 7fef87a18740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661ba32f0 0x55c661f77770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.817+0000 7fef87a18740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661bab4d0 0x55c661f77cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.817+0000 7fef87a18740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661bcc1b0 0x55c661f838f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.817+0000 7fef87a18740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55c661f7a3b0 con 0x55c661ba32f0 2024-05-14T15:40:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.817+0000 7fef87a18740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55c661e8b660 con 0x55c661bab4d0 2024-05-14T15:40:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.817+0000 7fef87a18740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55c661f7a530 con 0x55c661bcc1b0 2024-05-14T15:40:38.819 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.817+0000 7fef87a18740 10 client.0 _ll_register_callbacks cb 0x55c661e55400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:40:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.817+0000 7fef79e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661ba32f0 0x55c661f77770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.817+0000 7fef79400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661bab4d0 0x55c661f77cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:38.820 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.818+0000 7fef79400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661bab4d0 0x55c661f77cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:40456/0 (socket says 172.21.15.69:40456) 2024-05-14T15:40:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.818+0000 7fef79400640 1 -- 172.21.15.69:0/2529266802 learned_addr learned my addr 172.21.15.69:0/2529266802 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.818+0000 7fef7a800640 1 --2- 172.21.15.69:0/459008158 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fef600b2930 0x7fef600b4e40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55c661f6a3f0 tx=0x7fef74008370 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.818+0000 7fef7a800640 1 --2- 172.21.15.69:0/2529266802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661bcc1b0 0x55c661f838f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.818+0000 7fef79e00640 1 -- 172.21.15.69:0/2529266802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661bcc1b0 msgr2=0x55c661f838f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.818+0000 7fef79e00640 1 --2- 172.21.15.69:0/2529266802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661bcc1b0 0x55c661f838f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.818+0000 7fef79e00640 1 -- 172.21.15.69:0/2529266802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661bab4d0 msgr2=0x55c661f77cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.818+0000 7fef79e00640 1 --2- 172.21.15.69:0/2529266802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661bab4d0 0x55c661f77cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.818+0000 7fef79e00640 1 -- 172.21.15.69:0/2529266802 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c661cb0620 con 0x55c661ba32f0 2024-05-14T15:40:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.819+0000 7fef79e00640 1 --2- 172.21.15.69:0/2529266802 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661ba32f0 0x55c661f77770 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x55c661f6e630 tx=0x7fef6c0137d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc40a9e901a626a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:38.821 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.819+0000 7fef5b400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:40:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.819+0000 7fef5b400640 1 -- 172.21.15.69:0/2529266802 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6c00d950 con 0x55c661ba32f0 2024-05-14T15:40:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.819+0000 7fef87a18740 1 -- 172.21.15.69:0/2529266802 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef6c018070 con 0x55c661ba32f0 2024-05-14T15:40:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.819+0000 7fef5b400640 1 -- 172.21.15.69:0/2529266802 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9554+0+0 (secure 0 0 0) 0x7fef6c00daf0 con 0x55c661ba32f0 2024-05-14T15:40:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.819+0000 7fef5b400640 1 -- 172.21.15.69:0/2529266802 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fef6c00dd30 con 0x55c661ba32f0 2024-05-14T15:40:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.819+0000 7fef87a18740 10 client.17529 fetch_fsmap learned FSMap version 82 2024-05-14T15:40:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.819+0000 7fef87a18740 1 -- 172.21.15.69:0/2529266802 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=4+}) -- 0x55c661f866a0 con 0x55c661ba32f0 2024-05-14T15:40:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.820+0000 7fef5b400640 1 -- 172.21.15.69:0/2529266802 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef6c018070 con 0x55c661ba32f0 2024-05-14T15:40:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.820+0000 7fef5b400640 1 -- 172.21.15.69:0/2529266802 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 82) ==== 8414+0+0 (secure 0 0 0) 0x7fef6c01c3f0 con 0x55c661ba32f0 2024-05-14T15:40:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.820+0000 7fef87a18740 10 client.17529 fetch_fsmap finished waiting for FSMap version 82 2024-05-14T15:40:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.820+0000 7fef87a18740 10 client.17529 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:40:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.820+0000 7fef87a18740 20 client.17529 populate_metadata read hostname 'smithi069' 2024-05-14T15:40:38.823 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.820+0000 7fef87a18740 1 --2- 172.21.15.69:0/2529266802 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c661b8ad80 0x55c661f89bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.820+0000 7fef87a18740 4 client.17529 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:40:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.820+0000 7fef87a18740 1 -- 172.21.15.69:0/2529266802 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c661ee0160 con 0x55c661b8ad80 2024-05-14T15:40:38.825 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.821+0000 7fef79400640 1 --2- 172.21.15.69:0/2529266802 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c661b8ad80 0x55c661f89bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.822+0000 7fef79400640 1 --2- 172.21.15.69:0/2529266802 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c661b8ad80 0x55c661f89bb0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eaa729e05ec3bf3a server_cookie=62492c245abedb77 in_seq=0 out_seq=0 2024-05-14T15:40:38.826 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.822+0000 7fef5b400640 10 client.17529 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:40:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.825+0000 7fef5b400640 1 -- 172.21.15.69:0/2529266802 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55c661ee0160 con 0x55c661b8ad80 2024-05-14T15:40:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.825+0000 7fef5b400640 10 client.17529 handle_command_reply: tid=0 2024-05-14T15:40:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.825+0000 7fef87a18740 1 client.17529 shutdown 2024-05-14T15:40:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.825+0000 7fef87a18740 1 -- 172.21.15.69:0/2529266802 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661ba32f0 msgr2=0x55c661f77770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.825+0000 7fef87a18740 1 --2- 172.21.15.69:0/2529266802 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661ba32f0 0x55c661f77770 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x55c661f6e630 tx=0x7fef6c0137d0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.825+0000 7fef87a18740 1 -- 172.21.15.69:0/2529266802 shutdown_connections 2024-05-14T15:40:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.825+0000 7fef87a18740 1 --2- 172.21.15.69:0/2529266802 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661bcc1b0 0x55c661f838f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.825+0000 7fef87a18740 1 --2- 172.21.15.69:0/2529266802 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661bab4d0 0x55c661f77cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.825+0000 7fef87a18740 1 --2- 172.21.15.69:0/2529266802 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c661b8ad80 0x55c661f89bb0 crc :-1 s=READY pgs=256 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.825+0000 7fef87a18740 1 --2- 172.21.15.69:0/2529266802 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661ba32f0 0x55c661f77770 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.827 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.825+0000 7fef87a18740 1 -- 172.21.15.69:0/2529266802 >> 172.21.15.69:0/2529266802 conn(0x55c661bc0300 msgr2=0x55c661f6efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.825+0000 7fef5b400640 0 client.17529 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:40:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.825+0000 7fef87a18740 1 -- 172.21.15.69:0/2529266802 shutdown_connections 2024-05-14T15:40:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.826+0000 7fef87a18740 1 -- 172.21.15.69:0/2529266802 wait complete. 2024-05-14T15:40:38.828 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.826+0000 7fef87a18740 20 client.17529 trim_cache size 0 max 16384 2024-05-14T15:40:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.841+0000 7fef87a18740 1 Processor -- start 2024-05-14T15:40:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.841+0000 7fef87a18740 1 -- start start 2024-05-14T15:40:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.842+0000 7fef87a18740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661ba32f0 0x55c661f6dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.842+0000 7fef87a18740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661bab4d0 0x55c661f76730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.842+0000 7fef87a18740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661bcc1b0 0x55c661f79390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.842+0000 7fef87a18740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c010080 con 0x55c661bab4d0 2024-05-14T15:40:38.844 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.842+0000 7fef87a18740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c011e00 con 0x55c661bcc1b0 2024-05-14T15:40:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.842+0000 7fef87a18740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c010750 con 0x55c661ba32f0 2024-05-14T15:40:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.842+0000 7fef79400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661bab4d0 0x55c661f76730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.842+0000 7fef79400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661bab4d0 0x55c661f76730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56210/0 (socket says 172.21.15.69:56210) 2024-05-14T15:40:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.842+0000 7fef79400640 1 -- 172.21.15.69:0/711248017 learned_addr learned my addr 172.21.15.69:0/711248017 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.842+0000 7fef79400640 1 -- 172.21.15.69:0/711248017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661ba32f0 msgr2=0x55c661f6dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.842+0000 7fef79400640 1 --2- 172.21.15.69:0/711248017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661ba32f0 0x55c661f6dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.842+0000 7fef79400640 1 -- 172.21.15.69:0/711248017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661bcc1b0 msgr2=0x55c661f79390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.842+0000 7fef79400640 1 --2- 172.21.15.69:0/711248017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661bcc1b0 0x55c661f79390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.842+0000 7fef79400640 1 -- 172.21.15.69:0/711248017 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c661f69010 con 0x55c661bab4d0 2024-05-14T15:40:38.845 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.843+0000 7fef79400640 1 --2- 172.21.15.69:0/711248017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661bab4d0 0x55c661f76730 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fef680c7430 tx=0x7fef6802a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30bb9c3e17301c9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.843+0000 7fef66600640 1 -- 172.21.15.69:0/711248017 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef680e3070 con 0x55c661bab4d0 2024-05-14T15:40:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.843+0000 7fef66600640 1 -- 172.21.15.69:0/711248017 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef680ce570 con 0x55c661bab4d0 2024-05-14T15:40:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.843+0000 7fef66600640 1 -- 172.21.15.69:0/711248017 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef68049070 con 0x55c661bab4d0 2024-05-14T15:40:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.844+0000 7fef87a18740 1 -- 172.21.15.69:0/711248017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661bab4d0 msgr2=0x55c661f76730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.844+0000 7fef87a18740 1 --2- 172.21.15.69:0/711248017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661bab4d0 0x55c661f76730 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fef680c7430 tx=0x7fef6802a480 comp rx=0 tx=0).stop 2024-05-14T15:40:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.844+0000 7fef87a18740 1 -- 172.21.15.69:0/711248017 shutdown_connections 2024-05-14T15:40:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.844+0000 7fef87a18740 1 --2- 172.21.15.69:0/711248017 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661bcc1b0 0x55c661f79390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.844+0000 7fef87a18740 1 --2- 172.21.15.69:0/711248017 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661bab4d0 0x55c661f76730 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.844+0000 7fef87a18740 1 --2- 172.21.15.69:0/711248017 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661ba32f0 0x55c661f6dcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.847 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.844+0000 7fef87a18740 1 -- 172.21.15.69:0/711248017 >> 172.21.15.69:0/711248017 conn(0x55c661bc0300 msgr2=0x55c661f78c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.844+0000 7fef87a18740 1 -- 172.21.15.69:0/711248017 shutdown_connections 2024-05-14T15:40:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.844+0000 7fef87a18740 1 -- 172.21.15.69:0/711248017 wait complete. 2024-05-14T15:40:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.844+0000 7fef87a18740 1 -- start start 2024-05-14T15:40:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.845+0000 7fef87a18740 1 Processor -- start 2024-05-14T15:40:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.845+0000 7fef87a18740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661ba32f0 0x55c661f7aa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.845+0000 7fef87a18740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661bab4d0 0x55c661f7afa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.845+0000 7fef87a18740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661bcc1b0 0x55c661feff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.845+0000 7fef87a18740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c011670 con 0x55c661bab4d0 2024-05-14T15:40:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.845+0000 7fef87a18740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c010ee0 con 0x55c661ba32f0 2024-05-14T15:40:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.845+0000 7fef87a18740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fef5c00e080 con 0x55c661bcc1b0 2024-05-14T15:40:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.845+0000 7fef87a18740 10 client.0 _ll_register_callbacks cb 0x7fef6c007670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:40:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.845+0000 7fef79400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661bab4d0 0x55c661f7afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.845+0000 7fef79400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661bab4d0 0x55c661f7afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:56212/0 (socket says 172.21.15.69:56212) 2024-05-14T15:40:38.848 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.845+0000 7fef79400640 1 -- 172.21.15.69:0/1148158213 learned_addr learned my addr 172.21.15.69:0/1148158213 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:38.850 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.846+0000 7fef79e00640 1 --2- 172.21.15.69:0/1148158213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661ba32f0 0x55c661f7aa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.846+0000 7fef79400640 1 -- 172.21.15.69:0/1148158213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661bcc1b0 msgr2=0x55c661feff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.846+0000 7fef79400640 1 --2- 172.21.15.69:0/1148158213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661bcc1b0 0x55c661feff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.846+0000 7fef79400640 1 -- 172.21.15.69:0/1148158213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661ba32f0 msgr2=0x55c661f7aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.846+0000 7fef79400640 1 --2- 172.21.15.69:0/1148158213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661ba32f0 0x55c661f7aa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.846+0000 7fef79400640 1 -- 172.21.15.69:0/1148158213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c661ff04a0 con 0x55c661bab4d0 2024-05-14T15:40:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.846+0000 7fef79400640 1 --2- 172.21.15.69:0/1148158213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661bab4d0 0x55c661f7afa0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fef68100c30 tx=0x7fef680c6160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=689cc380f55d39d7 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.846+0000 7fef5b400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:40:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.846+0000 7fef5b400640 1 -- 172.21.15.69:0/1148158213 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef68049070 con 0x55c661bab4d0 2024-05-14T15:40:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.846+0000 7fef5b400640 1 -- 172.21.15.69:0/1148158213 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9554+0+0 (secure 0 0 0) 0x7fef681008b0 con 0x55c661bab4d0 2024-05-14T15:40:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.846+0000 7fef87a18740 1 -- 172.21.15.69:0/1148158213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef680ce570 con 0x55c661bab4d0 2024-05-14T15:40:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.846+0000 7fef5b400640 1 -- 172.21.15.69:0/1148158213 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7fef680ad050 con 0x55c661bab4d0 2024-05-14T15:40:38.851 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.846+0000 7fef87a18740 10 client.17535 fetch_fsmap learned FSMap version 82 2024-05-14T15:40:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.846+0000 7fef87a18740 1 -- 172.21.15.69:0/1148158213 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=4+}) -- 0x55c661ff15d0 con 0x55c661bab4d0 2024-05-14T15:40:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.847+0000 7fef5b400640 1 -- 172.21.15.69:0/1148158213 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fef680ce570 con 0x55c661bab4d0 2024-05-14T15:40:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.847+0000 7fef5b400640 1 -- 172.21.15.69:0/1148158213 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 82) ==== 8414+0+0 (secure 0 0 0) 0x7fef680d2b90 con 0x55c661bab4d0 2024-05-14T15:40:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.847+0000 7fef87a18740 10 client.17535 fetch_fsmap finished waiting for FSMap version 82 2024-05-14T15:40:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.847+0000 7fef87a18740 10 client.17535 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:40:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.847+0000 7fef87a18740 20 client.17535 populate_metadata read hostname 'smithi069' 2024-05-14T15:40:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.847+0000 7fef87a18740 1 --2- 172.21.15.69:0/1148158213 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c661b601c0 0x55c661ff3d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.847+0000 7fef87a18740 4 client.17535 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:40:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.847+0000 7fef87a18740 1 -- 172.21.15.69:0/1148158213 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55c661ed9fd0 con 0x55c661b601c0 2024-05-14T15:40:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.848+0000 7fef79e00640 1 --2- 172.21.15.69:0/1148158213 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c661b601c0 0x55c661ff3d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.849+0000 7fef79e00640 1 --2- 172.21.15.69:0/1148158213 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c661b601c0 0x55c661ff3d60 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6ba4e7fd80637e70 server_cookie=d9737d66749122ab in_seq=0 out_seq=0 2024-05-14T15:40:38.852 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.849+0000 7fef5b400640 10 client.17535 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:40:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.898+0000 7fef5b400640 1 -- 172.21.15.69:0/1148158213 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55c661ed9fd0 con 0x55c661b601c0 2024-05-14T15:40:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.898+0000 7fef5b400640 10 client.17535 handle_command_reply: tid=0 2024-05-14T15:40:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.898+0000 7fef87a18740 1 client.17535 shutdown 2024-05-14T15:40:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.898+0000 7fef87a18740 1 -- 172.21.15.69:0/1148158213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661bab4d0 msgr2=0x55c661f7afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:38.902 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.898+0000 7fef87a18740 1 --2- 172.21.15.69:0/1148158213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661bab4d0 0x55c661f7afa0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fef68100c30 tx=0x7fef680c6160 comp rx=0 tx=0).stop 2024-05-14T15:40:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.898+0000 7fef87a18740 1 -- 172.21.15.69:0/1148158213 shutdown_connections 2024-05-14T15:40:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.898+0000 7fef87a18740 1 --2- 172.21.15.69:0/1148158213 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55c661bcc1b0 0x55c661feff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.898+0000 7fef87a18740 1 --2- 172.21.15.69:0/1148158213 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55c661b601c0 0x55c661ff3d60 crc :-1 s=READY pgs=257 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.898+0000 7fef87a18740 1 --2- 172.21.15.69:0/1148158213 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55c661bab4d0 0x55c661f7afa0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.898+0000 7fef87a18740 1 --2- 172.21.15.69:0/1148158213 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55c661ba32f0 0x55c661f7aa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.903 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.898+0000 7fef87a18740 1 -- 172.21.15.69:0/1148158213 >> 172.21.15.69:0/1148158213 conn(0x55c661bc0300 msgr2=0x55c661f76490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.898+0000 7fef5b400640 0 client.17535 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:40:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.898+0000 7fef87a18740 1 -- 172.21.15.69:0/1148158213 shutdown_connections 2024-05-14T15:40:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.898+0000 7fef87a18740 1 -- 172.21.15.69:0/1148158213 wait complete. 2024-05-14T15:40:38.904 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.899+0000 7fef87a18740 20 client.17535 trim_cache size 0 max 16384 2024-05-14T15:40:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:40:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:40:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:40:38.905 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:40:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.899+0000 7fef80a00640 1 -- 172.21.15.69:0/459008158 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fef600b2930 msgr2=0x7fef600b4e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.899+0000 7fef80a00640 1 --2- 172.21.15.69:0/459008158 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fef600b2930 0x7fef600b4e40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x55c661f6a3f0 tx=0x7fef74008370 comp rx=0 tx=0).stop 2024-05-14T15:40:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.899+0000 7fef80a00640 1 -- 172.21.15.69:0/459008158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c111df0 msgr2=0x7fef7c116ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.899+0000 7fef80a00640 1 --2- 172.21.15.69:0/459008158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c111df0 0x7fef7c116ee0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fef68005ab0 tx=0x7fef68003d80 comp rx=0 tx=0).stop 2024-05-14T15:40:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.899+0000 7fef80a00640 1 -- 172.21.15.69:0/459008158 shutdown_connections 2024-05-14T15:40:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.899+0000 7fef80a00640 1 --2- 172.21.15.69:0/459008158 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fef600b2930 0x7fef600b4e40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.907 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.899+0000 7fef80a00640 1 --2- 172.21.15.69:0/459008158 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fef7c112910 0x7fef7c1af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.899+0000 7fef80a00640 1 --2- 172.21.15.69:0/459008158 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fef7c111df0 0x7fef7c116ee0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.899+0000 7fef80a00640 1 --2- 172.21.15.69:0/459008158 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fef7c10a4a0 0x7fef7c1169a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.899+0000 7fef80a00640 1 -- 172.21.15.69:0/459008158 >> 172.21.15.69:0/459008158 conn(0x7fef7c06e900 msgr2=0x7fef7c0739a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.900+0000 7fef80a00640 1 -- 172.21.15.69:0/459008158 shutdown_connections 2024-05-14T15:40:38.908 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:38.900+0000 7fef80a00640 1 -- 172.21.15.69:0/459008158 wait complete. 2024-05-14T15:40:40.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:40 smithi203 ceph-mon[34567]: pgmap v601: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-05-14T15:40:40.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:40 smithi092 ceph-mon[34729]: pgmap v601: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-05-14T15:40:40.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:40 smithi069 ceph-mon[31270]: pgmap v601: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 77 KiB/s rd, 1.3 MiB/s wr, 128 op/s 2024-05-14T15:40:41.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 895.0 s, 159.1 tps, lat 861.206 ms stddev 1435.951 2024-05-14T15:40:42.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:42 smithi203 ceph-mon[34567]: pgmap v602: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 1.7 MiB/s wr, 179 op/s 2024-05-14T15:40:42.447 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:42 smithi092 ceph-mon[34729]: pgmap v602: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 1.7 MiB/s wr, 179 op/s 2024-05-14T15:40:42.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:42 smithi069 ceph-mon[31270]: pgmap v602: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 113 KiB/s rd, 1.7 MiB/s wr, 179 op/s 2024-05-14T15:40:43.346 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:43 smithi203 ceph-mon[34567]: pgmap v603: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 1.5 MiB/s wr, 157 op/s 2024-05-14T15:40:43.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:43 smithi092 ceph-mon[34729]: pgmap v603: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 1.5 MiB/s wr, 157 op/s 2024-05-14T15:40:43.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:43 smithi069 ceph-mon[31270]: pgmap v603: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 1.5 MiB/s wr, 157 op/s 2024-05-14T15:40:45.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:45 smithi203 ceph-mon[34567]: pgmap v604: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 1.3 MiB/s wr, 146 op/s 2024-05-14T15:40:45.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:45 smithi092 ceph-mon[34729]: pgmap v604: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 1.3 MiB/s wr, 146 op/s 2024-05-14T15:40:45.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:45 smithi069 ceph-mon[31270]: pgmap v604: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 85 KiB/s rd, 1.3 MiB/s wr, 146 op/s 2024-05-14T15:40:46.367 INFO:teuthology.orchestra.run.smithi069.stderr:progress: 900.0 s, 359.2 tps, lat 334.631 ms stddev 651.339 2024-05-14T15:40:46.948 INFO:teuthology.orchestra.run.smithi069.stdout:transaction type: 2024-05-14T15:40:46.949 INFO:teuthology.orchestra.run.smithi069.stdout:scaling factor: 32 2024-05-14T15:40:46.949 INFO:teuthology.orchestra.run.smithi069.stdout:query mode: simple 2024-05-14T15:40:46.949 INFO:teuthology.orchestra.run.smithi069.stdout:number of clients: 100 2024-05-14T15:40:46.949 INFO:teuthology.orchestra.run.smithi069.stdout:number of threads: 4 2024-05-14T15:40:46.949 INFO:teuthology.orchestra.run.smithi069.stdout:duration: 900 s 2024-05-14T15:40:46.949 INFO:teuthology.orchestra.run.smithi069.stdout:number of transactions actually processed: 493166 2024-05-14T15:40:46.949 INFO:teuthology.orchestra.run.smithi069.stdout:latency average = 182.395 ms 2024-05-14T15:40:46.949 INFO:teuthology.orchestra.run.smithi069.stdout:latency stddev = 307.493 ms 2024-05-14T15:40:46.949 INFO:teuthology.orchestra.run.smithi069.stdout:tps = 547.608510 (including connections establishing) 2024-05-14T15:40:46.949 INFO:teuthology.orchestra.run.smithi069.stdout:tps = 547.620528 (excluding connections establishing) 2024-05-14T15:40:46.993 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo systemctl stop postgresql' 2024-05-14T15:40:47.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:47 smithi203 ceph-mon[34567]: pgmap v605: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 2.1 MiB/s wr, 227 op/s 2024-05-14T15:40:47.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:47 smithi092 ceph-mon[34729]: pgmap v605: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 2.1 MiB/s wr, 227 op/s 2024-05-14T15:40:47.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:47 smithi069 ceph-mon[31270]: pgmap v605: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 114 KiB/s rd, 2.1 MiB/s wr, 227 op/s 2024-05-14T15:40:49.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:49 smithi203 ceph-mon[34567]: pgmap v606: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 1.5 MiB/s wr, 161 op/s 2024-05-14T15:40:49.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:49 smithi092 ceph-mon[34729]: pgmap v606: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 1.5 MiB/s wr, 161 op/s 2024-05-14T15:40:49.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:49 smithi069 ceph-mon[31270]: pgmap v606: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 1.5 MiB/s wr, 161 op/s 2024-05-14T15:40:51.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:51 smithi203 ceph-mon[34567]: pgmap v607: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 2.3 MiB/s wr, 247 op/s 2024-05-14T15:40:51.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:51 smithi092 ceph-mon[34729]: pgmap v607: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 2.3 MiB/s wr, 247 op/s 2024-05-14T15:40:51.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:51 smithi069 ceph-mon[31270]: pgmap v607: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 2.3 MiB/s wr, 247 op/s 2024-05-14T15:40:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.136+0000 7f7a47600640 1 -- 172.21.15.69:0/1125155482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a40118be0 msgr2=0x7f7a4011b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.136+0000 7f7a47600640 1 --2- 172.21.15.69:0/1125155482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a40118be0 0x7f7a4011b0c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009ca0 tx=0x7f7a3802a8c0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.136+0000 7f7a47600640 1 -- 172.21.15.69:0/1125155482 shutdown_connections 2024-05-14T15:40:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.136+0000 7f7a47600640 1 --2- 172.21.15.69:0/1125155482 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a40118be0 0x7f7a4011b0c0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.136+0000 7f7a47600640 1 --2- 172.21.15.69:0/1125155482 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a40116130 0x7f7a40118550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.136+0000 7f7a47600640 1 --2- 172.21.15.69:0/1125155482 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a4010a770 0x7f7a4010ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.137 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.136+0000 7f7a47600640 1 -- 172.21.15.69:0/1125155482 >> 172.21.15.69:0/1125155482 conn(0x7f7a4006edb0 msgr2=0x7f7a4006f1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:52.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.136+0000 7f7a47600640 1 -- 172.21.15.69:0/1125155482 shutdown_connections 2024-05-14T15:40:52.138 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.136+0000 7f7a47600640 1 -- 172.21.15.69:0/1125155482 wait complete. 2024-05-14T15:40:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.137+0000 7f7a47600640 1 Processor -- start 2024-05-14T15:40:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.137+0000 7f7a47600640 1 -- start start 2024-05-14T15:40:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.138+0000 7f7a47600640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a4010a770 0x7f7a401a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.138+0000 7f7a47600640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a40116130 0x7f7a401a5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.138+0000 7f7a47600640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a40118be0 0x7f7a401a9a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.138+0000 7f7a47600640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4011e760 con 0x7f7a4010a770 2024-05-14T15:40:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.138+0000 7f7a47600640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4011e5e0 con 0x7f7a40118be0 2024-05-14T15:40:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.138+0000 7f7a47600640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4011e8e0 con 0x7f7a40116130 2024-05-14T15:40:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.138+0000 7f7a44c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a4010a770 0x7f7a401a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.138+0000 7f7a44c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a4010a770 0x7f7a401a51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34794/0 (socket says 172.21.15.69:34794) 2024-05-14T15:40:52.140 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.138+0000 7f7a44c00640 1 -- 172.21.15.69:0/1445790632 learned_addr learned my addr 172.21.15.69:0/1445790632 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.139+0000 7f7a37e00640 1 --2- 172.21.15.69:0/1445790632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a40116130 0x7f7a401a5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.139+0000 7f7a45600640 1 --2- 172.21.15.69:0/1445790632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a40118be0 0x7f7a401a9a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.139+0000 7f7a44c00640 1 -- 172.21.15.69:0/1445790632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a40116130 msgr2=0x7f7a401a5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.139+0000 7f7a44c00640 1 --2- 172.21.15.69:0/1445790632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a40116130 0x7f7a401a5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.139+0000 7f7a44c00640 1 -- 172.21.15.69:0/1445790632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a40118be0 msgr2=0x7f7a401a9a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.139+0000 7f7a44c00640 1 --2- 172.21.15.69:0/1445790632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a40118be0 0x7f7a401a9a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.139+0000 7f7a44c00640 1 -- 172.21.15.69:0/1445790632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a401aa040 con 0x7f7a4010a770 2024-05-14T15:40:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.139+0000 7f7a45600640 1 --2- 172.21.15.69:0/1445790632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a40118be0 0x7f7a401a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:40:52.141 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.139+0000 7f7a44c00640 1 --2- 172.21.15.69:0/1445790632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a4010a770 0x7f7a401a51e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000d950 tx=0x7f7a3000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:52.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.139+0000 7f7a3e000640 1 -- 172.21.15.69:0/1445790632 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30017070 con 0x7f7a4010a770 2024-05-14T15:40:52.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.139+0000 7f7a3e000640 1 -- 172.21.15.69:0/1445790632 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a30009c30 con 0x7f7a4010a770 2024-05-14T15:40:52.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.139+0000 7f7a47600640 1 -- 172.21.15.69:0/1445790632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a401aa330 con 0x7f7a4010a770 2024-05-14T15:40:52.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.139+0000 7f7a3e000640 1 -- 172.21.15.69:0/1445790632 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3000f620 con 0x7f7a4010a770 2024-05-14T15:40:52.142 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.140+0000 7f7a47600640 1 -- 172.21.15.69:0/1445790632 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a401b1cb0 con 0x7f7a4010a770 2024-05-14T15:40:52.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.144+0000 7f7a4e584740 1 Processor -- start 2024-05-14T15:40:52.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.144+0000 7f7a4e584740 1 -- start start 2024-05-14T15:40:52.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.144+0000 7f7a4e584740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7108481b0 0x55a710be9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.144+0000 7f7a4e584740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710be97c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.144+0000 7f7a3e000640 1 -- 172.21.15.69:0/1445790632 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f7a30010460 con 0x7f7a4010a770 2024-05-14T15:40:52.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.144+0000 7f7a4e584740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108274d0 0x55a710be9d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.144+0000 7f7a4e584740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55a710b4e550 con 0x55a71081f2f0 2024-05-14T15:40:52.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.144+0000 7f7a4e584740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a710af3bc0 con 0x55a7108481b0 2024-05-14T15:40:52.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.144+0000 7f7a4e584740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a710b4a510 con 0x55a7108274d0 2024-05-14T15:40:52.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.145+0000 7f7a44c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710be97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.145+0000 7f7a44c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710be97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34800/0 (socket says 172.21.15.69:34800) 2024-05-14T15:40:52.146 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.145+0000 7f7a44c00640 1 -- 172.21.15.69:0/437835110 learned_addr learned my addr 172.21.15.69:0/437835110 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:52.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.145+0000 7f7a37e00640 1 --2- 172.21.15.69:0/437835110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108274d0 0x55a710be9d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.147 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.145+0000 7f7a45600640 1 --2- 172.21.15.69:0/437835110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7108481b0 0x55a710be9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.145+0000 7f7a44c00640 1 -- 172.21.15.69:0/437835110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108274d0 msgr2=0x55a710be9d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.145+0000 7f7a44c00640 1 --2- 172.21.15.69:0/437835110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108274d0 0x55a710be9d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.145+0000 7f7a44c00640 1 -- 172.21.15.69:0/437835110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7108481b0 msgr2=0x55a710be9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.145+0000 7f7a44c00640 1 --2- 172.21.15.69:0/437835110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7108481b0 0x55a710be9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.145+0000 7f7a44c00640 1 -- 172.21.15.69:0/437835110 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a710860210 con 0x55a71081f2f0 2024-05-14T15:40:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.146+0000 7f7a44c00640 1 --2- 172.21.15.69:0/437835110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710be97c0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f7a300df910 tx=0x7f7a300ea750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=247c5278aa24290e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:52.149 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.146+0000 7f7a35c00640 1 -- 172.21.15.69:0/437835110 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a300e2ce0 con 0x55a71081f2f0 2024-05-14T15:40:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.146+0000 7f7a35c00640 1 -- 172.21.15.69:0/437835110 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a300ef070 con 0x55a71081f2f0 2024-05-14T15:40:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.146+0000 7f7a35c00640 1 -- 172.21.15.69:0/437835110 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a300f4710 con 0x55a71081f2f0 2024-05-14T15:40:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.146+0000 7f7a3e000640 1 --2- 172.21.15.69:0/1445790632 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7a240b29d0 0x7f7a240b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.147+0000 7f7a3e000640 1 -- 172.21.15.69:0/1445790632 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9554+0+0 (secure 0 0 0) 0x7f7a300e26f0 con 0x7f7a4010a770 2024-05-14T15:40:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.147+0000 7f7a45600640 1 --2- 172.21.15.69:0/1445790632 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7a240b29d0 0x7f7a240b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.147+0000 7f7a4e584740 1 -- 172.21.15.69:0/437835110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 msgr2=0x55a710be97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.147+0000 7f7a4e584740 1 --2- 172.21.15.69:0/437835110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710be97c0 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f7a300df910 tx=0x7f7a300ea750 comp rx=0 tx=0).stop 2024-05-14T15:40:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.147+0000 7f7a4e584740 1 -- 172.21.15.69:0/437835110 shutdown_connections 2024-05-14T15:40:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.147+0000 7f7a4e584740 1 --2- 172.21.15.69:0/437835110 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108274d0 0x55a710be9d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.147+0000 7f7a4e584740 1 --2- 172.21.15.69:0/437835110 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710be97c0 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.147+0000 7f7a4e584740 1 --2- 172.21.15.69:0/437835110 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7108481b0 0x55a710be9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.147+0000 7f7a4e584740 1 -- 172.21.15.69:0/437835110 >> 172.21.15.69:0/437835110 conn(0x55a71083c300 msgr2=0x55a710be5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:52.150 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.147+0000 7f7a4e584740 1 -- 172.21.15.69:0/437835110 shutdown_connections 2024-05-14T15:40:52.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.147+0000 7f7a45600640 1 --2- 172.21.15.69:0/1445790632 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7a240b29d0 0x7f7a240b4ee0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009a60 tx=0x7f7a38009890 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:52.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.147+0000 7f7a4e584740 1 -- 172.21.15.69:0/437835110 wait complete. 2024-05-14T15:40:52.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.148+0000 7f7a4e584740 1 -- start start 2024-05-14T15:40:52.151 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.148+0000 7f7a4e584740 1 Processor -- start 2024-05-14T15:40:52.153 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.149+0000 7f7a4e584740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710bf3780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.149+0000 7f7a4e584740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7108274d0 0x55a710bf3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.149+0000 7f7a4e584740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108481b0 0x55a710bff860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.149+0000 7f7a4e584740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55a710bf63b0 con 0x55a71081f2f0 2024-05-14T15:40:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.149+0000 7f7a4e584740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55a710b07660 con 0x55a7108274d0 2024-05-14T15:40:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.149+0000 7f7a4e584740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55a710bf6530 con 0x55a7108481b0 2024-05-14T15:40:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.149+0000 7f7a4e584740 10 client.0 _ll_register_callbacks cb 0x55a710ad1400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:40:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.149+0000 7f7a44c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710bf3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.149+0000 7f7a44c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710bf3780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34812/0 (socket says 172.21.15.69:34812) 2024-05-14T15:40:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.149+0000 7f7a44c00640 1 -- 172.21.15.69:0/3873619394 learned_addr learned my addr 172.21.15.69:0/3873619394 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.149+0000 7f7a37e00640 1 --2- 172.21.15.69:0/3873619394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7108274d0 0x55a710bf3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.149+0000 7f7a45600640 1 --2- 172.21.15.69:0/3873619394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108481b0 0x55a710bff860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.149+0000 7f7a44c00640 1 -- 172.21.15.69:0/3873619394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108481b0 msgr2=0x55a710bff860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:52.154 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.149+0000 7f7a44c00640 1 --2- 172.21.15.69:0/3873619394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108481b0 0x55a710bff860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.150+0000 7f7a44c00640 1 -- 172.21.15.69:0/3873619394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7108274d0 msgr2=0x55a710bf3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:52.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.150+0000 7f7a44c00640 1 --2- 172.21.15.69:0/3873619394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7108274d0 0x55a710bf3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.150+0000 7f7a44c00640 1 -- 172.21.15.69:0/3873619394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a71092c620 con 0x55a71081f2f0 2024-05-14T15:40:52.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.150+0000 7f7a37e00640 1 --2- 172.21.15.69:0/3873619394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7108274d0 0x55a710bf3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:40:52.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.150+0000 7f7a44c00640 1 --2- 172.21.15.69:0/3873619394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710bf3780 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f7a300058c0 tx=0x7f7a300e2970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20320c266aaf994e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:52.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.150+0000 7f7a2e000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:40:52.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.150+0000 7f7a2e000640 1 -- 172.21.15.69:0/3873619394 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30020070 con 0x55a71081f2f0 2024-05-14T15:40:52.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.150+0000 7f7a2e000640 1 -- 172.21.15.69:0/3873619394 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9554+0+0 (secure 0 0 0) 0x7f7a300910d0 con 0x55a71081f2f0 2024-05-14T15:40:52.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.150+0000 7f7a4e584740 1 -- 172.21.15.69:0/3873619394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a300ef070 con 0x55a71081f2f0 2024-05-14T15:40:52.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.150+0000 7f7a2e000640 1 -- 172.21.15.69:0/3873619394 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f7a300a5420 con 0x55a71081f2f0 2024-05-14T15:40:52.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.150+0000 7f7a4e584740 10 client.17547 fetch_fsmap learned FSMap version 82 2024-05-14T15:40:52.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.150+0000 7f7a4e584740 1 -- 172.21.15.69:0/3873619394 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=4+}) -- 0x55a710c02610 con 0x55a71081f2f0 2024-05-14T15:40:52.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.151+0000 7f7a2e000640 1 -- 172.21.15.69:0/3873619394 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a300ef070 con 0x55a71081f2f0 2024-05-14T15:40:52.155 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.151+0000 7f7a2e000640 1 -- 172.21.15.69:0/3873619394 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 82) ==== 8414+0+0 (secure 0 0 0) 0x7f7a300dfc50 con 0x55a71081f2f0 2024-05-14T15:40:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.151+0000 7f7a4e584740 10 client.17547 fetch_fsmap finished waiting for FSMap version 82 2024-05-14T15:40:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.151+0000 7f7a4e584740 10 client.17547 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:40:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.151+0000 7f7a4e584740 20 client.17547 populate_metadata read hostname 'smithi069' 2024-05-14T15:40:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.151+0000 7f7a4e584740 1 --2- 172.21.15.69:0/3873619394 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a710806d80 0x55a710c05970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.151+0000 7f7a4e584740 4 client.17547 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:40:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.151+0000 7f7a4e584740 1 -- 172.21.15.69:0/3873619394 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a710b5c160 con 0x55a710806d80 2024-05-14T15:40:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.152+0000 7f7a37e00640 1 --2- 172.21.15.69:0/3873619394 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a710806d80 0x55a710c05970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.153+0000 7f7a37e00640 1 --2- 172.21.15.69:0/3873619394 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a710806d80 0x55a710c05970 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6588ea69e9896f63 server_cookie=750b0f1e7df451c in_seq=0 out_seq=0 2024-05-14T15:40:52.156 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.153+0000 7f7a2e000640 10 client.17547 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:40:52.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.155+0000 7f7a2e000640 1 -- 172.21.15.69:0/3873619394 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55a710b5c160 con 0x55a710806d80 2024-05-14T15:40:52.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.155+0000 7f7a2e000640 10 client.17547 handle_command_reply: tid=0 2024-05-14T15:40:52.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.155+0000 7f7a4e584740 1 client.17547 shutdown 2024-05-14T15:40:52.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.155+0000 7f7a4e584740 1 -- 172.21.15.69:0/3873619394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 msgr2=0x55a710bf3780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:52.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.155+0000 7f7a4e584740 1 --2- 172.21.15.69:0/3873619394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710bf3780 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f7a300058c0 tx=0x7f7a300e2970 comp rx=0 tx=0).stop 2024-05-14T15:40:52.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.155+0000 7f7a4e584740 1 -- 172.21.15.69:0/3873619394 shutdown_connections 2024-05-14T15:40:52.157 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.155+0000 7f7a4e584740 1 --2- 172.21.15.69:0/3873619394 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108481b0 0x55a710bff860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.155+0000 7f7a4e584740 1 --2- 172.21.15.69:0/3873619394 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7108274d0 0x55a710bf3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.155+0000 7f7a4e584740 1 --2- 172.21.15.69:0/3873619394 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a710806d80 0x55a710c05970 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.155+0000 7f7a4e584740 1 --2- 172.21.15.69:0/3873619394 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710bf3780 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.155+0000 7f7a2e000640 0 client.17547 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:40:52.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.155+0000 7f7a4e584740 1 -- 172.21.15.69:0/3873619394 >> 172.21.15.69:0/3873619394 conn(0x55a71083c300 msgr2=0x55a710be9220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:52.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.155+0000 7f7a4e584740 1 -- 172.21.15.69:0/3873619394 shutdown_connections 2024-05-14T15:40:52.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.155+0000 7f7a4e584740 1 -- 172.21.15.69:0/3873619394 wait complete. 2024-05-14T15:40:52.158 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.156+0000 7f7a4e584740 20 client.17547 trim_cache size 0 max 16384 2024-05-14T15:40:52.173 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.172+0000 7f7a4e584740 1 Processor -- start 2024-05-14T15:40:52.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.173+0000 7f7a4e584740 1 -- start start 2024-05-14T15:40:52.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.173+0000 7f7a4e584740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710bedd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.173+0000 7f7a4e584740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7108274d0 0x55a710be9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.173+0000 7f7a4e584740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108481b0 0x55a710bff7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.173+0000 7f7a4e584740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7a401bbea0 con 0x55a71081f2f0 2024-05-14T15:40:52.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.173+0000 7f7a4e584740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7a401bdc20 con 0x55a7108274d0 2024-05-14T15:40:52.174 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.173+0000 7f7a4e584740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7a401bc570 con 0x55a7108481b0 2024-05-14T15:40:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.173+0000 7f7a44c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710bedd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.175 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.173+0000 7f7a44c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710bedd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34814/0 (socket says 172.21.15.69:34814) 2024-05-14T15:40:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.173+0000 7f7a44c00640 1 -- 172.21.15.69:0/2666912859 learned_addr learned my addr 172.21.15.69:0/2666912859 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.174+0000 7f7a37e00640 1 --2- 172.21.15.69:0/2666912859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7108274d0 0x55a710be9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.174+0000 7f7a45600640 1 --2- 172.21.15.69:0/2666912859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108481b0 0x55a710bff7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.174+0000 7f7a44c00640 1 -- 172.21.15.69:0/2666912859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108481b0 msgr2=0x55a710bff7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.174+0000 7f7a44c00640 1 --2- 172.21.15.69:0/2666912859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108481b0 0x55a710bff7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.174+0000 7f7a44c00640 1 -- 172.21.15.69:0/2666912859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7108274d0 msgr2=0x55a710be9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.174+0000 7f7a44c00640 1 --2- 172.21.15.69:0/2666912859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7108274d0 0x55a710be9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.174+0000 7f7a44c00640 1 -- 172.21.15.69:0/2666912859 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a710be1270 con 0x55a71081f2f0 2024-05-14T15:40:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.174+0000 7f7a44c00640 1 --2- 172.21.15.69:0/2666912859 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710bedd50 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f7a300e82d0 tx=0x7f7a300ea750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9969607bc4d7c0c0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.174+0000 7f7a35200640 1 -- 172.21.15.69:0/2666912859 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a30020030 con 0x55a71081f2f0 2024-05-14T15:40:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.175+0000 7f7a35200640 1 -- 172.21.15.69:0/2666912859 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a300ef070 con 0x55a71081f2f0 2024-05-14T15:40:52.176 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.175+0000 7f7a35200640 1 -- 172.21.15.69:0/2666912859 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a300a8cd0 con 0x55a71081f2f0 2024-05-14T15:40:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.175+0000 7f7a4e584740 1 -- 172.21.15.69:0/2666912859 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 msgr2=0x55a710bedd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.175+0000 7f7a4e584740 1 --2- 172.21.15.69:0/2666912859 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710bedd50 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f7a300e82d0 tx=0x7f7a300ea750 comp rx=0 tx=0).stop 2024-05-14T15:40:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.176+0000 7f7a4e584740 1 -- 172.21.15.69:0/2666912859 shutdown_connections 2024-05-14T15:40:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.176+0000 7f7a4e584740 1 --2- 172.21.15.69:0/2666912859 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108481b0 0x55a710bff7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.176+0000 7f7a4e584740 1 --2- 172.21.15.69:0/2666912859 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a7108274d0 0x55a710be9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.176+0000 7f7a4e584740 1 --2- 172.21.15.69:0/2666912859 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a71081f2f0 0x55a710bedd50 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.176+0000 7f7a4e584740 1 -- 172.21.15.69:0/2666912859 >> 172.21.15.69:0/2666912859 conn(0x55a71083c300 msgr2=0x55a710be4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.176+0000 7f7a4e584740 1 -- 172.21.15.69:0/2666912859 shutdown_connections 2024-05-14T15:40:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.176+0000 7f7a4e584740 1 -- 172.21.15.69:0/2666912859 wait complete. 2024-05-14T15:40:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.176+0000 7f7a4e584740 1 -- start start 2024-05-14T15:40:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.176+0000 7f7a4e584740 1 Processor -- start 2024-05-14T15:40:52.180 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.177+0000 7f7a4e584740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a71081f2f0 0x55a710c08b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.177+0000 7f7a4e584740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a7108274d0 0x55a710c09090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.177+0000 7f7a4e584740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108481b0 0x55a710c05fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.177+0000 7f7a4e584740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f7a401bd490 con 0x55a7108274d0 2024-05-14T15:40:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.177+0000 7f7a4e584740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f7a401bcd00 con 0x55a71081f2f0 2024-05-14T15:40:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.177+0000 7f7a4e584740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f7a401b9ea0 con 0x55a7108481b0 2024-05-14T15:40:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.177+0000 7f7a4e584740 10 client.0 _ll_register_callbacks cb 0x7f7a300e8b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:40:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.177+0000 7f7a37e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a7108274d0 0x55a710c09090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.177+0000 7f7a37e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a7108274d0 0x55a710c09090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:34820/0 (socket says 172.21.15.69:34820) 2024-05-14T15:40:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.177+0000 7f7a37e00640 1 -- 172.21.15.69:0/1673133887 learned_addr learned my addr 172.21.15.69:0/1673133887 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:40:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.177+0000 7f7a44c00640 1 --2- 172.21.15.69:0/1673133887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a71081f2f0 0x55a710c08b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.177+0000 7f7a37e00640 1 -- 172.21.15.69:0/1673133887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108481b0 msgr2=0x55a710c05fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.177+0000 7f7a37e00640 1 --2- 172.21.15.69:0/1673133887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108481b0 0x55a710c05fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.177+0000 7f7a37e00640 1 -- 172.21.15.69:0/1673133887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a71081f2f0 msgr2=0x55a710c08b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:40:52.181 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.177+0000 7f7a37e00640 1 --2- 172.21.15.69:0/1673133887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a71081f2f0 0x55a710c08b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.177+0000 7f7a37e00640 1 -- 172.21.15.69:0/1673133887 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a710c06760 con 0x55a7108274d0 2024-05-14T15:40:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.178+0000 7f7a44c00640 1 --2- 172.21.15.69:0/1673133887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a71081f2f0 0x55a710c08b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:40:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.178+0000 7f7a37e00640 1 --2- 172.21.15.69:0/1673133887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a7108274d0 0x55a710c09090 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f7a2800caf0 tx=0x7f7a280127c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2def974161a8efda server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:40:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.178+0000 7f7a2e000640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:40:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.178+0000 7f7a2e000640 1 -- 172.21.15.69:0/1673133887 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2801b530 con 0x55a7108274d0 2024-05-14T15:40:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.178+0000 7f7a4e584740 1 -- 172.21.15.69:0/1673133887 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a300ef070 con 0x55a7108274d0 2024-05-14T15:40:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.178+0000 7f7a2e000640 1 -- 172.21.15.69:0/1673133887 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9554+0+0 (secure 0 0 0) 0x7f7a2801b6d0 con 0x55a7108274d0 2024-05-14T15:40:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.178+0000 7f7a2e000640 1 -- 172.21.15.69:0/1673133887 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f7a2802b050 con 0x55a7108274d0 2024-05-14T15:40:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.178+0000 7f7a4e584740 10 client.17553 fetch_fsmap learned FSMap version 82 2024-05-14T15:40:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.178+0000 7f7a4e584740 1 -- 172.21.15.69:0/1673133887 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=4+}) -- 0x55a710c6d660 con 0x55a7108274d0 2024-05-14T15:40:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.179+0000 7f7a2e000640 1 -- 172.21.15.69:0/1673133887 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7a300ef070 con 0x55a7108274d0 2024-05-14T15:40:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.179+0000 7f7a2e000640 1 -- 172.21.15.69:0/1673133887 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 82) ==== 8414+0+0 (secure 0 0 0) 0x7f7a2800f040 con 0x55a7108274d0 2024-05-14T15:40:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.179+0000 7f7a4e584740 10 client.17553 fetch_fsmap finished waiting for FSMap version 82 2024-05-14T15:40:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.179+0000 7f7a4e584740 10 client.17553 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:40:52.182 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.179+0000 7f7a4e584740 20 client.17553 populate_metadata read hostname 'smithi069' 2024-05-14T15:40:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.179+0000 7f7a4e584740 1 --2- 172.21.15.69:0/1673133887 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a7107dc1c0 0x55a710c6ff10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:40:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.179+0000 7f7a4e584740 4 client.17553 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:40:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.179+0000 7f7a4e584740 1 -- 172.21.15.69:0/1673133887 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a710b55fd0 con 0x55a7107dc1c0 2024-05-14T15:40:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.180+0000 7f7a44c00640 1 --2- 172.21.15.69:0/1673133887 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a7107dc1c0 0x55a710c6ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:40:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.181+0000 7f7a44c00640 1 --2- 172.21.15.69:0/1673133887 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a7107dc1c0 0x55a710c6ff10 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1638224525c38f63 server_cookie=31c76a04eee5eace in_seq=0 out_seq=0 2024-05-14T15:40:52.183 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.181+0000 7f7a2e000640 10 client.17553 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:40:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.236+0000 7f7a2e000640 1 -- 172.21.15.69:0/1673133887 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a710b55fd0 con 0x55a7107dc1c0 2024-05-14T15:40:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.236+0000 7f7a2e000640 10 client.17553 handle_command_reply: tid=0 2024-05-14T15:40:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.236+0000 7f7a4e584740 1 client.17553 shutdown 2024-05-14T15:40:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.236+0000 7f7a4e584740 1 -- 172.21.15.69:0/1673133887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a7108274d0 msgr2=0x55a710c09090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.236+0000 7f7a4e584740 1 --2- 172.21.15.69:0/1673133887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a7108274d0 0x55a710c09090 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f7a2800caf0 tx=0x7f7a280127c0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.236+0000 7f7a4e584740 1 -- 172.21.15.69:0/1673133887 shutdown_connections 2024-05-14T15:40:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.236+0000 7f7a4e584740 1 --2- 172.21.15.69:0/1673133887 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55a7108481b0 0x55a710c05fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.236+0000 7f7a4e584740 1 --2- 172.21.15.69:0/1673133887 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55a7107dc1c0 0x55a710c6ff10 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.238 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.236+0000 7f7a4e584740 1 --2- 172.21.15.69:0/1673133887 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55a7108274d0 0x55a710c09090 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.236+0000 7f7a4e584740 1 --2- 172.21.15.69:0/1673133887 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55a71081f2f0 0x55a710c08b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.236+0000 7f7a4e584740 1 -- 172.21.15.69:0/1673133887 >> 172.21.15.69:0/1673133887 conn(0x55a71083c300 msgr2=0x55a710be4ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.236+0000 7f7a2e000640 0 client.17553 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:40:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.237+0000 7f7a4e584740 1 -- 172.21.15.69:0/1673133887 shutdown_connections 2024-05-14T15:40:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.237+0000 7f7a4e584740 1 -- 172.21.15.69:0/1673133887 wait complete. 2024-05-14T15:40:52.239 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.237+0000 7f7a4e584740 20 client.17553 trim_cache size 0 max 16384 2024-05-14T15:40:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:40:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:40:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:40:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:40:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.238+0000 7f7a47600640 1 -- 172.21.15.69:0/1445790632 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7a240b29d0 msgr2=0x7f7a240b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:52.240 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.238+0000 7f7a47600640 1 --2- 172.21.15.69:0/1445790632 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7a240b29d0 0x7f7a240b4ee0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7a38009a60 tx=0x7f7a38009890 comp rx=0 tx=0).stop 2024-05-14T15:40:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.238+0000 7f7a47600640 1 -- 172.21.15.69:0/1445790632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a4010a770 msgr2=0x7f7a401a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:40:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.238+0000 7f7a47600640 1 --2- 172.21.15.69:0/1445790632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a4010a770 0x7f7a401a51e0 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f7a3000d950 tx=0x7f7a3000de10 comp rx=0 tx=0).stop 2024-05-14T15:40:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.238+0000 7f7a47600640 1 -- 172.21.15.69:0/1445790632 shutdown_connections 2024-05-14T15:40:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.238+0000 7f7a47600640 1 --2- 172.21.15.69:0/1445790632 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f7a240b29d0 0x7f7a240b4ee0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.238+0000 7f7a47600640 1 --2- 172.21.15.69:0/1445790632 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f7a40118be0 0x7f7a401a9a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.238+0000 7f7a47600640 1 --2- 172.21.15.69:0/1445790632 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f7a40116130 0x7f7a401a5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.238+0000 7f7a47600640 1 --2- 172.21.15.69:0/1445790632 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f7a4010a770 0x7f7a401a51e0 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:40:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.238+0000 7f7a47600640 1 -- 172.21.15.69:0/1445790632 >> 172.21.15.69:0/1445790632 conn(0x7f7a4006edb0 msgr2=0x7f7a40116540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:40:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.239+0000 7f7a47600640 1 -- 172.21.15.69:0/1445790632 shutdown_connections 2024-05-14T15:40:52.241 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:40:52.239+0000 7f7a47600640 1 -- 172.21.15.69:0/1445790632 wait complete. 2024-05-14T15:40:53.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:53 smithi203 ceph-mon[34567]: pgmap v608: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 2.0 MiB/s wr, 205 op/s 2024-05-14T15:40:53.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:53 smithi092 ceph-mon[34729]: pgmap v608: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 2.0 MiB/s wr, 205 op/s 2024-05-14T15:40:53.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:53 smithi069 ceph-mon[31270]: pgmap v608: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 86 KiB/s rd, 2.0 MiB/s wr, 205 op/s 2024-05-14T15:40:55.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:55 smithi203 ceph-mon[34567]: pgmap v609: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 1.7 MiB/s wr, 187 op/s 2024-05-14T15:40:55.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:55 smithi092 ceph-mon[34729]: pgmap v609: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 1.7 MiB/s wr, 187 op/s 2024-05-14T15:40:55.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:55 smithi069 ceph-mon[31270]: pgmap v609: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 80 KiB/s rd, 1.7 MiB/s wr, 187 op/s 2024-05-14T15:40:57.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:57 smithi203 ceph-mon[34567]: pgmap v610: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 1.8 MiB/s wr, 205 op/s 2024-05-14T15:40:57.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:57 smithi092 ceph-mon[34729]: pgmap v610: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 1.8 MiB/s wr, 205 op/s 2024-05-14T15:40:57.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:57 smithi069 ceph-mon[31270]: pgmap v610: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 129 KiB/s rd, 1.8 MiB/s wr, 205 op/s 2024-05-14T15:40:59.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:40:59 smithi092 ceph-mon[34729]: pgmap v611: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 1.0 MiB/s wr, 119 op/s 2024-05-14T15:40:59.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:40:59 smithi069 ceph-mon[31270]: pgmap v611: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 1.0 MiB/s wr, 119 op/s 2024-05-14T15:41:00.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:40:59 smithi203 ceph-mon[34567]: pgmap v611: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 96 KiB/s rd, 1.0 MiB/s wr, 119 op/s 2024-05-14T15:41:01.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:01 smithi092 ceph-mon[34729]: pgmap v612: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 1.4 MiB/s wr, 167 op/s 2024-05-14T15:41:01.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:01 smithi069 ceph-mon[31270]: pgmap v612: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 1.4 MiB/s wr, 167 op/s 2024-05-14T15:41:02.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:01 smithi203 ceph-mon[34567]: pgmap v612: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 141 KiB/s rd, 1.4 MiB/s wr, 167 op/s 2024-05-14T15:41:03.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:03 smithi092 ceph-mon[34729]: pgmap v613: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 656 KiB/s wr, 115 op/s 2024-05-14T15:41:03.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:03 smithi069 ceph-mon[31270]: pgmap v613: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 656 KiB/s wr, 115 op/s 2024-05-14T15:41:04.027 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:03 smithi203 ceph-mon[34567]: pgmap v613: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 115 KiB/s rd, 656 KiB/s wr, 115 op/s 2024-05-14T15:41:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.577+0000 7f72ada00640 1 -- 172.21.15.69:0/2448010915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72a810a510 msgr2=0x7f72a810a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:05.578 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.577+0000 7f72ada00640 1 --2- 172.21.15.69:0/2448010915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72a810a510 0x7f72a810a920 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f7298009900 tx=0x7f729802a400 comp rx=0 tx=0).stop 2024-05-14T15:41:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.578+0000 7f72ada00640 1 -- 172.21.15.69:0/2448010915 shutdown_connections 2024-05-14T15:41:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.578+0000 7f72ada00640 1 --2- 172.21.15.69:0/2448010915 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72a810f550 0x7f72a8116cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.578+0000 7f72ada00640 1 --2- 172.21.15.69:0/2448010915 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72a810ea90 0x7f72a810eec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.578+0000 7f72ada00640 1 --2- 172.21.15.69:0/2448010915 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72a810a510 0x7f72a810a920 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.579 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.578+0000 7f72ada00640 1 -- 172.21.15.69:0/2448010915 >> 172.21.15.69:0/2448010915 conn(0x7f72a80771a0 msgr2=0x7f72a80775e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.579+0000 7f72ada00640 1 -- 172.21.15.69:0/2448010915 shutdown_connections 2024-05-14T15:41:05.580 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.579+0000 7f72ada00640 1 -- 172.21.15.69:0/2448010915 wait complete. 2024-05-14T15:41:05.584 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.584+0000 7f72ada00640 1 Processor -- start 2024-05-14T15:41:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.584+0000 7f72ada00640 1 -- start start 2024-05-14T15:41:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.584+0000 7f72ada00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72a810a510 0x7f72a81a0df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.585+0000 7f72ada00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72a810ea90 0x7f72a81a1350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.585 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.585+0000 7f72ada00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72a810f550 0x7f72a81a5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.585+0000 7f72ada00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f72a811a310 con 0x7f72a810ea90 2024-05-14T15:41:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.585+0000 7f72ada00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f72a811a190 con 0x7f72a810f550 2024-05-14T15:41:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.585+0000 7f72ada00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f72a811a490 con 0x7f72a810a510 2024-05-14T15:41:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.585+0000 7f72a7400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72a810f550 0x7f72a81a5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.585+0000 7f72a7400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72a810f550 0x7f72a81a5610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:48800/0 (socket says 172.21.15.69:48800) 2024-05-14T15:41:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.585+0000 7f72a6a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72a810a510 0x7f72a81a0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:05.586 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.585+0000 7f72a7400640 1 -- 172.21.15.69:0/3252582728 learned_addr learned my addr 172.21.15.69:0/3252582728 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.586+0000 7f72a7400640 1 -- 172.21.15.69:0/3252582728 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72a810a510 msgr2=0x7f72a81a0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.586+0000 7f72a7400640 1 --2- 172.21.15.69:0/3252582728 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72a810a510 0x7f72a81a0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.588 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.586+0000 7f72a7400640 1 -- 172.21.15.69:0/3252582728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72a810ea90 msgr2=0x7f72a81a1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.586+0000 7f72a7400640 1 --2- 172.21.15.69:0/3252582728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72a810ea90 0x7f72a81a1350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.586+0000 7f72a7400640 1 -- 172.21.15.69:0/3252582728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a81a5c50 con 0x7f72a810f550 2024-05-14T15:41:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.588+0000 7f72a7400640 1 --2- 172.21.15.69:0/3252582728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72a810f550 0x7f72a81a5610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009fd0 tx=0x7f72a000b260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:05.589 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.589+0000 7f729f400640 1 -- 172.21.15.69:0/3252582728 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0017070 con 0x7f72a810f550 2024-05-14T15:41:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.589+0000 7f72ada00640 1 -- 172.21.15.69:0/3252582728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72a81a5f40 con 0x7f72a810f550 2024-05-14T15:41:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.589+0000 7f72ada00640 1 -- 172.21.15.69:0/3252582728 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72a81ad8c0 con 0x7f72a810f550 2024-05-14T15:41:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.589+0000 7f729f400640 1 -- 172.21.15.69:0/3252582728 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f72a0003e00 con 0x7f72a810f550 2024-05-14T15:41:05.590 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.589+0000 7f729f400640 1 -- 172.21.15.69:0/3252582728 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72a0010460 con 0x7f72a810f550 2024-05-14T15:41:05.602 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.594+0000 7f72b4a31740 1 Processor -- start 2024-05-14T15:41:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.594+0000 7f72b4a31740 1 -- start start 2024-05-14T15:41:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.602+0000 7f72b4a31740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e07041b0 0x5578e0aa52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.602+0000 7f72b4a31740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06db2f0 0x5578e0aa57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.602+0000 7f72b4a31740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e06e34d0 0x5578e0aa5d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.602+0000 7f72b4a31740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5578e0a0a550 con 0x5578e06db2f0 2024-05-14T15:41:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.602+0000 7f72b4a31740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5578e09afbc0 con 0x5578e07041b0 2024-05-14T15:41:05.603 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.602+0000 7f72b4a31740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5578e0a06510 con 0x5578e06e34d0 2024-05-14T15:41:05.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.603+0000 7f72a6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06db2f0 0x5578e0aa57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:05.604 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.603+0000 7f729f400640 1 -- 172.21.15.69:0/3252582728 <== mon.2 v2:172.21.15.92:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f72a0003970 con 0x7f72a810f550 2024-05-14T15:41:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.605+0000 7f729f400640 1 --2- 172.21.15.69:0/3252582728 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f728c0b29d0 0x7f728c0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.606 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.606+0000 7f729f400640 1 -- 172.21.15.69:0/3252582728 <== mon.2 v2:172.21.15.92:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 9554+0+0 (secure 0 0 0) 0x7f72a00e2b00 con 0x7f72a810f550 2024-05-14T15:41:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.606+0000 7f72a7400640 1 --2- 172.21.15.69:0/3252582728 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f728c0b29d0 0x7f728c0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.606+0000 7f72a6a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06db2f0 0x5578e0aa57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38308/0 (socket says 172.21.15.69:38308) 2024-05-14T15:41:05.607 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.606+0000 7f72a6a00640 1 -- 172.21.15.69:0/3485526118 learned_addr learned my addr 172.21.15.69:0/3485526118 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.607+0000 7f72a6a00640 1 -- 172.21.15.69:0/3485526118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e06e34d0 msgr2=0x5578e0aa5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.607+0000 7f72a6a00640 1 --2- 172.21.15.69:0/3485526118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e06e34d0 0x5578e0aa5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.607+0000 7f72a6a00640 1 -- 172.21.15.69:0/3485526118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e07041b0 msgr2=0x5578e0aa52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.607+0000 7f72a6a00640 1 --2- 172.21.15.69:0/3485526118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e07041b0 0x5578e0aa52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.608 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.607+0000 7f72a6a00640 1 -- 172.21.15.69:0/3485526118 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e071c210 con 0x5578e06db2f0 2024-05-14T15:41:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.608+0000 7f72a7400640 1 --2- 172.21.15.69:0/3252582728 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f728c0b29d0 0x7f728c0b4ee0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f72a0003fd0 tx=0x7f72a000b910 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:05.609 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.609+0000 7f72a6a00640 1 --2- 172.21.15.69:0/3485526118 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06db2f0 0x5578e0aa57e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f729802a920 tx=0x7f7298031dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5da00fadf84bf8ee server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:05.613 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.609+0000 7f7293e00640 1 -- 172.21.15.69:0/3485526118 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7298035030 con 0x5578e06db2f0 2024-05-14T15:41:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.610+0000 7f7293e00640 1 -- 172.21.15.69:0/3485526118 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7298040070 con 0x5578e06db2f0 2024-05-14T15:41:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.610+0000 7f7293e00640 1 -- 172.21.15.69:0/3485526118 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7298003a80 con 0x5578e06db2f0 2024-05-14T15:41:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.611+0000 7f72b4a31740 1 -- 172.21.15.69:0/3485526118 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06db2f0 msgr2=0x5578e0aa57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.611+0000 7f72b4a31740 1 --2- 172.21.15.69:0/3485526118 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06db2f0 0x5578e0aa57e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f729802a920 tx=0x7f7298031dc0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.613+0000 7f72b4a31740 1 -- 172.21.15.69:0/3485526118 shutdown_connections 2024-05-14T15:41:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.613+0000 7f72b4a31740 1 --2- 172.21.15.69:0/3485526118 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e06e34d0 0x5578e0aa5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.613+0000 7f72b4a31740 1 --2- 172.21.15.69:0/3485526118 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06db2f0 0x5578e0aa57e0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.613+0000 7f72b4a31740 1 --2- 172.21.15.69:0/3485526118 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e07041b0 0x5578e0aa52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.613+0000 7f72b4a31740 1 -- 172.21.15.69:0/3485526118 >> 172.21.15.69:0/3485526118 conn(0x5578e06f8300 msgr2=0x5578e0aa1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:05.614 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.613+0000 7f72b4a31740 1 -- 172.21.15.69:0/3485526118 shutdown_connections 2024-05-14T15:41:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.613+0000 7f72b4a31740 1 -- 172.21.15.69:0/3485526118 wait complete. 2024-05-14T15:41:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.614+0000 7f72b4a31740 1 -- start start 2024-05-14T15:41:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.614+0000 7f72b4a31740 1 Processor -- start 2024-05-14T15:41:05.615 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.615+0000 7f72b4a31740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06db2f0 0x5578e0aaf830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.615+0000 7f72b4a31740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06e34d0 0x5578e0aafd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.615+0000 7f72b4a31740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e07041b0 0x5578e0abb880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.615+0000 7f72b4a31740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x5578e0ab2370 con 0x5578e06e34d0 2024-05-14T15:41:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.615+0000 7f72b4a31740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x5578e09c3660 con 0x5578e06db2f0 2024-05-14T15:41:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.615+0000 7f72b4a31740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x5578e0ab24f0 con 0x5578e07041b0 2024-05-14T15:41:05.616 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.615+0000 7f72b4a31740 10 client.0 _ll_register_callbacks cb 0x5578e098d400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:41:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.617+0000 7f72a6000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06db2f0 0x5578e0aaf830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.617+0000 7f72a6000640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06db2f0 0x5578e0aaf830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:48806/0 (socket says 172.21.15.69:48806) 2024-05-14T15:41:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.617+0000 7f72a6000640 1 -- 172.21.15.69:0/2981076931 learned_addr learned my addr 172.21.15.69:0/2981076931 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.617+0000 7f72a6000640 1 --2- 172.21.15.69:0/2981076931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e07041b0 0x5578e0abb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:05.618 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.617+0000 7f72a6a00640 1 --2- 172.21.15.69:0/2981076931 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06e34d0 0x5578e0aafd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.618+0000 7f72a6000640 1 -- 172.21.15.69:0/2981076931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e07041b0 msgr2=0x5578e0abb880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.618+0000 7f72a6000640 1 --2- 172.21.15.69:0/2981076931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e07041b0 0x5578e0abb880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.618+0000 7f72a6000640 1 -- 172.21.15.69:0/2981076931 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06e34d0 msgr2=0x5578e0aafd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.618+0000 7f72a6000640 1 --2- 172.21.15.69:0/2981076931 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06e34d0 0x5578e0aafd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.619 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.618+0000 7f72a6000640 1 -- 172.21.15.69:0/2981076931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578e07e8620 con 0x5578e06db2f0 2024-05-14T15:41:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.618+0000 7f72a6a00640 1 --2- 172.21.15.69:0/2981076931 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06e34d0 0x5578e0aafd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:41:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.618+0000 7f72a6000640 1 --2- 172.21.15.69:0/2981076931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06db2f0 0x5578e0aaf830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7294005fd0 tx=0x7f729400c270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6918c1cc8c555ea9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:05.620 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.618+0000 7f7290c00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:41:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.624+0000 7f7290c00640 1 -- 172.21.15.69:0/2981076931 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7294009e50 con 0x5578e06db2f0 2024-05-14T15:41:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.624+0000 7f7290c00640 1 -- 172.21.15.69:0/2981076931 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9554+0+0 (secure 0 0 0) 0x7f7294004020 con 0x5578e06db2f0 2024-05-14T15:41:05.625 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.624+0000 7f72b4a31740 1 -- 172.21.15.69:0/2981076931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7298040070 con 0x5578e06db2f0 2024-05-14T15:41:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.629+0000 7f7290c00640 1 -- 172.21.15.69:0/2981076931 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f7294023050 con 0x5578e06db2f0 2024-05-14T15:41:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.629+0000 7f72b4a31740 10 client.37040 fetch_fsmap learned FSMap version 82 2024-05-14T15:41:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.629+0000 7f72b4a31740 1 -- 172.21.15.69:0/2981076931 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=4+}) -- 0x5578e0abe720 con 0x5578e06db2f0 2024-05-14T15:41:05.630 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.629+0000 7f7290c00640 1 -- 172.21.15.69:0/2981076931 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7298040070 con 0x5578e06db2f0 2024-05-14T15:41:05.631 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.629+0000 7f7290c00640 1 -- 172.21.15.69:0/2981076931 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 82) ==== 8414+0+0 (secure 0 0 0) 0x7f729400f040 con 0x5578e06db2f0 2024-05-14T15:41:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.630+0000 7f72b4a31740 10 client.37040 fetch_fsmap finished waiting for FSMap version 82 2024-05-14T15:41:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.630+0000 7f72b4a31740 10 client.37040 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:41:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.630+0000 7f72b4a31740 20 client.37040 populate_metadata read hostname 'smithi069' 2024-05-14T15:41:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.630+0000 7f72b4a31740 1 --2- 172.21.15.69:0/2981076931 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578e06c2d80 0x5578e0ac1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.630+0000 7f72b4a31740 4 client.37040 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:41:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.630+0000 7f72b4a31740 1 -- 172.21.15.69:0/2981076931 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5578e0a18160 con 0x5578e06c2d80 2024-05-14T15:41:05.632 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.631+0000 7f72a6a00640 1 --2- 172.21.15.69:0/2981076931 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578e06c2d80 0x5578e0ac1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.632+0000 7f72a6a00640 1 --2- 172.21.15.69:0/2981076931 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578e06c2d80 0x5578e0ac1d40 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=64c5f135eba7c993 server_cookie=5d2be4e9e4d54fcf in_seq=0 out_seq=0 2024-05-14T15:41:05.633 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.632+0000 7f7290c00640 10 client.37040 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:41:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.634+0000 7f7290c00640 1 -- 172.21.15.69:0/2981076931 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x5578e0a18160 con 0x5578e06c2d80 2024-05-14T15:41:05.634 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.634+0000 7f7290c00640 10 client.37040 handle_command_reply: tid=0 2024-05-14T15:41:05.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.634+0000 7f72b4a31740 1 client.37040 shutdown 2024-05-14T15:41:05.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.634+0000 7f72b4a31740 1 -- 172.21.15.69:0/2981076931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06db2f0 msgr2=0x5578e0aaf830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:05.635 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.635+0000 7f72b4a31740 1 --2- 172.21.15.69:0/2981076931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06db2f0 0x5578e0aaf830 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f7294005fd0 tx=0x7f729400c270 comp rx=0 tx=0).stop 2024-05-14T15:41:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.635+0000 7f72b4a31740 1 -- 172.21.15.69:0/2981076931 shutdown_connections 2024-05-14T15:41:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.635+0000 7f72b4a31740 1 --2- 172.21.15.69:0/2981076931 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e07041b0 0x5578e0abb880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.635+0000 7f72b4a31740 1 --2- 172.21.15.69:0/2981076931 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578e06c2d80 0x5578e0ac1d40 crc :-1 s=READY pgs=260 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.635+0000 7f72b4a31740 1 --2- 172.21.15.69:0/2981076931 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06e34d0 0x5578e0aafd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.635+0000 7f72b4a31740 1 --2- 172.21.15.69:0/2981076931 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06db2f0 0x5578e0aaf830 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.635+0000 7f72b4a31740 1 -- 172.21.15.69:0/2981076931 >> 172.21.15.69:0/2981076931 conn(0x5578e06f8300 msgr2=0x5578e0aa6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:05.636 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.635+0000 7f7290c00640 0 client.37040 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:41:05.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.637+0000 7f72b4a31740 1 -- 172.21.15.69:0/2981076931 shutdown_connections 2024-05-14T15:41:05.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.637+0000 7f72b4a31740 1 -- 172.21.15.69:0/2981076931 wait complete. 2024-05-14T15:41:05.638 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.637+0000 7f72b4a31740 20 client.37040 trim_cache size 0 max 16384 2024-05-14T15:41:05.682 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.681+0000 7f72b4a31740 1 Processor -- start 2024-05-14T15:41:05.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.681+0000 7f72b4a31740 1 -- start start 2024-05-14T15:41:05.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.682+0000 7f72b4a31740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e06db2f0 0x5578e0aa5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.682+0000 7f72b4a31740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06e34d0 0x5578e0aa9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.682+0000 7f72b4a31740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e07041b0 0x5578e0ac7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.682+0000 7f72b4a31740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f72a81b7a00 con 0x5578e07041b0 2024-05-14T15:41:05.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.682+0000 7f72b4a31740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f72a81b9780 con 0x5578e06e34d0 2024-05-14T15:41:05.683 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.682+0000 7f72b4a31740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f72a81b80d0 con 0x5578e06db2f0 2024-05-14T15:41:05.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.682+0000 7f72a6a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06e34d0 0x5578e0aa9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:05.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.682+0000 7f72a6a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06e34d0 0x5578e0aa9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:48812/0 (socket says 172.21.15.69:48812) 2024-05-14T15:41:05.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.683+0000 7f72a6a00640 1 -- 172.21.15.69:0/1818383255 learned_addr learned my addr 172.21.15.69:0/1818383255 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:05.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.683+0000 7f72a6000640 1 --2- 172.21.15.69:0/1818383255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e07041b0 0x5578e0ac7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:05.684 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.684+0000 7f72a6000640 1 --2- 172.21.15.69:0/1818383255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e06db2f0 0x5578e0aa5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:05.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.684+0000 7f72a6a00640 1 -- 172.21.15.69:0/1818383255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e06db2f0 msgr2=0x5578e0aa5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:05.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.684+0000 7f72a6a00640 1 --2- 172.21.15.69:0/1818383255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e06db2f0 0x5578e0aa5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.685 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.684+0000 7f72a6a00640 1 -- 172.21.15.69:0/1818383255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e07041b0 msgr2=0x5578e0ac7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.685+0000 7f72a6a00640 1 --2- 172.21.15.69:0/1818383255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e07041b0 0x5578e0ac7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.685+0000 7f72a6a00640 1 -- 172.21.15.69:0/1818383255 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578e0aa6680 con 0x5578e06e34d0 2024-05-14T15:41:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.685+0000 7f72a6000640 1 --2- 172.21.15.69:0/1818383255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e07041b0 0x5578e0ac7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-14T15:41:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.685+0000 7f72a6a00640 1 --2- 172.21.15.69:0/1818383255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06e34d0 0x5578e0aa9f00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f72980057c0 tx=0x7f729802a400 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e76ed6031d912565 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:05.686 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.686+0000 7f7293400640 1 -- 172.21.15.69:0/1818383255 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7298035040 con 0x5578e06e34d0 2024-05-14T15:41:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.686+0000 7f7293400640 1 -- 172.21.15.69:0/1818383255 <== mon.2 v2:172.21.15.92:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7298040050 con 0x5578e06e34d0 2024-05-14T15:41:05.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.686+0000 7f7293400640 1 -- 172.21.15.69:0/1818383255 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f729804f430 con 0x5578e06e34d0 2024-05-14T15:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.687+0000 7f72b4a31740 1 -- 172.21.15.69:0/1818383255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06e34d0 msgr2=0x5578e0aa9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.688+0000 7f72b4a31740 1 --2- 172.21.15.69:0/1818383255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06e34d0 0x5578e0aa9f00 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f72980057c0 tx=0x7f729802a400 comp rx=0 tx=0).stop 2024-05-14T15:41:05.688 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.688+0000 7f72b4a31740 1 -- 172.21.15.69:0/1818383255 shutdown_connections 2024-05-14T15:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.688+0000 7f72b4a31740 1 --2- 172.21.15.69:0/1818383255 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e07041b0 0x5578e0ac7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.688+0000 7f72b4a31740 1 --2- 172.21.15.69:0/1818383255 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06e34d0 0x5578e0aa9f00 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.688+0000 7f72b4a31740 1 --2- 172.21.15.69:0/1818383255 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e06db2f0 0x5578e0aa5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.688+0000 7f72b4a31740 1 -- 172.21.15.69:0/1818383255 >> 172.21.15.69:0/1818383255 conn(0x5578e06f8300 msgr2=0x5578e0aa0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:05.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.689+0000 7f72b4a31740 1 -- 172.21.15.69:0/1818383255 shutdown_connections 2024-05-14T15:41:05.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.689+0000 7f72b4a31740 1 -- 172.21.15.69:0/1818383255 wait complete. 2024-05-14T15:41:05.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.689+0000 7f72b4a31740 1 -- start start 2024-05-14T15:41:05.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.690+0000 7f72b4a31740 1 Processor -- start 2024-05-14T15:41:05.692 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.691+0000 7f72b4a31740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06db2f0 0x5578e0ab7a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.692+0000 7f72b4a31740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06e34d0 0x5578e0ab2da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.692+0000 7f72b4a31740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e07041b0 0x5578e0ab32e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.692+0000 7f72a6000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06db2f0 0x5578e0ab7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:05.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.692+0000 7f72a6000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06db2f0 0x5578e0ab7a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:38328/0 (socket says 172.21.15.69:38328) 2024-05-14T15:41:05.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.692+0000 7f72a6a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06e34d0 0x5578e0ab2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:05.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.692+0000 7f72a6a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06e34d0 0x5578e0ab2da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.92:3300/0 says I am v2:172.21.15.69:48828/0 (socket says 172.21.15.69:48828) 2024-05-14T15:41:05.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.692+0000 7f72b4a31740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f72a81b8ff0 con 0x5578e06db2f0 2024-05-14T15:41:05.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.692+0000 7f72b4a31740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f72a81b8860 con 0x5578e06e34d0 2024-05-14T15:41:05.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.692+0000 7f72b4a31740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f72a81b5a00 con 0x5578e07041b0 2024-05-14T15:41:05.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.693+0000 7f72b4a31740 10 client.0 _ll_register_callbacks cb 0x7f729400c6f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:41:05.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.693+0000 7f72a6000640 1 -- 172.21.15.69:0/4003246088 learned_addr learned my addr 172.21.15.69:0/4003246088 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:05.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.694+0000 7f72a6000640 1 --2- 172.21.15.69:0/4003246088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e07041b0 0x5578e0ab32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:05.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.694+0000 7f72a6a00640 1 -- 172.21.15.69:0/4003246088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e07041b0 msgr2=0x5578e0ab32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:05.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.694+0000 7f72a6a00640 1 --2- 172.21.15.69:0/4003246088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e07041b0 0x5578e0ab32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.694+0000 7f72a6a00640 1 -- 172.21.15.69:0/4003246088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06db2f0 msgr2=0x5578e0ab7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:05.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.694+0000 7f72a6a00640 1 --2- 172.21.15.69:0/4003246088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06db2f0 0x5578e0ab7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:05.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.695+0000 7f72a6a00640 1 -- 172.21.15.69:0/4003246088 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578e0ab3820 con 0x5578e06e34d0 2024-05-14T15:41:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.695+0000 7f72a6000640 1 --2- 172.21.15.69:0/4003246088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e07041b0 0x5578e0ab32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:41:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.695+0000 7f7290c00640 10 client.0 ms_handle_connect on v2:172.21.15.92:3300/0 2024-05-14T15:41:05.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.695+0000 7f72a6a00640 1 --2- 172.21.15.69:0/4003246088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06e34d0 0x5578e0ab2da0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5578e0aa26b0 tx=0x7f7298005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f335bf124e537e75 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:05.697 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.696+0000 7f7290c00640 1 -- 172.21.15.69:0/4003246088 <== mon.2 v2:172.21.15.92:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7298035040 con 0x5578e06e34d0 2024-05-14T15:41:05.697 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.696+0000 7f7290c00640 1 -- 172.21.15.69:0/4003246088 <== mon.2 v2:172.21.15.92:3300/0 2 ==== osd_map(120..120 src has 1..120) ==== 9554+0+0 (secure 0 0 0) 0x7f729805a440 con 0x5578e06e34d0 2024-05-14T15:41:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.697+0000 7f72b4a31740 1 -- 172.21.15.69:0/4003246088 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7298040050 con 0x5578e06e34d0 2024-05-14T15:41:05.698 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.698+0000 7f7290c00640 1 -- 172.21.15.69:0/4003246088 <== mon.2 v2:172.21.15.92:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f7298035040 con 0x5578e06e34d0 2024-05-14T15:41:05.699 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.698+0000 7f72b4a31740 10 client.37046 fetch_fsmap learned FSMap version 82 2024-05-14T15:41:05.699 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.698+0000 7f72b4a31740 1 -- 172.21.15.69:0/4003246088 --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=4+}) -- 0x5578e0b3acf0 con 0x5578e06e34d0 2024-05-14T15:41:05.701 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.701+0000 7f7290c00640 1 -- 172.21.15.69:0/4003246088 <== mon.2 v2:172.21.15.92:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f7298040050 con 0x5578e06e34d0 2024-05-14T15:41:05.702 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.701+0000 7f7290c00640 1 -- 172.21.15.69:0/4003246088 <== mon.2 v2:172.21.15.92:3300/0 5 ==== fsmap(e 82) ==== 8414+0+0 (secure 0 0 0) 0x7f729803c650 con 0x5578e06e34d0 2024-05-14T15:41:05.703 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.701+0000 7f72b4a31740 10 client.37046 fetch_fsmap finished waiting for FSMap version 82 2024-05-14T15:41:05.703 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.701+0000 7f72b4a31740 10 client.37046 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:41:05.703 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.701+0000 7f72b4a31740 20 client.37046 populate_metadata read hostname 'smithi069' 2024-05-14T15:41:05.703 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.701+0000 7f72b4a31740 1 --2- 172.21.15.69:0/4003246088 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578e06981c0 0x5578e0b3cf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:05.703 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.701+0000 7f72b4a31740 4 client.37046 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:41:05.703 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.701+0000 7f72b4a31740 1 -- 172.21.15.69:0/4003246088 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5578e0a11fd0 con 0x5578e06981c0 2024-05-14T15:41:05.704 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.703+0000 7f72a6000640 1 --2- 172.21.15.69:0/4003246088 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578e06981c0 0x5578e0b3cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.706+0000 7f72a6000640 1 --2- 172.21.15.69:0/4003246088 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578e06981c0 0x5578e0b3cf80 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=277fa32e3b66611c server_cookie=631e3a4c9e93ad87 in_seq=0 out_seq=0 2024-05-14T15:41:05.706 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:05.706+0000 7f7290c00640 10 client.37046 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:41:05.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:05 smithi092 ceph-mon[34729]: pgmap v614: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 750 KiB/s wr, 123 op/s 2024-05-14T15:41:05.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:05 smithi069 ceph-mon[31270]: pgmap v614: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 750 KiB/s wr, 123 op/s 2024-05-14T15:41:06.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:05 smithi203 ceph-mon[34567]: pgmap v614: 129 pgs: 129 active+clean; 3.4 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 111 KiB/s rd, 750 KiB/s wr, 123 op/s 2024-05-14T15:41:06.747 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.746+0000 7f7290c00640 1 -- 172.21.15.69:0/4003246088 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5578e0a11fd0 con 0x5578e06981c0 2024-05-14T15:41:06.747 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.746+0000 7f7290c00640 10 client.37046 handle_command_reply: tid=0 2024-05-14T15:41:06.747 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.746+0000 7f72b4a31740 1 client.37046 shutdown 2024-05-14T15:41:06.747 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.746+0000 7f72b4a31740 1 -- 172.21.15.69:0/4003246088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06e34d0 msgr2=0x5578e0ab2da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:06.747 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.746+0000 7f72b4a31740 1 --2- 172.21.15.69:0/4003246088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06e34d0 0x5578e0ab2da0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x5578e0aa26b0 tx=0x7f7298005e80 comp rx=0 tx=0).stop 2024-05-14T15:41:06.747 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.746+0000 7f72b4a31740 1 -- 172.21.15.69:0/4003246088 shutdown_connections 2024-05-14T15:41:06.748 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.746+0000 7f72b4a31740 1 --2- 172.21.15.69:0/4003246088 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x5578e07041b0 0x5578e0ab32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:06.748 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.746+0000 7f72b4a31740 1 --2- 172.21.15.69:0/4003246088 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x5578e06e34d0 0x5578e0ab2da0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:06.748 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.746+0000 7f72b4a31740 1 --2- 172.21.15.69:0/4003246088 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x5578e06981c0 0x5578e0b3cf80 crc :-1 s=READY pgs=261 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:06.748 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.746+0000 7f72b4a31740 1 --2- 172.21.15.69:0/4003246088 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x5578e06db2f0 0x5578e0ab7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:06.748 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.746+0000 7f72b4a31740 1 -- 172.21.15.69:0/4003246088 >> 172.21.15.69:0/4003246088 conn(0x5578e06f8300 msgr2=0x5578e0aa09e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:06.748 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.746+0000 7f7290c00640 0 client.37046 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:41:06.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.747+0000 7f72b4a31740 1 -- 172.21.15.69:0/4003246088 shutdown_connections 2024-05-14T15:41:06.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.747+0000 7f72b4a31740 1 -- 172.21.15.69:0/4003246088 wait complete. 2024-05-14T15:41:06.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.747+0000 7f72b4a31740 20 client.37046 trim_cache size 0 max 16384 2024-05-14T15:41:06.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:41:06.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:41:06.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:41:06.749 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:41:06.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.748+0000 7f72ada00640 1 -- 172.21.15.69:0/3252582728 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f728c0b29d0 msgr2=0x7f728c0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:06.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.748+0000 7f72ada00640 1 --2- 172.21.15.69:0/3252582728 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f728c0b29d0 0x7f728c0b4ee0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f72a0003fd0 tx=0x7f72a000b910 comp rx=0 tx=0).stop 2024-05-14T15:41:06.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.748+0000 7f72ada00640 1 -- 172.21.15.69:0/3252582728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72a810f550 msgr2=0x7f72a81a5610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:06.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.748+0000 7f72ada00640 1 --2- 172.21.15.69:0/3252582728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72a810f550 0x7f72a81a5610 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009fd0 tx=0x7f72a000b260 comp rx=0 tx=0).stop 2024-05-14T15:41:06.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.749+0000 7f72ada00640 1 -- 172.21.15.69:0/3252582728 shutdown_connections 2024-05-14T15:41:06.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.749+0000 7f72ada00640 1 --2- 172.21.15.69:0/3252582728 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f728c0b29d0 0x7f728c0b4ee0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:06.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.749+0000 7f72ada00640 1 --2- 172.21.15.69:0/3252582728 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f72a810f550 0x7f72a81a5610 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:06.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.749+0000 7f72ada00640 1 --2- 172.21.15.69:0/3252582728 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f72a810ea90 0x7f72a81a1350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:06.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.749+0000 7f72ada00640 1 --2- 172.21.15.69:0/3252582728 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f72a810a510 0x7f72a81a0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:06.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.749+0000 7f72ada00640 1 -- 172.21.15.69:0/3252582728 >> 172.21.15.69:0/3252582728 conn(0x7f72a80771a0 msgr2=0x7f72a807a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:06.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.751+0000 7f72ada00640 1 -- 172.21.15.69:0/3252582728 shutdown_connections 2024-05-14T15:41:06.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:06.751+0000 7f72ada00640 1 -- 172.21.15.69:0/3252582728 wait complete. 2024-05-14T15:41:07.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:07 smithi092 ceph-mon[34729]: pgmap v615: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 3.6 MiB/s wr, 440 op/s 2024-05-14T15:41:07.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:07 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:41:07.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:07 smithi069 ceph-mon[31270]: pgmap v615: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 3.6 MiB/s wr, 440 op/s 2024-05-14T15:41:07.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:07 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:41:08.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:07 smithi203 ceph-mon[34567]: pgmap v615: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 148 KiB/s rd, 3.6 MiB/s wr, 440 op/s 2024-05-14T15:41:08.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:07 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:41:08.942 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:08 smithi092 ceph-mon[34729]: osdmap e121: 12 total, 12 up, 12 in 2024-05-14T15:41:08.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:08 smithi069 ceph-mon[31270]: osdmap e121: 12 total, 12 up, 12 in 2024-05-14T15:41:09.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:08 smithi203 ceph-mon[34567]: osdmap e121: 12 total, 12 up, 12 in 2024-05-14T15:41:09.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:09 smithi092 ceph-mon[34729]: pgmap v617: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 4.6 MiB/s wr, 542 op/s 2024-05-14T15:41:09.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:09 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:41:09.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:09 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:41:09.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:09 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:41:09.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:09 smithi069 ceph-mon[31270]: pgmap v617: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 4.6 MiB/s wr, 542 op/s 2024-05-14T15:41:09.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:09 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:41:09.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:09 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:41:09.975 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:09 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:41:10.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:09 smithi203 ceph-mon[34567]: pgmap v617: 129 pgs: 129 active+clean; 3.4 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 117 KiB/s rd, 4.6 MiB/s wr, 542 op/s 2024-05-14T15:41:10.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:09 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:41:10.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:09 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:41:10.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:09 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:41:11.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:11 smithi092 ceph-mon[34729]: pgmap v618: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 6.9 MiB/s wr, 765 op/s 2024-05-14T15:41:11.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:11 smithi069 ceph-mon[31270]: pgmap v618: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 6.9 MiB/s wr, 765 op/s 2024-05-14T15:41:12.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:11 smithi203 ceph-mon[34567]: pgmap v618: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 3.3 GiB data, 22 GiB used, 1.0 TiB / 1.0 TiB avail; 101 KiB/s rd, 6.9 MiB/s wr, 765 op/s 2024-05-14T15:41:13.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:13 smithi069 ceph-mon[31270]: pgmap v619: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.7 MiB/s wr, 837 op/s 2024-05-14T15:41:14.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:13 smithi203 ceph-mon[34567]: pgmap v619: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.7 MiB/s wr, 837 op/s 2024-05-14T15:41:14.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:13 smithi092 ceph-mon[34729]: pgmap v619: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 3.3 GiB data, 21 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.7 MiB/s wr, 837 op/s 2024-05-14T15:41:15.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:15 smithi069 ceph-mon[31270]: pgmap v620: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.6 MiB/s wr, 823 op/s 2024-05-14T15:41:16.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:15 smithi203 ceph-mon[34567]: pgmap v620: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.6 MiB/s wr, 823 op/s 2024-05-14T15:41:16.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:15 smithi092 ceph-mon[34729]: pgmap v620: 129 pgs: 3 active+clean+snaptrim, 7 active+clean+snaptrim_wait, 119 active+clean; 3.3 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 90 KiB/s rd, 7.6 MiB/s wr, 823 op/s 2024-05-14T15:41:17.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:17 smithi069 ceph-mon[31270]: pgmap v621: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 4.7 MiB/s wr, 498 op/s 2024-05-14T15:41:18.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:17 smithi203 ceph-mon[34567]: pgmap v621: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 4.7 MiB/s wr, 498 op/s 2024-05-14T15:41:18.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:17 smithi092 ceph-mon[34729]: pgmap v621: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 4.7 MiB/s wr, 498 op/s 2024-05-14T15:41:19.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:19 smithi069 ceph-mon[31270]: pgmap v622: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 4.0 MiB/s wr, 424 op/s 2024-05-14T15:41:19.995 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:19 smithi092 ceph-mon[34729]: pgmap v622: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 4.0 MiB/s wr, 424 op/s 2024-05-14T15:41:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.996+0000 7f9eb9200640 1 -- 172.21.15.69:0/4200297378 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9eb410bcf0 msgr2=0x7f9eb4105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.996+0000 7f9eb9200640 1 --2- 172.21.15.69:0/4200297378 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9eb410bcf0 0x7f9eb4105890 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4009900 tx=0x7f9ea402a410 comp rx=0 tx=0).stop 2024-05-14T15:41:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.996+0000 7f9eb9200640 1 -- 172.21.15.69:0/4200297378 shutdown_connections 2024-05-14T15:41:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.996+0000 7f9eb9200640 1 --2- 172.21.15.69:0/4200297378 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9eb4106440 0x7f9eb4112810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.996+0000 7f9eb9200640 1 --2- 172.21.15.69:0/4200297378 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9eb410c190 0x7f9eb4105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.996+0000 7f9eb9200640 1 --2- 172.21.15.69:0/4200297378 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9eb410bcf0 0x7f9eb4105890 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.996+0000 7f9eb9200640 1 -- 172.21.15.69:0/4200297378 >> 172.21.15.69:0/4200297378 conn(0x7f9eb4101390 msgr2=0x7f9eb41037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.996+0000 7f9eb9200640 1 -- 172.21.15.69:0/4200297378 shutdown_connections 2024-05-14T15:41:19.998 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.996+0000 7f9eb9200640 1 -- 172.21.15.69:0/4200297378 wait complete. 2024-05-14T15:41:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.997+0000 7f9eb9200640 1 Processor -- start 2024-05-14T15:41:19.999 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.997+0000 7f9eb9200640 1 -- start start 2024-05-14T15:41:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.998+0000 7f9eb9200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9eb4106440 0x7f9eb41a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.998+0000 7f9eb9200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9eb410bcf0 0x7f9eb41a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.998+0000 7f9eb9200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9eb410c190 0x7f9eb419c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.998+0000 7f9eb9200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb4115d90 con 0x7f9eb4106440 2024-05-14T15:41:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.998+0000 7f9eb9200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb4115c10 con 0x7f9eb410c190 2024-05-14T15:41:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.998+0000 7f9eb9200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb4115f10 con 0x7f9eb410bcf0 2024-05-14T15:41:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.998+0000 7f9eb3400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9eb4106440 0x7f9eb41a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.998+0000 7f9eb3400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9eb4106440 0x7f9eb41a24f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48640/0 (socket says 172.21.15.69:48640) 2024-05-14T15:41:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.998+0000 7f9eb3400640 1 -- 172.21.15.69:0/2854877688 learned_addr learned my addr 172.21.15.69:0/2854877688 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.998+0000 7f9eb2a00640 1 --2- 172.21.15.69:0/2854877688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9eb410bcf0 0x7f9eb41a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.998+0000 7f9eb3e00640 1 --2- 172.21.15.69:0/2854877688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9eb410c190 0x7f9eb419c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.998+0000 7f9eb3400640 1 -- 172.21.15.69:0/2854877688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9eb410bcf0 msgr2=0x7f9eb41a2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.998+0000 7f9eb3400640 1 --2- 172.21.15.69:0/2854877688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9eb410bcf0 0x7f9eb41a2a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.999+0000 7f9eb3400640 1 -- 172.21.15.69:0/2854877688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9eb410c190 msgr2=0x7f9eb419c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.999+0000 7f9eb3400640 1 --2- 172.21.15.69:0/2854877688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9eb410c190 0x7f9eb419c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.999+0000 7f9eb3400640 1 -- 172.21.15.69:0/2854877688 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9eb419cda0 con 0x7f9eb4106440 2024-05-14T15:41:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.999+0000 7f9eb2a00640 1 --2- 172.21.15.69:0/2854877688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9eb410bcf0 0x7f9eb41a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:41:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.999+0000 7f9eb3e00640 1 --2- 172.21.15.69:0/2854877688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9eb410c190 0x7f9eb419c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:41:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.999+0000 7f9eb3400640 1 --2- 172.21.15.69:0/2854877688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9eb4106440 0x7f9eb41a24f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4005940 tx=0x7f9ea40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.999+0000 7f9eabe00640 1 -- 172.21.15.69:0/2854877688 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea403f030 con 0x7f9eb4106440 2024-05-14T15:41:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.999+0000 7f9eabe00640 1 -- 172.21.15.69:0/2854877688 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ea4003c90 con 0x7f9eb4106440 2024-05-14T15:41:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.999+0000 7f9eabe00640 1 -- 172.21.15.69:0/2854877688 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4035070 con 0x7f9eb4106440 2024-05-14T15:41:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.999+0000 7f9eb9200640 1 -- 172.21.15.69:0/2854877688 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9eb419cfd0 con 0x7f9eb4106440 2024-05-14T15:41:20.003 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:19.999+0000 7f9eb9200640 1 -- 172.21.15.69:0/2854877688 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9eb419d4c0 con 0x7f9eb4106440 2024-05-14T15:41:20.004 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.003+0000 7f9ec1800740 1 Processor -- start 2024-05-14T15:41:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.003+0000 7f9ec1800740 1 -- start start 2024-05-14T15:41:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.003+0000 7f9eabe00640 1 -- 172.21.15.69:0/2854877688 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9ea4042030 con 0x7f9eb4106440 2024-05-14T15:41:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.003+0000 7f9ec1800740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6e71b0 0x55cc4aa88480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.003+0000 7f9ec1800740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6be2f0 0x55cc4aa889c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.003+0000 7f9ec1800740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6c64d0 0x55cc4aa88f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.003+0000 7f9ec1800740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cc4a9ed550 con 0x55cc4a6c64d0 2024-05-14T15:41:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.003+0000 7f9ec1800740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cc4a992bc0 con 0x55cc4a6e71b0 2024-05-14T15:41:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.003+0000 7f9ec1800740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cc4a9e9510 con 0x55cc4a6be2f0 2024-05-14T15:41:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.004+0000 7f9eb2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6c64d0 0x55cc4aa88f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.004+0000 7f9eb2a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6c64d0 0x55cc4aa88f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48654/0 (socket says 172.21.15.69:48654) 2024-05-14T15:41:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.004+0000 7f9eb2a00640 1 -- 172.21.15.69:0/558878597 learned_addr learned my addr 172.21.15.69:0/558878597 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.004+0000 7f9eb3400640 1 --2- 172.21.15.69:0/558878597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6be2f0 0x55cc4aa889c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.004+0000 7f9eb3e00640 1 --2- 172.21.15.69:0/558878597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6e71b0 0x55cc4aa88480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.004+0000 7f9eb2a00640 1 -- 172.21.15.69:0/558878597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6be2f0 msgr2=0x55cc4aa889c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.004+0000 7f9eb2a00640 1 --2- 172.21.15.69:0/558878597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6be2f0 0x55cc4aa889c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.004+0000 7f9eb2a00640 1 -- 172.21.15.69:0/558878597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6e71b0 msgr2=0x55cc4aa88480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.004+0000 7f9eb2a00640 1 --2- 172.21.15.69:0/558878597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6e71b0 0x55cc4aa88480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.007 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.004+0000 7f9eb2a00640 1 -- 172.21.15.69:0/558878597 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc4a6ff210 con 0x55cc4a6c64d0 2024-05-14T15:41:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.005+0000 7f9eb2a00640 1 --2- 172.21.15.69:0/558878597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6c64d0 0x55cc4aa88f00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0009b10 tx=0x7f9ea000e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b19b2307bd1c64 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.005+0000 7f9eabe00640 1 --2- 172.21.15.69:0/2854877688 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9e980b2950 0x7f9e980b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.005+0000 7f9ea8c00640 1 -- 172.21.15.69:0/558878597 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0016070 con 0x55cc4a6c64d0 2024-05-14T15:41:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.005+0000 7f9ea8c00640 1 -- 172.21.15.69:0/558878597 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ea00054b0 con 0x55cc4a6c64d0 2024-05-14T15:41:20.010 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.005+0000 7f9ea8c00640 1 -- 172.21.15.69:0/558878597 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0004dd0 con 0x55cc4a6c64d0 2024-05-14T15:41:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.005+0000 7f9eabe00640 1 -- 172.21.15.69:0/2854877688 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 9642+0+0 (secure 0 0 0) 0x7f9ea4103080 con 0x7f9eb4106440 2024-05-14T15:41:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.005+0000 7f9eb3e00640 1 --2- 172.21.15.69:0/2854877688 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9e980b2950 0x7f9e980b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.006+0000 7f9ec1800740 1 -- 172.21.15.69:0/558878597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6c64d0 msgr2=0x55cc4aa88f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.006+0000 7f9ec1800740 1 --2- 172.21.15.69:0/558878597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6c64d0 0x55cc4aa88f00 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f9ea0009b10 tx=0x7f9ea000e2f0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.006+0000 7f9eb3e00640 1 --2- 172.21.15.69:0/2854877688 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9e980b2950 0x7f9e980b4e60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55cc4aa855f0 tx=0x7f9eac009590 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.006+0000 7f9ec1800740 1 -- 172.21.15.69:0/558878597 shutdown_connections 2024-05-14T15:41:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.006+0000 7f9ec1800740 1 --2- 172.21.15.69:0/558878597 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6c64d0 0x55cc4aa88f00 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.006+0000 7f9ec1800740 1 --2- 172.21.15.69:0/558878597 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6be2f0 0x55cc4aa889c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.006+0000 7f9ec1800740 1 --2- 172.21.15.69:0/558878597 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6e71b0 0x55cc4aa88480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.006+0000 7f9ec1800740 1 -- 172.21.15.69:0/558878597 >> 172.21.15.69:0/558878597 conn(0x55cc4a6db300 msgr2=0x55cc4aa84c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.006+0000 7f9ec1800740 1 -- 172.21.15.69:0/558878597 shutdown_connections 2024-05-14T15:41:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.006+0000 7f9ec1800740 1 -- 172.21.15.69:0/558878597 wait complete. 2024-05-14T15:41:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.007+0000 7f9ec1800740 1 -- start start 2024-05-14T15:41:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.007+0000 7f9ec1800740 1 Processor -- start 2024-05-14T15:41:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.008+0000 7f9ec1800740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6be2f0 0x55cc4aa928d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.008+0000 7f9ec1800740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6c64d0 0x55cc4aa92e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.008+0000 7f9ec1800740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6e71b0 0x55cc4aa9ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.008+0000 7f9ec1800740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55cc4aa955b0 con 0x55cc4a6e71b0 2024-05-14T15:41:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.008+0000 7f9ec1800740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55cc4a9a6660 con 0x55cc4a6c64d0 2024-05-14T15:41:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.008+0000 7f9ec1800740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55cc4aa95730 con 0x55cc4a6be2f0 2024-05-14T15:41:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.008+0000 7f9ec1800740 10 client.0 _ll_register_callbacks cb 0x55cc4a970400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:41:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.008+0000 7f9eb3e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6e71b0 0x55cc4aa9ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.008+0000 7f9eb3e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6e71b0 0x55cc4aa9ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48668/0 (socket says 172.21.15.69:48668) 2024-05-14T15:41:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.008+0000 7f9eb3e00640 1 -- 172.21.15.69:0/3813111961 learned_addr learned my addr 172.21.15.69:0/3813111961 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.008+0000 7f9eb2a00640 1 --2- 172.21.15.69:0/3813111961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6c64d0 0x55cc4aa92e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.008+0000 7f9eb3400640 1 --2- 172.21.15.69:0/3813111961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6be2f0 0x55cc4aa928d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.009+0000 7f9eb3e00640 1 -- 172.21.15.69:0/3813111961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6be2f0 msgr2=0x55cc4aa928d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.009+0000 7f9eb3e00640 1 --2- 172.21.15.69:0/3813111961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6be2f0 0x55cc4aa928d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.009+0000 7f9eb3e00640 1 -- 172.21.15.69:0/3813111961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6c64d0 msgr2=0x55cc4aa92e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.009+0000 7f9eb3e00640 1 --2- 172.21.15.69:0/3813111961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6c64d0 0x55cc4aa92e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.009+0000 7f9eb3e00640 1 -- 172.21.15.69:0/3813111961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc4a7cb620 con 0x55cc4a6e71b0 2024-05-14T15:41:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.009+0000 7f9eb3e00640 1 --2- 172.21.15.69:0/3813111961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6e71b0 0x55cc4aa9ea60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f9eac005c00 tx=0x7f9eac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce00c2eceffb034e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.009+0000 7f9e9d600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:41:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.009+0000 7f9e9d600640 1 -- 172.21.15.69:0/3813111961 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eac00fd60 con 0x55cc4a6e71b0 2024-05-14T15:41:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.009+0000 7f9ec1800740 1 -- 172.21.15.69:0/3813111961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9ea00054b0 con 0x55cc4a6e71b0 2024-05-14T15:41:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.009+0000 7f9e9d600640 1 -- 172.21.15.69:0/3813111961 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(121..121 src has 1..121) ==== 9642+0+0 (secure 0 0 0) 0x7f9eac01f420 con 0x55cc4a6e71b0 2024-05-14T15:41:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.010+0000 7f9e9d600640 1 -- 172.21.15.69:0/3813111961 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f9eac012e20 con 0x55cc4a6e71b0 2024-05-14T15:41:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.010+0000 7f9ec1800740 10 client.17577 fetch_fsmap learned FSMap version 82 2024-05-14T15:41:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.010+0000 7f9ec1800740 1 -- 172.21.15.69:0/3813111961 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=4+}) -- 0x55cc4aaa17b0 con 0x55cc4a6e71b0 2024-05-14T15:41:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.010+0000 7f9e9d600640 1 -- 172.21.15.69:0/3813111961 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ea00054b0 con 0x55cc4a6e71b0 2024-05-14T15:41:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.010+0000 7f9e9d600640 1 -- 172.21.15.69:0/3813111961 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 82) ==== 8414+0+0 (secure 0 0 0) 0x7f9eac027630 con 0x55cc4a6e71b0 2024-05-14T15:41:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.010+0000 7f9ec1800740 10 client.17577 fetch_fsmap finished waiting for FSMap version 82 2024-05-14T15:41:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.010+0000 7f9ec1800740 10 client.17577 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:41:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.010+0000 7f9ec1800740 20 client.17577 populate_metadata read hostname 'smithi069' 2024-05-14T15:41:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.010+0000 7f9ec1800740 1 --2- 172.21.15.69:0/3813111961 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cc4a6a5d80 0x55cc4aaa4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.010+0000 7f9ec1800740 4 client.17577 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:41:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.010+0000 7f9ec1800740 1 -- 172.21.15.69:0/3813111961 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cc4a9fb160 con 0x55cc4a6a5d80 2024-05-14T15:41:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.011+0000 7f9eb3400640 1 --2- 172.21.15.69:0/3813111961 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cc4a6a5d80 0x55cc4aaa4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.012+0000 7f9eb3400640 1 --2- 172.21.15.69:0/3813111961 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cc4a6a5d80 0x55cc4aaa4da0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=640ead9eef17fa31 server_cookie=ad2a67bdc15ab417 in_seq=0 out_seq=0 2024-05-14T15:41:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.012+0000 7f9e9d600640 10 client.17577 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:41:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.014+0000 7f9e9d600640 1 -- 172.21.15.69:0/3813111961 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55cc4a9fb160 con 0x55cc4a6a5d80 2024-05-14T15:41:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.014+0000 7f9e9d600640 10 client.17577 handle_command_reply: tid=0 2024-05-14T15:41:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.014+0000 7f9ec1800740 1 client.17577 shutdown 2024-05-14T15:41:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.014+0000 7f9ec1800740 1 -- 172.21.15.69:0/3813111961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6e71b0 msgr2=0x55cc4aa9ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.014+0000 7f9ec1800740 1 --2- 172.21.15.69:0/3813111961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6e71b0 0x55cc4aa9ea60 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f9eac005c00 tx=0x7f9eac004a40 comp rx=0 tx=0).stop 2024-05-14T15:41:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.014+0000 7f9ec1800740 1 -- 172.21.15.69:0/3813111961 shutdown_connections 2024-05-14T15:41:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.014+0000 7f9ec1800740 1 --2- 172.21.15.69:0/3813111961 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cc4a6a5d80 0x55cc4aaa4da0 crc :-1 s=READY pgs=262 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.014+0000 7f9ec1800740 1 --2- 172.21.15.69:0/3813111961 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6e71b0 0x55cc4aa9ea60 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.014+0000 7f9ec1800740 1 --2- 172.21.15.69:0/3813111961 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6c64d0 0x55cc4aa92e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.014+0000 7f9ec1800740 1 --2- 172.21.15.69:0/3813111961 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6be2f0 0x55cc4aa928d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.014+0000 7f9e9d600640 0 client.17577 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:41:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.014+0000 7f9ec1800740 1 -- 172.21.15.69:0/3813111961 >> 172.21.15.69:0/3813111961 conn(0x55cc4a6db300 msgr2=0x55cc4aa8a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.014+0000 7f9ec1800740 1 -- 172.21.15.69:0/3813111961 shutdown_connections 2024-05-14T15:41:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.014+0000 7f9ec1800740 1 -- 172.21.15.69:0/3813111961 wait complete. 2024-05-14T15:41:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.015+0000 7f9ec1800740 20 client.17577 trim_cache size 0 max 16384 2024-05-14T15:41:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.031+0000 7f9ec1800740 1 Processor -- start 2024-05-14T15:41:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.031+0000 7f9ec1800740 1 -- start start 2024-05-14T15:41:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.031+0000 7f9ec1800740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6be2f0 0x55cc4aa84d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.031+0000 7f9ec1800740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6c64d0 0x55cc4aa89220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.031+0000 7f9ec1800740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6e71b0 0x55cc4aaaa5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.031+0000 7f9ec1800740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb41b34b0 con 0x55cc4a6be2f0 2024-05-14T15:41:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.031+0000 7f9ec1800740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb41b5230 con 0x55cc4a6e71b0 2024-05-14T15:41:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.031+0000 7f9ec1800740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb41b3b80 con 0x55cc4a6c64d0 2024-05-14T15:41:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.032+0000 7f9eb3400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6be2f0 0x55cc4aa84d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.032+0000 7f9eb3400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6be2f0 0x55cc4aa84d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48672/0 (socket says 172.21.15.69:48672) 2024-05-14T15:41:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.032+0000 7f9eb3400640 1 -- 172.21.15.69:0/3843729684 learned_addr learned my addr 172.21.15.69:0/3843729684 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.032+0000 7f9eb3400640 1 -- 172.21.15.69:0/3843729684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6c64d0 msgr2=0x55cc4aa89220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.032+0000 7f9eb3400640 1 --2- 172.21.15.69:0/3843729684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6c64d0 0x55cc4aa89220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.032+0000 7f9eb3400640 1 -- 172.21.15.69:0/3843729684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6e71b0 msgr2=0x55cc4aaaa5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.032+0000 7f9eb3400640 1 --2- 172.21.15.69:0/3843729684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6e71b0 0x55cc4aaaa5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.032+0000 7f9eb3400640 1 -- 172.21.15.69:0/3843729684 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cc4aa91d10 con 0x55cc4a6be2f0 2024-05-14T15:41:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.032+0000 7f9eb3400640 1 --2- 172.21.15.69:0/3843729684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6be2f0 0x55cc4aa84d90 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4004600 tx=0x7f9ea4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f015177c312668e server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.032+0000 7f9e9fe00640 1 -- 172.21.15.69:0/3843729684 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4049070 con 0x55cc4a6be2f0 2024-05-14T15:41:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.032+0000 7f9e9fe00640 1 -- 172.21.15.69:0/3843729684 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9ea4003e40 con 0x55cc4a6be2f0 2024-05-14T15:41:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.032+0000 7f9e9fe00640 1 -- 172.21.15.69:0/3843729684 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea40c6190 con 0x55cc4a6be2f0 2024-05-14T15:41:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.033+0000 7f9ec1800740 1 -- 172.21.15.69:0/3843729684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6be2f0 msgr2=0x55cc4aa84d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.033+0000 7f9ec1800740 1 --2- 172.21.15.69:0/3843729684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6be2f0 0x55cc4aa84d90 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4004600 tx=0x7f9ea4009260 comp rx=0 tx=0).stop 2024-05-14T15:41:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.033+0000 7f9ec1800740 1 -- 172.21.15.69:0/3843729684 shutdown_connections 2024-05-14T15:41:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.033+0000 7f9ec1800740 1 --2- 172.21.15.69:0/3843729684 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6e71b0 0x55cc4aaaa5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.033+0000 7f9ec1800740 1 --2- 172.21.15.69:0/3843729684 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6c64d0 0x55cc4aa89220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.033+0000 7f9ec1800740 1 --2- 172.21.15.69:0/3843729684 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6be2f0 0x55cc4aa84d90 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.039 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.033+0000 7f9ec1800740 1 -- 172.21.15.69:0/3843729684 >> 172.21.15.69:0/3843729684 conn(0x55cc4a6db300 msgr2=0x55cc4aa91600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.033+0000 7f9ec1800740 1 -- 172.21.15.69:0/3843729684 shutdown_connections 2024-05-14T15:41:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.033+0000 7f9ec1800740 1 -- 172.21.15.69:0/3843729684 wait complete. 2024-05-14T15:41:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.034+0000 7f9ec1800740 1 -- start start 2024-05-14T15:41:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.034+0000 7f9ec1800740 1 Processor -- start 2024-05-14T15:41:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.035+0000 7f9ec1800740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6be2f0 0x55cc4ab05340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.035+0000 7f9ec1800740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6c64d0 0x55cc4ab05880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.035+0000 7f9ec1800740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6e71b0 0x55cc4aa9a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.035+0000 7f9ec1800740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb41b4aa0 con 0x55cc4a6be2f0 2024-05-14T15:41:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.035+0000 7f9ec1800740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb41b4310 con 0x55cc4a6c64d0 2024-05-14T15:41:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.035+0000 7f9ec1800740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9eb41b14b0 con 0x55cc4a6e71b0 2024-05-14T15:41:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.035+0000 7f9ec1800740 10 client.0 _ll_register_callbacks cb 0x7f9eac0096a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:41:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.035+0000 7f9eb3400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6be2f0 0x55cc4ab05340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.035+0000 7f9eb3400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6be2f0 0x55cc4ab05340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:48686/0 (socket says 172.21.15.69:48686) 2024-05-14T15:41:20.040 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.035+0000 7f9eb3400640 1 -- 172.21.15.69:0/3717205595 learned_addr learned my addr 172.21.15.69:0/3717205595 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.035+0000 7f9eb3400640 1 -- 172.21.15.69:0/3717205595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6e71b0 msgr2=0x55cc4aa9a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.035+0000 7f9eb3400640 1 --2- 172.21.15.69:0/3717205595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6e71b0 0x55cc4aa9a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.035+0000 7f9eb2a00640 1 --2- 172.21.15.69:0/3717205595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6c64d0 0x55cc4ab05880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.035+0000 7f9eb3400640 1 -- 172.21.15.69:0/3717205595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6c64d0 msgr2=0x55cc4ab05880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.035+0000 7f9eb3400640 1 --2- 172.21.15.69:0/3717205595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6c64d0 0x55cc4ab05880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.035+0000 7f9eb3400640 1 -- 172.21.15.69:0/3717205595 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cc4aa9aa80 con 0x55cc4a6be2f0 2024-05-14T15:41:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.036+0000 7f9eb3400640 1 --2- 172.21.15.69:0/3717205595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6be2f0 0x55cc4ab05340 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40c7170 tx=0x7f9ea4003a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6adf90d04bbc01fe server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.036+0000 7f9e9d600640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:41:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.036+0000 7f9e9d600640 1 -- 172.21.15.69:0/3717205595 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4049040 con 0x55cc4a6be2f0 2024-05-14T15:41:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.036+0000 7f9e9d600640 1 -- 172.21.15.69:0/3717205595 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(121..121 src has 1..121) ==== 9642+0+0 (secure 0 0 0) 0x7f9ea41005f0 con 0x55cc4a6be2f0 2024-05-14T15:41:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.036+0000 7f9ec1800740 1 -- 172.21.15.69:0/3717205595 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cc4a9f4fd0 con 0x55cc4a6be2f0 2024-05-14T15:41:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.036+0000 7f9e9d600640 1 -- 172.21.15.69:0/3717205595 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f9ea41007f0 con 0x55cc4a6be2f0 2024-05-14T15:41:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.036+0000 7f9ec1800740 10 client.17583 fetch_fsmap learned FSMap version 82 2024-05-14T15:41:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.036+0000 7f9ec1800740 1 -- 172.21.15.69:0/3717205595 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=4+}) -- 0x55cc4ab0cac0 con 0x55cc4a6be2f0 2024-05-14T15:41:20.041 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.036+0000 7f9e9d600640 1 -- 172.21.15.69:0/3717205595 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x55cc4a9f4fd0 con 0x55cc4a6be2f0 2024-05-14T15:41:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.037+0000 7f9e9d600640 1 -- 172.21.15.69:0/3717205595 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 82) ==== 8414+0+0 (secure 0 0 0) 0x7f9ea40d28d0 con 0x55cc4a6be2f0 2024-05-14T15:41:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.037+0000 7f9ec1800740 10 client.17583 fetch_fsmap finished waiting for FSMap version 82 2024-05-14T15:41:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.037+0000 7f9ec1800740 10 client.17583 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:41:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.037+0000 7f9ec1800740 20 client.17583 populate_metadata read hostname 'smithi069' 2024-05-14T15:41:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.037+0000 7f9ec1800740 1 --2- 172.21.15.69:0/3717205595 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cc4a67b1c0 0x55cc4ab0f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.037+0000 7f9ec1800740 4 client.17583 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:41:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.037+0000 7f9ec1800740 1 -- 172.21.15.69:0/3717205595 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55cc4a9704b0 con 0x55cc4a67b1c0 2024-05-14T15:41:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.037+0000 7f9eb2a00640 1 --2- 172.21.15.69:0/3717205595 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cc4a67b1c0 0x55cc4ab0f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:20.042 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.038+0000 7f9eb2a00640 1 --2- 172.21.15.69:0/3717205595 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cc4a67b1c0 0x55cc4ab0f2c0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6c44821a5a9bd07 server_cookie=4d2bf4e3cd07d25 in_seq=0 out_seq=0 2024-05-14T15:41:20.043 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.038+0000 7f9e9d600640 10 client.17583 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:41:20.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:19 smithi203 ceph-mon[34567]: pgmap v622: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 4.0 MiB/s wr, 424 op/s 2024-05-14T15:41:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.098+0000 7f9e9d600640 1 -- 172.21.15.69:0/3717205595 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55cc4a9704b0 con 0x55cc4a67b1c0 2024-05-14T15:41:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.098+0000 7f9e9d600640 10 client.17583 handle_command_reply: tid=0 2024-05-14T15:41:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.099+0000 7f9ec1800740 1 client.17583 shutdown 2024-05-14T15:41:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.099+0000 7f9ec1800740 1 -- 172.21.15.69:0/3717205595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6be2f0 msgr2=0x55cc4ab05340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.099+0000 7f9ec1800740 1 --2- 172.21.15.69:0/3717205595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6be2f0 0x55cc4ab05340 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f9ea40c7170 tx=0x7f9ea4003a30 comp rx=0 tx=0).stop 2024-05-14T15:41:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.099+0000 7f9ec1800740 1 -- 172.21.15.69:0/3717205595 shutdown_connections 2024-05-14T15:41:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.099+0000 7f9ec1800740 1 --2- 172.21.15.69:0/3717205595 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55cc4a6e71b0 0x55cc4aa9a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.099+0000 7f9ec1800740 1 --2- 172.21.15.69:0/3717205595 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55cc4a6c64d0 0x55cc4ab05880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.099+0000 7f9ec1800740 1 --2- 172.21.15.69:0/3717205595 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55cc4a67b1c0 0x55cc4ab0f2c0 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.101 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.099+0000 7f9ec1800740 1 --2- 172.21.15.69:0/3717205595 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55cc4a6be2f0 0x55cc4ab05340 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.099+0000 7f9ec1800740 1 -- 172.21.15.69:0/3717205595 >> 172.21.15.69:0/3717205595 conn(0x55cc4a6db300 msgr2=0x55cc4aa91600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.099+0000 7f9e9d600640 0 client.17583 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:41:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.099+0000 7f9ec1800740 1 -- 172.21.15.69:0/3717205595 shutdown_connections 2024-05-14T15:41:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.099+0000 7f9ec1800740 1 -- 172.21.15.69:0/3717205595 wait complete. 2024-05-14T15:41:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.099+0000 7f9ec1800740 20 client.17583 trim_cache size 0 max 16384 2024-05-14T15:41:20.102 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:41:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:41:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:41:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:41:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.100+0000 7f9eb9200640 1 -- 172.21.15.69:0/2854877688 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9e980b2950 msgr2=0x7f9e980b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:20.103 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.100+0000 7f9eb9200640 1 --2- 172.21.15.69:0/2854877688 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9e980b2950 0x7f9e980b4e60 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x55cc4aa855f0 tx=0x7f9eac009590 comp rx=0 tx=0).stop 2024-05-14T15:41:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.100+0000 7f9eb9200640 1 -- 172.21.15.69:0/2854877688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9eb4106440 msgr2=0x7f9eb41a24f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.100+0000 7f9eb9200640 1 --2- 172.21.15.69:0/2854877688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9eb4106440 0x7f9eb41a24f0 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f9ea4005940 tx=0x7f9ea40042f0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.101+0000 7f9eb9200640 1 -- 172.21.15.69:0/2854877688 shutdown_connections 2024-05-14T15:41:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.101+0000 7f9eb9200640 1 --2- 172.21.15.69:0/2854877688 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9e980b2950 0x7f9e980b4e60 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.101+0000 7f9eb9200640 1 --2- 172.21.15.69:0/2854877688 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9eb410c190 0x7f9eb419c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.101+0000 7f9eb9200640 1 --2- 172.21.15.69:0/2854877688 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9eb410bcf0 0x7f9eb41a2a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.101+0000 7f9eb9200640 1 --2- 172.21.15.69:0/2854877688 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9eb4106440 0x7f9eb41a24f0 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.101+0000 7f9eb9200640 1 -- 172.21.15.69:0/2854877688 >> 172.21.15.69:0/2854877688 conn(0x7f9eb4101390 msgr2=0x7f9eb4103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.101+0000 7f9eb9200640 1 -- 172.21.15.69:0/2854877688 shutdown_connections 2024-05-14T15:41:20.104 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:20.101+0000 7f9eb9200640 1 -- 172.21.15.69:0/2854877688 wait complete. 2024-05-14T15:41:21.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:21 smithi203 ceph-mon[34567]: osdmap e122: 12 total, 12 up, 12 in 2024-05-14T15:41:21.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:21 smithi203 ceph-mon[34567]: pgmap v624: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 1.7 MiB/s wr, 191 op/s 2024-05-14T15:41:21.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:21 smithi092 ceph-mon[34729]: osdmap e122: 12 total, 12 up, 12 in 2024-05-14T15:41:21.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:21 smithi092 ceph-mon[34729]: pgmap v624: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 1.7 MiB/s wr, 191 op/s 2024-05-14T15:41:21.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:21 smithi069 ceph-mon[31270]: osdmap e122: 12 total, 12 up, 12 in 2024-05-14T15:41:21.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:21 smithi069 ceph-mon[31270]: pgmap v624: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 1.7 MiB/s wr, 191 op/s 2024-05-14T15:41:23.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:23 smithi203 ceph-mon[34567]: pgmap v625: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 753 KiB/s wr, 82 op/s 2024-05-14T15:41:23.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:23 smithi092 ceph-mon[34729]: pgmap v625: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 753 KiB/s wr, 82 op/s 2024-05-14T15:41:23.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:23 smithi069 ceph-mon[31270]: pgmap v625: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 753 KiB/s wr, 82 op/s 2024-05-14T15:41:25.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:25 smithi203 ceph-mon[34567]: pgmap v626: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 709 KiB/s wr, 78 op/s 2024-05-14T15:41:25.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:25 smithi092 ceph-mon[34729]: pgmap v626: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 709 KiB/s wr, 78 op/s 2024-05-14T15:41:25.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:25 smithi069 ceph-mon[31270]: pgmap v626: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 94 KiB/s rd, 709 KiB/s wr, 78 op/s 2024-05-14T15:41:27.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:27 smithi203 ceph-mon[34567]: pgmap v627: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 68 KiB/s wr, 24 op/s 2024-05-14T15:41:27.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:27 smithi092 ceph-mon[34729]: pgmap v627: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 68 KiB/s wr, 24 op/s 2024-05-14T15:41:27.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:27 smithi069 ceph-mon[31270]: pgmap v627: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 68 KiB/s wr, 24 op/s 2024-05-14T15:41:29.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:29 smithi203 ceph-mon[34567]: pgmap v628: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 68 KiB/s wr, 24 op/s 2024-05-14T15:41:29.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:29 smithi092 ceph-mon[34729]: pgmap v628: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 68 KiB/s wr, 24 op/s 2024-05-14T15:41:29.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:29 smithi069 ceph-mon[31270]: pgmap v628: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 65 KiB/s rd, 68 KiB/s wr, 24 op/s 2024-05-14T15:41:31.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:31 smithi203 ceph-mon[34567]: pgmap v629: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 77 KiB/s wr, 26 op/s 2024-05-14T15:41:31.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:31 smithi092 ceph-mon[34729]: pgmap v629: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 77 KiB/s wr, 26 op/s 2024-05-14T15:41:31.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:31 smithi069 ceph-mon[31270]: pgmap v629: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 77 KiB/s wr, 26 op/s 2024-05-14T15:41:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.322+0000 7f3d92c00640 1 -- 172.21.15.69:0/1129268322 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d8c10c180 msgr2=0x7f3d8c105dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.322+0000 7f3d92c00640 1 --2- 172.21.15.69:0/1129268322 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d8c10c180 0x7f3d8c105dc0 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f3d80009ca0 tx=0x7f3d8002a8c0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.324 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.322+0000 7f3d92c00640 1 -- 172.21.15.69:0/1129268322 shutdown_connections 2024-05-14T15:41:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.322+0000 7f3d92c00640 1 --2- 172.21.15.69:0/1129268322 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d8c106430 0x7f3d8c112800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.322+0000 7f3d92c00640 1 --2- 172.21.15.69:0/1129268322 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d8c10c180 0x7f3d8c105dc0 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.322+0000 7f3d92c00640 1 --2- 172.21.15.69:0/1129268322 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d8c10bce0 0x7f3d8c105880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.322+0000 7f3d92c00640 1 -- 172.21.15.69:0/1129268322 >> 172.21.15.69:0/1129268322 conn(0x7f3d8c1013e0 msgr2=0x7f3d8c103830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.323+0000 7f3d92c00640 1 -- 172.21.15.69:0/1129268322 shutdown_connections 2024-05-14T15:41:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.323+0000 7f3d92c00640 1 -- 172.21.15.69:0/1129268322 wait complete. 2024-05-14T15:41:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.324+0000 7f3d92c00640 1 Processor -- start 2024-05-14T15:41:33.325 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.324+0000 7f3d92c00640 1 -- start start 2024-05-14T15:41:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.324+0000 7f3d92c00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d8c106430 0x7f3d8c1a24f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.324+0000 7f3d92c00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d8c10bce0 0x7f3d8c1a2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.324+0000 7f3d92c00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d8c10c180 0x7f3d8c19c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.324+0000 7f3d92c00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c115dd0 con 0x7f3d8c10bce0 2024-05-14T15:41:33.327 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.324+0000 7f3d92c00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c115c50 con 0x7f3d8c10c180 2024-05-14T15:41:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.324+0000 7f3d92c00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c115f50 con 0x7f3d8c106430 2024-05-14T15:41:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.325+0000 7f3d90e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d8c10bce0 0x7f3d8c1a2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.325+0000 7f3d90e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d8c10bce0 0x7f3d8c1a2a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36728/0 (socket says 172.21.15.69:36728) 2024-05-14T15:41:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.325+0000 7f3d90e00640 1 -- 172.21.15.69:0/3770600320 learned_addr learned my addr 172.21.15.69:0/3770600320 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.325+0000 7f3d91800640 1 --2- 172.21.15.69:0/3770600320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d8c106430 0x7f3d8c1a24f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.325+0000 7f3d92200640 1 --2- 172.21.15.69:0/3770600320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d8c10c180 0x7f3d8c19c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.325+0000 7f3d90e00640 1 -- 172.21.15.69:0/3770600320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d8c106430 msgr2=0x7f3d8c1a24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.325+0000 7f3d90e00640 1 --2- 172.21.15.69:0/3770600320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d8c106430 0x7f3d8c1a24f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.325+0000 7f3d90e00640 1 -- 172.21.15.69:0/3770600320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d8c10c180 msgr2=0x7f3d8c19c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.325+0000 7f3d90e00640 1 --2- 172.21.15.69:0/3770600320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d8c10c180 0x7f3d8c19c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.325+0000 7f3d90e00640 1 -- 172.21.15.69:0/3770600320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d8c19cda0 con 0x7f3d8c10bce0 2024-05-14T15:41:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.325+0000 7f3d92200640 1 --2- 172.21.15.69:0/3770600320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d8c10c180 0x7f3d8c19c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:41:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.325+0000 7f3d90e00640 1 --2- 172.21.15.69:0/3770600320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d8c10bce0 0x7f3d8c1a2a30 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3d80000f80 tx=0x7f3d80032a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.326+0000 7f3d8a000640 1 -- 172.21.15.69:0/3770600320 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d80032e00 con 0x7f3d8c10bce0 2024-05-14T15:41:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.326+0000 7f3d8a000640 1 -- 172.21.15.69:0/3770600320 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d800044d0 con 0x7f3d8c10bce0 2024-05-14T15:41:33.328 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.326+0000 7f3d92c00640 1 -- 172.21.15.69:0/3770600320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d8c19cfd0 con 0x7f3d8c10bce0 2024-05-14T15:41:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.326+0000 7f3d8a000640 1 -- 172.21.15.69:0/3770600320 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d80030bc0 con 0x7f3d8c10bce0 2024-05-14T15:41:33.329 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.326+0000 7f3d92c00640 1 -- 172.21.15.69:0/3770600320 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d8c1a9290 con 0x7f3d8c10bce0 2024-05-14T15:41:33.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.330+0000 7f3d9b237740 1 Processor -- start 2024-05-14T15:41:33.331 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.330+0000 7f3d9b237740 1 -- start start 2024-05-14T15:41:33.332 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.331+0000 7f3d9b237740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3dc480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.331+0000 7f3d9b237740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb0122f0 0x55d2fb3dc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.331+0000 7f3d9b237740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb01a4d0 0x55d2fb3dcf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.331+0000 7f3d9b237740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55d2fb341550 con 0x55d2fb03b1b0 2024-05-14T15:41:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.331+0000 7f3d9b237740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d2fb2e6bc0 con 0x55d2fb01a4d0 2024-05-14T15:41:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.331+0000 7f3d9b237740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d2fb33d510 con 0x55d2fb0122f0 2024-05-14T15:41:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.331+0000 7f3d8a000640 1 -- 172.21.15.69:0/3770600320 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f3d80004040 con 0x7f3d8c10bce0 2024-05-14T15:41:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.331+0000 7f3d92200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3dc480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.331+0000 7f3d92200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3dc480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36736/0 (socket says 172.21.15.69:36736) 2024-05-14T15:41:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.331+0000 7f3d92200640 1 -- 172.21.15.69:0/1098761138 learned_addr learned my addr 172.21.15.69:0/1098761138 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.332+0000 7f3d91800640 1 --2- 172.21.15.69:0/1098761138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb0122f0 0x55d2fb3dc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.332+0000 7f3d92200640 1 -- 172.21.15.69:0/1098761138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb0122f0 msgr2=0x55d2fb3dc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.332+0000 7f3d92200640 1 --2- 172.21.15.69:0/1098761138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb0122f0 0x55d2fb3dc9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.333 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.332+0000 7f3d92200640 1 -- 172.21.15.69:0/1098761138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb01a4d0 msgr2=0x55d2fb3dcf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.332+0000 7f3d92200640 1 --2- 172.21.15.69:0/1098761138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb01a4d0 0x55d2fb3dcf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.332+0000 7f3d92200640 1 -- 172.21.15.69:0/1098761138 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2fb053210 con 0x55d2fb03b1b0 2024-05-14T15:41:33.334 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.332+0000 7f3d92200640 1 --2- 172.21.15.69:0/1098761138 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3dc480 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009bd0 tx=0x7f3d8400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aeecdf9fc70e2bb server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.332+0000 7f3d7aa00640 1 -- 172.21.15.69:0/1098761138 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84016070 con 0x55d2fb03b1b0 2024-05-14T15:41:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.332+0000 7f3d7aa00640 1 -- 172.21.15.69:0/1098761138 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d84011900 con 0x55d2fb03b1b0 2024-05-14T15:41:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.332+0000 7f3d7aa00640 1 -- 172.21.15.69:0/1098761138 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d84010670 con 0x55d2fb03b1b0 2024-05-14T15:41:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.333+0000 7f3d8a000640 1 --2- 172.21.15.69:0/3770600320 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3d740b29d0 0x7f3d740b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.333+0000 7f3d8a000640 1 -- 172.21.15.69:0/3770600320 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9554+0+0 (secure 0 0 0) 0x7f3d80103f10 con 0x7f3d8c10bce0 2024-05-14T15:41:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.333+0000 7f3d91800640 1 --2- 172.21.15.69:0/3770600320 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3d740b29d0 0x7f3d740b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.333+0000 7f3d9b237740 1 -- 172.21.15.69:0/1098761138 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb03b1b0 msgr2=0x55d2fb3dc480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.333+0000 7f3d9b237740 1 --2- 172.21.15.69:0/1098761138 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3dc480 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f3d84009bd0 tx=0x7f3d8400e6c0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.339 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.334+0000 7f3d9b237740 1 -- 172.21.15.69:0/1098761138 shutdown_connections 2024-05-14T15:41:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.334+0000 7f3d9b237740 1 --2- 172.21.15.69:0/1098761138 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb01a4d0 0x55d2fb3dcf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.334+0000 7f3d9b237740 1 --2- 172.21.15.69:0/1098761138 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb0122f0 0x55d2fb3dc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.334+0000 7f3d9b237740 1 --2- 172.21.15.69:0/1098761138 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3dc480 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.334+0000 7f3d9b237740 1 -- 172.21.15.69:0/1098761138 >> 172.21.15.69:0/1098761138 conn(0x55d2fb02f300 msgr2=0x55d2fb3d8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.334+0000 7f3d9b237740 1 -- 172.21.15.69:0/1098761138 shutdown_connections 2024-05-14T15:41:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.334+0000 7f3d9b237740 1 -- 172.21.15.69:0/1098761138 wait complete. 2024-05-14T15:41:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.334+0000 7f3d91800640 1 --2- 172.21.15.69:0/3770600320 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3d740b29d0 0x7f3d740b4ee0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c005fd0 tx=0x7f3d7c00b5d0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.334+0000 7f3d9b237740 1 -- start start 2024-05-14T15:41:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.335+0000 7f3d9b237740 1 Processor -- start 2024-05-14T15:41:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.335+0000 7f3d9b237740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3e69a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.335+0000 7f3d9b237740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb01a4d0 0x55d2fb3e6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.335+0000 7f3d9b237740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3f2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.340 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.335+0000 7f3d9b237740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x55d2fb3e95b0 con 0x55d2fb0122f0 2024-05-14T15:41:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.335+0000 7f3d9b237740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x55d2fb2fa660 con 0x55d2fb03b1b0 2024-05-14T15:41:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.335+0000 7f3d9b237740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x55d2fb3e9730 con 0x55d2fb01a4d0 2024-05-14T15:41:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.335+0000 7f3d9b237740 10 client.0 _ll_register_callbacks cb 0x55d2fb2c4400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:41:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.335+0000 7f3d91800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3e69a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.335+0000 7f3d91800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3e69a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36742/0 (socket says 172.21.15.69:36742) 2024-05-14T15:41:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.335+0000 7f3d91800640 1 -- 172.21.15.69:0/3344521 learned_addr learned my addr 172.21.15.69:0/3344521 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.336+0000 7f3d90e00640 1 --2- 172.21.15.69:0/3344521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb01a4d0 0x55d2fb3e6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.336+0000 7f3d91800640 1 -- 172.21.15.69:0/3344521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb01a4d0 msgr2=0x55d2fb3e6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.336+0000 7f3d92200640 1 --2- 172.21.15.69:0/3344521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3f2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.336+0000 7f3d91800640 1 --2- 172.21.15.69:0/3344521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb01a4d0 0x55d2fb3e6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.336+0000 7f3d91800640 1 -- 172.21.15.69:0/3344521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb03b1b0 msgr2=0x55d2fb3f2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.336+0000 7f3d91800640 1 --2- 172.21.15.69:0/3344521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3f2ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.336+0000 7f3d91800640 1 -- 172.21.15.69:0/3344521 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2fb11f620 con 0x55d2fb0122f0 2024-05-14T15:41:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.336+0000 7f3d91800640 1 --2- 172.21.15.69:0/3344521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3e69a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c012700 tx=0x7f3d7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7eb445c6e2ae6a server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:33.341 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.336+0000 7f3d6f400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:41:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.336+0000 7f3d6f400640 1 -- 172.21.15.69:0/3344521 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c023070 con 0x55d2fb0122f0 2024-05-14T15:41:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.337+0000 7f3d6f400640 1 -- 172.21.15.69:0/3344521 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 9554+0+0 (secure 0 0 0) 0x7f3d7c0035f0 con 0x55d2fb0122f0 2024-05-14T15:41:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.337+0000 7f3d9b237740 1 -- 172.21.15.69:0/3344521 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d84011900 con 0x55d2fb0122f0 2024-05-14T15:41:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.337+0000 7f3d6f400640 1 -- 172.21.15.69:0/3344521 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f3d7c02f050 con 0x55d2fb0122f0 2024-05-14T15:41:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.337+0000 7f3d9b237740 10 client.17595 fetch_fsmap learned FSMap version 82 2024-05-14T15:41:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.337+0000 7f3d9b237740 1 -- 172.21.15.69:0/3344521 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=4+}) -- 0x55d2fb3f58e0 con 0x55d2fb0122f0 2024-05-14T15:41:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.337+0000 7f3d6f400640 1 -- 172.21.15.69:0/3344521 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d84011900 con 0x55d2fb0122f0 2024-05-14T15:41:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.337+0000 7f3d6f400640 1 -- 172.21.15.69:0/3344521 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 82) ==== 8414+0+0 (secure 0 0 0) 0x7f3d7c01f850 con 0x55d2fb0122f0 2024-05-14T15:41:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.337+0000 7f3d9b237740 10 client.17595 fetch_fsmap finished waiting for FSMap version 82 2024-05-14T15:41:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.337+0000 7f3d9b237740 10 client.17595 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:41:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.338+0000 7f3d9b237740 20 client.17595 populate_metadata read hostname 'smithi069' 2024-05-14T15:41:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.338+0000 7f3d9b237740 1 --2- 172.21.15.69:0/3344521 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d2faff9d80 0x55d2fb3f8f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.342 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.338+0000 7f3d9b237740 4 client.17595 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:41:33.343 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.338+0000 7f3d9b237740 1 -- 172.21.15.69:0/3344521 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d2fb34f160 con 0x55d2faff9d80 2024-05-14T15:41:33.343 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.338+0000 7f3d90e00640 1 --2- 172.21.15.69:0/3344521 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d2faff9d80 0x55d2fb3f8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.339+0000 7f3d6f400640 10 client.17595 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:41:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.339+0000 7f3d90e00640 1 --2- 172.21.15.69:0/3344521 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d2faff9d80 0x55d2fb3f8f30 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=be30aefce3a0dc69 server_cookie=a3ef62d162c638c2 in_seq=0 out_seq=0 2024-05-14T15:41:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.341+0000 7f3d6f400640 1 -- 172.21.15.69:0/3344521 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x55d2fb34f160 con 0x55d2faff9d80 2024-05-14T15:41:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.341+0000 7f3d6f400640 10 client.17595 handle_command_reply: tid=0 2024-05-14T15:41:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.341+0000 7f3d9b237740 1 client.17595 shutdown 2024-05-14T15:41:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.342+0000 7f3d9b237740 1 -- 172.21.15.69:0/3344521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 msgr2=0x55d2fb3e69a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.342+0000 7f3d9b237740 1 --2- 172.21.15.69:0/3344521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3e69a0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c012700 tx=0x7f3d7c0046c0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.342+0000 7f3d9b237740 1 -- 172.21.15.69:0/3344521 shutdown_connections 2024-05-14T15:41:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.342+0000 7f3d9b237740 1 --2- 172.21.15.69:0/3344521 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3f2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.344 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.342+0000 7f3d9b237740 1 --2- 172.21.15.69:0/3344521 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb01a4d0 0x55d2fb3e6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.342+0000 7f3d9b237740 1 --2- 172.21.15.69:0/3344521 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d2faff9d80 0x55d2fb3f8f30 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.342+0000 7f3d9b237740 1 --2- 172.21.15.69:0/3344521 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3e69a0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.342+0000 7f3d6f400640 0 client.17595 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:41:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.342+0000 7f3d9b237740 1 -- 172.21.15.69:0/3344521 >> 172.21.15.69:0/3344521 conn(0x55d2fb02f300 msgr2=0x55d2fb3de1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.342+0000 7f3d9b237740 1 -- 172.21.15.69:0/3344521 shutdown_connections 2024-05-14T15:41:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.342+0000 7f3d9b237740 1 -- 172.21.15.69:0/3344521 wait complete. 2024-05-14T15:41:33.345 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.342+0000 7f3d9b237740 20 client.17595 trim_cache size 0 max 16384 2024-05-14T15:41:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.359+0000 7f3d9b237740 1 Processor -- start 2024-05-14T15:41:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.359+0000 7f3d9b237740 1 -- start start 2024-05-14T15:41:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.359+0000 7f3d9b237740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3deaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.359+0000 7f3d9b237740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb01a4d0 0x55d2fb3d7960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.359+0000 7f3d9b237740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3d7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.359+0000 7f3d9b237740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c1b3400 con 0x55d2fb0122f0 2024-05-14T15:41:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.359+0000 7f3d9b237740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c1b5180 con 0x55d2fb01a4d0 2024-05-14T15:41:33.360 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.359+0000 7f3d9b237740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c1b3ad0 con 0x55d2fb03b1b0 2024-05-14T15:41:33.361 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.359+0000 7f3d91800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3deaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.359+0000 7f3d91800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3deaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36752/0 (socket says 172.21.15.69:36752) 2024-05-14T15:41:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.359+0000 7f3d91800640 1 -- 172.21.15.69:0/192771979 learned_addr learned my addr 172.21.15.69:0/192771979 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.360+0000 7f3d90e00640 1 --2- 172.21.15.69:0/192771979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb01a4d0 0x55d2fb3d7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.360+0000 7f3d92200640 1 --2- 172.21.15.69:0/192771979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3d7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.360+0000 7f3d91800640 1 -- 172.21.15.69:0/192771979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb03b1b0 msgr2=0x55d2fb3d7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.360+0000 7f3d91800640 1 --2- 172.21.15.69:0/192771979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3d7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.360+0000 7f3d91800640 1 -- 172.21.15.69:0/192771979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb01a4d0 msgr2=0x55d2fb3d7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.360+0000 7f3d91800640 1 --2- 172.21.15.69:0/192771979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb01a4d0 0x55d2fb3d7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.360+0000 7f3d91800640 1 -- 172.21.15.69:0/192771979 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d2fb3d9820 con 0x55d2fb0122f0 2024-05-14T15:41:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.360+0000 7f3d91800640 1 --2- 172.21.15.69:0/192771979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3deaf0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0118e0 tx=0x7f3d7c01b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eb4d8db0b3f7383 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.361+0000 7f3d7a000640 1 -- 172.21.15.69:0/192771979 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c023040 con 0x55d2fb0122f0 2024-05-14T15:41:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.361+0000 7f3d7a000640 1 -- 172.21.15.69:0/192771979 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d7c037030 con 0x55d2fb0122f0 2024-05-14T15:41:33.362 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.361+0000 7f3d7a000640 1 -- 172.21.15.69:0/192771979 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c005480 con 0x55d2fb0122f0 2024-05-14T15:41:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.361+0000 7f3d9b237740 1 -- 172.21.15.69:0/192771979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 msgr2=0x55d2fb3deaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.361+0000 7f3d9b237740 1 --2- 172.21.15.69:0/192771979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3deaf0 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c0118e0 tx=0x7f3d7c01b460 comp rx=0 tx=0).stop 2024-05-14T15:41:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.362+0000 7f3d9b237740 1 -- 172.21.15.69:0/192771979 shutdown_connections 2024-05-14T15:41:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.362+0000 7f3d9b237740 1 --2- 172.21.15.69:0/192771979 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3d7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.362+0000 7f3d9b237740 1 --2- 172.21.15.69:0/192771979 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb01a4d0 0x55d2fb3d7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.362+0000 7f3d9b237740 1 --2- 172.21.15.69:0/192771979 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3deaf0 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.362+0000 7f3d9b237740 1 -- 172.21.15.69:0/192771979 >> 172.21.15.69:0/192771979 conn(0x55d2fb02f300 msgr2=0x55d2fb3d7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:33.366 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.362+0000 7f3d9b237740 1 -- 172.21.15.69:0/192771979 shutdown_connections 2024-05-14T15:41:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.362+0000 7f3d9b237740 1 -- 172.21.15.69:0/192771979 wait complete. 2024-05-14T15:41:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.362+0000 7f3d9b237740 1 -- start start 2024-05-14T15:41:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.362+0000 7f3d9b237740 1 Processor -- start 2024-05-14T15:41:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.363+0000 7f3d9b237740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3eec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.363+0000 7f3d9b237740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb01a4d0 0x55d2fb3ea000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.363+0000 7f3d9b237740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3ea540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.363+0000 7f3d9b237740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c1b49f0 con 0x55d2fb0122f0 2024-05-14T15:41:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.363+0000 7f3d9b237740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c1b4260 con 0x55d2fb03b1b0 2024-05-14T15:41:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.363+0000 7f3d9b237740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f3d8c1b1400 con 0x55d2fb01a4d0 2024-05-14T15:41:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.363+0000 7f3d9b237740 10 client.0 _ll_register_callbacks cb 0x7f3d7c00b8a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:41:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.363+0000 7f3d91800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3eec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.363+0000 7f3d91800640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3eec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:36760/0 (socket says 172.21.15.69:36760) 2024-05-14T15:41:33.367 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.363+0000 7f3d91800640 1 -- 172.21.15.69:0/3225566146 learned_addr learned my addr 172.21.15.69:0/3225566146 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:33.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.363+0000 7f3d92200640 1 --2- 172.21.15.69:0/3225566146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3ea540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.363+0000 7f3d90e00640 1 --2- 172.21.15.69:0/3225566146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb01a4d0 0x55d2fb3ea000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.363+0000 7f3d91800640 1 -- 172.21.15.69:0/3225566146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb01a4d0 msgr2=0x55d2fb3ea000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:33.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.363+0000 7f3d91800640 1 --2- 172.21.15.69:0/3225566146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb01a4d0 0x55d2fb3ea000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.363+0000 7f3d91800640 1 -- 172.21.15.69:0/3225566146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb03b1b0 msgr2=0x55d2fb3ea540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:33.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.363+0000 7f3d91800640 1 --2- 172.21.15.69:0/3225566146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3ea540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.364+0000 7f3d91800640 1 -- 172.21.15.69:0/3225566146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d2fb3ef480 con 0x55d2fb0122f0 2024-05-14T15:41:33.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.364+0000 7f3d92200640 1 --2- 172.21.15.69:0/3225566146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3ea540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:41:33.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.364+0000 7f3d91800640 1 --2- 172.21.15.69:0/3225566146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3eec50 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c011a60 tx=0x7f3d7c011e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b78ffb27bd26db0b server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:33.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.364+0000 7f3d6f400640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:41:33.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.364+0000 7f3d6f400640 1 -- 172.21.15.69:0/3225566146 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d7c023040 con 0x55d2fb0122f0 2024-05-14T15:41:33.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.364+0000 7f3d6f400640 1 -- 172.21.15.69:0/3225566146 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 9554+0+0 (secure 0 0 0) 0x7f3d7c01f6e0 con 0x55d2fb0122f0 2024-05-14T15:41:33.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.364+0000 7f3d9b237740 1 -- 172.21.15.69:0/3225566146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d7c037030 con 0x55d2fb0122f0 2024-05-14T15:41:33.368 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.364+0000 7f3d6f400640 1 -- 172.21.15.69:0/3225566146 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=82) ==== 24+0+0 (secure 0 0 0) 0x7f3d7c04b050 con 0x55d2fb0122f0 2024-05-14T15:41:33.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.364+0000 7f3d9b237740 10 client.17601 fetch_fsmap learned FSMap version 82 2024-05-14T15:41:33.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.364+0000 7f3d9b237740 1 -- 172.21.15.69:0/3225566146 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=82,monmap=4+}) -- 0x55d2fb460db0 con 0x55d2fb0122f0 2024-05-14T15:41:33.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.365+0000 7f3d6f400640 1 -- 172.21.15.69:0/3225566146 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f3d7c037030 con 0x55d2fb0122f0 2024-05-14T15:41:33.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.365+0000 7f3d6f400640 1 -- 172.21.15.69:0/3225566146 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 82) ==== 8414+0+0 (secure 0 0 0) 0x7f3d7c004910 con 0x55d2fb0122f0 2024-05-14T15:41:33.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.365+0000 7f3d9b237740 10 client.17601 fetch_fsmap finished waiting for FSMap version 82 2024-05-14T15:41:33.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.365+0000 7f3d9b237740 10 client.17601 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:41:33.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.365+0000 7f3d9b237740 20 client.17601 populate_metadata read hostname 'smithi069' 2024-05-14T15:41:33.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.365+0000 7f3d9b237740 1 --2- 172.21.15.69:0/3225566146 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d2fafcf1c0 0x55d2fb463560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:33.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.365+0000 7f3d9b237740 4 client.17601 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:41:33.369 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.365+0000 7f3d9b237740 1 -- 172.21.15.69:0/3225566146 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55d2fb348fd0 con 0x55d2fafcf1c0 2024-05-14T15:41:33.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.366+0000 7f3d90e00640 1 --2- 172.21.15.69:0/3225566146 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d2fafcf1c0 0x55d2fb463560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:33.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.367+0000 7f3d90e00640 1 --2- 172.21.15.69:0/3225566146 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d2fafcf1c0 0x55d2fb463560 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=36457187392be2a3 server_cookie=4e73aa49dd946e76 in_seq=0 out_seq=0 2024-05-14T15:41:33.370 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.367+0000 7f3d6f400640 10 client.17601 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:41:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.420+0000 7f3d6f400640 1 -- 172.21.15.69:0/3225566146 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55d2fb348fd0 con 0x55d2fafcf1c0 2024-05-14T15:41:33.421 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.420+0000 7f3d6f400640 10 client.17601 handle_command_reply: tid=0 2024-05-14T15:41:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.420+0000 7f3d9b237740 1 client.17601 shutdown 2024-05-14T15:41:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.421+0000 7f3d9b237740 1 -- 172.21.15.69:0/3225566146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 msgr2=0x55d2fb3eec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.421+0000 7f3d9b237740 1 --2- 172.21.15.69:0/3225566146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3eec50 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c011a60 tx=0x7f3d7c011e30 comp rx=0 tx=0).stop 2024-05-14T15:41:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.421+0000 7f3d9b237740 1 -- 172.21.15.69:0/3225566146 shutdown_connections 2024-05-14T15:41:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.421+0000 7f3d9b237740 1 --2- 172.21.15.69:0/3225566146 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x55d2fb03b1b0 0x55d2fb3ea540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.421+0000 7f3d9b237740 1 --2- 172.21.15.69:0/3225566146 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x55d2fb01a4d0 0x55d2fb3ea000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.421+0000 7f3d9b237740 1 --2- 172.21.15.69:0/3225566146 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x55d2fafcf1c0 0x55d2fb463560 crc :-1 s=READY pgs=265 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.421+0000 7f3d9b237740 1 --2- 172.21.15.69:0/3225566146 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x55d2fb0122f0 0x55d2fb3eec50 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.421+0000 7f3d9b237740 1 -- 172.21.15.69:0/3225566146 >> 172.21.15.69:0/3225566146 conn(0x55d2fb02f300 msgr2=0x55d2fb3d7c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:33.422 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.421+0000 7f3d6f400640 0 client.17601 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:41:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.421+0000 7f3d9b237740 1 -- 172.21.15.69:0/3225566146 shutdown_connections 2024-05-14T15:41:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.421+0000 7f3d9b237740 1 -- 172.21.15.69:0/3225566146 wait complete. 2024-05-14T15:41:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.421+0000 7f3d9b237740 20 client.17601 trim_cache size 0 max 16384 2024-05-14T15:41:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:41:33.423 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:41:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:41:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:41:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.422+0000 7f3d92c00640 1 -- 172.21.15.69:0/3770600320 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3d740b29d0 msgr2=0x7f3d740b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:33.424 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.422+0000 7f3d92c00640 1 --2- 172.21.15.69:0/3770600320 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3d740b29d0 0x7f3d740b4ee0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f3d7c005fd0 tx=0x7f3d7c00b5d0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.422+0000 7f3d92c00640 1 -- 172.21.15.69:0/3770600320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d8c10bce0 msgr2=0x7f3d8c1a2a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.422+0000 7f3d92c00640 1 --2- 172.21.15.69:0/3770600320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d8c10bce0 0x7f3d8c1a2a30 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f3d80000f80 tx=0x7f3d80032a10 comp rx=0 tx=0).stop 2024-05-14T15:41:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.423+0000 7f3d92c00640 1 -- 172.21.15.69:0/3770600320 shutdown_connections 2024-05-14T15:41:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.423+0000 7f3d92c00640 1 --2- 172.21.15.69:0/3770600320 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f3d740b29d0 0x7f3d740b4ee0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.423+0000 7f3d92c00640 1 --2- 172.21.15.69:0/3770600320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f3d8c10c180 0x7f3d8c19c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.423+0000 7f3d92c00640 1 --2- 172.21.15.69:0/3770600320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f3d8c10bce0 0x7f3d8c1a2a30 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.423+0000 7f3d92c00640 1 --2- 172.21.15.69:0/3770600320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f3d8c106430 0x7f3d8c1a24f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.423+0000 7f3d92c00640 1 -- 172.21.15.69:0/3770600320 >> 172.21.15.69:0/3770600320 conn(0x7f3d8c1013e0 msgr2=0x7f3d8c1017f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.423+0000 7f3d92c00640 1 -- 172.21.15.69:0/3770600320 shutdown_connections 2024-05-14T15:41:33.425 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:33.423+0000 7f3d92c00640 1 -- 172.21.15.69:0/3770600320 wait complete. 2024-05-14T15:41:33.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:33 smithi092 ceph-mon[34729]: pgmap v630: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 36 KiB/s wr, 19 op/s 2024-05-14T15:41:33.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:33 smithi069 ceph-mon[31270]: pgmap v630: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 36 KiB/s wr, 19 op/s 2024-05-14T15:41:34.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:33 smithi203 ceph-mon[34567]: pgmap v630: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 36 KiB/s wr, 19 op/s 2024-05-14T15:41:35.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:35 smithi092 ceph-mon[34729]: pgmap v631: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 34 KiB/s wr, 18 op/s 2024-05-14T15:41:35.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:35 smithi069 ceph-mon[31270]: pgmap v631: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 34 KiB/s wr, 18 op/s 2024-05-14T15:41:36.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:35 smithi203 ceph-mon[34567]: pgmap v631: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 44 KiB/s rd, 34 KiB/s wr, 18 op/s 2024-05-14T15:41:37.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:37 smithi092 ceph-mon[34729]: pgmap v632: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 68 KiB/s wr, 25 op/s 2024-05-14T15:41:37.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:37 smithi069 ceph-mon[31270]: pgmap v632: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 68 KiB/s wr, 25 op/s 2024-05-14T15:41:38.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:37 smithi203 ceph-mon[34567]: pgmap v632: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 73 KiB/s rd, 68 KiB/s wr, 25 op/s 2024-05-14T15:41:39.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:39 smithi092 ceph-mon[34729]: pgmap v633: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 59 KiB/s wr, 21 op/s 2024-05-14T15:41:39.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:39 smithi069 ceph-mon[31270]: pgmap v633: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 59 KiB/s wr, 21 op/s 2024-05-14T15:41:40.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:39 smithi203 ceph-mon[34567]: pgmap v633: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 59 KiB/s wr, 21 op/s 2024-05-14T15:41:41.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:41 smithi092 ceph-mon[34729]: pgmap v634: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 91 KiB/s wr, 30 op/s 2024-05-14T15:41:41.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:41 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:41:41.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:41 smithi069 ceph-mon[31270]: pgmap v634: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 91 KiB/s wr, 30 op/s 2024-05-14T15:41:41.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:41 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:41:42.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:41 smithi203 ceph-mon[34567]: pgmap v634: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 87 KiB/s rd, 91 KiB/s wr, 30 op/s 2024-05-14T15:41:42.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:41 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:41:43.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:43 smithi092 ceph-mon[34729]: pgmap v635: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 71 KiB/s wr, 25 op/s 2024-05-14T15:41:43.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:43 smithi069 ceph-mon[31270]: pgmap v635: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 71 KiB/s wr, 25 op/s 2024-05-14T15:41:44.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:43 smithi203 ceph-mon[34567]: pgmap v635: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 67 KiB/s rd, 71 KiB/s wr, 25 op/s 2024-05-14T15:41:45.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:45 smithi092 ceph-mon[34729]: pgmap v636: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 79 KiB/s wr, 25 op/s 2024-05-14T15:41:45.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:45 smithi069 ceph-mon[31270]: pgmap v636: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 79 KiB/s wr, 25 op/s 2024-05-14T15:41:46.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:45 smithi203 ceph-mon[34567]: pgmap v636: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 76 KiB/s rd, 79 KiB/s wr, 25 op/s 2024-05-14T15:41:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.646+0000 7fe25be00640 1 -- 172.21.15.69:0/339259960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c109ac0 msgr2=0x7fe25c103660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.646+0000 7fe25be00640 1 --2- 172.21.15.69:0/339259960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c109ac0 0x7fe25c103660 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7fe24c009900 tx=0x7fe24c02a410 comp rx=0 tx=0).stop 2024-05-14T15:41:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.646+0000 7fe25be00640 1 -- 172.21.15.69:0/339259960 shutdown_connections 2024-05-14T15:41:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.646+0000 7fe25be00640 1 --2- 172.21.15.69:0/339259960 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe25c104210 0x7fe25c1105e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.647 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.646+0000 7fe25be00640 1 --2- 172.21.15.69:0/339259960 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe25c109f60 0x7fe25c103ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.646+0000 7fe25be00640 1 --2- 172.21.15.69:0/339259960 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c109ac0 0x7fe25c103660 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.646+0000 7fe25be00640 1 -- 172.21.15.69:0/339259960 >> 172.21.15.69:0/339259960 conn(0x7fe25c079150 msgr2=0x7fe25c079590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:46.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.646+0000 7fe25be00640 1 -- 172.21.15.69:0/339259960 shutdown_connections 2024-05-14T15:41:46.648 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.646+0000 7fe25be00640 1 -- 172.21.15.69:0/339259960 wait complete. 2024-05-14T15:41:46.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.647+0000 7fe25be00640 1 Processor -- start 2024-05-14T15:41:46.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.647+0000 7fe25be00640 1 -- start start 2024-05-14T15:41:46.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.648+0000 7fe25be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c104210 0x7fe25c074fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.648+0000 7fe25be00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe25c109ac0 0x7fe25c075510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.648+0000 7fe25be00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe25c109f60 0x7fe25c075a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.648+0000 7fe25be00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c113bb0 con 0x7fe25c104210 2024-05-14T15:41:46.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.648+0000 7fe25be00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c113a30 con 0x7fe25c109ac0 2024-05-14T15:41:46.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.648+0000 7fe25be00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c113d30 con 0x7fe25c109f60 2024-05-14T15:41:46.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.648+0000 7fe25aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c104210 0x7fe25c074fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.648+0000 7fe25aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c104210 0x7fe25c074fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44838/0 (socket says 172.21.15.69:44838) 2024-05-14T15:41:46.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.648+0000 7fe25aa00640 1 -- 172.21.15.69:0/1825451626 learned_addr learned my addr 172.21.15.69:0/1825451626 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:46.650 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.649+0000 7fe25b400640 1 --2- 172.21.15.69:0/1825451626 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe25c109f60 0x7fe25c075a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.649+0000 7fe253e00640 1 --2- 172.21.15.69:0/1825451626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe25c109ac0 0x7fe25c075510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.649+0000 7fe25aa00640 1 -- 172.21.15.69:0/1825451626 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe25c109f60 msgr2=0x7fe25c075a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:46.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.649+0000 7fe25aa00640 1 --2- 172.21.15.69:0/1825451626 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe25c109f60 0x7fe25c075a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.649+0000 7fe25aa00640 1 -- 172.21.15.69:0/1825451626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe25c109ac0 msgr2=0x7fe25c075510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:46.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.649+0000 7fe25aa00640 1 --2- 172.21.15.69:0/1825451626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe25c109ac0 0x7fe25c075510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.649+0000 7fe25aa00640 1 -- 172.21.15.69:0/1825451626 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe25c1a8990 con 0x7fe25c104210 2024-05-14T15:41:46.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.649+0000 7fe253e00640 1 --2- 172.21.15.69:0/1825451626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe25c109ac0 0x7fe25c075510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:41:46.651 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.649+0000 7fe25aa00640 1 --2- 172.21.15.69:0/1825451626 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c104210 0x7fe25c074fd0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fe24c02a930 tx=0x7fe24c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:46.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.649+0000 7fe253400640 1 -- 172.21.15.69:0/1825451626 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c03f070 con 0x7fe25c104210 2024-05-14T15:41:46.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.649+0000 7fe253400640 1 -- 172.21.15.69:0/1825451626 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe24c003e10 con 0x7fe25c104210 2024-05-14T15:41:46.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.650+0000 7fe25be00640 1 -- 172.21.15.69:0/1825451626 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe25c1a8c20 con 0x7fe25c104210 2024-05-14T15:41:46.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.650+0000 7fe253400640 1 -- 172.21.15.69:0/1825451626 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c035030 con 0x7fe25c104210 2024-05-14T15:41:46.652 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.650+0000 7fe25be00640 1 -- 172.21.15.69:0/1825451626 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe25c1a9110 con 0x7fe25c104210 2024-05-14T15:41:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.653+0000 7fe26878b740 1 Processor -- start 2024-05-14T15:41:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.653+0000 7fe26878b740 1 -- start start 2024-05-14T15:41:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.654+0000 7fe253400640 1 -- 172.21.15.69:0/1825451626 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fe24c042070 con 0x7fe25c104210 2024-05-14T15:41:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.654+0000 7fe26878b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a91f1b0 0x564a5acc0480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.654+0000 7fe26878b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a8f62f0 0x564a5acc09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.654+0000 7fe26878b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8fe4d0 0x564a5acc0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.654 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.654+0000 7fe26878b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564a5ac25550 con 0x564a5a8fe4d0 2024-05-14T15:41:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.654+0000 7fe26878b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564a5abcabc0 con 0x564a5a8f62f0 2024-05-14T15:41:46.655 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.654+0000 7fe26878b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564a5ac21510 con 0x564a5a91f1b0 2024-05-14T15:41:46.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.654+0000 7fe253e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8fe4d0 0x564a5acc0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.654+0000 7fe253e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8fe4d0 0x564a5acc0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44850/0 (socket says 172.21.15.69:44850) 2024-05-14T15:41:46.656 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.654+0000 7fe253e00640 1 -- 172.21.15.69:0/2807233075 learned_addr learned my addr 172.21.15.69:0/2807233075 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.654+0000 7fe25aa00640 1 --2- 172.21.15.69:0/2807233075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a8f62f0 0x564a5acc09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.654+0000 7fe25b400640 1 --2- 172.21.15.69:0/2807233075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a91f1b0 0x564a5acc0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.655+0000 7fe253e00640 1 -- 172.21.15.69:0/2807233075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a91f1b0 msgr2=0x564a5acc0480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.655+0000 7fe253e00640 1 --2- 172.21.15.69:0/2807233075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a91f1b0 0x564a5acc0480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.655+0000 7fe253e00640 1 -- 172.21.15.69:0/2807233075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a8f62f0 msgr2=0x564a5acc09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.655+0000 7fe253e00640 1 --2- 172.21.15.69:0/2807233075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a8f62f0 0x564a5acc09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.655+0000 7fe253e00640 1 -- 172.21.15.69:0/2807233075 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a5a937210 con 0x564a5a8fe4d0 2024-05-14T15:41:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.655+0000 7fe253e00640 1 --2- 172.21.15.69:0/2807233075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8fe4d0 0x564a5acc0f00 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fe244009b60 tx=0x7fe24400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=941154fa2b80e1b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.655+0000 7fe24be00640 1 -- 172.21.15.69:0/2807233075 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244016070 con 0x564a5a8fe4d0 2024-05-14T15:41:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.655+0000 7fe24be00640 1 -- 172.21.15.69:0/2807233075 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe244009e50 con 0x564a5a8fe4d0 2024-05-14T15:41:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.655+0000 7fe24be00640 1 -- 172.21.15.69:0/2807233075 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244011470 con 0x564a5a8fe4d0 2024-05-14T15:41:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.655+0000 7fe253400640 1 --2- 172.21.15.69:0/1825451626 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe23c0b2950 0x7fe23c0b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.656+0000 7fe253400640 1 -- 172.21.15.69:0/1825451626 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9554+0+0 (secure 0 0 0) 0x7fe24c103360 con 0x7fe25c104210 2024-05-14T15:41:46.657 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.656+0000 7fe25b400640 1 --2- 172.21.15.69:0/1825451626 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe23c0b2950 0x7fe23c0b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.656+0000 7fe26878b740 1 -- 172.21.15.69:0/2807233075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8fe4d0 msgr2=0x564a5acc0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:46.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.657+0000 7fe26878b740 1 --2- 172.21.15.69:0/2807233075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8fe4d0 0x564a5acc0f00 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fe244009b60 tx=0x7fe24400e6c0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.657+0000 7fe25b400640 1 --2- 172.21.15.69:0/1825451626 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe23c0b2950 0x7fe23c0b4e60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x564a5acbd5f0 tx=0x7fe254009580 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:46.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.657+0000 7fe26878b740 1 -- 172.21.15.69:0/2807233075 shutdown_connections 2024-05-14T15:41:46.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.657+0000 7fe26878b740 1 --2- 172.21.15.69:0/2807233075 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8fe4d0 0x564a5acc0f00 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.657+0000 7fe26878b740 1 --2- 172.21.15.69:0/2807233075 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a8f62f0 0x564a5acc09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.659 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.657+0000 7fe26878b740 1 --2- 172.21.15.69:0/2807233075 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a91f1b0 0x564a5acc0480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.657+0000 7fe26878b740 1 -- 172.21.15.69:0/2807233075 >> 172.21.15.69:0/2807233075 conn(0x564a5a913300 msgr2=0x564a5acbcc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.657+0000 7fe26878b740 1 -- 172.21.15.69:0/2807233075 shutdown_connections 2024-05-14T15:41:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.657+0000 7fe26878b740 1 -- 172.21.15.69:0/2807233075 wait complete. 2024-05-14T15:41:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.658+0000 7fe26878b740 1 -- start start 2024-05-14T15:41:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.658+0000 7fe26878b740 1 Processor -- start 2024-05-14T15:41:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.658+0000 7fe26878b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8f62f0 0x564a5acca9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.658+0000 7fe26878b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a8fe4d0 0x564a5accaf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.658+0000 7fe26878b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a91f1b0 0x564a5acd6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.658+0000 7fe26878b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x564a5accd5b0 con 0x564a5a8f62f0 2024-05-14T15:41:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.658+0000 7fe26878b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x564a5abde660 con 0x564a5a91f1b0 2024-05-14T15:41:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.658+0000 7fe26878b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x564a5accd730 con 0x564a5a8fe4d0 2024-05-14T15:41:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.658+0000 7fe26878b740 10 client.0 _ll_register_callbacks cb 0x564a5aba8400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:41:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.659+0000 7fe25aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8f62f0 0x564a5acca9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.659+0000 7fe25aa00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8f62f0 0x564a5acca9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44862/0 (socket says 172.21.15.69:44862) 2024-05-14T15:41:46.660 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.659+0000 7fe25aa00640 1 -- 172.21.15.69:0/3914200463 learned_addr learned my addr 172.21.15.69:0/3914200463 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.659+0000 7fe25b400640 1 --2- 172.21.15.69:0/3914200463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a91f1b0 0x564a5acd6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.659+0000 7fe253e00640 1 --2- 172.21.15.69:0/3914200463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a8fe4d0 0x564a5accaf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.659+0000 7fe25aa00640 1 -- 172.21.15.69:0/3914200463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a8fe4d0 msgr2=0x564a5accaf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:46.661 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.659+0000 7fe25aa00640 1 --2- 172.21.15.69:0/3914200463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a8fe4d0 0x564a5accaf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.659+0000 7fe25aa00640 1 -- 172.21.15.69:0/3914200463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a91f1b0 msgr2=0x564a5acd6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.659+0000 7fe25aa00640 1 --2- 172.21.15.69:0/3914200463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a91f1b0 0x564a5acd6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.659+0000 7fe25aa00640 1 -- 172.21.15.69:0/3914200463 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a5aa03620 con 0x564a5a8f62f0 2024-05-14T15:41:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.659+0000 7fe25aa00640 1 --2- 172.21.15.69:0/3914200463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8f62f0 0x564a5acca9e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fe24c1006a0 tx=0x7fe24c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=667fa322f161c280 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:46.662 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.659+0000 7fe248c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:41:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.663+0000 7fe248c00640 1 -- 172.21.15.69:0/3914200463 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe24c049070 con 0x564a5a8f62f0 2024-05-14T15:41:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.663+0000 7fe248c00640 1 -- 172.21.15.69:0/3914200463 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 9554+0+0 (secure 0 0 0) 0x7fe24c1008c0 con 0x564a5a8f62f0 2024-05-14T15:41:46.664 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.663+0000 7fe26878b740 1 -- 172.21.15.69:0/3914200463 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe244009e50 con 0x564a5a8f62f0 2024-05-14T15:41:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.663+0000 7fe248c00640 1 -- 172.21.15.69:0/3914200463 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fe24c0c9940 con 0x564a5a8f62f0 2024-05-14T15:41:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.663+0000 7fe26878b740 10 client.17613 fetch_fsmap learned FSMap version 84 2024-05-14T15:41:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.663+0000 7fe26878b740 1 -- 172.21.15.69:0/3914200463 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) -- 0x564a5acd9870 con 0x564a5a8f62f0 2024-05-14T15:41:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.663+0000 7fe248c00640 1 -- 172.21.15.69:0/3914200463 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe244009e50 con 0x564a5a8f62f0 2024-05-14T15:41:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.663+0000 7fe248c00640 1 -- 172.21.15.69:0/3914200463 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 84) ==== 8406+0+0 (secure 0 0 0) 0x7fe24c0ce150 con 0x564a5a8f62f0 2024-05-14T15:41:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.663+0000 7fe26878b740 10 client.17613 fetch_fsmap finished waiting for FSMap version 84 2024-05-14T15:41:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.664+0000 7fe26878b740 10 client.17613 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:41:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.664+0000 7fe26878b740 20 client.17613 populate_metadata read hostname 'smithi069' 2024-05-14T15:41:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.664+0000 7fe26878b740 1 --2- 172.21.15.69:0/3914200463 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564a5a8ddd80 0x564a5acdce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.664+0000 7fe26878b740 4 client.17613 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-14T15:41:46.665 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.664+0000 7fe26878b740 1 -- 172.21.15.69:0/3914200463 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564a5ac33160 con 0x564a5a8ddd80 2024-05-14T15:41:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.664+0000 7fe253e00640 1 --2- 172.21.15.69:0/3914200463 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564a5a8ddd80 0x564a5acdce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.665+0000 7fe253e00640 1 --2- 172.21.15.69:0/3914200463 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564a5a8ddd80 0x564a5acdce90 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28e355592663e3f7 server_cookie=77d0b9cd716ba10c in_seq=0 out_seq=0 2024-05-14T15:41:46.666 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.665+0000 7fe248c00640 10 client.17613 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:41:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.668+0000 7fe248c00640 1 -- 172.21.15.69:0/3914200463 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23648 (crc 0 0 0) 0x564a5ac33160 con 0x564a5a8ddd80 2024-05-14T15:41:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.668+0000 7fe248c00640 10 client.17613 handle_command_reply: tid=0 2024-05-14T15:41:46.668 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.668+0000 7fe26878b740 1 client.17613 shutdown 2024-05-14T15:41:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.668+0000 7fe26878b740 1 -- 172.21.15.69:0/3914200463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8f62f0 msgr2=0x564a5acca9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.668+0000 7fe26878b740 1 --2- 172.21.15.69:0/3914200463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8f62f0 0x564a5acca9e0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fe24c1006a0 tx=0x7fe24c009260 comp rx=0 tx=0).stop 2024-05-14T15:41:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.668+0000 7fe26878b740 1 -- 172.21.15.69:0/3914200463 shutdown_connections 2024-05-14T15:41:46.669 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.668+0000 7fe26878b740 1 --2- 172.21.15.69:0/3914200463 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a91f1b0 0x564a5acd6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.668+0000 7fe26878b740 1 --2- 172.21.15.69:0/3914200463 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a8fe4d0 0x564a5accaf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.668+0000 7fe26878b740 1 --2- 172.21.15.69:0/3914200463 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564a5a8ddd80 0x564a5acdce90 crc :-1 s=READY pgs=266 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.668+0000 7fe26878b740 1 --2- 172.21.15.69:0/3914200463 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8f62f0 0x564a5acca9e0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.668+0000 7fe248c00640 0 client.17613 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:41:46.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.668+0000 7fe26878b740 1 -- 172.21.15.69:0/3914200463 >> 172.21.15.69:0/3914200463 conn(0x564a5a913300 msgr2=0x564a5acc21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:46.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.668+0000 7fe26878b740 1 -- 172.21.15.69:0/3914200463 shutdown_connections 2024-05-14T15:41:46.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.668+0000 7fe26878b740 1 -- 172.21.15.69:0/3914200463 wait complete. 2024-05-14T15:41:46.670 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.669+0000 7fe26878b740 20 client.17613 trim_cache size 0 max 16384 2024-05-14T15:41:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.686+0000 7fe26878b740 1 Processor -- start 2024-05-14T15:41:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.686+0000 7fe26878b740 1 -- start start 2024-05-14T15:41:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.686+0000 7fe26878b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a8f62f0 0x564a5acc2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.686+0000 7fe26878b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8fe4d0 0x564a5acc13f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.686+0000 7fe26878b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a91f1b0 0x564a5ace2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.686+0000 7fe26878b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1b33a0 con 0x564a5a8fe4d0 2024-05-14T15:41:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.686+0000 7fe26878b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1b50c0 con 0x564a5a91f1b0 2024-05-14T15:41:46.687 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.686+0000 7fe26878b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1b3a70 con 0x564a5a8f62f0 2024-05-14T15:41:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.687+0000 7fe253e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8fe4d0 0x564a5acc13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.687+0000 7fe253e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8fe4d0 0x564a5acc13f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44868/0 (socket says 172.21.15.69:44868) 2024-05-14T15:41:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.687+0000 7fe253e00640 1 -- 172.21.15.69:0/3012036362 learned_addr learned my addr 172.21.15.69:0/3012036362 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.687+0000 7fe25aa00640 1 --2- 172.21.15.69:0/3012036362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a8f62f0 0x564a5acc2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.687+0000 7fe25b400640 1 --2- 172.21.15.69:0/3012036362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a91f1b0 0x564a5ace2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.687+0000 7fe253e00640 1 -- 172.21.15.69:0/3012036362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a8f62f0 msgr2=0x564a5acc2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.687+0000 7fe253e00640 1 --2- 172.21.15.69:0/3012036362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a8f62f0 0x564a5acc2c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.687+0000 7fe253e00640 1 -- 172.21.15.69:0/3012036362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a91f1b0 msgr2=0x564a5ace2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.687+0000 7fe253e00640 1 --2- 172.21.15.69:0/3012036362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a91f1b0 0x564a5ace2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.687+0000 7fe253e00640 1 -- 172.21.15.69:0/3012036362 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564a5acbd820 con 0x564a5a8fe4d0 2024-05-14T15:41:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.687+0000 7fe25b400640 1 --2- 172.21.15.69:0/3012036362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a91f1b0 0x564a5ace2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:41:46.689 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.687+0000 7fe253e00640 1 --2- 172.21.15.69:0/3012036362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8fe4d0 0x564a5acc13f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fe244005fe0 tx=0x7fe244009de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d2c08815738eff server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.688+0000 7fe24b400640 1 -- 172.21.15.69:0/3012036362 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244016040 con 0x564a5a8fe4d0 2024-05-14T15:41:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.688+0000 7fe24b400640 1 -- 172.21.15.69:0/3012036362 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe244004880 con 0x564a5a8fe4d0 2024-05-14T15:41:46.690 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.688+0000 7fe24b400640 1 -- 172.21.15.69:0/3012036362 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe244011da0 con 0x564a5a8fe4d0 2024-05-14T15:41:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.689+0000 7fe26878b740 1 -- 172.21.15.69:0/3012036362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8fe4d0 msgr2=0x564a5acc13f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.689+0000 7fe26878b740 1 --2- 172.21.15.69:0/3012036362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8fe4d0 0x564a5acc13f0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fe244005fe0 tx=0x7fe244009de0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.689+0000 7fe26878b740 1 -- 172.21.15.69:0/3012036362 shutdown_connections 2024-05-14T15:41:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.689+0000 7fe26878b740 1 --2- 172.21.15.69:0/3012036362 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a91f1b0 0x564a5ace2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.689+0000 7fe26878b740 1 --2- 172.21.15.69:0/3012036362 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a8fe4d0 0x564a5acc13f0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.689+0000 7fe26878b740 1 --2- 172.21.15.69:0/3012036362 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a8f62f0 0x564a5acc2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.689+0000 7fe26878b740 1 -- 172.21.15.69:0/3012036362 >> 172.21.15.69:0/3012036362 conn(0x564a5a913300 msgr2=0x564a5acbbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:46.693 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.689+0000 7fe26878b740 1 -- 172.21.15.69:0/3012036362 shutdown_connections 2024-05-14T15:41:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.689+0000 7fe26878b740 1 -- 172.21.15.69:0/3012036362 wait complete. 2024-05-14T15:41:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.689+0000 7fe26878b740 1 -- start start 2024-05-14T15:41:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.690+0000 7fe26878b740 1 Processor -- start 2024-05-14T15:41:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.690+0000 7fe26878b740 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a8f62f0 0x564a5accdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.690+0000 7fe26878b740 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a8fe4d0 0x564a5acce290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.690+0000 7fe26878b740 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a91f1b0 0x564a5ad431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.690+0000 7fe26878b740 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1b4930 con 0x564a5a91f1b0 2024-05-14T15:41:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.690+0000 7fe26878b740 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1b41a0 con 0x564a5a8fe4d0 2024-05-14T15:41:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.690+0000 7fe26878b740 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fe25c1b13a0 con 0x564a5a8f62f0 2024-05-14T15:41:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.690+0000 7fe26878b740 10 client.0 _ll_register_callbacks cb 0x7fe24c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-14T15:41:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.690+0000 7fe25b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a91f1b0 0x564a5ad431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.690+0000 7fe25b400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a91f1b0 0x564a5ad431f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:44878/0 (socket says 172.21.15.69:44878) 2024-05-14T15:41:46.694 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.690+0000 7fe25b400640 1 -- 172.21.15.69:0/940782319 learned_addr learned my addr 172.21.15.69:0/940782319 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.691+0000 7fe25aa00640 1 --2- 172.21.15.69:0/940782319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a8f62f0 0x564a5accdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.691+0000 7fe253e00640 1 --2- 172.21.15.69:0/940782319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a8fe4d0 0x564a5acce290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.691+0000 7fe25b400640 1 -- 172.21.15.69:0/940782319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a8f62f0 msgr2=0x564a5accdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.691+0000 7fe25b400640 1 --2- 172.21.15.69:0/940782319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a8f62f0 0x564a5accdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.691+0000 7fe25b400640 1 -- 172.21.15.69:0/940782319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a8fe4d0 msgr2=0x564a5acce290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-14T15:41:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.691+0000 7fe25b400640 1 --2- 172.21.15.69:0/940782319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a8fe4d0 0x564a5acce290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.691+0000 7fe25b400640 1 -- 172.21.15.69:0/940782319 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564a5ad43730 con 0x564a5a91f1b0 2024-05-14T15:41:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.691+0000 7fe253e00640 1 --2- 172.21.15.69:0/940782319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a8fe4d0 0x564a5acce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:41:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.691+0000 7fe25b400640 1 --2- 172.21.15.69:0/940782319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a91f1b0 0x564a5ad431f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe254012a10 tx=0x7fe254004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c13bbbcb6ce0b9 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.691+0000 7fe248c00640 10 client.0 ms_handle_connect on v2:172.21.15.69:3300/0 2024-05-14T15:41:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.692+0000 7fe248c00640 1 -- 172.21.15.69:0/940782319 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe254004d20 con 0x564a5a91f1b0 2024-05-14T15:41:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.692+0000 7fe26878b740 1 -- 172.21.15.69:0/940782319 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe244004880 con 0x564a5a91f1b0 2024-05-14T15:41:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.692+0000 7fe248c00640 1 -- 172.21.15.69:0/940782319 <== mon.0 v2:172.21.15.69:3300/0 2 ==== osd_map(122..122 src has 1..122) ==== 9554+0+0 (secure 0 0 0) 0x7fe254020b60 con 0x564a5a91f1b0 2024-05-14T15:41:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.692+0000 7fe248c00640 1 -- 172.21.15.69:0/940782319 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fe254020d60 con 0x564a5a91f1b0 2024-05-14T15:41:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.692+0000 7fe26878b740 10 client.17619 fetch_fsmap learned FSMap version 84 2024-05-14T15:41:46.695 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.692+0000 7fe26878b740 1 -- 172.21.15.69:0/940782319 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=4+}) -- 0x564a5ad449c0 con 0x564a5a91f1b0 2024-05-14T15:41:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.692+0000 7fe248c00640 1 -- 172.21.15.69:0/940782319 <== mon.0 v2:172.21.15.69:3300/0 4 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fe244004880 con 0x564a5a91f1b0 2024-05-14T15:41:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.692+0000 7fe248c00640 1 -- 172.21.15.69:0/940782319 <== mon.0 v2:172.21.15.69:3300/0 5 ==== fsmap(e 84) ==== 8406+0+0 (secure 0 0 0) 0x7fe25400f040 con 0x564a5a91f1b0 2024-05-14T15:41:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.692+0000 7fe26878b740 10 client.17619 fetch_fsmap finished waiting for FSMap version 84 2024-05-14T15:41:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.692+0000 7fe26878b740 10 client.17619 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-05-14T15:41:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.692+0000 7fe26878b740 20 client.17619 populate_metadata read hostname 'smithi069' 2024-05-14T15:41:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.693+0000 7fe26878b740 1 --2- 172.21.15.69:0/940782319 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564a5a8b31c0 0x564a5ad47290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.693+0000 7fe26878b740 4 client.17619 mds_command: new command op to 34490 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-05-14T15:41:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.693+0000 7fe26878b740 1 -- 172.21.15.69:0/940782319 --> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] -- command(tid 0: {"prefix": "flush journal"}) -- 0x564a5ac2cfd0 con 0x564a5a8b31c0 2024-05-14T15:41:46.696 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.693+0000 7fe25aa00640 1 --2- 172.21.15.69:0/940782319 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564a5a8b31c0 0x564a5ad47290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.694+0000 7fe25aa00640 1 --2- 172.21.15.69:0/940782319 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564a5a8b31c0 0x564a5ad47290 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e10fcc03a3fa7c81 server_cookie=dd7777fd26f2db70 in_seq=0 out_seq=0 2024-05-14T15:41:46.697 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.694+0000 7fe248c00640 10 client.17619 ms_handle_connect on v2:172.21.15.92:6838/2029564385 2024-05-14T15:41:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.748+0000 7fe248c00640 1 -- 172.21.15.69:0/940782319 <== mds.0 v2:172.21.15.92:6838/2029564385 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x564a5ac2cfd0 con 0x564a5a8b31c0 2024-05-14T15:41:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.748+0000 7fe248c00640 10 client.17619 handle_command_reply: tid=0 2024-05-14T15:41:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.748+0000 7fe26878b740 1 client.17619 shutdown 2024-05-14T15:41:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.749+0000 7fe26878b740 1 -- 172.21.15.69:0/940782319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a91f1b0 msgr2=0x564a5ad431f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.749+0000 7fe26878b740 1 --2- 172.21.15.69:0/940782319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a91f1b0 0x564a5ad431f0 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fe254012a10 tx=0x7fe254004a40 comp rx=0 tx=0).stop 2024-05-14T15:41:46.750 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.749+0000 7fe26878b740 1 -- 172.21.15.69:0/940782319 shutdown_connections 2024-05-14T15:41:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.749+0000 7fe26878b740 1 --2- 172.21.15.69:0/940782319 >> [v2:172.21.15.92:6838/2029564385,v1:172.21.15.92:6839/2029564385] conn(0x564a5a8b31c0 0x564a5ad47290 crc :-1 s=READY pgs=267 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.749+0000 7fe26878b740 1 --2- 172.21.15.69:0/940782319 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x564a5a91f1b0 0x564a5ad431f0 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.749+0000 7fe26878b740 1 --2- 172.21.15.69:0/940782319 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x564a5a8fe4d0 0x564a5acce290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.749+0000 7fe26878b740 1 --2- 172.21.15.69:0/940782319 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x564a5a8f62f0 0x564a5accdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.749+0000 7fe248c00640 0 client.17619 ms_handle_reset on v2:172.21.15.92:6838/2029564385 2024-05-14T15:41:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.749+0000 7fe26878b740 1 -- 172.21.15.69:0/940782319 >> 172.21.15.69:0/940782319 conn(0x564a5a913300 msgr2=0x564a5acca060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.749+0000 7fe26878b740 1 -- 172.21.15.69:0/940782319 shutdown_connections 2024-05-14T15:41:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.749+0000 7fe26878b740 1 -- 172.21.15.69:0/940782319 wait complete. 2024-05-14T15:41:46.751 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.750+0000 7fe26878b740 20 client.17619 trim_cache size 0 max 16384 2024-05-14T15:41:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:{ 2024-05-14T15:41:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "message": "", 2024-05-14T15:41:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout: "return_code": 0 2024-05-14T15:41:46.752 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stdout:} 2024-05-14T15:41:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.751+0000 7fe25be00640 1 -- 172.21.15.69:0/1825451626 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe23c0b2950 msgr2=0x7fe23c0b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.751+0000 7fe25be00640 1 --2- 172.21.15.69:0/1825451626 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe23c0b2950 0x7fe23c0b4e60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x564a5acbd5f0 tx=0x7fe254009580 comp rx=0 tx=0).stop 2024-05-14T15:41:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.751+0000 7fe25be00640 1 -- 172.21.15.69:0/1825451626 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c104210 msgr2=0x7fe25c074fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.751+0000 7fe25be00640 1 --2- 172.21.15.69:0/1825451626 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c104210 0x7fe25c074fd0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fe24c02a930 tx=0x7fe24c003c20 comp rx=0 tx=0).stop 2024-05-14T15:41:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.751+0000 7fe25be00640 1 -- 172.21.15.69:0/1825451626 shutdown_connections 2024-05-14T15:41:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.751+0000 7fe25be00640 1 --2- 172.21.15.69:0/1825451626 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fe23c0b2950 0x7fe23c0b4e60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.751+0000 7fe25be00640 1 --2- 172.21.15.69:0/1825451626 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fe25c109f60 0x7fe25c075a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.751+0000 7fe25be00640 1 --2- 172.21.15.69:0/1825451626 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fe25c109ac0 0x7fe25c075510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.753 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.751+0000 7fe25be00640 1 --2- 172.21.15.69:0/1825451626 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fe25c104210 0x7fe25c074fd0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.751+0000 7fe25be00640 1 -- 172.21.15.69:0/1825451626 >> 172.21.15.69:0/1825451626 conn(0x7fe25c079150 msgr2=0x7fe25c101880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.751+0000 7fe25be00640 1 -- 172.21.15.69:0/1825451626 shutdown_connections 2024-05-14T15:41:46.754 INFO:teuthology.task.background_exec.ubuntu@smithi069.front.sepia.ceph.com.smithi069.stderr:2024-05-14T15:41:46.751+0000 7fe25be00640 1 -- 172.21.15.69:0/1825451626 wait complete. 2024-05-14T15:41:46.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:46 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:41:46.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:46 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:41:47.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:46 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:41:47.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:47 smithi092 ceph-mon[34729]: pgmap v637: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 97 KiB/s wr, 31 op/s 2024-05-14T15:41:47.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:47 smithi069 ceph-mon[31270]: pgmap v637: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 97 KiB/s wr, 31 op/s 2024-05-14T15:41:48.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:47 smithi203 ceph-mon[34567]: pgmap v637: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 93 KiB/s rd, 97 KiB/s wr, 31 op/s 2024-05-14T15:41:48.375 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ls -lZaR /tmp/cephfs/postgres/' 2024-05-14T15:41:49.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:49 smithi092 ceph-mon[34729]: pgmap v638: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 63 KiB/s wr, 23 op/s 2024-05-14T15:41:49.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:49 smithi069 ceph-mon[31270]: pgmap v638: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 63 KiB/s wr, 23 op/s 2024-05-14T15:41:50.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:49 smithi203 ceph-mon[34567]: pgmap v638: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 63 KiB/s rd, 63 KiB/s wr, 23 op/s 2024-05-14T15:41:50.603 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/: 2024-05-14T15:41:50.603 INFO:teuthology.orchestra.run.smithi069.stdout:total 2 2024-05-14T15:41:50.603 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:21 . 2024-05-14T15:41:50.603 INFO:teuthology.orchestra.run.smithi069.stdout:drwxrwxrwt. 3 root root system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:21 .. 2024-05-14T15:41:50.603 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 data 2024-05-14T15:41:50.604 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:50.604 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data: 2024-05-14T15:41:50.604 INFO:teuthology.orchestra.run.smithi069.stdout:total 46 2024-05-14T15:41:50.604 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 . 2024-05-14T15:41:50.604 INFO:teuthology.orchestra.run.smithi069.stdout:drwxr-xr-x. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:21 .. 2024-05-14T15:41:50.604 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 571643445 May 14 15:25 base 2024-05-14T15:41:50.604 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 30 May 14 15:22 current_logfiles 2024-05-14T15:41:50.604 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 572520 May 14 15:22 global 2024-05-14T15:41:50.604 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1047 May 14 15:22 log 2024-05-14T15:41:50.605 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_commit_ts 2024-05-14T15:41:50.605 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_dynshmem 2024-05-14T15:41:50.605 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4516 May 14 15:22 pg_hba.conf 2024-05-14T15:41:50.605 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1636 May 14 15:22 pg_ident.conf 2024-05-14T15:41:50.605 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 15:41 pg_logical 2024-05-14T15:41:50.605 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 pg_multixact 2024-05-14T15:41:50.605 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_notify 2024-05-14T15:41:50.605 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_replslot 2024-05-14T15:41:50.605 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_serial 2024-05-14T15:41:50.605 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_snapshots 2024-05-14T15:41:50.605 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 May 14 15:41 pg_stat 2024-05-14T15:41:50.605 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 May 14 15:41 pg_stat_tmp 2024-05-14T15:41:50.605 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 14 15:40 pg_subtrans 2024-05-14T15:41:50.606 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_tblspc 2024-05-14T15:41:50.606 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 pg_twophase 2024-05-14T15:41:50.606 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 14 15:22 PG_VERSION 2024-05-14T15:41:50.606 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 922746880 May 14 15:41 pg_wal 2024-05-14T15:41:50.606 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 May 14 15:22 pg_xact 2024-05-14T15:41:50.606 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 88 May 14 15:22 postgresql.auto.conf 2024-05-14T15:41:50.606 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 28082 May 14 15:22 postgresql.conf 2024-05-14T15:41:50.606 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 51 May 14 15:22 postmaster.opts 2024-05-14T15:41:50.606 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:50.606 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/base: 2024-05-14T15:41:50.606 INFO:teuthology.orchestra.run.smithi069.stdout:total 3 2024-05-14T15:41:50.606 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 571643445 May 14 15:25 . 2024-05-14T15:41:50.607 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:50.607 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 15:22 1 2024-05-14T15:41:50.607 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 15:22 13493 2024-05-14T15:41:50.607 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 555717167 May 14 15:29 13494 2024-05-14T15:41:50.607 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:25 pgsql_tmp 2024-05-14T15:41:50.607 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:50.607 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/base/1: 2024-05-14T15:41:50.607 INFO:teuthology.orchestra.run.smithi069.stdout:total 7778 2024-05-14T15:41:50.607 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 15:22 . 2024-05-14T15:41:50.607 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 571643445 May 14 15:25 .. 2024-05-14T15:41:50.607 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 112 2024-05-14T15:41:50.607 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 113 2024-05-14T15:41:50.607 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 15:22 1247 2024-05-14T15:41:50.607 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1247_fsm 2024-05-14T15:41:50.607 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1247_vm 2024-05-14T15:41:50.608 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 14 15:22 1249 2024-05-14T15:41:50.608 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1249_fsm 2024-05-14T15:41:50.608 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1249_vm 2024-05-14T15:41:50.608 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 14 15:22 1255 2024-05-14T15:41:50.608 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1255_fsm 2024-05-14T15:41:50.608 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1255_vm 2024-05-14T15:41:50.608 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 14 15:22 1259 2024-05-14T15:41:50.608 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1259_fsm 2024-05-14T15:41:50.608 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1259_vm 2024-05-14T15:41:50.608 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 14 15:22 13344 2024-05-14T15:41:50.608 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13344_fsm 2024-05-14T15:41:50.608 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13344_vm 2024-05-14T15:41:50.608 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13346 2024-05-14T15:41:50.608 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13348 2024-05-14T15:41:50.608 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13349 2024-05-14T15:41:50.609 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13349_fsm 2024-05-14T15:41:50.609 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13349_vm 2024-05-14T15:41:50.609 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13351 2024-05-14T15:41:50.609 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13353 2024-05-14T15:41:50.609 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13354 2024-05-14T15:41:50.609 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13354_fsm 2024-05-14T15:41:50.609 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13354_vm 2024-05-14T15:41:50.609 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13356 2024-05-14T15:41:50.609 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13358 2024-05-14T15:41:50.609 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13359 2024-05-14T15:41:50.609 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13359_fsm 2024-05-14T15:41:50.609 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13359_vm 2024-05-14T15:41:50.609 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13361 2024-05-14T15:41:50.609 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13363 2024-05-14T15:41:50.610 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 1417 2024-05-14T15:41:50.610 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 1418 2024-05-14T15:41:50.610 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 174 2024-05-14T15:41:50.610 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 175 2024-05-14T15:41:50.610 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2187 2024-05-14T15:41:50.610 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2224 2024-05-14T15:41:50.610 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2328 2024-05-14T15:41:50.610 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2336 2024-05-14T15:41:50.610 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2337 2024-05-14T15:41:50.610 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2579 2024-05-14T15:41:50.610 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2600 2024-05-14T15:41:50.610 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2600_fsm 2024-05-14T15:41:50.610 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2600_vm 2024-05-14T15:41:50.611 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2601 2024-05-14T15:41:50.611 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2601_fsm 2024-05-14T15:41:50.611 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2601_vm 2024-05-14T15:41:50.611 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2602 2024-05-14T15:41:50.611 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2602_fsm 2024-05-14T15:41:50.611 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2602_vm 2024-05-14T15:41:50.611 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2603 2024-05-14T15:41:50.611 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2603_fsm 2024-05-14T15:41:50.611 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2603_vm 2024-05-14T15:41:50.611 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2604 2024-05-14T15:41:50.611 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2605 2024-05-14T15:41:50.611 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2605_fsm 2024-05-14T15:41:50.611 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2605_vm 2024-05-14T15:41:50.612 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2606 2024-05-14T15:41:50.612 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2606_fsm 2024-05-14T15:41:50.612 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2606_vm 2024-05-14T15:41:50.612 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2607 2024-05-14T15:41:50.612 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2607_fsm 2024-05-14T15:41:50.612 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2607_vm 2024-05-14T15:41:50.612 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 14 15:22 2608 2024-05-14T15:41:50.612 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2608_fsm 2024-05-14T15:41:50.612 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2608_vm 2024-05-14T15:41:50.612 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 14 15:22 2609 2024-05-14T15:41:50.612 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2609_fsm 2024-05-14T15:41:50.612 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2609_vm 2024-05-14T15:41:50.612 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2610 2024-05-14T15:41:50.612 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2610_fsm 2024-05-14T15:41:50.613 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2610_vm 2024-05-14T15:41:50.613 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2611 2024-05-14T15:41:50.613 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2612 2024-05-14T15:41:50.613 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2612_fsm 2024-05-14T15:41:50.613 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2612_vm 2024-05-14T15:41:50.613 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2613 2024-05-14T15:41:50.613 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2615 2024-05-14T15:41:50.613 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2615_fsm 2024-05-14T15:41:50.613 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2615_vm 2024-05-14T15:41:50.613 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2616 2024-05-14T15:41:50.613 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2616_fsm 2024-05-14T15:41:50.613 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2616_vm 2024-05-14T15:41:50.613 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 14 15:22 2617 2024-05-14T15:41:50.613 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2617_fsm 2024-05-14T15:41:50.614 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2617_vm 2024-05-14T15:41:50.614 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 14 15:22 2618 2024-05-14T15:41:50.614 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2618_fsm 2024-05-14T15:41:50.614 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2618_vm 2024-05-14T15:41:50.614 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 14 15:22 2619 2024-05-14T15:41:50.614 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2619_fsm 2024-05-14T15:41:50.614 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2619_vm 2024-05-14T15:41:50.614 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2620 2024-05-14T15:41:50.614 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2650 2024-05-14T15:41:50.614 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2651 2024-05-14T15:41:50.614 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2652 2024-05-14T15:41:50.614 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2653 2024-05-14T15:41:50.614 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2654 2024-05-14T15:41:50.614 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2655 2024-05-14T15:41:50.615 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2656 2024-05-14T15:41:50.615 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2657 2024-05-14T15:41:50.615 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 14 15:22 2658 2024-05-14T15:41:50.615 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 15:22 2659 2024-05-14T15:41:50.615 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2660 2024-05-14T15:41:50.615 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2661 2024-05-14T15:41:50.615 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2662 2024-05-14T15:41:50.615 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2663 2024-05-14T15:41:50.615 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2664 2024-05-14T15:41:50.615 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2665 2024-05-14T15:41:50.615 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2666 2024-05-14T15:41:50.615 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2667 2024-05-14T15:41:50.615 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2668 2024-05-14T15:41:50.615 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2669 2024-05-14T15:41:50.615 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2670 2024-05-14T15:41:50.616 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 14 15:22 2673 2024-05-14T15:41:50.616 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 14 15:22 2674 2024-05-14T15:41:50.616 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 14 15:22 2675 2024-05-14T15:41:50.616 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2678 2024-05-14T15:41:50.616 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2679 2024-05-14T15:41:50.616 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2680 2024-05-14T15:41:50.616 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2681 2024-05-14T15:41:50.616 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2682 2024-05-14T15:41:50.616 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2683 2024-05-14T15:41:50.616 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2684 2024-05-14T15:41:50.616 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2685 2024-05-14T15:41:50.616 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2686 2024-05-14T15:41:50.616 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2687 2024-05-14T15:41:50.616 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2688 2024-05-14T15:41:50.617 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2689 2024-05-14T15:41:50.617 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 14 15:22 2690 2024-05-14T15:41:50.617 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 14 15:22 2691 2024-05-14T15:41:50.617 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2692 2024-05-14T15:41:50.617 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2693 2024-05-14T15:41:50.617 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2696 2024-05-14T15:41:50.617 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2699 2024-05-14T15:41:50.617 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2701 2024-05-14T15:41:50.617 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2702 2024-05-14T15:41:50.617 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2703 2024-05-14T15:41:50.617 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2704 2024-05-14T15:41:50.617 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2753 2024-05-14T15:41:50.617 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2753_fsm 2024-05-14T15:41:50.617 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2753_vm 2024-05-14T15:41:50.617 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2754 2024-05-14T15:41:50.618 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2755 2024-05-14T15:41:50.618 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2756 2024-05-14T15:41:50.618 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2757 2024-05-14T15:41:50.618 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2830 2024-05-14T15:41:50.618 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2831 2024-05-14T15:41:50.618 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2832 2024-05-14T15:41:50.618 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2833 2024-05-14T15:41:50.618 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2834 2024-05-14T15:41:50.618 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2835 2024-05-14T15:41:50.618 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2836 2024-05-14T15:41:50.618 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2837 2024-05-14T15:41:50.618 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 14 15:22 2838 2024-05-14T15:41:50.618 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2838_fsm 2024-05-14T15:41:50.619 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2838_vm 2024-05-14T15:41:50.619 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2839 2024-05-14T15:41:50.619 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2840 2024-05-14T15:41:50.619 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2840_fsm 2024-05-14T15:41:50.619 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2840_vm 2024-05-14T15:41:50.619 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2841 2024-05-14T15:41:50.619 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2995 2024-05-14T15:41:50.619 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2996 2024-05-14T15:41:50.619 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3079 2024-05-14T15:41:50.619 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3079_fsm 2024-05-14T15:41:50.619 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3079_vm 2024-05-14T15:41:50.619 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3080 2024-05-14T15:41:50.619 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3081 2024-05-14T15:41:50.619 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 3085 2024-05-14T15:41:50.619 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3118 2024-05-14T15:41:50.620 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3119 2024-05-14T15:41:50.620 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 14 15:22 3164 2024-05-14T15:41:50.620 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3256 2024-05-14T15:41:50.620 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3257 2024-05-14T15:41:50.620 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3258 2024-05-14T15:41:50.620 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3350 2024-05-14T15:41:50.620 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3351 2024-05-14T15:41:50.620 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3379 2024-05-14T15:41:50.620 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3380 2024-05-14T15:41:50.620 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3381 2024-05-14T15:41:50.620 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3394 2024-05-14T15:41:50.620 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3394_fsm 2024-05-14T15:41:50.620 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3394_vm 2024-05-14T15:41:50.620 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3395 2024-05-14T15:41:50.620 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3429 2024-05-14T15:41:50.621 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3430 2024-05-14T15:41:50.621 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3431 2024-05-14T15:41:50.621 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3433 2024-05-14T15:41:50.621 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3439 2024-05-14T15:41:50.621 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3440 2024-05-14T15:41:50.621 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 3455 2024-05-14T15:41:50.621 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 14 15:22 3456 2024-05-14T15:41:50.621 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3456_fsm 2024-05-14T15:41:50.621 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3456_vm 2024-05-14T15:41:50.621 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3466 2024-05-14T15:41:50.621 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3467 2024-05-14T15:41:50.621 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3468 2024-05-14T15:41:50.621 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3501 2024-05-14T15:41:50.621 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3502 2024-05-14T15:41:50.621 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3503 2024-05-14T15:41:50.621 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3534 2024-05-14T15:41:50.622 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3541 2024-05-14T15:41:50.622 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3541_fsm 2024-05-14T15:41:50.622 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3541_vm 2024-05-14T15:41:50.622 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3542 2024-05-14T15:41:50.622 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3574 2024-05-14T15:41:50.622 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3575 2024-05-14T15:41:50.622 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3576 2024-05-14T15:41:50.622 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3596 2024-05-14T15:41:50.622 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3597 2024-05-14T15:41:50.622 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3598 2024-05-14T15:41:50.622 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3599 2024-05-14T15:41:50.622 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3600 2024-05-14T15:41:50.622 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3600_fsm 2024-05-14T15:41:50.622 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3600_vm 2024-05-14T15:41:50.622 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3601 2024-05-14T15:41:50.623 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3601_fsm 2024-05-14T15:41:50.623 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3601_vm 2024-05-14T15:41:50.623 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3602 2024-05-14T15:41:50.623 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3602_fsm 2024-05-14T15:41:50.623 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3602_vm 2024-05-14T15:41:50.623 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3603 2024-05-14T15:41:50.623 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3603_fsm 2024-05-14T15:41:50.623 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3603_vm 2024-05-14T15:41:50.623 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3604 2024-05-14T15:41:50.623 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3605 2024-05-14T15:41:50.623 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3606 2024-05-14T15:41:50.623 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3607 2024-05-14T15:41:50.623 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3608 2024-05-14T15:41:50.623 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 3609 2024-05-14T15:41:50.623 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3712 2024-05-14T15:41:50.624 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3764 2024-05-14T15:41:50.624 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3764_fsm 2024-05-14T15:41:50.624 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3764_vm 2024-05-14T15:41:50.624 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3766 2024-05-14T15:41:50.624 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3767 2024-05-14T15:41:50.624 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3997 2024-05-14T15:41:50.624 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4143 2024-05-14T15:41:50.624 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4144 2024-05-14T15:41:50.624 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4145 2024-05-14T15:41:50.624 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4146 2024-05-14T15:41:50.624 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4147 2024-05-14T15:41:50.624 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4148 2024-05-14T15:41:50.624 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4149 2024-05-14T15:41:50.624 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4150 2024-05-14T15:41:50.624 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4151 2024-05-14T15:41:51.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:51 smithi092 ceph-mon[34729]: pgmap v639: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 103 KiB/s wr, 34 op/s 2024-05-14T15:41:51.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:51 smithi069 ceph-mon[31270]: pgmap v639: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 103 KiB/s wr, 34 op/s 2024-05-14T15:41:52.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:51 smithi203 ceph-mon[34567]: pgmap v639: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 99 KiB/s rd, 103 KiB/s wr, 34 op/s 2024-05-14T15:41:52.473 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4152 2024-05-14T15:41:52.473 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4153 2024-05-14T15:41:52.473 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4154 2024-05-14T15:41:52.473 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4155 2024-05-14T15:41:52.473 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4156 2024-05-14T15:41:52.474 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4157 2024-05-14T15:41:52.474 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4158 2024-05-14T15:41:52.474 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4159 2024-05-14T15:41:52.474 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4160 2024-05-14T15:41:52.474 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4161 2024-05-14T15:41:52.474 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4162 2024-05-14T15:41:52.474 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4163 2024-05-14T15:41:52.474 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4164 2024-05-14T15:41:52.474 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4165 2024-05-14T15:41:52.474 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4166 2024-05-14T15:41:52.474 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4167 2024-05-14T15:41:52.474 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4168 2024-05-14T15:41:52.474 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4169 2024-05-14T15:41:52.475 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4170 2024-05-14T15:41:52.475 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4171 2024-05-14T15:41:52.475 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4172 2024-05-14T15:41:52.475 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4173 2024-05-14T15:41:52.475 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4174 2024-05-14T15:41:52.475 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 5002 2024-05-14T15:41:52.475 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 548 2024-05-14T15:41:52.475 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 549 2024-05-14T15:41:52.475 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6102 2024-05-14T15:41:52.475 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6104 2024-05-14T15:41:52.475 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6106 2024-05-14T15:41:52.475 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6110 2024-05-14T15:41:52.475 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6111 2024-05-14T15:41:52.475 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6112 2024-05-14T15:41:52.475 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6113 2024-05-14T15:41:52.475 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6117 2024-05-14T15:41:52.476 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 826 2024-05-14T15:41:52.476 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 827 2024-05-14T15:41:52.476 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 828 2024-05-14T15:41:52.476 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 14 15:22 pg_filenode.map 2024-05-14T15:41:52.476 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 14 15:22 PG_VERSION 2024-05-14T15:41:52.476 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:52.476 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/base/13493: 2024-05-14T15:41:52.476 INFO:teuthology.orchestra.run.smithi069.stdout:total 7778 2024-05-14T15:41:52.476 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 7963139 May 14 15:22 . 2024-05-14T15:41:52.476 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 571643445 May 14 15:25 .. 2024-05-14T15:41:52.476 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 112 2024-05-14T15:41:52.476 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 113 2024-05-14T15:41:52.476 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 15:22 1247 2024-05-14T15:41:52.476 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1247_fsm 2024-05-14T15:41:52.477 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1247_vm 2024-05-14T15:41:52.477 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 14 15:22 1249 2024-05-14T15:41:52.477 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1249_fsm 2024-05-14T15:41:52.477 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1249_vm 2024-05-14T15:41:52.477 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 14 15:22 1255 2024-05-14T15:41:52.477 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1255_fsm 2024-05-14T15:41:52.477 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1255_vm 2024-05-14T15:41:52.477 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 14 15:22 1259 2024-05-14T15:41:52.477 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1259_fsm 2024-05-14T15:41:52.477 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1259_vm 2024-05-14T15:41:52.477 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 14 15:22 13344 2024-05-14T15:41:52.477 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13344_fsm 2024-05-14T15:41:52.477 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13344_vm 2024-05-14T15:41:52.477 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13346 2024-05-14T15:41:52.477 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13348 2024-05-14T15:41:52.477 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13349 2024-05-14T15:41:52.478 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13349_fsm 2024-05-14T15:41:52.478 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13349_vm 2024-05-14T15:41:52.478 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13351 2024-05-14T15:41:52.478 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13353 2024-05-14T15:41:52.478 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13354 2024-05-14T15:41:52.478 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13354_fsm 2024-05-14T15:41:52.478 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13354_vm 2024-05-14T15:41:52.478 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13356 2024-05-14T15:41:52.478 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13358 2024-05-14T15:41:52.478 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13359 2024-05-14T15:41:52.478 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13359_fsm 2024-05-14T15:41:52.478 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13359_vm 2024-05-14T15:41:52.478 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13361 2024-05-14T15:41:52.478 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13363 2024-05-14T15:41:52.479 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 1417 2024-05-14T15:41:52.479 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 1418 2024-05-14T15:41:52.479 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 174 2024-05-14T15:41:52.479 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 175 2024-05-14T15:41:52.479 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2187 2024-05-14T15:41:52.479 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2224 2024-05-14T15:41:52.479 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2328 2024-05-14T15:41:52.479 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2336 2024-05-14T15:41:52.479 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2337 2024-05-14T15:41:52.479 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2579 2024-05-14T15:41:52.479 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2600 2024-05-14T15:41:52.479 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2600_fsm 2024-05-14T15:41:52.479 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2600_vm 2024-05-14T15:41:52.480 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2601 2024-05-14T15:41:52.480 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2601_fsm 2024-05-14T15:41:52.480 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2601_vm 2024-05-14T15:41:52.480 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2602 2024-05-14T15:41:52.480 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2602_fsm 2024-05-14T15:41:52.480 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2602_vm 2024-05-14T15:41:52.480 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2603 2024-05-14T15:41:52.480 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2603_fsm 2024-05-14T15:41:52.480 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2603_vm 2024-05-14T15:41:52.480 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2604 2024-05-14T15:41:52.480 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2605 2024-05-14T15:41:52.480 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2605_fsm 2024-05-14T15:41:52.480 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2605_vm 2024-05-14T15:41:52.481 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2606 2024-05-14T15:41:52.481 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2606_fsm 2024-05-14T15:41:52.481 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2606_vm 2024-05-14T15:41:52.481 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2607 2024-05-14T15:41:52.481 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2607_fsm 2024-05-14T15:41:52.481 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2607_vm 2024-05-14T15:41:52.481 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 14 15:22 2608 2024-05-14T15:41:52.481 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2608_fsm 2024-05-14T15:41:52.481 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2608_vm 2024-05-14T15:41:52.481 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 14 15:22 2609 2024-05-14T15:41:52.481 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2609_fsm 2024-05-14T15:41:52.481 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2609_vm 2024-05-14T15:41:52.481 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2610 2024-05-14T15:41:52.481 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2610_fsm 2024-05-14T15:41:52.481 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2610_vm 2024-05-14T15:41:52.482 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2611 2024-05-14T15:41:52.482 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2612 2024-05-14T15:41:52.482 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2612_fsm 2024-05-14T15:41:52.482 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2612_vm 2024-05-14T15:41:52.482 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2613 2024-05-14T15:41:52.482 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2615 2024-05-14T15:41:52.482 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2615_fsm 2024-05-14T15:41:52.482 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2615_vm 2024-05-14T15:41:52.482 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2616 2024-05-14T15:41:52.482 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2616_fsm 2024-05-14T15:41:52.482 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2616_vm 2024-05-14T15:41:52.482 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 14 15:22 2617 2024-05-14T15:41:52.482 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2617_fsm 2024-05-14T15:41:52.482 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2617_vm 2024-05-14T15:41:52.482 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 14 15:22 2618 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2618_fsm 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2618_vm 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 14 15:22 2619 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2619_fsm 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2619_vm 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2620 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2650 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2651 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2652 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2653 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2654 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2655 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2656 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2657 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 14 15:22 2658 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 15:22 2659 2024-05-14T15:41:52.483 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2660 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2661 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2662 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2663 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2664 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2665 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2666 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2667 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2668 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2669 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2670 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 14 15:22 2673 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 14 15:22 2674 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 14 15:22 2675 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2678 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2679 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2680 2024-05-14T15:41:52.484 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2681 2024-05-14T15:41:52.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2682 2024-05-14T15:41:52.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2683 2024-05-14T15:41:52.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2684 2024-05-14T15:41:52.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2685 2024-05-14T15:41:52.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2686 2024-05-14T15:41:52.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2687 2024-05-14T15:41:52.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2688 2024-05-14T15:41:52.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2689 2024-05-14T15:41:52.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 14 15:22 2690 2024-05-14T15:41:52.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 14 15:22 2691 2024-05-14T15:41:52.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2692 2024-05-14T15:41:52.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2693 2024-05-14T15:41:52.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2696 2024-05-14T15:41:52.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2699 2024-05-14T15:41:52.485 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2701 2024-05-14T15:41:52.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2702 2024-05-14T15:41:52.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2703 2024-05-14T15:41:52.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2704 2024-05-14T15:41:52.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2753 2024-05-14T15:41:52.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2753_fsm 2024-05-14T15:41:52.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2753_vm 2024-05-14T15:41:52.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2754 2024-05-14T15:41:52.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2755 2024-05-14T15:41:52.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2756 2024-05-14T15:41:52.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2757 2024-05-14T15:41:52.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2830 2024-05-14T15:41:52.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2831 2024-05-14T15:41:52.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2832 2024-05-14T15:41:52.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2833 2024-05-14T15:41:52.486 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2834 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2835 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2836 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2837 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 14 15:22 2838 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2838_fsm 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2838_vm 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2839 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2840 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2840_fsm 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2840_vm 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2841 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2995 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2996 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3079 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3079_fsm 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3079_vm 2024-05-14T15:41:52.487 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3080 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3081 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 3085 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3118 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3119 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 14 15:22 3164 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3256 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3257 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3258 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3350 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3351 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3379 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3380 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3381 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3394 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3394_fsm 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3394_vm 2024-05-14T15:41:52.488 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3395 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3429 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3430 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3431 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3433 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3439 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3440 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 3455 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 14 15:22 3456 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3456_fsm 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3456_vm 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3466 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3467 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3468 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3501 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3502 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3503 2024-05-14T15:41:52.489 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3534 2024-05-14T15:41:52.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3541 2024-05-14T15:41:52.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3541_fsm 2024-05-14T15:41:52.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3541_vm 2024-05-14T15:41:52.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3542 2024-05-14T15:41:52.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3574 2024-05-14T15:41:52.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3575 2024-05-14T15:41:52.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3576 2024-05-14T15:41:52.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3596 2024-05-14T15:41:52.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3597 2024-05-14T15:41:52.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3598 2024-05-14T15:41:52.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3599 2024-05-14T15:41:52.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3600 2024-05-14T15:41:52.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3600_fsm 2024-05-14T15:41:52.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3600_vm 2024-05-14T15:41:52.490 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3601 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3601_fsm 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3601_vm 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3602 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3602_fsm 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3602_vm 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3603 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3603_fsm 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3603_vm 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3604 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3605 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3606 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3607 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3608 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 3609 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3712 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3764 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3764_fsm 2024-05-14T15:41:52.491 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3764_vm 2024-05-14T15:41:52.492 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3766 2024-05-14T15:41:52.492 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3767 2024-05-14T15:41:52.492 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3997 2024-05-14T15:41:52.492 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4143 2024-05-14T15:41:52.492 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4144 2024-05-14T15:41:52.492 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4145 2024-05-14T15:41:52.492 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4146 2024-05-14T15:41:52.492 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4147 2024-05-14T15:41:52.492 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4148 2024-05-14T15:41:52.492 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4149 2024-05-14T15:41:52.492 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4150 2024-05-14T15:41:52.492 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4151 2024-05-14T15:41:52.492 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4152 2024-05-14T15:41:52.492 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4153 2024-05-14T15:41:52.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:52 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:41:53.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:52 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:41:53.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:52 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:41:53.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:53 smithi069 ceph-mon[31270]: pgmap v640: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 76 KiB/s wr, 29 op/s 2024-05-14T15:41:54.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:53 smithi203 ceph-mon[34567]: pgmap v640: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 76 KiB/s wr, 29 op/s 2024-05-14T15:41:54.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:53 smithi092 ceph-mon[34729]: pgmap v640: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 72 KiB/s rd, 76 KiB/s wr, 29 op/s 2024-05-14T15:41:54.505 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4154 2024-05-14T15:41:54.505 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4155 2024-05-14T15:41:54.505 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4156 2024-05-14T15:41:54.505 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4157 2024-05-14T15:41:54.505 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4158 2024-05-14T15:41:54.505 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4159 2024-05-14T15:41:54.505 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4160 2024-05-14T15:41:54.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4161 2024-05-14T15:41:54.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4162 2024-05-14T15:41:54.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4163 2024-05-14T15:41:54.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4164 2024-05-14T15:41:54.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4165 2024-05-14T15:41:54.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4166 2024-05-14T15:41:54.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4167 2024-05-14T15:41:54.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4168 2024-05-14T15:41:54.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4169 2024-05-14T15:41:54.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4170 2024-05-14T15:41:54.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4171 2024-05-14T15:41:54.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4172 2024-05-14T15:41:54.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4173 2024-05-14T15:41:54.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4174 2024-05-14T15:41:54.506 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 5002 2024-05-14T15:41:54.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 548 2024-05-14T15:41:54.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 549 2024-05-14T15:41:54.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6102 2024-05-14T15:41:54.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6104 2024-05-14T15:41:54.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6106 2024-05-14T15:41:54.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6110 2024-05-14T15:41:54.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6111 2024-05-14T15:41:54.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6112 2024-05-14T15:41:54.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6113 2024-05-14T15:41:54.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6117 2024-05-14T15:41:54.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 826 2024-05-14T15:41:54.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 827 2024-05-14T15:41:54.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 828 2024-05-14T15:41:54.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 14 15:22 pg_filenode.map 2024-05-14T15:41:54.507 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 14 15:22 PG_VERSION 2024-05-14T15:41:54.507 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/base/13494: 2024-05-14T15:41:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:total 542695 2024-05-14T15:41:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 555717167 May 14 15:29 . 2024-05-14T15:41:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 571643445 May 14 15:25 .. 2024-05-14T15:41:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 112 2024-05-14T15:41:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 113 2024-05-14T15:41:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 15:26 1247 2024-05-14T15:41:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1247_fsm 2024-05-14T15:41:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:25 1247_vm 2024-05-14T15:41:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 434176 May 14 15:26 1249 2024-05-14T15:41:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:25 1249_fsm 2024-05-14T15:41:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:25 1249_vm 2024-05-14T15:41:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 663552 May 14 15:22 1255 2024-05-14T15:41:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1255_fsm 2024-05-14T15:41:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1255_vm 2024-05-14T15:41:54.508 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 106496 May 14 15:41 1259 2024-05-14T15:41:54.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1259_fsm 2024-05-14T15:41:54.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:25 1259_vm 2024-05-14T15:41:54.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 65536 May 14 15:22 13344 2024-05-14T15:41:54.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13344_fsm 2024-05-14T15:41:54.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13344_vm 2024-05-14T15:41:54.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13346 2024-05-14T15:41:54.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13348 2024-05-14T15:41:54.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13349 2024-05-14T15:41:54.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13349_fsm 2024-05-14T15:41:54.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13349_vm 2024-05-14T15:41:54.509 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13351 2024-05-14T15:41:54.510 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13353 2024-05-14T15:41:54.510 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13354 2024-05-14T15:41:54.510 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13354_fsm 2024-05-14T15:41:54.510 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13354_vm 2024-05-14T15:41:54.510 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13356 2024-05-14T15:41:54.510 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13358 2024-05-14T15:41:54.510 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13359 2024-05-14T15:41:54.510 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 13359_fsm 2024-05-14T15:41:54.510 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13359_vm 2024-05-14T15:41:54.510 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 13361 2024-05-14T15:41:54.510 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 13363 2024-05-14T15:41:54.510 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 1417 2024-05-14T15:41:54.510 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 1418 2024-05-14T15:41:54.511 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 441344000 May 14 15:41 16396 2024-05-14T15:41:54.511 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 May 14 15:39 16396_fsm 2024-05-14T15:41:54.511 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:41 16396_vm 2024-05-14T15:41:54.511 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 2834432 May 14 15:41 16397 2024-05-14T15:41:54.511 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:41 16397_fsm 2024-05-14T15:41:54.511 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:41 16397_vm 2024-05-14T15:41:54.511 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 4988928 May 14 15:41 16399 2024-05-14T15:41:54.511 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:41 16399_fsm 2024-05-14T15:41:54.511 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:41 16399_vm 2024-05-14T15:41:54.511 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:41 16400 2024-05-14T15:41:54.511 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 14 15:39 16402 2024-05-14T15:41:54.511 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 71901184 May 14 15:41 16404 2024-05-14T15:41:54.511 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 26173440 May 14 15:41 16406 2024-05-14T15:41:54.512 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:41 16406_fsm 2024-05-14T15:41:54.512 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:39 16406_vm 2024-05-14T15:41:54.512 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 174 2024-05-14T15:41:54.512 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 175 2024-05-14T15:41:54.512 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2187 2024-05-14T15:41:54.512 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2224 2024-05-14T15:41:54.512 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2328 2024-05-14T15:41:54.512 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2336 2024-05-14T15:41:54.512 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2337 2024-05-14T15:41:54.512 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:26 2579 2024-05-14T15:41:54.512 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2600 2024-05-14T15:41:54.512 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2600_fsm 2024-05-14T15:41:54.512 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2600_vm 2024-05-14T15:41:54.512 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2601 2024-05-14T15:41:54.512 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2601_fsm 2024-05-14T15:41:54.512 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2601_vm 2024-05-14T15:41:54.513 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2602 2024-05-14T15:41:54.513 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2602_fsm 2024-05-14T15:41:54.513 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2602_vm 2024-05-14T15:41:54.513 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2603 2024-05-14T15:41:54.513 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2603_fsm 2024-05-14T15:41:54.513 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2603_vm 2024-05-14T15:41:54.513 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2604 2024-05-14T15:41:54.513 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2605 2024-05-14T15:41:54.513 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2605_fsm 2024-05-14T15:41:54.513 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2605_vm 2024-05-14T15:41:54.513 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:26 2606 2024-05-14T15:41:54.513 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2606_fsm 2024-05-14T15:41:54.513 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:25 2606_vm 2024-05-14T15:41:54.513 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2607 2024-05-14T15:41:54.514 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2607_fsm 2024-05-14T15:41:54.514 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2607_vm 2024-05-14T15:41:54.514 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 466944 May 14 15:26 2608 2024-05-14T15:41:54.514 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2608_fsm 2024-05-14T15:41:54.514 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:25 2608_vm 2024-05-14T15:41:54.514 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 344064 May 14 15:22 2609 2024-05-14T15:41:54.514 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2609_fsm 2024-05-14T15:41:54.514 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2609_vm 2024-05-14T15:41:54.514 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:26 2610 2024-05-14T15:41:54.514 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2610_fsm 2024-05-14T15:41:54.514 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:25 2610_vm 2024-05-14T15:41:54.514 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2611 2024-05-14T15:41:54.514 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2612 2024-05-14T15:41:54.514 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2612_fsm 2024-05-14T15:41:54.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2612_vm 2024-05-14T15:41:54.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2613 2024-05-14T15:41:54.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2615 2024-05-14T15:41:54.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2615_fsm 2024-05-14T15:41:54.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2615_vm 2024-05-14T15:41:54.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2616 2024-05-14T15:41:54.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2616_fsm 2024-05-14T15:41:54.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2616_vm 2024-05-14T15:41:54.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 114688 May 14 15:22 2617 2024-05-14T15:41:54.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2617_fsm 2024-05-14T15:41:54.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2617_vm 2024-05-14T15:41:54.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 98304 May 14 15:22 2618 2024-05-14T15:41:54.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2618_fsm 2024-05-14T15:41:54.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2618_vm 2024-05-14T15:41:54.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 172032 May 14 15:41 2619 2024-05-14T15:41:54.515 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:28 2619_fsm 2024-05-14T15:41:54.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:25 2619_vm 2024-05-14T15:41:54.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2620 2024-05-14T15:41:54.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2650 2024-05-14T15:41:54.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2651 2024-05-14T15:41:54.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2652 2024-05-14T15:41:54.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2653 2024-05-14T15:41:54.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2654 2024-05-14T15:41:54.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2655 2024-05-14T15:41:54.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2656 2024-05-14T15:41:54.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2657 2024-05-14T15:41:54.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 122880 May 14 15:26 2658 2024-05-14T15:41:54.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 81920 May 14 15:26 2659 2024-05-14T15:41:54.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2660 2024-05-14T15:41:54.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2661 2024-05-14T15:41:54.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:26 2662 2024-05-14T15:41:54.516 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:26 2663 2024-05-14T15:41:54.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:26 2664 2024-05-14T15:41:54.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:26 2665 2024-05-14T15:41:54.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:26 2666 2024-05-14T15:41:54.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:26 2667 2024-05-14T15:41:54.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2668 2024-05-14T15:41:54.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2669 2024-05-14T15:41:54.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2670 2024-05-14T15:41:54.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 278528 May 14 15:26 2673 2024-05-14T15:41:54.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 352256 May 14 15:26 2674 2024-05-14T15:41:54.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 196608 May 14 15:22 2675 2024-05-14T15:41:54.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:26 2678 2024-05-14T15:41:54.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:26 2679 2024-05-14T15:41:54.517 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2680 2024-05-14T15:41:54.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2681 2024-05-14T15:41:54.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2682 2024-05-14T15:41:54.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2683 2024-05-14T15:41:54.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2684 2024-05-14T15:41:54.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2685 2024-05-14T15:41:54.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2686 2024-05-14T15:41:54.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2687 2024-05-14T15:41:54.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 2688 2024-05-14T15:41:54.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 49152 May 14 15:22 2689 2024-05-14T15:41:54.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 90112 May 14 15:22 2690 2024-05-14T15:41:54.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 253952 May 14 15:22 2691 2024-05-14T15:41:54.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2692 2024-05-14T15:41:54.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2693 2024-05-14T15:41:54.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:37 2696 2024-05-14T15:41:54.518 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2699 2024-05-14T15:41:54.519 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2701 2024-05-14T15:41:54.519 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2702 2024-05-14T15:41:54.519 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:26 2703 2024-05-14T15:41:54.519 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:26 2704 2024-05-14T15:41:54.519 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2753 2024-05-14T15:41:54.519 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2753_fsm 2024-05-14T15:41:54.519 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2753_vm 2024-05-14T15:41:54.519 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2754 2024-05-14T15:41:54.519 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2755 2024-05-14T15:41:54.519 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2756 2024-05-14T15:41:54.519 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 2757 2024-05-14T15:41:54.519 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2830 2024-05-14T15:41:54.519 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2831 2024-05-14T15:41:54.519 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2832 2024-05-14T15:41:54.519 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2833 2024-05-14T15:41:54.520 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2834 2024-05-14T15:41:54.520 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2835 2024-05-14T15:41:54.520 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2836 2024-05-14T15:41:54.520 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2837 2024-05-14T15:41:54.520 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 491520 May 14 15:22 2838 2024-05-14T15:41:54.520 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2838_fsm 2024-05-14T15:41:54.520 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2838_vm 2024-05-14T15:41:54.520 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2839 2024-05-14T15:41:54.520 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2840 2024-05-14T15:41:54.520 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2840_fsm 2024-05-14T15:41:54.520 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2840_vm 2024-05-14T15:41:54.520 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2841 2024-05-14T15:41:54.520 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2995 2024-05-14T15:41:54.520 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2996 2024-05-14T15:41:54.520 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3079 2024-05-14T15:41:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3079_fsm 2024-05-14T15:41:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3079_vm 2024-05-14T15:41:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3080 2024-05-14T15:41:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3081 2024-05-14T15:41:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:22 3085 2024-05-14T15:41:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3118 2024-05-14T15:41:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3119 2024-05-14T15:41:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 57344 May 14 15:22 3164 2024-05-14T15:41:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3256 2024-05-14T15:41:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3257 2024-05-14T15:41:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3258 2024-05-14T15:41:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3350 2024-05-14T15:41:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3351 2024-05-14T15:41:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3379 2024-05-14T15:41:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3380 2024-05-14T15:41:54.521 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3381 2024-05-14T15:41:54.522 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3394 2024-05-14T15:41:54.522 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3394_fsm 2024-05-14T15:41:54.522 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3394_vm 2024-05-14T15:41:54.522 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3395 2024-05-14T15:41:54.522 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3429 2024-05-14T15:41:54.522 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3430 2024-05-14T15:41:54.522 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3431 2024-05-14T15:41:54.522 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3433 2024-05-14T15:41:54.522 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3439 2024-05-14T15:41:54.522 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3440 2024-05-14T15:41:54.522 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 40960 May 14 15:26 3455 2024-05-14T15:41:54.522 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 221184 May 14 15:22 3456 2024-05-14T15:41:54.522 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3456_fsm 2024-05-14T15:41:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3456_vm 2024-05-14T15:41:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3466 2024-05-14T15:41:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3467 2024-05-14T15:41:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3468 2024-05-14T15:41:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3501 2024-05-14T15:41:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3502 2024-05-14T15:41:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3503 2024-05-14T15:41:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3534 2024-05-14T15:41:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3541 2024-05-14T15:41:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3541_fsm 2024-05-14T15:41:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3541_vm 2024-05-14T15:41:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3542 2024-05-14T15:41:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3574 2024-05-14T15:41:54.523 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3575 2024-05-14T15:41:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3576 2024-05-14T15:41:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3596 2024-05-14T15:41:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3597 2024-05-14T15:41:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3598 2024-05-14T15:41:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3599 2024-05-14T15:41:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3600 2024-05-14T15:41:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3600_fsm 2024-05-14T15:41:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3600_vm 2024-05-14T15:41:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3601 2024-05-14T15:41:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3601_fsm 2024-05-14T15:41:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3601_vm 2024-05-14T15:41:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3602 2024-05-14T15:41:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3602_fsm 2024-05-14T15:41:54.524 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3602_vm 2024-05-14T15:41:54.525 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3603 2024-05-14T15:41:54.525 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3603_fsm 2024-05-14T15:41:54.525 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3603_vm 2024-05-14T15:41:54.525 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3604 2024-05-14T15:41:54.525 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3605 2024-05-14T15:41:54.525 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3606 2024-05-14T15:41:54.525 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3607 2024-05-14T15:41:54.525 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3608 2024-05-14T15:41:54.525 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 32768 May 14 15:22 3609 2024-05-14T15:41:54.525 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3712 2024-05-14T15:41:54.525 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3764 2024-05-14T15:41:54.525 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 3764_fsm 2024-05-14T15:41:54.525 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3764_vm 2024-05-14T15:41:54.526 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3766 2024-05-14T15:41:54.526 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 3767 2024-05-14T15:41:54.526 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3997 2024-05-14T15:41:54.526 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4143 2024-05-14T15:41:54.526 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4144 2024-05-14T15:41:54.526 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4145 2024-05-14T15:41:54.526 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4146 2024-05-14T15:41:54.526 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4147 2024-05-14T15:41:54.526 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4148 2024-05-14T15:41:54.526 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4149 2024-05-14T15:41:54.526 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4150 2024-05-14T15:41:54.526 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4151 2024-05-14T15:41:54.526 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4152 2024-05-14T15:41:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4153 2024-05-14T15:41:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4154 2024-05-14T15:41:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4155 2024-05-14T15:41:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4156 2024-05-14T15:41:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4157 2024-05-14T15:41:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4158 2024-05-14T15:41:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4159 2024-05-14T15:41:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4160 2024-05-14T15:41:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4161 2024-05-14T15:41:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4162 2024-05-14T15:41:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4163 2024-05-14T15:41:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4164 2024-05-14T15:41:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4165 2024-05-14T15:41:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4166 2024-05-14T15:41:54.527 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4167 2024-05-14T15:41:54.528 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4168 2024-05-14T15:41:54.528 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4169 2024-05-14T15:41:54.528 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4170 2024-05-14T15:41:54.528 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4171 2024-05-14T15:41:54.528 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4172 2024-05-14T15:41:54.528 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4173 2024-05-14T15:41:54.528 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4174 2024-05-14T15:41:54.528 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 5002 2024-05-14T15:41:54.528 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 548 2024-05-14T15:41:54.528 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 549 2024-05-14T15:41:54.528 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6102 2024-05-14T15:41:54.528 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6104 2024-05-14T15:41:54.528 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6106 2024-05-14T15:41:54.528 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6110 2024-05-14T15:41:54.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6111 2024-05-14T15:41:54.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6112 2024-05-14T15:41:54.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6113 2024-05-14T15:41:54.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6117 2024-05-14T15:41:54.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 826 2024-05-14T15:41:54.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 827 2024-05-14T15:41:54.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 828 2024-05-14T15:41:54.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 14 15:22 pg_filenode.map 2024-05-14T15:41:54.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 151596 May 14 15:22 pg_internal.init 2024-05-14T15:41:54.902 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 3 May 14 15:22 PG_VERSION 2024-05-14T15:41:54.903 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:54.903 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/base/pgsql_tmp: 2024-05-14T15:41:54.903 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:41:54.903 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:25 . 2024-05-14T15:41:54.903 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 6 postgres postgres system_u:object_r:postgresql_db_t:s0 571643445 May 14 15:25 .. 2024-05-14T15:41:54.903 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:54.903 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/global: 2024-05-14T15:41:54.903 INFO:teuthology.orchestra.run.smithi069.stdout:total 561 2024-05-14T15:41:54.903 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 572520 May 14 15:22 . 2024-05-14T15:41:54.903 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:54.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1213 2024-05-14T15:41:54.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1213_fsm 2024-05-14T15:41:54.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1213_vm 2024-05-14T15:41:54.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1214 2024-05-14T15:41:54.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1214_fsm 2024-05-14T15:41:54.903 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1214_vm 2024-05-14T15:41:54.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 1232 2024-05-14T15:41:54.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 1233 2024-05-14T15:41:54.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1260 2024-05-14T15:41:54.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1260_fsm 2024-05-14T15:41:54.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1260_vm 2024-05-14T15:41:54.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1261 2024-05-14T15:41:54.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1261_fsm 2024-05-14T15:41:54.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1261_vm 2024-05-14T15:41:54.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1262 2024-05-14T15:41:54.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 1262_fsm 2024-05-14T15:41:54.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 1262_vm 2024-05-14T15:41:54.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2396 2024-05-14T15:41:54.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 24576 May 14 15:22 2396_fsm 2024-05-14T15:41:54.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2396_vm 2024-05-14T15:41:54.904 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2397 2024-05-14T15:41:54.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2671 2024-05-14T15:41:54.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2672 2024-05-14T15:41:54.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2676 2024-05-14T15:41:54.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2677 2024-05-14T15:41:54.905 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2694 2024-05-14T15:41:54.990 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2695 2024-05-14T15:41:54.990 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2697 2024-05-14T15:41:54.990 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 2698 2024-05-14T15:41:54.990 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2846 2024-05-14T15:41:54.990 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2847 2024-05-14T15:41:54.991 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2964 2024-05-14T15:41:54.991 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2965 2024-05-14T15:41:54.991 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 2966 2024-05-14T15:41:54.991 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 2967 2024-05-14T15:41:54.991 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 3592 2024-05-14T15:41:54.991 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 3593 2024-05-14T15:41:54.991 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4060 2024-05-14T15:41:54.991 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4061 2024-05-14T15:41:54.991 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4175 2024-05-14T15:41:54.991 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4176 2024-05-14T15:41:54.991 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4177 2024-05-14T15:41:54.991 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4178 2024-05-14T15:41:54.991 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4181 2024-05-14T15:41:54.991 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4182 2024-05-14T15:41:54.991 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4183 2024-05-14T15:41:54.991 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4184 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 4185 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 4186 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6000 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6001 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6002 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 6100 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6114 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 6115 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:41 pg_control 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 512 May 14 15:22 pg_filenode.map 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 23144 May 14 15:22 pg_internal.init 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/log: 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout:total 3 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 1047 May 14 15:22 . 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:54.992 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1118 May 14 15:41 postgresql-Tue.log 2024-05-14T15:41:54.993 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:54.993 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_commit_ts: 2024-05-14T15:41:54.993 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:41:54.993 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:41:54.993 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:54.993 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:54.993 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_dynshmem: 2024-05-14T15:41:54.993 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:41:54.993 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:41:54.993 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:54.993 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:54.993 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_logical: 2024-05-14T15:41:54.993 INFO:teuthology.orchestra.run.smithi069.stdout:total 3 2024-05-14T15:41:55.255 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 15:41 . 2024-05-14T15:41:55.255 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:55.255 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 mappings 2024-05-14T15:41:55.256 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 15:41 replorigin_checkpoint 2024-05-14T15:41:55.256 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 snapshots 2024-05-14T15:41:55.256 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.256 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_logical/mappings: 2024-05-14T15:41:55.256 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:41:55.256 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:41:55.256 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 15:41 .. 2024-05-14T15:41:55.256 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.256 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_logical/snapshots: 2024-05-14T15:41:55.256 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:41:55.256 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:41:55.256 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 8 May 14 15:41 .. 2024-05-14T15:41:55.256 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.257 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_multixact: 2024-05-14T15:41:55.257 INFO:teuthology.orchestra.run.smithi069.stdout:total 2 2024-05-14T15:41:55.257 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 . 2024-05-14T15:41:55.257 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:55.257 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 members 2024-05-14T15:41:55.257 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 offsets 2024-05-14T15:41:55.257 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.257 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_multixact/members: 2024-05-14T15:41:55.257 INFO:teuthology.orchestra.run.smithi069.stdout:total 9 2024-05-14T15:41:55.257 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 . 2024-05-14T15:41:55.257 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 .. 2024-05-14T15:41:55.257 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 0000 2024-05-14T15:41:55.257 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.257 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_multixact/offsets: 2024-05-14T15:41:55.258 INFO:teuthology.orchestra.run.smithi069.stdout:total 9 2024-05-14T15:41:55.258 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:22 . 2024-05-14T15:41:55.258 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 4 postgres postgres system_u:object_r:postgresql_db_t:s0 16384 May 14 15:22 .. 2024-05-14T15:41:55.258 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 8192 May 14 15:27 0000 2024-05-14T15:41:55.258 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.258 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_notify: 2024-05-14T15:41:55.258 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:41:55.258 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:41:55.258 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:55.258 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.258 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_replslot: 2024-05-14T15:41:55.258 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:41:55.258 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:41:55.258 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:55.258 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.259 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_serial: 2024-05-14T15:41:55.259 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:41:55.259 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:41:55.259 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:55.259 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.259 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_snapshots: 2024-05-14T15:41:55.259 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:41:55.259 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:41:55.259 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:55.259 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.259 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_stat: 2024-05-14T15:41:55.259 INFO:teuthology.orchestra.run.smithi069.stdout:total 16 2024-05-14T15:41:55.259 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 May 14 15:41 . 2024-05-14T15:41:55.260 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:55.260 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1952 May 14 15:41 db_0.stat 2024-05-14T15:41:55.260 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 10979 May 14 15:41 db_13494.stat 2024-05-14T15:41:55.260 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 1151 May 14 15:41 global.stat 2024-05-14T15:41:55.260 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.260 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_stat_tmp: 2024-05-14T15:41:55.260 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:41:55.260 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 14082 May 14 15:41 . 2024-05-14T15:41:55.260 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:55.260 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.260 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_subtrans: 2024-05-14T15:41:55.260 INFO:teuthology.orchestra.run.smithi069.stdout:total 145 2024-05-14T15:41:55.260 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 14 15:40 . 2024-05-14T15:41:55.260 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:55.765 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 147456 May 14 15:41 0007 2024-05-14T15:41:55.765 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.765 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_tblspc: 2024-05-14T15:41:55.765 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:41:55.765 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:41:55.765 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_twophase: 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_wal: 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout:total 884738 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 922746880 May 14 15:41 . 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1495321382 May 14 15:41 .. 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:41 000000010000000000000073 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:35 000000010000000000000074 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:33 000000010000000000000075 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:35 000000010000000000000076 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:32 000000010000000000000077 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:36 000000010000000000000078 2024-05-14T15:41:55.766 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:36 000000010000000000000079 2024-05-14T15:41:55.767 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:34 00000001000000000000007A 2024-05-14T15:41:55.767 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:33 00000001000000000000007B 2024-05-14T15:41:55.767 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:35 00000001000000000000007C 2024-05-14T15:41:55.767 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:33 00000001000000000000007D 2024-05-14T15:41:55.767 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:33 00000001000000000000007E 2024-05-14T15:41:55.767 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:35 00000001000000000000007F 2024-05-14T15:41:55.767 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:33 000000010000000000000080 2024-05-14T15:41:55.767 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:34 000000010000000000000081 2024-05-14T15:41:55.767 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:37 000000010000000000000082 2024-05-14T15:41:55.767 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:33 000000010000000000000083 2024-05-14T15:41:55.767 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:32 000000010000000000000084 2024-05-14T15:41:55.767 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:33 000000010000000000000085 2024-05-14T15:41:55.767 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:36 000000010000000000000086 2024-05-14T15:41:55.767 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:34 000000010000000000000087 2024-05-14T15:41:55.767 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:36 000000010000000000000088 2024-05-14T15:41:55.767 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:37 000000010000000000000089 2024-05-14T15:41:55.768 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:33 00000001000000000000008A 2024-05-14T15:41:55.768 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:34 00000001000000000000008B 2024-05-14T15:41:55.768 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:33 00000001000000000000008C 2024-05-14T15:41:55.768 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:34 00000001000000000000008D 2024-05-14T15:41:55.768 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:34 00000001000000000000008E 2024-05-14T15:41:55.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:35 00000001000000000000008F 2024-05-14T15:41:55.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:33 000000010000000000000090 2024-05-14T15:41:55.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:33 000000010000000000000091 2024-05-14T15:41:55.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:33 000000010000000000000092 2024-05-14T15:41:55.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:33 000000010000000000000093 2024-05-14T15:41:55.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:38 000000010000000000000094 2024-05-14T15:41:55.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:38 000000010000000000000095 2024-05-14T15:41:55.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:38 000000010000000000000096 2024-05-14T15:41:55.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:39 000000010000000000000097 2024-05-14T15:41:55.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:38 000000010000000000000098 2024-05-14T15:41:55.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:38 000000010000000000000099 2024-05-14T15:41:55.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:39 00000001000000000000009A 2024-05-14T15:41:55.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:38 00000001000000000000009B 2024-05-14T15:41:55.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:38 00000001000000000000009C 2024-05-14T15:41:55.810 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:38 00000001000000000000009D 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:38 00000001000000000000009E 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:40 00000001000000000000009F 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:39 0000000100000000000000A0 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:39 0000000100000000000000A1 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:38 0000000100000000000000A2 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:39 0000000100000000000000A3 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:39 0000000100000000000000A4 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:38 0000000100000000000000A5 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:39 0000000100000000000000A6 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:38 0000000100000000000000A7 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 16777216 May 14 15:40 0000000100000000000000A8 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 archive_status 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_wal/archive_status: 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout:total 1 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 0 May 14 15:22 . 2024-05-14T15:41:55.811 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 3 postgres postgres system_u:object_r:postgresql_db_t:s0 905969664 May 14 15:41 .. 2024-05-14T15:41:55.812 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:55.812 INFO:teuthology.orchestra.run.smithi069.stdout:/tmp/cephfs/postgres/data/pg_xact: 2024-05-14T15:41:55.812 INFO:teuthology.orchestra.run.smithi069.stdout:total 129 2024-05-14T15:41:55.812 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 2 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 May 14 15:22 . 2024-05-14T15:41:55.812 INFO:teuthology.orchestra.run.smithi069.stdout:drwx------. 20 postgres postgres system_u:object_r:postgresql_db_t:s0 1478544166 May 14 15:41 .. 2024-05-14T15:41:55.812 INFO:teuthology.orchestra.run.smithi069.stdout:-rw-------. 1 postgres postgres system_u:object_r:postgresql_db_t:s0 131072 May 14 15:41 0000 2024-05-14T15:41:55.821 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-05-14T15:41:55.832 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi069.front.sepia.ceph.com 2024-05-14T15:41:55.858 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-05-14T15:41:55.873 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-05-14T15:41:55.873 INFO:teuthology.task.exec:Executing custom commands... 2024-05-14T15:41:55.873 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi069.front.sepia.ceph.com 2024-05-14T15:41:55.873 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-05-14T15:41:55.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:55 smithi069 ceph-mon[31270]: pgmap v641: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 82 KiB/s wr, 30 op/s 2024-05-14T15:41:56.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:55 smithi203 ceph-mon[34567]: pgmap v641: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 82 KiB/s wr, 30 op/s 2024-05-14T15:41:56.155 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-05-14T15:41:56.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:55 smithi092 ceph-mon[34729]: pgmap v641: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 82 KiB/s rd, 82 KiB/s wr, 30 op/s 2024-05-14T15:41:56.260 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-05-14T15:41:56.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.524+0000 7f0f37200640 1 -- 172.21.15.69:0/554403759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f38106440 msgr2=0x7f0f38112810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:56.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.524+0000 7f0f37200640 1 --2- 172.21.15.69:0/554403759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f38106440 0x7f0f38112810 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f0f30009ca0 tx=0x7f0f3002a8c0 comp rx=0 tx=0).stop 2024-05-14T15:41:56.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.524+0000 7f0f37200640 1 -- 172.21.15.69:0/554403759 shutdown_connections 2024-05-14T15:41:56.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.524+0000 7f0f37200640 1 --2- 172.21.15.69:0/554403759 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f38106440 0x7f0f38112810 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:56.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.524+0000 7f0f37200640 1 --2- 172.21.15.69:0/554403759 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f3810c190 0x7f0f38105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:56.525 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.524+0000 7f0f37200640 1 --2- 172.21.15.69:0/554403759 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f3810bcf0 0x7f0f38105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:56.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.524+0000 7f0f37200640 1 -- 172.21.15.69:0/554403759 >> 172.21.15.69:0/554403759 conn(0x7f0f38101390 msgr2=0x7f0f381037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:56.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.524+0000 7f0f37200640 1 -- 172.21.15.69:0/554403759 shutdown_connections 2024-05-14T15:41:56.526 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.524+0000 7f0f37200640 1 -- 172.21.15.69:0/554403759 wait complete. 2024-05-14T15:41:56.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.525+0000 7f0f37200640 1 Processor -- start 2024-05-14T15:41:56.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.525+0000 7f0f37200640 1 -- start start 2024-05-14T15:41:56.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.526+0000 7f0f37200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f38106440 0x7f0f3819c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:56.527 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.526+0000 7f0f37200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f3810bcf0 0x7f0f3819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:56.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.526+0000 7f0f37200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f3810c190 0x7f0f381a0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:56.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.526+0000 7f0f37200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f0f38115de0 con 0x7f0f38106440 2024-05-14T15:41:56.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.526+0000 7f0f37200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f0f38115c60 con 0x7f0f3810bcf0 2024-05-14T15:41:56.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.526+0000 7f0f37200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f0f38115f60 con 0x7f0f3810c190 2024-05-14T15:41:56.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.526+0000 7f0f35e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f38106440 0x7f0f3819c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:56.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.526+0000 7f0f35e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f38106440 0x7f0f3819c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33148/0 (socket says 172.21.15.69:33148) 2024-05-14T15:41:56.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.526+0000 7f0f35e00640 1 -- 172.21.15.69:0/407436137 learned_addr learned my addr 172.21.15.69:0/407436137 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:56.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.526+0000 7f0f35400640 1 --2- 172.21.15.69:0/407436137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f3810bcf0 0x7f0f3819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:56.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.527+0000 7f0f35e00640 1 -- 172.21.15.69:0/407436137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f3810c190 msgr2=0x7f0f381a0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:56.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.527+0000 7f0f35e00640 1 --2- 172.21.15.69:0/407436137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f3810c190 0x7f0f381a0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:56.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.527+0000 7f0f35e00640 1 -- 172.21.15.69:0/407436137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f3810bcf0 msgr2=0x7f0f3819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:56.528 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.527+0000 7f0f35e00640 1 --2- 172.21.15.69:0/407436137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f3810bcf0 0x7f0f3819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:56.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.527+0000 7f0f35e00640 1 -- 172.21.15.69:0/407436137 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f381a1620 con 0x7f0f38106440 2024-05-14T15:41:56.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.527+0000 7f0f35e00640 1 --2- 172.21.15.69:0/407436137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f38106440 0x7f0f3819c7c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800d770 tx=0x7f0f2800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:56.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.527+0000 7f0f2ea00640 1 -- 172.21.15.69:0/407436137 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f28017070 con 0x7f0f38106440 2024-05-14T15:41:56.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.527+0000 7f0f2ea00640 1 -- 172.21.15.69:0/407436137 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f0f28009c30 con 0x7f0f38106440 2024-05-14T15:41:56.529 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.527+0000 7f0f37200640 1 -- 172.21.15.69:0/407436137 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f381a1910 con 0x7f0f38106440 2024-05-14T15:41:56.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.527+0000 7f0f2ea00640 1 -- 172.21.15.69:0/407436137 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f2800f620 con 0x7f0f38106440 2024-05-14T15:41:56.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.527+0000 7f0f37200640 1 -- 172.21.15.69:0/407436137 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f381a9290 con 0x7f0f38106440 2024-05-14T15:41:56.530 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.529+0000 7f0f37200640 1 -- 172.21.15.69:0/407436137 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f38050870 con 0x7f0f38106440 2024-05-14T15:41:56.532 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.531+0000 7f0f2ea00640 1 -- 172.21.15.69:0/407436137 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f0f2801a070 con 0x7f0f38106440 2024-05-14T15:41:56.534 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.534+0000 7f0f2ea00640 1 --2- 172.21.15.69:0/407436137 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f1c0b2950 0x7f0f1c0b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:56.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.534+0000 7f0f2ea00640 1 -- 172.21.15.69:0/407436137 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9554+0+0 (secure 0 0 0) 0x7f0f280e2670 con 0x7f0f38106440 2024-05-14T15:41:56.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.534+0000 7f0f35400640 1 --2- 172.21.15.69:0/407436137 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f1c0b2950 0x7f0f1c0b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:56.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.535+0000 7f0f35400640 1 --2- 172.21.15.69:0/407436137 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f1c0b2950 0x7f0f1c0b4e60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0f3810adc0 tx=0x7f0f2400c440 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:56.538 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.538+0000 7f0f2ea00640 1 -- 172.21.15.69:0/407436137 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f0f28009de0 con 0x7f0f38106440 2024-05-14T15:41:56.769 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.768+0000 7f0f37200640 1 -- 172.21.15.69:0/407436137 --> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f0f3810de70 con 0x7f0f1c0b2950 2024-05-14T15:41:56.786 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.785+0000 7f0f2ea00640 1 -- 172.21.15.69:0/407436137 <== mgr.34991 v2:172.21.15.69:6800/1271399048 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+351 (secure 0 0 0) 0x7f0f2400ea70 con 0x7f0f1c0b2950 2024-05-14T15:41:56.786 INFO:teuthology.orchestra.run.smithi069.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-05-14T00:00:00", "created": "2024-05-14T15:21:56", "first": "2024-05-14T15:22:00", "last": "2024-05-14T15:41:01", "last_pruned": "2024-05-14T15:41:01", "created_count": 20, "pruned_count": 14, "active": true} 2024-05-14T15:41:56.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.788+0000 7f0f37200640 1 -- 172.21.15.69:0/407436137 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f1c0b2950 msgr2=0x7f0f1c0b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:56.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.788+0000 7f0f37200640 1 --2- 172.21.15.69:0/407436137 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f1c0b2950 0x7f0f1c0b4e60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f0f3810adc0 tx=0x7f0f2400c440 comp rx=0 tx=0).stop 2024-05-14T15:41:56.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.789+0000 7f0f37200640 1 -- 172.21.15.69:0/407436137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f38106440 msgr2=0x7f0f3819c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:56.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.789+0000 7f0f37200640 1 --2- 172.21.15.69:0/407436137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f38106440 0x7f0f3819c7c0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f0f2800d770 tx=0x7f0f2800dc30 comp rx=0 tx=0).stop 2024-05-14T15:41:56.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.789+0000 7f0f37200640 1 -- 172.21.15.69:0/407436137 shutdown_connections 2024-05-14T15:41:56.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.789+0000 7f0f37200640 1 --2- 172.21.15.69:0/407436137 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f0f1c0b2950 0x7f0f1c0b4e60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:56.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.789+0000 7f0f37200640 1 --2- 172.21.15.69:0/407436137 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f0f3810c190 0x7f0f381a0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:56.790 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.789+0000 7f0f37200640 1 --2- 172.21.15.69:0/407436137 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f0f3810bcf0 0x7f0f3819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:56.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.789+0000 7f0f37200640 1 --2- 172.21.15.69:0/407436137 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f0f38106440 0x7f0f3819c7c0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:56.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.789+0000 7f0f37200640 1 -- 172.21.15.69:0/407436137 >> 172.21.15.69:0/407436137 conn(0x7f0f38101390 msgr2=0x7f0f38103ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:56.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.789+0000 7f0f37200640 1 -- 172.21.15.69:0/407436137 shutdown_connections 2024-05-14T15:41:56.791 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:56.789+0000 7f0f37200640 1 -- 172.21.15.69:0/407436137 wait complete. 2024-05-14T15:41:56.816 DEBUG:teuthology.orchestra.run.smithi069:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-05-14T15:41:57.089 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.088+0000 7f9ed0a00640 1 -- 172.21.15.69:0/623626474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc10bcf0 msgr2=0x7f9ecc105890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:57.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.088+0000 7f9ed0a00640 1 --2- 172.21.15.69:0/623626474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc10bcf0 0x7f9ecc105890 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc009900 tx=0x7f9ebc02a410 comp rx=0 tx=0).stop 2024-05-14T15:41:57.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.088+0000 7f9ed0a00640 1 -- 172.21.15.69:0/623626474 shutdown_connections 2024-05-14T15:41:57.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.089+0000 7f9ed0a00640 1 --2- 172.21.15.69:0/623626474 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ecc106440 0x7f9ecc112810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.089+0000 7f9ed0a00640 1 --2- 172.21.15.69:0/623626474 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ecc10c190 0x7f9ecc105dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.089+0000 7f9ed0a00640 1 --2- 172.21.15.69:0/623626474 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc10bcf0 0x7f9ecc105890 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.089+0000 7f9ed0a00640 1 -- 172.21.15.69:0/623626474 >> 172.21.15.69:0/623626474 conn(0x7f9ecc101390 msgr2=0x7f9ecc1037e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:57.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.089+0000 7f9ed0a00640 1 -- 172.21.15.69:0/623626474 shutdown_connections 2024-05-14T15:41:57.090 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.089+0000 7f9ed0a00640 1 -- 172.21.15.69:0/623626474 wait complete. 2024-05-14T15:41:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.090+0000 7f9ed0a00640 1 Processor -- start 2024-05-14T15:41:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.090+0000 7f9ed0a00640 1 -- start start 2024-05-14T15:41:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.090+0000 7f9ed0a00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ecc106440 0x7f9ecc1a2550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.090+0000 7f9ed0a00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc10bcf0 0x7f9ecc1a2a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.091+0000 7f9ed0a00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ecc10c190 0x7f9ecc19c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.091+0000 7f9ed0a00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc115df0 con 0x7f9ecc10bcf0 2024-05-14T15:41:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.091+0000 7f9ed0a00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc115c70 con 0x7f9ecc10c190 2024-05-14T15:41:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.091+0000 7f9ed0a00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f9ecc115f70 con 0x7f9ecc106440 2024-05-14T15:41:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.091+0000 7f9ec9e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc10bcf0 0x7f9ecc1a2a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:57.093 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.091+0000 7f9ec9e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc10bcf0 0x7f9ecc1a2a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33174/0 (socket says 172.21.15.69:33174) 2024-05-14T15:41:57.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.091+0000 7f9ec9e00640 1 -- 172.21.15.69:0/2132995284 learned_addr learned my addr 172.21.15.69:0/2132995284 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:57.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.091+0000 7f9eca800640 1 --2- 172.21.15.69:0/2132995284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ecc106440 0x7f9ecc1a2550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:57.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.091+0000 7f9ecb200640 1 --2- 172.21.15.69:0/2132995284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ecc10c190 0x7f9ecc19c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:57.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.091+0000 7f9ec9e00640 1 -- 172.21.15.69:0/2132995284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ecc106440 msgr2=0x7f9ecc1a2550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:57.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.091+0000 7f9ec9e00640 1 --2- 172.21.15.69:0/2132995284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ecc106440 0x7f9ecc1a2550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.091+0000 7f9ec9e00640 1 -- 172.21.15.69:0/2132995284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ecc10c190 msgr2=0x7f9ecc19c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:57.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.091+0000 7f9ec9e00640 1 --2- 172.21.15.69:0/2132995284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ecc10c190 0x7f9ecc19c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.091+0000 7f9ec9e00640 1 -- 172.21.15.69:0/2132995284 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ecc19ce00 con 0x7f9ecc10bcf0 2024-05-14T15:41:57.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.092+0000 7f9ec9e00640 1 --2- 172.21.15.69:0/2132995284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc10bcf0 0x7f9ecc1a2a90 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8005d00 tx=0x7f9eb800dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:57.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.092+0000 7f9ec3400640 1 -- 172.21.15.69:0/2132995284 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb8017070 con 0x7f9ecc10bcf0 2024-05-14T15:41:57.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.092+0000 7f9ec3400640 1 -- 172.21.15.69:0/2132995284 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f9eb8009c30 con 0x7f9ecc10bcf0 2024-05-14T15:41:57.094 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.092+0000 7f9ed0a00640 1 -- 172.21.15.69:0/2132995284 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ecc19d090 con 0x7f9ecc10bcf0 2024-05-14T15:41:57.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.092+0000 7f9ec3400640 1 -- 172.21.15.69:0/2132995284 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9eb800f620 con 0x7f9ecc10bcf0 2024-05-14T15:41:57.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.092+0000 7f9ed0a00640 1 -- 172.21.15.69:0/2132995284 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ecc1a92f0 con 0x7f9ecc10bcf0 2024-05-14T15:41:57.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:56 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:41:57.095 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.093+0000 7f9ed0a00640 1 -- 172.21.15.69:0/2132995284 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ecc106fd0 con 0x7f9ecc10bcf0 2024-05-14T15:41:57.096 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.096+0000 7f9ec3400640 1 -- 172.21.15.69:0/2132995284 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f9eb801a070 con 0x7f9ecc10bcf0 2024-05-14T15:41:57.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.098+0000 7f9ec3400640 1 --2- 172.21.15.69:0/2132995284 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9eb00b2950 0x7f9eb00b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:57.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.099+0000 7f9ec3400640 1 -- 172.21.15.69:0/2132995284 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9554+0+0 (secure 0 0 0) 0x7f9eb80e24c0 con 0x7f9ecc10bcf0 2024-05-14T15:41:57.099 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.099+0000 7f9eca800640 1 --2- 172.21.15.69:0/2132995284 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9eb00b2950 0x7f9eb00b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:57.100 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.099+0000 7f9eca800640 1 --2- 172.21.15.69:0/2132995284 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9eb00b2950 0x7f9eb00b4e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0057c0 tx=0x7f9ebc000bc0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:57.102 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.101+0000 7f9ec3400640 1 -- 172.21.15.69:0/2132995284 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f9eb8009de0 con 0x7f9ecc10bcf0 2024-05-14T15:41:57.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:56 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:41:57.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:56 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:41:57.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.335+0000 7f9ed0a00640 1 -- 172.21.15.69:0/2132995284 --> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f9ecc103a30 con 0x7f9eb00b2950 2024-05-14T15:41:57.355 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.354+0000 7f9ec3400640 1 -- 172.21.15.69:0/2132995284 <== mgr.34991 v2:172.21.15.69:6800/1271399048 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f9ecc103a30 con 0x7f9eb00b2950 2024-05-14T15:41:57.355 INFO:teuthology.orchestra.run.smithi069.stdout:/ 1m 6m3h 2024-05-14T15:41:57.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.357+0000 7f9ed0a00640 1 -- 172.21.15.69:0/2132995284 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9eb00b2950 msgr2=0x7f9eb00b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:57.358 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.357+0000 7f9ed0a00640 1 --2- 172.21.15.69:0/2132995284 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9eb00b2950 0x7f9eb00b4e60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f9ebc0057c0 tx=0x7f9ebc000bc0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.357+0000 7f9ed0a00640 1 -- 172.21.15.69:0/2132995284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc10bcf0 msgr2=0x7f9ecc1a2a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:57.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.357+0000 7f9ed0a00640 1 --2- 172.21.15.69:0/2132995284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc10bcf0 0x7f9ecc1a2a90 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f9eb8005d00 tx=0x7f9eb800dde0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.357+0000 7f9ed0a00640 1 -- 172.21.15.69:0/2132995284 shutdown_connections 2024-05-14T15:41:57.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.357+0000 7f9ed0a00640 1 --2- 172.21.15.69:0/2132995284 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f9eb00b2950 0x7f9eb00b4e60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.357+0000 7f9ed0a00640 1 --2- 172.21.15.69:0/2132995284 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f9ecc10c190 0x7f9ecc19c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.357+0000 7f9ed0a00640 1 --2- 172.21.15.69:0/2132995284 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f9ecc10bcf0 0x7f9ecc1a2a90 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.357+0000 7f9ed0a00640 1 --2- 172.21.15.69:0/2132995284 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f9ecc106440 0x7f9ecc1a2550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.357+0000 7f9ed0a00640 1 -- 172.21.15.69:0/2132995284 >> 172.21.15.69:0/2132995284 conn(0x7f9ecc101390 msgr2=0x7f9ecc103320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:57.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.357+0000 7f9ed0a00640 1 -- 172.21.15.69:0/2132995284 shutdown_connections 2024-05-14T15:41:57.359 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.358+0000 7f9ed0a00640 1 -- 172.21.15.69:0/2132995284 wait complete. 2024-05-14T15:41:57.384 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-05-14T15:41:57.394 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-05-14T15:41:57.395 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-05-14T15:41:57.395 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-05-14T15:41:57.414 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-14T15:41:57.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.717+0000 7fa05a200640 1 -- 172.21.15.69:0/3299609083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa05410c120 msgr2=0x7fa054105d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:57.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.717+0000 7fa05a200640 1 --2- 172.21.15.69:0/3299609083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa05410c120 0x7fa054105d60 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009900 tx=0x7fa03c02a3f0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.717+0000 7fa05a200640 1 -- 172.21.15.69:0/3299609083 shutdown_connections 2024-05-14T15:41:57.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.717+0000 7fa05a200640 1 --2- 172.21.15.69:0/3299609083 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa0541063d0 0x7fa0541127a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.717+0000 7fa05a200640 1 --2- 172.21.15.69:0/3299609083 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa05410c120 0x7fa054105d60 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.717+0000 7fa05a200640 1 --2- 172.21.15.69:0/3299609083 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa05410bc80 0x7fa054105820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.717+0000 7fa05a200640 1 -- 172.21.15.69:0/3299609083 >> 172.21.15.69:0/3299609083 conn(0x7fa05407d5a0 msgr2=0x7fa05407d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:57.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.717+0000 7fa05a200640 1 -- 172.21.15.69:0/3299609083 shutdown_connections 2024-05-14T15:41:57.719 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.717+0000 7fa05a200640 1 -- 172.21.15.69:0/3299609083 wait complete. 2024-05-14T15:41:57.720 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.718+0000 7fa05a200640 1 Processor -- start 2024-05-14T15:41:57.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.719+0000 7fa05a200640 1 -- start start 2024-05-14T15:41:57.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.719+0000 7fa05a200640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0541063d0 0x7fa0541a2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:57.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.719+0000 7fa05a200640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa05410bc80 0x7fa0541a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:57.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.719+0000 7fa05a200640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa05410c120 0x7fa05419c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:57.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.719+0000 7fa05a200640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa054115d20 con 0x7fa05410bc80 2024-05-14T15:41:57.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.719+0000 7fa05a200640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa054115ba0 con 0x7fa05410c120 2024-05-14T15:41:57.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.719+0000 7fa05a200640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa054115ea0 con 0x7fa0541063d0 2024-05-14T15:41:57.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.719+0000 7fa04be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa05410bc80 0x7fa0541a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:57.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.719+0000 7fa04be00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa05410bc80 0x7fa0541a2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33188/0 (socket says 172.21.15.69:33188) 2024-05-14T15:41:57.722 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.719+0000 7fa04be00640 1 -- 172.21.15.69:0/461394683 learned_addr learned my addr 172.21.15.69:0/461394683 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:57.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.720+0000 7fa058e00640 1 --2- 172.21.15.69:0/461394683 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0541063d0 0x7fa0541a2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:57.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.720+0000 7fa059800640 1 --2- 172.21.15.69:0/461394683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa05410c120 0x7fa05419c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:57.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.720+0000 7fa04be00640 1 -- 172.21.15.69:0/461394683 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0541063d0 msgr2=0x7fa0541a2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:57.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.720+0000 7fa04be00640 1 --2- 172.21.15.69:0/461394683 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0541063d0 0x7fa0541a2500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.720+0000 7fa04be00640 1 -- 172.21.15.69:0/461394683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa05410c120 msgr2=0x7fa05419c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:57.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.720+0000 7fa04be00640 1 --2- 172.21.15.69:0/461394683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa05410c120 0x7fa05419c680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.720+0000 7fa04be00640 1 -- 172.21.15.69:0/461394683 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05419cdb0 con 0x7fa05410bc80 2024-05-14T15:41:57.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.720+0000 7fa059800640 1 --2- 172.21.15.69:0/461394683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa05410c120 0x7fa05419c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:41:57.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.720+0000 7fa04be00640 1 --2- 172.21.15.69:0/461394683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa05410bc80 0x7fa0541a2a40 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fa03c005940 tx=0x7fa03c0040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:57.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.720+0000 7fa052000640 1 -- 172.21.15.69:0/461394683 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c03f030 con 0x7fa05410bc80 2024-05-14T15:41:57.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.721+0000 7fa052000640 1 -- 172.21.15.69:0/461394683 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa03c003a80 con 0x7fa05410bc80 2024-05-14T15:41:57.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.721+0000 7fa05a200640 1 -- 172.21.15.69:0/461394683 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa05419cfe0 con 0x7fa05410bc80 2024-05-14T15:41:57.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.721+0000 7fa052000640 1 -- 172.21.15.69:0/461394683 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa03c035070 con 0x7fa05410bc80 2024-05-14T15:41:57.723 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.721+0000 7fa05a200640 1 -- 172.21.15.69:0/461394683 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa05419d4d0 con 0x7fa05410bc80 2024-05-14T15:41:57.724 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.722+0000 7fa05a200640 1 -- 172.21.15.69:0/461394683 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa054106f60 con 0x7fa05410bc80 2024-05-14T15:41:57.725 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.724+0000 7fa052000640 1 -- 172.21.15.69:0/461394683 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa03c042030 con 0x7fa05410bc80 2024-05-14T15:41:57.726 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.726+0000 7fa052000640 1 --2- 172.21.15.69:0/461394683 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa0380b2950 0x7fa0380b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:57.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.726+0000 7fa052000640 1 -- 172.21.15.69:0/461394683 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9554+0+0 (secure 0 0 0) 0x7fa03c103450 con 0x7fa05410bc80 2024-05-14T15:41:57.727 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.726+0000 7fa058e00640 1 --2- 172.21.15.69:0/461394683 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa0380b2950 0x7fa0380b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:57.728 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.727+0000 7fa058e00640 1 --2- 172.21.15.69:0/461394683 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa0380b2950 0x7fa0380b4e60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa044005d90 tx=0x7fa044005d20 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:57.730 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.730+0000 7fa052000640 1 -- 172.21.15.69:0/461394683 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa03c0caa20 con 0x7fa05410bc80 2024-05-14T15:41:57.928 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.927+0000 7fa05a200640 1 -- 172.21.15.69:0/461394683 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa05406a160 con 0x7fa05410bc80 2024-05-14T15:41:57.932 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.931+0000 7fa052000640 1 -- 172.21.15.69:0/461394683 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) ==== 74+0+25425 (secure 0 0 0) 0x7fa03c0ca320 con 0x7fa05410bc80 2024-05-14T15:41:57.933 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:41:57.933 INFO:teuthology.orchestra.run.smithi069.stdout:{"epoch":122,"fsid":"1cc2580e-1203-11ef-bc98-c7b262605968","created":"2024-05-14T15:04:32.074994+0000","modified":"2024-05-14T15:41:20.041841+0000","last_up_change":"2024-05-14T15:14:44.049523+0000","last_in_change":"2024-05-14T15:14:16.752653+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-14T15:09:03.561841+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-14T15:16:02.641690+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"80","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-14T15:16:06.949687+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":35,"snap_epoch":121,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-14T15:16:20.891122+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":35,"snap_epoch":121,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"8640de99-c23a-494e-a100-aafd04fe1867","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6802","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6803","nonce":301095601}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6804","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6805","nonce":301095601}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6808","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6809","nonce":301095601}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6806","nonce":301095601},{"type":"v1","addr":"172.21.15.69:6807","nonce":301095601}]},"public_addr":"172.21.15.69:6803/301095601","cluster_addr":"172.21.15.69:6805/301095601","heartbeat_back_addr":"172.21.15.69:6809/301095601","heartbeat_front_addr":"172.21.15.69:6807/301095601","state":["exists","up"]},{"osd":1,"uuid":"89f78a32-7afb-49f3-9287-5478a1cc8829","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6800","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6801","nonce":2774122776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6802","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6803","nonce":2774122776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6806","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6807","nonce":2774122776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6804","nonce":2774122776},{"type":"v1","addr":"172.21.15.92:6805","nonce":2774122776}]},"public_addr":"172.21.15.92:6801/2774122776","cluster_addr":"172.21.15.92:6803/2774122776","heartbeat_back_addr":"172.21.15.92:6807/2774122776","heartbeat_front_addr":"172.21.15.92:6805/2774122776","state":["exists","up"]},{"osd":2,"uuid":"a38ef5c4-3a1a-4d68-be5f-5ed30c0b1151","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6800","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6801","nonce":2836920513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6802","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6803","nonce":2836920513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6806","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6807","nonce":2836920513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6804","nonce":2836920513},{"type":"v1","addr":"172.21.15.203:6805","nonce":2836920513}]},"public_addr":"172.21.15.203:6801/2836920513","cluster_addr":"172.21.15.203:6803/2836920513","heartbeat_back_addr":"172.21.15.203:6807/2836920513","heartbeat_front_addr":"172.21.15.203:6805/2836920513","state":["exists","up"]},{"osd":3,"uuid":"81409850-de26-4520-972c-31a716adf4cf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6810","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6811","nonce":680308620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6812","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6813","nonce":680308620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6816","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6817","nonce":680308620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6814","nonce":680308620},{"type":"v1","addr":"172.21.15.69:6815","nonce":680308620}]},"public_addr":"172.21.15.69:6811/680308620","cluster_addr":"172.21.15.69:6813/680308620","heartbeat_back_addr":"172.21.15.69:6817/680308620","heartbeat_front_addr":"172.21.15.69:6815/680308620","state":["exists","up"]},{"osd":4,"uuid":"9aa3a6b0-cc63-4eae-8416-8ab630994985","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6808","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6809","nonce":1071971048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6810","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6811","nonce":1071971048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6814","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6815","nonce":1071971048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6812","nonce":1071971048},{"type":"v1","addr":"172.21.15.92:6813","nonce":1071971048}]},"public_addr":"172.21.15.92:6809/1071971048","cluster_addr":"172.21.15.92:6811/1071971048","heartbeat_back_addr":"172.21.15.92:6815/1071971048","heartbeat_front_addr":"172.21.15.92:6813/1071971048","state":["exists","up"]},{"osd":5,"uuid":"f7fcde57-e280-494b-a45f-8fa007ed9ee9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6808","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6809","nonce":1404230851}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6810","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6811","nonce":1404230851}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6814","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6815","nonce":1404230851}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6812","nonce":1404230851},{"type":"v1","addr":"172.21.15.203:6813","nonce":1404230851}]},"public_addr":"172.21.15.203:6809/1404230851","cluster_addr":"172.21.15.203:6811/1404230851","heartbeat_back_addr":"172.21.15.203:6815/1404230851","heartbeat_front_addr":"172.21.15.203:6813/1404230851","state":["exists","up"]},{"osd":6,"uuid":"86f1373a-3b39-4a7f-b14c-9bf8695c6b91","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6818","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6819","nonce":1213427819}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6820","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6821","nonce":1213427819}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6824","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6825","nonce":1213427819}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6822","nonce":1213427819},{"type":"v1","addr":"172.21.15.69:6823","nonce":1213427819}]},"public_addr":"172.21.15.69:6819/1213427819","cluster_addr":"172.21.15.69:6821/1213427819","heartbeat_back_addr":"172.21.15.69:6825/1213427819","heartbeat_front_addr":"172.21.15.69:6823/1213427819","state":["exists","up"]},{"osd":7,"uuid":"e790fbf1-3e34-4950-bdfa-cf1adbd451c0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6816","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6817","nonce":4274774582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6818","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6819","nonce":4274774582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6822","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6823","nonce":4274774582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6820","nonce":4274774582},{"type":"v1","addr":"172.21.15.92:6821","nonce":4274774582}]},"public_addr":"172.21.15.92:6817/4274774582","cluster_addr":"172.21.15.92:6819/4274774582","heartbeat_back_addr":"172.21.15.92:6823/4274774582","heartbeat_front_addr":"172.21.15.92:6821/4274774582","state":["exists","up"]},{"osd":8,"uuid":"65019fee-6b18-4d13-841a-2e3acb51f180","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6816","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6817","nonce":2480959249}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6818","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6819","nonce":2480959249}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6822","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6823","nonce":2480959249}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6820","nonce":2480959249},{"type":"v1","addr":"172.21.15.203:6821","nonce":2480959249}]},"public_addr":"172.21.15.203:6817/2480959249","cluster_addr":"172.21.15.203:6819/2480959249","heartbeat_back_addr":"172.21.15.203:6823/2480959249","heartbeat_front_addr":"172.21.15.203:6821/2480959249","state":["exists","up"]},{"osd":9,"uuid":"b5ecc3d1-2bdd-4856-8a46-e4e2d52970fa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":61,"up_thru":90,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6826","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6827","nonce":2649966866}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6828","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6829","nonce":2649966866}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6832","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6833","nonce":2649966866}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.69:6830","nonce":2649966866},{"type":"v1","addr":"172.21.15.69:6831","nonce":2649966866}]},"public_addr":"172.21.15.69:6827/2649966866","cluster_addr":"172.21.15.69:6829/2649966866","heartbeat_back_addr":"172.21.15.69:6833/2649966866","heartbeat_front_addr":"172.21.15.69:6831/2649966866","state":["exists","up"]},{"osd":10,"uuid":"45287823-f7ea-431f-ac01-a72762b01a9f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":66,"up_thru":77,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6824","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6825","nonce":3650822776}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6826","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6827","nonce":3650822776}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6830","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6831","nonce":3650822776}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.92:6828","nonce":3650822776},{"type":"v1","addr":"172.21.15.92:6829","nonce":3650822776}]},"public_addr":"172.21.15.92:6825/3650822776","cluster_addr":"172.21.15.92:6827/3650822776","heartbeat_back_addr":"172.21.15.92:6831/3650822776","heartbeat_front_addr":"172.21.15.92:6829/3650822776","state":["exists","up"]},{"osd":11,"uuid":"2f3a10f9-2414-4151-b1cf-3db68b2a66fb","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":72,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6824","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6825","nonce":2590258806}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6826","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6827","nonce":2590258806}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6830","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6831","nonce":2590258806}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.203:6828","nonce":2590258806},{"type":"v1","addr":"172.21.15.203:6829","nonce":2590258806}]},"public_addr":"172.21.15.203:6825/2590258806","cluster_addr":"172.21.15.203:6827/2590258806","heartbeat_back_addr":"172.21.15.203:6831/2590258806","heartbeat_front_addr":"172.21.15.203:6829/2590258806","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:07:50.047712+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:08:25.223293+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:01.269713+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:09:38.679607+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:16.161314+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:10:53.323450+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:11:31.930106+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:10.173015+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:12:48.056752+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:13:25.780142+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:03.705208+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-14T15:14:41.267371+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.8","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.0","mappings":[{"from":4,"to":6}]},{"pgid":"3.c","mappings":[{"from":3,"to":9}]},{"pgid":"3.14","mappings":[{"from":1,"to":9}]},{"pgid":"3.28","mappings":[{"from":5,"to":7}]},{"pgid":"3.2a","mappings":[{"from":3,"to":8}]},{"pgid":"3.2c","mappings":[{"from":4,"to":9}]},{"pgid":"3.31","mappings":[{"from":4,"to":8}]},{"pgid":"3.38","mappings":[{"from":5,"to":6}]},{"pgid":"4.b","mappings":[{"from":9,"to":8}]},{"pgid":"4.f","mappings":[{"from":9,"to":8}]},{"pgid":"4.16","mappings":[{"from":9,"to":10}]},{"pgid":"4.1a","mappings":[{"from":5,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.69:0/979899385":"2024-05-15T15:21:37.785013+0000","172.21.15.69:0/3660048780":"2024-05-15T15:21:37.785013+0000","172.21.15.69:0/151981233":"2024-05-15T15:05:41.383453+0000","172.21.15.69:0/3776172313":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/2537958790":"2024-05-15T15:21:37.785013+0000","172.21.15.69:0/3403928589":"2024-05-15T15:21:37.785013+0000","172.21.15.69:0/1288620257":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/2718114316":"2024-05-15T15:05:41.383453+0000","172.21.15.69:6801/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/865506483":"2024-05-15T15:21:37.785013+0000","172.21.15.69:0/1655882616":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/4183332474":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/586229880":"2024-05-15T15:05:06.373096+0000","172.21.15.69:0/2806878946":"2024-05-15T15:05:06.373096+0000","172.21.15.69:6800/2537958790":"2024-05-15T15:21:37.785013+0000","172.21.15.69:6800/2718114316":"2024-05-15T15:05:41.383453+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":22,"length":1},{"begin":35,"length":1}]},{"pool":4,"snaps":[{"begin":22,"length":1},{"begin":35,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-14T15:41:57.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.934+0000 7fa05a200640 1 -- 172.21.15.69:0/461394683 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa0380b2950 msgr2=0x7fa0380b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:57.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.934+0000 7fa05a200640 1 --2- 172.21.15.69:0/461394683 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa0380b2950 0x7fa0380b4e60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fa044005d90 tx=0x7fa044005d20 comp rx=0 tx=0).stop 2024-05-14T15:41:57.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.934+0000 7fa05a200640 1 -- 172.21.15.69:0/461394683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa05410bc80 msgr2=0x7fa0541a2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:57.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.934+0000 7fa05a200640 1 --2- 172.21.15.69:0/461394683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa05410bc80 0x7fa0541a2a40 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fa03c005940 tx=0x7fa03c0040e0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.934+0000 7fa05a200640 1 -- 172.21.15.69:0/461394683 shutdown_connections 2024-05-14T15:41:57.935 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.934+0000 7fa05a200640 1 --2- 172.21.15.69:0/461394683 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa0380b2950 0x7fa0380b4e60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.934+0000 7fa05a200640 1 --2- 172.21.15.69:0/461394683 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa05410c120 0x7fa05419c680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.934+0000 7fa05a200640 1 --2- 172.21.15.69:0/461394683 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa05410bc80 0x7fa0541a2a40 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.934+0000 7fa05a200640 1 --2- 172.21.15.69:0/461394683 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa0541063d0 0x7fa0541a2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:57.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.934+0000 7fa05a200640 1 -- 172.21.15.69:0/461394683 >> 172.21.15.69:0/461394683 conn(0x7fa05407d5a0 msgr2=0x7fa054104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:57.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.934+0000 7fa05a200640 1 -- 172.21.15.69:0/461394683 shutdown_connections 2024-05-14T15:41:57.936 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:57.934+0000 7fa05a200640 1 -- 172.21.15.69:0/461394683 wait complete. 2024-05-14T15:41:57.963 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-14T15:09:03.561841+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-05-14T15:16:02.641690+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '80', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-05-14T15:16:06.949687+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 35, 'snap_epoch': 121, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-05-14T15:16:20.891122+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 35, 'snap_epoch': 121, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-05-14T15:41:57.964 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-05-14T15:41:58.028 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:57 smithi069 ceph-mon[31270]: pgmap v642: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 79 KiB/s wr, 33 op/s 2024-05-14T15:41:58.028 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:57 smithi069 ceph-mon[31270]: from='client.17625 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:41:58.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:57 smithi203 ceph-mon[34567]: pgmap v642: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 79 KiB/s wr, 33 op/s 2024-05-14T15:41:58.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:57 smithi203 ceph-mon[34567]: from='client.17625 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:41:58.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:57 smithi092 ceph-mon[34729]: pgmap v642: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 79 KiB/s rd, 79 KiB/s wr, 33 op/s 2024-05-14T15:41:58.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:57 smithi092 ceph-mon[34729]: from='client.17625 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:41:58.227 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.226+0000 7fa92fe00640 1 -- 172.21.15.69:0/780269941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa93010bc80 msgr2=0x7fa930105820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:58.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.226+0000 7fa92fe00640 1 --2- 172.21.15.69:0/780269941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa93010bc80 0x7fa930105820 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fa920009900 tx=0x7fa92002a410 comp rx=0 tx=0).stop 2024-05-14T15:41:58.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.226+0000 7fa92fe00640 1 -- 172.21.15.69:0/780269941 shutdown_connections 2024-05-14T15:41:58.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.226+0000 7fa92fe00640 1 --2- 172.21.15.69:0/780269941 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9301063d0 0x7fa9301127a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.226+0000 7fa92fe00640 1 --2- 172.21.15.69:0/780269941 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa93010c120 0x7fa930105d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.226+0000 7fa92fe00640 1 --2- 172.21.15.69:0/780269941 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa93010bc80 0x7fa930105820 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.227+0000 7fa92fe00640 1 -- 172.21.15.69:0/780269941 >> 172.21.15.69:0/780269941 conn(0x7fa93007d5a0 msgr2=0x7fa93007d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:58.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.227+0000 7fa92fe00640 1 -- 172.21.15.69:0/780269941 shutdown_connections 2024-05-14T15:41:58.228 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.227+0000 7fa92fe00640 1 -- 172.21.15.69:0/780269941 wait complete. 2024-05-14T15:41:58.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.228+0000 7fa92fe00640 1 Processor -- start 2024-05-14T15:41:58.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.228+0000 7fa92fe00640 1 -- start start 2024-05-14T15:41:58.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.228+0000 7fa92fe00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9301063d0 0x7fa9301a2500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:58.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.228+0000 7fa92fe00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa93010bc80 0x7fa9301a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:58.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.228+0000 7fa92fe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa93010c120 0x7fa93019c680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:58.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.228+0000 7fa92fe00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fa930115d20 con 0x7fa93010c120 2024-05-14T15:41:58.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.228+0000 7fa92fe00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fa930115ba0 con 0x7fa93010bc80 2024-05-14T15:41:58.229 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.228+0000 7fa92fe00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fa930115ea0 con 0x7fa9301063d0 2024-05-14T15:41:58.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.228+0000 7fa92f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa93010c120 0x7fa93019c680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:58.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.228+0000 7fa92f400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa93010c120 0x7fa93019c680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33208/0 (socket says 172.21.15.69:33208) 2024-05-14T15:41:58.230 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.228+0000 7fa92f400640 1 -- 172.21.15.69:0/3381543499 learned_addr learned my addr 172.21.15.69:0/3381543499 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:58.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.229+0000 7fa92e000640 1 --2- 172.21.15.69:0/3381543499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa93010bc80 0x7fa9301a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:58.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.229+0000 7fa92f400640 1 -- 172.21.15.69:0/3381543499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9301063d0 msgr2=0x7fa9301a2500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:58.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.229+0000 7fa92f400640 1 --2- 172.21.15.69:0/3381543499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9301063d0 0x7fa9301a2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.229+0000 7fa92f400640 1 -- 172.21.15.69:0/3381543499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa93010bc80 msgr2=0x7fa9301a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:58.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.229+0000 7fa92f400640 1 --2- 172.21.15.69:0/3381543499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa93010bc80 0x7fa9301a2a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.229+0000 7fa92f400640 1 -- 172.21.15.69:0/3381543499 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa93019cdb0 con 0x7fa93010c120 2024-05-14T15:41:58.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.229+0000 7fa92f400640 1 --2- 172.21.15.69:0/3381543499 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa93010c120 0x7fa93019c680 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa92800cad0 tx=0x7fa92800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:58.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.229+0000 7fa927400640 1 -- 172.21.15.69:0/3381543499 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92800ae20 con 0x7fa93010c120 2024-05-14T15:41:58.231 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.229+0000 7fa927400640 1 -- 172.21.15.69:0/3381543499 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fa928005020 con 0x7fa93010c120 2024-05-14T15:41:58.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.229+0000 7fa92fe00640 1 -- 172.21.15.69:0/3381543499 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa93019d040 con 0x7fa93010c120 2024-05-14T15:41:58.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.229+0000 7fa927400640 1 -- 172.21.15.69:0/3381543499 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa92800f6b0 con 0x7fa93010c120 2024-05-14T15:41:58.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.229+0000 7fa92fe00640 1 -- 172.21.15.69:0/3381543499 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9301a92a0 con 0x7fa93010c120 2024-05-14T15:41:58.232 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.231+0000 7fa92fe00640 1 -- 172.21.15.69:0/3381543499 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa930106f60 con 0x7fa93010c120 2024-05-14T15:41:58.233 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.233+0000 7fa927400640 1 -- 172.21.15.69:0/3381543499 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fa9280051d0 con 0x7fa93010c120 2024-05-14T15:41:58.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.234+0000 7fa927400640 1 --2- 172.21.15.69:0/3381543499 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa9140b2950 0x7fa9140b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:58.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.235+0000 7fa927400640 1 -- 172.21.15.69:0/3381543499 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9554+0+0 (secure 0 0 0) 0x7fa9280e2f00 con 0x7fa93010c120 2024-05-14T15:41:58.235 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.235+0000 7fa92ea00640 1 --2- 172.21.15.69:0/3381543499 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa9140b2950 0x7fa9140b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:58.236 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.235+0000 7fa92ea00640 1 --2- 172.21.15.69:0/3381543499 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa9140b2950 0x7fa9140b4e60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa92002a930 tx=0x7fa920000bc0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:58.237 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.237+0000 7fa927400640 1 -- 172.21.15.69:0/3381543499 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fa928014030 con 0x7fa93010c120 2024-05-14T15:41:58.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.446+0000 7fa92fe00640 1 -- 172.21.15.69:0/3381543499 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa93002dc30 con 0x7fa93010c120 2024-05-14T15:41:58.448 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.447+0000 7fa927400640 1 -- 172.21.15.69:0/3381543499 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v122) ==== 93+0+10 (secure 0 0 0) 0x7fa9280aa470 con 0x7fa93010c120 2024-05-14T15:41:58.448 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 1 2024-05-14T15:41:58.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.450+0000 7fa92fe00640 1 -- 172.21.15.69:0/3381543499 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa9140b2950 msgr2=0x7fa9140b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:58.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.450+0000 7fa92fe00640 1 --2- 172.21.15.69:0/3381543499 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa9140b2950 0x7fa9140b4e60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fa92002a930 tx=0x7fa920000bc0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.450+0000 7fa92fe00640 1 -- 172.21.15.69:0/3381543499 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa93010c120 msgr2=0x7fa93019c680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:58.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.450+0000 7fa92fe00640 1 --2- 172.21.15.69:0/3381543499 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa93010c120 0x7fa93019c680 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7fa92800cad0 tx=0x7fa92800cf90 comp rx=0 tx=0).stop 2024-05-14T15:41:58.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.450+0000 7fa92fe00640 1 -- 172.21.15.69:0/3381543499 shutdown_connections 2024-05-14T15:41:58.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.450+0000 7fa92fe00640 1 --2- 172.21.15.69:0/3381543499 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fa9140b2950 0x7fa9140b4e60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.450+0000 7fa92fe00640 1 --2- 172.21.15.69:0/3381543499 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fa93010c120 0x7fa93019c680 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.450+0000 7fa92fe00640 1 --2- 172.21.15.69:0/3381543499 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fa93010bc80 0x7fa9301a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.450+0000 7fa92fe00640 1 --2- 172.21.15.69:0/3381543499 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fa9301063d0 0x7fa9301a2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.451 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.450+0000 7fa92fe00640 1 -- 172.21.15.69:0/3381543499 >> 172.21.15.69:0/3381543499 conn(0x7fa93007d5a0 msgr2=0x7fa930107320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:58.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.450+0000 7fa92fe00640 1 -- 172.21.15.69:0/3381543499 shutdown_connections 2024-05-14T15:41:58.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.450+0000 7fa92fe00640 1 -- 172.21.15.69:0/3381543499 wait complete. 2024-05-14T15:41:58.479 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-05-14T15:41:58.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.747+0000 7efd9ca00640 1 -- 172.21.15.69:0/2762307551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd9810a2f0 msgr2=0x7efd9810a700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:58.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.747+0000 7efd9ca00640 1 --2- 172.21.15.69:0/2762307551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd9810a2f0 0x7efd9810a700 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7efd80009900 tx=0x7efd8002a410 comp rx=0 tx=0).stop 2024-05-14T15:41:58.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.747+0000 7efd9ca00640 1 -- 172.21.15.69:0/2762307551 shutdown_connections 2024-05-14T15:41:58.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.747+0000 7efd9ca00640 1 --2- 172.21.15.69:0/2762307551 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd9810f340 0x7efd98116ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.747+0000 7efd9ca00640 1 --2- 172.21.15.69:0/2762307551 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd9810e880 0x7efd9810ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.747+0000 7efd9ca00640 1 --2- 172.21.15.69:0/2762307551 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd9810a2f0 0x7efd9810a700 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.747+0000 7efd9ca00640 1 -- 172.21.15.69:0/2762307551 >> 172.21.15.69:0/2762307551 conn(0x7efd98076c90 msgr2=0x7efd980770d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:58.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.747+0000 7efd9ca00640 1 -- 172.21.15.69:0/2762307551 shutdown_connections 2024-05-14T15:41:58.748 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.747+0000 7efd9ca00640 1 -- 172.21.15.69:0/2762307551 wait complete. 2024-05-14T15:41:58.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.748+0000 7efd9ca00640 1 Processor -- start 2024-05-14T15:41:58.749 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.748+0000 7efd9ca00640 1 -- start start 2024-05-14T15:41:58.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.749+0000 7efd9ca00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd9810a2f0 0x7efd981a6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:58.750 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.749+0000 7efd9ca00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd9810e880 0x7efd981a6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:58.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.749+0000 7efd9ca00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd9810f340 0x7efd981a0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:58.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.749+0000 7efd9ca00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7efd9811a150 con 0x7efd9810e880 2024-05-14T15:41:58.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.749+0000 7efd9ca00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7efd98119fd0 con 0x7efd9810a2f0 2024-05-14T15:41:58.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.749+0000 7efd9ca00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7efd9811a2d0 con 0x7efd9810f340 2024-05-14T15:41:58.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.749+0000 7efd95e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd9810e880 0x7efd981a6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:58.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.749+0000 7efd95e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd9810e880 0x7efd981a6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33224/0 (socket says 172.21.15.69:33224) 2024-05-14T15:41:58.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.749+0000 7efd95e00640 1 -- 172.21.15.69:0/1687687920 learned_addr learned my addr 172.21.15.69:0/1687687920 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:58.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.749+0000 7efd96800640 1 --2- 172.21.15.69:0/1687687920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd9810a2f0 0x7efd981a6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:58.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.749+0000 7efd97200640 1 --2- 172.21.15.69:0/1687687920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd9810f340 0x7efd981a0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:58.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.749+0000 7efd95e00640 1 -- 172.21.15.69:0/1687687920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd9810f340 msgr2=0x7efd981a0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:58.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.749+0000 7efd95e00640 1 --2- 172.21.15.69:0/1687687920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd9810f340 0x7efd981a0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.750+0000 7efd95e00640 1 -- 172.21.15.69:0/1687687920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd9810a2f0 msgr2=0x7efd981a6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:58.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.750+0000 7efd95e00640 1 --2- 172.21.15.69:0/1687687920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd9810a2f0 0x7efd981a6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.750+0000 7efd95e00640 1 -- 172.21.15.69:0/1687687920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd981a1030 con 0x7efd9810e880 2024-05-14T15:41:58.751 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.750+0000 7efd95e00640 1 --2- 172.21.15.69:0/1687687920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd9810e880 0x7efd981a6cc0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7efd8800d770 tx=0x7efd8800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:58.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.753+0000 7efd8f400640 1 -- 172.21.15.69:0/1687687920 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd88017070 con 0x7efd9810e880 2024-05-14T15:41:58.753 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.753+0000 7efd8f400640 1 -- 172.21.15.69:0/1687687920 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7efd88009c30 con 0x7efd9810e880 2024-05-14T15:41:58.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.753+0000 7efd9ca00640 1 -- 172.21.15.69:0/1687687920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd981a1320 con 0x7efd9810e880 2024-05-14T15:41:58.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.753+0000 7efd8f400640 1 -- 172.21.15.69:0/1687687920 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd8800f620 con 0x7efd9810e880 2024-05-14T15:41:58.754 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.753+0000 7efd9ca00640 1 -- 172.21.15.69:0/1687687920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd981ad600 con 0x7efd9810e880 2024-05-14T15:41:58.755 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.754+0000 7efd9ca00640 1 -- 172.21.15.69:0/1687687920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd9806a160 con 0x7efd9810e880 2024-05-14T15:41:58.757 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.756+0000 7efd8f400640 1 -- 172.21.15.69:0/1687687920 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7efd8801a070 con 0x7efd9810e880 2024-05-14T15:41:58.758 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.758+0000 7efd8f400640 1 --2- 172.21.15.69:0/1687687920 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7efd7c0b2950 0x7efd7c0b4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:58.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.758+0000 7efd8f400640 1 -- 172.21.15.69:0/1687687920 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9554+0+0 (secure 0 0 0) 0x7efd880e2640 con 0x7efd9810e880 2024-05-14T15:41:58.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.758+0000 7efd96800640 1 --2- 172.21.15.69:0/1687687920 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7efd7c0b2950 0x7efd7c0b4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:58.759 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.759+0000 7efd96800640 1 --2- 172.21.15.69:0/1687687920 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7efd7c0b2950 0x7efd7c0b4e60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efd981a1ad0 tx=0x7efd80000bc0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:58.763 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.762+0000 7efd8f400640 1 -- 172.21.15.69:0/1687687920 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7efd88009de0 con 0x7efd9810e880 2024-05-14T15:41:58.974 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.973+0000 7efd9ca00640 1 -- 172.21.15.69:0/1687687920 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7efd981ad830 con 0x7efd9810e880 2024-05-14T15:41:58.975 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.974+0000 7efd8f400640 1 -- 172.21.15.69:0/1687687920 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v122) ==== 104+0+11 (secure 0 0 0) 0x7efd880a9bb0 con 0x7efd9810e880 2024-05-14T15:41:58.975 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-05-14T15:41:58.978 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.977+0000 7efd9ca00640 1 -- 172.21.15.69:0/1687687920 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7efd7c0b2950 msgr2=0x7efd7c0b4e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:58.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.977+0000 7efd9ca00640 1 --2- 172.21.15.69:0/1687687920 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7efd7c0b2950 0x7efd7c0b4e60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7efd981a1ad0 tx=0x7efd80000bc0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.977+0000 7efd9ca00640 1 -- 172.21.15.69:0/1687687920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd9810e880 msgr2=0x7efd981a6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:58.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.977+0000 7efd9ca00640 1 --2- 172.21.15.69:0/1687687920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd9810e880 0x7efd981a6cc0 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7efd8800d770 tx=0x7efd8800dc30 comp rx=0 tx=0).stop 2024-05-14T15:41:58.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.977+0000 7efd9ca00640 1 -- 172.21.15.69:0/1687687920 shutdown_connections 2024-05-14T15:41:58.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.977+0000 7efd9ca00640 1 --2- 172.21.15.69:0/1687687920 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7efd7c0b2950 0x7efd7c0b4e60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.977+0000 7efd9ca00640 1 --2- 172.21.15.69:0/1687687920 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7efd9810f340 0x7efd981a0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.977+0000 7efd9ca00640 1 --2- 172.21.15.69:0/1687687920 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7efd9810e880 0x7efd981a6cc0 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.977+0000 7efd9ca00640 1 --2- 172.21.15.69:0/1687687920 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7efd9810a2f0 0x7efd981a6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:58.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.977+0000 7efd9ca00640 1 -- 172.21.15.69:0/1687687920 >> 172.21.15.69:0/1687687920 conn(0x7efd98076c90 msgr2=0x7efd98107af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:58.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.978+0000 7efd9ca00640 1 -- 172.21.15.69:0/1687687920 shutdown_connections 2024-05-14T15:41:58.979 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:58.978+0000 7efd9ca00640 1 -- 172.21.15.69:0/1687687920 wait complete. 2024-05-14T15:41:59.007 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-05-14T15:41:59.075 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:58 smithi069 ceph-mon[31270]: from='client.17631 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:41:59.075 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:58 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/461394683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:41:59.075 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:58 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3381543499' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T15:41:59.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:58 smithi203 ceph-mon[34567]: from='client.17631 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:41:59.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:58 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/461394683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:41:59.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:58 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3381543499' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T15:41:59.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:58 smithi092 ceph-mon[34729]: from='client.17631 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-14T15:41:59.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:58 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/461394683' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-14T15:41:59.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:58 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3381543499' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-14T15:41:59.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.287+0000 7f47bd400640 1 -- 172.21.15.69:0/3583164320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b81063f0 msgr2=0x7f47b81127c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:59.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.287+0000 7f47bd400640 1 --2- 172.21.15.69:0/3583164320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b81063f0 0x7f47b81127c0 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009ca0 tx=0x7f47b002a8c0 comp rx=0 tx=0).stop 2024-05-14T15:41:59.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.287+0000 7f47bd400640 1 -- 172.21.15.69:0/3583164320 shutdown_connections 2024-05-14T15:41:59.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.287+0000 7f47bd400640 1 --2- 172.21.15.69:0/3583164320 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b81063f0 0x7f47b81127c0 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:59.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.287+0000 7f47bd400640 1 --2- 172.21.15.69:0/3583164320 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b810c140 0x7f47b8105d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:59.288 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.287+0000 7f47bd400640 1 --2- 172.21.15.69:0/3583164320 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b810bca0 0x7f47b8105840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:59.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.287+0000 7f47bd400640 1 -- 172.21.15.69:0/3583164320 >> 172.21.15.69:0/3583164320 conn(0x7f47b8101370 msgr2=0x7f47b8103790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:59.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.287+0000 7f47bd400640 1 -- 172.21.15.69:0/3583164320 shutdown_connections 2024-05-14T15:41:59.289 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.287+0000 7f47bd400640 1 -- 172.21.15.69:0/3583164320 wait complete. 2024-05-14T15:41:59.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.288+0000 7f47bd400640 1 Processor -- start 2024-05-14T15:41:59.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.288+0000 7f47bd400640 1 -- start start 2024-05-14T15:41:59.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.289+0000 7f47bd400640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b81063f0 0x7f47b819c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:59.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.289+0000 7f47bd400640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b810bca0 0x7f47b819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:59.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.289+0000 7f47bd400640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b810c140 0x7f47b81a0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:59.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.289+0000 7f47bd400640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8115db0 con 0x7f47b810bca0 2024-05-14T15:41:59.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.289+0000 7f47bd400640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8115c30 con 0x7f47b810c140 2024-05-14T15:41:59.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.289+0000 7f47bd400640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f47b8115f30 con 0x7f47b81063f0 2024-05-14T15:41:59.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.289+0000 7f47afe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b810bca0 0x7f47b819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:59.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.289+0000 7f47afe00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b810bca0 0x7f47b819ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33232/0 (socket says 172.21.15.69:33232) 2024-05-14T15:41:59.290 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.289+0000 7f47afe00640 1 -- 172.21.15.69:0/385878324 learned_addr learned my addr 172.21.15.69:0/385878324 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.290+0000 7f47b7e00640 1 --2- 172.21.15.69:0/385878324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b81063f0 0x7f47b819c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.290+0000 7f47afe00640 1 -- 172.21.15.69:0/385878324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b81063f0 msgr2=0x7f47b819c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.290+0000 7f47bca00640 1 --2- 172.21.15.69:0/385878324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b810c140 0x7f47b81a0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.290+0000 7f47afe00640 1 --2- 172.21.15.69:0/385878324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b81063f0 0x7f47b819c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.290+0000 7f47afe00640 1 -- 172.21.15.69:0/385878324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b810c140 msgr2=0x7f47b81a0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.290+0000 7f47afe00640 1 --2- 172.21.15.69:0/385878324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b810c140 0x7f47b81a0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.290+0000 7f47afe00640 1 -- 172.21.15.69:0/385878324 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b81a15f0 con 0x7f47b810bca0 2024-05-14T15:41:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.290+0000 7f47b7e00640 1 --2- 172.21.15.69:0/385878324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b81063f0 0x7f47b819c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:41:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.290+0000 7f47afe00640 1 --2- 172.21.15.69:0/385878324 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b810bca0 0x7f47b819ccf0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f47a0005d00 tx=0x7f47a000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.290+0000 7f47b5600640 1 -- 172.21.15.69:0/385878324 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a0017070 con 0x7f47b810bca0 2024-05-14T15:41:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.290+0000 7f47b5600640 1 -- 172.21.15.69:0/385878324 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f47a0009c30 con 0x7f47b810bca0 2024-05-14T15:41:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.290+0000 7f47b5600640 1 -- 172.21.15.69:0/385878324 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a000f620 con 0x7f47b810bca0 2024-05-14T15:41:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.290+0000 7f47bd400640 1 -- 172.21.15.69:0/385878324 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b81a18e0 con 0x7f47b810bca0 2024-05-14T15:41:59.292 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.291+0000 7f47bd400640 1 -- 172.21.15.69:0/385878324 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b81a1de0 con 0x7f47b810bca0 2024-05-14T15:41:59.293 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.292+0000 7f47bd400640 1 -- 172.21.15.69:0/385878324 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47b806a160 con 0x7f47b810bca0 2024-05-14T15:41:59.296 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.296+0000 7f47b5600640 1 -- 172.21.15.69:0/385878324 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f47a001a070 con 0x7f47b810bca0 2024-05-14T15:41:59.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.298+0000 7f47b5600640 1 --2- 172.21.15.69:0/385878324 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f479c0b29d0 0x7f479c0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:59.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.298+0000 7f47b5600640 1 -- 172.21.15.69:0/385878324 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9554+0+0 (secure 0 0 0) 0x7f47a00e2440 con 0x7f47b810bca0 2024-05-14T15:41:59.299 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.299+0000 7f47b7e00640 1 --2- 172.21.15.69:0/385878324 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f479c0b29d0 0x7f479c0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:59.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.299+0000 7f47b7e00640 1 --2- 172.21.15.69:0/385878324 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f479c0b29d0 0x7f479c0b4ee0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f47b8106980 tx=0x7f47a8005e50 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:59.300 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.300+0000 7f47b5600640 1 -- 172.21.15.69:0/385878324 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f47b81a1de0 con 0x7f47b810bca0 2024-05-14T15:41:59.504 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.504+0000 7f47bd400640 1 -- 172.21.15.69:0/385878324 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f47b810de10 con 0x7f47b810bca0 2024-05-14T15:41:59.505 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.505+0000 7f47b5600640 1 -- 172.21.15.69:0/385878324 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v122) ==== 100+0+11 (secure 0 0 0) 0x7f47a0009de0 con 0x7f47b810bca0 2024-05-14T15:41:59.506 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 64 2024-05-14T15:41:59.508 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.507+0000 7f47bd400640 1 -- 172.21.15.69:0/385878324 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f479c0b29d0 msgr2=0x7f479c0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:59.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.507+0000 7f47bd400640 1 --2- 172.21.15.69:0/385878324 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f479c0b29d0 0x7f479c0b4ee0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f47b8106980 tx=0x7f47a8005e50 comp rx=0 tx=0).stop 2024-05-14T15:41:59.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.507+0000 7f47bd400640 1 -- 172.21.15.69:0/385878324 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b810bca0 msgr2=0x7f47b819ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:59.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.507+0000 7f47bd400640 1 --2- 172.21.15.69:0/385878324 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b810bca0 0x7f47b819ccf0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f47a0005d00 tx=0x7f47a000dde0 comp rx=0 tx=0).stop 2024-05-14T15:41:59.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.508+0000 7f47bd400640 1 -- 172.21.15.69:0/385878324 shutdown_connections 2024-05-14T15:41:59.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.508+0000 7f47bd400640 1 --2- 172.21.15.69:0/385878324 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f479c0b29d0 0x7f479c0b4ee0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:59.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.508+0000 7f47bd400640 1 --2- 172.21.15.69:0/385878324 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f47b810c140 0x7f47b81a0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:59.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.508+0000 7f47bd400640 1 --2- 172.21.15.69:0/385878324 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f47b810bca0 0x7f47b819ccf0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:59.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.508+0000 7f47bd400640 1 --2- 172.21.15.69:0/385878324 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f47b81063f0 0x7f47b819c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:59.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.508+0000 7f47bd400640 1 -- 172.21.15.69:0/385878324 >> 172.21.15.69:0/385878324 conn(0x7f47b8101370 msgr2=0x7f47b8103a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:59.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.508+0000 7f47bd400640 1 -- 172.21.15.69:0/385878324 shutdown_connections 2024-05-14T15:41:59.509 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.508+0000 7f47bd400640 1 -- 172.21.15.69:0/385878324 wait complete. 2024-05-14T15:41:59.532 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-05-14T15:41:59.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.801+0000 7f57fea00640 1 -- 172.21.15.69:0/1219684310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57f8077620 msgr2=0x7f57f8077a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:59.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.801+0000 7f57fea00640 1 --2- 172.21.15.69:0/1219684310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57f8077620 0x7f57f8077a30 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f57ec009900 tx=0x7f57ec02a410 comp rx=0 tx=0).stop 2024-05-14T15:41:59.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.801+0000 7f57fea00640 1 -- 172.21.15.69:0/1219684310 shutdown_connections 2024-05-14T15:41:59.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.801+0000 7f57fea00640 1 --2- 172.21.15.69:0/1219684310 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57f81148c0 0x7f57f8116ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:59.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.801+0000 7f57fea00640 1 --2- 172.21.15.69:0/1219684310 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57f8111f60 0x7f57f8114380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:59.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.801+0000 7f57fea00640 1 --2- 172.21.15.69:0/1219684310 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57f8077620 0x7f57f8077a30 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:59.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.801+0000 7f57fea00640 1 -- 172.21.15.69:0/1219684310 >> 172.21.15.69:0/1219684310 conn(0x7f57f8101370 msgr2=0x7f57f8103790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:41:59.802 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.801+0000 7f57fea00640 1 -- 172.21.15.69:0/1219684310 shutdown_connections 2024-05-14T15:41:59.803 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.801+0000 7f57fea00640 1 -- 172.21.15.69:0/1219684310 wait complete. 2024-05-14T15:41:59.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.802+0000 7f57fea00640 1 Processor -- start 2024-05-14T15:41:59.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.802+0000 7f57fea00640 1 -- start start 2024-05-14T15:41:59.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.803+0000 7f57fea00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57f8077620 0x7f57f81a67b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:59.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.803+0000 7f57fea00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57f8111f60 0x7f57f81a6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:59.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.803+0000 7f57fea00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57f81148c0 0x7f57f81a09c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:59.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.803+0000 7f57fea00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f57f811a100 con 0x7f57f81148c0 2024-05-14T15:41:59.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.803+0000 7f57fea00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f57f8119f80 con 0x7f57f8111f60 2024-05-14T15:41:59.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.803+0000 7f57fea00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f57f811a280 con 0x7f57f8077620 2024-05-14T15:41:59.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.803+0000 7f57fe000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57f81148c0 0x7f57f81a09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:59.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.803+0000 7f57fe000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57f81148c0 0x7f57f81a09c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33242/0 (socket says 172.21.15.69:33242) 2024-05-14T15:41:59.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.803+0000 7f57fe000640 1 -- 172.21.15.69:0/3746370127 learned_addr learned my addr 172.21.15.69:0/3746370127 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:41:59.804 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.803+0000 7f57fcc00640 1 --2- 172.21.15.69:0/3746370127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57f8111f60 0x7f57f81a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:59.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.803+0000 7f57fd600640 1 --2- 172.21.15.69:0/3746370127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57f8077620 0x7f57f81a67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:59.805 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.803+0000 7f57fe000640 1 -- 172.21.15.69:0/3746370127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57f8077620 msgr2=0x7f57f81a67b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:59.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.803+0000 7f57fe000640 1 --2- 172.21.15.69:0/3746370127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57f8077620 0x7f57f81a67b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:59.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.804+0000 7f57fe000640 1 -- 172.21.15.69:0/3746370127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57f8111f60 msgr2=0x7f57f81a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:41:59.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.804+0000 7f57fe000640 1 --2- 172.21.15.69:0/3746370127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57f8111f60 0x7f57f81a6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:41:59.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.804+0000 7f57fe000640 1 -- 172.21.15.69:0/3746370127 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57f81a1060 con 0x7f57f81148c0 2024-05-14T15:41:59.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.804+0000 7f57fcc00640 1 --2- 172.21.15.69:0/3746370127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57f8111f60 0x7f57f81a6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-14T15:41:59.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.804+0000 7f57fe000640 1 --2- 172.21.15.69:0/3746370127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57f81148c0 0x7f57f81a09c0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f57f000eaa0 tx=0x7f57f000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:59.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.804+0000 7f57f6000640 1 -- 172.21.15.69:0/3746370127 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f000cdb0 con 0x7f57f81148c0 2024-05-14T15:41:59.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.804+0000 7f57f6000640 1 -- 172.21.15.69:0/3746370127 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f57f0005020 con 0x7f57f81148c0 2024-05-14T15:41:59.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.804+0000 7f57fea00640 1 -- 172.21.15.69:0/3746370127 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57f81a1350 con 0x7f57f81148c0 2024-05-14T15:41:59.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.804+0000 7f57f6000640 1 -- 172.21.15.69:0/3746370127 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57f00116d0 con 0x7f57f81148c0 2024-05-14T15:41:59.806 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.804+0000 7f57fea00640 1 -- 172.21.15.69:0/3746370127 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57f81ad630 con 0x7f57f81148c0 2024-05-14T15:41:59.807 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.806+0000 7f57fea00640 1 -- 172.21.15.69:0/3746370127 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57f806a160 con 0x7f57f81148c0 2024-05-14T15:41:59.808 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.808+0000 7f57f6000640 1 -- 172.21.15.69:0/3746370127 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f57f00051d0 con 0x7f57f81148c0 2024-05-14T15:41:59.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.809+0000 7f57f6000640 1 --2- 172.21.15.69:0/3746370127 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f57e00b29d0 0x7f57e00b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:41:59.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.809+0000 7f57f6000640 1 -- 172.21.15.69:0/3746370127 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9554+0+0 (secure 0 0 0) 0x7f57f00e2c40 con 0x7f57f81148c0 2024-05-14T15:41:59.810 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.809+0000 7f57fd600640 1 --2- 172.21.15.69:0/3746370127 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f57e00b29d0 0x7f57e00b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:41:59.811 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.810+0000 7f57fd600640 1 --2- 172.21.15.69:0/3746370127 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f57e00b29d0 0x7f57e00b4ee0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f57ec006010 tx=0x7f57ec009680 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:41:59.814 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:41:59.813+0000 7f57f6000640 1 -- 172.21.15.69:0/3746370127 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f57f0016030 con 0x7f57f81148c0 2024-05-14T15:41:59.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:59 smithi069 ceph-mon[31270]: pgmap v643: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 28 op/s 2024-05-14T15:41:59.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:59 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1687687920' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-14T15:41:59.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:41:59 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/385878324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-14T15:42:00.008 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.008+0000 7f57fea00640 1 -- 172.21.15.69:0/3746370127 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f57f8103ea0 con 0x7f57f81148c0 2024-05-14T15:42:00.009 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.009+0000 7f57f6000640 1 -- 172.21.15.69:0/3746370127 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v122) ==== 103+0+11 (secure 0 0 0) 0x7f57f00aa1b0 con 0x7f57f81148c0 2024-05-14T15:42:00.009 INFO:teuthology.orchestra.run.smithi069.stdout:pg_num: 32 2024-05-14T15:42:00.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.011+0000 7f57fea00640 1 -- 172.21.15.69:0/3746370127 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f57e00b29d0 msgr2=0x7f57e00b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:42:00.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.011+0000 7f57fea00640 1 --2- 172.21.15.69:0/3746370127 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f57e00b29d0 0x7f57e00b4ee0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f57ec006010 tx=0x7f57ec009680 comp rx=0 tx=0).stop 2024-05-14T15:42:00.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.011+0000 7f57fea00640 1 -- 172.21.15.69:0/3746370127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57f81148c0 msgr2=0x7f57f81a09c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:42:00.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.011+0000 7f57fea00640 1 --2- 172.21.15.69:0/3746370127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57f81148c0 0x7f57f81a09c0 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f57f000eaa0 tx=0x7f57f000ef60 comp rx=0 tx=0).stop 2024-05-14T15:42:00.012 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.011+0000 7f57fea00640 1 -- 172.21.15.69:0/3746370127 shutdown_connections 2024-05-14T15:42:00.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.011+0000 7f57fea00640 1 --2- 172.21.15.69:0/3746370127 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f57e00b29d0 0x7f57e00b4ee0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:00.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.011+0000 7f57fea00640 1 --2- 172.21.15.69:0/3746370127 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f57f81148c0 0x7f57f81a09c0 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:00.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.011+0000 7f57fea00640 1 --2- 172.21.15.69:0/3746370127 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f57f8111f60 0x7f57f81a6cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:00.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.011+0000 7f57fea00640 1 --2- 172.21.15.69:0/3746370127 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f57f8077620 0x7f57f81a67b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:00.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.011+0000 7f57fea00640 1 -- 172.21.15.69:0/3746370127 >> 172.21.15.69:0/3746370127 conn(0x7f57f8101370 msgr2=0x7f57f807a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:42:00.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.012+0000 7f57fea00640 1 -- 172.21.15.69:0/3746370127 shutdown_connections 2024-05-14T15:42:00.013 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.012+0000 7f57fea00640 1 -- 172.21.15.69:0/3746370127 wait complete. 2024-05-14T15:42:00.037 DEBUG:teuthology.orchestra.run.smithi069:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-05-14T15:42:00.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:59 smithi203 ceph-mon[34567]: pgmap v643: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 28 op/s 2024-05-14T15:42:00.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:59 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1687687920' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-14T15:42:00.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:41:59 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/385878324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-14T15:42:00.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:59 smithi092 ceph-mon[34729]: pgmap v643: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 64 KiB/s rd, 60 KiB/s wr, 28 op/s 2024-05-14T15:42:00.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:59 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1687687920' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-05-14T15:42:00.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:41:59 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/385878324' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-05-14T15:42:00.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.310+0000 7f6807e00640 1 -- 172.21.15.69:0/4150763993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f680810f340 msgr2=0x7f6808116ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:42:00.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.310+0000 7f6807e00640 1 --2- 172.21.15.69:0/4150763993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f680810f340 0x7f6808116ae0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f6800009ca0 tx=0x7f680002a8c0 comp rx=0 tx=0).stop 2024-05-14T15:42:00.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.310+0000 7f6807e00640 1 -- 172.21.15.69:0/4150763993 shutdown_connections 2024-05-14T15:42:00.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.310+0000 7f6807e00640 1 --2- 172.21.15.69:0/4150763993 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f680810f340 0x7f6808116ae0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:00.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.310+0000 7f6807e00640 1 --2- 172.21.15.69:0/4150763993 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f680810e880 0x7f680810ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:00.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.310+0000 7f6807e00640 1 --2- 172.21.15.69:0/4150763993 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680810a2f0 0x7f680810a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:00.311 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.310+0000 7f6807e00640 1 -- 172.21.15.69:0/4150763993 >> 172.21.15.69:0/4150763993 conn(0x7f6808076c90 msgr2=0x7f68080770d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:42:00.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.310+0000 7f6807e00640 1 -- 172.21.15.69:0/4150763993 shutdown_connections 2024-05-14T15:42:00.312 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.310+0000 7f6807e00640 1 -- 172.21.15.69:0/4150763993 wait complete. 2024-05-14T15:42:00.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.311+0000 7f6807e00640 1 Processor -- start 2024-05-14T15:42:00.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.311+0000 7f6807e00640 1 -- start start 2024-05-14T15:42:00.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6807e00640 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f680810a2f0 0x7f68081a6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:42:00.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6807e00640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f680810e880 0x7f68081a6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:42:00.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6807e00640 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680810f340 0x7f68081a0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:42:00.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6807e00640 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f680811a130 con 0x7f680810e880 2024-05-14T15:42:00.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6807e00640 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f6808119fb0 con 0x7f680810f340 2024-05-14T15:42:00.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6807e00640 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f680811a2b0 con 0x7f680810a2f0 2024-05-14T15:42:00.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6806000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f680810e880 0x7f68081a6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:42:00.314 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6806000640 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f680810e880 0x7f68081a6c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:33268/0 (socket says 172.21.15.69:33268) 2024-05-14T15:42:00.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6806000640 1 -- 172.21.15.69:0/3715693081 learned_addr learned my addr 172.21.15.69:0/3715693081 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:42:00.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6807400640 1 --2- 172.21.15.69:0/3715693081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680810f340 0x7f68081a0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:42:00.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6806a00640 1 --2- 172.21.15.69:0/3715693081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f680810a2f0 0x7f68081a6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:42:00.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6806000640 1 -- 172.21.15.69:0/3715693081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f680810a2f0 msgr2=0x7f68081a6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:42:00.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6806000640 1 --2- 172.21.15.69:0/3715693081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f680810a2f0 0x7f68081a6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:00.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6806000640 1 -- 172.21.15.69:0/3715693081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680810f340 msgr2=0x7f68081a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:42:00.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6806000640 1 --2- 172.21.15.69:0/3715693081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680810f340 0x7f68081a0950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:00.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6806000640 1 -- 172.21.15.69:0/3715693081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68081a0f40 con 0x7f680810e880 2024-05-14T15:42:00.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6807400640 1 --2- 172.21.15.69:0/3715693081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680810f340 0x7f68081a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:42:00.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.312+0000 7f6806a00640 1 --2- 172.21.15.69:0/3715693081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f680810a2f0 0x7f68081a6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:42:00.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.313+0000 7f6806000640 1 --2- 172.21.15.69:0/3715693081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f680810e880 0x7f68081a6c80 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f67f400c970 tx=0x7f67f400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:42:00.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.313+0000 7f67ff400640 1 -- 172.21.15.69:0/3715693081 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f4007bb0 con 0x7f680810e880 2024-05-14T15:42:00.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.313+0000 7f67ff400640 1 -- 172.21.15.69:0/3715693081 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f67f4007d50 con 0x7f680810e880 2024-05-14T15:42:00.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.313+0000 7f67ff400640 1 -- 172.21.15.69:0/3715693081 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f4004e10 con 0x7f680810e880 2024-05-14T15:42:00.315 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.313+0000 7f6807e00640 1 -- 172.21.15.69:0/3715693081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68081a1230 con 0x7f680810e880 2024-05-14T15:42:00.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.313+0000 7f6807e00640 1 -- 172.21.15.69:0/3715693081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68081ad5c0 con 0x7f680810e880 2024-05-14T15:42:00.316 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.314+0000 7f6807e00640 1 -- 172.21.15.69:0/3715693081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f680806a160 con 0x7f680810e880 2024-05-14T15:42:00.318 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.317+0000 7f67ff400640 1 -- 172.21.15.69:0/3715693081 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f67f4005000 con 0x7f680810e880 2024-05-14T15:42:00.319 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.319+0000 7f67ff400640 1 --2- 172.21.15.69:0/3715693081 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f67ec0b29d0 0x7f67ec0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:42:00.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.319+0000 7f67ff400640 1 -- 172.21.15.69:0/3715693081 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(122..122 src has 1..122) ==== 9554+0+0 (secure 0 0 0) 0x7f67f40e2af0 con 0x7f680810e880 2024-05-14T15:42:00.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.319+0000 7f6806a00640 1 --2- 172.21.15.69:0/3715693081 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f67ec0b29d0 0x7f67ec0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:42:00.320 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.320+0000 7f6806a00640 1 --2- 172.21.15.69:0/3715693081 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f67ec0b29d0 0x7f67ec0b4ee0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f68081a1a90 tx=0x7f67f8005db0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:42:00.324 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.324+0000 7f67ff400640 1 -- 172.21.15.69:0/3715693081 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f67f4014030 con 0x7f680810e880 2024-05-14T15:42:00.620 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.619+0000 7f6807e00640 1 -- 172.21.15.69:0/3715693081 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f68081a1e80 con 0x7f680810e880 2024-05-14T15:42:00.645 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.644+0000 7f67ff400640 1 -- 172.21.15.69:0/3715693081 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+816175 (secure 0 0 0) 0x7f67f40aa060 con 0x7f680810e880 2024-05-14T15:42:00.656 INFO:teuthology.orchestra.run.smithi069.stdout: 2024-05-14T15:42:00.657 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:42:00.657 INFO:teuthology.orchestra.run.smithi069.stdout: "epoch": 25, 2024-05-14T15:42:00.657 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.657 INFO:teuthology.orchestra.run.smithi069.stdout: "active_gid": 34991, 2024-05-14T15:42:00.657 INFO:teuthology.orchestra.run.smithi069.stdout: "active_name": "x", 2024-05-14T15:42:00.657 INFO:teuthology.orchestra.run.smithi069.stdout: "active_addrs": { 2024-05-14T15:42:00.657 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2024-05-14T15:42:00.657 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.657 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2024-05-14T15:42:00.657 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:6800", 2024-05-14T15:42:00.657 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 1271399048 2024-05-14T15:42:00.657 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.657 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.657 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v1", 2024-05-14T15:42:00.658 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:6801", 2024-05-14T15:42:00.658 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 1271399048 2024-05-14T15:42:00.658 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.658 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-05-14T15:42:00.658 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.658 INFO:teuthology.orchestra.run.smithi069.stdout: "active_addr": "172.21.15.69:6801/1271399048", 2024-05-14T15:42:00.658 INFO:teuthology.orchestra.run.smithi069.stdout: "active_change": "2024-05-14T15:21:37.785387+0000", 2024-05-14T15:42:00.658 INFO:teuthology.orchestra.run.smithi069.stdout: "active_mgr_features": 4540701547738038271, 2024-05-14T15:42:00.658 INFO:teuthology.orchestra.run.smithi069.stdout: "available": true, 2024-05-14T15:42:00.658 INFO:teuthology.orchestra.run.smithi069.stdout: "standbys": [ 2024-05-14T15:42:00.658 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.658 INFO:teuthology.orchestra.run.smithi069.stdout: "gid": 24988, 2024-05-14T15:42:00.658 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "z", 2024-05-14T15:42:00.659 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_features": 4540701547738038271, 2024-05-14T15:42:00.659 INFO:teuthology.orchestra.run.smithi069.stdout: "available_modules": [ 2024-05-14T15:42:00.659 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.659 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alerts", 2024-05-14T15:42:00.659 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.659 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.659 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.659 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-05-14T15:42:00.659 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-05-14T15:42:00.659 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.659 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.659 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.659 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-05-14T15:42:00.659 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.659 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.659 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.660 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How frequently to reexamine health status", 2024-05-14T15:42:00.660 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.660 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.660 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.660 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.660 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.660 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.660 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.660 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.660 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.660 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.660 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.660 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.660 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.660 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.661 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.661 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.661 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.661 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.661 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.661 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.661 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.661 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.661 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.661 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.661 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.661 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.661 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.661 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.662 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.662 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.662 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.662 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.662 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.662 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.662 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.662 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.662 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.662 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.662 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.662 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.662 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.662 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.662 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.663 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.664 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.664 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.664 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.664 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.664 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.664 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.664 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.664 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.664 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.664 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.664 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.664 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.664 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.664 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.664 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_destination": { 2024-05-14T15:42:00.664 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_destination", 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email address to send alerts to", 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_from_name": { 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_from_name", 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.665 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.666 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "Ceph", 2024-05-14T15:42:00.666 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.666 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.666 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.666 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email From: name", 2024-05-14T15:42:00.666 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.666 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.666 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.666 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.666 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_host": { 2024-05-14T15:42:00.666 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_host", 2024-05-14T15:42:00.666 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.666 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.666 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.666 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.667 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.667 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.667 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.667 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP server", 2024-05-14T15:42:00.667 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.667 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.667 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.667 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.667 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_password": { 2024-05-14T15:42:00.667 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_password", 2024-05-14T15:42:00.667 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.667 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.667 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.667 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.667 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.667 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.668 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.668 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Password to authenticate with", 2024-05-14T15:42:00.668 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.668 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.668 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.668 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.668 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_port": { 2024-05-14T15:42:00.668 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_port", 2024-05-14T15:42:00.668 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.668 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.668 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.668 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "465", 2024-05-14T15:42:00.668 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.668 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.668 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.668 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP port", 2024-05-14T15:42:00.669 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.669 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.669 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.669 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.669 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_sender": { 2024-05-14T15:42:00.669 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_sender", 2024-05-14T15:42:00.669 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.669 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.669 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.669 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.669 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.669 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.669 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.669 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP envelope sender", 2024-05-14T15:42:00.670 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.670 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.670 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.670 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.670 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_ssl": { 2024-05-14T15:42:00.670 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_ssl", 2024-05-14T15:42:00.670 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.670 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.670 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.670 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.670 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.670 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.670 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.670 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-14T15:42:00.671 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.671 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.671 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.671 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.671 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_user": { 2024-05-14T15:42:00.671 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_user", 2024-05-14T15:42:00.671 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.671 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.671 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.671 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.671 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.672 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.672 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.672 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "User to authenticate as", 2024-05-14T15:42:00.672 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.672 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.672 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.672 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.672 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.672 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.672 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.672 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.672 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.672 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.672 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.672 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.672 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.673 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.673 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.673 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.673 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.673 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.673 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.673 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.673 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.673 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "balancer", 2024-05-14T15:42:00.673 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.673 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.673 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.673 INFO:teuthology.orchestra.run.smithi069.stdout: "active": { 2024-05-14T15:42:00.673 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "active", 2024-05-14T15:42:00.673 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.673 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.674 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.674 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.674 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.674 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.674 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.674 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically balance PGs across cluster", 2024-05-14T15:42:00.674 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.674 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.674 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.674 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.674 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_time": { 2024-05-14T15:42:00.674 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_time", 2024-05-14T15:42:00.674 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.674 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.674 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.675 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0000", 2024-05-14T15:42:00.675 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.675 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.675 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.675 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "beginning time of day to automatically balance", 2024-05-14T15:42:00.675 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T15:42:00.675 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.675 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.675 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.675 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_weekday": { 2024-05-14T15:42:00.675 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_weekday", 2024-05-14T15:42:00.675 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-05-14T15:42:00.675 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.675 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.675 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.676 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2024-05-14T15:42:00.676 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2024-05-14T15:42:00.676 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.676 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-14T15:42:00.676 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T15:42:00.676 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.676 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.676 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.676 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_max_iterations": { 2024-05-14T15:42:00.676 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_max_iterations", 2024-05-14T15:42:00.676 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-05-14T15:42:00.676 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.676 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.676 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "25", 2024-05-14T15:42:00.676 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-05-14T15:42:00.676 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "250", 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_metrics": { 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_metrics", 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "pgs,objects,bytes", 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-14T15:42:00.677 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-14T15:42:00.678 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.678 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.678 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.678 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_step": { 2024-05-14T15:42:00.678 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_step", 2024-05-14T15:42:00.678 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:00.678 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.678 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.678 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.5", 2024-05-14T15:42:00.678 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0.001", 2024-05-14T15:42:00.678 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "0.999", 2024-05-14T15:42:00.678 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.678 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "aggressiveness of optimization", 2024-05-14T15:42:00.678 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-14T15:42:00.678 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.679 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.679 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.679 INFO:teuthology.orchestra.run.smithi069.stdout: "end_time": { 2024-05-14T15:42:00.679 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_time", 2024-05-14T15:42:00.679 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.679 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.679 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.679 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2359", 2024-05-14T15:42:00.679 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.679 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.679 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.679 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ending time of day to automatically balance", 2024-05-14T15:42:00.679 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T15:42:00.679 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.679 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.680 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.680 INFO:teuthology.orchestra.run.smithi069.stdout: "end_weekday": { 2024-05-14T15:42:00.680 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_weekday", 2024-05-14T15:42:00.680 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-05-14T15:42:00.680 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.680 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.680 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.680 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2024-05-14T15:42:00.680 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2024-05-14T15:42:00.680 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.680 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-14T15:42:00.680 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T15:42:00.680 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.680 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.680 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.680 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.681 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.681 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.681 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.681 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.681 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.681 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.681 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.681 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.681 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.681 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.681 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.681 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.681 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.681 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.681 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.681 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.682 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.682 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.682 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.682 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.682 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.682 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.682 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.682 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.682 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.682 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.682 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.682 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.682 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.682 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.682 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.682 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.683 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.683 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.683 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.683 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.683 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.683 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.683 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.683 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.683 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.683 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.683 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.683 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.683 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.683 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.683 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.683 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.684 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.685 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.685 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.685 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.685 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.685 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.685 INFO:teuthology.orchestra.run.smithi069.stdout: "min_score": { 2024-05-14T15:42:00.685 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_score", 2024-05-14T15:42:00.685 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:00.685 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.685 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.685 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.685 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.685 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.685 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.686 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-14T15:42:00.686 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.686 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.686 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.686 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.686 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2024-05-14T15:42:00.686 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2024-05-14T15:42:00.686 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.686 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.686 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.686 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "upmap", 2024-05-14T15:42:00.686 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.686 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.686 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.686 INFO:teuthology.orchestra.run.smithi069.stdout: "crush-compat", 2024-05-14T15:42:00.686 INFO:teuthology.orchestra.run.smithi069.stdout: "none", 2024-05-14T15:42:00.687 INFO:teuthology.orchestra.run.smithi069.stdout: "read", 2024-05-14T15:42:00.687 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap", 2024-05-14T15:42:00.687 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap-read" 2024-05-14T15:42:00.687 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.687 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Balancer mode", 2024-05-14T15:42:00.687 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.687 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.687 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.687 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.687 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_ids": { 2024-05-14T15:42:00.687 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_ids", 2024-05-14T15:42:00.687 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.687 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.687 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.687 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.688 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.688 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.688 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.688 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-14T15:42:00.688 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.688 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.688 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.688 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.688 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-05-14T15:42:00.688 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-05-14T15:42:00.688 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.688 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.688 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.688 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-05-14T15:42:00.688 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.689 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.689 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.689 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-14T15:42:00.689 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.689 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.689 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.689 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.689 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.689 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.689 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.689 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.689 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.689 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.689 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.689 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.689 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.690 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.690 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.690 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.690 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.690 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.690 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_deviation": { 2024-05-14T15:42:00.690 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_deviation", 2024-05-14T15:42:00.690 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.690 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.690 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.690 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-05-14T15:42:00.690 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-05-14T15:42:00.690 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.690 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.690 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-14T15:42:00.690 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-14T15:42:00.691 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.691 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.691 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.691 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_optimizations": { 2024-05-14T15:42:00.691 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_optimizations", 2024-05-14T15:42:00.691 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-05-14T15:42:00.691 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.691 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.691 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:00.691 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.691 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.691 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.691 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-14T15:42:00.691 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.692 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.692 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.692 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.692 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.692 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.692 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.692 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm", 2024-05-14T15:42:00.692 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.692 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.692 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.692 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_down_multiplier": { 2024-05-14T15:42:00.692 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_down_multiplier", 2024-05-14T15:42:00.692 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:00.692 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.693 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.693 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2024-05-14T15:42:00.693 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.693 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.693 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.693 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-14T15:42:00.693 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.693 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.693 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.693 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.693 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_refresh_rate": { 2024-05-14T15:42:00.693 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_refresh_rate", 2024-05-14T15:42:00.693 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.693 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.694 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.694 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "20", 2024-05-14T15:42:00.694 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.694 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.694 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.694 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-14T15:42:00.694 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.694 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.694 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.694 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.694 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_starting_port": { 2024-05-14T15:42:00.694 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_starting_port", 2024-05-14T15:42:00.694 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.694 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.695 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.695 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4721", 2024-05-14T15:42:00.695 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.695 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.695 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.695 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-14T15:42:00.695 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.695 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.695 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.695 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.695 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_ptrace": { 2024-05-14T15:42:00.695 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_ptrace", 2024-05-14T15:42:00.695 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.695 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.695 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.695 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.696 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.696 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.696 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.696 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-14T15:42:00.696 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-14T15:42:00.696 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.696 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.696 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.696 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_interval": { 2024-05-14T15:42:00.696 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_interval", 2024-05-14T15:42:00.696 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.696 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.696 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.696 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-05-14T15:42:00.696 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.697 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.697 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.697 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-14T15:42:00.697 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.697 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.697 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.697 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.697 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_memory_target_ratio": { 2024-05-14T15:42:00.697 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_memory_target_ratio", 2024-05-14T15:42:00.697 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:00.697 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.697 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.697 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.7", 2024-05-14T15:42:00.697 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.697 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.698 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.698 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-14T15:42:00.698 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.698 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.698 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.698 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.698 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm_log_destination": { 2024-05-14T15:42:00.698 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm_log_destination", 2024-05-14T15:42:00.698 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.698 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.698 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.698 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.698 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.698 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.699 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.699 INFO:teuthology.orchestra.run.smithi069.stdout: "file", 2024-05-14T15:42:00.699 INFO:teuthology.orchestra.run.smithi069.stdout: "file,syslog", 2024-05-14T15:42:00.699 INFO:teuthology.orchestra.run.smithi069.stdout: "syslog" 2024-05-14T15:42:00.699 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.699 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-14T15:42:00.699 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.699 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.699 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.699 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.699 INFO:teuthology.orchestra.run.smithi069.stdout: "cgroups_split": { 2024-05-14T15:42:00.699 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cgroups_split", 2024-05-14T15:42:00.699 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.699 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.699 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.700 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.700 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.700 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.700 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.700 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-14T15:42:00.700 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.700 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.700 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.700 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.700 INFO:teuthology.orchestra.run.smithi069.stdout: "config_checks_enabled": { 2024-05-14T15:42:00.700 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_checks_enabled", 2024-05-14T15:42:00.700 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.700 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.700 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.700 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.700 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.701 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.701 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.701 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-14T15:42:00.701 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.701 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.701 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.701 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.701 INFO:teuthology.orchestra.run.smithi069.stdout: "config_dashboard": { 2024-05-14T15:42:00.701 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_dashboard", 2024-05-14T15:42:00.701 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.701 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.701 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.701 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.701 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.701 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.702 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.702 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-14T15:42:00.702 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.702 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.702 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.702 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.702 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_alertmanager": { 2024-05-14T15:42:00.702 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_alertmanager", 2024-05-14T15:42:00.702 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.702 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.702 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.702 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-14T15:42:00.702 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.702 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.702 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.703 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-05-14T15:42:00.703 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.703 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.703 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.703 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.703 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_base": { 2024-05-14T15:42:00.703 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_base", 2024-05-14T15:42:00.703 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.703 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.703 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.703 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-14T15:42:00.703 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.703 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.703 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.703 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Container image name, without the tag", 2024-05-14T15:42:00.704 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.704 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.704 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.704 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.704 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_elasticsearch": { 2024-05-14T15:42:00.704 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_elasticsearch", 2024-05-14T15:42:00.704 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.704 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.704 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.704 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-14T15:42:00.704 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.704 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.704 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.704 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "elasticsearch container image", 2024-05-14T15:42:00.705 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.705 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.705 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.705 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.705 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_grafana": { 2024-05-14T15:42:00.705 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_grafana", 2024-05-14T15:42:00.705 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.705 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.705 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.705 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-14T15:42:00.705 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.705 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.705 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.705 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-05-14T15:42:00.706 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.706 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.706 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.706 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.706 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_haproxy": { 2024-05-14T15:42:00.706 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_haproxy", 2024-05-14T15:42:00.706 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.706 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.706 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.706 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-14T15:42:00.706 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.706 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.706 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.706 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "HAproxy container image", 2024-05-14T15:42:00.707 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.707 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.707 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.707 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.707 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_agent": { 2024-05-14T15:42:00.707 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_agent", 2024-05-14T15:42:00.707 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.707 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.707 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.707 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-14T15:42:00.707 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.707 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.707 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.707 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger agent container image", 2024-05-14T15:42:00.708 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.708 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.708 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.708 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.708 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_collector": { 2024-05-14T15:42:00.708 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_collector", 2024-05-14T15:42:00.708 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.708 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.708 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.708 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-14T15:42:00.708 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.708 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.708 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.708 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger collector container image", 2024-05-14T15:42:00.708 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.709 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.709 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.709 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.709 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_query": { 2024-05-14T15:42:00.709 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_query", 2024-05-14T15:42:00.709 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.709 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.709 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.709 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-14T15:42:00.709 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.709 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.709 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.709 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger query container image", 2024-05-14T15:42:00.709 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.709 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.710 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.710 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.710 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_keepalived": { 2024-05-14T15:42:00.710 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_keepalived", 2024-05-14T15:42:00.710 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.710 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.710 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.710 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-14T15:42:00.710 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.710 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.710 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.710 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Keepalived container image", 2024-05-14T15:42:00.710 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.710 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.711 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.711 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.711 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_loki": { 2024-05-14T15:42:00.711 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_loki", 2024-05-14T15:42:00.711 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.711 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.711 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.711 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-14T15:42:00.711 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.711 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.711 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.711 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Loki container image", 2024-05-14T15:42:00.711 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.711 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.711 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.712 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.712 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_node_exporter": { 2024-05-14T15:42:00.712 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_node_exporter", 2024-05-14T15:42:00.712 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.712 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.712 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.712 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-14T15:42:00.712 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.712 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.712 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.712 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-05-14T15:42:00.712 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.712 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.712 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.712 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.712 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_nvmeof": { 2024-05-14T15:42:00.713 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_nvmeof", 2024-05-14T15:42:00.713 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.713 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.713 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.713 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-14T15:42:00.713 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.713 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.713 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.713 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Nvme-of container image", 2024-05-14T15:42:00.713 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.713 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.713 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.713 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.713 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_prometheus": { 2024-05-14T15:42:00.713 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_prometheus", 2024-05-14T15:42:00.714 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.714 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.714 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.714 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-14T15:42:00.714 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.714 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.714 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.714 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-05-14T15:42:00.714 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.714 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.714 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.714 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.714 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_promtail": { 2024-05-14T15:42:00.714 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_promtail", 2024-05-14T15:42:00.715 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.715 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.715 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.715 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-14T15:42:00.715 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.715 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.715 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.715 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Promtail container image", 2024-05-14T15:42:00.715 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.715 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.715 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.715 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.715 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_samba": { 2024-05-14T15:42:00.715 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_samba", 2024-05-14T15:42:00.715 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.715 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.716 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.716 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-14T15:42:00.716 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.716 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.716 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.716 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Samba/SMB container image", 2024-05-14T15:42:00.716 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.716 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.716 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.716 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.716 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_snmp_gateway": { 2024-05-14T15:42:00.716 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_snmp_gateway", 2024-05-14T15:42:00.716 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.717 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.717 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.717 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-14T15:42:00.717 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.717 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.717 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.717 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SNMP Gateway container image", 2024-05-14T15:42:00.717 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.717 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.717 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.717 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.717 INFO:teuthology.orchestra.run.smithi069.stdout: "container_init": { 2024-05-14T15:42:00.717 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_init", 2024-05-14T15:42:00.717 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.718 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.718 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.718 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.718 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.718 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.718 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.718 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Run podman/docker with `--init`", 2024-05-14T15:42:00.718 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.718 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.718 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.718 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.718 INFO:teuthology.orchestra.run.smithi069.stdout: "daemon_cache_timeout": { 2024-05-14T15:42:00.718 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "daemon_cache_timeout", 2024-05-14T15:42:00.718 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.719 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.719 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.719 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-05-14T15:42:00.719 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.719 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.719 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.719 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-14T15:42:00.719 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.719 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.719 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.719 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.719 INFO:teuthology.orchestra.run.smithi069.stdout: "default_cephadm_command_timeout": { 2024-05-14T15:42:00.719 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_cephadm_command_timeout", 2024-05-14T15:42:00.719 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.719 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.720 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.720 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "900", 2024-05-14T15:42:00.720 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.720 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.720 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.720 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-14T15:42:00.720 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.720 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.720 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.720 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.720 INFO:teuthology.orchestra.run.smithi069.stdout: "default_registry": { 2024-05-14T15:42:00.720 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_registry", 2024-05-14T15:42:00.720 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.720 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.720 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.720 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io", 2024-05-14T15:42:00.721 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.721 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.721 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.721 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-14T15:42:00.721 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.721 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.721 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.721 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.721 INFO:teuthology.orchestra.run.smithi069.stdout: "device_cache_timeout": { 2024-05-14T15:42:00.721 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_cache_timeout", 2024-05-14T15:42:00.721 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.721 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.721 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.721 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1800", 2024-05-14T15:42:00.721 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.722 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.722 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.722 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache device inventory", 2024-05-14T15:42:00.722 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.722 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.722 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.722 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.722 INFO:teuthology.orchestra.run.smithi069.stdout: "device_enhanced_scan": { 2024-05-14T15:42:00.722 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_enhanced_scan", 2024-05-14T15:42:00.722 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.722 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.722 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.722 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.722 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.722 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: "facts_cache_timeout": { 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "facts_cache_timeout", 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache host facts data", 2024-05-14T15:42:00.723 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: "grafana_dashboards_path": { 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "grafana_dashboards_path", 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.724 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: "host_check_interval": { 2024-05-14T15:42:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "host_check_interval", 2024-05-14T15:42:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-05-14T15:42:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to perform a host check", 2024-05-14T15:42:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: "hw_monitoring": { 2024-05-14T15:42:00.725 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hw_monitoring", 2024-05-14T15:42:00.726 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.726 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.726 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.726 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.726 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.726 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.726 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.726 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-14T15:42:00.726 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.726 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.726 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.726 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.726 INFO:teuthology.orchestra.run.smithi069.stdout: "inventory_list_all": { 2024-05-14T15:42:00.726 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "inventory_list_all", 2024-05-14T15:42:00.726 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.727 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.727 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.727 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.727 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.727 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.727 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.727 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-14T15:42:00.727 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.727 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.727 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.727 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.727 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.727 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.727 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.727 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.728 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.728 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.728 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.728 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.728 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.728 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.728 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.728 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.728 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.728 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.728 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.728 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.728 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.728 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.728 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.729 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.729 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.729 INFO:teuthology.orchestra.run.smithi069.stdout: "log_refresh_metadata": { 2024-05-14T15:42:00.729 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_refresh_metadata", 2024-05-14T15:42:00.729 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.729 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.729 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.729 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.729 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.729 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.729 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.729 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-14T15:42:00.729 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.729 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.729 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.729 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.730 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.730 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.730 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.730 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.730 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.730 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.730 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.730 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.730 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.730 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-14T15:42:00.730 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.730 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.730 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.730 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.730 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.731 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.731 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.731 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.731 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.731 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.731 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.731 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.731 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.731 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.731 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.731 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.731 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.731 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.731 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.731 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.732 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.732 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.732 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.732 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.732 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.732 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.732 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.732 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.732 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.732 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.732 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.732 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.732 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.732 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.732 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.732 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.733 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.733 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.733 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.733 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-14T15:42:00.733 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-14T15:42:00.733 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.733 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.733 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.733 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.733 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.733 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.733 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.733 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-14T15:42:00.733 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.733 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.733 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.734 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.734 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-14T15:42:00.734 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-14T15:42:00.734 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.734 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.734 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.734 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "*", 2024-05-14T15:42:00.734 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.734 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.734 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.734 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-14T15:42:00.734 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.734 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.734 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.734 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.734 INFO:teuthology.orchestra.run.smithi069.stdout: "max_count_per_host": { 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_count_per_host", 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of daemons per service per host", 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: "max_osd_draining_count": { 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_osd_draining_count", 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.735 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: "migration_current": { 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "migration_current", 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.736 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.737 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.737 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.737 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "internal - do not modify", 2024-05-14T15:42:00.737 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.737 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.737 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.737 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.737 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2024-05-14T15:42:00.737 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2024-05-14T15:42:00.737 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.737 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.737 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.737 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "root", 2024-05-14T15:42:00.737 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.737 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.737 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.738 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm-package", 2024-05-14T15:42:00.738 INFO:teuthology.orchestra.run.smithi069.stdout: "root" 2024-05-14T15:42:00.738 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.738 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "mode for remote execution of cephadm", 2024-05-14T15:42:00.738 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.738 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.738 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.738 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.738 INFO:teuthology.orchestra.run.smithi069.stdout: "oob_default_addr": { 2024-05-14T15:42:00.738 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "oob_default_addr", 2024-05-14T15:42:00.738 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.738 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.738 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.738 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "169.254.1.1", 2024-05-14T15:42:00.738 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.739 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.739 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.739 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-14T15:42:00.739 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.739 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.739 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.739 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.739 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_alerts_path": { 2024-05-14T15:42:00.739 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_alerts_path", 2024-05-14T15:42:00.739 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.739 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.739 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.739 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-14T15:42:00.739 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.739 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.739 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_insecure": { 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_insecure", 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.740 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.741 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.741 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.741 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_password": { 2024-05-14T15:42:00.741 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_password", 2024-05-14T15:42:00.741 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.741 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.741 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.741 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.741 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.741 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.741 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.741 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-14T15:42:00.741 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.741 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.741 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.741 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.742 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_url": { 2024-05-14T15:42:00.742 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_url", 2024-05-14T15:42:00.742 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.742 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.742 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.742 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.742 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.742 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.742 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.742 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-14T15:42:00.742 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.742 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.742 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.742 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.743 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_username": { 2024-05-14T15:42:00.743 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_username", 2024-05-14T15:42:00.743 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.743 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.743 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.743 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.743 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.743 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.743 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.743 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-14T15:42:00.743 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.743 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.743 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.743 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.743 INFO:teuthology.orchestra.run.smithi069.stdout: "secure_monitoring_stack": { 2024-05-14T15:42:00.744 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "secure_monitoring_stack", 2024-05-14T15:42:00.744 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.744 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.744 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.744 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.744 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.744 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.744 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.744 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-14T15:42:00.744 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.744 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.744 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.744 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.744 INFO:teuthology.orchestra.run.smithi069.stdout: "service_discovery_port": { 2024-05-14T15:42:00.744 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "service_discovery_port", 2024-05-14T15:42:00.745 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.745 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.745 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.745 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8765", 2024-05-14T15:42:00.745 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.745 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.745 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.745 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "cephadm service discovery port", 2024-05-14T15:42:00.745 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.745 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.745 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.745 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.745 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.745 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.745 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.745 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.746 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.746 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.746 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.746 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.746 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.746 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.746 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.746 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.746 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.746 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.746 INFO:teuthology.orchestra.run.smithi069.stdout: "ssh_config_file": { 2024-05-14T15:42:00.746 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssh_config_file", 2024-05-14T15:42:00.746 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.746 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.747 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.747 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.747 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.747 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.747 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.747 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-14T15:42:00.747 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.747 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.747 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.747 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.747 INFO:teuthology.orchestra.run.smithi069.stdout: "use_agent": { 2024-05-14T15:42:00.747 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_agent", 2024-05-14T15:42:00.747 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.747 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.747 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.748 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.748 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.748 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.748 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.748 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-14T15:42:00.748 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.748 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.748 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.748 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.748 INFO:teuthology.orchestra.run.smithi069.stdout: "use_repo_digest": { 2024-05-14T15:42:00.748 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_repo_digest", 2024-05-14T15:42:00.748 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.748 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.748 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.748 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.749 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.749 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.749 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.749 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-14T15:42:00.749 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.749 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.749 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.749 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.749 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_failed_host_check": { 2024-05-14T15:42:00.749 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_failed_host_check", 2024-05-14T15:42:00.749 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.749 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.749 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.749 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.749 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.750 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.750 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.750 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if the host check fails", 2024-05-14T15:42:00.750 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.750 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.750 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.750 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.750 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_daemons": { 2024-05-14T15:42:00.750 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_daemons", 2024-05-14T15:42:00.750 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.750 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.750 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.750 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.751 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.751 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.751 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.751 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-14T15:42:00.751 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.751 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.751 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.751 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.751 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_hosts": { 2024-05-14T15:42:00.751 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_hosts", 2024-05-14T15:42:00.751 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.751 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.751 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.751 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.751 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.752 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.752 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.752 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-14T15:42:00.752 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.752 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.752 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.752 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.752 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.752 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.752 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.752 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crash", 2024-05-14T15:42:00.752 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.752 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.752 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.752 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.753 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.753 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.753 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.753 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.753 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.753 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.753 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.753 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.753 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.753 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.753 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.753 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.753 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.753 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.753 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.754 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.754 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.754 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.754 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.754 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.754 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.754 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.754 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.754 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.754 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.754 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.754 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.754 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.754 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.755 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.756 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: "retain_interval": { 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retain_interval", 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "31536000", 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-14T15:42:00.757 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.758 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.758 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.758 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.758 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.758 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.758 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.758 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.758 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.758 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.758 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.758 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.758 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.758 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.758 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.758 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_recent_interval": { 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_recent_interval", 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1209600", 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.759 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.760 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.760 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.760 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dashboard", 2024-05-14T15:42:00.760 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.760 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.760 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.760 INFO:teuthology.orchestra.run.smithi069.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-14T15:42:00.760 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-14T15:42:00.760 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.760 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.760 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.760 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:00.760 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.760 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.760 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.760 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.761 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.761 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.761 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.761 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.761 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_HOST": { 2024-05-14T15:42:00.761 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-14T15:42:00.761 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.761 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.761 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.761 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.761 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.761 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.761 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.761 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.761 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.761 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.762 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.762 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.762 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-14T15:42:00.762 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-14T15:42:00.762 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.762 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.762 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.762 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.762 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.762 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.762 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.762 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.762 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.762 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.763 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.763 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.763 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_ENABLED": { 2024-05-14T15:42:00.763 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_ENABLED", 2024-05-14T15:42:00.763 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.763 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.763 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.763 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.763 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.763 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.763 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.763 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.763 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.763 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.763 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.763 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: "ENABLE_BROWSABLE_API": { 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-14T15:42:00.764 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.765 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.765 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.765 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.765 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.765 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.765 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.765 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.765 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.765 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.765 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.765 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.765 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-14T15:42:00.765 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-14T15:42:00.765 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.765 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.765 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.766 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.766 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.766 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.766 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.766 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.766 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.766 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.766 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.766 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.766 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-14T15:42:00.766 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-14T15:42:00.766 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.766 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.766 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.766 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.767 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.767 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.767 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.767 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.767 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.767 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.767 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.767 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.767 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-14T15:42:00.767 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-14T15:42:00.767 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.767 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.767 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.767 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.767 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.767 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.768 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.769 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.769 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.769 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.769 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-14T15:42:00.769 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-14T15:42:00.769 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.769 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.769 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.769 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.769 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.769 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.769 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.769 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.769 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.769 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.770 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.770 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.770 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-14T15:42:00.770 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-14T15:42:00.770 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.770 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.770 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.770 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.770 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.770 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.770 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.770 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.770 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.770 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.770 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.770 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.771 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-14T15:42:00.771 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-14T15:42:00.771 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.771 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.771 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.771 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.771 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.771 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.771 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.771 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.771 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.771 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.772 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_PASSWORD": { 2024-05-14T15:42:00.773 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-14T15:42:00.773 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.773 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.773 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.773 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-05-14T15:42:00.773 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.773 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.773 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.773 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.773 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.773 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.773 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.773 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.773 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-14T15:42:00.773 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-14T15:42:00.773 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.774 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.774 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.774 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.774 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.774 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.774 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.774 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.774 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.774 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.774 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.774 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.774 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_URL": { 2024-05-14T15:42:00.774 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_URL", 2024-05-14T15:42:00.774 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.774 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.775 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.775 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.775 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.775 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.775 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.775 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.775 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.775 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.775 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.775 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.775 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_USERNAME": { 2024-05-14T15:42:00.775 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-14T15:42:00.775 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.775 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.775 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.775 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-05-14T15:42:00.776 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.776 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.776 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.776 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.776 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.776 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.776 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.776 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.776 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-14T15:42:00.776 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-14T15:42:00.776 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.776 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.776 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.776 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.776 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.777 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.777 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.777 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.777 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.777 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.777 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.777 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.777 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-14T15:42:00.777 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-14T15:42:00.777 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.777 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.777 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.777 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.777 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.777 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.777 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.778 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.778 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.778 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.778 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.778 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.778 INFO:teuthology.orchestra.run.smithi069.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-14T15:42:00.778 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-14T15:42:00.778 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.778 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.778 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.778 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.778 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.778 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.778 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.778 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.778 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.779 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.780 INFO:teuthology.orchestra.run.smithi069.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-14T15:42:00.780 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-14T15:42:00.780 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.780 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.780 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.780 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "[]", 2024-05-14T15:42:00.780 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.780 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.780 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.780 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.780 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.780 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.780 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.780 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.780 INFO:teuthology.orchestra.run.smithi069.stdout: "MULTICLUSTER_CONFIG": { 2024-05-14T15:42:00.780 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-14T15:42:00.781 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.781 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.781 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.781 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "{}", 2024-05-14T15:42:00.781 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.781 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.781 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.781 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.781 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.781 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.781 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.781 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.781 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_HOST": { 2024-05-14T15:42:00.781 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-14T15:42:00.781 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.781 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.782 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.782 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.782 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.782 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.782 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.782 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.782 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.782 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.782 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.782 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.782 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-14T15:42:00.782 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-14T15:42:00.782 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.782 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.782 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.783 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.784 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.784 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.784 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.784 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.784 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.784 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.784 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-14T15:42:00.784 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-14T15:42:00.784 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.784 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.784 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.784 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.784 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.784 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.784 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.785 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.785 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.785 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.785 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.785 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.785 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-14T15:42:00.785 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-14T15:42:00.785 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.785 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.785 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.785 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.785 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.785 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.785 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.785 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.786 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.786 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.786 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.786 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.786 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-14T15:42:00.786 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-14T15:42:00.786 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.786 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.786 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.786 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.786 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.786 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.786 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.786 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.787 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.787 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.787 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.787 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.787 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-14T15:42:00.787 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-14T15:42:00.787 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.787 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.787 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.787 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.787 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.787 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.787 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.787 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.787 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.788 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.789 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-14T15:42:00.789 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-14T15:42:00.789 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.789 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.789 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.789 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.789 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.789 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.789 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.789 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.789 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.789 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.789 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.789 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.789 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_ENABLED": { 2024-05-14T15:42:00.789 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-14T15:42:00.790 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.790 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.790 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.790 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.790 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.790 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.790 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.790 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.790 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.790 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.790 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.790 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.790 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-14T15:42:00.790 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-14T15:42:00.791 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.791 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.791 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.791 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-14T15:42:00.791 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.791 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.791 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.791 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.791 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.791 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.791 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.791 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.791 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-14T15:42:00.791 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-14T15:42:00.791 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.792 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.792 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.792 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:00.792 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.792 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.792 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.792 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.792 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.792 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.792 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.792 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.792 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-14T15:42:00.792 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-14T15:42:00.792 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.792 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.792 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.793 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8", 2024-05-14T15:42:00.793 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.793 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.793 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.793 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.793 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.793 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.793 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.793 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.793 INFO:teuthology.orchestra.run.smithi069.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-14T15:42:00.793 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-14T15:42:00.793 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.793 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.793 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.793 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "45", 2024-05-14T15:42:00.793 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.794 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.794 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.794 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.794 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.794 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.794 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.794 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.794 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ACCESS_KEY": { 2024-05-14T15:42:00.794 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-14T15:42:00.794 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.794 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.794 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.794 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.794 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.794 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.795 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.795 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.795 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.795 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.795 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.795 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.795 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-14T15:42:00.795 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-14T15:42:00.795 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.795 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.795 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.795 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-05-14T15:42:00.795 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.795 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.795 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.795 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SECRET_KEY": { 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.796 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.797 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.797 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SSL_VERIFY": { 2024-05-14T15:42:00.797 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-14T15:42:00.797 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.797 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.797 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.797 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.797 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.797 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.797 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.797 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.797 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.797 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.797 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.797 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.797 INFO:teuthology.orchestra.run.smithi069.stdout: "UNSAFE_TLS_v1_2": { 2024-05-14T15:42:00.798 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-14T15:42:00.798 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.798 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.798 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.798 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.798 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.798 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.798 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.798 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.798 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.798 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.798 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.798 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.798 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.799 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.800 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.800 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:00.800 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.800 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.800 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.800 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.800 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.800 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.800 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.800 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.800 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-14T15:42:00.800 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-14T15:42:00.800 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.800 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.800 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.800 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: "cross_origin_url": { 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cross_origin_url", 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.801 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.802 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.802 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.802 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.802 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.802 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.802 INFO:teuthology.orchestra.run.smithi069.stdout: "crt_file": { 2024-05-14T15:42:00.802 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crt_file", 2024-05-14T15:42:00.802 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.802 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.802 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.802 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.802 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.802 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.802 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.802 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.803 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.803 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.803 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.803 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.803 INFO:teuthology.orchestra.run.smithi069.stdout: "debug": { 2024-05-14T15:42:00.803 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "debug", 2024-05-14T15:42:00.803 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.803 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.803 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.803 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.803 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.803 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.803 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.803 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable/disable debug options", 2024-05-14T15:42:00.804 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.804 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.804 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.804 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.804 INFO:teuthology.orchestra.run.smithi069.stdout: "jwt_token_ttl": { 2024-05-14T15:42:00.804 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "jwt_token_ttl", 2024-05-14T15:42:00.804 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.804 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.804 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.804 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "28800", 2024-05-14T15:42:00.804 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.804 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.804 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.804 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.804 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.804 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.805 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.805 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.805 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2024-05-14T15:42:00.805 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2024-05-14T15:42:00.805 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.805 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.805 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.805 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.805 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.805 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.805 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.805 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.805 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.805 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.805 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.806 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.806 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.806 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.806 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.806 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.806 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.806 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.806 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.806 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.806 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.806 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.806 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.806 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.806 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.806 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.806 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.807 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.808 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.809 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.809 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.809 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.809 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.809 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.809 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.809 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.809 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.809 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.809 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.809 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.809 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.809 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.809 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.809 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.810 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.810 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.810 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.810 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.810 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.810 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.810 INFO:teuthology.orchestra.run.smithi069.stdout: "motd": { 2024-05-14T15:42:00.810 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "motd", 2024-05-14T15:42:00.810 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.810 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.810 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.810 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.810 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.810 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.810 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.810 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "The message of the day", 2024-05-14T15:42:00.811 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.811 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.811 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.811 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.811 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect_resolve_ip_addr": { 2024-05-14T15:42:00.811 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "redirect_resolve_ip_addr", 2024-05-14T15:42:00.811 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.811 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.811 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.811 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.811 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.811 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.811 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.811 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.811 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.811 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.812 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.812 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.812 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-05-14T15:42:00.812 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-05-14T15:42:00.812 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.812 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.812 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.812 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2024-05-14T15:42:00.812 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.812 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.812 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.812 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.812 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.812 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.812 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.812 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.813 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-05-14T15:42:00.813 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-05-14T15:42:00.813 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.813 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.813 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.813 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8080", 2024-05-14T15:42:00.813 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.813 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.813 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.813 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.813 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.813 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.813 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.813 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.813 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.813 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.814 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.814 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.814 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.814 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.814 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.814 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.814 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.814 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.814 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.814 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.814 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.814 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.814 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2024-05-14T15:42:00.814 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl_server_port": { 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl_server_port", 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.815 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.816 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8443", 2024-05-14T15:42:00.816 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.816 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.816 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.816 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.816 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.816 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.816 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.816 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.816 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2024-05-14T15:42:00.816 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2024-05-14T15:42:00.816 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.816 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.816 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.816 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "redirect", 2024-05-14T15:42:00.817 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.817 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.817 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.817 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.817 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect" 2024-05-14T15:42:00.817 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.817 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.817 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.817 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.817 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.817 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.817 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2024-05-14T15:42:00.817 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2024-05-14T15:42:00.817 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.817 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.817 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.818 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2024-05-14T15:42:00.818 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2024-05-14T15:42:00.818 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2024-05-14T15:42:00.818 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.818 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.818 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.818 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.818 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.818 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.818 INFO:teuthology.orchestra.run.smithi069.stdout: "url_prefix": { 2024-05-14T15:42:00.818 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url_prefix", 2024-05-14T15:42:00.818 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.818 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.818 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.818 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.818 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.819 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.819 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.819 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.819 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.819 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.819 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.819 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.819 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.819 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.819 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.819 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2024-05-14T15:42:00.819 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.819 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.819 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.819 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_monitoring": { 2024-05-14T15:42:00.820 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_monitoring", 2024-05-14T15:42:00.820 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.820 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.820 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.820 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.820 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.820 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.820 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.820 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "monitor device health metrics", 2024-05-14T15:42:00.820 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.820 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.820 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.820 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.820 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.820 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.821 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.821 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.821 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.821 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.821 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.821 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.821 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.821 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.821 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.821 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.821 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.821 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.821 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.821 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.822 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.822 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.822 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.822 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.822 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.822 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.822 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.822 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.822 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.822 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.822 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.822 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.822 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.823 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.823 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.823 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.823 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.823 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.823 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.823 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.823 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.823 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.823 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.823 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.823 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.823 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.823 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.824 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.824 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.824 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.824 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.824 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.824 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.824 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.824 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.824 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.824 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.824 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.824 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.824 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.824 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.824 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.824 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: "mark_out_threshold": { 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mark_out_threshold", 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.825 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2419200", 2024-05-14T15:42:00.826 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.826 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.826 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.826 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-14T15:42:00.826 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.826 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.826 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.826 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.826 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_name": { 2024-05-14T15:42:00.826 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_name", 2024-05-14T15:42:00.826 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.826 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.826 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.826 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "device_health_metrics", 2024-05-14T15:42:00.826 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.827 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.827 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.827 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-14T15:42:00.827 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.827 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.827 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.827 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.827 INFO:teuthology.orchestra.run.smithi069.stdout: "retention_period": { 2024-05-14T15:42:00.827 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retention_period", 2024-05-14T15:42:00.827 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.827 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.827 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.827 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15552000", 2024-05-14T15:42:00.827 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.827 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.827 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain device health metrics", 2024-05-14T15:42:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_frequency": { 2024-05-14T15:42:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_frequency", 2024-05-14T15:42:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2024-05-14T15:42:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-14T15:42:00.828 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.829 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.829 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.829 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.829 INFO:teuthology.orchestra.run.smithi069.stdout: "self_heal": { 2024-05-14T15:42:00.829 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "self_heal", 2024-05-14T15:42:00.829 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.829 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.829 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.829 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.829 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.829 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.829 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.829 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-14T15:42:00.829 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.829 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.829 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.830 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.830 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-05-14T15:42:00.830 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-05-14T15:42:00.830 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.830 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.830 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.830 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-05-14T15:42:00.830 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.830 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.830 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.830 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and check device health", 2024-05-14T15:42:00.830 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.830 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.830 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.830 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.831 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.831 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.831 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.831 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.831 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.831 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.831 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.831 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.831 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.831 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.831 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.831 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.831 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.831 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.831 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_threshold": { 2024-05-14T15:42:00.831 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_threshold", 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7257600", 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "diskprediction_local", 2024-05-14T15:42:00.832 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.833 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.833 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.833 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.833 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.833 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.833 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.833 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.833 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.833 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.833 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.833 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.833 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.833 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.833 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.833 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.834 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.834 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.834 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.834 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.834 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.834 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.834 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.834 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.834 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.834 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.834 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.834 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.834 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.834 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.835 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.835 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.835 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.835 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.835 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.835 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.835 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.835 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.835 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.835 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.835 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.835 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.835 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.835 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.835 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.835 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.836 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.836 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.836 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.836 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.836 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.836 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.836 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.836 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.836 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.836 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.836 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.836 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.836 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.836 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.836 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.836 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: "predict_interval": { 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predict_interval", 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.837 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2024-05-14T15:42:00.838 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.838 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.838 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.838 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.838 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.838 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.838 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.838 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.838 INFO:teuthology.orchestra.run.smithi069.stdout: "predictor_model": { 2024-05-14T15:42:00.838 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predictor_model", 2024-05-14T15:42:00.838 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.838 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.838 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.838 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "prophetstor", 2024-05-14T15:42:00.838 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.838 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.839 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.840 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "influx", 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": false, 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "influxdb python module not found", 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: "batch_size": { 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "batch_size", 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5000", 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.841 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-14T15:42:00.842 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.842 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.842 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.842 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.842 INFO:teuthology.orchestra.run.smithi069.stdout: "database": { 2024-05-14T15:42:00.842 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "database", 2024-05-14T15:42:00.842 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.842 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.842 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.842 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "ceph", 2024-05-14T15:42:00.842 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.842 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.842 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.842 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-14T15:42:00.842 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.843 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.843 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.843 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.843 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": { 2024-05-14T15:42:00.843 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hostname", 2024-05-14T15:42:00.843 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.843 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.843 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.843 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.843 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.843 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.843 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.843 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server hostname", 2024-05-14T15:42:00.843 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.843 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.844 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.844 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.844 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-05-14T15:42:00.844 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-05-14T15:42:00.844 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.844 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.844 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.844 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "30", 2024-05-14T15:42:00.844 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "5", 2024-05-14T15:42:00.844 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.844 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.844 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-14T15:42:00.844 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.844 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.844 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.844 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.845 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.845 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.845 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.845 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.845 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.845 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.845 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.845 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.845 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.845 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.845 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.845 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.845 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.845 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.845 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.846 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.846 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.846 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.846 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.846 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.846 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.846 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.846 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.846 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.846 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.846 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.846 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.846 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.846 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.847 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.848 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.849 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.849 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.849 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.849 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.849 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.849 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.849 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.849 INFO:teuthology.orchestra.run.smithi069.stdout: "password": { 2024-05-14T15:42:00.849 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "password", 2024-05-14T15:42:00.849 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.849 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.849 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.849 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.849 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.850 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.850 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.850 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "password of InfluxDB server user", 2024-05-14T15:42:00.850 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.850 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.850 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.850 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.850 INFO:teuthology.orchestra.run.smithi069.stdout: "port": { 2024-05-14T15:42:00.850 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "port", 2024-05-14T15:42:00.850 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.850 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.850 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.850 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8086", 2024-05-14T15:42:00.850 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.851 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.851 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.851 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server port", 2024-05-14T15:42:00.851 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.851 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.851 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.851 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.851 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.851 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.851 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.851 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.851 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.851 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.851 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.851 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.851 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.852 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.852 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.852 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.852 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.852 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.852 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2024-05-14T15:42:00.852 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2024-05-14T15:42:00.852 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.852 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.852 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.852 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "false", 2024-05-14T15:42:00.852 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.852 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.852 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.852 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T15:42:00.852 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.853 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.853 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.853 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.853 INFO:teuthology.orchestra.run.smithi069.stdout: "threads": { 2024-05-14T15:42:00.853 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threads", 2024-05-14T15:42:00.853 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.853 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.853 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.853 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-05-14T15:42:00.853 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-05-14T15:42:00.853 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "32", 2024-05-14T15:42:00.853 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.853 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-14T15:42:00.853 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.853 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.853 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.854 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.854 INFO:teuthology.orchestra.run.smithi069.stdout: "username": { 2024-05-14T15:42:00.854 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "username", 2024-05-14T15:42:00.854 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.854 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.854 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.854 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.854 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.854 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.854 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.854 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "username of InfluxDB server user", 2024-05-14T15:42:00.854 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.854 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.854 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.854 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.855 INFO:teuthology.orchestra.run.smithi069.stdout: "verify_ssl": { 2024-05-14T15:42:00.855 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "verify_ssl", 2024-05-14T15:42:00.855 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.855 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.855 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.855 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "true", 2024-05-14T15:42:00.855 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.855 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.855 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.855 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T15:42:00.855 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.855 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.855 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.855 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.856 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.856 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.856 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.856 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "insights", 2024-05-14T15:42:00.856 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.856 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.856 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.856 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.856 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.856 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.856 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.856 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.856 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.856 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.856 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.856 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.857 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.857 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.857 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.857 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.857 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.857 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.857 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.857 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.857 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.857 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.857 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.857 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.857 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.858 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.858 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.858 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.858 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.858 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.858 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.858 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.858 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.858 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.858 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.858 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.858 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.858 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.858 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.859 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.859 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.859 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.859 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.859 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.859 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.859 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.859 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.859 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.859 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.859 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.859 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.859 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.859 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.859 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.859 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.860 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.861 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.861 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.861 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.861 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.861 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.861 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.861 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.861 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.861 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.861 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.861 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.861 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.861 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.861 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.861 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.861 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.862 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.862 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.862 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "iostat", 2024-05-14T15:42:00.862 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.862 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.862 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.862 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.862 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.862 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.862 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.862 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.862 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.862 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.862 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.863 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.864 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.865 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.866 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.866 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.866 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.866 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.866 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.866 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.866 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.866 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.866 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.866 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.866 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.866 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.866 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.866 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.866 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.867 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.867 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.867 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.867 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.867 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.867 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.867 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.867 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.867 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.867 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.867 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.867 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.867 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.867 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "k8sevents", 2024-05-14T15:42:00.867 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.867 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.868 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.868 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_event_retention_days": { 2024-05-14T15:42:00.868 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ceph_event_retention_days", 2024-05-14T15:42:00.868 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.868 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.868 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.868 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7", 2024-05-14T15:42:00.868 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.868 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.868 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.868 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-14T15:42:00.868 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.868 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.868 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.868 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.868 INFO:teuthology.orchestra.run.smithi069.stdout: "config_check_secs": { 2024-05-14T15:42:00.869 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_check_secs", 2024-05-14T15:42:00.869 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.869 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.869 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.869 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:00.869 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "10", 2024-05-14T15:42:00.869 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.869 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.869 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-14T15:42:00.869 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.869 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.869 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.869 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.869 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.869 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.870 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.870 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.870 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.870 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.870 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.870 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.870 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.870 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.870 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.870 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.870 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.870 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.870 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.870 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.871 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.871 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.871 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.871 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.871 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.871 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.871 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.871 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.871 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.871 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.871 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.871 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.871 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.871 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.872 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.872 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.872 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.872 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.872 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.872 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.872 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.872 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.872 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.872 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.872 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.872 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.872 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.872 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.872 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.872 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.873 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.874 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.874 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.874 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.874 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.874 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.874 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.874 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.874 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.874 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.874 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.874 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.874 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.874 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.874 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.874 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.875 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.875 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.875 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.875 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.875 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.875 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.875 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.875 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.875 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.875 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "localpool", 2024-05-14T15:42:00.875 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.875 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.875 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.875 INFO:teuthology.orchestra.run.smithi069.stdout: "failure_domain": { 2024-05-14T15:42:00.875 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "failure_domain", 2024-05-14T15:42:00.875 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.876 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.876 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.876 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "host", 2024-05-14T15:42:00.876 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.876 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.876 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.876 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "failure domain for any created local pool", 2024-05-14T15:42:00.876 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-14T15:42:00.876 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.876 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.876 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.876 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.876 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.876 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.876 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.877 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.877 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.877 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.877 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.877 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.877 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.877 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.877 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.877 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.877 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.877 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.877 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.877 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.877 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.877 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.877 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.878 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.878 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.878 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.878 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.878 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.878 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.878 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.878 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.878 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.878 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.878 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.878 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.878 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.878 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.878 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.878 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.879 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.879 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.879 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.879 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.879 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.879 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.879 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.879 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.879 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.879 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.879 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.879 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.879 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.879 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.879 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.879 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.880 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.881 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.881 INFO:teuthology.orchestra.run.smithi069.stdout: "min_size": { 2024-05-14T15:42:00.881 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_size", 2024-05-14T15:42:00.881 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.881 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.881 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.881 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.881 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.881 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.881 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.881 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default min_size for any created local pool", 2024-05-14T15:42:00.881 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-14T15:42:00.881 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.881 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.881 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.881 INFO:teuthology.orchestra.run.smithi069.stdout: "num_rep": { 2024-05-14T15:42:00.882 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "num_rep", 2024-05-14T15:42:00.882 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.882 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.882 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.882 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3", 2024-05-14T15:42:00.882 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.882 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.882 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.882 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default replica count for any created local pool", 2024-05-14T15:42:00.882 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.882 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.882 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.882 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.883 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_num": { 2024-05-14T15:42:00.883 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_num", 2024-05-14T15:42:00.883 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.883 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.883 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.883 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "128", 2024-05-14T15:42:00.883 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.883 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.883 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.883 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default pg_num for any created local pool", 2024-05-14T15:42:00.883 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.883 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.883 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.883 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.884 INFO:teuthology.orchestra.run.smithi069.stdout: "prefix": { 2024-05-14T15:42:00.884 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prefix", 2024-05-14T15:42:00.884 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.884 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.884 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.884 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.884 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.884 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.884 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.884 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name prefix for any created local pool", 2024-05-14T15:42:00.884 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.884 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.884 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.884 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.885 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.885 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.885 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.885 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.885 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.885 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.885 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.885 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.885 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.885 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.885 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.885 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.885 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.885 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.885 INFO:teuthology.orchestra.run.smithi069.stdout: "subtree": { 2024-05-14T15:42:00.886 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "subtree", 2024-05-14T15:42:00.886 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.886 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.886 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.886 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "rack", 2024-05-14T15:42:00.886 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.886 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.886 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.886 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-14T15:42:00.886 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-14T15:42:00.886 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.886 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.886 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.886 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mds_autoscaler", 2024-05-14T15:42:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.887 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.888 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.888 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.888 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.888 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.888 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.888 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.888 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.888 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.888 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.888 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.888 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.888 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.888 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.888 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.888 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.888 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.889 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.889 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.889 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.889 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.889 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.889 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.889 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.889 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.889 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.889 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.889 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.889 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.889 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.889 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.889 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.889 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.890 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.890 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.890 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.890 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.890 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.890 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.890 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.890 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.890 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.890 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.890 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.890 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.890 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.890 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.891 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.891 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.891 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.891 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.891 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.891 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.891 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.891 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.891 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.891 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.891 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.891 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.891 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.891 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.891 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.892 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.892 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.892 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.892 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.892 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.892 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.892 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.892 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.892 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.892 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.892 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.892 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.892 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.892 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.892 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.892 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirroring", 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.893 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.894 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.894 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.894 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.894 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.894 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.894 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.894 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.894 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.894 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.894 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.894 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.894 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.894 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.894 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.894 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.895 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.896 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.896 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.896 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.896 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.896 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.896 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.896 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.896 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.896 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.896 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.896 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.896 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.896 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.896 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.896 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.897 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.897 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.897 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.897 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.897 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.897 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.897 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.897 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.897 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.897 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.897 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.897 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.897 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.897 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.897 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.897 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.898 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.898 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.898 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.898 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.898 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.898 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.898 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.898 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.898 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.898 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.898 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.898 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "nfs", 2024-05-14T15:42:00.898 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.898 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.898 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.898 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.899 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.900 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.900 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.900 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.900 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.900 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.900 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.900 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.900 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.900 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.900 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.900 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.900 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.900 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.900 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.900 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.900 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.901 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.902 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.902 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.902 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.902 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.902 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.902 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.902 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.902 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.902 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.902 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.902 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.902 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.902 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.902 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.902 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.903 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: "fail_fs": { 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "fail_fs", 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.904 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.905 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.906 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.906 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.906 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.906 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.906 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.906 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.906 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.906 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.906 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.906 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.906 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.906 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.906 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.906 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.907 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.907 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.907 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.907 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.907 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.907 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.907 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.907 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.907 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.907 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.907 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.907 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.907 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.907 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.907 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.908 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.909 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.909 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.909 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.909 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.909 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.909 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.909 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.909 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.909 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.909 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.909 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.909 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.909 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.909 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator": { 2024-05-14T15:42:00.909 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2024-05-14T15:42:00.910 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.910 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.910 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.910 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.910 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.910 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.910 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.910 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2024-05-14T15:42:00.910 INFO:teuthology.orchestra.run.smithi069.stdout: "rook", 2024-05-14T15:42:00.910 INFO:teuthology.orchestra.run.smithi069.stdout: "test_orchestrator" 2024-05-14T15:42:00.910 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.910 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Orchestrator backend", 2024-05-14T15:42:00.910 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.910 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.911 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.911 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.911 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.911 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.911 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.911 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.911 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.911 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.911 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.911 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.911 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.911 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.911 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.911 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.911 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.911 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.912 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.912 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.912 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.912 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_perf_query", 2024-05-14T15:42:00.912 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.912 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.912 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.912 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.912 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.912 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.912 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.912 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.912 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.912 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.912 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.913 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.913 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.913 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.913 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.913 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.913 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.913 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.913 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.913 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.913 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.913 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.913 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.913 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.913 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.913 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.913 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.914 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.914 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.914 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.914 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.914 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.914 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.914 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.914 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.914 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.914 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.914 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.914 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.914 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.914 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.915 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.916 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.917 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_support", 2024-05-14T15:42:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.918 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.919 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.920 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.921 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.922 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.923 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_autoscaler", 2024-05-14T15:42:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.924 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.925 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.926 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.927 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.928 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-05-14T15:42:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-05-14T15:42:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-05-14T15:42:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.929 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "threshold": { 2024-05-14T15:42:00.930 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threshold", 2024-05-14T15:42:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2024-05-14T15:42:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1.0", 2024-05-14T15:42:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "scaling threshold", 2024-05-14T15:42:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-14T15:42:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.931 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "progress", 2024-05-14T15:42:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_pg_recovery_event": { 2024-05-14T15:42:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_pg_recovery_event", 2024-05-14T15:42:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.932 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-14T15:42:00.933 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.933 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.933 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.933 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.933 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2024-05-14T15:42:00.933 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2024-05-14T15:42:00.933 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.933 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.933 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.933 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.933 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.933 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.933 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.933 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.934 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.934 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.934 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.934 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.934 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.934 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.934 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.934 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.934 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.934 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.934 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.934 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.934 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.934 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.934 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.935 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.935 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.935 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.935 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.935 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.935 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.935 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.935 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.935 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.935 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.935 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.935 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.935 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.935 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.936 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.936 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.936 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.936 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.936 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.936 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.936 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.936 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.936 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.936 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.936 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.936 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.936 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.936 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.936 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.937 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.937 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.937 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.937 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.937 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.937 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.937 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.937 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.937 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.937 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.937 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.937 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.937 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.937 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.937 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.938 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.938 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.938 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.938 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.938 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.938 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.938 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.938 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.938 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.938 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.938 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.938 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.938 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.938 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.939 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.939 INFO:teuthology.orchestra.run.smithi069.stdout: "max_completed_events": { 2024-05-14T15:42:00.939 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_completed_events", 2024-05-14T15:42:00.939 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.939 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.939 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.939 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "50", 2024-05-14T15:42:00.939 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.939 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.939 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.939 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "number of past completed events to remember", 2024-05-14T15:42:00.939 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.939 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.939 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.939 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.940 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-05-14T15:42:00.940 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-05-14T15:42:00.940 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:00.940 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.940 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.940 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-05-14T15:42:00.940 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.940 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.940 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.940 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long the module is going to sleep", 2024-05-14T15:42:00.940 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.940 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.940 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.940 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.940 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.940 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.941 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.941 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.941 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.941 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.941 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.941 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.941 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.941 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.941 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.941 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.941 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.941 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.941 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.941 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.941 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.942 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus", 2024-05-14T15:42:00.942 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.942 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.942 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.942 INFO:teuthology.orchestra.run.smithi069.stdout: "cache": { 2024-05-14T15:42:00.942 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cache", 2024-05-14T15:42:00.942 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.942 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.942 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.942 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.942 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.942 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.942 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.942 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.943 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.943 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.943 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.943 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.943 INFO:teuthology.orchestra.run.smithi069.stdout: "exclude_perf_counters": { 2024-05-14T15:42:00.943 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "exclude_perf_counters", 2024-05-14T15:42:00.943 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.943 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.943 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.943 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.943 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.943 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.943 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.943 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-14T15:42:00.943 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-14T15:42:00.944 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.944 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.944 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.944 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.944 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.944 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.944 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.944 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.944 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.944 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.944 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.944 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.944 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.944 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.944 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.945 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.945 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.945 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.945 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.945 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.945 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.945 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.945 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.945 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.945 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.945 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.946 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.946 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.946 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.946 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.946 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.946 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.946 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.946 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.946 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.946 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.946 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.946 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.946 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.946 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.947 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.947 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.947 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.947 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.947 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.947 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.947 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.947 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.947 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.947 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.947 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.947 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.947 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.947 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.947 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.947 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.948 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.948 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.948 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.948 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.948 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.948 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.948 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.948 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.948 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.948 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.948 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.948 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.948 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.948 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.948 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.948 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.949 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.949 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools": { 2024-05-14T15:42:00.949 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools", 2024-05-14T15:42:00.949 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.949 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.949 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.949 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.949 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.949 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.949 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.949 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.949 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.949 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.949 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.949 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.949 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-14T15:42:00.950 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-14T15:42:00.950 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.950 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.950 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.950 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300", 2024-05-14T15:42:00.950 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.950 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.950 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.950 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.950 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.950 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.950 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.950 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.950 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_interval": { 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_interval", 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15.0", 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.951 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.952 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.952 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2024-05-14T15:42:00.952 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.952 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.952 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.952 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-14T15:42:00.952 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.952 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.952 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.952 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.952 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-05-14T15:42:00.952 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-05-14T15:42:00.952 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.952 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.952 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "9283", 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.953 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.954 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.954 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.954 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.954 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.954 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.954 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.954 INFO:teuthology.orchestra.run.smithi069.stdout: "stale_cache_strategy": { 2024-05-14T15:42:00.954 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stale_cache_strategy", 2024-05-14T15:42:00.954 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.954 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.954 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.954 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "log", 2024-05-14T15:42:00.954 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.954 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.954 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "default", 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: "default", 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: "error" 2024-05-14T15:42:00.955 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.956 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.957 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.957 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.957 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.957 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.957 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.957 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2024-05-14T15:42:00.957 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.957 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.957 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.957 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.957 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.957 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.957 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.957 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.957 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.957 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.958 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.958 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.958 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.958 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.958 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.958 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.958 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.958 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.958 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.958 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.958 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.958 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.958 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.958 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.959 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.960 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.960 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.960 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.960 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.960 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.960 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.960 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.960 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.960 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.960 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.960 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.960 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.960 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.960 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.960 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.960 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.961 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_snap_create": { 2024-05-14T15:42:00.962 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_snap_create", 2024-05-14T15:42:00.962 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.962 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.962 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.962 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:00.962 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.962 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.962 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.962 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.962 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.962 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.962 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.962 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.962 INFO:teuthology.orchestra.run.smithi069.stdout: "mirror_snapshot_schedule": { 2024-05-14T15:42:00.963 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirror_snapshot_schedule", 2024-05-14T15:42:00.963 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.963 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.963 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.963 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.963 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.963 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.963 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.963 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.963 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.963 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.963 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.963 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.963 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.963 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.963 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: "trash_purge_schedule": { 2024-05-14T15:42:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "trash_purge_schedule", 2024-05-14T15:42:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.964 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "restful", 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.965 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.966 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_auth": { 2024-05-14T15:42:00.966 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_auth", 2024-05-14T15:42:00.966 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.966 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.966 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.966 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.966 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.966 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.966 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.966 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.966 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.966 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.966 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.966 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.967 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2024-05-14T15:42:00.967 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2024-05-14T15:42:00.967 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.967 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.967 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.967 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.967 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.967 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.967 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.967 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.967 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.967 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.967 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.967 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.967 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.968 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.968 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.968 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.968 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.968 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.968 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.968 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.968 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.968 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.968 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.968 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.968 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.968 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.968 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.968 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.969 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.969 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.969 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.969 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.969 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.969 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.969 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.969 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.969 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.969 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.969 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.969 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.969 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.969 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.970 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.970 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.970 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.970 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.970 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.970 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.970 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.970 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.970 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.970 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.970 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.970 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.970 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.970 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.970 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.971 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.971 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.971 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.971 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.971 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.971 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.971 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.971 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.971 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.971 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.971 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.971 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.971 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.971 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.972 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.972 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.972 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.972 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.972 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.972 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.972 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.972 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.972 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.972 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.972 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.972 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-05-14T15:42:00.972 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-05-14T15:42:00.972 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.973 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.973 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.973 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.973 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.973 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.973 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.973 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.973 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.973 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.973 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.973 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.973 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-05-14T15:42:00.973 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-05-14T15:42:00.973 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.973 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.974 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.974 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.974 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.974 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.974 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.974 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.974 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.974 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.974 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.974 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.974 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.974 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.974 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.974 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.974 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.975 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.975 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.975 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.975 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.975 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.975 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.975 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.975 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.975 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.975 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.975 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.975 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.975 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rgw", 2024-05-14T15:42:00.975 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.975 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.976 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.976 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.976 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.976 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.976 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.976 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.976 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.976 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.976 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.976 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.976 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.976 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.976 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.976 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.976 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.977 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.977 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.977 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.977 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.977 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.977 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.977 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.977 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.977 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.977 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.977 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.977 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.977 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.977 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.977 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.977 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.978 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.978 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.978 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.978 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.978 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.978 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.978 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.978 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.978 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.978 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.978 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.978 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.978 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.978 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.978 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.979 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.979 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.979 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.979 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.979 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.979 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.979 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.979 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.979 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.979 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.979 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.979 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.979 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.979 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.979 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.979 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.980 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.980 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.980 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.980 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.980 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.980 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.980 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.980 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.980 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.980 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.980 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.980 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.980 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.980 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.980 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.980 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.981 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.981 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.981 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.981 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.981 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.981 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.981 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.981 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.981 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.981 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.981 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rook", 2024-05-14T15:42:00.981 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.981 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.981 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.981 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.981 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.982 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.982 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.982 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.982 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.982 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.982 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.982 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.982 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.982 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.982 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.982 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.982 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.982 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.982 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.983 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.983 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.983 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.983 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.983 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.983 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.983 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.983 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.983 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.983 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.983 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.983 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.983 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.983 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.983 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.983 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.984 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.984 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.984 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.984 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.984 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.984 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.984 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.984 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.984 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.984 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.984 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.984 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.984 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.984 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.984 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.984 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.985 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.985 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.985 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.985 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.985 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.985 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.985 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.985 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.985 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.985 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.985 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.985 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.985 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.985 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.985 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.985 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.986 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.986 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.986 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.986 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.986 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.986 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.986 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:00.986 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:00.986 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.986 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:00.986 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.986 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:00.986 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.986 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.986 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.987 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.987 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.987 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.987 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.987 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.987 INFO:teuthology.orchestra.run.smithi069.stdout: "storage_class": { 2024-05-14T15:42:00.987 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "storage_class", 2024-05-14T15:42:00.987 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.987 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.987 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.987 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "local", 2024-05-14T15:42:00.987 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.987 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.987 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.987 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-14T15:42:00.987 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "selftest", 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.988 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.989 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.989 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.989 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.989 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.989 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.989 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.989 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.989 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.989 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.989 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.989 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.989 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.989 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.989 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.989 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:00.989 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:00.990 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.990 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.990 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.990 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.990 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.990 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.990 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.990 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.990 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.990 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.990 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.990 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.990 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:00.990 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:00.990 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.991 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.992 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.992 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:00.992 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:00.992 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.992 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.992 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:00.992 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:00.992 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.992 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.992 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.992 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.992 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.992 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.992 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.992 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.992 INFO:teuthology.orchestra.run.smithi069.stdout: "roption1": { 2024-05-14T15:42:00.993 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption1", 2024-05-14T15:42:00.993 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.993 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.993 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.993 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.993 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.993 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.993 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.993 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.993 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.993 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.993 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.993 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.993 INFO:teuthology.orchestra.run.smithi069.stdout: "roption2": { 2024-05-14T15:42:00.993 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption2", 2024-05-14T15:42:00.993 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.994 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.994 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.994 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "xyz", 2024-05-14T15:42:00.994 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.994 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.994 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.994 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.994 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.994 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.994 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.994 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.994 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption1": { 2024-05-14T15:42:00.994 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption1", 2024-05-14T15:42:00.994 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.994 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.995 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.995 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.995 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.995 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.995 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.995 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.995 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.995 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.995 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.995 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.995 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption2": { 2024-05-14T15:42:00.995 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption2", 2024-05-14T15:42:00.995 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:00.995 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.995 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.995 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption3": { 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption3", 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.996 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.997 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.997 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.997 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.997 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.997 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.997 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption4": { 2024-05-14T15:42:00.997 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption4", 2024-05-14T15:42:00.997 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:00.997 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.997 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.997 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.997 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.997 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.997 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.997 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.997 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption5": { 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption5", 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.998 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.999 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption6": { 2024-05-14T15:42:00.999 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption6", 2024-05-14T15:42:00.999 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:00.999 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:00.999 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:00.999 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:00.999 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:00.999 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:00.999 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:00.999 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:00.999 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:00.999 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:00.999 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:00.999 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:00.999 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption7": { 2024-05-14T15:42:00.999 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption7", 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "42", 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.000 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.001 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.001 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.001 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.001 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.001 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.001 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.001 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.001 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.001 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.001 INFO:teuthology.orchestra.run.smithi069.stdout: "testkey": { 2024-05-14T15:42:01.001 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testkey", 2024-05-14T15:42:01.001 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.001 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.001 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.001 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.001 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.002 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.002 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.002 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.002 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.002 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.002 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.002 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.002 INFO:teuthology.orchestra.run.smithi069.stdout: "testlkey": { 2024-05-14T15:42:01.002 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testlkey", 2024-05-14T15:42:01.002 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.002 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.002 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.002 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.002 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.002 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: "testnewline": { 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testnewline", 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.003 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smb", 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.004 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.005 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.005 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.005 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.005 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.005 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.005 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.005 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.005 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.005 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.005 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.005 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.005 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.005 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.005 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.005 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.006 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.006 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.006 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.006 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.006 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.006 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.006 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.006 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.006 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.006 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.006 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.006 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.006 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.006 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.006 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.006 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.007 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.007 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.007 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.007 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.007 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.007 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.007 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.007 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.007 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.007 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.007 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.007 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.007 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.007 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.007 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.008 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: "update_orchestration": { 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "update_orchestration", 2024-05-14T15:42:01.009 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.010 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.010 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.010 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.010 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.010 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.010 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.010 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-14T15:42:01.010 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.010 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.010 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.010 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.010 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.010 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.010 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.010 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2024-05-14T15:42:01.011 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.011 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.011 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.011 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_m_granularity": { 2024-05-14T15:42:01.011 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_m_granularity", 2024-05-14T15:42:01.011 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.011 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.011 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.011 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.011 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.011 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.011 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.011 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow minute scheduled snapshots", 2024-05-14T15:42:01.011 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.011 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.011 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.012 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.012 INFO:teuthology.orchestra.run.smithi069.stdout: "dump_on_update": { 2024-05-14T15:42:01.012 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dump_on_update", 2024-05-14T15:42:01.012 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.012 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.012 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.012 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.012 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.012 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.012 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.012 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "dump database to debug log on update", 2024-05-14T15:42:01.012 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.012 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.012 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.012 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.012 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.013 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.013 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.013 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.013 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.013 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.013 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.013 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.013 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.013 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.013 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.013 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.013 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.013 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.013 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.013 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.013 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.014 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.014 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.014 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.014 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.014 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.014 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.014 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.014 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.014 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.014 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.014 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.014 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.014 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.014 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.014 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.014 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.015 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.016 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.017 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.018 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.018 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.018 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.018 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stats", 2024-05-14T15:42:01.018 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.018 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.018 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.018 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.018 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.018 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.018 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.018 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.018 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.018 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.018 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.018 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.019 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.020 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.020 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.020 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.020 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.020 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.020 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.020 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.020 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.020 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.020 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.020 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.020 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.020 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.020 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.020 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.020 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.021 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.021 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.021 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.021 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.021 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.021 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.021 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.021 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.021 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.021 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.021 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.021 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.021 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.021 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.021 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.021 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.022 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.022 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.022 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.022 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.022 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.022 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.022 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.022 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.022 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.022 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.022 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.022 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.022 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.022 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.022 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.022 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "status", 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.023 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.024 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.025 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.026 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.026 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.026 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.026 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.026 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.026 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.026 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.026 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.026 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.026 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.026 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.026 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.026 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.026 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.026 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.026 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.027 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.028 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telegraf", 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: "address": { 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "address", 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.029 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.030 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.030 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.030 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.030 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.030 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.030 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-05-14T15:42:01.030 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-05-14T15:42:01.030 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.030 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.030 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.030 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15", 2024-05-14T15:42:01.030 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.030 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.030 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.030 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.031 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.031 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.031 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.031 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.031 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.033 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.033 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.033 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.033 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.033 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.033 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.033 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.033 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.033 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.034 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.034 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.034 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.034 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.034 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.034 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.034 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.034 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.034 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.034 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.034 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.034 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.034 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.034 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.034 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.034 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.035 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.035 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.035 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.035 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.035 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.035 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.035 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.035 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.035 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.035 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.035 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.035 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.035 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.035 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.035 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.036 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.036 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.036 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.036 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.036 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.036 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.036 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.036 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.036 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.036 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.036 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.036 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.036 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.036 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.036 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.037 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.037 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.037 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.037 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.037 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.037 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.037 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.037 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.037 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.037 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.037 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.037 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.037 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.037 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.037 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.037 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.038 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.038 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.038 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.038 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.038 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.038 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.038 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.038 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.038 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.038 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.038 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.038 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.038 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.038 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.039 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.039 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telemetry", 2024-05-14T15:42:01.039 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.039 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.039 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.039 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_basic": { 2024-05-14T15:42:01.039 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_basic", 2024-05-14T15:42:01.039 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.039 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.039 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.039 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.039 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.039 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.039 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.039 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-14T15:42:01.039 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.040 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.040 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.040 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.040 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_crash": { 2024-05-14T15:42:01.040 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_crash", 2024-05-14T15:42:01.040 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.040 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.040 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.040 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.040 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.040 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.040 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.040 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-14T15:42:01.040 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.040 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.040 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_device": { 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_device", 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_ident": { 2024-05-14T15:42:01.041 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_ident", 2024-05-14T15:42:01.042 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.042 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.042 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.042 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.042 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.042 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.042 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.042 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-14T15:42:01.042 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.042 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.042 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.042 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.042 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_perf": { 2024-05-14T15:42:01.042 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_perf", 2024-05-14T15:42:01.042 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.042 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: "contact": { 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "contact", 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.043 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.044 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.044 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.044 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.044 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.044 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.044 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.044 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.044 INFO:teuthology.orchestra.run.smithi069.stdout: "description": { 2024-05-14T15:42:01.044 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "description", 2024-05-14T15:42:01.044 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.044 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.044 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.044 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.044 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.044 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.045 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.045 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.045 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.045 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.045 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.045 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.045 INFO:teuthology.orchestra.run.smithi069.stdout: "device_url": { 2024-05-14T15:42:01.045 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_url", 2024-05-14T15:42:01.045 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.045 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.045 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.045 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-14T15:42:01.045 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.045 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.045 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.045 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.046 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.046 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.046 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.046 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.046 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2024-05-14T15:42:01.046 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2024-05-14T15:42:01.046 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.046 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.046 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.046 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.046 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.046 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.046 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.046 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.046 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.047 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.047 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.047 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.047 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-05-14T15:42:01.047 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-05-14T15:42:01.047 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.047 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.047 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.047 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "24", 2024-05-14T15:42:01.047 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "8", 2024-05-14T15:42:01.047 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.047 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.047 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.047 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.047 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.048 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.048 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.048 INFO:teuthology.orchestra.run.smithi069.stdout: "last_opt_revision": { 2024-05-14T15:42:01.048 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "last_opt_revision", 2024-05-14T15:42:01.048 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.048 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.048 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.048 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1", 2024-05-14T15:42:01.048 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.048 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.048 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.048 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.048 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.048 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.048 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.049 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.049 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard": { 2024-05-14T15:42:01.049 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard", 2024-05-14T15:42:01.049 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.049 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.049 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.049 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.049 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.049 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.049 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.049 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.049 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.049 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.049 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.049 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.049 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard_description": { 2024-05-14T15:42:01.050 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard_description", 2024-05-14T15:42:01.050 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.050 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.050 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.050 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.050 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.050 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.050 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.050 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.050 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.050 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.050 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.050 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.050 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.050 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.051 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.051 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.051 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.051 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.051 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.051 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.051 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.051 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.051 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.051 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.051 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.051 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.051 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.051 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.051 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.052 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.052 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.052 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.052 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.052 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.052 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.052 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.052 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.052 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.052 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.052 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.052 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.052 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.052 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.052 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.053 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.053 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.053 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.053 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.053 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.053 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.053 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.053 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.053 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.053 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.053 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.053 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.053 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.053 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.053 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.054 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.054 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.054 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.054 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.054 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.054 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.054 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.054 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.054 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.054 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.054 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.054 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.054 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.054 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.054 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.055 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.055 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.055 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.055 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.055 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.055 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.055 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.055 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.055 INFO:teuthology.orchestra.run.smithi069.stdout: "organization": { 2024-05-14T15:42:01.055 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "organization", 2024-05-14T15:42:01.055 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.055 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.055 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.055 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.055 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.056 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.056 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.056 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.056 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.056 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.056 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.056 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.056 INFO:teuthology.orchestra.run.smithi069.stdout: "proxy": { 2024-05-14T15:42:01.056 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "proxy", 2024-05-14T15:42:01.056 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.056 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.056 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.056 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.056 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.056 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.057 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.057 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.057 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.057 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.057 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.057 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.057 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.057 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.057 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.057 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.057 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.057 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.057 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.057 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.057 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.057 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.058 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.058 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.058 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.058 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.058 INFO:teuthology.orchestra.run.smithi069.stdout: "url": { 2024-05-14T15:42:01.058 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url", 2024-05-14T15:42:01.058 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.058 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.058 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.058 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-14T15:42:01.058 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.058 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.058 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.058 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.058 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.059 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.059 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.059 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.059 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.059 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.059 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.059 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "test_orchestrator", 2024-05-14T15:42:01.059 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.059 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.059 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.059 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.059 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.059 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.059 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.059 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.060 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.061 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.061 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.061 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.061 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.061 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.061 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.061 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.061 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.061 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.061 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.061 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.061 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.061 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.061 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.061 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.061 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.062 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.062 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.062 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.062 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.062 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.062 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.062 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.062 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.062 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.062 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.062 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.062 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.062 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.062 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.063 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.063 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.063 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.063 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.063 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.063 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.063 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.063 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.063 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.063 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.063 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.063 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.063 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.063 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.064 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.064 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.064 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.064 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.064 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.064 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.064 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.064 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.064 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.064 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.064 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.064 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.064 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.064 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.064 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.064 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.065 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.065 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.065 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.065 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.065 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.065 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.065 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2024-05-14T15:42:01.065 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.065 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.065 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.065 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.065 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.065 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.065 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.065 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.066 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.066 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.066 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.066 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.066 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.066 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.066 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.066 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.066 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.066 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.066 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.066 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.066 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.066 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.066 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.067 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.067 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.067 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.067 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.067 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.067 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.067 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.067 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.067 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.067 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.067 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.067 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.067 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.067 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.067 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.068 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.068 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.068 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.068 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.068 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.068 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.068 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.068 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.068 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.068 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.068 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.068 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.068 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.068 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.068 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.068 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.069 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.069 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.069 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.069 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.069 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.069 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.069 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.069 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.069 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.069 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.069 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.069 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.069 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.069 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.069 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.069 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.070 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.070 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.070 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.070 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_clones": { 2024-05-14T15:42:01.070 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_clones", 2024-05-14T15:42:01.070 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.070 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.070 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.070 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4", 2024-05-14T15:42:01.070 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.070 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.070 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.071 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-14T15:42:01.071 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.071 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.071 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.071 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.071 INFO:teuthology.orchestra.run.smithi069.stdout: "periodic_async_work": { 2024-05-14T15:42:01.071 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "periodic_async_work", 2024-05-14T15:42:01.071 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.071 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.071 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.071 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.071 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.071 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.071 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.072 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Periodically check for async work", 2024-05-14T15:42:01.072 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.072 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.072 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.072 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.072 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_delay": { 2024-05-14T15:42:01.072 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_delay", 2024-05-14T15:42:01.072 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.072 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.072 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.072 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.072 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.072 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.072 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.072 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-14T15:42:01.073 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.073 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.073 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.073 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.073 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_no_wait": { 2024-05-14T15:42:01.073 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_no_wait", 2024-05-14T15:42:01.073 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.073 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.073 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.073 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.073 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.073 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.073 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.073 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-14T15:42:01.073 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.073 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.074 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.074 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.074 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.074 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.074 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.074 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.074 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.074 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.074 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.074 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.074 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.074 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.074 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.074 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.075 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.075 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.075 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.075 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.075 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.075 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix", 2024-05-14T15:42:01.075 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.075 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.075 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.075 INFO:teuthology.orchestra.run.smithi069.stdout: "discovery_interval": { 2024-05-14T15:42:01.075 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "discovery_interval", 2024-05-14T15:42:01.075 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-05-14T15:42:01.075 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.075 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.075 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "100", 2024-05-14T15:42:01.076 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.076 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.076 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.076 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.076 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.076 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.076 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.076 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.076 INFO:teuthology.orchestra.run.smithi069.stdout: "identifier": { 2024-05-14T15:42:01.076 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "identifier", 2024-05-14T15:42:01.076 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.076 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.076 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.076 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.076 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.076 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.077 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.078 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.078 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.078 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.078 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.078 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.078 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.078 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.078 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.078 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.078 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.078 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.078 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.078 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.078 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.078 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.079 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.080 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.081 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.081 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.081 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.081 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.081 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.081 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.081 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.081 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.081 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.081 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.081 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.081 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.081 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.081 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.081 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.081 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.082 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.082 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.082 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.082 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.082 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.082 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.082 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.082 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.082 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.082 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.082 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.082 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.082 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.082 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.083 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.083 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.083 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.083 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.083 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.083 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.083 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.083 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_host": { 2024-05-14T15:42:01.083 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_host", 2024-05-14T15:42:01.083 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.083 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.083 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.083 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.083 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.084 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.084 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.084 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.084 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.084 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.084 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.084 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.084 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_port": { 2024-05-14T15:42:01.084 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_port", 2024-05-14T15:42:01.084 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.084 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.084 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.084 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10051", 2024-05-14T15:42:01.084 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.084 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.084 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_sender": { 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_sender", 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.085 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.086 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.086 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.086 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.086 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.086 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-05-14T15:42:01.086 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.086 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.086 INFO:teuthology.orchestra.run.smithi069.stdout: "gid": 34988, 2024-05-14T15:42:01.086 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "y", 2024-05-14T15:42:01.086 INFO:teuthology.orchestra.run.smithi069.stdout: "mgr_features": 4540701547738038271, 2024-05-14T15:42:01.086 INFO:teuthology.orchestra.run.smithi069.stdout: "available_modules": [ 2024-05-14T15:42:01.086 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.086 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alerts", 2024-05-14T15:42:01.086 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.087 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.087 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.087 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-05-14T15:42:01.087 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-05-14T15:42:01.087 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.087 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.087 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.087 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-05-14T15:42:01.087 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.087 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.087 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.087 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How frequently to reexamine health status", 2024-05-14T15:42:01.087 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.087 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.087 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.088 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.089 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.090 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.090 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.090 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.090 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.090 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.090 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.090 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.090 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.090 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.090 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.090 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.090 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.090 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.090 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.090 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.091 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.091 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.091 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.091 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.091 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.091 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.091 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.091 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.091 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.091 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.091 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.091 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.091 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.091 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.091 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.091 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_destination": { 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_destination", 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email address to send alerts to", 2024-05-14T15:42:01.092 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_from_name": { 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_from_name", 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "Ceph", 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email From: name", 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.093 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.094 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_host": { 2024-05-14T15:42:01.094 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_host", 2024-05-14T15:42:01.094 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.094 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.094 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.094 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.094 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.094 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.094 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.094 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP server", 2024-05-14T15:42:01.094 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.094 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.094 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.094 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.094 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_password": { 2024-05-14T15:42:01.095 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_password", 2024-05-14T15:42:01.095 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.095 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.095 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.095 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.095 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.095 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.095 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.095 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Password to authenticate with", 2024-05-14T15:42:01.095 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.095 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.095 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.095 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.095 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_port": { 2024-05-14T15:42:01.095 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_port", 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "465", 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP port", 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_sender": { 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_sender", 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.096 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.097 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.097 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.097 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.097 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.097 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP envelope sender", 2024-05-14T15:42:01.097 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.097 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.097 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.097 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.097 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_ssl": { 2024-05-14T15:42:01.097 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_ssl", 2024-05-14T15:42:01.097 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.097 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.097 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.097 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.097 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.098 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.098 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.098 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-14T15:42:01.098 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.098 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.098 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.098 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.098 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_user": { 2024-05-14T15:42:01.098 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_user", 2024-05-14T15:42:01.098 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.098 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.098 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.098 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.098 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.098 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.099 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.099 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "User to authenticate as", 2024-05-14T15:42:01.099 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.099 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.099 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.099 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.099 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.099 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.099 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.099 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.099 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.099 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.099 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.099 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.100 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.100 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.100 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.100 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.100 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.100 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.100 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.100 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.100 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.100 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "balancer", 2024-05-14T15:42:01.100 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.100 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.100 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.100 INFO:teuthology.orchestra.run.smithi069.stdout: "active": { 2024-05-14T15:42:01.100 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "active", 2024-05-14T15:42:01.101 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.101 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.101 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.101 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.101 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.101 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.101 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.101 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically balance PGs across cluster", 2024-05-14T15:42:01.101 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.101 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.101 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.101 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.101 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_time": { 2024-05-14T15:42:01.101 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_time", 2024-05-14T15:42:01.101 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.101 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.102 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.102 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0000", 2024-05-14T15:42:01.102 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.102 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.102 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.102 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "beginning time of day to automatically balance", 2024-05-14T15:42:01.102 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T15:42:01.102 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.102 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.102 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.102 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_weekday": { 2024-05-14T15:42:01.102 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_weekday", 2024-05-14T15:42:01.102 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-05-14T15:42:01.103 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.103 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.103 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.103 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2024-05-14T15:42:01.103 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2024-05-14T15:42:01.103 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.103 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-14T15:42:01.103 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T15:42:01.103 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.103 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.103 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.103 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_max_iterations": { 2024-05-14T15:42:01.103 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_max_iterations", 2024-05-14T15:42:01.103 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-05-14T15:42:01.103 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.103 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.104 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "25", 2024-05-14T15:42:01.104 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-05-14T15:42:01.104 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "250", 2024-05-14T15:42:01.104 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.104 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-14T15:42:01.104 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.104 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.104 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.104 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.104 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_metrics": { 2024-05-14T15:42:01.104 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_metrics", 2024-05-14T15:42:01.104 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.104 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.104 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.104 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "pgs,objects,bytes", 2024-05-14T15:42:01.105 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.105 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.105 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.105 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-14T15:42:01.105 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-14T15:42:01.105 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.105 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.105 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.105 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_step": { 2024-05-14T15:42:01.105 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_step", 2024-05-14T15:42:01.105 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:01.105 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.105 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.105 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.5", 2024-05-14T15:42:01.105 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0.001", 2024-05-14T15:42:01.106 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "0.999", 2024-05-14T15:42:01.106 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.106 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "aggressiveness of optimization", 2024-05-14T15:42:01.106 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-14T15:42:01.106 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.106 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.106 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.106 INFO:teuthology.orchestra.run.smithi069.stdout: "end_time": { 2024-05-14T15:42:01.106 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_time", 2024-05-14T15:42:01.106 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.106 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.106 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.106 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2359", 2024-05-14T15:42:01.107 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.107 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.107 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.107 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ending time of day to automatically balance", 2024-05-14T15:42:01.107 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T15:42:01.107 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.107 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.107 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.107 INFO:teuthology.orchestra.run.smithi069.stdout: "end_weekday": { 2024-05-14T15:42:01.107 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_weekday", 2024-05-14T15:42:01.107 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-05-14T15:42:01.107 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.107 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.107 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.107 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2024-05-14T15:42:01.108 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2024-05-14T15:42:01.108 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.108 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-14T15:42:01.108 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T15:42:01.108 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.108 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.108 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.108 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.108 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.108 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.108 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.108 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.108 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.108 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.108 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.109 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.110 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.110 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.110 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.110 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.110 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.110 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.110 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.110 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.110 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.110 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.110 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.110 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.110 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.110 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.110 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.111 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: "min_score": { 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_score", 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:01.112 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.113 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.113 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.113 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.113 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.113 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.113 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-14T15:42:01.113 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.113 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.113 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.113 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.113 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2024-05-14T15:42:01.113 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2024-05-14T15:42:01.113 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.113 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.113 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.113 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "upmap", 2024-05-14T15:42:01.114 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.114 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.114 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.114 INFO:teuthology.orchestra.run.smithi069.stdout: "crush-compat", 2024-05-14T15:42:01.114 INFO:teuthology.orchestra.run.smithi069.stdout: "none", 2024-05-14T15:42:01.114 INFO:teuthology.orchestra.run.smithi069.stdout: "read", 2024-05-14T15:42:01.114 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap", 2024-05-14T15:42:01.114 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap-read" 2024-05-14T15:42:01.114 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.114 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Balancer mode", 2024-05-14T15:42:01.114 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.114 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.114 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.114 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.114 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_ids": { 2024-05-14T15:42:01.114 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_ids", 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.115 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.116 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_deviation": { 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_deviation", 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-14T15:42:01.117 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-14T15:42:01.118 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.118 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.118 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.118 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_optimizations": { 2024-05-14T15:42:01.118 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_optimizations", 2024-05-14T15:42:01.118 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-05-14T15:42:01.118 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.118 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.118 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:01.118 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.118 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.118 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.118 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-14T15:42:01.118 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.119 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.119 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.119 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.119 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.119 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.119 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.119 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm", 2024-05-14T15:42:01.119 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.119 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.119 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.119 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_down_multiplier": { 2024-05-14T15:42:01.119 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_down_multiplier", 2024-05-14T15:42:01.119 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:01.119 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.119 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2024-05-14T15:42:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-14T15:42:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_refresh_rate": { 2024-05-14T15:42:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_refresh_rate", 2024-05-14T15:42:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "20", 2024-05-14T15:42:01.120 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.121 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.121 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.121 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-14T15:42:01.121 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.121 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.121 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.121 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.121 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_starting_port": { 2024-05-14T15:42:01.121 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_starting_port", 2024-05-14T15:42:01.121 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.121 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.121 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.121 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4721", 2024-05-14T15:42:01.121 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.121 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.121 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.122 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-14T15:42:01.122 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.122 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.122 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.122 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.122 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_ptrace": { 2024-05-14T15:42:01.122 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_ptrace", 2024-05-14T15:42:01.122 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.122 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.122 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.122 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.122 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.122 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.122 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.122 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_interval": { 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_interval", 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.123 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.124 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.124 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_memory_target_ratio": { 2024-05-14T15:42:01.124 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_memory_target_ratio", 2024-05-14T15:42:01.124 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:01.124 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.124 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.124 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.7", 2024-05-14T15:42:01.124 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.124 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.124 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.124 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-14T15:42:01.124 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.124 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.124 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.124 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.124 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm_log_destination": { 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm_log_destination", 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: "file", 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: "file,syslog", 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: "syslog" 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.125 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.126 INFO:teuthology.orchestra.run.smithi069.stdout: "cgroups_split": { 2024-05-14T15:42:01.126 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cgroups_split", 2024-05-14T15:42:01.126 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.126 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.126 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.126 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.126 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.126 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.126 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.126 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-14T15:42:01.126 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.126 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.126 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.126 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.126 INFO:teuthology.orchestra.run.smithi069.stdout: "config_checks_enabled": { 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_checks_enabled", 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: "config_dashboard": { 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_dashboard", 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.127 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-14T15:42:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_alertmanager": { 2024-05-14T15:42:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_alertmanager", 2024-05-14T15:42:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.128 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-14T15:42:01.129 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.129 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.129 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.129 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-05-14T15:42:01.129 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.129 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.129 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.129 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.129 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_base": { 2024-05-14T15:42:01.129 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_base", 2024-05-14T15:42:01.129 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.129 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.129 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.129 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-14T15:42:01.129 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.129 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.130 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.130 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Container image name, without the tag", 2024-05-14T15:42:01.130 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.130 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.130 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.130 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.130 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_elasticsearch": { 2024-05-14T15:42:01.130 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_elasticsearch", 2024-05-14T15:42:01.130 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.130 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.130 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.130 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-14T15:42:01.130 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.130 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.130 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.130 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "elasticsearch container image", 2024-05-14T15:42:01.131 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.131 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.131 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.131 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.131 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_grafana": { 2024-05-14T15:42:01.131 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_grafana", 2024-05-14T15:42:01.131 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.131 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.131 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.131 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-14T15:42:01.131 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.131 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.131 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.131 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-05-14T15:42:01.131 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.131 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.132 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.132 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.132 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_haproxy": { 2024-05-14T15:42:01.132 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_haproxy", 2024-05-14T15:42:01.132 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.132 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.132 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.132 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-14T15:42:01.132 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.132 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.132 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.132 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "HAproxy container image", 2024-05-14T15:42:01.132 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.132 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.132 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.133 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.133 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_agent": { 2024-05-14T15:42:01.133 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_agent", 2024-05-14T15:42:01.133 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.133 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.133 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.133 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-14T15:42:01.133 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.133 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.133 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.133 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger agent container image", 2024-05-14T15:42:01.133 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.133 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.133 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.133 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.134 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_collector": { 2024-05-14T15:42:01.134 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_collector", 2024-05-14T15:42:01.134 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.134 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.134 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.134 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-14T15:42:01.134 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.134 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.134 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.134 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger collector container image", 2024-05-14T15:42:01.134 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.134 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.134 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.134 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.135 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_query": { 2024-05-14T15:42:01.135 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_query", 2024-05-14T15:42:01.135 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.135 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.135 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.135 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-14T15:42:01.135 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.135 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.135 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.135 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger query container image", 2024-05-14T15:42:01.135 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.135 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.135 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.135 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.135 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_keepalived": { 2024-05-14T15:42:01.135 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_keepalived", 2024-05-14T15:42:01.136 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.136 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.136 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.136 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-14T15:42:01.136 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.136 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.136 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.136 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Keepalived container image", 2024-05-14T15:42:01.136 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.136 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.136 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.136 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.136 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_loki": { 2024-05-14T15:42:01.136 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_loki", 2024-05-14T15:42:01.136 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.136 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.137 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.137 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-14T15:42:01.137 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.137 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.137 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.137 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Loki container image", 2024-05-14T15:42:01.137 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.137 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.137 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.137 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.137 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_node_exporter": { 2024-05-14T15:42:01.137 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_node_exporter", 2024-05-14T15:42:01.137 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.137 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.137 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.137 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-14T15:42:01.138 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.138 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.138 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.138 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-05-14T15:42:01.138 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.138 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.138 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.138 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.138 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_nvmeof": { 2024-05-14T15:42:01.138 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_nvmeof", 2024-05-14T15:42:01.138 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.138 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.138 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.138 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-14T15:42:01.139 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.139 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.139 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.139 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Nvme-of container image", 2024-05-14T15:42:01.139 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.139 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.139 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.139 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.139 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_prometheus": { 2024-05-14T15:42:01.139 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_prometheus", 2024-05-14T15:42:01.139 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.139 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.139 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.139 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-14T15:42:01.139 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.140 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.140 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.140 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-05-14T15:42:01.140 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.140 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.140 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.140 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.140 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_promtail": { 2024-05-14T15:42:01.140 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_promtail", 2024-05-14T15:42:01.140 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.140 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.140 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.140 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-14T15:42:01.140 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.140 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.141 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.141 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Promtail container image", 2024-05-14T15:42:01.141 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.141 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.141 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.141 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.141 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_samba": { 2024-05-14T15:42:01.141 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_samba", 2024-05-14T15:42:01.141 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.141 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.141 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.141 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-14T15:42:01.141 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.141 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.141 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.141 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Samba/SMB container image", 2024-05-14T15:42:01.142 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.142 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.142 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.142 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.142 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_snmp_gateway": { 2024-05-14T15:42:01.142 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_snmp_gateway", 2024-05-14T15:42:01.142 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.142 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.142 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.142 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-14T15:42:01.142 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.142 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.142 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.142 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SNMP Gateway container image", 2024-05-14T15:42:01.142 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.143 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.143 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.143 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.143 INFO:teuthology.orchestra.run.smithi069.stdout: "container_init": { 2024-05-14T15:42:01.143 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_init", 2024-05-14T15:42:01.143 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.143 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.143 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.143 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.143 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.143 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.143 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.143 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Run podman/docker with `--init`", 2024-05-14T15:42:01.143 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.143 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.144 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.144 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.144 INFO:teuthology.orchestra.run.smithi069.stdout: "daemon_cache_timeout": { 2024-05-14T15:42:01.144 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "daemon_cache_timeout", 2024-05-14T15:42:01.144 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.144 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.144 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.144 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-05-14T15:42:01.144 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.144 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.144 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.144 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-14T15:42:01.144 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.144 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.144 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.145 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.145 INFO:teuthology.orchestra.run.smithi069.stdout: "default_cephadm_command_timeout": { 2024-05-14T15:42:01.145 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_cephadm_command_timeout", 2024-05-14T15:42:01.145 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.145 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.145 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.145 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "900", 2024-05-14T15:42:01.145 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.145 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.145 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.145 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-14T15:42:01.145 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.145 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.145 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.145 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.146 INFO:teuthology.orchestra.run.smithi069.stdout: "default_registry": { 2024-05-14T15:42:01.146 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_registry", 2024-05-14T15:42:01.146 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.146 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.146 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.146 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io", 2024-05-14T15:42:01.146 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.146 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.146 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.146 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-14T15:42:01.146 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.146 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.146 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.146 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.147 INFO:teuthology.orchestra.run.smithi069.stdout: "device_cache_timeout": { 2024-05-14T15:42:01.147 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_cache_timeout", 2024-05-14T15:42:01.147 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.147 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.147 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.147 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1800", 2024-05-14T15:42:01.147 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.147 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.147 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.147 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache device inventory", 2024-05-14T15:42:01.147 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.147 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.147 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.147 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.147 INFO:teuthology.orchestra.run.smithi069.stdout: "device_enhanced_scan": { 2024-05-14T15:42:01.147 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_enhanced_scan", 2024-05-14T15:42:01.148 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.148 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.148 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.148 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.148 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.148 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.148 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.148 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-14T15:42:01.148 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.148 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.148 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.148 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.148 INFO:teuthology.orchestra.run.smithi069.stdout: "facts_cache_timeout": { 2024-05-14T15:42:01.148 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "facts_cache_timeout", 2024-05-14T15:42:01.148 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.148 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.149 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.149 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-05-14T15:42:01.149 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.149 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.149 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.149 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache host facts data", 2024-05-14T15:42:01.149 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.149 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.149 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.149 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.149 INFO:teuthology.orchestra.run.smithi069.stdout: "grafana_dashboards_path": { 2024-05-14T15:42:01.149 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "grafana_dashboards_path", 2024-05-14T15:42:01.149 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.149 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.149 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.149 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-14T15:42:01.150 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.150 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.150 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.150 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-14T15:42:01.150 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.150 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.150 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.150 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.150 INFO:teuthology.orchestra.run.smithi069.stdout: "host_check_interval": { 2024-05-14T15:42:01.150 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "host_check_interval", 2024-05-14T15:42:01.150 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.150 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.150 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.150 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-05-14T15:42:01.151 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.151 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.151 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.151 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to perform a host check", 2024-05-14T15:42:01.151 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.151 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.151 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.151 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.151 INFO:teuthology.orchestra.run.smithi069.stdout: "hw_monitoring": { 2024-05-14T15:42:01.151 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hw_monitoring", 2024-05-14T15:42:01.151 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.151 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.151 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.151 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.152 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.152 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.152 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.152 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-14T15:42:01.152 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.152 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.152 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.152 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.152 INFO:teuthology.orchestra.run.smithi069.stdout: "inventory_list_all": { 2024-05-14T15:42:01.152 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "inventory_list_all", 2024-05-14T15:42:01.152 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.152 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.152 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.152 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.152 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.152 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.153 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.153 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-14T15:42:01.153 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.153 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.153 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.153 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.153 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.153 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.153 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.153 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.153 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.153 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.153 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.153 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.153 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.154 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.154 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.154 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.154 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.154 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.154 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.154 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.154 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.154 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.154 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.154 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.154 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.154 INFO:teuthology.orchestra.run.smithi069.stdout: "log_refresh_metadata": { 2024-05-14T15:42:01.154 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_refresh_metadata", 2024-05-14T15:42:01.155 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.155 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.155 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.155 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.155 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.155 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.155 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.155 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-14T15:42:01.155 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.155 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.155 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.155 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.155 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.155 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.155 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-14T15:42:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.156 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.157 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.158 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.158 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.158 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.158 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.158 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.158 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.158 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.158 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.158 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.158 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.158 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.158 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.158 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.158 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.158 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-14T15:42:01.159 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-14T15:42:01.159 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.159 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.159 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.159 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.159 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.159 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.159 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.159 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-14T15:42:01.159 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.159 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.159 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.159 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.159 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-14T15:42:01.159 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-14T15:42:01.160 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.160 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.160 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.160 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "*", 2024-05-14T15:42:01.160 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.160 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.160 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.160 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-14T15:42:01.160 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.160 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.160 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.160 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.160 INFO:teuthology.orchestra.run.smithi069.stdout: "max_count_per_host": { 2024-05-14T15:42:01.160 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_count_per_host", 2024-05-14T15:42:01.160 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.161 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.161 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.161 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:01.161 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.161 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.161 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.161 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of daemons per service per host", 2024-05-14T15:42:01.161 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.161 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.161 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.161 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.161 INFO:teuthology.orchestra.run.smithi069.stdout: "max_osd_draining_count": { 2024-05-14T15:42:01.161 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_osd_draining_count", 2024-05-14T15:42:01.161 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.161 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.161 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.162 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:01.162 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.162 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.162 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.162 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-14T15:42:01.162 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.162 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.162 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.162 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.162 INFO:teuthology.orchestra.run.smithi069.stdout: "migration_current": { 2024-05-14T15:42:01.162 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "migration_current", 2024-05-14T15:42:01.162 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.163 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.163 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.163 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.163 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.163 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.163 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.163 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "internal - do not modify", 2024-05-14T15:42:01.163 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.163 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.163 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.163 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.163 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2024-05-14T15:42:01.163 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2024-05-14T15:42:01.163 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.164 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.164 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.164 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "root", 2024-05-14T15:42:01.164 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.164 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.164 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.164 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm-package", 2024-05-14T15:42:01.164 INFO:teuthology.orchestra.run.smithi069.stdout: "root" 2024-05-14T15:42:01.164 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.164 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "mode for remote execution of cephadm", 2024-05-14T15:42:01.165 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.165 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.165 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.165 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.165 INFO:teuthology.orchestra.run.smithi069.stdout: "oob_default_addr": { 2024-05-14T15:42:01.165 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "oob_default_addr", 2024-05-14T15:42:01.165 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.165 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.166 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.166 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "169.254.1.1", 2024-05-14T15:42:01.166 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.166 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.166 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.166 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-14T15:42:01.166 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.167 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.167 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.167 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.167 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_alerts_path": { 2024-05-14T15:42:01.167 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_alerts_path", 2024-05-14T15:42:01.167 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.167 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.167 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.167 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-14T15:42:01.167 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.167 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.167 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.168 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-14T15:42:01.168 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.168 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.168 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.168 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.168 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_insecure": { 2024-05-14T15:42:01.168 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_insecure", 2024-05-14T15:42:01.168 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.168 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.168 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.168 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.168 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.168 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.168 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.169 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-14T15:42:01.169 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.169 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.169 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.169 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.169 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_password": { 2024-05-14T15:42:01.169 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_password", 2024-05-14T15:42:01.169 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.169 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.169 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.169 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.169 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.169 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.169 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.169 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-14T15:42:01.170 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.170 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.170 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.170 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.170 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_url": { 2024-05-14T15:42:01.170 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_url", 2024-05-14T15:42:01.170 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.170 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.170 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.170 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.170 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.170 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.170 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.170 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-14T15:42:01.170 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_username": { 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_username", 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.171 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.172 INFO:teuthology.orchestra.run.smithi069.stdout: "secure_monitoring_stack": { 2024-05-14T15:42:01.172 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "secure_monitoring_stack", 2024-05-14T15:42:01.172 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.172 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.172 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.172 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.172 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.172 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.172 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.172 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-14T15:42:01.172 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.172 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.172 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.172 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.172 INFO:teuthology.orchestra.run.smithi069.stdout: "service_discovery_port": { 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "service_discovery_port", 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8765", 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "cephadm service discovery port", 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.173 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.174 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.174 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.174 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.174 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.174 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.174 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.174 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.174 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.174 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.174 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.174 INFO:teuthology.orchestra.run.smithi069.stdout: "ssh_config_file": { 2024-05-14T15:42:01.174 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssh_config_file", 2024-05-14T15:42:01.174 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.174 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.174 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.174 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.175 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.175 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.175 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.175 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-14T15:42:01.175 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.175 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.175 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.175 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.175 INFO:teuthology.orchestra.run.smithi069.stdout: "use_agent": { 2024-05-14T15:42:01.175 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_agent", 2024-05-14T15:42:01.175 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.175 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.175 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.175 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.175 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.175 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.176 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.176 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-14T15:42:01.176 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.176 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.176 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.176 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.176 INFO:teuthology.orchestra.run.smithi069.stdout: "use_repo_digest": { 2024-05-14T15:42:01.176 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_repo_digest", 2024-05-14T15:42:01.176 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.176 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.176 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.176 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.176 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.176 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.176 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.176 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_failed_host_check": { 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_failed_host_check", 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if the host check fails", 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.177 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.178 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.178 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_daemons": { 2024-05-14T15:42:01.178 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_daemons", 2024-05-14T15:42:01.178 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.178 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.178 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.178 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.178 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.178 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.178 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.178 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-14T15:42:01.178 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.178 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.178 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.178 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.179 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_hosts": { 2024-05-14T15:42:01.179 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_hosts", 2024-05-14T15:42:01.179 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.179 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.179 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.179 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.179 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.179 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.179 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.179 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-14T15:42:01.179 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.179 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.179 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.179 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.179 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.179 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crash", 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.180 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.181 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.181 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.181 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.181 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.181 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.181 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.181 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.181 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.181 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.181 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.181 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.181 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.181 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.181 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.181 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.181 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.182 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.182 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.182 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.182 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.182 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.182 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.182 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.182 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.182 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.182 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.182 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.182 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.182 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.182 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.182 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.182 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.183 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.183 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.183 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.183 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.183 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.183 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.183 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.183 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.183 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.183 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.183 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.183 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.183 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.183 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.183 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.183 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.184 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.184 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.184 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.184 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.184 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.184 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.184 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.184 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.184 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.184 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.184 INFO:teuthology.orchestra.run.smithi069.stdout: "retain_interval": { 2024-05-14T15:42:01.184 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retain_interval", 2024-05-14T15:42:01.184 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.184 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.184 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.184 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "31536000", 2024-05-14T15:42:01.185 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.185 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.185 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.185 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-14T15:42:01.185 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.185 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.185 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.185 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.185 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.185 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.185 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.185 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.185 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.185 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.185 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.185 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.186 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.186 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.186 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.186 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.186 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.186 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.186 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_recent_interval": { 2024-05-14T15:42:01.186 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_recent_interval", 2024-05-14T15:42:01.186 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.186 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.186 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.186 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1209600", 2024-05-14T15:42:01.186 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.186 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.187 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.187 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-14T15:42:01.187 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.187 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.187 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.187 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.187 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.187 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.187 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.187 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dashboard", 2024-05-14T15:42:01.187 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.187 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.187 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.187 INFO:teuthology.orchestra.run.smithi069.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-14T15:42:01.187 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-14T15:42:01.188 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.188 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.188 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.188 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:01.188 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.188 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.188 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.188 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.188 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.188 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.188 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.188 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.188 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_HOST": { 2024-05-14T15:42:01.188 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-14T15:42:01.188 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.189 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.189 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.189 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.189 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.189 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.189 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.189 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.189 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.189 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.189 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.189 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.189 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-14T15:42:01.189 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-14T15:42:01.189 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.189 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.189 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.190 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.190 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.190 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.190 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.190 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.190 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.190 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.190 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.190 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.190 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_ENABLED": { 2024-05-14T15:42:01.190 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_ENABLED", 2024-05-14T15:42:01.190 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.190 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.190 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.190 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.190 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.191 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.191 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.191 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.191 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.191 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.191 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.191 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.191 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-14T15:42:01.191 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-14T15:42:01.191 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.191 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.191 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.191 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.191 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.192 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.192 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.192 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.192 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.192 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.192 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.192 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.192 INFO:teuthology.orchestra.run.smithi069.stdout: "ENABLE_BROWSABLE_API": { 2024-05-14T15:42:01.192 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-14T15:42:01.192 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.192 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.192 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.192 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.192 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.192 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.192 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.193 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.193 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.193 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.193 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.193 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.193 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-14T15:42:01.193 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-14T15:42:01.193 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.193 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.193 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.193 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.193 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.193 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.193 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.193 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.194 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.194 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.194 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.194 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.194 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-14T15:42:01.194 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-14T15:42:01.194 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.194 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.194 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.194 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.194 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.194 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.194 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.194 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.195 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.195 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.195 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.195 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.195 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-14T15:42:01.195 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-14T15:42:01.195 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.195 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.195 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.195 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.195 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.195 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.195 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.195 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.195 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.196 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.196 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.196 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.196 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-14T15:42:01.196 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-14T15:42:01.196 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.196 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.196 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.196 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.196 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.196 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.196 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.196 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.196 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.196 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.197 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.197 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.197 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-14T15:42:01.197 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-14T15:42:01.197 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.197 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.197 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.197 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.197 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.197 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.197 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.197 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.197 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.197 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.198 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.198 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.198 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-14T15:42:01.198 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-14T15:42:01.198 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.198 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.198 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.198 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.198 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.198 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.198 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.198 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.198 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.198 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.198 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.199 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.199 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-14T15:42:01.199 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-14T15:42:01.199 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.199 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.199 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.199 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.199 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.199 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.199 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.199 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.199 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.199 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.199 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.199 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.200 INFO:teuthology.orchestra.run.smithi069.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-14T15:42:01.200 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-14T15:42:01.200 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.200 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.200 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.200 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.200 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.200 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.200 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.200 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.200 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.200 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.200 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.200 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.200 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_PASSWORD": { 2024-05-14T15:42:01.201 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-14T15:42:01.201 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.201 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.201 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.201 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-05-14T15:42:01.201 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.201 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.201 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.201 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.201 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.201 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.201 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.201 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.201 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-14T15:42:01.201 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-14T15:42:01.201 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.202 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.202 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.202 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.202 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.202 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.202 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.202 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.202 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.202 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.202 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.202 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.202 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_URL": { 2024-05-14T15:42:01.202 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_URL", 2024-05-14T15:42:01.202 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.202 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.203 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.203 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.203 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.203 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.203 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.203 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.203 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.203 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.203 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.203 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.203 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_USERNAME": { 2024-05-14T15:42:01.203 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-14T15:42:01.203 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.203 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.203 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-05-14T15:42:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-14T15:42:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-14T15:42:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.204 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.205 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.205 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.205 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.205 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.205 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.205 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.205 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.205 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-14T15:42:01.205 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-14T15:42:01.205 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.205 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.205 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.205 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.205 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.205 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.206 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.206 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.206 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.206 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.206 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.206 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.206 INFO:teuthology.orchestra.run.smithi069.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-14T15:42:01.206 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-14T15:42:01.206 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.206 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.206 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.206 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.206 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.206 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.206 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.206 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.207 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.207 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.207 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.207 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.207 INFO:teuthology.orchestra.run.smithi069.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-14T15:42:01.207 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-14T15:42:01.207 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.207 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.207 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.207 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.207 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.207 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.207 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.207 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.207 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.207 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "[]", 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.208 INFO:teuthology.orchestra.run.smithi069.stdout: "MULTICLUSTER_CONFIG": { 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "{}", 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_HOST": { 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.209 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.210 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.210 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.210 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.210 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.210 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.210 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.210 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.210 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.210 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.210 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.210 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-14T15:42:01.210 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-14T15:42:01.210 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.210 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.210 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.210 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.211 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.211 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.211 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.211 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.211 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.211 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.211 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.211 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.211 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-14T15:42:01.211 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-14T15:42:01.211 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.211 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.211 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.211 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.211 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.211 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.212 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.213 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.214 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-14T15:42:01.214 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-14T15:42:01.214 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.214 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.214 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.214 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.214 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.214 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.214 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.214 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.214 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.214 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.214 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.214 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.214 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-14T15:42:01.215 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-14T15:42:01.215 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.215 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.215 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.215 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.215 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.215 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.215 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.215 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.215 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.215 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.215 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.215 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.215 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-14T15:42:01.215 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-14T15:42:01.215 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.216 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.217 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.217 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.217 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.217 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.217 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.217 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.217 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.217 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.217 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_ENABLED": { 2024-05-14T15:42:01.217 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-14T15:42:01.217 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.217 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.217 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.217 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.217 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.217 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.218 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.218 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.218 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.218 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.218 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.218 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.218 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-14T15:42:01.218 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-14T15:42:01.218 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.218 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.218 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.218 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-14T15:42:01.218 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.218 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.218 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.218 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.219 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8", 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-14T15:42:01.220 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "45", 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ACCESS_KEY": { 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.221 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.222 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.222 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.222 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.222 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.222 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.222 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.222 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.222 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.222 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.222 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-14T15:42:01.222 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-14T15:42:01.222 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.222 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.222 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.222 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-05-14T15:42:01.223 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.223 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.223 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.223 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.223 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.223 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.223 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.223 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.223 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SECRET_KEY": { 2024-05-14T15:42:01.223 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-14T15:42:01.223 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.223 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.223 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.223 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.223 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.223 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SSL_VERIFY": { 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.224 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: "UNSAFE_TLS_v1_2": { 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.225 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.226 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-14T15:42:01.226 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-14T15:42:01.226 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.226 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.226 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.226 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.226 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.226 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.226 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.226 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.226 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.226 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.226 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.226 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.226 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.227 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: "cross_origin_url": { 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cross_origin_url", 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.228 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: "crt_file": { 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crt_file", 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.229 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.230 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.230 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.230 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.230 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.230 INFO:teuthology.orchestra.run.smithi069.stdout: "debug": { 2024-05-14T15:42:01.230 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "debug", 2024-05-14T15:42:01.230 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.230 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.230 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.230 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.230 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.230 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.230 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.230 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable/disable debug options", 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: "jwt_token_ttl": { 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "jwt_token_ttl", 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "28800", 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.231 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.232 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.233 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.233 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.233 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.233 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.233 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.233 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.233 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.233 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.233 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.233 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.233 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.233 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.233 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.233 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.233 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.233 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.234 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.234 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.234 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.234 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.234 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.234 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.234 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.234 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.234 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.234 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.234 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.234 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.234 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.234 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.234 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.235 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.235 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.237 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.237 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.237 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.237 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.237 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.237 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.237 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.237 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.238 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.238 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.238 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.238 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.238 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.238 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.238 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.238 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.238 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.238 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.238 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.238 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.238 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.238 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.238 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.238 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: "motd": { 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "motd", 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.239 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.240 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.240 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.240 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.240 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "The message of the day", 2024-05-14T15:42:01.240 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.240 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.240 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.240 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.240 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect_resolve_ip_addr": { 2024-05-14T15:42:01.240 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "redirect_resolve_ip_addr", 2024-05-14T15:42:01.240 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.240 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.240 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.240 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.240 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.240 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.241 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.241 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.241 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.241 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.241 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.241 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.241 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-05-14T15:42:01.241 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-05-14T15:42:01.241 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.241 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.241 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.241 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2024-05-14T15:42:01.241 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.241 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.241 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.241 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.242 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.242 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.242 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.242 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.242 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-05-14T15:42:01.242 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-05-14T15:42:01.242 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.242 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.242 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.242 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8080", 2024-05-14T15:42:01.242 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.242 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.242 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.242 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.242 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.242 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.243 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl_server_port": { 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl_server_port", 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.244 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.245 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.245 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8443", 2024-05-14T15:42:01.245 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.245 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.245 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.245 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.245 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.245 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.245 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.245 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.245 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2024-05-14T15:42:01.245 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2024-05-14T15:42:01.245 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.245 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.245 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.245 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "redirect", 2024-05-14T15:42:01.246 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.246 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.246 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.246 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.246 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect" 2024-05-14T15:42:01.246 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.246 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.246 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.246 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.246 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.246 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.246 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2024-05-14T15:42:01.246 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2024-05-14T15:42:01.246 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.246 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.246 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.247 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2024-05-14T15:42:01.247 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2024-05-14T15:42:01.247 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2024-05-14T15:42:01.247 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.247 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.247 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.247 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.247 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.247 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.247 INFO:teuthology.orchestra.run.smithi069.stdout: "url_prefix": { 2024-05-14T15:42:01.247 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url_prefix", 2024-05-14T15:42:01.247 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.247 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.247 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.247 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.247 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.248 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.248 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.248 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.248 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.248 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.248 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.248 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.248 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.248 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.248 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.248 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2024-05-14T15:42:01.248 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.248 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.248 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.248 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_monitoring": { 2024-05-14T15:42:01.248 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_monitoring", 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "monitor device health metrics", 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.249 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.250 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.250 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.250 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.250 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.250 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.250 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.250 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.250 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.250 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.250 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.250 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.250 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.250 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.250 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.250 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.251 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.251 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.251 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.251 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.251 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.251 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.251 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.251 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.251 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.251 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.251 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.251 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.251 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.251 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.251 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.251 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.252 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.252 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.252 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.252 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.252 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.252 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.252 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.252 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.252 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.252 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.252 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.252 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.252 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.252 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.252 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.252 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.253 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.254 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.254 INFO:teuthology.orchestra.run.smithi069.stdout: "mark_out_threshold": { 2024-05-14T15:42:01.254 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mark_out_threshold", 2024-05-14T15:42:01.254 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.254 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.254 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.254 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2419200", 2024-05-14T15:42:01.254 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.254 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.254 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.254 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-14T15:42:01.254 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.254 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.254 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.254 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.254 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_name": { 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_name", 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "device_health_metrics", 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: "retention_period": { 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retention_period", 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.255 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.256 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.256 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15552000", 2024-05-14T15:42:01.256 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.256 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.256 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.256 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain device health metrics", 2024-05-14T15:42:01.256 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.256 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.256 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.256 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.256 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_frequency": { 2024-05-14T15:42:01.256 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_frequency", 2024-05-14T15:42:01.256 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.256 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.256 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.256 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2024-05-14T15:42:01.257 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.257 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.257 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.257 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-14T15:42:01.257 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.257 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.257 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.257 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.257 INFO:teuthology.orchestra.run.smithi069.stdout: "self_heal": { 2024-05-14T15:42:01.257 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "self_heal", 2024-05-14T15:42:01.257 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.257 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.257 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.257 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.258 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.258 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.258 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.258 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-14T15:42:01.258 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.258 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.258 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.258 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.258 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-05-14T15:42:01.258 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-05-14T15:42:01.258 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.258 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.258 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.259 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-05-14T15:42:01.259 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.259 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.259 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.259 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and check device health", 2024-05-14T15:42:01.259 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.259 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.259 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.259 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.259 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.259 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.259 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.259 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.260 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.260 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.260 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.260 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.260 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.260 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.260 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.260 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.260 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.260 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.260 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_threshold": { 2024-05-14T15:42:01.260 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_threshold", 2024-05-14T15:42:01.260 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.260 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.260 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.261 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7257600", 2024-05-14T15:42:01.261 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.261 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.261 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.261 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-14T15:42:01.261 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.261 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.261 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.261 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.261 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.261 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.261 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.261 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "diskprediction_local", 2024-05-14T15:42:01.261 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.261 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.262 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.262 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.262 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.262 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.262 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.262 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.262 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.262 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.262 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.262 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.262 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.262 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.262 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.262 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.262 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.263 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.263 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.263 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.263 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.263 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.263 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.263 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.263 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.263 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.263 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.263 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.263 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.263 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.263 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.263 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.263 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.264 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.264 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.264 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.264 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.264 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.264 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.264 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.264 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.264 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.264 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.264 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.264 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.264 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.264 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.264 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.264 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.265 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.265 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.265 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.265 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.265 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.265 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.265 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.265 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.265 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.265 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.265 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.265 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.265 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.265 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.265 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.265 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.266 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.266 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.266 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.266 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.266 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.266 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.266 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.266 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.266 INFO:teuthology.orchestra.run.smithi069.stdout: "predict_interval": { 2024-05-14T15:42:01.266 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predict_interval", 2024-05-14T15:42:01.266 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.266 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.266 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.267 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2024-05-14T15:42:01.267 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.267 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.267 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.267 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.267 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.267 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.267 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.267 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.267 INFO:teuthology.orchestra.run.smithi069.stdout: "predictor_model": { 2024-05-14T15:42:01.267 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predictor_model", 2024-05-14T15:42:01.267 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.267 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.267 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.267 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "prophetstor", 2024-05-14T15:42:01.268 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.268 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.268 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.268 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.268 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.268 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.268 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.268 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.268 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-05-14T15:42:01.268 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-05-14T15:42:01.268 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.268 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.268 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.268 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-05-14T15:42:01.268 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.269 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.269 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.269 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.269 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.269 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.269 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.269 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.269 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.269 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.269 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.269 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.269 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.269 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.269 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.269 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.270 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.270 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.270 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.270 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.270 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.270 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.270 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.270 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.270 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.270 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "influx", 2024-05-14T15:42:01.270 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": false, 2024-05-14T15:42:01.270 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "influxdb python module not found", 2024-05-14T15:42:01.270 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.271 INFO:teuthology.orchestra.run.smithi069.stdout: "batch_size": { 2024-05-14T15:42:01.271 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "batch_size", 2024-05-14T15:42:01.271 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.271 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.271 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.271 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5000", 2024-05-14T15:42:01.271 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.271 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.271 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.271 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-14T15:42:01.271 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.271 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.271 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.271 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.271 INFO:teuthology.orchestra.run.smithi069.stdout: "database": { 2024-05-14T15:42:01.271 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "database", 2024-05-14T15:42:01.272 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.272 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.272 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.272 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "ceph", 2024-05-14T15:42:01.272 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.272 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.272 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.272 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-14T15:42:01.272 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.272 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.272 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.272 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.272 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": { 2024-05-14T15:42:01.273 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hostname", 2024-05-14T15:42:01.273 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.273 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.273 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.273 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.273 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.273 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.273 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.273 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server hostname", 2024-05-14T15:42:01.273 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.273 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.273 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.273 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.273 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-05-14T15:42:01.273 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-05-14T15:42:01.273 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.274 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.274 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.274 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "30", 2024-05-14T15:42:01.274 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "5", 2024-05-14T15:42:01.274 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.274 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.274 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-14T15:42:01.274 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.274 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.274 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.274 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.274 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.274 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.274 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.274 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.275 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.276 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.276 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.276 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.276 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.276 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.276 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.276 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.276 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.276 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.276 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.276 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.276 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.276 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.276 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.276 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.277 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.277 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.277 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.277 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.277 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.277 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.277 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.277 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.277 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.277 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.277 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.277 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.277 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.277 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.277 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.278 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.278 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.278 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.278 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.278 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.278 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.278 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.278 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.278 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.278 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.278 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.278 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.278 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.278 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.279 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.279 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.279 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.279 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.279 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.279 INFO:teuthology.orchestra.run.smithi069.stdout: "password": { 2024-05-14T15:42:01.279 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "password", 2024-05-14T15:42:01.279 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.279 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.279 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.279 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.279 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.279 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.279 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.279 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "password of InfluxDB server user", 2024-05-14T15:42:01.279 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.280 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.280 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.280 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.280 INFO:teuthology.orchestra.run.smithi069.stdout: "port": { 2024-05-14T15:42:01.280 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "port", 2024-05-14T15:42:01.280 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.280 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.280 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.280 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8086", 2024-05-14T15:42:01.280 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.280 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.280 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.280 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server port", 2024-05-14T15:42:01.280 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.280 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.280 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.281 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.281 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.281 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.281 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.281 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.281 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.281 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.281 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.281 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.281 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.281 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.281 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.281 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.281 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.281 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.282 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2024-05-14T15:42:01.282 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2024-05-14T15:42:01.282 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.282 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.282 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.282 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "false", 2024-05-14T15:42:01.282 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.282 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.282 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.282 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T15:42:01.282 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.282 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.282 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.282 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.283 INFO:teuthology.orchestra.run.smithi069.stdout: "threads": { 2024-05-14T15:42:01.283 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threads", 2024-05-14T15:42:01.283 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.283 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.283 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.283 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-05-14T15:42:01.283 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-05-14T15:42:01.283 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "32", 2024-05-14T15:42:01.283 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.283 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-14T15:42:01.283 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.283 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.283 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.283 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.283 INFO:teuthology.orchestra.run.smithi069.stdout: "username": { 2024-05-14T15:42:01.283 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "username", 2024-05-14T15:42:01.284 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.284 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.284 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.284 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.284 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.284 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.284 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.284 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "username of InfluxDB server user", 2024-05-14T15:42:01.284 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.284 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.284 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.284 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.284 INFO:teuthology.orchestra.run.smithi069.stdout: "verify_ssl": { 2024-05-14T15:42:01.284 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "verify_ssl", 2024-05-14T15:42:01.284 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.284 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.285 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.285 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "true", 2024-05-14T15:42:01.285 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.285 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.285 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.285 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T15:42:01.285 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.285 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.285 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.285 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.285 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.285 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.285 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.285 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "insights", 2024-05-14T15:42:01.285 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.286 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.286 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.286 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.286 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.286 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.286 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.286 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.286 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.286 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.286 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.286 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.286 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.286 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.286 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.286 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.286 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.287 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.287 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.287 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.287 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.287 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.287 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.287 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.287 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.287 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.287 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.287 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.287 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.287 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.287 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.287 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.288 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.288 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.288 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.288 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.288 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.288 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.288 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.288 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.288 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.288 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.288 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.288 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.288 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.288 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.288 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.288 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.289 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.289 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.289 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.289 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.289 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.289 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.289 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.289 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.289 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.289 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.289 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.289 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.289 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.289 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.289 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.289 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.290 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.290 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.290 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.290 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.290 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.290 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.290 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.290 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.290 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.290 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.290 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.290 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.290 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.290 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.290 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.291 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.291 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.291 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.291 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.291 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.291 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.291 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.291 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.291 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.291 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.291 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.291 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "iostat", 2024-05-14T15:42:01.291 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.291 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.291 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.291 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.292 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.293 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.293 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.293 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.293 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.293 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.293 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.293 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.293 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.293 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.293 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.293 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.293 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.293 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.293 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.293 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.293 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.294 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.294 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.294 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.294 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.294 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.294 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.294 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.294 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.294 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.294 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.294 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.294 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.294 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.294 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.294 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.294 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.295 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.295 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.295 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.295 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.295 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.295 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.295 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.295 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.295 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.295 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.295 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.295 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.295 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.295 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.295 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.295 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.296 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.296 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.296 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.296 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.296 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.296 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.296 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.296 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.296 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.296 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.296 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.296 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.296 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.296 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.296 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.296 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "k8sevents", 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_event_retention_days": { 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ceph_event_retention_days", 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7", 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.297 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.298 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.298 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-14T15:42:01.298 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.298 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.298 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.298 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.298 INFO:teuthology.orchestra.run.smithi069.stdout: "config_check_secs": { 2024-05-14T15:42:01.298 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_check_secs", 2024-05-14T15:42:01.298 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.298 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.298 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.298 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:01.298 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "10", 2024-05-14T15:42:01.298 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.298 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.299 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.300 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.301 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.302 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.302 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.302 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.302 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.302 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.302 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.302 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.302 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.302 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.302 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.302 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.302 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.302 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.302 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.302 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.302 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.303 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "localpool", 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: "failure_domain": { 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "failure_domain", 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.304 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "host", 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "failure domain for any created local pool", 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.305 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.306 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.306 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.306 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.306 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.306 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.306 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.306 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.306 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.306 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.306 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.306 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.306 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.306 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.306 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.306 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.307 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.308 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.308 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.308 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.308 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.308 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.308 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.308 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.308 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.308 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.308 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.308 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.308 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.308 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.308 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.308 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.308 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: "min_size": { 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_size", 2024-05-14T15:42:01.309 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.310 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.310 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.310 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.310 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.310 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.310 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.310 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default min_size for any created local pool", 2024-05-14T15:42:01.310 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-14T15:42:01.310 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.310 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.310 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.310 INFO:teuthology.orchestra.run.smithi069.stdout: "num_rep": { 2024-05-14T15:42:01.310 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "num_rep", 2024-05-14T15:42:01.310 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.310 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.311 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.311 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3", 2024-05-14T15:42:01.311 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.311 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.311 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.311 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default replica count for any created local pool", 2024-05-14T15:42:01.311 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.311 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.311 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.311 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.311 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_num": { 2024-05-14T15:42:01.311 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_num", 2024-05-14T15:42:01.311 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.311 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.311 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.311 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "128", 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default pg_num for any created local pool", 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: "prefix": { 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prefix", 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.312 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name prefix for any created local pool", 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.313 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.314 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.314 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.314 INFO:teuthology.orchestra.run.smithi069.stdout: "subtree": { 2024-05-14T15:42:01.314 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "subtree", 2024-05-14T15:42:01.314 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.314 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.314 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.314 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "rack", 2024-05-14T15:42:01.314 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.314 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.314 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.314 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-14T15:42:01.314 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-14T15:42:01.314 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.314 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.314 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mds_autoscaler", 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.315 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.316 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.317 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.318 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.318 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.318 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.318 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.318 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.318 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.318 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.318 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.318 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.318 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.318 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.318 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.318 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.318 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.318 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.319 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.320 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.320 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.320 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.320 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.320 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.320 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.320 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.320 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.320 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.320 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.320 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirroring", 2024-05-14T15:42:01.320 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.320 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.320 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.320 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.320 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.321 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.322 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.322 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.322 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.322 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.322 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.322 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.322 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.322 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.322 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.322 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.322 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.322 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.322 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.322 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.322 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.323 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.323 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.323 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.323 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.323 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.323 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.323 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.323 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.323 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.323 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.323 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.323 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.323 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.323 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.323 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.323 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.324 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.324 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.324 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.324 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.324 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.324 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.324 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.324 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.324 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.324 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.324 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.324 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.324 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.324 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.324 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.324 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.325 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.325 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.325 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.325 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.325 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.325 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.325 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.325 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.325 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.325 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.325 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.325 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.325 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.325 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.325 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.325 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.326 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.326 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.326 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.326 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.326 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.326 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "nfs", 2024-05-14T15:42:01.326 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.326 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.326 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.326 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.326 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.326 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.326 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.326 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.326 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.327 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.328 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.329 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.330 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.331 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.332 INFO:teuthology.orchestra.run.smithi069.stdout: "fail_fs": { 2024-05-14T15:42:01.332 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "fail_fs", 2024-05-14T15:42:01.332 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.332 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.332 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.332 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.332 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.332 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.332 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.332 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-14T15:42:01.332 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.332 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.332 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.332 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.332 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.332 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.333 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.333 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.333 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.333 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.333 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.333 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.333 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.333 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.333 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.333 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.333 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.333 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.333 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.333 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.333 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.333 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.334 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.335 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.335 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.335 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.335 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.335 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.335 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.335 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.335 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.335 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.335 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.335 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.335 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.335 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.335 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.335 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.335 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.336 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.337 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.337 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.337 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator": { 2024-05-14T15:42:01.337 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2024-05-14T15:42:01.337 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.337 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.337 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.337 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.337 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.337 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.337 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.337 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2024-05-14T15:42:01.337 INFO:teuthology.orchestra.run.smithi069.stdout: "rook", 2024-05-14T15:42:01.337 INFO:teuthology.orchestra.run.smithi069.stdout: "test_orchestrator" 2024-05-14T15:42:01.337 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.338 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Orchestrator backend", 2024-05-14T15:42:01.338 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.338 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.338 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.338 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.338 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.338 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.338 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.338 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.338 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.338 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.338 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.338 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.338 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.338 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.338 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.339 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.339 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.339 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.339 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.339 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.339 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.339 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_perf_query", 2024-05-14T15:42:01.339 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.339 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.339 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.339 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.339 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.339 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.339 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.339 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.339 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.340 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.340 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.340 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.340 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.340 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.340 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.340 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.340 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.340 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.340 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.340 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.340 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.340 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.340 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.340 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.340 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.341 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.342 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.342 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.342 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.342 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.342 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.342 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.342 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.342 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.342 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.342 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.342 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.342 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.342 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.342 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.343 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.343 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.343 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.343 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.343 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.343 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.343 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.343 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.343 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.343 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.343 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.343 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.343 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.343 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.343 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.343 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.344 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.344 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.344 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.344 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.344 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.344 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.344 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.344 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.344 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.344 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.344 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.344 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.344 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.344 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.345 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.345 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.345 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.345 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.345 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_support", 2024-05-14T15:42:01.345 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.345 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.345 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.345 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.345 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.345 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.345 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.345 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.345 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.345 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.345 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.346 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.346 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.346 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.346 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.346 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.346 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.346 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.346 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.346 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.346 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.346 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.346 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.346 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.347 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.347 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.347 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.347 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.347 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.347 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.347 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.347 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.347 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.347 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.347 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.347 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.347 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.347 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.347 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.347 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.348 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.349 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.349 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.349 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.349 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.349 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.349 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.349 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.349 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.349 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.349 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.349 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.349 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.349 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.349 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.349 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.349 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.350 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.350 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.350 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.350 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.350 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.350 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.350 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.350 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.350 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.350 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.350 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.350 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.350 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.350 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.351 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.351 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.351 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.351 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_autoscaler", 2024-05-14T15:42:01.351 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.351 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.351 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.351 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.351 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.351 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.351 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.351 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.351 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.351 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.351 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.352 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.352 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.352 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.352 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.352 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.352 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.352 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.352 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.352 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.352 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.352 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.352 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.352 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.352 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.352 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.352 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.353 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.353 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.353 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.353 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.353 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.353 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.353 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.353 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.353 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.353 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.353 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.353 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.353 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.353 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.353 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.354 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.354 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.354 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.354 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.354 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.354 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.354 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.354 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.354 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.354 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.354 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.354 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.354 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.354 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.355 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.355 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.355 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.355 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.355 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.355 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.355 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.355 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.355 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.355 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.355 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.355 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.355 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.355 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.356 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.356 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.356 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.356 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-05-14T15:42:01.356 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-05-14T15:42:01.356 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.356 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.356 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.356 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-05-14T15:42:01.356 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.356 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.356 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.356 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.356 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.356 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.357 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.357 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.357 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.357 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.357 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.357 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.357 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.357 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.357 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.357 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.357 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.357 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.357 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.357 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.357 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.357 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.358 INFO:teuthology.orchestra.run.smithi069.stdout: "threshold": { 2024-05-14T15:42:01.358 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threshold", 2024-05-14T15:42:01.358 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:01.358 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.358 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.358 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2024-05-14T15:42:01.358 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1.0", 2024-05-14T15:42:01.358 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.358 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.358 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "scaling threshold", 2024-05-14T15:42:01.358 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-14T15:42:01.358 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.358 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.358 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.359 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.359 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.359 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.359 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "progress", 2024-05-14T15:42:01.359 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.359 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.359 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.359 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_pg_recovery_event": { 2024-05-14T15:42:01.359 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_pg_recovery_event", 2024-05-14T15:42:01.359 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.359 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.359 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.359 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.359 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.359 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.359 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.360 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-14T15:42:01.360 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.360 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.360 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.360 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.360 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2024-05-14T15:42:01.360 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2024-05-14T15:42:01.360 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.360 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.360 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.360 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.360 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.360 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.360 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.360 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.361 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.361 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.361 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.361 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.361 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.361 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.361 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.361 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.361 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.361 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.361 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.361 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.361 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.361 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.361 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.361 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.362 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.362 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.362 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.362 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.362 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.362 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.362 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.362 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.362 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.362 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.362 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.362 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.362 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.362 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.363 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.363 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.363 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.363 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.363 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.363 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.363 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.363 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.363 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.363 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.363 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.363 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.363 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.363 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.363 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.364 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.364 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.364 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.364 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.364 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.364 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.364 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.364 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.364 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.364 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.364 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.364 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.364 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.364 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.364 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.364 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.365 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.365 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.365 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.365 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.365 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.365 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.365 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.365 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.365 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.365 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.365 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.365 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.365 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.365 INFO:teuthology.orchestra.run.smithi069.stdout: "max_completed_events": { 2024-05-14T15:42:01.365 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_completed_events", 2024-05-14T15:42:01.365 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.366 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.366 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.366 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "50", 2024-05-14T15:42:01.366 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.366 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.366 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.366 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "number of past completed events to remember", 2024-05-14T15:42:01.366 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.366 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.366 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.366 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.366 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-05-14T15:42:01.366 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-05-14T15:42:01.366 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-05-14T15:42:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long the module is going to sleep", 2024-05-14T15:42:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.367 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.368 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.368 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.368 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.368 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.368 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.368 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.368 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.368 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.368 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.368 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.368 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.368 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.368 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.368 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus", 2024-05-14T15:42:01.368 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.369 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.369 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.369 INFO:teuthology.orchestra.run.smithi069.stdout: "cache": { 2024-05-14T15:42:01.369 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cache", 2024-05-14T15:42:01.369 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.369 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.369 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.369 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.369 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.369 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.369 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.369 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.369 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.369 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.369 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.369 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.370 INFO:teuthology.orchestra.run.smithi069.stdout: "exclude_perf_counters": { 2024-05-14T15:42:01.370 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "exclude_perf_counters", 2024-05-14T15:42:01.370 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.370 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.370 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.370 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.370 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.370 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.370 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.370 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-14T15:42:01.370 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-14T15:42:01.370 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.370 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.371 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.371 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.371 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.371 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.371 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.371 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.371 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.371 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.371 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.371 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.371 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.371 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.371 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.371 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.371 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.372 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.372 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.372 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.372 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.372 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.372 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.372 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.372 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.372 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.372 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.372 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.372 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.372 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.372 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.373 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.373 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.373 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.373 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.373 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.373 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.373 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.373 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.373 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.373 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.373 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.373 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.373 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.373 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.374 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.374 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.374 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.374 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.374 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.374 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.374 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.374 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.374 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.374 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.374 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.374 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.374 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.374 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.375 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools": { 2024-05-14T15:42:01.376 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools", 2024-05-14T15:42:01.376 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.376 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.376 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.376 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.376 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.376 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.376 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.376 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.376 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.376 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.376 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.376 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.376 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-14T15:42:01.376 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-14T15:42:01.376 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.377 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.377 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.377 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300", 2024-05-14T15:42:01.377 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.377 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.377 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.377 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.377 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.377 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.377 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.377 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.377 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_interval": { 2024-05-14T15:42:01.377 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_interval", 2024-05-14T15:42:01.377 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:01.377 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.378 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.378 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15.0", 2024-05-14T15:42:01.378 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.378 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.378 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.378 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.378 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.378 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.378 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.378 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.378 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-05-14T15:42:01.378 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-05-14T15:42:01.378 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.378 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.379 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.379 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2024-05-14T15:42:01.379 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.379 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.379 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.379 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-14T15:42:01.379 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.379 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.379 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.379 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.379 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-05-14T15:42:01.379 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-05-14T15:42:01.379 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.379 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.380 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.380 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "9283", 2024-05-14T15:42:01.380 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.380 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.380 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.380 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-14T15:42:01.380 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.380 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.380 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.380 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.380 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.380 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.380 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.380 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.380 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.381 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.381 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.381 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.381 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.381 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.381 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.381 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.381 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.381 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.381 INFO:teuthology.orchestra.run.smithi069.stdout: "stale_cache_strategy": { 2024-05-14T15:42:01.381 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stale_cache_strategy", 2024-05-14T15:42:01.381 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.381 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.381 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.381 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "log", 2024-05-14T15:42:01.381 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.382 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.382 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.382 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.382 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.382 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.382 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.382 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.382 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2024-05-14T15:42:01.382 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2024-05-14T15:42:01.382 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.382 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.382 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.382 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "default", 2024-05-14T15:42:01.383 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.383 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.383 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.383 INFO:teuthology.orchestra.run.smithi069.stdout: "default", 2024-05-14T15:42:01.383 INFO:teuthology.orchestra.run.smithi069.stdout: "error" 2024-05-14T15:42:01.383 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.383 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.383 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.383 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.383 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.383 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.383 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2024-05-14T15:42:01.383 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2024-05-14T15:42:01.383 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.383 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.383 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.384 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2024-05-14T15:42:01.384 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2024-05-14T15:42:01.384 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2024-05-14T15:42:01.384 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.384 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.384 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.384 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.384 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.384 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.384 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.384 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.384 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.384 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2024-05-14T15:42:01.384 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.384 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.384 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.385 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.385 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.385 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.385 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.385 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.385 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.385 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.385 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.385 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.385 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.385 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.385 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.385 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.385 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.385 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.385 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.386 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.386 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.386 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.386 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.386 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.386 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.386 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.386 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.386 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.386 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.386 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.386 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.386 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.386 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.386 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.387 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.388 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_snap_create": { 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_snap_create", 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.389 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.390 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.390 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.390 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.390 INFO:teuthology.orchestra.run.smithi069.stdout: "mirror_snapshot_schedule": { 2024-05-14T15:42:01.390 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirror_snapshot_schedule", 2024-05-14T15:42:01.390 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.390 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.390 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.390 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.390 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.390 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.390 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.390 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.390 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.390 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.391 INFO:teuthology.orchestra.run.smithi069.stdout: "trash_purge_schedule": { 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "trash_purge_schedule", 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.392 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "restful", 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_auth": { 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_auth", 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.393 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.394 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2024-05-14T15:42:01.394 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2024-05-14T15:42:01.394 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.394 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.394 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.394 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.394 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.394 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.394 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.394 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.394 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.394 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.394 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.394 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.395 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.395 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.395 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.395 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.395 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.395 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.395 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.395 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.395 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.395 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.395 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.395 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.395 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.395 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.395 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.396 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.396 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.396 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.396 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.396 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.396 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.396 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.396 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.396 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.396 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.396 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.396 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.396 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.396 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.396 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.396 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.397 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.398 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.398 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.398 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.398 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.398 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.398 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.398 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.398 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.398 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.398 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.398 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.398 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.398 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.398 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.398 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.399 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.399 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.399 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.399 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.399 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.399 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.399 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.399 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-05-14T15:42:01.399 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-05-14T15:42:01.399 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.399 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.399 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.399 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.399 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.399 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.399 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.400 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.401 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.402 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.402 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.402 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rgw", 2024-05-14T15:42:01.402 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.402 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.402 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.402 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.402 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.402 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.402 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.402 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.402 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.402 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.402 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.402 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.402 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.403 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.403 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.403 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.403 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.403 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.403 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.403 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.403 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.403 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.403 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.403 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.403 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.403 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.403 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.403 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.403 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.404 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.404 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.404 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.404 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.404 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.404 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.404 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.404 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.404 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.404 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.404 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.404 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.404 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.404 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.404 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.405 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.405 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.405 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.405 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.405 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.405 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.405 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.405 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.405 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.405 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.405 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.405 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.405 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.405 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.405 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.406 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.406 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.406 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.406 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.406 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.406 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.406 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.406 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.406 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.406 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.406 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.406 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.406 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.406 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.407 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.407 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.407 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.407 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.407 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.407 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.407 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.407 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.407 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.407 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.407 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.408 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.408 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.408 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.408 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.408 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.408 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.408 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rook", 2024-05-14T15:42:01.408 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.408 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.408 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.408 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.408 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.408 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.408 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.409 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.409 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.409 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.409 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.409 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.409 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.409 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.409 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.409 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.409 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.409 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.409 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.409 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.409 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.410 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.410 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.410 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.410 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.410 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.410 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.410 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.410 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.410 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.410 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.410 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.410 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.410 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.410 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.411 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.411 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.411 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.411 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.411 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.411 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.411 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.411 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.411 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.411 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.411 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.411 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.411 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.411 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.412 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.412 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.412 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.412 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.412 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.412 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.412 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.412 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.412 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.412 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.412 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.412 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.412 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.412 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.413 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.413 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.413 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.413 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.413 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.413 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.413 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.413 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.413 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.413 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.413 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.413 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.413 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.413 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.414 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.414 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.414 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.414 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.414 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.414 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.414 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.414 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.414 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.414 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.414 INFO:teuthology.orchestra.run.smithi069.stdout: "storage_class": { 2024-05-14T15:42:01.414 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "storage_class", 2024-05-14T15:42:01.414 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.414 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.414 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.414 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "local", 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "selftest", 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.415 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.416 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.416 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.416 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.416 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.416 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.416 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.416 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.416 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.416 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.416 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.416 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.416 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.416 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.416 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.416 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.416 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.417 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.418 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.418 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.418 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.418 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.418 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.418 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.418 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.418 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.418 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.418 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.418 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.418 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.418 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.418 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.418 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.418 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.419 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.419 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.419 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.419 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.419 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.419 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.419 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.419 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.419 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.419 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.419 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.419 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.419 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.419 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.419 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.419 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: "roption1": { 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption1", 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.420 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: "roption2": { 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption2", 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "xyz", 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption1": { 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption1", 2024-05-14T15:42:01.421 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.422 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.422 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.422 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.422 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.422 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.422 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.422 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.422 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.422 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.422 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.422 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.422 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption2": { 2024-05-14T15:42:01.422 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption2", 2024-05-14T15:42:01.422 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.422 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption3": { 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption3", 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.423 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.424 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.424 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.424 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.424 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.424 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.424 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.424 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.424 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption4": { 2024-05-14T15:42:01.424 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption4", 2024-05-14T15:42:01.424 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.424 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.424 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.424 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.424 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.424 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption5": { 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption5", 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.425 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.426 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.426 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.426 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.426 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption6": { 2024-05-14T15:42:01.426 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption6", 2024-05-14T15:42:01.426 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.426 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.426 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.426 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.426 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.426 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.426 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.426 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.426 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.426 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption7": { 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption7", 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "42", 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.427 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: "testkey": { 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testkey", 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.428 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: "testlkey": { 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testlkey", 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.429 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.430 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.430 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.430 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.430 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.430 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.430 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.430 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.430 INFO:teuthology.orchestra.run.smithi069.stdout: "testnewline": { 2024-05-14T15:42:01.430 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testnewline", 2024-05-14T15:42:01.430 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.430 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.430 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.430 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.430 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.430 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.430 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.431 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.431 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.431 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.431 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.431 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.431 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.431 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.431 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.431 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smb", 2024-05-14T15:42:01.431 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.431 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.431 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.431 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.431 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.431 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.431 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.432 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.433 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.433 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.433 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.433 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.433 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.433 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.433 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.433 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.433 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.433 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.433 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.433 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.433 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.433 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.433 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.433 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.434 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.434 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.434 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.434 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.434 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.434 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.434 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.434 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.434 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.434 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.434 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.434 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.434 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.434 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.434 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.434 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.435 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: "update_orchestration": { 2024-05-14T15:42:01.436 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "update_orchestration", 2024-05-14T15:42:01.437 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.437 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.437 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.437 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.437 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.437 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.437 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.437 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-14T15:42:01.437 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.437 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.437 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.437 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.437 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.437 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.437 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.438 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2024-05-14T15:42:01.438 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.438 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.438 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.438 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_m_granularity": { 2024-05-14T15:42:01.438 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_m_granularity", 2024-05-14T15:42:01.438 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.438 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.438 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.438 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.438 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.438 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.438 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.438 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow minute scheduled snapshots", 2024-05-14T15:42:01.438 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: "dump_on_update": { 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dump_on_update", 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "dump database to debug log on update", 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.439 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.440 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.440 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.440 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.440 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.440 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.440 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.440 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.440 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.440 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.440 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.440 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.440 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.440 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.440 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.440 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.440 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.441 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.442 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.442 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.442 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.442 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.442 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.442 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.442 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.442 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.442 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.442 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.442 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.442 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.442 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.442 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.443 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.443 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.443 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.443 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.443 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.443 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.443 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.443 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.443 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.443 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.443 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.443 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.443 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.443 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.445 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.446 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.446 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.446 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.446 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.446 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.446 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.446 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.446 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.446 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.446 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.446 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.446 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.446 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.446 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.447 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.447 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.447 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.447 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.447 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.447 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.447 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.447 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.447 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.447 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.447 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.447 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stats", 2024-05-14T15:42:01.447 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.447 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.447 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.448 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.448 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.448 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.448 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.448 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.448 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.448 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.448 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.448 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.448 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.448 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.448 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.448 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.448 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.448 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.448 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.449 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.450 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.450 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.450 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.450 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.450 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.450 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.450 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.450 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.450 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.450 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.450 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.450 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.450 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.450 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.450 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.451 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.452 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "status", 2024-05-14T15:42:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.453 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.454 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.454 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.454 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.454 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.454 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.454 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.454 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.454 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.454 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.454 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.454 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.454 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.454 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.454 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.454 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.455 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.456 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.456 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.456 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.456 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.456 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.456 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.456 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.456 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.456 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.456 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.456 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.456 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.456 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.456 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.456 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.456 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.457 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.458 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.458 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.458 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.458 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.458 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.458 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.458 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.458 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.458 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.458 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.458 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.458 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.458 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.458 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.459 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.459 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telegraf", 2024-05-14T15:42:01.459 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.459 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.459 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.459 INFO:teuthology.orchestra.run.smithi069.stdout: "address": { 2024-05-14T15:42:01.459 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "address", 2024-05-14T15:42:01.459 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.459 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.459 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.459 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-14T15:42:01.459 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.459 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.459 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.459 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15", 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.460 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.461 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.462 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.462 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.462 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.462 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.462 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.462 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.462 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.462 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.462 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.462 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.462 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.462 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.462 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.462 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.462 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.463 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.464 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.464 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.464 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.464 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.464 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.464 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.464 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.464 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.464 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.464 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.464 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.464 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.464 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.464 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.464 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.465 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.466 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.466 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.466 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.466 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.466 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.466 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.466 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.466 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telemetry", 2024-05-14T15:42:01.466 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.466 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.466 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.466 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_basic": { 2024-05-14T15:42:01.466 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_basic", 2024-05-14T15:42:01.466 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.466 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.466 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.467 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.467 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.467 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.467 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.467 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-14T15:42:01.467 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.467 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.467 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.467 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.467 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_crash": { 2024-05-14T15:42:01.467 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_crash", 2024-05-14T15:42:01.467 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.467 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.467 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.467 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.467 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.468 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.468 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.468 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-14T15:42:01.468 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.468 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.468 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.468 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.468 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_device": { 2024-05-14T15:42:01.468 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_device", 2024-05-14T15:42:01.468 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.468 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.468 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.468 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.468 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.468 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.469 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.469 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-14T15:42:01.469 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.469 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.469 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.469 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.469 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_ident": { 2024-05-14T15:42:01.469 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_ident", 2024-05-14T15:42:01.469 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.469 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.469 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.469 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.469 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.469 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.469 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.469 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-14T15:42:01.470 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.470 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.470 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.470 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.470 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_perf": { 2024-05-14T15:42:01.470 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_perf", 2024-05-14T15:42:01.470 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.470 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.470 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.470 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.470 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.470 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.470 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.470 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-14T15:42:01.471 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.471 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.471 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.471 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.471 INFO:teuthology.orchestra.run.smithi069.stdout: "contact": { 2024-05-14T15:42:01.471 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "contact", 2024-05-14T15:42:01.471 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.471 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.471 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.471 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.471 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.471 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.471 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.471 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.471 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.471 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: "description": { 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "description", 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.472 INFO:teuthology.orchestra.run.smithi069.stdout: "device_url": { 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_url", 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.473 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.474 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.474 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.474 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.474 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.474 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.474 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.474 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.474 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.474 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.474 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.474 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-05-14T15:42:01.474 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-05-14T15:42:01.474 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.474 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.474 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.474 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "24", 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "8", 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: "last_opt_revision": { 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "last_opt_revision", 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1", 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.475 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard": { 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard", 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.476 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard_description": { 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard_description", 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.477 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.478 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.478 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.478 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.478 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.478 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.478 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.478 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.478 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.478 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.478 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.478 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.478 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.478 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.478 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.478 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.478 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.479 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.480 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.480 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.480 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.480 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.480 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.480 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.480 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.480 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.480 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.480 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.480 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.480 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.480 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.480 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.480 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.480 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.481 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.481 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.481 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.481 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.481 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.481 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.481 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.481 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.481 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.481 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.481 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.481 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.481 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.481 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.481 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.481 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.482 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.482 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.482 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.482 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.482 INFO:teuthology.orchestra.run.smithi069.stdout: "organization": { 2024-05-14T15:42:01.482 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "organization", 2024-05-14T15:42:01.482 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.482 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.482 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.482 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.482 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.482 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.482 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.482 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.482 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.482 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.483 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.483 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.483 INFO:teuthology.orchestra.run.smithi069.stdout: "proxy": { 2024-05-14T15:42:01.483 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "proxy", 2024-05-14T15:42:01.483 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.483 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.483 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.483 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.483 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.483 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.483 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.483 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.483 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.483 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.483 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.483 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.484 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.484 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.484 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.484 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.484 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.484 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.484 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.484 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.484 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.484 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.484 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.484 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.484 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.484 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.484 INFO:teuthology.orchestra.run.smithi069.stdout: "url": { 2024-05-14T15:42:01.484 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url", 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "test_orchestrator", 2024-05-14T15:42:01.485 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.486 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.486 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.486 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.486 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.486 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.486 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.486 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.486 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.486 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.486 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.486 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.486 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.486 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.486 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.487 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.487 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.487 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.487 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.487 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.487 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.487 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.487 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.487 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.487 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.487 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.487 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.487 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.487 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.487 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.487 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.488 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.488 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.488 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.488 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.488 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.488 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.488 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.488 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.488 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.488 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.488 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.488 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.488 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.488 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.488 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.489 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.489 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.489 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.489 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.489 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.489 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.489 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.489 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.489 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.489 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.489 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.489 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.489 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.489 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.489 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.489 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.490 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.490 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.490 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.490 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.490 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.490 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.490 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.490 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.490 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.490 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.490 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.490 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.490 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.490 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.490 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.490 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.491 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.491 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.491 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.491 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.491 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.491 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.491 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.491 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.491 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.491 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.491 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.491 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.491 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2024-05-14T15:42:01.491 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.491 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.492 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.492 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.492 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.492 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.492 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.492 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.492 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.492 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.492 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.492 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.492 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.492 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.492 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.492 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.492 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.492 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.493 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.493 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.493 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.493 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.493 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.493 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.493 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.493 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.493 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.493 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.493 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.493 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.493 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.493 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.493 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.493 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.494 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.494 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.494 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.494 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.494 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.494 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.494 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.494 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.494 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.494 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.494 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.494 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.494 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.494 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.494 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.495 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.495 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.495 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.495 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.495 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.495 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.495 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.495 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.495 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.495 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.495 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.495 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.495 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.495 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.495 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.496 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.496 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.496 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.496 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.496 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.496 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.496 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.496 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.496 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.496 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_clones": { 2024-05-14T15:42:01.496 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_clones", 2024-05-14T15:42:01.496 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.496 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.496 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.496 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4", 2024-05-14T15:42:01.497 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.497 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.497 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.497 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-14T15:42:01.497 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.497 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.497 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.497 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.497 INFO:teuthology.orchestra.run.smithi069.stdout: "periodic_async_work": { 2024-05-14T15:42:01.497 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "periodic_async_work", 2024-05-14T15:42:01.497 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.497 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.497 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.497 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.497 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.498 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.498 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.498 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Periodically check for async work", 2024-05-14T15:42:01.498 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.498 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.498 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.498 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.498 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_delay": { 2024-05-14T15:42:01.498 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_delay", 2024-05-14T15:42:01.498 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.498 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.499 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.499 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.499 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.499 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.499 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.499 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-14T15:42:01.499 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.499 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.499 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.499 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.499 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_no_wait": { 2024-05-14T15:42:01.499 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_no_wait", 2024-05-14T15:42:01.499 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.499 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.500 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.500 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.500 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.500 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.500 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.500 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-14T15:42:01.500 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.500 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.500 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.500 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.500 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.500 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.500 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.500 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.500 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.500 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.501 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.501 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.501 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.501 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.501 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.501 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.501 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.501 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.501 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.501 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.501 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.501 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix", 2024-05-14T15:42:01.501 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.501 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.501 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.502 INFO:teuthology.orchestra.run.smithi069.stdout: "discovery_interval": { 2024-05-14T15:42:01.502 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "discovery_interval", 2024-05-14T15:42:01.502 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-05-14T15:42:01.502 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.502 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.502 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "100", 2024-05-14T15:42:01.502 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.502 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.502 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.502 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.502 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.502 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.502 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.502 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.503 INFO:teuthology.orchestra.run.smithi069.stdout: "identifier": { 2024-05-14T15:42:01.503 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "identifier", 2024-05-14T15:42:01.503 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.503 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.503 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.503 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.503 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.503 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.503 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.503 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.503 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.503 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.503 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.503 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.503 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-05-14T15:42:01.504 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-05-14T15:42:01.504 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.504 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.504 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.504 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-05-14T15:42:01.504 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.504 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.504 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.504 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.504 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.504 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.504 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.504 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.504 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.504 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.505 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.505 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.505 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.505 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.505 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.505 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.505 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.505 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.505 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.505 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.505 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.505 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.505 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.505 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.506 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.506 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.506 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.506 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.506 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.506 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.506 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.506 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.506 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.506 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.506 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.506 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.506 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.506 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.506 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.507 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.507 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.507 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.507 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.507 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.507 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.507 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.507 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.507 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.507 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.507 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.507 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.507 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.507 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.507 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.507 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.508 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.508 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.508 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.508 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.508 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.508 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.508 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.508 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.508 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.508 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.508 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.508 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.508 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.508 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.509 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.509 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.509 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.509 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.509 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.509 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.509 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.509 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.509 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.509 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.509 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.509 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.509 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.509 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.509 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.509 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.510 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.510 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.510 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.510 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.510 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.510 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.510 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.510 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_host": { 2024-05-14T15:42:01.510 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_host", 2024-05-14T15:42:01.510 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.510 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.510 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.510 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.510 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.510 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.511 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.511 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.511 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.511 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.511 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.511 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.511 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_port": { 2024-05-14T15:42:01.511 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_port", 2024-05-14T15:42:01.511 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.511 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.511 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.511 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10051", 2024-05-14T15:42:01.511 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.511 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.511 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.512 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.512 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.512 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.512 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.512 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.512 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_sender": { 2024-05-14T15:42:01.512 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_sender", 2024-05-14T15:42:01.512 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.512 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.512 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.512 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-14T15:42:01.512 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.512 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.512 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.512 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.512 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: "modules": [ 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: "dashboard", 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: "iostat", 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: "nfs", 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: "restful", 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: "snap_schedule" 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.513 INFO:teuthology.orchestra.run.smithi069.stdout: "available_modules": [ 2024-05-14T15:42:01.514 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.514 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "alerts", 2024-05-14T15:42:01.514 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.514 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.514 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.514 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-05-14T15:42:01.514 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-05-14T15:42:01.514 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.514 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.514 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.514 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-05-14T15:42:01.514 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.514 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.514 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.514 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How frequently to reexamine health status", 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.515 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.516 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.516 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.516 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.516 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.516 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.516 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.516 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.516 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.516 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.516 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.516 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.516 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.516 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.516 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.516 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.516 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.517 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.518 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.518 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.518 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.518 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.518 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.518 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.518 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.518 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.518 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.518 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.518 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.518 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.518 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.518 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.518 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.518 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.519 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.519 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.519 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.519 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.519 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.519 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.519 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.519 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.519 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_destination": { 2024-05-14T15:42:01.519 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_destination", 2024-05-14T15:42:01.519 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.519 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.519 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.519 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.519 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.519 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email address to send alerts to", 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_from_name": { 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_from_name", 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "Ceph", 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Email From: name", 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.520 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.521 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.521 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.521 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_host": { 2024-05-14T15:42:01.521 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_host", 2024-05-14T15:42:01.521 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.521 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.521 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.521 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.521 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.521 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.521 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.521 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP server", 2024-05-14T15:42:01.521 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.521 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.521 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.521 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.522 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_password": { 2024-05-14T15:42:01.522 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_password", 2024-05-14T15:42:01.522 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.522 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.522 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.522 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.522 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.522 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.522 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.522 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Password to authenticate with", 2024-05-14T15:42:01.522 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.522 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.522 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.522 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.522 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_port": { 2024-05-14T15:42:01.523 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_port", 2024-05-14T15:42:01.523 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.523 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.523 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.523 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "465", 2024-05-14T15:42:01.523 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.523 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.523 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.523 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP port", 2024-05-14T15:42:01.523 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.523 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.523 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.523 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.523 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_sender": { 2024-05-14T15:42:01.523 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_sender", 2024-05-14T15:42:01.523 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SMTP envelope sender", 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_ssl": { 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_ssl", 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.524 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.525 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.525 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.525 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.525 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use SSL to connect to SMTP server", 2024-05-14T15:42:01.525 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.525 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.525 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.525 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.525 INFO:teuthology.orchestra.run.smithi069.stdout: "smtp_user": { 2024-05-14T15:42:01.525 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smtp_user", 2024-05-14T15:42:01.525 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.525 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.525 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.525 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.525 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.525 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.526 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.526 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "User to authenticate as", 2024-05-14T15:42:01.526 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.526 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.526 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.526 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.526 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.526 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.526 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.526 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.526 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.526 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.526 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.526 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.526 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "balancer", 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: "active": { 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "active", 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.527 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically balance PGs across cluster", 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_time": { 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_time", 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0000", 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.528 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.529 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.529 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "beginning time of day to automatically balance", 2024-05-14T15:42:01.529 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T15:42:01.529 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.529 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.529 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.529 INFO:teuthology.orchestra.run.smithi069.stdout: "begin_weekday": { 2024-05-14T15:42:01.529 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "begin_weekday", 2024-05-14T15:42:01.529 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-05-14T15:42:01.529 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.529 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.529 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.529 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2024-05-14T15:42:01.529 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2024-05-14T15:42:01.529 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.529 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-05-14T15:42:01.530 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T15:42:01.530 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.530 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.530 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.530 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_max_iterations": { 2024-05-14T15:42:01.530 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_max_iterations", 2024-05-14T15:42:01.530 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-05-14T15:42:01.530 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.530 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.530 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "25", 2024-05-14T15:42:01.530 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-05-14T15:42:01.530 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "250", 2024-05-14T15:42:01.530 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.530 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-05-14T15:42:01.530 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_metrics": { 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_metrics", 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "pgs,objects,bytes", 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.531 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: "crush_compat_step": { 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crush_compat_step", 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.5", 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0.001", 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "0.999", 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "aggressiveness of optimization", 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: "end_time": { 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_time", 2024-05-14T15:42:01.532 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2359", 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ending time of day to automatically balance", 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: "end_weekday": { 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "end_weekday", 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.533 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.534 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "0", 2024-05-14T15:42:01.534 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "6", 2024-05-14T15:42:01.534 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.534 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-05-14T15:42:01.534 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-05-14T15:42:01.534 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.534 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.534 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.534 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.534 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.534 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.534 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.534 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.534 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.534 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.535 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.535 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.535 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.535 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.535 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.535 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.535 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.535 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.535 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.535 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.535 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.535 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.535 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.535 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.535 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.535 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.536 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.537 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.537 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.537 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.537 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.537 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.537 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.537 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.537 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.537 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.537 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.537 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.537 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.537 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.537 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.537 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.537 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.538 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.538 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.538 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.538 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.538 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.538 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.538 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.538 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.538 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.538 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.538 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.538 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.538 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.538 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.539 INFO:teuthology.orchestra.run.smithi069.stdout: "min_score": { 2024-05-14T15:42:01.539 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_score", 2024-05-14T15:42:01.539 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:01.539 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.539 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.539 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.539 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.539 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.539 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.539 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-05-14T15:42:01.539 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.539 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.539 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.539 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.539 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2024-05-14T15:42:01.540 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2024-05-14T15:42:01.540 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.540 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.540 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.540 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "upmap", 2024-05-14T15:42:01.540 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.540 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.540 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.540 INFO:teuthology.orchestra.run.smithi069.stdout: "crush-compat", 2024-05-14T15:42:01.540 INFO:teuthology.orchestra.run.smithi069.stdout: "none", 2024-05-14T15:42:01.540 INFO:teuthology.orchestra.run.smithi069.stdout: "read", 2024-05-14T15:42:01.540 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap", 2024-05-14T15:42:01.540 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap-read" 2024-05-14T15:42:01.540 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.540 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Balancer mode", 2024-05-14T15:42:01.541 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.541 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.541 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.541 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.541 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_ids": { 2024-05-14T15:42:01.541 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_ids", 2024-05-14T15:42:01.541 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.541 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.541 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.541 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.541 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.541 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.541 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.541 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-05-14T15:42:01.541 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.541 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.542 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.542 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.542 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-05-14T15:42:01.542 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-05-14T15:42:01.542 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.542 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.542 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.542 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-05-14T15:42:01.542 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.542 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.542 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.542 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-05-14T15:42:01.542 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.542 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.542 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.543 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.543 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.543 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.543 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.543 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.543 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.543 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.543 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.543 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.543 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.543 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.543 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.543 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.543 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.543 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_deviation": { 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_deviation", 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "deviation below which no optimization is attempted", 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: "upmap_max_optimizations": { 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "upmap_max_optimizations", 2024-05-14T15:42:01.544 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-05-14T15:42:01.545 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.545 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.545 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:01.545 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.545 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.545 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.545 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-05-14T15:42:01.545 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.545 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.545 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.545 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.545 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.545 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.545 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.545 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm", 2024-05-14T15:42:01.545 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.546 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.546 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.546 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_down_multiplier": { 2024-05-14T15:42:01.546 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_down_multiplier", 2024-05-14T15:42:01.546 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:01.546 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.546 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.546 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2024-05-14T15:42:01.546 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.546 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.546 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.546 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-05-14T15:42:01.546 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.546 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_refresh_rate": { 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_refresh_rate", 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "20", 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.547 INFO:teuthology.orchestra.run.smithi069.stdout: "agent_starting_port": { 2024-05-14T15:42:01.548 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "agent_starting_port", 2024-05-14T15:42:01.548 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.548 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.548 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.548 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4721", 2024-05-14T15:42:01.548 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.548 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.548 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.548 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-05-14T15:42:01.548 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.548 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.548 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.548 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.548 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_ptrace": { 2024-05-14T15:42:01.548 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_ptrace", 2024-05-14T15:42:01.549 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.549 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.549 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.549 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.549 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.549 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.549 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.549 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-05-14T15:42:01.549 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-05-14T15:42:01.549 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.549 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.549 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.549 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_interval": { 2024-05-14T15:42:01.549 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_interval", 2024-05-14T15:42:01.549 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.550 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.550 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.550 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-05-14T15:42:01.550 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.550 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.550 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.550 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to autotune daemon memory", 2024-05-14T15:42:01.550 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.550 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.550 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.550 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.550 INFO:teuthology.orchestra.run.smithi069.stdout: "autotune_memory_target_ratio": { 2024-05-14T15:42:01.550 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "autotune_memory_target_ratio", 2024-05-14T15:42:01.550 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:01.550 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.550 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.551 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0.7", 2024-05-14T15:42:01.551 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.551 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.551 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.551 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-05-14T15:42:01.551 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.551 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.551 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.551 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.551 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm_log_destination": { 2024-05-14T15:42:01.551 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cephadm_log_destination", 2024-05-14T15:42:01.551 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.551 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.551 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.551 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.551 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: "file", 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: "file,syslog", 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: "syslog" 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: "cgroups_split": { 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cgroups_split", 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.552 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.553 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.553 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.553 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.553 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-05-14T15:42:01.553 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.553 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.553 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.553 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.553 INFO:teuthology.orchestra.run.smithi069.stdout: "config_checks_enabled": { 2024-05-14T15:42:01.553 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_checks_enabled", 2024-05-14T15:42:01.553 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.553 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.553 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.553 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.553 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.553 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.554 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.554 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-05-14T15:42:01.554 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.554 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.554 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.554 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.554 INFO:teuthology.orchestra.run.smithi069.stdout: "config_dashboard": { 2024-05-14T15:42:01.554 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_dashboard", 2024-05-14T15:42:01.554 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.554 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.554 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.554 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.554 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.554 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.555 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.555 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-05-14T15:42:01.555 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.555 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.555 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.555 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.555 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_alertmanager": { 2024-05-14T15:42:01.555 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_alertmanager", 2024-05-14T15:42:01.555 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.555 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.555 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.555 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-05-14T15:42:01.555 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.555 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.555 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.556 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-05-14T15:42:01.556 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.556 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.556 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.556 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.556 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_base": { 2024-05-14T15:42:01.556 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_base", 2024-05-14T15:42:01.556 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.556 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.556 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.556 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/ceph", 2024-05-14T15:42:01.556 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.556 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.556 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.556 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Container image name, without the tag", 2024-05-14T15:42:01.556 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.557 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.557 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.557 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.557 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_elasticsearch": { 2024-05-14T15:42:01.557 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_elasticsearch", 2024-05-14T15:42:01.557 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.557 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.557 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.557 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-05-14T15:42:01.557 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.557 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.557 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.557 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "elasticsearch container image", 2024-05-14T15:42:01.557 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.557 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.558 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.558 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.558 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_grafana": { 2024-05-14T15:42:01.558 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_grafana", 2024-05-14T15:42:01.558 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.558 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.558 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.558 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-05-14T15:42:01.558 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.558 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.558 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.558 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-05-14T15:42:01.558 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.558 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.558 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_haproxy": { 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_haproxy", 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "HAproxy container image", 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_agent": { 2024-05-14T15:42:01.559 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_agent", 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger agent container image", 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_collector": { 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_collector", 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.560 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.561 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-05-14T15:42:01.561 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.561 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.561 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.561 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger collector container image", 2024-05-14T15:42:01.561 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.561 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.561 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.561 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.561 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_jaeger_query": { 2024-05-14T15:42:01.561 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_jaeger_query", 2024-05-14T15:42:01.561 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.561 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.561 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.561 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-05-14T15:42:01.561 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.562 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.562 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.562 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Jaeger query container image", 2024-05-14T15:42:01.562 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.562 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.562 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.562 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.562 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_keepalived": { 2024-05-14T15:42:01.562 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_keepalived", 2024-05-14T15:42:01.562 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.562 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.562 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.562 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-05-14T15:42:01.562 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.563 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.563 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.563 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Keepalived container image", 2024-05-14T15:42:01.563 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.563 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.563 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.563 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.563 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_loki": { 2024-05-14T15:42:01.563 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_loki", 2024-05-14T15:42:01.563 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.563 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.563 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.563 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/loki:2.4.0", 2024-05-14T15:42:01.563 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.563 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.563 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Loki container image", 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_node_exporter": { 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_node_exporter", 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.564 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.565 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.565 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.565 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_nvmeof": { 2024-05-14T15:42:01.565 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_nvmeof", 2024-05-14T15:42:01.565 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.565 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.565 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.565 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.1", 2024-05-14T15:42:01.565 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.565 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.565 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.565 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Nvme-of container image", 2024-05-14T15:42:01.565 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.565 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.565 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.566 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.566 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_prometheus": { 2024-05-14T15:42:01.566 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_prometheus", 2024-05-14T15:42:01.566 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.566 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.566 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.566 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-05-14T15:42:01.566 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.566 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.566 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.566 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Prometheus container image", 2024-05-14T15:42:01.566 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.566 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.566 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.566 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.566 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_promtail": { 2024-05-14T15:42:01.567 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_promtail", 2024-05-14T15:42:01.567 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.567 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.567 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.567 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/grafana/promtail:2.4.0", 2024-05-14T15:42:01.567 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.567 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.567 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.567 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Promtail container image", 2024-05-14T15:42:01.567 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.567 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.567 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.567 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.567 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_samba": { 2024-05-14T15:42:01.567 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_samba", 2024-05-14T15:42:01.567 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.568 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.568 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.568 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-05-14T15:42:01.568 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.568 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.568 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.568 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Samba/SMB container image", 2024-05-14T15:42:01.568 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.568 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.568 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.568 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.568 INFO:teuthology.orchestra.run.smithi069.stdout: "container_image_snmp_gateway": { 2024-05-14T15:42:01.568 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_image_snmp_gateway", 2024-05-14T15:42:01.568 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.568 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.568 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.569 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-05-14T15:42:01.569 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.569 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.569 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.569 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "SNMP Gateway container image", 2024-05-14T15:42:01.569 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.569 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.569 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.569 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.569 INFO:teuthology.orchestra.run.smithi069.stdout: "container_init": { 2024-05-14T15:42:01.569 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "container_init", 2024-05-14T15:42:01.569 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.569 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.569 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.569 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.569 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.570 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.570 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.570 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Run podman/docker with `--init`", 2024-05-14T15:42:01.570 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.570 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.570 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.570 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.570 INFO:teuthology.orchestra.run.smithi069.stdout: "daemon_cache_timeout": { 2024-05-14T15:42:01.570 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "daemon_cache_timeout", 2024-05-14T15:42:01.570 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.570 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.570 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.570 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-05-14T15:42:01.570 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.571 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.571 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.571 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-05-14T15:42:01.571 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.571 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.571 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.571 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.571 INFO:teuthology.orchestra.run.smithi069.stdout: "default_cephadm_command_timeout": { 2024-05-14T15:42:01.571 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_cephadm_command_timeout", 2024-05-14T15:42:01.571 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.571 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.571 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.571 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "900", 2024-05-14T15:42:01.571 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.571 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.572 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.572 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-05-14T15:42:01.572 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.572 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.572 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.572 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.572 INFO:teuthology.orchestra.run.smithi069.stdout: "default_registry": { 2024-05-14T15:42:01.572 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "default_registry", 2024-05-14T15:42:01.572 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.572 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.572 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.572 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "docker.io", 2024-05-14T15:42:01.572 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.572 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.572 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.573 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-05-14T15:42:01.573 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.573 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.573 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.573 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.573 INFO:teuthology.orchestra.run.smithi069.stdout: "device_cache_timeout": { 2024-05-14T15:42:01.573 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_cache_timeout", 2024-05-14T15:42:01.573 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.573 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.573 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.573 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1800", 2024-05-14T15:42:01.573 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.573 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.573 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.573 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache device inventory", 2024-05-14T15:42:01.574 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.574 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.574 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.574 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.574 INFO:teuthology.orchestra.run.smithi069.stdout: "device_enhanced_scan": { 2024-05-14T15:42:01.574 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_enhanced_scan", 2024-05-14T15:42:01.574 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.574 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.574 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.574 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.574 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.574 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.574 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.574 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use libstoragemgmt during device scans", 2024-05-14T15:42:01.575 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.575 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.575 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.575 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.575 INFO:teuthology.orchestra.run.smithi069.stdout: "facts_cache_timeout": { 2024-05-14T15:42:01.575 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "facts_cache_timeout", 2024-05-14T15:42:01.575 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.575 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.575 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.575 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-05-14T15:42:01.575 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.575 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.575 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.575 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "seconds to cache host facts data", 2024-05-14T15:42:01.575 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.575 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.576 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.576 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.576 INFO:teuthology.orchestra.run.smithi069.stdout: "grafana_dashboards_path": { 2024-05-14T15:42:01.576 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "grafana_dashboards_path", 2024-05-14T15:42:01.576 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.576 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.576 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.576 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-05-14T15:42:01.576 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.576 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.576 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.576 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-05-14T15:42:01.576 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.576 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.576 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.576 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.577 INFO:teuthology.orchestra.run.smithi069.stdout: "host_check_interval": { 2024-05-14T15:42:01.577 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "host_check_interval", 2024-05-14T15:42:01.577 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.577 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.577 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.577 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-05-14T15:42:01.577 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.577 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.577 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.577 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to perform a host check", 2024-05-14T15:42:01.577 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.577 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.577 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.577 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.577 INFO:teuthology.orchestra.run.smithi069.stdout: "hw_monitoring": { 2024-05-14T15:42:01.577 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hw_monitoring", 2024-05-14T15:42:01.578 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.578 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.578 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.578 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.578 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.578 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.578 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.578 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-05-14T15:42:01.578 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.578 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.578 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.578 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.578 INFO:teuthology.orchestra.run.smithi069.stdout: "inventory_list_all": { 2024-05-14T15:42:01.578 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "inventory_list_all", 2024-05-14T15:42:01.578 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.579 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.579 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.579 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.579 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.579 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.579 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.579 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-05-14T15:42:01.579 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.579 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.579 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.579 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.579 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.579 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.579 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.579 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.579 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.580 INFO:teuthology.orchestra.run.smithi069.stdout: "log_refresh_metadata": { 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_refresh_metadata", 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.581 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.582 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.582 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.582 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.582 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.582 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.582 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-05-14T15:42:01.582 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.582 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.582 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.582 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.582 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.582 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.582 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.582 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.582 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.583 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.583 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.583 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.583 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.583 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.583 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.583 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.583 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.583 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.583 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.583 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.583 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.583 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.583 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.583 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.584 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.584 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.584 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.584 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.584 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.584 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.584 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.584 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.584 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.584 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.584 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.584 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.584 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.584 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.584 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.584 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf": { 2024-05-14T15:42:01.585 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-05-14T15:42:01.585 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.585 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.585 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.585 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.585 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.585 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.585 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.585 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-05-14T15:42:01.585 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.585 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.585 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.585 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.585 INFO:teuthology.orchestra.run.smithi069.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-05-14T15:42:01.585 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-05-14T15:42:01.585 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.586 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.586 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.586 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "*", 2024-05-14T15:42:01.586 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.586 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.586 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.586 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-05-14T15:42:01.586 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.586 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.586 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.586 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.586 INFO:teuthology.orchestra.run.smithi069.stdout: "max_count_per_host": { 2024-05-14T15:42:01.586 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_count_per_host", 2024-05-14T15:42:01.586 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.586 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.587 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.587 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:01.587 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.587 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.587 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.587 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of daemons per service per host", 2024-05-14T15:42:01.587 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.587 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.587 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.587 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.587 INFO:teuthology.orchestra.run.smithi069.stdout: "max_osd_draining_count": { 2024-05-14T15:42:01.587 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_osd_draining_count", 2024-05-14T15:42:01.588 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.588 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.588 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.588 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:01.588 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.588 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.588 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.588 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-05-14T15:42:01.588 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.588 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.588 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.588 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.588 INFO:teuthology.orchestra.run.smithi069.stdout: "migration_current": { 2024-05-14T15:42:01.588 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "migration_current", 2024-05-14T15:42:01.589 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.589 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.589 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.589 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.589 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.589 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.589 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.589 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "internal - do not modify", 2024-05-14T15:42:01.589 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.589 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.589 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.589 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.589 INFO:teuthology.orchestra.run.smithi069.stdout: "mode": { 2024-05-14T15:42:01.589 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mode", 2024-05-14T15:42:01.590 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.590 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.590 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.590 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "root", 2024-05-14T15:42:01.590 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.590 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.590 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.590 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm-package", 2024-05-14T15:42:01.590 INFO:teuthology.orchestra.run.smithi069.stdout: "root" 2024-05-14T15:42:01.590 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.590 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "mode for remote execution of cephadm", 2024-05-14T15:42:01.590 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.590 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.590 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.591 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.591 INFO:teuthology.orchestra.run.smithi069.stdout: "oob_default_addr": { 2024-05-14T15:42:01.591 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "oob_default_addr", 2024-05-14T15:42:01.591 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.591 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.591 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.591 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "169.254.1.1", 2024-05-14T15:42:01.591 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.591 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.591 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.591 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Default address for RedFish API (oob management).", 2024-05-14T15:42:01.591 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.591 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.591 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.592 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.592 INFO:teuthology.orchestra.run.smithi069.stdout: "prometheus_alerts_path": { 2024-05-14T15:42:01.592 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus_alerts_path", 2024-05-14T15:42:01.592 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.592 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.592 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.592 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-05-14T15:42:01.592 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.592 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.592 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.592 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-05-14T15:42:01.592 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.592 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.592 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.592 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.592 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_insecure": { 2024-05-14T15:42:01.593 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_insecure", 2024-05-14T15:42:01.593 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.593 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.593 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.593 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.593 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.593 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.593 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.593 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-05-14T15:42:01.593 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.593 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.593 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.593 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.593 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_password": { 2024-05-14T15:42:01.593 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_password", 2024-05-14T15:42:01.593 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.594 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.594 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.594 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.594 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.594 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.594 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.594 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-05-14T15:42:01.594 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.594 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.594 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.594 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.594 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_url": { 2024-05-14T15:42:01.594 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_url", 2024-05-14T15:42:01.594 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.594 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: "registry_username": { 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "registry_username", 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.595 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: "secure_monitoring_stack": { 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "secure_monitoring_stack", 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.596 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-05-14T15:42:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: "service_discovery_port": { 2024-05-14T15:42:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "service_discovery_port", 2024-05-14T15:42:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8765", 2024-05-14T15:42:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "cephadm service discovery port", 2024-05-14T15:42:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.597 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.598 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.598 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.598 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.598 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.598 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.598 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.598 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.598 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.598 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.598 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.598 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.598 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.598 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.598 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.599 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.599 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.599 INFO:teuthology.orchestra.run.smithi069.stdout: "ssh_config_file": { 2024-05-14T15:42:01.599 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssh_config_file", 2024-05-14T15:42:01.599 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.599 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.599 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.599 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.599 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.599 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.599 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.599 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-05-14T15:42:01.599 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.599 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.599 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.599 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: "use_agent": { 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_agent", 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: "use_repo_digest": { 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "use_repo_digest", 2024-05-14T15:42:01.600 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.601 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.601 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.601 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.601 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.601 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.601 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.601 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-05-14T15:42:01.601 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.601 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.601 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.601 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.601 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_failed_host_check": { 2024-05-14T15:42:01.601 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_failed_host_check", 2024-05-14T15:42:01.601 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.601 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.601 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.602 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.602 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.602 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.602 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.602 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if the host check fails", 2024-05-14T15:42:01.602 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.602 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.602 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.602 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.602 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_daemons": { 2024-05-14T15:42:01.602 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_daemons", 2024-05-14T15:42:01.602 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.602 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.602 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.602 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.602 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.603 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.603 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.603 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-05-14T15:42:01.603 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.603 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.603 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.603 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.603 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_on_stray_hosts": { 2024-05-14T15:42:01.603 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_on_stray_hosts", 2024-05-14T15:42:01.603 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.603 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.603 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.603 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.603 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.603 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-05-14T15:42:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crash", 2024-05-14T15:42:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.604 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.605 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.606 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.606 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.606 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.606 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.606 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.606 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.606 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.606 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.606 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.606 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.606 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.606 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.606 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.606 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.606 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.607 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.608 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: "retain_interval": { 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retain_interval", 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "31536000", 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain crashes before pruning them", 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.609 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.610 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.610 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.610 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.610 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.610 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.610 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.610 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.610 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.610 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.610 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.610 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.610 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.610 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.610 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_recent_interval": { 2024-05-14T15:42:01.610 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_recent_interval", 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1209600", 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "time interval in which to warn about recent crashes", 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dashboard", 2024-05-14T15:42:01.611 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.612 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_HOST": { 2024-05-14T15:42:01.613 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_HOST", 2024-05-14T15:42:01.613 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.613 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.613 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.613 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.613 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.613 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.613 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.613 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.613 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.613 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.613 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.613 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.613 INFO:teuthology.orchestra.run.smithi069.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-05-14T15:42:01.613 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-05-14T15:42:01.613 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.614 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.614 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.614 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.614 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.614 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.614 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.614 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.614 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.614 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.614 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.614 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.614 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_ENABLED": { 2024-05-14T15:42:01.614 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_ENABLED", 2024-05-14T15:42:01.614 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.614 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.615 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.616 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.616 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.616 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.616 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.616 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.616 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.616 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.616 INFO:teuthology.orchestra.run.smithi069.stdout: "ENABLE_BROWSABLE_API": { 2024-05-14T15:42:01.616 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ENABLE_BROWSABLE_API", 2024-05-14T15:42:01.616 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.616 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.616 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.616 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.616 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.616 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.617 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.617 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.617 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.617 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.617 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.617 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.617 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-05-14T15:42:01.617 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-05-14T15:42:01.617 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.617 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.617 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.617 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.617 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.617 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.617 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.617 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.618 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.618 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.618 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.618 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.618 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-05-14T15:42:01.618 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-05-14T15:42:01.618 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.618 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.618 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.618 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.618 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.618 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.618 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.618 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.619 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.619 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.619 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.619 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.619 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-05-14T15:42:01.619 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-05-14T15:42:01.619 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.619 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.619 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.619 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.619 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.619 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.619 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.619 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.619 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.619 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.620 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.620 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.620 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-05-14T15:42:01.620 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-05-14T15:42:01.620 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.620 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.620 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.620 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.620 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.620 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.620 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.620 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.620 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.620 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.620 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.621 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.621 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_NFS": { 2024-05-14T15:42:01.621 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-05-14T15:42:01.621 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.621 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.621 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.621 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.621 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.621 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.621 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.621 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.621 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.621 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.621 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.621 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.621 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RBD": { 2024-05-14T15:42:01.622 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-05-14T15:42:01.622 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.622 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.622 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.622 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.622 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.622 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.622 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.622 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.622 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.622 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.622 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.622 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.622 INFO:teuthology.orchestra.run.smithi069.stdout: "FEATURE_TOGGLE_RGW": { 2024-05-14T15:42:01.622 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-05-14T15:42:01.623 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.623 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.623 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.623 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.623 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.623 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.623 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.623 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.623 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.623 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.623 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.623 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.623 INFO:teuthology.orchestra.run.smithi069.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-05-14T15:42:01.623 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-05-14T15:42:01.623 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.623 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.624 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.624 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.624 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.624 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.624 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.624 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.624 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.624 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.624 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.624 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.624 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_PASSWORD": { 2024-05-14T15:42:01.624 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_PASSWORD", 2024-05-14T15:42:01.624 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.624 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.624 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.625 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.626 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.626 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.626 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.626 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.626 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.626 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.626 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_URL": { 2024-05-14T15:42:01.626 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_URL", 2024-05-14T15:42:01.626 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.626 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.626 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.626 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.626 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.626 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.626 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.627 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.627 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.627 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.627 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.627 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.627 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_API_USERNAME": { 2024-05-14T15:42:01.627 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_API_USERNAME", 2024-05-14T15:42:01.627 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.627 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.627 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.627 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-05-14T15:42:01.627 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.627 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.627 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.627 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.628 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.628 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.628 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.628 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.628 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-05-14T15:42:01.628 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-05-14T15:42:01.628 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.628 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.628 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.628 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.628 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.628 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.628 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.628 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.628 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.628 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.629 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.629 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.629 INFO:teuthology.orchestra.run.smithi069.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-05-14T15:42:01.629 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-05-14T15:42:01.629 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.629 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.629 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.629 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.629 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.629 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.629 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.629 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.629 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.629 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.629 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.629 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.630 INFO:teuthology.orchestra.run.smithi069.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-05-14T15:42:01.630 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-05-14T15:42:01.630 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.630 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.630 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.630 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.630 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.630 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.630 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.630 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.630 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.630 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.630 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.630 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.630 INFO:teuthology.orchestra.run.smithi069.stdout: "ISSUE_TRACKER_API_KEY": { 2024-05-14T15:42:01.631 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-05-14T15:42:01.631 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.631 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.631 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.631 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.631 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.631 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.631 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.631 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.631 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.631 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.631 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.631 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.631 INFO:teuthology.orchestra.run.smithi069.stdout: "MANAGED_BY_CLUSTERS": { 2024-05-14T15:42:01.631 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-05-14T15:42:01.632 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.632 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.632 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.632 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "[]", 2024-05-14T15:42:01.632 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.632 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.632 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.632 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.632 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.632 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.632 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.632 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.632 INFO:teuthology.orchestra.run.smithi069.stdout: "MULTICLUSTER_CONFIG": { 2024-05-14T15:42:01.632 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "MULTICLUSTER_CONFIG", 2024-05-14T15:42:01.632 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.632 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.633 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.633 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "{}", 2024-05-14T15:42:01.633 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.633 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.633 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.633 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.633 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.633 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.633 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.633 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.633 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_HOST": { 2024-05-14T15:42:01.633 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_HOST", 2024-05-14T15:42:01.633 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.633 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.634 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.634 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.634 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.634 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.634 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.634 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.634 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.634 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.634 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.634 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.634 INFO:teuthology.orchestra.run.smithi069.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-05-14T15:42:01.634 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-05-14T15:42:01.634 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.634 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.635 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.635 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.635 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.635 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.635 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.635 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.635 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.635 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.635 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.635 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.635 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-05-14T15:42:01.635 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-05-14T15:42:01.635 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.635 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.635 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.635 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.636 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.636 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.636 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.636 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.636 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.636 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.636 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.636 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.636 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-05-14T15:42:01.636 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-05-14T15:42:01.636 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.636 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.636 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.636 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.636 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.636 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.637 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.638 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.638 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.638 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.638 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-05-14T15:42:01.638 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-05-14T15:42:01.638 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.638 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.638 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.638 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.638 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.638 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.638 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.638 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.638 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.639 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-05-14T15:42:01.640 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-05-14T15:42:01.640 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.640 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.640 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.640 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.640 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.640 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.640 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.640 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.640 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.640 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.640 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.640 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.640 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-05-14T15:42:01.640 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-05-14T15:42:01.640 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_ENABLED": { 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_ENABLED", 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.641 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.642 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.643 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.643 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.643 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.643 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.643 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.643 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-05-14T15:42:01.643 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-05-14T15:42:01.643 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.643 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.643 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.643 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:01.643 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.643 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.643 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.643 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.643 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.644 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.644 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.644 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.644 INFO:teuthology.orchestra.run.smithi069.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-05-14T15:42:01.644 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-05-14T15:42:01.644 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.644 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.644 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.644 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8", 2024-05-14T15:42:01.644 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.644 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.644 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.644 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.644 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.644 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.644 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.645 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.645 INFO:teuthology.orchestra.run.smithi069.stdout: "REST_REQUESTS_TIMEOUT": { 2024-05-14T15:42:01.645 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-05-14T15:42:01.645 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.645 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.645 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.645 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "45", 2024-05-14T15:42:01.645 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.645 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.645 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.645 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.645 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.645 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.645 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.645 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.645 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ACCESS_KEY": { 2024-05-14T15:42:01.646 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ACCESS_KEY", 2024-05-14T15:42:01.646 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.646 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.646 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.646 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.646 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.646 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.646 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.646 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.646 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.646 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.646 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.646 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.646 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-05-14T15:42:01.646 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-05-14T15:42:01.647 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.647 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.649 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.649 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "admin", 2024-05-14T15:42:01.649 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.649 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.649 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.649 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.649 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.649 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.649 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.650 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.650 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SECRET_KEY": { 2024-05-14T15:42:01.650 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SECRET_KEY", 2024-05-14T15:42:01.650 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.650 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.650 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.650 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.650 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.650 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.650 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.650 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.650 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.650 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.650 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.650 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.650 INFO:teuthology.orchestra.run.smithi069.stdout: "RGW_API_SSL_VERIFY": { 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "RGW_API_SSL_VERIFY", 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: "UNSAFE_TLS_v1_2": { 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "UNSAFE_TLS_v1_2", 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.651 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.652 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.653 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.653 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.653 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.653 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.653 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.653 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.653 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.653 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-05-14T15:42:01.653 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-05-14T15:42:01.653 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.653 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.653 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.653 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:01.653 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.653 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.653 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.654 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.654 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.654 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.654 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.654 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.654 INFO:teuthology.orchestra.run.smithi069.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-05-14T15:42:01.654 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-05-14T15:42:01.654 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.654 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.654 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.654 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-05-14T15:42:01.654 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.654 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.654 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.654 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.655 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.655 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.655 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.655 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.655 INFO:teuthology.orchestra.run.smithi069.stdout: "cross_origin_url": { 2024-05-14T15:42:01.655 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cross_origin_url", 2024-05-14T15:42:01.655 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.655 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.655 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.655 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.655 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.655 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.655 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.655 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.655 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.656 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.656 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.656 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.656 INFO:teuthology.orchestra.run.smithi069.stdout: "crt_file": { 2024-05-14T15:42:01.656 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "crt_file", 2024-05-14T15:42:01.656 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.656 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.656 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.656 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.656 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.656 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.656 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.656 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.656 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.656 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: "debug": { 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "debug", 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Enable/disable debug options", 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.657 INFO:teuthology.orchestra.run.smithi069.stdout: "jwt_token_ttl": { 2024-05-14T15:42:01.658 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "jwt_token_ttl", 2024-05-14T15:42:01.658 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.658 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.658 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.658 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "28800", 2024-05-14T15:42:01.658 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.658 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.658 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.658 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.658 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.658 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.658 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.658 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.658 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2024-05-14T15:42:01.658 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.659 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.660 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.660 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.660 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.660 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.660 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.660 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.660 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.660 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.660 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.660 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.660 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.660 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.660 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.660 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.660 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.660 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.661 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.661 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.661 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.661 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.661 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.661 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.661 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.661 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.661 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.661 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.661 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.661 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.661 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.661 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.661 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.661 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.662 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.662 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.662 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.662 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.662 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.662 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.662 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.662 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.662 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.662 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.662 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.662 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.662 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.662 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.662 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.663 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.664 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.664 INFO:teuthology.orchestra.run.smithi069.stdout: "motd": { 2024-05-14T15:42:01.664 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "motd", 2024-05-14T15:42:01.664 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.664 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.664 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.664 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.664 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.664 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.664 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.664 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "The message of the day", 2024-05-14T15:42:01.664 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.664 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.664 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.664 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.664 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect_resolve_ip_addr": { 2024-05-14T15:42:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "redirect_resolve_ip_addr", 2024-05-14T15:42:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.665 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-05-14T15:42:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-05-14T15:42:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2024-05-14T15:42:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-05-14T15:42:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-05-14T15:42:01.666 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.667 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.667 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.667 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8080", 2024-05-14T15:42:01.667 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.667 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.667 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.667 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.667 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.667 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.667 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.667 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.667 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.667 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.667 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.667 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.668 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.668 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.668 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.668 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.668 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.668 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.668 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.668 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.668 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.668 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.668 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2024-05-14T15:42:01.668 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2024-05-14T15:42:01.668 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.668 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.668 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.669 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.669 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.669 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.669 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.669 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.669 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.669 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.669 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.669 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.669 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl_server_port": { 2024-05-14T15:42:01.669 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl_server_port", 2024-05-14T15:42:01.669 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.669 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.669 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.669 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8443", 2024-05-14T15:42:01.670 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.670 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.670 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.670 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.670 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.670 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.670 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.670 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.670 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2024-05-14T15:42:01.670 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2024-05-14T15:42:01.670 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.670 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.670 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.670 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "redirect", 2024-05-14T15:42:01.670 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.670 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.671 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.671 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.671 INFO:teuthology.orchestra.run.smithi069.stdout: "redirect" 2024-05-14T15:42:01.671 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.671 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.671 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.671 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.671 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.671 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.671 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2024-05-14T15:42:01.671 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2024-05-14T15:42:01.671 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.671 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.671 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.671 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "url_prefix": { 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url_prefix", 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.672 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_monitoring": { 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_monitoring", 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.673 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "monitor device health metrics", 2024-05-14T15:42:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.674 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.675 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.676 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.677 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.678 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "mark_out_threshold": { 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mark_out_threshold", 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "2419200", 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.679 INFO:teuthology.orchestra.run.smithi069.stdout: "pool_name": { 2024-05-14T15:42:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pool_name", 2024-05-14T15:42:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "device_health_metrics", 2024-05-14T15:42:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name of pool in which to store device health metrics", 2024-05-14T15:42:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "retention_period": { 2024-05-14T15:42:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "retention_period", 2024-05-14T15:42:01.680 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15552000", 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long to retain device health metrics", 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_frequency": { 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_frequency", 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.681 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2024-05-14T15:42:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to scrape device health metrics", 2024-05-14T15:42:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "self_heal": { 2024-05-14T15:42:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "self_heal", 2024-05-14T15:42:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.682 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.683 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how frequently to wake up and check device health", 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.684 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "warn_threshold": { 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "warn_threshold", 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7257600", 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.685 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "diskprediction_local", 2024-05-14T15:42:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.686 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.687 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.688 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.689 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "predict_interval": { 2024-05-14T15:42:01.690 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predict_interval", 2024-05-14T15:42:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "86400", 2024-05-14T15:42:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "predictor_model": { 2024-05-14T15:42:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "predictor_model", 2024-05-14T15:42:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.691 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "prophetstor", 2024-05-14T15:42:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-05-14T15:42:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-05-14T15:42:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.692 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "600", 2024-05-14T15:42:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.693 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "influx", 2024-05-14T15:42:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": false, 2024-05-14T15:42:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "influxdb python module not found", 2024-05-14T15:42:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.694 INFO:teuthology.orchestra.run.smithi069.stdout: "batch_size": { 2024-05-14T15:42:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "batch_size", 2024-05-14T15:42:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5000", 2024-05-14T15:42:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-05-14T15:42:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "database": { 2024-05-14T15:42:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "database", 2024-05-14T15:42:01.695 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "ceph", 2024-05-14T15:42:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-05-14T15:42:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "hostname": { 2024-05-14T15:42:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "hostname", 2024-05-14T15:42:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.696 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server hostname", 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "30", 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "5", 2024-05-14T15:42:01.697 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-05-14T15:42:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.698 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.699 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.700 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.701 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "password": { 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "password", 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.702 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "password of InfluxDB server user", 2024-05-14T15:42:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "port": { 2024-05-14T15:42:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "port", 2024-05-14T15:42:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "8086", 2024-05-14T15:42:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.703 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "InfluxDB server port", 2024-05-14T15:42:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.704 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "ssl": { 2024-05-14T15:42:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ssl", 2024-05-14T15:42:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "false", 2024-05-14T15:42:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T15:42:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.705 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "threads": { 2024-05-14T15:42:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threads", 2024-05-14T15:42:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-05-14T15:42:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-05-14T15:42:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "32", 2024-05-14T15:42:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-05-14T15:42:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "username": { 2024-05-14T15:42:01.706 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "username", 2024-05-14T15:42:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "username of InfluxDB server user", 2024-05-14T15:42:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "verify_ssl": { 2024-05-14T15:42:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "verify_ssl", 2024-05-14T15:42:01.707 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "true", 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "insights", 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.708 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.709 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.710 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.711 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.712 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.713 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "iostat", 2024-05-14T15:42:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.714 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.715 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.716 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.717 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.718 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "k8sevents", 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.719 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_event_retention_days": { 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "ceph_event_retention_days", 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "7", 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Days to hold ceph event information within local cache", 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "config_check_secs": { 2024-05-14T15:42:01.720 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "config_check_secs", 2024-05-14T15:42:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "10", 2024-05-14T15:42:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-05-14T15:42:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.721 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.722 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.723 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.724 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.725 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.726 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "localpool", 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "failure_domain": { 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "failure_domain", 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "host", 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.727 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "failure domain for any created local pool", 2024-05-14T15:42:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-05-14T15:42:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.728 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.729 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.730 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.731 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.732 INFO:teuthology.orchestra.run.smithi069.stdout: "min_size": { 2024-05-14T15:42:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "min_size", 2024-05-14T15:42:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default min_size for any created local pool", 2024-05-14T15:42:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-05-14T15:42:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "num_rep": { 2024-05-14T15:42:01.733 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "num_rep", 2024-05-14T15:42:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3", 2024-05-14T15:42:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default replica count for any created local pool", 2024-05-14T15:42:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_num": { 2024-05-14T15:42:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_num", 2024-05-14T15:42:01.734 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "128", 2024-05-14T15:42:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "default pg_num for any created local pool", 2024-05-14T15:42:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "prefix": { 2024-05-14T15:42:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prefix", 2024-05-14T15:42:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.735 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "name prefix for any created local pool", 2024-05-14T15:42:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.736 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "subtree": { 2024-05-14T15:42:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "subtree", 2024-05-14T15:42:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "rack", 2024-05-14T15:42:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.737 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "CRUSH level for which to create a local pool", 2024-05-14T15:42:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-05-14T15:42:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mds_autoscaler", 2024-05-14T15:42:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.738 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.739 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.740 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.741 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.742 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.743 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirroring", 2024-05-14T15:42:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.744 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.745 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.746 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.747 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.748 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.749 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.750 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "nfs", 2024-05-14T15:42:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.751 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.752 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.753 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.754 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.755 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.756 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2024-05-14T15:42:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "fail_fs": { 2024-05-14T15:42:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "fail_fs", 2024-05-14T15:42:01.757 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-05-14T15:42:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.758 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.759 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.760 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.761 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.762 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator": { 2024-05-14T15:42:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "orchestrator", 2024-05-14T15:42:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.763 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "cephadm", 2024-05-14T15:42:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "rook", 2024-05-14T15:42:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "test_orchestrator" 2024-05-14T15:42:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Orchestrator backend", 2024-05-14T15:42:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.764 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.765 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_perf_query", 2024-05-14T15:42:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.766 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.767 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.768 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.769 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.770 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "osd_support", 2024-05-14T15:42:01.771 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.772 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.773 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.774 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.775 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.776 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "pg_autoscaler", 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.777 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.778 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.779 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.780 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-05-14T15:42:01.781 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-05-14T15:42:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-05-14T15:42:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.782 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "threshold": { 2024-05-14T15:42:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "threshold", 2024-05-14T15:42:01.783 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "3.0", 2024-05-14T15:42:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1.0", 2024-05-14T15:42:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "scaling threshold", 2024-05-14T15:42:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-05-14T15:42:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.784 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "progress", 2024-05-14T15:42:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_pg_recovery_event": { 2024-05-14T15:42:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_pg_recovery_event", 2024-05-14T15:42:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow the module to show pg recovery progress", 2024-05-14T15:42:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.785 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2024-05-14T15:42:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2024-05-14T15:42:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.786 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.787 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.788 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.789 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.790 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "max_completed_events": { 2024-05-14T15:42:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_completed_events", 2024-05-14T15:42:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.791 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "50", 2024-05-14T15:42:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "number of past completed events to remember", 2024-05-14T15:42:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "sleep_interval": { 2024-05-14T15:42:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sleep_interval", 2024-05-14T15:42:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "5", 2024-05-14T15:42:01.792 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "how long the module is going to sleep", 2024-05-14T15:42:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.793 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "prometheus", 2024-05-14T15:42:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.794 INFO:teuthology.orchestra.run.smithi069.stdout: "cache": { 2024-05-14T15:42:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "cache", 2024-05-14T15:42:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "exclude_perf_counters": { 2024-05-14T15:42:01.795 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "exclude_perf_counters", 2024-05-14T15:42:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-05-14T15:42:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-05-14T15:42:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.796 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.797 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.798 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.799 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.800 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools": { 2024-05-14T15:42:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools", 2024-05-14T15:42:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.801 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_stats_pools_refresh_interval": { 2024-05-14T15:42:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-05-14T15:42:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "300", 2024-05-14T15:42:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.802 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "scrape_interval": { 2024-05-14T15:42:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "scrape_interval", 2024-05-14T15:42:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15.0", 2024-05-14T15:42:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.803 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-05-14T15:42:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-05-14T15:42:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "::", 2024-05-14T15:42:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-05-14T15:42:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.804 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-05-14T15:42:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-05-14T15:42:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "9283", 2024-05-14T15:42:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-05-14T15:42:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.805 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.806 INFO:teuthology.orchestra.run.smithi069.stdout: "stale_cache_strategy": { 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stale_cache_strategy", 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "log", 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_behaviour": { 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_behaviour", 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.807 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "default", 2024-05-14T15:42:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "default", 2024-05-14T15:42:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "error" 2024-05-14T15:42:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "standby_error_status_code": { 2024-05-14T15:42:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "standby_error_status_code", 2024-05-14T15:42:01.808 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "500", 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "400", 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "599", 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.809 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.810 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.811 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.812 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.813 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_snap_create": { 2024-05-14T15:42:01.814 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_snap_create", 2024-05-14T15:42:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10", 2024-05-14T15:42:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "mirror_snapshot_schedule": { 2024-05-14T15:42:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "mirror_snapshot_schedule", 2024-05-14T15:42:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.815 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.816 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "trash_purge_schedule": { 2024-05-14T15:42:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "trash_purge_schedule", 2024-05-14T15:42:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.817 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "restful", 2024-05-14T15:42:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.818 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "enable_auth": { 2024-05-14T15:42:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enable_auth", 2024-05-14T15:42:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "key_file": { 2024-05-14T15:42:01.819 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "key_file", 2024-05-14T15:42:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.820 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.821 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.822 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.823 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.824 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "server_addr": { 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_addr", 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.825 INFO:teuthology.orchestra.run.smithi069.stdout: "server_port": { 2024-05-14T15:42:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "server_port", 2024-05-14T15:42:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.826 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rgw", 2024-05-14T15:42:01.827 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.828 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.829 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.830 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.831 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.832 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rook", 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.833 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.834 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.835 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.836 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.837 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.838 INFO:teuthology.orchestra.run.smithi069.stdout: "storage_class": { 2024-05-14T15:42:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "storage_class", 2024-05-14T15:42:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "local", 2024-05-14T15:42:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-05-14T15:42:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.839 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "selftest", 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.840 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.841 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.842 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.843 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "roption1": { 2024-05-14T15:42:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption1", 2024-05-14T15:42:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.844 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "roption2": { 2024-05-14T15:42:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "roption2", 2024-05-14T15:42:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.845 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "xyz", 2024-05-14T15:42:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption1": { 2024-05-14T15:42:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption1", 2024-05-14T15:42:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.846 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption2": { 2024-05-14T15:42:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption2", 2024-05-14T15:42:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.847 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption3": { 2024-05-14T15:42:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption3", 2024-05-14T15:42:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "float", 2024-05-14T15:42:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.848 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.849 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.849 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.849 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.849 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.849 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.849 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.849 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.849 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption4": { 2024-05-14T15:42:01.849 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption4", 2024-05-14T15:42:01.849 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.849 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.849 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.849 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.849 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.849 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.850 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.850 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.850 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.850 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.850 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.850 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.850 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption5": { 2024-05-14T15:42:01.850 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption5", 2024-05-14T15:42:01.850 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.850 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.850 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.853 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.853 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.853 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.853 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.853 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.853 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.854 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.854 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.854 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.854 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption6": { 2024-05-14T15:42:01.854 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption6", 2024-05-14T15:42:01.854 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.854 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.854 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.854 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.854 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.854 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.854 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.854 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.854 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.855 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.855 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.855 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.855 INFO:teuthology.orchestra.run.smithi069.stdout: "rwoption7": { 2024-05-14T15:42:01.855 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rwoption7", 2024-05-14T15:42:01.855 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.855 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.855 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.855 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.855 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "1", 2024-05-14T15:42:01.855 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "42", 2024-05-14T15:42:01.855 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.855 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.855 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.855 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.856 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.856 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.856 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.856 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.856 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.856 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.856 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.856 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.856 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.856 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.856 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.856 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.856 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.856 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.856 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.857 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.857 INFO:teuthology.orchestra.run.smithi069.stdout: "testkey": { 2024-05-14T15:42:01.857 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testkey", 2024-05-14T15:42:01.857 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.857 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.857 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.857 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.857 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.857 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.857 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.857 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.857 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.857 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.857 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.857 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.858 INFO:teuthology.orchestra.run.smithi069.stdout: "testlkey": { 2024-05-14T15:42:01.858 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testlkey", 2024-05-14T15:42:01.858 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.858 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.858 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.858 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.858 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.858 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.858 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.858 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.858 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.858 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.858 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.858 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.858 INFO:teuthology.orchestra.run.smithi069.stdout: "testnewline": { 2024-05-14T15:42:01.859 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "testnewline", 2024-05-14T15:42:01.859 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.859 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.859 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.859 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.859 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.859 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.859 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.859 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.859 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.859 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.859 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.859 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.859 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.859 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.859 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.860 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "smb", 2024-05-14T15:42:01.860 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.860 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.860 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.860 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.860 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.860 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.860 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.860 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.860 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.860 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.860 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.860 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.860 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.860 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.860 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.861 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.862 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.862 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.862 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.862 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.862 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.862 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.862 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.862 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.862 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.862 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.862 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.862 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.862 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.862 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.862 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.863 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.864 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.864 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.864 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.864 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.864 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.864 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.864 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.864 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.864 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.864 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.864 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.864 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.864 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.864 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.864 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: "update_orchestration": { 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "update_orchestration", 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.865 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.866 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-05-14T15:42:01.866 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.866 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.866 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.866 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.866 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.866 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.866 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.866 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2024-05-14T15:42:01.866 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.866 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.866 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.866 INFO:teuthology.orchestra.run.smithi069.stdout: "allow_m_granularity": { 2024-05-14T15:42:01.866 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "allow_m_granularity", 2024-05-14T15:42:01.866 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.867 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.867 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.867 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.867 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.867 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.867 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.867 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "allow minute scheduled snapshots", 2024-05-14T15:42:01.867 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.867 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.867 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.867 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.867 INFO:teuthology.orchestra.run.smithi069.stdout: "dump_on_update": { 2024-05-14T15:42:01.867 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "dump_on_update", 2024-05-14T15:42:01.867 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.867 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.868 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.868 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.868 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.868 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.868 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.868 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "dump database to debug log on update", 2024-05-14T15:42:01.868 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.868 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.868 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.868 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.868 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.868 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.868 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.868 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.868 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.868 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.869 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.869 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.869 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.869 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.869 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.869 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.869 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.869 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.869 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.869 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.869 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.869 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.869 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.869 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.869 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.870 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.870 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.870 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.870 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.870 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.870 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.870 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.870 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.870 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.870 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.870 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.870 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.870 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.870 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.870 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.871 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.871 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.871 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.871 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.871 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.871 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.871 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.871 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.871 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.871 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.871 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.871 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.871 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.871 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.871 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.872 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.873 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.874 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.874 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.874 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "stats", 2024-05-14T15:42:01.874 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.874 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.874 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.874 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.874 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.874 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.874 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.874 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.874 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.874 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.874 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.874 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.875 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.876 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.876 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.876 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.876 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.876 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.876 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.876 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.876 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.876 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.876 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.876 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.876 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.876 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.876 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.876 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.876 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.877 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.878 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.878 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.878 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.878 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.878 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.878 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.878 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.878 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.878 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.878 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.878 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.878 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.878 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.878 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.879 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.879 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.879 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.879 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.879 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.879 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.879 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.879 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.879 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.879 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.879 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.879 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.879 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.879 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.879 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "status", 2024-05-14T15:42:01.879 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.880 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.881 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.882 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.882 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.882 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.882 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.882 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.882 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.882 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.882 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.882 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.882 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.882 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.882 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.882 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.882 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.882 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.882 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.883 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.883 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.883 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.883 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.883 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.883 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.883 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.883 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.883 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.883 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.883 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.883 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.883 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.883 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.883 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.884 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telegraf", 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: "address": { 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "address", 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.885 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-05-14T15:42:01.886 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.886 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.886 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.886 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.886 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.886 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.886 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.886 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.886 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-05-14T15:42:01.886 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-05-14T15:42:01.886 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.886 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.886 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.886 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "15", 2024-05-14T15:42:01.886 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.886 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.887 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.888 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.889 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.890 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.890 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.890 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.890 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.890 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.890 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.890 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.890 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.890 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.890 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.890 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.890 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.890 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.890 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.890 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.890 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.891 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.891 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.891 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.891 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.891 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.891 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.891 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.891 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.891 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.891 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.891 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.891 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.891 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.891 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.891 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.891 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.892 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.892 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.892 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.892 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.892 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.892 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.892 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.892 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.892 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.892 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.892 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "telemetry", 2024-05-14T15:42:01.892 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.892 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.892 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.892 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_basic": { 2024-05-14T15:42:01.892 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_basic", 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share basic cluster information (size, version)", 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_crash": { 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_crash", 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.893 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.894 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.894 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.894 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.894 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.894 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-05-14T15:42:01.894 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.894 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.894 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.894 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.894 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_device": { 2024-05-14T15:42:01.894 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_device", 2024-05-14T15:42:01.894 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.894 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.894 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.894 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.894 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.895 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.895 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.895 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-05-14T15:42:01.895 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.895 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.895 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.895 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.895 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_ident": { 2024-05-14T15:42:01.895 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_ident", 2024-05-14T15:42:01.895 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.895 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.895 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.895 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.895 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.896 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.896 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.896 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-05-14T15:42:01.896 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.896 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.896 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.896 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.896 INFO:teuthology.orchestra.run.smithi069.stdout: "channel_perf": { 2024-05-14T15:42:01.896 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "channel_perf", 2024-05-14T15:42:01.896 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.896 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.896 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.896 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.896 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.896 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.896 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Share various performance metrics of a cluster", 2024-05-14T15:42:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: "contact": { 2024-05-14T15:42:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "contact", 2024-05-14T15:42:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.897 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.898 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.898 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.898 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.898 INFO:teuthology.orchestra.run.smithi069.stdout: "description": { 2024-05-14T15:42:01.898 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "description", 2024-05-14T15:42:01.898 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.898 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.898 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.898 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.898 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.898 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.898 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.898 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.898 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.898 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: "device_url": { 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "device_url", 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.899 INFO:teuthology.orchestra.run.smithi069.stdout: "enabled": { 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "enabled", 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.900 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "24", 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "8", 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: "last_opt_revision": { 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "last_opt_revision", 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "1", 2024-05-14T15:42:01.901 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard": { 2024-05-14T15:42:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard", 2024-05-14T15:42:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.902 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "leaderboard_description": { 2024-05-14T15:42:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "leaderboard_description", 2024-05-14T15:42:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.903 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.904 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.904 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.904 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.904 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.904 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.904 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.904 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.904 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.904 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.904 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.904 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.904 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.904 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.904 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.904 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.905 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.905 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.905 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.905 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.905 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.905 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.905 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.905 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.905 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.905 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.905 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.905 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.905 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.905 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.905 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.906 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.906 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.906 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.906 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.906 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.906 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.906 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.906 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.906 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.906 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.906 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.906 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.906 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.906 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.906 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.907 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.907 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.907 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.907 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.907 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.907 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.907 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.907 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.907 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.907 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.907 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.907 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.907 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.907 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.907 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.907 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: "organization": { 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "organization", 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.908 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.909 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.909 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.909 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.909 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.909 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.909 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.909 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.909 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.909 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.909 INFO:teuthology.orchestra.run.smithi069.stdout: "proxy": { 2024-05-14T15:42:01.909 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "proxy", 2024-05-14T15:42:01.909 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.909 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.909 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.909 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.909 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.910 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.910 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.910 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.910 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.910 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.910 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.910 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.910 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.910 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.910 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.910 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.910 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.910 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.910 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.910 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.910 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.911 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.911 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.911 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.911 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.911 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.911 INFO:teuthology.orchestra.run.smithi069.stdout: "url": { 2024-05-14T15:42:01.911 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "url", 2024-05-14T15:42:01.911 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.911 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.911 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.911 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-05-14T15:42:01.911 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.911 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.911 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.911 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.911 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "test_orchestrator", 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.912 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.913 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.913 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.913 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.913 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.913 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.913 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.913 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.913 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.913 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.913 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.913 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.913 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.913 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.913 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.913 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.913 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.914 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.914 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.914 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.914 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.914 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.914 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.914 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.914 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.914 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.914 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.914 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.914 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.914 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.914 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.914 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.914 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.915 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.915 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.915 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.915 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.915 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.915 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.915 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.915 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.915 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.915 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.915 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.915 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.915 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.915 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.915 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.915 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.916 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2024-05-14T15:42:01.917 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.918 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.918 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.918 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.918 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.918 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.918 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.918 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.918 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.918 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.918 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.918 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.918 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.918 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.918 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.918 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.918 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.919 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.919 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.919 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.919 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.919 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.919 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.919 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.919 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.919 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.919 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.919 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.919 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.919 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.919 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.919 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.919 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.920 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.921 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.921 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.921 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.921 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.921 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.921 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.921 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.921 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.921 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.921 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.921 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.921 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.921 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.921 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.921 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.921 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.922 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.922 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.922 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.922 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.922 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.922 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.922 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.922 INFO:teuthology.orchestra.run.smithi069.stdout: "max_concurrent_clones": { 2024-05-14T15:42:01.922 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "max_concurrent_clones", 2024-05-14T15:42:01.922 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.922 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.922 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.922 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "4", 2024-05-14T15:42:01.922 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.922 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.922 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Number of asynchronous cloner threads", 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: "periodic_async_work": { 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "periodic_async_work", 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Periodically check for async work", 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.923 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.924 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.924 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.924 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_delay": { 2024-05-14T15:42:01.924 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_delay", 2024-05-14T15:42:01.924 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.924 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.924 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.924 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.924 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.924 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.924 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.924 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-05-14T15:42:01.924 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.924 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.924 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.924 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: "snapshot_clone_no_wait": { 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snapshot_clone_no_wait", 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "True", 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.925 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.926 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.926 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.926 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.926 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.926 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.926 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.926 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.926 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.926 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.926 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.926 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.926 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.926 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.926 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.926 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix", 2024-05-14T15:42:01.927 INFO:teuthology.orchestra.run.smithi069.stdout: "can_run": true, 2024-05-14T15:42:01.927 INFO:teuthology.orchestra.run.smithi069.stdout: "error_string": "", 2024-05-14T15:42:01.927 INFO:teuthology.orchestra.run.smithi069.stdout: "module_options": { 2024-05-14T15:42:01.927 INFO:teuthology.orchestra.run.smithi069.stdout: "discovery_interval": { 2024-05-14T15:42:01.927 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "discovery_interval", 2024-05-14T15:42:01.927 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "uint", 2024-05-14T15:42:01.927 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.927 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.927 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "100", 2024-05-14T15:42:01.927 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.927 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.927 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.927 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.927 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.927 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.927 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: "identifier": { 2024-05-14T15:42:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "identifier", 2024-05-14T15:42:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.928 INFO:teuthology.orchestra.run.smithi069.stdout: "interval": { 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "interval", 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "secs", 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "60", 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: "log_level": { 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_level", 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.929 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.930 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster": { 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster", 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_cluster_level": { 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_cluster_level", 2024-05-14T15:42:01.931 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "info", 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [ 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: "", 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: "critical", 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: "debug", 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: "error", 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: "info", 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: "warning" 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.932 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.933 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.933 INFO:teuthology.orchestra.run.smithi069.stdout: "log_to_file": { 2024-05-14T15:42:01.933 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "log_to_file", 2024-05-14T15:42:01.933 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "bool", 2024-05-14T15:42:01.933 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.933 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.933 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "False", 2024-05-14T15:42:01.933 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.933 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.933 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.933 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.933 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.933 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.933 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.933 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.933 INFO:teuthology.orchestra.run.smithi069.stdout: "sqlite3_killpoint": { 2024-05-14T15:42:01.934 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "sqlite3_killpoint", 2024-05-14T15:42:01.934 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.934 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "dev", 2024-05-14T15:42:01.934 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 1, 2024-05-14T15:42:01.934 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "0", 2024-05-14T15:42:01.934 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.934 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.934 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.934 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.934 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.934 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.934 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.934 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.934 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_host": { 2024-05-14T15:42:01.934 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_host", 2024-05-14T15:42:01.934 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "", 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_port": { 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_port", 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "int", 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.935 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "10051", 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: "zabbix_sender": { 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "zabbix_sender", 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "str", 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: "level": "advanced", 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: "flags": 0, 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: "min": "", 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: "max": "", 2024-05-14T15:42:01.936 INFO:teuthology.orchestra.run.smithi069.stdout: "enum_allowed": [], 2024-05-14T15:42:01.937 INFO:teuthology.orchestra.run.smithi069.stdout: "desc": "", 2024-05-14T15:42:01.937 INFO:teuthology.orchestra.run.smithi069.stdout: "long_desc": "", 2024-05-14T15:42:01.937 INFO:teuthology.orchestra.run.smithi069.stdout: "tags": [], 2024-05-14T15:42:01.937 INFO:teuthology.orchestra.run.smithi069.stdout: "see_also": [] 2024-05-14T15:42:01.937 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.937 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.937 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.937 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.937 INFO:teuthology.orchestra.run.smithi069.stdout: "services": { 2024-05-14T15:42:01.937 INFO:teuthology.orchestra.run.smithi069.stdout: "dashboard": "https://172.21.15.69:8443/" 2024-05-14T15:42:01.937 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.937 INFO:teuthology.orchestra.run.smithi069.stdout: "always_on_modules": { 2024-05-14T15:42:01.937 INFO:teuthology.orchestra.run.smithi069.stdout: "octopus": [ 2024-05-14T15:42:01.937 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2024-05-14T15:42:01.937 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2024-05-14T15:42:01.937 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: "pacific": [ 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2024-05-14T15:42:01.938 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: "quincy": [ 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: "reef": [ 2024-05-14T15:42:01.939 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: ], 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: "squid": [ 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: "balancer", 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: "crash", 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: "devicehealth", 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: "orchestrator", 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: "pg_autoscaler", 2024-05-14T15:42:01.940 INFO:teuthology.orchestra.run.smithi069.stdout: "progress", 2024-05-14T15:42:01.941 INFO:teuthology.orchestra.run.smithi069.stdout: "rbd_support", 2024-05-14T15:42:01.941 INFO:teuthology.orchestra.run.smithi069.stdout: "status", 2024-05-14T15:42:01.941 INFO:teuthology.orchestra.run.smithi069.stdout: "telemetry", 2024-05-14T15:42:01.941 INFO:teuthology.orchestra.run.smithi069.stdout: "volumes" 2024-05-14T15:42:01.941 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-05-14T15:42:01.941 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.941 INFO:teuthology.orchestra.run.smithi069.stdout: "last_failure_osd_epoch": 92, 2024-05-14T15:42:01.941 INFO:teuthology.orchestra.run.smithi069.stdout: "active_clients": [ 2024-05-14T15:42:01.941 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.941 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "devicehealth", 2024-05-14T15:42:01.941 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2024-05-14T15:42:01.941 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.941 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2024-05-14T15:42:01.941 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2024-05-14T15:42:01.941 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3396079634 2024-05-14T15:42:01.941 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "libcephsqlite", 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3725097221 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "rbd_support", 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.942 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 2586714065 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3750011422 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.943 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "snap_schedule", 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 3249781718 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: "name": "volumes", 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: "addrvec": [ 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: { 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: "type": "v2", 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: "addr": "172.21.15.69:0", 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: "nonce": 2603604864 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.944 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-05-14T15:42:01.945 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:01.945 INFO:teuthology.orchestra.run.smithi069.stdout: ] 2024-05-14T15:42:01.945 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:42:01.945 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:00 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3746370127' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-14T15:42:01.946 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:00 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/3715693081' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-14T15:42:01.946 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:00 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3746370127' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-14T15:42:01.946 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:00 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/3715693081' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-14T15:42:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.653+0000 7f6807e00640 1 -- 172.21.15.69:0/3715693081 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f67ec0b29d0 msgr2=0x7f67ec0b4ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:42:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.653+0000 7f6807e00640 1 --2- 172.21.15.69:0/3715693081 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f67ec0b29d0 0x7f67ec0b4ee0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f68081a1a90 tx=0x7f67f8005db0 comp rx=0 tx=0).stop 2024-05-14T15:42:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.653+0000 7f6807e00640 1 -- 172.21.15.69:0/3715693081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f680810e880 msgr2=0x7f68081a6c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:42:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.653+0000 7f6807e00640 1 --2- 172.21.15.69:0/3715693081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f680810e880 0x7f68081a6c80 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f67f400c970 tx=0x7f67f400ce30 comp rx=0 tx=0).stop 2024-05-14T15:42:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.654+0000 7f6807e00640 1 -- 172.21.15.69:0/3715693081 shutdown_connections 2024-05-14T15:42:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.654+0000 7f6807e00640 1 --2- 172.21.15.69:0/3715693081 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f67ec0b29d0 0x7f67ec0b4ee0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.654+0000 7f6807e00640 1 --2- 172.21.15.69:0/3715693081 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f680810f340 0x7f68081a0950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.654+0000 7f6807e00640 1 --2- 172.21.15.69:0/3715693081 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f680810e880 0x7f68081a6c80 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.654+0000 7f6807e00640 1 --2- 172.21.15.69:0/3715693081 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f680810a2f0 0x7f68081a6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.654+0000 7f6807e00640 1 -- 172.21.15.69:0/3715693081 >> 172.21.15.69:0/3715693081 conn(0x7f6808076c90 msgr2=0x7f6808107e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:42:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.654+0000 7f6807e00640 1 -- 172.21.15.69:0/3715693081 shutdown_connections 2024-05-14T15:42:01.947 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:00.654+0000 7f6807e00640 1 -- 172.21.15.69:0/3715693081 wait complete. 2024-05-14T15:42:01.987 DEBUG:tasks.check_counter:Getting stats from a 2024-05-14T15:42:01.987 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph daemon mds.a perf dump 2024-05-14T15:42:01.988 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:00 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3746370127' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-05-14T15:42:01.988 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:00 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/3715693081' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-05-14T15:42:02.071 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:01 smithi069 ceph-mon[31270]: pgmap v644: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 71 KiB/s wr, 32 op/s 2024-05-14T15:42:02.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:01 smithi203 ceph-mon[34567]: pgmap v644: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 71 KiB/s wr, 32 op/s 2024-05-14T15:42:02.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:01 smithi092 ceph-mon[34729]: pgmap v644: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 78 KiB/s rd, 71 KiB/s wr, 32 op/s 2024-05-14T15:42:02.449 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:42:03.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:03 smithi069 ceph-mon[31270]: pgmap v645: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 35 op/s 2024-05-14T15:42:03.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:03 smithi069 ceph-mon[31270]: osdmap e123: 12 total, 12 up, 12 in 2024-05-14T15:42:04.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:03 smithi203 ceph-mon[34567]: pgmap v645: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 35 op/s 2024-05-14T15:42:04.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:03 smithi203 ceph-mon[34567]: osdmap e123: 12 total, 12 up, 12 in 2024-05-14T15:42:04.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:03 smithi092 ceph-mon[34729]: pgmap v645: 129 pgs: 129 active+clean; 3.2 GiB data, 20 GiB used, 1.0 TiB / 1.0 TiB avail; 51 KiB/s rd, 52 KiB/s wr, 35 op/s 2024-05-14T15:42:04.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:03 smithi092 ceph-mon[34729]: osdmap e123: 12 total, 12 up, 12 in 2024-05-14T15:42:05.889 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:42:05.889 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T15:42:05.889 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 3039, 2024-05-14T15:42:05.889 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 3023, 2024-05-14T15:42:05.889 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 5368737, 2024-05-14T15:42:05.889 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 981037, 2024-05-14T15:42:05.889 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 7, 2024-05-14T15:42:05.890 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 2, 2024-05-14T15:42:05.890 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.623443777, 2024-05-14T15:42:05.890 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.192568980, 2024-05-14T15:42:05.890 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.168746319, 2024-05-14T15:42:05.890 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.200920856, 2024-05-14T15:42:05.890 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:05.890 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 3021, 2024-05-14T15:42:05.890 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.427390283, 2024-05-14T15:42:05.890 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000141473 2024-05-14T15:42:05.890 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.890 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:05.890 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.890 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.891 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.891 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.891 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 296352, 2024-05-14T15:42:05.891 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 46752 2024-05-14T15:42:05.891 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.891 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T15:42:05.891 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 647, 2024-05-14T15:42:05.891 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 596, 2024-05-14T15:42:05.891 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 1971052, 2024-05-14T15:42:05.891 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 288436, 2024-05-14T15:42:05.891 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 9, 2024-05-14T15:42:05.891 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 5, 2024-05-14T15:42:05.891 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.201971354, 2024-05-14T15:42:05.891 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.081954148, 2024-05-14T15:42:05.891 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.104144077, 2024-05-14T15:42:05.892 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.032272233, 2024-05-14T15:42:05.892 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:05.892 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 594, 2024-05-14T15:42:05.892 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.089313901, 2024-05-14T15:42:05.892 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000150360 2024-05-14T15:42:05.892 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.892 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:05.892 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.892 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.892 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.892 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.892 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 1917264, 2024-05-14T15:42:05.892 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 219680 2024-05-14T15:42:05.892 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.892 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T15:42:05.893 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 1430, 2024-05-14T15:42:05.893 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 1747, 2024-05-14T15:42:05.893 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 2473114, 2024-05-14T15:42:05.893 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 1158440, 2024-05-14T15:42:05.893 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 7, 2024-05-14T15:42:05.893 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 4, 2024-05-14T15:42:05.893 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.348062094, 2024-05-14T15:42:05.893 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.126584590, 2024-05-14T15:42:05.893 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.074528803, 2024-05-14T15:42:05.893 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.111166927, 2024-05-14T15:42:05.893 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:05.893 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 1744, 2024-05-14T15:42:05.893 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.296327419, 2024-05-14T15:42:05.893 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000169912 2024-05-14T15:42:05.893 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.894 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:05.894 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.894 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.894 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.894 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.894 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-14T15:42:05.894 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 704336 2024-05-14T15:42:05.894 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.894 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2024-05-14T15:42:05.894 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 1, 2024-05-14T15:42:05.894 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2024-05-14T15:42:05.894 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.894 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-MDSRank": { 2024-05-14T15:42:05.895 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2024-05-14T15:42:05.895 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2024-05-14T15:42:05.895 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 7488, 2024-05-14T15:42:05.895 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.424320073, 2024-05-14T15:42:05.895 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000056666 2024-05-14T15:42:05.895 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:05.895 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.895 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-PurgeQueue": { 2024-05-14T15:42:05.895 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2024-05-14T15:42:05.895 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2024-05-14T15:42:05.895 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.895 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.895 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.895 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:05.895 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.896 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": { 2024-05-14T15:42:05.896 INFO:teuthology.orchestra.run.smithi069.stdout: "request": 0, 2024-05-14T15:42:05.896 INFO:teuthology.orchestra.run.smithi069.stdout: "reply": 0, 2024-05-14T15:42:05.896 INFO:teuthology.orchestra.run.smithi069.stdout: "reply_latency": { 2024-05-14T15:42:05.896 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.896 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.896 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.896 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.896 INFO:teuthology.orchestra.run.smithi069.stdout: "slow_reply": 0, 2024-05-14T15:42:05.896 INFO:teuthology.orchestra.run.smithi069.stdout: "forward": 0, 2024-05-14T15:42:05.896 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_fetch_complete": 0, 2024-05-14T15:42:05.896 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_fetch_keys": 0, 2024-05-14T15:42:05.896 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_commit": 0, 2024-05-14T15:42:05.896 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_split": 0, 2024-05-14T15:42:05.896 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_merge": 0, 2024-05-14T15:42:05.897 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes": 516, 2024-05-14T15:42:05.897 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_top": 13, 2024-05-14T15:42:05.897 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_bottom": 503, 2024-05-14T15:42:05.897 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_pin_tail": 0, 2024-05-14T15:42:05.897 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_pinned": 498, 2024-05-14T15:42:05.897 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_expired": 0, 2024-05-14T15:42:05.897 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_with_caps": 0, 2024-05-14T15:42:05.897 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": 0, 2024-05-14T15:42:05.897 INFO:teuthology.orchestra.run.smithi069.stdout: "subtrees": 11, 2024-05-14T15:42:05.897 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse": 0, 2024-05-14T15:42:05.897 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_hit": 0, 2024-05-14T15:42:05.897 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_forward": 0, 2024-05-14T15:42:05.897 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_discover": 0, 2024-05-14T15:42:05.897 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_dir_fetch": 0, 2024-05-14T15:42:05.897 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_remote_ino": 0, 2024-05-14T15:42:05.897 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_lock": 0, 2024-05-14T15:42:05.898 INFO:teuthology.orchestra.run.smithi069.stdout: "load_cent": 0, 2024-05-14T15:42:05.898 INFO:teuthology.orchestra.run.smithi069.stdout: "q": 0, 2024-05-14T15:42:05.898 INFO:teuthology.orchestra.run.smithi069.stdout: "exported": 0, 2024-05-14T15:42:05.898 INFO:teuthology.orchestra.run.smithi069.stdout: "exported_inodes": 0, 2024-05-14T15:42:05.898 INFO:teuthology.orchestra.run.smithi069.stdout: "imported": 0, 2024-05-14T15:42:05.898 INFO:teuthology.orchestra.run.smithi069.stdout: "imported_inodes": 0, 2024-05-14T15:42:05.898 INFO:teuthology.orchestra.run.smithi069.stdout: "openino_dir_fetch": 0, 2024-05-14T15:42:05.898 INFO:teuthology.orchestra.run.smithi069.stdout: "openino_backtrace_fetch": 0, 2024-05-14T15:42:05.898 INFO:teuthology.orchestra.run.smithi069.stdout: "openino_peer_discover": 0, 2024-05-14T15:42:05.898 INFO:teuthology.orchestra.run.smithi069.stdout: "root_rfiles": 0, 2024-05-14T15:42:05.898 INFO:teuthology.orchestra.run.smithi069.stdout: "root_rbytes": 0, 2024-05-14T15:42:05.898 INFO:teuthology.orchestra.run.smithi069.stdout: "root_rsnaps": 0, 2024-05-14T15:42:05.898 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T15:42:05.898 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_set_tag": 0, 2024-05-14T15:42:05.898 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T15:42:05.899 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_inotable_repaired": 0, 2024-05-14T15:42:05.899 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_dir_inodes": 0, 2024-05-14T15:42:05.899 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T15:42:05.899 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T15:42:05.899 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_file_inodes": 0, 2024-05-14T15:42:05.899 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_inode_file_caps": 0, 2024-05-14T15:42:05.899 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_revoke": 0, 2024-05-14T15:42:05.899 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_grant": 0, 2024-05-14T15:42:05.899 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T15:42:05.899 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T15:42:05.899 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T15:42:05.899 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_caps": 0, 2024-05-14T15:42:05.899 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_caps_dirty": 0, 2024-05-14T15:42:05.899 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_cap_release": 0, 2024-05-14T15:42:05.899 INFO:teuthology.orchestra.run.smithi069.stdout: "process_request_cap_release": 0 2024-05-14T15:42:05.900 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.900 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_cache": { 2024-05-14T15:42:05.900 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_update": 0, 2024-05-14T15:42:05.900 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_update_receipt": 0, 2024-05-14T15:42:05.900 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_try_discover": 0, 2024-05-14T15:42:05.900 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_send_discover": 0, 2024-05-14T15:42:05.900 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_handle_discover": 0, 2024-05-14T15:42:05.900 INFO:teuthology.orchestra.run.smithi069.stdout: "num_strays": 0, 2024-05-14T15:42:05.900 INFO:teuthology.orchestra.run.smithi069.stdout: "num_strays_delayed": 0, 2024-05-14T15:42:05.900 INFO:teuthology.orchestra.run.smithi069.stdout: "num_strays_enqueuing": 0, 2024-05-14T15:42:05.900 INFO:teuthology.orchestra.run.smithi069.stdout: "strays_created": 0, 2024-05-14T15:42:05.900 INFO:teuthology.orchestra.run.smithi069.stdout: "strays_enqueued": 0, 2024-05-14T15:42:05.900 INFO:teuthology.orchestra.run.smithi069.stdout: "strays_reintegrated": 0, 2024-05-14T15:42:05.901 INFO:teuthology.orchestra.run.smithi069.stdout: "strays_migrated": 0, 2024-05-14T15:42:05.901 INFO:teuthology.orchestra.run.smithi069.stdout: "num_recovering_processing": 0, 2024-05-14T15:42:05.901 INFO:teuthology.orchestra.run.smithi069.stdout: "num_recovering_enqueued": 0, 2024-05-14T15:42:05.901 INFO:teuthology.orchestra.run.smithi069.stdout: "num_recovering_prioritized": 0, 2024-05-14T15:42:05.901 INFO:teuthology.orchestra.run.smithi069.stdout: "recovery_started": 0, 2024-05-14T15:42:05.901 INFO:teuthology.orchestra.run.smithi069.stdout: "recovery_completed": 0, 2024-05-14T15:42:05.901 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_quiesce_path": 0, 2024-05-14T15:42:05.901 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_quiesce_inode": 0, 2024-05-14T15:42:05.901 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T15:42:05.901 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_exportdir": 0, 2024-05-14T15:42:05.901 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_flush": 0, 2024-05-14T15:42:05.901 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_fragmentdir": 0, 2024-05-14T15:42:05.901 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_fragstats": 0, 2024-05-14T15:42:05.901 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_inodestats": 0 2024-05-14T15:42:05.901 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.902 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_log": { 2024-05-14T15:42:05.902 INFO:teuthology.orchestra.run.smithi069.stdout: "evlrg": 0, 2024-05-14T15:42:05.902 INFO:teuthology.orchestra.run.smithi069.stdout: "evadd": 0, 2024-05-14T15:42:05.902 INFO:teuthology.orchestra.run.smithi069.stdout: "evex": 0, 2024-05-14T15:42:05.902 INFO:teuthology.orchestra.run.smithi069.stdout: "evtrm": 0, 2024-05-14T15:42:05.902 INFO:teuthology.orchestra.run.smithi069.stdout: "ev": 3554, 2024-05-14T15:42:05.902 INFO:teuthology.orchestra.run.smithi069.stdout: "evexg": 0, 2024-05-14T15:42:05.902 INFO:teuthology.orchestra.run.smithi069.stdout: "evexd": 0, 2024-05-14T15:42:05.902 INFO:teuthology.orchestra.run.smithi069.stdout: "segadd": 0, 2024-05-14T15:42:05.902 INFO:teuthology.orchestra.run.smithi069.stdout: "segex": 0, 2024-05-14T15:42:05.902 INFO:teuthology.orchestra.run.smithi069.stdout: "segtrm": 0, 2024-05-14T15:42:05.902 INFO:teuthology.orchestra.run.smithi069.stdout: "seg": 5, 2024-05-14T15:42:05.902 INFO:teuthology.orchestra.run.smithi069.stdout: "segmjr": 2, 2024-05-14T15:42:05.902 INFO:teuthology.orchestra.run.smithi069.stdout: "segexg": 0, 2024-05-14T15:42:05.902 INFO:teuthology.orchestra.run.smithi069.stdout: "segexd": 0, 2024-05-14T15:42:05.902 INFO:teuthology.orchestra.run.smithi069.stdout: "expos": 4194304, 2024-05-14T15:42:05.903 INFO:teuthology.orchestra.run.smithi069.stdout: "wrpos": 10506652, 2024-05-14T15:42:05.903 INFO:teuthology.orchestra.run.smithi069.stdout: "rdpos": 10506078, 2024-05-14T15:42:05.903 INFO:teuthology.orchestra.run.smithi069.stdout: "jlat": { 2024-05-14T15:42:05.903 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.903 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.903 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.903 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.903 INFO:teuthology.orchestra.run.smithi069.stdout: "replayed": 3554 2024-05-14T15:42:05.903 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.903 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_mem": { 2024-05-14T15:42:05.903 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 231, 2024-05-14T15:42:05.903 INFO:teuthology.orchestra.run.smithi069.stdout: "ino+": 664, 2024-05-14T15:42:05.903 INFO:teuthology.orchestra.run.smithi069.stdout: "ino-": 433, 2024-05-14T15:42:05.903 INFO:teuthology.orchestra.run.smithi069.stdout: "dir": 22, 2024-05-14T15:42:05.903 INFO:teuthology.orchestra.run.smithi069.stdout: "dir+": 33, 2024-05-14T15:42:05.903 INFO:teuthology.orchestra.run.smithi069.stdout: "dir-": 11, 2024-05-14T15:42:05.904 INFO:teuthology.orchestra.run.smithi069.stdout: "dn": 516, 2024-05-14T15:42:05.904 INFO:teuthology.orchestra.run.smithi069.stdout: "dn+": 731, 2024-05-14T15:42:05.904 INFO:teuthology.orchestra.run.smithi069.stdout: "dn-": 215, 2024-05-14T15:42:05.904 INFO:teuthology.orchestra.run.smithi069.stdout: "cap": 0, 2024-05-14T15:42:05.904 INFO:teuthology.orchestra.run.smithi069.stdout: "cap+": 0, 2024-05-14T15:42:05.904 INFO:teuthology.orchestra.run.smithi069.stdout: "cap-": 0, 2024-05-14T15:42:05.904 INFO:teuthology.orchestra.run.smithi069.stdout: "rss": 121860, 2024-05-14T15:42:05.904 INFO:teuthology.orchestra.run.smithi069.stdout: "heap": 215440 2024-05-14T15:42:05.904 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.904 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_server": { 2024-05-14T15:42:05.904 INFO:teuthology.orchestra.run.smithi069.stdout: "dispatch_client_request": 0, 2024-05-14T15:42:05.904 INFO:teuthology.orchestra.run.smithi069.stdout: "dispatch_server_request": 0, 2024-05-14T15:42:05.904 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_request": 0, 2024-05-14T15:42:05.904 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_session": 0, 2024-05-14T15:42:05.904 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_peer_request": 0, 2024-05-14T15:42:05.904 INFO:teuthology.orchestra.run.smithi069.stdout: "req_create_latency": { 2024-05-14T15:42:05.905 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.905 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.905 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.905 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.905 INFO:teuthology.orchestra.run.smithi069.stdout: "req_getattr_latency": { 2024-05-14T15:42:05.905 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.905 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.905 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.905 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.905 INFO:teuthology.orchestra.run.smithi069.stdout: "req_getfilelock_latency": { 2024-05-14T15:42:05.905 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.905 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.905 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.905 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.905 INFO:teuthology.orchestra.run.smithi069.stdout: "req_link_latency": { 2024-05-14T15:42:05.905 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.906 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.906 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.906 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.906 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookup_latency": { 2024-05-14T15:42:05.906 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.906 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.906 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.906 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.906 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookuphash_latency": { 2024-05-14T15:42:05.906 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.906 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.906 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.906 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.906 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookupino_latency": { 2024-05-14T15:42:05.906 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.906 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.907 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.907 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.907 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookupname_latency": { 2024-05-14T15:42:05.907 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.907 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.907 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.907 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.907 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookupparent_latency": { 2024-05-14T15:42:05.907 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.907 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.907 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.907 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.907 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookupsnap_latency": { 2024-05-14T15:42:05.907 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.907 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.908 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.908 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.908 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lssnap_latency": { 2024-05-14T15:42:05.908 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.908 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.908 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.908 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.908 INFO:teuthology.orchestra.run.smithi069.stdout: "req_mkdir_latency": { 2024-05-14T15:42:05.909 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.909 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.909 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.909 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.909 INFO:teuthology.orchestra.run.smithi069.stdout: "req_mknod_latency": { 2024-05-14T15:42:05.909 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.909 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.909 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.909 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.909 INFO:teuthology.orchestra.run.smithi069.stdout: "req_mksnap_latency": { 2024-05-14T15:42:05.909 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.909 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.909 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.909 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.909 INFO:teuthology.orchestra.run.smithi069.stdout: "req_open_latency": { 2024-05-14T15:42:05.909 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.910 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.910 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.910 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.910 INFO:teuthology.orchestra.run.smithi069.stdout: "req_readdir_latency": { 2024-05-14T15:42:05.910 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.910 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.910 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.910 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.910 INFO:teuthology.orchestra.run.smithi069.stdout: "req_rename_latency": { 2024-05-14T15:42:05.910 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.910 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.910 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.910 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.910 INFO:teuthology.orchestra.run.smithi069.stdout: "req_renamesnap_latency": { 2024-05-14T15:42:05.910 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.911 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.911 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.911 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.911 INFO:teuthology.orchestra.run.smithi069.stdout: "req_snapdiff_latency": { 2024-05-14T15:42:05.911 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.911 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.911 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.911 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.911 INFO:teuthology.orchestra.run.smithi069.stdout: "req_rmdir_latency": { 2024-05-14T15:42:05.911 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.911 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.911 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.911 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.911 INFO:teuthology.orchestra.run.smithi069.stdout: "req_rmsnap_latency": { 2024-05-14T15:42:05.912 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.912 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.912 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.912 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.912 INFO:teuthology.orchestra.run.smithi069.stdout: "req_rmxattr_latency": { 2024-05-14T15:42:05.912 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.912 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.912 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.912 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.912 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setattr_latency": { 2024-05-14T15:42:05.912 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.912 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.912 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.912 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.912 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setdirlayout_latency": { 2024-05-14T15:42:05.912 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.913 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.913 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.913 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.913 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setfilelock_latency": { 2024-05-14T15:42:05.913 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.913 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.913 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.913 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.913 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setlayout_latency": { 2024-05-14T15:42:05.913 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.913 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.913 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.913 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.913 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setxattr_latency": { 2024-05-14T15:42:05.913 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.913 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.914 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.914 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.914 INFO:teuthology.orchestra.run.smithi069.stdout: "req_symlink_latency": { 2024-05-14T15:42:05.914 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.914 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.914 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.914 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.914 INFO:teuthology.orchestra.run.smithi069.stdout: "req_unlink_latency": { 2024-05-14T15:42:05.914 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.914 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.914 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.914 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.914 INFO:teuthology.orchestra.run.smithi069.stdout: "cap_revoke_eviction": 0, 2024-05-14T15:42:05.914 INFO:teuthology.orchestra.run.smithi069.stdout: "cap_acquisition_throttle": 0, 2024-05-14T15:42:05.914 INFO:teuthology.orchestra.run.smithi069.stdout: "req_getvxattr_latency": { 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_sessions": { 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: "session_count": 2, 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: "session_add": 3, 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: "session_remove": 1, 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: "sessions_open": 2, 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: "sessions_stale": 0, 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: "total_load": 0, 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: "average_load": 0, 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: "avg_session_uptime": 2902, 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: "mdthresh_evicted": 0 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.915 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2024-05-14T15:42:05.916 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2024-05-14T15:42:05.916 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2024-05-14T15:42:05.916 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T15:42:05.916 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2024-05-14T15:42:05.916 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T15:42:05.916 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2024-05-14T15:42:05.916 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T15:42:05.916 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T15:42:05.916 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T15:42:05.916 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T15:42:05.916 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T15:42:05.916 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2024-05-14T15:42:05.916 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T15:42:05.916 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T15:42:05.916 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_bytes": 0, 2024-05-14T15:42:05.916 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_items": 0, 2024-05-14T15:42:05.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_bytes": 0, 2024-05-14T15:42:05.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_items": 0, 2024-05-14T15:42:05.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T15:42:05.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T15:42:05.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T15:42:05.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T15:42:05.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T15:42:05.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2024-05-14T15:42:05.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2024-05-14T15:42:05.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2024-05-14T15:42:05.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T15:42:05.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T15:42:05.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2024-05-14T15:42:05.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2024-05-14T15:42:05.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2024-05-14T15:42:05.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2024-05-14T15:42:05.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T15:42:05.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2024-05-14T15:42:05.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T15:42:05.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2024-05-14T15:42:05.918 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 207889, 2024-05-14T15:42:05.918 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 64, 2024-05-14T15:42:05.918 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 0, 2024-05-14T15:42:05.918 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 0, 2024-05-14T15:42:05.918 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2024-05-14T15:42:05.918 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2024-05-14T15:42:05.918 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2024-05-14T15:42:05.918 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2024-05-14T15:42:05.919 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2024-05-14T15:42:05.919 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2024-05-14T15:42:05.919 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 9944, 2024-05-14T15:42:05.919 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 192, 2024-05-14T15:42:05.919 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T15:42:05.919 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2024-05-14T15:42:05.919 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 0, 2024-05-14T15:42:05.919 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 0, 2024-05-14T15:42:05.919 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 947751, 2024-05-14T15:42:05.919 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 9177, 2024-05-14T15:42:05.919 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2024-05-14T15:42:05.919 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2024-05-14T15:42:05.919 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2024-05-14T15:42:05.920 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2024-05-14T15:42:05.920 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.920 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter": { 2024-05-14T15:42:05.920 INFO:teuthology.orchestra.run.smithi069.stdout: "op_active": 1, 2024-05-14T15:42:05.920 INFO:teuthology.orchestra.run.smithi069.stdout: "op_laggy": 0, 2024-05-14T15:42:05.920 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send": 4583, 2024-05-14T15:42:05.920 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send_bytes": 21, 2024-05-14T15:42:05.920 INFO:teuthology.orchestra.run.smithi069.stdout: "op_resend": 3, 2024-05-14T15:42:05.920 INFO:teuthology.orchestra.run.smithi069.stdout: "op_reply": 4582, 2024-05-14T15:42:05.920 INFO:teuthology.orchestra.run.smithi069.stdout: "op_latency": { 2024-05-14T15:42:05.920 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 4582, 2024-05-14T15:42:05.920 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 10.619767057, 2024-05-14T15:42:05.920 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.002317714 2024-05-14T15:42:05.920 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.921 INFO:teuthology.orchestra.run.smithi069.stdout: "op_inflight": 0, 2024-05-14T15:42:05.921 INFO:teuthology.orchestra.run.smithi069.stdout: "oplen_avg": { 2024-05-14T15:42:05.921 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 4583, 2024-05-14T15:42:05.921 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 4584 2024-05-14T15:42:05.921 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.921 INFO:teuthology.orchestra.run.smithi069.stdout: "op": 4583, 2024-05-14T15:42:05.921 INFO:teuthology.orchestra.run.smithi069.stdout: "op_r": 4583, 2024-05-14T15:42:05.921 INFO:teuthology.orchestra.run.smithi069.stdout: "op_w": 0, 2024-05-14T15:42:05.921 INFO:teuthology.orchestra.run.smithi069.stdout: "op_rmw": 0, 2024-05-14T15:42:05.921 INFO:teuthology.orchestra.run.smithi069.stdout: "op_pg": 0, 2024-05-14T15:42:05.921 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_stat": 2823, 2024-05-14T15:42:05.921 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_create": 0, 2024-05-14T15:42:05.921 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_read": 1758, 2024-05-14T15:42:05.921 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_write": 0, 2024-05-14T15:42:05.922 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writefull": 0, 2024-05-14T15:42:05.922 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writesame": 0, 2024-05-14T15:42:05.922 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_append": 0, 2024-05-14T15:42:05.922 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_zero": 0, 2024-05-14T15:42:05.922 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_truncate": 0, 2024-05-14T15:42:05.922 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_delete": 0, 2024-05-14T15:42:05.922 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_mapext": 0, 2024-05-14T15:42:05.922 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_sparse_read": 0, 2024-05-14T15:42:05.922 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_clonerange": 0, 2024-05-14T15:42:05.922 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_getxattr": 1, 2024-05-14T15:42:05.922 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_setxattr": 0, 2024-05-14T15:42:05.922 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_cmpxattr": 0, 2024-05-14T15:42:05.922 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_rmxattr": 0, 2024-05-14T15:42:05.922 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_resetxattrs": 0, 2024-05-14T15:42:05.923 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_call": 0, 2024-05-14T15:42:05.923 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_watch": 0, 2024-05-14T15:42:05.923 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_notify": 0, 2024-05-14T15:42:05.923 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T15:42:05.923 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls": 0, 2024-05-14T15:42:05.923 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls_filter": 0, 2024-05-14T15:42:05.923 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_other": 0, 2024-05-14T15:42:05.923 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_active": 0, 2024-05-14T15:42:05.923 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_send": 0, 2024-05-14T15:42:05.923 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_resend": 0, 2024-05-14T15:42:05.923 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_ping": 0, 2024-05-14T15:42:05.923 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_active": 0, 2024-05-14T15:42:05.923 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_send": 0, 2024-05-14T15:42:05.923 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_resend": 0, 2024-05-14T15:42:05.923 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_active": 0, 2024-05-14T15:42:05.923 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_send": 0, 2024-05-14T15:42:05.924 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_resend": 0, 2024-05-14T15:42:05.924 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_active": 0, 2024-05-14T15:42:05.924 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_send": 0, 2024-05-14T15:42:05.924 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_resend": 0, 2024-05-14T15:42:05.924 INFO:teuthology.orchestra.run.smithi069.stdout: "command_active": 0, 2024-05-14T15:42:05.924 INFO:teuthology.orchestra.run.smithi069.stdout: "command_send": 0, 2024-05-14T15:42:05.924 INFO:teuthology.orchestra.run.smithi069.stdout: "command_resend": 0, 2024-05-14T15:42:05.924 INFO:teuthology.orchestra.run.smithi069.stdout: "map_epoch": 123, 2024-05-14T15:42:05.924 INFO:teuthology.orchestra.run.smithi069.stdout: "map_full": 0, 2024-05-14T15:42:05.924 INFO:teuthology.orchestra.run.smithi069.stdout: "map_inc": 34, 2024-05-14T15:42:05.924 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_sessions": 7, 2024-05-14T15:42:05.924 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_open": 9, 2024-05-14T15:42:05.924 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_close": 2, 2024-05-14T15:42:05.924 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_laggy": 0, 2024-05-14T15:42:05.924 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_wr": 0, 2024-05-14T15:42:05.924 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_rd": 2, 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_del": 0 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: "oft": { 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_total_objs": 0, 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_total_kv_pairs": 0, 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_total_updates": 0, 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_total_removes": 0 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: "osd-slow-ops": { 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: "slow_ops_count": 0 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: "purge_queue": { 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executing_ops": 0, 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executing_ops_high_water": 0, 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executing": 0, 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executing_high_water": 0, 2024-05-14T15:42:05.925 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executed_ops": 0, 2024-05-14T15:42:05.926 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executed": 0, 2024-05-14T15:42:05.926 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_item_in_journal": 0 2024-05-14T15:42:05.926 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.926 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T15:42:05.926 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-05-14T15:42:05.926 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2024-05-14T15:42:05.926 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-05-14T15:42:05.926 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 5112, 2024-05-14T15:42:05.926 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 9323026, 2024-05-14T15:42:05.926 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:05.926 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 5112, 2024-05-14T15:42:05.926 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2024-05-14T15:42:05.926 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2024-05-14T15:42:05.926 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 5112, 2024-05-14T15:42:05.926 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 9323026, 2024-05-14T15:42:05.927 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-05-14T15:42:05.927 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.927 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.927 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.927 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:05.927 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.927 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_bytes": { 2024-05-14T15:42:05.927 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-05-14T15:42:05.927 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2024-05-14T15:42:05.927 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-05-14T15:42:05.927 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2024-05-14T15:42:05.927 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2024-05-14T15:42:05.927 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:05.927 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:05.927 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 4583, 2024-05-14T15:42:05.927 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 6316511, 2024-05-14T15:42:05.928 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 4582, 2024-05-14T15:42:05.928 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 6316511, 2024-05-14T15:42:05.928 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-05-14T15:42:05.928 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.928 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.928 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.928 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:05.928 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.928 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_ops": { 2024-05-14T15:42:05.928 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 1, 2024-05-14T15:42:05.928 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 1024, 2024-05-14T15:42:05.928 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-05-14T15:42:05.928 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2024-05-14T15:42:05.928 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2024-05-14T15:42:05.928 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:05.928 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:05.929 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 4583, 2024-05-14T15:42:05.929 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 4583, 2024-05-14T15:42:05.929 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 4582, 2024-05-14T15:42:05.929 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 4582, 2024-05-14T15:42:05.929 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-05-14T15:42:05.929 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.929 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.929 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.929 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:05.929 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.929 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-write_buf_throttle": { 2024-05-14T15:42:05.929 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-05-14T15:42:05.929 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 3758096384, 2024-05-14T15:42:05.929 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-05-14T15:42:05.929 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2024-05-14T15:42:05.930 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2024-05-14T15:42:05.930 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:05.930 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:05.930 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2024-05-14T15:42:05.930 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2024-05-14T15:42:05.930 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2024-05-14T15:42:05.930 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2024-05-14T15:42:05.930 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-05-14T15:42:05.930 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.930 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.930 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.930 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:05.930 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:05.931 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-write_buf_throttle-0x55e7a52968f0": { 2024-05-14T15:42:05.931 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-05-14T15:42:05.931 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 3758096384, 2024-05-14T15:42:05.931 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-05-14T15:42:05.931 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2024-05-14T15:42:05.931 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2024-05-14T15:42:05.931 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:05.931 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:05.931 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2024-05-14T15:42:05.931 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2024-05-14T15:42:05.931 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2024-05-14T15:42:05.931 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2024-05-14T15:42:05.931 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-05-14T15:42:05.931 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:05.931 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:05.932 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:05.932 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:05.932 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:05.932 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:42:06.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:05 smithi203 ceph-mon[34567]: pgmap v647: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 56 KiB/s wr, 37 op/s 2024-05-14T15:42:06.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:05 smithi092 ceph-mon[34729]: pgmap v647: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 56 KiB/s wr, 37 op/s 2024-05-14T15:42:06.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:05 smithi069 ceph-mon[31270]: pgmap v647: 129 pgs: 129 active+clean; 3.2 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 50 KiB/s rd, 56 KiB/s wr, 37 op/s 2024-05-14T15:42:07.938 INFO:tasks.check_counter:Daemon mds.a mds.exported=0 2024-05-14T15:42:07.939 INFO:tasks.check_counter:Daemon mds.a mds.imported=0 2024-05-14T15:42:07.939 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update=0 2024-05-14T15:42:07.939 INFO:tasks.check_counter:Daemon mds.a mds_cache.dir_update_receipt=0 2024-05-14T15:42:07.939 INFO:tasks.check_counter:Daemon mds.a mds.root_rsnaps=0 2024-05-14T15:42:07.939 INFO:tasks.check_counter:Daemon mds.a mds_server.req_mksnap_latency.avgcount=0 2024-05-14T15:42:07.939 INFO:tasks.check_counter:Daemon mds.a mds_server.req_rmsnap_latency.avgcount=0 2024-05-14T15:42:07.939 DEBUG:tasks.check_counter:Getting stats from d 2024-05-14T15:42:07.939 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph daemon mds.d perf dump 2024-05-14T15:42:08.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:07 smithi203 ceph-mon[34567]: pgmap v648: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-05-14T15:42:08.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:07 smithi092 ceph-mon[34729]: pgmap v648: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-05-14T15:42:08.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:07 smithi069 ceph-mon[31270]: pgmap v648: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 45 KiB/s rd, 77 KiB/s wr, 37 op/s 2024-05-14T15:42:08.379 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:42:09.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:08 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:09.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:08 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:09.344 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:08 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:10.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:09 smithi092 ceph-mon[34729]: pgmap v649: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 77 KiB/s wr, 34 op/s 2024-05-14T15:42:10.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:09 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:10.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:09 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:42:10.193 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:09 smithi069 ceph-mon[31270]: pgmap v649: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 77 KiB/s wr, 34 op/s 2024-05-14T15:42:10.194 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:09 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:10.194 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:09 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:42:10.352 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:09 smithi203 ceph-mon[34567]: pgmap v649: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 77 KiB/s wr, 34 op/s 2024-05-14T15:42:10.352 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:09 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:10.353 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:09 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-14T15:42:11.045 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:42:11.045 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T15:42:11.045 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 438, 2024-05-14T15:42:11.045 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 428, 2024-05-14T15:42:11.045 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 1622896, 2024-05-14T15:42:11.045 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 264896, 2024-05-14T15:42:11.045 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 4, 2024-05-14T15:42:11.045 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 0, 2024-05-14T15:42:11.045 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.174191368, 2024-05-14T15:42:11.045 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.070895912, 2024-05-14T15:42:11.045 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.100252283, 2024-05-14T15:42:11.046 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.020084616, 2024-05-14T15:42:11.046 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:11.046 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 427, 2024-05-14T15:42:11.046 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.069455144, 2024-05-14T15:42:11.046 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000162658 2024-05-14T15:42:11.046 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:11.046 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:11.046 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:11.046 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:11.046 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:11.046 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:11.046 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 1622896, 2024-05-14T15:42:11.046 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 264896 2024-05-14T15:42:11.047 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:11.047 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T15:42:11.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 7, 2024-05-14T15:42:11.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 330, 2024-05-14T15:42:11.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 3424, 2024-05-14T15:42:11.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 294336, 2024-05-14T15:42:11.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 6, 2024-05-14T15:42:11.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 3, 2024-05-14T15:42:11.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.063812403, 2024-05-14T15:42:11.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.051067647, 2024-05-14T15:42:11.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.004807054, 2024-05-14T15:42:11.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-14T15:42:11.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:11.047 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 328, 2024-05-14T15:42:11.048 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.076598237, 2024-05-14T15:42:11.048 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000233531 2024-05-14T15:42:11.048 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:11.048 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:11.048 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:11.048 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:11.048 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:11.048 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:11.048 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 3424, 2024-05-14T15:42:11.048 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 294336 2024-05-14T15:42:11.048 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:11.048 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T15:42:11.048 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 0, 2024-05-14T15:42:11.048 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 2, 2024-05-14T15:42:11.048 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 0, 2024-05-14T15:42:11.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 0, 2024-05-14T15:42:11.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 2, 2024-05-14T15:42:11.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 1, 2024-05-14T15:42:11.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.000779007, 2024-05-14T15:42:11.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.000000000, 2024-05-14T15:42:11.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.000622977, 2024-05-14T15:42:11.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-14T15:42:11.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:11.049 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:11.049 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:11.049 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:11.049 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:11.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:11.049 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:11.050 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:11.050 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:11.050 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:11.050 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-14T15:42:11.050 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 0 2024-05-14T15:42:11.050 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:11.050 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2024-05-14T15:42:11.050 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 0, 2024-05-14T15:42:11.050 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2024-05-14T15:42:11.050 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:11.050 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2024-05-14T15:42:11.050 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2024-05-14T15:42:11.050 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2024-05-14T15:42:11.051 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T15:42:11.051 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2024-05-14T15:42:11.051 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T15:42:11.051 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2024-05-14T15:42:11.051 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T15:42:11.051 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T15:42:11.051 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T15:42:11.051 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T15:42:11.051 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T15:42:11.051 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2024-05-14T15:42:11.051 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T15:42:11.051 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T15:42:11.051 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_bytes": 0, 2024-05-14T15:42:11.051 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_items": 0, 2024-05-14T15:42:11.052 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_bytes": 0, 2024-05-14T15:42:11.052 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_items": 0, 2024-05-14T15:42:11.052 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T15:42:11.052 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T15:42:11.052 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T15:42:11.052 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T15:42:11.052 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T15:42:11.052 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2024-05-14T15:42:11.052 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2024-05-14T15:42:11.052 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2024-05-14T15:42:11.052 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T15:42:11.052 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T15:42:11.052 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2024-05-14T15:42:11.052 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2024-05-14T15:42:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2024-05-14T15:42:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2024-05-14T15:42:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T15:42:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2024-05-14T15:42:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T15:42:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2024-05-14T15:42:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 148754, 2024-05-14T15:42:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 31, 2024-05-14T15:42:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 0, 2024-05-14T15:42:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 0, 2024-05-14T15:42:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2024-05-14T15:42:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2024-05-14T15:42:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2024-05-14T15:42:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2024-05-14T15:42:11.053 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2024-05-14T15:42:11.054 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2024-05-14T15:42:11.054 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 0, 2024-05-14T15:42:11.054 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 0, 2024-05-14T15:42:11.054 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T15:42:11.054 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2024-05-14T15:42:11.054 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 0, 2024-05-14T15:42:11.054 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 0, 2024-05-14T15:42:11.054 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 928, 2024-05-14T15:42:11.054 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 2, 2024-05-14T15:42:11.054 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2024-05-14T15:42:11.054 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2024-05-14T15:42:11.054 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2024-05-14T15:42:11.054 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2024-05-14T15:42:11.054 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:11.055 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T15:42:11.055 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-05-14T15:42:11.055 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2024-05-14T15:42:11.055 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-05-14T15:42:11.055 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 441, 2024-05-14T15:42:11.055 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 1561009, 2024-05-14T15:42:11.055 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:11.055 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 441, 2024-05-14T15:42:11.055 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2024-05-14T15:42:11.055 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2024-05-14T15:42:11.055 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 441, 2024-05-14T15:42:11.055 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 1561009, 2024-05-14T15:42:11.055 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-05-14T15:42:11.055 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:11.055 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:11.056 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:11.056 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:11.056 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:11.056 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:42:11.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:11 smithi203 ceph-mon[34567]: osdmap e124: 12 total, 12 up, 12 in 2024-05-14T15:42:11.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:11 smithi203 ceph-mon[34567]: pgmap v651: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 75 KiB/s wr, 19 op/s 2024-05-14T15:42:11.365 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:11 smithi069 ceph-mon[31270]: osdmap e124: 12 total, 12 up, 12 in 2024-05-14T15:42:11.365 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:11 smithi069 ceph-mon[31270]: pgmap v651: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 75 KiB/s wr, 19 op/s 2024-05-14T15:42:11.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:11 smithi092 ceph-mon[34729]: osdmap e124: 12 total, 12 up, 12 in 2024-05-14T15:42:11.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:11 smithi092 ceph-mon[34729]: pgmap v651: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 46 KiB/s rd, 75 KiB/s wr, 19 op/s 2024-05-14T15:42:12.019 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-05-14T15:42:12.019 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-05-14T15:42:12.019 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-05-14T15:42:12.019 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-05-14T15:42:12.020 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-05-14T15:42:12.020 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-05-14T15:42:12.020 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-05-14T15:42:12.020 DEBUG:tasks.check_counter:Getting stats from g 2024-05-14T15:42:12.020 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph daemon mds.g perf dump 2024-05-14T15:42:12.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:12 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:42:12.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:12 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:42:12.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:12 smithi069 ceph-mon[31270]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:42:12.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:12 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:42:12.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:12 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:42:12.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:12 smithi203 ceph-mon[34567]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:42:12.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:12 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-14T15:42:12.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:12 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-14T15:42:12.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:12 smithi092 ceph-mon[34729]: from='mgr.34991 172.21.15.69:0/734355447' entity='mgr.x' 2024-05-14T15:42:12.472 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:42:13.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:13 smithi069 ceph-mon[31270]: pgmap v652: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 62 KiB/s wr, 17 op/s 2024-05-14T15:42:13.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:13 smithi092 ceph-mon[34729]: pgmap v652: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 62 KiB/s wr, 17 op/s 2024-05-14T15:42:13.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:13 smithi203 ceph-mon[34567]: pgmap v652: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 39 KiB/s rd, 62 KiB/s wr, 17 op/s 2024-05-14T15:42:14.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:14 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:14.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:14 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:14.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:14 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:15.045 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:42:15.046 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T15:42:15.046 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 1465, 2024-05-14T15:42:15.046 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 1467, 2024-05-14T15:42:15.046 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 492185, 2024-05-14T15:42:15.046 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 465871, 2024-05-14T15:42:15.046 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 7, 2024-05-14T15:42:15.046 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 2, 2024-05-14T15:42:15.046 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.391164662, 2024-05-14T15:42:15.046 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.162099910, 2024-05-14T15:42:15.046 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.083763751, 2024-05-14T15:42:15.046 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.104878710, 2024-05-14T15:42:15.046 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:15.046 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 1465, 2024-05-14T15:42:15.046 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.257302066, 2024-05-14T15:42:15.047 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000175632 2024-05-14T15:42:15.047 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:15.047 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.047 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.047 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.047 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-14T15:42:15.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 0 2024-05-14T15:42:15.047 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.047 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T15:42:15.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 3172, 2024-05-14T15:42:15.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 3492, 2024-05-14T15:42:15.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 6076681, 2024-05-14T15:42:15.047 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 1715717, 2024-05-14T15:42:15.048 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 7, 2024-05-14T15:42:15.048 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 5, 2024-05-14T15:42:15.048 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.582464525, 2024-05-14T15:42:15.048 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.200099338, 2024-05-14T15:42:15.048 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.141674580, 2024-05-14T15:42:15.048 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.196397815, 2024-05-14T15:42:15.048 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:15.048 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 3489, 2024-05-14T15:42:15.048 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.458430335, 2024-05-14T15:42:15.048 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000131393 2024-05-14T15:42:15.048 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.048 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:15.048 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.048 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.048 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.049 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 320, 2024-05-14T15:42:15.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 707600 2024-05-14T15:42:15.049 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.049 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T15:42:15.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 541, 2024-05-14T15:42:15.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 467, 2024-05-14T15:42:15.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 2091860, 2024-05-14T15:42:15.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 269461, 2024-05-14T15:42:15.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 5, 2024-05-14T15:42:15.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 3, 2024-05-14T15:42:15.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.191211533, 2024-05-14T15:42:15.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.075029871, 2024-05-14T15:42:15.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.128493474, 2024-05-14T15:42:15.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.017660347, 2024-05-14T15:42:15.049 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:15.050 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 467, 2024-05-14T15:42:15.050 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.089799698, 2024-05-14T15:42:15.050 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000192290 2024-05-14T15:42:15.050 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.050 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:15.050 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.050 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.050 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.050 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.050 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 2090512, 2024-05-14T15:42:15.050 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 268496 2024-05-14T15:42:15.050 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.050 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2024-05-14T15:42:15.050 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 1, 2024-05-14T15:42:15.050 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2024-05-14T15:42:15.051 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.051 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-MDSRank": { 2024-05-14T15:42:15.051 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2024-05-14T15:42:15.051 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2024-05-14T15:42:15.051 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 7610, 2024-05-14T15:42:15.051 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.407270134, 2024-05-14T15:42:15.051 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000053517 2024-05-14T15:42:15.051 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:15.051 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.051 INFO:teuthology.orchestra.run.smithi069.stdout: "finisher-PurgeQueue": { 2024-05-14T15:42:15.051 INFO:teuthology.orchestra.run.smithi069.stdout: "queue_len": 0, 2024-05-14T15:42:15.051 INFO:teuthology.orchestra.run.smithi069.stdout: "complete_latency": { 2024-05-14T15:42:15.051 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.051 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.051 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.052 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:15.052 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.052 INFO:teuthology.orchestra.run.smithi069.stdout: "mds": { 2024-05-14T15:42:15.052 INFO:teuthology.orchestra.run.smithi069.stdout: "request": 0, 2024-05-14T15:42:15.052 INFO:teuthology.orchestra.run.smithi069.stdout: "reply": 0, 2024-05-14T15:42:15.052 INFO:teuthology.orchestra.run.smithi069.stdout: "reply_latency": { 2024-05-14T15:42:15.052 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.052 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.052 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.052 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.052 INFO:teuthology.orchestra.run.smithi069.stdout: "slow_reply": 0, 2024-05-14T15:42:15.052 INFO:teuthology.orchestra.run.smithi069.stdout: "forward": 0, 2024-05-14T15:42:15.052 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_fetch_complete": 0, 2024-05-14T15:42:15.052 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_fetch_keys": 0, 2024-05-14T15:42:15.052 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_commit": 0, 2024-05-14T15:42:15.053 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_split": 0, 2024-05-14T15:42:15.053 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_merge": 0, 2024-05-14T15:42:15.053 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes": 943, 2024-05-14T15:42:15.053 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_top": 315, 2024-05-14T15:42:15.053 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_bottom": 628, 2024-05-14T15:42:15.053 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_pin_tail": 0, 2024-05-14T15:42:15.053 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_pinned": 493, 2024-05-14T15:42:15.053 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_expired": 0, 2024-05-14T15:42:15.053 INFO:teuthology.orchestra.run.smithi069.stdout: "inodes_with_caps": 0, 2024-05-14T15:42:15.053 INFO:teuthology.orchestra.run.smithi069.stdout: "caps": 0, 2024-05-14T15:42:15.053 INFO:teuthology.orchestra.run.smithi069.stdout: "subtrees": 17, 2024-05-14T15:42:15.053 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse": 0, 2024-05-14T15:42:15.053 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_hit": 0, 2024-05-14T15:42:15.053 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_forward": 0, 2024-05-14T15:42:15.053 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_discover": 0, 2024-05-14T15:42:15.053 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_dir_fetch": 0, 2024-05-14T15:42:15.054 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_remote_ino": 0, 2024-05-14T15:42:15.054 INFO:teuthology.orchestra.run.smithi069.stdout: "traverse_lock": 0, 2024-05-14T15:42:15.054 INFO:teuthology.orchestra.run.smithi069.stdout: "load_cent": 0, 2024-05-14T15:42:15.054 INFO:teuthology.orchestra.run.smithi069.stdout: "q": 0, 2024-05-14T15:42:15.054 INFO:teuthology.orchestra.run.smithi069.stdout: "exported": 0, 2024-05-14T15:42:15.054 INFO:teuthology.orchestra.run.smithi069.stdout: "exported_inodes": 0, 2024-05-14T15:42:15.054 INFO:teuthology.orchestra.run.smithi069.stdout: "imported": 0, 2024-05-14T15:42:15.054 INFO:teuthology.orchestra.run.smithi069.stdout: "imported_inodes": 0, 2024-05-14T15:42:15.054 INFO:teuthology.orchestra.run.smithi069.stdout: "openino_dir_fetch": 0, 2024-05-14T15:42:15.054 INFO:teuthology.orchestra.run.smithi069.stdout: "openino_backtrace_fetch": 0, 2024-05-14T15:42:15.054 INFO:teuthology.orchestra.run.smithi069.stdout: "openino_peer_discover": 0, 2024-05-14T15:42:15.054 INFO:teuthology.orchestra.run.smithi069.stdout: "root_rfiles": 0, 2024-05-14T15:42:15.054 INFO:teuthology.orchestra.run.smithi069.stdout: "root_rbytes": 0, 2024-05-14T15:42:15.054 INFO:teuthology.orchestra.run.smithi069.stdout: "root_rsnaps": 0, 2024-05-14T15:42:15.055 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T15:42:15.055 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_set_tag": 0, 2024-05-14T15:42:15.055 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T15:42:15.055 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_inotable_repaired": 0, 2024-05-14T15:42:15.055 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_dir_inodes": 0, 2024-05-14T15:42:15.055 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T15:42:15.055 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T15:42:15.055 INFO:teuthology.orchestra.run.smithi069.stdout: "scrub_file_inodes": 0, 2024-05-14T15:42:15.055 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_inode_file_caps": 0, 2024-05-14T15:42:15.055 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_revoke": 0, 2024-05-14T15:42:15.055 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_grant": 0, 2024-05-14T15:42:15.055 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T15:42:15.055 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T15:42:15.055 INFO:teuthology.orchestra.run.smithi069.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T15:42:15.055 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_caps": 0, 2024-05-14T15:42:15.055 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_caps_dirty": 0, 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_cap_release": 0, 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "process_request_cap_release": 0 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_cache": { 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_update": 0, 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_update_receipt": 0, 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_try_discover": 0, 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_send_discover": 0, 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "dir_handle_discover": 0, 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "num_strays": 0, 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "num_strays_delayed": 0, 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "num_strays_enqueuing": 0, 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "strays_created": 0, 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "strays_enqueued": 0, 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "strays_reintegrated": 0, 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "strays_migrated": 0, 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "num_recovering_processing": 0, 2024-05-14T15:42:15.056 INFO:teuthology.orchestra.run.smithi069.stdout: "num_recovering_enqueued": 0, 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: "num_recovering_prioritized": 0, 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: "recovery_started": 0, 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: "recovery_completed": 0, 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_quiesce_path": 0, 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_quiesce_inode": 0, 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_exportdir": 0, 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_flush": 0, 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_fragmentdir": 0, 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_fragstats": 0, 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: "ireq_inodestats": 0 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_log": { 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: "evlrg": 0, 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: "evadd": 0, 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: "evex": 0, 2024-05-14T15:42:15.057 INFO:teuthology.orchestra.run.smithi069.stdout: "evtrm": 0, 2024-05-14T15:42:15.058 INFO:teuthology.orchestra.run.smithi069.stdout: "ev": 2697, 2024-05-14T15:42:15.058 INFO:teuthology.orchestra.run.smithi069.stdout: "evexg": 0, 2024-05-14T15:42:15.058 INFO:teuthology.orchestra.run.smithi069.stdout: "evexd": 0, 2024-05-14T15:42:15.058 INFO:teuthology.orchestra.run.smithi069.stdout: "segadd": 0, 2024-05-14T15:42:15.058 INFO:teuthology.orchestra.run.smithi069.stdout: "segex": 0, 2024-05-14T15:42:15.058 INFO:teuthology.orchestra.run.smithi069.stdout: "segtrm": 0, 2024-05-14T15:42:15.058 INFO:teuthology.orchestra.run.smithi069.stdout: "seg": 5, 2024-05-14T15:42:15.058 INFO:teuthology.orchestra.run.smithi069.stdout: "segmjr": 2, 2024-05-14T15:42:15.058 INFO:teuthology.orchestra.run.smithi069.stdout: "segexg": 0, 2024-05-14T15:42:15.058 INFO:teuthology.orchestra.run.smithi069.stdout: "segexd": 0, 2024-05-14T15:42:15.058 INFO:teuthology.orchestra.run.smithi069.stdout: "expos": 4194304, 2024-05-14T15:42:15.058 INFO:teuthology.orchestra.run.smithi069.stdout: "wrpos": 9466660, 2024-05-14T15:42:15.058 INFO:teuthology.orchestra.run.smithi069.stdout: "rdpos": 9458286, 2024-05-14T15:42:15.058 INFO:teuthology.orchestra.run.smithi069.stdout: "jlat": { 2024-05-14T15:42:15.058 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: "replayed": 2697 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_mem": { 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: "ino": 696, 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: "ino+": 1321, 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: "ino-": 625, 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: "dir": 62, 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: "dir+": 69, 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: "dir-": 7, 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: "dn": 757, 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: "dn+": 1376, 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: "dn-": 619, 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: "cap": 0, 2024-05-14T15:42:15.059 INFO:teuthology.orchestra.run.smithi069.stdout: "cap+": 0, 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: "cap-": 0, 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: "rss": 124612, 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: "heap": 215440 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_server": { 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: "dispatch_client_request": 0, 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: "dispatch_server_request": 0, 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_request": 0, 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_client_session": 0, 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: "handle_peer_request": 0, 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: "req_create_latency": { 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: "req_getattr_latency": { 2024-05-14T15:42:15.060 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: "req_getfilelock_latency": { 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: "req_link_latency": { 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookup_latency": { 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.061 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookuphash_latency": { 2024-05-14T15:42:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookupino_latency": { 2024-05-14T15:42:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookupname_latency": { 2024-05-14T15:42:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.062 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookupparent_latency": { 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lookupsnap_latency": { 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: "req_lssnap_latency": { 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.063 INFO:teuthology.orchestra.run.smithi069.stdout: "req_mkdir_latency": { 2024-05-14T15:42:15.064 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.064 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.064 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.064 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.064 INFO:teuthology.orchestra.run.smithi069.stdout: "req_mknod_latency": { 2024-05-14T15:42:15.064 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.064 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.064 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.065 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.065 INFO:teuthology.orchestra.run.smithi069.stdout: "req_mksnap_latency": { 2024-05-14T15:42:15.065 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.065 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.065 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.065 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.065 INFO:teuthology.orchestra.run.smithi069.stdout: "req_open_latency": { 2024-05-14T15:42:15.065 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.065 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.065 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.065 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.065 INFO:teuthology.orchestra.run.smithi069.stdout: "req_readdir_latency": { 2024-05-14T15:42:15.065 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.065 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.065 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.065 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.066 INFO:teuthology.orchestra.run.smithi069.stdout: "req_rename_latency": { 2024-05-14T15:42:15.066 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.066 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.066 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.066 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.066 INFO:teuthology.orchestra.run.smithi069.stdout: "req_renamesnap_latency": { 2024-05-14T15:42:15.066 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.066 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.066 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.066 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.066 INFO:teuthology.orchestra.run.smithi069.stdout: "req_snapdiff_latency": { 2024-05-14T15:42:15.066 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.066 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.066 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.066 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.067 INFO:teuthology.orchestra.run.smithi069.stdout: "req_rmdir_latency": { 2024-05-14T15:42:15.067 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.067 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.067 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.067 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.067 INFO:teuthology.orchestra.run.smithi069.stdout: "req_rmsnap_latency": { 2024-05-14T15:42:15.067 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.067 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.067 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.067 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.067 INFO:teuthology.orchestra.run.smithi069.stdout: "req_rmxattr_latency": { 2024-05-14T15:42:15.067 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.067 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.067 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.067 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.067 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setattr_latency": { 2024-05-14T15:42:15.068 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.068 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.068 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.068 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.068 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setdirlayout_latency": { 2024-05-14T15:42:15.068 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.068 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.068 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.068 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.068 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setfilelock_latency": { 2024-05-14T15:42:15.068 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.068 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.068 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.068 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.068 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setlayout_latency": { 2024-05-14T15:42:15.069 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.069 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.069 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.069 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.069 INFO:teuthology.orchestra.run.smithi069.stdout: "req_setxattr_latency": { 2024-05-14T15:42:15.069 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.069 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.069 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.069 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.069 INFO:teuthology.orchestra.run.smithi069.stdout: "req_symlink_latency": { 2024-05-14T15:42:15.069 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.069 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.069 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.069 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.069 INFO:teuthology.orchestra.run.smithi069.stdout: "req_unlink_latency": { 2024-05-14T15:42:15.069 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.070 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.070 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.070 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.070 INFO:teuthology.orchestra.run.smithi069.stdout: "cap_revoke_eviction": 0, 2024-05-14T15:42:15.070 INFO:teuthology.orchestra.run.smithi069.stdout: "cap_acquisition_throttle": 0, 2024-05-14T15:42:15.070 INFO:teuthology.orchestra.run.smithi069.stdout: "req_getvxattr_latency": { 2024-05-14T15:42:15.070 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.070 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.070 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.070 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:15.070 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.070 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_sessions": { 2024-05-14T15:42:15.070 INFO:teuthology.orchestra.run.smithi069.stdout: "session_count": 1, 2024-05-14T15:42:15.070 INFO:teuthology.orchestra.run.smithi069.stdout: "session_add": 3, 2024-05-14T15:42:15.071 INFO:teuthology.orchestra.run.smithi069.stdout: "session_remove": 2, 2024-05-14T15:42:15.071 INFO:teuthology.orchestra.run.smithi069.stdout: "sessions_open": 2, 2024-05-14T15:42:15.071 INFO:teuthology.orchestra.run.smithi069.stdout: "sessions_stale": 0, 2024-05-14T15:42:15.071 INFO:teuthology.orchestra.run.smithi069.stdout: "total_load": 0, 2024-05-14T15:42:15.071 INFO:teuthology.orchestra.run.smithi069.stdout: "average_load": 0, 2024-05-14T15:42:15.071 INFO:teuthology.orchestra.run.smithi069.stdout: "avg_session_uptime": 4592, 2024-05-14T15:42:15.071 INFO:teuthology.orchestra.run.smithi069.stdout: "mdthresh_evicted": 0 2024-05-14T15:42:15.071 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.071 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2024-05-14T15:42:15.071 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2024-05-14T15:42:15.071 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2024-05-14T15:42:15.071 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T15:42:15.071 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2024-05-14T15:42:15.071 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T15:42:15.071 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2024-05-14T15:42:15.071 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T15:42:15.072 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T15:42:15.072 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T15:42:15.072 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T15:42:15.072 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T15:42:15.072 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2024-05-14T15:42:15.072 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T15:42:15.072 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T15:42:15.072 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_bytes": 0, 2024-05-14T15:42:15.072 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_items": 0, 2024-05-14T15:42:15.072 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_bytes": 0, 2024-05-14T15:42:15.072 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_items": 0, 2024-05-14T15:42:15.072 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T15:42:15.072 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T15:42:15.072 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T15:42:15.072 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T15:42:15.073 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T15:42:15.073 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2024-05-14T15:42:15.073 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2024-05-14T15:42:15.073 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2024-05-14T15:42:15.073 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T15:42:15.073 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T15:42:15.073 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2024-05-14T15:42:15.073 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2024-05-14T15:42:15.073 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2024-05-14T15:42:15.073 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2024-05-14T15:42:15.073 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T15:42:15.073 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2024-05-14T15:42:15.073 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T15:42:15.073 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2024-05-14T15:42:15.073 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 199042, 2024-05-14T15:42:15.073 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 59, 2024-05-14T15:42:15.074 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 0, 2024-05-14T15:42:15.074 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 0, 2024-05-14T15:42:15.074 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2024-05-14T15:42:15.074 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2024-05-14T15:42:15.074 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2024-05-14T15:42:15.074 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2024-05-14T15:42:15.074 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2024-05-14T15:42:15.074 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2024-05-14T15:42:15.074 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 9704, 2024-05-14T15:42:15.074 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 186, 2024-05-14T15:42:15.074 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T15:42:15.074 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2024-05-14T15:42:15.074 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 0, 2024-05-14T15:42:15.074 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 0, 2024-05-14T15:42:15.074 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 2646871, 2024-05-14T15:42:15.074 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 13901, 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: "objecter": { 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: "op_active": 0, 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: "op_laggy": 0, 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send": 4638, 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: "op_send_bytes": 21, 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: "op_resend": 3, 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: "op_reply": 4638, 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: "op_latency": { 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 4638, 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 12.743721649, 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.002747676 2024-05-14T15:42:15.075 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.076 INFO:teuthology.orchestra.run.smithi069.stdout: "op_inflight": 0, 2024-05-14T15:42:15.076 INFO:teuthology.orchestra.run.smithi069.stdout: "oplen_avg": { 2024-05-14T15:42:15.076 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 4638, 2024-05-14T15:42:15.076 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 4639 2024-05-14T15:42:15.076 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.076 INFO:teuthology.orchestra.run.smithi069.stdout: "op": 4638, 2024-05-14T15:42:15.076 INFO:teuthology.orchestra.run.smithi069.stdout: "op_r": 4638, 2024-05-14T15:42:15.076 INFO:teuthology.orchestra.run.smithi069.stdout: "op_w": 0, 2024-05-14T15:42:15.076 INFO:teuthology.orchestra.run.smithi069.stdout: "op_rmw": 0, 2024-05-14T15:42:15.076 INFO:teuthology.orchestra.run.smithi069.stdout: "op_pg": 0, 2024-05-14T15:42:15.076 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_stat": 2835, 2024-05-14T15:42:15.076 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_create": 0, 2024-05-14T15:42:15.076 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_read": 1801, 2024-05-14T15:42:15.076 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_write": 0, 2024-05-14T15:42:15.076 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writefull": 0, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_writesame": 0, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_append": 0, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_zero": 0, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_truncate": 0, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_delete": 0, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_mapext": 0, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_sparse_read": 0, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_clonerange": 0, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_getxattr": 1, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_setxattr": 0, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_cmpxattr": 0, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_rmxattr": 0, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_resetxattrs": 0, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_call": 0, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_watch": 0, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_notify": 0, 2024-05-14T15:42:15.077 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T15:42:15.078 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls": 0, 2024-05-14T15:42:15.078 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_pgls_filter": 0, 2024-05-14T15:42:15.078 INFO:teuthology.orchestra.run.smithi069.stdout: "osdop_other": 0, 2024-05-14T15:42:15.078 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_active": 0, 2024-05-14T15:42:15.078 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_send": 0, 2024-05-14T15:42:15.078 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_resend": 0, 2024-05-14T15:42:15.078 INFO:teuthology.orchestra.run.smithi069.stdout: "linger_ping": 0, 2024-05-14T15:42:15.078 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_active": 0, 2024-05-14T15:42:15.078 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_send": 0, 2024-05-14T15:42:15.078 INFO:teuthology.orchestra.run.smithi069.stdout: "poolop_resend": 0, 2024-05-14T15:42:15.078 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_active": 0, 2024-05-14T15:42:15.078 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_send": 0, 2024-05-14T15:42:15.078 INFO:teuthology.orchestra.run.smithi069.stdout: "poolstat_resend": 0, 2024-05-14T15:42:15.078 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_active": 0, 2024-05-14T15:42:15.078 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_send": 0, 2024-05-14T15:42:15.078 INFO:teuthology.orchestra.run.smithi069.stdout: "statfs_resend": 0, 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "command_active": 0, 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "command_send": 0, 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "command_resend": 0, 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "map_epoch": 124, 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "map_full": 0, 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "map_inc": 35, 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_sessions": 6, 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_open": 8, 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_session_close": 2, 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_laggy": 0, 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_wr": 0, 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_rd": 2, 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_del": 0 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "oft": { 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_total_objs": 0, 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_total_kv_pairs": 0, 2024-05-14T15:42:15.079 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_total_updates": 0, 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: "omap_total_removes": 0 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: "osd-slow-ops": { 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: "slow_ops_count": 0 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: "purge_queue": { 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executing_ops": 0, 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executing_ops_high_water": 0, 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executing": 0, 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executing_high_water": 0, 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executed_ops": 0, 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_executed": 0, 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: "pq_item_in_journal": 0 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-05-14T15:42:15.080 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 5174, 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 8164961, 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 5174, 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 5174, 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 8164961, 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_bytes": { 2024-05-14T15:42:15.081 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-05-14T15:42:15.082 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2024-05-14T15:42:15.082 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-05-14T15:42:15.082 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2024-05-14T15:42:15.082 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2024-05-14T15:42:15.082 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:15.082 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:15.082 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 4638, 2024-05-14T15:42:15.082 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 5272882, 2024-05-14T15:42:15.082 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 4638, 2024-05-14T15:42:15.082 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 5272882, 2024-05-14T15:42:15.082 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-05-14T15:42:15.082 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.082 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.082 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.082 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-objecter_ops": { 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 1024, 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 4638, 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 4638, 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 4638, 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 4638, 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.083 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-write_buf_throttle": { 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 3758096384, 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.084 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-write_buf_throttle-0x5567e89be8f0": { 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 3758096384, 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 0, 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 0, 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 0, 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 0, 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-05-14T15:42:15.085 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:15.086 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:15.086 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:15.086 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:15.086 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:15.086 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:42:15.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:15 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:15.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:15 smithi092 ceph-mon[34729]: pgmap v653: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 53 KiB/s wr, 15 op/s 2024-05-14T15:42:15.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:15 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:15.473 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:15 smithi069 ceph-mon[31270]: pgmap v653: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 53 KiB/s wr, 15 op/s 2024-05-14T15:42:15.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:15 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:15.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:15 smithi203 ceph-mon[34567]: pgmap v653: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 53 KiB/s wr, 15 op/s 2024-05-14T15:42:16.024 INFO:tasks.check_counter:Daemon mds.g mds.exported=0 2024-05-14T15:42:16.024 INFO:tasks.check_counter:Daemon mds.g mds.imported=0 2024-05-14T15:42:16.024 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update=0 2024-05-14T15:42:16.024 INFO:tasks.check_counter:Daemon mds.g mds_cache.dir_update_receipt=0 2024-05-14T15:42:16.024 INFO:tasks.check_counter:Daemon mds.g mds.root_rsnaps=0 2024-05-14T15:42:16.024 INFO:tasks.check_counter:Daemon mds.g mds_server.req_mksnap_latency.avgcount=0 2024-05-14T15:42:16.024 INFO:tasks.check_counter:Daemon mds.g mds_server.req_rmsnap_latency.avgcount=0 2024-05-14T15:42:16.024 DEBUG:tasks.check_counter:Getting stats from j 2024-05-14T15:42:16.025 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph daemon mds.j perf dump 2024-05-14T15:42:16.469 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:42:17.910 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:17 smithi069 ceph-mon[31270]: pgmap v654: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 15 op/s 2024-05-14T15:42:17.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:17 smithi092 ceph-mon[34729]: pgmap v654: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 15 op/s 2024-05-14T15:42:18.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:17 smithi203 ceph-mon[34567]: pgmap v654: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 15 op/s 2024-05-14T15:42:18.912 INFO:teuthology.orchestra.run.smithi069.stdout:{ 2024-05-14T15:42:18.912 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T15:42:18.912 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 4, 2024-05-14T15:42:18.912 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 4, 2024-05-14T15:42:18.912 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 2944, 2024-05-14T15:42:18.912 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 448, 2024-05-14T15:42:18.912 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 4, 2024-05-14T15:42:18.912 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 0, 2024-05-14T15:42:18.912 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.004061911, 2024-05-14T15:42:18.912 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.000058728, 2024-05-14T15:42:18.912 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.001143683, 2024-05-14T15:42:18.913 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-14T15:42:18.913 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:18.913 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 3, 2024-05-14T15:42:18.913 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.001505149, 2024-05-14T15:42:18.913 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000501716 2024-05-14T15:42:18.913 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:18.913 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:18.913 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:18.913 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:18.913 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:18.913 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:18.913 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-05-14T15:42:18.913 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 448 2024-05-14T15:42:18.913 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:18.914 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T15:42:18.914 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 3, 2024-05-14T15:42:18.914 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 331, 2024-05-14T15:42:18.914 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 480, 2024-05-14T15:42:18.914 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 294416, 2024-05-14T15:42:18.914 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 6, 2024-05-14T15:42:18.914 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 3, 2024-05-14T15:42:18.914 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.066911432, 2024-05-14T15:42:18.914 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.052277755, 2024-05-14T15:42:18.914 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.006844387, 2024-05-14T15:42:18.914 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-05-14T15:42:18.914 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:18.914 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 328, 2024-05-14T15:42:18.915 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.076027494, 2024-05-14T15:42:18.915 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000231791 2024-05-14T15:42:18.915 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:18.915 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:18.915 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:18.915 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:18.915 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:18.915 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:18.915 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 480, 2024-05-14T15:42:18.915 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 294416 2024-05-14T15:42:18.915 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:18.915 INFO:teuthology.orchestra.run.smithi069.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T15:42:18.915 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_messages": 442, 2024-05-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages": 432, 2024-05-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_bytes": 1624608, 2024-05-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_bytes": 267152, 2024-05-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_created_connections": 2, 2024-05-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_active_connections": 1, 2024-05-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_total_time": 0.177387052, 2024-05-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_send_time": 0.074799179, 2024-05-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_recv_time": 0.105502662, 2024-05-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_running_fast_dispatch_time": 0.018804121, 2024-05-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 431, 2024-05-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.072329739, 2024-05-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000167818 2024-05-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:18.916 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:18.917 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:18.917 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:18.917 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:18.917 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:18.917 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_recv_encrypted_bytes": 1624608, 2024-05-14T15:42:18.917 INFO:teuthology.orchestra.run.smithi069.stdout: "msgr_send_encrypted_bytes": 267152 2024-05-14T15:42:18.917 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:18.917 INFO:teuthology.orchestra.run.smithi069.stdout: "cct": { 2024-05-14T15:42:18.917 INFO:teuthology.orchestra.run.smithi069.stdout: "total_workers": 0, 2024-05-14T15:42:18.917 INFO:teuthology.orchestra.run.smithi069.stdout: "unhealthy_workers": 0 2024-05-14T15:42:18.917 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:18.917 INFO:teuthology.orchestra.run.smithi069.stdout: "mempool": { 2024-05-14T15:42:18.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_bytes": 0, 2024-05-14T15:42:18.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bloom_filter_items": 0, 2024-05-14T15:42:18.917 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T15:42:18.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_alloc_items": 0, 2024-05-14T15:42:18.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T15:42:18.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_data_items": 0, 2024-05-14T15:42:18.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T15:42:18.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T15:42:18.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T15:42:18.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T15:42:18.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T15:42:18.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_other_items": 0, 2024-05-14T15:42:18.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T15:42:18.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T15:42:18.918 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_bytes": 0, 2024-05-14T15:42:18.919 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_extent_items": 0, 2024-05-14T15:42:18.919 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_bytes": 0, 2024-05-14T15:42:18.919 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_blob_items": 0, 2024-05-14T15:42:18.919 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T15:42:18.919 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T15:42:18.919 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T15:42:18.919 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T15:42:18.919 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T15:42:18.919 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_fsck_items": 0, 2024-05-14T15:42:18.919 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_bytes": 0, 2024-05-14T15:42:18.919 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_txc_items": 0, 2024-05-14T15:42:18.919 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T15:42:18.919 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T15:42:18.919 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_bytes": 0, 2024-05-14T15:42:18.920 INFO:teuthology.orchestra.run.smithi069.stdout: "bluestore_writing_items": 0, 2024-05-14T15:42:18.920 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_bytes": 0, 2024-05-14T15:42:18.920 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_items": 0, 2024-05-14T15:42:18.920 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T15:42:18.920 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_reader_items": 0, 2024-05-14T15:42:18.920 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T15:42:18.920 INFO:teuthology.orchestra.run.smithi069.stdout: "bluefs_file_writer_items": 0, 2024-05-14T15:42:18.920 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_bytes": 148714, 2024-05-14T15:42:18.920 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_anon_items": 30, 2024-05-14T15:42:18.920 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_bytes": 0, 2024-05-14T15:42:18.920 INFO:teuthology.orchestra.run.smithi069.stdout: "buffer_meta_items": 0, 2024-05-14T15:42:18.920 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_bytes": 0, 2024-05-14T15:42:18.920 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_items": 0, 2024-05-14T15:42:18.920 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_bytes": 0, 2024-05-14T15:42:18.920 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_mapbl_items": 0, 2024-05-14T15:42:18.921 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_bytes": 0, 2024-05-14T15:42:18.921 INFO:teuthology.orchestra.run.smithi069.stdout: "osd_pglog_items": 0, 2024-05-14T15:42:18.921 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_bytes": 0, 2024-05-14T15:42:18.921 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_items": 0, 2024-05-14T15:42:18.921 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T15:42:18.921 INFO:teuthology.orchestra.run.smithi069.stdout: "osdmap_mapping_items": 0, 2024-05-14T15:42:18.921 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_bytes": 0, 2024-05-14T15:42:18.921 INFO:teuthology.orchestra.run.smithi069.stdout: "pgmap_items": 0, 2024-05-14T15:42:18.921 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_bytes": 928, 2024-05-14T15:42:18.921 INFO:teuthology.orchestra.run.smithi069.stdout: "mds_co_items": 2, 2024-05-14T15:42:18.921 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_bytes": 0, 2024-05-14T15:42:18.921 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_1_items": 0, 2024-05-14T15:42:18.921 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_bytes": 0, 2024-05-14T15:42:18.921 INFO:teuthology.orchestra.run.smithi069.stdout: "unittest_2_items": 0 2024-05-14T15:42:18.921 INFO:teuthology.orchestra.run.smithi069.stdout: }, 2024-05-14T15:42:18.922 INFO:teuthology.orchestra.run.smithi069.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T15:42:18.922 INFO:teuthology.orchestra.run.smithi069.stdout: "val": 0, 2024-05-14T15:42:18.922 INFO:teuthology.orchestra.run.smithi069.stdout: "max": 104857600, 2024-05-14T15:42:18.922 INFO:teuthology.orchestra.run.smithi069.stdout: "get_started": 0, 2024-05-14T15:42:18.922 INFO:teuthology.orchestra.run.smithi069.stdout: "get": 445, 2024-05-14T15:42:18.922 INFO:teuthology.orchestra.run.smithi069.stdout: "get_sum": 1562166, 2024-05-14T15:42:18.922 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:18.922 INFO:teuthology.orchestra.run.smithi069.stdout: "get_or_fail_success": 445, 2024-05-14T15:42:18.922 INFO:teuthology.orchestra.run.smithi069.stdout: "take": 0, 2024-05-14T15:42:18.922 INFO:teuthology.orchestra.run.smithi069.stdout: "take_sum": 0, 2024-05-14T15:42:18.922 INFO:teuthology.orchestra.run.smithi069.stdout: "put": 445, 2024-05-14T15:42:18.922 INFO:teuthology.orchestra.run.smithi069.stdout: "put_sum": 1562166, 2024-05-14T15:42:18.922 INFO:teuthology.orchestra.run.smithi069.stdout: "wait": { 2024-05-14T15:42:18.922 INFO:teuthology.orchestra.run.smithi069.stdout: "avgcount": 0, 2024-05-14T15:42:18.923 INFO:teuthology.orchestra.run.smithi069.stdout: "sum": 0.000000000, 2024-05-14T15:42:18.923 INFO:teuthology.orchestra.run.smithi069.stdout: "avgtime": 0.000000000 2024-05-14T15:42:18.923 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:18.923 INFO:teuthology.orchestra.run.smithi069.stdout: } 2024-05-14T15:42:18.923 INFO:teuthology.orchestra.run.smithi069.stdout:} 2024-05-14T15:42:19.607 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:19 smithi069 ceph-mon[31270]: pgmap v655: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 15 op/s 2024-05-14T15:42:19.607 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:19 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:19.822 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-05-14T15:42:19.822 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-05-14T15:42:19.822 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-05-14T15:42:19.822 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-05-14T15:42:19.822 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-05-14T15:42:19.822 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-05-14T15:42:19.822 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-05-14T15:42:19.823 DEBUG:tasks.check_counter:Getting stats from b 2024-05-14T15:42:19.823 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph daemon mds.b perf dump 2024-05-14T15:42:19.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:19 smithi092 ceph-mon[34729]: pgmap v655: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 15 op/s 2024-05-14T15:42:19.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:19 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:20.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:19 smithi203 ceph-mon[34567]: pgmap v655: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 56 KiB/s rd, 52 KiB/s wr, 15 op/s 2024-05-14T15:42:20.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:19 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:20.433 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T15:42:21.898 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:21 smithi203 ceph-mon[34567]: pgmap v656: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-05-14T15:42:21.900 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:21 smithi092 ceph-mon[34729]: pgmap v656: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-05-14T15:42:21.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:21 smithi069 ceph-mon[31270]: pgmap v656: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 53 KiB/s rd, 49 KiB/s wr, 15 op/s 2024-05-14T15:42:23.273 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-05-14T15:42:23.273 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T15:42:23.273 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 16520, 2024-05-14T15:42:23.273 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 23197, 2024-05-14T15:42:23.273 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 6102585, 2024-05-14T15:42:23.274 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 27908456, 2024-05-14T15:42:23.274 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 11, 2024-05-14T15:42:23.274 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 4, 2024-05-14T15:42:23.274 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 4.436795363, 2024-05-14T15:42:23.274 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 2.212096615, 2024-05-14T15:42:23.274 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 2.140405111, 2024-05-14T15:42:23.274 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.278695070, 2024-05-14T15:42:23.274 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:23.274 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 23202, 2024-05-14T15:42:23.274 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 3.996587555, 2024-05-14T15:42:23.274 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000172251 2024-05-14T15:42:23.274 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.274 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:23.275 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 31398, 2024-05-14T15:42:23.275 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.020796804, 2024-05-14T15:42:23.275 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000662 2024-05-14T15:42:23.275 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.275 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 3104, 2024-05-14T15:42:23.275 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 506848 2024-05-14T15:42:23.275 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.275 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T15:42:23.275 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 24301, 2024-05-14T15:42:23.275 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 27311, 2024-05-14T15:42:23.275 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 8223048, 2024-05-14T15:42:23.275 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 31350033, 2024-05-14T15:42:23.275 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 14, 2024-05-14T15:42:23.275 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 6, 2024-05-14T15:42:23.276 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 5.966768209, 2024-05-14T15:42:23.276 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 2.795025726, 2024-05-14T15:42:23.276 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 3.167033741, 2024-05-14T15:42:23.276 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.429471427, 2024-05-14T15:42:23.276 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:23.276 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 27312, 2024-05-14T15:42:23.276 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 4.506383886, 2024-05-14T15:42:23.276 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000164996 2024-05-14T15:42:23.276 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.276 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:23.276 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 42514, 2024-05-14T15:42:23.276 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.026495618, 2024-05-14T15:42:23.276 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000623 2024-05-14T15:42:23.276 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 653440, 2024-05-14T15:42:23.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 385632 2024-05-14T15:42:23.277 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.277 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T15:42:23.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 9964, 2024-05-14T15:42:23.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 13138, 2024-05-14T15:42:23.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 5583083, 2024-05-14T15:42:23.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 18328682, 2024-05-14T15:42:23.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 240, 2024-05-14T15:42:23.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 8, 2024-05-14T15:42:23.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 3.336517352, 2024-05-14T15:42:23.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 1.673958831, 2024-05-14T15:42:23.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 1.603631506, 2024-05-14T15:42:23.277 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.203956210, 2024-05-14T15:42:23.278 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:23.278 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 13127, 2024-05-14T15:42:23.278 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2.321660287, 2024-05-14T15:42:23.278 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000176861 2024-05-14T15:42:23.278 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.278 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:23.278 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 16619, 2024-05-14T15:42:23.278 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.015110233, 2024-05-14T15:42:23.278 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000909 2024-05-14T15:42:23.278 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.278 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 2281424, 2024-05-14T15:42:23.278 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 324656 2024-05-14T15:42:23.278 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.278 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2024-05-14T15:42:23.279 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2024-05-14T15:42:23.279 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2024-05-14T15:42:23.279 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.279 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2024-05-14T15:42:23.279 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-05-14T15:42:23.279 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-05-14T15:42:23.279 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 8962, 2024-05-14T15:42:23.279 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 10.456960410, 2024-05-14T15:42:23.279 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001166811 2024-05-14T15:42:23.279 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:23.279 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.279 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2024-05-14T15:42:23.279 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-05-14T15:42:23.280 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-05-14T15:42:23.280 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 117, 2024-05-14T15:42:23.280 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.013403495, 2024-05-14T15:42:23.280 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000114559 2024-05-14T15:42:23.280 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:23.280 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.280 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2024-05-14T15:42:23.280 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 6497, 2024-05-14T15:42:23.280 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 4877, 2024-05-14T15:42:23.280 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2024-05-14T15:42:23.280 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 4877, 2024-05-14T15:42:23.280 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 129.150326624, 2024-05-14T15:42:23.280 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.026481510 2024-05-14T15:42:23.280 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.280 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2024-05-14T15:42:23.281 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 1620, 2024-05-14T15:42:23.281 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 8, 2024-05-14T15:42:23.281 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 1, 2024-05-14T15:42:23.281 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 922, 2024-05-14T15:42:23.281 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 4, 2024-05-14T15:42:23.281 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 0, 2024-05-14T15:42:23.281 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 151, 2024-05-14T15:42:23.281 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 58, 2024-05-14T15:42:23.281 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 82, 2024-05-14T15:42:23.281 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 11, 2024-05-14T15:42:23.281 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 67, 2024-05-14T15:42:23.281 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 1742, 2024-05-14T15:42:23.281 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 44, 2024-05-14T15:42:23.281 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 44, 2024-05-14T15:42:23.281 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 32, 2024-05-14T15:42:23.282 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 9205, 2024-05-14T15:42:23.282 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 7382, 2024-05-14T15:42:23.282 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 1531, 2024-05-14T15:42:23.282 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 20, 2024-05-14T15:42:23.282 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 1, 2024-05-14T15:42:23.282 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2024-05-14T15:42:23.282 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 12, 2024-05-14T15:42:23.282 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 3244, 2024-05-14T15:42:23.282 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 3, 2024-05-14T15:42:23.282 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 66, 2024-05-14T15:42:23.282 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 1678, 2024-05-14T15:42:23.282 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 34, 2024-05-14T15:42:23.282 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 746, 2024-05-14T15:42:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2024-05-14T15:42:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 1083, 2024-05-14T15:42:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2024-05-14T15:42:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 1015, 2024-05-14T15:42:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 1478530389, 2024-05-14T15:42:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 6, 2024-05-14T15:42:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 1083, 2024-05-14T15:42:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2024-05-14T15:42:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T15:42:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2024-05-14T15:42:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 151, 2024-05-14T15:42:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 6, 2024-05-14T15:42:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 145, 2024-05-14T15:42:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 932, 2024-05-14T15:42:23.283 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 16, 2024-05-14T15:42:23.284 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 1628, 2024-05-14T15:42:23.284 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 1619, 2024-05-14T15:42:23.284 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T15:42:23.284 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T15:42:23.284 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T15:42:23.284 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 4903, 2024-05-14T15:42:23.284 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 1263, 2024-05-14T15:42:23.284 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 25, 2024-05-14T15:42:23.284 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 1135 2024-05-14T15:42:23.284 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.284 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2024-05-14T15:42:23.284 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 153, 2024-05-14T15:42:23.284 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 43, 2024-05-14T15:42:23.284 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 24, 2024-05-14T15:42:23.284 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 66, 2024-05-14T15:42:23.285 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 1196, 2024-05-14T15:42:23.285 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 0, 2024-05-14T15:42:23.285 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2024-05-14T15:42:23.285 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2024-05-14T15:42:23.285 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 29, 2024-05-14T15:42:23.285 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 21, 2024-05-14T15:42:23.285 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 15, 2024-05-14T15:42:23.285 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 4, 2024-05-14T15:42:23.285 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2024-05-14T15:42:23.285 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2024-05-14T15:42:23.285 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2024-05-14T15:42:23.285 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2024-05-14T15:42:23.285 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2024-05-14T15:42:23.285 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_path": 0, 2024-05-14T15:42:23.286 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_inode": 0, 2024-05-14T15:42:23.286 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 6, 2024-05-14T15:42:23.286 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 73, 2024-05-14T15:42:23.286 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2024-05-14T15:42:23.286 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 4, 2024-05-14T15:42:23.286 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2024-05-14T15:42:23.286 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0 2024-05-14T15:42:23.286 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.286 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2024-05-14T15:42:23.286 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 0, 2024-05-14T15:42:23.286 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 7157, 2024-05-14T15:42:23.286 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 7098, 2024-05-14T15:42:23.286 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 7098, 2024-05-14T15:42:23.286 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 59, 2024-05-14T15:42:23.286 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2024-05-14T15:42:23.287 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 47, 2024-05-14T15:42:23.287 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 100, 2024-05-14T15:42:23.287 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 99, 2024-05-14T15:42:23.287 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 99, 2024-05-14T15:42:23.287 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 1, 2024-05-14T15:42:23.287 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 1, 2024-05-14T15:42:23.287 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2024-05-14T15:42:23.287 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 2, 2024-05-14T15:42:23.287 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 46305852, 2024-05-14T15:42:23.287 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 46885225, 2024-05-14T15:42:23.287 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 0, 2024-05-14T15:42:23.287 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2024-05-14T15:42:23.287 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3493, 2024-05-14T15:42:23.287 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 38.920358487, 2024-05-14T15:42:23.287 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.011142387 2024-05-14T15:42:23.288 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.288 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 0 2024-05-14T15:42:23.288 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.288 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2024-05-14T15:42:23.288 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 137, 2024-05-14T15:42:23.288 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 1814, 2024-05-14T15:42:23.288 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 1677, 2024-05-14T15:42:23.288 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 96, 2024-05-14T15:42:23.288 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 161, 2024-05-14T15:42:23.288 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 65, 2024-05-14T15:42:23.288 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 151, 2024-05-14T15:42:23.288 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 1943, 2024-05-14T15:42:23.288 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 1792, 2024-05-14T15:42:23.288 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 44, 2024-05-14T15:42:23.289 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 1496, 2024-05-14T15:42:23.289 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 1452, 2024-05-14T15:42:23.289 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 136844, 2024-05-14T15:42:23.289 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 231824 2024-05-14T15:42:23.289 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.289 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2024-05-14T15:42:23.289 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 8247, 2024-05-14T15:42:23.289 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 1195, 2024-05-14T15:42:23.289 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 6497, 2024-05-14T15:42:23.289 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 109, 2024-05-14T15:42:23.289 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 2495, 2024-05-14T15:42:23.289 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2024-05-14T15:42:23.289 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 961, 2024-05-14T15:42:23.289 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 3.974003765, 2024-05-14T15:42:23.289 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.004135279 2024-05-14T15:42:23.290 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.290 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2024-05-14T15:42:23.290 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 613, 2024-05-14T15:42:23.290 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.455086371, 2024-05-14T15:42:23.290 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000742392 2024-05-14T15:42:23.290 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.290 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2024-05-14T15:42:23.290 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.290 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.290 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.290 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.290 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2024-05-14T15:42:23.290 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 16, 2024-05-14T15:42:23.290 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.355400415, 2024-05-14T15:42:23.291 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.022212525 2024-05-14T15:42:23.291 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.291 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2024-05-14T15:42:23.291 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2184, 2024-05-14T15:42:23.291 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 109.875251828, 2024-05-14T15:42:23.291 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.050309181 2024-05-14T15:42:23.291 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.291 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2024-05-14T15:42:23.291 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.291 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.291 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.291 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.291 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2024-05-14T15:42:23.291 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.292 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.292 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.292 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.292 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2024-05-14T15:42:23.292 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.292 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.292 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.292 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.292 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2024-05-14T15:42:23.292 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.292 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.292 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.292 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.292 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2024-05-14T15:42:23.292 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.293 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.293 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.293 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.294 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2024-05-14T15:42:23.294 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 21, 2024-05-14T15:42:23.294 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.010221176, 2024-05-14T15:42:23.294 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000486722 2024-05-14T15:42:23.294 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.294 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2024-05-14T15:42:23.294 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 37, 2024-05-14T15:42:23.294 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.131336209, 2024-05-14T15:42:23.294 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.003549627 2024-05-14T15:42:23.294 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.294 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2024-05-14T15:42:23.294 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.294 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.295 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.295 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.295 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2024-05-14T15:42:23.295 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 21, 2024-05-14T15:42:23.295 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.448804743, 2024-05-14T15:42:23.295 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.021371654 2024-05-14T15:42:23.295 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.295 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2024-05-14T15:42:23.295 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 876, 2024-05-14T15:42:23.295 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1.736829854, 2024-05-14T15:42:23.295 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001982682 2024-05-14T15:42:23.295 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.295 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2024-05-14T15:42:23.295 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 58, 2024-05-14T15:42:23.295 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.249545163, 2024-05-14T15:42:23.296 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.004302502 2024-05-14T15:42:23.296 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.296 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2024-05-14T15:42:23.296 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 48, 2024-05-14T15:42:23.296 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 11.479540205, 2024-05-14T15:42:23.296 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.239157087 2024-05-14T15:42:23.296 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.296 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2024-05-14T15:42:23.296 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.296 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.296 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.296 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.296 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2024-05-14T15:42:23.296 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.297 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.297 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.297 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.297 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2024-05-14T15:42:23.297 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2, 2024-05-14T15:42:23.297 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.054149696, 2024-05-14T15:42:23.297 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.027074848 2024-05-14T15:42:23.297 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.297 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2024-05-14T15:42:23.297 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 15, 2024-05-14T15:42:23.297 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.216594528, 2024-05-14T15:42:23.297 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.014439635 2024-05-14T15:42:23.297 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.297 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2024-05-14T15:42:23.297 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.298 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.298 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.298 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.298 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2024-05-14T15:42:23.298 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2, 2024-05-14T15:42:23.298 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.003644629, 2024-05-14T15:42:23.298 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001822314 2024-05-14T15:42:23.298 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.298 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2024-05-14T15:42:23.298 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.299 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.299 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.299 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.299 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2024-05-14T15:42:23.299 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.299 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.299 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.299 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.299 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2024-05-14T15:42:23.299 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.299 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.300 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.300 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.300 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2024-05-14T15:42:23.300 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 8, 2024-05-14T15:42:23.300 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.062738480, 2024-05-14T15:42:23.300 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.007842310 2024-05-14T15:42:23.300 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.300 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2024-05-14T15:42:23.300 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.300 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.300 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.301 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.301 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2024-05-14T15:42:23.301 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 15, 2024-05-14T15:42:23.301 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.097179562, 2024-05-14T15:42:23.301 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.006478637 2024-05-14T15:42:23.301 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.301 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2024-05-14T15:42:23.301 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2024-05-14T15:42:23.301 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2024-05-14T15:42:23.301 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.301 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.301 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.301 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:23.301 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.302 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2024-05-14T15:42:23.302 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 2, 2024-05-14T15:42:23.302 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 6, 2024-05-14T15:42:23.302 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 4, 2024-05-14T15:42:23.302 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 2, 2024-05-14T15:42:23.302 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2024-05-14T15:42:23.302 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 533, 2024-05-14T15:42:23.302 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 266, 2024-05-14T15:42:23.302 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 1234, 2024-05-14T15:42:23.302 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2024-05-14T15:42:23.302 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.302 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2024-05-14T15:42:23.302 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 240, 2024-05-14T15:42:23.302 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 240, 2024-05-14T15:42:23.303 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T15:42:23.303 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2024-05-14T15:42:23.303 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T15:42:23.303 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2024-05-14T15:42:23.303 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T15:42:23.303 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T15:42:23.303 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T15:42:23.303 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T15:42:23.303 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T15:42:23.303 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2024-05-14T15:42:23.303 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T15:42:23.303 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T15:42:23.303 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2024-05-14T15:42:23.303 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2024-05-14T15:42:23.304 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2024-05-14T15:42:23.304 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2024-05-14T15:42:23.304 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T15:42:23.304 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T15:42:23.304 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T15:42:23.304 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T15:42:23.304 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T15:42:23.304 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2024-05-14T15:42:23.304 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2024-05-14T15:42:23.304 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2024-05-14T15:42:23.304 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T15:42:23.304 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T15:42:23.304 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2024-05-14T15:42:23.304 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2024-05-14T15:42:23.304 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2024-05-14T15:42:23.305 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2024-05-14T15:42:23.305 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T15:42:23.305 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2024-05-14T15:42:23.305 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T15:42:23.305 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2024-05-14T15:42:23.305 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 401755, 2024-05-14T15:42:23.305 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 140, 2024-05-14T15:42:23.305 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2024-05-14T15:42:23.305 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2024-05-14T15:42:23.305 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2024-05-14T15:42:23.305 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2024-05-14T15:42:23.305 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2024-05-14T15:42:23.305 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2024-05-14T15:42:23.305 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2024-05-14T15:42:23.305 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2024-05-14T15:42:23.305 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 9704, 2024-05-14T15:42:23.306 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 186, 2024-05-14T15:42:23.306 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T15:42:23.306 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2024-05-14T15:42:23.306 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2024-05-14T15:42:23.306 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2024-05-14T15:42:23.306 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 697987, 2024-05-14T15:42:23.306 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 5082, 2024-05-14T15:42:23.306 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2024-05-14T15:42:23.306 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2024-05-14T15:42:23.306 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2024-05-14T15:42:23.306 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2024-05-14T15:42:23.306 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.306 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2024-05-14T15:42:23.306 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2024-05-14T15:42:23.307 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2024-05-14T15:42:23.307 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 8562, 2024-05-14T15:42:23.307 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 47942015, 2024-05-14T15:42:23.307 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 34, 2024-05-14T15:42:23.307 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 8562, 2024-05-14T15:42:23.307 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2024-05-14T15:42:23.307 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 8562, 2024-05-14T15:42:23.307 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 209.719160480, 2024-05-14T15:42:23.307 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.024494178 2024-05-14T15:42:23.307 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.307 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2024-05-14T15:42:23.307 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2024-05-14T15:42:23.307 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 8562, 2024-05-14T15:42:23.307 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 13216 2024-05-14T15:42:23.307 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.308 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 8562, 2024-05-14T15:42:23.308 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 1119, 2024-05-14T15:42:23.308 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 7443, 2024-05-14T15:42:23.308 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2024-05-14T15:42:23.308 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2024-05-14T15:42:23.308 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 841, 2024-05-14T15:42:23.308 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 1782, 2024-05-14T15:42:23.308 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 21, 2024-05-14T15:42:23.308 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 3508, 2024-05-14T15:42:23.308 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 332, 2024-05-14T15:42:23.308 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2024-05-14T15:42:23.308 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2024-05-14T15:42:23.308 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2024-05-14T15:42:23.308 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 4, 2024-05-14T15:42:23.308 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 572, 2024-05-14T15:42:23.309 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2024-05-14T15:42:23.309 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2024-05-14T15:42:23.309 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2024-05-14T15:42:23.309 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 1096, 2024-05-14T15:42:23.309 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 2706, 2024-05-14T15:42:23.309 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2024-05-14T15:42:23.309 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2024-05-14T15:42:23.309 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2024-05-14T15:42:23.309 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2024-05-14T15:42:23.309 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2024-05-14T15:42:23.309 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2024-05-14T15:42:23.309 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T15:42:23.309 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2024-05-14T15:42:23.309 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2024-05-14T15:42:23.310 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 0, 2024-05-14T15:42:23.310 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2024-05-14T15:42:23.310 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2024-05-14T15:42:23.310 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2024-05-14T15:42:23.310 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2024-05-14T15:42:23.310 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2024-05-14T15:42:23.310 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2024-05-14T15:42:23.310 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2024-05-14T15:42:23.310 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2024-05-14T15:42:23.310 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2024-05-14T15:42:23.310 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2024-05-14T15:42:23.310 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2024-05-14T15:42:23.310 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2024-05-14T15:42:23.310 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2024-05-14T15:42:23.311 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2024-05-14T15:42:23.311 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2024-05-14T15:42:23.311 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2024-05-14T15:42:23.311 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 124, 2024-05-14T15:42:23.311 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2024-05-14T15:42:23.311 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 44, 2024-05-14T15:42:23.311 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 12, 2024-05-14T15:42:23.311 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 12, 2024-05-14T15:42:23.311 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 0, 2024-05-14T15:42:23.311 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2024-05-14T15:42:23.311 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 2212, 2024-05-14T15:42:23.311 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 18, 2024-05-14T15:42:23.311 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 124 2024-05-14T15:42:23.311 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.311 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2024-05-14T15:42:23.312 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 1, 2024-05-14T15:42:23.312 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2024-05-14T15:42:23.312 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2024-05-14T15:42:23.312 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2024-05-14T15:42:23.312 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.312 INFO:teuthology.orchestra.run.smithi092.stdout: "osd-slow-ops": { 2024-05-14T15:42:23.312 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 0 2024-05-14T15:42:23.312 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.312 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2024-05-14T15:42:23.312 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2024-05-14T15:42:23.312 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 10, 2024-05-14T15:42:23.312 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2024-05-14T15:42:23.312 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 5, 2024-05-14T15:42:23.312 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed_ops": 40, 2024-05-14T15:42:23.312 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 21, 2024-05-14T15:42:23.313 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2024-05-14T15:42:23.313 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.313 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T15:42:23.313 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:23.313 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-05-14T15:42:23.313 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:23.313 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 50781, 2024-05-14T15:42:23.313 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 15221227, 2024-05-14T15:42:23.313 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:23.313 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 50781, 2024-05-14T15:42:23.313 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-05-14T15:42:23.313 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-05-14T15:42:23.313 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 50781, 2024-05-14T15:42:23.313 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 15221227, 2024-05-14T15:42:23.313 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:23.314 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.314 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.314 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.314 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:23.314 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.314 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2024-05-14T15:42:23.314 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:23.314 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-05-14T15:42:23.314 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:23.314 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-05-14T15:42:23.314 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-05-14T15:42:23.314 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:23.314 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:23.314 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 8562, 2024-05-14T15:42:23.315 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 47944276, 2024-05-14T15:42:23.315 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 8562, 2024-05-14T15:42:23.315 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 47944276, 2024-05-14T15:42:23.315 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:23.315 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.315 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.315 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.315 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:23.315 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.315 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2024-05-14T15:42:23.315 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:23.315 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2024-05-14T15:42:23.315 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:23.315 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-05-14T15:42:23.316 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-05-14T15:42:23.316 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:23.316 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:23.316 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 8562, 2024-05-14T15:42:23.316 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 8562, 2024-05-14T15:42:23.316 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 8562, 2024-05-14T15:42:23.316 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 8562, 2024-05-14T15:42:23.316 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:23.316 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.316 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.316 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.316 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:23.316 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.316 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2024-05-14T15:42:23.316 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:23.317 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-05-14T15:42:23.317 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:23.317 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 21, 2024-05-14T15:42:23.317 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 2393, 2024-05-14T15:42:23.317 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:23.317 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 21, 2024-05-14T15:42:23.317 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-05-14T15:42:23.317 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-05-14T15:42:23.317 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 15, 2024-05-14T15:42:23.317 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 2393, 2024-05-14T15:42:23.317 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:23.317 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.317 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.317 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.317 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:23.317 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:23.318 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x557996cc0680": { 2024-05-14T15:42:23.318 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:23.318 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-05-14T15:42:23.318 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:23.318 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 7157, 2024-05-14T15:42:23.318 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 42690921, 2024-05-14T15:42:23.318 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:23.318 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 7157, 2024-05-14T15:42:23.318 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-05-14T15:42:23.318 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-05-14T15:42:23.318 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 3493, 2024-05-14T15:42:23.318 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 42690921, 2024-05-14T15:42:23.318 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:23.318 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:23.319 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:23.319 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:23.319 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:23.319 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:23.319 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-05-14T15:42:23.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:23 smithi092 ceph-mon[34729]: pgmap v657: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-05-14T15:42:23.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:23 smithi069 ceph-mon[31270]: pgmap v657: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-05-14T15:42:24.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:23 smithi203 ceph-mon[34567]: pgmap v657: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 27 KiB/s wr, 12 op/s 2024-05-14T15:42:24.225 INFO:tasks.check_counter:Daemon mds.b mds.exported=66 2024-05-14T15:42:24.226 INFO:tasks.check_counter:Daemon mds.b mds.imported=34 2024-05-14T15:42:24.226 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=153 2024-05-14T15:42:24.226 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=43 2024-05-14T15:42:24.226 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-05-14T15:42:24.226 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=21 2024-05-14T15:42:24.226 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=15 2024-05-14T15:42:24.226 DEBUG:tasks.check_counter:Getting stats from e 2024-05-14T15:42:24.227 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph daemon mds.e perf dump 2024-05-14T15:42:24.751 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T15:42:25.924 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:25 smithi092 ceph-mon[34729]: pgmap v658: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-05-14T15:42:25.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:25 smithi069 ceph-mon[31270]: pgmap v658: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-05-14T15:42:26.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:25 smithi203 ceph-mon[34567]: pgmap v658: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 28 KiB/s wr, 13 op/s 2024-05-14T15:42:27.122 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-05-14T15:42:27.122 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T15:42:27.122 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 1757, 2024-05-14T15:42:27.122 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 1641, 2024-05-14T15:42:27.122 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 3071339, 2024-05-14T15:42:27.122 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 1129853, 2024-05-14T15:42:27.122 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 30, 2024-05-14T15:42:27.122 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 6, 2024-05-14T15:42:27.122 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.496556577, 2024-05-14T15:42:27.122 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.206264044, 2024-05-14T15:42:27.122 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.319867046, 2024-05-14T15:42:27.123 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.029106057, 2024-05-14T15:42:27.123 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:27.123 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1636, 2024-05-14T15:42:27.123 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.273570211, 2024-05-14T15:42:27.123 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000167218 2024-05-14T15:42:27.123 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.123 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:27.123 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1572, 2024-05-14T15:42:27.123 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000882608, 2024-05-14T15:42:27.123 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000561 2024-05-14T15:42:27.123 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.123 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 2134064, 2024-05-14T15:42:27.123 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 336352 2024-05-14T15:42:27.123 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.124 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T15:42:27.124 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 16713, 2024-05-14T15:42:27.124 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 14170, 2024-05-14T15:42:27.124 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 6584791, 2024-05-14T15:42:27.124 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 10489277, 2024-05-14T15:42:27.124 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 11, 2024-05-14T15:42:27.124 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 6, 2024-05-14T15:42:27.124 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 3.949537814, 2024-05-14T15:42:27.124 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 2.050392577, 2024-05-14T15:42:27.124 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 2.330925682, 2024-05-14T15:42:27.124 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.088619786, 2024-05-14T15:42:27.124 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:27.124 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 14172, 2024-05-14T15:42:27.124 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2.100646053, 2024-05-14T15:42:27.124 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000148225 2024-05-14T15:42:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 26220, 2024-05-14T15:42:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.016307657, 2024-05-14T15:42:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000621 2024-05-14T15:42:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-14T15:42:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 144592 2024-05-14T15:42:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T15:42:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 1577, 2024-05-14T15:42:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 1808, 2024-05-14T15:42:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 1090471, 2024-05-14T15:42:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 2811733, 2024-05-14T15:42:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 10, 2024-05-14T15:42:27.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 7, 2024-05-14T15:42:27.126 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.339057947, 2024-05-14T15:42:27.126 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.141889088, 2024-05-14T15:42:27.126 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.178136354, 2024-05-14T15:42:27.126 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.035564912, 2024-05-14T15:42:27.126 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:27.126 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1806, 2024-05-14T15:42:27.126 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.309719173, 2024-05-14T15:42:27.126 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000171494 2024-05-14T15:42:27.126 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.126 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:27.127 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1718, 2024-05-14T15:42:27.127 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.003325763, 2024-05-14T15:42:27.127 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000001935 2024-05-14T15:42:27.127 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.127 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-14T15:42:27.127 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 503904 2024-05-14T15:42:27.127 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.127 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2024-05-14T15:42:27.127 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2024-05-14T15:42:27.127 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2024-05-14T15:42:27.127 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.127 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2024-05-14T15:42:27.127 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-05-14T15:42:27.127 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-05-14T15:42:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2590, 2024-05-14T15:42:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1.438505944, 2024-05-14T15:42:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000555407 2024-05-14T15:42:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2024-05-14T15:42:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-05-14T15:42:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-05-14T15:42:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 151, 2024-05-14T15:42:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.014718218, 2024-05-14T15:42:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000097471 2024-05-14T15:42:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.128 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2024-05-14T15:42:27.129 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 2027, 2024-05-14T15:42:27.129 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 1457, 2024-05-14T15:42:27.129 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2024-05-14T15:42:27.129 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1457, 2024-05-14T15:42:27.129 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 50.040079385, 2024-05-14T15:42:27.129 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.034344598 2024-05-14T15:42:27.129 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.129 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2024-05-14T15:42:27.129 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 570, 2024-05-14T15:42:27.129 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 1, 2024-05-14T15:42:27.129 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 0, 2024-05-14T15:42:27.129 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 19, 2024-05-14T15:42:27.129 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 1, 2024-05-14T15:42:27.129 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 0, 2024-05-14T15:42:27.129 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 474, 2024-05-14T15:42:27.130 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 30, 2024-05-14T15:42:27.130 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 396, 2024-05-14T15:42:27.130 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 48, 2024-05-14T15:42:27.130 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 432, 2024-05-14T15:42:27.130 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 674, 2024-05-14T15:42:27.130 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 258, 2024-05-14T15:42:27.130 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 258, 2024-05-14T15:42:27.130 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 39, 2024-05-14T15:42:27.130 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 3981, 2024-05-14T15:42:27.130 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 2753, 2024-05-14T15:42:27.130 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 563, 2024-05-14T15:42:27.130 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 78, 2024-05-14T15:42:27.130 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 0, 2024-05-14T15:42:27.130 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2024-05-14T15:42:27.131 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 12, 2024-05-14T15:42:27.131 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 474, 2024-05-14T15:42:27.131 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2024-05-14T15:42:27.131 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 34, 2024-05-14T15:42:27.131 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 611, 2024-05-14T15:42:27.131 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 36, 2024-05-14T15:42:27.131 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 829, 2024-05-14T15:42:27.131 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2024-05-14T15:42:27.131 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 1014, 2024-05-14T15:42:27.131 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2024-05-14T15:42:27.131 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 1015, 2024-05-14T15:42:27.131 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 1478530389, 2024-05-14T15:42:27.131 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 6, 2024-05-14T15:42:27.131 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 1014, 2024-05-14T15:42:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2024-05-14T15:42:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T15:42:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2024-05-14T15:42:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 11, 2024-05-14T15:42:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T15:42:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 11, 2024-05-14T15:42:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 1003, 2024-05-14T15:42:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 11, 2024-05-14T15:42:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 449, 2024-05-14T15:42:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 443, 2024-05-14T15:42:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T15:42:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T15:42:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T15:42:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 2505, 2024-05-14T15:42:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 1482, 2024-05-14T15:42:27.132 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 23, 2024-05-14T15:42:27.133 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 105 2024-05-14T15:42:27.133 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.133 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2024-05-14T15:42:27.133 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 104, 2024-05-14T15:42:27.133 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 489, 2024-05-14T15:42:27.133 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 287, 2024-05-14T15:42:27.133 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 510, 2024-05-14T15:42:27.133 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 136, 2024-05-14T15:42:27.133 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 0, 2024-05-14T15:42:27.133 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2024-05-14T15:42:27.133 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2024-05-14T15:42:27.133 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 27, 2024-05-14T15:42:27.133 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 19, 2024-05-14T15:42:27.133 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 15, 2024-05-14T15:42:27.133 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 5, 2024-05-14T15:42:27.134 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2024-05-14T15:42:27.134 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2024-05-14T15:42:27.134 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2024-05-14T15:42:27.134 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2024-05-14T15:42:27.134 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2024-05-14T15:42:27.134 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_path": 0, 2024-05-14T15:42:27.134 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_inode": 0, 2024-05-14T15:42:27.134 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T15:42:27.134 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 35, 2024-05-14T15:42:27.134 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2024-05-14T15:42:27.134 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 1, 2024-05-14T15:42:27.134 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2024-05-14T15:42:27.135 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0 2024-05-14T15:42:27.135 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.135 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2024-05-14T15:42:27.135 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 0, 2024-05-14T15:42:27.135 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 3544, 2024-05-14T15:42:27.135 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 0, 2024-05-14T15:42:27.135 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 0, 2024-05-14T15:42:27.135 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 3544, 2024-05-14T15:42:27.135 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2024-05-14T15:42:27.135 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 0, 2024-05-14T15:42:27.135 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 5, 2024-05-14T15:42:27.135 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 0, 2024-05-14T15:42:27.135 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 0, 2024-05-14T15:42:27.135 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 5, 2024-05-14T15:42:27.135 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 2, 2024-05-14T15:42:27.136 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2024-05-14T15:42:27.136 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 0, 2024-05-14T15:42:27.136 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 4194304, 2024-05-14T15:42:27.136 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 9474966, 2024-05-14T15:42:27.136 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 0, 2024-05-14T15:42:27.136 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2024-05-14T15:42:27.136 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 791, 2024-05-14T15:42:27.136 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 6.687410689, 2024-05-14T15:42:27.136 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.008454375 2024-05-14T15:42:27.136 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.136 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 0 2024-05-14T15:42:27.136 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.136 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2024-05-14T15:42:27.136 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 438, 2024-05-14T15:42:27.137 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 1064, 2024-05-14T15:42:27.137 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 626, 2024-05-14T15:42:27.137 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 97, 2024-05-14T15:42:27.137 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 290, 2024-05-14T15:42:27.137 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 193, 2024-05-14T15:42:27.137 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 474, 2024-05-14T15:42:27.137 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 1187, 2024-05-14T15:42:27.137 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 713, 2024-05-14T15:42:27.137 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 258, 2024-05-14T15:42:27.137 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 614, 2024-05-14T15:42:27.137 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 356, 2024-05-14T15:42:27.137 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 128556, 2024-05-14T15:42:27.137 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 223632 2024-05-14T15:42:27.137 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.137 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2024-05-14T15:42:27.138 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 2650, 2024-05-14T15:42:27.138 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 181, 2024-05-14T15:42:27.138 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 2027, 2024-05-14T15:42:27.138 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 63, 2024-05-14T15:42:27.138 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 495, 2024-05-14T15:42:27.138 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2024-05-14T15:42:27.138 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 18, 2024-05-14T15:42:27.138 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.116168380, 2024-05-14T15:42:27.138 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.006453798 2024-05-14T15:42:27.138 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.138 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2024-05-14T15:42:27.138 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 64, 2024-05-14T15:42:27.138 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.129125641, 2024-05-14T15:42:27.138 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.002017588 2024-05-14T15:42:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2024-05-14T15:42:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2024-05-14T15:42:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 14, 2024-05-14T15:42:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.403805843, 2024-05-14T15:42:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.028843274 2024-05-14T15:42:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2024-05-14T15:42:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 932, 2024-05-14T15:42:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 38.845813222, 2024-05-14T15:42:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.041680057 2024-05-14T15:42:27.139 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.140 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2024-05-14T15:42:27.140 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.140 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.140 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.140 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.140 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2024-05-14T15:42:27.140 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.140 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.140 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.140 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.140 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2024-05-14T15:42:27.140 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.140 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.140 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.140 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.140 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2024-05-14T15:42:27.141 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.141 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.141 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.141 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.141 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2024-05-14T15:42:27.141 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.141 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.141 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.141 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.141 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2024-05-14T15:42:27.142 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.142 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.142 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.142 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.142 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2024-05-14T15:42:27.142 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.142 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.142 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.142 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.143 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2024-05-14T15:42:27.143 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.143 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.143 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.143 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.143 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2024-05-14T15:42:27.143 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.143 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.143 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.143 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.143 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2024-05-14T15:42:27.143 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 352, 2024-05-14T15:42:27.143 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.429301926, 2024-05-14T15:42:27.143 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001219607 2024-05-14T15:42:27.143 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.144 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2024-05-14T15:42:27.144 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 23, 2024-05-14T15:42:27.144 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.035555130, 2024-05-14T15:42:27.144 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001545875 2024-05-14T15:42:27.144 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.144 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2024-05-14T15:42:27.144 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 35, 2024-05-14T15:42:27.144 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 9.888922632, 2024-05-14T15:42:27.144 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.282540646 2024-05-14T15:42:27.144 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.144 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2024-05-14T15:42:27.144 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.144 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.144 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.145 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.145 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2024-05-14T15:42:27.145 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.145 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.145 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.145 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.145 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2024-05-14T15:42:27.145 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.145 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.145 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.145 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.145 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2024-05-14T15:42:27.145 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.146 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.146 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.146 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.146 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2024-05-14T15:42:27.146 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.146 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.146 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.146 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.146 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2024-05-14T15:42:27.146 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.146 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.146 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.146 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.146 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2024-05-14T15:42:27.147 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.147 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.147 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.147 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.147 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2024-05-14T15:42:27.147 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.147 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.147 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.147 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.147 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2024-05-14T15:42:27.147 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.147 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.147 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.147 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.147 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2024-05-14T15:42:27.148 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.148 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.148 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.148 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.148 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2024-05-14T15:42:27.148 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.148 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.148 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.148 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.148 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2024-05-14T15:42:27.148 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 19, 2024-05-14T15:42:27.148 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.191386611, 2024-05-14T15:42:27.148 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.010072979 2024-05-14T15:42:27.148 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.149 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2024-05-14T15:42:27.149 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2024-05-14T15:42:27.149 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2024-05-14T15:42:27.149 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.149 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.149 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.149 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:27.149 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.149 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2024-05-14T15:42:27.149 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 2, 2024-05-14T15:42:27.149 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 4, 2024-05-14T15:42:27.149 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 2, 2024-05-14T15:42:27.149 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 2, 2024-05-14T15:42:27.149 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2024-05-14T15:42:27.150 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 413, 2024-05-14T15:42:27.150 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 206, 2024-05-14T15:42:27.150 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 1238, 2024-05-14T15:42:27.150 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2024-05-14T15:42:27.150 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.150 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2024-05-14T15:42:27.150 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2024-05-14T15:42:27.150 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2024-05-14T15:42:27.150 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T15:42:27.150 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2024-05-14T15:42:27.150 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T15:42:27.150 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2024-05-14T15:42:27.150 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T15:42:27.150 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T15:42:27.150 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T15:42:27.151 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T15:42:27.151 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T15:42:27.151 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2024-05-14T15:42:27.151 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T15:42:27.151 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T15:42:27.151 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2024-05-14T15:42:27.151 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2024-05-14T15:42:27.151 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2024-05-14T15:42:27.151 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2024-05-14T15:42:27.151 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T15:42:27.151 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T15:42:27.151 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T15:42:27.151 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T15:42:27.151 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T15:42:27.151 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2024-05-14T15:42:27.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2024-05-14T15:42:27.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2024-05-14T15:42:27.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T15:42:27.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T15:42:27.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2024-05-14T15:42:27.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2024-05-14T15:42:27.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2024-05-14T15:42:27.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2024-05-14T15:42:27.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T15:42:27.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2024-05-14T15:42:27.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T15:42:27.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2024-05-14T15:42:27.152 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 497816, 2024-05-14T15:42:27.152 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 162, 2024-05-14T15:42:27.152 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2024-05-14T15:42:27.153 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2024-05-14T15:42:27.153 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2024-05-14T15:42:27.153 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2024-05-14T15:42:27.153 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2024-05-14T15:42:27.153 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2024-05-14T15:42:27.153 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2024-05-14T15:42:27.153 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2024-05-14T15:42:27.153 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 9704, 2024-05-14T15:42:27.153 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 186, 2024-05-14T15:42:27.153 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T15:42:27.153 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2024-05-14T15:42:27.153 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2024-05-14T15:42:27.153 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2024-05-14T15:42:27.153 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 1616554, 2024-05-14T15:42:27.154 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 16564, 2024-05-14T15:42:27.154 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2024-05-14T15:42:27.154 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2024-05-14T15:42:27.154 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2024-05-14T15:42:27.154 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2024-05-14T15:42:27.154 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.154 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2024-05-14T15:42:27.154 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2024-05-14T15:42:27.154 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2024-05-14T15:42:27.154 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 2231, 2024-05-14T15:42:27.154 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 5394459, 2024-05-14T15:42:27.154 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 33, 2024-05-14T15:42:27.154 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 2231, 2024-05-14T15:42:27.154 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2024-05-14T15:42:27.155 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2231, 2024-05-14T15:42:27.155 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 12.799643505, 2024-05-14T15:42:27.155 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.005737177 2024-05-14T15:42:27.155 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.155 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2024-05-14T15:42:27.155 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2024-05-14T15:42:27.155 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2231, 2024-05-14T15:42:27.155 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2467 2024-05-14T15:42:27.155 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.155 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 2231, 2024-05-14T15:42:27.155 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 1032, 2024-05-14T15:42:27.155 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 1199, 2024-05-14T15:42:27.155 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2024-05-14T15:42:27.155 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2024-05-14T15:42:27.155 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 0, 2024-05-14T15:42:27.156 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 10, 2024-05-14T15:42:27.156 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 17, 2024-05-14T15:42:27.156 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 808, 2024-05-14T15:42:27.156 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 96, 2024-05-14T15:42:27.156 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2024-05-14T15:42:27.156 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2024-05-14T15:42:27.156 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2024-05-14T15:42:27.156 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 0, 2024-05-14T15:42:27.156 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 81, 2024-05-14T15:42:27.156 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2024-05-14T15:42:27.156 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2024-05-14T15:42:27.156 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2024-05-14T15:42:27.156 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 1014, 2024-05-14T15:42:27.156 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 20, 2024-05-14T15:42:27.157 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2024-05-14T15:42:27.157 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2024-05-14T15:42:27.157 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2024-05-14T15:42:27.157 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2024-05-14T15:42:27.157 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2024-05-14T15:42:27.157 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2024-05-14T15:42:27.157 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T15:42:27.157 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2024-05-14T15:42:27.157 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2024-05-14T15:42:27.157 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 0, 2024-05-14T15:42:27.157 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2024-05-14T15:42:27.157 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2024-05-14T15:42:27.157 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2024-05-14T15:42:27.157 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2024-05-14T15:42:27.157 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2024-05-14T15:42:27.158 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2024-05-14T15:42:27.158 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2024-05-14T15:42:27.158 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2024-05-14T15:42:27.158 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2024-05-14T15:42:27.158 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2024-05-14T15:42:27.158 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2024-05-14T15:42:27.158 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2024-05-14T15:42:27.158 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2024-05-14T15:42:27.158 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2024-05-14T15:42:27.158 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2024-05-14T15:42:27.158 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2024-05-14T15:42:27.158 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 124, 2024-05-14T15:42:27.158 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2024-05-14T15:42:27.158 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 35, 2024-05-14T15:42:27.158 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 12, 2024-05-14T15:42:27.159 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 12, 2024-05-14T15:42:27.159 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 0, 2024-05-14T15:42:27.159 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2024-05-14T15:42:27.159 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 334, 2024-05-14T15:42:27.159 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 2, 2024-05-14T15:42:27.159 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 85 2024-05-14T15:42:27.159 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.159 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2024-05-14T15:42:27.159 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 1, 2024-05-14T15:42:27.159 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2024-05-14T15:42:27.159 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2024-05-14T15:42:27.159 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2024-05-14T15:42:27.159 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.159 INFO:teuthology.orchestra.run.smithi092.stdout: "osd-slow-ops": { 2024-05-14T15:42:27.159 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 0 2024-05-14T15:42:27.160 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.160 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2024-05-14T15:42:27.160 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2024-05-14T15:42:27.160 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 17, 2024-05-14T15:42:27.160 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2024-05-14T15:42:27.160 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 3, 2024-05-14T15:42:27.160 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed_ops": 67, 2024-05-14T15:42:27.160 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 19, 2024-05-14T15:42:27.160 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2024-05-14T15:42:27.160 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.160 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T15:42:27.160 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:27.160 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-05-14T15:42:27.160 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:27.160 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 20043, 2024-05-14T15:42:27.161 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 8908553, 2024-05-14T15:42:27.161 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:27.161 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 20043, 2024-05-14T15:42:27.161 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-05-14T15:42:27.161 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-05-14T15:42:27.161 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 20043, 2024-05-14T15:42:27.161 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 8908553, 2024-05-14T15:42:27.161 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:27.161 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.161 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.161 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.161 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:27.161 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.161 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2024-05-14T15:42:27.161 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:27.161 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-05-14T15:42:27.162 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:27.162 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-05-14T15:42:27.162 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-05-14T15:42:27.162 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:27.162 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:27.162 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 2231, 2024-05-14T15:42:27.162 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 5396826, 2024-05-14T15:42:27.162 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 2231, 2024-05-14T15:42:27.162 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 5396826, 2024-05-14T15:42:27.162 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:27.162 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.162 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.162 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.162 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:27.163 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.163 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2024-05-14T15:42:27.163 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:27.163 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2024-05-14T15:42:27.163 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:27.163 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-05-14T15:42:27.163 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-05-14T15:42:27.163 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:27.163 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:27.163 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 2231, 2024-05-14T15:42:27.163 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 2231, 2024-05-14T15:42:27.163 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 2231, 2024-05-14T15:42:27.163 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 2231, 2024-05-14T15:42:27.163 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:27.163 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.163 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.164 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.164 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:27.164 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.164 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2024-05-14T15:42:27.164 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:27.164 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-05-14T15:42:27.164 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:27.164 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 19, 2024-05-14T15:42:27.164 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 2383, 2024-05-14T15:42:27.164 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:27.164 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 19, 2024-05-14T15:42:27.164 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-05-14T15:42:27.164 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-05-14T15:42:27.164 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 17, 2024-05-14T15:42:27.164 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 2383, 2024-05-14T15:42:27.165 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:27.165 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.165 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.165 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.165 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:27.165 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:27.165 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x560deb9a4340": { 2024-05-14T15:42:27.165 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:27.165 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-05-14T15:42:27.165 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:27.165 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 3544, 2024-05-14T15:42:27.165 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 5280662, 2024-05-14T15:42:27.165 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:27.165 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 3544, 2024-05-14T15:42:27.165 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-05-14T15:42:27.165 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-05-14T15:42:27.166 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 791, 2024-05-14T15:42:27.166 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 5280662, 2024-05-14T15:42:27.166 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:27.166 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:27.166 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:27.166 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:27.166 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:27.166 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:27.166 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-05-14T15:42:27.956 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:27 smithi092 ceph-mon[34729]: pgmap v659: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-05-14T15:42:27.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:27 smithi069 ceph-mon[31270]: pgmap v659: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-05-14T15:42:28.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:27 smithi203 ceph-mon[34567]: pgmap v659: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 30 KiB/s rd, 26 KiB/s wr, 13 op/s 2024-05-14T15:42:28.284 INFO:tasks.check_counter:Daemon mds.e mds.exported=34 2024-05-14T15:42:28.284 INFO:tasks.check_counter:Daemon mds.e mds.imported=36 2024-05-14T15:42:28.285 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=104 2024-05-14T15:42:28.285 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=489 2024-05-14T15:42:28.285 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-05-14T15:42:28.285 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-05-14T15:42:28.285 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-05-14T15:42:28.285 DEBUG:tasks.check_counter:Getting stats from h 2024-05-14T15:42:28.285 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph daemon mds.h perf dump 2024-05-14T15:42:28.778 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T15:42:29.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:29 smithi092 ceph-mon[34729]: pgmap v660: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-05-14T15:42:29.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:29 smithi092 ceph-mon[34729]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:29.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:29 smithi069 ceph-mon[31270]: pgmap v660: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-05-14T15:42:29.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:29 smithi069 ceph-mon[31270]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:30.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:29 smithi203 ceph-mon[34567]: pgmap v660: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 7.5 KiB/s rd, 3.1 KiB/s wr, 9 op/s 2024-05-14T15:42:30.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:29 smithi203 ceph-mon[34567]: fsmap cephfs:5 5 up:standby-replay 2 up:standby 5 up:active 2024-05-14T15:42:31.124 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-05-14T15:42:31.124 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T15:42:31.124 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 13059, 2024-05-14T15:42:31.124 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 10634, 2024-05-14T15:42:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 7526806, 2024-05-14T15:42:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 18075261, 2024-05-14T15:42:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 11, 2024-05-14T15:42:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 5, 2024-05-14T15:42:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 3.336740954, 2024-05-14T15:42:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 1.726663203, 2024-05-14T15:42:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 1.883144830, 2024-05-14T15:42:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.130486859, 2024-05-14T15:42:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 10633, 2024-05-14T15:42:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1.499822945, 2024-05-14T15:42:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000141053 2024-05-14T15:42:31.125 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 18043, 2024-05-14T15:42:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.012279650, 2024-05-14T15:42:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000680 2024-05-14T15:42:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 2132864, 2024-05-14T15:42:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 794448 2024-05-14T15:42:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T15:42:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 12863, 2024-05-14T15:42:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 14517, 2024-05-14T15:42:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 4285951, 2024-05-14T15:42:31.126 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 6489189, 2024-05-14T15:42:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 30, 2024-05-14T15:42:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 5, 2024-05-14T15:42:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 2.464819831, 2024-05-14T15:42:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 1.048025924, 2024-05-14T15:42:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 1.756384403, 2024-05-14T15:42:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.006746532, 2024-05-14T15:42:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 14512, 2024-05-14T15:42:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2.412327090, 2024-05-14T15:42:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000166229 2024-05-14T15:42:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 23349, 2024-05-14T15:42:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.014405693, 2024-05-14T15:42:31.127 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000616 2024-05-14T15:42:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 6544, 2024-05-14T15:42:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 161792 2024-05-14T15:42:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T15:42:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 3587, 2024-05-14T15:42:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 3308, 2024-05-14T15:42:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 2037348, 2024-05-14T15:42:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 6274810, 2024-05-14T15:42:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 11, 2024-05-14T15:42:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 6, 2024-05-14T15:42:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.714332736, 2024-05-14T15:42:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.323085537, 2024-05-14T15:42:31.128 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.398973280, 2024-05-14T15:42:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.058148125, 2024-05-14T15:42:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3309, 2024-05-14T15:42:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.523412575, 2024-05-14T15:42:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000158178 2024-05-14T15:42:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 4411, 2024-05-14T15:42:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.002190341, 2024-05-14T15:42:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000496 2024-05-14T15:42:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-05-14T15:42:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 448 2024-05-14T15:42:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.129 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2024-05-14T15:42:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2024-05-14T15:42:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2024-05-14T15:42:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2024-05-14T15:42:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-05-14T15:42:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-05-14T15:42:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 4095, 2024-05-14T15:42:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 3.934541758, 2024-05-14T15:42:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000960816 2024-05-14T15:42:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2024-05-14T15:42:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-05-14T15:42:31.130 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-05-14T15:42:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 44, 2024-05-14T15:42:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.003748873, 2024-05-14T15:42:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000085201 2024-05-14T15:42:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2024-05-14T15:42:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 3363, 2024-05-14T15:42:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 2650, 2024-05-14T15:42:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2024-05-14T15:42:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2650, 2024-05-14T15:42:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 35.547375220, 2024-05-14T15:42:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.013414103 2024-05-14T15:42:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2024-05-14T15:42:31.131 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 713, 2024-05-14T15:42:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 4, 2024-05-14T15:42:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 0, 2024-05-14T15:42:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 19, 2024-05-14T15:42:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 1, 2024-05-14T15:42:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 0, 2024-05-14T15:42:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 514, 2024-05-14T15:42:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 39, 2024-05-14T15:42:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 347, 2024-05-14T15:42:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 128, 2024-05-14T15:42:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 459, 2024-05-14T15:42:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 911, 2024-05-14T15:42:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 195, 2024-05-14T15:42:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 195, 2024-05-14T15:42:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 28, 2024-05-14T15:42:31.132 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 7799, 2024-05-14T15:42:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 4981, 2024-05-14T15:42:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 705, 2024-05-14T15:42:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 81, 2024-05-14T15:42:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 1, 2024-05-14T15:42:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2024-05-14T15:42:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 10, 2024-05-14T15:42:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 442, 2024-05-14T15:42:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2024-05-14T15:42:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 20, 2024-05-14T15:42:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 817, 2024-05-14T15:42:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 24, 2024-05-14T15:42:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 938, 2024-05-14T15:42:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2024-05-14T15:42:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 928, 2024-05-14T15:42:31.133 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2024-05-14T15:42:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 1015, 2024-05-14T15:42:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 1478530389, 2024-05-14T15:42:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 6, 2024-05-14T15:42:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 928, 2024-05-14T15:42:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2024-05-14T15:42:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T15:42:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2024-05-14T15:42:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 22, 2024-05-14T15:42:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T15:42:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 22, 2024-05-14T15:42:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 906, 2024-05-14T15:42:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 7, 2024-05-14T15:42:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 606, 2024-05-14T15:42:31.134 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 978, 2024-05-14T15:42:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T15:42:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T15:42:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T15:42:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 9245, 2024-05-14T15:42:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 7560, 2024-05-14T15:42:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 7, 2024-05-14T15:42:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 393 2024-05-14T15:42:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2024-05-14T15:42:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 382, 2024-05-14T15:42:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 322, 2024-05-14T15:42:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 177, 2024-05-14T15:42:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 371, 2024-05-14T15:42:31.135 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 369, 2024-05-14T15:42:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 0, 2024-05-14T15:42:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2024-05-14T15:42:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2024-05-14T15:42:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 125, 2024-05-14T15:42:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 5, 2024-05-14T15:42:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 115, 2024-05-14T15:42:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 8, 2024-05-14T15:42:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2024-05-14T15:42:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2024-05-14T15:42:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2024-05-14T15:42:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2024-05-14T15:42:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2024-05-14T15:42:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_path": 0, 2024-05-14T15:42:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_inode": 0, 2024-05-14T15:42:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T15:42:31.136 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 26, 2024-05-14T15:42:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2024-05-14T15:42:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 1, 2024-05-14T15:42:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2024-05-14T15:42:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0 2024-05-14T15:42:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2024-05-14T15:42:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 0, 2024-05-14T15:42:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 10229, 2024-05-14T15:42:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 0, 2024-05-14T15:42:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 0, 2024-05-14T15:42:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 10229, 2024-05-14T15:42:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2024-05-14T15:42:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 0, 2024-05-14T15:42:31.137 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 13, 2024-05-14T15:42:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 0, 2024-05-14T15:42:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 0, 2024-05-14T15:42:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 13, 2024-05-14T15:42:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 2, 2024-05-14T15:42:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2024-05-14T15:42:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 0, 2024-05-14T15:42:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 4194304, 2024-05-14T15:42:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 21584475, 2024-05-14T15:42:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 0, 2024-05-14T15:42:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2024-05-14T15:42:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1522, 2024-05-14T15:42:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 13.190188781, 2024-05-14T15:42:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.008666352 2024-05-14T15:42:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.138 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 0 2024-05-14T15:42:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2024-05-14T15:42:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 373, 2024-05-14T15:42:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 1142, 2024-05-14T15:42:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 769, 2024-05-14T15:42:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 79, 2024-05-14T15:42:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 261, 2024-05-14T15:42:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 182, 2024-05-14T15:42:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 514, 2024-05-14T15:42:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 1452, 2024-05-14T15:42:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 938, 2024-05-14T15:42:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 195, 2024-05-14T15:42:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 773, 2024-05-14T15:42:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 578, 2024-05-14T15:42:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 130180, 2024-05-14T15:42:31.139 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 223632 2024-05-14T15:42:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2024-05-14T15:42:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 5460, 2024-05-14T15:42:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 229, 2024-05-14T15:42:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 3363, 2024-05-14T15:42:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 69, 2024-05-14T15:42:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 722, 2024-05-14T15:42:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2024-05-14T15:42:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 78, 2024-05-14T15:42:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.519052098, 2024-05-14T15:42:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.006654514 2024-05-14T15:42:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2024-05-14T15:42:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 31, 2024-05-14T15:42:31.140 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.129613974, 2024-05-14T15:42:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.004181095 2024-05-14T15:42:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2024-05-14T15:42:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2024-05-14T15:42:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 115, 2024-05-14T15:42:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.950095870, 2024-05-14T15:42:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.008261703 2024-05-14T15:42:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2024-05-14T15:42:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1730, 2024-05-14T15:42:31.141 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 25.406806191, 2024-05-14T15:42:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.014686015 2024-05-14T15:42:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2024-05-14T15:42:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2024-05-14T15:42:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2024-05-14T15:42:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.142 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2024-05-14T15:42:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2024-05-14T15:42:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.143 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.144 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2024-05-14T15:42:31.144 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.144 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.144 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.144 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.144 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2024-05-14T15:42:31.144 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.144 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.144 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.144 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.145 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2024-05-14T15:42:31.145 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.145 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.145 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.145 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.145 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2024-05-14T15:42:31.145 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.145 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.145 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.145 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.145 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2024-05-14T15:42:31.145 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 426, 2024-05-14T15:42:31.145 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.698272782, 2024-05-14T15:42:31.145 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001639137 2024-05-14T15:42:31.145 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.146 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2024-05-14T15:42:31.146 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 25, 2024-05-14T15:42:31.146 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.052119586, 2024-05-14T15:42:31.146 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.002084783 2024-05-14T15:42:31.146 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.146 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2024-05-14T15:42:31.146 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 120, 2024-05-14T15:42:31.146 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 6.885476104, 2024-05-14T15:42:31.146 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.057378967 2024-05-14T15:42:31.146 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.146 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2024-05-14T15:42:31.146 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.146 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.146 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.147 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.147 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2024-05-14T15:42:31.147 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.147 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.147 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.147 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.147 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2024-05-14T15:42:31.147 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.147 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.147 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.147 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.147 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2024-05-14T15:42:31.147 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.148 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.148 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.148 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.148 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2024-05-14T15:42:31.148 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.148 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.148 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.148 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.148 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2024-05-14T15:42:31.148 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.148 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.148 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.148 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.148 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2024-05-14T15:42:31.149 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.149 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.149 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.149 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.149 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2024-05-14T15:42:31.149 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.149 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.149 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.149 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.149 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2024-05-14T15:42:31.149 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.149 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.149 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.149 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.150 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2024-05-14T15:42:31.150 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.150 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.150 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.150 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.150 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2024-05-14T15:42:31.150 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.150 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.150 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.150 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.150 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2024-05-14T15:42:31.150 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 125, 2024-05-14T15:42:31.150 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.905938615, 2024-05-14T15:42:31.150 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.007247508 2024-05-14T15:42:31.151 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.151 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2024-05-14T15:42:31.151 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2024-05-14T15:42:31.151 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2024-05-14T15:42:31.151 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.151 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.151 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.151 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:31.151 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.151 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2024-05-14T15:42:31.151 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 2, 2024-05-14T15:42:31.151 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 5, 2024-05-14T15:42:31.151 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 3, 2024-05-14T15:42:31.151 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 2, 2024-05-14T15:42:31.151 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2024-05-14T15:42:31.152 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 151, 2024-05-14T15:42:31.152 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 75, 2024-05-14T15:42:31.152 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 1241, 2024-05-14T15:42:31.152 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2024-05-14T15:42:31.152 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.152 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2024-05-14T15:42:31.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2024-05-14T15:42:31.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2024-05-14T15:42:31.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T15:42:31.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2024-05-14T15:42:31.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T15:42:31.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2024-05-14T15:42:31.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T15:42:31.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T15:42:31.152 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T15:42:31.153 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T15:42:31.153 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T15:42:31.153 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2024-05-14T15:42:31.153 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T15:42:31.153 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T15:42:31.153 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2024-05-14T15:42:31.153 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2024-05-14T15:42:31.153 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2024-05-14T15:42:31.153 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2024-05-14T15:42:31.153 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T15:42:31.153 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T15:42:31.153 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T15:42:31.153 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T15:42:31.153 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T15:42:31.154 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2024-05-14T15:42:31.154 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2024-05-14T15:42:31.154 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2024-05-14T15:42:31.154 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T15:42:31.154 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T15:42:31.154 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2024-05-14T15:42:31.154 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2024-05-14T15:42:31.154 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2024-05-14T15:42:31.154 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2024-05-14T15:42:31.154 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T15:42:31.154 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2024-05-14T15:42:31.155 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T15:42:31.155 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2024-05-14T15:42:31.155 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 517850, 2024-05-14T15:42:31.155 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 170, 2024-05-14T15:42:31.155 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2024-05-14T15:42:31.155 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2024-05-14T15:42:31.155 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2024-05-14T15:42:31.155 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2024-05-14T15:42:31.155 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2024-05-14T15:42:31.155 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2024-05-14T15:42:31.155 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2024-05-14T15:42:31.155 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2024-05-14T15:42:31.155 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 9704, 2024-05-14T15:42:31.155 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 186, 2024-05-14T15:42:31.155 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T15:42:31.156 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2024-05-14T15:42:31.156 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2024-05-14T15:42:31.156 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2024-05-14T15:42:31.156 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 1462510, 2024-05-14T15:42:31.156 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 13887, 2024-05-14T15:42:31.156 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2024-05-14T15:42:31.156 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2024-05-14T15:42:31.156 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2024-05-14T15:42:31.156 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2024-05-14T15:42:31.156 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.156 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2024-05-14T15:42:31.156 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2024-05-14T15:42:31.156 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2024-05-14T15:42:31.156 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 2958, 2024-05-14T15:42:31.156 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 17560613, 2024-05-14T15:42:31.156 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 31, 2024-05-14T15:42:31.157 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 2958, 2024-05-14T15:42:31.157 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2024-05-14T15:42:31.157 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2958, 2024-05-14T15:42:31.157 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 20.266435087, 2024-05-14T15:42:31.157 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.006851397 2024-05-14T15:42:31.157 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.157 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2024-05-14T15:42:31.157 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2024-05-14T15:42:31.157 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2958, 2024-05-14T15:42:31.157 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 3379 2024-05-14T15:42:31.157 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.157 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 2958, 2024-05-14T15:42:31.157 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 935, 2024-05-14T15:42:31.157 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 2023, 2024-05-14T15:42:31.157 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2024-05-14T15:42:31.158 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2024-05-14T15:42:31.158 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 0, 2024-05-14T15:42:31.158 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 10, 2024-05-14T15:42:31.158 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 3, 2024-05-14T15:42:31.158 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 1525, 2024-05-14T15:42:31.158 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 88, 2024-05-14T15:42:31.158 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2024-05-14T15:42:31.158 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2024-05-14T15:42:31.158 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2024-05-14T15:42:31.158 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 1, 2024-05-14T15:42:31.158 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 35, 2024-05-14T15:42:31.158 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2024-05-14T15:42:31.158 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2024-05-14T15:42:31.158 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2024-05-14T15:42:31.158 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 928, 2024-05-14T15:42:31.159 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 20, 2024-05-14T15:42:31.159 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2024-05-14T15:42:31.159 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2024-05-14T15:42:31.159 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2024-05-14T15:42:31.159 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2024-05-14T15:42:31.159 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2024-05-14T15:42:31.159 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2024-05-14T15:42:31.159 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T15:42:31.159 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2024-05-14T15:42:31.159 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2024-05-14T15:42:31.159 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 0, 2024-05-14T15:42:31.159 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2024-05-14T15:42:31.159 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2024-05-14T15:42:31.159 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2024-05-14T15:42:31.159 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2024-05-14T15:42:31.160 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2024-05-14T15:42:31.160 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2024-05-14T15:42:31.160 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2024-05-14T15:42:31.160 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2024-05-14T15:42:31.160 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2024-05-14T15:42:31.160 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2024-05-14T15:42:31.160 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2024-05-14T15:42:31.160 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2024-05-14T15:42:31.160 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2024-05-14T15:42:31.160 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2024-05-14T15:42:31.160 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2024-05-14T15:42:31.160 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2024-05-14T15:42:31.160 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 124, 2024-05-14T15:42:31.160 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2024-05-14T15:42:31.161 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 35, 2024-05-14T15:42:31.161 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 12, 2024-05-14T15:42:31.161 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 12, 2024-05-14T15:42:31.161 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 0, 2024-05-14T15:42:31.161 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2024-05-14T15:42:31.161 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 609, 2024-05-14T15:42:31.161 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 8, 2024-05-14T15:42:31.161 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 152 2024-05-14T15:42:31.161 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.161 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2024-05-14T15:42:31.161 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 1, 2024-05-14T15:42:31.161 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2024-05-14T15:42:31.161 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2024-05-14T15:42:31.162 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2024-05-14T15:42:31.162 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.162 INFO:teuthology.orchestra.run.smithi092.stdout: "osd-slow-ops": { 2024-05-14T15:42:31.162 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 0 2024-05-14T15:42:31.162 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.162 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2024-05-14T15:42:31.162 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2024-05-14T15:42:31.162 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 10, 2024-05-14T15:42:31.162 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2024-05-14T15:42:31.162 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 2, 2024-05-14T15:42:31.162 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed_ops": 19, 2024-05-14T15:42:31.162 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 5, 2024-05-14T15:42:31.162 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2024-05-14T15:42:31.162 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.163 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T15:42:31.163 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:31.163 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-05-14T15:42:31.163 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:31.163 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 29505, 2024-05-14T15:42:31.163 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 11160693, 2024-05-14T15:42:31.163 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:31.163 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 29505, 2024-05-14T15:42:31.163 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-05-14T15:42:31.163 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-05-14T15:42:31.163 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 29505, 2024-05-14T15:42:31.163 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 11160693, 2024-05-14T15:42:31.163 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:31.163 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.163 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.164 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.164 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:31.164 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.164 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2024-05-14T15:42:31.164 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:31.164 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-05-14T15:42:31.164 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:31.164 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-05-14T15:42:31.164 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-05-14T15:42:31.164 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:31.164 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:31.164 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 2958, 2024-05-14T15:42:31.164 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 17561246, 2024-05-14T15:42:31.164 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 2958, 2024-05-14T15:42:31.164 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 17561246, 2024-05-14T15:42:31.164 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:31.165 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.165 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.165 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.165 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:31.165 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.165 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2024-05-14T15:42:31.165 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:31.165 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2024-05-14T15:42:31.165 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:31.165 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-05-14T15:42:31.165 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-05-14T15:42:31.165 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:31.165 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:31.165 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 2958, 2024-05-14T15:42:31.165 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 2958, 2024-05-14T15:42:31.165 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 2958, 2024-05-14T15:42:31.166 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 2958, 2024-05-14T15:42:31.166 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:31.166 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.166 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.166 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.166 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:31.166 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.166 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2024-05-14T15:42:31.166 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:31.166 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-05-14T15:42:31.166 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:31.166 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 5, 2024-05-14T15:42:31.166 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 697, 2024-05-14T15:42:31.166 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:31.166 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 5, 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 3, 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 697, 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x558f4e2e2410": { 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 10229, 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 17390171, 2024-05-14T15:42:31.167 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:31.168 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 10229, 2024-05-14T15:42:31.168 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-05-14T15:42:31.168 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-05-14T15:42:31.168 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 1522, 2024-05-14T15:42:31.168 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 17390171, 2024-05-14T15:42:31.168 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:31.168 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:31.168 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:31.168 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:31.168 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:31.168 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:31.168 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-05-14T15:42:31.944 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:31 smithi092 ceph-mon[34729]: pgmap v661: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-05-14T15:42:31.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:31 smithi069 ceph-mon[31270]: pgmap v661: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-05-14T15:42:32.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:31 smithi203 ceph-mon[34567]: pgmap v661: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 8.3 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-05-14T15:42:32.204 INFO:tasks.check_counter:Daemon mds.h mds.exported=20 2024-05-14T15:42:32.204 INFO:tasks.check_counter:Daemon mds.h mds.imported=24 2024-05-14T15:42:32.204 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=382 2024-05-14T15:42:32.204 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=322 2024-05-14T15:42:32.204 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-05-14T15:42:32.204 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-05-14T15:42:32.204 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-05-14T15:42:32.204 DEBUG:tasks.check_counter:Getting stats from k 2024-05-14T15:42:32.205 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph daemon mds.k perf dump 2024-05-14T15:42:32.690 INFO:teuthology.orchestra.run.smithi092.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.b/config 2024-05-14T15:42:33.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:33 smithi092 ceph-mon[34729]: pgmap v662: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-14T15:42:33.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:33 smithi069 ceph-mon[31270]: pgmap v662: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-14T15:42:34.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:33 smithi203 ceph-mon[34567]: pgmap v662: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 426 B/s wr, 9 op/s 2024-05-14T15:42:35.227 INFO:teuthology.orchestra.run.smithi092.stdout:{ 2024-05-14T15:42:35.227 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T15:42:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 13013, 2024-05-14T15:42:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 10018, 2024-05-14T15:42:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 7470918, 2024-05-14T15:42:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 4327442, 2024-05-14T15:42:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 19, 2024-05-14T15:42:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 7, 2024-05-14T15:42:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 3.271163334, 2024-05-14T15:42:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 1.693841488, 2024-05-14T15:42:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 2.012352638, 2024-05-14T15:42:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.051110492, 2024-05-14T15:42:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 10019, 2024-05-14T15:42:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1.425030775, 2024-05-14T15:42:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000142232 2024-05-14T15:42:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.228 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 20143, 2024-05-14T15:42:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.011271235, 2024-05-14T15:42:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000559 2024-05-14T15:42:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 2126624, 2024-05-14T15:42:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 292304 2024-05-14T15:42:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T15:42:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 8590, 2024-05-14T15:42:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 8995, 2024-05-14T15:42:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 2719783, 2024-05-14T15:42:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 11107905, 2024-05-14T15:42:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 19, 2024-05-14T15:42:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 6, 2024-05-14T15:42:35.229 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 1.579032938, 2024-05-14T15:42:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.655192936, 2024-05-14T15:42:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.898185412, 2024-05-14T15:42:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.128948971, 2024-05-14T15:42:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 8990, 2024-05-14T15:42:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1.008031035, 2024-05-14T15:42:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000112128 2024-05-14T15:42:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 11448, 2024-05-14T15:42:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.006229017, 2024-05-14T15:42:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000544 2024-05-14T15:42:35.230 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 3936, 2024-05-14T15:42:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 698512 2024-05-14T15:42:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T15:42:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_messages": 1662, 2024-05-14T15:42:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages": 1680, 2024-05-14T15:42:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_bytes": 969047, 2024-05-14T15:42:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_bytes": 998273, 2024-05-14T15:42:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_created_connections": 12, 2024-05-14T15:42:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_active_connections": 7, 2024-05-14T15:42:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_total_time": 0.403701961, 2024-05-14T15:42:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_send_time": 0.194310147, 2024-05-14T15:42:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_recv_time": 0.197181690, 2024-05-14T15:42:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_running_fast_dispatch_time": 0.035868514, 2024-05-14T15:42:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:35.231 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1679, 2024-05-14T15:42:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.299999668, 2024-05-14T15:42:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000178677 2024-05-14T15:42:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1834, 2024-05-14T15:42:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.001762287, 2024-05-14T15:42:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000960 2024-05-14T15:42:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-05-14T15:42:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "msgr_send_encrypted_bytes": 448 2024-05-14T15:42:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "cct": { 2024-05-14T15:42:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "total_workers": 1, 2024-05-14T15:42:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: "unhealthy_workers": 0 2024-05-14T15:42:35.232 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-MDSRank": { 2024-05-14T15:42:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-05-14T15:42:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-05-14T15:42:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3489, 2024-05-14T15:42:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 2.060493705, 2024-05-14T15:42:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000590568 2024-05-14T15:42:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "finisher-PurgeQueue": { 2024-05-14T15:42:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "queue_len": 0, 2024-05-14T15:42:35.233 INFO:teuthology.orchestra.run.smithi092.stdout: "complete_latency": { 2024-05-14T15:42:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 932, 2024-05-14T15:42:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.091055221, 2024-05-14T15:42:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000097698 2024-05-14T15:42:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "mds": { 2024-05-14T15:42:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "request": 2810, 2024-05-14T15:42:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "reply": 2372, 2024-05-14T15:42:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "reply_latency": { 2024-05-14T15:42:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2372, 2024-05-14T15:42:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 25.195354829, 2024-05-14T15:42:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.010621987 2024-05-14T15:42:35.234 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_reply": 0, 2024-05-14T15:42:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "forward": 438, 2024-05-14T15:42:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_complete": 1, 2024-05-14T15:42:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_fetch_keys": 0, 2024-05-14T15:42:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_commit": 11, 2024-05-14T15:42:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_split": 0, 2024-05-14T15:42:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_merge": 0, 2024-05-14T15:42:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes": 437, 2024-05-14T15:42:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_top": 16, 2024-05-14T15:42:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_bottom": 404, 2024-05-14T15:42:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pin_tail": 17, 2024-05-14T15:42:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_pinned": 415, 2024-05-14T15:42:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_expired": 229, 2024-05-14T15:42:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "inodes_with_caps": 326, 2024-05-14T15:42:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "caps": 326, 2024-05-14T15:42:35.235 INFO:teuthology.orchestra.run.smithi092.stdout: "subtrees": 41, 2024-05-14T15:42:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse": 7300, 2024-05-14T15:42:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_hit": 5101, 2024-05-14T15:42:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_forward": 426, 2024-05-14T15:42:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_discover": 49, 2024-05-14T15:42:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_dir_fetch": 0, 2024-05-14T15:42:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_remote_ino": 0, 2024-05-14T15:42:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "traverse_lock": 4, 2024-05-14T15:42:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "load_cent": 448, 2024-05-14T15:42:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "q": 0, 2024-05-14T15:42:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "exported": 7, 2024-05-14T15:42:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "exported_inodes": 206, 2024-05-14T15:42:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "imported": 19, 2024-05-14T15:42:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "imported_inodes": 450, 2024-05-14T15:42:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_dir_fetch": 0, 2024-05-14T15:42:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_backtrace_fetch": 1153, 2024-05-14T15:42:35.236 INFO:teuthology.orchestra.run.smithi092.stdout: "openino_peer_discover": 0, 2024-05-14T15:42:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rfiles": 1015, 2024-05-14T15:42:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rbytes": 1478530389, 2024-05-14T15:42:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "root_rsnaps": 6, 2024-05-14T15:42:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_fetch": 1153, 2024-05-14T15:42:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_set_tag": 0, 2024-05-14T15:42:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T15:42:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_inotable_repaired": 0, 2024-05-14T15:42:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_inodes": 0, 2024-05-14T15:42:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T15:42:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T15:42:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "scrub_file_inodes": 1153, 2024-05-14T15:42:35.237 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_inode_file_caps": 22, 2024-05-14T15:42:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_revoke": 597, 2024-05-14T15:42:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_grant": 867, 2024-05-14T15:42:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T15:42:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T15:42:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T15:42:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps": 3301, 2024-05-14T15:42:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_caps_dirty": 882, 2024-05-14T15:42:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_cap_release": 71, 2024-05-14T15:42:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "process_request_cap_release": 1118 2024-05-14T15:42:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_cache": { 2024-05-14T15:42:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update": 135, 2024-05-14T15:42:35.238 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_update_receipt": 510, 2024-05-14T15:42:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_try_discover": 299, 2024-05-14T15:42:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_send_discover": 480, 2024-05-14T15:42:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "dir_handle_discover": 226, 2024-05-14T15:42:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays": 0, 2024-05-14T15:42:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_delayed": 0, 2024-05-14T15:42:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "num_strays_enqueuing": 0, 2024-05-14T15:42:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_created": 233, 2024-05-14T15:42:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_enqueued": 214, 2024-05-14T15:42:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_reintegrated": 10, 2024-05-14T15:42:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "strays_migrated": 13, 2024-05-14T15:42:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_processing": 0, 2024-05-14T15:42:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_enqueued": 0, 2024-05-14T15:42:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "num_recovering_prioritized": 0, 2024-05-14T15:42:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_started": 0, 2024-05-14T15:42:35.239 INFO:teuthology.orchestra.run.smithi092.stdout: "recovery_completed": 0, 2024-05-14T15:42:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_path": 0, 2024-05-14T15:42:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_quiesce_inode": 0, 2024-05-14T15:42:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T15:42:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_exportdir": 7, 2024-05-14T15:42:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_flush": 0, 2024-05-14T15:42:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragmentdir": 0, 2024-05-14T15:42:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_fragstats": 0, 2024-05-14T15:42:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "ireq_inodestats": 0 2024-05-14T15:42:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.240 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_log": { 2024-05-14T15:42:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "evlrg": 0, 2024-05-14T15:42:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "evadd": 3561, 2024-05-14T15:42:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "evex": 0, 2024-05-14T15:42:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "evtrm": 0, 2024-05-14T15:42:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "ev": 3561, 2024-05-14T15:42:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "evexg": 0, 2024-05-14T15:42:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "evexd": 0, 2024-05-14T15:42:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "segadd": 5, 2024-05-14T15:42:35.241 INFO:teuthology.orchestra.run.smithi092.stdout: "segex": 0, 2024-05-14T15:42:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "segtrm": 0, 2024-05-14T15:42:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "seg": 5, 2024-05-14T15:42:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "segmjr": 2, 2024-05-14T15:42:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "segexg": 0, 2024-05-14T15:42:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "segexd": 0, 2024-05-14T15:42:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "expos": 4194304, 2024-05-14T15:42:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "wrpos": 10590216, 2024-05-14T15:42:35.242 INFO:teuthology.orchestra.run.smithi092.stdout: "rdpos": 0, 2024-05-14T15:42:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "jlat": { 2024-05-14T15:42:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1240, 2024-05-14T15:42:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 8.837068169, 2024-05-14T15:42:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.007126667 2024-05-14T15:42:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "replayed": 0 2024-05-14T15:42:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_mem": { 2024-05-14T15:42:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "ino": 377, 2024-05-14T15:42:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "ino+": 798, 2024-05-14T15:42:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "ino-": 421, 2024-05-14T15:42:35.243 INFO:teuthology.orchestra.run.smithi092.stdout: "dir": 93, 2024-05-14T15:42:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "dir+": 262, 2024-05-14T15:42:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "dir-": 169, 2024-05-14T15:42:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "dn": 437, 2024-05-14T15:42:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "dn+": 891, 2024-05-14T15:42:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "dn-": 454, 2024-05-14T15:42:35.244 INFO:teuthology.orchestra.run.smithi092.stdout: "cap": 326, 2024-05-14T15:42:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "cap+": 646, 2024-05-14T15:42:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "cap-": 320, 2024-05-14T15:42:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "rss": 128544, 2024-05-14T15:42:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "heap": 223632 2024-05-14T15:42:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.245 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_server": { 2024-05-14T15:42:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_client_request": 4655, 2024-05-14T15:42:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "dispatch_server_request": 353, 2024-05-14T15:42:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_request": 2810, 2024-05-14T15:42:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_client_session": 53, 2024-05-14T15:42:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "handle_peer_request": 820, 2024-05-14T15:42:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "req_create_latency": { 2024-05-14T15:42:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 214, 2024-05-14T15:42:35.246 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1.261004518, 2024-05-14T15:42:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.005892544 2024-05-14T15:42:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getattr_latency": { 2024-05-14T15:42:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 45, 2024-05-14T15:42:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 1.946225209, 2024-05-14T15:42:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.043249449 2024-05-14T15:42:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getfilelock_latency": { 2024-05-14T15:42:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.247 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "req_link_latency": { 2024-05-14T15:42:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 10, 2024-05-14T15:42:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.205893697, 2024-05-14T15:42:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.020589369 2024-05-14T15:42:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookup_latency": { 2024-05-14T15:42:35.248 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 1571, 2024-05-14T15:42:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 15.523606763, 2024-05-14T15:42:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.009881353 2024-05-14T15:42:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookuphash_latency": { 2024-05-14T15:42:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupino_latency": { 2024-05-14T15:42:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.249 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupname_latency": { 2024-05-14T15:42:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupparent_latency": { 2024-05-14T15:42:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lookupsnap_latency": { 2024-05-14T15:42:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.250 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "req_lssnap_latency": { 2024-05-14T15:42:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.251 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mkdir_latency": { 2024-05-14T15:42:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mknod_latency": { 2024-05-14T15:42:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.252 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "req_mksnap_latency": { 2024-05-14T15:42:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "req_open_latency": { 2024-05-14T15:42:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 256, 2024-05-14T15:42:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.459868014, 2024-05-14T15:42:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001796359 2024-05-14T15:42:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "req_readdir_latency": { 2024-05-14T15:42:35.253 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 25, 2024-05-14T15:42:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.044553315, 2024-05-14T15:42:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.001782132 2024-05-14T15:42:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rename_latency": { 2024-05-14T15:42:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 226, 2024-05-14T15:42:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 5.444278232, 2024-05-14T15:42:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.024089726 2024-05-14T15:42:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "req_renamesnap_latency": { 2024-05-14T15:42:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.254 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "req_snapdiff_latency": { 2024-05-14T15:42:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmdir_latency": { 2024-05-14T15:42:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmsnap_latency": { 2024-05-14T15:42:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.255 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "req_rmxattr_latency": { 2024-05-14T15:42:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setattr_latency": { 2024-05-14T15:42:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 2, 2024-05-14T15:42:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.026635755, 2024-05-14T15:42:35.256 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.013317877 2024-05-14T15:42:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setdirlayout_latency": { 2024-05-14T15:42:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setfilelock_latency": { 2024-05-14T15:42:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.257 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setlayout_latency": { 2024-05-14T15:42:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "req_setxattr_latency": { 2024-05-14T15:42:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "req_symlink_latency": { 2024-05-14T15:42:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.258 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "req_unlink_latency": { 2024-05-14T15:42:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 23, 2024-05-14T15:42:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.283289326, 2024-05-14T15:42:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.012316927 2024-05-14T15:42:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_revoke_eviction": 0, 2024-05-14T15:42:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "cap_acquisition_throttle": 0, 2024-05-14T15:42:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "req_getvxattr_latency": { 2024-05-14T15:42:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_sessions": { 2024-05-14T15:42:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "session_count": 2, 2024-05-14T15:42:35.259 INFO:teuthology.orchestra.run.smithi092.stdout: "session_add": 3, 2024-05-14T15:42:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "session_remove": 1, 2024-05-14T15:42:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_open": 2, 2024-05-14T15:42:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "sessions_stale": 0, 2024-05-14T15:42:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "total_load": 303, 2024-05-14T15:42:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "average_load": 151, 2024-05-14T15:42:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "avg_session_uptime": 1243, 2024-05-14T15:42:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "mdthresh_evicted": 0 2024-05-14T15:42:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "mempool": { 2024-05-14T15:42:35.260 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_bytes": 0, 2024-05-14T15:42:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "bloom_filter_items": 0, 2024-05-14T15:42:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T15:42:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_alloc_items": 0, 2024-05-14T15:42:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T15:42:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_data_items": 0, 2024-05-14T15:42:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T15:42:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T15:42:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T15:42:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T15:42:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T15:42:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_other_items": 0, 2024-05-14T15:42:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T15:42:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T15:42:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_bytes": 0, 2024-05-14T15:42:35.261 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_extent_items": 0, 2024-05-14T15:42:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_bytes": 0, 2024-05-14T15:42:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_blob_items": 0, 2024-05-14T15:42:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T15:42:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T15:42:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T15:42:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T15:42:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T15:42:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_fsck_items": 0, 2024-05-14T15:42:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_bytes": 0, 2024-05-14T15:42:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_txc_items": 0, 2024-05-14T15:42:35.262 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T15:42:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T15:42:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_bytes": 0, 2024-05-14T15:42:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "bluestore_writing_items": 0, 2024-05-14T15:42:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_bytes": 0, 2024-05-14T15:42:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_items": 0, 2024-05-14T15:42:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T15:42:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_reader_items": 0, 2024-05-14T15:42:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T15:42:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "bluefs_file_writer_items": 0, 2024-05-14T15:42:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_bytes": 528181, 2024-05-14T15:42:35.263 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_anon_items": 183, 2024-05-14T15:42:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_bytes": 0, 2024-05-14T15:42:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "buffer_meta_items": 0, 2024-05-14T15:42:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_bytes": 0, 2024-05-14T15:42:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_items": 0, 2024-05-14T15:42:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_bytes": 0, 2024-05-14T15:42:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_mapbl_items": 0, 2024-05-14T15:42:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_bytes": 0, 2024-05-14T15:42:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_pglog_items": 0, 2024-05-14T15:42:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_bytes": 9704, 2024-05-14T15:42:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_items": 186, 2024-05-14T15:42:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T15:42:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "osdmap_mapping_items": 0, 2024-05-14T15:42:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_bytes": 0, 2024-05-14T15:42:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "pgmap_items": 0, 2024-05-14T15:42:35.264 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_bytes": 1504450, 2024-05-14T15:42:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "mds_co_items": 17610, 2024-05-14T15:42:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_bytes": 0, 2024-05-14T15:42:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_1_items": 0, 2024-05-14T15:42:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_bytes": 0, 2024-05-14T15:42:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "unittest_2_items": 0 2024-05-14T15:42:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "objecter": { 2024-05-14T15:42:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "op_active": 0, 2024-05-14T15:42:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "op_laggy": 0, 2024-05-14T15:42:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send": 3439, 2024-05-14T15:42:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "op_send_bytes": 6478442, 2024-05-14T15:42:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "op_resend": 33, 2024-05-14T15:42:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "op_reply": 3439, 2024-05-14T15:42:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "op_latency": { 2024-05-14T15:42:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3439, 2024-05-14T15:42:35.265 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 24.942304829, 2024-05-14T15:42:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.007252778 2024-05-14T15:42:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "op_inflight": 0, 2024-05-14T15:42:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "oplen_avg": { 2024-05-14T15:42:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 3439, 2024-05-14T15:42:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 3649 2024-05-14T15:42:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "op": 3439, 2024-05-14T15:42:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "op_r": 1280, 2024-05-14T15:42:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "op_w": 2159, 2024-05-14T15:42:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "op_rmw": 0, 2024-05-14T15:42:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "op_pg": 0, 2024-05-14T15:42:35.266 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_stat": 0, 2024-05-14T15:42:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_create": 10, 2024-05-14T15:42:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_read": 126, 2024-05-14T15:42:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_write": 1366, 2024-05-14T15:42:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writefull": 163, 2024-05-14T15:42:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_writesame": 0, 2024-05-14T15:42:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_append": 0, 2024-05-14T15:42:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_zero": 0, 2024-05-14T15:42:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_truncate": 0, 2024-05-14T15:42:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_delete": 441, 2024-05-14T15:42:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_mapext": 0, 2024-05-14T15:42:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_sparse_read": 0, 2024-05-14T15:42:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_clonerange": 0, 2024-05-14T15:42:35.267 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_getxattr": 1153, 2024-05-14T15:42:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_setxattr": 20, 2024-05-14T15:42:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_cmpxattr": 0, 2024-05-14T15:42:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_rmxattr": 0, 2024-05-14T15:42:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_resetxattrs": 0, 2024-05-14T15:42:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_call": 0, 2024-05-14T15:42:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_watch": 0, 2024-05-14T15:42:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_notify": 0, 2024-05-14T15:42:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T15:42:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls": 0, 2024-05-14T15:42:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_pgls_filter": 0, 2024-05-14T15:42:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "osdop_other": 0, 2024-05-14T15:42:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_active": 0, 2024-05-14T15:42:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_send": 0, 2024-05-14T15:42:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_resend": 0, 2024-05-14T15:42:35.268 INFO:teuthology.orchestra.run.smithi092.stdout: "linger_ping": 0, 2024-05-14T15:42:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_active": 0, 2024-05-14T15:42:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_send": 0, 2024-05-14T15:42:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "poolop_resend": 0, 2024-05-14T15:42:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_active": 0, 2024-05-14T15:42:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_send": 0, 2024-05-14T15:42:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "poolstat_resend": 0, 2024-05-14T15:42:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_active": 0, 2024-05-14T15:42:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_send": 0, 2024-05-14T15:42:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "statfs_resend": 0, 2024-05-14T15:42:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "command_active": 0, 2024-05-14T15:42:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "command_send": 0, 2024-05-14T15:42:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "command_resend": 0, 2024-05-14T15:42:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "map_epoch": 124, 2024-05-14T15:42:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "map_full": 0, 2024-05-14T15:42:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "map_inc": 35, 2024-05-14T15:42:35.269 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_sessions": 12, 2024-05-14T15:42:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_open": 12, 2024-05-14T15:42:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_session_close": 0, 2024-05-14T15:42:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "osd_laggy": 0, 2024-05-14T15:42:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_wr": 278, 2024-05-14T15:42:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_rd": 2, 2024-05-14T15:42:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_del": 90 2024-05-14T15:42:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "oft": { 2024-05-14T15:42:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_objs": 1, 2024-05-14T15:42:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_kv_pairs": 0, 2024-05-14T15:42:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_updates": 0, 2024-05-14T15:42:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "omap_total_removes": 0 2024-05-14T15:42:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.270 INFO:teuthology.orchestra.run.smithi092.stdout: "osd-slow-ops": { 2024-05-14T15:42:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "slow_ops_count": 0 2024-05-14T15:42:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "purge_queue": { 2024-05-14T15:42:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops": 0, 2024-05-14T15:42:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_ops_high_water": 10, 2024-05-14T15:42:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing": 0, 2024-05-14T15:42:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executing_high_water": 5, 2024-05-14T15:42:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed_ops": 428, 2024-05-14T15:42:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_executed": 214, 2024-05-14T15:42:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "pq_item_in_journal": 0 2024-05-14T15:42:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T15:42:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-05-14T15:42:35.271 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 23261, 2024-05-14T15:42:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 9032456, 2024-05-14T15:42:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 23261, 2024-05-14T15:42:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-05-14T15:42:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-05-14T15:42:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 23261, 2024-05-14T15:42:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 9032456, 2024-05-14T15:42:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.272 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_bytes": { 2024-05-14T15:42:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 104857600, 2024-05-14T15:42:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-05-14T15:42:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-05-14T15:42:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 3439, 2024-05-14T15:42:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 6502264, 2024-05-14T15:42:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 3439, 2024-05-14T15:42:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 6502264, 2024-05-14T15:42:35.273 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-objecter_ops": { 2024-05-14T15:42:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 1024, 2024-05-14T15:42:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:35.274 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 0, 2024-05-14T15:42:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 0, 2024-05-14T15:42:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 3439, 2024-05-14T15:42:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 3439, 2024-05-14T15:42:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 3439, 2024-05-14T15:42:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 3439, 2024-05-14T15:42:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.275 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle": { 2024-05-14T15:42:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-05-14T15:42:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 214, 2024-05-14T15:42:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 23838, 2024-05-14T15:42:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 214, 2024-05-14T15:42:35.276 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-05-14T15:42:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-05-14T15:42:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 126, 2024-05-14T15:42:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 23838, 2024-05-14T15:42:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: }, 2024-05-14T15:42:35.277 INFO:teuthology.orchestra.run.smithi092.stdout: "throttle-write_buf_throttle-0x559f449ac5b0": { 2024-05-14T15:42:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "val": 0, 2024-05-14T15:42:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "max": 3758096384, 2024-05-14T15:42:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "get_started": 0, 2024-05-14T15:42:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "get": 3561, 2024-05-14T15:42:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "get_sum": 6395912, 2024-05-14T15:42:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "get_or_fail_success": 3561, 2024-05-14T15:42:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "take": 0, 2024-05-14T15:42:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "take_sum": 0, 2024-05-14T15:42:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "put": 1240, 2024-05-14T15:42:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "put_sum": 6395912, 2024-05-14T15:42:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "wait": { 2024-05-14T15:42:35.278 INFO:teuthology.orchestra.run.smithi092.stdout: "avgcount": 0, 2024-05-14T15:42:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: "sum": 0.000000000, 2024-05-14T15:42:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: "avgtime": 0.000000000 2024-05-14T15:42:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:35.279 INFO:teuthology.orchestra.run.smithi092.stdout: } 2024-05-14T15:42:35.279 INFO:teuthology.orchestra.run.smithi092.stdout:} 2024-05-14T15:42:35.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:35 smithi092 ceph-mon[34729]: pgmap v663: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T15:42:35.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:35 smithi069 ceph-mon[31270]: pgmap v663: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T15:42:36.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:35 smithi203 ceph-mon[34567]: pgmap v663: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.8 KiB/s rd, 426 B/s wr, 10 op/s 2024-05-14T15:42:36.198 INFO:tasks.check_counter:Daemon mds.k mds.exported=7 2024-05-14T15:42:36.198 INFO:tasks.check_counter:Daemon mds.k mds.imported=19 2024-05-14T15:42:36.198 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update=135 2024-05-14T15:42:36.198 INFO:tasks.check_counter:Daemon mds.k mds_cache.dir_update_receipt=510 2024-05-14T15:42:36.199 INFO:tasks.check_counter:Daemon mds.k mds.root_rsnaps=6 2024-05-14T15:42:36.199 INFO:tasks.check_counter:Daemon mds.k mds_server.req_mksnap_latency.avgcount=0 2024-05-14T15:42:36.199 INFO:tasks.check_counter:Daemon mds.k mds_server.req_rmsnap_latency.avgcount=0 2024-05-14T15:42:36.199 DEBUG:tasks.check_counter:Getting stats from c 2024-05-14T15:42:36.199 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph daemon mds.c perf dump 2024-05-14T15:42:36.818 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:42:37.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:37 smithi203 ceph-mon[34567]: pgmap v664: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-05-14T15:42:37.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:37 smithi092 ceph-mon[34729]: pgmap v664: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-05-14T15:42:37.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:37 smithi069 ceph-mon[31270]: pgmap v664: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-05-14T15:42:39.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:39 smithi203 ceph-mon[34567]: pgmap v665: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-14T15:42:39.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:39 smithi092 ceph-mon[34729]: pgmap v665: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-14T15:42:39.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:39 smithi069 ceph-mon[31270]: pgmap v665: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-14T15:42:40.331 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-05-14T15:42:40.331 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T15:42:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 3380, 2024-05-14T15:42:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 3306, 2024-05-14T15:42:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 19724780, 2024-05-14T15:42:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 1175524, 2024-05-14T15:42:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 6, 2024-05-14T15:42:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 2, 2024-05-14T15:42:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.753412624, 2024-05-14T15:42:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.240160167, 2024-05-14T15:42:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.321315612, 2024-05-14T15:42:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.174432683, 2024-05-14T15:42:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 3305, 2024-05-14T15:42:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.343290538, 2024-05-14T15:42:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000103870 2024-05-14T15:42:40.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 2104928, 2024-05-14T15:42:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 274944 2024-05-14T15:42:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T15:42:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 1309, 2024-05-14T15:42:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 1635, 2024-05-14T15:42:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 13664339, 2024-05-14T15:42:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 1066484, 2024-05-14T15:42:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 8, 2024-05-14T15:42:40.333 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 6, 2024-05-14T15:42:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.330923226, 2024-05-14T15:42:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.109199759, 2024-05-14T15:42:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.118601808, 2024-05-14T15:42:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.072650132, 2024-05-14T15:42:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 1633, 2024-05-14T15:42:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.191455371, 2024-05-14T15:42:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000117241 2024-05-14T15:42:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.334 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-05-14T15:42:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 652064 2024-05-14T15:42:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T15:42:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 974, 2024-05-14T15:42:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 976, 2024-05-14T15:42:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 12827086, 2024-05-14T15:42:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 309739, 2024-05-14T15:42:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 5, 2024-05-14T15:42:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 4, 2024-05-14T15:42:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.238834840, 2024-05-14T15:42:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.076887916, 2024-05-14T15:42:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.083814055, 2024-05-14T15:42:40.335 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.058736386, 2024-05-14T15:42:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 974, 2024-05-14T15:42:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.104099852, 2024-05-14T15:42:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000106878 2024-05-14T15:42:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-14T15:42:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 0 2024-05-14T15:42:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.336 INFO:teuthology.orchestra.run.smithi203.stdout: "cct": { 2024-05-14T15:42:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "total_workers": 1, 2024-05-14T15:42:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "unhealthy_workers": 0 2024-05-14T15:42:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-MDSRank": { 2024-05-14T15:42:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-05-14T15:42:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-05-14T15:42:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 8540, 2024-05-14T15:42:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.480148946, 2024-05-14T15:42:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000056223 2024-05-14T15:42:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.337 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-PurgeQueue": { 2024-05-14T15:42:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-05-14T15:42:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-05-14T15:42:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "mds": { 2024-05-14T15:42:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "request": 0, 2024-05-14T15:42:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "reply": 0, 2024-05-14T15:42:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "reply_latency": { 2024-05-14T15:42:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.338 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_reply": 0, 2024-05-14T15:42:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "forward": 0, 2024-05-14T15:42:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_complete": 0, 2024-05-14T15:42:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_keys": 0, 2024-05-14T15:42:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_commit": 0, 2024-05-14T15:42:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_split": 0, 2024-05-14T15:42:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_merge": 0, 2024-05-14T15:42:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes": 169, 2024-05-14T15:42:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_top": 89, 2024-05-14T15:42:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_bottom": 80, 2024-05-14T15:42:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pin_tail": 0, 2024-05-14T15:42:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pinned": 41, 2024-05-14T15:42:40.339 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_expired": 0, 2024-05-14T15:42:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_with_caps": 0, 2024-05-14T15:42:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "caps": 0, 2024-05-14T15:42:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "subtrees": 23, 2024-05-14T15:42:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse": 0, 2024-05-14T15:42:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_hit": 0, 2024-05-14T15:42:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_forward": 0, 2024-05-14T15:42:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_discover": 0, 2024-05-14T15:42:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_dir_fetch": 0, 2024-05-14T15:42:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_remote_ino": 0, 2024-05-14T15:42:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_lock": 0, 2024-05-14T15:42:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "load_cent": 0, 2024-05-14T15:42:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "q": 0, 2024-05-14T15:42:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "exported": 0, 2024-05-14T15:42:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "exported_inodes": 0, 2024-05-14T15:42:40.340 INFO:teuthology.orchestra.run.smithi203.stdout: "imported": 0, 2024-05-14T15:42:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "imported_inodes": 0, 2024-05-14T15:42:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_dir_fetch": 0, 2024-05-14T15:42:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_backtrace_fetch": 0, 2024-05-14T15:42:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_peer_discover": 0, 2024-05-14T15:42:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rfiles": 1015, 2024-05-14T15:42:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rbytes": 1478530389, 2024-05-14T15:42:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rsnaps": 6, 2024-05-14T15:42:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T15:42:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_set_tag": 0, 2024-05-14T15:42:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T15:42:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_inotable_repaired": 0, 2024-05-14T15:42:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_inodes": 0, 2024-05-14T15:42:40.341 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T15:42:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T15:42:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_file_inodes": 0, 2024-05-14T15:42:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_inode_file_caps": 0, 2024-05-14T15:42:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_revoke": 0, 2024-05-14T15:42:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_grant": 0, 2024-05-14T15:42:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T15:42:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T15:42:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T15:42:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps": 0, 2024-05-14T15:42:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps_dirty": 0, 2024-05-14T15:42:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_cap_release": 0, 2024-05-14T15:42:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "process_request_cap_release": 0 2024-05-14T15:42:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.342 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_cache": { 2024-05-14T15:42:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update": 0, 2024-05-14T15:42:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update_receipt": 0, 2024-05-14T15:42:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_try_discover": 0, 2024-05-14T15:42:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_send_discover": 0, 2024-05-14T15:42:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_handle_discover": 0, 2024-05-14T15:42:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays": 0, 2024-05-14T15:42:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_delayed": 0, 2024-05-14T15:42:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_enqueuing": 0, 2024-05-14T15:42:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_created": 0, 2024-05-14T15:42:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_enqueued": 0, 2024-05-14T15:42:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_reintegrated": 0, 2024-05-14T15:42:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_migrated": 0, 2024-05-14T15:42:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_processing": 0, 2024-05-14T15:42:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_enqueued": 0, 2024-05-14T15:42:40.343 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_prioritized": 0, 2024-05-14T15:42:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_started": 0, 2024-05-14T15:42:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_completed": 0, 2024-05-14T15:42:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_path": 0, 2024-05-14T15:42:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_inode": 0, 2024-05-14T15:42:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T15:42:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_exportdir": 0, 2024-05-14T15:42:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_flush": 0, 2024-05-14T15:42:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragmentdir": 0, 2024-05-14T15:42:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragstats": 0, 2024-05-14T15:42:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_inodestats": 0 2024-05-14T15:42:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_log": { 2024-05-14T15:42:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "evlrg": 0, 2024-05-14T15:42:40.344 INFO:teuthology.orchestra.run.smithi203.stdout: "evadd": 0, 2024-05-14T15:42:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "evex": 0, 2024-05-14T15:42:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "evtrm": 0, 2024-05-14T15:42:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "ev": 7157, 2024-05-14T15:42:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "evexg": 0, 2024-05-14T15:42:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "evexd": 0, 2024-05-14T15:42:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "segadd": 0, 2024-05-14T15:42:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "segex": 0, 2024-05-14T15:42:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "segtrm": 0, 2024-05-14T15:42:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "seg": 2, 2024-05-14T15:42:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "segmjr": 89, 2024-05-14T15:42:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "segexg": 0, 2024-05-14T15:42:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "segexd": 0, 2024-05-14T15:42:40.345 INFO:teuthology.orchestra.run.smithi203.stdout: "expos": 46305852, 2024-05-14T15:42:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "wrpos": 46885225, 2024-05-14T15:42:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "rdpos": 46880747, 2024-05-14T15:42:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "jlat": { 2024-05-14T15:42:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "replayed": 7157 2024-05-14T15:42:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_mem": { 2024-05-14T15:42:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "ino": 131, 2024-05-14T15:42:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "ino+": 1785, 2024-05-14T15:42:40.346 INFO:teuthology.orchestra.run.smithi203.stdout: "ino-": 1654, 2024-05-14T15:42:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "dir": 51, 2024-05-14T15:42:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "dir+": 141, 2024-05-14T15:42:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "dir-": 90, 2024-05-14T15:42:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "dn": 169, 2024-05-14T15:42:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "dn+": 1873, 2024-05-14T15:42:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "dn-": 1704, 2024-05-14T15:42:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "cap": 0, 2024-05-14T15:42:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "cap+": 0, 2024-05-14T15:42:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "cap-": 0, 2024-05-14T15:42:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "rss": 121940, 2024-05-14T15:42:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "heap": 215440 2024-05-14T15:42:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_server": { 2024-05-14T15:42:40.347 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_client_request": 0, 2024-05-14T15:42:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_server_request": 0, 2024-05-14T15:42:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_request": 0, 2024-05-14T15:42:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_session": 0, 2024-05-14T15:42:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_peer_request": 0, 2024-05-14T15:42:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "req_create_latency": { 2024-05-14T15:42:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getattr_latency": { 2024-05-14T15:42:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getfilelock_latency": { 2024-05-14T15:42:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: "req_link_latency": { 2024-05-14T15:42:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookup_latency": { 2024-05-14T15:42:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.349 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.350 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookuphash_latency": { 2024-05-14T15:42:40.350 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.350 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.350 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.350 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.350 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupino_latency": { 2024-05-14T15:42:40.350 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.350 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.350 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.350 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.350 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupname_latency": { 2024-05-14T15:42:40.350 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.350 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.351 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.351 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.351 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupparent_latency": { 2024-05-14T15:42:40.351 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.351 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.351 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.351 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.351 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupsnap_latency": { 2024-05-14T15:42:40.351 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.351 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.351 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.351 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.351 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lssnap_latency": { 2024-05-14T15:42:40.351 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.351 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.352 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.352 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.352 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mkdir_latency": { 2024-05-14T15:42:40.352 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.353 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.353 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.353 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.353 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mknod_latency": { 2024-05-14T15:42:40.353 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.353 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.353 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.353 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.353 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mksnap_latency": { 2024-05-14T15:42:40.353 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.353 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.353 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.353 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.353 INFO:teuthology.orchestra.run.smithi203.stdout: "req_open_latency": { 2024-05-14T15:42:40.354 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.354 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.354 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.354 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.354 INFO:teuthology.orchestra.run.smithi203.stdout: "req_readdir_latency": { 2024-05-14T15:42:40.354 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.354 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.354 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.354 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.354 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rename_latency": { 2024-05-14T15:42:40.354 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.354 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.354 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.355 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.355 INFO:teuthology.orchestra.run.smithi203.stdout: "req_renamesnap_latency": { 2024-05-14T15:42:40.355 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.355 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.355 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.355 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.355 INFO:teuthology.orchestra.run.smithi203.stdout: "req_snapdiff_latency": { 2024-05-14T15:42:40.355 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.355 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.355 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.355 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.355 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmdir_latency": { 2024-05-14T15:42:40.355 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.355 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.356 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.356 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.356 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmsnap_latency": { 2024-05-14T15:42:40.356 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.356 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.356 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.356 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.356 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmxattr_latency": { 2024-05-14T15:42:40.356 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.356 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.356 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.356 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.356 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setattr_latency": { 2024-05-14T15:42:40.356 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.356 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.356 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.357 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.357 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setdirlayout_latency": { 2024-05-14T15:42:40.357 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.357 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.357 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.357 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.357 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setfilelock_latency": { 2024-05-14T15:42:40.357 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.357 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.357 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.357 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.357 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setlayout_latency": { 2024-05-14T15:42:40.357 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.357 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.358 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.358 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.358 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setxattr_latency": { 2024-05-14T15:42:40.358 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.358 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.358 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.358 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.358 INFO:teuthology.orchestra.run.smithi203.stdout: "req_symlink_latency": { 2024-05-14T15:42:40.358 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.358 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.358 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.358 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.358 INFO:teuthology.orchestra.run.smithi203.stdout: "req_unlink_latency": { 2024-05-14T15:42:40.358 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.358 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.359 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.359 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.359 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_revoke_eviction": 0, 2024-05-14T15:42:40.359 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_acquisition_throttle": 0, 2024-05-14T15:42:40.359 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getvxattr_latency": { 2024-05-14T15:42:40.359 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.359 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.359 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.359 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:40.359 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.359 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_sessions": { 2024-05-14T15:42:40.359 INFO:teuthology.orchestra.run.smithi203.stdout: "session_count": 2, 2024-05-14T15:42:40.359 INFO:teuthology.orchestra.run.smithi203.stdout: "session_add": 6, 2024-05-14T15:42:40.359 INFO:teuthology.orchestra.run.smithi203.stdout: "session_remove": 4, 2024-05-14T15:42:40.359 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_open": 4, 2024-05-14T15:42:40.360 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_stale": 0, 2024-05-14T15:42:40.360 INFO:teuthology.orchestra.run.smithi203.stdout: "total_load": 0, 2024-05-14T15:42:40.360 INFO:teuthology.orchestra.run.smithi203.stdout: "average_load": 0, 2024-05-14T15:42:40.360 INFO:teuthology.orchestra.run.smithi203.stdout: "avg_session_uptime": 4582, 2024-05-14T15:42:40.360 INFO:teuthology.orchestra.run.smithi203.stdout: "mdthresh_evicted": 0 2024-05-14T15:42:40.360 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.360 INFO:teuthology.orchestra.run.smithi203.stdout: "mempool": { 2024-05-14T15:42:40.360 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_bytes": 0, 2024-05-14T15:42:40.360 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_items": 0, 2024-05-14T15:42:40.360 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T15:42:40.360 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_items": 0, 2024-05-14T15:42:40.360 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T15:42:40.360 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_items": 0, 2024-05-14T15:42:40.360 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T15:42:40.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T15:42:40.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T15:42:40.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T15:42:40.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T15:42:40.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_items": 0, 2024-05-14T15:42:40.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T15:42:40.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T15:42:40.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_bytes": 0, 2024-05-14T15:42:40.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_items": 0, 2024-05-14T15:42:40.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_bytes": 0, 2024-05-14T15:42:40.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_items": 0, 2024-05-14T15:42:40.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T15:42:40.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T15:42:40.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T15:42:40.361 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_items": 0, 2024-05-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_bytes": 0, 2024-05-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_items": 0, 2024-05-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_bytes": 0, 2024-05-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_items": 0, 2024-05-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_bytes": 0, 2024-05-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_items": 0, 2024-05-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_items": 0, 2024-05-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_items": 0, 2024-05-14T15:42:40.362 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_bytes": 216770, 2024-05-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_items": 71, 2024-05-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_bytes": 0, 2024-05-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_items": 0, 2024-05-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_bytes": 0, 2024-05-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_items": 0, 2024-05-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_bytes": 0, 2024-05-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_items": 0, 2024-05-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_bytes": 0, 2024-05-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_items": 0, 2024-05-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_bytes": 9704, 2024-05-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_items": 186, 2024-05-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_items": 0, 2024-05-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_bytes": 0, 2024-05-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_items": 0, 2024-05-14T15:42:40.363 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_bytes": 538533, 2024-05-14T15:42:40.364 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_items": 1609, 2024-05-14T15:42:40.364 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_bytes": 0, 2024-05-14T15:42:40.364 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_items": 0, 2024-05-14T15:42:40.364 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_bytes": 0, 2024-05-14T15:42:40.364 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_items": 0 2024-05-14T15:42:40.364 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.364 INFO:teuthology.orchestra.run.smithi203.stdout: "objecter": { 2024-05-14T15:42:40.364 INFO:teuthology.orchestra.run.smithi203.stdout: "op_active": 0, 2024-05-14T15:42:40.364 INFO:teuthology.orchestra.run.smithi203.stdout: "op_laggy": 0, 2024-05-14T15:42:40.364 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send": 5109, 2024-05-14T15:42:40.364 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send_bytes": 26, 2024-05-14T15:42:40.364 INFO:teuthology.orchestra.run.smithi203.stdout: "op_resend": 4, 2024-05-14T15:42:40.364 INFO:teuthology.orchestra.run.smithi203.stdout: "op_reply": 5109, 2024-05-14T15:42:40.364 INFO:teuthology.orchestra.run.smithi203.stdout: "op_latency": { 2024-05-14T15:42:40.365 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 5109, 2024-05-14T15:42:40.365 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 8.602794720, 2024-05-14T15:42:40.365 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.001683850 2024-05-14T15:42:40.365 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.365 INFO:teuthology.orchestra.run.smithi203.stdout: "op_inflight": 0, 2024-05-14T15:42:40.365 INFO:teuthology.orchestra.run.smithi203.stdout: "oplen_avg": { 2024-05-14T15:42:40.365 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 5109, 2024-05-14T15:42:40.365 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 5110 2024-05-14T15:42:40.365 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.365 INFO:teuthology.orchestra.run.smithi203.stdout: "op": 5109, 2024-05-14T15:42:40.365 INFO:teuthology.orchestra.run.smithi203.stdout: "op_r": 5109, 2024-05-14T15:42:40.365 INFO:teuthology.orchestra.run.smithi203.stdout: "op_w": 0, 2024-05-14T15:42:40.365 INFO:teuthology.orchestra.run.smithi203.stdout: "op_rmw": 0, 2024-05-14T15:42:40.365 INFO:teuthology.orchestra.run.smithi203.stdout: "op_pg": 0, 2024-05-14T15:42:40.366 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_stat": 2986, 2024-05-14T15:42:40.366 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_create": 0, 2024-05-14T15:42:40.366 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_read": 2120, 2024-05-14T15:42:40.366 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_write": 0, 2024-05-14T15:42:40.366 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writefull": 0, 2024-05-14T15:42:40.366 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writesame": 0, 2024-05-14T15:42:40.366 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_append": 0, 2024-05-14T15:42:40.366 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_zero": 0, 2024-05-14T15:42:40.366 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_truncate": 0, 2024-05-14T15:42:40.366 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_delete": 0, 2024-05-14T15:42:40.366 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_mapext": 0, 2024-05-14T15:42:40.366 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_sparse_read": 0, 2024-05-14T15:42:40.366 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_clonerange": 0, 2024-05-14T15:42:40.366 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_getxattr": 2, 2024-05-14T15:42:40.366 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_setxattr": 0, 2024-05-14T15:42:40.367 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_cmpxattr": 0, 2024-05-14T15:42:40.367 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_rmxattr": 0, 2024-05-14T15:42:40.367 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_resetxattrs": 0, 2024-05-14T15:42:40.367 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_call": 0, 2024-05-14T15:42:40.367 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_watch": 0, 2024-05-14T15:42:40.367 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_notify": 0, 2024-05-14T15:42:40.367 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T15:42:40.367 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls": 0, 2024-05-14T15:42:40.367 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls_filter": 0, 2024-05-14T15:42:40.367 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_other": 0, 2024-05-14T15:42:40.367 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_active": 0, 2024-05-14T15:42:40.367 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_send": 0, 2024-05-14T15:42:40.367 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_resend": 0, 2024-05-14T15:42:40.367 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_ping": 0, 2024-05-14T15:42:40.367 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_active": 0, 2024-05-14T15:42:40.367 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_send": 0, 2024-05-14T15:42:40.368 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_resend": 0, 2024-05-14T15:42:40.368 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_active": 0, 2024-05-14T15:42:40.368 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_send": 0, 2024-05-14T15:42:40.368 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_resend": 0, 2024-05-14T15:42:40.368 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_active": 0, 2024-05-14T15:42:40.368 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_send": 0, 2024-05-14T15:42:40.368 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_resend": 0, 2024-05-14T15:42:40.368 INFO:teuthology.orchestra.run.smithi203.stdout: "command_active": 0, 2024-05-14T15:42:40.368 INFO:teuthology.orchestra.run.smithi203.stdout: "command_send": 0, 2024-05-14T15:42:40.368 INFO:teuthology.orchestra.run.smithi203.stdout: "command_resend": 0, 2024-05-14T15:42:40.368 INFO:teuthology.orchestra.run.smithi203.stdout: "map_epoch": 124, 2024-05-14T15:42:40.368 INFO:teuthology.orchestra.run.smithi203.stdout: "map_full": 0, 2024-05-14T15:42:40.368 INFO:teuthology.orchestra.run.smithi203.stdout: "map_inc": 35, 2024-05-14T15:42:40.368 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_sessions": 8, 2024-05-14T15:42:40.368 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_open": 8, 2024-05-14T15:42:40.368 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_close": 0, 2024-05-14T15:42:40.369 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_laggy": 0, 2024-05-14T15:42:40.369 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_wr": 0, 2024-05-14T15:42:40.369 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_rd": 2, 2024-05-14T15:42:40.369 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_del": 0 2024-05-14T15:42:40.369 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.369 INFO:teuthology.orchestra.run.smithi203.stdout: "oft": { 2024-05-14T15:42:40.369 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_objs": 0, 2024-05-14T15:42:40.369 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_kv_pairs": 0, 2024-05-14T15:42:40.369 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_updates": 0, 2024-05-14T15:42:40.369 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_removes": 0 2024-05-14T15:42:40.369 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.369 INFO:teuthology.orchestra.run.smithi203.stdout: "osd-slow-ops": { 2024-05-14T15:42:40.369 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_ops_count": 0 2024-05-14T15:42:40.369 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.370 INFO:teuthology.orchestra.run.smithi203.stdout: "purge_queue": { 2024-05-14T15:42:40.370 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops": 0, 2024-05-14T15:42:40.370 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops_high_water": 0, 2024-05-14T15:42:40.370 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing": 0, 2024-05-14T15:42:40.370 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_high_water": 0, 2024-05-14T15:42:40.370 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed_ops": 0, 2024-05-14T15:42:40.370 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed": 0, 2024-05-14T15:42:40.370 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_item_in_journal": 0 2024-05-14T15:42:40.370 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.370 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T15:42:40.370 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:40.370 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-05-14T15:42:40.370 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:40.370 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 5659, 2024-05-14T15:42:40.370 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 45676091, 2024-05-14T15:42:40.371 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:40.371 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 5659, 2024-05-14T15:42:40.371 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-05-14T15:42:40.371 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-05-14T15:42:40.371 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 5659, 2024-05-14T15:42:40.371 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 45676091, 2024-05-14T15:42:40.371 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:40.371 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.371 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.371 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.371 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:40.371 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.371 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_bytes": { 2024-05-14T15:42:40.371 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:40.371 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-05-14T15:42:40.371 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 5109, 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 42690931, 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 5109, 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 42690931, 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_ops": { 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:40.372 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 1024, 2024-05-14T15:42:40.373 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:40.373 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-05-14T15:42:40.373 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-05-14T15:42:40.373 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:40.373 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:40.373 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 5109, 2024-05-14T15:42:40.373 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 5109, 2024-05-14T15:42:40.373 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 5109, 2024-05-14T15:42:40.373 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 5109, 2024-05-14T15:42:40.373 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:40.373 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.373 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.373 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.373 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:40.374 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.374 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle": { 2024-05-14T15:42:40.374 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:40.374 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-05-14T15:42:40.374 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:40.374 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-05-14T15:42:40.374 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-05-14T15:42:40.374 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:40.374 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:40.374 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-05-14T15:42:40.374 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-05-14T15:42:40.374 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 0, 2024-05-14T15:42:40.374 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 0, 2024-05-14T15:42:40.374 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:40.375 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.375 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.375 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.375 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:40.375 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:40.375 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle-0x5628c55ce8f0": { 2024-05-14T15:42:40.375 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:40.375 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-05-14T15:42:40.375 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:40.375 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-05-14T15:42:40.375 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-05-14T15:42:40.375 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:40.375 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:40.375 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-05-14T15:42:40.376 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-05-14T15:42:40.376 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 0, 2024-05-14T15:42:40.376 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 0, 2024-05-14T15:42:40.376 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:40.376 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:40.376 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:40.376 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:40.376 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:40.376 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:40.376 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-05-14T15:42:41.573 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-05-14T15:42:41.573 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-05-14T15:42:41.573 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-05-14T15:42:41.573 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-05-14T15:42:41.573 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=6 2024-05-14T15:42:41.573 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-05-14T15:42:41.574 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-05-14T15:42:41.574 DEBUG:tasks.check_counter:Getting stats from f 2024-05-14T15:42:41.574 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph daemon mds.f perf dump 2024-05-14T15:42:41.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:41 smithi203 ceph-mon[34567]: pgmap v666: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-05-14T15:42:41.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:41 smithi092 ceph-mon[34729]: pgmap v666: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-05-14T15:42:41.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:41 smithi069 ceph-mon[31270]: pgmap v666: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-05-14T15:42:42.118 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:42:43.937 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:43 smithi203 ceph-mon[34567]: pgmap v667: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:42:43.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:43 smithi069 ceph-mon[31270]: pgmap v667: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:42:44.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:43 smithi092 ceph-mon[34729]: pgmap v667: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:42:44.720 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-05-14T15:42:44.720 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T15:42:44.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 4158, 2024-05-14T15:42:44.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 4158, 2024-05-14T15:42:44.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 14375514, 2024-05-14T15:42:44.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 1321427, 2024-05-14T15:42:44.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 6, 2024-05-14T15:42:44.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 2, 2024-05-14T15:42:44.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.805352848, 2024-05-14T15:42:44.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.276175476, 2024-05-14T15:42:44.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.228800678, 2024-05-14T15:42:44.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.232527768, 2024-05-14T15:42:44.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:44.721 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 4157, 2024-05-14T15:42:44.721 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.366570302, 2024-05-14T15:42:44.721 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000088181 2024-05-14T15:42:44.721 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.721 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:44.722 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.722 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.722 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.722 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.722 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 2944, 2024-05-14T15:42:44.722 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 448 2024-05-14T15:42:44.722 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.722 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T15:42:44.722 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 1117, 2024-05-14T15:42:44.722 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 1043, 2024-05-14T15:42:44.722 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 6445612, 2024-05-14T15:42:44.722 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 456750, 2024-05-14T15:42:44.722 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 4, 2024-05-14T15:42:44.722 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 3, 2024-05-14T15:42:44.723 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.300435928, 2024-05-14T15:42:44.723 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.095755059, 2024-05-14T15:42:44.723 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.175112820, 2024-05-14T15:42:44.723 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.051040611, 2024-05-14T15:42:44.723 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:44.723 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 1042, 2024-05-14T15:42:44.723 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.115822299, 2024-05-14T15:42:44.723 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000111153 2024-05-14T15:42:44.723 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.723 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:44.723 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.723 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.723 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.723 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.723 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 2105312, 2024-05-14T15:42:44.724 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 276064 2024-05-14T15:42:44.724 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.724 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T15:42:44.724 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 114, 2024-05-14T15:42:44.724 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 444, 2024-05-14T15:42:44.724 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 27808, 2024-05-14T15:42:44.724 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 744498, 2024-05-14T15:42:44.724 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 9, 2024-05-14T15:42:44.724 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 5, 2024-05-14T15:42:44.724 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.069134465, 2024-05-14T15:42:44.724 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.034503229, 2024-05-14T15:42:44.724 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.014970751, 2024-05-14T15:42:44.724 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.008795095, 2024-05-14T15:42:44.724 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:44.724 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 441, 2024-05-14T15:42:44.724 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.066919515, 2024-05-14T15:42:44.725 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000151744 2024-05-14T15:42:44.725 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.725 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:44.725 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.725 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.725 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.725 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.725 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 480, 2024-05-14T15:42:44.725 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 709200 2024-05-14T15:42:44.725 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.725 INFO:teuthology.orchestra.run.smithi203.stdout: "cct": { 2024-05-14T15:42:44.725 INFO:teuthology.orchestra.run.smithi203.stdout: "total_workers": 1, 2024-05-14T15:42:44.725 INFO:teuthology.orchestra.run.smithi203.stdout: "unhealthy_workers": 0 2024-05-14T15:42:44.725 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.725 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-MDSRank": { 2024-05-14T15:42:44.726 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-05-14T15:42:44.726 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-05-14T15:42:44.726 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 8150, 2024-05-14T15:42:44.726 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.396000052, 2024-05-14T15:42:44.726 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000048588 2024-05-14T15:42:44.726 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:44.726 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.726 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-PurgeQueue": { 2024-05-14T15:42:44.726 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-05-14T15:42:44.726 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-05-14T15:42:44.726 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.726 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.726 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.726 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:44.727 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.727 INFO:teuthology.orchestra.run.smithi203.stdout: "mds": { 2024-05-14T15:42:44.727 INFO:teuthology.orchestra.run.smithi203.stdout: "request": 0, 2024-05-14T15:42:44.727 INFO:teuthology.orchestra.run.smithi203.stdout: "reply": 0, 2024-05-14T15:42:44.727 INFO:teuthology.orchestra.run.smithi203.stdout: "reply_latency": { 2024-05-14T15:42:44.727 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.727 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.727 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.727 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.727 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_reply": 0, 2024-05-14T15:42:44.727 INFO:teuthology.orchestra.run.smithi203.stdout: "forward": 0, 2024-05-14T15:42:44.727 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_complete": 0, 2024-05-14T15:42:44.727 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_keys": 0, 2024-05-14T15:42:44.727 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_commit": 0, 2024-05-14T15:42:44.727 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_split": 0, 2024-05-14T15:42:44.727 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_merge": 0, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes": 517, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_top": 102, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_bottom": 415, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pin_tail": 0, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pinned": 371, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_expired": 0, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_with_caps": 0, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "caps": 0, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "subtrees": 14, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse": 0, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_hit": 0, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_forward": 0, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_discover": 0, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_dir_fetch": 0, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_remote_ino": 0, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_lock": 0, 2024-05-14T15:42:44.728 INFO:teuthology.orchestra.run.smithi203.stdout: "load_cent": 0, 2024-05-14T15:42:44.729 INFO:teuthology.orchestra.run.smithi203.stdout: "q": 0, 2024-05-14T15:42:44.729 INFO:teuthology.orchestra.run.smithi203.stdout: "exported": 0, 2024-05-14T15:42:44.729 INFO:teuthology.orchestra.run.smithi203.stdout: "exported_inodes": 0, 2024-05-14T15:42:44.729 INFO:teuthology.orchestra.run.smithi203.stdout: "imported": 0, 2024-05-14T15:42:44.729 INFO:teuthology.orchestra.run.smithi203.stdout: "imported_inodes": 0, 2024-05-14T15:42:44.729 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_dir_fetch": 0, 2024-05-14T15:42:44.729 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_backtrace_fetch": 0, 2024-05-14T15:42:44.729 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_peer_discover": 0, 2024-05-14T15:42:44.729 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rfiles": 0, 2024-05-14T15:42:44.729 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rbytes": 0, 2024-05-14T15:42:44.729 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rsnaps": 0, 2024-05-14T15:42:44.729 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T15:42:44.729 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_set_tag": 0, 2024-05-14T15:42:44.729 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T15:42:44.729 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_inotable_repaired": 0, 2024-05-14T15:42:44.729 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_inodes": 0, 2024-05-14T15:42:44.730 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T15:42:44.730 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T15:42:44.730 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_file_inodes": 0, 2024-05-14T15:42:44.730 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_inode_file_caps": 0, 2024-05-14T15:42:44.730 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_revoke": 0, 2024-05-14T15:42:44.730 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_grant": 0, 2024-05-14T15:42:44.730 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T15:42:44.730 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T15:42:44.730 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T15:42:44.730 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps": 0, 2024-05-14T15:42:44.730 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps_dirty": 0, 2024-05-14T15:42:44.730 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_cap_release": 0, 2024-05-14T15:42:44.730 INFO:teuthology.orchestra.run.smithi203.stdout: "process_request_cap_release": 0 2024-05-14T15:42:44.730 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_cache": { 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update": 0, 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update_receipt": 0, 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_try_discover": 0, 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_send_discover": 0, 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_handle_discover": 0, 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays": 0, 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_delayed": 0, 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_enqueuing": 0, 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_created": 0, 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_enqueued": 0, 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_reintegrated": 0, 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_migrated": 0, 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_processing": 0, 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_enqueued": 0, 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_prioritized": 0, 2024-05-14T15:42:44.731 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_started": 0, 2024-05-14T15:42:44.732 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_completed": 0, 2024-05-14T15:42:44.732 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_path": 0, 2024-05-14T15:42:44.732 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_inode": 0, 2024-05-14T15:42:44.732 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T15:42:44.732 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_exportdir": 0, 2024-05-14T15:42:44.732 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_flush": 0, 2024-05-14T15:42:44.732 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragmentdir": 0, 2024-05-14T15:42:44.732 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragstats": 0, 2024-05-14T15:42:44.732 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_inodestats": 0 2024-05-14T15:42:44.732 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.732 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_log": { 2024-05-14T15:42:44.732 INFO:teuthology.orchestra.run.smithi203.stdout: "evlrg": 0, 2024-05-14T15:42:44.732 INFO:teuthology.orchestra.run.smithi203.stdout: "evadd": 0, 2024-05-14T15:42:44.732 INFO:teuthology.orchestra.run.smithi203.stdout: "evex": 0, 2024-05-14T15:42:44.732 INFO:teuthology.orchestra.run.smithi203.stdout: "evtrm": 0, 2024-05-14T15:42:44.732 INFO:teuthology.orchestra.run.smithi203.stdout: "ev": 10229, 2024-05-14T15:42:44.733 INFO:teuthology.orchestra.run.smithi203.stdout: "evexg": 0, 2024-05-14T15:42:44.733 INFO:teuthology.orchestra.run.smithi203.stdout: "evexd": 0, 2024-05-14T15:42:44.733 INFO:teuthology.orchestra.run.smithi203.stdout: "segadd": 0, 2024-05-14T15:42:44.733 INFO:teuthology.orchestra.run.smithi203.stdout: "segex": 0, 2024-05-14T15:42:44.733 INFO:teuthology.orchestra.run.smithi203.stdout: "segtrm": 0, 2024-05-14T15:42:44.733 INFO:teuthology.orchestra.run.smithi203.stdout: "seg": 13, 2024-05-14T15:42:44.733 INFO:teuthology.orchestra.run.smithi203.stdout: "segmjr": 2, 2024-05-14T15:42:44.733 INFO:teuthology.orchestra.run.smithi203.stdout: "segexg": 0, 2024-05-14T15:42:44.733 INFO:teuthology.orchestra.run.smithi203.stdout: "segexd": 0, 2024-05-14T15:42:44.733 INFO:teuthology.orchestra.run.smithi203.stdout: "expos": 4194304, 2024-05-14T15:42:44.733 INFO:teuthology.orchestra.run.smithi203.stdout: "wrpos": 21584475, 2024-05-14T15:42:44.733 INFO:teuthology.orchestra.run.smithi203.stdout: "rdpos": 21584414, 2024-05-14T15:42:44.733 INFO:teuthology.orchestra.run.smithi203.stdout: "jlat": { 2024-05-14T15:42:44.733 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.733 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.733 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.734 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.734 INFO:teuthology.orchestra.run.smithi203.stdout: "replayed": 10229 2024-05-14T15:42:44.734 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.734 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_mem": { 2024-05-14T15:42:44.734 INFO:teuthology.orchestra.run.smithi203.stdout: "ino": 355, 2024-05-14T15:42:44.734 INFO:teuthology.orchestra.run.smithi203.stdout: "ino+": 1115, 2024-05-14T15:42:44.734 INFO:teuthology.orchestra.run.smithi203.stdout: "ino-": 760, 2024-05-14T15:42:44.734 INFO:teuthology.orchestra.run.smithi203.stdout: "dir": 29, 2024-05-14T15:42:44.734 INFO:teuthology.orchestra.run.smithi203.stdout: "dir+": 78, 2024-05-14T15:42:44.734 INFO:teuthology.orchestra.run.smithi203.stdout: "dir-": 49, 2024-05-14T15:42:44.734 INFO:teuthology.orchestra.run.smithi203.stdout: "dn": 517, 2024-05-14T15:42:44.734 INFO:teuthology.orchestra.run.smithi203.stdout: "dn+": 1384, 2024-05-14T15:42:44.734 INFO:teuthology.orchestra.run.smithi203.stdout: "dn-": 867, 2024-05-14T15:42:44.734 INFO:teuthology.orchestra.run.smithi203.stdout: "cap": 0, 2024-05-14T15:42:44.734 INFO:teuthology.orchestra.run.smithi203.stdout: "cap+": 0, 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: "cap-": 0, 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: "rss": 121844, 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: "heap": 215440 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_server": { 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_client_request": 0, 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_server_request": 0, 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_request": 0, 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_session": 0, 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_peer_request": 0, 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: "req_create_latency": { 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getattr_latency": { 2024-05-14T15:42:44.735 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.736 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.736 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.736 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.736 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getfilelock_latency": { 2024-05-14T15:42:44.736 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.736 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.736 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.736 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.736 INFO:teuthology.orchestra.run.smithi203.stdout: "req_link_latency": { 2024-05-14T15:42:44.736 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.736 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.736 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.736 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.736 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookup_latency": { 2024-05-14T15:42:44.736 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.736 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.737 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.737 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.737 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookuphash_latency": { 2024-05-14T15:42:44.737 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.737 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.737 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.737 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.737 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupino_latency": { 2024-05-14T15:42:44.737 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.737 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.737 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.737 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.737 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupname_latency": { 2024-05-14T15:42:44.737 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.738 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.738 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.738 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.738 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupparent_latency": { 2024-05-14T15:42:44.738 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.738 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.738 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.738 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.738 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupsnap_latency": { 2024-05-14T15:42:44.738 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.738 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.738 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.738 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.738 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lssnap_latency": { 2024-05-14T15:42:44.738 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.738 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.739 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.739 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.739 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mkdir_latency": { 2024-05-14T15:42:44.739 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.739 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.739 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.739 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.739 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mknod_latency": { 2024-05-14T15:42:44.739 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.740 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.740 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.740 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.740 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mksnap_latency": { 2024-05-14T15:42:44.740 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.740 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.740 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.740 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.740 INFO:teuthology.orchestra.run.smithi203.stdout: "req_open_latency": { 2024-05-14T15:42:44.740 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.740 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.740 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.740 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.740 INFO:teuthology.orchestra.run.smithi203.stdout: "req_readdir_latency": { 2024-05-14T15:42:44.740 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.740 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.741 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.741 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.741 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rename_latency": { 2024-05-14T15:42:44.741 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.741 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.741 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.741 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.741 INFO:teuthology.orchestra.run.smithi203.stdout: "req_renamesnap_latency": { 2024-05-14T15:42:44.741 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.741 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.741 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.741 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.741 INFO:teuthology.orchestra.run.smithi203.stdout: "req_snapdiff_latency": { 2024-05-14T15:42:44.741 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.741 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.741 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.742 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.742 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmdir_latency": { 2024-05-14T15:42:44.742 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.742 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.742 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.742 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.742 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmsnap_latency": { 2024-05-14T15:42:44.742 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.742 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.742 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.742 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.742 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmxattr_latency": { 2024-05-14T15:42:44.742 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.742 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.742 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.743 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.743 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setattr_latency": { 2024-05-14T15:42:44.743 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.743 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.743 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.743 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.743 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setdirlayout_latency": { 2024-05-14T15:42:44.743 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.743 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.743 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.743 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.743 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setfilelock_latency": { 2024-05-14T15:42:44.743 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.743 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.743 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setlayout_latency": { 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setxattr_latency": { 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: "req_symlink_latency": { 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.744 INFO:teuthology.orchestra.run.smithi203.stdout: "req_unlink_latency": { 2024-05-14T15:42:44.745 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.745 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.745 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.745 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.745 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_revoke_eviction": 0, 2024-05-14T15:42:44.745 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_acquisition_throttle": 0, 2024-05-14T15:42:44.745 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getvxattr_latency": { 2024-05-14T15:42:44.745 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.745 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.745 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.745 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:44.745 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.745 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_sessions": { 2024-05-14T15:42:44.745 INFO:teuthology.orchestra.run.smithi203.stdout: "session_count": 2, 2024-05-14T15:42:44.745 INFO:teuthology.orchestra.run.smithi203.stdout: "session_add": 5, 2024-05-14T15:42:44.746 INFO:teuthology.orchestra.run.smithi203.stdout: "session_remove": 3, 2024-05-14T15:42:44.746 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_open": 4, 2024-05-14T15:42:44.746 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_stale": 0, 2024-05-14T15:42:44.746 INFO:teuthology.orchestra.run.smithi203.stdout: "total_load": 0, 2024-05-14T15:42:44.746 INFO:teuthology.orchestra.run.smithi203.stdout: "average_load": 0, 2024-05-14T15:42:44.746 INFO:teuthology.orchestra.run.smithi203.stdout: "avg_session_uptime": 4582, 2024-05-14T15:42:44.746 INFO:teuthology.orchestra.run.smithi203.stdout: "mdthresh_evicted": 0 2024-05-14T15:42:44.746 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.746 INFO:teuthology.orchestra.run.smithi203.stdout: "mempool": { 2024-05-14T15:42:44.746 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_bytes": 0, 2024-05-14T15:42:44.746 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_items": 0, 2024-05-14T15:42:44.746 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T15:42:44.746 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_items": 0, 2024-05-14T15:42:44.746 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T15:42:44.746 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_items": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_items": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_bytes": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_items": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_bytes": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_items": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T15:42:44.747 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_items": 0, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_bytes": 0, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_items": 0, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_bytes": 0, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_items": 0, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_bytes": 0, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_items": 0, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_items": 0, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_items": 0, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_bytes": 199849, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_items": 61, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_bytes": 0, 2024-05-14T15:42:44.748 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_items": 0, 2024-05-14T15:42:44.749 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_bytes": 0, 2024-05-14T15:42:44.749 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_items": 0, 2024-05-14T15:42:44.749 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_bytes": 0, 2024-05-14T15:42:44.749 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_items": 0, 2024-05-14T15:42:44.749 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_bytes": 0, 2024-05-14T15:42:44.749 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_items": 0, 2024-05-14T15:42:44.749 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_bytes": 9704, 2024-05-14T15:42:44.749 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_items": 186, 2024-05-14T15:42:44.749 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T15:42:44.749 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_items": 0, 2024-05-14T15:42:44.749 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_bytes": 0, 2024-05-14T15:42:44.749 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_items": 0, 2024-05-14T15:42:44.749 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_bytes": 1211919, 2024-05-14T15:42:44.749 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_items": 9311, 2024-05-14T15:42:44.749 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_bytes": 0, 2024-05-14T15:42:44.749 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_items": 0, 2024-05-14T15:42:44.750 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_bytes": 0, 2024-05-14T15:42:44.750 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_items": 0 2024-05-14T15:42:44.750 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.750 INFO:teuthology.orchestra.run.smithi203.stdout: "objecter": { 2024-05-14T15:42:44.750 INFO:teuthology.orchestra.run.smithi203.stdout: "op_active": 0, 2024-05-14T15:42:44.750 INFO:teuthology.orchestra.run.smithi203.stdout: "op_laggy": 0, 2024-05-14T15:42:44.750 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send": 4833, 2024-05-14T15:42:44.750 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send_bytes": 21, 2024-05-14T15:42:44.750 INFO:teuthology.orchestra.run.smithi203.stdout: "op_resend": 3, 2024-05-14T15:42:44.750 INFO:teuthology.orchestra.run.smithi203.stdout: "op_reply": 4833, 2024-05-14T15:42:44.750 INFO:teuthology.orchestra.run.smithi203.stdout: "op_latency": { 2024-05-14T15:42:44.750 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 4833, 2024-05-14T15:42:44.750 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 11.513725641, 2024-05-14T15:42:44.750 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.002382314 2024-05-14T15:42:44.750 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.750 INFO:teuthology.orchestra.run.smithi203.stdout: "op_inflight": 0, 2024-05-14T15:42:44.751 INFO:teuthology.orchestra.run.smithi203.stdout: "oplen_avg": { 2024-05-14T15:42:44.751 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 4833, 2024-05-14T15:42:44.751 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 4834 2024-05-14T15:42:44.751 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.751 INFO:teuthology.orchestra.run.smithi203.stdout: "op": 4833, 2024-05-14T15:42:44.751 INFO:teuthology.orchestra.run.smithi203.stdout: "op_r": 4833, 2024-05-14T15:42:44.751 INFO:teuthology.orchestra.run.smithi203.stdout: "op_w": 0, 2024-05-14T15:42:44.751 INFO:teuthology.orchestra.run.smithi203.stdout: "op_rmw": 0, 2024-05-14T15:42:44.751 INFO:teuthology.orchestra.run.smithi203.stdout: "op_pg": 0, 2024-05-14T15:42:44.751 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_stat": 2899, 2024-05-14T15:42:44.751 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_create": 0, 2024-05-14T15:42:44.751 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_read": 1932, 2024-05-14T15:42:44.751 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_write": 0, 2024-05-14T15:42:44.751 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writefull": 0, 2024-05-14T15:42:44.751 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writesame": 0, 2024-05-14T15:42:44.751 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_append": 0, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_zero": 0, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_truncate": 0, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_delete": 0, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_mapext": 0, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_sparse_read": 0, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_clonerange": 0, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_getxattr": 1, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_setxattr": 0, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_cmpxattr": 0, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_rmxattr": 0, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_resetxattrs": 0, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_call": 0, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_watch": 0, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_notify": 0, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls": 0, 2024-05-14T15:42:44.752 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls_filter": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_other": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_active": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_send": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_resend": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_ping": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_active": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_send": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_resend": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_active": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_send": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_resend": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_active": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_send": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_resend": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "command_active": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "command_send": 0, 2024-05-14T15:42:44.753 INFO:teuthology.orchestra.run.smithi203.stdout: "command_resend": 0, 2024-05-14T15:42:44.754 INFO:teuthology.orchestra.run.smithi203.stdout: "map_epoch": 124, 2024-05-14T15:42:44.754 INFO:teuthology.orchestra.run.smithi203.stdout: "map_full": 0, 2024-05-14T15:42:44.754 INFO:teuthology.orchestra.run.smithi203.stdout: "map_inc": 35, 2024-05-14T15:42:44.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_sessions": 6, 2024-05-14T15:42:44.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_open": 7, 2024-05-14T15:42:44.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_close": 1, 2024-05-14T15:42:44.754 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_laggy": 0, 2024-05-14T15:42:44.754 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_wr": 0, 2024-05-14T15:42:44.754 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_rd": 2, 2024-05-14T15:42:44.754 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_del": 0 2024-05-14T15:42:44.754 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.754 INFO:teuthology.orchestra.run.smithi203.stdout: "oft": { 2024-05-14T15:42:44.754 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_objs": 0, 2024-05-14T15:42:44.754 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_kv_pairs": 0, 2024-05-14T15:42:44.754 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_updates": 0, 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_removes": 0 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: "osd-slow-ops": { 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_ops_count": 0 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: "purge_queue": { 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops": 0, 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops_high_water": 0, 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing": 0, 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_high_water": 0, 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed_ops": 0, 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed": 0, 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_item_in_journal": 0 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:44.755 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 5385, 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 20333379, 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 5385, 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 5385, 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 20333379, 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_bytes": { 2024-05-14T15:42:44.756 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:44.757 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-05-14T15:42:44.757 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:44.757 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-05-14T15:42:44.757 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-05-14T15:42:44.757 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:44.757 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:44.757 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 4833, 2024-05-14T15:42:44.757 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 17391552, 2024-05-14T15:42:44.757 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 4833, 2024-05-14T15:42:44.757 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 17391552, 2024-05-14T15:42:44.757 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:44.757 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.757 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.757 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.757 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:44.757 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.758 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_ops": { 2024-05-14T15:42:44.758 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:44.758 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 1024, 2024-05-14T15:42:44.758 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:44.758 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-05-14T15:42:44.758 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-05-14T15:42:44.758 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:44.758 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:44.758 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 4833, 2024-05-14T15:42:44.758 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 4833, 2024-05-14T15:42:44.758 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 4833, 2024-05-14T15:42:44.758 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 4833, 2024-05-14T15:42:44.758 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:44.758 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.758 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.759 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.759 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:44.759 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.759 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle": { 2024-05-14T15:42:44.759 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:44.759 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-05-14T15:42:44.759 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:44.759 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-05-14T15:42:44.759 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-05-14T15:42:44.759 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:44.759 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:44.759 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-05-14T15:42:44.759 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-05-14T15:42:44.759 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 0, 2024-05-14T15:42:44.759 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 0, 2024-05-14T15:42:44.760 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:44.760 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.760 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.760 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.760 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:44.760 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:44.760 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle-0x55dede09a8f0": { 2024-05-14T15:42:44.760 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:44.760 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-05-14T15:42:44.760 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:44.760 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-05-14T15:42:44.760 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-05-14T15:42:44.760 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:44.760 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:44.760 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-05-14T15:42:44.760 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-05-14T15:42:44.761 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 0, 2024-05-14T15:42:44.761 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 0, 2024-05-14T15:42:44.761 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:44.761 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:44.761 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:44.761 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:44.761 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:44.761 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:44.761 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-05-14T15:42:45.845 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:45 smithi203 ceph-mon[34567]: pgmap v668: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:42:45.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:45 smithi069 ceph-mon[31270]: pgmap v668: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:42:46.022 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-05-14T15:42:46.022 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-05-14T15:42:46.022 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-05-14T15:42:46.022 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-05-14T15:42:46.022 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-05-14T15:42:46.022 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-05-14T15:42:46.023 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-05-14T15:42:46.023 DEBUG:tasks.check_counter:Getting stats from i 2024-05-14T15:42:46.023 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph daemon mds.i perf dump 2024-05-14T15:42:46.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:45 smithi092 ceph-mon[34729]: pgmap v668: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:42:46.505 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:42:47.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:47 smithi069 ceph-mon[31270]: pgmap v669: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-05-14T15:42:48.029 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:47 smithi203 ceph-mon[34567]: pgmap v669: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-05-14T15:42:48.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:47 smithi092 ceph-mon[34729]: pgmap v669: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-05-14T15:42:49.312 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-05-14T15:42:49.312 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T15:42:49.312 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 2817, 2024-05-14T15:42:49.313 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 3478, 2024-05-14T15:42:49.313 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 1331248, 2024-05-14T15:42:49.313 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 7345333, 2024-05-14T15:42:49.313 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 11, 2024-05-14T15:42:49.313 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 4, 2024-05-14T15:42:49.313 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.613988732, 2024-05-14T15:42:49.313 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.259087576, 2024-05-14T15:42:49.313 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.255670398, 2024-05-14T15:42:49.313 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.085333942, 2024-05-14T15:42:49.313 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:49.313 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 3476, 2024-05-14T15:42:49.313 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.406621650, 2024-05-14T15:42:49.313 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000116979 2024-05-14T15:42:49.313 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.313 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:49.313 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 2869, 2024-05-14T15:42:49.314 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.001937379, 2024-05-14T15:42:49.314 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000675 2024-05-14T15:42:49.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.314 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 160, 2024-05-14T15:42:49.314 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 512864 2024-05-14T15:42:49.314 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.314 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T15:42:49.314 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 11591, 2024-05-14T15:42:49.314 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 7720, 2024-05-14T15:42:49.314 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 7289407, 2024-05-14T15:42:49.314 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 3551867, 2024-05-14T15:42:49.314 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 11, 2024-05-14T15:42:49.314 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 6, 2024-05-14T15:42:49.314 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 1.881432540, 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.748270181, 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 1.433195677, 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.040800695, 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 7719, 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.740975353, 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000095993 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 16937, 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.007729408, 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000456 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 2118832, 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 284960 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.315 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T15:42:49.316 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 5623, 2024-05-14T15:42:49.316 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 7187, 2024-05-14T15:42:49.316 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 2162541, 2024-05-14T15:42:49.316 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 4460706, 2024-05-14T15:42:49.316 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 28, 2024-05-14T15:42:49.316 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 4, 2024-05-14T15:42:49.316 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 1.168995080, 2024-05-14T15:42:49.316 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.499697836, 2024-05-14T15:42:49.316 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.783216636, 2024-05-14T15:42:49.316 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.013957160, 2024-05-14T15:42:49.316 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:49.316 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 7185, 2024-05-14T15:42:49.316 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.682684264, 2024-05-14T15:42:49.316 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000095015 2024-05-14T15:42:49.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.317 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:49.317 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 10567, 2024-05-14T15:42:49.317 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.007545176, 2024-05-14T15:42:49.317 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000714 2024-05-14T15:42:49.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.317 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 4960, 2024-05-14T15:42:49.317 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 146464 2024-05-14T15:42:49.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.317 INFO:teuthology.orchestra.run.smithi203.stdout: "cct": { 2024-05-14T15:42:49.317 INFO:teuthology.orchestra.run.smithi203.stdout: "total_workers": 1, 2024-05-14T15:42:49.317 INFO:teuthology.orchestra.run.smithi203.stdout: "unhealthy_workers": 0 2024-05-14T15:42:49.317 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.317 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-MDSRank": { 2024-05-14T15:42:49.317 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-05-14T15:42:49.317 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-05-14T15:42:49.318 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 2783, 2024-05-14T15:42:49.318 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 1.394876170, 2024-05-14T15:42:49.318 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000501213 2024-05-14T15:42:49.318 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:49.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.318 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-PurgeQueue": { 2024-05-14T15:42:49.318 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-05-14T15:42:49.318 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-05-14T15:42:49.318 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 33, 2024-05-14T15:42:49.318 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.002376351, 2024-05-14T15:42:49.318 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000072010 2024-05-14T15:42:49.318 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:49.318 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.318 INFO:teuthology.orchestra.run.smithi203.stdout: "mds": { 2024-05-14T15:42:49.318 INFO:teuthology.orchestra.run.smithi203.stdout: "request": 2007, 2024-05-14T15:42:49.319 INFO:teuthology.orchestra.run.smithi203.stdout: "reply": 1550, 2024-05-14T15:42:49.319 INFO:teuthology.orchestra.run.smithi203.stdout: "reply_latency": { 2024-05-14T15:42:49.319 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 1550, 2024-05-14T15:42:49.319 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 58.957705811, 2024-05-14T15:42:49.319 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.038037229 2024-05-14T15:42:49.319 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.319 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_reply": 0, 2024-05-14T15:42:49.319 INFO:teuthology.orchestra.run.smithi203.stdout: "forward": 457, 2024-05-14T15:42:49.319 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_complete": 4, 2024-05-14T15:42:49.319 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_keys": 0, 2024-05-14T15:42:49.319 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_commit": 27, 2024-05-14T15:42:49.319 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_split": 2, 2024-05-14T15:42:49.319 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_merge": 0, 2024-05-14T15:42:49.319 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes": 666, 2024-05-14T15:42:49.319 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_top": 164, 2024-05-14T15:42:49.320 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_bottom": 491, 2024-05-14T15:42:49.320 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pin_tail": 11, 2024-05-14T15:42:49.320 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pinned": 431, 2024-05-14T15:42:49.320 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_expired": 756, 2024-05-14T15:42:49.320 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_with_caps": 286, 2024-05-14T15:42:49.320 INFO:teuthology.orchestra.run.smithi203.stdout: "caps": 286, 2024-05-14T15:42:49.320 INFO:teuthology.orchestra.run.smithi203.stdout: "subtrees": 39, 2024-05-14T15:42:49.320 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse": 3792, 2024-05-14T15:42:49.320 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_hit": 3048, 2024-05-14T15:42:49.320 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_forward": 443, 2024-05-14T15:42:49.320 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_discover": 66, 2024-05-14T15:42:49.320 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_dir_fetch": 1, 2024-05-14T15:42:49.320 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_remote_ino": 0, 2024-05-14T15:42:49.320 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_lock": 9, 2024-05-14T15:42:49.320 INFO:teuthology.orchestra.run.smithi203.stdout: "load_cent": 68, 2024-05-14T15:42:49.320 INFO:teuthology.orchestra.run.smithi203.stdout: "q": 0, 2024-05-14T15:42:49.321 INFO:teuthology.orchestra.run.smithi203.stdout: "exported": 15, 2024-05-14T15:42:49.321 INFO:teuthology.orchestra.run.smithi203.stdout: "exported_inodes": 723, 2024-05-14T15:42:49.321 INFO:teuthology.orchestra.run.smithi203.stdout: "imported": 29, 2024-05-14T15:42:49.321 INFO:teuthology.orchestra.run.smithi203.stdout: "imported_inodes": 1072, 2024-05-14T15:42:49.321 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_dir_fetch": 0, 2024-05-14T15:42:49.321 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_backtrace_fetch": 919, 2024-05-14T15:42:49.321 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_peer_discover": 0, 2024-05-14T15:42:49.321 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rfiles": 1015, 2024-05-14T15:42:49.321 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rbytes": 1478530389, 2024-05-14T15:42:49.321 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rsnaps": 6, 2024-05-14T15:42:49.321 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_fetch": 919, 2024-05-14T15:42:49.321 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_set_tag": 0, 2024-05-14T15:42:49.321 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T15:42:49.321 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_inotable_repaired": 0, 2024-05-14T15:42:49.321 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_inodes": 0, 2024-05-14T15:42:49.321 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T15:42:49.322 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T15:42:49.322 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_file_inodes": 919, 2024-05-14T15:42:49.322 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_inode_file_caps": 25, 2024-05-14T15:42:49.322 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_revoke": 586, 2024-05-14T15:42:49.322 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_grant": 548, 2024-05-14T15:42:49.322 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T15:42:49.322 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T15:42:49.322 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T15:42:49.322 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps": 2005, 2024-05-14T15:42:49.322 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps_dirty": 632, 2024-05-14T15:42:49.322 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_cap_release": 15, 2024-05-14T15:42:49.322 INFO:teuthology.orchestra.run.smithi203.stdout: "process_request_cap_release": 47 2024-05-14T15:42:49.322 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.322 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_cache": { 2024-05-14T15:42:49.323 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update": 53, 2024-05-14T15:42:49.323 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update_receipt": 586, 2024-05-14T15:42:49.323 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_try_discover": 336, 2024-05-14T15:42:49.323 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_send_discover": 590, 2024-05-14T15:42:49.323 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_handle_discover": 90, 2024-05-14T15:42:49.323 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays": 1, 2024-05-14T15:42:49.323 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_delayed": 0, 2024-05-14T15:42:49.323 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_enqueuing": 0, 2024-05-14T15:42:49.323 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_created": 16, 2024-05-14T15:42:49.323 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_enqueued": 3, 2024-05-14T15:42:49.323 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_reintegrated": 13, 2024-05-14T15:42:49.323 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_migrated": 9, 2024-05-14T15:42:49.323 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_processing": 0, 2024-05-14T15:42:49.323 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_enqueued": 0, 2024-05-14T15:42:49.324 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_prioritized": 0, 2024-05-14T15:42:49.324 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_started": 0, 2024-05-14T15:42:49.324 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_completed": 0, 2024-05-14T15:42:49.324 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_path": 0, 2024-05-14T15:42:49.324 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_inode": 0, 2024-05-14T15:42:49.324 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T15:42:49.324 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_exportdir": 15, 2024-05-14T15:42:49.324 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_flush": 0, 2024-05-14T15:42:49.324 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragmentdir": 2, 2024-05-14T15:42:49.324 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragstats": 0, 2024-05-14T15:42:49.324 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_inodestats": 0 2024-05-14T15:42:49.324 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.324 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_log": { 2024-05-14T15:42:49.324 INFO:teuthology.orchestra.run.smithi203.stdout: "evlrg": 0, 2024-05-14T15:42:49.324 INFO:teuthology.orchestra.run.smithi203.stdout: "evadd": 2697, 2024-05-14T15:42:49.325 INFO:teuthology.orchestra.run.smithi203.stdout: "evex": 0, 2024-05-14T15:42:49.325 INFO:teuthology.orchestra.run.smithi203.stdout: "evtrm": 0, 2024-05-14T15:42:49.325 INFO:teuthology.orchestra.run.smithi203.stdout: "ev": 2697, 2024-05-14T15:42:49.325 INFO:teuthology.orchestra.run.smithi203.stdout: "evexg": 0, 2024-05-14T15:42:49.325 INFO:teuthology.orchestra.run.smithi203.stdout: "evexd": 0, 2024-05-14T15:42:49.325 INFO:teuthology.orchestra.run.smithi203.stdout: "segadd": 5, 2024-05-14T15:42:49.325 INFO:teuthology.orchestra.run.smithi203.stdout: "segex": 0, 2024-05-14T15:42:49.325 INFO:teuthology.orchestra.run.smithi203.stdout: "segtrm": 0, 2024-05-14T15:42:49.325 INFO:teuthology.orchestra.run.smithi203.stdout: "seg": 5, 2024-05-14T15:42:49.325 INFO:teuthology.orchestra.run.smithi203.stdout: "segmjr": 2, 2024-05-14T15:42:49.325 INFO:teuthology.orchestra.run.smithi203.stdout: "segexg": 0, 2024-05-14T15:42:49.325 INFO:teuthology.orchestra.run.smithi203.stdout: "segexd": 0, 2024-05-14T15:42:49.325 INFO:teuthology.orchestra.run.smithi203.stdout: "expos": 4194304, 2024-05-14T15:42:49.325 INFO:teuthology.orchestra.run.smithi203.stdout: "wrpos": 9466660, 2024-05-14T15:42:49.325 INFO:teuthology.orchestra.run.smithi203.stdout: "rdpos": 0, 2024-05-14T15:42:49.325 INFO:teuthology.orchestra.run.smithi203.stdout: "jlat": { 2024-05-14T15:42:49.326 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 923, 2024-05-14T15:42:49.326 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 9.044433765, 2024-05-14T15:42:49.326 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.009798953 2024-05-14T15:42:49.326 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.326 INFO:teuthology.orchestra.run.smithi203.stdout: "replayed": 0 2024-05-14T15:42:49.326 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.326 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_mem": { 2024-05-14T15:42:49.326 INFO:teuthology.orchestra.run.smithi203.stdout: "ino": 622, 2024-05-14T15:42:49.326 INFO:teuthology.orchestra.run.smithi203.stdout: "ino+": 1354, 2024-05-14T15:42:49.326 INFO:teuthology.orchestra.run.smithi203.stdout: "ino-": 732, 2024-05-14T15:42:49.326 INFO:teuthology.orchestra.run.smithi203.stdout: "dir": 96, 2024-05-14T15:42:49.326 INFO:teuthology.orchestra.run.smithi203.stdout: "dir+": 315, 2024-05-14T15:42:49.326 INFO:teuthology.orchestra.run.smithi203.stdout: "dir-": 219, 2024-05-14T15:42:49.326 INFO:teuthology.orchestra.run.smithi203.stdout: "dn": 666, 2024-05-14T15:42:49.327 INFO:teuthology.orchestra.run.smithi203.stdout: "dn+": 1449, 2024-05-14T15:42:49.327 INFO:teuthology.orchestra.run.smithi203.stdout: "dn-": 783, 2024-05-14T15:42:49.327 INFO:teuthology.orchestra.run.smithi203.stdout: "cap": 286, 2024-05-14T15:42:49.327 INFO:teuthology.orchestra.run.smithi203.stdout: "cap+": 878, 2024-05-14T15:42:49.327 INFO:teuthology.orchestra.run.smithi203.stdout: "cap-": 592, 2024-05-14T15:42:49.327 INFO:teuthology.orchestra.run.smithi203.stdout: "rss": 130948, 2024-05-14T15:42:49.327 INFO:teuthology.orchestra.run.smithi203.stdout: "heap": 223632 2024-05-14T15:42:49.327 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.327 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_server": { 2024-05-14T15:42:49.327 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_client_request": 2570, 2024-05-14T15:42:49.327 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_server_request": 341, 2024-05-14T15:42:49.327 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_request": 2007, 2024-05-14T15:42:49.327 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_session": 47, 2024-05-14T15:42:49.327 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_peer_request": 567, 2024-05-14T15:42:49.327 INFO:teuthology.orchestra.run.smithi203.stdout: "req_create_latency": { 2024-05-14T15:42:49.327 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 4, 2024-05-14T15:42:49.328 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.038711901, 2024-05-14T15:42:49.328 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.009677975 2024-05-14T15:42:49.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.328 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getattr_latency": { 2024-05-14T15:42:49.328 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 76, 2024-05-14T15:42:49.328 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.195768279, 2024-05-14T15:42:49.328 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.002575898 2024-05-14T15:42:49.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.328 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getfilelock_latency": { 2024-05-14T15:42:49.328 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.328 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.328 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.328 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.328 INFO:teuthology.orchestra.run.smithi203.stdout: "req_link_latency": { 2024-05-14T15:42:49.328 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 13, 2024-05-14T15:42:49.329 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.365704871, 2024-05-14T15:42:49.329 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.028131143 2024-05-14T15:42:49.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.329 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookup_latency": { 2024-05-14T15:42:49.329 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 842, 2024-05-14T15:42:49.329 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 29.007925275, 2024-05-14T15:42:49.329 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.034451217 2024-05-14T15:42:49.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.329 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookuphash_latency": { 2024-05-14T15:42:49.329 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.329 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.329 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.329 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.329 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupino_latency": { 2024-05-14T15:42:49.329 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.330 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.330 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.330 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupname_latency": { 2024-05-14T15:42:49.330 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.330 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.330 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.330 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupparent_latency": { 2024-05-14T15:42:49.330 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.330 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.330 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.330 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.330 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupsnap_latency": { 2024-05-14T15:42:49.330 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.331 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.331 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.331 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.331 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lssnap_latency": { 2024-05-14T15:42:49.331 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.331 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.331 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.331 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.331 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mkdir_latency": { 2024-05-14T15:42:49.332 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.332 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.332 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.332 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mknod_latency": { 2024-05-14T15:42:49.332 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.332 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.332 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.332 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mksnap_latency": { 2024-05-14T15:42:49.332 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.332 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.332 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.332 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.332 INFO:teuthology.orchestra.run.smithi203.stdout: "req_open_latency": { 2024-05-14T15:42:49.333 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 516, 2024-05-14T15:42:49.333 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.612280215, 2024-05-14T15:42:49.333 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.001186589 2024-05-14T15:42:49.333 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.333 INFO:teuthology.orchestra.run.smithi203.stdout: "req_readdir_latency": { 2024-05-14T15:42:49.333 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 61, 2024-05-14T15:42:49.333 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.113072264, 2024-05-14T15:42:49.333 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.001853643 2024-05-14T15:42:49.333 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.333 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rename_latency": { 2024-05-14T15:42:49.333 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 22, 2024-05-14T15:42:49.333 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 28.435496413, 2024-05-14T15:42:49.333 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 1.292522564 2024-05-14T15:42:49.333 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.333 INFO:teuthology.orchestra.run.smithi203.stdout: "req_renamesnap_latency": { 2024-05-14T15:42:49.334 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.334 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.334 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.334 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.334 INFO:teuthology.orchestra.run.smithi203.stdout: "req_snapdiff_latency": { 2024-05-14T15:42:49.334 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.334 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.334 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.334 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.334 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmdir_latency": { 2024-05-14T15:42:49.334 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.334 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.334 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.334 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.335 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmsnap_latency": { 2024-05-14T15:42:49.335 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.335 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.335 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.335 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmxattr_latency": { 2024-05-14T15:42:49.335 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.335 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.335 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.335 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setattr_latency": { 2024-05-14T15:42:49.335 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.335 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.335 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.335 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.335 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setdirlayout_latency": { 2024-05-14T15:42:49.336 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.336 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.336 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.336 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setfilelock_latency": { 2024-05-14T15:42:49.336 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.336 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.336 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.336 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setlayout_latency": { 2024-05-14T15:42:49.336 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.336 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.336 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.336 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.336 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setxattr_latency": { 2024-05-14T15:42:49.337 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.337 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.337 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.337 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.337 INFO:teuthology.orchestra.run.smithi203.stdout: "req_symlink_latency": { 2024-05-14T15:42:49.337 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.337 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.337 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.337 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.337 INFO:teuthology.orchestra.run.smithi203.stdout: "req_unlink_latency": { 2024-05-14T15:42:49.337 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 16, 2024-05-14T15:42:49.337 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.188746593, 2024-05-14T15:42:49.337 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.011796662 2024-05-14T15:42:49.337 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.337 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_revoke_eviction": 0, 2024-05-14T15:42:49.337 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_acquisition_throttle": 0, 2024-05-14T15:42:49.338 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getvxattr_latency": { 2024-05-14T15:42:49.338 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.338 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.338 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.338 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:49.338 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.338 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_sessions": { 2024-05-14T15:42:49.338 INFO:teuthology.orchestra.run.smithi203.stdout: "session_count": 1, 2024-05-14T15:42:49.338 INFO:teuthology.orchestra.run.smithi203.stdout: "session_add": 3, 2024-05-14T15:42:49.338 INFO:teuthology.orchestra.run.smithi203.stdout: "session_remove": 2, 2024-05-14T15:42:49.338 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_open": 1, 2024-05-14T15:42:49.338 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_stale": 0, 2024-05-14T15:42:49.338 INFO:teuthology.orchestra.run.smithi203.stdout: "total_load": 454, 2024-05-14T15:42:49.338 INFO:teuthology.orchestra.run.smithi203.stdout: "average_load": 454, 2024-05-14T15:42:49.338 INFO:teuthology.orchestra.run.smithi203.stdout: "avg_session_uptime": 1273, 2024-05-14T15:42:49.338 INFO:teuthology.orchestra.run.smithi203.stdout: "mdthresh_evicted": 0 2024-05-14T15:42:49.339 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.339 INFO:teuthology.orchestra.run.smithi203.stdout: "mempool": { 2024-05-14T15:42:49.339 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_bytes": 0, 2024-05-14T15:42:49.339 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_items": 0, 2024-05-14T15:42:49.339 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T15:42:49.339 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_items": 0, 2024-05-14T15:42:49.339 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T15:42:49.339 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_items": 0, 2024-05-14T15:42:49.339 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T15:42:49.339 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T15:42:49.339 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T15:42:49.339 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T15:42:49.339 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T15:42:49.339 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_items": 0, 2024-05-14T15:42:49.339 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T15:42:49.339 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T15:42:49.340 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_bytes": 0, 2024-05-14T15:42:49.340 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_items": 0, 2024-05-14T15:42:49.340 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_bytes": 0, 2024-05-14T15:42:49.340 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_items": 0, 2024-05-14T15:42:49.340 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T15:42:49.340 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T15:42:49.340 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T15:42:49.340 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T15:42:49.340 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T15:42:49.340 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_items": 0, 2024-05-14T15:42:49.340 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_bytes": 0, 2024-05-14T15:42:49.340 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_items": 0, 2024-05-14T15:42:49.340 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T15:42:49.340 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T15:42:49.340 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_bytes": 0, 2024-05-14T15:42:49.340 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_items": 0, 2024-05-14T15:42:49.341 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_bytes": 0, 2024-05-14T15:42:49.341 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_items": 0, 2024-05-14T15:42:49.341 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T15:42:49.341 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_items": 0, 2024-05-14T15:42:49.341 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T15:42:49.341 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_items": 0, 2024-05-14T15:42:49.341 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_bytes": 562111, 2024-05-14T15:42:49.341 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_items": 179, 2024-05-14T15:42:49.341 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_bytes": 0, 2024-05-14T15:42:49.341 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_items": 0, 2024-05-14T15:42:49.341 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_bytes": 0, 2024-05-14T15:42:49.341 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_items": 0, 2024-05-14T15:42:49.341 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_bytes": 0, 2024-05-14T15:42:49.341 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_items": 0, 2024-05-14T15:42:49.341 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_bytes": 0, 2024-05-14T15:42:49.341 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_items": 0, 2024-05-14T15:42:49.342 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_bytes": 9704, 2024-05-14T15:42:49.342 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_items": 186, 2024-05-14T15:42:49.342 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T15:42:49.342 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_items": 0, 2024-05-14T15:42:49.342 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_bytes": 0, 2024-05-14T15:42:49.342 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_items": 0, 2024-05-14T15:42:49.342 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_bytes": 2146791, 2024-05-14T15:42:49.342 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_items": 18873, 2024-05-14T15:42:49.342 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_bytes": 0, 2024-05-14T15:42:49.342 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_items": 0, 2024-05-14T15:42:49.342 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_bytes": 0, 2024-05-14T15:42:49.342 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_items": 0 2024-05-14T15:42:49.342 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.342 INFO:teuthology.orchestra.run.smithi203.stdout: "objecter": { 2024-05-14T15:42:49.342 INFO:teuthology.orchestra.run.smithi203.stdout: "op_active": 0, 2024-05-14T15:42:49.343 INFO:teuthology.orchestra.run.smithi203.stdout: "op_laggy": 0, 2024-05-14T15:42:49.343 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send": 2158, 2024-05-14T15:42:49.343 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send_bytes": 5441339, 2024-05-14T15:42:49.343 INFO:teuthology.orchestra.run.smithi203.stdout: "op_resend": 33, 2024-05-14T15:42:49.343 INFO:teuthology.orchestra.run.smithi203.stdout: "op_reply": 2158, 2024-05-14T15:42:49.343 INFO:teuthology.orchestra.run.smithi203.stdout: "op_latency": { 2024-05-14T15:42:49.343 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 2158, 2024-05-14T15:42:49.343 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 13.279685715, 2024-05-14T15:42:49.343 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.006153700 2024-05-14T15:42:49.343 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.343 INFO:teuthology.orchestra.run.smithi203.stdout: "op_inflight": 0, 2024-05-14T15:42:49.343 INFO:teuthology.orchestra.run.smithi203.stdout: "oplen_avg": { 2024-05-14T15:42:49.343 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 2158, 2024-05-14T15:42:49.343 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 2366 2024-05-14T15:42:49.344 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.344 INFO:teuthology.orchestra.run.smithi203.stdout: "op": 2158, 2024-05-14T15:42:49.344 INFO:teuthology.orchestra.run.smithi203.stdout: "op_r": 926, 2024-05-14T15:42:49.344 INFO:teuthology.orchestra.run.smithi203.stdout: "op_w": 1232, 2024-05-14T15:42:49.344 INFO:teuthology.orchestra.run.smithi203.stdout: "op_rmw": 0, 2024-05-14T15:42:49.344 INFO:teuthology.orchestra.run.smithi203.stdout: "op_pg": 0, 2024-05-14T15:42:49.344 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_stat": 0, 2024-05-14T15:42:49.344 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_create": 10, 2024-05-14T15:42:49.344 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_read": 3, 2024-05-14T15:42:49.344 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_write": 926, 2024-05-14T15:42:49.344 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writefull": 84, 2024-05-14T15:42:49.344 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writesame": 0, 2024-05-14T15:42:49.344 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_append": 0, 2024-05-14T15:42:49.344 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_zero": 1, 2024-05-14T15:42:49.344 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_truncate": 0, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_delete": 22, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_mapext": 0, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_sparse_read": 0, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_clonerange": 0, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_getxattr": 919, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_setxattr": 20, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_cmpxattr": 0, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_rmxattr": 0, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_resetxattrs": 0, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_call": 0, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_watch": 0, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_notify": 0, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls": 0, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls_filter": 0, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_other": 0, 2024-05-14T15:42:49.345 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_active": 0, 2024-05-14T15:42:49.346 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_send": 0, 2024-05-14T15:42:49.346 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_resend": 0, 2024-05-14T15:42:49.346 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_ping": 0, 2024-05-14T15:42:49.346 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_active": 0, 2024-05-14T15:42:49.346 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_send": 0, 2024-05-14T15:42:49.346 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_resend": 0, 2024-05-14T15:42:49.346 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_active": 0, 2024-05-14T15:42:49.346 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_send": 0, 2024-05-14T15:42:49.346 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_resend": 0, 2024-05-14T15:42:49.346 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_active": 0, 2024-05-14T15:42:49.346 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_send": 0, 2024-05-14T15:42:49.346 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_resend": 0, 2024-05-14T15:42:49.346 INFO:teuthology.orchestra.run.smithi203.stdout: "command_active": 0, 2024-05-14T15:42:49.346 INFO:teuthology.orchestra.run.smithi203.stdout: "command_send": 0, 2024-05-14T15:42:49.346 INFO:teuthology.orchestra.run.smithi203.stdout: "command_resend": 0, 2024-05-14T15:42:49.347 INFO:teuthology.orchestra.run.smithi203.stdout: "map_epoch": 124, 2024-05-14T15:42:49.347 INFO:teuthology.orchestra.run.smithi203.stdout: "map_full": 0, 2024-05-14T15:42:49.347 INFO:teuthology.orchestra.run.smithi203.stdout: "map_inc": 35, 2024-05-14T15:42:49.347 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_sessions": 12, 2024-05-14T15:42:49.347 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_open": 12, 2024-05-14T15:42:49.347 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_close": 0, 2024-05-14T15:42:49.347 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_laggy": 0, 2024-05-14T15:42:49.347 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_wr": 310, 2024-05-14T15:42:49.347 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_rd": 8, 2024-05-14T15:42:49.347 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_del": 63 2024-05-14T15:42:49.347 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.347 INFO:teuthology.orchestra.run.smithi203.stdout: "oft": { 2024-05-14T15:42:49.347 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_objs": 1, 2024-05-14T15:42:49.347 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_kv_pairs": 0, 2024-05-14T15:42:49.347 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_updates": 0, 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_removes": 0 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: "osd-slow-ops": { 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_ops_count": 2 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: "purge_queue": { 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops": 0, 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops_high_water": 4, 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing": 0, 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_high_water": 1, 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed_ops": 8, 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed": 3, 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_item_in_journal": 0 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:49.348 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 20027, 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 8947772, 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 20027, 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 20027, 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 8947772, 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_bytes": { 2024-05-14T15:42:49.349 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:49.350 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-05-14T15:42:49.350 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:49.350 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-05-14T15:42:49.350 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-05-14T15:42:49.350 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:49.350 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:49.350 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 2158, 2024-05-14T15:42:49.350 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 5441738, 2024-05-14T15:42:49.350 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 2158, 2024-05-14T15:42:49.350 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 5441738, 2024-05-14T15:42:49.350 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:49.350 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.350 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.350 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.350 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:49.351 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.351 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_ops": { 2024-05-14T15:42:49.351 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:49.351 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 1024, 2024-05-14T15:42:49.351 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:49.351 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-05-14T15:42:49.351 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-05-14T15:42:49.351 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:49.351 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:49.351 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 2158, 2024-05-14T15:42:49.351 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 2158, 2024-05-14T15:42:49.351 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 2158, 2024-05-14T15:42:49.351 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 2158, 2024-05-14T15:42:49.351 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:49.351 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.351 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle": { 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 3, 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 463, 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 3, 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 3, 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 463, 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:49.352 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.353 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.353 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.353 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:49.353 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:49.353 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle-0x5640b014e5b0": { 2024-05-14T15:42:49.353 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:49.353 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-05-14T15:42:49.353 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:49.353 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 2697, 2024-05-14T15:42:49.353 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 5272356, 2024-05-14T15:42:49.353 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:49.353 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 2697, 2024-05-14T15:42:49.353 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-05-14T15:42:49.353 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-05-14T15:42:49.353 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 923, 2024-05-14T15:42:49.353 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 5272356, 2024-05-14T15:42:49.354 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:49.354 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:49.354 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:49.354 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:49.354 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:49.354 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:49.354 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-05-14T15:42:49.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:49 smithi069 ceph-mon[31270]: pgmap v670: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-14T15:42:50.019 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:49 smithi092 ceph-mon[34729]: pgmap v670: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-14T15:42:50.036 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:49 smithi203 ceph-mon[34567]: pgmap v670: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-14T15:42:50.502 INFO:tasks.check_counter:Daemon mds.i mds.exported=15 2024-05-14T15:42:50.502 INFO:tasks.check_counter:Daemon mds.i mds.imported=29 2024-05-14T15:42:50.503 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=53 2024-05-14T15:42:50.503 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=586 2024-05-14T15:42:50.503 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-05-14T15:42:50.503 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-05-14T15:42:50.503 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-05-14T15:42:50.503 DEBUG:tasks.check_counter:Getting stats from l 2024-05-14T15:42:50.503 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph daemon mds.l perf dump 2024-05-14T15:42:51.039 INFO:teuthology.orchestra.run.smithi203.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.c/config 2024-05-14T15:42:51.808 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:51 smithi203 ceph-mon[34567]: pgmap v671: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-05-14T15:42:51.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:51 smithi069 ceph-mon[31270]: pgmap v671: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-05-14T15:42:52.066 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:51 smithi092 ceph-mon[34729]: pgmap v671: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-05-14T15:42:54.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:53 smithi203 ceph-mon[34567]: pgmap v672: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:42:54.097 INFO:teuthology.orchestra.run.smithi203.stdout:{ 2024-05-14T15:42:54.097 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-0": { 2024-05-14T15:42:54.097 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 1781, 2024-05-14T15:42:54.097 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 1783, 2024-05-14T15:42:54.098 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 4653393, 2024-05-14T15:42:54.098 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 566421, 2024-05-14T15:42:54.098 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 8, 2024-05-14T15:42:54.098 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 3, 2024-05-14T15:42:54.098 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.330003858, 2024-05-14T15:42:54.098 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.101727990, 2024-05-14T15:42:54.098 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.100286874, 2024-05-14T15:42:54.098 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.092668651, 2024-05-14T15:42:54.098 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:54.098 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 1781, 2024-05-14T15:42:54.098 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.184096749, 2024-05-14T15:42:54.098 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000103367 2024-05-14T15:42:54.098 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.099 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:54.099 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.099 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.099 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.099 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.099 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 0, 2024-05-14T15:42:54.099 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 0 2024-05-14T15:42:54.099 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.099 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-1": { 2024-05-14T15:42:54.099 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 560, 2024-05-14T15:42:54.099 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 486, 2024-05-14T15:42:54.099 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 2108862, 2024-05-14T15:42:54.099 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 282466, 2024-05-14T15:42:54.099 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 6, 2024-05-14T15:42:54.099 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 3, 2024-05-14T15:42:54.100 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.199407455, 2024-05-14T15:42:54.100 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.069707664, 2024-05-14T15:42:54.100 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.145747928, 2024-05-14T15:42:54.100 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.020976742, 2024-05-14T15:42:54.100 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:54.100 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 485, 2024-05-14T15:42:54.100 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.065573261, 2024-05-14T15:42:54.100 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000135202 2024-05-14T15:42:54.100 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.100 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:54.100 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.100 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.100 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.100 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.101 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 2107760, 2024-05-14T15:42:54.101 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 281824 2024-05-14T15:42:54.101 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.101 INFO:teuthology.orchestra.run.smithi203.stdout: "AsyncMessenger::Worker-2": { 2024-05-14T15:42:54.101 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_messages": 2987, 2024-05-14T15:42:54.101 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages": 3322, 2024-05-14T15:42:54.101 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_bytes": 1962008, 2024-05-14T15:42:54.101 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_bytes": 1606454, 2024-05-14T15:42:54.101 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_created_connections": 7, 2024-05-14T15:42:54.101 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_active_connections": 5, 2024-05-14T15:42:54.101 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_total_time": 0.609395440, 2024-05-14T15:42:54.101 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_send_time": 0.202403042, 2024-05-14T15:42:54.101 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_recv_time": 0.156457269, 2024-05-14T15:42:54.101 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_running_fast_dispatch_time": 0.183048679, 2024-05-14T15:42:54.101 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_messages_queue_lat": { 2024-05-14T15:42:54.102 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 3320, 2024-05-14T15:42:54.102 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.326193700, 2024-05-14T15:42:54.102 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000098251 2024-05-14T15:42:54.102 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.102 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_handle_ack_lat": { 2024-05-14T15:42:54.102 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.102 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.102 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.102 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.102 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_recv_encrypted_bytes": 3264, 2024-05-14T15:42:54.102 INFO:teuthology.orchestra.run.smithi203.stdout: "msgr_send_encrypted_bytes": 658496 2024-05-14T15:42:54.102 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.102 INFO:teuthology.orchestra.run.smithi203.stdout: "cct": { 2024-05-14T15:42:54.102 INFO:teuthology.orchestra.run.smithi203.stdout: "total_workers": 1, 2024-05-14T15:42:54.103 INFO:teuthology.orchestra.run.smithi203.stdout: "unhealthy_workers": 0 2024-05-14T15:42:54.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.103 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-MDSRank": { 2024-05-14T15:42:54.103 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-05-14T15:42:54.103 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-05-14T15:42:54.103 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 7974, 2024-05-14T15:42:54.103 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.419877170, 2024-05-14T15:42:54.103 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000052655 2024-05-14T15:42:54.103 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:54.103 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.103 INFO:teuthology.orchestra.run.smithi203.stdout: "finisher-PurgeQueue": { 2024-05-14T15:42:54.103 INFO:teuthology.orchestra.run.smithi203.stdout: "queue_len": 0, 2024-05-14T15:42:54.103 INFO:teuthology.orchestra.run.smithi203.stdout: "complete_latency": { 2024-05-14T15:42:54.103 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.104 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.104 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.104 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:54.104 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.104 INFO:teuthology.orchestra.run.smithi203.stdout: "mds": { 2024-05-14T15:42:54.104 INFO:teuthology.orchestra.run.smithi203.stdout: "request": 0, 2024-05-14T15:42:54.104 INFO:teuthology.orchestra.run.smithi203.stdout: "reply": 0, 2024-05-14T15:42:54.104 INFO:teuthology.orchestra.run.smithi203.stdout: "reply_latency": { 2024-05-14T15:42:54.104 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.104 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.104 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.104 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.104 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_reply": 0, 2024-05-14T15:42:54.104 INFO:teuthology.orchestra.run.smithi203.stdout: "forward": 0, 2024-05-14T15:42:54.105 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_complete": 0, 2024-05-14T15:42:54.105 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_fetch_keys": 0, 2024-05-14T15:42:54.105 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_commit": 0, 2024-05-14T15:42:54.105 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_split": 0, 2024-05-14T15:42:54.105 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_merge": 0, 2024-05-14T15:42:54.105 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes": 476, 2024-05-14T15:42:54.105 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_top": 72, 2024-05-14T15:42:54.105 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_bottom": 404, 2024-05-14T15:42:54.105 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pin_tail": 0, 2024-05-14T15:42:54.105 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_pinned": 373, 2024-05-14T15:42:54.105 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_expired": 0, 2024-05-14T15:42:54.105 INFO:teuthology.orchestra.run.smithi203.stdout: "inodes_with_caps": 0, 2024-05-14T15:42:54.105 INFO:teuthology.orchestra.run.smithi203.stdout: "caps": 0, 2024-05-14T15:42:54.105 INFO:teuthology.orchestra.run.smithi203.stdout: "subtrees": 11, 2024-05-14T15:42:54.106 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse": 0, 2024-05-14T15:42:54.106 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_hit": 0, 2024-05-14T15:42:54.106 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_forward": 0, 2024-05-14T15:42:54.106 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_discover": 0, 2024-05-14T15:42:54.106 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_dir_fetch": 0, 2024-05-14T15:42:54.106 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_remote_ino": 0, 2024-05-14T15:42:54.106 INFO:teuthology.orchestra.run.smithi203.stdout: "traverse_lock": 0, 2024-05-14T15:42:54.106 INFO:teuthology.orchestra.run.smithi203.stdout: "load_cent": 0, 2024-05-14T15:42:54.106 INFO:teuthology.orchestra.run.smithi203.stdout: "q": 0, 2024-05-14T15:42:54.106 INFO:teuthology.orchestra.run.smithi203.stdout: "exported": 0, 2024-05-14T15:42:54.106 INFO:teuthology.orchestra.run.smithi203.stdout: "exported_inodes": 0, 2024-05-14T15:42:54.106 INFO:teuthology.orchestra.run.smithi203.stdout: "imported": 0, 2024-05-14T15:42:54.106 INFO:teuthology.orchestra.run.smithi203.stdout: "imported_inodes": 0, 2024-05-14T15:42:54.106 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_dir_fetch": 0, 2024-05-14T15:42:54.106 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_backtrace_fetch": 0, 2024-05-14T15:42:54.107 INFO:teuthology.orchestra.run.smithi203.stdout: "openino_peer_discover": 0, 2024-05-14T15:42:54.107 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rfiles": 0, 2024-05-14T15:42:54.107 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rbytes": 0, 2024-05-14T15:42:54.107 INFO:teuthology.orchestra.run.smithi203.stdout: "root_rsnaps": 0, 2024-05-14T15:42:54.107 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_fetch": 0, 2024-05-14T15:42:54.107 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_set_tag": 0, 2024-05-14T15:42:54.107 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_backtrace_repaired": 0, 2024-05-14T15:42:54.107 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_inotable_repaired": 0, 2024-05-14T15:42:54.107 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_inodes": 0, 2024-05-14T15:42:54.107 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dir_base_inodes": 0, 2024-05-14T15:42:54.107 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_dirfrag_rstats": 0, 2024-05-14T15:42:54.107 INFO:teuthology.orchestra.run.smithi203.stdout: "scrub_file_inodes": 0, 2024-05-14T15:42:54.107 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_inode_file_caps": 0, 2024-05-14T15:42:54.107 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_revoke": 0, 2024-05-14T15:42:54.107 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_grant": 0, 2024-05-14T15:42:54.107 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_trunc": 0, 2024-05-14T15:42:54.108 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-05-14T15:42:54.108 INFO:teuthology.orchestra.run.smithi203.stdout: "ceph_cap_op_flush_ack": 0, 2024-05-14T15:42:54.108 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps": 0, 2024-05-14T15:42:54.108 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_caps_dirty": 0, 2024-05-14T15:42:54.108 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_cap_release": 0, 2024-05-14T15:42:54.108 INFO:teuthology.orchestra.run.smithi203.stdout: "process_request_cap_release": 0 2024-05-14T15:42:54.108 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.108 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_cache": { 2024-05-14T15:42:54.108 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update": 0, 2024-05-14T15:42:54.108 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_update_receipt": 0, 2024-05-14T15:42:54.108 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_try_discover": 0, 2024-05-14T15:42:54.108 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_send_discover": 0, 2024-05-14T15:42:54.108 INFO:teuthology.orchestra.run.smithi203.stdout: "dir_handle_discover": 0, 2024-05-14T15:42:54.108 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays": 0, 2024-05-14T15:42:54.108 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_delayed": 0, 2024-05-14T15:42:54.109 INFO:teuthology.orchestra.run.smithi203.stdout: "num_strays_enqueuing": 0, 2024-05-14T15:42:54.109 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_created": 0, 2024-05-14T15:42:54.109 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_enqueued": 0, 2024-05-14T15:42:54.109 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_reintegrated": 0, 2024-05-14T15:42:54.109 INFO:teuthology.orchestra.run.smithi203.stdout: "strays_migrated": 0, 2024-05-14T15:42:54.109 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_processing": 0, 2024-05-14T15:42:54.109 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_enqueued": 0, 2024-05-14T15:42:54.109 INFO:teuthology.orchestra.run.smithi203.stdout: "num_recovering_prioritized": 0, 2024-05-14T15:42:54.109 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_started": 0, 2024-05-14T15:42:54.109 INFO:teuthology.orchestra.run.smithi203.stdout: "recovery_completed": 0, 2024-05-14T15:42:54.109 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_path": 0, 2024-05-14T15:42:54.109 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_quiesce_inode": 0, 2024-05-14T15:42:54.109 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_enqueue_scrub": 0, 2024-05-14T15:42:54.109 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_exportdir": 0, 2024-05-14T15:42:54.110 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_flush": 0, 2024-05-14T15:42:54.110 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragmentdir": 0, 2024-05-14T15:42:54.110 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_fragstats": 0, 2024-05-14T15:42:54.110 INFO:teuthology.orchestra.run.smithi203.stdout: "ireq_inodestats": 0 2024-05-14T15:42:54.110 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.110 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_log": { 2024-05-14T15:42:54.110 INFO:teuthology.orchestra.run.smithi203.stdout: "evlrg": 0, 2024-05-14T15:42:54.110 INFO:teuthology.orchestra.run.smithi203.stdout: "evadd": 0, 2024-05-14T15:42:54.110 INFO:teuthology.orchestra.run.smithi203.stdout: "evex": 0, 2024-05-14T15:42:54.110 INFO:teuthology.orchestra.run.smithi203.stdout: "evtrm": 0, 2024-05-14T15:42:54.110 INFO:teuthology.orchestra.run.smithi203.stdout: "ev": 3544, 2024-05-14T15:42:54.110 INFO:teuthology.orchestra.run.smithi203.stdout: "evexg": 0, 2024-05-14T15:42:54.110 INFO:teuthology.orchestra.run.smithi203.stdout: "evexd": 0, 2024-05-14T15:42:54.110 INFO:teuthology.orchestra.run.smithi203.stdout: "segadd": 0, 2024-05-14T15:42:54.111 INFO:teuthology.orchestra.run.smithi203.stdout: "segex": 0, 2024-05-14T15:42:54.111 INFO:teuthology.orchestra.run.smithi203.stdout: "segtrm": 0, 2024-05-14T15:42:54.111 INFO:teuthology.orchestra.run.smithi203.stdout: "seg": 5, 2024-05-14T15:42:54.111 INFO:teuthology.orchestra.run.smithi203.stdout: "segmjr": 2, 2024-05-14T15:42:54.111 INFO:teuthology.orchestra.run.smithi203.stdout: "segexg": 0, 2024-05-14T15:42:54.111 INFO:teuthology.orchestra.run.smithi203.stdout: "segexd": 0, 2024-05-14T15:42:54.111 INFO:teuthology.orchestra.run.smithi203.stdout: "expos": 4194304, 2024-05-14T15:42:54.111 INFO:teuthology.orchestra.run.smithi203.stdout: "wrpos": 9474966, 2024-05-14T15:42:54.111 INFO:teuthology.orchestra.run.smithi203.stdout: "rdpos": 9474905, 2024-05-14T15:42:54.111 INFO:teuthology.orchestra.run.smithi203.stdout: "jlat": { 2024-05-14T15:42:54.111 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.111 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.111 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.111 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.111 INFO:teuthology.orchestra.run.smithi203.stdout: "replayed": 3544 2024-05-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_mem": { 2024-05-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi203.stdout: "ino": 410, 2024-05-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi203.stdout: "ino+": 1039, 2024-05-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi203.stdout: "ino-": 629, 2024-05-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi203.stdout: "dir": 23, 2024-05-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi203.stdout: "dir+": 64, 2024-05-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi203.stdout: "dir-": 41, 2024-05-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi203.stdout: "dn": 476, 2024-05-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi203.stdout: "dn+": 1112, 2024-05-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi203.stdout: "dn-": 636, 2024-05-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi203.stdout: "cap": 0, 2024-05-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi203.stdout: "cap+": 0, 2024-05-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi203.stdout: "cap-": 0, 2024-05-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi203.stdout: "rss": 122572, 2024-05-14T15:42:54.112 INFO:teuthology.orchestra.run.smithi203.stdout: "heap": 215440 2024-05-14T15:42:54.113 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.113 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_server": { 2024-05-14T15:42:54.113 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_client_request": 0, 2024-05-14T15:42:54.113 INFO:teuthology.orchestra.run.smithi203.stdout: "dispatch_server_request": 0, 2024-05-14T15:42:54.113 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_request": 0, 2024-05-14T15:42:54.113 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_client_session": 0, 2024-05-14T15:42:54.113 INFO:teuthology.orchestra.run.smithi203.stdout: "handle_peer_request": 0, 2024-05-14T15:42:54.113 INFO:teuthology.orchestra.run.smithi203.stdout: "req_create_latency": { 2024-05-14T15:42:54.113 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.113 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.113 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.113 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.113 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getattr_latency": { 2024-05-14T15:42:54.113 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.114 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.114 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.114 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.114 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getfilelock_latency": { 2024-05-14T15:42:54.114 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.114 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.114 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.114 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.114 INFO:teuthology.orchestra.run.smithi203.stdout: "req_link_latency": { 2024-05-14T15:42:54.114 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.114 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.114 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.114 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.114 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookup_latency": { 2024-05-14T15:42:54.114 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.115 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.115 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.115 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.115 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookuphash_latency": { 2024-05-14T15:42:54.115 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.115 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.115 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.115 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.115 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupino_latency": { 2024-05-14T15:42:54.115 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.115 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.115 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.115 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.115 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupname_latency": { 2024-05-14T15:42:54.115 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.116 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.116 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.116 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.116 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupparent_latency": { 2024-05-14T15:42:54.116 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.116 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.116 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.116 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.116 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lookupsnap_latency": { 2024-05-14T15:42:54.116 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.116 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.116 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.116 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.116 INFO:teuthology.orchestra.run.smithi203.stdout: "req_lssnap_latency": { 2024-05-14T15:42:54.116 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.116 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.117 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.117 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.117 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mkdir_latency": { 2024-05-14T15:42:54.117 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.117 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.117 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.117 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.117 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mknod_latency": { 2024-05-14T15:42:54.117 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.118 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.118 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.118 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.118 INFO:teuthology.orchestra.run.smithi203.stdout: "req_mksnap_latency": { 2024-05-14T15:42:54.118 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.118 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.118 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.118 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.118 INFO:teuthology.orchestra.run.smithi203.stdout: "req_open_latency": { 2024-05-14T15:42:54.118 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.118 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.118 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.118 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.118 INFO:teuthology.orchestra.run.smithi203.stdout: "req_readdir_latency": { 2024-05-14T15:42:54.119 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.119 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.119 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.119 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.119 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rename_latency": { 2024-05-14T15:42:54.119 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.119 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.119 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.119 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.119 INFO:teuthology.orchestra.run.smithi203.stdout: "req_renamesnap_latency": { 2024-05-14T15:42:54.119 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.119 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.119 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.119 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.119 INFO:teuthology.orchestra.run.smithi203.stdout: "req_snapdiff_latency": { 2024-05-14T15:42:54.120 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.120 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.120 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.120 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.120 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmdir_latency": { 2024-05-14T15:42:54.120 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.120 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.120 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.120 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.120 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmsnap_latency": { 2024-05-14T15:42:54.120 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.120 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.120 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.120 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.121 INFO:teuthology.orchestra.run.smithi203.stdout: "req_rmxattr_latency": { 2024-05-14T15:42:54.121 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.121 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.121 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.121 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.121 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setattr_latency": { 2024-05-14T15:42:54.121 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.121 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.121 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.121 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.121 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setdirlayout_latency": { 2024-05-14T15:42:54.121 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.121 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.121 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.121 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.122 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setfilelock_latency": { 2024-05-14T15:42:54.122 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.122 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.122 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.122 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.122 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setlayout_latency": { 2024-05-14T15:42:54.122 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.122 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.122 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.122 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.122 INFO:teuthology.orchestra.run.smithi203.stdout: "req_setxattr_latency": { 2024-05-14T15:42:54.122 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.122 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.123 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.123 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.123 INFO:teuthology.orchestra.run.smithi203.stdout: "req_symlink_latency": { 2024-05-14T15:42:54.123 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.123 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.123 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.123 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.123 INFO:teuthology.orchestra.run.smithi203.stdout: "req_unlink_latency": { 2024-05-14T15:42:54.123 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.123 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.123 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.123 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.123 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_revoke_eviction": 0, 2024-05-14T15:42:54.123 INFO:teuthology.orchestra.run.smithi203.stdout: "cap_acquisition_throttle": 0, 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: "req_getvxattr_latency": { 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_sessions": { 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: "session_count": 2, 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: "session_add": 4, 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: "session_remove": 2, 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_open": 3, 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: "sessions_stale": 0, 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: "total_load": 0, 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: "average_load": 0, 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: "avg_session_uptime": 3764, 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: "mdthresh_evicted": 0 2024-05-14T15:42:54.124 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.125 INFO:teuthology.orchestra.run.smithi203.stdout: "mempool": { 2024-05-14T15:42:54.125 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_bytes": 0, 2024-05-14T15:42:54.125 INFO:teuthology.orchestra.run.smithi203.stdout: "bloom_filter_items": 0, 2024-05-14T15:42:54.125 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_bytes": 0, 2024-05-14T15:42:54.125 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_alloc_items": 0, 2024-05-14T15:42:54.125 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_bytes": 0, 2024-05-14T15:42:54.125 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_data_items": 0, 2024-05-14T15:42:54.125 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_bytes": 0, 2024-05-14T15:42:54.125 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_onode_items": 0, 2024-05-14T15:42:54.125 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_bytes": 0, 2024-05-14T15:42:54.125 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_meta_items": 0, 2024-05-14T15:42:54.125 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_bytes": 0, 2024-05-14T15:42:54.125 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_other_items": 0, 2024-05-14T15:42:54.125 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_bytes": 0, 2024-05-14T15:42:54.125 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_cache_buffer_items": 0, 2024-05-14T15:42:54.125 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_bytes": 0, 2024-05-14T15:42:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_extent_items": 0, 2024-05-14T15:42:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_bytes": 0, 2024-05-14T15:42:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_blob_items": 0, 2024-05-14T15:42:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_bytes": 0, 2024-05-14T15:42:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_shared_blob_items": 0, 2024-05-14T15:42:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_bytes": 0, 2024-05-14T15:42:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_inline_bl_items": 0, 2024-05-14T15:42:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_bytes": 0, 2024-05-14T15:42:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_fsck_items": 0, 2024-05-14T15:42:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_bytes": 0, 2024-05-14T15:42:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_txc_items": 0, 2024-05-14T15:42:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_bytes": 0, 2024-05-14T15:42:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_deferred_items": 0, 2024-05-14T15:42:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_bytes": 0, 2024-05-14T15:42:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: "bluestore_writing_items": 0, 2024-05-14T15:42:54.126 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_bytes": 0, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_items": 0, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_bytes": 0, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_reader_items": 0, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_bytes": 0, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "bluefs_file_writer_items": 0, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_bytes": 208707, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_anon_items": 68, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_bytes": 0, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "buffer_meta_items": 0, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_bytes": 0, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_items": 0, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_bytes": 0, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_mapbl_items": 0, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_bytes": 0, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_pglog_items": 0, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_bytes": 9704, 2024-05-14T15:42:54.127 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_items": 186, 2024-05-14T15:42:54.128 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_bytes": 0, 2024-05-14T15:42:54.128 INFO:teuthology.orchestra.run.smithi203.stdout: "osdmap_mapping_items": 0, 2024-05-14T15:42:54.128 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_bytes": 0, 2024-05-14T15:42:54.128 INFO:teuthology.orchestra.run.smithi203.stdout: "pgmap_items": 0, 2024-05-14T15:42:54.128 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_bytes": 1277214, 2024-05-14T15:42:54.128 INFO:teuthology.orchestra.run.smithi203.stdout: "mds_co_items": 11808, 2024-05-14T15:42:54.128 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_bytes": 0, 2024-05-14T15:42:54.128 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_1_items": 0, 2024-05-14T15:42:54.128 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_bytes": 0, 2024-05-14T15:42:54.128 INFO:teuthology.orchestra.run.smithi203.stdout: "unittest_2_items": 0 2024-05-14T15:42:54.128 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.128 INFO:teuthology.orchestra.run.smithi203.stdout: "objecter": { 2024-05-14T15:42:54.128 INFO:teuthology.orchestra.run.smithi203.stdout: "op_active": 0, 2024-05-14T15:42:54.128 INFO:teuthology.orchestra.run.smithi203.stdout: "op_laggy": 0, 2024-05-14T15:42:54.128 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send": 4764, 2024-05-14T15:42:54.128 INFO:teuthology.orchestra.run.smithi203.stdout: "op_send_bytes": 21, 2024-05-14T15:42:54.129 INFO:teuthology.orchestra.run.smithi203.stdout: "op_resend": 3, 2024-05-14T15:42:54.129 INFO:teuthology.orchestra.run.smithi203.stdout: "op_reply": 4764, 2024-05-14T15:42:54.129 INFO:teuthology.orchestra.run.smithi203.stdout: "op_latency": { 2024-05-14T15:42:54.129 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 4764, 2024-05-14T15:42:54.129 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 10.035761514, 2024-05-14T15:42:54.129 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.002106583 2024-05-14T15:42:54.129 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.129 INFO:teuthology.orchestra.run.smithi203.stdout: "op_inflight": 0, 2024-05-14T15:42:54.129 INFO:teuthology.orchestra.run.smithi203.stdout: "oplen_avg": { 2024-05-14T15:42:54.129 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 4764, 2024-05-14T15:42:54.129 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 4765 2024-05-14T15:42:54.129 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.129 INFO:teuthology.orchestra.run.smithi203.stdout: "op": 4764, 2024-05-14T15:42:54.129 INFO:teuthology.orchestra.run.smithi203.stdout: "op_r": 4764, 2024-05-14T15:42:54.129 INFO:teuthology.orchestra.run.smithi203.stdout: "op_w": 0, 2024-05-14T15:42:54.130 INFO:teuthology.orchestra.run.smithi203.stdout: "op_rmw": 0, 2024-05-14T15:42:54.130 INFO:teuthology.orchestra.run.smithi203.stdout: "op_pg": 0, 2024-05-14T15:42:54.130 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_stat": 2919, 2024-05-14T15:42:54.130 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_create": 0, 2024-05-14T15:42:54.130 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_read": 1843, 2024-05-14T15:42:54.130 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_write": 0, 2024-05-14T15:42:54.130 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writefull": 0, 2024-05-14T15:42:54.130 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_writesame": 0, 2024-05-14T15:42:54.130 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_append": 0, 2024-05-14T15:42:54.130 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_zero": 0, 2024-05-14T15:42:54.130 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_truncate": 0, 2024-05-14T15:42:54.130 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_delete": 0, 2024-05-14T15:42:54.130 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_mapext": 0, 2024-05-14T15:42:54.130 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_sparse_read": 0, 2024-05-14T15:42:54.130 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_clonerange": 0, 2024-05-14T15:42:54.131 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_getxattr": 1, 2024-05-14T15:42:54.131 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_setxattr": 0, 2024-05-14T15:42:54.131 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_cmpxattr": 0, 2024-05-14T15:42:54.131 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_rmxattr": 0, 2024-05-14T15:42:54.131 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_resetxattrs": 0, 2024-05-14T15:42:54.131 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_call": 0, 2024-05-14T15:42:54.131 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_watch": 0, 2024-05-14T15:42:54.131 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_notify": 0, 2024-05-14T15:42:54.131 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_src_cmpxattr": 0, 2024-05-14T15:42:54.131 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls": 0, 2024-05-14T15:42:54.131 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_pgls_filter": 0, 2024-05-14T15:42:54.131 INFO:teuthology.orchestra.run.smithi203.stdout: "osdop_other": 0, 2024-05-14T15:42:54.131 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_active": 0, 2024-05-14T15:42:54.131 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_send": 0, 2024-05-14T15:42:54.131 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_resend": 0, 2024-05-14T15:42:54.132 INFO:teuthology.orchestra.run.smithi203.stdout: "linger_ping": 0, 2024-05-14T15:42:54.132 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_active": 0, 2024-05-14T15:42:54.132 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_send": 0, 2024-05-14T15:42:54.132 INFO:teuthology.orchestra.run.smithi203.stdout: "poolop_resend": 0, 2024-05-14T15:42:54.132 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_active": 0, 2024-05-14T15:42:54.132 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_send": 0, 2024-05-14T15:42:54.132 INFO:teuthology.orchestra.run.smithi203.stdout: "poolstat_resend": 0, 2024-05-14T15:42:54.132 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_active": 0, 2024-05-14T15:42:54.132 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_send": 0, 2024-05-14T15:42:54.132 INFO:teuthology.orchestra.run.smithi203.stdout: "statfs_resend": 0, 2024-05-14T15:42:54.132 INFO:teuthology.orchestra.run.smithi203.stdout: "command_active": 0, 2024-05-14T15:42:54.132 INFO:teuthology.orchestra.run.smithi203.stdout: "command_send": 0, 2024-05-14T15:42:54.132 INFO:teuthology.orchestra.run.smithi203.stdout: "command_resend": 0, 2024-05-14T15:42:54.132 INFO:teuthology.orchestra.run.smithi203.stdout: "map_epoch": 124, 2024-05-14T15:42:54.132 INFO:teuthology.orchestra.run.smithi203.stdout: "map_full": 0, 2024-05-14T15:42:54.133 INFO:teuthology.orchestra.run.smithi203.stdout: "map_inc": 35, 2024-05-14T15:42:54.133 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_sessions": 7, 2024-05-14T15:42:54.133 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_open": 10, 2024-05-14T15:42:54.133 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_session_close": 3, 2024-05-14T15:42:54.133 INFO:teuthology.orchestra.run.smithi203.stdout: "osd_laggy": 0, 2024-05-14T15:42:54.133 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_wr": 0, 2024-05-14T15:42:54.133 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_rd": 2, 2024-05-14T15:42:54.133 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_del": 0 2024-05-14T15:42:54.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.133 INFO:teuthology.orchestra.run.smithi203.stdout: "oft": { 2024-05-14T15:42:54.133 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_objs": 0, 2024-05-14T15:42:54.133 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_kv_pairs": 0, 2024-05-14T15:42:54.133 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_updates": 0, 2024-05-14T15:42:54.133 INFO:teuthology.orchestra.run.smithi203.stdout: "omap_total_removes": 0 2024-05-14T15:42:54.133 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.134 INFO:teuthology.orchestra.run.smithi203.stdout: "osd-slow-ops": { 2024-05-14T15:42:54.134 INFO:teuthology.orchestra.run.smithi203.stdout: "slow_ops_count": 0 2024-05-14T15:42:54.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.134 INFO:teuthology.orchestra.run.smithi203.stdout: "purge_queue": { 2024-05-14T15:42:54.134 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops": 0, 2024-05-14T15:42:54.134 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_ops_high_water": 0, 2024-05-14T15:42:54.134 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing": 0, 2024-05-14T15:42:54.134 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executing_high_water": 0, 2024-05-14T15:42:54.134 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed_ops": 0, 2024-05-14T15:42:54.134 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_executed": 0, 2024-05-14T15:42:54.134 INFO:teuthology.orchestra.run.smithi203.stdout: "pq_item_in_journal": 0 2024-05-14T15:42:54.134 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.134 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-05-14T15:42:54.134 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:54.134 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-05-14T15:42:54.134 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:54.135 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 5324, 2024-05-14T15:42:54.135 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 8213773, 2024-05-14T15:42:54.135 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:54.135 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 5324, 2024-05-14T15:42:54.135 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-05-14T15:42:54.135 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-05-14T15:42:54.135 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 5324, 2024-05-14T15:42:54.135 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 8213773, 2024-05-14T15:42:54.135 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:54.135 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.135 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.135 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.135 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:54.135 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.135 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_bytes": { 2024-05-14T15:42:54.135 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:54.136 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 104857600, 2024-05-14T15:42:54.136 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:54.136 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-05-14T15:42:54.136 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-05-14T15:42:54.136 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:54.136 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:54.136 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 4764, 2024-05-14T15:42:54.136 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 5280667, 2024-05-14T15:42:54.136 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 4764, 2024-05-14T15:42:54.136 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 5280667, 2024-05-14T15:42:54.136 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:54.136 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.136 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.136 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.137 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:54.137 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.137 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-objecter_ops": { 2024-05-14T15:42:54.137 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:54.137 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 1024, 2024-05-14T15:42:54.137 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:54.137 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-05-14T15:42:54.137 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-05-14T15:42:54.137 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:54.137 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:54.137 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 4764, 2024-05-14T15:42:54.137 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 4764, 2024-05-14T15:42:54.137 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 4764, 2024-05-14T15:42:54.137 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 4764, 2024-05-14T15:42:54.137 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:54.138 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.138 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.138 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.138 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:54.138 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.138 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle": { 2024-05-14T15:42:54.138 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:54.138 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-05-14T15:42:54.138 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:54.138 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-05-14T15:42:54.138 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-05-14T15:42:54.138 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:54.138 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:54.138 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-05-14T15:42:54.138 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-05-14T15:42:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 0, 2024-05-14T15:42:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 0, 2024-05-14T15:42:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: }, 2024-05-14T15:42:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: "throttle-write_buf_throttle-0x559643d488f0": { 2024-05-14T15:42:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: "val": 0, 2024-05-14T15:42:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: "max": 3758096384, 2024-05-14T15:42:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: "get_started": 0, 2024-05-14T15:42:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: "get": 0, 2024-05-14T15:42:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: "get_sum": 0, 2024-05-14T15:42:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_fail": 0, 2024-05-14T15:42:54.139 INFO:teuthology.orchestra.run.smithi203.stdout: "get_or_fail_success": 0, 2024-05-14T15:42:54.140 INFO:teuthology.orchestra.run.smithi203.stdout: "take": 0, 2024-05-14T15:42:54.140 INFO:teuthology.orchestra.run.smithi203.stdout: "take_sum": 0, 2024-05-14T15:42:54.140 INFO:teuthology.orchestra.run.smithi203.stdout: "put": 0, 2024-05-14T15:42:54.140 INFO:teuthology.orchestra.run.smithi203.stdout: "put_sum": 0, 2024-05-14T15:42:54.140 INFO:teuthology.orchestra.run.smithi203.stdout: "wait": { 2024-05-14T15:42:54.140 INFO:teuthology.orchestra.run.smithi203.stdout: "avgcount": 0, 2024-05-14T15:42:54.140 INFO:teuthology.orchestra.run.smithi203.stdout: "sum": 0.000000000, 2024-05-14T15:42:54.140 INFO:teuthology.orchestra.run.smithi203.stdout: "avgtime": 0.000000000 2024-05-14T15:42:54.140 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:54.140 INFO:teuthology.orchestra.run.smithi203.stdout: } 2024-05-14T15:42:54.140 INFO:teuthology.orchestra.run.smithi203.stdout:} 2024-05-14T15:42:54.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:53 smithi092 ceph-mon[34729]: pgmap v672: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:42:54.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:53 smithi069 ceph-mon[31270]: pgmap v672: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.0 KiB/s rd, 9 op/s 2024-05-14T15:42:55.353 INFO:tasks.check_counter:Daemon mds.l mds.exported=0 2024-05-14T15:42:55.353 INFO:tasks.check_counter:Daemon mds.l mds.imported=0 2024-05-14T15:42:55.353 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update=0 2024-05-14T15:42:55.353 INFO:tasks.check_counter:Daemon mds.l mds_cache.dir_update_receipt=0 2024-05-14T15:42:55.353 INFO:tasks.check_counter:Daemon mds.l mds.root_rsnaps=0 2024-05-14T15:42:55.354 INFO:tasks.check_counter:Daemon mds.l mds_server.req_mksnap_latency.avgcount=0 2024-05-14T15:42:55.354 INFO:tasks.check_counter:Daemon mds.l mds_server.req_rmsnap_latency.avgcount=0 2024-05-14T15:42:55.354 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-14T15:42:55.365 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-14T15:42:55.365 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:42:55.365 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:42:55.433 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:42:55.434 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:42:55.489 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd blocklist ls 2024-05-14T15:42:55.942 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:42:55.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:55 smithi069 ceph-mon[31270]: pgmap v673: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:42:56.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:55 smithi203 ceph-mon[34567]: pgmap v673: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:42:56.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:55 smithi092 ceph-mon[34729]: pgmap v673: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 9 op/s 2024-05-14T15:42:57.972 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:57 smithi069 ceph-mon[31270]: pgmap v674: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-05-14T15:42:58.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:57 smithi203 ceph-mon[34567]: pgmap v674: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-05-14T15:42:58.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:57 smithi092 ceph-mon[34729]: pgmap v674: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 10 op/s 2024-05-14T15:42:58.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.325+0000 7fd53ac00700 1 -- 172.21.15.69:0/2398310571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd53410a7c0 msgr2=0x7fd53410abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:42:58.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.325+0000 7fd53ac00700 1 --2- 172.21.15.69:0/2398310571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd53410a7c0 0x7fd53410abd0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7fd520009990 tx=0x7fd520009ca0 comp rx=0 tx=0).stop 2024-05-14T15:42:58.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.325+0000 7fd53ac00700 1 -- 172.21.15.69:0/2398310571 shutdown_connections 2024-05-14T15:42:58.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.325+0000 7fd53ac00700 1 --2- 172.21.15.69:0/2398310571 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd53410b110 0x7fd534117620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:58.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.325+0000 7fd53ac00700 1 --2- 172.21.15.69:0/2398310571 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd53410f6c0 0x7fd53410fad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:58.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.325+0000 7fd53ac00700 1 --2- 172.21.15.69:0/2398310571 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd53410a7c0 0x7fd53410abd0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:58.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.325+0000 7fd53ac00700 1 -- 172.21.15.69:0/2398310571 >> 172.21.15.69:0/2398310571 conn(0x7fd534076b00 msgr2=0x7fd534076f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:42:58.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.326+0000 7fd53ac00700 1 -- 172.21.15.69:0/2398310571 shutdown_connections 2024-05-14T15:42:58.328 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.326+0000 7fd53ac00700 1 -- 172.21.15.69:0/2398310571 wait complete. 2024-05-14T15:42:58.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.327+0000 7fd53ac00700 1 Processor -- start 2024-05-14T15:42:58.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.327+0000 7fd53ac00700 1 -- start start 2024-05-14T15:42:58.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.327+0000 7fd53ac00700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd53410a7c0 0x7fd5341a11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:42:58.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.327+0000 7fd53ac00700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd53410b110 0x7fd5341a1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:42:58.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.327+0000 7fd53ac00700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd53410f6c0 0x7fd5341a59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:42:58.329 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.327+0000 7fd53ac00700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7fd53411a7b0 con 0x7fd53410a7c0 2024-05-14T15:42:58.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.327+0000 7fd53ac00700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7fd53411a630 con 0x7fd53410b110 2024-05-14T15:42:58.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.327+0000 7fd53ac00700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7fd53411a930 con 0x7fd53410f6c0 2024-05-14T15:42:58.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.328+0000 7fd539800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd53410a7c0 0x7fd5341a11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:42:58.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.328+0000 7fd539800700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd53410a7c0 0x7fd5341a11c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42950/0 (socket says 172.21.15.69:42950) 2024-05-14T15:42:58.330 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.328+0000 7fd539800700 1 -- 172.21.15.69:0/2956147751 learned_addr learned my addr 172.21.15.69:0/2956147751 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:42:58.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.328+0000 7fd538e00700 1 --2- 172.21.15.69:0/2956147751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd53410b110 0x7fd5341a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:42:58.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.328+0000 7fd53a200700 1 --2- 172.21.15.69:0/2956147751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd53410f6c0 0x7fd5341a59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:42:58.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.328+0000 7fd539800700 1 -- 172.21.15.69:0/2956147751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd53410f6c0 msgr2=0x7fd5341a59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:42:58.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.328+0000 7fd539800700 1 --2- 172.21.15.69:0/2956147751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd53410f6c0 0x7fd5341a59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:58.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.328+0000 7fd539800700 1 -- 172.21.15.69:0/2956147751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd53410b110 msgr2=0x7fd5341a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:42:58.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.328+0000 7fd539800700 1 --2- 172.21.15.69:0/2956147751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd53410b110 0x7fd5341a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:58.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.328+0000 7fd539800700 1 -- 172.21.15.69:0/2956147751 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5341a6090 con 0x7fd53410a7c0 2024-05-14T15:42:58.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.328+0000 7fd53a200700 1 --2- 172.21.15.69:0/2956147751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd53410f6c0 0x7fd5341a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:42:58.331 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.329+0000 7fd539800700 1 --2- 172.21.15.69:0/2956147751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd53410a7c0 0x7fd5341a11c0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fd52800d950 tx=0x7fd52800dd10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:42:58.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.329+0000 7fd532000700 1 -- 172.21.15.69:0/2956147751 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd528016070 con 0x7fd53410a7c0 2024-05-14T15:42:58.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.329+0000 7fd532000700 1 -- 172.21.15.69:0/2956147751 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7fd528010460 con 0x7fd53410a7c0 2024-05-14T15:42:58.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.329+0000 7fd53ac00700 1 -- 172.21.15.69:0/2956147751 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5341a6380 con 0x7fd53410a7c0 2024-05-14T15:42:58.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.329+0000 7fd532000700 1 -- 172.21.15.69:0/2956147751 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd52800f620 con 0x7fd53410a7c0 2024-05-14T15:42:58.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.329+0000 7fd53ac00700 1 -- 172.21.15.69:0/2956147751 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5341adca0 con 0x7fd53410a7c0 2024-05-14T15:42:58.332 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.330+0000 7fd53ac00700 1 -- 172.21.15.69:0/2956147751 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5340512c0 con 0x7fd53410a7c0 2024-05-14T15:42:58.335 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.333+0000 7fd532000700 1 -- 172.21.15.69:0/2956147751 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7fd528019070 con 0x7fd53410a7c0 2024-05-14T15:42:58.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.334+0000 7fd532000700 1 --2- 172.21.15.69:0/2956147751 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd51c0b2a70 0x7fd51c0b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:42:58.336 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.335+0000 7fd532000700 1 -- 172.21.15.69:0/2956147751 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 9554+0+0 (secure 0 0 0) 0x7fd5280e2960 con 0x7fd53410a7c0 2024-05-14T15:42:58.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.335+0000 7fd538e00700 1 --2- 172.21.15.69:0/2956147751 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd51c0b2a70 0x7fd51c0b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:42:58.337 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.336+0000 7fd538e00700 1 --2- 172.21.15.69:0/2956147751 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd51c0b2a70 0x7fd51c0b4f80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd52000b5c0 tx=0x7fd520005fb0 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:42:58.339 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.337+0000 7fd532000700 1 -- 172.21.15.69:0/2956147751 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7fd5280a9ed0 con 0x7fd53410a7c0 2024-05-14T15:42:58.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.582+0000 7fd53ac00700 1 -- 172.21.15.69:0/2956147751 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd5341a2550 con 0x7fd53410a7c0 2024-05-14T15:42:58.584 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.583+0000 7fd532000700 1 -- 172.21.15.69:0/2956147751 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v124) ==== 81+0+941 (secure 0 0 0) 0x7fd5341a2550 con 0x7fd53410a7c0 2024-05-14T15:42:58.585 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/979899385 2024-05-15T15:21:37.785013+0000 2024-05-14T15:42:58.585 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3660048780 2024-05-15T15:21:37.785013+0000 2024-05-14T15:42:58.585 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/151981233 2024-05-15T15:05:41.383453+0000 2024-05-14T15:42:58.585 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3776172313 2024-05-15T15:05:41.383453+0000 2024-05-14T15:42:58.585 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/2537958790 2024-05-15T15:21:37.785013+0000 2024-05-14T15:42:58.585 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3403928589 2024-05-15T15:21:37.785013+0000 2024-05-14T15:42:58.585 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/1288620257 2024-05-15T15:05:41.383453+0000 2024-05-14T15:42:58.585 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/2718114316 2024-05-15T15:05:41.383453+0000 2024-05-14T15:42:58.585 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/586229880 2024-05-15T15:05:06.373096+0000 2024-05-14T15:42:58.585 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/865506483 2024-05-15T15:21:37.785013+0000 2024-05-14T15:42:58.586 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/1655882616 2024-05-15T15:05:06.373096+0000 2024-05-14T15:42:58.586 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/4183332474 2024-05-15T15:05:06.373096+0000 2024-05-14T15:42:58.586 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/586229880 2024-05-15T15:05:06.373096+0000 2024-05-14T15:42:58.586 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/2806878946 2024-05-15T15:05:06.373096+0000 2024-05-14T15:42:58.586 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/2537958790 2024-05-15T15:21:37.785013+0000 2024-05-14T15:42:58.586 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/2718114316 2024-05-15T15:05:41.383453+0000 2024-05-14T15:42:58.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.586+0000 7fd53ac00700 1 -- 172.21.15.69:0/2956147751 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd51c0b2a70 msgr2=0x7fd51c0b4f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:42:58.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.586+0000 7fd53ac00700 1 --2- 172.21.15.69:0/2956147751 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd51c0b2a70 0x7fd51c0b4f80 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fd52000b5c0 tx=0x7fd520005fb0 comp rx=0 tx=0).stop 2024-05-14T15:42:58.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.586+0000 7fd53ac00700 1 -- 172.21.15.69:0/2956147751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd53410a7c0 msgr2=0x7fd5341a11c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:42:58.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.586+0000 7fd53ac00700 1 --2- 172.21.15.69:0/2956147751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd53410a7c0 0x7fd5341a11c0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fd52800d950 tx=0x7fd52800dd10 comp rx=0 tx=0).stop 2024-05-14T15:42:58.588 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.586+0000 7fd53ac00700 1 -- 172.21.15.69:0/2956147751 shutdown_connections 2024-05-14T15:42:58.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.586+0000 7fd53ac00700 1 --2- 172.21.15.69:0/2956147751 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7fd51c0b2a70 0x7fd51c0b4f80 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:58.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.586+0000 7fd53ac00700 1 --2- 172.21.15.69:0/2956147751 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7fd53410a7c0 0x7fd5341a11c0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:58.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.586+0000 7fd53ac00700 1 --2- 172.21.15.69:0/2956147751 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7fd53410f6c0 0x7fd5341a59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:58.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.586+0000 7fd53ac00700 1 --2- 172.21.15.69:0/2956147751 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7fd53410b110 0x7fd5341a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:42:58.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.586+0000 7fd53ac00700 1 -- 172.21.15.69:0/2956147751 >> 172.21.15.69:0/2956147751 conn(0x7fd534076b00 msgr2=0x7fd534108980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:42:58.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.587+0000 7fd53ac00700 1 -- 172.21.15.69:0/2956147751 shutdown_connections 2024-05-14T15:42:58.589 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:42:58.587+0000 7fd53ac00700 1 -- 172.21.15.69:0/2956147751 wait complete. 2024-05-14T15:42:58.590 INFO:teuthology.orchestra.run.smithi069.stderr:listed 16 entries 2024-05-14T15:42:58.971 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:58 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/2956147751' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T15:42:59.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:58 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/2956147751' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T15:42:59.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:58 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/2956147751' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T15:42:59.451 DEBUG:teuthology.orchestra.run.smithi069:> set -ex 2024-05-14T15:42:59.452 DEBUG:teuthology.orchestra.run.smithi069:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-14T15:42:59.502 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780 shell --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 -- ceph osd blocklist ls 2024-05-14T15:42:59.973 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:42:59 smithi069 ceph-mon[31270]: pgmap v675: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-14T15:42:59.984 INFO:teuthology.orchestra.run.smithi069.stderr:Inferring config /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/mon.a/config 2024-05-14T15:43:00.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:42:59 smithi203 ceph-mon[34567]: pgmap v675: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-14T15:43:00.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:42:59 smithi092 ceph-mon[34729]: pgmap v675: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 8 op/s 2024-05-14T15:43:01.943 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:43:01 smithi092 ceph-mon[34729]: pgmap v676: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-05-14T15:43:02.030 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:43:01 smithi069 ceph-mon[31270]: pgmap v676: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-05-14T15:43:02.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:43:01 smithi203 ceph-mon[34567]: pgmap v676: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 11 op/s 2024-05-14T15:43:02.440 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.438+0000 7f51e1600700 1 -- 172.21.15.69:0/2808119796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51dc10e8f0 msgr2=0x7f51dc110dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:43:02.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.438+0000 7f51e1600700 1 --2- 172.21.15.69:0/2808119796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51dc10e8f0 0x7f51dc110dd0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f51d400b0a0 tx=0x7f51d400b3b0 comp rx=0 tx=0).stop 2024-05-14T15:43:02.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.438+0000 7f51e1600700 1 -- 172.21.15.69:0/2808119796 shutdown_connections 2024-05-14T15:43:02.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.438+0000 7f51e1600700 1 --2- 172.21.15.69:0/2808119796 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51dc10e8f0 0x7f51dc110dd0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:43:02.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.438+0000 7f51e1600700 1 --2- 172.21.15.69:0/2808119796 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51dc105480 0x7f51dc105890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:43:02.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.438+0000 7f51e1600700 1 --2- 172.21.15.69:0/2808119796 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51dc105dd0 0x7f51dc10e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:43:02.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.438+0000 7f51e1600700 1 -- 172.21.15.69:0/2808119796 >> 172.21.15.69:0/2808119796 conn(0x7f51dc0fef30 msgr2=0x7f51dc101350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:43:02.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.439+0000 7f51e1600700 1 -- 172.21.15.69:0/2808119796 shutdown_connections 2024-05-14T15:43:02.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.439+0000 7f51e1600700 1 -- 172.21.15.69:0/2808119796 wait complete. 2024-05-14T15:43:02.441 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.440+0000 7f51e1600700 1 Processor -- start 2024-05-14T15:43:02.442 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.440+0000 7f51e1600700 1 -- start start 2024-05-14T15:43:02.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.440+0000 7f51e1600700 1 --2- >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51dc105480 0x7f51dc19ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:43:02.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.440+0000 7f51e1600700 1 --2- >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51dc105dd0 0x7f51dc19d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:43:02.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.440+0000 7f51e1600700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51dc10e8f0 0x7f51dc1a1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:43:02.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.440+0000 7f51e1600700 1 -- --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_getmap magic: 0 -- 0x7f51dc114300 con 0x7f51dc10e8f0 2024-05-14T15:43:02.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.440+0000 7f51e1600700 1 -- --> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] -- mon_getmap magic: 0 -- 0x7f51dc114180 con 0x7f51dc105480 2024-05-14T15:43:02.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.440+0000 7f51e1600700 1 -- --> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] -- mon_getmap magic: 0 -- 0x7f51dc114480 con 0x7f51dc105dd0 2024-05-14T15:43:02.443 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.441+0000 7f51db400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51dc10e8f0 0x7f51dc1a1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:43:02.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.441+0000 7f51db400700 1 --2- >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51dc10e8f0 0x7f51dc1a1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.69:3300/0 says I am v2:172.21.15.69:42968/0 (socket says 172.21.15.69:42968) 2024-05-14T15:43:02.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.441+0000 7f51db400700 1 -- 172.21.15.69:0/1423304396 learned_addr learned my addr 172.21.15.69:0/1423304396 (peer_addr_for_me v2:172.21.15.69:0/0) 2024-05-14T15:43:02.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.441+0000 7f51da000700 1 --2- 172.21.15.69:0/1423304396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51dc105dd0 0x7f51dc19d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:43:02.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.441+0000 7f51daa00700 1 --2- 172.21.15.69:0/1423304396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51dc105480 0x7f51dc19ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:43:02.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.441+0000 7f51db400700 1 -- 172.21.15.69:0/1423304396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51dc105dd0 msgr2=0x7f51dc19d470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:43:02.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.441+0000 7f51db400700 1 --2- 172.21.15.69:0/1423304396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51dc105dd0 0x7f51dc19d470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:43:02.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.441+0000 7f51db400700 1 -- 172.21.15.69:0/1423304396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51dc105480 msgr2=0x7f51dc19ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:43:02.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.441+0000 7f51db400700 1 --2- 172.21.15.69:0/1423304396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51dc105480 0x7f51dc19ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:43:02.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.441+0000 7f51db400700 1 -- 172.21.15.69:0/1423304396 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51dc1a1cf0 con 0x7f51dc10e8f0 2024-05-14T15:43:02.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.441+0000 7f51daa00700 1 --2- 172.21.15.69:0/1423304396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51dc105480 0x7f51dc19ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-14T15:43:02.444 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.442+0000 7f51db400700 1 --2- 172.21.15.69:0/1423304396 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51dc10e8f0 0x7f51dc1a1700 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f51d400b830 tx=0x7f51d4004db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:43:02.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.442+0000 7f51d3400700 1 -- 172.21.15.69:0/1423304396 <== mon.0 v2:172.21.15.69:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d4021070 con 0x7f51dc10e8f0 2024-05-14T15:43:02.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.442+0000 7f51d3400700 1 -- 172.21.15.69:0/1423304396 <== mon.0 v2:172.21.15.69:3300/0 2 ==== config(25 keys) ==== 1063+0+0 (secure 0 0 0) 0x7f51d4007c80 con 0x7f51dc10e8f0 2024-05-14T15:43:02.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.442+0000 7f51e1600700 1 -- 172.21.15.69:0/1423304396 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51dc1a1f80 con 0x7f51dc10e8f0 2024-05-14T15:43:02.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.442+0000 7f51d3400700 1 -- 172.21.15.69:0/1423304396 <== mon.0 v2:172.21.15.69:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d4005260 con 0x7f51dc10e8f0 2024-05-14T15:43:02.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.442+0000 7f51e1600700 1 -- 172.21.15.69:0/1423304396 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51dc1a2460 con 0x7f51dc10e8f0 2024-05-14T15:43:02.445 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.443+0000 7f51e1600700 1 -- 172.21.15.69:0/1423304396 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51dc0512c0 con 0x7f51dc10e8f0 2024-05-14T15:43:02.447 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.446+0000 7f51d3400700 1 -- 172.21.15.69:0/1423304396 <== mon.0 v2:172.21.15.69:3300/0 4 ==== mgrmap(e 25) ==== 149783+0+0 (secure 0 0 0) 0x7f51d4024070 con 0x7f51dc10e8f0 2024-05-14T15:43:02.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.447+0000 7f51d3400700 1 --2- 172.21.15.69:0/1423304396 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f51c00b29f0 0x7f51c00b4f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-14T15:43:02.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.447+0000 7f51d3400700 1 -- 172.21.15.69:0/1423304396 <== mon.0 v2:172.21.15.69:3300/0 5 ==== osd_map(124..124 src has 1..124) ==== 9554+0+0 (secure 0 0 0) 0x7f51d400f020 con 0x7f51dc10e8f0 2024-05-14T15:43:02.449 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.448+0000 7f51daa00700 1 --2- 172.21.15.69:0/1423304396 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f51c00b29f0 0x7f51c00b4f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-14T15:43:02.450 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.449+0000 7f51daa00700 1 --2- 172.21.15.69:0/1423304396 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f51c00b29f0 0x7f51c00b4f00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f51cc005fd0 tx=0x7f51cc005e20 comp rx=0 tx=0).ready entity=mgr.34991 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-14T15:43:02.452 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.450+0000 7f51d3400700 1 -- 172.21.15.69:0/1423304396 <== mon.0 v2:172.21.15.69:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+191963 (secure 0 0 0) 0x7f51d402b020 con 0x7f51dc10e8f0 2024-05-14T15:43:02.698 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.696+0000 7f51e1600700 1 -- 172.21.15.69:0/1423304396 --> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f51dc02e5f0 con 0x7f51dc10e8f0 2024-05-14T15:43:02.699 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.697+0000 7f51d3400700 1 -- 172.21.15.69:0/1423304396 <== mon.0 v2:172.21.15.69:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v124) ==== 81+0+941 (secure 0 0 0) 0x7f51d40abb60 con 0x7f51dc10e8f0 2024-05-14T15:43:02.699 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/979899385 2024-05-15T15:21:37.785013+0000 2024-05-14T15:43:02.699 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3660048780 2024-05-15T15:21:37.785013+0000 2024-05-14T15:43:02.700 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/151981233 2024-05-15T15:05:41.383453+0000 2024-05-14T15:43:02.700 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3776172313 2024-05-15T15:05:41.383453+0000 2024-05-14T15:43:02.700 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/2537958790 2024-05-15T15:21:37.785013+0000 2024-05-14T15:43:02.700 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/3403928589 2024-05-15T15:21:37.785013+0000 2024-05-14T15:43:02.700 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/1288620257 2024-05-15T15:05:41.383453+0000 2024-05-14T15:43:02.700 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/2718114316 2024-05-15T15:05:41.383453+0000 2024-05-14T15:43:02.700 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6801/586229880 2024-05-15T15:05:06.373096+0000 2024-05-14T15:43:02.700 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/865506483 2024-05-15T15:21:37.785013+0000 2024-05-14T15:43:02.700 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/1655882616 2024-05-15T15:05:06.373096+0000 2024-05-14T15:43:02.700 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/4183332474 2024-05-15T15:05:06.373096+0000 2024-05-14T15:43:02.700 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/586229880 2024-05-15T15:05:06.373096+0000 2024-05-14T15:43:02.700 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:0/2806878946 2024-05-15T15:05:06.373096+0000 2024-05-14T15:43:02.700 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/2537958790 2024-05-15T15:21:37.785013+0000 2024-05-14T15:43:02.700 INFO:teuthology.orchestra.run.smithi069.stdout:172.21.15.69:6800/2718114316 2024-05-15T15:05:41.383453+0000 2024-05-14T15:43:02.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.701+0000 7f51e1600700 1 -- 172.21.15.69:0/1423304396 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f51c00b29f0 msgr2=0x7f51c00b4f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:43:02.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.701+0000 7f51e1600700 1 --2- 172.21.15.69:0/1423304396 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f51c00b29f0 0x7f51c00b4f00 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f51cc005fd0 tx=0x7f51cc005e20 comp rx=0 tx=0).stop 2024-05-14T15:43:02.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.701+0000 7f51e1600700 1 -- 172.21.15.69:0/1423304396 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51dc10e8f0 msgr2=0x7f51dc1a1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-14T15:43:02.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.701+0000 7f51e1600700 1 --2- 172.21.15.69:0/1423304396 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51dc10e8f0 0x7f51dc1a1700 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f51d400b830 tx=0x7f51d4004db0 comp rx=0 tx=0).stop 2024-05-14T15:43:02.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.701+0000 7f51e1600700 1 -- 172.21.15.69:0/1423304396 shutdown_connections 2024-05-14T15:43:02.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.701+0000 7f51e1600700 1 --2- 172.21.15.69:0/1423304396 >> [v2:172.21.15.69:6800/1271399048,v1:172.21.15.69:6801/1271399048] conn(0x7f51c00b29f0 0x7f51c00b4f00 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:43:02.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.701+0000 7f51e1600700 1 --2- 172.21.15.69:0/1423304396 >> [v2:172.21.15.69:3300/0,v1:172.21.15.69:6789/0] conn(0x7f51dc10e8f0 0x7f51dc1a1700 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:43:02.703 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.701+0000 7f51e1600700 1 --2- 172.21.15.69:0/1423304396 >> [v2:172.21.15.92:3300/0,v1:172.21.15.92:6789/0] conn(0x7f51dc105480 0x7f51dc19ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:43:02.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.701+0000 7f51e1600700 1 --2- 172.21.15.69:0/1423304396 >> [v2:172.21.15.203:3300/0,v1:172.21.15.203:6789/0] conn(0x7f51dc105dd0 0x7f51dc19d470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-14T15:43:02.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.701+0000 7f51e1600700 1 -- 172.21.15.69:0/1423304396 >> 172.21.15.69:0/1423304396 conn(0x7f51dc0fef30 msgr2=0x7f51dc1031e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-14T15:43:02.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.701+0000 7f51e1600700 1 -- 172.21.15.69:0/1423304396 shutdown_connections 2024-05-14T15:43:02.704 INFO:teuthology.orchestra.run.smithi069.stderr:2024-05-14T15:43:02.701+0000 7f51e1600700 1 -- 172.21.15.69:0/1423304396 wait complete. 2024-05-14T15:43:02.704 INFO:teuthology.orchestra.run.smithi069.stderr:listed 16 entries 2024-05-14T15:43:02.974 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:43:02 smithi069 ceph-mon[31270]: from='client.? 172.21.15.69:0/1423304396' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T15:43:03.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:43:02 smithi203 ceph-mon[34567]: from='client.? 172.21.15.69:0/1423304396' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T15:43:03.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:43:02 smithi092 ceph-mon[34729]: from='client.? 172.21.15.69:0/1423304396' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-14T15:43:03.526 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi069.front.sepia.ceph.com... 2024-05-14T15:43:03.527 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:43:03.527 DEBUG:teuthology.orchestra.run.smithi069:> sudo fusermount -u /tmp/cephfs 2024-05-14T15:43:03.635 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi069.stderr:ceph-fuse[88593]: fuse finished with error 0 and tester_r 0 2024-05-14T15:43:03.881 INFO:teuthology.orchestra.run:waiting for 300 2024-05-14T15:43:04.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:43:03 smithi203 ceph-mon[34567]: pgmap v677: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 KiB/s wr, 23 op/s 2024-05-14T15:43:04.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:43:03 smithi092 ceph-mon[34729]: pgmap v677: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 KiB/s wr, 23 op/s 2024-05-14T15:43:04.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:43:03 smithi069 ceph-mon[31270]: pgmap v677: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 21 KiB/s wr, 23 op/s 2024-05-14T15:43:06.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:43:05 smithi203 ceph-mon[34567]: pgmap v678: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 KiB/s wr, 25 op/s 2024-05-14T15:43:06.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:43:05 smithi092 ceph-mon[34729]: pgmap v678: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 KiB/s wr, 25 op/s 2024-05-14T15:43:06.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:43:05 smithi069 ceph-mon[31270]: pgmap v678: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 27 KiB/s wr, 25 op/s 2024-05-14T15:43:08.096 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:43:07 smithi203 ceph-mon[34567]: pgmap v679: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 51 KiB/s wr, 29 op/s 2024-05-14T15:43:08.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:43:07 smithi092 ceph-mon[34729]: pgmap v679: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 51 KiB/s wr, 29 op/s 2024-05-14T15:43:08.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:43:07 smithi069 ceph-mon[31270]: pgmap v679: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 51 KiB/s wr, 29 op/s 2024-05-14T15:43:09.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:43:08 smithi203 ceph-mon[34567]: osdmap e125: 12 total, 12 up, 12 in 2024-05-14T15:43:09.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:43:08 smithi092 ceph-mon[34729]: osdmap e125: 12 total, 12 up, 12 in 2024-05-14T15:43:09.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:43:08 smithi069 ceph-mon[31270]: osdmap e125: 12 total, 12 up, 12 in 2024-05-14T15:43:09.983 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi069.front.sepia.ceph.com 2024-05-14T15:43:09.983 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:43:09.983 DEBUG:teuthology.orchestra.run.smithi069:> (cd /home/ubuntu/cephtest && exec rmdir -- /tmp/cephfs) 2024-05-14T15:43:10.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:43:10.088 DEBUG:teuthology.orchestra.run.smithi069:> ip netns list 2024-05-14T15:43:10.094 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:43:09 smithi203 ceph-mon[34567]: pgmap v681: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 61 KiB/s wr, 33 op/s 2024-05-14T15:43:10.193 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:43:09 smithi092 ceph-mon[34729]: pgmap v681: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 61 KiB/s wr, 33 op/s 2024-05-14T15:43:10.204 INFO:teuthology.orchestra.run.smithi069.stdout:ceph-ns--tmp-cephfs (id: 0) 2024-05-14T15:43:10.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:43:10.205 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip netns delete ceph-ns--tmp-cephfs 2024-05-14T15:43:10.223 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:43:09 smithi069 ceph-mon[31270]: pgmap v681: 129 pgs: 129 active+clean; 3.0 GiB data, 19 GiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 61 KiB/s wr, 33 op/s 2024-05-14T15:43:10.298 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-14T15:43:10.298 DEBUG:teuthology.orchestra.run.smithi069:> sudo ip link delete ceph-brx 2024-05-14T15:43:10.449 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-14T15:43:10.460 INFO:tasks.cephadm:Teardown begin 2024-05-14T15:43:10.460 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/cephadm.py", line 2273, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-05-14T15:43:10.461 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T15:43:10.533 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T15:43:10.646 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T15:43:10.739 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-14T15:43:10.739 DEBUG:teuthology.orchestra.run.smithi069:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-14T15:43:10.796 DEBUG:teuthology.orchestra.run.smithi092:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-14T15:43:10.852 DEBUG:teuthology.orchestra.run.smithi203:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-14T15:43:10.911 INFO:tasks.cephadm:Stopping all daemons... 2024-05-14T15:43:10.911 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-14T15:43:10.911 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mon.a 2024-05-14T15:43:11.474 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:43:11 smithi069 systemd[1]: Stopping Ceph mon.a for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:43:12.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:43:11 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a[31265]: 2024-05-14T15:43:11.721+0000 7f22e4600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:43:12.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:43:11 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a[31265]: 2024-05-14T15:43:11.721+0000 7f22e4600700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-14T15:43:12.224 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:43:11 smithi069 podman[115794]: 2024-05-14 15:43:11.886158531 +0000 UTC m=+0.515747841 container died bc76d6ff7912cff5c63b93fcdbae2a9d200b7c5bed48a449d8577ae9b14ab5bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-14T15:43:12.622 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:43:12 smithi069 podman[115794]: 2024-05-14 15:43:12.364340432 +0000 UTC m=+0.993929776 container cleanup bc76d6ff7912cff5c63b93fcdbae2a9d200b7c5bed48a449d8577ae9b14ab5bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-14T15:43:12.622 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:43:12 smithi069 bash[115794]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a 2024-05-14T15:43:12.961 INFO:journalctl@ceph.mon.a.smithi069.stdout:May 14 15:43:12 smithi069 podman[115837]: 2024-05-14 15:43:12.620022568 +0000 UTC m=+0.728924975 container remove bc76d6ff7912cff5c63b93fcdbae2a9d200b7c5bed48a449d8577ae9b14ab5bc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-a, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5) 2024-05-14T15:43:12.987 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mon.a.service' 2024-05-14T15:43:13.114 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:43:13.114 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-14T15:43:13.115 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-05-14T15:43:13.115 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mon.b 2024-05-14T15:43:13.900 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:43:13 smithi092 systemd[1]: Stopping Ceph mon.b for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:43:14.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:43:14 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-b[34725]: 2024-05-14T15:43:14.374+0000 7fce02e00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:43:14.694 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:43:14 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-b[34725]: 2024-05-14T15:43:14.374+0000 7fce02e00700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-14T15:43:15.088 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:43:14 smithi092 podman[72391]: 2024-05-14 15:43:14.709054021 +0000 UTC m=+0.716033371 container died 34b43213dadf372def6ec68030b2dc51577d3ffad9d2dfc27d3d9e9ff73add39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-14T15:43:15.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:43:15 smithi092 podman[72391]: 2024-05-14 15:43:15.228224616 +0000 UTC m=+1.235203923 container cleanup 34b43213dadf372def6ec68030b2dc51577d3ffad9d2dfc27d3d9e9ff73add39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-b, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-14T15:43:15.443 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:43:15 smithi092 bash[72391]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-b 2024-05-14T15:43:15.803 INFO:journalctl@ceph.mon.b.smithi092.stdout:May 14 15:43:15 smithi092 podman[72414]: 2024-05-14 15:43:15.480162092 +0000 UTC m=+0.857885127 container remove 34b43213dadf372def6ec68030b2dc51577d3ffad9d2dfc27d3d9e9ff73add39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-b, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T15:43:15.839 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mon.b.service' 2024-05-14T15:43:15.948 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:43:15.948 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-05-14T15:43:15.948 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-05-14T15:43:15.948 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mon.c 2024-05-14T15:43:16.345 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:43:16 smithi203 systemd[1]: Stopping Ceph mon.c for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:43:17.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:43:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-c[34563]: 2024-05-14T15:43:16.628+0000 7f86e0000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:43:17.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:43:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-c[34563]: 2024-05-14T15:43:16.628+0000 7f86e0000700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-14T15:43:17.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:43:16 smithi203 podman[74845]: 2024-05-14 15:43:16.824704055 +0000 UTC m=+0.332338603 container died d39800e8b6ba3b1203c6bec0cb4fa50fa424ca7396112af5adec02e5849ecf58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-14T15:43:17.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:43:17 smithi203 podman[74845]: 2024-05-14 15:43:17.335234366 +0000 UTC m=+0.842868944 container cleanup d39800e8b6ba3b1203c6bec0cb4fa50fa424ca7396112af5adec02e5849ecf58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-c, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, org.label-schema.license=GPLv2) 2024-05-14T15:43:17.595 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:43:17 smithi203 bash[74845]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-c 2024-05-14T15:43:18.095 INFO:journalctl@ceph.mon.c.smithi203.stdout:May 14 15:43:17 smithi203 podman[74858]: 2024-05-14 15:43:17.678911592 +0000 UTC m=+0.834735263 container remove d39800e8b6ba3b1203c6bec0cb4fa50fa424ca7396112af5adec02e5849ecf58 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mon-c, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-14T15:43:18.282 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mon.c.service' 2024-05-14T15:43:18.422 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:43:18.422 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-05-14T15:43:18.422 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-14T15:43:18.422 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mgr.x 2024-05-14T15:43:18.974 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:43:18 smithi069 systemd[1]: Stopping Ceph mgr.x for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:43:19.474 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:43:19 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:43:19.098+0000 7f043d200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:43:19.474 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:43:19 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x[31500]: 2024-05-14T15:43:19.098+0000 7f043d200700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-14T15:43:19.474 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:43:19 smithi069 podman[116261]: 2024-05-14 15:43:19.211907126 +0000 UTC m=+0.307264103 container died fad87f236ca82ebf9dd0cdc11828619c29f9de8c1f2c448dd54dc36ed6dd2367 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T15:43:19.974 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:43:19 smithi069 podman[116261]: 2024-05-14 15:43:19.733429593 +0000 UTC m=+0.828786594 container cleanup fad87f236ca82ebf9dd0cdc11828619c29f9de8c1f2c448dd54dc36ed6dd2367 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-14T15:43:19.974 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:43:19 smithi069 bash[116261]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x 2024-05-14T15:43:20.473 INFO:journalctl@ceph.mgr.x.smithi069.stdout:May 14 15:43:20 smithi069 podman[116273]: 2024-05-14 15:43:20.004385073 +0000 UTC m=+0.782733920 container remove fad87f236ca82ebf9dd0cdc11828619c29f9de8c1f2c448dd54dc36ed6dd2367 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:e2b755a64f0d72176b57299d02e880cf0620d780, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-x, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-14T15:43:20.560 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mgr.x.service' 2024-05-14T15:43:20.673 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:43:20.673 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-14T15:43:20.673 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-14T15:43:20.673 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mgr.y 2024-05-14T15:43:21.194 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:43:20 smithi092 systemd[1]: Stopping Ceph mgr.y for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:43:21.603 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:43:21 smithi092 podman[72700]: 2024-05-14 15:43:21.350594504 +0000 UTC m=+0.245510157 container died 408ee8c8735f9984f892e58278f70988c502f626c21c6dd4c21d87a4e1512da8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2) 2024-05-14T15:43:22.193 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:43:21 smithi092 podman[72700]: 2024-05-14 15:43:21.90103436 +0000 UTC m=+0.795950013 container cleanup 408ee8c8735f9984f892e58278f70988c502f626c21c6dd4c21d87a4e1512da8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T15:43:22.193 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:43:21 smithi092 bash[72700]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y 2024-05-14T15:43:22.193 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:43:22 smithi092 podman[72715]: 2024-05-14 15:43:22.119426598 +0000 UTC m=+0.753127766 container remove 408ee8c8735f9984f892e58278f70988c502f626c21c6dd4c21d87a4e1512da8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-y, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-14T15:43:22.193 INFO:journalctl@ceph.mgr.y.smithi092.stdout:May 14 15:43:22 smithi092 systemd[1]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-14T15:43:22.630 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mgr.y.service' 2024-05-14T15:43:22.743 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:43:22.743 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-14T15:43:22.744 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-05-14T15:43:22.744 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mgr.z 2024-05-14T15:43:23.095 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:43:22 smithi203 systemd[1]: Stopping Ceph mgr.z for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:43:23.845 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:43:23 smithi203 podman[74981]: 2024-05-14 15:43:23.50739012 +0000 UTC m=+0.289970294 container died 2f68526f6c2f8dbfa11cd7232a38601e4ae676252a767c202a0c210d92a7a440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:43:24.345 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:43:24 smithi203 podman[74981]: 2024-05-14 15:43:24.084947849 +0000 UTC m=+0.867527995 container cleanup 2f68526f6c2f8dbfa11cd7232a38601e4ae676252a767c202a0c210d92a7a440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS) 2024-05-14T15:43:24.345 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:43:24 smithi203 bash[74981]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z 2024-05-14T15:43:24.825 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:43:24 smithi203 podman[74994]: 2024-05-14 15:43:24.351987304 +0000 UTC m=+0.836319849 container remove 2f68526f6c2f8dbfa11cd7232a38601e4ae676252a767c202a0c210d92a7a440 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mgr-z, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T15:43:24.825 INFO:journalctl@ceph.mgr.z.smithi203.stdout:May 14 15:43:24 smithi203 systemd[1]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mgr.z.service: Main process exited, code=exited, status=143/n/a 2024-05-14T15:43:24.867 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mgr.z.service' 2024-05-14T15:43:24.977 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:43:24.978 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-05-14T15:43:24.978 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-14T15:43:24.978 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.0 2024-05-14T15:43:25.473 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:43:25 smithi069 systemd[1]: Stopping Ceph osd.0 for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:43:25.974 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:43:25 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-0[43342]: 2024-05-14T15:43:25.596+0000 7fb251400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:43:25.975 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:43:25 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-0[43342]: 2024-05-14T15:43:25.596+0000 7fb251400700 -1 osd.0 125 *** Got signal Terminated *** 2024-05-14T15:43:25.975 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:43:25 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-0[43342]: 2024-05-14T15:43:25.596+0000 7fb251400700 -1 osd.0 125 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T15:43:31.974 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:43:31 smithi069 podman[116383]: 2024-05-14 15:43:31.664195218 +0000 UTC m=+6.235409563 container died 6ea50f17bd09987ebb01598ff0fdcec378ea5fa1b2a211c50568e786b50c30d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-0, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T15:43:32.458 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:43:32 smithi069 podman[116383]: 2024-05-14 15:43:32.155323857 +0000 UTC m=+6.726538209 container cleanup 6ea50f17bd09987ebb01598ff0fdcec378ea5fa1b2a211c50568e786b50c30d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2) 2024-05-14T15:43:32.459 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:43:32 smithi069 bash[116383]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-0 2024-05-14T15:43:32.723 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:43:32 smithi069 podman[116400]: 2024-05-14 15:43:32.456926346 +0000 UTC m=+0.778093002 container remove 6ea50f17bd09987ebb01598ff0fdcec378ea5fa1b2a211c50568e786b50c30d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-0, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-14T15:43:33.704 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:43:33 smithi069 podman[116488]: 2024-05-14 15:43:33.223287216 +0000 UTC m=+0.040014245 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:43:33.704 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:43:33 smithi069 podman[116488]: 2024-05-14 15:43:33.541425562 +0000 UTC m=+0.358152611 container create 6bf0b2814b8422017118da6940f48a30d5a2f93d139fc11e214a924483b1776a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True) 2024-05-14T15:43:34.474 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:43:34 smithi069 podman[116488]: 2024-05-14 15:43:34.146663954 +0000 UTC m=+0.963391013 container init 6bf0b2814b8422017118da6940f48a30d5a2f93d139fc11e214a924483b1776a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:43:34.474 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:43:34 smithi069 podman[116488]: 2024-05-14 15:43:34.15582811 +0000 UTC m=+0.972555186 container start 6bf0b2814b8422017118da6940f48a30d5a2f93d139fc11e214a924483b1776a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-14T15:43:34.474 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:43:34 smithi069 podman[116488]: 2024-05-14 15:43:34.275134487 +0000 UTC m=+1.091861522 container attach 6bf0b2814b8422017118da6940f48a30d5a2f93d139fc11e214a924483b1776a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T15:43:35.430 INFO:journalctl@ceph.osd.0.smithi069.stdout:May 14 15:43:35 smithi069 podman[116488]: 2024-05-14 15:43:35.013721258 +0000 UTC m=+1.830448304 container died 6bf0b2814b8422017118da6940f48a30d5a2f93d139fc11e214a924483b1776a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T15:43:35.857 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.0.service' 2024-05-14T15:43:35.969 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:43:35.970 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-14T15:43:35.970 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-14T15:43:35.970 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.1 2024-05-14T15:43:36.443 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:43:36 smithi092 systemd[1]: Stopping Ceph osd.1 for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:43:36.943 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:43:36 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-1[39280]: 2024-05-14T15:43:36.593+0000 7f19d1000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:43:36.943 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:43:36 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-1[39280]: 2024-05-14T15:43:36.593+0000 7f19d1000700 -1 osd.1 125 *** Got signal Terminated *** 2024-05-14T15:43:36.943 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:43:36 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-1[39280]: 2024-05-14T15:43:36.593+0000 7f19d1000700 -1 osd.1 125 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T15:43:42.911 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:43:42 smithi092 podman[72823]: 2024-05-14 15:43:42.587463729 +0000 UTC m=+6.148321131 container died c65ecdf8e7abf4e6e96d024fbe3b94aa6bd23141fe75b006f5eade446ea51a76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-1, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-14T15:43:43.193 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:43:43 smithi092 podman[72823]: 2024-05-14 15:43:43.028593412 +0000 UTC m=+6.589450836 container cleanup c65ecdf8e7abf4e6e96d024fbe3b94aa6bd23141fe75b006f5eade446ea51a76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-1, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-14T15:43:43.193 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:43:43 smithi092 bash[72823]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-1 2024-05-14T15:43:43.693 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:43:43 smithi092 podman[72839]: 2024-05-14 15:43:43.323490558 +0000 UTC m=+0.725827971 container remove c65ecdf8e7abf4e6e96d024fbe3b94aa6bd23141fe75b006f5eade446ea51a76 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-1, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240507) 2024-05-14T15:43:44.444 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:43:44 smithi092 podman[72927]: 2024-05-14 15:43:44.116089415 +0000 UTC m=+0.113972523 container create 3c7767a6320a985f4643c41d027da256579fa18f991a53ce196f27b856c9772f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-1-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-14T15:43:44.444 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:43:44 smithi092 podman[72927]: 2024-05-14 15:43:44.035359769 +0000 UTC m=+0.033242827 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:43:44.943 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:43:44 smithi092 podman[72927]: 2024-05-14 15:43:44.447322462 +0000 UTC m=+0.445205540 container init 3c7767a6320a985f4643c41d027da256579fa18f991a53ce196f27b856c9772f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-1-deactivate, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-14T15:43:44.943 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:43:44 smithi092 podman[72927]: 2024-05-14 15:43:44.458543991 +0000 UTC m=+0.456427057 container start 3c7767a6320a985f4643c41d027da256579fa18f991a53ce196f27b856c9772f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:43:44.943 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:43:44 smithi092 podman[72927]: 2024-05-14 15:43:44.610297139 +0000 UTC m=+0.608180234 container attach 3c7767a6320a985f4643c41d027da256579fa18f991a53ce196f27b856c9772f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T15:43:45.924 INFO:journalctl@ceph.osd.1.smithi092.stdout:May 14 15:43:45 smithi092 podman[72952]: 2024-05-14 15:43:45.543695618 +0000 UTC m=+0.034000233 container died 3c7767a6320a985f4643c41d027da256579fa18f991a53ce196f27b856c9772f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:43:46.305 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.1.service' 2024-05-14T15:43:46.407 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:43:46.407 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-14T15:43:46.407 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-14T15:43:46.407 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.2 2024-05-14T15:43:46.845 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:43:46 smithi203 systemd[1]: Stopping Ceph osd.2 for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:43:47.345 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:43:47 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-2[39845]: 2024-05-14T15:43:47.035+0000 7fc2c7a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:43:47.346 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:43:47 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-2[39845]: 2024-05-14T15:43:47.035+0000 7fc2c7a00700 -1 osd.2 125 *** Got signal Terminated *** 2024-05-14T15:43:47.346 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:43:47 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-2[39845]: 2024-05-14T15:43:47.035+0000 7fc2c7a00700 -1 osd.2 125 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T15:43:53.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:43:52 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:43:52.780+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:43:53.474 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:43:53 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3[50126]: 2024-05-14T15:43:53.107+0000 7fdec7a00700 -1 osd.3 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.565466+0000 front 2024-05-14T15:43:25.565546+0000 (oldest deadline 2024-05-14T15:43:52.567239+0000) 2024-05-14T15:43:53.594 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:43:53 smithi203 podman[75103]: 2024-05-14 15:43:53.317220121 +0000 UTC m=+6.427510917 container died fd1c22becc09fc5a10164e646c25e9da43c89c87f1d4005c80d5048189c121a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:43:53.877 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:43:53 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:43:53.759+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:43:54.149 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:43:54 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:43:54.114+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:43:54.150 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:43:53 smithi203 podman[75103]: 2024-05-14 15:43:53.875939412 +0000 UTC m=+6.986230249 container cleanup fd1c22becc09fc5a10164e646c25e9da43c89c87f1d4005c80d5048189c121a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=) 2024-05-14T15:43:54.150 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:43:53 smithi203 bash[75103]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-2 2024-05-14T15:43:54.473 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:43:54 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3[50126]: 2024-05-14T15:43:54.083+0000 7fdec7a00700 -1 osd.3 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.565466+0000 front 2024-05-14T15:43:25.565546+0000 (oldest deadline 2024-05-14T15:43:52.567239+0000) 2024-05-14T15:43:54.594 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:43:54 smithi203 podman[75122]: 2024-05-14 15:43:54.148177105 +0000 UTC m=+0.798206952 container remove fd1c22becc09fc5a10164e646c25e9da43c89c87f1d4005c80d5048189c121a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-2, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-05-14T15:43:55.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:43:54 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:43:54.799+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:43:55.095 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:43:54 smithi203 podman[75217]: 2024-05-14 15:43:54.826479597 +0000 UTC m=+0.042495514 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:43:55.095 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:43:54 smithi203 podman[75217]: 2024-05-14 15:43:54.95769707 +0000 UTC m=+0.173713005 container create f0fecc539c871d4c2ab3d87f6e878c7cf24597466561ffb39196602887b05517 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-05-14T15:43:55.431 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:43:55 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:43:55.154+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:43:55.432 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:43:55 smithi203 podman[75217]: 2024-05-14 15:43:55.303359573 +0000 UTC m=+0.519375515 container init f0fecc539c871d4c2ab3d87f6e878c7cf24597466561ffb39196602887b05517 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:43:55.432 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:43:55 smithi203 podman[75217]: 2024-05-14 15:43:55.313436777 +0000 UTC m=+0.529452722 container start f0fecc539c871d4c2ab3d87f6e878c7cf24597466561ffb39196602887b05517 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:43:55.473 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:43:55 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3[50126]: 2024-05-14T15:43:55.040+0000 7fdec7a00700 -1 osd.3 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.565466+0000 front 2024-05-14T15:43:25.565546+0000 (oldest deadline 2024-05-14T15:43:52.567239+0000) 2024-05-14T15:43:55.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:43:55 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:43:55.278+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:43:55.822 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:43:55 smithi203 podman[75217]: 2024-05-14 15:43:55.511092966 +0000 UTC m=+0.727108954 container attach f0fecc539c871d4c2ab3d87f6e878c7cf24597466561ffb39196602887b05517 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux ) 2024-05-14T15:43:55.823 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:43:55 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:43:55.430+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:43:55.948 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:43:55 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:43:55.564+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:43:56.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:43:55 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:43:55.821+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:43:56.223 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:43:56 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3[50126]: 2024-05-14T15:43:56.069+0000 7fdec7a00700 -1 osd.3 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.565466+0000 front 2024-05-14T15:43:25.565546+0000 (oldest deadline 2024-05-14T15:43:52.567239+0000) 2024-05-14T15:43:56.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:43:55 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:43:55.946+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:43:56.481 INFO:journalctl@ceph.osd.2.smithi203.stdout:May 14 15:43:56 smithi203 podman[75217]: 2024-05-14 15:43:56.307751269 +0000 UTC m=+1.523767210 container died f0fecc539c871d4c2ab3d87f6e878c7cf24597466561ffb39196602887b05517 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240507) 2024-05-14T15:43:56.482 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:43:56 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:43:56.115+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:43:56.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:43:56 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:43:56.282+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:43:56.733 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:43:56 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:43:56.480+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:43:56.962 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:43:56 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:43:56.575+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:43:57.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:43:56 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:43:56.776+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:43:57.162 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.2.service' 2024-05-14T15:43:57.223 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:43:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3[50126]: 2024-05-14T15:43:57.039+0000 7fdec7a00700 -1 osd.3 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.565466+0000 front 2024-05-14T15:43:25.565546+0000 (oldest deadline 2024-05-14T15:43:52.567239+0000) 2024-05-14T15:43:57.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:43:56 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:43:56.960+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:43:57.274 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:43:57.274 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-14T15:43:57.274 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-14T15:43:57.274 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.3 2024-05-14T15:43:57.475 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:43:57 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:43:57.098+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:43:57.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:43:57 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:43:57.320+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:43:57.723 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:43:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:43:57.583+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:43:57.723 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:43:57 smithi069 systemd[1]: Stopping Ceph osd.3 for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:43:57.808 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:43:57 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:43:57.473+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:43:58.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:43:57 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:43:57.807+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:43:58.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:43:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:43:57.917+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:43:58.224 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:43:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3[50126]: 2024-05-14T15:43:57.882+0000 7fded1200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:43:58.224 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:43:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3[50126]: 2024-05-14T15:43:57.882+0000 7fded1200700 -1 osd.3 125 *** Got signal Terminated *** 2024-05-14T15:43:58.224 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:43:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3[50126]: 2024-05-14T15:43:57.882+0000 7fded1200700 -1 osd.3 125 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T15:43:58.224 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:43:58 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3[50126]: 2024-05-14T15:43:58.022+0000 7fdec7a00700 -1 osd.3 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.565466+0000 front 2024-05-14T15:43:25.565546+0000 (oldest deadline 2024-05-14T15:43:52.567239+0000) 2024-05-14T15:43:58.505 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:43:58 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:43:58.101+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:43:58.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:43:58 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:43:58.342+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:43:58.799 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:43:58 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:43:58.504+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:43:58.944 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:43:58 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:43:58.591+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:43:59.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:43:58 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:43:58.798+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:43:59.224 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:43:58 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3[50126]: 2024-05-14T15:43:58.997+0000 7fdec7a00700 -1 osd.3 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.565466+0000 front 2024-05-14T15:43:25.565546+0000 (oldest deadline 2024-05-14T15:43:52.567239+0000) 2024-05-14T15:43:59.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:43:58 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:43:58.943+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:43:59.519 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:43:59 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:43:59.147+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:43:59.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:43:59 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:43:59.332+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:43:59.782 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:43:59 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:43:59.518+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:43:59.898 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:43:59 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:43:59.547+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:00.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:43:59 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:43:59.781+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:00.223 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:44:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3[50126]: 2024-05-14T15:44:00.002+0000 7fdec7a00700 -1 osd.3 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.565466+0000 front 2024-05-14T15:43:25.565546+0000 (oldest deadline 2024-05-14T15:43:52.567239+0000) 2024-05-14T15:44:00.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:43:59 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:43:59.896+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:00.504 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:00 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:00.164+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:00.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:00 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:00.327+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:00.844 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:00 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:00.503+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:00.845 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:00 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:00.750+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:00.933 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:00.584+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:01.223 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:44:01 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3[50126]: 2024-05-14T15:44:01.015+0000 7fdec7a00700 -1 osd.3 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.565466+0000 front 2024-05-14T15:43:25.565546+0000 (oldest deadline 2024-05-14T15:43:52.567239+0000) 2024-05-14T15:44:01.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:00.931+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:01.475 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:01 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:01.174+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:01.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:01 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:01.362+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:01.798 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:01 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:01.474+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:01.892 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:01 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:01.615+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:01.892 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:01 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:01.891+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:02.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:01 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:01.796+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:02.223 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:44:01 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3[50126]: 2024-05-14T15:44:01.973+0000 7fdec7a00700 -1 osd.3 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.565466+0000 front 2024-05-14T15:43:25.565546+0000 (oldest deadline 2024-05-14T15:43:52.567239+0000) 2024-05-14T15:44:02.447 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:02 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:02.165+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:02.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:02 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:02.347+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:02.844 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:02 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:02.446+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:02.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:02 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:02.661+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:02.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:02 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:02.853+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:03.195 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:02 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:02.845+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:03.594 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:03 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:03.194+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:03.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:03 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:03.416+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:03.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:03 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:03.416+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:03.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:03 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:03.353+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:03.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:03 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:03.353+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:03.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:03 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:03.833+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:03.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:03 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:03.706+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:04.175 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:03 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:03.844+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:04.347 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:03 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4[46159]: 2024-05-14T15:44:03.972+0000 7f3625800700 -1 osd.4 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.949916+0000 front 2024-05-14T15:43:38.949997+0000 (oldest deadline 2024-05-14T15:44:03.050070+0000) 2024-05-14T15:44:04.347 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:04 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:04.174+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:04.433 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:04 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:04.174+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:04.474 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:44:04 smithi069 podman[116604]: 2024-05-14 15:44:04.174163782 +0000 UTC m=+6.464956272 container died 7bca7e4af62beea30720832ee21800f0616cfcfd2118aebb9c1d746babe84c66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2) 2024-05-14T15:44:04.690 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:04 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:04.432+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:04.690 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:04 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:04.432+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:04.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:04 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:04.345+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:04.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:04 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:04.345+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:04.864 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:04 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:04.674+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:04.864 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:44:04 smithi069 podman[116604]: 2024-05-14 15:44:04.701507115 +0000 UTC m=+6.992299589 container cleanup 7bca7e4af62beea30720832ee21800f0616cfcfd2118aebb9c1d746babe84c66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507) 2024-05-14T15:44:04.864 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:44:04 smithi069 bash[116604]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3 2024-05-14T15:44:05.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:04 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:04.824+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:05.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:04 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:04.824+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:05.224 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:44:05 smithi069 podman[116622]: 2024-05-14 15:44:05.011183396 +0000 UTC m=+0.800998033 container remove 7bca7e4af62beea30720832ee21800f0616cfcfd2118aebb9c1d746babe84c66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:44:05.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:04 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:04.863+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:05.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:04 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:04.863+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:05.348 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:04 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4[46159]: 2024-05-14T15:44:04.960+0000 7f3625800700 -1 osd.4 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.949916+0000 front 2024-05-14T15:43:38.949997+0000 (oldest deadline 2024-05-14T15:44:03.050070+0000) 2024-05-14T15:44:05.348 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:05 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:05.177+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:05.475 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:05 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:05.202+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:05.475 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:05 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:05.202+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:05.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:05 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:05.345+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:05.718 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:05 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:05.345+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:05.800 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:05 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:05.474+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:05.801 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:05 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:05.474+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:05.853 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:44:05 smithi069 podman[116710]: 2024-05-14 15:44:05.49706232 +0000 UTC m=+0.037680014 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:44:05.853 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:44:05 smithi069 podman[116710]: 2024-05-14 15:44:05.67914082 +0000 UTC m=+0.219758532 container create b036ff2ad0ef9416863c6730894c1679b760d0ff0038a9a88b070544d0ddfa4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-14T15:44:05.854 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:05 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:05.666+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:05.854 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:05 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:05.666+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:06.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:05 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:05.799+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:06.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:05 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:05.799+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:06.132 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:44:05 smithi069 podman[116710]: 2024-05-14 15:44:05.982889625 +0000 UTC m=+0.523507344 container init b036ff2ad0ef9416863c6730894c1679b760d0ff0038a9a88b070544d0ddfa4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-05-14T15:44:06.132 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:44:05 smithi069 podman[116710]: 2024-05-14 15:44:05.994021828 +0000 UTC m=+0.534639574 container start b036ff2ad0ef9416863c6730894c1679b760d0ff0038a9a88b070544d0ddfa4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-14T15:44:06.132 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:05 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:05.878+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:06.132 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:05 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:05.878+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:06.306 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:05 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4[46159]: 2024-05-14T15:44:05.972+0000 7f3625800700 -1 osd.4 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.949916+0000 front 2024-05-14T15:43:38.949997+0000 (oldest deadline 2024-05-14T15:44:03.050070+0000) 2024-05-14T15:44:06.306 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:06 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:06.148+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:06.440 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:44:06 smithi069 podman[116710]: 2024-05-14 15:44:06.131713555 +0000 UTC m=+0.672331307 container attach b036ff2ad0ef9416863c6730894c1679b760d0ff0038a9a88b070544d0ddfa4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-14T15:44:06.512 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:06 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:06.232+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:06.512 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:06 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:06.232+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:06.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:06 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:06.304+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:06.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:06 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:06.304+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:06.710 INFO:journalctl@ceph.osd.3.smithi069.stdout:May 14 15:44:06 smithi069 podman[116710]: 2024-05-14 15:44:06.441179719 +0000 UTC m=+0.981797438 container died b036ff2ad0ef9416863c6730894c1679b760d0ff0038a9a88b070544d0ddfa4d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=) 2024-05-14T15:44:06.844 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:06 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:06.758+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:06.844 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:06 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:06.758+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:06.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:06 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:06.511+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:06.845 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:06 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:06.511+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:06.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:06 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:06.708+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:06.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:06 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:06.708+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:06.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:06 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:06.861+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:06.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:06 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:06.861+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:07.172 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:06 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4[46159]: 2024-05-14T15:44:06.949+0000 7f3625800700 -1 osd.4 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.949916+0000 front 2024-05-14T15:43:38.949997+0000 (oldest deadline 2024-05-14T15:44:03.050070+0000) 2024-05-14T15:44:07.329 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.3.service' 2024-05-14T15:44:07.423 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:44:07.423 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-14T15:44:07.424 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-14T15:44:07.424 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.4 2024-05-14T15:44:07.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:07 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:07.171+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:07.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:07 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:07.326+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:07.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:07 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:07.326+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:07.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:07 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:07.476+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:07.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:07 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:07.476+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:07.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:07 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:07.261+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:07.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:07 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:07.261+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:07.912 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:07 smithi092 systemd[1]: Stopping Ceph osd.4 for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:44:07.973 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:07 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:07.849+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:07.973 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:07 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:07.849+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:07.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:07 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:07.680+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:07.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:07 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:07.680+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:08.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:07 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:07.752+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:08.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:07 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:07.752+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:08.193 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:08 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:08.157+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:08.193 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:07 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4[46159]: 2024-05-14T15:44:07.909+0000 7f3625800700 -1 osd.4 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.949916+0000 front 2024-05-14T15:43:38.949997+0000 (oldest deadline 2024-05-14T15:44:03.050070+0000) 2024-05-14T15:44:08.193 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:07 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4[46159]: 2024-05-14T15:44:07.980+0000 7f362f000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:44:08.193 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:07 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4[46159]: 2024-05-14T15:44:07.980+0000 7f362f000700 -1 osd.4 125 *** Got signal Terminated *** 2024-05-14T15:44:08.193 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:07 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4[46159]: 2024-05-14T15:44:07.980+0000 7f362f000700 -1 osd.4 125 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T15:44:08.480 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:08 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:08.218+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:08.480 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:08 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:08.218+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:08.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:08 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:08.296+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:08.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:08 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:08.296+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:08.793 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:08 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:08.479+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:08.793 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:08 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:08.479+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:09.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:08 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:08.793+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:09.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:08 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:08.793+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:09.193 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:08 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4[46159]: 2024-05-14T15:44:08.928+0000 7f3625800700 -1 osd.4 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.949916+0000 front 2024-05-14T15:43:38.949997+0000 (oldest deadline 2024-05-14T15:44:03.050070+0000) 2024-05-14T15:44:09.193 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:09.154+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:09.223 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:08 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:08.724+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:09.223 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:08 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:08.724+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:09.223 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:08 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:08.886+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:09.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:08 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:08.886+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:09.508 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:09 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:09.188+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:09.508 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:09 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:09.188+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:09.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:09.290+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:09.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:09.290+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:09.792 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:09 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:09.506+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:09.792 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:09 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:09.506+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:10.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:09 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:09.791+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:10.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:09 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:09.791+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:10.193 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4[46159]: 2024-05-14T15:44:09.938+0000 7f3625800700 -1 osd.4 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.949916+0000 front 2024-05-14T15:43:38.949997+0000 (oldest deadline 2024-05-14T15:44:03.050070+0000) 2024-05-14T15:44:10.193 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:10.177+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:10.223 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:09 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:09.743+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:10.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:09 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:09.743+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:10.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:09 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:09.863+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:10.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:09 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:09.863+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:10.460 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:10 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:10.174+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:10.460 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:10 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:10.174+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:10.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:10.277+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:10.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:10.277+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:10.806 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:10 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:10.458+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:10.806 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:10 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:10.458+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:10.973 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:10 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:10.881+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:10.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:10 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:10.881+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:10.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:10 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:10.699+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:10.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:10 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:10.699+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:11.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:10 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:10.805+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:11.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:10 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:10.805+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:11.193 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:11 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:11.152+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:11.193 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4[46159]: 2024-05-14T15:44:10.937+0000 7f3625800700 -1 osd.4 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.949916+0000 front 2024-05-14T15:43:38.949997+0000 (oldest deadline 2024-05-14T15:44:03.050070+0000) 2024-05-14T15:44:11.432 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:11 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:11.180+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:11.432 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:11 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:11.180+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:11.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:11 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:11.311+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:11.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:11 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:11.311+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:11.772 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:11 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:11.431+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:11.772 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:11 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:11.431+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:11.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:11 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:11.844+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:11.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:11 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:11.844+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:11.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:11 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:11.707+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:11.975 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:11 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:11.707+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:12.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:11 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:11.770+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:12.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:11 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:11.770+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:12.193 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:11 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4[46159]: 2024-05-14T15:44:11.919+0000 7f3625800700 -1 osd.4 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.949916+0000 front 2024-05-14T15:43:38.949997+0000 (oldest deadline 2024-05-14T15:44:03.050070+0000) 2024-05-14T15:44:12.193 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:12 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:12.150+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:12.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:12 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:12.393+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:12.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:12 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:12.393+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:12.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:12 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:12.216+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:12.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:12 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:12.216+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:12.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:12 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:12.296+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:12.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:12 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:12.296+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:13.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:12 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:12.723+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:13.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:12 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:12.723+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:13.147 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:12 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4[46159]: 2024-05-14T15:44:12.887+0000 7f3625800700 -1 osd.4 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.949916+0000 front 2024-05-14T15:43:38.949997+0000 (oldest deadline 2024-05-14T15:44:03.050070+0000) 2024-05-14T15:44:13.223 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:12.886+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:13.223 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:12.886+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:13.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:12.750+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:13.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:12 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:12.750+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:13.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:13 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:13.146+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:13.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:13 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:13.326+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:13.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:13 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:13.326+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:13.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:13 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:13.377+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:13.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:13 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:13.377+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:13.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:13 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:13.231+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:13.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:13 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:13.231+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:13.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:13 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:13.716+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:13.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:13 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:13.716+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:13.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:13 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:13.716+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:13.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:13 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:13.921+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:13.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:13 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:13.921+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:13.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:13 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:13.921+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:14.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:13 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:13.736+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:14.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:13 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:13.736+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:14.594 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:14 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:14.412+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:14.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:14 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:14.412+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:14.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:14 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:14.195+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:14.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:14 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:14.195+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:14.617 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:14 smithi092 podman[73046]: 2024-05-14 15:44:14.295097493 +0000 UTC m=+6.466045387 container died c9616c7744fb000f569820143d6c54288cb70d5254d5700046236e7135df99e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=) 2024-05-14T15:44:14.618 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:14 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:14.193+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:14.618 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:14 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:14.279+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:14.618 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:14 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:14.279+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:14.618 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:14 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:14.279+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:14.943 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:14 smithi092 podman[73046]: 2024-05-14 15:44:14.757401843 +0000 UTC m=+6.928349778 container cleanup c9616c7744fb000f569820143d6c54288cb70d5254d5700046236e7135df99e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True) 2024-05-14T15:44:14.943 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:14 smithi092 bash[73046]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4 2024-05-14T15:44:14.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:14 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:14.689+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:14.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:14 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:14.689+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:14.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:14 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:14.689+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:14.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:14 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:14.885+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:14.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:14 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:14.885+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:14.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:14 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:14.885+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:15.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:14 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:14.755+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:15.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:14 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:14.755+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:15.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:14 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:14.755+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:15.319 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:15 smithi092 podman[73064]: 2024-05-14 15:44:15.000923052 +0000 UTC m=+0.680524433 container remove c9616c7744fb000f569820143d6c54288cb70d5254d5700046236e7135df99e0 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-14T15:44:15.319 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:15 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:15.184+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:15.319 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:15 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:15.184+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:15.594 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:15.416+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:15.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:15.416+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:15.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:15.172+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:15.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:15.172+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:15.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:15.172+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:15.692 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:15 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:15.318+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:15.692 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:15 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:15.318+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:15.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:15 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:15.318+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:16.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:15.764+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:16.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:15.764+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:16.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:15.764+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:16.193 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:15 smithi092 podman[73151]: 2024-05-14 15:44:15.739690259 +0000 UTC m=+0.032186046 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:44:16.193 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:15 smithi092 podman[73151]: 2024-05-14 15:44:15.860134053 +0000 UTC m=+0.152629878 container create 68ad5d2eb32844fcf36f7b8ae5b6b407baa399e2d52171a3510454051ac81d51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-14T15:44:16.223 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:15 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:15.861+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:16.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:15 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:15.861+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:16.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:15 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:15.861+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:16.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:15 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:15.736+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:16.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:15 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:15.736+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:16.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:15 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:15.736+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:16.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:16.393+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:16.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:16.393+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:16.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:16.191+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:16.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:16.191+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:16.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:16.191+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:16.663 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:16 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:16.272+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:16.663 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:16 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:16.272+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:16.663 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:16 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:16.272+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:16.663 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:16 smithi092 podman[73151]: 2024-05-14 15:44:16.197489851 +0000 UTC m=+0.489985693 container init 68ad5d2eb32844fcf36f7b8ae5b6b407baa399e2d52171a3510454051ac81d51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-05-14T15:44:16.663 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:16 smithi092 podman[73151]: 2024-05-14 15:44:16.20853738 +0000 UTC m=+0.501033212 container start 68ad5d2eb32844fcf36f7b8ae5b6b407baa399e2d52171a3510454051ac81d51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-14T15:44:16.663 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:16 smithi092 podman[73151]: 2024-05-14 15:44:16.312742777 +0000 UTC m=+0.605238625 container attach 68ad5d2eb32844fcf36f7b8ae5b6b407baa399e2d52171a3510454051ac81d51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-14T15:44:16.663 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:16 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:16.210+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:16.664 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:16 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:16.210+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:16.943 INFO:journalctl@ceph.osd.4.smithi092.stdout:May 14 15:44:16 smithi092 podman[73151]: 2024-05-14 15:44:16.662329055 +0000 UTC m=+0.954824923 container died 68ad5d2eb32844fcf36f7b8ae5b6b407baa399e2d52171a3510454051ac81d51 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507) 2024-05-14T15:44:17.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:16.809+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:17.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:16.809+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:17.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:16.809+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:17.223 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:16 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:16.736+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:17.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:16 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:16.736+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:17.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:16 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:16.736+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:17.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:16 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:16.909+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:17.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:16 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:16.909+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:17.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:16 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:16.909+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:17.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:17 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:17.217+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:17.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:17 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:17.217+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:17.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:17 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:17.227+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:17.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:17 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:17.227+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:17.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:17 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:17.227+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:17.520 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.4.service' 2024-05-14T15:44:17.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:17.359+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:17.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:17.359+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:17.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:17.359+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.137578+0000 front 2024-05-14T15:43:51.137774+0000 (oldest deadline 2024-05-14T15:44:16.437887+0000) 2024-05-14T15:44:17.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:17.169+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:17.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:17.169+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:17.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:17.169+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:17.675 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:44:17.675 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-14T15:44:17.675 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-14T15:44:17.675 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.5 2024-05-14T15:44:17.869 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:17 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:17.702+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:17.869 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:17 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:17.702+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:17.869 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:17 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:17.702+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:18.094 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:17 smithi203 systemd[1]: Stopping Ceph osd.5 for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:44:18.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:17.814+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:18.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:17.814+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:18.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:17.814+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:18.165 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:17 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:17.867+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:18.165 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:17 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:17.867+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:18.165 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:17 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:17.867+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:18.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:18 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:18.259+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:18.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:18 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:18.259+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:18.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:18 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:18.259+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:18.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:18 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:18.183+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:18.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:18 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:18.183+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:18.594 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:18.173+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:18.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:18.173+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:18.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:18.173+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:18.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:18.248+0000 7f0d32000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:44:18.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:18.248+0000 7f0d32000700 -1 osd.5 125 *** Got signal Terminated *** 2024-05-14T15:44:18.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:18.248+0000 7f0d32000700 -1 osd.5 125 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T15:44:18.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:18.356+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:18.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:18.356+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:18.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:18.356+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.137578+0000 front 2024-05-14T15:43:51.137774+0000 (oldest deadline 2024-05-14T15:44:16.437887+0000) 2024-05-14T15:44:18.916 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:18 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:18.660+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:18.916 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:18 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:18.660+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:18.916 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:18 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:18.660+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:19.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:18.789+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:19.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:18.789+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:19.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:18.789+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:19.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:18 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:18.915+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:19.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:18 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:18.915+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:19.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:18 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:18.915+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:19.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:19 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:19.181+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:19.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:19 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:19.181+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:19.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:19 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:19.237+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:19.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:19 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:19.237+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:19.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:19 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:19.237+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:19.594 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:19.156+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:19.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:19.156+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:19.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:19.156+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:19.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:19.390+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:19.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:19.390+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:19.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:19.390+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.137578+0000 front 2024-05-14T15:43:51.137774+0000 (oldest deadline 2024-05-14T15:44:16.437887+0000) 2024-05-14T15:44:19.918 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:19 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:19.625+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:19.918 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:19 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:19.625+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:19.918 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:19 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:19.625+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:20.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:19.793+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:20.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:19.793+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:20.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:19.793+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:20.223 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:19 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:19.917+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:20.223 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:19 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:19.917+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:20.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:19 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:19.917+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:20.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:20.193+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:20.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:20.193+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:20.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:20.193+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:20.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:20.382+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:20.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:20.382+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:20.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:20.382+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.137578+0000 front 2024-05-14T15:43:51.137774+0000 (oldest deadline 2024-05-14T15:44:16.437887+0000) 2024-05-14T15:44:20.693 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:20 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:20.211+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:20.693 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:20 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:20.211+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:20.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:20 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:20.198+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:20.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:20 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:20.198+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:20.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:20 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:20.198+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:20.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:20 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:20.868+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:20.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:20 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:20.868+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:20.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:20 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:20.868+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:20.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:20 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:20.643+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:20.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:20 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:20.643+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:20.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:20 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:20.643+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:21.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:20.750+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:21.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:20.750+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:21.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:20.750+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:21.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:21 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:21.156+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:21.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:21 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:21.156+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:21.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:21 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:21.156+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:21.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:21 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:21.182+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:21.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:21 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:21.182+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:21.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:21.237+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:21.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:21.237+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:21.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:21.237+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:21.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:21.386+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:21.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:21.386+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:21.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:21.386+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.137578+0000 front 2024-05-14T15:43:51.137774+0000 (oldest deadline 2024-05-14T15:44:16.437887+0000) 2024-05-14T15:44:21.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:21 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:21.892+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:21.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:21 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:21.892+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:21.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:21 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:21.892+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:21.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:21 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:21.677+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:21.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:21 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:21.677+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:21.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:21 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:21.677+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:22.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:21.785+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:22.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:21.785+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:22.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:21.785+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:22.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:22 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:22.200+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:22.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:22 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:22.200+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:22.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:22 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:22.187+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:22.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:22 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:22.187+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:22.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:22 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:22.187+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:22.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:22.417+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:25.930488+0000 front 2024-05-14T15:43:25.930291+0000 (oldest deadline 2024-05-14T15:43:54.731949+0000) 2024-05-14T15:44:22.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:22.417+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.834460+0000 front 2024-05-14T15:43:38.834942+0000 (oldest deadline 2024-05-14T15:44:02.934405+0000) 2024-05-14T15:44:22.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5[46392]: 2024-05-14T15:44:22.417+0000 7f0d28800700 -1 osd.5 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.137578+0000 front 2024-05-14T15:43:51.137774+0000 (oldest deadline 2024-05-14T15:44:16.437887+0000) 2024-05-14T15:44:22.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:22.277+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:22.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:22.277+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:22.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:22.277+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:23.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:22.749+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:23.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:22.749+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:23.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:22.749+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:23.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:22 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:22.723+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:23.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:22 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:22.723+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:23.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:22 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:22.723+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:23.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:22 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:22.846+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:23.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:22 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:22.846+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:23.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:22 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:22.846+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:23.484 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:23.241+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:23.484 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:23.241+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:23.484 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:23.241+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:23.693 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:23 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:23.211+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:23.693 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:23 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:23.211+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:23.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:23 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:23.211+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:23.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:23 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:23.212+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:23.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:23 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:23.212+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:23.799 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:23.707+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:23.799 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:23.707+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:23.799 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:23.707+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:23.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:23 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:23.896+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:23.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:23 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:23.896+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:23.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:23 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:23.896+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:23.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:23 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:23.699+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:23.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:23 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:23.699+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:23.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:23 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:23.699+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:24.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:24 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:24.168+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:24.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:24 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:24.168+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:24.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:24 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:24.246+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:24.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:24 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:24.246+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:24.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:24 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:24.246+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:24.594 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:24 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:24.192+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:24.594 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:24 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:24.192+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:24.594 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:24 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:24.192+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:25.095 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:24 smithi203 podman[75322]: 2024-05-14 15:44:24.800609868 +0000 UTC m=+6.696678765 container died 47c6a8b0a4ac6bd8f2ebdeaae6f9fae4e3524bc97a2a2e78069851de75030456 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240507, GIT_CLEAN=True, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-05-14T15:44:25.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:24 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:24.750+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:25.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:24 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:24.750+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:25.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:24 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:24.750+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:25.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:24 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:24.745+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:25.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:24 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:24.745+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:25.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:24 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:24.745+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:25.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:24 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:24.878+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:25.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:24 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:24.878+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:25.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:24 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:24.878+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:25.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:24 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:24.878+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:43:59.665838+0000 front 2024-05-14T15:43:59.665730+0000 (oldest deadline 2024-05-14T15:44:24.366034+0000) 2024-05-14T15:44:25.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:25 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:25.124+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:25.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:25 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:25.124+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:25.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:25 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:25.124+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:25.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:25 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:25.239+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:25.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:25 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:25.239+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:25.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:25 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:25.239+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:25.594 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:25 smithi203 podman[75322]: 2024-05-14 15:44:25.294308901 +0000 UTC m=+7.190377841 container cleanup 47c6a8b0a4ac6bd8f2ebdeaae6f9fae4e3524bc97a2a2e78069851de75030456 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T15:44:25.595 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:25 smithi203 bash[75322]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5 2024-05-14T15:44:25.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:25 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:25.173+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:25.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:25 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:25.173+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:25.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:25 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:25.173+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:25.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:25 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:25.918+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:25.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:25 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:25.918+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:25.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:25 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:25.918+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:25.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:25 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:25.918+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:43:59.665838+0000 front 2024-05-14T15:43:59.665730+0000 (oldest deadline 2024-05-14T15:44:24.366034+0000) 2024-05-14T15:44:25.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:25 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:25.703+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:25.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:25 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:25.703+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:25.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:25 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:25.703+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:26.094 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:25 smithi203 podman[75355]: 2024-05-14 15:44:25.646910555 +0000 UTC m=+0.821111256 container remove 47c6a8b0a4ac6bd8f2ebdeaae6f9fae4e3524bc97a2a2e78069851de75030456 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T15:44:26.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:25 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:25.797+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:26.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:25 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:25.797+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:26.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:25 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:25.797+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:26.379 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:26 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:26.254+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:26.380 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:26 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:26.254+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:26.380 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:26 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:26.254+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:26.380 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:26 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:26.254+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:26.380 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:26 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:26.106+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:26.380 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:26 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:26.106+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:26.380 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:26 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:26.106+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:26.466 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:26 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:26.206+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:26.466 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:26 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:26.206+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:26.466 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:26 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:26.206+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:26.466 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:26 smithi203 podman[75442]: 2024-05-14 15:44:26.142245263 +0000 UTC m=+0.034280485 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:44:26.466 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:26 smithi203 podman[75442]: 2024-05-14 15:44:26.30522625 +0000 UTC m=+0.197261510 container create 7b3400bd11f91f9db5f7f9bd747d4b7153370af06d8ca32e5b3904d421952e39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-14T15:44:26.771 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:26 smithi203 podman[75442]: 2024-05-14 15:44:26.59376432 +0000 UTC m=+0.485799553 container init 7b3400bd11f91f9db5f7f9bd747d4b7153370af06d8ca32e5b3904d421952e39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507) 2024-05-14T15:44:26.771 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:26 smithi203 podman[75442]: 2024-05-14 15:44:26.605286857 +0000 UTC m=+0.497322088 container start 7b3400bd11f91f9db5f7f9bd747d4b7153370af06d8ca32e5b3904d421952e39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-14T15:44:26.772 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:26 smithi203 podman[75442]: 2024-05-14 15:44:26.708364296 +0000 UTC m=+0.600399540 container attach 7b3400bd11f91f9db5f7f9bd747d4b7153370af06d8ca32e5b3904d421952e39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T15:44:26.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:26 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:26.942+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:26.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:26 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:26.942+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:26.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:26 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:26.942+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:26.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:26 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:26.942+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:43:59.665838+0000 front 2024-05-14T15:43:59.665730+0000 (oldest deadline 2024-05-14T15:44:24.366034+0000) 2024-05-14T15:44:26.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:26 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:26.702+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:26.975 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:26 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:26.702+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:26.975 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:26 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:26.702+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:27.042 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:26 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:26.769+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:27.042 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:26 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:26.769+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:27.042 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:26 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:26.769+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:27.345 INFO:journalctl@ceph.osd.5.smithi203.stdout:May 14 15:44:27 smithi203 podman[75442]: 2024-05-14 15:44:27.041692722 +0000 UTC m=+0.933728042 container died 7b3400bd11f91f9db5f7f9bd747d4b7153370af06d8ca32e5b3904d421952e39 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-5-deactivate, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2) 2024-05-14T15:44:27.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:27 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:27.195+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:27.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:27 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:27.195+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:27.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:27 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:27.195+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:27.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:27 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:27.149+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:27.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:27 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:27.149+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:27.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:27 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:27.149+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:27.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:27 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:27.255+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:27.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:27 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:27.255+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:27.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:27 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:27.255+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:27.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:27 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:27.255+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:27.801 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.5.service' 2024-05-14T15:44:27.910 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:44:27.911 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-14T15:44:27.911 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-14T15:44:27.911 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.6 2024-05-14T15:44:27.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:27 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:27.720+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:27.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:27 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:27.720+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:27.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:27 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:27.720+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:27.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:27 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:27.720+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:28.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:27 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:27.810+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:28.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:27 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:27.810+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:28.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:27 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:27.810+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:28.193 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:28 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:28.111+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:28.193 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:28 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:28.111+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:28.193 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:28 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:28.111+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:28.472 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:27 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:27.990+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:28.472 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:27 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:27.990+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:28.472 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:27 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:27.990+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:28.473 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:27 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:27.990+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:43:59.665838+0000 front 2024-05-14T15:43:59.665730+0000 (oldest deadline 2024-05-14T15:44:24.366034+0000) 2024-05-14T15:44:28.473 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:28 smithi069 systemd[1]: Stopping Ceph osd.6 for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:44:28.473 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:28 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:28.469+0000 7f714be00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:44:28.473 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:28 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:28.469+0000 7f714be00700 -1 osd.6 125 *** Got signal Terminated *** 2024-05-14T15:44:28.473 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:28 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:28.469+0000 7f714be00700 -1 osd.6 125 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T15:44:28.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:28 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:28.172+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:28.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:28 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:28.172+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:28.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:28 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:28.172+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:28.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:28 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:28.282+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:28.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:28 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:28.282+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:28.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:28 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:28.282+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:28.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:28 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:28.282+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:29.035 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:28 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:28.759+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:29.035 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:28 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:28.759+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:29.035 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:28 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:28.759+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:29.035 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:28 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:28.759+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:29.094 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:28 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:28.816+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:29.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:28 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:28.816+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:29.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:28 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:28.816+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:29.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:29 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:29.080+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:29.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:29 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:29.080+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:29.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:29 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:29.080+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:29.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:29 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:29.284+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:29.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:29 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:29.284+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:29.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:29 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:29.284+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:29.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:29 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:29.284+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:29.474 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:29 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:29.033+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:29.474 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:29 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:29.033+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:29.474 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:29 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:29.033+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:29.474 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:29 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:29.033+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:43:59.665838+0000 front 2024-05-14T15:43:59.665730+0000 (oldest deadline 2024-05-14T15:44:24.366034+0000) 2024-05-14T15:44:29.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:29 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:29.143+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:29.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:29 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:29.143+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:29.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:29 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:29.143+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:29.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:29 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:29.143+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:30.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:29 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:29.842+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:30.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:29 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:29.842+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:30.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:29 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:29.842+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:30.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:29 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:29.987+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:30.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:29 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:29.987+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:30.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:29 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:29.987+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:30.224 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:29 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:29.987+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:43:59.665838+0000 front 2024-05-14T15:43:59.665730+0000 (oldest deadline 2024-05-14T15:44:24.366034+0000) 2024-05-14T15:44:30.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:29 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:29.762+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:30.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:29 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:29.762+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:30.225 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:29 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:29.762+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:30.225 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:29 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:29.762+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:30.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:30 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:30.062+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:30.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:30 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:30.062+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:30.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:30 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:30.062+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:30.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:30 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:30.268+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:30.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:30 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:30.268+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:30.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:30 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:30.268+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:30.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:30 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:30.268+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:30.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:30 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:30.097+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:30.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:30 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:30.097+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:30.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:30 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:30.097+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:30.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:30 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:30.097+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:31.025 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:30 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:30.752+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:31.025 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:30 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:30.752+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:31.025 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:30 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:30.752+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:31.025 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:30 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:30.752+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:31.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:30 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:30.872+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:31.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:30 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:30.872+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:31.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:30 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:30.872+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:31.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:31 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:31.078+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:31.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:31 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:31.078+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:31.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:31 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:31.078+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:31.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:31 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:31.078+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:31.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:31 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:31.076+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:31.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:31 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:31.076+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:31.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:31 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:31.076+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:31.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:31 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:31.281+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:31.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:31 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:31.281+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:31.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:31 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:31.281+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:31.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:31 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:31.281+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:31.473 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:31 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:31.023+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:31.473 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:31 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:31.023+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:31.474 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:31 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:31.023+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:31.474 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:31 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:31.023+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:43:59.665838+0000 front 2024-05-14T15:43:59.665730+0000 (oldest deadline 2024-05-14T15:44:24.366034+0000) 2024-05-14T15:44:32.047 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:31 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:31.722+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:32.048 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:31 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:31.722+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:32.048 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:31 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:31.722+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:32.048 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:31 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:31.722+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:32.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:31 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:31.910+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:32.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:31 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:31.910+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:32.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:31 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:31.910+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:32.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:32 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:32.042+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:32.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:32 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:32.042+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:32.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:32 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:32.042+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:32.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:32 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:32.042+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:32.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:32 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:32.049+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:32.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:32 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:32.049+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:32.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:32 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:32.049+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:32.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:32 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:32.272+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:32.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:32 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:32.272+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:32.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:32 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:32.272+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:32.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:32 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:32.272+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:32.474 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:32 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:32.045+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:32.474 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:32 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:32.045+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:32.474 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:32 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:32.045+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:32.474 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:32 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:32.045+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:43:59.665838+0000 front 2024-05-14T15:43:59.665730+0000 (oldest deadline 2024-05-14T15:44:24.366034+0000) 2024-05-14T15:44:32.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:32 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:32.702+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:32.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:32 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:32.702+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:32.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:32 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:32.702+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:32.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:32 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:32.702+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:33.344 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:32 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:32.946+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:33.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:32 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:32.946+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:33.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:32 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:32.946+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:33.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:33 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:33.045+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:33.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:33 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:33.045+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:33.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:33 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:33.045+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:33.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:33 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:33.045+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:33.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:33 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:33.090+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:33.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:33 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:33.090+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:33.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:33 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:33.090+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:33.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:33 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:33.262+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:33.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:33 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:33.262+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:33.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:33 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:33.262+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:33.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:33 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:33.262+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:33.474 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:33 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:33.030+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.353001+0000 front 2024-05-14T15:43:30.352842+0000 (oldest deadline 2024-05-14T15:43:55.653053+0000) 2024-05-14T15:44:33.474 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:33 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:33.030+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.356794+0000 front 2024-05-14T15:43:40.356871+0000 (oldest deadline 2024-05-14T15:44:04.457020+0000) 2024-05-14T15:44:33.474 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:33 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:33.030+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.760453+0000 front 2024-05-14T15:43:49.760525+0000 (oldest deadline 2024-05-14T15:44:13.860807+0000) 2024-05-14T15:44:33.474 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:33 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6[56721]: 2024-05-14T15:44:33.030+0000 7f7142600700 -1 osd.6 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:43:59.665838+0000 front 2024-05-14T15:43:59.665730+0000 (oldest deadline 2024-05-14T15:44:24.366034+0000) 2024-05-14T15:44:33.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:33 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:33.720+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:33.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:33 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:33.720+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:33.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:33 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:33.720+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:33.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:33 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:33.720+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:34.344 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:33 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:33.960+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:34.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:33 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:33.960+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:34.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:33 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:33.960+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:34.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:34 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:34.038+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:34.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:34 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:34.038+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:34.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:34 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:34.038+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:34.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:34 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:34.038+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:34.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:34 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:34.101+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:34.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:34 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:34.101+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:34.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:34 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:34.101+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:34.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:34 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:34.255+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:34.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:34 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:34.255+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:34.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:34 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:34.256+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:34.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:34 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:34.256+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:35.103 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:34 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:34.725+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:35.103 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:34 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:34.725+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:35.103 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:34 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:34.725+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:35.103 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:34 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:34.725+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:35.103 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:34 smithi069 podman[116827]: 2024-05-14 15:44:34.750354539 +0000 UTC m=+6.432517484 container died 9e42bc8c5571e48148fe3d650e7765fabe30a32f1a7d1ccf977b3d125d4d0eb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS) 2024-05-14T15:44:35.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:34 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:34.941+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:35.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:34 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:34.942+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:35.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:34 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:34.942+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:35.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:34 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:34.942+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:35.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:35 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:35.022+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:35.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:35 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:35.022+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:35.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:35 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:35.022+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:35.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:35 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:35.023+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:35.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:35 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:35.023+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:35.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:35 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:35.064+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:35.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:35 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:35.064+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:35.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:35 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:35.064+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:35.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:35 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:35.246+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:35.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:35 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:35.246+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:35.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:35 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:35.246+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:35.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:35 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:35.246+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:35.473 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:35 smithi069 podman[116827]: 2024-05-14 15:44:35.271654318 +0000 UTC m=+6.953817286 container cleanup 9e42bc8c5571e48148fe3d650e7765fabe30a32f1a7d1ccf977b3d125d4d0eb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5) 2024-05-14T15:44:35.474 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:35 smithi069 bash[116827]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6 2024-05-14T15:44:35.974 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:35 smithi069 podman[116844]: 2024-05-14 15:44:35.523018876 +0000 UTC m=+0.740503788 container remove 9e42bc8c5571e48148fe3d650e7765fabe30a32f1a7d1ccf977b3d125d4d0eb6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD) 2024-05-14T15:44:35.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:35 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:35.704+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:35.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:35 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:35.704+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:35.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:35 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:35.704+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:35.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:35 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:35.704+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:35.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:35 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:35.704+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:36.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:35 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:35.905+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:36.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:35 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:35.905+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:36.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:35 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:35.905+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:36.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:35 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:35.905+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:36.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:36 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:36.056+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:36.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:36 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:36.056+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:36.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:36 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:36.056+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:36.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:36 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:36.056+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:36.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:36 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:36.056+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:36.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:36 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:36.022+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:36.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:36 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:36.022+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:36.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:36 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:36.022+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:36.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:36 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:36.226+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:36.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:36 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:36.226+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:36.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:36 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:36.226+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:36.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:36 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:36.226+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:36.684 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:36 smithi069 podman[116938]: 2024-05-14 15:44:36.333703962 +0000 UTC m=+0.035358239 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:44:36.684 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:36 smithi069 podman[116938]: 2024-05-14 15:44:36.480473826 +0000 UTC m=+0.182128131 container create fdc5369b31babe4bc66247f12a76a58e998e400f1edea804959c8d06b838a5ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6-deactivate, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux ) 2024-05-14T15:44:36.684 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:36 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:36.670+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:36.684 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:36 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:36.670+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:36.684 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:36 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:36.670+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:36.684 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:36 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:36.670+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:36.684 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:36 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:36.670+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:36.963 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:36 smithi069 podman[116938]: 2024-05-14 15:44:36.802587496 +0000 UTC m=+0.504241861 container init fdc5369b31babe4bc66247f12a76a58e998e400f1edea804959c8d06b838a5ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-05-14T15:44:36.963 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:36 smithi069 podman[116938]: 2024-05-14 15:44:36.813566558 +0000 UTC m=+0.515220869 container start fdc5369b31babe4bc66247f12a76a58e998e400f1edea804959c8d06b838a5ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6-deactivate, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-05-14T15:44:36.964 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:36 smithi069 podman[116938]: 2024-05-14 15:44:36.962580845 +0000 UTC m=+0.664235194 container attach fdc5369b31babe4bc66247f12a76a58e998e400f1edea804959c8d06b838a5ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6-deactivate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-14T15:44:37.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:36 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:36.907+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:37.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:36 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:36.907+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:37.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:36 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:36.907+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:37.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:36 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:36.907+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:37.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:37 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:37.061+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:37.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:37 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:37.061+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:37.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:37 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:37.061+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:37.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:37 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:37.061+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:37.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:37 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:37.061+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:37.391 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:37 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:37.012+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:37.391 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:37 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:37.012+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:37.391 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:37 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:37.012+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:37.391 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:37 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:37.012+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.818926+0000 front 2024-05-14T15:44:12.819003+0000 (oldest deadline 2024-05-14T15:44:36.919153+0000) 2024-05-14T15:44:37.391 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:37 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:37.230+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:37.391 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:37 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:37.230+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:37.392 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:37 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:37.230+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:37.392 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:37 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:37.230+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:37.643 INFO:journalctl@ceph.osd.6.smithi069.stdout:May 14 15:44:37 smithi069 podman[116938]: 2024-05-14 15:44:37.255866961 +0000 UTC m=+0.957521273 container died fdc5369b31babe4bc66247f12a76a58e998e400f1edea804959c8d06b838a5ab (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-6-deactivate, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T15:44:37.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:37 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:37.671+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:37.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:37 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:37.671+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:37.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:37 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:37.671+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:37.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:37 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:37.671+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:37.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:37 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:37.671+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:38.101 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.6.service' 2024-05-14T15:44:38.194 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:44:38.194 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-14T15:44:38.194 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-14T15:44:38.194 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.7 2024-05-14T15:44:38.273 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:38 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:38.001+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:38.273 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:38 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:38.001+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:38.273 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:38 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:38.001+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:38.273 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:38 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:38.001+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.818926+0000 front 2024-05-14T15:44:12.819003+0000 (oldest deadline 2024-05-14T15:44:36.919153+0000) 2024-05-14T15:44:38.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:37 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:37.915+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:38.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:37 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:37.915+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:38.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:37 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:37.915+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:38.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:37 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:37.915+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:38.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:38 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:38.015+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:38.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:38 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:38.015+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:38.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:38 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:38.015+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:38.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:38 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:38.015+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:38.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:38 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:38.015+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:38.693 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:38 smithi092 systemd[1]: Stopping Ceph osd.7 for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:44:38.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:38 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:38.273+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:38.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:38 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:38.273+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:38.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:38 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:38.273+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:38.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:38 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:38.273+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:38.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:38 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:38.273+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:38.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:38.622+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:38.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:38.622+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:38.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:38.622+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:38.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:38.622+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:38.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:38 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:38.622+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:39.193 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:38 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:38.798+0000 7f58adc00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:44:39.193 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:38 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:38.798+0000 7f58adc00700 -1 osd.7 125 *** Got signal Terminated *** 2024-05-14T15:44:39.193 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:38 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:38.798+0000 7f58adc00700 -1 osd.7 125 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T15:44:39.194 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:39 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:39.036+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:39.194 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:39 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:39.036+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:39.194 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:39 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:39.036+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:39.194 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:39 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:39.036+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.818926+0000 front 2024-05-14T15:44:12.819003+0000 (oldest deadline 2024-05-14T15:44:36.919153+0000) 2024-05-14T15:44:39.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:38 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:38.901+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:39.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:38 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:38.901+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:39.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:38 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:38.901+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:39.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:38 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:38.901+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:39.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:38 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:38.995+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:39.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:38 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:38.995+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:39.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:38 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:38.995+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:39.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:38 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:38.995+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:39.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:38 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:38.995+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:39.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:39 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:39.279+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:39.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:39 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:39.279+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:39.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:39 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:39.279+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:39.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:39 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:39.279+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:39.695 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:39 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:39.279+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:39.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:39 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:39.609+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:39.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:39 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:39.609+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:39.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:39 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:39.609+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:39.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:39 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:39.609+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:39.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:39 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:39.609+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:40.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:39 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:39.938+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:40.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:39 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:39.938+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:40.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:39 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:39.938+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:40.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:39 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:39.938+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:40.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:40 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:40.000+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:40.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:40 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:40.000+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:40.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:40 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:40.000+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:40.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:40 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:40.000+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:40.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:40 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:40.000+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:40.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:40 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:40.078+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:40.444 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:40 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:40.078+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:40.444 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:40 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:40.078+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:40.444 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:40 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:40.078+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.818926+0000 front 2024-05-14T15:44:12.819003+0000 (oldest deadline 2024-05-14T15:44:36.919153+0000) 2024-05-14T15:44:40.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:40 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:40.300+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:40.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:40 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:40.300+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:40.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:40 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:40.300+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:40.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:40 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:40.300+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:40.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:40 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:40.300+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:40.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:40 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:40.603+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:40.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:40 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:40.603+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:40.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:40 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:40.603+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:40.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:40 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:40.603+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:40.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:40 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:40.603+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:41.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:40 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:40.890+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:41.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:40 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:40.890+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:41.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:40 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:40.890+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:41.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:40 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:40.890+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:41.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:40 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:40.976+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:41.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:40 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:40.976+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:41.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:40 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:40.976+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:41.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:40 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:40.976+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:41.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:40 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:40.976+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:41.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:41 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:41.092+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:41.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:41 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:41.092+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:41.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:41 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:41.092+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:41.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:41 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:41.092+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.818926+0000 front 2024-05-14T15:44:12.819003+0000 (oldest deadline 2024-05-14T15:44:36.919153+0000) 2024-05-14T15:44:41.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:41 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:41.252+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:41.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:41 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:41.252+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:41.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:41 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:41.252+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:41.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:41 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:41.252+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:41.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:41 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:41.252+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:41.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:41 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:41.575+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:41.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:41 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:41.575+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:41.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:41 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:41.575+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:41.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:41 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:41.575+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:41.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:41 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:41.575+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:42.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:41 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:41.877+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:42.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:41 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:41.877+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:42.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:41 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:41.877+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:42.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:41 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:41.877+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:42.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:41 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:41.930+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:42.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:41 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:41.930+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:42.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:41 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:41.930+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:42.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:41 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:41.930+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:42.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:41 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:41.930+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:42.443 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:42 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:42.049+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:42.444 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:42 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:42.049+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:42.444 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:42 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:42.049+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:42.444 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:42 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:42.049+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.818926+0000 front 2024-05-14T15:44:12.819003+0000 (oldest deadline 2024-05-14T15:44:36.919153+0000) 2024-05-14T15:44:42.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:42 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:42.285+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:42.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:42 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:42.285+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:42.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:42 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:42.285+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:42.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:42 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:42.285+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:42.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:42 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:42.285+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:42.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:42 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:42.621+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:42.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:42 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:42.621+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:42.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:42 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:42.621+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:42.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:42 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:42.621+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:42.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:42 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:42.621+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:43.312 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:43 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:43.018+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.303653+0000 front 2024-05-14T15:43:40.303796+0000 (oldest deadline 2024-05-14T15:44:03.203409+0000) 2024-05-14T15:44:43.312 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:43 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:43.018+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.406932+0000 front 2024-05-14T15:43:48.406684+0000 (oldest deadline 2024-05-14T15:44:14.306795+0000) 2024-05-14T15:44:43.312 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:43 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:43.018+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.710211+0000 front 2024-05-14T15:44:00.710547+0000 (oldest deadline 2024-05-14T15:44:24.711990+0000) 2024-05-14T15:44:43.312 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:43 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7[52700]: 2024-05-14T15:44:43.018+0000 7f58a4400700 -1 osd.7 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.818926+0000 front 2024-05-14T15:44:12.819003+0000 (oldest deadline 2024-05-14T15:44:36.919153+0000) 2024-05-14T15:44:43.344 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:42 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:42.848+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:43.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:42 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:42.848+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:43.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:42 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:42.848+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:43.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:42 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:42.848+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:43.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:42 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:42.976+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:43.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:42 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:42.976+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:43.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:42 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:42.976+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:43.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:42 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:42.976+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:43.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:42 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:42.976+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:43.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:43 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:43.309+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:43.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:43 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:43.309+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:43.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:43 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:43.309+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:43.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:43 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:43.309+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:43.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:43 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:43.309+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:43.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:43 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:43.596+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:43.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:43 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:43.596+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:43.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:43 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:43.596+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:43.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:43 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:43.596+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:43.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:43 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:43.596+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:44.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:43 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:43.891+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:44.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:43 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:43.891+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:44.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:43 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:43.891+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:44.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:43 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:43.891+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:44.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:43 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:43.996+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:44.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:43 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:43.996+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:44.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:43 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:43.996+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:44.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:43 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:43.996+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:44.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:43 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:43.996+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:44.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:44 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:44.312+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:44.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:44 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:44.312+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:44.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:44 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:44.312+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:44.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:44 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:44.312+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:44.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:44 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:44.312+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:44.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:44 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:44.611+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:44.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:44 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:44.611+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:44.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:44 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:44.611+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:44.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:44 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:44.611+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:44.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:44 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:44.611+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:45.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:44 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:44.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:45.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:44 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:44.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:45.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:44 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:44.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:45.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:44 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:44.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:45.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:45 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:45.044+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:45.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:45 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:45.044+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:45.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:45 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:45.044+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:45.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:45 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:45.044+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:45.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:45 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:45.044+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:45.681 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:45 smithi092 podman[73268]: 2024-05-14 15:44:45.3586793 +0000 UTC m=+6.725514811 container died ef028671244da9b0fc5a3073c76b8d96d7872126466c4cc38482247f5dc68898 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T15:44:45.681 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:45 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:45.279+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:45.681 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:45 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:45.279+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:45.681 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:45 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:45.279+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:45.681 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:45 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:45.279+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:45.681 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:45 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:45.279+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:45.943 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:45 smithi092 podman[73268]: 2024-05-14 15:44:45.842447364 +0000 UTC m=+7.209282886 container cleanup ef028671244da9b0fc5a3073c76b8d96d7872126466c4cc38482247f5dc68898 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T15:44:45.943 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:45 smithi092 bash[73268]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7 2024-05-14T15:44:45.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:45 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:45.624+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:45.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:45 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:45.624+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:45.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:45 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:45.624+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:45.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:45 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:45.624+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:45.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:45 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:45.624+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:45.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:45 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:45.624+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:44:46.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:45 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:45.829+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:46.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:45 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:45.829+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:46.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:45 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:45.829+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:46.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:45 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:45.829+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:46.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:45 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:45.829+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:44:46.095 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:45.999+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:46.095 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:45.999+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:46.095 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:45.999+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:46.095 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:45.999+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:46.096 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:45.999+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:46.096 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:45.999+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:23.026056+0000 front 2024-05-14T15:44:23.026137+0000 (oldest deadline 2024-05-14T15:44:45.227663+0000) 2024-05-14T15:44:46.446 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:46 smithi092 podman[73285]: 2024-05-14 15:44:46.136788757 +0000 UTC m=+0.752444783 container remove ef028671244da9b0fc5a3073c76b8d96d7872126466c4cc38482247f5dc68898 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-14T15:44:46.446 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:46 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:46.276+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:46.446 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:46 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:46.276+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:46.446 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:46 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:46.276+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:46.446 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:46 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:46.276+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:46.446 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:46 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:46.276+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:46.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:46 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:46.660+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:46.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:46 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:46.660+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:46.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:46 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:46.660+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:46.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:46 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:46.660+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:46.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:46 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:46.660+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:46.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:46 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:46.660+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:44:47.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:46.835+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:47.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:46.835+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:47.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:46.835+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:47.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:46.835+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:47.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:46.835+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:44:47.095 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:46.995+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:47.095 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:46.995+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:47.095 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:46.995+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:47.095 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:46.995+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:47.095 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:46.995+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:47.096 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:46 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:46.995+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:23.026056+0000 front 2024-05-14T15:44:23.026137+0000 (oldest deadline 2024-05-14T15:44:45.227663+0000) 2024-05-14T15:44:47.193 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:46 smithi092 podman[73374]: 2024-05-14 15:44:46.804182302 +0000 UTC m=+0.031139435 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:44:47.193 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:46 smithi092 podman[73374]: 2024-05-14 15:44:46.928141361 +0000 UTC m=+0.155098523 container create aebbac3b81129e4f58979e04452e30691c023b203e68d8062573f46107f09540 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7-deactivate, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True) 2024-05-14T15:44:47.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:47 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:47.285+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:47.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:47 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:47.285+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:47.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:47 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:47.285+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:47.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:47 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:47.285+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:47.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:47 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:47.285+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:47.694 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:47 smithi092 podman[73374]: 2024-05-14 15:44:47.226634531 +0000 UTC m=+0.453591750 container init aebbac3b81129e4f58979e04452e30691c023b203e68d8062573f46107f09540 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-05-14T15:44:47.694 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:47 smithi092 podman[73374]: 2024-05-14 15:44:47.238516441 +0000 UTC m=+0.465473617 container start aebbac3b81129e4f58979e04452e30691c023b203e68d8062573f46107f09540 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2) 2024-05-14T15:44:47.694 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:47 smithi092 podman[73374]: 2024-05-14 15:44:47.322245013 +0000 UTC m=+0.549202232 container attach aebbac3b81129e4f58979e04452e30691c023b203e68d8062573f46107f09540 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-14T15:44:47.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:47 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:47.622+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:47.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:47 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:47.622+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:47.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:47 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:47.622+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:47.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:47 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:47.622+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:47.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:47 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:47.622+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:47.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:47 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:47.622+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:44:48.080 INFO:journalctl@ceph.osd.7.smithi092.stdout:May 14 15:44:47 smithi092 podman[73399]: 2024-05-14 15:44:47.753565966 +0000 UTC m=+0.034835809 container died aebbac3b81129e4f58979e04452e30691c023b203e68d8062573f46107f09540 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-7-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD) 2024-05-14T15:44:48.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:47 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:47.863+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:48.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:47 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:47.863+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:48.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:47 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:47.863+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:48.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:47 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:47.863+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:48.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:47 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:47.863+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:44:48.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:48 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:48.028+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:48.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:48 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:48.028+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:48.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:48 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:48.028+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:48.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:48 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:48.028+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:48.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:48 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:48.028+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:48.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:48 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:48.028+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:23.026056+0000 front 2024-05-14T15:44:23.026137+0000 (oldest deadline 2024-05-14T15:44:45.227663+0000) 2024-05-14T15:44:48.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:48 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:48.309+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:48.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:48 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:48.309+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:48.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:48 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:48.309+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:48.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:48 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:48.309+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:48.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:48 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:48.309+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:48.444 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:48 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:48.309+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:44:48.562 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.7.service' 2024-05-14T15:44:48.665 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:44:48.665 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-14T15:44:48.666 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-05-14T15:44:48.666 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.8 2024-05-14T15:44:48.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:48 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:48.613+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:48.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:48 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:48.613+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:48.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:48 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:48.613+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:48.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:48 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:48.613+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:48.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:48 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:48.613+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:48.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:48 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:48.613+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:44:49.040 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:48 smithi203 systemd[1]: Stopping Ceph osd.8 for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:44:49.040 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:48 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:48.825+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:49.041 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:48 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:48.825+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:49.041 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:48 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:48.825+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:49.041 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:48 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:48.825+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:49.041 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:48 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:48.825+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:44:49.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:49 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:49.039+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:49.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:49 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:49.039+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:49.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:49 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:49.039+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:49.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:49 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:49.039+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:49.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:49 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:49.039+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:49.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:49 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:49.039+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:23.026056+0000 front 2024-05-14T15:44:23.026137+0000 (oldest deadline 2024-05-14T15:44:45.227663+0000) 2024-05-14T15:44:49.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:49 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:49.246+0000 7ff8e0200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:44:49.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:49 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:49.246+0000 7ff8e0200700 -1 osd.8 125 *** Got signal Terminated *** 2024-05-14T15:44:49.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:49 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:49.246+0000 7ff8e0200700 -1 osd.8 125 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T15:44:49.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:49 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:49.358+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:49.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:49 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:49.358+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:49.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:49 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:49.358+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:49.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:49 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:49.358+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:49.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:49 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:49.358+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:49.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:49 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:49.358+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:44:49.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:49 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:49.662+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:49.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:49 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:49.662+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:49.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:49 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:49.662+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:49.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:49 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:49.662+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:49.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:49 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:49.662+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:49.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:49 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:49.662+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:44:50.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:49 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:49.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:50.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:49 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:49.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:50.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:49 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:49.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:50.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:49 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:49.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:50.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:49 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:49.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:44:50.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:50 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:50.081+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:50.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:50 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:50.081+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:50.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:50 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:50.081+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:50.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:50 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:50.082+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:50.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:50 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:50.082+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:50.346 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:50 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:50.082+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:23.026056+0000 front 2024-05-14T15:44:23.026137+0000 (oldest deadline 2024-05-14T15:44:45.227663+0000) 2024-05-14T15:44:50.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:50 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:50.389+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:50.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:50 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:50.389+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:50.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:50 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:50.389+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:50.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:50 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:50.389+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:50.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:50 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:50.389+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:50.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:50 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:50.389+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:44:50.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:50 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:50.641+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:50.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:50 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:50.641+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:50.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:50 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:50.641+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:50.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:50 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:50.641+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:50.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:50 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:50.641+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:50.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:50 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:50.641+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:44:51.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:51 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:51.076+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:51.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:51 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:51.076+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:51.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:51 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:51.076+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:51.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:51 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:51.076+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:51.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:51 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:51.076+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:51.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:51 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:51.076+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:23.026056+0000 front 2024-05-14T15:44:23.026137+0000 (oldest deadline 2024-05-14T15:44:45.227663+0000) 2024-05-14T15:44:51.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:50 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:50.909+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:51.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:50 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:50.909+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:51.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:50 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:50.909+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:51.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:50 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:50.909+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:51.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:50 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:50.909+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:44:51.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:51 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:51.364+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:51.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:51 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:51.364+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:51.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:51 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:51.364+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:51.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:51 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:51.364+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:51.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:51 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:51.364+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:51.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:51 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:51.364+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:44:51.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:51 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:51.616+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:51.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:51 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:51.616+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:51.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:51 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:51.616+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:51.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:51 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:51.616+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:51.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:51 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:51.616+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:51.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:51 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:51.616+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:44:52.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:52 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:52.124+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:52.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:52 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:52.124+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:52.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:52 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:52.124+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:52.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:52 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:52.124+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:52.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:52 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:52.124+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:52.345 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:52 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:52.124+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:23.026056+0000 front 2024-05-14T15:44:23.026137+0000 (oldest deadline 2024-05-14T15:44:45.227663+0000) 2024-05-14T15:44:52.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:51 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:51.884+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:52.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:51 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:51.885+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:52.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:51 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:51.885+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:52.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:51 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:51.885+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:52.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:51 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:51.885+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:44:52.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:52 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:52.370+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:52.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:52 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:52.370+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:52.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:52 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:52.370+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:52.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:52 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:52.370+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:52.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:52 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:52.370+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:52.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:52 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:52.370+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:44:52.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:52 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:52.666+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:52.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:52 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:52.666+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:52.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:52 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:52.666+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:52.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:52 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:52.666+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:52.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:52 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:52.666+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:52.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:52 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:52.666+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:44:53.247 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:52 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:52.928+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:53.247 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:52 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:52.928+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:53.247 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:52 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:52.928+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:53.247 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:52 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:52.928+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:53.247 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:52 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:52.928+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:44:53.247 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:53 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:53.112+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:53.248 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:53 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:53.112+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:53.248 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:53 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:53.112+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:53.248 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:53 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:53.112+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:53.248 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:53 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:53.112+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:53.248 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:53 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:53.112+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:23.026056+0000 front 2024-05-14T15:44:23.026137+0000 (oldest deadline 2024-05-14T15:44:45.227663+0000) 2024-05-14T15:44:53.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:53 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:53.389+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:53.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:53 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:53.389+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:53.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:53 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:53.389+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:53.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:53 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:53.389+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:53.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:53 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:53.389+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:53.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:53 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:53.389+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:44:53.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:53 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:53.683+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:53.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:53 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:53.683+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:53.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:53 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:53.683+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:53.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:53 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:53.683+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:53.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:53 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:53.683+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:53.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:53 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:53.683+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:44:54.279 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:54 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:54.122+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:28.801903+0000 front 2024-05-14T15:43:28.802071+0000 (oldest deadline 2024-05-14T15:43:53.502177+0000) 2024-05-14T15:44:54.279 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:54 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:54.122+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:40.408277+0000 front 2024-05-14T15:43:40.408015+0000 (oldest deadline 2024-05-14T15:44:05.108075+0000) 2024-05-14T15:44:54.279 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:54 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:54.122+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:51.512177+0000 front 2024-05-14T15:43:51.512644+0000 (oldest deadline 2024-05-14T15:44:14.412312+0000) 2024-05-14T15:44:54.279 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:54 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:54.122+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:00.217201+0000 front 2024-05-14T15:44:00.217091+0000 (oldest deadline 2024-05-14T15:44:28.418891+0000) 2024-05-14T15:44:54.279 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:54 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:54.122+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:12.521779+0000 front 2024-05-14T15:44:12.521971+0000 (oldest deadline 2024-05-14T15:44:34.822064+0000) 2024-05-14T15:44:54.279 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:54 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8[53366]: 2024-05-14T15:44:54.122+0000 7ff8d6a00700 -1 osd.8 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:23.026056+0000 front 2024-05-14T15:44:23.026137+0000 (oldest deadline 2024-05-14T15:44:45.227663+0000) 2024-05-14T15:44:54.279 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:53 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:53.904+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:54.279 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:53 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:53.904+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:54.280 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:53 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:53.904+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:54.280 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:53 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:53.904+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:54.280 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:53 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:53.904+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:44:54.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:54 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:54.350+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:54.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:54 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:54.350+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:54.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:54 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:54.350+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:54.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:54 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:54.350+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:54.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:54 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:54.350+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:54.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:54 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:54.350+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:44:54.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:54 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:54.651+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:54.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:54 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:54.651+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:54.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:54 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:54.651+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:54.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:54 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:54.651+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:54.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:54 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:54.651+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:54.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:54 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:54.651+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:44:55.215 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:54 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:54.945+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:55.215 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:54 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:54.945+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:55.215 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:54 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:54.945+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:55.215 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:54 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:54.945+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:55.215 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:54 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:54.945+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:44:55.538 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:55 smithi203 podman[75547]: 2024-05-14 15:44:55.213505437 +0000 UTC m=+6.102679915 container died 3c441321632f722815e97317e9ad353f14ebd2984fd764519213872e5e5364ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:44:55.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:55 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:55.397+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:55.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:55 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:55.397+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:55.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:55 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:55.397+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:55.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:55 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:55.397+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:55.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:55 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:55.397+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:55.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:55 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:55.397+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:44:55.844 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:55 smithi203 podman[75547]: 2024-05-14 15:44:55.673390006 +0000 UTC m=+6.562564497 container cleanup 3c441321632f722815e97317e9ad353f14ebd2984fd764519213872e5e5364ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T15:44:55.845 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:55 smithi203 bash[75547]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8 2024-05-14T15:44:55.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:55 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:55.641+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:55.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:55 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:55.641+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:55.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:55 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:55.641+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:55.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:55 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:55.641+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:55.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:55 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:55.641+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:55.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:55 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:55.641+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:44:56.344 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:55 smithi203 podman[75573]: 2024-05-14 15:44:55.941669491 +0000 UTC m=+0.715438376 container remove 3c441321632f722815e97317e9ad353f14ebd2984fd764519213872e5e5364ad (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-05-14T15:44:56.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:55 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:55.954+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:56.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:55 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:55.954+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:56.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:55 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:55.954+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:56.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:55 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:55.954+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:56.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:55 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:55.954+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:44:56.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:56 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:56.412+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:56.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:56 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:56.412+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:56.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:56 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:56.412+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:56.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:56 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:56.412+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:56.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:56 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:56.412+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:56.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:56 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:56.412+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:44:56.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:56 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:56.412+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:44:56.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:56 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:56.651+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:56.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:56 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:56.651+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:56.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:56 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:56.651+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:56.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:56 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:56.651+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:56.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:56 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:56.651+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:56.975 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:56 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:56.651+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:44:57.095 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:56 smithi203 podman[75663]: 2024-05-14 15:44:56.730085503 +0000 UTC m=+0.033368431 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:44:57.095 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:56 smithi203 podman[75663]: 2024-05-14 15:44:56.867522172 +0000 UTC m=+0.170805133 container create 70e36de952620ccf3e77f331a94c38166d796033cb064a3955be75a64a60ba32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8-deactivate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:44:57.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:56 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:56.912+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:57.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:56 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:56.912+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:57.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:56 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:56.912+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:57.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:56 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:56.912+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:57.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:56 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:56.912+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:44:57.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:56 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:56.912+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:44:57.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:57 smithi203 podman[75663]: 2024-05-14 15:44:57.188466661 +0000 UTC m=+0.491749611 container init 70e36de952620ccf3e77f331a94c38166d796033cb064a3955be75a64a60ba32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8-deactivate, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD) 2024-05-14T15:44:57.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:57 smithi203 podman[75663]: 2024-05-14 15:44:57.200602981 +0000 UTC m=+0.503885971 container start 70e36de952620ccf3e77f331a94c38166d796033cb064a3955be75a64a60ba32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8-deactivate, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T15:44:57.595 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:57 smithi203 podman[75663]: 2024-05-14 15:44:57.303979569 +0000 UTC m=+0.607262553 container attach 70e36de952620ccf3e77f331a94c38166d796033cb064a3955be75a64a60ba32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240507, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T15:44:57.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:57 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:57.448+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:57.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:57 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:57.448+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:57.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:57 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:57.448+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:57.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:57 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:57.448+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:57.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:57 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:57.448+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:57.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:57 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:57.448+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:44:57.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:57 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:57.448+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:44:57.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:57.618+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:57.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:57.618+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:57.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:57.618+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:57.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:57.618+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:57.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:57.618+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:57.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:57 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:57.618+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:44:58.023 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:57 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:57.889+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:58.023 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:57 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:57.889+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:58.023 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:57 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:57.889+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:58.023 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:57 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:57.889+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:58.023 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:57 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:57.889+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:44:58.023 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:57 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:57.889+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:44:58.024 INFO:journalctl@ceph.osd.8.smithi203.stdout:May 14 15:44:57 smithi203 podman[75663]: 2024-05-14 15:44:57.650368617 +0000 UTC m=+0.953651641 container died 70e36de952620ccf3e77f331a94c38166d796033cb064a3955be75a64a60ba32 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-14T15:44:58.423 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.8.service' 2024-05-14T15:44:58.541 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:44:58.541 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-05-14T15:44:58.541 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-05-14T15:44:58.541 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.9 2024-05-14T15:44:58.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:58 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:58.491+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:58.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:58 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:58.491+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:58.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:58 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:58.491+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:58.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:58 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:58.491+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:58.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:58 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:58.491+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:58.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:58 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:58.491+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:44:58.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:58 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:58.491+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:44:58.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:58 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:58.596+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:58.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:58 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:58.596+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:58.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:58 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:58.596+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:58.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:58 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:58.596+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:58.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:58 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:58.596+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:58.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:58 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:58.596+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:44:58.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:58 smithi069 systemd[1]: Stopping Ceph osd.9 for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:44:59.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:58 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:58.902+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:44:59.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:58 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:58.902+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:44:59.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:58 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:58.902+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:44:59.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:58 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:58.902+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:44:59.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:58 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:58.902+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:44:59.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:58 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:58.902+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:44:59.473 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:59 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:59.096+0000 7ff61a400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:44:59.473 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:59 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:59.097+0000 7ff61a400700 -1 osd.9 125 *** Got signal Terminated *** 2024-05-14T15:44:59.474 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:59 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:59.097+0000 7ff61a400700 -1 osd.9 125 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T15:44:59.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:59 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:59.520+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:44:59.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:59 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:59.520+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:44:59.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:59 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:59.520+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:44:59.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:59 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:59.520+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:44:59.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:59 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:59.520+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:44:59.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:59 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:59.520+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:44:59.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:44:59 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:44:59.520+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:44:59.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:59 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:59.592+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:44:59.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:59 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:59.592+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:44:59.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:59 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:59.592+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:44:59.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:59 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:59.592+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:44:59.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:59 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:59.592+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:44:59.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:44:59 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:44:59.592+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:45:00.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:59 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:59.940+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:00.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:59 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:59.940+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:00.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:59 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:59.940+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:00.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:59 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:59.940+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:00.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:59 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:59.940+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:00.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:44:59 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:44:59.940+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:00.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:00 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:00.566+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:45:00.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:00 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:00.566+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:45:00.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:00 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:00.566+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:45:00.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:00 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:00.566+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:45:00.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:00 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:00.566+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:45:00.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:00 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:00.566+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:45:00.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:00 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:00.566+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:45:00.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:00.598+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:45:00.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:00.598+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:45:00.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:00.598+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:45:00.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:00.598+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:45:00.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:00.598+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:45:00.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:00 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:00.598+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:45:01.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:00 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:00.915+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:01.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:00 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:00.915+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:01.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:00 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:00.915+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:01.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:00 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:00.915+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:01.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:00 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:00.915+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:01.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:00 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:00.915+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:01.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:01 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:01.540+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:45:01.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:01 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:01.540+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:45:01.693 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:01 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:01.540+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:45:01.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:01 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:01.540+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:45:01.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:01 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:01.540+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:45:01.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:01 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:01.540+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:45:01.694 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:01 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:01.540+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:45:01.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:01 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:01.626+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:45:01.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:01 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:01.626+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:45:01.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:01 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:01.626+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:45:01.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:01 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:01.626+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:45:01.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:01 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:01.626+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:45:01.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:01 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:01.626+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:45:02.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:01 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:01.884+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:02.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:01 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:01.884+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:02.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:01 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:01.884+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:02.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:01 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:01.884+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:02.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:01 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:01.884+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:02.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:01 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:01.884+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:02.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:02 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:02.549+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:45:02.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:02 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:02.549+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:45:02.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:02 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:02.549+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:45:02.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:02 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:02.549+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:45:02.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:02 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:02.549+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:45:02.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:02 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:02.549+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:45:02.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:02 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:02.549+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:45:02.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:02 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:02.639+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:45:02.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:02 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:02.639+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:45:02.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:02 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:02.639+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:45:02.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:02 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:02.639+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:45:02.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:02 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:02.639+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:45:02.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:02 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:02.639+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:45:03.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:02 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:02.878+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:03.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:02 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:02.878+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:03.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:02 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:02.878+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:03.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:02 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:02.878+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:03.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:02 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:02.878+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:03.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:02 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:02.878+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:03.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:03 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:03.568+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:45:03.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:03 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:03.568+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:45:03.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:03 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:03.568+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:45:03.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:03 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:03.568+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:45:03.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:03 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:03.568+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:45:03.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:03 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:03.568+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:45:03.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:03 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:03.568+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:45:03.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:03 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:03.653+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:30.133059+0000 front 2024-05-14T15:43:30.133160+0000 (oldest deadline 2024-05-14T15:43:55.433292+0000) 2024-05-14T15:45:03.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:03 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:03.653+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:39.536648+0000 front 2024-05-14T15:43:39.536234+0000 (oldest deadline 2024-05-14T15:44:04.836468+0000) 2024-05-14T15:45:03.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:03 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:03.653+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:49.539540+0000 front 2024-05-14T15:43:49.539335+0000 (oldest deadline 2024-05-14T15:44:13.541321+0000) 2024-05-14T15:45:03.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:03 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:03.653+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.846426+0000 front 2024-05-14T15:44:02.846572+0000 (oldest deadline 2024-05-14T15:44:26.848295+0000) 2024-05-14T15:45:03.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:03 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:03.653+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.750567+0000 front 2024-05-14T15:44:09.750635+0000 (oldest deadline 2024-05-14T15:44:35.050395+0000) 2024-05-14T15:45:03.974 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:03 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9[63741]: 2024-05-14T15:45:03.653+0000 7ff615c00700 -1 osd.9 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.853589+0000 front 2024-05-14T15:44:20.853702+0000 (oldest deadline 2024-05-14T15:44:44.953319+0000) 2024-05-14T15:45:04.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:03 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:03.898+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:04.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:03 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:03.898+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:04.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:03 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:03.898+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:04.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:03 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:03.898+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:04.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:03 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:03.898+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:04.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:03 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:03.898+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:04.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:04 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:04.545+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:45:04.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:04 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:04.545+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:45:04.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:04 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:04.545+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:45:04.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:04 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:04.545+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:45:04.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:04 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:04.545+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:45:04.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:04 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:04.545+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:45:04.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:04 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:04.545+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:45:05.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:04 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:04.903+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:05.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:04 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:04.903+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:05.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:04 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:04.903+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:05.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:04 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:04.903+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:05.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:04 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:04.903+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:05.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:04 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:04.903+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:05.674 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:05 smithi069 podman[117055]: 2024-05-14 15:45:05.370671509 +0000 UTC m=+6.432108781 container died dc7321948c11b6de0d4fcfb5fe3835fa4bc75c5cecee3e364f74e446200286bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-05-14T15:45:05.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:05 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:05.525+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:45:05.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:05 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:05.525+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:45:05.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:05 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:05.525+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:45:05.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:05 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:05.525+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:45:05.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:05 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:05.525+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:45:05.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:05 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:05.525+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:45:05.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:05 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:05.525+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:45:05.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:05 smithi069 podman[117055]: 2024-05-14 15:45:05.834502172 +0000 UTC m=+6.895939437 container cleanup dc7321948c11b6de0d4fcfb5fe3835fa4bc75c5cecee3e364f74e446200286bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-14T15:45:05.973 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:05 smithi069 bash[117055]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9 2024-05-14T15:45:06.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:05 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:05.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:06.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:05 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:05.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:06.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:05 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:05.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:06.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:05 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:05.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:06.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:05 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:05.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:06.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:05 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:05.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:06.473 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:06 smithi069 podman[117073]: 2024-05-14 15:45:06.083331421 +0000 UTC m=+0.684277802 container remove dc7321948c11b6de0d4fcfb5fe3835fa4bc75c5cecee3e364f74e446200286bb (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:45:06.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:06 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:06.570+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:45:06.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:06 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:06.570+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:45:06.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:06 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:06.570+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:45:06.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:06 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:06.570+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:45:06.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:06 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:06.570+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:45:06.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:06 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:06.570+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:45:06.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:06 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:06.570+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:45:07.135 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:06 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:06.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:07.170 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:06 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:06.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:07.170 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:06 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:06.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:07.170 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:06 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:06.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:07.170 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:06 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:06.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:07.170 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:06 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:06.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:07.223 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:06 smithi069 podman[117160]: 2024-05-14 15:45:06.850588339 +0000 UTC m=+0.032662902 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:45:07.224 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:06 smithi069 podman[117160]: 2024-05-14 15:45:06.96759026 +0000 UTC m=+0.149664846 container create 4fed1d7ff1a620468d25976730fc082748abb4c9ee83501622567b937e97f28b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9-deactivate, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, ceph=True) 2024-05-14T15:45:07.706 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:07 smithi069 podman[117160]: 2024-05-14 15:45:07.254467381 +0000 UTC m=+0.436541955 container init 4fed1d7ff1a620468d25976730fc082748abb4c9ee83501622567b937e97f28b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-14T15:45:07.706 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:07 smithi069 podman[117160]: 2024-05-14 15:45:07.265068947 +0000 UTC m=+0.447143571 container start 4fed1d7ff1a620468d25976730fc082748abb4c9ee83501622567b937e97f28b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:45:07.706 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:07 smithi069 podman[117160]: 2024-05-14 15:45:07.403453854 +0000 UTC m=+0.585528434 container attach 4fed1d7ff1a620468d25976730fc082748abb4c9ee83501622567b937e97f28b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240507, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:45:07.706 INFO:journalctl@ceph.osd.9.smithi069.stdout:May 14 15:45:07 smithi069 podman[117160]: 2024-05-14 15:45:07.70536985 +0000 UTC m=+0.887444404 container died 4fed1d7ff1a620468d25976730fc082748abb4c9ee83501622567b937e97f28b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-9-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-14T15:45:07.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:07 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:07.578+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:45:07.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:07 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:07.578+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:45:07.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:07 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:07.578+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:45:07.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:07 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:07.578+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:45:07.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:07 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:07.578+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:45:07.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:07 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:07.578+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:45:07.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:07 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:07.578+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:45:08.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:07 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:07.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:08.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:07 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:07.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:08.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:07 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:07.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:08.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:07 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:07.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:08.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:07 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:07.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:08.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:07 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:07.880+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:08.492 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.9.service' 2024-05-14T15:45:08.593 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:45:08.594 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-05-14T15:45:08.594 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-05-14T15:45:08.594 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.10 2024-05-14T15:45:08.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:08 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:08.579+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:45:08.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:08 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:08.579+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:45:08.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:08 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:08.579+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:45:08.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:08 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:08.579+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:45:08.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:08 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:08.579+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:45:08.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:08 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:08.579+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:45:08.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:08 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:08.579+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:45:08.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:08 smithi092 systemd[1]: Stopping Ceph osd.10 for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:45:09.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:08 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:08.913+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:09.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:08 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:08.913+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:09.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:08 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:08.913+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:09.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:08 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:08.913+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:09.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:08 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:08.913+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:09.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:08 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:08.913+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:09.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:08 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:08.913+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-05-14T15:44:42.802788+0000 front 2024-05-14T15:44:42.802875+0000 (oldest deadline 2024-05-14T15:45:08.102388+0000) 2024-05-14T15:45:09.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:09.151+0000 7ff4e2400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:45:09.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:09.151+0000 7ff4e2400700 -1 osd.10 125 *** Got signal Terminated *** 2024-05-14T15:45:09.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:09.151+0000 7ff4e2400700 -1 osd.10 125 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T15:45:09.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:09.610+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:45:09.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:09.610+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:45:09.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:09.610+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:45:09.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:09.610+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:45:09.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:09.610+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:45:09.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:09.610+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:45:09.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:09.610+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:45:10.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:09 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:09.894+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:10.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:09 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:09.894+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:10.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:09 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:09.894+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:10.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:09 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:09.894+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:10.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:09 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:09.894+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:10.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:09 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:09.894+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:10.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:09 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:09.894+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-05-14T15:44:42.802788+0000 front 2024-05-14T15:44:42.802875+0000 (oldest deadline 2024-05-14T15:45:08.102388+0000) 2024-05-14T15:45:10.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:10.609+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:45:10.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:10.609+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:45:10.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:10.609+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:45:10.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:10.609+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:45:10.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:10.609+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:45:10.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:10.609+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:45:10.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:10 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:10.609+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:45:11.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:10 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:10.875+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:11.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:10 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:10.875+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:11.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:10 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:10.875+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:11.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:10 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:10.875+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:11.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:10 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:10.875+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:11.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:10 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:10.875+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:11.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:10 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:10.875+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-05-14T15:44:42.802788+0000 front 2024-05-14T15:44:42.802875+0000 (oldest deadline 2024-05-14T15:45:08.102388+0000) 2024-05-14T15:45:11.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:11 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:11.627+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:45:11.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:11 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:11.627+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:45:11.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:11 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:11.627+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:45:11.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:11 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:11.627+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:45:11.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:11 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:11.627+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:45:11.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:11 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:11.627+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:45:11.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:11 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:11.627+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:45:12.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:11 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:11.860+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:12.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:11 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:11.860+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:12.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:11 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:11.860+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:12.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:11 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:11.860+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:12.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:11 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:11.860+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:12.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:11 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:11.860+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:12.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:11 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:11.860+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-05-14T15:44:42.802788+0000 front 2024-05-14T15:44:42.802875+0000 (oldest deadline 2024-05-14T15:45:08.102388+0000) 2024-05-14T15:45:12.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:12 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:12.608+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:45:12.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:12 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:12.608+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:45:12.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:12 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:12.608+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:45:12.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:12 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:12.608+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:45:12.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:12 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:12.608+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:45:12.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:12 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:12.608+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:45:12.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:12 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:12.608+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:45:13.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:12 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:12.814+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:13.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:12 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:12.814+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:13.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:12 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:12.814+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:13.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:12 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:12.814+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:13.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:12 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:12.814+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:13.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:12 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:12.814+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:13.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:12 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:12.814+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-05-14T15:44:42.802788+0000 front 2024-05-14T15:44:42.802875+0000 (oldest deadline 2024-05-14T15:45:08.102388+0000) 2024-05-14T15:45:13.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:13 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:13.574+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:29.345616+0000 front 2024-05-14T15:43:29.345515+0000 (oldest deadline 2024-05-14T15:43:54.644973+0000) 2024-05-14T15:45:13.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:13 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:13.574+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:38.048096+0000 front 2024-05-14T15:43:38.048530+0000 (oldest deadline 2024-05-14T15:44:02.748348+0000) 2024-05-14T15:45:13.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:13 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:13.574+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:48.050277+0000 front 2024-05-14T15:43:48.050105+0000 (oldest deadline 2024-05-14T15:44:13.350179+0000) 2024-05-14T15:45:13.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:13 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:13.574+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6814 osd.3 since back 2024-05-14T15:44:02.655403+0000 front 2024-05-14T15:44:02.655288+0000 (oldest deadline 2024-05-14T15:44:25.555199+0000) 2024-05-14T15:45:13.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:13 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:13.574+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:11.760529+0000 front 2024-05-14T15:44:11.760663+0000 (oldest deadline 2024-05-14T15:44:37.660732+0000) 2024-05-14T15:45:13.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:13 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:13.574+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:22.863385+0000 front 2024-05-14T15:44:22.863898+0000 (oldest deadline 2024-05-14T15:44:47.464680+0000) 2024-05-14T15:45:13.944 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:13 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10[59362]: 2024-05-14T15:45:13.574+0000 7ff4d8c00700 -1 osd.10 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:32.167063+0000 front 2024-05-14T15:44:32.166745+0000 (oldest deadline 2024-05-14T15:44:55.666366+0000) 2024-05-14T15:45:14.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:13 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:13.826+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:14.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:13 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:13.826+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:14.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:13 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:13.826+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:14.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:13 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:13.826+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:14.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:13 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:13.826+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:14.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:13 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:13.826+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:14.095 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:13 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:13.826+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-05-14T15:44:42.802788+0000 front 2024-05-14T15:44:42.802875+0000 (oldest deadline 2024-05-14T15:45:08.102388+0000) 2024-05-14T15:45:15.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:14 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:14.866+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:15.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:14 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:14.866+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:15.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:14 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:14.866+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:15.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:14 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:14.866+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:15.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:14 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:14.866+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:15.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:14 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:14.866+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:15.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:14 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:14.866+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-05-14T15:44:42.802788+0000 front 2024-05-14T15:44:42.802875+0000 (oldest deadline 2024-05-14T15:45:08.102388+0000) 2024-05-14T15:45:15.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:15 smithi092 podman[73491]: 2024-05-14 15:45:15.094683527 +0000 UTC m=+6.083712058 container died c3919f97a3f2f674c7eeb5c78a6f41ed042633671641cd6fc5bd65f325bb7638 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_CLEAN=True) 2024-05-14T15:45:15.895 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:15 smithi092 podman[73491]: 2024-05-14 15:45:15.64347157 +0000 UTC m=+6.632500094 container cleanup c3919f97a3f2f674c7eeb5c78a6f41ed042633671641cd6fc5bd65f325bb7638 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:45:15.895 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:15 smithi092 bash[73491]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10 2024-05-14T15:45:16.193 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:15 smithi092 podman[73509]: 2024-05-14 15:45:15.894413146 +0000 UTC m=+0.784713755 container remove c3919f97a3f2f674c7eeb5c78a6f41ed042633671641cd6fc5bd65f325bb7638 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T15:45:16.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:15.906+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:16.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:15.906+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:16.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:15.906+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:16.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:15.906+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:16.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:15.906+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:16.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:15.906+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:16.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:15.906+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-05-14T15:44:42.802788+0000 front 2024-05-14T15:44:42.802875+0000 (oldest deadline 2024-05-14T15:45:08.102388+0000) 2024-05-14T15:45:16.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:16 smithi092 podman[73597]: 2024-05-14 15:45:16.592104296 +0000 UTC m=+0.032602127 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:45:16.943 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:16 smithi092 podman[73597]: 2024-05-14 15:45:16.703927437 +0000 UTC m=+0.144425308 container create ee2dd0001183a2862eb4b237cd783d392877a0bf16308e4c2bfe73dd25abdd66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10-deactivate, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-14T15:45:17.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:16.906+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:17.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:16.906+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:17.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:16.906+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:17.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:16.906+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:17.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:16.906+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:17.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:16.906+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:17.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:16 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:16.906+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-05-14T15:44:42.802788+0000 front 2024-05-14T15:44:42.802875+0000 (oldest deadline 2024-05-14T15:45:08.102388+0000) 2024-05-14T15:45:17.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:17 smithi092 podman[73597]: 2024-05-14 15:45:17.049164441 +0000 UTC m=+0.489662315 container init ee2dd0001183a2862eb4b237cd783d392877a0bf16308e4c2bfe73dd25abdd66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-14T15:45:17.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:17 smithi092 podman[73597]: 2024-05-14 15:45:17.062156587 +0000 UTC m=+0.502654427 container start ee2dd0001183a2862eb4b237cd783d392877a0bf16308e4c2bfe73dd25abdd66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T15:45:17.443 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:17 smithi092 podman[73597]: 2024-05-14 15:45:17.148022347 +0000 UTC m=+0.588520275 container attach ee2dd0001183a2862eb4b237cd783d392877a0bf16308e4c2bfe73dd25abdd66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T15:45:17.882 INFO:journalctl@ceph.osd.10.smithi092.stdout:May 14 15:45:17 smithi092 podman[73597]: 2024-05-14 15:45:17.515276795 +0000 UTC m=+0.955774658 container died ee2dd0001183a2862eb4b237cd783d392877a0bf16308e4c2bfe73dd25abdd66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-10-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-14T15:45:18.256 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.10.service' 2024-05-14T15:45:18.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:17.892+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:18.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:17.892+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:18.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:17.892+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:18.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:17.892+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:18.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:17.892+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:18.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:17.892+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:18.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:17 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:17.892+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-05-14T15:44:42.802788+0000 front 2024-05-14T15:44:42.802875+0000 (oldest deadline 2024-05-14T15:45:08.102388+0000) 2024-05-14T15:45:18.366 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:45:18.366 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-05-14T15:45:18.366 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-05-14T15:45:18.366 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.11 2024-05-14T15:45:18.844 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:18 smithi203 systemd[1]: Stopping Ceph osd.11 for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:45:19.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:18.846+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:19.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:18.846+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:19.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:18.846+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:19.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:18.846+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:19.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:18.846+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:19.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:18.846+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:19.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:18.846+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-05-14T15:44:42.802788+0000 front 2024-05-14T15:44:42.802875+0000 (oldest deadline 2024-05-14T15:45:08.102388+0000) 2024-05-14T15:45:19.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:18.846+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6820 osd.8 since back 2024-05-14T15:44:53.404051+0000 front 2024-05-14T15:44:53.404242+0000 (oldest deadline 2024-05-14T15:45:18.103965+0000) 2024-05-14T15:45:19.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:19.025+0000 7f1112200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:45:19.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:19.025+0000 7f1112200700 -1 osd.11 125 *** Got signal Terminated *** 2024-05-14T15:45:19.346 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:19.025+0000 7f1112200700 -1 osd.11 125 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-14T15:45:20.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:19.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:20.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:19.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:20.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:19.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:20.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:19.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:20.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:19.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:20.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:19.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:20.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:19.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-05-14T15:44:42.802788+0000 front 2024-05-14T15:44:42.802875+0000 (oldest deadline 2024-05-14T15:45:08.102388+0000) 2024-05-14T15:45:20.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:19 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:19.873+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6820 osd.8 since back 2024-05-14T15:44:53.404051+0000 front 2024-05-14T15:44:53.404242+0000 (oldest deadline 2024-05-14T15:45:18.103965+0000) 2024-05-14T15:45:21.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:20.863+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:21.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:20.863+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:21.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:20.863+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:21.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:20.863+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:21.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:20.863+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:21.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:20.864+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:21.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:20.864+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-05-14T15:44:42.802788+0000 front 2024-05-14T15:44:42.802875+0000 (oldest deadline 2024-05-14T15:45:08.102388+0000) 2024-05-14T15:45:21.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:20 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:20.864+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6820 osd.8 since back 2024-05-14T15:44:53.404051+0000 front 2024-05-14T15:44:53.404242+0000 (oldest deadline 2024-05-14T15:45:18.103965+0000) 2024-05-14T15:45:22.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:21.877+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:22.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:21.877+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:22.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:21.877+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:22.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:21.877+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:22.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:21.877+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:22.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:21.877+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:22.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:21.877+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-05-14T15:44:42.802788+0000 front 2024-05-14T15:44:42.802875+0000 (oldest deadline 2024-05-14T15:45:08.102388+0000) 2024-05-14T15:45:22.345 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:21 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:21.877+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6820 osd.8 since back 2024-05-14T15:44:53.404051+0000 front 2024-05-14T15:44:53.404242+0000 (oldest deadline 2024-05-14T15:45:18.103965+0000) 2024-05-14T15:45:23.247 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:22.916+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:23.247 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:22.916+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:23.248 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:22.916+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:23.248 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:22.916+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:23.248 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:22.916+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:23.248 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:22.916+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:23.248 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:22.916+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-05-14T15:44:42.802788+0000 front 2024-05-14T15:44:42.802875+0000 (oldest deadline 2024-05-14T15:45:08.102388+0000) 2024-05-14T15:45:23.248 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:22.916+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6820 osd.8 since back 2024-05-14T15:44:53.404051+0000 front 2024-05-14T15:44:53.404242+0000 (oldest deadline 2024-05-14T15:45:18.103965+0000) 2024-05-14T15:45:24.284 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:23.912+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6806 osd.0 since back 2024-05-14T15:43:26.572123+0000 front 2024-05-14T15:43:26.572373+0000 (oldest deadline 2024-05-14T15:43:52.472175+0000) 2024-05-14T15:45:24.284 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:23.912+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6804 osd.1 since back 2024-05-14T15:43:41.579219+0000 front 2024-05-14T15:43:41.579354+0000 (oldest deadline 2024-05-14T15:44:04.479346+0000) 2024-05-14T15:45:24.284 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:23.912+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6804 osd.2 since back 2024-05-14T15:43:50.381793+0000 front 2024-05-14T15:43:50.381883+0000 (oldest deadline 2024-05-14T15:44:13.881975+0000) 2024-05-14T15:45:24.284 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:23.912+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6812 osd.4 since back 2024-05-14T15:44:09.689648+0000 front 2024-05-14T15:44:09.689758+0000 (oldest deadline 2024-05-14T15:44:34.291384+0000) 2024-05-14T15:45:24.284 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:23.912+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6812 osd.5 since back 2024-05-14T15:44:20.695488+0000 front 2024-05-14T15:44:20.695694+0000 (oldest deadline 2024-05-14T15:44:45.395775+0000) 2024-05-14T15:45:24.284 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:23.912+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.69:6822 osd.6 since back 2024-05-14T15:44:31.297924+0000 front 2024-05-14T15:44:31.297880+0000 (oldest deadline 2024-05-14T15:44:56.498611+0000) 2024-05-14T15:45:24.285 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:23.912+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.92:6820 osd.7 since back 2024-05-14T15:44:42.802788+0000 front 2024-05-14T15:44:42.802875+0000 (oldest deadline 2024-05-14T15:45:08.102388+0000) 2024-05-14T15:45:24.285 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:23 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11[60303]: 2024-05-14T15:45:23.912+0000 7f1108a00700 -1 osd.11 125 heartbeat_check: no reply from 172.21.15.203:6820 osd.8 since back 2024-05-14T15:44:53.404051+0000 front 2024-05-14T15:44:53.404242+0000 (oldest deadline 2024-05-14T15:45:18.103965+0000) 2024-05-14T15:45:25.344 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:25 smithi203 podman[75767]: 2024-05-14 15:45:25.150673778 +0000 UTC m=+6.365350639 container died 3a584047d77f9ccfd304b4c55df8914a908e7a878e55f7dee9525da9721d65ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD) 2024-05-14T15:45:25.788 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:25 smithi203 podman[75767]: 2024-05-14 15:45:25.584653353 +0000 UTC m=+6.799330200 container cleanup 3a584047d77f9ccfd304b4c55df8914a908e7a878e55f7dee9525da9721d65ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T15:45:25.789 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:25 smithi203 bash[75767]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11 2024-05-14T15:45:25.789 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:25 smithi203 podman[75796]: 2024-05-14 15:45:25.785898363 +0000 UTC m=+0.606717945 container remove 3a584047d77f9ccfd304b4c55df8914a908e7a878e55f7dee9525da9721d65ef (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True) 2024-05-14T15:45:26.844 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:26 smithi203 podman[75882]: 2024-05-14 15:45:26.447738336 +0000 UTC m=+0.036061107 image pull bc14c6192b1a9279701ead435afd6a28db099db39c71ce5b6f404961d71ff345 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430 2024-05-14T15:45:26.845 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:26 smithi203 podman[75882]: 2024-05-14 15:45:26.587104615 +0000 UTC m=+0.175427404 container create 467f909c357fae14e6c0dbd7cf1ec7546fb410d435638e63a73e63b7a755b79b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:45:27.325 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:26 smithi203 podman[75882]: 2024-05-14 15:45:26.848855773 +0000 UTC m=+0.437178545 container init 467f909c357fae14e6c0dbd7cf1ec7546fb410d435638e63a73e63b7a755b79b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11-deactivate, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507, GIT_CLEAN=True, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-14T15:45:27.326 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:26 smithi203 podman[75882]: 2024-05-14 15:45:26.860233637 +0000 UTC m=+0.448556446 container start 467f909c357fae14e6c0dbd7cf1ec7546fb410d435638e63a73e63b7a755b79b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11-deactivate, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507) 2024-05-14T15:45:27.326 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:26 smithi203 podman[75882]: 2024-05-14 15:45:26.939330244 +0000 UTC m=+0.527653077 container attach 467f909c357fae14e6c0dbd7cf1ec7546fb410d435638e63a73e63b7a755b79b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T15:45:27.326 INFO:journalctl@ceph.osd.11.smithi203.stdout:May 14 15:45:27 smithi203 podman[75882]: 2024-05-14 15:45:27.324665822 +0000 UTC m=+0.912988694 container died 467f909c357fae14e6c0dbd7cf1ec7546fb410d435638e63a73e63b7a755b79b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-osd-11-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T15:45:28.067 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@osd.11.service' 2024-05-14T15:45:28.182 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:45:28.182 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-05-14T15:45:28.183 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-05-14T15:45:28.183 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.a 2024-05-14T15:45:28.724 INFO:journalctl@ceph.mds.a.smithi069.stdout:May 14 15:45:28 smithi069 systemd[1]: Stopping Ceph mds.a for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:45:29.224 INFO:journalctl@ceph.mds.a.smithi069.stdout:May 14 15:45:28 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-a[70763]: 2024-05-14T15:45:28.781+0000 7f2220600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:45:29.224 INFO:journalctl@ceph.mds.a.smithi069.stdout:May 14 15:45:28 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-a[70763]: 2024-05-14T15:45:28.781+0000 7f2220600700 -1 mds.a *** got signal Terminated *** 2024-05-14T15:45:32.473 INFO:journalctl@ceph.mds.a.smithi069.stdout:May 14 15:45:32 smithi069 podman[117277]: 2024-05-14 15:45:32.18200716 +0000 UTC m=+3.558728258 container died 1ec93ab2325da832c95800336154c4ad6d07e324582c8a98d8f7ea4b05e0691f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-a, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=) 2024-05-14T15:45:32.910 INFO:journalctl@ceph.mds.a.smithi069.stdout:May 14 15:45:32 smithi069 podman[117277]: 2024-05-14 15:45:32.658316075 +0000 UTC m=+4.035037166 container cleanup 1ec93ab2325da832c95800336154c4ad6d07e324582c8a98d8f7ea4b05e0691f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-a, org.label-schema.build-date=20240507, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-14T15:45:32.911 INFO:journalctl@ceph.mds.a.smithi069.stdout:May 14 15:45:32 smithi069 bash[117277]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-a 2024-05-14T15:45:33.223 INFO:journalctl@ceph.mds.a.smithi069.stdout:May 14 15:45:32 smithi069 podman[117289]: 2024-05-14 15:45:32.9094089 +0000 UTC m=+0.714108396 container remove 1ec93ab2325da832c95800336154c4ad6d07e324582c8a98d8f7ea4b05e0691f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-a, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=) 2024-05-14T15:45:33.349 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.a.service' 2024-05-14T15:45:33.446 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:45:33.446 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-05-14T15:45:33.446 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-05-14T15:45:33.446 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.d 2024-05-14T15:45:33.973 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:45:33 smithi069 systemd[1]: Stopping Ceph mds.d for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:45:34.473 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:45:34 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-d[69352]: 2024-05-14T15:45:34.059+0000 7f208c200700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:45:34.474 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:45:34 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-d[69352]: 2024-05-14T15:45:34.059+0000 7f208c200700 -1 mds.d *** got signal Terminated *** 2024-05-14T15:45:36.314 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:45:36 smithi069 podman[117398]: 2024-05-14 15:45:36.029409438 +0000 UTC m=+2.091240389 container died 2638599ce9a6e0411394fc6863fee59ccab887c2c85794642e8fd28aa5af0223 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-d, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-14T15:45:36.670 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:45:36 smithi069 podman[117398]: 2024-05-14 15:45:36.512317365 +0000 UTC m=+2.574148280 container cleanup 2638599ce9a6e0411394fc6863fee59ccab887c2c85794642e8fd28aa5af0223 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-d, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-05-14T15:45:36.670 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:45:36 smithi069 bash[117398]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-d 2024-05-14T15:45:36.973 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:45:36 smithi069 podman[117411]: 2024-05-14 15:45:36.766801496 +0000 UTC m=+0.713718321 container remove 2638599ce9a6e0411394fc6863fee59ccab887c2c85794642e8fd28aa5af0223 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-d, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS) 2024-05-14T15:45:37.198 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.d.service' 2024-05-14T15:45:37.267 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:45:37 smithi069 systemd[1]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.d.service: Deactivated successfully. 2024-05-14T15:45:37.268 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:45:37 smithi069 systemd[1]: Stopped Ceph mds.d for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:45:37.268 INFO:journalctl@ceph.mds.d.smithi069.stdout:May 14 15:45:37 smithi069 systemd[1]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.d.service: Consumed 2.723s CPU time. 2024-05-14T15:45:37.300 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:45:37.300 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-05-14T15:45:37.301 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-05-14T15:45:37.301 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.g 2024-05-14T15:45:37.723 INFO:journalctl@ceph.mds.g.smithi069.stdout:May 14 15:45:37 smithi069 systemd[1]: Stopping Ceph mds.g for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:45:38.223 INFO:journalctl@ceph.mds.g.smithi069.stdout:May 14 15:45:37 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-g[70343]: 2024-05-14T15:45:37.862+0000 7f3a30400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:45:38.224 INFO:journalctl@ceph.mds.g.smithi069.stdout:May 14 15:45:37 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-g[70343]: 2024-05-14T15:45:37.862+0000 7f3a30400700 -1 mds.g *** got signal Terminated *** 2024-05-14T15:45:39.687 INFO:journalctl@ceph.mds.g.smithi069.stdout:May 14 15:45:39 smithi069 podman[117526]: 2024-05-14 15:45:39.353693436 +0000 UTC m=+1.621524751 container died 17f68fe0585dd1f9de39fd7429b1f88a0bbd35ac2acbb417188ab0e03ff59171 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-g, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:45:39.973 INFO:journalctl@ceph.mds.g.smithi069.stdout:May 14 15:45:39 smithi069 podman[117526]: 2024-05-14 15:45:39.808021618 +0000 UTC m=+2.075852953 container cleanup 17f68fe0585dd1f9de39fd7429b1f88a0bbd35ac2acbb417188ab0e03ff59171 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-g, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507) 2024-05-14T15:45:39.974 INFO:journalctl@ceph.mds.g.smithi069.stdout:May 14 15:45:39 smithi069 bash[117526]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-g 2024-05-14T15:45:40.474 INFO:journalctl@ceph.mds.g.smithi069.stdout:May 14 15:45:40 smithi069 podman[117540]: 2024-05-14 15:45:40.059159301 +0000 UTC m=+0.689325967 container remove 17f68fe0585dd1f9de39fd7429b1f88a0bbd35ac2acbb417188ab0e03ff59171 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-g, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240507, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-05-14T15:45:40.554 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.g.service' 2024-05-14T15:45:40.661 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:45:40.661 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-05-14T15:45:40.661 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-05-14T15:45:40.661 DEBUG:teuthology.orchestra.run.smithi069:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.j 2024-05-14T15:45:41.223 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:45:40 smithi069 systemd[1]: Stopping Ceph mds.j for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:45:41.724 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:45:41 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-j[68938]: 2024-05-14T15:45:41.267+0000 7f8757800700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:45:41.724 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:45:41 smithi069 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-j[68938]: 2024-05-14T15:45:41.268+0000 7f8757800700 -1 mds.j *** got signal Terminated *** 2024-05-14T15:45:43.450 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:45:43 smithi069 podman[117646]: 2024-05-14 15:45:43.135545997 +0000 UTC m=+1.993517568 container died e71b1e048153fe2997fda96c267e7fba244836da8eaef0d01ee4fbb97dd13f79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-j, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T15:45:43.723 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:45:43 smithi069 podman[117646]: 2024-05-14 15:45:43.636711539 +0000 UTC m=+2.494683142 container cleanup e71b1e048153fe2997fda96c267e7fba244836da8eaef0d01ee4fbb97dd13f79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T15:45:43.723 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:45:43 smithi069 bash[117646]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-j 2024-05-14T15:45:44.161 DEBUG:teuthology.orchestra.run.smithi069:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.j.service' 2024-05-14T15:45:44.223 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:45:43 smithi069 podman[117658]: 2024-05-14 15:45:43.912626791 +0000 UTC m=+0.762128757 container remove e71b1e048153fe2997fda96c267e7fba244836da8eaef0d01ee4fbb97dd13f79 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2) 2024-05-14T15:45:44.223 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:45:44 smithi069 systemd[1]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.j.service: Deactivated successfully. 2024-05-14T15:45:44.223 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:45:44 smithi069 systemd[1]: Stopped Ceph mds.j for 1cc2580e-1203-11ef-bc98-c7b262605968. 2024-05-14T15:45:44.223 INFO:journalctl@ceph.mds.j.smithi069.stdout:May 14 15:45:44 smithi069 systemd[1]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.j.service: Consumed 2.716s CPU time. 2024-05-14T15:45:44.264 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:45:44.264 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-05-14T15:45:44.264 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-05-14T15:45:44.264 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.b 2024-05-14T15:45:44.692 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:45:44 smithi092 systemd[1]: Stopping Ceph mds.b for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:45:45.193 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:45:44 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b[64556]: 2024-05-14T15:45:44.831+0000 7f132ae00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:45:45.193 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:45:44 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b[64556]: 2024-05-14T15:45:44.831+0000 7f132ae00700 -1 mds.b *** got signal Terminated *** 2024-05-14T15:45:53.442 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:45:53 smithi092 podman[73717]: 2024-05-14 15:45:53.153700953 +0000 UTC m=+8.452543709 container died bc41471641aefa1ed89602b147212d427d0617c12f51ab48c068ca50b53ca30d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=) 2024-05-14T15:45:53.867 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:45:53 smithi092 podman[73717]: 2024-05-14 15:45:53.610430141 +0000 UTC m=+8.909272890 container cleanup bc41471641aefa1ed89602b147212d427d0617c12f51ab48c068ca50b53ca30d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.33.5) 2024-05-14T15:45:53.868 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:45:53 smithi092 bash[73717]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b 2024-05-14T15:45:54.193 INFO:journalctl@ceph.mds.b.smithi092.stdout:May 14 15:45:53 smithi092 podman[73730]: 2024-05-14 15:45:53.86646984 +0000 UTC m=+0.692134240 container remove bc41471641aefa1ed89602b147212d427d0617c12f51ab48c068ca50b53ca30d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-b, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T15:45:54.343 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.b.service' 2024-05-14T15:45:54.440 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:45:54.440 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-05-14T15:45:54.440 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-05-14T15:45:54.441 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.e 2024-05-14T15:45:54.942 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:45:54 smithi092 systemd[1]: Stopping Ceph mds.e for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:45:55.443 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:45:55 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:45:55.065+0000 7f8a1be00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:45:55.443 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:45:55 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e[63934]: 2024-05-14T15:45:55.065+0000 7f8a1be00700 -1 mds.e *** got signal Terminated *** 2024-05-14T15:46:01.052 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:46:00 smithi092 podman[73839]: 2024-05-14 15:46:00.739390733 +0000 UTC m=+5.816423433 container died fcffe07313c6834f0be8009a0652385a9a639561d453a94e41def9d1bda2737a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-05-14T15:46:01.421 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:46:01 smithi092 podman[73839]: 2024-05-14 15:46:01.210617562 +0000 UTC m=+6.287650225 container cleanup fcffe07313c6834f0be8009a0652385a9a639561d453a94e41def9d1bda2737a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True) 2024-05-14T15:46:01.421 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:46:01 smithi092 bash[73839]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e 2024-05-14T15:46:01.693 INFO:journalctl@ceph.mds.e.smithi092.stdout:May 14 15:46:01 smithi092 podman[73850]: 2024-05-14 15:46:01.419934962 +0000 UTC m=+0.655080225 container remove fcffe07313c6834f0be8009a0652385a9a639561d453a94e41def9d1bda2737a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-05-14T15:46:01.881 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.e.service' 2024-05-14T15:46:01.985 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:46:01.985 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-05-14T15:46:01.985 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-05-14T15:46:01.985 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.h 2024-05-14T15:46:02.192 INFO:journalctl@ceph.mds.h.smithi092.stdout:May 14 15:46:02 smithi092 systemd[1]: Stopping Ceph mds.h for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:46:02.943 INFO:journalctl@ceph.mds.h.smithi092.stdout:May 14 15:46:02 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-h[64238]: 2024-05-14T15:46:02.561+0000 7febd1000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:46:02.943 INFO:journalctl@ceph.mds.h.smithi092.stdout:May 14 15:46:02 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-h[64238]: 2024-05-14T15:46:02.561+0000 7febd1000700 -1 mds.h *** got signal Terminated *** 2024-05-14T15:46:07.943 INFO:journalctl@ceph.mds.h.smithi092.stdout:May 14 15:46:07 smithi092 podman[73963]: 2024-05-14 15:46:07.643090993 +0000 UTC m=+5.232088701 container died 8fc665051fca720fcdbcb91f7a19075d3baf342061c3762feb0c27056f1a64a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-h, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-05-14T15:46:08.323 INFO:journalctl@ceph.mds.h.smithi092.stdout:May 14 15:46:08 smithi092 podman[73963]: 2024-05-14 15:46:08.096599402 +0000 UTC m=+5.685597141 container cleanup 8fc665051fca720fcdbcb91f7a19075d3baf342061c3762feb0c27056f1a64a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-h, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240507) 2024-05-14T15:46:08.323 INFO:journalctl@ceph.mds.h.smithi092.stdout:May 14 15:46:08 smithi092 bash[73963]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-h 2024-05-14T15:46:08.692 INFO:journalctl@ceph.mds.h.smithi092.stdout:May 14 15:46:08 smithi092 podman[73976]: 2024-05-14 15:46:08.322499452 +0000 UTC m=+0.663283669 container remove 8fc665051fca720fcdbcb91f7a19075d3baf342061c3762feb0c27056f1a64a5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-05-14T15:46:08.857 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.h.service' 2024-05-14T15:46:08.959 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:46:08.960 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-05-14T15:46:08.960 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-05-14T15:46:08.960 DEBUG:teuthology.orchestra.run.smithi092:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.k 2024-05-14T15:46:09.193 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:46:09 smithi092 systemd[1]: Stopping Ceph mds.k for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:46:09.943 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:46:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-k[63623]: 2024-05-14T15:46:09.542+0000 7fee39a00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:46:09.943 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:46:09 smithi092 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-k[63623]: 2024-05-14T15:46:09.542+0000 7fee39a00700 -1 mds.k *** got signal Terminated *** 2024-05-14T15:46:14.063 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:46:13 smithi092 podman[74082]: 2024-05-14 15:46:13.779577642 +0000 UTC m=+4.383430617 container died 0e121ec7b39a0b6ed0ba460af8990578d78c081e86fc4b6a7a87f23043c903d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-k, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5) 2024-05-14T15:46:14.318 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:46:14 smithi092 podman[74082]: 2024-05-14 15:46:14.15764545 +0000 UTC m=+4.761498418 container cleanup 0e121ec7b39a0b6ed0ba460af8990578d78c081e86fc4b6a7a87f23043c903d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-k, GIT_CLEAN=True, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240507, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-14T15:46:14.318 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:46:14 smithi092 bash[74082]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-k 2024-05-14T15:46:14.693 INFO:journalctl@ceph.mds.k.smithi092.stdout:May 14 15:46:14 smithi092 podman[74095]: 2024-05-14 15:46:14.317009408 +0000 UTC m=+0.506876977 container remove 0e121ec7b39a0b6ed0ba460af8990578d78c081e86fc4b6a7a87f23043c903d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-k, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-14T15:46:14.798 DEBUG:teuthology.orchestra.run.smithi092:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.k.service' 2024-05-14T15:46:14.900 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:46:14.900 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-05-14T15:46:14.900 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-05-14T15:46:14.901 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.c 2024-05-14T15:46:15.344 INFO:journalctl@ceph.mds.c.smithi203.stdout:May 14 15:46:15 smithi203 systemd[1]: Stopping Ceph mds.c for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:46:15.845 INFO:journalctl@ceph.mds.c.smithi203.stdout:May 14 15:46:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-c[65138]: 2024-05-14T15:46:15.465+0000 7ff9bd600700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:46:15.845 INFO:journalctl@ceph.mds.c.smithi203.stdout:May 14 15:46:15 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-c[65138]: 2024-05-14T15:46:15.465+0000 7ff9bd600700 -1 mds.c *** got signal Terminated *** 2024-05-14T15:46:17.594 INFO:journalctl@ceph.mds.c.smithi203.stdout:May 14 15:46:17 smithi203 podman[75986]: 2024-05-14 15:46:17.32109021 +0000 UTC m=+1.999270821 container died 9b8e97558b07912d3b247745b9ca17e26edd1359345db8281e799e1444c535a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-c, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240507, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504) 2024-05-14T15:46:18.002 INFO:journalctl@ceph.mds.c.smithi203.stdout:May 14 15:46:17 smithi203 podman[75986]: 2024-05-14 15:46:17.725412888 +0000 UTC m=+2.403593539 container cleanup 9b8e97558b07912d3b247745b9ca17e26edd1359345db8281e799e1444c535a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T15:46:18.003 INFO:journalctl@ceph.mds.c.smithi203.stdout:May 14 15:46:17 smithi203 bash[75986]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-c 2024-05-14T15:46:18.269 INFO:journalctl@ceph.mds.c.smithi203.stdout:May 14 15:46:18 smithi203 podman[76010]: 2024-05-14 15:46:18.00142652 +0000 UTC m=+0.668303567 container remove 9b8e97558b07912d3b247745b9ca17e26edd1359345db8281e799e1444c535a4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-c, ceph=True, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240507) 2024-05-14T15:46:18.287 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.c.service' 2024-05-14T15:46:18.398 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:46:18.398 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-05-14T15:46:18.398 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-05-14T15:46:18.398 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.f 2024-05-14T15:46:18.594 INFO:journalctl@ceph.mds.f.smithi203.stdout:May 14 15:46:18 smithi203 systemd[1]: Stopping Ceph mds.f for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:46:19.345 INFO:journalctl@ceph.mds.f.smithi203.stdout:May 14 15:46:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-f[64830]: 2024-05-14T15:46:18.935+0000 7f91a0c00700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:46:19.345 INFO:journalctl@ceph.mds.f.smithi203.stdout:May 14 15:46:18 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-f[64830]: 2024-05-14T15:46:18.935+0000 7f91a0c00700 -1 mds.f *** got signal Terminated *** 2024-05-14T15:46:21.169 INFO:journalctl@ceph.mds.f.smithi203.stdout:May 14 15:46:20 smithi203 podman[76117]: 2024-05-14 15:46:20.909938891 +0000 UTC m=+2.101376683 container died 0b60258cc0f91101db9ad0a9de6e1c4b87bc20b619828f7a15dc4443d383e370 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , ceph=True) 2024-05-14T15:46:21.497 INFO:journalctl@ceph.mds.f.smithi203.stdout:May 14 15:46:21 smithi203 podman[76117]: 2024-05-14 15:46:21.278822753 +0000 UTC m=+2.470260539 container cleanup 0b60258cc0f91101db9ad0a9de6e1c4b87bc20b619828f7a15dc4443d383e370 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-f, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T15:46:21.497 INFO:journalctl@ceph.mds.f.smithi203.stdout:May 14 15:46:21 smithi203 bash[76117]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-f 2024-05-14T15:46:21.844 INFO:journalctl@ceph.mds.f.smithi203.stdout:May 14 15:46:21 smithi203 podman[76129]: 2024-05-14 15:46:21.496695219 +0000 UTC m=+0.572922383 container remove 0b60258cc0f91101db9ad0a9de6e1c4b87bc20b619828f7a15dc4443d383e370 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-f, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_BRANCH=HEAD) 2024-05-14T15:46:22.011 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.f.service' 2024-05-14T15:46:22.110 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:46:22.110 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-05-14T15:46:22.110 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-05-14T15:46:22.111 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.i 2024-05-14T15:46:22.344 INFO:journalctl@ceph.mds.i.smithi203.stdout:May 14 15:46:22 smithi203 systemd[1]: Stopping Ceph mds.i for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:46:23.094 INFO:journalctl@ceph.mds.i.smithi203.stdout:May 14 15:46:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-i[65447]: 2024-05-14T15:46:22.697+0000 7fe472400700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:46:23.094 INFO:journalctl@ceph.mds.i.smithi203.stdout:May 14 15:46:22 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-i[65447]: 2024-05-14T15:46:22.697+0000 7fe472400700 -1 mds.i *** got signal Terminated *** 2024-05-14T15:46:26.937 INFO:journalctl@ceph.mds.i.smithi203.stdout:May 14 15:46:26 smithi203 podman[76239]: 2024-05-14 15:46:26.666214297 +0000 UTC m=+4.123100350 container died d9cb71fb793dc81af53abce90ed1beaa8c6b9dae3d8c867619b2984be48cf64a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-i, GIT_BRANCH=HEAD, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, io.buildah.version=1.33.5, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240507, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-14T15:46:27.267 INFO:journalctl@ceph.mds.i.smithi203.stdout:May 14 15:46:27 smithi203 podman[76239]: 2024-05-14 15:46:27.049064876 +0000 UTC m=+4.505950926 container cleanup d9cb71fb793dc81af53abce90ed1beaa8c6b9dae3d8c867619b2984be48cf64a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-i, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.build-date=20240507, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-05-14T15:46:27.268 INFO:journalctl@ceph.mds.i.smithi203.stdout:May 14 15:46:27 smithi203 bash[76239]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-i 2024-05-14T15:46:27.594 INFO:journalctl@ceph.mds.i.smithi203.stdout:May 14 15:46:27 smithi203 podman[76251]: 2024-05-14 15:46:27.266840747 +0000 UTC m=+0.582725997 container remove d9cb71fb793dc81af53abce90ed1beaa8c6b9dae3d8c867619b2984be48cf64a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-i, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.build-date=20240507) 2024-05-14T15:46:27.824 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.i.service' 2024-05-14T15:46:27.920 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:46:27.920 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-05-14T15:46:27.920 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-05-14T15:46:27.920 DEBUG:teuthology.orchestra.run.smithi203:> sudo systemctl stop ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.l 2024-05-14T15:46:28.344 INFO:journalctl@ceph.mds.l.smithi203.stdout:May 14 15:46:28 smithi203 systemd[1]: Stopping Ceph mds.l for 1cc2580e-1203-11ef-bc98-c7b262605968... 2024-05-14T15:46:28.844 INFO:journalctl@ceph.mds.l.smithi203.stdout:May 14 15:46:28 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-l[64518]: 2024-05-14T15:46:28.524+0000 7fd653000700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-14T15:46:28.845 INFO:journalctl@ceph.mds.l.smithi203.stdout:May 14 15:46:28 smithi203 ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-l[64518]: 2024-05-14T15:46:28.524+0000 7fd653000700 -1 mds.l *** got signal Terminated *** 2024-05-14T15:46:30.519 INFO:journalctl@ceph.mds.l.smithi203.stdout:May 14 15:46:30 smithi203 podman[76359]: 2024-05-14 15:46:30.145176112 +0000 UTC m=+1.741004757 container died 0daa61d8b7f7ca7468d1f6128b87848b8ec3f4360eb742625e1fb23430bd242a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240507, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a) 2024-05-14T15:46:30.844 INFO:journalctl@ceph.mds.l.smithi203.stdout:May 14 15:46:30 smithi203 podman[76359]: 2024-05-14 15:46:30.627649524 +0000 UTC m=+2.223478181 container cleanup 0daa61d8b7f7ca7468d1f6128b87848b8ec3f4360eb742625e1fb23430bd242a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-l, GIT_CLEAN=True, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.build-date=20240507, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2) 2024-05-14T15:46:30.845 INFO:journalctl@ceph.mds.l.smithi203.stdout:May 14 15:46:30 smithi203 bash[76359]: ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-l 2024-05-14T15:46:31.285 INFO:journalctl@ceph.mds.l.smithi203.stdout:May 14 15:46:30 smithi203 podman[76372]: 2024-05-14 15:46:30.853475703 +0000 UTC m=+0.597031122 container remove 0daa61d8b7f7ca7468d1f6128b87848b8ec3f4360eb742625e1fb23430bd242a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:d324431b4d2338fa16c3bb003d46b4793ae98b04c9b497ba1bc6cc9b14e61430, name=ceph-1cc2580e-1203-11ef-bc98-c7b262605968-mds-l, org.label-schema.build-date=20240507, RELEASE=wip-vshankar-testing-20240509.053109-debug-e2b755a, io.buildah.version=1.33.5, GIT_COMMIT=627304247bdbcb1f80af6cad8aac9a1ee2979504, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-05-14T15:46:31.322 DEBUG:teuthology.orchestra.run.smithi203:> sudo pkill -f 'journalctl -f -n 0 -u ceph-1cc2580e-1203-11ef-bc98-c7b262605968@mds.l.service' 2024-05-14T15:46:31.429 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-14T15:46:31.429 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-05-14T15:46:31.430 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-14T15:46:31.745 INFO:teuthology.orchestra.run.smithi069.stdout:Deleting cluster with fsid: 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:46:36.737 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-14T15:46:37.053 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:46:42.103 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 --force --keep-logs 2024-05-14T15:46:42.421 INFO:teuthology.orchestra.run.smithi203.stdout:Deleting cluster with fsid: 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T15:46:47.541 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T15:46:47.634 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T15:46:47.728 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-14T15:46:47.811 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-14T15:46:47.813 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878/remote/smithi069/crash 2024-05-14T15:46:47.814 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/crash -- . 2024-05-14T15:46:47.937 INFO:teuthology.orchestra.run.smithi069.stderr:tar: /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-14T15:46:47.937 INFO:teuthology.orchestra.run.smithi069.stderr:tar: Error is not recoverable: exiting now 2024-05-14T15:46:47.941 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878/remote/smithi092/crash 2024-05-14T15:46:47.942 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/crash -- . 2024-05-14T15:46:48.050 INFO:teuthology.orchestra.run.smithi092.stderr:tar: /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-14T15:46:48.050 INFO:teuthology.orchestra.run.smithi092.stderr:tar: Error is not recoverable: exiting now 2024-05-14T15:46:48.055 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/crash to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878/remote/smithi203/crash 2024-05-14T15:46:48.056 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/crash -- . 2024-05-14T15:46:48.136 INFO:teuthology.orchestra.run.smithi203.stderr:tar: /var/lib/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/crash: Cannot open: No such file or directory 2024-05-14T15:46:48.137 INFO:teuthology.orchestra.run.smithi203.stderr:tar: Error is not recoverable: exiting now 2024-05-14T15:46:48.139 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-14T15:46:48.140 DEBUG:teuthology.orchestra.run.smithi069:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-05-14T15:46:48.307 INFO:teuthology.orchestra.run.smithi069.stdout:2024-05-14T15:23:06.049490+0000 mds.b (mds.0) 9 : cluster [WRN] Scrub error on inode 0x1000000001b (/volumes/qa/sv_0/29d788fd-95ff-4078-b97d-da43ceeacd66/postgres/data/pg_logical) see mds.b log and `damage ls` output for details 2024-05-14T15:46:48.309 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-05-14T15:46:48.309 INFO:tasks.cephadm:Compressing logs... 2024-05-14T15:46:48.309 DEBUG:teuthology.orchestra.run.smithi069:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-14T15:46:48.314 DEBUG:teuthology.orchestra.run.smithi092:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-14T15:46:48.322 DEBUG:teuthology.orchestra.run.smithi203:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-14T15:46:48.401 INFO:teuthology.orchestra.run.smithi069.stderr:find: ‘/var/log/rbd-target-api’gzip -5: No such file or directory --verbose 2024-05-14T15:46:48.401 INFO:teuthology.orchestra.run.smithi069.stderr: -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.log 2024-05-14T15:46:48.407 INFO:teuthology.orchestra.run.smithi203.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose: No such file or directory -- 2024-05-14T15:46:48.407 INFO:teuthology.orchestra.run.smithi203.stderr: /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.log 2024-05-14T15:46:48.408 INFO:teuthology.orchestra.run.smithi203.stderr:gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.2.log 2024-05-14T15:46:48.409 INFO:teuthology.orchestra.run.smithi069.stderr:gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.audit.log 2024-05-14T15:46:48.409 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.f.log 2024-05-14T15:46:48.410 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.g.log 2024-05-14T15:46:48.410 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.audit.log 2024-05-14T15:46:48.412 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.j.log 2024-05-14T15:46:48.412 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.5.log 2024-05-14T15:46:48.412 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.c.log 2024-05-14T15:46:48.413 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.3.log 2024-05-14T15:46:48.413 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mon.c.log 2024-05-14T15:46:48.413 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mgr.z.log 2024-05-14T15:46:48.414 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.0.log 2024-05-14T15:46:48.414 INFO:teuthology.orchestra.run.smithi069.stderr: 87.6% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.log.gz 2024-05-14T15:46:48.416 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mgr.x.log 2024-05-14T15:46:48.416 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mon.a.log 2024-05-14T15:46:48.416 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.i.log 2024-05-14T15:46:48.416 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mgr.z.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.cephadm.log 2024-05-14T15:46:48.416 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.11.log 2024-05-14T15:46:48.417 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.8.log 2024-05-14T15:46:48.418 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.6.log 2024-05-14T15:46:48.418 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.cephadm.log 2024-05-14T15:46:48.419 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.11.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-volume.log 2024-05-14T15:46:48.419 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.l.log 2024-05-14T15:46:48.420 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-14T15:46:48.420 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.a.log 2024-05-14T15:46:48.420 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-volume.log 2024-05-14T15:46:48.421 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.d.log 2024-05-14T15:46:48.422 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.9.log 2024-05-14T15:46:48.422 INFO:teuthology.orchestra.run.smithi069.stderr: 94.4% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.j.log.gz 2024-05-14T15:46:48.423 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-05-14T15:46:48.424 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-14T15:46:48.425 INFO:teuthology.orchestra.run.smithi203.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.l.log: /var/log/ceph/cephadm.log: 92.6% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mgr.z.log.gz 2024-05-14T15:46:48.425 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-05-14T15:46:48.429 INFO:teuthology.orchestra.run.smithi069.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.admin.log: 94.4% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.d.log.gz 2024-05-14T15:46:48.437 INFO:teuthology.orchestra.run.smithi069.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-05-14T15:46:48.444 INFO:teuthology.orchestra.run.smithi092.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-05-14T15:46:48.454 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.log 2024-05-14T15:46:48.456 INFO:teuthology.orchestra.run.smithi092.stderr:gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.audit.log 2024-05-14T15:46:48.457 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.7.log 2024-05-14T15:46:48.458 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.b.log 2024-05-14T15:46:48.460 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.4.log 2024-05-14T15:46:48.461 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.1.log 2024-05-14T15:46:48.462 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mgr.y.log 2024-05-14T15:46:48.463 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.h.log 2024-05-14T15:46:48.465 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.10.log 2024-05-14T15:46:48.466 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.cephadm.log 2024-05-14T15:46:48.467 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.10.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.e.log 2024-05-14T15:46:48.469 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-volume.log 2024-05-14T15:46:48.470 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mon.b.log 2024-05-14T15:46:48.471 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.k.log 2024-05-14T15:46:48.472 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-14T15:46:48.474 INFO:teuthology.orchestra.run.smithi092.stderr:/var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.k.log: /var/log/ceph/cephadm.log: 92.6% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mgr.y.log.gz 2024-05-14T15:46:48.545 INFO:teuthology.orchestra.run.smithi069.stderr: 83.9% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.cephadm.log.gz 2024-05-14T15:46:48.566 INFO:teuthology.orchestra.run.smithi069.stderr: 90.2% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.audit.log.gz 2024-05-14T15:46:48.600 INFO:teuthology.orchestra.run.smithi203.stderr: 83.6% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.cephadm.log.gz 2024-05-14T15:46:48.665 INFO:teuthology.orchestra.run.smithi092.stderr: 83.6% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.cephadm.log.gz 2024-05-14T15:46:48.688 INFO:teuthology.orchestra.run.smithi092.stderr: 90.4% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.audit.log.gz 2024-05-14T15:46:48.696 INFO:teuthology.orchestra.run.smithi203.stderr: 90.9% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-volume.log.gz 2024-05-14T15:46:48.760 INFO:teuthology.orchestra.run.smithi203.stderr: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-14T15:46:48.793 INFO:teuthology.orchestra.run.smithi069.stderr: 90.9% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-volume.log.gz 2024-05-14T15:46:48.812 INFO:teuthology.orchestra.run.smithi092.stderr: 87.6% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.log.gz 2024-05-14T15:46:48.865 INFO:teuthology.orchestra.run.smithi092.stderr: 90.9% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-volume.log.gz 2024-05-14T15:46:48.931 INFO:teuthology.orchestra.run.smithi092.stderr: 92.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-14T15:46:49.188 INFO:teuthology.orchestra.run.smithi069.stderr: 94.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-14T15:46:49.449 INFO:teuthology.orchestra.run.smithi203.stderr: 90.4% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.audit.log.gz 2024-05-14T15:46:49.462 INFO:teuthology.orchestra.run.smithi203.stderr: 87.6% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph.log.gz 2024-05-14T15:46:49.826 INFO:teuthology.orchestra.run.smithi203.stderr: 94.0% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.l.log.gz 2024-05-14T15:46:50.063 INFO:teuthology.orchestra.run.smithi069.stderr: 93.8% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.g.log.gz 2024-05-14T15:46:51.155 INFO:teuthology.orchestra.run.smithi069.stderr: 94.2% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.a.log.gz 2024-05-14T15:46:51.867 INFO:teuthology.orchestra.run.smithi092.stderr: 91.7% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mon.b.log.gz 2024-05-14T15:46:52.302 INFO:teuthology.orchestra.run.smithi069.stderr: 90.2% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mgr.x.log.gz 2024-05-14T15:46:52.468 INFO:teuthology.orchestra.run.smithi203.stderr: 94.2% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.c.log.gz 2024-05-14T15:46:52.855 INFO:teuthology.orchestra.run.smithi203.stderr: 91.7% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mon.c.log.gz 2024-05-14T15:46:55.189 INFO:teuthology.orchestra.run.smithi203.stderr: 95.6% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.f.log.gz 2024-05-14T15:47:00.477 INFO:teuthology.orchestra.run.smithi203.stderr: 93.7% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.i.log.gz 2024-05-14T15:47:02.637 INFO:teuthology.orchestra.run.smithi069.stderr: 90.2% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mon.a.log.gz 2024-05-14T15:47:05.890 INFO:teuthology.orchestra.run.smithi092.stderr: 94.0% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.e.log.gz 2024-05-14T15:47:13.504 INFO:teuthology.orchestra.run.smithi092.stderr: 94.0% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.k.log.gz 2024-05-14T15:47:32.753 INFO:teuthology.orchestra.run.smithi092.stderr: 93.5% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.b.log.gz 2024-05-14T15:47:51.077 INFO:teuthology.orchestra.run.smithi092.stderr: 95.2% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-mds.h.log.gz 2024-05-14T15:51:10.938 INFO:teuthology.orchestra.run.smithi092.stderr: 90.9% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.1.log.gz 2024-05-14T15:51:13.132 INFO:teuthology.orchestra.run.smithi092.stderr: 90.9% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.10.log.gz 2024-05-14T15:52:30.051 INFO:teuthology.orchestra.run.smithi092.stderr: 91.0% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.4.log.gz 2024-05-14T15:52:42.720 INFO:teuthology.orchestra.run.smithi092.stderr: 90.8% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.7.log.gz 2024-05-14T15:52:42.755 INFO:teuthology.orchestra.run.smithi092.stderr: 2024-05-14T15:52:42.755 INFO:teuthology.orchestra.run.smithi092.stderr:real 5m54.386s 2024-05-14T15:52:42.755 INFO:teuthology.orchestra.run.smithi092.stderr:user 9m29.159s 2024-05-14T15:52:42.755 INFO:teuthology.orchestra.run.smithi092.stderr:sys 1m2.528s 2024-05-14T15:53:18.537 INFO:teuthology.orchestra.run.smithi203.stderr: 90.9% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.8.log.gz 2024-05-14T15:55:55.428 INFO:teuthology.orchestra.run.smithi203.stderr: 90.9% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.11.log.gz 2024-05-14T15:56:05.916 INFO:teuthology.orchestra.run.smithi203.stderr: 90.9% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.2.log.gz 2024-05-14T15:57:00.330 INFO:teuthology.orchestra.run.smithi203.stderr: 90.8% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.5.log.gz 2024-05-14T15:57:00.353 INFO:teuthology.orchestra.run.smithi203.stderr: 2024-05-14T15:57:00.353 INFO:teuthology.orchestra.run.smithi203.stderr:real 10m11.982s 2024-05-14T15:57:00.353 INFO:teuthology.orchestra.run.smithi203.stderr:user 13m2.439s 2024-05-14T15:57:00.353 INFO:teuthology.orchestra.run.smithi203.stderr:sys 1m27.191s 2024-05-14T16:02:15.016 INFO:teuthology.orchestra.run.smithi069.stderr: 90.9% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.0.log.gz 2024-05-14T16:03:34.107 INFO:teuthology.orchestra.run.smithi069.stderr: 94.2% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-05-14T16:04:26.828 INFO:teuthology.orchestra.run.smithi069.stderr: 90.8% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.3.log.gz 2024-05-14T16:04:43.574 INFO:teuthology.orchestra.run.smithi069.stderr: 90.7% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.9.log.gz 2024-05-14T16:04:46.724 INFO:teuthology.orchestra.run.smithi069.stderr: 90.8% -- replaced with /var/log/ceph/1cc2580e-1203-11ef-bc98-c7b262605968/ceph-osd.6.log.gz 2024-05-14T16:04:46.734 INFO:teuthology.orchestra.run.smithi069.stderr: 2024-05-14T16:04:46.735 INFO:teuthology.orchestra.run.smithi069.stderr:real 17m58.378s 2024-05-14T16:04:46.735 INFO:teuthology.orchestra.run.smithi069.stderr:user 22m33.042s 2024-05-14T16:04:46.735 INFO:teuthology.orchestra.run.smithi069.stderr:sys 2m46.919s 2024-05-14T16:04:46.736 INFO:tasks.cephadm:Archiving logs... 2024-05-14T16:04:46.736 DEBUG:teuthology.misc:Transferring archived files from smithi069:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878/remote/smithi069/log 2024-05-14T16:04:46.738 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-14T16:06:08.502 DEBUG:teuthology.misc:Transferring archived files from smithi092:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878/remote/smithi092/log 2024-05-14T16:06:08.503 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-14T16:07:03.013 DEBUG:teuthology.misc:Transferring archived files from smithi203:/var/log/ceph to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878/remote/smithi203/log 2024-05-14T16:07:03.014 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-14T16:08:08.997 INFO:tasks.cephadm:Removing cluster... 2024-05-14T16:08:08.998 DEBUG:teuthology.orchestra.run.smithi069:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 --force 2024-05-14T16:08:09.811 INFO:teuthology.orchestra.run.smithi069.stdout:Deleting cluster with fsid: 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T16:08:11.715 DEBUG:teuthology.orchestra.run.smithi092:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 --force 2024-05-14T16:08:12.253 INFO:teuthology.orchestra.run.smithi092.stdout:Deleting cluster with fsid: 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T16:08:13.993 DEBUG:teuthology.orchestra.run.smithi203:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 1cc2580e-1203-11ef-bc98-c7b262605968 --force 2024-05-14T16:08:14.418 INFO:teuthology.orchestra.run.smithi203.stdout:Deleting cluster with fsid: 1cc2580e-1203-11ef-bc98-c7b262605968 2024-05-14T16:08:16.318 INFO:tasks.cephadm:Removing cephadm ... 2024-05-14T16:08:16.319 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-14T16:08:16.433 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-14T16:08:16.491 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-14T16:08:16.550 INFO:tasks.cephadm:Teardown complete 2024-05-14T16:08:16.550 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-14T16:08:16.562 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_1ae7ad82388e92a475afff437d49054826c019a1/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/git.ceph.com_ceph-c_e2b755a64f0d72176b57299d02e880cf0620d780/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-05-14T16:08:16.563 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-14T16:08:16.563 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-14T16:08:16.572 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-14T16:08:16.581 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-14T16:08:16.778 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-14T16:08:16.793 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-14T16:08:16.794 DEBUG:teuthology.orchestra.run.smithi069:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T16:08:16.802 DEBUG:teuthology.orchestra.run.smithi092:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T16:08:16.809 DEBUG:teuthology.orchestra.run.smithi203:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-14T16:08:16.848 INFO:teuthology.orchestra.run.smithi069.stderr:bash: line 1: ntpq: command not found 2024-05-14T16:08:16.856 INFO:teuthology.orchestra.run.smithi092.stderr:bash: line 1: ntpq: command not found 2024-05-14T16:08:16.863 INFO:teuthology.orchestra.run.smithi203.stderr:bash: line 1: ntpq: command not found 2024-05-14T16:08:16.962 INFO:teuthology.orchestra.run.smithi069.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T16:08:16.962 INFO:teuthology.orchestra.run.smithi069.stdout:=============================================================================== 2024-05-14T16:08:16.962 INFO:teuthology.orchestra.run.smithi069.stdout:^* hv01.front.sepia.ceph.com 3 6 377 6 +736us[ +748us] +/- 43ms 2024-05-14T16:08:16.962 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 10 -943us[ -931us] +/- 60ms 2024-05-14T16:08:16.963 INFO:teuthology.orchestra.run.smithi069.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 -62us[ -50us] +/- 81ms 2024-05-14T16:08:16.963 INFO:teuthology.orchestra.run.smithi069.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T16:08:16.993 INFO:teuthology.orchestra.run.smithi203.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T16:08:16.993 INFO:teuthology.orchestra.run.smithi203.stdout:=============================================================================== 2024-05-14T16:08:16.993 INFO:teuthology.orchestra.run.smithi203.stdout:^* hv01.front.sepia.ceph.com 3 6 377 5 +756us[ +786us] +/- 43ms 2024-05-14T16:08:16.993 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 5 -972us[ -972us] +/- 60ms 2024-05-14T16:08:16.993 INFO:teuthology.orchestra.run.smithi203.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 5 -82us[ -82us] +/- 81ms 2024-05-14T16:08:16.994 INFO:teuthology.orchestra.run.smithi203.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T16:08:16.994 INFO:teuthology.orchestra.run.smithi092.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-14T16:08:16.994 INFO:teuthology.orchestra.run.smithi092.stdout:=============================================================================== 2024-05-14T16:08:16.994 INFO:teuthology.orchestra.run.smithi092.stdout:^* hv01.front.sepia.ceph.com 3 6 377 8 +751us[ +753us] +/- 43ms 2024-05-14T16:08:16.994 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv02.front.sepia.ceph.com 3 8 377 133 -942us[ -932us] +/- 58ms 2024-05-14T16:08:16.994 INFO:teuthology.orchestra.run.smithi092.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 8 -57us[ -57us] +/- 81ms 2024-05-14T16:08:16.994 INFO:teuthology.orchestra.run.smithi092.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-05-14T16:08:16.998 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-14T16:08:17.009 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-14T16:08:17.010 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-14T16:08:17.025 DEBUG:teuthology.orchestra.run.smithi069:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-14T16:08:17.326 DEBUG:teuthology.orchestra.run.smithi092:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-14T16:08:17.577 DEBUG:teuthology.orchestra.run.smithi203:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-14T16:08:17.801 DEBUG:teuthology.orchestra.run.smithi069:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T16:08:17.898 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T16:08:17.898 DEBUG:teuthology.orchestra.run.smithi092:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T16:08:17.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T16:08:17.992 DEBUG:teuthology.orchestra.run.smithi203:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-05-14T16:08:18.085 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T16:08:18.086 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-14T16:08:18.098 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-14T16:08:18.110 INFO:teuthology.task.internal:Duration was 4395.601997 seconds 2024-05-14T16:08:18.110 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-14T16:08:18.122 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-14T16:08:18.122 DEBUG:teuthology.orchestra.run.smithi069:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-14T16:08:18.129 DEBUG:teuthology.orchestra.run.smithi092:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-14T16:08:18.137 DEBUG:teuthology.orchestra.run.smithi203:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-14T16:08:18.298 INFO:teuthology.orchestra.run.smithi069.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T16:08:18.307 INFO:teuthology.orchestra.run.smithi203.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T16:08:18.326 INFO:teuthology.orchestra.run.smithi092.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-14T16:08:18.821 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-14T16:08:18.821 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi069.front.sepia.ceph.com 2024-05-14T16:08:18.822 DEBUG:teuthology.orchestra.run.smithi069:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-14T16:08:18.897 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi092.front.sepia.ceph.com 2024-05-14T16:08:18.897 DEBUG:teuthology.orchestra.run.smithi092:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-14T16:08:18.973 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi203.front.sepia.ceph.com 2024-05-14T16:08:18.973 DEBUG:teuthology.orchestra.run.smithi203:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-14T16:08:19.053 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-14T16:08:19.053 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-14T16:08:19.062 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-14T16:08:19.071 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-14T16:08:19.163 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-14T16:08:19.163 DEBUG:teuthology.orchestra.run.smithi069:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-14T16:08:19.169 DEBUG:teuthology.orchestra.run.smithi092:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-14T16:08:19.174 DEBUG:teuthology.orchestra.run.smithi203:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-14T16:08:20.143 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-14T16:08:20.157 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-14T16:08:20.157 DEBUG:teuthology.orchestra.run.smithi069:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-14T16:08:20.241 DEBUG:teuthology.orchestra.run.smithi092:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-14T16:08:20.330 DEBUG:teuthology.orchestra.run.smithi203:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-14T16:08:20.420 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-14T16:08:20.433 DEBUG:teuthology.orchestra.run.smithi069:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-14T16:08:20.440 DEBUG:teuthology.orchestra.run.smithi092:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-14T16:08:20.448 DEBUG:teuthology.orchestra.run.smithi203:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-14T16:08:20.553 INFO:teuthology.orchestra.run.smithi069.stdout:kernel.core_pattern = core 2024-05-14T16:08:20.568 INFO:teuthology.orchestra.run.smithi203.stdout:kernel.core_pattern = core 2024-05-14T16:08:20.572 INFO:teuthology.orchestra.run.smithi092.stdout:kernel.core_pattern = core 2024-05-14T16:08:20.627 DEBUG:teuthology.orchestra.run.smithi069:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-14T16:08:20.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T16:08:20.679 DEBUG:teuthology.orchestra.run.smithi092:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-14T16:08:20.732 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T16:08:20.733 DEBUG:teuthology.orchestra.run.smithi203:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-14T16:08:20.786 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-14T16:08:20.787 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-14T16:08:20.799 INFO:teuthology.task.internal:Transferring archived files... 2024-05-14T16:08:20.802 DEBUG:teuthology.misc:Transferring archived files from smithi069:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878/remote/smithi069 2024-05-14T16:08:20.802 DEBUG:teuthology.orchestra.run.smithi069:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-14T16:08:20.923 DEBUG:teuthology.misc:Transferring archived files from smithi092:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878/remote/smithi092 2024-05-14T16:08:20.923 DEBUG:teuthology.orchestra.run.smithi092:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-14T16:08:21.023 DEBUG:teuthology.misc:Transferring archived files from smithi203:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878/remote/smithi203 2024-05-14T16:08:21.023 DEBUG:teuthology.orchestra.run.smithi203:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-14T16:08:21.115 INFO:teuthology.task.internal:Removing archive directory... 2024-05-14T16:08:21.116 DEBUG:teuthology.orchestra.run.smithi069:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-14T16:08:21.123 DEBUG:teuthology.orchestra.run.smithi092:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-14T16:08:21.130 DEBUG:teuthology.orchestra.run.smithi203:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-14T16:08:21.184 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-14T16:08:21.197 INFO:teuthology.task.internal:Not uploading archives. 2024-05-14T16:08:21.197 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-14T16:08:21.209 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-14T16:08:21.209 DEBUG:teuthology.orchestra.run.smithi069:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-14T16:08:21.216 DEBUG:teuthology.orchestra.run.smithi092:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-14T16:08:21.223 DEBUG:teuthology.orchestra.run.smithi203:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-14T16:08:21.266 INFO:teuthology.orchestra.run.smithi069.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 14 16:08 /home/ubuntu/cephtest 2024-05-14T16:08:21.273 INFO:teuthology.orchestra.run.smithi092.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 14 16:08 /home/ubuntu/cephtest 2024-05-14T16:08:21.276 INFO:teuthology.orchestra.run.smithi203.stdout: 393229 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 14 16:08 /home/ubuntu/cephtest 2024-05-14T16:08:21.279 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-14T16:08:21.291 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-14T16:08:21.304 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-05-14T16:08:21.304 INFO:teuthology.nuke:Checking targets against current locks 2024-05-14T16:08:21.331 DEBUG:teuthology.nuke:shortname: smithi069 2024-05-14T16:08:21.332 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T16:08:21.354 DEBUG:teuthology.nuke:shortname: smithi092 2024-05-14T16:08:21.354 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T16:08:21.358 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi069.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 14:45:26.170040', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFVTSATEondWaJSdgRY6kdk/ZTBWkk+ubUoyzp8T6nUPAAS9/lGJdNr6YpYY7QuWronnz1zShCj5icDrCXtKXx0='} 2024-05-14T16:08:21.375 DEBUG:teuthology.nuke:shortname: smithi203 2024-05-14T16:08:21.375 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-14T16:08:21.381 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi092.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 14:45:26.172007', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBJ6Nsr7eyxaj3OkHGBYHr8Z9HbsE2Cp2JkecWp4xZsntz3z1EQLl9H4IIlOihXD9cKGcoTslcQne5cF7XVkte3M='} 2024-05-14T16:08:21.398 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi203.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2024-05-14_07:04:04-fs-wip-vshankar-testing-20240509.053109-debug-testing-default-smithi/7705878', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-14 14:45:26.173776', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEUF+A+T1wRajnKCWp0bJUM9x42LNW5q7GoSE9gbZwpLoAIMEVwT1EafiPSLSdBsbVU9KtpgFwcNj4YxV+tDndI='} 2024-05-14T16:08:21.407 INFO:teuthology.orchestra.console.smithi069:Power off 2024-05-14T16:08:21.408 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-14T16:08:21.430 DEBUG:teuthology.orchestra.console.smithi069:power off output: Chassis Power Control: Down/Off 2024-05-14T16:08:21.431 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T16:08:21.446 INFO:teuthology.orchestra.console.smithi092:Power off 2024-05-14T16:08:21.446 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-14T16:08:21.458 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2024-05-14T16:08:21.468 DEBUG:teuthology.orchestra.console.smithi092:power off output: Chassis Power Control: Down/Off 2024-05-14T16:08:21.468 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T16:08:21.483 INFO:teuthology.orchestra.console.smithi203:Power off 2024-05-14T16:08:21.483 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-05-14T16:08:21.496 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2024-05-14T16:08:21.508 DEBUG:teuthology.orchestra.console.smithi203:power off output: Chassis Power Control: Down/Off 2024-05-14T16:08:21.508 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T16:08:21.530 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2024-05-14T16:08:25.459 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T16:08:25.497 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T16:08:25.531 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T16:08:25.570 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is on 2024-05-14T16:08:25.607 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2024-05-14T16:08:25.642 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2024-05-14T16:08:29.571 DEBUG:teuthology.orchestra.console.smithi069:pexpect command: ipmitool -H smithi069.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T16:08:29.608 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T16:08:29.643 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T16:08:29.683 DEBUG:teuthology.orchestra.console.smithi069:check power output: Chassis Power is off 2024-05-14T16:08:29.718 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is on 2024-05-14T16:08:29.755 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is on 2024-05-14T16:08:29.784 INFO:teuthology.orchestra.console.smithi069:Power off completed 2024-05-14T16:08:33.723 DEBUG:teuthology.orchestra.console.smithi092:pexpect command: ipmitool -H smithi092.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T16:08:33.756 DEBUG:teuthology.orchestra.console.smithi203:pexpect command: ipmitool -H smithi203.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-05-14T16:08:33.834 DEBUG:teuthology.orchestra.console.smithi092:check power output: Chassis Power is off 2024-05-14T16:08:33.865 DEBUG:teuthology.orchestra.console.smithi203:check power output: Chassis Power is off 2024-05-14T16:08:33.935 INFO:teuthology.orchestra.console.smithi092:Power off completed 2024-05-14T16:08:33.966 INFO:teuthology.orchestra.console.smithi203:Power off completed 2024-05-14T16:08:34.071 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/5 replication/always} standby-replay tasks/{0-subvolume/{with-namespace-isolated} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/no 6-workunit/postgres}} duration: 4395.601997375488 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default mon.a-kernel-sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e mon.b-kernel-sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e mon.c-kernel-sha1: fb9a6a44107e0b9f9ca2d9a78f2308f5dd49911e owner: scheduled_vshankar@teuthology status: fail success: false 2024-05-14T16:08:34.072 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-14T16:08:34.159 INFO:teuthology.run:FAIL